[2025-10-22T17:00:02.524473] [INFO ] [MAIN ] Using last completed trading day: 2025-10-22 [2025-10-22T17:00:02.698596] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-22T17:00:02.698791] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-22T17:00:02.803359] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-22T17:00:02.803740] [WARN ] [STATE ] State set to: RUNNING [2025-10-22T17:00:02.803828] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-22T17:00:02.803879] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-22T17:00:02.803958] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-22T17:00:02.803994] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-22T17:00:04.567954] [DEBUG] [SYMBOL ] Found 2419 valid NYSE symbols. [2025-10-22T17:00:04.568137] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-22T17:00:04.568419] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-22T17:00:04.568924] [INFO ] [LOCAL ] Symbols cache updated with 2367 symbols. [2025-10-22T17:00:04.568981] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-22T17:00:04.569015] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-22T17:00:04.569071] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-22T17:00:04.569103] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-22T17:00:04.569131] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-22T17:00:04.571437] [DEBUG] [LOCAL ] Found 2367 symbols in cached list. [2025-10-22T17:00:04.571576] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-22T17:00:04.571802] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-22T17:00:04.571859] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2367 valid symbols. [2025-10-22T17:00:04.571892] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-22T17:00:04.571924] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-22T17:00:04.597685] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-22T17:00:04.625304] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-22T17:00:04.625497] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-22T17:00:04.625534] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-22T17:00:04.625564] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-22T17:00:04.625624] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-22T17:00:04.626012] [DEBUG] [LOCAL ] Found 2367 symbols in cached list. [2025-10-22T17:00:04.626053] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-22T17:00:04.626085] [INFO ] [MAIN ] Starting incremental update for 2367 symbols. [2025-10-22T17:00:04.626114] [INFO ] [MAIN ] Running in parallel mode [2025-10-22T17:00:04.626296] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2367 symbols [2025-10-22T17:00:05.267876] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:05.315500] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:05.337053] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:05.345778] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-22T17:00:05.349731] [DEBUG] [LOCAL ] A: No existing data file found in primary storage. [2025-10-22T17:00:05.350883] [WARN ] [MAIN ] A: No existing data found, performing full refresh instead. [2025-10-22T17:00:05.360772] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-22T17:00:05.360941] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-22T17:00:05.370521] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-22T17:00:05.375503] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:05.376366] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-22T17:00:05.376702] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-22T17:00:05.376509] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-10-22T17:00:05.376847] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-22T17:00:05.376599] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-22T17:00:05.377081] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-22T17:00:05.377202] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-22T17:00:05.377467] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-22T17:00:05.389008] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-22T17:00:05.377332] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-22T17:00:05.398671] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-22T17:00:05.398771] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-22T17:00:06.076335] [DEBUG] [LOCAL ] AA: Loaded 53622 existing records from primary storage. [2025-10-22T17:00:06.164601] [INFO ] [MAIN ] AA: Loaded 53622 existing records. [2025-10-22T17:00:06.491020] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:06.517523] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-22T17:00:06.790164] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:06.813885] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:06.814224] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-22T17:00:06.814630] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-10-22T17:00:06.814381] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-22T17:00:06.818977] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:06.819473] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-22T17:00:06.819574] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-22T17:00:06.819420] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-22T17:00:07.182064] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:07.182424] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-22T17:00:07.220950] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-22T17:00:07.221986] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-22T17:00:07.489708] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-22T17:00:07.490618] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-22T17:00:07.835978] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-22T17:00:07.836913] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-22T17:00:08.139630] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T17:00:08.143544] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-10-22T17:00:08.226964] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-22T17:00:08.227947] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-22T17:00:08.471094] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-22T17:00:08.471972] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-22T17:00:08.600023] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T17:00:08.609619] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-22T17:00:08.772445] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-22T17:00:08.773286] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-22T17:00:08.851231] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-22T17:00:08.855062] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-10-22T17:00:09.074930] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T17:00:09.085321] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-22T17:00:09.094429] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-22T17:00:09.095247] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-22T17:00:09.366416] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-22T17:00:09.367458] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-22T17:00:09.616191] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-22T17:00:09.617068] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-22T17:00:09.826717] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-22T17:00:09.831991] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-10-22T17:00:09.918298] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:00:09.928076] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-22T17:00:10.005360] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-22T17:00:10.006070] [INFO ] [REMOTE ] AAM: Full fetch complete (916 records). [2025-10-22T17:00:10.006142] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-22T17:00:10.179881] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-10-22T17:00:10.180048] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:00:10.180117] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:00:10.180190] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-22T17:00:10.180256] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-22T17:00:10.180293] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-22T17:00:10.180332] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-22T17:00:10.180389] [INFO ] [MAIN ] Update Progress: 1/2367 symbols completed. AAM took 5.5s. Estimated remaining: 3h 39m 1s. Rate: 10.8 symbols/min [2025-10-22T17:00:10.344337] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:10.395771] [DEBUG] [LOCAL ] AAP: Loaded 51758 existing records from primary storage. [2025-10-22T17:00:10.396086] [INFO ] [MAIN ] AAP: Loaded 51758 existing records. [2025-10-22T17:00:10.570077] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:10.570271] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-22T17:00:10.570318] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-22T17:00:10.570702] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-22T17:00:10.570759] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-22T17:00:10.929723] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:10.930211] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-22T17:00:11.011119] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-22T17:00:11.021692] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-22T17:00:11.079217] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-22T17:00:11.086016] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-10-22T17:00:11.874091] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T17:00:11.884430] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-22T17:00:12.253894] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T17:00:12.259301] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-10-22T17:00:12.319989] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T17:00:12.329782] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-22T17:00:13.002268] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-22T17:00:13.013456] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-22T17:00:13.172762] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T17:00:13.177731] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-10-22T17:00:13.787092] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T17:00:13.799635] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-22T17:00:14.121511] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-22T17:00:14.127997] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-10-22T17:00:14.202962] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-22T17:00:14.212461] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-22T17:00:14.936907] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T17:00:14.948449] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-22T17:00:15.534690] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T17:00:15.540333] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-10-22T17:00:15.947057] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T17:00:15.964688] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-22T17:00:15.999427] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-22T17:00:16.010601] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-22T17:00:16.624598] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T17:00:16.635923] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-22T17:00:16.713811] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-22T17:00:16.720150] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-10. [2025-10-22T17:00:17.682500] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:00:17.693887] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-22T17:00:17.795147] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T17:00:17.806705] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-22T17:00:17.817917] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T17:00:17.821896] [INFO ] [REMOTE ] AAMI: Full fetch complete (33173 records). [2025-10-22T17:00:17.822017] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-10-22T17:00:18.201783] [DEBUG] [VALIDATOR ] AAMI: All expected trading days are present. [2025-10-22T17:00:18.201878] [DEBUG] [VALIDATOR ] AAMI: Primary data validation passed. [2025-10-22T17:00:18.202263] [INFO ] [MAIN ] AAMI: Fetched primary data is valid. [2025-10-22T17:00:18.202308] [DEBUG] [LOCAL ] AAMI: Saving primary data. [2025-10-22T17:00:18.203284] [DEBUG] [LOCAL ] AAMI: Trimmed 33173 records to 24441 (keeping 200 days of data) [2025-10-22T17:00:18.369953] [DEBUG] [LOCAL ] AAMI: Primary data saved (24441 records). [2025-10-22T17:00:18.370104] [INFO ] [MAIN ] AAMI: Full history saved. [2025-10-22T17:00:18.370184] [INFO ] [MAIN ] Update Progress: 2/2367 symbols completed. AAMI took 13.7s. Estimated remaining: 4h 30m 52s. Rate: 8.7 symbols/min [2025-10-22T17:00:18.542958] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:18.543170] [DEBUG] [LOCAL ] AAT: No existing data file found in primary storage. [2025-10-22T17:00:18.543239] [WARN ] [MAIN ] AAT: No existing data found, performing full refresh instead. [2025-10-22T17:00:18.543484] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-22T17:00:18.543555] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-22T17:00:18.543712] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-10-22T17:00:18.543844] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-22T17:00:18.879554] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-22T17:00:18.946807] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-22T17:00:18.950310] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:18.951549] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-22T17:00:19.426335] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T17:00:19.438013] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-22T17:00:19.563963] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-22T17:00:19.575512] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-22T17:00:20.237266] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-22T17:00:20.242986] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-22T17:00:21.088852] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T17:00:21.100052] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-22T17:00:21.143472] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-22T17:00:21.155786] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-22T17:00:21.256545] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T17:00:21.262921] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-22T17:00:21.298222] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T17:00:21.310534] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-22T17:00:22.402481] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T17:00:22.408826] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-22T17:00:22.706728] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T17:00:22.717967] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-22T17:00:22.797036] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T17:00:22.808566] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-22T17:00:23.223445] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-22T17:00:23.236548] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-22T17:00:23.804715] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T17:00:23.812191] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-22T17:00:24.377755] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T17:00:24.390885] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-22T17:00:24.578973] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T17:00:24.590690] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-22T17:00:24.684500] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-22T17:00:24.691207] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-22T17:00:24.968461] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T17:00:24.977332] [INFO ] [REMOTE ] A: Full fetch complete (73600 records). [2025-10-22T17:00:24.977494] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-22T17:00:25.372790] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-22T17:00:25.372882] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-22T17:00:25.373545] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-22T17:00:25.373596] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-22T17:00:25.375244] [DEBUG] [LOCAL ] A: Trimmed 73600 records to 50664 (keeping 200 days of data) [2025-10-22T17:00:25.706271] [DEBUG] [LOCAL ] A: Primary data saved (50664 records). [2025-10-22T17:00:25.706427] [INFO ] [MAIN ] A: Full history saved. [2025-10-22T17:00:25.706518] [INFO ] [MAIN ] Update Progress: 3/2367 symbols completed. A took 21.1s. Estimated remaining: 4h 36m 51s. Rate: 8.5 symbols/min [2025-10-22T17:00:25.896456] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:25.896916] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-22T17:00:25.897287] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-22T17:00:25.897513] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-22T17:00:25.897831] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-22T17:00:25.897950] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-22T17:00:25.916887] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-22T17:00:25.918977] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T17:00:26.002687] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-22T17:00:26.317968] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:00:26.381614] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-22T17:00:26.567264] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:26.567737] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-10-22T17:00:26.786467] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:00:26.786944] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-10-22T17:00:26.787043] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:00:26.787099] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-22T17:00:26.787468] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:00:26.787603] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-22T17:00:26.787819] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-22T17:00:26.787907] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-22T17:00:26.787964] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-22T17:00:26.788042] [INFO ] [MAIN ] Update Progress: 4/2367 symbols completed. AAUC took 1.1s. Estimated remaining: 3h 38m 12s. Rate: 10.8 symbols/min [2025-10-22T17:00:27.011580] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:27.013970] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-22T17:00:27.023249] [INFO ] [REMOTE ] AA: Full fetch complete (77733 records). [2025-10-22T17:00:27.023399] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-22T17:00:27.221721] [DEBUG] [LOCAL ] AB: Loaded 24859 existing records from primary storage. [2025-10-22T17:00:27.241025] [INFO ] [MAIN ] AB: Loaded 24859 existing records. [2025-10-22T17:00:27.587023] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-22T17:00:27.592279] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-22T17:00:27.624875] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-22T17:00:27.651195] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:27.651675] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-22T17:00:27.652189] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-22T17:00:27.652491] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-22T17:00:27.668623] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-22T17:00:27.668894] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-22T17:00:27.694829] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T17:00:27.747185] [DEBUG] [LOCAL ] AA: Trimmed 77733 records to 53622 (keeping 200 days of data) [2025-10-22T17:00:27.777945] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-22T17:00:28.273808] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:28.304948] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-22T17:00:28.420164] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T17:00:28.433442] [INFO ] [REMOTE ] AAP: Full fetch complete (75116 records). [2025-10-22T17:00:28.435774] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-22T17:00:28.738991] [DEBUG] [LOCAL ] AA: Primary data saved (53622 records). [2025-10-22T17:00:28.767248] [INFO ] [MAIN ] AA: Full history saved. [2025-10-22T17:00:28.778911] [INFO ] [MAIN ] Update Progress: 5/2367 symbols completed. AA took 24.1s. Estimated remaining: 3h 10m 10s. Rate: 12.4 symbols/min [2025-10-22T17:00:28.950940] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-22T17:00:28.956295] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-22T17:00:28.979536] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-22T17:00:28.979737] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-22T17:00:29.050517] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:29.067361] [DEBUG] [LOCAL ] AAP: Trimmed 75116 records to 51734 (keeping 200 days of data) [2025-10-22T17:00:29.068570] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-22T17:00:29.136014] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-22T17:00:29.421891] [DEBUG] [LOCAL ] ABBV: Loaded 53682 existing records from primary storage. [2025-10-22T17:00:29.428549] [INFO ] [MAIN ] ABBV: Loaded 53682 existing records. [2025-10-22T17:00:29.570969] [DEBUG] [LOCAL ] AAP: Primary data saved (51734 records). [2025-10-22T17:00:29.614087] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-22T17:00:29.644749] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:29.645684] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-22T17:00:29.645804] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-22T17:00:29.645529] [INFO ] [MAIN ] Update Progress: 6/2367 symbols completed. AAP took 19.5s. Estimated remaining: 2h 44m 5s. Rate: 14.4 symbols/min [2025-10-22T17:00:29.651447] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-22T17:00:29.691724] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-22T17:00:29.950220] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:30.053688] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T17:00:30.115923] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-22T17:00:30.211199] [DEBUG] [LOCAL ] ABCB: Loaded 30362 existing records from primary storage. [2025-10-22T17:00:30.242296] [INFO ] [MAIN ] ABCB: Loaded 30362 existing records. [2025-10-22T17:00:30.275211] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:30.280684] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-22T17:00:30.443700] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T17:00:30.484852] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:30.485394] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-22T17:00:30.485468] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-22T17:00:30.486091] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-22T17:00:30.486161] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-22T17:00:30.486045] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-22T17:00:30.836578] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:30.836935] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-22T17:00:31.703614] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T17:00:31.712193] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-22T17:00:32.023574] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T17:00:32.032331] [INFO ] [REMOTE ] AAT: Full fetch complete (43082 records). [2025-10-22T17:00:32.032569] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-22T17:00:32.369171] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T17:00:32.398603] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-22T17:00:32.464817] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-22T17:00:32.465025] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-22T17:00:32.465500] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-22T17:00:32.465683] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-22T17:00:32.466968] [DEBUG] [LOCAL ] AAT: Trimmed 43082 records to 30227 (keeping 200 days of data) [2025-10-22T17:00:32.619763] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-22T17:00:32.636668] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-22T17:00:32.699772] [DEBUG] [LOCAL ] AAT: Primary data saved (30227 records). [2025-10-22T17:00:32.699915] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-22T17:00:32.699987] [INFO ] [MAIN ] Update Progress: 7/2367 symbols completed. AAT took 14.3s. Estimated remaining: 2h 37m 45s. Rate: 15.0 symbols/min [2025-10-22T17:00:32.878276] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:32.927456] [DEBUG] [LOCAL ] ABEV: Loaded 53287 existing records from primary storage. [2025-10-22T17:00:32.927910] [INFO ] [MAIN ] ABEV: Loaded 53287 existing records. [2025-10-22T17:00:33.121732] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:33.121921] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-22T17:00:33.121969] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-22T17:00:33.122202] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-22T17:00:33.122258] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-22T17:00:33.524462] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:33.525234] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-22T17:00:33.527564] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T17:00:33.554074] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-22T17:00:33.555025] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T17:00:33.562319] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-22T17:00:34.544318] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T17:00:34.554458] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-22T17:00:35.267753] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T17:00:35.275300] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-22T17:00:35.305153] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T17:00:35.314117] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-22T17:00:35.528716] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T17:00:35.539182] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-22T17:00:36.325909] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T17:00:36.337561] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-22T17:00:36.557060] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-22T17:00:36.563610] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-22T17:00:36.592813] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T17:00:36.600751] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-22T17:00:36.965193] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T17:00:36.975083] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-22T17:00:37.602925] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T17:00:37.607612] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-22T17:00:37.798967] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-22T17:00:37.805276] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-22T17:00:38.422387] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T17:00:38.428307] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-22T17:00:38.502380] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-22T17:00:38.513953] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-22T17:00:38.600222] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T17:00:38.612362] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-22T17:00:39.045300] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T17:00:39.051207] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-22T17:00:39.549514] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-22T17:00:39.554797] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-22T17:00:40.449602] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T17:00:40.501301] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-22T17:00:40.515817] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T17:00:40.528749] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-22T17:00:40.533464] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-22T17:00:40.542124] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-22T17:00:40.836751] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T17:00:40.842339] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-22T17:00:41.627754] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T17:00:41.635392] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-22T17:00:42.067736] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T17:00:42.072303] [INFO ] [REMOTE ] AB: Full fetch complete (44104 records). [2025-10-22T17:00:42.072437] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-22T17:00:42.515136] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-22T17:00:42.517058] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-22T17:00:42.527487] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-22T17:00:42.528721] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-22T17:00:42.528813] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-22T17:00:42.529599] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-22T17:00:42.531472] [DEBUG] [LOCAL ] AB: Trimmed 44104 records to 24673 (keeping 200 days of data) [2025-10-22T17:00:42.674549] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T17:00:42.702957] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-22T17:00:42.719714] [DEBUG] [LOCAL ] AB: Primary data saved (24673 records). [2025-10-22T17:00:42.719791] [INFO ] [MAIN ] AB: Full history saved. [2025-10-22T17:00:42.719865] [INFO ] [MAIN ] Update Progress: 8/2367 symbols completed. AB took 15.9s. Estimated remaining: 3h 7m 13s. Rate: 12.6 symbols/min [2025-10-22T17:00:42.896039] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:42.896244] [DEBUG] [LOCAL ] ABG: No existing data file found in primary storage. [2025-10-22T17:00:42.896315] [WARN ] [MAIN ] ABG: No existing data found, performing full refresh instead. [2025-10-22T17:00:42.896583] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-22T17:00:42.896685] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-22T17:00:42.896810] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-10-22T17:00:42.896973] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-22T17:00:43.016933] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T17:00:43.047608] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-22T17:00:43.290671] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:43.290984] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-22T17:00:43.992165] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T17:00:44.002875] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-22T17:00:44.412827] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T17:00:44.417282] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-22T17:00:44.897357] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-22T17:00:44.909044] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-22T17:00:45.072272] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T17:00:45.075920] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-22T17:00:45.968242] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-22T17:00:45.979890] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-22T17:00:46.237326] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T17:00:46.242197] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-22T17:00:47.067850] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-22T17:00:47.079587] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-22T17:00:47.155188] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-22T17:00:47.161370] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-22T17:00:47.833693] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-22T17:00:47.845567] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-22T17:00:47.855536] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-22T17:00:47.859557] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-22T17:00:48.716617] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (5.67 seconds). [2025-10-22T17:00:48.722111] [INFO ] [REMOTE ] ABCB: Full fetch complete (44980 records). [2025-10-22T17:00:48.722201] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-22T17:00:49.038913] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-22T17:00:49.059129] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T17:00:49.151224] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-22T17:00:49.145711] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-22T17:00:49.163192] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-22T17:00:49.163841] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-22T17:00:49.164355] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-22T17:00:49.164516] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-22T17:00:49.166097] [DEBUG] [LOCAL ] ABCB: Trimmed 44980 records to 30308 (keeping 200 days of data) [2025-10-22T17:00:49.344722] [DEBUG] [LOCAL ] ABCB: Primary data saved (30308 records). [2025-10-22T17:00:49.344850] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-22T17:00:49.344954] [INFO ] [MAIN ] Update Progress: 9/2367 symbols completed. ABCB took 19.7s. Estimated remaining: 3h 15m 16s. Rate: 12.1 symbols/min [2025-10-22T17:00:49.514108] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:49.544110] [DEBUG] [LOCAL ] ABM: Loaded 32115 existing records from primary storage. [2025-10-22T17:00:49.544373] [INFO ] [MAIN ] ABM: Loaded 32115 existing records. [2025-10-22T17:00:49.725741] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:49.726110] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-22T17:00:49.726228] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-22T17:00:49.726428] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-22T17:00:49.726493] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-22T17:00:49.882506] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T17:00:50.052513] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-22T17:00:50.135334] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:50.135843] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-22T17:00:50.158505] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T17:00:50.167552] [INFO ] [REMOTE ] ABBV: Full fetch complete (77456 records). [2025-10-22T17:00:50.167742] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-22T17:00:50.168669] [FATAL] [VALIDATOR ] ABBV: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:00:50.168762] [FATAL] [MAIN ] ABBV: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:00:50.168837] [WARN ] [MAIN ] ABBV: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:00:50.168910] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-22T17:00:50.168972] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-22T17:00:50.169008] [INFO ] [LOCAL ] ABBV: Starting deletion of derivative data. [2025-10-22T17:00:50.169141] [DEBUG] [LOCAL ] ABBV: Deleted derivative data file. [2025-10-22T17:00:50.170996] [INFO ] [MAIN ] Update Progress: 10/2367 symbols completed. ABBV took 21.4s. Estimated remaining: 2h 58m 55s. Rate: 13.2 symbols/min [2025-10-22T17:00:50.339559] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:50.381215] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T17:00:50.386334] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-22T17:00:50.404180] [DEBUG] [LOCAL ] ABR: Loaded 51919 existing records from primary storage. [2025-10-22T17:00:50.404475] [INFO ] [MAIN ] ABR: Loaded 51919 existing records. [2025-10-22T17:00:50.578270] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:50.578459] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-22T17:00:50.578505] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-22T17:00:50.578717] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-22T17:00:50.578773] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-22T17:00:50.925754] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:50.926059] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-22T17:00:51.143852] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T17:00:51.149713] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-22T17:00:51.478558] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T17:00:51.483289] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-22T17:00:51.712248] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T17:00:51.721283] [INFO ] [REMOTE ] ABEV: Full fetch complete (77339 records). [2025-10-22T17:00:51.721410] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-22T17:00:52.116104] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-22T17:00:52.116272] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-22T17:00:52.117031] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-22T17:00:52.117114] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-22T17:00:52.118719] [DEBUG] [LOCAL ] ABEV: Trimmed 77339 records to 53284 (keeping 200 days of data) [2025-10-22T17:00:52.344995] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T17:00:52.351774] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-22T17:00:52.449251] [DEBUG] [LOCAL ] ABEV: Primary data saved (53284 records). [2025-10-22T17:00:52.449395] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-22T17:00:52.449496] [INFO ] [MAIN ] Update Progress: 11/2367 symbols completed. ABEV took 19.7s. Estimated remaining: 2h 50m 43s. Rate: 13.8 symbols/min [2025-10-22T17:00:52.537969] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T17:00:52.574447] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-22T17:00:52.639497] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:52.689746] [DEBUG] [LOCAL ] ABT: Loaded 53623 existing records from primary storage. [2025-10-22T17:00:52.690074] [INFO ] [MAIN ] ABT: Loaded 53623 existing records. [2025-10-22T17:00:52.866774] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:00:52.867144] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-22T17:00:52.867199] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-22T17:00:52.867448] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-22T17:00:52.882168] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-22T17:00:52.962191] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-22T17:00:53.004036] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-22T17:00:53.279195] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:53.279506] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-22T17:00:53.589444] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T17:00:53.592430] [INFO ] [REMOTE ] ABG: Full fetch complete (26737 records). [2025-10-22T17:00:53.592503] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-22T17:00:53.976740] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T17:00:53.976970] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-22T17:00:53.984117] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-22T17:00:53.983843] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-22T17:00:53.984458] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-22T17:00:53.984534] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-22T17:00:53.985931] [DEBUG] [LOCAL ] ABG: Trimmed 26737 records to 17859 (keeping 200 days of data) [2025-10-22T17:00:54.089722] [DEBUG] [LOCAL ] ABG: Primary data saved (17859 records). [2025-10-22T17:00:54.089847] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-22T17:00:54.089924] [INFO ] [MAIN ] Update Progress: 12/2367 symbols completed. ABG took 11.4s. Estimated remaining: 2h 41m 47s. Rate: 14.6 symbols/min [2025-10-22T17:00:54.255769] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:00:54.255910] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-22T17:00:54.255947] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-22T17:00:54.256067] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-22T17:00:54.256108] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-22T17:00:54.256149] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-22T17:00:54.256181] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-22T17:00:54.603241] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:00:54.603543] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-22T17:00:54.882772] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T17:00:54.892708] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-22T17:00:55.229720] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T17:00:55.240916] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-22T17:00:55.575840] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T17:00:55.583258] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-22T17:00:55.606677] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-22T17:00:55.611364] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-22T17:00:56.673538] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T17:00:56.679225] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-22T17:00:56.755128] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T17:00:56.761289] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-22T17:00:56.803779] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T17:00:56.815533] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-22T17:00:56.846463] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T17:00:56.857898] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-22T17:00:57.866865] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-22T17:00:57.873303] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-22T17:00:58.158607] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T17:00:58.165876] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-22T17:00:58.618019] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T17:00:58.629435] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-22T17:00:58.745155] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-22T17:00:58.756425] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-22T17:00:58.772995] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-22T17:00:58.779051] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-22T17:00:59.342732] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T17:00:59.351135] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-22T17:00:59.957587] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T17:00:59.966637] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-22T17:01:00.338996] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T17:01:00.346378] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-22T17:01:00.611925] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T17:01:00.623194] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-22T17:01:00.708479] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T17:01:00.719413] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-22T17:01:01.190991] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T17:01:01.195979] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-22T17:01:02.100729] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T17:01:02.109241] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-22T17:01:02.407577] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T17:01:02.413959] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-22T17:01:02.497587] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T17:01:02.509416] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-22T17:01:02.657129] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T17:01:02.667771] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-22T17:01:03.507734] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T17:01:03.513111] [INFO ] [REMOTE ] ABM: Full fetch complete (44797 records). [2025-10-22T17:01:03.513237] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-22T17:01:03.514189] [FATAL] [VALIDATOR ] ABM: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:01:03.514278] [FATAL] [MAIN ] ABM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:01:03.514321] [WARN ] [MAIN ] ABM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:01:03.514386] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-22T17:01:03.514450] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-22T17:01:03.514487] [INFO ] [LOCAL ] ABM: Starting deletion of derivative data. [2025-10-22T17:01:03.514630] [DEBUG] [LOCAL ] ABM: Deleted derivative data file. [2025-10-22T17:01:03.516107] [INFO ] [MAIN ] Update Progress: 13/2367 symbols completed. ABM took 14.2s. Estimated remaining: 2h 57m 44s. Rate: 13.2 symbols/min [2025-10-22T17:01:03.709009] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-22T17:01:03.712299] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:01:03.719104] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-22T17:01:03.760664] [DEBUG] [LOCAL ] ACCO: Loaded 36747 existing records from primary storage. [2025-10-22T17:01:03.760976] [INFO ] [MAIN ] ACCO: Loaded 36747 existing records. [2025-10-22T17:01:03.947994] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:01:03.948360] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-22T17:01:03.948600] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-22T17:01:03.948908] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-22T17:01:03.948958] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-22T17:01:04.324041] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:01:04.324489] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-22T17:01:04.362293] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T17:01:04.375554] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-22T17:01:04.707239] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-22T17:01:04.718979] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-22T17:01:04.753197] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T17:01:04.762396] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-22T17:01:05.782285] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T17:01:05.790415] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-22T17:01:05.832190] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T17:01:05.835592] [INFO ] [REMOTE ] ACA: Full fetch complete (34143 records). [2025-10-22T17:01:05.835697] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-22T17:01:05.836356] [FATAL] [VALIDATOR ] ACA: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:01:05.836479] [FATAL] [MAIN ] ACA: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:01:05.836521] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:01:05.836560] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-22T17:01:05.836627] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-22T17:01:05.836706] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-10-22T17:01:05.836761] [DEBUG] [LOCAL ] ACA: No derivative data file found to delete. [2025-10-22T17:01:05.836816] [INFO ] [MAIN ] Update Progress: 14/2367 symbols completed. ACA took 11.7s. Estimated remaining: 2h 51m 28s. Rate: 13.7 symbols/min [2025-10-22T17:01:06.002287] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:01:06.042229] [DEBUG] [LOCAL ] ACEL: Loaded 26474 existing records from primary storage. [2025-10-22T17:01:06.042486] [INFO ] [MAIN ] ACEL: Loaded 26474 existing records. [2025-10-22T17:01:06.224579] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:01:06.224834] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-22T17:01:06.224882] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-22T17:01:06.225308] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-22T17:01:06.225365] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-22T17:01:06.595750] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:01:06.596462] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-22T17:01:06.659075] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-22T17:01:06.661365] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T17:01:06.683278] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-22T17:01:07.122040] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T17:01:07.317681] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-22T17:01:07.828035] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T17:01:08.117692] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-22T17:01:08.590756] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T17:01:08.917735] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-22T17:01:09.039447] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T17:01:09.717796] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-22T17:01:09.768477] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T17:01:10.517773] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-22T17:01:10.772129] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T17:01:10.809165] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T17:01:11.317730] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-22T17:01:11.607062] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-22T17:01:12.117617] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-22T17:01:12.551707] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-22T17:01:12.917755] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-22T17:01:13.671235] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T17:01:13.717629] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-22T17:01:14.270743] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T17:01:14.517684] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-22T17:01:15.289485] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-22T17:01:15.318332] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-22T17:01:15.321373] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T17:01:15.320275] [INFO ] [REMOTE ] ABT: Full fetch complete (77771 records). [2025-10-22T17:01:15.329662] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-22T17:01:15.713326] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-22T17:01:15.713405] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-22T17:01:15.714121] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-22T17:01:15.714186] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-22T17:01:15.715766] [DEBUG] [LOCAL ] ABT: Trimmed 77771 records to 53624 (keeping 200 days of data) [2025-10-22T17:01:16.046627] [DEBUG] [LOCAL ] ABT: Primary data saved (53624 records). [2025-10-22T17:01:16.046830] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-22T17:01:16.046948] [INFO ] [MAIN ] Update Progress: 15/2367 symbols completed. ABT took 23.6s. Estimated remaining: 3h 6m 39s. Rate: 12.6 symbols/min [2025-10-22T17:01:16.122835] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-22T17:01:16.219919] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:01:16.220060] [DEBUG] [LOCAL ] ACHR: No existing data file found in primary storage. [2025-10-22T17:01:16.220097] [WARN ] [MAIN ] ACHR: No existing data found, performing full refresh instead. [2025-10-22T17:01:16.220206] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-22T17:01:16.220275] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-22T17:01:16.220348] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-22T17:01:16.220409] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-22T17:01:16.570229] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:01:16.917756] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-22T17:01:17.360386] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T17:01:17.368511] [INFO ] [REMOTE ] ABR: Full fetch complete (75039 records). [2025-10-22T17:01:17.368679] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-22T17:01:17.369493] [FATAL] [VALIDATOR ] ABR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:01:17.369580] [FATAL] [MAIN ] ABR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:01:17.369626] [WARN ] [MAIN ] ABR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:01:17.369749] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-22T17:01:17.369834] [DEBUG] [LOCAL ] ABR: No primary data file found to delete. [2025-10-22T17:01:17.369888] [INFO ] [LOCAL ] ABR: Starting deletion of derivative data. [2025-10-22T17:01:17.370036] [DEBUG] [LOCAL ] ABR: Deleted derivative data file. [2025-10-22T17:01:17.371096] [INFO ] [MAIN ] Update Progress: 16/2367 symbols completed. ABR took 27.2s. Estimated remaining: 2h 58m 9s. Rate: 13.2 symbols/min [2025-10-22T17:01:17.544017] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:01:17.582135] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T17:01:17.625142] [DEBUG] [LOCAL ] ACI: Loaded 53286 existing records from primary storage. [2025-10-22T17:01:17.625458] [INFO ] [MAIN ] ACI: Loaded 53286 existing records. [2025-10-22T17:01:17.722871] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-22T17:01:17.809552] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:01:17.809809] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-22T17:01:17.809873] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-22T17:01:17.810088] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-22T17:01:17.810145] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-22T17:01:18.244469] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:01:18.264880] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-22T17:01:18.517939] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-22T17:01:19.004752] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-22T17:01:19.317681] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-22T17:01:20.117629] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-22T17:01:20.305133] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T17:01:20.917702] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-22T17:01:21.460942] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-22T17:01:21.717639] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-22T17:01:21.887622] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-22T17:01:21.926343] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-22T17:01:22.517777] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-22T17:01:22.887457] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T17:01:22.893101] [INFO ] [REMOTE ] ACCO: Full fetch complete (53784 records). [2025-10-22T17:01:22.893248] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-22T17:01:22.894067] [FATAL] [VALIDATOR ] ACCO: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:01:22.894168] [FATAL] [MAIN ] ACCO: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:01:22.894212] [WARN ] [MAIN ] ACCO: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:01:22.894253] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-22T17:01:22.894325] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-10-22T17:01:22.894384] [INFO ] [LOCAL ] ACCO: Starting deletion of derivative data. [2025-10-22T17:01:22.894517] [DEBUG] [LOCAL ] ACCO: Deleted derivative data file. [2025-10-22T17:01:22.895256] [INFO ] [MAIN ] Update Progress: 17/2367 symbols completed. ACCO took 19.4s. Estimated remaining: 3h 0m 20s. Rate: 13.0 symbols/min [2025-10-22T17:01:23.071935] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:01:23.114823] [DEBUG] [LOCAL ] ACM: Loaded 42827 existing records from primary storage. [2025-10-22T17:01:23.115141] [INFO ] [MAIN ] ACM: Loaded 42827 existing records. [2025-10-22T17:01:23.297776] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:01:23.297969] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-22T17:01:23.298018] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-22T17:01:23.298206] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-22T17:01:23.298245] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-22T17:01:23.322873] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-22T17:01:23.669604] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:01:24.117685] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-22T17:01:24.534304] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T17:01:24.753939] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-22T17:01:24.917754] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-22T17:01:25.717678] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-22T17:01:25.797576] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T17:01:26.131276] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T17:01:26.517756] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-22T17:01:27.317696] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-22T17:01:27.420300] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T17:01:27.940097] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T17:01:28.117746] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-22T17:01:28.917748] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-22T17:01:29.660706] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T17:01:29.717731] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-22T17:01:29.866081] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-22T17:01:30.517774] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-22T17:01:30.746567] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T17:01:30.831956] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T17:01:31.317723] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-22T17:01:32.117760] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-22T17:01:32.794046] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T17:01:32.917741] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-22T17:01:32.999090] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-22T17:01:33.717751] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-22T17:01:33.904453] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T17:01:33.996432] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T17:01:34.001109] [INFO ] [REMOTE ] ACEL: Full fetch complete (38757 records). [2025-10-22T17:01:34.001292] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-22T17:01:34.392085] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-22T17:01:34.392211] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-22T17:01:34.392744] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-22T17:01:34.392846] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-22T17:01:34.394261] [DEBUG] [LOCAL ] ACEL: Trimmed 38757 records to 26346 (keeping 200 days of data) [2025-10-22T17:01:34.521409] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-22T17:01:34.562368] [DEBUG] [LOCAL ] ACEL: Primary data saved (26346 records). [2025-10-22T17:01:34.562577] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-22T17:01:34.562718] [INFO ] [MAIN ] Update Progress: 18/2367 symbols completed. ACEL took 28.7s. Estimated remaining: 3h 15m 37s. Rate: 12.0 symbols/min [2025-10-22T17:01:34.749870] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:01:34.807573] [DEBUG] [LOCAL ] ACN: Loaded 53440 existing records from primary storage. [2025-10-22T17:01:34.808076] [INFO ] [MAIN ] ACN: Loaded 53440 existing records. [2025-10-22T17:01:35.023227] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:01:35.023756] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-22T17:01:35.023842] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-22T17:01:35.024127] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-22T17:01:35.024217] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-22T17:01:35.322730] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-22T17:01:35.402765] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T17:01:35.496296] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:01:36.117797] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-22T17:01:36.917686] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-22T17:01:37.006965] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T17:01:37.082782] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-22T17:01:37.527360] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T17:01:37.717752] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-22T17:01:38.517795] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-22T17:01:38.920998] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T17:01:39.008220] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-22T17:01:39.317680] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-22T17:01:40.117678] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-22T17:01:40.214374] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T17:01:40.917697] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-22T17:01:40.948936] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T17:01:41.717687] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-22T17:01:42.019339] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-22T17:01:42.517738] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-22T17:01:43.317739] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-22T17:01:43.556295] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-22T17:01:43.641451] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T17:01:44.072330] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T17:01:44.117851] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-22T17:01:44.917739] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-22T17:01:45.239560] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T17:01:45.717935] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-22T17:01:46.517669] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-22T17:01:46.608367] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T17:01:46.869903] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-22T17:01:47.317947] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-22T17:01:47.529213] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T17:01:48.117936] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-22T17:01:48.605888] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-22T17:01:48.917751] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-22T17:01:49.377343] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-22T17:01:49.385987] [INFO ] [REMOTE ] ACM: Full fetch complete (63037 records). [2025-10-22T17:01:49.386231] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-22T17:01:49.387541] [FATAL] [VALIDATOR ] ACM: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:01:49.387638] [FATAL] [MAIN ] ACM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:01:49.387749] [WARN ] [MAIN ] ACM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:01:49.387814] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-22T17:01:49.387886] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-10-22T17:01:49.387936] [INFO ] [LOCAL ] ACM: Starting deletion of derivative data. [2025-10-22T17:01:49.388126] [DEBUG] [LOCAL ] ACM: Deleted derivative data file. [2025-10-22T17:01:49.388953] [INFO ] [MAIN ] Update Progress: 19/2367 symbols completed. ACM took 26.5s. Estimated remaining: 3h 35m 46s. Rate: 10.9 symbols/min [2025-10-22T17:01:49.569833] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:01:49.609100] [DEBUG] [LOCAL ] ACP: Loaded 31078 existing records from primary storage. [2025-10-22T17:01:49.609470] [INFO ] [MAIN ] ACP: Loaded 31078 existing records. [2025-10-22T17:01:49.721448] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-22T17:01:49.812338] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:01:49.812627] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-22T17:01:49.812714] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-22T17:01:49.812964] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-22T17:01:49.813006] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-22T17:01:50.200516] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:01:50.517792] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-22T17:01:50.651660] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T17:01:50.805257] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-22T17:01:51.317778] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-22T17:01:51.416078] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T17:01:51.425183] [INFO ] [REMOTE ] ACI: Full fetch complete (77233 records). [2025-10-22T17:01:51.425346] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-22T17:01:51.839513] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-22T17:01:51.839698] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-22T17:01:51.840474] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-22T17:01:51.840566] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-22T17:01:51.843060] [DEBUG] [LOCAL ] ACI: Trimmed 77233 records to 53286 (keeping 200 days of data) [2025-10-22T17:01:51.967856] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T17:01:52.129310] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-22T17:01:52.209966] [DEBUG] [LOCAL ] ACI: Primary data saved (53286 records). [2025-10-22T17:01:52.210126] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-22T17:01:52.211162] [INFO ] [MAIN ] Update Progress: 20/2367 symbols completed. ACI took 34.8s. Estimated remaining: 3h 30m 25s. Rate: 11.2 symbols/min [2025-10-22T17:01:52.381749] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:01:52.381943] [DEBUG] [LOCAL ] ACR: No existing data file found in primary storage. [2025-10-22T17:01:52.381983] [WARN ] [MAIN ] ACR: No existing data found, performing full refresh instead. [2025-10-22T17:01:52.382093] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-22T17:01:52.382134] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-22T17:01:52.382177] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-22T17:01:52.382210] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-22T17:01:52.737848] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:01:52.917745] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-22T17:01:53.121472] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:01:53.389679] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-22T17:01:53.717758] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-22T17:01:54.517767] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-22T17:01:55.013961] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T17:01:55.199582] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-22T17:01:55.317807] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-22T17:01:55.444179] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-22T17:01:55.721024] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-22T17:01:56.117675] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-22T17:01:56.917782] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-22T17:01:57.717737] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-22T17:01:58.517795] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-22T17:01:58.534677] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T17:01:59.067965] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-22T17:01:59.111714] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.99 seconds). [2025-10-22T17:01:59.122415] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-22T17:01:59.122616] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-22T17:01:59.322677] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-22T17:01:59.580926] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-22T17:01:59.581046] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-22T17:01:59.581855] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-22T17:01:59.581931] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-22T17:01:59.583727] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-10-22T17:01:59.924019] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-10-22T17:01:59.924327] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-22T17:01:59.924546] [INFO ] [MAIN ] Update Progress: 21/2367 symbols completed. ACHR took 43.9s. Estimated remaining: 3h 34m 40s. Rate: 10.9 symbols/min [2025-10-22T17:02:00.106047] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T17:02:00.127202] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-22T17:02:00.169722] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:00.170063] [DEBUG] [LOCAL ] ACRE: No existing data file found in primary storage. [2025-10-22T17:02:00.170143] [WARN ] [MAIN ] ACRE: No existing data found, performing full refresh instead. [2025-10-22T17:02:00.176068] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T17:02:00.176556] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-22T17:02:00.179235] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-22T17:02:00.179321] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-10-22T17:02:00.179360] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-22T17:02:00.540688] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:00.917769] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-22T17:02:01.717753] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-22T17:02:02.148781] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-22T17:02:02.172289] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-22T17:02:02.517700] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-22T17:02:02.703953] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T17:02:03.119262] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-22T17:02:03.317732] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-22T17:02:03.881300] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T17:02:04.117746] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-22T17:02:04.917736] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-22T17:02:05.612034] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-22T17:02:05.717740] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-22T17:02:05.974572] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T17:02:06.517699] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-22T17:02:07.226616] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T17:02:07.317749] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-22T17:02:07.430490] [DEBUG] [REMOTE ] ACP: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-22T17:02:07.430867] [WARN ] [REMOTE ] ACP: No data returned for month 2025-06 [2025-10-22T17:02:07.430975] [FATAL] [REMOTE ] ACP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:02:07.431101] [FATAL] [MAIN ] ACP: Failed to fetch primary data. [2025-10-22T17:02:07.431203] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:02:07.431294] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-22T17:02:07.431379] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-22T17:02:07.431433] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-10-22T17:02:07.431580] [DEBUG] [LOCAL ] ACP: Deleted derivative data file. [2025-10-22T17:02:07.432298] [INFO ] [MAIN ] Update Progress: 22/2367 symbols completed. ACP took 18.0s. Estimated remaining: 3h 38m 10s. Rate: 10.7 symbols/min [2025-10-22T17:02:07.614218] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:07.625048] [DEBUG] [LOCAL ] ACV: Loaded 7423 existing records from primary storage. [2025-10-22T17:02:07.625263] [INFO ] [MAIN ] ACV: Loaded 7423 existing records. [2025-10-22T17:02:07.816954] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:02:07.817531] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-22T17:02:07.817799] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-22T17:02:07.818049] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-22T17:02:07.818403] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-22T17:02:08.026084] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T17:02:08.124569] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-22T17:02:08.244181] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:08.789682] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-22T17:02:08.917695] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-22T17:02:09.717696] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-22T17:02:10.241265] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T17:02:10.509301] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T17:02:10.517618] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-22T17:02:11.146485] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-22T17:02:11.317755] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-22T17:02:12.117694] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-22T17:02:12.704421] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T17:02:12.917701] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-22T17:02:13.061490] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T17:02:13.717693] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-22T17:02:14.517744] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-22T17:02:14.538625] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T17:02:14.973511] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-22T17:02:14.982791] [INFO ] [REMOTE ] ACN: Full fetch complete (77023 records). [2025-10-22T17:02:14.982983] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-22T17:02:14.984168] [FATAL] [VALIDATOR ] ACN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:02:14.984283] [FATAL] [MAIN ] ACN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:02:14.984347] [WARN ] [MAIN ] ACN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:02:14.984391] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-22T17:02:14.984627] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-10-22T17:02:14.984705] [INFO ] [LOCAL ] ACN: Starting deletion of derivative data. [2025-10-22T17:02:14.984872] [DEBUG] [LOCAL ] ACN: Deleted derivative data file. [2025-10-22T17:02:14.986772] [INFO ] [MAIN ] Update Progress: 23/2367 symbols completed. ACN took 40.4s. Estimated remaining: 3h 41m 25s. Rate: 10.6 symbols/min [2025-10-22T17:02:15.164031] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:15.192261] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-22T17:02:15.193541] [INFO ] [REMOTE ] ACR: Full fetch complete (8559 records). [2025-10-22T17:02:15.193627] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-22T17:02:15.329284] [DEBUG] [LOCAL ] ACVA: Loaded 49262 existing records from primary storage. [2025-10-22T17:02:15.327824] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-22T17:02:15.340752] [INFO ] [MAIN ] ACVA: Loaded 49262 existing records. [2025-10-22T17:02:15.736806] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:02:15.747341] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-22T17:02:15.771799] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-22T17:02:15.815195] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-22T17:02:15.815408] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-22T17:02:15.815499] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-22T17:02:15.860398] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-22T17:02:15.894140] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-22T17:02:15.911043] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-22T17:02:15.923124] [DEBUG] [LOCAL ] ACR: Trimmed 8559 records to 5310 (keeping 200 days of data) [2025-10-22T17:02:16.084178] [DEBUG] [LOCAL ] ACR: Primary data saved (5310 records). [2025-10-22T17:02:16.115449] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-22T17:02:16.120691] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-22T17:02:16.138863] [INFO ] [MAIN ] Update Progress: 24/2367 symbols completed. ACR took 23.9s. Estimated remaining: 3h 33m 59s. Rate: 10.9 symbols/min [2025-10-22T17:02:16.278730] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:16.304905] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T17:02:16.404600] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:16.404812] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-22T17:02:16.404856] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-22T17:02:16.404995] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-22T17:02:16.405037] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-22T17:02:16.405079] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-22T17:02:16.405112] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-22T17:02:16.767475] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:16.917744] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-10-22T17:02:17.139725] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:02:17.140072] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-10-22T17:02:17.140186] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:02:17.140277] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-22T17:02:17.140352] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:02:17.140618] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-22T17:02:17.140727] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-22T17:02:17.140775] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-22T17:02:17.140818] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-22T17:02:17.140868] [INFO ] [MAIN ] Update Progress: 25/2367 symbols completed. AD took 1.0s. Estimated remaining: 3h 26m 54s. Rate: 11.3 symbols/min [2025-10-22T17:02:17.348520] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:17.405196] [DEBUG] [LOCAL ] ADC: Loaded 46430 existing records from primary storage. [2025-10-22T17:02:17.405801] [INFO ] [MAIN ] ADC: Loaded 46430 existing records. [2025-10-22T17:02:17.599238] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:02:17.599545] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-22T17:02:17.599618] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-22T17:02:17.599975] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-22T17:02:17.600033] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-22T17:02:17.717672] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-22T17:02:17.719538] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-22T17:02:17.990179] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:18.157981] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-22T17:02:18.517735] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-22T17:02:19.317737] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-22T17:02:19.971752] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T17:02:20.117786] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-22T17:02:20.256012] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T17:02:20.917889] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-22T17:02:20.970299] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-22T17:02:21.717693] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-22T17:02:22.525245] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-22T17:02:22.543843] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T17:02:23.271412] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T17:02:23.317674] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-22T17:02:23.340370] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T17:02:24.117847] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-22T17:02:24.631977] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T17:02:24.917681] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-22T17:02:25.602490] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T17:02:25.717608] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-22T17:02:26.252461] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T17:02:26.517747] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-22T17:02:27.320115] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-22T17:02:27.322472] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-22T17:02:27.897567] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T17:02:28.117678] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-22T17:02:28.917899] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-22T17:02:28.965444] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T17:02:29.717744] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-22T17:02:29.739199] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-22T17:02:29.742304] [INFO ] [REMOTE ] ACV: Full fetch complete (10409 records). [2025-10-22T17:02:29.742404] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-22T17:02:29.743096] [FATAL] [VALIDATOR ] ACV: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:02:29.743191] [FATAL] [MAIN ] ACV: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:02:29.743264] [WARN ] [MAIN ] ACV: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:02:29.743351] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-22T17:02:29.743425] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-22T17:02:29.743464] [INFO ] [LOCAL ] ACV: Starting deletion of derivative data. [2025-10-22T17:02:29.743629] [DEBUG] [LOCAL ] ACV: Deleted derivative data file. [2025-10-22T17:02:29.743749] [INFO ] [MAIN ] Update Progress: 26/2367 symbols completed. ACV took 22.3s. Estimated remaining: 3h 37m 46s. Rate: 10.7 symbols/min [2025-10-22T17:02:29.923325] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:29.958941] [DEBUG] [LOCAL ] ADCT: Loaded 35445 existing records from primary storage. [2025-10-22T17:02:29.959236] [INFO ] [MAIN ] ADCT: Loaded 35445 existing records. [2025-10-22T17:02:30.145589] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:02:30.170378] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-22T17:02:30.173277] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-22T17:02:30.175052] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T17:02:30.175100] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-22T17:02:30.185249] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-22T17:02:30.547984] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-22T17:02:30.558787] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:30.839028] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-22T17:02:31.317682] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-22T17:02:32.099379] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T17:02:32.117619] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-22T17:02:32.773404] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T17:02:32.779158] [INFO ] [REMOTE ] ACRE: Full fetch complete (49478 records). [2025-10-22T17:02:32.779303] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-22T17:02:32.922867] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-22T17:02:33.198931] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-22T17:02:33.199027] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-22T17:02:33.199567] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-22T17:02:33.199615] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-22T17:02:33.200862] [DEBUG] [LOCAL ] ACRE: Trimmed 49478 records to 33223 (keeping 200 days of data) [2025-10-22T17:02:33.413225] [DEBUG] [LOCAL ] ACRE: Primary data saved (33223 records). [2025-10-22T17:02:33.413386] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-22T17:02:33.413477] [INFO ] [MAIN ] Update Progress: 27/2367 symbols completed. ACRE took 33.5s. Estimated remaining: 3h 34m 55s. Rate: 10.9 symbols/min [2025-10-22T17:02:33.598109] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:33.645112] [DEBUG] [LOCAL ] ADM: Loaded 53400 existing records from primary storage. [2025-10-22T17:02:33.645462] [INFO ] [MAIN ] ADM: Loaded 53400 existing records. [2025-10-22T17:02:33.718815] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-22T17:02:33.825812] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:02:33.826285] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-22T17:02:33.826391] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-22T17:02:33.826635] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-22T17:02:33.826731] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-22T17:02:34.124389] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-22T17:02:34.222171] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:34.517689] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-22T17:02:34.543367] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:02:35.317779] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-22T17:02:35.548414] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T17:02:35.624889] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T17:02:36.117741] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-22T17:02:36.917639] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-22T17:02:37.197288] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T17:02:37.729195] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-22T17:02:37.732256] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T17:02:37.888717] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T17:02:38.517758] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-22T17:02:39.317727] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-22T17:02:39.646785] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-22T17:02:39.822560] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-22T17:02:40.117760] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-22T17:02:40.792208] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T17:02:40.917760] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-22T17:02:41.717635] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-22T17:02:42.033531] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T17:02:42.104040] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-22T17:02:42.517746] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-22T17:02:43.243798] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T17:02:43.317743] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-22T17:02:44.117689] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-22T17:02:44.321522] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T17:02:44.915785] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T17:02:44.924571] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-22T17:02:45.717693] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-22T17:02:45.840489] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T17:02:46.219303] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-22T17:02:46.517773] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-22T17:02:47.086633] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T17:02:47.317719] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-22T17:02:48.117802] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-22T17:02:48.577919] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-22T17:02:48.609850] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T17:02:48.917696] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-22T17:02:49.717688] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-22T17:02:49.808530] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T17:02:49.820197] [INFO ] [REMOTE ] ACVA: Full fetch complete (70689 records). [2025-10-22T17:02:49.820405] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-22T17:02:49.821441] [FATAL] [VALIDATOR ] ACVA: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:02:49.821561] [FATAL] [MAIN ] ACVA: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:02:49.821635] [WARN ] [MAIN ] ACVA: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:02:49.821757] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-22T17:02:49.821856] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-10-22T17:02:49.821909] [INFO ] [LOCAL ] ACVA: Starting deletion of derivative data. [2025-10-22T17:02:49.822092] [DEBUG] [LOCAL ] ACVA: Deleted derivative data file. [2025-10-22T17:02:49.822906] [INFO ] [MAIN ] Update Progress: 28/2367 symbols completed. ACVA took 34.8s. Estimated remaining: 3h 49m 60s. Rate: 10.2 symbols/min [2025-10-22T17:02:50.017970] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:50.018156] [DEBUG] [LOCAL ] ADNT: No existing data file found in primary storage. [2025-10-22T17:02:50.018198] [WARN ] [MAIN ] ADNT: No existing data found, performing full refresh instead. [2025-10-22T17:02:50.018317] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-22T17:02:50.018361] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-22T17:02:50.018404] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-10-22T17:02:50.018438] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-22T17:02:50.388894] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:50.517742] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-22T17:02:50.559690] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T17:02:50.567543] [INFO ] [REMOTE ] ADC: Full fetch complete (66361 records). [2025-10-22T17:02:50.567795] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-22T17:02:50.569204] [FATAL] [VALIDATOR ] ADC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:02:50.569309] [FATAL] [MAIN ] ADC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:02:50.569383] [WARN ] [MAIN ] ADC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:02:50.569477] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-22T17:02:50.569578] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-22T17:02:50.569635] [INFO ] [LOCAL ] ADC: Starting deletion of derivative data. [2025-10-22T17:02:50.569825] [DEBUG] [LOCAL ] ADC: Deleted derivative data file. [2025-10-22T17:02:50.570502] [INFO ] [MAIN ] Update Progress: 29/2367 symbols completed. ADC took 33.4s. Estimated remaining: 3h 42m 59s. Rate: 10.5 symbols/min [2025-10-22T17:02:50.739482] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:02:50.791242] [DEBUG] [LOCAL ] ADT: Loaded 53436 existing records from primary storage. [2025-10-22T17:02:50.791551] [INFO ] [MAIN ] ADT: Loaded 53436 existing records. [2025-10-22T17:02:50.976045] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:02:50.976446] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-22T17:02:50.976495] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-22T17:02:50.976990] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-22T17:02:50.977047] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-22T17:02:51.318527] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-22T17:02:51.358224] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:02:51.384334] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:02:51.870047] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T17:02:52.117667] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-22T17:02:52.917625] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-22T17:02:53.183497] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-22T17:02:53.717631] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-22T17:02:53.921096] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T17:02:54.380114] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T17:02:54.517738] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-22T17:02:55.152377] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T17:02:55.317749] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-22T17:02:56.117777] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-22T17:02:56.304743] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T17:02:56.922873] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-22T17:02:56.944723] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T17:02:57.217095] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T17:02:57.717777] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-22T17:02:58.477443] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T17:02:58.517678] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-22T17:02:59.317802] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-22T17:02:59.739923] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-22T17:02:59.863335] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T17:03:00.117689] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-22T17:03:00.613632] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-22T17:03:00.917673] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-22T17:03:01.717689] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-22T17:03:01.958934] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T17:03:02.382671] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T17:03:02.517685] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-22T17:03:03.243515] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T17:03:03.317797] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-22T17:03:03.788215] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-22T17:03:03.798438] [INFO ] [REMOTE ] ADM: Full fetch complete (77472 records). [2025-10-22T17:03:03.798682] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-22T17:03:03.903249] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T17:03:03.956190] [INFO ] [REMOTE ] ADCT: Full fetch complete (51466 records). [2025-10-22T17:03:03.974759] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-22T17:03:04.124886] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-22T17:03:04.562154] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-22T17:03:04.576286] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-22T17:03:04.589103] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-22T17:03:04.596776] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-22T17:03:04.642531] [DEBUG] [LOCAL ] ADM: Trimmed 77472 records to 53394 (keeping 200 days of data) [2025-10-22T17:03:04.810995] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-22T17:03:04.812139] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-22T17:03:04.825290] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-22T17:03:04.839425] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-22T17:03:04.846616] [DEBUG] [LOCAL ] ADCT: Trimmed 51466 records to 35462 (keeping 200 days of data) [2025-10-22T17:03:04.943392] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-22T17:03:05.249719] [DEBUG] [LOCAL ] ADM: Primary data saved (53394 records). [2025-10-22T17:03:05.250902] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-22T17:03:05.251313] [INFO ] [MAIN ] Update Progress: 30/2367 symbols completed. ADM took 31.8s. Estimated remaining: 3h 54m 31s. Rate: 10.0 symbols/min [2025-10-22T17:03:05.374947] [DEBUG] [LOCAL ] ADCT: Primary data saved (35462 records). [2025-10-22T17:03:05.396588] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-22T17:03:05.422270] [INFO ] [MAIN ] Update Progress: 31/2367 symbols completed. ADCT took 35.7s. Estimated remaining: 3h 47m 4s. Rate: 10.3 symbols/min [2025-10-22T17:03:05.447564] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:03:05.632251] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:03:05.641757] [DEBUG] [LOCAL ] ADX: Loaded 27734 existing records from primary storage. [2025-10-22T17:03:05.641972] [INFO ] [MAIN ] ADX: Loaded 27734 existing records. [2025-10-22T17:03:05.832611] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:03:05.844428] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-22T17:03:05.844617] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-22T17:03:05.844986] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-22T17:03:05.845043] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-22T17:03:06.029681] [DEBUG] [LOCAL ] AEE: Loaded 50107 existing records from primary storage. [2025-10-22T17:03:06.092722] [INFO ] [MAIN ] AEE: Loaded 50107 existing records. [2025-10-22T17:03:06.345301] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:03:06.397329] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-22T17:03:06.424884] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:03:06.425254] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-22T17:03:06.425465] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-22T17:03:06.426021] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-22T17:03:06.426107] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-22T17:03:06.559727] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-22T17:03:06.678969] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-22T17:03:06.862613] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-22T17:03:06.867322] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:03:07.317774] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-22T17:03:07.970458] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T17:03:08.117621] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-22T17:03:08.248166] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T17:03:08.871443] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T17:03:08.917626] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-22T17:03:09.368923] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T17:03:09.717677] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-22T17:03:10.477147] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T17:03:10.517670] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-22T17:03:11.317768] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-22T17:03:11.388199] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T17:03:12.117745] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-22T17:03:12.196758] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T17:03:12.917743] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-22T17:03:13.177929] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T17:03:13.717748] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-22T17:03:14.261158] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-22T17:03:14.517670] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-22T17:03:15.207756] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T17:03:15.317676] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-22T17:03:15.445474] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (3.33 seconds). [2025-10-22T17:03:16.117732] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-22T17:03:16.501256] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T17:03:16.826626] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T17:03:16.833277] [INFO ] [REMOTE ] ADNT: Full fetch complete (67511 records). [2025-10-22T17:03:16.833460] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-22T17:03:16.836843] [FATAL] [VALIDATOR ] ADNT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:03:16.836989] [FATAL] [MAIN ] ADNT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:03:16.837198] [WARN ] [MAIN ] ADNT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:03:16.837274] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-22T17:03:16.837339] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-10-22T17:03:16.837375] [INFO ] [LOCAL ] ADNT: Starting deletion of derivative data. [2025-10-22T17:03:16.837413] [DEBUG] [LOCAL ] ADNT: No derivative data file found to delete. [2025-10-22T17:03:16.837472] [INFO ] [MAIN ] Update Progress: 32/2367 symbols completed. ADNT took 27.0s. Estimated remaining: 3h 53m 45s. Rate: 10.0 symbols/min [2025-10-22T17:03:16.922771] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-22T17:03:17.018602] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:03:17.037213] [DEBUG] [LOCAL ] AEFC: Loaded 7734 existing records from primary storage. [2025-10-22T17:03:17.047053] [INFO ] [MAIN ] AEFC: Loaded 7734 existing records. [2025-10-22T17:03:17.080875] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-22T17:03:17.259316] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:03:17.259563] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-22T17:03:17.259610] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-22T17:03:17.260301] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-22T17:03:17.260358] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-22T17:03:17.615410] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:03:17.717616] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-22T17:03:18.512201] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T17:03:18.517608] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-22T17:03:18.762421] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T17:03:19.223909] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-22T17:03:19.317994] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-22T17:03:20.093084] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-22T17:03:20.117673] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-22T17:03:20.917748] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-22T17:03:21.717734] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-22T17:03:21.902195] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T17:03:22.329394] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T17:03:22.517666] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-22T17:03:23.317760] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-22T17:03:23.538375] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T17:03:23.612502] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-22T17:03:24.117688] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-22T17:03:24.632059] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-22T17:03:24.917687] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-22T17:03:25.576584] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-22T17:03:25.717627] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-22T17:03:26.121734] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T17:03:26.415466] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T17:03:26.517695] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-22T17:03:27.317688] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-22T17:03:28.122141] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-22T17:03:28.127758] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T17:03:28.917683] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-22T17:03:29.416121] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-22T17:03:29.428476] [INFO ] [REMOTE ] ADT: Full fetch complete (77364 records). [2025-10-22T17:03:29.428797] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-22T17:03:29.575721] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T17:03:29.722891] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-22T17:03:29.786278] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T17:03:29.905297] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-22T17:03:29.905426] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-22T17:03:29.906358] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-22T17:03:29.906433] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-22T17:03:29.908633] [DEBUG] [LOCAL ] ADT: Trimmed 77364 records to 53435 (keeping 200 days of data) [2025-10-22T17:03:30.248439] [DEBUG] [LOCAL ] ADT: Primary data saved (53435 records). [2025-10-22T17:03:30.248691] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-22T17:03:30.250188] [INFO ] [MAIN ] Update Progress: 33/2367 symbols completed. ADT took 39.7s. Estimated remaining: 4h 2m 23s. Rate: 9.6 symbols/min [2025-10-22T17:03:30.426189] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:03:30.477951] [DEBUG] [LOCAL ] AEG: Loaded 49601 existing records from primary storage. [2025-10-22T17:03:30.478440] [INFO ] [MAIN ] AEG: Loaded 49601 existing records. [2025-10-22T17:03:30.522940] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-22T17:03:30.674739] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:03:30.675119] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-22T17:03:30.675174] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-22T17:03:30.675476] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-22T17:03:30.675537] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-22T17:03:31.077105] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T17:03:31.082733] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:03:31.317781] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-22T17:03:32.065924] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-22T17:03:32.117662] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-22T17:03:32.476691] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T17:03:32.917741] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-22T17:03:33.415555] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T17:03:33.524687] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-22T17:03:33.717745] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-22T17:03:34.517740] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-22T17:03:35.317765] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-22T17:03:35.447426] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T17:03:35.765597] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T17:03:35.771319] [INFO ] [REMOTE ] ADX: Full fetch complete (41911 records). [2025-10-22T17:03:35.771583] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-22T17:03:36.122827] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-22T17:03:36.245871] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-22T17:03:36.245999] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-22T17:03:36.246591] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-22T17:03:36.246707] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-22T17:03:36.248758] [DEBUG] [LOCAL ] ADX: Trimmed 41911 records to 27644 (keeping 200 days of data) [2025-10-22T17:03:36.439823] [DEBUG] [LOCAL ] ADX: Primary data saved (27644 records). [2025-10-22T17:03:36.440084] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-22T17:03:36.440247] [INFO ] [MAIN ] Update Progress: 34/2367 symbols completed. ADX took 31.2s. Estimated remaining: 4h 2m 14s. Rate: 9.6 symbols/min [2025-10-22T17:03:36.693036] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:03:36.754879] [DEBUG] [LOCAL ] AEM: Loaded 53477 existing records from primary storage. [2025-10-22T17:03:36.755316] [INFO ] [MAIN ] AEM: Loaded 53477 existing records. [2025-10-22T17:03:36.895879] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-22T17:03:36.917991] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-22T17:03:36.934433] [INFO ] [REMOTE ] AEFC: Full fetch complete (11627 records). [2025-10-22T17:03:36.935393] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-22T17:03:36.961420] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:03:36.987353] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-22T17:03:37.076239] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-22T17:03:37.087682] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-22T17:03:37.093028] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-22T17:03:37.291781] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T17:03:37.718477] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-22T17:03:37.722799] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-22T17:03:37.722925] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-22T17:03:37.723663] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-22T17:03:37.729156] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-22T17:03:37.773262] [DEBUG] [LOCAL ] AEFC: Trimmed 11627 records to 7650 (keeping 200 days of data) [2025-10-22T17:03:37.814924] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:03:37.864367] [DEBUG] [LOCAL ] AEFC: Primary data saved (7650 records). [2025-10-22T17:03:37.864547] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-22T17:03:37.864690] [INFO ] [MAIN ] Update Progress: 35/2367 symbols completed. AEFC took 21.0s. Estimated remaining: 3h 56m 48s. Rate: 9.8 symbols/min [2025-10-22T17:03:38.054047] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:03:38.115425] [DEBUG] [LOCAL ] AEO: Loaded 53564 existing records from primary storage. [2025-10-22T17:03:38.115888] [INFO ] [MAIN ] AEO: Loaded 53564 existing records. [2025-10-22T17:03:38.327528] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:03:38.327892] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-22T17:03:38.327943] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-22T17:03:38.328487] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-22T17:03:38.328831] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-22T17:03:38.533442] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-22T17:03:38.748977] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-22T17:03:38.770816] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:03:39.061551] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-22T17:03:39.317756] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-22T17:03:40.117686] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-22T17:03:40.188662] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T17:03:40.879673] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T17:03:40.917730] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-22T17:03:41.717775] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-22T17:03:42.113207] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T17:03:42.122308] [INFO ] [REMOTE ] AEE: Full fetch complete (73021 records). [2025-10-22T17:03:42.122491] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-22T17:03:42.520070] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-22T17:03:42.539472] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-22T17:03:42.539773] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-22T17:03:42.540600] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-22T17:03:42.540893] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-22T17:03:42.572992] [DEBUG] [LOCAL ] AEE: Trimmed 73021 records to 50072 (keeping 200 days of data) [2025-10-22T17:03:42.574818] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T17:03:42.918029] [DEBUG] [LOCAL ] AEE: Primary data saved (50072 records). [2025-10-22T17:03:42.918382] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-22T17:03:42.919769] [INFO ] [MAIN ] Update Progress: 36/2367 symbols completed. AEE took 37.5s. Estimated remaining: 3h 55m 35s. Rate: 9.9 symbols/min [2025-10-22T17:03:43.100818] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:03:43.101237] [DEBUG] [LOCAL ] AER: No existing data file found in primary storage. [2025-10-22T17:03:43.101315] [WARN ] [MAIN ] AER: No existing data found, performing full refresh instead. [2025-10-22T17:03:43.101515] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-22T17:03:43.101718] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-22T17:03:43.101877] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-10-22T17:03:43.101988] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-22T17:03:43.318894] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-22T17:03:43.331447] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T17:03:43.531733] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:03:44.053146] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T17:03:44.117631] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-22T17:03:44.917736] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-22T17:03:45.292315] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T17:03:45.721835] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-22T17:03:45.730153] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T17:03:46.490031] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T17:03:46.517743] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-22T17:03:47.317729] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-22T17:03:47.711675] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T17:03:48.117775] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-22T17:03:48.294294] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T17:03:48.917740] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-22T17:03:48.992511] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T17:03:49.724395] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-22T17:03:49.731745] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-22T17:03:50.517701] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-22T17:03:50.899986] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-22T17:03:51.317760] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-22T17:03:51.581456] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T17:03:52.117749] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-22T17:03:52.522218] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T17:03:52.879275] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T17:03:52.917678] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-22T17:03:53.717673] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-22T17:03:54.020818] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T17:03:54.295687] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T17:03:54.517736] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-22T17:03:55.317680] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-22T17:03:55.584390] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-22T17:03:56.117695] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-22T17:03:56.454045] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T17:03:56.917667] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-22T17:03:57.037778] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T17:03:57.717722] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-22T17:03:58.517735] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-22T17:03:58.967188] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-22T17:03:59.317781] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-22T17:03:59.359751] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T17:03:59.494813] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (3.38 seconds). [2025-10-22T17:04:00.117757] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-22T17:04:00.299708] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T17:04:00.917750] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-22T17:04:01.143699] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T17:04:01.717776] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-22T17:04:02.395468] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-22T17:04:02.517747] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-22T17:04:02.648045] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T17:04:03.317742] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-22T17:04:03.834411] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-22T17:04:04.117752] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-22T17:04:04.560037] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T17:04:04.714349] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T17:04:04.917720] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-22T17:04:05.717739] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-22T17:04:05.763396] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T17:04:06.517681] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-22T17:04:06.897823] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T17:04:06.907029] [INFO ] [REMOTE ] AEG: Full fetch complete (70665 records). [2025-10-22T17:04:06.907308] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-22T17:04:07.319008] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-22T17:04:07.318763] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-22T17:04:07.320102] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-22T17:04:07.320879] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-22T17:04:07.320947] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-22T17:04:07.322983] [DEBUG] [LOCAL ] AEG: Trimmed 70665 records to 49558 (keeping 200 days of data) [2025-10-22T17:04:07.627221] [DEBUG] [LOCAL ] AEG: Primary data saved (49558 records). [2025-10-22T17:04:07.627412] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-22T17:04:07.629261] [INFO ] [MAIN ] Update Progress: 37/2367 symbols completed. AEG took 37.4s. Estimated remaining: 4h 15m 3s. Rate: 9.1 symbols/min [2025-10-22T17:04:07.865959] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-22T17:04:07.876542] [INFO ] [REMOTE ] AEM: Full fetch complete (77473 records). [2025-10-22T17:04:07.876831] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-22T17:04:08.280858] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-22T17:04:08.281130] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-22T17:04:08.282064] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-22T17:04:08.282133] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-22T17:04:08.284226] [DEBUG] [LOCAL ] AEM: Trimmed 77473 records to 53477 (keeping 200 days of data) [2025-10-22T17:04:08.660385] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-22T17:04:08.681708] [INFO ] [REMOTE ] AEO: Full fetch complete (77650 records). [2025-10-22T17:04:08.681849] [DEBUG] [LOCAL ] AEM: Primary data saved (53477 records). [2025-10-22T17:04:08.682326] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-22T17:04:08.682215] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-22T17:04:08.683553] [INFO ] [MAIN ] Update Progress: 38/2367 symbols completed. AEM took 32.2s. Estimated remaining: 4h 9m 18s. Rate: 9.3 symbols/min [2025-10-22T17:04:09.132244] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-22T17:04:09.132405] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-22T17:04:09.133561] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-22T17:04:09.133814] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-22T17:04:09.169307] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-22T17:04:09.166143] [DEBUG] [LOCAL ] AEO: Trimmed 77650 records to 53564 (keeping 200 days of data) [2025-10-22T17:04:09.181914] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-22T17:04:09.520317] [DEBUG] [LOCAL ] AEO: Primary data saved (53564 records). [2025-10-22T17:04:09.520523] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-22T17:04:09.521716] [INFO ] [MAIN ] Update Progress: 39/2367 symbols completed. AEO took 31.7s. Estimated remaining: 4h 3m 38s. Rate: 9.6 symbols/min [2025-10-22T17:04:11.768688] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-22T17:04:11.780602] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-22T17:04:13.402417] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-22T17:04:13.410385] [INFO ] [REMOTE ] AER: Full fetch complete (69939 records). [2025-10-22T17:04:13.410602] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-22T17:04:13.792841] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-22T17:04:13.792924] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-22T17:04:13.793561] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-22T17:04:13.793602] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-22T17:04:13.795479] [DEBUG] [LOCAL ] AER: Trimmed 69939 records to 47899 (keeping 200 days of data) [2025-10-22T17:04:14.084119] [DEBUG] [LOCAL ] AER: Primary data saved (47899 records). [2025-10-22T17:04:14.084278] [INFO ] [MAIN ] AER: Full history saved. [2025-10-22T17:04:14.084359] [INFO ] [MAIN ] Update Progress: 40/2367 symbols completed. AER took 31.2s. Estimated remaining: 4h 1m 52s. Rate: 9.6 symbols/min [2025-10-22T17:04:14.730339] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:14.728823] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:14.776275] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-22T17:04:14.778052] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:14.778312] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-22T17:04:14.807491] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-22T17:04:14.811833] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:14.812688] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-22T17:04:14.812871] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-22T17:04:14.812932] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-22T17:04:14.932471] [DEBUG] [LOCAL ] AFB: Loaded 11097 existing records from primary storage. [2025-10-22T17:04:14.964959] [INFO ] [MAIN ] AFB: Loaded 11097 existing records. [2025-10-22T17:04:15.281911] [DEBUG] [LOCAL ] AESI: Loaded 49822 existing records from primary storage. [2025-10-22T17:04:15.307499] [INFO ] [MAIN ] AESI: Loaded 49822 existing records. [2025-10-22T17:04:15.324412] [DEBUG] [LOCAL ] AES: Loaded 53665 existing records from primary storage. [2025-10-22T17:04:15.404152] [INFO ] [MAIN ] AES: Loaded 53665 existing records. [2025-10-22T17:04:15.571925] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:04:15.643066] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-22T17:04:15.698976] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:15.729498] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-10-22T17:04:15.729604] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-22T17:04:15.786848] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-22T17:04:15.817304] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-22T17:04:15.823177] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:04:15.860208] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-22T17:04:15.865475] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-22T17:04:15.913360] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-22T17:04:15.952921] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-22T17:04:16.043784] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:04:15.997160] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:04:16.054419] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-22T17:04:16.082575] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-22T17:04:16.134178] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-22T17:04:16.077314] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-10-22T17:04:16.153634] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-22T17:04:16.154058] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:04:16.236730] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-22T17:04:16.267274] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:04:16.281102] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-22T17:04:16.296697] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-22T17:04:16.302255] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-22T17:04:16.363638] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-22T17:04:16.368984] [INFO ] [MAIN ] Update Progress: 41/2367 symbols completed. AEXA took 2.3s. Estimated remaining: 3h 58m 2s. Rate: 9.8 symbols/min [2025-10-22T17:04:16.909153] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:16.960518] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-22T17:04:17.138806] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:17.185944] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:17.192254] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-22T17:04:17.287947] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:17.289525] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-22T17:04:17.316110] [DEBUG] [LOCAL ] AFG: Loaded 31884 existing records from primary storage. [2025-10-22T17:04:17.316428] [INFO ] [MAIN ] AFG: Loaded 31884 existing records. [2025-10-22T17:04:17.521572] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:04:17.521832] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-22T17:04:17.521900] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-22T17:04:17.522154] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-22T17:04:17.522218] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-22T17:04:17.907321] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:17.907732] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-22T17:04:17.973188] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T17:04:17.976227] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-22T17:04:18.488088] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-22T17:04:18.490914] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-22T17:04:18.960227] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T17:04:18.974540] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-22T17:04:19.002965] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T17:04:19.010141] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-22T17:04:19.323745] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T17:04:19.323255] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-22T17:04:19.339099] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-22T17:04:19.339968] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-22T17:04:20.286195] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T17:04:20.293694] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-22T17:04:20.321241] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T17:04:20.325616] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-22T17:04:20.495574] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T17:04:20.505176] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-22T17:04:21.155162] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-22T17:04:21.158115] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-22T17:04:21.220582] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T17:04:21.563509] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-22T17:04:21.717729] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-22T17:04:21.796870] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T17:04:22.353557] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T17:04:22.517690] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-22T17:04:23.317743] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-22T17:04:23.690946] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T17:04:23.872714] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T17:04:23.916941] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T17:04:24.117753] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-22T17:04:24.731409] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T17:04:24.917766] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-22T17:04:25.717724] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-22T17:04:26.387087] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T17:04:26.517728] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-22T17:04:27.317751] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-22T17:04:27.451545] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T17:04:27.972922] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-22T17:04:28.117769] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-22T17:04:28.718968] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T17:04:28.917753] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-22T17:04:29.717623] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-22T17:04:30.090092] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T17:04:30.473128] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-22T17:04:30.517613] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-22T17:04:30.637491] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T17:04:31.317690] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-22T17:04:32.117760] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-22T17:04:32.548396] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-22T17:04:32.865002] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T17:04:32.868850] [INFO ] [REMOTE ] AFB: Full fetch complete (16374 records). [2025-10-22T17:04:32.869198] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-22T17:04:32.922757] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-22T17:04:33.017855] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T17:04:33.292026] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-22T17:04:33.292114] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-22T17:04:33.292366] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-22T17:04:33.292409] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-22T17:04:33.293078] [DEBUG] [LOCAL ] AFB: Trimmed 16374 records to 11018 (keeping 200 days of data) [2025-10-22T17:04:33.358047] [DEBUG] [LOCAL ] AFB: Primary data saved (11018 records). [2025-10-22T17:04:33.358216] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-22T17:04:33.358328] [INFO ] [MAIN ] Update Progress: 42/2367 symbols completed. AFB took 19.3s. Estimated remaining: 4h 7m 56s. Rate: 9.4 symbols/min [2025-10-22T17:04:33.537443] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:33.542057] [DEBUG] [LOCAL ] AFGB: Loaded 2236 existing records from primary storage. [2025-10-22T17:04:33.542238] [INFO ] [MAIN ] AFGB: Loaded 2236 existing records. [2025-10-22T17:04:33.718105] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-22T17:04:33.717956] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:04:33.719358] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-22T17:04:33.719421] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-22T17:04:33.719558] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-22T17:04:33.719598] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-22T17:04:34.076832] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:34.429353] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T17:04:34.517748] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-22T17:04:35.317763] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-22T17:04:35.655703] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T17:04:35.777684] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-22T17:04:36.117692] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-22T17:04:36.917691] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-22T17:04:37.081533] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T17:04:37.494574] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T17:04:37.515309] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-22T17:04:37.717762] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-22T17:04:38.517764] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-22T17:04:39.317685] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-22T17:04:39.748352] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-22T17:04:39.821449] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-22T17:04:39.831729] [INFO ] [REMOTE ] AESI: Full fetch complete (71632 records). [2025-10-22T17:04:39.832017] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-22T17:04:40.117682] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-22T17:04:40.290415] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-22T17:04:40.290574] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-22T17:04:40.291611] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-22T17:04:40.291807] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-22T17:04:40.305613] [DEBUG] [LOCAL ] AESI: Trimmed 71632 records to 49817 (keeping 200 days of data) [2025-10-22T17:04:40.327459] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T17:04:40.653333] [DEBUG] [LOCAL ] AESI: Primary data saved (49817 records). [2025-10-22T17:04:40.653588] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-22T17:04:40.653749] [INFO ] [MAIN ] Update Progress: 43/2367 symbols completed. AESI took 26.6s. Estimated remaining: 4h 8m 38s. Rate: 9.3 symbols/min [2025-10-22T17:04:40.827336] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:40.827577] [DEBUG] [LOCAL ] AFGC: No existing data file found in primary storage. [2025-10-22T17:04:40.827623] [WARN ] [MAIN ] AFGC: No existing data found, performing full refresh instead. [2025-10-22T17:04:40.827824] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-22T17:04:40.827896] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-22T17:04:40.827971] [DEBUG] [LOCAL ] AFGC: No primary data file found to delete. [2025-10-22T17:04:40.828013] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-22T17:04:40.927340] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-22T17:04:41.215817] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:41.504100] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-22T17:04:41.584836] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-22T17:04:41.717738] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-22T17:04:42.517844] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-22T17:04:43.041317] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-22T17:04:43.317773] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-22T17:04:43.849865] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-22T17:04:44.117692] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-22T17:04:44.214483] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T17:04:44.606139] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-22T17:04:44.917681] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-22T17:04:45.521770] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-22T17:04:45.717739] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-22T17:04:46.188049] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-22T17:04:46.517676] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-22T17:04:47.317683] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-22T17:04:47.876664] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-22T17:04:47.961306] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T17:04:47.968046] [INFO ] [REMOTE ] AFG: Full fetch complete (46912 records). [2025-10-22T17:04:47.968190] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-22T17:04:48.124362] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-22T17:04:48.368199] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-22T17:04:48.368280] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-22T17:04:48.368778] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-22T17:04:48.368840] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-22T17:04:48.369791] [DEBUG] [LOCAL ] AFG: Trimmed 46912 records to 31910 (keeping 200 days of data) [2025-10-22T17:04:48.569440] [DEBUG] [LOCAL ] AFG: Primary data saved (31910 records). [2025-10-22T17:04:48.569597] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-22T17:04:48.569728] [INFO ] [MAIN ] Update Progress: 44/2367 symbols completed. AFG took 32.2s. Estimated remaining: 4h 9m 51s. Rate: 9.3 symbols/min [2025-10-22T17:04:48.635724] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-22T17:04:48.739731] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:48.743166] [DEBUG] [LOCAL ] AFGD: Loaded 1769 existing records from primary storage. [2025-10-22T17:04:48.743321] [INFO ] [MAIN ] AFGD: Loaded 1769 existing records. [2025-10-22T17:04:48.912909] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:04:48.913160] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-22T17:04:48.913226] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-22T17:04:48.913364] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-22T17:04:48.913419] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-22T17:04:48.924086] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-22T17:04:49.266063] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:49.717701] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-22T17:04:50.286837] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-22T17:04:50.517675] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-22T17:04:50.957882] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T17:04:51.317744] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-22T17:04:51.684272] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.76 seconds). [2025-10-22T17:04:51.693796] [INFO ] [REMOTE ] AES: Full fetch complete (77843 records). [2025-10-22T17:04:51.694018] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-22T17:04:51.806432] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-22T17:04:52.106107] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-22T17:04:52.106207] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-22T17:04:52.107023] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-22T17:04:52.107093] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-22T17:04:52.108692] [DEBUG] [LOCAL ] AES: Trimmed 77843 records to 53665 (keeping 200 days of data) [2025-10-22T17:04:52.162632] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-22T17:04:52.429523] [DEBUG] [LOCAL ] AES: Primary data saved (53665 records). [2025-10-22T17:04:52.429681] [INFO ] [MAIN ] AES: Full history saved. [2025-10-22T17:04:52.429775] [INFO ] [MAIN ] Update Progress: 45/2367 symbols completed. AES took 38.3s. Estimated remaining: 4h 7m 31s. Rate: 9.4 symbols/min [2025-10-22T17:04:52.596583] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:04:52.601067] [DEBUG] [LOCAL ] AFGE: Loaded 2292 existing records from primary storage. [2025-10-22T17:04:52.601256] [INFO ] [MAIN ] AFGE: Loaded 2292 existing records. [2025-10-22T17:04:52.677684] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-22T17:04:52.777975] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:04:52.778170] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-22T17:04:52.778215] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-22T17:04:52.778337] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-22T17:04:52.778374] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-22T17:04:52.922832] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-22T17:04:53.127768] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:04:53.533540] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-22T17:04:53.717684] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-22T17:04:54.273760] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-22T17:04:54.517675] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-22T17:04:54.949280] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-22T17:04:55.317681] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-22T17:04:55.956625] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T17:04:56.117696] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-22T17:04:56.553883] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-22T17:04:56.917681] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-22T17:04:57.369264] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-22T17:04:57.717733] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-22T17:04:58.279216] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T17:04:58.517688] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-22T17:04:59.090115] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-22T17:04:59.317675] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-22T17:04:59.765959] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-22T17:05:00.117679] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-22T17:05:00.672158] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-22T17:05:00.917739] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-22T17:05:01.392360] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-22T17:05:01.717685] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-22T17:05:02.178398] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-22T17:05:02.517681] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-22T17:05:02.953677] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T17:05:03.317894] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-22T17:05:03.865099] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-22T17:05:03.866147] [INFO ] [REMOTE ] AFGC: Full fetch complete (3566 records). [2025-10-22T17:05:03.866228] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-22T17:05:04.127406] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-22T17:05:04.383023] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-22T17:05:04.383100] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-22T17:05:04.383229] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-22T17:05:04.383267] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-22T17:05:04.383610] [DEBUG] [LOCAL ] AFGC: Trimmed 3566 records to 2540 (keeping 200 days of data) [2025-10-22T17:05:04.399636] [DEBUG] [LOCAL ] AFGC: Primary data saved (2540 records). [2025-10-22T17:05:04.399732] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-22T17:05:04.399794] [INFO ] [MAIN ] Update Progress: 46/2367 symbols completed. AFGC took 23.7s. Estimated remaining: 4h 12m 6s. Rate: 9.2 symbols/min [2025-10-22T17:05:04.573973] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-22T17:05:04.577157] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:05:04.632456] [DEBUG] [LOCAL ] AFL: Loaded 53177 existing records from primary storage. [2025-10-22T17:05:04.632845] [INFO ] [MAIN ] AFL: Loaded 53177 existing records. [2025-10-22T17:05:04.812076] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:05:04.812288] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-22T17:05:04.812334] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-22T17:05:04.812523] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-22T17:05:04.812573] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-22T17:05:04.922873] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-22T17:05:05.175716] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:05:05.357900] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T17:05:05.717694] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-22T17:05:06.168976] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-22T17:05:06.170013] [INFO ] [REMOTE ] AFGD: Full fetch complete (2717 records). [2025-10-22T17:05:06.170100] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-22T17:05:06.170551] [FATAL] [VALIDATOR ] AFGD: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:05:06.170675] [FATAL] [MAIN ] AFGD: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:05:06.170748] [WARN ] [MAIN ] AFGD: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:05:06.170833] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-22T17:05:06.170917] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-22T17:05:06.170970] [INFO ] [LOCAL ] AFGD: Starting deletion of derivative data. [2025-10-22T17:05:06.171155] [DEBUG] [LOCAL ] AFGD: Deleted derivative data file. [2025-10-22T17:05:06.171264] [INFO ] [MAIN ] Update Progress: 47/2367 symbols completed. AFGD took 17.6s. Estimated remaining: 4h 8m 5s. Rate: 9.4 symbols/min [2025-10-22T17:05:06.349443] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:05:06.349623] [DEBUG] [LOCAL ] AG: No existing data file found in primary storage. [2025-10-22T17:05:06.349692] [WARN ] [MAIN ] AG: No existing data found, performing full refresh instead. [2025-10-22T17:05:06.349805] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-22T17:05:06.349846] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-22T17:05:06.349920] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-10-22T17:05:06.349978] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-22T17:05:06.522951] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-22T17:05:06.726145] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:05:07.214892] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-22T17:05:07.317676] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-22T17:05:07.884774] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-22T17:05:08.117684] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-22T17:05:08.917691] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-22T17:05:09.544656] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-22T17:05:09.717727] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-22T17:05:09.889699] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T17:05:10.150630] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-22T17:05:10.517763] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-22T17:05:10.983330] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-22T17:05:11.317682] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-22T17:05:12.117676] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-22T17:05:12.598167] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-22T17:05:12.917677] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-22T17:05:13.478782] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T17:05:13.480343] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-22T17:05:13.717730] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-22T17:05:14.284093] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-22T17:05:14.284942] [INFO ] [REMOTE ] AFGB: Full fetch complete (3437 records). [2025-10-22T17:05:14.285010] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-22T17:05:14.522798] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-22T17:05:14.636188] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-22T17:05:14.636267] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-22T17:05:14.636389] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-22T17:05:14.636429] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-22T17:05:14.636823] [DEBUG] [LOCAL ] AFGB: Trimmed 3437 records to 2210 (keeping 200 days of data) [2025-10-22T17:05:14.650520] [DEBUG] [LOCAL ] AFGB: Primary data saved (2210 records). [2025-10-22T17:05:14.650678] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-22T17:05:14.650776] [INFO ] [MAIN ] Update Progress: 48/2367 symbols completed. AFGB took 41.3s. Estimated remaining: 4h 9m 38s. Rate: 9.3 symbols/min [2025-10-22T17:05:14.814093] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:05:14.851969] [DEBUG] [LOCAL ] AGCO: Loaded 42188 existing records from primary storage. [2025-10-22T17:05:14.852266] [INFO ] [MAIN ] AGCO: Loaded 42188 existing records. [2025-10-22T17:05:15.029882] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:05:15.030084] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-22T17:05:15.030129] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-22T17:05:15.030347] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-22T17:05:15.030384] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-22T17:05:15.322743] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-22T17:05:15.396989] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:05:15.817736] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-22T17:05:16.091420] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:05:16.117734] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-22T17:05:16.917762] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-22T17:05:17.717741] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-22T17:05:17.973486] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T17:05:18.449193] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T17:05:18.503541] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-22T17:05:18.504460] [INFO ] [REMOTE ] AFGE: Full fetch complete (3328 records). [2025-10-22T17:05:18.504531] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-22T17:05:18.525815] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-22T17:05:18.881398] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-22T17:05:18.881472] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-22T17:05:18.881602] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-22T17:05:18.881710] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-22T17:05:18.882059] [DEBUG] [LOCAL ] AFGE: Trimmed 3328 records to 2245 (keeping 200 days of data) [2025-10-22T17:05:18.895860] [DEBUG] [LOCAL ] AFGE: Primary data saved (2245 records). [2025-10-22T17:05:18.895922] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-22T17:05:18.895989] [INFO ] [MAIN ] Update Progress: 49/2367 symbols completed. AFGE took 26.5s. Estimated remaining: 4h 7m 47s. Rate: 9.4 symbols/min [2025-10-22T17:05:19.062247] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:05:19.080443] [DEBUG] [LOCAL ] AGD: Loaded 19315 existing records from primary storage. [2025-10-22T17:05:19.080714] [INFO ] [MAIN ] AGD: Loaded 19315 existing records. [2025-10-22T17:05:19.253041] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:05:19.253280] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-22T17:05:19.253327] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-22T17:05:19.253678] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-22T17:05:19.253735] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-22T17:05:19.327253] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-22T17:05:19.611171] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:05:20.117742] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-22T17:05:20.582034] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T17:05:20.917670] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-22T17:05:21.056802] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T17:05:21.267712] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T17:05:21.717687] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-22T17:05:22.343195] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T17:05:22.517680] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-22T17:05:22.970593] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T17:05:23.025051] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-22T17:05:23.317669] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-22T17:05:24.117700] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-22T17:05:24.130816] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T17:05:24.917677] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-22T17:05:25.686375] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T17:05:25.717611] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-22T17:05:26.483589] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T17:05:26.517613] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-22T17:05:27.315129] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T17:05:27.323845] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-22T17:05:28.117751] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-22T17:05:28.400225] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T17:05:28.917687] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-22T17:05:29.185986] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-22T17:05:29.505863] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-22T17:05:29.717748] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-22T17:05:30.336028] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T17:05:30.517636] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-22T17:05:31.318134] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-22T17:05:31.322582] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T17:05:32.117690] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-22T17:05:32.461871] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-22T17:05:32.540255] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T17:05:32.917762] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-22T17:05:33.459441] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-22T17:05:33.717697] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-22T17:05:33.903834] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T17:05:34.517730] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-22T17:05:35.317670] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-22T17:05:35.562018] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T17:05:36.117734] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-22T17:05:36.675873] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T17:05:36.730945] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-22T17:05:36.917757] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-22T17:05:37.717732] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-22T17:05:37.773076] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T17:05:37.785992] [INFO ] [REMOTE ] AFL: Full fetch complete (77068 records). [2025-10-22T17:05:37.786183] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-22T17:05:38.203598] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-22T17:05:38.203852] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-22T17:05:38.204616] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-22T17:05:38.204855] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-22T17:05:38.230356] [DEBUG] [LOCAL ] AFL: Trimmed 77068 records to 53174 (keeping 200 days of data) [2025-10-22T17:05:38.231927] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T17:05:38.535251] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-22T17:05:38.582406] [DEBUG] [LOCAL ] AFL: Primary data saved (53174 records). [2025-10-22T17:05:38.582541] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-22T17:05:38.583495] [INFO ] [MAIN ] Update Progress: 50/2367 symbols completed. AFL took 34.2s. Estimated remaining: 4h 17m 56s. Rate: 9.0 symbols/min [2025-10-22T17:05:38.753144] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:05:38.803577] [DEBUG] [LOCAL ] AGI: Loaded 53423 existing records from primary storage. [2025-10-22T17:05:38.804013] [INFO ] [MAIN ] AGI: Loaded 53423 existing records. [2025-10-22T17:05:38.975681] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:05:38.975964] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-22T17:05:38.976021] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-22T17:05:38.976769] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-22T17:05:38.976858] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-22T17:05:39.319022] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-22T17:05:39.323630] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:05:39.419174] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-22T17:05:39.909774] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-22T17:05:40.117759] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-22T17:05:40.856267] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T17:05:40.917733] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-22T17:05:41.220561] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T17:05:41.717699] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-22T17:05:42.486705] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T17:05:42.493723] [INFO ] [REMOTE ] AGCO: Full fetch complete (61666 records). [2025-10-22T17:05:42.493869] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-22T17:05:42.525099] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-22T17:05:42.877340] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-22T17:05:42.877430] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-22T17:05:42.878113] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-22T17:05:42.878199] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-22T17:05:42.879552] [DEBUG] [LOCAL ] AGCO: Trimmed 61666 records to 42149 (keeping 200 days of data) [2025-10-22T17:05:43.140744] [DEBUG] [LOCAL ] AGCO: Primary data saved (42149 records). [2025-10-22T17:05:43.140871] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-22T17:05:43.141872] [INFO ] [MAIN ] Update Progress: 51/2367 symbols completed. AGCO took 28.5s. Estimated remaining: 4h 16m 13s. Rate: 9.0 symbols/min [2025-10-22T17:05:43.322749] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-22T17:05:43.326575] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:05:43.379578] [DEBUG] [LOCAL ] AGL: Loaded 52587 existing records from primary storage. [2025-10-22T17:05:43.380015] [INFO ] [MAIN ] AGL: Loaded 52587 existing records. [2025-10-22T17:05:43.569669] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:05:43.585352] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-22T17:05:43.596010] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-22T17:05:43.596492] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-22T17:05:43.598031] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T17:05:43.596981] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-22T17:05:43.966823] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:05:44.117676] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-22T17:05:44.473365] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-22T17:05:44.746816] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-22T17:05:44.917747] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-22T17:05:45.717781] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-22T17:05:46.100350] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-22T17:05:46.517742] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-22T17:05:47.007173] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-22T17:05:47.283363] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:05:47.317682] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-22T17:05:47.823858] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T17:05:47.828108] [INFO ] [REMOTE ] AGD: Full fetch complete (26660 records). [2025-10-22T17:05:47.828213] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-22T17:05:48.122984] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-22T17:05:48.194121] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-22T17:05:48.194203] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-22T17:05:48.194546] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-22T17:05:48.194609] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-22T17:05:48.195483] [DEBUG] [LOCAL ] AGD: Trimmed 26660 records to 19283 (keeping 200 days of data) [2025-10-22T17:05:48.307393] [DEBUG] [LOCAL ] AGD: Primary data saved (19283 records). [2025-10-22T17:05:48.307528] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-22T17:05:48.307607] [INFO ] [MAIN ] Update Progress: 52/2367 symbols completed. AGD took 29.4s. Estimated remaining: 4h 15m 0s. Rate: 9.1 symbols/min [2025-10-22T17:05:48.473074] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:05:48.483596] [DEBUG] [LOCAL ] AGM: Loaded 10663 existing records from primary storage. [2025-10-22T17:05:48.483822] [INFO ] [MAIN ] AGM: Loaded 10663 existing records. [2025-10-22T17:05:48.658663] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:05:48.658880] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-22T17:05:48.658930] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-22T17:05:48.659105] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-22T17:05:48.659160] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-22T17:05:48.924565] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-22T17:05:49.021014] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:05:49.111630] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T17:05:49.717684] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-22T17:05:50.483907] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-22T17:05:50.517624] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-22T17:05:50.572026] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T17:05:50.688614] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T17:05:51.317780] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-22T17:05:52.117768] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-22T17:05:52.917758] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-22T17:05:52.969438] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T17:05:53.064985] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-22T17:05:53.075740] [INFO ] [REMOTE ] AG: Full fetch complete (77784 records). [2025-10-22T17:05:53.075921] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-22T17:05:53.448669] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-22T17:05:53.473121] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-22T17:05:53.473215] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-22T17:05:53.474008] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-22T17:05:53.474073] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-22T17:05:53.475501] [DEBUG] [LOCAL ] AG: Trimmed 77784 records to 53644 (keeping 200 days of data) [2025-10-22T17:05:53.740746] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-22T17:05:53.795206] [DEBUG] [LOCAL ] AG: Primary data saved (53644 records). [2025-10-22T17:05:53.795340] [INFO ] [MAIN ] AG: Full history saved. [2025-10-22T17:05:53.795422] [INFO ] [MAIN ] Update Progress: 53/2367 symbols completed. AG took 47.6s. Estimated remaining: 4h 14m 5s. Rate: 9.1 symbols/min [2025-10-22T17:05:53.963340] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:05:53.994634] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T17:05:54.022570] [DEBUG] [LOCAL ] AGO: Loaded 27763 existing records from primary storage. [2025-10-22T17:05:54.022841] [INFO ] [MAIN ] AGO: Loaded 27763 existing records. [2025-10-22T17:05:54.193143] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:05:54.193322] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-22T17:05:54.193370] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-22T17:05:54.193563] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-22T17:05:54.193617] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-22T17:05:54.517911] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-22T17:05:54.538623] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:05:55.193331] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-22T17:05:55.317635] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-22T17:05:55.543520] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T17:05:56.106434] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T17:05:56.117787] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-22T17:05:56.574932] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-22T17:05:56.917761] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-22T17:05:57.717697] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-22T17:05:58.102868] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T17:05:58.517739] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-22T17:05:59.317686] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-22T17:05:59.373796] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T17:05:59.460977] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T17:06:00.117625] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-22T17:06:00.692439] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T17:06:00.917619] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-22T17:06:01.157280] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T17:06:01.717625] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-22T17:06:02.517754] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-22T17:06:02.625403] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T17:06:02.691435] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T17:06:03.289919] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T17:06:03.317621] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-22T17:06:04.117688] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-22T17:06:04.283413] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-22T17:06:04.285750] [INFO ] [REMOTE ] AGM: Full fetch complete (13322 records). [2025-10-22T17:06:04.285823] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-22T17:06:04.655199] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-22T17:06:04.655300] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-22T17:06:04.655550] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-22T17:06:04.655593] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-22T17:06:04.656082] [DEBUG] [LOCAL ] AGM: Trimmed 13322 records to 10617 (keeping 200 days of data) [2025-10-22T17:06:04.722918] [DEBUG] [LOCAL ] AGM: Primary data saved (10617 records). [2025-10-22T17:06:04.723026] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-22T17:06:04.723101] [INFO ] [MAIN ] Update Progress: 54/2367 symbols completed. AGM took 16.4s. Estimated remaining: 4h 17m 4s. Rate: 9.0 symbols/min [2025-10-22T17:06:04.894144] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:06:04.922924] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-22T17:06:04.924109] [DEBUG] [LOCAL ] AGRO: Loaded 32640 existing records from primary storage. [2025-10-22T17:06:04.925639] [INFO ] [MAIN ] AGRO: Loaded 32640 existing records. [2025-10-22T17:06:05.106221] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:06:05.106439] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-22T17:06:05.106487] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-22T17:06:05.106721] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-22T17:06:05.106778] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-22T17:06:05.463617] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:06:05.717744] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-22T17:06:05.970409] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-22T17:06:06.517686] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-22T17:06:06.775502] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T17:06:07.174237] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T17:06:07.317721] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-22T17:06:08.090046] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T17:06:08.117614] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-22T17:06:08.917736] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-22T17:06:09.074895] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T17:06:09.640626] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T17:06:09.717614] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-22T17:06:10.341071] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:06:10.517638] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-22T17:06:11.317815] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-22T17:06:11.605485] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T17:06:11.614254] [INFO ] [REMOTE ] AGL: Full fetch complete (75950 records). [2025-10-22T17:06:11.614397] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-22T17:06:12.089991] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-22T17:06:12.097238] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-22T17:06:12.111359] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-22T17:06:12.113550] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-22T17:06:12.112104] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-22T17:06:12.121128] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-22T17:06:12.124035] [DEBUG] [LOCAL ] AGL: Trimmed 75950 records to 52595 (keeping 200 days of data) [2025-10-22T17:06:12.416109] [DEBUG] [LOCAL ] AGL: Primary data saved (52595 records). [2025-10-22T17:06:12.416248] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-22T17:06:12.417766] [INFO ] [MAIN ] Update Progress: 55/2367 symbols completed. AGL took 29.3s. Estimated remaining: 4h 17m 41s. Rate: 9.0 symbols/min [2025-10-22T17:06:12.615393] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:06:12.650834] [DEBUG] [LOCAL ] AGX: Loaded 32682 existing records from primary storage. [2025-10-22T17:06:12.651097] [INFO ] [MAIN ] AGX: Loaded 32682 existing records. [2025-10-22T17:06:12.853117] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:06:12.853524] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-22T17:06:12.853776] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-22T17:06:12.854045] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-22T17:06:12.854105] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-22T17:06:12.919777] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-22T17:06:13.224976] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:06:13.272499] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T17:06:13.273312] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T17:06:13.717695] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-22T17:06:14.255832] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-22T17:06:14.517755] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-22T17:06:15.317745] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-22T17:06:15.551479] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T17:06:15.981928] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T17:06:16.117852] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-22T17:06:16.892536] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T17:06:16.917628] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-22T17:06:17.717788] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-22T17:06:18.323745] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-22T17:06:18.517688] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-22T17:06:18.544989] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T17:06:19.099688] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T17:06:19.317799] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-22T17:06:19.834225] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T17:06:20.117738] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-22T17:06:20.451099] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T17:06:20.917758] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-22T17:06:21.410025] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-22T17:06:21.717809] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-22T17:06:22.517790] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-22T17:06:22.918664] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T17:06:22.928709] [INFO ] [REMOTE ] AGI: Full fetch complete (77322 records). [2025-10-22T17:06:22.928978] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-22T17:06:23.330462] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-22T17:06:23.374253] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T17:06:23.402105] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-22T17:06:23.409836] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-22T17:06:23.411786] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-22T17:06:23.412329] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-22T17:06:23.415419] [DEBUG] [LOCAL ] AGI: Trimmed 77322 records to 53423 (keeping 200 days of data) [2025-10-22T17:06:23.542367] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T17:06:23.786894] [DEBUG] [LOCAL ] AGI: Primary data saved (53423 records). [2025-10-22T17:06:23.787091] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-22T17:06:23.788111] [INFO ] [MAIN ] Update Progress: 56/2367 symbols completed. AGI took 45.2s. Estimated remaining: 4h 20m 47s. Rate: 8.9 symbols/min [2025-10-22T17:06:23.961390] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:06:24.002328] [DEBUG] [LOCAL ] AHH: Loaded 40272 existing records from primary storage. [2025-10-22T17:06:24.002733] [INFO ] [MAIN ] AHH: Loaded 40272 existing records. [2025-10-22T17:06:24.122950] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-22T17:06:24.195496] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:06:24.196322] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-22T17:06:24.196451] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-22T17:06:24.196824] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-22T17:06:24.196937] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-22T17:06:24.573639] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T17:06:24.616379] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:06:24.917743] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-22T17:06:25.546484] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T17:06:25.717772] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-22T17:06:26.365381] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:06:26.517765] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-22T17:06:27.229287] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T17:06:27.235267] [INFO ] [REMOTE ] AGRO: Full fetch complete (48849 records). [2025-10-22T17:06:27.235461] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-22T17:06:27.326705] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-22T17:06:27.670265] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-22T17:06:27.670454] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-22T17:06:27.671125] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-22T17:06:27.671194] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-22T17:06:27.672635] [DEBUG] [LOCAL ] AGRO: Trimmed 48849 records to 32457 (keeping 200 days of data) [2025-10-22T17:06:27.864915] [DEBUG] [LOCAL ] AGRO: Primary data saved (32457 records). [2025-10-22T17:06:27.865060] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-22T17:06:27.866303] [INFO ] [MAIN ] Update Progress: 57/2367 symbols completed. AGRO took 23.1s. Estimated remaining: 4h 18m 51s. Rate: 8.9 symbols/min [2025-10-22T17:06:28.049357] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:06:28.049630] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-22T17:06:28.049728] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-22T17:06:28.050038] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-22T17:06:28.050110] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-22T17:06:28.050233] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-22T17:06:28.050364] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-22T17:06:28.122945] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-22T17:06:28.387661] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T17:06:28.468797] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:06:28.718085] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T17:06:28.917632] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-10-22T17:06:29.120060] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:06:29.120523] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-10-22T17:06:29.120683] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:06:29.120770] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-22T17:06:29.120857] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:06:29.120953] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-22T17:06:29.121063] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-22T17:06:29.121137] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-22T17:06:29.121232] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-22T17:06:29.121312] [INFO ] [MAIN ] Update Progress: 58/2367 symbols completed. AHL took 1.3s. Estimated remaining: 4h 15m 7s. Rate: 9.1 symbols/min [2025-10-22T17:06:29.309461] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:06:29.355731] [DEBUG] [LOCAL ] AHR: Loaded 48969 existing records from primary storage. [2025-10-22T17:06:29.356144] [INFO ] [MAIN ] AHR: Loaded 48969 existing records. [2025-10-22T17:06:29.550086] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:06:29.568572] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-22T17:06:29.569156] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-22T17:06:29.569885] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T17:06:29.576340] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-22T17:06:29.576444] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-22T17:06:29.723548] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-22T17:06:29.952917] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:06:30.517609] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-22T17:06:30.916684] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T17:06:31.317677] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-22T17:06:31.735046] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T17:06:32.117720] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-22T17:06:32.917632] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-22T17:06:32.988873] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:06:33.714843] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T17:06:33.723886] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-22T17:06:33.838248] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T17:06:34.517694] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-22T17:06:35.304769] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T17:06:35.317616] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-22T17:06:35.873070] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T17:06:35.878232] [INFO ] [REMOTE ] AGO: Full fetch complete (39790 records). [2025-10-22T17:06:35.878372] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-22T17:06:36.124626] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-22T17:06:36.266300] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-22T17:06:36.266393] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-22T17:06:36.266874] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-22T17:06:36.266940] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-22T17:06:36.268063] [DEBUG] [LOCAL ] AGO: Trimmed 39790 records to 27710 (keeping 200 days of data) [2025-10-22T17:06:36.433068] [DEBUG] [LOCAL ] AGO: Primary data saved (27710 records). [2025-10-22T17:06:36.433197] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-22T17:06:36.433283] [INFO ] [MAIN ] Update Progress: 59/2367 symbols completed. AGO took 42.6s. Estimated remaining: 4h 15m 27s. Rate: 9.0 symbols/min [2025-10-22T17:06:36.610107] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:06:36.617572] [DEBUG] [LOCAL ] AHT: Loaded 6381 existing records from primary storage. [2025-10-22T17:06:36.617859] [INFO ] [MAIN ] AHT: Loaded 6381 existing records. [2025-10-22T17:06:36.799744] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:06:36.800054] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-22T17:06:36.800127] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-22T17:06:36.800274] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-22T17:06:36.800325] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-22T17:06:36.921031] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-22T17:06:36.932119] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T17:06:37.191142] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:06:37.717749] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-22T17:06:37.884942] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T17:06:38.281962] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T17:06:38.371029] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-22T17:06:38.517633] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-22T17:06:39.233495] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T17:06:39.317739] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-22T17:06:39.945114] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T17:06:40.117689] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-22T17:06:40.917730] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-22T17:06:41.018052] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-22T17:06:41.717733] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-22T17:06:42.316081] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T17:06:42.517753] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-22T17:06:42.553531] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T17:06:43.317778] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-22T17:06:44.047306] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T17:06:44.117717] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-22T17:06:44.818942] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T17:06:44.872677] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-22T17:06:44.917915] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-22T17:06:45.717688] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-22T17:06:45.756796] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-22T17:06:46.517695] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-22T17:06:47.074959] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T17:06:47.136590] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T17:06:47.317742] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-22T17:06:48.117718] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-22T17:06:48.917761] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-22T17:06:49.717751] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-22T17:06:50.543721] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T17:06:50.546022] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-22T17:06:50.707046] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T17:06:50.875040] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (3.56 seconds). [2025-10-22T17:06:50.880503] [INFO ] [REMOTE ] AGX: Full fetch complete (49017 records). [2025-10-22T17:06:50.880613] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-22T17:06:51.272571] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-22T17:06:51.272766] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-22T17:06:51.273323] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-22T17:06:51.273404] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-22T17:06:51.274570] [DEBUG] [LOCAL ] AGX: Trimmed 49017 records to 32652 (keeping 200 days of data) [2025-10-22T17:06:51.329763] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-22T17:06:51.369677] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-22T17:06:51.391382] [INFO ] [REMOTE ] AHT: Full fetch complete (9090 records). [2025-10-22T17:06:51.397759] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-22T17:06:51.406280] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (3.29 seconds). [2025-10-22T17:06:51.872009] [DEBUG] [LOCAL ] AGX: Primary data saved (32652 records). [2025-10-22T17:06:51.894044] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-22T17:06:51.894151] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-22T17:06:51.895128] [INFO ] [MAIN ] Update Progress: 60/2367 symbols completed. AGX took 39.5s. Estimated remaining: 4h 20m 59s. Rate: 8.8 symbols/min [2025-10-22T17:06:51.895214] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-22T17:06:51.927245] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-22T17:06:51.959126] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-22T17:06:51.986355] [DEBUG] [LOCAL ] AHT: Trimmed 9090 records to 6358 (keeping 200 days of data) [2025-10-22T17:06:52.082995] [DEBUG] [LOCAL ] AHT: Primary data saved (6358 records). [2025-10-22T17:06:52.100761] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-22T17:06:52.100675] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:06:52.100907] [INFO ] [MAIN ] Update Progress: 61/2367 symbols completed. AHT took 15.7s. Estimated remaining: 4h 16m 44s. Rate: 9.0 symbols/min [2025-10-22T17:06:52.122804] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-22T17:06:52.272792] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:06:52.309389] [DEBUG] [LOCAL ] AI: Loaded 53765 existing records from primary storage. [2025-10-22T17:06:52.309810] [INFO ] [MAIN ] AI: Loaded 53765 existing records. [2025-10-22T17:06:52.518720] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:06:52.515109] [DEBUG] [LOCAL ] AIG: Loaded 53461 existing records from primary storage. [2025-10-22T17:06:52.519026] [INFO ] [MAIN ] AIG: Loaded 53461 existing records. [2025-10-22T17:06:52.541195] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-22T17:06:52.553573] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-22T17:06:52.597349] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-22T17:06:52.613036] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-22T17:06:52.819690] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:06:52.830435] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-22T17:06:52.830546] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-22T17:06:52.902255] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-22T17:06:52.902383] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-22T17:06:53.189703] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:06:53.228937] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-22T17:06:53.413991] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-22T17:06:53.487805] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:06:53.718875] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-22T17:06:53.722072] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T17:06:54.517785] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-22T17:06:55.317778] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-22T17:06:55.458142] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T17:06:55.676408] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-22T17:06:55.752979] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-22T17:06:56.117637] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-22T17:06:56.899553] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T17:06:56.917619] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-22T17:06:57.717745] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-22T17:06:57.804934] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T17:06:58.285107] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T17:06:58.517733] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-22T17:06:59.317753] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-22T17:06:59.864302] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-22T17:06:59.944325] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T17:07:00.117614] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-22T17:07:00.917679] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-22T17:07:01.101500] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T17:07:01.717677] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-22T17:07:02.066235] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-22T17:07:02.517687] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-22T17:07:02.954634] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-22T17:07:03.276556] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T17:07:03.283626] [INFO ] [REMOTE ] AHH: Full fetch complete (59508 records). [2025-10-22T17:07:03.283806] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-22T17:07:03.322957] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-22T17:07:03.704426] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-22T17:07:03.704508] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-22T17:07:03.705199] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-22T17:07:03.705280] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-22T17:07:03.706570] [DEBUG] [LOCAL ] AHH: Trimmed 59508 records to 40160 (keeping 200 days of data) [2025-10-22T17:07:03.937452] [DEBUG] [LOCAL ] AHH: Primary data saved (40160 records). [2025-10-22T17:07:03.937680] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-22T17:07:03.937808] [INFO ] [MAIN ] Update Progress: 62/2367 symbols completed. AHH took 40.1s. Estimated remaining: 4h 19m 49s. Rate: 8.9 symbols/min [2025-10-22T17:07:04.101806] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T17:07:04.135831] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-22T17:07:04.172836] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:07:04.173067] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-22T17:07:04.173122] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-22T17:07:04.173271] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-22T17:07:04.173334] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-22T17:07:04.173411] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-22T17:07:04.173459] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-22T17:07:04.651520] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:07:04.917749] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-22T17:07:05.429736] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-22T17:07:05.717686] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-10-22T17:07:05.936982] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:07:05.937296] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-10-22T17:07:05.937382] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:07:05.937430] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-22T17:07:05.937489] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:07:05.937560] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-22T17:07:05.937624] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-22T17:07:05.937696] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-22T17:07:05.937797] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-22T17:07:05.937848] [INFO ] [MAIN ] Update Progress: 63/2367 symbols completed. AII took 2.0s. Estimated remaining: 4h 16m 48s. Rate: 9.0 symbols/min [2025-10-22T17:07:06.120386] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:07:06.155453] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T17:07:06.184878] [DEBUG] [LOCAL ] AIN: Loaded 24431 existing records from primary storage. [2025-10-22T17:07:06.185146] [INFO ] [MAIN ] AIN: Loaded 24431 existing records. [2025-10-22T17:07:06.361006] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:07:06.361312] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-22T17:07:06.361360] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-22T17:07:06.361525] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-22T17:07:06.361562] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-22T17:07:06.534622] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-22T17:07:06.696069] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T17:07:06.742227] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:07:06.742370] [INFO ] [REMOTE ] AHR: Full fetch complete (70454 records). [2025-10-22T17:07:06.742863] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-22T17:07:06.743793] [FATAL] [VALIDATOR ] AHR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:07:06.743885] [FATAL] [MAIN ] AHR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:07:06.743929] [WARN ] [MAIN ] AHR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:07:06.743995] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-22T17:07:06.744062] [DEBUG] [LOCAL ] AHR: No primary data file found to delete. [2025-10-22T17:07:06.744099] [INFO ] [LOCAL ] AHR: Starting deletion of derivative data. [2025-10-22T17:07:06.744242] [DEBUG] [LOCAL ] AHR: Deleted derivative data file. [2025-10-22T17:07:06.744915] [INFO ] [MAIN ] Update Progress: 64/2367 symbols completed. AHR took 37.6s. Estimated remaining: 4h 13m 10s. Rate: 9.1 symbols/min [2025-10-22T17:07:06.915865] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:07:06.931774] [DEBUG] [LOCAL ] AIO: Loaded 13039 existing records from primary storage. [2025-10-22T17:07:06.932033] [INFO ] [MAIN ] AIO: Loaded 13039 existing records. [2025-10-22T17:07:07.105944] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:07:07.106219] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-22T17:07:07.106299] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-22T17:07:07.106480] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-22T17:07:07.106521] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-22T17:07:07.322884] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-22T17:07:07.475525] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:07:08.117759] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-22T17:07:08.368156] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T17:07:08.573119] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T17:07:08.917691] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-22T17:07:09.717673] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-22T17:07:10.518834] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-22T17:07:10.531821] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T17:07:10.628976] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-22T17:07:10.650864] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-22T17:07:11.280087] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T17:07:11.317671] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-22T17:07:12.117722] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-22T17:07:12.386242] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T17:07:12.917668] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-22T17:07:13.717763] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-22T17:07:14.067203] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T17:07:14.251305] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T17:07:14.517725] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-22T17:07:14.570763] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-22T17:07:15.317727] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-22T17:07:16.117719] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-22T17:07:16.488496] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T17:07:16.917617] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-22T17:07:17.018411] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-22T17:07:17.717675] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-22T17:07:18.075103] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T17:07:18.131155] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T17:07:18.517788] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-22T17:07:19.317744] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-22T17:07:20.117726] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-22T17:07:20.198319] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-22T17:07:20.331917] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T17:07:20.362209] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T17:07:20.917742] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-22T17:07:21.208404] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T17:07:21.717697] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-22T17:07:22.517689] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-22T17:07:23.317662] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-22T17:07:23.491262] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-22T17:07:23.541004] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T17:07:23.545727] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-22T17:07:24.117686] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-22T17:07:24.327317] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-22T17:07:24.662005] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-22T17:07:24.917745] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-22T17:07:25.704443] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-22T17:07:25.717622] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-22T17:07:26.517688] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-22T17:07:26.603855] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-22T17:07:27.317768] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-22T17:07:28.117725] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-22T17:07:28.517622] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T17:07:28.527911] [INFO ] [REMOTE ] AIG: Full fetch complete (77565 records). [2025-10-22T17:07:28.528160] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-22T17:07:28.941677] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-22T17:07:29.000058] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-22T17:07:29.000248] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-22T17:07:29.001335] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-22T17:07:29.001452] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-22T17:07:29.004330] [DEBUG] [LOCAL ] AIG: Trimmed 77565 records to 53459 (keeping 200 days of data) [2025-10-22T17:07:29.128531] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-22T17:07:29.158244] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-22T17:07:29.166126] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-22T17:07:29.506316] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-22T17:07:29.722624] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-22T17:07:29.868154] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-22T17:07:29.871983] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-22T17:07:29.873298] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-22T17:07:29.878672] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-22T17:07:29.882804] [DEBUG] [LOCAL ] AIG: Primary data saved (53459 records). [2025-10-22T17:07:29.883028] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-22T17:07:29.883312] [INFO ] [MAIN ] Update Progress: 65/2367 symbols completed. AIG took 37.8s. Estimated remaining: 4h 22m 49s. Rate: 8.8 symbols/min [2025-10-22T17:07:29.948772] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 53765 (keeping 200 days of data) [2025-10-22T17:07:30.133357] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T17:07:30.182799] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:07:30.193347] [DEBUG] [LOCAL ] AIR: No existing data file found in primary storage. [2025-10-22T17:07:30.194001] [WARN ] [MAIN ] AIR: No existing data found, performing full refresh instead. [2025-10-22T17:07:30.201780] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-22T17:07:30.205484] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-22T17:07:30.218353] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-10-22T17:07:30.218486] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-22T17:07:30.518353] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-22T17:07:30.832998] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:07:30.849081] [DEBUG] [LOCAL ] AI: Primary data saved (53765 records). [2025-10-22T17:07:30.849223] [INFO ] [MAIN ] AI: Full history saved. [2025-10-22T17:07:30.850347] [INFO ] [MAIN ] Update Progress: 66/2367 symbols completed. AI took 39.0s. Estimated remaining: 4h 19m 17s. Rate: 8.9 symbols/min [2025-10-22T17:07:31.023622] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:07:31.024103] [DEBUG] [LOCAL ] AIT: No existing data file found in primary storage. [2025-10-22T17:07:31.024210] [WARN ] [MAIN ] AIT: No existing data found, performing full refresh instead. [2025-10-22T17:07:31.024399] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-22T17:07:31.024441] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-22T17:07:31.024481] [DEBUG] [LOCAL ] AIT: No primary data file found to delete. [2025-10-22T17:07:31.024512] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-22T17:07:31.164238] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T17:07:31.200437] [INFO ] [REMOTE ] AIN: Full fetch complete (33723 records). [2025-10-22T17:07:31.261824] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-22T17:07:31.332721] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-22T17:07:31.580486] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:07:31.729517] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T17:07:31.866947] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-22T17:07:31.867061] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-22T17:07:31.867666] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-22T17:07:31.867781] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-22T17:07:31.868863] [DEBUG] [LOCAL ] AIN: Trimmed 33723 records to 24301 (keeping 200 days of data) [2025-10-22T17:07:32.025275] [DEBUG] [LOCAL ] AIN: Primary data saved (24301 records). [2025-10-22T17:07:32.025481] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-22T17:07:32.025590] [INFO ] [MAIN ] Update Progress: 67/2367 symbols completed. AIN took 26.1s. Estimated remaining: 4h 15m 58s. Rate: 9.0 symbols/min [2025-10-22T17:07:32.125836] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-22T17:07:32.203879] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:07:32.246784] [DEBUG] [LOCAL ] AIV: Loaded 41856 existing records from primary storage. [2025-10-22T17:07:32.247201] [INFO ] [MAIN ] AIV: Loaded 41856 existing records. [2025-10-22T17:07:32.437028] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:07:32.437349] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-22T17:07:32.437427] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-22T17:07:32.437978] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-22T17:07:32.438038] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-22T17:07:32.839104] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:07:32.842442] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T17:07:32.917627] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-22T17:07:33.676877] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T17:07:33.717610] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-22T17:07:33.937048] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-22T17:07:34.517773] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-22T17:07:34.900384] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T17:07:35.320745] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-22T17:07:36.117749] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-22T17:07:36.595637] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T17:07:36.713476] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-22T17:07:36.748556] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-22T17:07:36.751384] [INFO ] [REMOTE ] AIO: Full fetch complete (20069 records). [2025-10-22T17:07:36.751456] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-22T17:07:36.927948] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-22T17:07:37.123259] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-22T17:07:37.123363] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-22T17:07:37.123690] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-22T17:07:37.123757] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-22T17:07:37.124315] [DEBUG] [LOCAL ] AIO: Trimmed 20069 records to 12916 (keeping 200 days of data) [2025-10-22T17:07:37.202598] [DEBUG] [LOCAL ] AIO: Primary data saved (12916 records). [2025-10-22T17:07:37.202764] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-22T17:07:37.202853] [INFO ] [MAIN ] Update Progress: 68/2367 symbols completed. AIO took 30.5s. Estimated remaining: 4h 15m 1s. Rate: 9.0 symbols/min [2025-10-22T17:07:37.375591] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:07:37.405715] [DEBUG] [LOCAL ] AIZ: Loaded 29391 existing records from primary storage. [2025-10-22T17:07:37.406025] [INFO ] [MAIN ] AIZ: Loaded 29391 existing records. [2025-10-22T17:07:37.603522] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:07:37.603806] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-22T17:07:37.603858] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-22T17:07:37.604083] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-22T17:07:37.604137] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-22T17:07:37.722765] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-22T17:07:37.956309] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:07:38.250514] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T17:07:38.517756] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-22T17:07:39.269828] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T17:07:39.317686] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-22T17:07:39.906361] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T17:07:40.117746] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-22T17:07:40.698329] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T17:07:40.917745] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-22T17:07:41.560128] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T17:07:41.717732] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-22T17:07:42.365992] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:07:42.517674] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-22T17:07:43.317671] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-22T17:07:43.436694] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T17:07:44.064605] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T17:07:44.117624] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-22T17:07:44.835347] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T17:07:44.899315] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-22T17:07:44.917614] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-22T17:07:45.717631] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-22T17:07:46.292148] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-22T17:07:46.517688] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-22T17:07:46.542131] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-22T17:07:47.317733] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-22T17:07:48.117762] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-22T17:07:48.556111] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-22T17:07:48.732157] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T17:07:48.917696] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-22T17:07:49.363707] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T17:07:49.717746] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-22T17:07:49.923299] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T17:07:50.517629] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-22T17:07:51.084365] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T17:07:51.317687] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-22T17:07:51.969415] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T17:07:52.117741] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-22T17:07:52.729733] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T17:07:52.917762] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-22T17:07:53.481772] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T17:07:53.717736] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-22T17:07:54.124123] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T17:07:54.517795] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-22T17:07:54.966009] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T17:07:55.317676] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-22T17:07:55.814148] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T17:07:56.117725] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-22T17:07:56.917770] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-22T17:07:57.131496] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T17:07:57.141022] [INFO ] [REMOTE ] AIV: Full fetch complete (60367 records). [2025-10-22T17:07:57.141214] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-22T17:07:57.610544] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-22T17:07:57.610690] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-22T17:07:57.611399] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-22T17:07:57.611561] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-22T17:07:57.612835] [DEBUG] [LOCAL ] AIV: Trimmed 60367 records to 41857 (keeping 200 days of data) [2025-10-22T17:07:57.717687] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-22T17:07:57.774207] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T17:07:57.916166] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T17:07:57.931108] [DEBUG] [LOCAL ] AIV: Primary data saved (41857 records). [2025-10-22T17:07:57.931749] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-22T17:07:57.932496] [INFO ] [MAIN ] Update Progress: 69/2367 symbols completed. AIV took 25.9s. Estimated remaining: 4h 22m 43s. Rate: 8.7 symbols/min [2025-10-22T17:07:58.097510] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:07:58.104436] [DEBUG] [LOCAL ] AIZN: Loaded 3846 existing records from primary storage. [2025-10-22T17:07:58.104702] [INFO ] [MAIN ] AIZN: Loaded 3846 existing records. [2025-10-22T17:07:58.277470] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:07:58.277745] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-22T17:07:58.277802] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-22T17:07:58.277966] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-22T17:07:58.278020] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-22T17:07:58.524742] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-22T17:07:58.654287] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:07:59.080701] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T17:07:59.317737] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-22T17:07:59.618589] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T17:08:00.117673] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-22T17:08:00.359519] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T17:08:00.914990] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T17:08:00.917601] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-22T17:08:01.377359] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T17:08:01.717674] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-22T17:08:02.517732] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-22T17:08:03.158029] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T17:08:03.163581] [INFO ] [REMOTE ] AIR: Full fetch complete (40091 records). [2025-10-22T17:08:03.163716] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-22T17:08:03.164299] [FATAL] [VALIDATOR ] AIR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:08:03.164386] [FATAL] [MAIN ] AIR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:08:03.164429] [WARN ] [MAIN ] AIR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:08:03.164467] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-22T17:08:03.164524] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-10-22T17:08:03.164558] [INFO ] [LOCAL ] AIR: Starting deletion of derivative data. [2025-10-22T17:08:03.164596] [DEBUG] [LOCAL ] AIR: No derivative data file found to delete. [2025-10-22T17:08:03.164671] [INFO ] [MAIN ] Update Progress: 70/2367 symbols completed. AIR took 33.3s. Estimated remaining: 4h 21m 43s. Rate: 8.8 symbols/min [2025-10-22T17:08:03.319385] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-22T17:08:03.345339] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:08:03.392201] [DEBUG] [LOCAL ] AJG: Loaded 46428 existing records from primary storage. [2025-10-22T17:08:03.392586] [INFO ] [MAIN ] AJG: Loaded 46428 existing records. [2025-10-22T17:08:03.581034] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:08:03.581283] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-22T17:08:03.581331] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-22T17:08:03.581518] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-22T17:08:03.581555] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-22T17:08:03.951221] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:08:03.976428] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-22T17:08:03.978025] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-22T17:08:04.117692] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-22T17:08:04.917761] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-22T17:08:05.540485] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-22T17:08:05.717667] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-22T17:08:05.951299] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T17:08:06.098935] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-22T17:08:06.517737] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-22T17:08:07.317683] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-22T17:08:07.955200] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T17:08:08.117629] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-22T17:08:08.521398] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T17:08:08.917754] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-22T17:08:09.496969] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T17:08:09.504856] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T17:08:09.506527] [INFO ] [REMOTE ] AIT: Full fetch complete (39116 records). [2025-10-22T17:08:09.506987] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-22T17:08:09.722819] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-22T17:08:09.870181] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-22T17:08:09.870259] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-22T17:08:09.870723] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-22T17:08:09.870783] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-22T17:08:09.871583] [DEBUG] [LOCAL ] AIT: Trimmed 39116 records to 26566 (keeping 200 days of data) [2025-10-22T17:08:10.032158] [DEBUG] [LOCAL ] AIT: Primary data saved (26566 records). [2025-10-22T17:08:10.032277] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-22T17:08:10.032344] [INFO ] [MAIN ] Update Progress: 71/2367 symbols completed. AIT took 39.2s. Estimated remaining: 4h 21m 37s. Rate: 8.8 symbols/min [2025-10-22T17:08:10.197612] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:08:10.197798] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-22T17:08:10.197842] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-22T17:08:10.197948] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-22T17:08:10.197988] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-22T17:08:10.198028] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-22T17:08:10.198059] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-22T17:08:10.528116] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-22T17:08:10.548921] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:08:11.059539] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T17:08:11.063857] [INFO ] [REMOTE ] AIZ: Full fetch complete (42809 records). [2025-10-22T17:08:11.063966] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-22T17:08:11.175456] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T17:08:11.324895] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-22T17:08:11.452292] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-22T17:08:11.452373] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-22T17:08:11.452887] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-22T17:08:11.452947] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-22T17:08:11.453818] [DEBUG] [LOCAL ] AIZ: Trimmed 42809 records to 29244 (keeping 200 days of data) [2025-10-22T17:08:11.628357] [DEBUG] [LOCAL ] AIZ: Primary data saved (29244 records). [2025-10-22T17:08:11.628483] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-22T17:08:11.628562] [INFO ] [MAIN ] Update Progress: 72/2367 symbols completed. AIZ took 34.4s. Estimated remaining: 4h 18m 43s. Rate: 8.9 symbols/min [2025-10-22T17:08:11.795630] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:08:11.836974] [DEBUG] [LOCAL ] AKR: Loaded 46115 existing records from primary storage. [2025-10-22T17:08:11.837259] [INFO ] [MAIN ] AKR: Loaded 46115 existing records. [2025-10-22T17:08:12.021893] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T17:08:12.021765] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:08:12.023325] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-22T17:08:12.023376] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-22T17:08:12.023689] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-22T17:08:12.023745] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-22T17:08:12.121681] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-22T17:08:12.371063] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:08:12.694524] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-22T17:08:12.917632] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-22T17:08:13.388040] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-22T17:08:13.717682] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-22T17:08:14.517672] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-22T17:08:15.081227] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T17:08:15.317625] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-22T17:08:15.451523] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T17:08:15.786222] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-22T17:08:16.117681] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-22T17:08:16.513934] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-22T17:08:16.917754] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-22T17:08:17.717623] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-22T17:08:18.209987] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-22T17:08:18.517687] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-22T17:08:19.317297] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T17:08:19.327394] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-22T17:08:19.817494] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-22T17:08:19.903025] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T17:08:20.117669] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-22T17:08:20.917683] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-22T17:08:21.712064] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T17:08:21.721217] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-22T17:08:22.500736] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T17:08:22.501847] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T17:08:22.517604] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-22T17:08:23.317694] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-22T17:08:24.016952] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-22T17:08:24.018180] [INFO ] [REMOTE ] AIZN: Full fetch complete (5776 records). [2025-10-22T17:08:24.018250] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-22T17:08:24.018600] [FATAL] [VALIDATOR ] AIZN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:08:24.018722] [FATAL] [MAIN ] AIZN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:08:24.018766] [WARN ] [MAIN ] AIZN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:08:24.018806] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-22T17:08:24.018864] [DEBUG] [LOCAL ] AIZN: No primary data file found to delete. [2025-10-22T17:08:24.018899] [INFO ] [LOCAL ] AIZN: Starting deletion of derivative data. [2025-10-22T17:08:24.019053] [DEBUG] [LOCAL ] AIZN: Deleted derivative data file. [2025-10-22T17:08:24.019134] [INFO ] [MAIN ] Update Progress: 73/2367 symbols completed. AIZN took 26.1s. Estimated remaining: 4h 21m 33s. Rate: 8.8 symbols/min [2025-10-22T17:08:24.122947] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-22T17:08:24.217420] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:08:24.219404] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T17:08:24.269286] [DEBUG] [LOCAL ] AL: Loaded 44794 existing records from primary storage. [2025-10-22T17:08:24.269584] [INFO ] [MAIN ] AL: Loaded 44794 existing records. [2025-10-22T17:08:24.441767] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:08:24.442004] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-22T17:08:24.442054] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-22T17:08:24.442266] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-22T17:08:24.442321] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-22T17:08:24.680590] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T17:08:24.792183] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:08:24.917630] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-22T17:08:25.717756] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-22T17:08:26.070393] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-22T17:08:26.522859] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-22T17:08:26.542255] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:08:27.317741] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-22T17:08:28.109712] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T17:08:28.118734] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-22T17:08:28.362501] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-22T17:08:28.376569] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-22T17:08:28.917761] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-22T17:08:29.717741] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-22T17:08:30.461131] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T17:08:30.475571] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-22T17:08:30.477273] [INFO ] [REMOTE ] AKA: Full fetch complete (2821 records). [2025-10-22T17:08:30.477357] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-22T17:08:30.522777] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-22T17:08:30.675134] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-22T17:08:30.675407] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:08:30.675499] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:08:30.675593] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-22T17:08:30.675718] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-22T17:08:30.675794] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-22T17:08:30.675869] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-22T17:08:30.676014] [INFO ] [MAIN ] Update Progress: 74/2367 symbols completed. AKA took 20.6s. Estimated remaining: 4h 21m 21s. Rate: 8.8 symbols/min [2025-10-22T17:08:30.886098] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:08:30.935298] [DEBUG] [LOCAL ] ALB: Loaded 53366 existing records from primary storage. [2025-10-22T17:08:30.935609] [INFO ] [MAIN ] ALB: Loaded 53366 existing records. [2025-10-22T17:08:31.114736] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:08:31.114963] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-22T17:08:31.115022] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-22T17:08:31.115234] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-22T17:08:31.115298] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-22T17:08:31.324779] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-22T17:08:31.476622] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:08:32.117633] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-22T17:08:32.253258] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T17:08:32.917774] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-22T17:08:33.267836] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T17:08:33.717752] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-22T17:08:34.178699] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-22T17:08:34.519760] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-22T17:08:34.534567] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T17:08:35.287741] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T17:08:35.317672] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-22T17:08:35.830732] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T17:08:36.117693] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-22T17:08:36.917692] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-22T17:08:37.011794] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T17:08:37.676289] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T17:08:37.717734] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-22T17:08:38.517694] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-22T17:08:38.669612] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T17:08:39.317802] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-22T17:08:39.381501] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T17:08:39.843859] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T17:08:40.117684] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-22T17:08:40.917732] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-22T17:08:41.255779] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-22T17:08:41.653603] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T17:08:41.717620] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-22T17:08:42.055387] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T17:08:42.517767] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-22T17:08:43.317731] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-22T17:08:43.468676] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T17:08:43.476280] [INFO ] [REMOTE ] AKR: Full fetch complete (65519 records). [2025-10-22T17:08:43.476401] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-22T17:08:43.856584] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-22T17:08:43.856716] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-22T17:08:43.857445] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-22T17:08:43.857570] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-22T17:08:43.859179] [DEBUG] [LOCAL ] AKR: Trimmed 65519 records to 46103 (keeping 200 days of data) [2025-10-22T17:08:43.974225] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T17:08:44.126979] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-22T17:08:44.173571] [DEBUG] [LOCAL ] AKR: Primary data saved (46103 records). [2025-10-22T17:08:44.174138] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-22T17:08:44.174926] [INFO ] [MAIN ] Update Progress: 75/2367 symbols completed. AKR took 32.5s. Estimated remaining: 4h 24m 37s. Rate: 8.7 symbols/min [2025-10-22T17:08:44.339524] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:08:44.385915] [DEBUG] [LOCAL ] ALC: Loaded 51216 existing records from primary storage. [2025-10-22T17:08:44.386218] [INFO ] [MAIN ] ALC: Loaded 51216 existing records. [2025-10-22T17:08:44.558764] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:08:44.558984] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-22T17:08:44.559031] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-22T17:08:44.559442] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-22T17:08:44.559478] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-22T17:08:44.909867] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:08:44.917633] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-22T17:08:45.445245] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-22T17:08:45.717679] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-22T17:08:45.755190] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T17:08:46.346928] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-22T17:08:46.355564] [INFO ] [REMOTE ] AL: Full fetch complete (63656 records). [2025-10-22T17:08:46.355786] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-22T17:08:46.528094] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-22T17:08:46.774986] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-22T17:08:46.775095] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-22T17:08:46.775880] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-22T17:08:46.775953] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-22T17:08:46.777836] [DEBUG] [LOCAL ] AL: Trimmed 63656 records to 44805 (keeping 200 days of data) [2025-10-22T17:08:47.060344] [DEBUG] [LOCAL ] AL: Primary data saved (44805 records). [2025-10-22T17:08:47.060501] [INFO ] [MAIN ] AL: Full history saved. [2025-10-22T17:08:47.061382] [INFO ] [MAIN ] Update Progress: 76/2367 symbols completed. AL took 23.0s. Estimated remaining: 4h 22m 29s. Rate: 8.7 symbols/min [2025-10-22T17:08:47.225174] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:08:47.256849] [DEBUG] [LOCAL ] ALE: Loaded 32060 existing records from primary storage. [2025-10-22T17:08:47.257201] [INFO ] [MAIN ] ALE: Loaded 32060 existing records. [2025-10-22T17:08:47.324077] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-22T17:08:47.432102] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:08:47.432321] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-22T17:08:47.432369] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-22T17:08:47.432545] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-22T17:08:47.432582] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-22T17:08:47.789875] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:08:47.905345] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-22T17:08:48.117684] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-22T17:08:48.353340] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T17:08:48.360790] [INFO ] [REMOTE ] AJG: Full fetch complete (68885 records). [2025-10-22T17:08:48.360922] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-22T17:08:48.777520] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-22T17:08:48.777726] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-22T17:08:48.778516] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-22T17:08:48.778606] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-22T17:08:48.780409] [DEBUG] [LOCAL ] AJG: Trimmed 68885 records to 46386 (keeping 200 days of data) [2025-10-22T17:08:48.918988] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-22T17:08:49.160630] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T17:08:49.272515] [DEBUG] [LOCAL ] AJG: Primary data saved (46386 records). [2025-10-22T17:08:49.272698] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-22T17:08:49.273598] [INFO ] [MAIN ] Update Progress: 77/2367 symbols completed. AJG took 46.1s. Estimated remaining: 4h 20m 3s. Rate: 8.8 symbols/min [2025-10-22T17:08:49.717761] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-22T17:08:50.021589] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T17:08:50.182913] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-22T17:08:50.517772] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-22T17:08:51.317674] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-22T17:08:51.412591] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T17:08:52.117756] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-22T17:08:52.410153] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T17:08:52.527023] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-22T17:08:52.917761] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-22T17:08:53.685592] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T17:08:53.717611] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-22T17:08:54.068563] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T17:08:54.517745] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-22T17:08:55.317683] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-22T17:08:55.461928] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T17:08:55.838119] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T17:08:56.117717] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-22T17:08:56.917727] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-22T17:08:57.798778] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-22T17:08:57.816727] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-22T17:08:57.835091] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-22T17:08:57.926461] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T17:08:58.517755] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-22T17:08:59.317638] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-22T17:08:59.655376] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T17:08:59.921498] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-22T17:09:00.117684] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-22T17:09:00.917631] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-22T17:09:01.295950] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-22T17:09:01.717626] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-22T17:09:01.995622] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T17:09:02.517744] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-22T17:09:03.142505] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-22T17:09:03.248275] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T17:09:03.317618] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-22T17:09:04.040269] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T17:09:04.117721] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-22T17:09:04.917749] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-22T17:09:05.121113] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T17:09:05.717761] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-22T17:09:06.378504] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T17:09:06.453842] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-22T17:09:06.462758] [INFO ] [REMOTE ] ALB: Full fetch complete (77074 records). [2025-10-22T17:09:06.462901] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-22T17:09:06.527209] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-22T17:09:06.861218] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-22T17:09:06.861302] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-22T17:09:06.862027] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-22T17:09:06.862092] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-22T17:09:06.863509] [DEBUG] [LOCAL ] ALB: Trimmed 77074 records to 53362 (keeping 200 days of data) [2025-10-22T17:09:07.209148] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T17:09:07.241833] [DEBUG] [LOCAL ] ALB: Primary data saved (53362 records). [2025-10-22T17:09:07.241980] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-22T17:09:07.242939] [INFO ] [MAIN ] Update Progress: 78/2367 symbols completed. ALB took 36.6s. Estimated remaining: 4h 25m 24s. Rate: 8.6 symbols/min [2025-10-22T17:09:07.317759] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-22T17:09:08.094434] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T17:09:08.100941] [INFO ] [REMOTE ] ALE: Full fetch complete (44363 records). [2025-10-22T17:09:08.101035] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-22T17:09:08.505413] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-22T17:09:08.505488] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-22T17:09:08.505957] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-22T17:09:08.506018] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-22T17:09:08.506937] [DEBUG] [LOCAL ] ALE: Trimmed 44363 records to 32075 (keeping 200 days of data) [2025-10-22T17:09:08.696461] [DEBUG] [LOCAL ] ALE: Primary data saved (32075 records). [2025-10-22T17:09:08.696612] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-22T17:09:08.696730] [INFO ] [MAIN ] Update Progress: 79/2367 symbols completed. ALE took 21.6s. Estimated remaining: 4h 22m 37s. Rate: 8.7 symbols/min [2025-10-22T17:09:09.241773] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-22T17:09:09.250694] [INFO ] [REMOTE ] ALC: Full fetch complete (73851 records). [2025-10-22T17:09:09.250852] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-22T17:09:09.642209] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-22T17:09:09.642297] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-22T17:09:09.643088] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-22T17:09:09.643152] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-22T17:09:09.644667] [DEBUG] [LOCAL ] ALC: Trimmed 73851 records to 51212 (keeping 200 days of data) [2025-10-22T17:09:09.942413] [DEBUG] [LOCAL ] ALC: Primary data saved (51212 records). [2025-10-22T17:09:09.942553] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-22T17:09:09.943159] [INFO ] [MAIN ] Update Progress: 80/2367 symbols completed. ALC took 25.8s. Estimated remaining: 4h 19m 49s. Rate: 8.8 symbols/min [2025-10-22T17:09:10.493948] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:10.567462] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:10.642904] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:10.646847] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:10.650106] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-22T17:09:10.650166] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-22T17:09:10.650252] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-22T17:09:10.650292] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-22T17:09:10.650341] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-22T17:09:10.650426] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-22T17:09:10.701407] [DEBUG] [LOCAL ] ALG: Loaded 9723 existing records from primary storage. [2025-10-22T17:09:10.726234] [INFO ] [MAIN ] ALG: Loaded 9723 existing records. [2025-10-22T17:09:10.889665] [DEBUG] [LOCAL ] ALEX: Loaded 30881 existing records from primary storage. [2025-10-22T17:09:10.945479] [INFO ] [MAIN ] ALEX: Loaded 30881 existing records. [2025-10-22T17:09:11.115924] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:09:11.196004] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-22T17:09:11.198197] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-22T17:09:11.247350] [DEBUG] [LOCAL ] ALIT: Loaded 52785 existing records from primary storage. [2025-10-22T17:09:11.258208] [INFO ] [MAIN ] ALIT: Loaded 52785 existing records. [2025-10-22T17:09:11.258009] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-22T17:09:11.297550] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-22T17:09:11.773184] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:09:11.827166] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-22T17:09:11.874440] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-22T17:09:11.910843] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:09:11.905815] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:11.945701] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-22T17:09:11.953296] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-22T17:09:11.953749] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-22T17:09:11.953627] [INFO ] [REMOTE ] ALH: Fetching primary data for 2025-01. [2025-10-22T17:09:11.954165] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-22T17:09:11.998300] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-22T17:09:12.035437] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-22T17:09:12.307781] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:09:12.383466] [WARN ] [REMOTE ] ALH: No data returned for month 2025-01 [2025-10-22T17:09:12.433731] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:09:12.491542] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-22T17:09:12.503905] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:12.573221] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:09:12.611394] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-22T17:09:12.664057] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-22T17:09:12.697320] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-22T17:09:12.707895] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-22T17:09:12.764279] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-22T17:09:12.782407] [INFO ] [MAIN ] Update Progress: 81/2367 symbols completed. ALH took 2.8s. Estimated remaining: 4h 17m 50s. Rate: 8.9 symbols/min [2025-10-22T17:09:13.001774] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:13.061104] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:13.062823] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-22T17:09:13.062013] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-22T17:09:13.145614] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:13.204425] [DEBUG] [LOCAL ] ALK: Loaded 53087 existing records from primary storage. [2025-10-22T17:09:13.204871] [INFO ] [MAIN ] ALK: Loaded 53087 existing records. [2025-10-22T17:09:13.386254] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:09:13.386535] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-22T17:09:13.386586] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-22T17:09:13.386847] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-22T17:09:13.386960] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-22T17:09:13.777530] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T17:09:13.783413] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:13.786783] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-22T17:09:13.787486] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-22T17:09:14.166957] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T17:09:14.172866] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-22T17:09:14.626829] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T17:09:14.643702] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T17:09:14.644295] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-22T17:09:14.647112] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-22T17:09:14.963940] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T17:09:15.203386] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T17:09:15.317784] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-22T17:09:15.592237] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T17:09:16.117745] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-22T17:09:16.150072] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T17:09:16.917631] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-22T17:09:16.957908] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T17:09:17.012238] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T17:09:17.717674] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-22T17:09:18.517631] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-22T17:09:18.534779] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T17:09:18.723792] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T17:09:19.317678] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-22T17:09:20.117675] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-22T17:09:20.312208] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T17:09:20.751999] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T17:09:20.768613] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-22T17:09:20.917667] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-22T17:09:21.717716] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-22T17:09:22.427266] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T17:09:22.517690] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-22T17:09:23.317691] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-22T17:09:23.540679] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T17:09:24.117753] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-22T17:09:24.278953] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T17:09:24.472194] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T17:09:24.923901] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-22T17:09:24.924739] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T17:09:25.717724] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-22T17:09:26.517722] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-22T17:09:26.742321] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T17:09:27.317678] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-22T17:09:27.517426] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T17:09:27.706602] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T17:09:28.057924] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T17:09:28.117759] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-22T17:09:28.887307] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T17:09:28.917612] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-22T17:09:29.638061] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-22T17:09:29.639788] [INFO ] [REMOTE ] ALG: Full fetch complete (15277 records). [2025-10-22T17:09:29.639857] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-22T17:09:29.722877] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-22T17:09:30.006715] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-22T17:09:30.006803] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-22T17:09:30.007069] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-22T17:09:30.007112] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-22T17:09:30.007721] [DEBUG] [LOCAL ] ALG: Trimmed 15277 records to 9714 (keeping 200 days of data) [2025-10-22T17:09:30.069548] [DEBUG] [LOCAL ] ALG: Primary data saved (9714 records). [2025-10-22T17:09:30.069717] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-22T17:09:30.069811] [INFO ] [MAIN ] Update Progress: 82/2367 symbols completed. ALG took 20.1s. Estimated remaining: 4h 22m 37s. Rate: 8.7 symbols/min [2025-10-22T17:09:30.242850] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:30.289024] [DEBUG] [LOCAL ] ALL: Loaded 49648 existing records from primary storage. [2025-10-22T17:09:30.289330] [INFO ] [MAIN ] ALL: Loaded 49648 existing records. [2025-10-22T17:09:30.465463] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:09:30.465709] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-22T17:09:30.465766] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-22T17:09:30.466093] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-22T17:09:30.466150] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-22T17:09:30.523711] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-22T17:09:30.819600] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:31.317720] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-22T17:09:31.524488] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:09:31.961254] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T17:09:32.117736] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-22T17:09:32.585810] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T17:09:32.917704] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-22T17:09:32.983541] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T17:09:33.717681] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-22T17:09:34.415361] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T17:09:34.517739] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-22T17:09:35.317628] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-22T17:09:35.653833] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T17:09:36.117678] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-22T17:09:36.307087] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T17:09:36.728314] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T17:09:36.917715] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-22T17:09:37.717742] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-22T17:09:37.870549] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T17:09:38.517637] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-22T17:09:38.916406] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-22T17:09:39.317685] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-22T17:09:39.536577] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T17:09:39.830996] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T17:09:39.838670] [INFO ] [REMOTE ] ALEX: Full fetch complete (44562 records). [2025-10-22T17:09:39.838794] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-22T17:09:40.124172] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-22T17:09:40.252183] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-22T17:09:40.252260] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-22T17:09:40.252743] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-22T17:09:40.252822] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-22T17:09:40.253764] [DEBUG] [LOCAL ] ALEX: Trimmed 44562 records to 30810 (keeping 200 days of data) [2025-10-22T17:09:40.435822] [DEBUG] [LOCAL ] ALEX: Primary data saved (30810 records). [2025-10-22T17:09:40.435948] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-22T17:09:40.436025] [INFO ] [MAIN ] Update Progress: 83/2367 symbols completed. ALEX took 30.5s. Estimated remaining: 4h 24m 5s. Rate: 8.6 symbols/min [2025-10-22T17:09:40.609066] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:40.658533] [DEBUG] [LOCAL ] ALLE: Loaded 43990 existing records from primary storage. [2025-10-22T17:09:40.658844] [INFO ] [MAIN ] ALLE: Loaded 43990 existing records. [2025-10-22T17:09:40.845245] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:09:40.845465] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-22T17:09:40.845513] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-22T17:09:40.846026] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-22T17:09:40.846084] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-22T17:09:40.922017] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-22T17:09:41.365748] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:41.395273] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-22T17:09:41.717670] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-22T17:09:41.808837] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:09:41.819099] [INFO ] [REMOTE ] ALIT: Full fetch complete (76623 records). [2025-10-22T17:09:41.819353] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-22T17:09:42.222880] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-22T17:09:42.222986] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-22T17:09:42.223752] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-22T17:09:42.223815] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-22T17:09:42.225208] [DEBUG] [LOCAL ] ALIT: Trimmed 76623 records to 52781 (keeping 200 days of data) [2025-10-22T17:09:42.518808] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-22T17:09:42.533222] [DEBUG] [LOCAL ] ALIT: Primary data saved (52781 records). [2025-10-22T17:09:42.533541] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-22T17:09:42.534356] [INFO ] [MAIN ] Update Progress: 84/2367 symbols completed. ALIT took 32.6s. Estimated remaining: 4h 21m 47s. Rate: 8.7 symbols/min [2025-10-22T17:09:42.699162] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T17:09:42.754529] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:42.806472] [DEBUG] [LOCAL ] ALLY: Loaded 53223 existing records from primary storage. [2025-10-22T17:09:42.806837] [INFO ] [MAIN ] ALLY: Loaded 53223 existing records. [2025-10-22T17:09:42.990408] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:09:42.990679] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-22T17:09:42.990742] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-22T17:09:42.990979] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-22T17:09:42.991036] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-22T17:09:43.322812] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-22T17:09:43.354606] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:43.488798] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T17:09:43.497499] [INFO ] [REMOTE ] ALK: Full fetch complete (77036 records). [2025-10-22T17:09:43.497632] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-22T17:09:43.884774] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-22T17:09:43.884861] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-22T17:09:43.885587] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-22T17:09:43.885686] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-22T17:09:43.887158] [DEBUG] [LOCAL ] ALK: Trimmed 77036 records to 53087 (keeping 200 days of data) [2025-10-22T17:09:44.119473] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-22T17:09:44.217051] [DEBUG] [LOCAL ] ALK: Primary data saved (53087 records). [2025-10-22T17:09:44.217285] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-22T17:09:44.217999] [INFO ] [MAIN ] Update Progress: 85/2367 symbols completed. ALK took 31.4s. Estimated remaining: 4h 19m 20s. Rate: 8.8 symbols/min [2025-10-22T17:09:44.231216] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T17:09:44.445577] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:09:44.486897] [DEBUG] [LOCAL ] ALSN: Loaded 43269 existing records from primary storage. [2025-10-22T17:09:44.487224] [INFO ] [MAIN ] ALSN: Loaded 43269 existing records. [2025-10-22T17:09:44.661601] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:09:44.661828] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-22T17:09:44.661915] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-22T17:09:44.662106] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-22T17:09:44.662145] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-22T17:09:44.920106] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-22T17:09:45.019990] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:09:45.210041] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T17:09:45.717636] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-22T17:09:46.143964] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-22T17:09:46.233366] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:09:46.517677] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-22T17:09:47.317724] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-22T17:09:47.474570] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T17:09:48.110423] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T17:09:48.123218] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-22T17:09:48.917669] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-22T17:09:49.020205] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T17:09:49.717822] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-22T17:09:50.517681] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-22T17:09:50.800855] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T17:09:50.900227] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-10-22T17:09:51.041996] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T17:09:51.317675] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-22T17:09:52.117754] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-22T17:09:52.317221] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T17:09:52.771155] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:09:52.917723] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-22T17:09:53.503342] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T17:09:53.717740] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-22T17:09:54.325325] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T17:09:54.517744] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-22T17:09:55.317758] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-22T17:09:56.110341] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T17:09:56.121195] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-22T17:09:56.148113] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-22T17:09:56.917631] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-22T17:09:57.032420] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T17:09:57.439595] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T17:09:57.717666] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-22T17:09:58.517745] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-22T17:09:59.322224] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-22T17:09:59.325105] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-22T17:09:59.389338] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T17:09:59.653802] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T17:10:00.117677] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-22T17:10:00.927944] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-22T17:10:00.934743] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T17:10:01.717744] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-22T17:10:02.085826] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T17:10:02.370888] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T17:10:02.517782] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-22T17:10:03.317724] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-22T17:10:03.732832] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T17:10:04.117685] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-22T17:10:04.317472] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T17:10:04.914866] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T17:10:04.917996] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-22T17:10:05.717633] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-22T17:10:06.090892] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-22T17:10:06.517616] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-22T17:10:06.703265] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T17:10:07.084524] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T17:10:07.317711] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-22T17:10:08.117683] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-22T17:10:08.483189] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-22T17:10:08.491304] [INFO ] [REMOTE ] ALL: Full fetch complete (72459 records). [2025-10-22T17:10:08.491471] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-22T17:10:08.886282] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-22T17:10:08.886360] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-22T17:10:08.887054] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-22T17:10:08.887117] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-22T17:10:08.888453] [DEBUG] [LOCAL ] ALL: Trimmed 72459 records to 49604 (keeping 200 days of data) [2025-10-22T17:10:08.944006] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-22T17:10:09.207620] [DEBUG] [LOCAL ] ALL: Primary data saved (49604 records). [2025-10-22T17:10:09.207904] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-22T17:10:09.208925] [INFO ] [MAIN ] Update Progress: 86/2367 symbols completed. ALL took 39.1s. Estimated remaining: 4h 27m 16s. Rate: 8.5 symbols/min [2025-10-22T17:10:09.355720] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T17:10:09.421310] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:09.459138] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-22T17:10:09.475548] [DEBUG] [LOCAL ] ALTG: Loaded 23188 existing records from primary storage. [2025-10-22T17:10:09.475916] [INFO ] [MAIN ] ALTG: Loaded 23188 existing records. [2025-10-22T17:10:09.652924] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:10:09.653195] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-22T17:10:09.653262] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-22T17:10:09.653464] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-22T17:10:09.653508] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-22T17:10:09.727446] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-22T17:10:10.011710] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:10.517772] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-22T17:10:10.828209] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T17:10:10.835123] [INFO ] [REMOTE ] ALLE: Full fetch complete (64954 records). [2025-10-22T17:10:10.835261] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-22T17:10:11.229173] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-22T17:10:11.229380] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-22T17:10:11.230180] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-22T17:10:11.230264] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-22T17:10:11.231702] [DEBUG] [LOCAL ] ALLE: Trimmed 64954 records to 43945 (keeping 200 days of data) [2025-10-22T17:10:11.336193] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-22T17:10:11.527578] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T17:10:11.568114] [DEBUG] [LOCAL ] ALLE: Primary data saved (43945 records). [2025-10-22T17:10:11.568269] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-22T17:10:11.569330] [INFO ] [MAIN ] Update Progress: 87/2367 symbols completed. ALLE took 31.1s. Estimated remaining: 4h 25m 6s. Rate: 8.6 symbols/min [2025-10-22T17:10:11.741726] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:11.753826] [DEBUG] [LOCAL ] ALUR: Loaded 9307 existing records from primary storage. [2025-10-22T17:10:11.754063] [INFO ] [MAIN ] ALUR: Loaded 9307 existing records. [2025-10-22T17:10:11.934528] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:10:11.934756] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-22T17:10:11.934806] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-22T17:10:11.934976] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-22T17:10:11.935030] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-22T17:10:12.139481] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-22T17:10:12.300321] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:12.478508] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T17:10:12.645861] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-22T17:10:12.654567] [INFO ] [REMOTE ] ALLY: Full fetch complete (77250 records). [2025-10-22T17:10:12.654729] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-22T17:10:12.922963] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-22T17:10:13.040784] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-22T17:10:13.040863] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-22T17:10:13.041575] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-22T17:10:13.041618] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-22T17:10:13.043098] [DEBUG] [LOCAL ] ALLY: Trimmed 77250 records to 53222 (keeping 200 days of data) [2025-10-22T17:10:13.378438] [DEBUG] [LOCAL ] ALLY: Primary data saved (53222 records). [2025-10-22T17:10:13.378635] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-22T17:10:13.379895] [INFO ] [MAIN ] Update Progress: 88/2367 symbols completed. ALLY took 30.8s. Estimated remaining: 4h 22m 45s. Rate: 8.7 symbols/min [2025-10-22T17:10:13.555419] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:13.595586] [DEBUG] [LOCAL ] ALV: Loaded 42182 existing records from primary storage. [2025-10-22T17:10:13.595915] [INFO ] [MAIN ] ALV: Loaded 42182 existing records. [2025-10-22T17:10:13.722880] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-22T17:10:13.773773] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:10:13.774352] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-22T17:10:13.774404] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-22T17:10:13.774582] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-22T17:10:13.774636] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-22T17:10:14.088914] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T17:10:14.149703] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:14.173018] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-22T17:10:14.517639] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-22T17:10:15.317684] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-22T17:10:16.117683] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-22T17:10:16.261948] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T17:10:16.300916] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-22T17:10:16.917627] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-22T17:10:17.175019] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T17:10:17.182043] [INFO ] [REMOTE ] ALSN: Full fetch complete (62401 records). [2025-10-22T17:10:17.182174] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-22T17:10:17.182964] [FATAL] [VALIDATOR ] ALSN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:10:17.183075] [FATAL] [MAIN ] ALSN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:10:17.183152] [WARN ] [MAIN ] ALSN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:10:17.183227] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-22T17:10:17.183318] [DEBUG] [LOCAL ] ALSN: No primary data file found to delete. [2025-10-22T17:10:17.183492] [INFO ] [LOCAL ] ALSN: Starting deletion of derivative data. [2025-10-22T17:10:17.183779] [DEBUG] [LOCAL ] ALSN: Deleted derivative data file. [2025-10-22T17:10:17.184436] [INFO ] [MAIN ] Update Progress: 89/2367 symbols completed. ALSN took 33.0s. Estimated remaining: 4h 21m 19s. Rate: 8.7 symbols/min [2025-10-22T17:10:17.364018] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:17.382212] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T17:10:17.394085] [DEBUG] [LOCAL ] ALX: Loaded 7228 existing records from primary storage. [2025-10-22T17:10:17.394294] [INFO ] [MAIN ] ALX: Loaded 7228 existing records. [2025-10-22T17:10:17.575233] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:10:17.575563] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-22T17:10:17.575623] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-22T17:10:17.575833] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-22T17:10:17.575892] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-22T17:10:17.722822] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-22T17:10:17.936969] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:18.517756] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-22T17:10:19.058614] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-22T17:10:19.317669] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-22T17:10:19.467838] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T17:10:20.073337] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T17:10:20.117628] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-22T17:10:20.491349] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T17:10:20.917716] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-22T17:10:21.185824] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T17:10:21.717632] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-22T17:10:22.106635] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-22T17:10:22.517736] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-22T17:10:23.041705] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-22T17:10:23.317715] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-22T17:10:23.355827] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T17:10:23.867004] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-22T17:10:24.117754] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-22T17:10:24.917728] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-22T17:10:24.980842] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-22T17:10:25.717731] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-22T17:10:26.104268] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-22T17:10:26.517684] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-22T17:10:27.294514] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-22T17:10:27.317622] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-22T17:10:27.898997] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T17:10:28.117677] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-22T17:10:28.917726] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-22T17:10:28.969822] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T17:10:29.401685] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-22T17:10:29.717667] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-22T17:10:30.063985] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T17:10:30.517752] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-22T17:10:31.307608] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T17:10:31.317626] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-22T17:10:31.370899] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-22T17:10:31.834167] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-22T17:10:32.117679] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-22T17:10:32.863913] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-22T17:10:32.917684] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-22T17:10:33.717671] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-22T17:10:33.913470] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T17:10:34.517675] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-22T17:10:34.625175] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T17:10:35.317682] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-22T17:10:35.521909] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T17:10:36.117720] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-22T17:10:36.849425] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-22T17:10:36.917627] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-22T17:10:37.114272] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T17:10:37.672713] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-22T17:10:37.677281] [INFO ] [REMOTE ] ALTG: Full fetch complete (33429 records). [2025-10-22T17:10:37.677367] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-22T17:10:37.722753] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-22T17:10:38.071923] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-22T17:10:38.072008] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-22T17:10:38.072403] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-22T17:10:38.072491] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-22T17:10:38.073274] [DEBUG] [LOCAL ] ALTG: Trimmed 33429 records to 23079 (keeping 200 days of data) [2025-10-22T17:10:38.195470] [DEBUG] [LOCAL ] ALTG: Primary data saved (23079 records). [2025-10-22T17:10:38.195592] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-22T17:10:38.195690] [INFO ] [MAIN ] Update Progress: 90/2367 symbols completed. ALTG took 29.0s. Estimated remaining: 4h 27m 9s. Rate: 8.5 symbols/min [2025-10-22T17:10:38.362372] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:38.410318] [DEBUG] [LOCAL ] AM: Loaded 51857 existing records from primary storage. [2025-10-22T17:10:38.410712] [INFO ] [MAIN ] AM: Loaded 51857 existing records. [2025-10-22T17:10:38.518949] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-22T17:10:38.599482] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:10:38.599712] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-22T17:10:38.599767] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-22T17:10:38.600244] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-22T17:10:38.600281] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-22T17:10:38.768759] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T17:10:38.969953] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:39.317683] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-22T17:10:40.117673] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-22T17:10:40.180717] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T17:10:40.836449] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-22T17:10:40.917678] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-22T17:10:41.064458] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T17:10:41.717776] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-22T17:10:41.720758] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-22T17:10:41.723041] [INFO ] [REMOTE ] ALUR: Full fetch complete (18319 records). [2025-10-22T17:10:41.723213] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-22T17:10:42.096458] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-22T17:10:42.096536] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-22T17:10:42.096852] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-22T17:10:42.096914] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-22T17:10:42.097437] [DEBUG] [LOCAL ] ALUR: Trimmed 18319 records to 9277 (keeping 200 days of data) [2025-10-22T17:10:42.149152] [DEBUG] [LOCAL ] ALUR: Primary data saved (9277 records). [2025-10-22T17:10:42.149293] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-22T17:10:42.149372] [INFO ] [MAIN ] Update Progress: 91/2367 symbols completed. ALUR took 30.6s. Estimated remaining: 4h 25m 45s. Rate: 8.6 symbols/min [2025-10-22T17:10:42.333562] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:42.367631] [DEBUG] [LOCAL ] AMBC: Loaded 36048 existing records from primary storage. [2025-10-22T17:10:42.367983] [INFO ] [MAIN ] AMBC: Loaded 36048 existing records. [2025-10-22T17:10:42.520138] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-22T17:10:42.563178] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:10:42.563843] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-22T17:10:42.563915] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-22T17:10:42.570297] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-22T17:10:42.570257] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-22T17:10:42.570489] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-22T17:10:42.930240] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:43.317718] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-22T17:10:44.117634] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-22T17:10:44.302787] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T17:10:44.501427] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T17:10:44.917718] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-22T17:10:45.044978] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T17:10:45.717685] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-22T17:10:46.127470] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T17:10:46.517637] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-22T17:10:46.623301] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T17:10:46.625562] [INFO ] [REMOTE ] ALX: Full fetch complete (8108 records). [2025-10-22T17:10:46.625634] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-22T17:10:47.019904] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-22T17:10:47.019996] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-22T17:10:47.020193] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-22T17:10:47.020230] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-22T17:10:47.020620] [DEBUG] [LOCAL ] ALX: Trimmed 8108 records to 7271 (keeping 200 days of data) [2025-10-22T17:10:47.064225] [DEBUG] [LOCAL ] ALX: Primary data saved (7271 records). [2025-10-22T17:10:47.064343] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-22T17:10:47.064415] [INFO ] [MAIN ] Update Progress: 92/2367 symbols completed. ALX took 29.9s. Estimated remaining: 4h 24m 46s. Rate: 8.6 symbols/min [2025-10-22T17:10:47.232126] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:47.271048] [DEBUG] [LOCAL ] AMBP: Loaded 44418 existing records from primary storage. [2025-10-22T17:10:47.271364] [INFO ] [MAIN ] AMBP: Loaded 44418 existing records. [2025-10-22T17:10:47.324353] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-22T17:10:47.448742] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:10:47.448944] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-22T17:10:47.448993] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-22T17:10:47.449223] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-22T17:10:47.449270] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-22T17:10:47.842083] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:48.117058] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T17:10:48.125829] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-22T17:10:48.917750] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-22T17:10:49.119019] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T17:10:49.717763] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-22T17:10:49.933989] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T17:10:50.517671] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-22T17:10:50.635377] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-22T17:10:51.317635] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-22T17:10:51.354375] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T17:10:51.582506] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T17:10:52.117712] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-22T17:10:52.881577] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T17:10:52.917626] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-22T17:10:53.379398] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T17:10:53.386665] [INFO ] [REMOTE ] ALV: Full fetch complete (62424 records). [2025-10-22T17:10:53.386787] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-22T17:10:53.727077] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-22T17:10:53.782228] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-22T17:10:53.782312] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-22T17:10:53.782947] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-22T17:10:53.783009] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-22T17:10:53.784284] [DEBUG] [LOCAL ] ALV: Trimmed 62424 records to 42191 (keeping 200 days of data) [2025-10-22T17:10:54.039971] [DEBUG] [LOCAL ] ALV: Primary data saved (42191 records). [2025-10-22T17:10:54.040103] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-22T17:10:54.040773] [INFO ] [MAIN ] Update Progress: 93/2367 symbols completed. ALV took 40.7s. Estimated remaining: 4h 24m 39s. Rate: 8.6 symbols/min [2025-10-22T17:10:54.203133] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:54.203295] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-22T17:10:54.203331] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-22T17:10:54.203442] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-22T17:10:54.203482] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-22T17:10:54.203521] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-22T17:10:54.203551] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-22T17:10:54.523058] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-22T17:10:54.560295] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:54.705566] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T17:10:55.317627] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-10-22T17:10:55.436873] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T17:10:55.513231] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:10:55.513485] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-10-22T17:10:55.513571] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:10:55.513616] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-22T17:10:55.513740] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:10:55.513817] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-22T17:10:55.513879] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-22T17:10:55.513914] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-22T17:10:55.513952] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-22T17:10:55.513995] [INFO ] [MAIN ] Update Progress: 94/2367 symbols completed. AMBQ took 1.5s. Estimated remaining: 4h 22m 19s. Rate: 8.7 symbols/min [2025-10-22T17:10:55.684729] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:10:55.734694] [DEBUG] [LOCAL ] AMC: Loaded 53766 existing records from primary storage. [2025-10-22T17:10:55.734999] [INFO ] [MAIN ] AMC: Loaded 53766 existing records. [2025-10-22T17:10:55.915483] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:10:55.915775] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-22T17:10:55.915831] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-22T17:10:55.916086] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-22T17:10:55.916122] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-22T17:10:56.075382] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T17:10:56.126720] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-22T17:10:56.294390] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:10:56.917759] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-22T17:10:57.518576] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T17:10:57.717723] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-22T17:10:58.517757] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-22T17:10:58.585994] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:10:59.317743] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-22T17:10:59.359690] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T17:10:59.907882] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-22T17:11:00.117763] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-22T17:11:00.917630] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-22T17:11:01.477830] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T17:11:01.582621] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-22T17:11:01.717638] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-22T17:11:02.434711] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T17:11:02.517719] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-22T17:11:03.317682] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-22T17:11:03.672591] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-22T17:11:03.672058] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-22T17:11:04.117714] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-22T17:11:04.573675] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T17:11:04.917638] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-22T17:11:05.717638] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-22T17:11:05.920383] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T17:11:06.517719] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-22T17:11:07.276079] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-22T17:11:07.317750] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-22T17:11:08.099758] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-22T17:11:08.117620] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-22T17:11:08.156319] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T17:11:08.166779] [INFO ] [REMOTE ] AMBC: Full fetch complete (51881 records). [2025-10-22T17:11:08.167046] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-22T17:11:08.573973] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-22T17:11:08.574066] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-22T17:11:08.574774] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-22T17:11:08.574844] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-22T17:11:08.576283] [DEBUG] [LOCAL ] AMBC: Trimmed 51881 records to 35885 (keeping 200 days of data) [2025-10-22T17:11:08.778479] [DEBUG] [LOCAL ] AMBC: Primary data saved (35885 records). [2025-10-22T17:11:08.778739] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-22T17:11:08.778913] [INFO ] [MAIN ] Update Progress: 95/2367 symbols completed. AMBC took 26.6s. Estimated remaining: 4h 24m 44s. Rate: 8.6 symbols/min [2025-10-22T17:11:08.929894] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-22T17:11:08.965478] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:11:08.997974] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T17:11:09.054619] [DEBUG] [LOCAL ] AMCR: Loaded 53670 existing records from primary storage. [2025-10-22T17:11:09.055012] [INFO ] [MAIN ] AMCR: Loaded 53670 existing records. [2025-10-22T17:11:09.268640] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:11:09.268897] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-22T17:11:09.268947] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-22T17:11:09.269131] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-22T17:11:09.269171] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-22T17:11:09.625010] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:11:09.651555] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T17:11:09.717683] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-22T17:11:10.517763] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-22T17:11:11.317632] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-22T17:11:11.387975] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-22T17:11:11.759719] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T17:11:12.117619] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-22T17:11:12.235102] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T17:11:12.917715] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-22T17:11:13.239461] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-22T17:11:13.717804] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-22T17:11:13.823378] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T17:11:13.830037] [INFO ] [REMOTE ] AMBP: Full fetch complete (64994 records). [2025-10-22T17:11:13.830182] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-22T17:11:14.211016] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-22T17:11:14.211134] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-22T17:11:14.211783] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-22T17:11:14.211845] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-22T17:11:14.213056] [DEBUG] [LOCAL ] AMBP: Trimmed 64994 records to 44318 (keeping 200 days of data) [2025-10-22T17:11:14.463051] [DEBUG] [LOCAL ] AMBP: Primary data saved (44318 records). [2025-10-22T17:11:14.463213] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-22T17:11:14.463869] [INFO ] [MAIN ] Update Progress: 96/2367 symbols completed. AMBP took 27.4s. Estimated remaining: 4h 24m 6s. Rate: 8.6 symbols/min [2025-10-22T17:11:14.526672] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-22T17:11:14.656479] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T17:11:14.673361] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:11:14.682318] [INFO ] [REMOTE ] AM: Full fetch complete (75675 records). [2025-10-22T17:11:14.682474] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-22T17:11:15.066290] [DEBUG] [LOCAL ] AME: Loaded 48489 existing records from primary storage. [2025-10-22T17:11:15.085124] [INFO ] [MAIN ] AME: Loaded 48489 existing records. [2025-10-22T17:11:15.103177] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-22T17:11:15.103254] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-22T17:11:15.146756] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-22T17:11:15.168910] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-22T17:11:15.219798] [DEBUG] [LOCAL ] AM: Trimmed 75675 records to 51849 (keeping 200 days of data) [2025-10-22T17:11:15.396567] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:11:15.406151] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-22T17:11:15.406251] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-22T17:11:15.409455] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-22T17:11:15.410057] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-22T17:11:15.901252] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:11:15.908790] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-22T17:11:15.982906] [DEBUG] [LOCAL ] AM: Primary data saved (51849 records). [2025-10-22T17:11:15.983182] [INFO ] [MAIN ] AM: Full history saved. [2025-10-22T17:11:15.984015] [INFO ] [MAIN ] Update Progress: 97/2367 symbols completed. AM took 37.8s. Estimated remaining: 4h 21m 51s. Rate: 8.7 symbols/min [2025-10-22T17:11:16.118370] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T17:11:16.140463] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-22T17:11:16.203451] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:11:16.236133] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-22T17:11:16.267447] [DEBUG] [LOCAL ] AMG: Loaded 20131 existing records from primary storage. [2025-10-22T17:11:16.267820] [INFO ] [MAIN ] AMG: Loaded 20131 existing records. [2025-10-22T17:11:16.474310] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:11:16.474520] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-22T17:11:16.474566] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-22T17:11:16.474807] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-22T17:11:16.474863] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-22T17:11:16.816526] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:11:16.917671] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-22T17:11:17.653875] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T17:11:17.717638] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-22T17:11:17.895957] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T17:11:18.156009] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T17:11:18.517782] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-22T17:11:19.317871] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-22T17:11:19.600848] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T17:11:19.992501] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-22T17:11:20.117731] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-22T17:11:20.803816] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T17:11:20.917679] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-22T17:11:21.587744] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T17:11:21.717711] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-22T17:11:22.517760] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-22T17:11:22.755171] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T17:11:23.317724] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-22T17:11:23.546184] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T17:11:24.117678] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-22T17:11:24.845134] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-22T17:11:24.917619] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-22T17:11:25.087724] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T17:11:25.150088] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-22T17:11:25.717726] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-22T17:11:26.517721] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-22T17:11:26.839317] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T17:11:27.148376] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-22T17:11:27.317670] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-22T17:11:28.117668] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-22T17:11:28.397876] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T17:11:28.917760] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-22T17:11:29.278311] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T17:11:29.707268] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-22T17:11:29.717716] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-22T17:11:30.517634] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-22T17:11:30.558535] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T17:11:31.317669] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-22T17:11:31.350296] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-22T17:11:31.567009] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T17:11:32.117763] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-22T17:11:32.917678] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-22T17:11:33.084485] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-22T17:11:33.717769] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-22T17:11:33.862422] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.54 seconds). [2025-10-22T17:11:33.874573] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-22T17:11:33.874787] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-22T17:11:34.287280] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-22T17:11:34.287376] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-22T17:11:34.288165] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-22T17:11:34.288232] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-22T17:11:34.289835] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 53766 (keeping 200 days of data) [2025-10-22T17:11:34.520903] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-22T17:11:34.603579] [DEBUG] [LOCAL ] AMC: Primary data saved (53766 records). [2025-10-22T17:11:34.603874] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-22T17:11:34.604919] [INFO ] [MAIN ] Update Progress: 98/2367 symbols completed. AMC took 39.1s. Estimated remaining: 4h 26m 15s. Rate: 8.5 symbols/min [2025-10-22T17:11:34.785286] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:11:34.785674] [DEBUG] [LOCAL ] AMH: No existing data file found in primary storage. [2025-10-22T17:11:34.785761] [WARN ] [MAIN ] AMH: No existing data found, performing full refresh instead. [2025-10-22T17:11:34.786068] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-22T17:11:34.786131] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-22T17:11:34.801054] [DEBUG] [LOCAL ] AMH: No primary data file found to delete. [2025-10-22T17:11:34.808082] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-22T17:11:34.892387] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T17:11:35.185914] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:11:35.317680] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-22T17:11:35.635530] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T17:11:35.995083] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-22T17:11:36.117753] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-22T17:11:36.663776] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T17:11:36.917753] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-22T17:11:37.717639] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-22T17:11:37.922720] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T17:11:38.517708] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-22T17:11:39.028764] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T17:11:39.266608] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-22T17:11:39.276083] [INFO ] [REMOTE ] AMCR: Full fetch complete (77843 records). [2025-10-22T17:11:39.276230] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-22T17:11:39.323224] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-22T17:11:39.665343] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-22T17:11:39.665478] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-22T17:11:39.666243] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-22T17:11:39.666308] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-22T17:11:39.667825] [DEBUG] [LOCAL ] AMCR: Trimmed 77843 records to 53670 (keeping 200 days of data) [2025-10-22T17:11:39.980732] [DEBUG] [LOCAL ] AMCR: Primary data saved (53670 records). [2025-10-22T17:11:39.980891] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-22T17:11:39.981547] [INFO ] [MAIN ] Update Progress: 99/2367 symbols completed. AMCR took 31.2s. Estimated remaining: 4h 25m 30s. Rate: 8.5 symbols/min [2025-10-22T17:11:40.121684] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-22T17:11:40.194263] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:11:40.194523] [DEBUG] [LOCAL ] AMN: No existing data file found in primary storage. [2025-10-22T17:11:40.194702] [WARN ] [MAIN ] AMN: No existing data found, performing full refresh instead. [2025-10-22T17:11:40.194837] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-22T17:11:40.194905] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-22T17:11:40.218858] [DEBUG] [LOCAL ] AMN: No primary data file found to delete. [2025-10-22T17:11:40.219045] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-22T17:11:40.238197] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T17:11:40.611496] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:11:40.917803] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-22T17:11:41.287005] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T17:11:41.438077] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T17:11:41.443536] [INFO ] [REMOTE ] AMG: Full fetch complete (29587 records). [2025-10-22T17:11:41.443761] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-22T17:11:41.727145] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-22T17:11:41.972303] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-22T17:11:41.972392] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-22T17:11:41.972809] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-22T17:11:41.972872] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-22T17:11:41.973683] [DEBUG] [LOCAL ] AMG: Trimmed 29587 records to 20036 (keeping 200 days of data) [2025-10-22T17:11:42.095821] [DEBUG] [LOCAL ] AMG: Primary data saved (20036 records). [2025-10-22T17:11:42.095923] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-22T17:11:42.095996] [INFO ] [MAIN ] Update Progress: 100/2367 symbols completed. AMG took 26.1s. Estimated remaining: 4h 23m 32s. Rate: 8.6 symbols/min [2025-10-22T17:11:42.261597] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:11:42.292604] [DEBUG] [LOCAL ] AMP: Loaded 31914 existing records from primary storage. [2025-10-22T17:11:42.292911] [INFO ] [MAIN ] AMP: Loaded 31914 existing records. [2025-10-22T17:11:42.469727] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:11:42.470037] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-22T17:11:42.470185] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-22T17:11:42.470469] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-22T17:11:42.470525] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-22T17:11:42.523769] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-22T17:11:42.825045] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T17:11:42.854922] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:11:43.317622] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-22T17:11:43.534839] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T17:11:44.117769] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-22T17:11:44.285226] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T17:11:44.789771] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T17:11:44.917668] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-22T17:11:45.713500] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T17:11:45.720671] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-22T17:11:46.517737] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-22T17:11:46.620933] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T17:11:47.317768] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-22T17:11:47.428004] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T17:11:48.090323] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T17:11:48.117620] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-22T17:11:48.917625] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-22T17:11:49.272408] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T17:11:49.281127] [INFO ] [REMOTE ] AME: Full fetch complete (70045 records). [2025-10-22T17:11:49.281314] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-22T17:11:49.702326] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-22T17:11:49.702508] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-22T17:11:49.703271] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-22T17:11:49.703350] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-22T17:11:49.704896] [DEBUG] [LOCAL ] AME: Trimmed 70045 records to 48418 (keeping 200 days of data) [2025-10-22T17:11:49.774962] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-22T17:11:49.831954] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T17:11:50.066247] [DEBUG] [LOCAL ] AME: Primary data saved (48418 records). [2025-10-22T17:11:50.066378] [INFO ] [MAIN ] AME: Full history saved. [2025-10-22T17:11:50.066855] [INFO ] [MAIN ] Update Progress: 101/2367 symbols completed. AME took 35.6s. Estimated remaining: 4h 23m 47s. Rate: 8.6 symbols/min [2025-10-22T17:11:50.256009] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:11:50.282473] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T17:11:50.336284] [DEBUG] [LOCAL ] AMPX: Loaded 52398 existing records from primary storage. [2025-10-22T17:11:50.336713] [INFO ] [MAIN ] AMPX: Loaded 52398 existing records. [2025-10-22T17:11:50.518056] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-22T17:11:50.532037] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:11:50.532302] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-22T17:11:50.532521] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-22T17:11:50.533575] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-22T17:11:50.533635] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-22T17:11:50.902695] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:11:51.317746] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-22T17:11:51.344477] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:11:52.117628] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-22T17:11:52.156187] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T17:11:52.917631] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-22T17:11:53.057462] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T17:11:53.619267] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T17:11:53.717625] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-22T17:11:54.517636] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-22T17:11:54.627607] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T17:11:55.317672] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-22T17:11:55.343869] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T17:11:56.117679] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-22T17:11:56.329336] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T17:11:56.917671] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-22T17:11:56.958406] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T17:11:57.717738] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-22T17:11:57.888886] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T17:11:58.517756] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-22T17:11:58.637047] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T17:11:59.202637] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-22T17:11:59.317631] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-22T17:11:59.871987] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T17:12:00.117707] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-22T17:12:00.917630] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-22T17:12:01.115770] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:12:01.717671] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-22T17:12:02.182805] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-22T17:12:02.446323] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-22T17:12:02.517675] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-22T17:12:03.161229] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T17:12:03.317703] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-22T17:12:04.013892] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T17:12:04.117613] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-22T17:12:04.917831] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-22T17:12:05.355257] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-22T17:12:05.517876] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-22T17:12:05.717681] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-22T17:12:06.517763] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-22T17:12:06.630629] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T17:12:07.317702] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-22T17:12:07.680979] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T17:12:07.687954] [INFO ] [REMOTE ] AMN: Full fetch complete (60224 records). [2025-10-22T17:12:07.688112] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-22T17:12:08.077980] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-22T17:12:08.078124] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-22T17:12:08.078802] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-22T17:12:08.078881] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-22T17:12:08.105844] [DEBUG] [LOCAL ] AMN: Trimmed 60224 records to 41641 (keeping 200 days of data) [2025-10-22T17:12:08.107996] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T17:12:08.118288] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-22T17:12:08.356785] [DEBUG] [LOCAL ] AMN: Primary data saved (41641 records). [2025-10-22T17:12:08.356951] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-22T17:12:08.357035] [INFO ] [MAIN ] Update Progress: 102/2367 symbols completed. AMN took 28.4s. Estimated remaining: 4h 27m 51s. Rate: 8.5 symbols/min [2025-10-22T17:12:08.521700] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:12:08.555155] [DEBUG] [LOCAL ] AMPY: Loaded 39389 existing records from primary storage. [2025-10-22T17:12:08.555425] [INFO ] [MAIN ] AMPY: Loaded 39389 existing records. [2025-10-22T17:12:08.726991] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:12:08.727197] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-22T17:12:08.727258] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-22T17:12:08.727606] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-22T17:12:08.727730] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-22T17:12:08.936223] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-22T17:12:09.090144] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:12:09.118211] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T17:12:09.647869] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T17:12:09.656596] [INFO ] [REMOTE ] AMH: Full fetch complete (75112 records). [2025-10-22T17:12:09.656790] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-22T17:12:09.722892] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-22T17:12:10.039906] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-22T17:12:10.040001] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-22T17:12:10.040729] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-22T17:12:10.040791] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-22T17:12:10.042284] [DEBUG] [LOCAL ] AMH: Trimmed 75112 records to 51830 (keeping 200 days of data) [2025-10-22T17:12:10.346585] [DEBUG] [LOCAL ] AMH: Primary data saved (51830 records). [2025-10-22T17:12:10.346736] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-22T17:12:10.346812] [INFO ] [MAIN ] Update Progress: 103/2367 symbols completed. AMH took 35.7s. Estimated remaining: 4h 25m 52s. Rate: 8.5 symbols/min [2025-10-22T17:12:10.513294] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:12:10.517666] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-22T17:12:10.543283] [DEBUG] [LOCAL ] AMR: Loaded 28870 existing records from primary storage. [2025-10-22T17:12:10.543604] [INFO ] [MAIN ] AMR: Loaded 28870 existing records. [2025-10-22T17:12:10.751775] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:12:10.760072] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-22T17:12:10.761043] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T17:12:10.760567] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-22T17:12:10.762851] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-22T17:12:10.766259] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-22T17:12:10.797142] [INFO ] [REMOTE ] AMP: Full fetch complete (47622 records). [2025-10-22T17:12:10.835133] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-22T17:12:11.497108] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:12:11.503509] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-22T17:12:11.522629] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T17:12:11.610289] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-22T17:12:11.610417] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-22T17:12:11.611095] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-22T17:12:11.611161] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-22T17:12:11.612563] [DEBUG] [LOCAL ] AMP: Trimmed 47622 records to 31807 (keeping 200 days of data) [2025-10-22T17:12:11.828910] [DEBUG] [LOCAL ] AMP: Primary data saved (31807 records). [2025-10-22T17:12:11.829057] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-22T17:12:11.829158] [INFO ] [MAIN ] Update Progress: 104/2367 symbols completed. AMP took 29.7s. Estimated remaining: 4h 23m 44s. Rate: 8.6 symbols/min [2025-10-22T17:12:11.995775] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:12:12.032155] [DEBUG] [LOCAL ] AMRC: Loaded 38589 existing records from primary storage. [2025-10-22T17:12:12.032448] [INFO ] [MAIN ] AMRC: Loaded 38589 existing records. [2025-10-22T17:12:12.121151] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-22T17:12:12.210797] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:12:12.211148] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-22T17:12:12.211207] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-22T17:12:12.211573] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-22T17:12:12.211618] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-22T17:12:12.567174] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:12:12.596233] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-22T17:12:12.764833] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T17:12:12.917715] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-22T17:12:13.252529] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T17:12:13.717728] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-22T17:12:13.993391] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T17:12:14.517752] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-22T17:12:15.104840] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T17:12:15.317736] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-22T17:12:16.117765] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-22T17:12:16.661594] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T17:12:16.838355] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-22T17:12:16.917633] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-22T17:12:17.454416] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T17:12:17.717714] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-22T17:12:18.517756] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-22T17:12:18.829837] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T17:12:18.946263] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-22T17:12:19.317771] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-22T17:12:20.024283] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T17:12:20.117714] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-22T17:12:20.466724] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T17:12:20.917716] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-22T17:12:21.717707] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-22T17:12:21.817761] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T17:12:22.268723] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T17:12:22.517728] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-22T17:12:23.317702] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-22T17:12:23.894553] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-22T17:12:23.932834] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T17:12:24.117752] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-22T17:12:24.833487] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T17:12:24.917791] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-22T17:12:25.717757] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-22T17:12:26.302017] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T17:12:26.389334] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-22T17:12:26.397804] [INFO ] [REMOTE ] AMPX: Full fetch complete (74856 records). [2025-10-22T17:12:26.397960] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-22T17:12:26.398800] [FATAL] [VALIDATOR ] AMPX: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:12:26.398894] [FATAL] [MAIN ] AMPX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:12:26.398937] [WARN ] [MAIN ] AMPX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:12:26.399023] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-22T17:12:26.399106] [DEBUG] [LOCAL ] AMPX: No primary data file found to delete. [2025-10-22T17:12:26.399145] [INFO ] [LOCAL ] AMPX: Starting deletion of derivative data. [2025-10-22T17:12:26.399391] [DEBUG] [LOCAL ] AMPX: Deleted derivative data file. [2025-10-22T17:12:26.400120] [INFO ] [MAIN ] Update Progress: 105/2367 symbols completed. AMPX took 36.3s. Estimated remaining: 4h 26m 20s. Rate: 8.5 symbols/min [2025-10-22T17:12:26.522853] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-22T17:12:26.573273] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:12:26.573441] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-22T17:12:26.573478] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-22T17:12:26.573589] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-22T17:12:26.573628] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-22T17:12:26.573710] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-22T17:12:26.573751] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-22T17:12:26.919466] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:12:27.221414] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T17:12:27.317675] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-10-22T17:12:27.543750] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:12:27.544038] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-10-22T17:12:27.544135] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:12:27.544180] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-22T17:12:27.544213] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:12:27.544249] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-22T17:12:27.544323] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-22T17:12:27.544359] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-22T17:12:27.544397] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-22T17:12:27.544441] [INFO ] [MAIN ] Update Progress: 106/2367 symbols completed. AMRZ took 1.1s. Estimated remaining: 4h 24m 7s. Rate: 8.6 symbols/min [2025-10-22T17:12:27.720194] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:12:27.774091] [DEBUG] [LOCAL ] AMT: Loaded 52448 existing records from primary storage. [2025-10-22T17:12:27.774393] [INFO ] [MAIN ] AMT: Loaded 52448 existing records. [2025-10-22T17:12:27.957995] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:12:27.958295] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-22T17:12:27.958385] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-22T17:12:27.958973] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-22T17:12:27.959033] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-22T17:12:28.123667] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-22T17:12:28.211790] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T17:12:28.355370] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:12:28.919338] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-22T17:12:29.717634] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-22T17:12:29.798313] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T17:12:30.523938] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-22T17:12:30.542604] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:12:31.068220] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T17:12:31.317734] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-22T17:12:32.075631] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T17:12:32.117664] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-22T17:12:32.633783] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T17:12:32.917782] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-22T17:12:33.428852] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T17:12:33.717753] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-22T17:12:34.410122] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T17:12:34.517707] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-22T17:12:35.160111] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T17:12:35.317755] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-22T17:12:35.887410] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T17:12:36.117733] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-22T17:12:36.636146] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T17:12:36.643281] [INFO ] [REMOTE ] AMRC: Full fetch complete (54595 records). [2025-10-22T17:12:36.643381] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-22T17:12:36.922835] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-22T17:12:37.042574] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-22T17:12:37.042673] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-22T17:12:37.043252] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-22T17:12:37.043295] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-22T17:12:37.044382] [DEBUG] [LOCAL ] AMRC: Trimmed 54595 records to 38551 (keeping 200 days of data) [2025-10-22T17:12:37.259622] [DEBUG] [LOCAL ] AMRC: Primary data saved (38551 records). [2025-10-22T17:12:37.259792] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-22T17:12:37.259874] [INFO ] [MAIN ] Update Progress: 107/2367 symbols completed. AMRC took 25.4s. Estimated remaining: 4h 24m 57s. Rate: 8.5 symbols/min [2025-10-22T17:12:37.444099] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:12:37.470563] [DEBUG] [LOCAL ] AMTB: Loaded 20430 existing records from primary storage. [2025-10-22T17:12:37.470920] [INFO ] [MAIN ] AMTB: Loaded 20430 existing records. [2025-10-22T17:12:37.676553] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:12:37.676830] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-22T17:12:37.676996] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-22T17:12:37.677184] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-22T17:12:37.677225] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-22T17:12:37.730393] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-22T17:12:38.048564] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:12:38.075929] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-22T17:12:38.239992] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-22T17:12:38.517755] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-22T17:12:39.044474] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T17:12:39.317636] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-22T17:12:39.723587] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T17:12:40.117717] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-22T17:12:40.917668] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-22T17:12:41.172493] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T17:12:41.182151] [INFO ] [REMOTE ] AMPY: Full fetch complete (53351 records). [2025-10-22T17:12:41.182312] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-22T17:12:41.614677] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-22T17:12:41.614770] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-22T17:12:41.615313] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-22T17:12:41.615354] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-22T17:12:41.616466] [DEBUG] [LOCAL ] AMPY: Trimmed 53351 records to 39376 (keeping 200 days of data) [2025-10-22T17:12:41.727867] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-22T17:12:41.854878] [DEBUG] [LOCAL ] AMPY: Primary data saved (39376 records). [2025-10-22T17:12:41.855013] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-22T17:12:41.855142] [INFO ] [MAIN ] Update Progress: 108/2367 symbols completed. AMPY took 33.5s. Estimated remaining: 4h 23m 59s. Rate: 8.6 symbols/min [2025-10-22T17:12:42.025973] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:12:42.031415] [DEBUG] [LOCAL ] AMTD: Loaded 3827 existing records from primary storage. [2025-10-22T17:12:42.031595] [INFO ] [MAIN ] AMTD: Loaded 3827 existing records. [2025-10-22T17:12:42.212682] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:12:42.213254] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-22T17:12:42.213471] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-22T17:12:42.213752] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-22T17:12:42.213954] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-22T17:12:42.370047] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-22T17:12:42.459682] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T17:12:42.521692] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-22T17:12:42.548165] [INFO ] [REMOTE ] AMR: Full fetch complete (40717 records). [2025-10-22T17:12:42.573510] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-22T17:12:42.767420] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:12:42.879718] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T17:12:43.080943] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-22T17:12:43.081027] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-22T17:12:43.081483] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-22T17:12:43.081522] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-22T17:12:43.082488] [DEBUG] [LOCAL ] AMR: Trimmed 40717 records to 28786 (keeping 200 days of data) [2025-10-22T17:12:43.253236] [DEBUG] [LOCAL ] AMR: Primary data saved (28786 records). [2025-10-22T17:12:43.253389] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-22T17:12:43.254148] [INFO ] [MAIN ] Update Progress: 109/2367 symbols completed. AMR took 32.9s. Estimated remaining: 4h 21m 55s. Rate: 8.6 symbols/min [2025-10-22T17:12:43.327784] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-22T17:12:43.423747] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:12:43.471541] [DEBUG] [LOCAL ] AMTM: Loaded 50302 existing records from primary storage. [2025-10-22T17:12:43.471890] [INFO ] [MAIN ] AMTM: Loaded 50302 existing records. [2025-10-22T17:12:43.644223] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:12:43.644428] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-22T17:12:43.644475] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-22T17:12:43.644689] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-22T17:12:43.644749] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-22T17:12:43.925689] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-22T17:12:44.001401] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:12:44.117625] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-22T17:12:44.528726] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T17:12:44.917679] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-22T17:12:45.412703] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-22T17:12:45.717624] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-22T17:12:45.834827] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-22T17:12:46.326280] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T17:12:46.517765] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-22T17:12:47.317705] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-22T17:12:48.117709] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-22T17:12:48.307597] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-22T17:12:48.358016] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T17:12:48.917675] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-22T17:12:49.717725] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-22T17:12:49.907719] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T17:12:50.163368] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-22T17:12:50.517742] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-22T17:12:51.317718] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-22T17:12:51.486866] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T17:12:51.952201] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T17:12:52.117699] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-22T17:12:52.511238] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T17:12:52.917631] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-22T17:12:53.530260] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-22T17:12:53.567601] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:12:53.717730] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-22T17:12:54.517632] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-22T17:12:54.681473] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T17:12:55.317721] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-22T17:12:56.117748] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-22T17:12:56.451402] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-22T17:12:56.496812] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T17:12:56.500450] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-22T17:12:56.917704] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-22T17:12:57.565540] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-22T17:12:57.717637] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-22T17:12:58.048584] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-22T17:12:58.517671] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-22T17:12:59.176138] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-22T17:12:59.317677] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-22T17:13:00.117753] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-22T17:13:00.418032] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T17:13:00.823623] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-22T17:13:00.917741] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-22T17:13:01.717742] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-22T17:13:01.873869] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T17:13:01.875273] [INFO ] [REMOTE ] AMTD: Full fetch complete (5422 records). [2025-10-22T17:13:01.875350] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-22T17:13:02.262290] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-22T17:13:02.262414] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-22T17:13:02.262581] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-22T17:13:02.262621] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-22T17:13:02.263014] [DEBUG] [LOCAL ] AMTD: Trimmed 5422 records to 3812 (keeping 200 days of data) [2025-10-22T17:13:02.284379] [DEBUG] [LOCAL ] AMTD: Primary data saved (3812 records). [2025-10-22T17:13:02.284467] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-22T17:13:02.284541] [INFO ] [MAIN ] Update Progress: 110/2367 symbols completed. AMTD took 20.4s. Estimated remaining: 4h 25m 56s. Rate: 8.5 symbols/min [2025-10-22T17:13:02.450872] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:13:02.460670] [DEBUG] [LOCAL ] AMWL: Loaded 9764 existing records from primary storage. [2025-10-22T17:13:02.460904] [INFO ] [MAIN ] AMWL: Loaded 9764 existing records. [2025-10-22T17:13:02.522780] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-22T17:13:02.634285] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:13:02.634492] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-22T17:13:02.634540] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-22T17:13:02.634712] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-22T17:13:02.634768] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-22T17:13:02.978739] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:13:03.317738] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-22T17:13:03.649535] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-22T17:13:04.117718] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-22T17:13:04.308530] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-22T17:13:04.483885] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-22T17:13:04.917751] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-22T17:13:05.109565] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T17:13:05.717675] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-22T17:13:06.517697] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-22T17:13:06.660459] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T17:13:06.664103] [INFO ] [REMOTE ] AMTB: Full fetch complete (29602 records). [2025-10-22T17:13:06.664238] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-22T17:13:07.072868] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-22T17:13:07.073081] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-22T17:13:07.074008] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-22T17:13:07.074107] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-22T17:13:07.101401] [DEBUG] [LOCAL ] AMTB: Trimmed 29602 records to 20336 (keeping 200 days of data) [2025-10-22T17:13:07.108326] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-22T17:13:07.240516] [DEBUG] [LOCAL ] AMTB: Primary data saved (20336 records). [2025-10-22T17:13:07.240666] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-22T17:13:07.240763] [INFO ] [MAIN ] Update Progress: 111/2367 symbols completed. AMTB took 30.0s. Estimated remaining: 4h 25m 6s. Rate: 8.5 symbols/min [2025-10-22T17:13:07.319226] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-22T17:13:07.350498] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-22T17:13:07.422689] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:13:07.468463] [DEBUG] [LOCAL ] AMX: Loaded 49203 existing records from primary storage. [2025-10-22T17:13:07.468820] [INFO ] [MAIN ] AMX: Loaded 49203 existing records. [2025-10-22T17:13:07.641215] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:13:07.641478] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-22T17:13:07.641535] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-22T17:13:07.641770] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-22T17:13:07.641826] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-22T17:13:07.983131] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:13:08.117634] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-22T17:13:08.917741] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-22T17:13:09.717666] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-22T17:13:09.761423] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-22T17:13:09.770123] [INFO ] [REMOTE ] AMT: Full fetch complete (76166 records). [2025-10-22T17:13:09.770249] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-22T17:13:10.066207] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T17:13:10.202315] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-22T17:13:10.202443] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-22T17:13:10.203226] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-22T17:13:10.203288] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-22T17:13:10.204732] [DEBUG] [LOCAL ] AMT: Trimmed 76166 records to 52430 (keeping 200 days of data) [2025-10-22T17:13:10.522584] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-22T17:13:10.525068] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T17:13:10.551237] [DEBUG] [LOCAL ] AMT: Primary data saved (52430 records). [2025-10-22T17:13:10.551358] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-22T17:13:10.551917] [INFO ] [MAIN ] Update Progress: 112/2367 symbols completed. AMT took 43.0s. Estimated remaining: 4h 23m 44s. Rate: 8.6 symbols/min [2025-10-22T17:13:10.719699] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:13:10.751606] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-22T17:13:10.784948] [DEBUG] [LOCAL ] AN: Loaded 31126 existing records from primary storage. [2025-10-22T17:13:10.785280] [INFO ] [MAIN ] AN: Loaded 31126 existing records. [2025-10-22T17:13:10.957977] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:13:10.958181] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-22T17:13:10.958228] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-22T17:13:10.958579] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-22T17:13:10.958635] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-22T17:13:11.309192] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:13:11.317676] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-22T17:13:12.117678] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-22T17:13:12.501679] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-22T17:13:12.917735] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-22T17:13:13.167167] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-22T17:13:13.722769] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-22T17:13:13.734848] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:13:14.517757] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-22T17:13:14.644288] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T17:13:14.809997] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-22T17:13:15.317732] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-22T17:13:15.861366] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T17:13:16.117729] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-22T17:13:16.813774] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-22T17:13:16.917668] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-22T17:13:17.259619] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T17:13:17.717674] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-22T17:13:18.517750] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-22T17:13:18.644266] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T17:13:19.197356] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T17:13:19.317710] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-22T17:13:20.117730] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-22T17:13:20.192392] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T17:13:20.761819] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T17:13:20.833536] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T17:13:20.917629] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-22T17:13:21.680543] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-22T17:13:21.717675] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-22T17:13:22.517725] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-22T17:13:23.317672] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-22T17:13:23.437132] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T17:13:24.088559] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T17:13:24.117677] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-22T17:13:24.729381] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T17:13:24.737531] [INFO ] [REMOTE ] AMTM: Full fetch complete (73626 records). [2025-10-22T17:13:24.737709] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-22T17:13:24.919092] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-22T17:13:25.163290] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-22T17:13:25.163396] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-22T17:13:25.164395] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-22T17:13:25.164474] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-22T17:13:25.166574] [DEBUG] [LOCAL ] AMTM: Trimmed 73626 records to 50253 (keeping 200 days of data) [2025-10-22T17:13:25.553591] [DEBUG] [LOCAL ] AMTM: Primary data saved (50253 records). [2025-10-22T17:13:25.553873] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-22T17:13:25.554825] [INFO ] [MAIN ] Update Progress: 113/2367 symbols completed. AMTM took 42.3s. Estimated remaining: 4h 26m 16s. Rate: 8.5 symbols/min [2025-10-22T17:13:25.718362] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-22T17:13:25.826815] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:13:25.839482] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-22T17:13:25.886630] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T17:13:25.948079] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-22T17:13:25.948429] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-22T17:13:26.135669] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:13:26.135946] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-22T17:13:26.136009] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-22T17:13:26.136403] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-22T17:13:26.136461] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-22T17:13:26.484417] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:13:26.517618] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-22T17:13:26.973344] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T17:13:27.317714] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-22T17:13:28.117769] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-22T17:13:28.805934] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-22T17:13:28.887453] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T17:13:28.917633] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-22T17:13:28.929249] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T17:13:29.717767] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-22T17:13:30.517749] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-22T17:13:30.698982] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T17:13:30.702286] [INFO ] [REMOTE ] AMWL: Full fetch complete (14810 records). [2025-10-22T17:13:30.702371] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-22T17:13:31.061003] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-22T17:13:31.061201] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-22T17:13:31.061545] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-22T17:13:31.061627] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-22T17:13:31.062490] [DEBUG] [LOCAL ] AMWL: Trimmed 14810 records to 9814 (keeping 200 days of data) [2025-10-22T17:13:31.115027] [DEBUG] [LOCAL ] AMWL: Primary data saved (9814 records). [2025-10-22T17:13:31.115149] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-22T17:13:31.115230] [INFO ] [MAIN ] Update Progress: 114/2367 symbols completed. AMWL took 28.8s. Estimated remaining: 4h 25m 39s. Rate: 8.5 symbols/min [2025-10-22T17:13:31.286832] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:13:31.317758] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-22T17:13:31.337031] [DEBUG] [LOCAL ] ANF: Loaded 52051 existing records from primary storage. [2025-10-22T17:13:31.337443] [INFO ] [MAIN ] ANF: Loaded 52051 existing records. [2025-10-22T17:13:31.549129] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-10-22T17:13:31.553054] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:13:31.563573] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-22T17:13:31.564300] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-22T17:13:31.564748] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-22T17:13:31.564805] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-22T17:13:31.927838] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:13:31.949312] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T17:13:32.117715] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-22T17:13:32.917627] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-22T17:13:33.024182] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T17:13:33.717631] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-22T17:13:34.331524] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T17:13:34.420165] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-22T17:13:34.517771] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-22T17:13:35.317760] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-22T17:13:35.718474] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T17:13:35.751956] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T17:13:36.117781] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-22T17:13:36.917721] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-22T17:13:37.718151] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-22T17:13:37.720890] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-22T17:13:37.907618] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T17:13:38.220183] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-22T17:13:38.225256] [INFO ] [REMOTE ] AN: Full fetch complete (47089 records). [2025-10-22T17:13:38.225351] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-22T17:13:38.522874] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-22T17:13:38.599214] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-22T17:13:38.599292] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-22T17:13:38.599924] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-22T17:13:38.599997] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-22T17:13:38.601003] [DEBUG] [LOCAL ] AN: Trimmed 47089 records to 31030 (keeping 200 days of data) [2025-10-22T17:13:38.782581] [DEBUG] [LOCAL ] AN: Primary data saved (31030 records). [2025-10-22T17:13:38.782740] [INFO ] [MAIN ] AN: Full history saved. [2025-10-22T17:13:38.782826] [INFO ] [MAIN ] Update Progress: 115/2367 symbols completed. AN took 28.2s. Estimated remaining: 4h 25m 43s. Rate: 8.5 symbols/min [2025-10-22T17:13:38.951232] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:13:38.951432] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-22T17:13:38.951500] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-22T17:13:38.951614] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-22T17:13:38.951683] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-22T17:13:38.951742] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-22T17:13:38.951796] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-22T17:13:39.322783] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-22T17:13:39.336634] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:13:39.546897] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-22T17:13:40.117676] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-10-22T17:13:40.313899] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:13:40.314204] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-10-22T17:13:40.314307] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:13:40.314356] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-22T17:13:40.314418] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:13:40.314489] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-22T17:13:40.314551] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-22T17:13:40.314586] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-22T17:13:40.314624] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-22T17:13:40.314731] [INFO ] [MAIN ] Update Progress: 116/2367 symbols completed. ANGX took 1.5s. Estimated remaining: 4h 23m 49s. Rate: 8.5 symbols/min [2025-10-22T17:13:40.494926] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:13:40.514116] [DEBUG] [LOCAL ] ANRO: Loaded 19651 existing records from primary storage. [2025-10-22T17:13:40.514361] [INFO ] [MAIN ] ANRO: Loaded 19651 existing records. [2025-10-22T17:13:40.704215] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:13:40.704529] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-22T17:13:40.704587] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-22T17:13:40.704791] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-22T17:13:40.704852] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-22T17:13:40.922843] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-22T17:13:41.106577] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:13:41.131081] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T17:13:41.158071] [INFO ] [REMOTE ] AMX: Full fetch complete (71033 records). [2025-10-22T17:13:41.174171] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-22T17:13:41.246258] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-22T17:13:41.575955] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-22T17:13:41.576034] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-22T17:13:41.576742] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-22T17:13:41.576804] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-22T17:13:41.578192] [DEBUG] [LOCAL ] AMX: Trimmed 71033 records to 49176 (keeping 200 days of data) [2025-10-22T17:13:41.745359] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-22T17:13:41.869301] [DEBUG] [LOCAL ] AMX: Primary data saved (49176 records). [2025-10-22T17:13:41.869456] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-22T17:13:41.869564] [INFO ] [MAIN ] Update Progress: 117/2367 symbols completed. AMX took 34.6s. Estimated remaining: 4h 21m 56s. Rate: 8.6 symbols/min [2025-10-22T17:13:42.517727] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-22T17:13:42.765754] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T17:13:43.317772] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-22T17:13:43.580560] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-22T17:13:43.759420] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-22T17:13:44.117664] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-22T17:13:44.895332] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T17:13:44.917618] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-22T17:13:45.717672] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-22T17:13:46.518315] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-22T17:13:46.530244] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-22T17:13:46.618944] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T17:13:46.887066] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T17:13:47.317775] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-22T17:13:48.117720] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-22T17:13:48.714586] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-22T17:13:48.917667] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-22T17:13:49.161055] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-22T17:13:49.376176] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T17:13:49.717719] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-22T17:13:50.517716] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-22T17:13:50.900503] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T17:13:51.023797] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-22T17:13:51.317723] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-22T17:13:52.034437] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T17:13:52.117612] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-22T17:13:52.621185] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-22T17:13:52.917766] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-22T17:13:53.259896] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T17:13:53.717707] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-22T17:13:53.802679] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-22T17:13:53.811391] [INFO ] [REMOTE ] ANET: Full fetch complete (77945 records). [2025-10-22T17:13:53.811526] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-22T17:13:54.201175] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-22T17:13:54.201269] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-22T17:13:54.202089] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-22T17:13:54.202157] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-22T17:13:54.203721] [DEBUG] [LOCAL ] ANET: Trimmed 77945 records to 53766 (keeping 200 days of data) [2025-10-22T17:13:54.516795] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-10-22T17:13:54.516918] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-22T17:13:54.517624] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-22T17:13:54.517593] [INFO ] [MAIN ] Update Progress: 118/2367 symbols completed. ANET took 29.0s. Estimated remaining: 4h 23m 37s. Rate: 8.5 symbols/min [2025-10-22T17:13:54.881393] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-22T17:13:55.317768] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-22T17:13:56.259033] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T17:13:56.262802] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-22T17:13:56.346212] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T17:13:56.816501] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-22T17:13:56.917626] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-22T17:13:57.717701] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-22T17:13:58.738309] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T17:13:58.749046] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-22T17:13:58.793842] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T17:13:58.799428] [INFO ] [REMOTE ] ANRO: Full fetch complete (30348 records). [2025-10-22T17:13:58.799512] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-22T17:13:59.198187] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-22T17:13:59.198281] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-22T17:13:59.198740] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-22T17:13:59.198802] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-22T17:13:59.199536] [DEBUG] [LOCAL ] ANRO: Trimmed 30348 records to 19715 (keeping 200 days of data) [2025-10-22T17:13:59.310259] [DEBUG] [LOCAL ] ANRO: Primary data saved (19715 records). [2025-10-22T17:13:59.310393] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-22T17:13:59.310471] [INFO ] [MAIN ] Update Progress: 119/2367 symbols completed. ANRO took 19.0s. Estimated remaining: 4h 22m 48s. Rate: 8.6 symbols/min [2025-10-22T17:14:00.870417] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T17:14:00.879871] [INFO ] [REMOTE ] ANF: Full fetch complete (75790 records). [2025-10-22T17:14:00.880022] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-22T17:14:01.268055] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-22T17:14:01.268151] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-22T17:14:01.268946] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-22T17:14:01.269013] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-22T17:14:01.270460] [DEBUG] [LOCAL ] ANF: Trimmed 75790 records to 52040 (keeping 200 days of data) [2025-10-22T17:14:01.573724] [DEBUG] [LOCAL ] ANF: Primary data saved (52040 records). [2025-10-22T17:14:01.574062] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-22T17:14:01.574707] [INFO ] [MAIN ] Update Progress: 120/2367 symbols completed. ANF took 30.5s. Estimated remaining: 4h 21m 12s. Rate: 8.6 symbols/min [2025-10-22T17:14:02.268559] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:02.327499] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:02.328400] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:02.320446] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-22T17:14:02.335688] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-22T17:14:02.355267] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-22T17:14:02.354935] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:02.355413] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-22T17:14:02.355682] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-22T17:14:02.355868] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-22T17:14:02.508772] [DEBUG] [LOCAL ] AOMR: Loaded 16383 existing records from primary storage. [2025-10-22T17:14:02.547423] [INFO ] [MAIN ] AOMR: Loaded 16383 existing records. [2025-10-22T17:14:02.555208] [DEBUG] [LOCAL ] ANVS: Loaded 23984 existing records from primary storage. [2025-10-22T17:14:02.576897] [INFO ] [MAIN ] ANVS: Loaded 23984 existing records. [2025-10-22T17:14:02.840858] [DEBUG] [LOCAL ] AOD: Loaded 30971 existing records from primary storage. [2025-10-22T17:14:02.891599] [INFO ] [MAIN ] AOD: Loaded 30971 existing records. [2025-10-22T17:14:03.209246] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:03.259210] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:03.279167] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:03.276155] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-22T17:14:03.279574] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-22T17:14:03.285436] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-10-22T17:14:03.279502] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-22T17:14:03.302720] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-22T17:14:03.320331] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-22T17:14:03.307970] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-22T17:14:03.391347] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-22T17:14:03.361197] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:03.391565] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-22T17:14:03.464722] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-22T17:14:03.497042] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-22T17:14:03.565368] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-22T17:14:03.568747] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-22T17:14:03.596296] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:14:03.718531] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-10-22T17:14:03.767566] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:14:03.825673] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-22T17:14:03.834489] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:14:03.873293] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-22T17:14:03.915455] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-22T17:14:03.953899] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-22T17:14:04.045540] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-22T17:14:04.086175] [INFO ] [MAIN ] Update Progress: 121/2367 symbols completed. AOMD took 2.5s. Estimated remaining: 4h 19m 42s. Rate: 8.6 symbols/min [2025-10-22T17:14:04.280453] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:04.338225] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-22T17:14:04.482315] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:04.529932] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-22T17:14:04.609676] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:04.634341] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:04.634950] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-22T17:14:04.672491] [DEBUG] [LOCAL ] AON: Loaded 45103 existing records from primary storage. [2025-10-22T17:14:04.672801] [INFO ] [MAIN ] AON: Loaded 45103 existing records. [2025-10-22T17:14:04.845624] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:04.845837] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-22T17:14:04.845915] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-22T17:14:04.846398] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-22T17:14:04.846458] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-22T17:14:05.139752] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T17:14:05.152777] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-22T17:14:05.208639] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:05.209351] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-22T17:14:05.930740] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T17:14:05.936938] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-22T17:14:05.951573] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-22T17:14:05.955726] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-22T17:14:06.204086] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T17:14:06.212421] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-22T17:14:06.817455] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-22T17:14:06.821578] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-22T17:14:07.046187] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T17:14:07.130183] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T17:14:07.317750] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-22T17:14:07.351614] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-22T17:14:07.632614] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T17:14:08.117726] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-22T17:14:08.917713] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-22T17:14:09.020814] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T17:14:09.257025] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T17:14:09.717732] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-22T17:14:10.006044] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T17:14:10.517734] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-22T17:14:11.317633] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-22T17:14:11.336586] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-22T17:14:11.483248] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T17:14:12.117742] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-22T17:14:12.274999] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-22T17:14:12.917628] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-22T17:14:12.954093] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-22T17:14:13.717762] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-22T17:14:13.859505] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T17:14:14.517780] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-22T17:14:15.317799] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-22T17:14:15.355907] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T17:14:15.847032] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T17:14:16.117670] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-22T17:14:16.296207] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T17:14:16.917732] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-22T17:14:17.561416] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T17:14:17.717696] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-22T17:14:18.424014] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T17:14:18.517708] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-22T17:14:18.963209] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T17:14:19.317735] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-22T17:14:20.123499] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-22T17:14:20.128579] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T17:14:20.232211] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T17:14:20.917753] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-22T17:14:21.462217] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-22T17:14:21.717716] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-22T17:14:22.426531] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T17:14:22.429012] [INFO ] [REMOTE ] AOMR: Full fetch complete (23201 records). [2025-10-22T17:14:22.429082] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-22T17:14:22.519448] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-22T17:14:22.629466] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T17:14:22.834480] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-22T17:14:22.834579] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-22T17:14:22.834955] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-22T17:14:22.835016] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-22T17:14:22.835561] [DEBUG] [LOCAL ] AOMR: Trimmed 23201 records to 16310 (keeping 200 days of data) [2025-10-22T17:14:22.929568] [DEBUG] [LOCAL ] AOMR: Primary data saved (16310 records). [2025-10-22T17:14:22.929720] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-22T17:14:22.929806] [INFO ] [MAIN ] Update Progress: 122/2367 symbols completed. AOMR took 21.3s. Estimated remaining: 4h 23m 14s. Rate: 8.5 symbols/min [2025-10-22T17:14:23.096691] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:23.121565] [DEBUG] [LOCAL ] AORT: Loaded 28922 existing records from primary storage. [2025-10-22T17:14:23.121829] [INFO ] [MAIN ] AORT: Loaded 28922 existing records. [2025-10-22T17:14:23.292978] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:23.293140] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-22T17:14:23.293187] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-22T17:14:23.293379] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-22T17:14:23.293435] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-22T17:14:23.323409] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-22T17:14:23.644782] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:23.868687] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T17:14:24.117720] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-22T17:14:24.595028] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-22T17:14:24.917626] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-22T17:14:24.987318] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T17:14:25.717709] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-22T17:14:26.517631] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-22T17:14:26.662324] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T17:14:27.024468] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T17:14:27.317742] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-22T17:14:27.849849] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T17:14:28.117694] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-22T17:14:28.699382] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T17:14:28.917712] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-22T17:14:29.478745] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T17:14:29.717706] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-22T17:14:30.231274] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:14:30.517730] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-22T17:14:31.317669] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-22T17:14:31.443382] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:14:31.915800] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T17:14:31.922468] [INFO ] [REMOTE ] AOD: Full fetch complete (44924 records). [2025-10-22T17:14:31.922624] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-22T17:14:32.122806] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-22T17:14:32.319126] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-22T17:14:32.319231] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-22T17:14:32.319915] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-22T17:14:32.320041] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-22T17:14:32.321212] [DEBUG] [LOCAL ] AOD: Trimmed 44924 records to 30865 (keeping 200 days of data) [2025-10-22T17:14:32.515778] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T17:14:32.517274] [DEBUG] [LOCAL ] AOD: Primary data saved (30865 records). [2025-10-22T17:14:32.522634] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-22T17:14:32.523421] [INFO ] [MAIN ] Update Progress: 123/2367 symbols completed. AOD took 30.9s. Estimated remaining: 4h 23m 54s. Rate: 8.5 symbols/min [2025-10-22T17:14:32.704556] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:32.753634] [DEBUG] [LOCAL ] AOS: Loaded 48651 existing records from primary storage. [2025-10-22T17:14:32.754091] [INFO ] [MAIN ] AOS: Loaded 48651 existing records. [2025-10-22T17:14:32.938604] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-22T17:14:33.009021] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:33.009364] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-22T17:14:33.009440] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-22T17:14:33.010071] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-22T17:14:33.010145] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-22T17:14:33.590128] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:33.610510] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T17:14:33.717735] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-22T17:14:34.517736] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-22T17:14:34.914984] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T17:14:34.922293] [INFO ] [REMOTE ] AON: Full fetch complete (65156 records). [2025-10-22T17:14:34.935851] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-22T17:14:34.937048] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-22T17:14:34.986339] [INFO ] [REMOTE ] ANVS: Full fetch complete (36884 records). [2025-10-22T17:14:35.013421] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-22T17:14:35.341926] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-22T17:14:35.695120] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-22T17:14:35.695534] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-22T17:14:35.712959] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-22T17:14:35.713081] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-22T17:14:35.727016] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-22T17:14:35.727194] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-22T17:14:35.727714] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-22T17:14:35.727798] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-22T17:14:35.728552] [DEBUG] [LOCAL ] AON: Trimmed 65156 records to 45033 (keeping 200 days of data) [2025-10-22T17:14:35.729712] [DEBUG] [LOCAL ] ANVS: Trimmed 36884 records to 23982 (keeping 200 days of data) [2025-10-22T17:14:36.102454] [DEBUG] [LOCAL ] ANVS: Primary data saved (23982 records). [2025-10-22T17:14:36.104086] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-22T17:14:36.105624] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T17:14:36.112136] [INFO ] [MAIN ] Update Progress: 124/2367 symbols completed. ANVS took 34.5s. Estimated remaining: 4h 22m 44s. Rate: 8.5 symbols/min [2025-10-22T17:14:36.137754] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-22T17:14:36.353221] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:36.363205] [DEBUG] [LOCAL ] AON: Primary data saved (45033 records). [2025-10-22T17:14:36.363438] [INFO ] [MAIN ] AON: Full history saved. [2025-10-22T17:14:36.363548] [INFO ] [MAIN ] Update Progress: 125/2367 symbols completed. AON took 32.2s. Estimated remaining: 4h 20m 35s. Rate: 8.6 symbols/min [2025-10-22T17:14:36.451045] [DEBUG] [LOCAL ] AP: Loaded 7409 existing records from primary storage. [2025-10-22T17:14:36.467712] [INFO ] [MAIN ] AP: Loaded 7409 existing records. [2025-10-22T17:14:36.710434] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:36.740792] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:36.741108] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-22T17:14:36.741162] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-22T17:14:36.741318] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-22T17:14:36.741373] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-22T17:14:37.003417] [DEBUG] [LOCAL ] APAM: Loaded 35815 existing records from primary storage. [2025-10-22T17:14:37.020533] [INFO ] [MAIN ] APAM: Loaded 35815 existing records. [2025-10-22T17:14:37.293362] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:37.299237] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-22T17:14:37.344725] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:37.345269] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-22T17:14:37.345382] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-22T17:14:37.345895] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-22T17:14:37.368681] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-22T17:14:37.440967] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-22T17:14:37.734253] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-22T17:14:37.774821] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:37.777345] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T17:14:38.058631] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T17:14:38.517635] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-22T17:14:39.317736] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-22T17:14:39.447480] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T17:14:39.799982] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-22T17:14:40.117628] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-22T17:14:40.746866] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T17:14:40.917734] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-22T17:14:41.695592] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T17:14:41.717638] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-22T17:14:42.257503] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T17:14:42.517726] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-22T17:14:43.317708] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-22T17:14:43.464424] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T17:14:43.627092] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T17:14:43.652070] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-22T17:14:44.117742] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-22T17:14:44.917749] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-22T17:14:45.463790] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-22T17:14:45.489408] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T17:14:45.717724] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-22T17:14:46.517740] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-22T17:14:46.812081] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T17:14:47.317715] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-22T17:14:47.628557] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T17:14:48.117736] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-22T17:14:48.253684] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T17:14:48.258421] [INFO ] [REMOTE ] AORT: Full fetch complete (42497 records). [2025-10-22T17:14:48.258514] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-22T17:14:48.649298] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-22T17:14:48.649371] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-22T17:14:48.649852] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-22T17:14:48.649913] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-22T17:14:48.650762] [DEBUG] [LOCAL ] AORT: Trimmed 42497 records to 28916 (keeping 200 days of data) [2025-10-22T17:14:48.813846] [DEBUG] [LOCAL ] AORT: Primary data saved (28916 records). [2025-10-22T17:14:48.813994] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-22T17:14:48.814116] [INFO ] [MAIN ] Update Progress: 126/2367 symbols completed. AORT took 25.9s. Estimated remaining: 4h 22m 6s. Rate: 8.6 symbols/min [2025-10-22T17:14:48.922893] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-22T17:14:48.981587] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:14:49.021459] [DEBUG] [LOCAL ] APD: Loaded 45477 existing records from primary storage. [2025-10-22T17:14:49.021783] [INFO ] [MAIN ] APD: Loaded 45477 existing records. [2025-10-22T17:14:49.214669] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:14:49.214854] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-22T17:14:49.214901] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-22T17:14:49.215342] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-22T17:14:49.215400] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-22T17:14:49.572140] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:14:49.600844] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-22T17:14:49.636464] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-22T17:14:49.717616] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-22T17:14:50.517725] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-22T17:14:51.317771] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-22T17:14:51.466536] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T17:14:52.117734] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-22T17:14:52.252791] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T17:14:52.656548] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-22T17:14:52.917767] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-22T17:14:53.406674] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-22T17:14:53.717738] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-22T17:14:54.065860] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T17:14:54.442490] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T17:14:54.517613] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-22T17:14:55.317624] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-22T17:14:55.333428] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-22T17:14:56.117666] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-22T17:14:56.917629] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-22T17:14:57.055884] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T17:14:57.720517] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-22T17:14:57.726005] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T17:14:58.281961] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T17:14:58.452374] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-22T17:14:58.517610] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-22T17:14:59.258441] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T17:14:59.317616] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-22T17:15:00.117720] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-22T17:15:00.143145] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T17:15:00.917740] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-22T17:15:01.576973] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T17:15:01.717710] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-22T17:15:01.879288] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T17:15:01.880872] [INFO ] [REMOTE ] AP: Full fetch complete (9080 records). [2025-10-22T17:15:01.880960] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-22T17:15:02.276243] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-22T17:15:02.276341] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-22T17:15:02.276597] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-22T17:15:02.276670] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-22T17:15:02.277286] [DEBUG] [LOCAL ] AP: Trimmed 9080 records to 7414 (keeping 200 days of data) [2025-10-22T17:15:02.319243] [DEBUG] [LOCAL ] AP: Primary data saved (7414 records). [2025-10-22T17:15:02.319382] [INFO ] [MAIN ] AP: Full history saved. [2025-10-22T17:15:02.319467] [INFO ] [MAIN ] Update Progress: 127/2367 symbols completed. AP took 26.2s. Estimated remaining: 4h 23m 53s. Rate: 8.5 symbols/min [2025-10-22T17:15:02.492989] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:15:02.519807] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-22T17:15:02.543105] [DEBUG] [LOCAL ] APG: Loaded 50625 existing records from primary storage. [2025-10-22T17:15:02.543429] [INFO ] [MAIN ] APG: Loaded 50625 existing records. [2025-10-22T17:15:02.748172] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:15:02.748397] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-22T17:15:02.748451] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-22T17:15:02.749045] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-22T17:15:02.749111] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-22T17:15:03.105589] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:15:03.153042] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T17:15:03.317721] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-22T17:15:04.117755] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-22T17:15:04.266921] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T17:15:04.769958] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T17:15:04.917710] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-22T17:15:05.724467] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-22T17:15:05.741816] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:15:06.324904] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T17:15:06.330432] [INFO ] [REMOTE ] APAM: Full fetch complete (51798 records). [2025-10-22T17:15:06.330600] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-22T17:15:06.331267] [FATAL] [VALIDATOR ] APAM: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:15:06.331358] [FATAL] [MAIN ] APAM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:15:06.331403] [WARN ] [MAIN ] APAM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:15:06.331471] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-22T17:15:06.331537] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-22T17:15:06.331574] [INFO ] [LOCAL ] APAM: Starting deletion of derivative data. [2025-10-22T17:15:06.331777] [DEBUG] [LOCAL ] APAM: Deleted derivative data file. [2025-10-22T17:15:06.331871] [INFO ] [MAIN ] Update Progress: 128/2367 symbols completed. APAM took 30.0s. Estimated remaining: 4h 22m 53s. Rate: 8.5 symbols/min [2025-10-22T17:15:06.498451] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:15:06.530703] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-22T17:15:06.553410] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-22T17:15:06.553762] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-22T17:15:06.727009] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:15:06.727192] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-22T17:15:06.727242] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-22T17:15:06.727581] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-22T17:15:06.727635] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-22T17:15:07.071108] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:15:07.278111] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T17:15:07.317619] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-22T17:15:08.122759] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-22T17:15:08.146087] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T17:15:08.917706] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-22T17:15:09.114816] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T17:15:09.122923] [INFO ] [REMOTE ] AOS: Full fetch complete (71075 records). [2025-10-22T17:15:09.123076] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-22T17:15:09.528456] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-22T17:15:09.528688] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-22T17:15:09.529430] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-22T17:15:09.529508] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-22T17:15:09.556387] [DEBUG] [LOCAL ] AOS: Trimmed 71075 records to 48646 (keeping 200 days of data) [2025-10-22T17:15:09.558015] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T17:15:09.759707] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-22T17:15:09.878083] [DEBUG] [LOCAL ] AOS: Primary data saved (48646 records). [2025-10-22T17:15:09.878220] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-22T17:15:09.879052] [INFO ] [MAIN ] Update Progress: 129/2367 symbols completed. AOS took 37.4s. Estimated remaining: 4h 21m 45s. Rate: 8.6 symbols/min [2025-10-22T17:15:10.042920] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:15:10.043111] [DEBUG] [LOCAL ] APLE: No existing data file found in primary storage. [2025-10-22T17:15:10.043150] [WARN ] [MAIN ] APLE: No existing data found, performing full refresh instead. [2025-10-22T17:15:10.043264] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-22T17:15:10.043306] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-22T17:15:10.043359] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-22T17:15:10.043422] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-22T17:15:10.424105] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:15:10.517714] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-22T17:15:11.100336] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-22T17:15:11.317722] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-22T17:15:11.488975] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T17:15:12.117664] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-22T17:15:12.232058] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T17:15:12.917707] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-22T17:15:13.648390] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-22T17:15:13.717712] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-22T17:15:13.806019] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T17:15:14.517637] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-22T17:15:14.695372] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T17:15:15.317703] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-22T17:15:15.751065] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-22T17:15:16.117746] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-22T17:15:16.167616] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T17:15:16.917765] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-22T17:15:17.064002] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T17:15:17.596333] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T17:15:17.717620] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-22T17:15:18.517732] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-22T17:15:18.813366] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-22T17:15:19.256154] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T17:15:19.317753] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-22T17:15:19.960219] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T17:15:20.117708] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-22T17:15:20.917669] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-22T17:15:21.257359] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-22T17:15:21.404820] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-22T17:15:21.717683] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-22T17:15:22.517628] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-22T17:15:22.568477] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T17:15:23.317635] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-22T17:15:23.582925] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T17:15:24.117732] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-22T17:15:24.254299] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T17:15:24.917752] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-22T17:15:25.113191] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T17:15:25.717760] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-22T17:15:25.998578] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T17:15:26.517633] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-22T17:15:26.810486] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T17:15:26.818361] [INFO ] [REMOTE ] APD: Full fetch complete (67330 records). [2025-10-22T17:15:26.818472] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-22T17:15:27.197761] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-22T17:15:27.197904] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-22T17:15:27.198634] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-22T17:15:27.198754] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-22T17:15:27.200134] [DEBUG] [LOCAL ] APD: Trimmed 67330 records to 45416 (keeping 200 days of data) [2025-10-22T17:15:27.319089] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-22T17:15:27.485760] [DEBUG] [LOCAL ] APD: Primary data saved (45416 records). [2025-10-22T17:15:27.485888] [INFO ] [MAIN ] APD: Full history saved. [2025-10-22T17:15:27.485968] [INFO ] [MAIN ] Update Progress: 130/2367 symbols completed. APD took 38.7s. Estimated remaining: 4h 24m 40s. Rate: 8.5 symbols/min [2025-10-22T17:15:27.653400] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:15:27.702995] [DEBUG] [LOCAL ] APO: Loaded 53390 existing records from primary storage. [2025-10-22T17:15:27.703299] [INFO ] [MAIN ] APO: Loaded 53390 existing records. [2025-10-22T17:15:27.869694] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-22T17:15:27.947384] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:15:27.947593] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-22T17:15:27.947706] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-22T17:15:27.948189] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-22T17:15:27.948257] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-22T17:15:28.150918] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-22T17:15:28.294702] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:15:28.437576] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-22T17:15:28.917752] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-22T17:15:29.252233] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T17:15:29.717713] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-22T17:15:29.960518] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T17:15:30.517733] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-22T17:15:30.742729] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T17:15:31.160342] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T17:15:31.168918] [INFO ] [REMOTE ] APG: Full fetch complete (72192 records). [2025-10-22T17:15:31.169068] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-22T17:15:31.322528] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-22T17:15:31.558307] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-22T17:15:31.558386] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-22T17:15:31.559095] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-22T17:15:31.559157] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-22T17:15:31.560525] [DEBUG] [LOCAL ] APG: Trimmed 72192 records to 50617 (keeping 200 days of data) [2025-10-22T17:15:31.860595] [DEBUG] [LOCAL ] APG: Primary data saved (50617 records). [2025-10-22T17:15:31.860821] [INFO ] [MAIN ] APG: Full history saved. [2025-10-22T17:15:31.861836] [INFO ] [MAIN ] Update Progress: 131/2367 symbols completed. APG took 29.5s. Estimated remaining: 4h 23m 47s. Rate: 8.5 symbols/min [2025-10-22T17:15:32.033342] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:15:32.042828] [DEBUG] [LOCAL ] APOS: Loaded 7132 existing records from primary storage. [2025-10-22T17:15:32.043051] [INFO ] [MAIN ] APOS: Loaded 7132 existing records. [2025-10-22T17:15:32.122314] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-22T17:15:32.223587] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:15:32.223885] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-22T17:15:32.233923] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-22T17:15:32.250542] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-22T17:15:32.250707] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-22T17:15:32.320733] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T17:15:32.637816] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:15:32.917719] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-22T17:15:33.233058] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T17:15:33.642562] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-22T17:15:33.717728] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-22T17:15:34.006024] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T17:15:34.517696] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-22T17:15:35.317665] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-22T17:15:35.822587] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-22T17:15:36.117741] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-22T17:15:36.446339] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T17:15:36.726598] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T17:15:36.917638] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-22T17:15:37.456388] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-22T17:15:37.717725] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-22T17:15:38.477913] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T17:15:38.486913] [INFO ] [REMOTE ] APLE: Full fetch complete (74796 records). [2025-10-22T17:15:38.487045] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-22T17:15:38.523926] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-22T17:15:38.887553] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-22T17:15:38.887661] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-22T17:15:38.888413] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-22T17:15:38.888461] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-22T17:15:38.890092] [DEBUG] [LOCAL ] APLE: Trimmed 74796 records to 51958 (keeping 200 days of data) [2025-10-22T17:15:39.199753] [DEBUG] [LOCAL ] APLE: Primary data saved (51958 records). [2025-10-22T17:15:39.199897] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-22T17:15:39.199967] [INFO ] [MAIN ] Update Progress: 132/2367 symbols completed. APLE took 29.3s. Estimated remaining: 4h 23m 44s. Rate: 8.5 symbols/min [2025-10-22T17:15:39.322766] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-22T17:15:39.370615] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:15:39.417940] [DEBUG] [LOCAL ] APTV: Loaded 51874 existing records from primary storage. [2025-10-22T17:15:39.418274] [INFO ] [MAIN ] APTV: Loaded 51874 existing records. [2025-10-22T17:15:39.600822] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:15:39.601179] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-22T17:15:39.601266] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-22T17:15:39.601505] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-22T17:15:39.601561] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-22T17:15:39.889687] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-22T17:15:39.950098] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-22T17:15:40.035708] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:15:40.117708] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-22T17:15:40.242451] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T17:15:40.908352] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T17:15:40.917600] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-22T17:15:41.642474] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T17:15:41.717688] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-22T17:15:42.404492] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-22T17:15:42.517698] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-22T17:15:43.317740] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-22T17:15:44.119027] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-22T17:15:44.121099] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-22T17:15:44.543589] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-22T17:15:44.917709] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-22T17:15:45.542567] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-22T17:15:45.717729] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-22T17:15:46.517720] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-22T17:15:46.571672] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-22T17:15:47.216217] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T17:15:47.317760] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-22T17:15:47.843162] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-22T17:15:48.117707] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-22T17:15:48.917629] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-22T17:15:49.118174] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:15:49.392693] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-22T17:15:49.631510] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T17:15:49.632903] [INFO ] [REMOTE ] APOS: Full fetch complete (10221 records). [2025-10-22T17:15:49.632971] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-22T17:15:49.722879] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-22T17:15:49.985237] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-22T17:15:49.985312] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-22T17:15:49.985536] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-22T17:15:49.985576] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-22T17:15:49.986026] [DEBUG] [LOCAL ] APOS: Trimmed 10221 records to 7058 (keeping 200 days of data) [2025-10-22T17:15:50.030537] [DEBUG] [LOCAL ] APOS: Primary data saved (7058 records). [2025-10-22T17:15:50.030695] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-22T17:15:50.030808] [INFO ] [MAIN ] Update Progress: 133/2367 symbols completed. APOS took 18.2s. Estimated remaining: 4h 24m 40s. Rate: 8.4 symbols/min [2025-10-22T17:15:50.198109] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:15:50.244518] [DEBUG] [LOCAL ] AQN: Loaded 51684 existing records from primary storage. [2025-10-22T17:15:50.244873] [INFO ] [MAIN ] AQN: Loaded 51684 existing records. [2025-10-22T17:15:50.425639] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:15:50.425896] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-22T17:15:50.425943] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-22T17:15:50.426220] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-22T17:15:50.426276] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-22T17:15:50.522940] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-22T17:15:50.776969] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:15:51.317668] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-22T17:15:51.589000] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T17:15:52.117710] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-22T17:15:52.427638] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T17:15:52.917702] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-22T17:15:53.525722] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-22T17:15:53.535014] [INFO ] [REMOTE ] APH: Full fetch complete (77869 records). [2025-10-22T17:15:53.535149] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-22T17:15:53.722798] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-22T17:15:53.941068] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-22T17:15:53.965405] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-22T17:15:53.969136] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-22T17:15:53.969283] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-22T17:15:53.971408] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T17:15:53.983224] [DEBUG] [LOCAL ] APH: Trimmed 77869 records to 53691 (keeping 200 days of data) [2025-10-22T17:15:54.307961] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-10-22T17:15:54.308093] [INFO ] [MAIN ] APH: Full history saved. [2025-10-22T17:15:54.308852] [INFO ] [MAIN ] Update Progress: 134/2367 symbols completed. APH took 48.0s. Estimated remaining: 4h 23m 46s. Rate: 8.5 symbols/min [2025-10-22T17:15:54.481067] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:15:54.488870] [DEBUG] [LOCAL ] AQNB: Loaded 3940 existing records from primary storage. [2025-10-22T17:15:54.489080] [INFO ] [MAIN ] AQNB: Loaded 3940 existing records. [2025-10-22T17:15:54.525343] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-22T17:15:54.669410] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:15:54.669618] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-22T17:15:54.669793] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-22T17:15:54.670114] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-22T17:15:54.670180] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-22T17:15:54.773418] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T17:15:55.080664] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:15:55.317705] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-22T17:15:55.855612] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-22T17:15:55.895786] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-22T17:15:55.897252] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T17:15:56.117702] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-22T17:15:56.917717] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-22T17:15:57.362569] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T17:15:57.717624] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-22T17:15:57.944663] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T17:15:58.517719] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-22T17:15:59.317734] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-22T17:15:59.411080] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T17:16:00.117860] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-22T17:16:00.350443] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T17:16:00.917627] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-22T17:16:01.100866] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T17:16:01.732480] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-22T17:16:01.740265] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T17:16:02.358725] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T17:16:02.517635] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-22T17:16:02.914719] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-22T17:16:02.940983] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-22T17:16:02.949828] [INFO ] [REMOTE ] APO: Full fetch complete (77467 records). [2025-10-22T17:16:02.949959] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-22T17:16:03.321595] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-22T17:16:03.374548] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-22T17:16:03.374629] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-22T17:16:03.375429] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-22T17:16:03.375478] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-22T17:16:03.376845] [DEBUG] [LOCAL ] APO: Trimmed 77467 records to 53388 (keeping 200 days of data) [2025-10-22T17:16:03.694483] [DEBUG] [LOCAL ] APO: Primary data saved (53388 records). [2025-10-22T17:16:03.694615] [INFO ] [MAIN ] APO: Full history saved. [2025-10-22T17:16:03.694722] [INFO ] [MAIN ] Update Progress: 135/2367 symbols completed. APO took 36.2s. Estimated remaining: 4h 24m 17s. Rate: 8.4 symbols/min [2025-10-22T17:16:03.859864] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:16:03.909950] [DEBUG] [LOCAL ] AR: Loaded 53590 existing records from primary storage. [2025-10-22T17:16:03.910282] [INFO ] [MAIN ] AR: Loaded 53590 existing records. [2025-10-22T17:16:04.012461] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-22T17:16:04.107241] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:16:04.107485] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-22T17:16:04.107534] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-22T17:16:04.108096] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-22T17:16:04.108155] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-22T17:16:04.122887] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-22T17:16:04.505180] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:16:04.834394] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-22T17:16:04.917638] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-22T17:16:05.717739] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-22T17:16:06.517725] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-22T17:16:06.763807] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T17:16:07.029851] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-22T17:16:07.317714] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-22T17:16:07.465598] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T17:16:08.117731] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-22T17:16:08.917728] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-22T17:16:09.038453] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T17:16:09.717707] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-22T17:16:09.920203] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T17:16:10.292776] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T17:16:10.522811] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-22T17:16:10.535767] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T17:16:11.107903] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-22T17:16:11.317735] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-22T17:16:12.117734] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-22T17:16:12.922901] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-22T17:16:12.936101] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T17:16:13.619461] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-22T17:16:13.620417] [INFO ] [REMOTE ] AQNB: Full fetch complete (5389 records). [2025-10-22T17:16:13.620483] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-22T17:16:13.719210] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-22T17:16:14.007944] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-22T17:16:14.008068] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-22T17:16:14.008365] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-22T17:16:14.008453] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-22T17:16:14.009014] [DEBUG] [LOCAL ] AQNB: Trimmed 5389 records to 3886 (keeping 200 days of data) [2025-10-22T17:16:14.035495] [DEBUG] [LOCAL ] AQNB: Primary data saved (3886 records). [2025-10-22T17:16:14.035868] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-22T17:16:14.035983] [INFO ] [MAIN ] Update Progress: 136/2367 symbols completed. AQNB took 19.7s. Estimated remaining: 4h 25m 3s. Rate: 8.4 symbols/min [2025-10-22T17:16:14.191495] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-22T17:16:14.272146] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:16:14.272306] [DEBUG] [LOCAL ] ARCO: No existing data file found in primary storage. [2025-10-22T17:16:14.272343] [WARN ] [MAIN ] ARCO: No existing data found, performing full refresh instead. [2025-10-22T17:16:14.272449] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-22T17:16:14.272489] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-22T17:16:14.272529] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-22T17:16:14.272560] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-22T17:16:14.522807] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-22T17:16:14.624814] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:16:15.317715] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-22T17:16:15.635635] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T17:16:16.117696] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-22T17:16:16.505684] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T17:16:16.910238] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T17:16:16.920832] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-22T17:16:17.717747] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-22T17:16:18.043717] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T17:16:18.407444] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-22T17:16:18.420832] [INFO ] [REMOTE ] APTV: Full fetch complete (75833 records). [2025-10-22T17:16:18.421049] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-22T17:16:18.526502] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-22T17:16:18.883392] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-22T17:16:18.984419] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-22T17:16:18.984498] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-22T17:16:18.985226] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-22T17:16:18.985287] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-22T17:16:18.986711] [DEBUG] [LOCAL ] APTV: Trimmed 75833 records to 51849 (keeping 200 days of data) [2025-10-22T17:16:19.288703] [DEBUG] [LOCAL ] APTV: Primary data saved (51849 records). [2025-10-22T17:16:19.288875] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-22T17:16:19.289622] [INFO ] [MAIN ] Update Progress: 137/2367 symbols completed. APTV took 40.1s. Estimated remaining: 4h 24m 25s. Rate: 8.4 symbols/min [2025-10-22T17:16:19.322096] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-22T17:16:19.459722] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:16:19.476205] [DEBUG] [LOCAL ] ARDC: Loaded 15258 existing records from primary storage. [2025-10-22T17:16:19.476439] [INFO ] [MAIN ] ARDC: Loaded 15258 existing records. [2025-10-22T17:16:19.647402] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:16:19.647689] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-22T17:16:19.647753] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-22T17:16:19.647925] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-22T17:16:19.647962] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-22T17:16:20.009339] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:16:20.117701] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-22T17:16:20.171984] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-22T17:16:20.179785] [INFO ] [REMOTE ] AQN: Full fetch complete (74965 records). [2025-10-22T17:16:20.179907] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-22T17:16:20.180701] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:16:20.180793] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:16:20.180836] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:16:20.180876] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-22T17:16:20.180951] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-22T17:16:20.181008] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-10-22T17:16:20.181190] [DEBUG] [LOCAL ] AQN: Deleted derivative data file. [2025-10-22T17:16:20.181724] [INFO ] [MAIN ] Update Progress: 138/2367 symbols completed. AQN took 30.2s. Estimated remaining: 4h 22m 37s. Rate: 8.5 symbols/min [2025-10-22T17:16:20.344297] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:16:20.371411] [DEBUG] [LOCAL ] ARDT: Loaded 27405 existing records from primary storage. [2025-10-22T17:16:20.371700] [INFO ] [MAIN ] ARDT: Loaded 27405 existing records. [2025-10-22T17:16:20.542457] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:16:20.542625] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-22T17:16:20.542704] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-22T17:16:20.542880] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-22T17:16:20.542917] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-22T17:16:20.884894] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:16:20.917609] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-22T17:16:21.261955] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T17:16:21.531856] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-22T17:16:21.717727] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-22T17:16:22.376257] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T17:16:22.517709] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-22T17:16:23.329958] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-22T17:16:23.336075] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T17:16:23.729529] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T17:16:24.117744] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-22T17:16:24.553355] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T17:16:24.917751] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-22T17:16:25.717706] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-22T17:16:25.905491] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T17:16:26.517715] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-22T17:16:26.628588] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T17:16:27.060936] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T17:16:27.317705] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-22T17:16:28.117634] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-22T17:16:28.196113] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-22T17:16:28.506784] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-22T17:16:28.917708] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-22T17:16:29.717704] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-22T17:16:29.905153] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T17:16:30.227138] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T17:16:30.517723] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-22T17:16:30.715779] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-22T17:16:31.317689] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-22T17:16:31.381998] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T17:16:32.117758] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-22T17:16:32.917755] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-22T17:16:33.088769] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T17:16:33.260066] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T17:16:33.717727] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-22T17:16:33.775992] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-22T17:16:34.517707] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-22T17:16:35.124200] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T17:16:35.267949] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-22T17:16:35.317611] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-22T17:16:36.117733] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-22T17:16:36.281607] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T17:16:36.917709] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-22T17:16:37.717627] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-22T17:16:37.960865] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T17:16:38.195181] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-22T17:16:38.517747] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-22T17:16:38.727307] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T17:16:39.317723] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-22T17:16:39.985000] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-22T17:16:40.117688] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-22T17:16:40.319941] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T17:16:40.917635] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-22T17:16:41.397000] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T17:16:41.717721] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-22T17:16:42.517684] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-22T17:16:42.751185] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T17:16:42.760372] [INFO ] [REMOTE ] AR: Full fetch complete (77348 records). [2025-10-22T17:16:42.760536] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-22T17:16:42.761453] [FATAL] [VALIDATOR ] AR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:16:42.761550] [FATAL] [MAIN ] AR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:16:42.761593] [WARN ] [MAIN ] AR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:16:42.761634] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-22T17:16:42.761749] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-22T17:16:42.761801] [INFO ] [LOCAL ] AR: Starting deletion of derivative data. [2025-10-22T17:16:42.761984] [DEBUG] [LOCAL ] AR: Deleted derivative data file. [2025-10-22T17:16:42.762077] [INFO ] [MAIN ] Update Progress: 139/2367 symbols completed. AR took 39.1s. Estimated remaining: 4h 26m 39s. Rate: 8.4 symbols/min [2025-10-22T17:16:42.948875] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:16:42.949203] [DEBUG] [LOCAL ] ARE: No existing data file found in primary storage. [2025-10-22T17:16:42.949269] [WARN ] [MAIN ] ARE: No existing data found, performing full refresh instead. [2025-10-22T17:16:42.949545] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-22T17:16:42.949598] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-22T17:16:42.949809] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-22T17:16:42.949937] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-22T17:16:43.074207] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T17:16:43.324726] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-22T17:16:43.329314] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:16:44.054050] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T17:16:44.059206] [INFO ] [REMOTE ] ARDT: Full fetch complete (41598 records). [2025-10-22T17:16:44.059300] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-22T17:16:44.122794] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-22T17:16:44.429541] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-22T17:16:44.429634] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-22T17:16:44.430137] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-22T17:16:44.430181] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-22T17:16:44.431098] [DEBUG] [LOCAL ] ARDT: Trimmed 41598 records to 27391 (keeping 200 days of data) [2025-10-22T17:16:44.584415] [DEBUG] [LOCAL ] ARDT: Primary data saved (27391 records). [2025-10-22T17:16:44.584572] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-22T17:16:44.584751] [INFO ] [MAIN ] Update Progress: 140/2367 symbols completed. ARDT took 24.4s. Estimated remaining: 4h 25m 6s. Rate: 8.4 symbols/min [2025-10-22T17:16:44.755735] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:16:44.785255] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T17:16:44.835854] [DEBUG] [LOCAL ] ARES: Loaded 49679 existing records from primary storage. [2025-10-22T17:16:44.836183] [INFO ] [MAIN ] ARES: Loaded 49679 existing records. [2025-10-22T17:16:44.925146] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-22T17:16:45.025102] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:16:45.025361] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-22T17:16:45.025417] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-22T17:16:45.025776] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-22T17:16:45.025832] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-22T17:16:45.344599] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T17:16:45.429933] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:16:45.717729] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-22T17:16:46.465972] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T17:16:46.517705] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-22T17:16:46.915893] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T17:16:46.919233] [INFO ] [REMOTE ] ARDC: Full fetch complete (21391 records). [2025-10-22T17:16:46.919306] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-22T17:16:46.919860] [FATAL] [VALIDATOR ] ARDC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:16:46.919946] [FATAL] [MAIN ] ARDC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:16:46.919987] [WARN ] [MAIN ] ARDC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:16:46.920025] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-22T17:16:46.920092] [DEBUG] [LOCAL ] ARDC: No primary data file found to delete. [2025-10-22T17:16:46.920127] [INFO ] [LOCAL ] ARDC: Starting deletion of derivative data. [2025-10-22T17:16:46.920263] [DEBUG] [LOCAL ] ARDC: Deleted derivative data file. [2025-10-22T17:16:46.920327] [INFO ] [MAIN ] Update Progress: 141/2367 symbols completed. ARDC took 27.6s. Estimated remaining: 4h 23m 43s. Rate: 8.4 symbols/min [2025-10-22T17:16:47.085950] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:16:47.086119] [DEBUG] [LOCAL ] ARI: No existing data file found in primary storage. [2025-10-22T17:16:47.086156] [WARN ] [MAIN ] ARI: No existing data found, performing full refresh instead. [2025-10-22T17:16:47.086267] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-22T17:16:47.086330] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-22T17:16:47.086388] [DEBUG] [LOCAL ] ARI: No primary data file found to delete. [2025-10-22T17:16:47.086421] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-22T17:16:47.322951] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-22T17:16:47.432638] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:16:47.752184] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T17:16:48.117715] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-22T17:16:48.917731] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-22T17:16:49.166839] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T17:16:49.717634] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-22T17:16:50.050485] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T17:16:50.274462] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T17:16:50.281364] [INFO ] [REMOTE ] ARCO: Full fetch complete (64694 records). [2025-10-22T17:16:50.281558] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-22T17:16:50.282723] [FATAL] [VALIDATOR ] ARCO: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:16:50.282828] [FATAL] [MAIN ] ARCO: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:16:50.282871] [WARN ] [MAIN ] ARCO: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:16:50.282942] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-22T17:16:50.283007] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-22T17:16:50.283043] [INFO ] [LOCAL ] ARCO: Starting deletion of derivative data. [2025-10-22T17:16:50.283081] [DEBUG] [LOCAL ] ARCO: No derivative data file found to delete. [2025-10-22T17:16:50.283137] [INFO ] [MAIN ] Update Progress: 142/2367 symbols completed. ARCO took 36.2s. Estimated remaining: 4h 22m 38s. Rate: 8.5 symbols/min [2025-10-22T17:16:50.449588] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:16:50.492819] [DEBUG] [LOCAL ] ARLO: Loaded 43536 existing records from primary storage. [2025-10-22T17:16:50.493098] [INFO ] [MAIN ] ARLO: Loaded 43536 existing records. [2025-10-22T17:16:50.522906] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-22T17:16:50.667827] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:16:50.668043] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-22T17:16:50.668091] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-22T17:16:50.668296] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-22T17:16:50.668335] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-22T17:16:51.016922] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:16:51.127412] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-22T17:16:51.317741] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-22T17:16:52.117713] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-22T17:16:52.152066] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T17:16:52.917694] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-22T17:16:53.054314] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T17:16:53.584505] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T17:16:53.717628] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-22T17:16:54.517634] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-22T17:16:54.564435] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T17:16:55.242688] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T17:16:55.317710] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-22T17:16:56.083891] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:16:56.117728] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-22T17:16:56.572259] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T17:16:56.917706] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-22T17:16:57.408991] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-22T17:16:57.717726] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-22T17:16:58.517764] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-22T17:16:58.938143] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T17:16:59.168374] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:16:59.317664] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-22T17:17:00.117711] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-22T17:17:00.514517] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T17:17:00.648097] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T17:17:00.917718] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-22T17:17:01.469173] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T17:17:01.717750] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-22T17:17:02.517627] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-22T17:17:02.744745] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T17:17:02.986843] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T17:17:03.317699] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-22T17:17:03.975026] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T17:17:04.117739] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-22T17:17:04.917695] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-22T17:17:05.283769] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-22T17:17:05.717690] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-22T17:17:05.791314] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T17:17:06.517619] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-22T17:17:06.920728] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T17:17:06.956875] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T17:17:07.317727] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-22T17:17:07.712371] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T17:17:08.117635] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-22T17:17:08.917629] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-22T17:17:09.278382] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T17:17:09.717728] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-22T17:17:09.727274] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T17:17:10.323176] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T17:17:10.517765] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-22T17:17:10.940883] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T17:17:11.317639] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-22T17:17:12.117717] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-22T17:17:12.917756] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-22T17:17:13.171995] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-10-22T17:17:13.717631] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-22T17:17:13.890106] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-22T17:17:13.997975] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T17:17:14.517770] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-22T17:17:14.889102] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-22T17:17:14.896204] [INFO ] [REMOTE ] ARLO: Full fetch complete (63147 records). [2025-10-22T17:17:14.896320] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-22T17:17:15.296090] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-22T17:17:15.296197] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-22T17:17:15.296933] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-22T17:17:15.297068] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-22T17:17:15.298501] [DEBUG] [LOCAL ] ARLO: Trimmed 63147 records to 43510 (keeping 200 days of data) [2025-10-22T17:17:15.360562] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-22T17:17:15.425273] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T17:17:15.588997] [DEBUG] [LOCAL ] ARLO: Primary data saved (43510 records). [2025-10-22T17:17:15.589131] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-22T17:17:15.589891] [INFO ] [MAIN ] Update Progress: 143/2367 symbols completed. ARLO took 25.3s. Estimated remaining: 4h 27m 14s. Rate: 8.3 symbols/min [2025-10-22T17:17:15.761432] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:17:15.761611] [DEBUG] [LOCAL ] ARMK: No existing data file found in primary storage. [2025-10-22T17:17:15.761676] [WARN ] [MAIN ] ARMK: No existing data found, performing full refresh instead. [2025-10-22T17:17:15.761801] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-22T17:17:15.761842] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-22T17:17:15.761883] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-10-22T17:17:15.761934] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-22T17:17:16.140390] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:17:16.127207] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-22T17:17:16.169793] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T17:17:16.917692] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-22T17:17:17.046306] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T17:17:17.717776] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-22T17:17:17.895763] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T17:17:18.447140] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T17:17:18.455554] [INFO ] [REMOTE ] ARE: Full fetch complete (73055 records). [2025-10-22T17:17:18.455704] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-22T17:17:18.522845] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-22T17:17:18.886172] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-22T17:17:18.886299] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-22T17:17:18.887059] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-22T17:17:18.887147] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-22T17:17:18.905307] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T17:17:18.904621] [DEBUG] [LOCAL ] ARE: Trimmed 73055 records to 50927 (keeping 200 days of data) [2025-10-22T17:17:18.912445] [INFO ] [REMOTE ] ARI: Full fetch complete (61963 records). [2025-10-22T17:17:18.912565] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-22T17:17:18.913421] [FATAL] [VALIDATOR ] ARI: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:17:18.913522] [FATAL] [MAIN ] ARI: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:17:18.913564] [WARN ] [MAIN ] ARI: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:17:18.913625] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-22T17:17:18.913729] [DEBUG] [LOCAL ] ARI: No primary data file found to delete. [2025-10-22T17:17:18.913774] [INFO ] [LOCAL ] ARI: Starting deletion of derivative data. [2025-10-22T17:17:18.913816] [DEBUG] [LOCAL ] ARI: No derivative data file found to delete. [2025-10-22T17:17:18.913876] [INFO ] [MAIN ] Update Progress: 144/2367 symbols completed. ARI took 32.0s. Estimated remaining: 4h 26m 7s. Rate: 8.4 symbols/min [2025-10-22T17:17:19.272441] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:17:19.280804] [DEBUG] [LOCAL ] AROC: No existing data file found in primary storage. [2025-10-22T17:17:19.306956] [WARN ] [MAIN ] AROC: No existing data found, performing full refresh instead. [2025-10-22T17:17:19.309383] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-22T17:17:19.309962] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-22T17:17:19.313679] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-10-22T17:17:19.316289] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-22T17:17:19.329271] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-22T17:17:19.776129] [DEBUG] [LOCAL ] ARE: Primary data saved (50927 records). [2025-10-22T17:17:19.780219] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-22T17:17:19.780361] [INFO ] [MAIN ] Update Progress: 145/2367 symbols completed. ARE took 37.0s. Estimated remaining: 4h 24m 23s. Rate: 8.4 symbols/min [2025-10-22T17:17:19.779942] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:17:19.946518] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:17:19.946762] [DEBUG] [LOCAL ] ARR: No existing data file found in primary storage. [2025-10-22T17:17:19.946832] [WARN ] [MAIN ] ARR: No existing data found, performing full refresh instead. [2025-10-22T17:17:19.947017] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-22T17:17:19.947108] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-22T17:17:19.947233] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-22T17:17:19.947317] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-22T17:17:20.128890] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-22T17:17:20.260045] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T17:17:20.373029] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:17:20.917704] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-22T17:17:21.143165] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T17:17:21.717702] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-22T17:17:22.177213] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-22T17:17:22.517782] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-22T17:17:22.657015] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T17:17:23.317748] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-22T17:17:23.491549] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T17:17:23.500086] [INFO ] [REMOTE ] ARES: Full fetch complete (71729 records). [2025-10-22T17:17:23.500221] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-22T17:17:23.893626] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-22T17:17:23.893775] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-22T17:17:23.894520] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-22T17:17:23.894585] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-22T17:17:23.895996] [DEBUG] [LOCAL ] ARES: Trimmed 71729 records to 49676 (keeping 200 days of data) [2025-10-22T17:17:24.120838] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-22T17:17:24.205409] [DEBUG] [LOCAL ] ARES: Primary data saved (49676 records). [2025-10-22T17:17:24.205537] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-22T17:17:24.206397] [INFO ] [MAIN ] Update Progress: 146/2367 symbols completed. ARES took 39.6s. Estimated remaining: 4h 23m 34s. Rate: 8.4 symbols/min [2025-10-22T17:17:24.374302] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:17:24.374446] [DEBUG] [LOCAL ] ARW: No existing data file found in primary storage. [2025-10-22T17:17:24.374484] [WARN ] [MAIN ] ARW: No existing data found, performing full refresh instead. [2025-10-22T17:17:24.374593] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-22T17:17:24.374633] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-22T17:17:24.374719] [DEBUG] [LOCAL ] ARW: No primary data file found to delete. [2025-10-22T17:17:24.374759] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-22T17:17:24.740067] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:17:24.768974] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-22T17:17:24.865382] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T17:17:24.917638] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-22T17:17:25.717729] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-22T17:17:25.856803] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T17:17:26.517626] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-22T17:17:26.710313] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T17:17:27.244407] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T17:17:27.317688] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-22T17:17:28.013845] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T17:17:28.117697] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-22T17:17:28.917717] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-22T17:17:29.313615] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-22T17:17:29.717743] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-22T17:17:29.864520] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T17:17:30.292796] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T17:17:30.517720] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-22T17:17:31.317634] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-22T17:17:31.398449] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T17:17:32.117728] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-22T17:17:32.541555] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-22T17:17:32.631490] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T17:17:32.917694] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-22T17:17:33.717632] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-22T17:17:34.115243] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T17:17:34.419720] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T17:17:34.517734] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-22T17:17:35.064820] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T17:17:35.317707] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-22T17:17:36.117637] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-22T17:17:36.227758] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T17:17:36.917631] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-22T17:17:36.966718] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T17:17:37.717731] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-22T17:17:38.163278] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-22T17:17:38.517706] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-22T17:17:38.614619] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T17:17:38.936244] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T17:17:39.317695] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-22T17:17:40.094009] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T17:17:40.117605] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-22T17:17:40.917731] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-22T17:17:41.045825] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T17:17:41.665785] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T17:17:41.717708] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-22T17:17:42.493319] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T17:17:42.517709] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-22T17:17:43.317722] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-22T17:17:43.759362] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T17:17:44.117761] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-22T17:17:44.237151] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T17:17:44.922785] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-22T17:17:44.940369] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T17:17:45.507309] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T17:17:45.717713] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-22T17:17:46.517697] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-22T17:17:46.604510] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:17:46.613683] [INFO ] [REMOTE ] ARMK: Full fetch complete (72990 records). [2025-10-22T17:17:46.613936] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-22T17:17:47.027116] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-22T17:17:47.027270] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-22T17:17:47.028205] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-22T17:17:47.028283] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-22T17:17:47.030139] [DEBUG] [LOCAL ] ARMK: Trimmed 72990 records to 50369 (keeping 200 days of data) [2025-10-22T17:17:47.324681] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-22T17:17:47.344365] [DEBUG] [LOCAL ] ARMK: Primary data saved (50369 records). [2025-10-22T17:17:47.345057] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-22T17:17:47.345242] [INFO ] [MAIN ] Update Progress: 147/2367 symbols completed. ARMK took 31.8s. Estimated remaining: 4h 27m 29s. Rate: 8.3 symbols/min [2025-10-22T17:17:47.514823] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:17:47.514986] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-22T17:17:47.515025] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-22T17:17:47.515135] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-22T17:17:47.515176] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-22T17:17:47.515219] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-22T17:17:47.515252] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-22T17:17:47.875056] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:17:47.928609] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T17:17:47.937591] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-22T17:17:48.117712] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-10-22T17:17:48.310718] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:17:48.311110] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-10-22T17:17:48.311208] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:17:48.311273] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-22T17:17:48.311335] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:17:48.311406] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-22T17:17:48.311469] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-22T17:17:48.311505] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-22T17:17:48.311545] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-22T17:17:48.311589] [INFO ] [MAIN ] Update Progress: 148/2367 symbols completed. ARX took 1.0s. Estimated remaining: 4h 25m 48s. Rate: 8.3 symbols/min [2025-10-22T17:17:48.476187] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:17:48.523875] [DEBUG] [LOCAL ] AS: Loaded 53198 existing records from primary storage. [2025-10-22T17:17:48.524200] [INFO ] [MAIN ] AS: Loaded 53198 existing records. [2025-10-22T17:17:48.698389] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:17:48.698607] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-22T17:17:48.698688] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-22T17:17:48.699141] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-22T17:17:48.699198] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-22T17:17:48.917832] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-22T17:17:49.057617] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:17:49.086172] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T17:17:49.717703] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-22T17:17:50.517731] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-22T17:17:51.198742] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-22T17:17:51.207410] [INFO ] [REMOTE ] ARR: Full fetch complete (75498 records). [2025-10-22T17:17:51.207611] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-22T17:17:51.319916] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-22T17:17:51.621084] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-22T17:17:51.621282] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-22T17:17:51.622226] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-22T17:17:51.622433] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-22T17:17:51.649674] [DEBUG] [LOCAL ] ARR: Trimmed 75498 records to 52091 (keeping 200 days of data) [2025-10-22T17:17:51.651349] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T17:17:51.978188] [DEBUG] [LOCAL ] ARR: Primary data saved (52091 records). [2025-10-22T17:17:51.978328] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-22T17:17:51.978400] [INFO ] [MAIN ] Update Progress: 149/2367 symbols completed. ARR took 32.2s. Estimated remaining: 4h 24m 49s. Rate: 8.4 symbols/min [2025-10-22T17:17:52.123058] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-22T17:17:52.148847] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:17:52.163820] [DEBUG] [LOCAL ] ASA: Loaded 15663 existing records from primary storage. [2025-10-22T17:17:52.164046] [INFO ] [MAIN ] ASA: Loaded 15663 existing records. [2025-10-22T17:17:52.340754] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:17:52.341049] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-22T17:17:52.341114] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-22T17:17:52.357143] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-22T17:17:52.359390] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-22T17:17:52.395127] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T17:17:52.483390] [INFO ] [REMOTE ] AROC: Full fetch complete (71041 records). [2025-10-22T17:17:52.521085] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-22T17:17:52.571304] [FATAL] [VALIDATOR ] AROC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:17:52.619897] [FATAL] [MAIN ] AROC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:17:52.636760] [WARN ] [MAIN ] AROC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:17:52.650053] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-22T17:17:52.653584] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-10-22T17:17:52.659300] [INFO ] [LOCAL ] AROC: Starting deletion of derivative data. [2025-10-22T17:17:52.692347] [DEBUG] [LOCAL ] AROC: No derivative data file found to delete. [2025-10-22T17:17:52.692492] [INFO ] [MAIN ] Update Progress: 150/2367 symbols completed. AROC took 33.8s. Estimated remaining: 4h 23m 6s. Rate: 8.4 symbols/min [2025-10-22T17:17:52.788103] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:17:52.852951] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T17:17:52.928257] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:17:52.926722] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-22T17:17:52.977743] [DEBUG] [LOCAL ] ASAN: Loaded 52732 existing records from primary storage. [2025-10-22T17:17:52.978059] [INFO ] [MAIN ] ASAN: Loaded 52732 existing records. [2025-10-22T17:17:53.151984] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:17:53.152236] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-22T17:17:53.152282] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-22T17:17:53.152484] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-22T17:17:53.152546] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-22T17:17:53.508806] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:17:53.538590] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:17:53.717687] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-22T17:17:53.847283] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T17:17:54.517780] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-22T17:17:55.317632] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-22T17:17:55.365635] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-22T17:17:55.652227] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T17:17:56.117705] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-22T17:17:56.759039] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T17:17:56.917730] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-22T17:17:57.641638] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T17:17:57.717610] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-22T17:17:58.517731] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-22T17:17:58.811550] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T17:17:59.141875] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T17:17:59.317636] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-22T17:17:59.790470] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T17:17:59.796383] [INFO ] [REMOTE ] ARW: Full fetch complete (48680 records). [2025-10-22T17:17:59.796495] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-22T17:18:00.124096] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-22T17:18:00.179978] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-22T17:18:00.180185] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-22T17:18:00.180782] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-22T17:18:00.180851] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-22T17:18:00.181934] [DEBUG] [LOCAL ] ARW: Trimmed 48680 records to 33141 (keeping 200 days of data) [2025-10-22T17:18:00.372229] [DEBUG] [LOCAL ] ARW: Primary data saved (33141 records). [2025-10-22T17:18:00.372362] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-22T17:18:00.372436] [INFO ] [MAIN ] Update Progress: 151/2367 symbols completed. ARW took 36.2s. Estimated remaining: 4h 23m 7s. Rate: 8.4 symbols/min [2025-10-22T17:18:00.536951] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:18:00.578143] [DEBUG] [LOCAL ] ASB: Loaded 49698 existing records from primary storage. [2025-10-22T17:18:00.578431] [INFO ] [MAIN ] ASB: Loaded 49698 existing records. [2025-10-22T17:18:00.751633] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:18:00.751842] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-22T17:18:00.751920] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-22T17:18:00.752441] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-22T17:18:00.752501] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-22T17:18:00.930572] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-22T17:18:01.121571] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:18:01.129979] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-22T17:18:01.200498] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T17:18:01.717697] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-22T17:18:02.517629] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-22T17:18:02.799308] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T17:18:03.317740] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-22T17:18:03.617438] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T17:18:03.662357] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T17:18:04.117633] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-22T17:18:04.917722] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-22T17:18:05.011742] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T17:18:05.617166] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-22T17:18:05.717780] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-22T17:18:05.773419] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T17:18:06.517723] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-22T17:18:06.604865] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-22T17:18:07.317695] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-22T17:18:08.117738] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-22T17:18:08.172525] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-22T17:18:08.426931] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-22T17:18:08.917736] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-22T17:18:09.685100] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:18:09.717713] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-22T17:18:10.517636] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-22T17:18:10.649190] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T17:18:11.317705] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-22T17:18:11.500565] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T17:18:12.117753] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-22T17:18:12.520705] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T17:18:12.827955] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T17:18:12.917623] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-22T17:18:13.067001] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-22T17:18:13.717769] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-22T17:18:14.517746] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-22T17:18:14.895772] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T17:18:14.904496] [INFO ] [REMOTE ] AS: Full fetch complete (76921 records). [2025-10-22T17:18:14.904626] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-22T17:18:15.306765] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-22T17:18:15.306849] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-22T17:18:15.307582] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-22T17:18:15.307622] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-22T17:18:15.309065] [DEBUG] [LOCAL ] AS: Trimmed 76921 records to 53198 (keeping 200 days of data) [2025-10-22T17:18:15.359781] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-22T17:18:15.620670] [DEBUG] [LOCAL ] AS: Primary data saved (53198 records). [2025-10-22T17:18:15.620859] [INFO ] [MAIN ] AS: Full history saved. [2025-10-22T17:18:15.621822] [INFO ] [MAIN ] Update Progress: 152/2367 symbols completed. AS took 27.3s. Estimated remaining: 4h 24m 58s. Rate: 8.4 symbols/min [2025-10-22T17:18:15.771888] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-22T17:18:15.831547] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:18:15.836240] [DEBUG] [LOCAL ] ASBA: Loaded 3501 existing records from primary storage. [2025-10-22T17:18:15.836383] [INFO ] [MAIN ] ASBA: Loaded 3501 existing records. [2025-10-22T17:18:16.011054] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:18:16.011366] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-22T17:18:16.011510] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-22T17:18:16.011686] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-22T17:18:16.011753] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-22T17:18:16.120235] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-22T17:18:16.372174] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:18:16.400277] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T17:18:16.539976] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-22T17:18:16.917736] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-22T17:18:17.717757] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-22T17:18:18.262162] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-22T17:18:18.366669] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T17:18:18.517758] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-22T17:18:19.115908] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T17:18:19.120408] [INFO ] [REMOTE ] ASA: Full fetch complete (20812 records). [2025-10-22T17:18:19.120500] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-22T17:18:19.323272] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-22T17:18:19.497371] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-22T17:18:19.497455] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-22T17:18:19.497931] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-22T17:18:19.497995] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-22T17:18:19.498601] [DEBUG] [LOCAL ] ASA: Trimmed 20812 records to 15680 (keeping 200 days of data) [2025-10-22T17:18:19.594904] [DEBUG] [LOCAL ] ASA: Primary data saved (15680 records). [2025-10-22T17:18:19.595048] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-22T17:18:19.595125] [INFO ] [MAIN ] Update Progress: 153/2367 symbols completed. ASA took 27.6s. Estimated remaining: 4h 24m 5s. Rate: 8.4 symbols/min [2025-10-22T17:18:19.760239] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:18:19.760398] [DEBUG] [LOCAL ] ASC: No existing data file found in primary storage. [2025-10-22T17:18:19.760435] [WARN ] [MAIN ] ASC: No existing data found, performing full refresh instead. [2025-10-22T17:18:19.760542] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-22T17:18:19.760582] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-22T17:18:19.760622] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-10-22T17:18:19.760703] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-22T17:18:20.112413] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:18:20.117620] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-22T17:18:20.404245] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T17:18:20.526459] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T17:18:20.917740] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-22T17:18:21.385143] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-22T17:18:21.717755] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-22T17:18:21.743972] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T17:18:22.517744] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-22T17:18:23.252941] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T17:18:23.317697] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-22T17:18:24.117721] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-22T17:18:24.267594] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T17:18:24.380272] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-22T17:18:24.917752] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-22T17:18:25.717751] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-22T17:18:26.308749] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-22T17:18:26.350022] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T17:18:26.517743] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-22T17:18:27.138344] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-22T17:18:27.317720] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-22T17:18:27.320196] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T17:18:27.907186] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T17:18:28.117637] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-22T17:18:28.749981] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-22T17:18:28.917717] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-22T17:18:29.717701] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-22T17:18:30.517698] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-22T17:18:30.913374] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T17:18:30.922885] [INFO ] [REMOTE ] ASAN: Full fetch complete (76637 records). [2025-10-22T17:18:30.943786] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-22T17:18:30.945517] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T17:18:31.323064] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-22T17:18:31.346284] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-22T17:18:31.346358] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-22T17:18:31.347150] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-22T17:18:31.347303] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-22T17:18:31.348771] [DEBUG] [LOCAL ] ASAN: Trimmed 76637 records to 52732 (keeping 200 days of data) [2025-10-22T17:18:31.652961] [DEBUG] [LOCAL ] ASAN: Primary data saved (52732 records). [2025-10-22T17:18:31.653107] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-22T17:18:31.653185] [INFO ] [MAIN ] Update Progress: 154/2367 symbols completed. ASAN took 39.0s. Estimated remaining: 4h 25m 8s. Rate: 8.3 symbols/min [2025-10-22T17:18:31.837114] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:18:31.854998] [DEBUG] [LOCAL ] ASG: Loaded 19380 existing records from primary storage. [2025-10-22T17:18:31.855371] [INFO ] [MAIN ] ASG: Loaded 19380 existing records. [2025-10-22T17:18:32.039995] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:18:32.054889] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-22T17:18:32.069040] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-22T17:18:32.069236] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-22T17:18:32.073882] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-22T17:18:32.074229] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-22T17:18:32.121865] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-22T17:18:32.109629] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T17:18:32.462629] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:18:32.917698] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-22T17:18:33.688021] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T17:18:33.717617] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-22T17:18:34.111415] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-22T17:18:34.517759] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-22T17:18:34.942276] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T17:18:35.082557] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-22T17:18:35.317694] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-22T17:18:36.117720] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-22T17:18:36.917737] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-22T17:18:37.015482] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-22T17:18:37.085086] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T17:18:37.717758] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-22T17:18:38.517705] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-22T17:18:38.637451] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T17:18:38.646031] [INFO ] [REMOTE ] ASB: Full fetch complete (72248 records). [2025-10-22T17:18:38.646157] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-22T17:18:38.852186] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T17:18:39.072157] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-22T17:18:39.072232] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-22T17:18:39.072936] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-22T17:18:39.072998] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-22T17:18:39.074300] [DEBUG] [LOCAL ] ASB: Trimmed 72248 records to 49696 (keeping 200 days of data) [2025-10-22T17:18:39.317630] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-22T17:18:39.385440] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-22T17:18:39.395658] [DEBUG] [LOCAL ] ASB: Primary data saved (49696 records). [2025-10-22T17:18:39.395742] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-22T17:18:39.396583] [INFO ] [MAIN ] Update Progress: 155/2367 symbols completed. ASB took 39.0s. Estimated remaining: 4h 25m 9s. Rate: 8.3 symbols/min [2025-10-22T17:18:39.566497] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:18:39.588123] [DEBUG] [LOCAL ] ASGI: Loaded 23005 existing records from primary storage. [2025-10-22T17:18:39.588383] [INFO ] [MAIN ] ASGI: Loaded 23005 existing records. [2025-10-22T17:18:39.762899] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:18:39.763058] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-22T17:18:39.763104] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-22T17:18:39.763342] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-22T17:18:39.763379] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-22T17:18:40.014274] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T17:18:40.123419] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:18:40.123497] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-22T17:18:40.917814] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-22T17:18:41.456862] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-22T17:18:41.459327] [INFO ] [REMOTE ] ASBA: Full fetch complete (5224 records). [2025-10-22T17:18:41.459438] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-22T17:18:41.591738] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T17:18:41.722841] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-22T17:18:41.872581] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-22T17:18:41.872681] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-22T17:18:41.872838] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-22T17:18:41.872878] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-22T17:18:41.873236] [DEBUG] [LOCAL ] ASBA: Trimmed 5224 records to 3475 (keeping 200 days of data) [2025-10-22T17:18:41.893905] [DEBUG] [LOCAL ] ASBA: Primary data saved (3475 records). [2025-10-22T17:18:41.893977] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-22T17:18:41.894044] [INFO ] [MAIN ] Update Progress: 156/2367 symbols completed. ASBA took 26.3s. Estimated remaining: 4h 23m 55s. Rate: 8.4 symbols/min [2025-10-22T17:18:42.059899] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:18:42.101859] [DEBUG] [LOCAL ] ASGN: Loaded 36654 existing records from primary storage. [2025-10-22T17:18:42.102174] [INFO ] [MAIN ] ASGN: Loaded 36654 existing records. [2025-10-22T17:18:42.275227] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:18:42.275434] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-22T17:18:42.275491] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-22T17:18:42.275852] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-22T17:18:42.275907] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-22T17:18:42.522809] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-22T17:18:42.620511] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:18:43.217058] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T17:18:43.317614] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-22T17:18:43.789750] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T17:18:43.795800] [INFO ] [REMOTE ] ASC: Full fetch complete (56017 records). [2025-10-22T17:18:43.795894] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-22T17:18:44.130850] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-22T17:18:44.187196] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-22T17:18:44.187455] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-22T17:18:44.188099] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-22T17:18:44.188160] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-22T17:18:44.189310] [DEBUG] [LOCAL ] ASC: Trimmed 56017 records to 37184 (keeping 200 days of data) [2025-10-22T17:18:44.310530] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-22T17:18:44.427053] [DEBUG] [LOCAL ] ASC: Primary data saved (37184 records). [2025-10-22T17:18:44.427188] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-22T17:18:44.427261] [INFO ] [MAIN ] Update Progress: 157/2367 symbols completed. ASC took 24.8s. Estimated remaining: 4h 22m 43s. Rate: 8.4 symbols/min [2025-10-22T17:18:44.917690] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-22T17:18:45.717630] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-22T17:18:45.792866] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-22T17:18:46.517700] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-22T17:18:47.042017] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T17:18:47.317635] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-22T17:18:47.737725] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T17:18:47.985477] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (3.85 seconds). [2025-10-22T17:18:48.117626] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-22T17:18:48.397384] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T17:18:48.917745] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-22T17:18:49.382110] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-22T17:18:49.717752] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-22T17:18:50.019305] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T17:18:50.517695] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-22T17:18:50.819548] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T17:18:51.317711] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-22T17:18:52.117707] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-22T17:18:52.395159] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T17:18:52.917792] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-22T17:18:53.011424] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-22T17:18:53.324841] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (2.81 seconds). [2025-10-22T17:18:53.717762] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-22T17:18:54.517700] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-22T17:18:54.782431] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T17:18:55.250829] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T17:18:55.317617] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-22T17:18:55.390061] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T17:18:56.117712] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-22T17:18:56.396991] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T17:18:56.917636] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-22T17:18:57.225350] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T17:18:57.717756] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-22T17:18:58.079497] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-22T17:18:58.517794] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-22T17:18:58.924262] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T17:18:59.317757] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-22T17:18:59.691946] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T17:19:00.117634] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-22T17:19:00.359028] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T17:19:00.917741] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-22T17:19:01.598174] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T17:19:01.717774] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-22T17:19:01.928420] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T17:19:01.931667] [INFO ] [REMOTE ] ASG: Full fetch complete (30699 records). [2025-10-22T17:19:01.931769] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-22T17:19:01.932392] [FATAL] [VALIDATOR ] ASG: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:19:01.932481] [FATAL] [MAIN ] ASG: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:19:01.932554] [WARN ] [MAIN ] ASG: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:19:01.932639] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-22T17:19:01.932769] [DEBUG] [LOCAL ] ASG: No primary data file found to delete. [2025-10-22T17:19:01.932822] [INFO ] [LOCAL ] ASG: Starting deletion of derivative data. [2025-10-22T17:19:01.933075] [DEBUG] [LOCAL ] ASG: Deleted derivative data file. [2025-10-22T17:19:01.933201] [INFO ] [MAIN ] Update Progress: 158/2367 symbols completed. ASG took 30.3s. Estimated remaining: 4h 25m 1s. Rate: 8.3 symbols/min [2025-10-22T17:19:02.517750] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-22T17:19:03.143022] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T17:19:03.317622] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-22T17:19:03.362058] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T17:19:04.117768] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-22T17:19:05.194210] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T17:19:05.201929] [INFO ] [REMOTE ] ASGN: Full fetch complete (53654 records). [2025-10-22T17:19:05.202049] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-22T17:19:05.468636] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T17:19:05.507761] [INFO ] [REMOTE ] ASGI: Full fetch complete (32884 records). [2025-10-22T17:19:05.510526] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-22T17:19:05.532123] [FATAL] [VALIDATOR ] ASGI: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:19:05.537372] [FATAL] [MAIN ] ASGI: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:19:05.559350] [WARN ] [MAIN ] ASGI: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:19:05.566929] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-22T17:19:05.568253] [DEBUG] [LOCAL ] ASGI: No primary data file found to delete. [2025-10-22T17:19:05.583152] [INFO ] [LOCAL ] ASGI: Starting deletion of derivative data. [2025-10-22T17:19:05.584299] [DEBUG] [LOCAL ] ASGI: Deleted derivative data file. [2025-10-22T17:19:05.587837] [INFO ] [MAIN ] Update Progress: 159/2367 symbols completed. ASGI took 26.2s. Estimated remaining: 4h 24m 4s. Rate: 8.4 symbols/min [2025-10-22T17:19:05.601430] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-22T17:19:05.601494] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-22T17:19:05.602151] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-22T17:19:05.602213] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-22T17:19:05.603454] [DEBUG] [LOCAL ] ASGN: Trimmed 53654 records to 36689 (keeping 200 days of data) [2025-10-22T17:19:05.816043] [DEBUG] [LOCAL ] ASGN: Primary data saved (36689 records). [2025-10-22T17:19:05.816187] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-22T17:19:05.817019] [INFO ] [MAIN ] Update Progress: 160/2367 symbols completed. ASGN took 23.9s. Estimated remaining: 4h 22m 21s. Rate: 8.4 symbols/min [2025-10-22T17:19:06.460798] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:06.461992] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:06.511751] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:06.533935] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:06.534365] [DEBUG] [LOCAL ] ASH: No existing data file found in primary storage. [2025-10-22T17:19:06.534410] [WARN ] [MAIN ] ASH: No existing data found, performing full refresh instead. [2025-10-22T17:19:06.534500] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-22T17:19:06.534756] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-22T17:19:06.534871] [DEBUG] [LOCAL ] ASH: No primary data file found to delete. [2025-10-22T17:19:06.535046] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-22T17:19:06.630695] [DEBUG] [LOCAL ] ASR: Loaded 9484 existing records from primary storage. [2025-10-22T17:19:06.657338] [INFO ] [MAIN ] ASR: Loaded 9484 existing records. [2025-10-22T17:19:06.719874] [DEBUG] [LOCAL ] ASIX: Loaded 23106 existing records from primary storage. [2025-10-22T17:19:06.774969] [INFO ] [MAIN ] ASIX: Loaded 23106 existing records. [2025-10-22T17:19:07.064170] [DEBUG] [LOCAL ] ASPN: Loaded 49890 existing records from primary storage. [2025-10-22T17:19:07.159731] [INFO ] [MAIN ] ASPN: Loaded 49890 existing records. [2025-10-22T17:19:07.246006] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:19:07.322613] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-22T17:19:07.347231] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-22T17:19:07.306975] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:19:07.361842] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-22T17:19:07.367105] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-22T17:19:07.385307] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-22T17:19:07.395715] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-22T17:19:07.439785] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-22T17:19:07.439994] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-22T17:19:07.455278] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:07.492431] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-22T17:19:07.762450] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:19:07.819175] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-22T17:19:07.873422] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-22T17:19:07.888557] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-22T17:19:07.931342] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-22T17:19:08.579677] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:08.636794] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:08.655275] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-22T17:19:08.669609] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-22T17:19:08.784806] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:08.785146] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-22T17:19:09.790112] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-22T17:19:09.799889] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-22T17:19:09.911680] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T17:19:09.924380] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-22T17:19:09.923457] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T17:19:09.930579] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-22T17:19:10.663831] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T17:19:10.678339] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-22T17:19:10.715627] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T17:19:10.910413] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T17:19:11.279738] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T17:19:11.317611] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-22T17:19:12.117686] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-22T17:19:12.316247] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T17:19:12.917721] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-22T17:19:13.281740] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T17:19:13.499576] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T17:19:13.717706] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-22T17:19:14.527183] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-22T17:19:14.530288] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T17:19:15.297811] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T17:19:15.317611] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-22T17:19:15.802278] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T17:19:16.117766] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-22T17:19:16.545953] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T17:19:16.917744] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-22T17:19:17.717723] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-22T17:19:17.791314] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T17:19:18.517810] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-22T17:19:18.592068] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:19:18.790677] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T17:19:19.276675] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-22T17:19:19.317750] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-22T17:19:20.117631] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-22T17:19:20.279195] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-22T17:19:20.917749] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-22T17:19:21.717752] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-22T17:19:21.743113] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T17:19:22.517705] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-22T17:19:22.885142] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T17:19:22.880488] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-22T17:19:23.317718] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-22T17:19:23.341935] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T17:19:24.117703] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-22T17:19:24.917696] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-22T17:19:25.017410] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-22T17:19:25.049856] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T17:19:25.717618] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-22T17:19:25.899883] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-22T17:19:26.517693] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-22T17:19:27.150252] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T17:19:27.317631] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-22T17:19:27.688727] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T17:19:28.000139] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-22T17:19:28.117637] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-22T17:19:28.804427] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-22T17:19:28.917702] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-22T17:19:29.717637] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-22T17:19:29.756601] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T17:19:30.517695] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-22T17:19:30.772223] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T17:19:31.317697] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-22T17:19:31.468258] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-22T17:19:31.470165] [INFO ] [REMOTE ] ASR: Full fetch complete (12514 records). [2025-10-22T17:19:31.470235] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-22T17:19:31.470660] [FATAL] [VALIDATOR ] ASR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:19:31.470774] [FATAL] [MAIN ] ASR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:19:31.470861] [WARN ] [MAIN ] ASR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:19:31.470953] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-22T17:19:31.471030] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-10-22T17:19:31.471065] [INFO ] [LOCAL ] ASR: Starting deletion of derivative data. [2025-10-22T17:19:31.471362] [DEBUG] [LOCAL ] ASR: Deleted derivative data file. [2025-10-22T17:19:31.471450] [INFO ] [MAIN ] Update Progress: 161/2367 symbols completed. ASR took 25.7s. Estimated remaining: 4h 26m 28s. Rate: 8.3 symbols/min [2025-10-22T17:19:31.650569] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:31.703293] [DEBUG] [LOCAL ] ASX: Loaded 52881 existing records from primary storage. [2025-10-22T17:19:31.703635] [INFO ] [MAIN ] ASX: Loaded 52881 existing records. [2025-10-22T17:19:31.877796] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:19:31.878006] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-22T17:19:31.878066] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-22T17:19:31.878359] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-22T17:19:31.878442] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-22T17:19:32.122717] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-22T17:19:32.223783] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:32.579280] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T17:19:32.583440] [INFO ] [REMOTE ] ASIX: Full fetch complete (31063 records). [2025-10-22T17:19:32.583518] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-22T17:19:32.925314] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-22T17:19:32.944427] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-22T17:19:32.944494] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-22T17:19:32.944927] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-22T17:19:32.945012] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-22T17:19:32.945846] [DEBUG] [LOCAL ] ASIX: Trimmed 31063 records to 22992 (keeping 200 days of data) [2025-10-22T17:19:33.088054] [DEBUG] [LOCAL ] ASIX: Primary data saved (22992 records). [2025-10-22T17:19:33.088186] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-22T17:19:33.088279] [INFO ] [MAIN ] Update Progress: 162/2367 symbols completed. ASIX took 27.3s. Estimated remaining: 4h 25m 4s. Rate: 8.3 symbols/min [2025-10-22T17:19:33.252987] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:33.286474] [DEBUG] [LOCAL ] ATEN: Loaded 37831 existing records from primary storage. [2025-10-22T17:19:33.286776] [INFO ] [MAIN ] ATEN: Loaded 37831 existing records. [2025-10-22T17:19:33.466422] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:19:33.466612] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-22T17:19:33.466693] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-22T17:19:33.467135] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-22T17:19:33.467189] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-22T17:19:33.721305] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-22T17:19:33.832291] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:33.853178] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:19:34.517749] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-22T17:19:34.568867] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T17:19:35.317748] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-22T17:19:35.772766] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-22T17:19:36.117628] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-22T17:19:36.187311] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T17:19:36.193920] [INFO ] [REMOTE ] ASH: Full fetch complete (55668 records). [2025-10-22T17:19:36.194021] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-22T17:19:36.574661] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-22T17:19:36.574751] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-22T17:19:36.575313] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-22T17:19:36.575353] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-22T17:19:36.576437] [DEBUG] [LOCAL ] ASH: Trimmed 55668 records to 37383 (keeping 200 days of data) [2025-10-22T17:19:36.801244] [DEBUG] [LOCAL ] ASH: Primary data saved (37383 records). [2025-10-22T17:19:36.801442] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-22T17:19:36.801527] [INFO ] [MAIN ] Update Progress: 163/2367 symbols completed. ASH took 31.0s. Estimated remaining: 4h 24m 10s. Rate: 8.3 symbols/min [2025-10-22T17:19:36.922886] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-22T17:19:36.972757] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:37.001920] [DEBUG] [LOCAL ] ATGE: Loaded 30618 existing records from primary storage. [2025-10-22T17:19:37.002180] [INFO ] [MAIN ] ATGE: Loaded 30618 existing records. [2025-10-22T17:19:37.183764] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:19:37.184096] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-22T17:19:37.184155] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-22T17:19:37.184563] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-22T17:19:37.184627] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-22T17:19:37.318687] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-22T17:19:37.595280] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:37.695363] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-22T17:19:37.717717] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-22T17:19:38.517693] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-22T17:19:38.561403] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T17:19:39.142686] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:19:39.317696] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-22T17:19:40.117711] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-22T17:19:40.247244] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:19:40.698634] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T17:19:40.917704] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-22T17:19:41.630433] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T17:19:41.717635] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-22T17:19:42.517624] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-22T17:19:42.988712] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T17:19:42.997266] [INFO ] [REMOTE ] ASPN: Full fetch complete (72607 records). [2025-10-22T17:19:42.997407] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-22T17:19:43.318233] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-22T17:19:43.401101] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-22T17:19:43.401300] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-22T17:19:43.402131] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-22T17:19:43.402210] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-22T17:19:43.414855] [DEBUG] [LOCAL ] ASPN: Trimmed 72607 records to 49875 (keeping 200 days of data) [2025-10-22T17:19:43.436759] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T17:19:43.724046] [DEBUG] [LOCAL ] ASPN: Primary data saved (49875 records). [2025-10-22T17:19:43.724271] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-22T17:19:43.724405] [INFO ] [MAIN ] Update Progress: 164/2367 symbols completed. ASPN took 37.9s. Estimated remaining: 4h 23m 59s. Rate: 8.3 symbols/min [2025-10-22T17:19:43.901361] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:43.921894] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T17:19:43.954449] [DEBUG] [LOCAL ] ATHM: Loaded 31322 existing records from primary storage. [2025-10-22T17:19:43.954767] [INFO ] [MAIN ] ATHM: Loaded 31322 existing records. [2025-10-22T17:19:44.126674] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-22T17:19:44.132078] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:19:44.133162] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-22T17:19:44.133235] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-22T17:19:44.133632] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-22T17:19:44.133747] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-22T17:19:44.527221] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:44.917787] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-22T17:19:44.959875] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T17:19:45.601150] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T17:19:45.717686] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-22T17:19:46.517731] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-22T17:19:46.815096] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T17:19:47.108104] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-22T17:19:47.317716] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-22T17:19:47.603338] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T17:19:48.117714] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-22T17:19:48.769091] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:19:48.917683] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-22T17:19:49.324296] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T17:19:49.717632] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-22T17:19:50.389846] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T17:19:50.517720] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-22T17:19:51.317626] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-22T17:19:51.361728] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T17:19:52.054859] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T17:19:52.117622] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-22T17:19:52.917024] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T17:19:52.925528] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-22T17:19:53.608588] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T17:19:53.717690] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-22T17:19:53.846723] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-22T17:19:54.517701] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-22T17:19:55.131534] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T17:19:55.317713] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-22T17:19:56.122727] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-22T17:19:56.140526] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T17:19:56.419572] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T17:19:56.917696] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-22T17:19:57.587419] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T17:19:57.593586] [INFO ] [REMOTE ] ATEN: Full fetch complete (56809 records). [2025-10-22T17:19:57.593784] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-22T17:19:57.722850] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-22T17:19:57.988267] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-22T17:19:57.988360] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-22T17:19:57.989039] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-22T17:19:57.989119] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-22T17:19:57.990381] [DEBUG] [LOCAL ] ATEN: Trimmed 56809 records to 37731 (keeping 200 days of data) [2025-10-22T17:19:58.239041] [DEBUG] [LOCAL ] ATEN: Primary data saved (37731 records). [2025-10-22T17:19:58.239208] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-22T17:19:58.239909] [INFO ] [MAIN ] Update Progress: 165/2367 symbols completed. ATEN took 25.2s. Estimated remaining: 4h 25m 29s. Rate: 8.3 symbols/min [2025-10-22T17:19:58.413158] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:19:58.422229] [DEBUG] [LOCAL ] ATHS: Loaded 6564 existing records from primary storage. [2025-10-22T17:19:58.422459] [INFO ] [MAIN ] ATHS: Loaded 6564 existing records. [2025-10-22T17:19:58.524534] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-22T17:19:58.631938] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T17:19:58.636583] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:19:58.636875] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-22T17:19:58.636950] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-22T17:19:58.648638] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-22T17:19:58.649117] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-22T17:19:59.007523] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:19:59.121005] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-22T17:19:59.317777] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-22T17:19:59.917141] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T17:20:00.117752] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-22T17:20:00.573544] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-22T17:20:00.917743] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-22T17:20:01.717748] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-22T17:20:01.799071] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T17:20:02.001608] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T17:20:02.517751] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-22T17:20:03.196788] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-22T17:20:03.317634] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-22T17:20:03.349133] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T17:20:04.086040] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-22T17:20:04.117621] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-22T17:20:04.701362] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-22T17:20:04.917716] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-22T17:20:05.717715] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-22T17:20:06.418868] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-22T17:20:06.517633] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-22T17:20:06.600556] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T17:20:07.240856] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-22T17:20:07.317696] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-22T17:20:08.117766] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-22T17:20:08.741729] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T17:20:08.917637] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-22T17:20:09.438797] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T17:20:09.447505] [INFO ] [REMOTE ] ASX: Full fetch complete (76799 records). [2025-10-22T17:20:09.447629] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-22T17:20:09.715261] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-22T17:20:09.721281] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-22T17:20:09.850287] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-22T17:20:09.850367] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-22T17:20:09.851105] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-22T17:20:09.851171] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-22T17:20:09.852565] [DEBUG] [LOCAL ] ASX: Trimmed 76799 records to 52880 (keeping 200 days of data) [2025-10-22T17:20:10.163765] [DEBUG] [LOCAL ] ASX: Primary data saved (52880 records). [2025-10-22T17:20:10.163912] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-22T17:20:10.164806] [INFO ] [MAIN ] Update Progress: 166/2367 symbols completed. ASX took 38.7s. Estimated remaining: 4h 26m 24s. Rate: 8.3 symbols/min [2025-10-22T17:20:10.338857] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:20:10.393007] [DEBUG] [LOCAL ] ATI: Loaded 51304 existing records from primary storage. [2025-10-22T17:20:10.393334] [INFO ] [MAIN ] ATI: Loaded 51304 existing records. [2025-10-22T17:20:10.522774] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-22T17:20:10.573330] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:20:10.573544] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-22T17:20:10.573593] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-22T17:20:10.573831] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-22T17:20:10.573889] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-22T17:20:10.919152] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:20:10.976519] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-22T17:20:11.140758] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-22T17:20:11.317713] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-22T17:20:12.117734] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-22T17:20:12.917708] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-22T17:20:12.932143] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T17:20:12.933522] [INFO ] [REMOTE ] ATHS: Full fetch complete (9629 records). [2025-10-22T17:20:12.933590] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-22T17:20:13.328553] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-22T17:20:13.328924] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-22T17:20:13.331091] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T17:20:13.339974] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-22T17:20:13.340181] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-22T17:20:13.341071] [DEBUG] [LOCAL ] ATHS: Trimmed 9629 records to 6496 (keeping 200 days of data) [2025-10-22T17:20:13.380118] [DEBUG] [LOCAL ] ATHS: Primary data saved (6496 records). [2025-10-22T17:20:13.380238] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-22T17:20:13.380317] [INFO ] [MAIN ] Update Progress: 167/2367 symbols completed. ATHS took 15.1s. Estimated remaining: 4h 25m 24s. Rate: 8.3 symbols/min [2025-10-22T17:20:13.549993] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:20:13.581541] [DEBUG] [LOCAL ] ATKR: Loaded 34887 existing records from primary storage. [2025-10-22T17:20:13.581839] [INFO ] [MAIN ] ATKR: Loaded 34887 existing records. [2025-10-22T17:20:13.722805] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-22T17:20:13.759522] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:20:13.759860] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-22T17:20:13.759913] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-22T17:20:13.760168] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-22T17:20:13.760227] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-22T17:20:14.151665] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:20:14.163443] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T17:20:14.170182] [INFO ] [REMOTE ] ATGE: Full fetch complete (45595 records). [2025-10-22T17:20:14.170296] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-22T17:20:14.522966] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-22T17:20:14.603247] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-22T17:20:14.603333] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-22T17:20:14.603877] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-22T17:20:14.603938] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-22T17:20:14.604858] [DEBUG] [LOCAL ] ATGE: Trimmed 45595 records to 30426 (keeping 200 days of data) [2025-10-22T17:20:14.785147] [DEBUG] [LOCAL ] ATGE: Primary data saved (30426 records). [2025-10-22T17:20:14.785325] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-22T17:20:14.785414] [INFO ] [MAIN ] Update Progress: 168/2367 symbols completed. ATGE took 38.0s. Estimated remaining: 4h 24m 0s. Rate: 8.3 symbols/min [2025-10-22T17:20:14.958139] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T17:20:14.978177] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:20:15.019286] [DEBUG] [LOCAL ] ATMU: Loaded 38780 existing records from primary storage. [2025-10-22T17:20:15.019602] [INFO ] [MAIN ] ATMU: Loaded 38780 existing records. [2025-10-22T17:20:15.193008] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:20:15.193248] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-22T17:20:15.193304] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-22T17:20:15.193489] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-22T17:20:15.193543] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-22T17:20:15.322850] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-22T17:20:15.563751] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:20:16.117722] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-22T17:20:16.310366] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T17:20:16.602901] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-22T17:20:16.917681] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-22T17:20:17.654167] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T17:20:17.717710] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-22T17:20:18.517633] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-22T17:20:18.959781] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-22T17:20:19.317614] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-22T17:20:19.570759] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-10-22T17:20:20.117717] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-22T17:20:20.741771] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T17:20:20.793147] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-22T17:20:20.917705] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-22T17:20:21.544981] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T17:20:21.717613] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-22T17:20:22.384268] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T17:20:22.517826] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-22T17:20:22.968813] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-22T17:20:23.317702] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-22T17:20:24.117636] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-22T17:20:24.370792] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T17:20:24.729577] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T17:20:24.917773] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-22T17:20:25.571056] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T17:20:25.717742] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-22T17:20:26.517737] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-22T17:20:26.558038] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T17:20:27.241538] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T17:20:27.317708] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-22T17:20:28.098325] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T17:20:28.117620] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-22T17:20:28.442849] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T17:20:28.917746] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-22T17:20:29.717738] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-22T17:20:29.865691] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T17:20:30.465760] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T17:20:30.517702] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-22T17:20:30.745843] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T17:20:30.751071] [INFO ] [REMOTE ] ATHM: Full fetch complete (49532 records). [2025-10-22T17:20:30.751197] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-22T17:20:31.147290] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-22T17:20:31.147429] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-22T17:20:31.148163] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-22T17:20:31.148240] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-22T17:20:31.149527] [DEBUG] [LOCAL ] ATHM: Trimmed 49532 records to 31208 (keeping 200 days of data) [2025-10-22T17:20:31.324260] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-22T17:20:31.346662] [DEBUG] [LOCAL ] ATHM: Primary data saved (31208 records). [2025-10-22T17:20:31.346916] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-22T17:20:31.347008] [INFO ] [MAIN ] Update Progress: 169/2367 symbols completed. ATHM took 47.6s. Estimated remaining: 4h 25m 55s. Rate: 8.3 symbols/min [2025-10-22T17:20:31.512118] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:20:31.551112] [DEBUG] [LOCAL ] ATO: Loaded 41624 existing records from primary storage. [2025-10-22T17:20:31.551455] [INFO ] [MAIN ] ATO: Loaded 41624 existing records. [2025-10-22T17:20:31.721883] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:20:31.722088] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-22T17:20:31.722134] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-22T17:20:31.722345] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-22T17:20:31.722399] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-22T17:20:32.066290] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:20:32.117719] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-22T17:20:32.352834] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T17:20:32.412883] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T17:20:32.917701] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-22T17:20:33.415040] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T17:20:33.717742] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-22T17:20:34.517686] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-22T17:20:34.600838] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T17:20:34.937326] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T17:20:35.317744] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-22T17:20:35.995499] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T17:20:36.117710] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-22T17:20:36.759323] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T17:20:36.917699] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-22T17:20:37.316173] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T17:20:37.717696] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-22T17:20:38.205453] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-22T17:20:38.517757] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-22T17:20:39.255618] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T17:20:39.264257] [INFO ] [REMOTE ] ATI: Full fetch complete (74047 records). [2025-10-22T17:20:39.264418] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-22T17:20:39.322925] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-22T17:20:39.671628] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-22T17:20:39.671772] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-22T17:20:39.673151] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-22T17:20:39.673234] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-22T17:20:39.675226] [DEBUG] [LOCAL ] ATI: Trimmed 74047 records to 51283 (keeping 200 days of data) [2025-10-22T17:20:39.969367] [DEBUG] [LOCAL ] ATI: Primary data saved (51283 records). [2025-10-22T17:20:39.969494] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-22T17:20:39.970358] [INFO ] [MAIN ] Update Progress: 170/2367 symbols completed. ATI took 29.8s. Estimated remaining: 4h 26m 5s. Rate: 8.3 symbols/min [2025-10-22T17:20:40.118511] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-22T17:20:40.144955] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:20:40.169170] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T17:20:40.206105] [DEBUG] [LOCAL ] ATR: Loaded 30495 existing records from primary storage. [2025-10-22T17:20:40.206385] [INFO ] [MAIN ] ATR: Loaded 30495 existing records. [2025-10-22T17:20:40.389598] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:20:40.389844] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-22T17:20:40.389892] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-22T17:20:40.390073] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-22T17:20:40.390112] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-22T17:20:40.753127] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:20:40.917766] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-22T17:20:41.112724] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T17:20:41.119327] [INFO ] [REMOTE ] ATKR: Full fetch complete (53255 records). [2025-10-22T17:20:41.119489] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-22T17:20:41.530283] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-22T17:20:41.530389] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-22T17:20:41.531008] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-22T17:20:41.531077] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-22T17:20:41.532183] [DEBUG] [LOCAL ] ATKR: Trimmed 53255 records to 34853 (keeping 200 days of data) [2025-10-22T17:20:41.718834] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-22T17:20:41.743837] [DEBUG] [LOCAL ] ATKR: Primary data saved (34853 records). [2025-10-22T17:20:41.743937] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-22T17:20:41.744662] [INFO ] [MAIN ] Update Progress: 171/2367 symbols completed. ATKR took 28.4s. Estimated remaining: 4h 24m 47s. Rate: 8.3 symbols/min [2025-10-22T17:20:41.946529] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:20:41.974669] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T17:20:41.995053] [DEBUG] [LOCAL ] ATS: Loaded 17169 existing records from primary storage. [2025-10-22T17:20:41.995280] [INFO ] [MAIN ] ATS: Loaded 17169 existing records. [2025-10-22T17:20:42.172899] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:20:42.173150] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-22T17:20:42.173275] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-22T17:20:42.173482] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-22T17:20:42.173539] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-22T17:20:42.412084] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T17:20:42.526390] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-22T17:20:42.557372] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:20:43.317699] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-22T17:20:43.397748] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T17:20:44.042623] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T17:20:44.117687] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-22T17:20:44.628499] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:20:44.917696] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-22T17:20:45.601617] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T17:20:45.717692] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-22T17:20:46.357635] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T17:20:46.517730] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-22T17:20:46.861627] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T17:20:47.317776] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-22T17:20:48.012775] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T17:20:48.032954] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T17:20:48.117616] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-22T17:20:48.917724] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-22T17:20:49.055300] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T17:20:49.717731] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-22T17:20:50.400415] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T17:20:50.517638] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-22T17:20:50.759299] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T17:20:50.765586] [INFO ] [REMOTE ] ATMU: Full fetch complete (56956 records). [2025-10-22T17:20:50.765734] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-22T17:20:51.142452] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-22T17:20:51.142529] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-22T17:20:51.143119] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-22T17:20:51.143181] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-22T17:20:51.144294] [DEBUG] [LOCAL ] ATMU: Trimmed 56956 records to 38718 (keeping 200 days of data) [2025-10-22T17:20:51.341823] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-22T17:20:51.374173] [DEBUG] [LOCAL ] ATMU: Primary data saved (38718 records). [2025-10-22T17:20:51.374330] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-22T17:20:51.374429] [INFO ] [MAIN ] Update Progress: 172/2367 symbols completed. ATMU took 36.6s. Estimated remaining: 4h 25m 11s. Rate: 8.3 symbols/min [2025-10-22T17:20:51.540193] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:20:51.581685] [DEBUG] [LOCAL ] ATUS: Loaded 49928 existing records from primary storage. [2025-10-22T17:20:51.581995] [INFO ] [MAIN ] ATUS: Loaded 49928 existing records. [2025-10-22T17:20:51.755849] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:20:51.756053] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-22T17:20:51.756099] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-22T17:20:51.756487] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-22T17:20:51.756542] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-22T17:20:52.110379] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:20:52.122763] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-22T17:20:52.142863] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T17:20:52.712806] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T17:20:52.917635] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-22T17:20:53.110287] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T17:20:53.717690] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-22T17:20:54.431287] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T17:20:54.517788] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-22T17:20:54.624824] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-22T17:20:55.317755] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-22T17:20:56.083357] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T17:20:56.117717] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-22T17:20:56.891604] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T17:20:56.917700] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-22T17:20:57.464772] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T17:20:57.717627] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-22T17:20:58.405578] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T17:20:58.412373] [INFO ] [REMOTE ] ATO: Full fetch complete (60711 records). [2025-10-22T17:20:58.412538] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-22T17:20:58.522907] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-22T17:20:58.815090] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-22T17:20:58.815273] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-22T17:20:58.816021] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-22T17:20:58.821806] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-22T17:20:58.832834] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T17:20:58.840215] [DEBUG] [LOCAL ] ATO: Trimmed 60711 records to 41529 (keeping 200 days of data) [2025-10-22T17:20:59.092489] [DEBUG] [LOCAL ] ATO: Primary data saved (41529 records). [2025-10-22T17:20:59.092612] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-22T17:20:59.093427] [INFO ] [MAIN ] Update Progress: 173/2367 symbols completed. ATO took 27.7s. Estimated remaining: 4h 25m 9s. Rate: 8.3 symbols/min [2025-10-22T17:20:59.263784] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:20:59.311854] [DEBUG] [LOCAL ] AU: Loaded 53089 existing records from primary storage. [2025-10-22T17:20:59.312197] [INFO ] [MAIN ] AU: Loaded 53089 existing records. [2025-10-22T17:20:59.323468] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-22T17:20:59.496862] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:20:59.497100] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-22T17:20:59.497158] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-22T17:20:59.497900] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-22T17:20:59.497957] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-22T17:20:59.855299] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:21:00.117635] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-22T17:21:00.200896] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T17:21:00.342948] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T17:21:00.917724] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-22T17:21:01.231682] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T17:21:01.717776] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-22T17:21:02.517771] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-22T17:21:02.948437] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-22T17:21:03.120873] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-22T17:21:03.317760] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-22T17:21:03.988534] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T17:21:04.117690] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-22T17:21:04.917722] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-22T17:21:05.117914] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T17:21:05.717616] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-22T17:21:05.747753] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T17:21:06.418132] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T17:21:06.517730] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-22T17:21:07.317625] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-22T17:21:07.784272] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-22T17:21:07.843530] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T17:21:08.117748] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-22T17:21:08.926625] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-22T17:21:08.930037] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T17:21:09.717727] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-22T17:21:10.329612] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-22T17:21:10.517815] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-22T17:21:10.535190] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T17:21:10.540494] [INFO ] [REMOTE ] ATR: Full fetch complete (43971 records). [2025-10-22T17:21:10.540614] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-22T17:21:10.919522] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-22T17:21:10.979706] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-22T17:21:10.979816] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-22T17:21:10.980342] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-22T17:21:10.980403] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-22T17:21:10.981348] [DEBUG] [LOCAL ] ATR: Trimmed 43971 records to 30392 (keeping 200 days of data) [2025-10-22T17:21:11.168414] [DEBUG] [LOCAL ] ATR: Primary data saved (30392 records). [2025-10-22T17:21:11.168544] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-22T17:21:11.168620] [INFO ] [MAIN ] Update Progress: 174/2367 symbols completed. ATR took 31.2s. Estimated remaining: 4h 26m 3s. Rate: 8.2 symbols/min [2025-10-22T17:21:11.325497] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-22T17:21:11.358199] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:11.397384] [DEBUG] [LOCAL ] AUB: Loaded 45881 existing records from primary storage. [2025-10-22T17:21:11.397725] [INFO ] [MAIN ] AUB: Loaded 45881 existing records. [2025-10-22T17:21:11.568607] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:21:11.568846] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-22T17:21:11.568892] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-22T17:21:11.569373] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-22T17:21:11.569428] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-22T17:21:11.916956] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:21:12.117688] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-22T17:21:12.254618] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T17:21:12.437141] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-22T17:21:12.917771] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-22T17:21:13.687040] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T17:21:13.717718] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-22T17:21:14.517629] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-22T17:21:15.025471] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-22T17:21:15.317733] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-22T17:21:15.381786] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T17:21:16.129607] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-22T17:21:16.137049] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:21:16.917744] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-22T17:21:17.091229] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T17:21:17.093849] [INFO ] [REMOTE ] ATS: Full fetch complete (25475 records). [2025-10-22T17:21:17.093939] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-22T17:21:17.494427] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-22T17:21:17.494560] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-22T17:21:17.495032] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-22T17:21:17.495134] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-22T17:21:17.495912] [DEBUG] [LOCAL ] ATS: Trimmed 25475 records to 17012 (keeping 200 days of data) [2025-10-22T17:21:17.614768] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-22T17:21:17.648338] [DEBUG] [LOCAL ] ATS: Primary data saved (17012 records). [2025-10-22T17:21:17.648489] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-22T17:21:17.648569] [INFO ] [MAIN ] Update Progress: 175/2367 symbols completed. ATS took 35.9s. Estimated remaining: 4h 25m 46s. Rate: 8.2 symbols/min [2025-10-22T17:21:17.722727] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-22T17:21:17.831149] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:17.837272] [DEBUG] [LOCAL ] AUNA: Loaded 5226 existing records from primary storage. [2025-10-22T17:21:17.837489] [INFO ] [MAIN ] AUNA: Loaded 5226 existing records. [2025-10-22T17:21:18.024923] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:21:18.025281] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-22T17:21:18.025332] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-22T17:21:18.025709] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-22T17:21:18.025767] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-22T17:21:18.450273] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T17:21:18.449000] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:21:18.517761] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-22T17:21:19.317686] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-22T17:21:19.356469] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-22T17:21:19.579797] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T17:21:20.117712] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-22T17:21:20.917704] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-22T17:21:21.345076] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-22T17:21:21.717747] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-22T17:21:21.771579] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T17:21:22.346604] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T17:21:22.388251] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-22T17:21:22.517712] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-22T17:21:23.317733] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-22T17:21:24.117799] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-22T17:21:24.360020] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T17:21:24.917629] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-22T17:21:24.985960] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T17:21:25.717680] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-22T17:21:26.517633] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-22T17:21:26.623621] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-22T17:21:26.633918] [INFO ] [REMOTE ] AU: Full fetch complete (76631 records). [2025-10-22T17:21:26.634122] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-22T17:21:27.059874] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-22T17:21:27.094289] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-22T17:21:27.094938] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-22T17:21:27.095744] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-22T17:21:27.096185] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-22T17:21:27.097688] [DEBUG] [LOCAL ] AU: Trimmed 76631 records to 53089 (keeping 200 days of data) [2025-10-22T17:21:27.195092] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-22T17:21:27.320566] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-22T17:21:27.431621] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T17:21:27.442677] [INFO ] [REMOTE ] ATUS: Full fetch complete (71420 records). [2025-10-22T17:21:27.443693] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-22T17:21:27.572667] [DEBUG] [LOCAL ] AU: Primary data saved (53089 records). [2025-10-22T17:21:27.583817] [INFO ] [MAIN ] AU: Full history saved. [2025-10-22T17:21:27.600316] [INFO ] [MAIN ] Update Progress: 176/2367 symbols completed. AU took 28.5s. Estimated remaining: 4h 26m 12s. Rate: 8.2 symbols/min [2025-10-22T17:21:27.874193] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-22T17:21:28.015855] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:28.052401] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-22T17:21:28.052548] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-22T17:21:28.053509] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-22T17:21:28.053625] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-22T17:21:28.055459] [DEBUG] [LOCAL ] ATUS: Trimmed 71420 records to 49957 (keeping 200 days of data) [2025-10-22T17:21:28.134767] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-22T17:21:28.346052] [DEBUG] [LOCAL ] ATUS: Primary data saved (49957 records). [2025-10-22T17:21:28.356317] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-22T17:21:28.356447] [INFO ] [MAIN ] Update Progress: 177/2367 symbols completed. ATUS took 37.0s. Estimated remaining: 4h 24m 43s. Rate: 8.3 symbols/min [2025-10-22T17:21:28.388744] [DEBUG] [LOCAL ] AVA: Loaded 38417 existing records from primary storage. [2025-10-22T17:21:28.416875] [INFO ] [MAIN ] AVA: Loaded 38417 existing records. [2025-10-22T17:21:28.701183] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:28.734820] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:21:28.735052] [DEBUG] [LOCAL ] AVAL: No existing data file found in primary storage. [2025-10-22T17:21:28.735128] [WARN ] [MAIN ] AVAL: No existing data found, performing full refresh instead. [2025-10-22T17:21:28.735312] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-22T17:21:28.735427] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-22T17:21:28.735514] [DEBUG] [LOCAL ] AVAL: No primary data file found to delete. [2025-10-22T17:21:28.735369] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-22T17:21:28.735573] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-22T17:21:28.735708] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-22T17:21:28.788952] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-22T17:21:28.800939] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-22T17:21:28.836702] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-22T17:21:28.922715] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-22T17:21:29.511062] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:21:29.530854] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:21:29.717737] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-22T17:21:30.517719] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-22T17:21:30.534530] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-22T17:21:30.617612] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T17:21:31.284990] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T17:21:31.317688] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-22T17:21:32.062405] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-22T17:21:32.117613] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-22T17:21:32.917705] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-22T17:21:33.082589] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-22T17:21:33.422075] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-22T17:21:33.717638] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-22T17:21:34.517711] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-22T17:21:35.128839] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T17:21:35.317755] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-22T17:21:35.409066] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T17:21:36.117719] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-22T17:21:36.695364] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T17:21:36.696430] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T17:21:36.917621] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-22T17:21:37.717717] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-22T17:21:38.454023] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T17:21:38.517709] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-22T17:21:39.017148] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-22T17:21:39.092510] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-22T17:21:39.317687] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-22T17:21:40.117637] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-22T17:21:40.808912] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T17:21:40.917624] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-22T17:21:41.716169] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T17:21:41.724731] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-22T17:21:42.373347] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T17:21:42.517746] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-22T17:21:42.531835] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T17:21:42.533405] [INFO ] [REMOTE ] AUNA: Full fetch complete (7812 records). [2025-10-22T17:21:42.533487] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-22T17:21:42.888615] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-22T17:21:42.888761] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-22T17:21:42.889029] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-22T17:21:42.889091] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-22T17:21:42.889472] [DEBUG] [LOCAL ] AUNA: Trimmed 7812 records to 5250 (keeping 200 days of data) [2025-10-22T17:21:42.916958] [DEBUG] [LOCAL ] AUNA: Primary data saved (5250 records). [2025-10-22T17:21:42.917032] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-22T17:21:42.917103] [INFO ] [MAIN ] Update Progress: 178/2367 symbols completed. AUNA took 25.3s. Estimated remaining: 4h 26m 6s. Rate: 8.2 symbols/min [2025-10-22T17:21:43.084536] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:43.123168] [DEBUG] [LOCAL ] AVB: Loaded 42231 existing records from primary storage. [2025-10-22T17:21:43.123446] [INFO ] [MAIN ] AVB: Loaded 42231 existing records. [2025-10-22T17:21:43.235357] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T17:21:43.308572] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:21:43.308817] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-22T17:21:43.308863] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-22T17:21:43.309044] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-22T17:21:43.309080] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-22T17:21:43.322799] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-22T17:21:43.660606] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:21:44.117686] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-22T17:21:44.869494] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T17:21:44.917735] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-22T17:21:45.642057] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-22T17:21:45.665727] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T17:21:45.717616] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-22T17:21:46.517698] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-22T17:21:47.214709] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T17:21:47.317717] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-22T17:21:48.117454] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T17:21:48.124341] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-22T17:21:48.716266] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T17:21:48.724395] [INFO ] [REMOTE ] AUB: Full fetch complete (66390 records). [2025-10-22T17:21:48.724544] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-22T17:21:48.922737] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-22T17:21:49.120417] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-22T17:21:49.120546] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-22T17:21:49.121328] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-22T17:21:49.121391] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-22T17:21:49.122763] [DEBUG] [LOCAL ] AUB: Trimmed 66390 records to 45843 (keeping 200 days of data) [2025-10-22T17:21:49.402207] [DEBUG] [LOCAL ] AUB: Primary data saved (45843 records). [2025-10-22T17:21:49.402365] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-22T17:21:49.403473] [INFO ] [MAIN ] Update Progress: 179/2367 symbols completed. AUB took 38.2s. Estimated remaining: 4h 25m 49s. Rate: 8.2 symbols/min [2025-10-22T17:21:49.583014] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:49.583249] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-22T17:21:49.583376] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-22T17:21:49.583554] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-22T17:21:49.583620] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-22T17:21:49.583799] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-22T17:21:49.583953] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-22T17:21:49.695047] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T17:21:49.718057] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-22T17:21:49.973314] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:21:50.191986] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-22T17:21:50.517623] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-10-22T17:21:50.578866] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T17:21:50.704055] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:21:50.704382] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-10-22T17:21:50.704455] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:21:50.704496] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-22T17:21:50.704530] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:21:50.704569] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-22T17:21:50.704629] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-22T17:21:50.704744] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-22T17:21:50.704812] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-22T17:21:50.704862] [INFO ] [MAIN ] Update Progress: 180/2367 symbols completed. AVBC took 1.3s. Estimated remaining: 4h 24m 29s. Rate: 8.3 symbols/min [2025-10-22T17:21:50.881635] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:50.902462] [DEBUG] [LOCAL ] AVD: Loaded 21426 existing records from primary storage. [2025-10-22T17:21:50.902725] [INFO ] [MAIN ] AVD: Loaded 21426 existing records. [2025-10-22T17:21:51.087028] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:21:51.087274] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-22T17:21:51.087333] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-22T17:21:51.087509] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-22T17:21:51.087565] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-22T17:21:51.325176] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-22T17:21:51.454929] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:21:52.117694] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-22T17:21:52.926135] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-22T17:21:52.931247] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T17:21:53.717703] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-22T17:21:53.745749] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T17:21:53.796462] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T17:21:54.517721] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-22T17:21:54.760230] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-22T17:21:55.225848] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-22T17:21:55.317686] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-22T17:21:56.117712] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-22T17:21:56.917628] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-22T17:21:57.002863] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T17:21:57.654014] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T17:21:57.659803] [INFO ] [REMOTE ] AVA: Full fetch complete (55496 records). [2025-10-22T17:21:57.659940] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-22T17:21:57.725809] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-22T17:21:57.757937] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-22T17:21:57.778096] [INFO ] [REMOTE ] AVAL: Full fetch complete (15062 records). [2025-10-22T17:21:57.822320] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-22T17:21:58.377172] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-22T17:21:58.377877] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-22T17:21:58.384171] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-22T17:21:58.389490] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-22T17:21:58.464983] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-22T17:21:58.465317] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-22T17:21:58.465552] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-22T17:21:58.465629] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-22T17:21:58.465228] [DEBUG] [LOCAL ] AVA: Trimmed 55496 records to 38305 (keeping 200 days of data) [2025-10-22T17:21:58.467377] [DEBUG] [LOCAL ] AVAL: Trimmed 15062 records to 8482 (keeping 200 days of data) [2025-10-22T17:21:58.538627] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-22T17:21:58.613914] [DEBUG] [LOCAL ] AVAL: Primary data saved (8482 records). [2025-10-22T17:21:58.619984] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-22T17:21:58.620092] [INFO ] [MAIN ] Update Progress: 181/2367 symbols completed. AVAL took 30.3s. Estimated remaining: 4h 24m 30s. Rate: 8.3 symbols/min [2025-10-22T17:21:58.871811] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:58.932431] [DEBUG] [LOCAL ] AVA: Primary data saved (38305 records). [2025-10-22T17:21:58.933124] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-22T17:21:58.933280] [INFO ] [MAIN ] Update Progress: 182/2367 symbols completed. AVA took 31.3s. Estimated remaining: 4h 22m 59s. Rate: 8.3 symbols/min [2025-10-22T17:21:59.028974] [DEBUG] [LOCAL ] AVK: Loaded 18704 existing records from primary storage. [2025-10-22T17:21:59.045490] [INFO ] [MAIN ] AVK: Loaded 18704 existing records. [2025-10-22T17:21:59.205366] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:21:59.306369] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:21:59.307519] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-22T17:21:59.307608] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-22T17:21:59.307915] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-22T17:21:59.307970] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-22T17:21:59.440078] [DEBUG] [LOCAL ] AVNS: Loaded 33563 existing records from primary storage. [2025-10-22T17:21:59.451098] [INFO ] [MAIN ] AVNS: Loaded 33563 existing records. [2025-10-22T17:21:59.660698] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T17:21:59.682970] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-22T17:21:59.828279] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:21:59.845662] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-22T17:21:59.880417] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-22T17:21:59.887215] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-22T17:21:59.908384] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-22T17:21:59.941077] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-22T17:21:59.965315] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:22:00.122776] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-22T17:22:00.337902] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:22:00.917714] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-22T17:22:01.171007] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T17:22:01.443985] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T17:22:01.717746] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-22T17:22:02.456912] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-22T17:22:02.517767] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-22T17:22:02.752266] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-22T17:22:03.317718] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-22T17:22:03.627249] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T17:22:04.117731] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-22T17:22:04.841277] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T17:22:04.917707] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-22T17:22:04.990885] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T17:22:05.717672] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-22T17:22:05.819374] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T17:22:06.517742] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-22T17:22:07.206875] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T17:22:07.317741] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-22T17:22:07.331847] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-22T17:22:08.117708] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-22T17:22:08.379784] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T17:22:08.917753] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-22T17:22:09.536020] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T17:22:09.717709] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-22T17:22:10.099579] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T17:22:10.517758] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-22T17:22:10.851676] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-22T17:22:11.317726] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-22T17:22:11.637455] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T17:22:12.117703] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-22T17:22:12.455079] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-22T17:22:12.917691] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-22T17:22:13.099790] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-22T17:22:13.717699] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-22T17:22:14.517702] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-22T17:22:14.575895] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T17:22:14.794893] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T17:22:15.317752] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-22T17:22:15.732961] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T17:22:16.117632] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-22T17:22:16.416348] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-22T17:22:16.917727] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-22T17:22:17.493882] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T17:22:17.717758] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-22T17:22:18.063441] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T17:22:18.066452] [INFO ] [REMOTE ] AVD: Full fetch complete (32580 records). [2025-10-22T17:22:18.066532] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-22T17:22:18.431495] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-22T17:22:18.431605] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-22T17:22:18.432068] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-22T17:22:18.432140] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-22T17:22:18.433303] [DEBUG] [LOCAL ] AVD: Trimmed 32580 records to 21323 (keeping 200 days of data) [2025-10-22T17:22:18.522691] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-22T17:22:18.557208] [DEBUG] [LOCAL ] AVD: Primary data saved (21323 records). [2025-10-22T17:22:18.557333] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-22T17:22:18.557409] [INFO ] [MAIN ] Update Progress: 183/2367 symbols completed. AVD took 27.9s. Estimated remaining: 4h 25m 20s. Rate: 8.2 symbols/min [2025-10-22T17:22:18.725448] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:22:18.761607] [DEBUG] [LOCAL ] AVNT: Loaded 38781 existing records from primary storage. [2025-10-22T17:22:18.761906] [INFO ] [MAIN ] AVNT: Loaded 38781 existing records. [2025-10-22T17:22:18.938726] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:22:18.938980] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-22T17:22:18.939049] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-22T17:22:18.939240] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-22T17:22:18.939295] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-22T17:22:19.293016] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:22:19.317614] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-22T17:22:19.402600] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:22:19.410099] [INFO ] [REMOTE ] AVB: Full fetch complete (59416 records). [2025-10-22T17:22:19.410220] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-22T17:22:19.563552] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T17:22:19.845379] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-22T17:22:19.845452] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-22T17:22:19.846273] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-22T17:22:19.846330] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-22T17:22:19.847896] [DEBUG] [LOCAL ] AVB: Trimmed 59416 records to 42169 (keeping 200 days of data) [2025-10-22T17:22:20.107924] [DEBUG] [LOCAL ] AVB: Primary data saved (42169 records). [2025-10-22T17:22:20.108051] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-22T17:22:20.108772] [INFO ] [MAIN ] Update Progress: 184/2367 symbols completed. AVB took 37.2s. Estimated remaining: 4h 24m 4s. Rate: 8.3 symbols/min [2025-10-22T17:22:20.122854] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-22T17:22:20.278624] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:22:20.330244] [DEBUG] [LOCAL ] AVTR: Loaded 53572 existing records from primary storage. [2025-10-22T17:22:20.330603] [INFO ] [MAIN ] AVTR: Loaded 53572 existing records. [2025-10-22T17:22:20.503943] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:22:20.504124] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-22T17:22:20.504170] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-22T17:22:20.504624] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-22T17:22:20.504713] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-22T17:22:20.870338] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:22:20.892218] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T17:22:20.917624] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-22T17:22:21.637319] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T17:22:21.717745] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-22T17:22:22.517694] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-22T17:22:22.789359] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-22T17:22:23.203885] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T17:22:23.317744] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-22T17:22:23.706748] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-22T17:22:24.117735] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-22T17:22:24.721174] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T17:22:24.917750] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-22T17:22:25.240998] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T17:22:25.717956] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-22T17:22:25.920128] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T17:22:26.517720] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-22T17:22:27.280113] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T17:22:27.317605] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-22T17:22:28.097538] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-22T17:22:28.103442] [INFO ] [REMOTE ] AVNS: Full fetch complete (48439 records). [2025-10-22T17:22:28.103530] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-22T17:22:28.124669] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-22T17:22:28.497869] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-22T17:22:28.497969] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-22T17:22:28.498503] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-22T17:22:28.498545] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-22T17:22:28.499465] [DEBUG] [LOCAL ] AVNS: Trimmed 48439 records to 33534 (keeping 200 days of data) [2025-10-22T17:22:28.693150] [DEBUG] [LOCAL ] AVNS: Primary data saved (33534 records). [2025-10-22T17:22:28.693280] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-22T17:22:28.693357] [INFO ] [MAIN ] Update Progress: 185/2367 symbols completed. AVNS took 29.8s. Estimated remaining: 4h 24m 13s. Rate: 8.3 symbols/min [2025-10-22T17:22:28.862754] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:22:28.899698] [DEBUG] [LOCAL ] AVY: Loaded 38140 existing records from primary storage. [2025-10-22T17:22:28.899974] [INFO ] [MAIN ] AVY: Loaded 38140 existing records. [2025-10-22T17:22:28.931240] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-22T17:22:29.092181] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:22:29.092528] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-22T17:22:29.092876] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-22T17:22:29.093376] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-22T17:22:29.093587] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-22T17:22:29.172532] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T17:22:29.319250] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T17:22:29.510351] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:22:29.717927] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-22T17:22:30.488445] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T17:22:30.517708] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-22T17:22:31.304964] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T17:22:31.317613] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-22T17:22:31.951564] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T17:22:32.117717] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-22T17:22:32.626010] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:22:32.917723] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-22T17:22:33.717712] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-22T17:22:33.826900] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T17:22:34.223770] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T17:22:34.227549] [INFO ] [REMOTE ] AVK: Full fetch complete (26720 records). [2025-10-22T17:22:34.227619] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-22T17:22:34.518747] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-22T17:22:34.603711] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-22T17:22:34.603795] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-22T17:22:34.604186] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-22T17:22:34.604247] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-22T17:22:34.604979] [DEBUG] [LOCAL ] AVK: Trimmed 26720 records to 18618 (keeping 200 days of data) [2025-10-22T17:22:34.717563] [DEBUG] [LOCAL ] AVK: Primary data saved (18618 records). [2025-10-22T17:22:34.717764] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-22T17:22:34.717852] [INFO ] [MAIN ] Update Progress: 186/2367 symbols completed. AVK took 36.1s. Estimated remaining: 4h 23m 51s. Rate: 8.3 symbols/min [2025-10-22T17:22:34.888836] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:22:34.911908] [DEBUG] [LOCAL ] AWF: Loaded 24135 existing records from primary storage. [2025-10-22T17:22:34.912186] [INFO ] [MAIN ] AWF: Loaded 24135 existing records. [2025-10-22T17:22:35.102356] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:22:35.102663] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-22T17:22:35.102727] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-22T17:22:35.102967] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-22T17:22:35.103023] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-22T17:22:35.331359] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-22T17:22:35.423009] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T17:22:35.523049] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:22:36.121965] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-22T17:22:36.124311] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T17:22:36.917728] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-22T17:22:37.147155] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T17:22:37.421846] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T17:22:37.717704] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-22T17:22:38.293407] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T17:22:38.517707] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-22T17:22:38.904427] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T17:22:39.317688] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-22T17:22:39.836167] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T17:22:40.117684] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-22T17:22:40.635565] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T17:22:40.917694] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-22T17:22:41.605191] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T17:22:41.717638] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-22T17:22:42.113251] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-22T17:22:42.517802] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-22T17:22:43.317684] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-22T17:22:43.344841] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T17:22:43.952710] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T17:22:44.117728] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-22T17:22:44.917729] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-22T17:22:45.200007] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T17:22:45.236924] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T17:22:45.717720] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-22T17:22:46.245695] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T17:22:46.251734] [INFO ] [REMOTE ] AVNT: Full fetch complete (56095 records). [2025-10-22T17:22:46.251869] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-22T17:22:46.522888] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-22T17:22:46.678001] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-22T17:22:46.678085] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-22T17:22:46.678683] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-22T17:22:46.678744] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-22T17:22:46.679893] [DEBUG] [LOCAL ] AVNT: Trimmed 56095 records to 38618 (keeping 200 days of data) [2025-10-22T17:22:46.914153] [DEBUG] [LOCAL ] AVNT: Primary data saved (38618 records). [2025-10-22T17:22:46.914319] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-22T17:22:46.915195] [INFO ] [MAIN ] Update Progress: 187/2367 symbols completed. AVNT took 28.4s. Estimated remaining: 4h 24m 41s. Rate: 8.2 symbols/min [2025-10-22T17:22:47.085789] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:22:47.144181] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T17:22:47.157936] [DEBUG] [LOCAL ] AWI: Loaded 25268 existing records from primary storage. [2025-10-22T17:22:47.158339] [INFO ] [MAIN ] AWI: Loaded 25268 existing records. [2025-10-22T17:22:47.328134] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-22T17:22:47.334015] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:22:47.334304] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-22T17:22:47.334357] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-22T17:22:47.334554] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-22T17:22:47.334609] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-22T17:22:47.720363] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T17:22:47.724518] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:22:48.117699] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-22T17:22:48.922725] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-22T17:22:48.950480] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T17:22:49.302636] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T17:22:49.717745] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-22T17:22:50.396797] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T17:22:50.517705] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-22T17:22:50.927514] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T17:22:51.317694] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-22T17:22:51.924318] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T17:22:52.117695] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-22T17:22:52.593972] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T17:22:52.917720] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-22T17:22:53.450221] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T17:22:53.710784] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T17:22:53.717917] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-22T17:22:54.517759] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-22T17:22:55.329501] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-22T17:22:55.351589] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T17:22:55.651306] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T17:22:56.117707] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-22T17:22:56.653568] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T17:22:56.917752] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-22T17:22:57.717711] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-22T17:22:58.011770] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T17:22:58.021151] [INFO ] [REMOTE ] AVTR: Full fetch complete (77669 records). [2025-10-22T17:22:58.021313] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-22T17:22:58.429843] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T17:22:58.467624] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-22T17:22:58.467962] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-22T17:22:58.469372] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-22T17:22:58.469482] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-22T17:22:58.476832] [DEBUG] [LOCAL ] AVTR: Trimmed 77669 records to 53571 (keeping 200 days of data) [2025-10-22T17:22:58.486782] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-22T17:22:58.541119] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-22T17:22:58.819207] [DEBUG] [LOCAL ] AVTR: Primary data saved (53571 records). [2025-10-22T17:22:58.819363] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-22T17:22:58.820173] [INFO ] [MAIN ] Update Progress: 188/2367 symbols completed. AVTR took 38.7s. Estimated remaining: 4h 25m 27s. Rate: 8.2 symbols/min [2025-10-22T17:22:58.998836] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:22:59.047971] [DEBUG] [LOCAL ] AWK: Loaded 48465 existing records from primary storage. [2025-10-22T17:22:59.048327] [INFO ] [MAIN ] AWK: Loaded 48465 existing records. [2025-10-22T17:22:59.230805] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:22:59.231040] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-22T17:22:59.231087] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-22T17:22:59.231343] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-22T17:22:59.231397] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-22T17:22:59.322866] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-22T17:22:59.594553] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:22:59.803891] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T17:22:59.810065] [INFO ] [REMOTE ] AWF: Full fetch complete (36039 records). [2025-10-22T17:22:59.810279] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-22T17:23:00.125330] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-22T17:23:00.248630] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-22T17:23:00.248757] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-22T17:23:00.249207] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-22T17:23:00.249251] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-22T17:23:00.250228] [DEBUG] [LOCAL ] AWF: Trimmed 36039 records to 24048 (keeping 200 days of data) [2025-10-22T17:23:00.398989] [DEBUG] [LOCAL ] AWF: Primary data saved (24048 records). [2025-10-22T17:23:00.399139] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-22T17:23:00.399222] [INFO ] [MAIN ] Update Progress: 189/2367 symbols completed. AWF took 25.7s. Estimated remaining: 4h 24m 14s. Rate: 8.2 symbols/min [2025-10-22T17:23:00.577247] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:23:00.599392] [DEBUG] [LOCAL ] AWP: Loaded 21668 existing records from primary storage. [2025-10-22T17:23:00.599639] [INFO ] [MAIN ] AWP: Loaded 21668 existing records. [2025-10-22T17:23:00.782443] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:23:00.782782] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-22T17:23:00.782841] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-22T17:23:00.783506] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-22T17:23:00.783565] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-22T17:23:00.929164] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-22T17:23:01.190591] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:23:01.717807] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-22T17:23:05.999364] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (5.07 seconds). [2025-10-22T17:23:06.005939] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-22T17:23:06.029425] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (6.71 seconds). [2025-10-22T17:23:06.039481] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-22T17:23:06.086434] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (4.37 seconds). [2025-10-22T17:23:06.092364] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-22T17:23:06.629801] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (6.50 seconds). [2025-10-22T17:23:06.639435] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-22T17:23:07.119848] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-22T17:23:07.124030] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-22T17:23:07.221401] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T17:23:07.227439] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-22T17:23:07.425441] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-22T17:23:07.433901] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-22T17:23:08.239545] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T17:23:08.244448] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-22T17:23:08.546088] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T17:23:08.550860] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T17:23:08.917870] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-22T17:23:09.294849] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T17:23:09.309371] [INFO ] [REMOTE ] AVY: Full fetch complete (56702 records). [2025-10-22T17:23:09.322081] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-22T17:23:09.322855] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T17:23:09.706084] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-22T17:23:09.706160] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-22T17:23:09.706764] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-22T17:23:09.706826] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-22T17:23:09.708074] [DEBUG] [LOCAL ] AVY: Trimmed 56702 records to 38119 (keeping 200 days of data) [2025-10-22T17:23:09.765055] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-22T17:23:09.951226] [DEBUG] [LOCAL ] AVY: Primary data saved (38119 records). [2025-10-22T17:23:09.951380] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-22T17:23:09.952270] [INFO ] [MAIN ] Update Progress: 190/2367 symbols completed. AVY took 41.3s. Estimated remaining: 4h 24m 33s. Rate: 8.2 symbols/min [2025-10-22T17:23:10.122080] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:23:10.147157] [DEBUG] [LOCAL ] AWR: Loaded 22805 existing records from primary storage. [2025-10-22T17:23:10.147418] [INFO ] [MAIN ] AWR: Loaded 22805 existing records. [2025-10-22T17:23:10.325859] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:23:10.326184] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-22T17:23:10.326257] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-22T17:23:10.326600] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-22T17:23:10.326736] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-22T17:23:10.522884] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-22T17:23:10.695267] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:23:10.737988] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T17:23:10.857912] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T17:23:11.317634] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-22T17:23:11.734973] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T17:23:12.117734] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-22T17:23:12.502340] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T17:23:12.917696] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-22T17:23:13.146003] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T17:23:13.717751] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-22T17:23:14.517686] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-22T17:23:14.705554] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T17:23:15.097262] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T17:23:15.317629] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-22T17:23:15.618970] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T17:23:16.117712] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-22T17:23:16.917751] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-22T17:23:17.204448] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T17:23:17.285158] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T17:23:17.679362] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-22T17:23:17.717619] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-22T17:23:18.517743] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-22T17:23:18.996028] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T17:23:19.317761] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-22T17:23:20.123275] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-22T17:23:20.135102] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T17:23:20.343239] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T17:23:20.917691] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-22T17:23:21.270470] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T17:23:21.274924] [INFO ] [REMOTE ] AWI: Full fetch complete (36060 records). [2025-10-22T17:23:21.275016] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-22T17:23:21.646283] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-22T17:23:21.646355] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-22T17:23:21.646811] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-22T17:23:21.646873] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-22T17:23:21.647593] [DEBUG] [LOCAL ] AWI: Trimmed 36060 records to 25139 (keeping 200 days of data) [2025-10-22T17:23:21.739394] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-22T17:23:21.807800] [DEBUG] [LOCAL ] AWI: Primary data saved (25139 records). [2025-10-22T17:23:21.807935] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-22T17:23:21.808015] [INFO ] [MAIN ] Update Progress: 191/2367 symbols completed. AWI took 34.9s. Estimated remaining: 4h 25m 18s. Rate: 8.2 symbols/min [2025-10-22T17:23:21.944263] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T17:23:21.990674] [INFO ] [REMOTE ] AWP: Full fetch complete (31708 records). [2025-10-22T17:23:21.993980] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:23:21.994141] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-22T17:23:22.295600] [DEBUG] [LOCAL ] AX: Loaded 27940 existing records from primary storage. [2025-10-22T17:23:22.296103] [INFO ] [MAIN ] AX: Loaded 27940 existing records. [2025-10-22T17:23:22.500474] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-22T17:23:22.505755] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-22T17:23:22.543252] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-22T17:23:22.524353] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-22T17:23:22.565415] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:23:22.566678] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-22T17:23:22.566735] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-22T17:23:22.567004] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-22T17:23:22.567058] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-22T17:23:22.565504] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-22T17:23:22.647724] [DEBUG] [LOCAL ] AWP: Trimmed 31708 records to 21587 (keeping 200 days of data) [2025-10-22T17:23:23.040411] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:23:23.075016] [DEBUG] [LOCAL ] AWP: Primary data saved (21587 records). [2025-10-22T17:23:23.074316] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T17:23:23.075196] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-22T17:23:23.080087] [INFO ] [MAIN ] Update Progress: 192/2367 symbols completed. AWP took 22.7s. Estimated remaining: 4h 24m 2s. Rate: 8.2 symbols/min [2025-10-22T17:23:23.243180] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:23:23.243349] [DEBUG] [LOCAL ] AXL: No existing data file found in primary storage. [2025-10-22T17:23:23.243438] [WARN ] [MAIN ] AXL: No existing data found, performing full refresh instead. [2025-10-22T17:23:23.243519] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-22T17:23:23.243554] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-22T17:23:23.243594] [DEBUG] [LOCAL ] AXL: No primary data file found to delete. [2025-10-22T17:23:23.243626] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-22T17:23:23.322740] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-22T17:23:23.599351] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:23:24.117762] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-22T17:23:24.596592] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-22T17:23:24.624963] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T17:23:24.917739] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-22T17:23:25.449539] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T17:23:25.717628] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-22T17:23:25.861518] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T17:23:26.517700] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-22T17:23:27.220354] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T17:23:27.317610] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-22T17:23:27.648105] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T17:23:28.117730] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-22T17:23:28.820076] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T17:23:28.917706] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-22T17:23:29.207265] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T17:23:29.717707] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-22T17:23:30.532754] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-22T17:23:30.535864] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T17:23:30.926248] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T17:23:31.317685] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-22T17:23:31.779047] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T17:23:32.117771] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-22T17:23:32.917708] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-22T17:23:33.015515] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T17:23:33.222083] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-22T17:23:33.717717] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-22T17:23:34.517629] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-22T17:23:34.607356] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T17:23:34.767758] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T17:23:35.317764] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-22T17:23:36.117683] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-22T17:23:36.145756] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T17:23:36.917623] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-22T17:23:37.107322] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T17:23:37.718100] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-22T17:23:37.719755] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-22T17:23:37.723990] [INFO ] [REMOTE ] AWR: Full fetch complete (32482 records). [2025-10-22T17:23:37.724062] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-22T17:23:38.099500] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-22T17:23:38.099596] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-22T17:23:38.100044] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-22T17:23:38.100102] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-22T17:23:38.100855] [DEBUG] [LOCAL ] AWR: Trimmed 32482 records to 22661 (keeping 200 days of data) [2025-10-22T17:23:38.232184] [DEBUG] [LOCAL ] AWR: Primary data saved (22661 records). [2025-10-22T17:23:38.232300] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-22T17:23:38.232373] [INFO ] [MAIN ] Update Progress: 193/2367 symbols completed. AWR took 28.3s. Estimated remaining: 4h 25m 23s. Rate: 8.2 symbols/min [2025-10-22T17:23:38.400440] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:23:38.452245] [DEBUG] [LOCAL ] AXP: Loaded 53161 existing records from primary storage. [2025-10-22T17:23:38.452572] [INFO ] [MAIN ] AXP: Loaded 53161 existing records. [2025-10-22T17:23:38.522781] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-22T17:23:38.636772] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:23:38.637026] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-22T17:23:38.637088] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-22T17:23:38.637288] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-22T17:23:38.637324] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-22T17:23:38.937074] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-22T17:23:39.003036] [INFO ] [REMOTE ] AWK: Full fetch complete (70926 records). [2025-10-22T17:23:39.023168] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:23:39.023791] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-22T17:23:39.324573] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-22T17:23:39.456977] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-22T17:23:39.457167] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-22T17:23:39.458130] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-22T17:23:39.458274] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-22T17:23:39.484549] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T17:23:39.494278] [DEBUG] [LOCAL ] AWK: Trimmed 70926 records to 48388 (keeping 200 days of data) [2025-10-22T17:23:39.736584] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T17:23:39.815561] [DEBUG] [LOCAL ] AWK: Primary data saved (48388 records). [2025-10-22T17:23:39.815718] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-22T17:23:39.816495] [INFO ] [MAIN ] Update Progress: 194/2367 symbols completed. AWK took 41.0s. Estimated remaining: 4h 24m 12s. Rate: 8.2 symbols/min [2025-10-22T17:23:39.989082] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:23:39.994731] [DEBUG] [LOCAL ] AXR: Loaded 2916 existing records from primary storage. [2025-10-22T17:23:39.994913] [INFO ] [MAIN ] AXR: Loaded 2916 existing records. [2025-10-22T17:23:40.122793] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-22T17:23:40.178947] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:23:40.179112] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-22T17:23:40.179159] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-22T17:23:40.179312] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-22T17:23:40.179368] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-22T17:23:40.527556] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:23:40.917733] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-22T17:23:41.344540] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-22T17:23:41.717730] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-22T17:23:41.925720] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T17:23:42.164271] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T17:23:42.430042] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-22T17:23:42.517702] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-22T17:23:43.015557] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-22T17:23:43.317703] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-22T17:23:44.117689] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-22T17:23:44.643216] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-22T17:23:44.917735] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-22T17:23:45.388927] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-22T17:23:45.717780] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-22T17:23:46.334384] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-22T17:23:46.517931] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-22T17:23:46.698963] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T17:23:47.317697] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-22T17:23:47.787094] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-22T17:23:48.117714] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-22T17:23:48.601969] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-22T17:23:48.672320] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-22T17:23:48.917774] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-22T17:23:49.528062] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T17:23:49.717744] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-22T17:23:50.517726] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-22T17:23:51.106167] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-22T17:23:51.317691] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-22T17:23:51.919549] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T17:23:52.000464] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-22T17:23:52.117633] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-22T17:23:52.762065] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T17:23:52.762930] [INFO ] [REMOTE ] AXR: Full fetch complete (4393 records). [2025-10-22T17:23:52.762998] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-22T17:23:52.922770] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-22T17:23:53.145450] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-22T17:23:53.145530] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-22T17:23:53.145680] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-22T17:23:53.145741] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-22T17:23:53.146112] [DEBUG] [LOCAL ] AXR: Trimmed 4393 records to 2907 (keeping 200 days of data) [2025-10-22T17:23:53.163393] [DEBUG] [LOCAL ] AXR: Primary data saved (2907 records). [2025-10-22T17:23:53.163472] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-22T17:23:53.163545] [INFO ] [MAIN ] Update Progress: 195/2367 symbols completed. AXR took 13.3s. Estimated remaining: 4h 25m 12s. Rate: 8.2 symbols/min [2025-10-22T17:23:53.328296] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:23:53.363875] [DEBUG] [LOCAL ] AXS: Loaded 38784 existing records from primary storage. [2025-10-22T17:23:53.364157] [INFO ] [MAIN ] AXS: Loaded 38784 existing records. [2025-10-22T17:23:53.539441] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:23:53.539686] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-22T17:23:53.539743] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-22T17:23:53.539978] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-22T17:23:53.540015] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-22T17:23:53.724714] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-22T17:23:53.896244] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:23:54.517629] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-22T17:23:54.845420] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-22T17:23:55.317717] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-22T17:23:55.774212] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-22T17:23:55.878010] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T17:23:56.117772] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-22T17:23:56.423182] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T17:23:56.917632] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-22T17:23:57.241135] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-22T17:23:57.717742] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-22T17:23:58.354917] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T17:23:58.517696] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-22T17:23:59.317616] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-22T17:23:59.485722] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T17:23:59.494403] [INFO ] [REMOTE ] AXL: Full fetch complete (73118 records). [2025-10-22T17:23:59.494555] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-22T17:23:59.890158] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-22T17:23:59.890279] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-22T17:23:59.891128] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-22T17:23:59.891272] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-22T17:23:59.914303] [DEBUG] [LOCAL ] AXL: Trimmed 73118 records to 50533 (keeping 200 days of data) [2025-10-22T17:23:59.915613] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T17:24:00.121692] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-22T17:24:00.204894] [DEBUG] [LOCAL ] AXL: Primary data saved (50533 records). [2025-10-22T17:24:00.205033] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-22T17:24:00.205106] [INFO ] [MAIN ] Update Progress: 196/2367 symbols completed. AXL took 37.1s. Estimated remaining: 4h 25m 1s. Rate: 8.2 symbols/min [2025-10-22T17:24:00.375978] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:00.421491] [DEBUG] [LOCAL ] AXTA: Loaded 52287 existing records from primary storage. [2025-10-22T17:24:00.421838] [INFO ] [MAIN ] AXTA: Loaded 52287 existing records. [2025-10-22T17:24:00.616288] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:24:00.616515] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-22T17:24:00.616565] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-22T17:24:00.617213] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-22T17:24:00.617286] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-22T17:24:00.919057] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-22T17:24:00.996456] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:24:01.006963] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:01.007516] [INFO ] [REMOTE ] AX: Full fetch complete (42209 records). [2025-10-22T17:24:01.007944] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-22T17:24:01.398688] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-22T17:24:01.398834] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-22T17:24:01.399367] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-22T17:24:01.399411] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-22T17:24:01.400449] [DEBUG] [LOCAL ] AX: Trimmed 42209 records to 27804 (keeping 200 days of data) [2025-10-22T17:24:01.565283] [DEBUG] [LOCAL ] AX: Primary data saved (27804 records). [2025-10-22T17:24:01.565422] [INFO ] [MAIN ] AX: Full history saved. [2025-10-22T17:24:01.565504] [INFO ] [MAIN ] Update Progress: 197/2367 symbols completed. AX took 39.8s. Estimated remaining: 4h 23m 48s. Rate: 8.2 symbols/min [2025-10-22T17:24:01.600082] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T17:24:01.717717] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-22T17:24:02.517738] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-22T17:24:03.016411] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-22T17:24:03.107108] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T17:24:03.317723] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-22T17:24:03.909955] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T17:24:04.117734] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-22T17:24:04.917692] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-22T17:24:05.566637] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-22T17:24:05.717694] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-22T17:24:05.785350] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T17:24:06.342528] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T17:24:06.517724] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-22T17:24:07.317757] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-22T17:24:07.831931] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-22T17:24:08.117708] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-22T17:24:08.156312] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T17:24:08.917916] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-22T17:24:08.922749] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-22T17:24:09.717687] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-22T17:24:09.967518] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T17:24:10.517755] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-22T17:24:10.602333] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T17:24:10.756064] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T17:24:11.317807] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-22T17:24:12.117750] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-22T17:24:13.075595] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T17:24:13.084499] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-22T17:24:13.291586] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (2.77 seconds). [2025-10-22T17:24:13.300395] [INFO ] [REMOTE ] AXP: Full fetch complete (77120 records). [2025-10-22T17:24:13.300536] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-22T17:24:13.701591] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-22T17:24:13.701718] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-22T17:24:13.702824] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-22T17:24:13.702990] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-22T17:24:13.731038] [DEBUG] [LOCAL ] AXP: Trimmed 77120 records to 53162 (keeping 200 days of data) [2025-10-22T17:24:13.733058] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T17:24:13.744921] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-22T17:24:14.079142] [DEBUG] [LOCAL ] AXP: Primary data saved (53162 records). [2025-10-22T17:24:14.079284] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-22T17:24:14.080285] [INFO ] [MAIN ] Update Progress: 198/2367 symbols completed. AXP took 35.8s. Estimated remaining: 4h 24m 38s. Rate: 8.2 symbols/min [2025-10-22T17:24:14.570870] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T17:24:14.577448] [INFO ] [REMOTE ] AXS: Full fetch complete (55899 records). [2025-10-22T17:24:14.577586] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-22T17:24:14.578341] [FATAL] [VALIDATOR ] AXS: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:24:14.578467] [FATAL] [MAIN ] AXS: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:24:14.578542] [WARN ] [MAIN ] AXS: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:24:14.578627] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-22T17:24:14.578765] [DEBUG] [LOCAL ] AXS: No primary data file found to delete. [2025-10-22T17:24:14.578812] [INFO ] [LOCAL ] AXS: Starting deletion of derivative data. [2025-10-22T17:24:14.578968] [DEBUG] [LOCAL ] AXS: Deleted derivative data file. [2025-10-22T17:24:14.579555] [INFO ] [MAIN ] Update Progress: 199/2367 symbols completed. AXS took 21.4s. Estimated remaining: 4h 23m 16s. Rate: 8.2 symbols/min [2025-10-22T17:24:15.541948] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:24:15.552352] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-22T17:24:17.522766] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-22T17:24:17.539361] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-22T17:24:19.243751] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T17:24:19.254762] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-22T17:24:21.073131] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T17:24:21.084485] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-22T17:24:22.943633] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T17:24:22.952476] [INFO ] [REMOTE ] AXTA: Full fetch complete (75466 records). [2025-10-22T17:24:22.952610] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-22T17:24:23.356964] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-22T17:24:23.357057] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-22T17:24:23.357897] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-22T17:24:23.357971] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-22T17:24:23.359467] [DEBUG] [LOCAL ] AXTA: Trimmed 75466 records to 52290 (keeping 200 days of data) [2025-10-22T17:24:23.660628] [DEBUG] [LOCAL ] AXTA: Primary data saved (52290 records). [2025-10-22T17:24:23.660793] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-22T17:24:23.660875] [INFO ] [MAIN ] Update Progress: 200/2367 symbols completed. AXTA took 23.5s. Estimated remaining: 4h 23m 29s. Rate: 8.2 symbols/min [2025-10-22T17:24:24.258239] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:24.343452] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-22T17:24:24.361983] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:24.370364] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:24.370599] [DEBUG] [LOCAL ] AZO: No existing data file found in primary storage. [2025-10-22T17:24:24.372474] [WARN ] [MAIN ] AZO: No existing data found, performing full refresh instead. [2025-10-22T17:24:24.372373] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-22T17:24:24.374072] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-22T17:24:24.374333] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-22T17:24:24.374278] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-22T17:24:24.374444] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-22T17:24:24.389461] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-22T17:24:24.394064] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:24.394296] [DEBUG] [LOCAL ] AZO: No primary data file found to delete. [2025-10-22T17:24:24.394940] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-22T17:24:24.395011] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-22T17:24:24.720466] [DEBUG] [LOCAL ] AZZ: Loaded 22911 existing records from primary storage. [2025-10-22T17:24:24.731508] [INFO ] [MAIN ] AZZ: Loaded 22911 existing records. [2025-10-22T17:24:24.726077] [DEBUG] [LOCAL ] AYI: Loaded 24331 existing records from primary storage. [2025-10-22T17:24:24.833334] [INFO ] [MAIN ] AYI: Loaded 24331 existing records. [2025-10-22T17:24:25.410679] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:24:25.506916] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-22T17:24:25.563865] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:25.571544] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:25.571920] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-22T17:24:25.544234] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-22T17:24:25.572168] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-22T17:24:25.575160] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:24:25.576349] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-22T17:24:25.577116] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-22T17:24:25.577540] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-22T17:24:25.577727] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-22T17:24:25.577578] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-22T17:24:25.602314] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-22T17:24:26.258313] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:26.287338] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-22T17:24:26.331251] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:26.331935] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-22T17:24:26.340530] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T17:24:26.343407] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-22T17:24:26.830585] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T17:24:26.836597] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-22T17:24:27.035115] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:24:27.035418] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-22T17:24:27.035504] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:24:27.035575] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-22T17:24:27.035613] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:24:27.035700] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-22T17:24:27.035766] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-22T17:24:27.035805] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-22T17:24:27.035862] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-22T17:24:27.035918] [INFO ] [MAIN ] Update Progress: 201/2367 symbols completed. B took 3.4s. Estimated remaining: 4h 22m 39s. Rate: 8.2 symbols/min [2025-10-22T17:24:27.150296] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T17:24:27.170434] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-22T17:24:27.247716] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:27.301177] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-22T17:24:27.301518] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-22T17:24:27.510380] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:24:27.510798] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-22T17:24:27.510874] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-22T17:24:27.511113] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-22T17:24:27.511181] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-22T17:24:27.701336] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T17:24:27.780928] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-22T17:24:27.945665] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T17:24:27.953909] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:27.960724] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-22T17:24:27.961482] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-22T17:24:28.078510] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-22T17:24:28.082091] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-22T17:24:28.932968] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T17:24:28.937609] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-22T17:24:29.051579] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T17:24:29.056387] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-22T17:24:29.269398] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-22T17:24:29.272773] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-22T17:24:30.022461] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T17:24:30.027362] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-22T17:24:30.303777] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-22T17:24:30.314808] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-22T17:24:30.341809] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T17:24:30.362627] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T17:24:30.517637] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-22T17:24:30.861543] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-22T17:24:31.317625] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-22T17:24:31.399064] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T17:24:32.117699] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-22T17:24:32.195233] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T17:24:32.219327] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-22T17:24:32.917639] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-22T17:24:32.984725] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T17:24:33.717763] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-22T17:24:33.945457] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T17:24:34.517764] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-22T17:24:35.317625] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-22T17:24:35.758220] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T17:24:36.117734] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-22T17:24:36.179422] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-22T17:24:36.504742] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-22T17:24:36.917626] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-22T17:24:36.981543] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T17:24:37.717747] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-22T17:24:38.517733] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-22T17:24:38.705592] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T17:24:39.317639] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-22T17:24:39.436532] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-22T17:24:39.837622] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T17:24:40.117748] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-22T17:24:40.296230] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-22T17:24:40.917700] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-22T17:24:41.717638] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-22T17:24:42.025209] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-22T17:24:42.476700] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-22T17:24:42.517614] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-22T17:24:42.654976] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T17:24:42.657003] [INFO ] [REMOTE ] AZO: Full fetch complete (15896 records). [2025-10-22T17:24:42.657077] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-22T17:24:43.025119] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-22T17:24:43.025202] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-22T17:24:43.025530] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-22T17:24:43.025572] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-22T17:24:43.026167] [DEBUG] [LOCAL ] AZO: Trimmed 15896 records to 10731 (keeping 200 days of data) [2025-10-22T17:24:43.092322] [DEBUG] [LOCAL ] AZO: Primary data saved (10731 records). [2025-10-22T17:24:43.092453] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-22T17:24:43.092524] [INFO ] [MAIN ] Update Progress: 202/2367 symbols completed. AZO took 19.4s. Estimated remaining: 4h 24m 6s. Rate: 8.2 symbols/min [2025-10-22T17:24:43.262418] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:43.318248] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-22T17:24:43.318414] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-22T17:24:43.319574] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-10-22T17:24:43.493564] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:24:43.493802] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-22T17:24:43.493849] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-22T17:24:43.494063] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-22T17:24:43.494103] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-22T17:24:43.840901] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:43.979102] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T17:24:43.984079] [INFO ] [REMOTE ] AZZ: Full fetch complete (32235 records). [2025-10-22T17:24:43.984172] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-22T17:24:44.122742] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-22T17:24:44.361812] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-22T17:24:44.361890] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-22T17:24:44.362393] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-22T17:24:44.362454] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-22T17:24:44.363320] [DEBUG] [LOCAL ] AZZ: Trimmed 32235 records to 22928 (keeping 200 days of data) [2025-10-22T17:24:44.497581] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T17:24:44.527143] [DEBUG] [LOCAL ] AZZ: Primary data saved (22928 records). [2025-10-22T17:24:44.527258] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-22T17:24:44.527330] [INFO ] [MAIN ] Update Progress: 203/2367 symbols completed. AZZ took 20.9s. Estimated remaining: 4h 22m 56s. Rate: 8.2 symbols/min [2025-10-22T17:24:44.689873] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:44.739539] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-22T17:24:44.739891] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-22T17:24:44.914675] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:24:44.914865] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-22T17:24:44.914913] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-22T17:24:44.915150] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-22T17:24:44.915200] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-22T17:24:44.926555] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-22T17:24:45.274389] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:45.717721] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-22T17:24:46.193409] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-22T17:24:46.463324] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-22T17:24:46.517627] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-22T17:24:47.317726] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-22T17:24:48.117634] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-22T17:24:48.324637] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-22T17:24:48.823528] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-22T17:24:48.917619] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-22T17:24:48.998988] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T17:24:49.717636] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-22T17:24:49.832485] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-22T17:24:50.517707] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-22T17:24:51.317769] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-22T17:24:51.508792] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-10-22T17:24:51.561707] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T17:24:51.922948] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-22T17:24:52.117724] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-22T17:24:52.917683] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-22T17:24:53.437468] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-22T17:24:53.717746] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-22T17:24:54.517736] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-22T17:24:54.674280] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-22T17:24:54.865871] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T17:24:54.869748] [INFO ] [REMOTE ] AYI: Full fetch complete (36737 records). [2025-10-22T17:24:54.869828] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-22T17:24:54.870367] [FATAL] [VALIDATOR ] AYI: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:24:54.870471] [FATAL] [MAIN ] AYI: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:24:54.870514] [WARN ] [MAIN ] AYI: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:24:54.870553] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-22T17:24:54.870609] [DEBUG] [LOCAL ] AYI: No primary data file found to delete. [2025-10-22T17:24:54.870669] [INFO ] [LOCAL ] AYI: Starting deletion of derivative data. [2025-10-22T17:24:54.870873] [DEBUG] [LOCAL ] AYI: Deleted derivative data file. [2025-10-22T17:24:54.870961] [INFO ] [MAIN ] Update Progress: 204/2367 symbols completed. AYI took 31.2s. Estimated remaining: 4h 23m 21s. Rate: 8.2 symbols/min [2025-10-22T17:24:55.042037] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:55.092612] [DEBUG] [LOCAL ] BAH: Loaded 51653 existing records from primary storage. [2025-10-22T17:24:55.092967] [INFO ] [MAIN ] BAH: Loaded 51653 existing records. [2025-10-22T17:24:55.266463] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:24:55.266690] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-22T17:24:55.266747] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-22T17:24:55.267018] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-22T17:24:55.267073] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-22T17:24:55.328211] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-22T17:24:55.625915] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:55.659098] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-22T17:24:56.117731] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-22T17:24:56.239986] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T17:24:56.248844] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-22T17:24:56.248969] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-22T17:24:56.634846] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-22T17:24:56.634986] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-22T17:24:56.635802] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-22T17:24:56.635874] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-22T17:24:56.637275] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 53790 (keeping 200 days of data) [2025-10-22T17:24:56.894195] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-22T17:24:56.917617] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-22T17:24:57.000574] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-22T17:24:57.000728] [INFO ] [MAIN ] BA: Full history saved. [2025-10-22T17:24:57.000851] [INFO ] [MAIN ] Update Progress: 205/2367 symbols completed. BA took 30.0s. Estimated remaining: 4h 22m 19s. Rate: 8.2 symbols/min [2025-10-22T17:24:57.171574] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:24:57.207024] [DEBUG] [LOCAL ] BAK: Loaded 39479 existing records from primary storage. [2025-10-22T17:24:57.207307] [INFO ] [MAIN ] BAK: Loaded 39479 existing records. [2025-10-22T17:24:57.381853] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:24:57.382087] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-22T17:24:57.382155] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-22T17:24:57.382481] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-22T17:24:57.382547] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-22T17:24:57.730937] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-22T17:24:57.736240] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:24:57.884695] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T17:24:58.517762] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-22T17:24:59.252277] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-22T17:24:59.317700] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-22T17:25:00.117715] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-22T17:25:00.355269] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T17:25:00.474626] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-10-22T17:25:00.917735] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-22T17:25:01.717727] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-22T17:25:01.876265] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-22T17:25:01.913958] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T17:25:02.517703] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-22T17:25:02.832478] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-22T17:25:03.317784] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-22T17:25:04.117725] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-22T17:25:04.435071] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-22T17:25:04.791531] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-22T17:25:04.917630] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-22T17:25:05.239028] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T17:25:05.310333] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T17:25:05.717735] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-22T17:25:06.517743] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-22T17:25:07.317636] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-22T17:25:07.472585] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-22T17:25:08.117739] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-22T17:25:08.343926] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-22T17:25:08.419870] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T17:25:08.457626] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-22T17:25:08.917687] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-22T17:25:09.717721] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-22T17:25:10.188080] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-22T17:25:10.517689] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-22T17:25:10.673531] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T17:25:11.317712] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-22T17:25:12.117625] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-22T17:25:12.618905] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-22T17:25:12.757897] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-22T17:25:12.858615] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T17:25:12.917606] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-22T17:25:13.717705] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-22T17:25:13.848865] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T17:25:14.370682] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T17:25:14.517716] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-22T17:25:15.317743] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-22T17:25:15.991263] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T17:25:16.117683] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-22T17:25:16.379637] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-22T17:25:16.387980] [INFO ] [REMOTE ] BAC: Full fetch complete (77598 records). [2025-10-22T17:25:16.388104] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-22T17:25:16.388884] [FATAL] [VALIDATOR ] BAC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:25:16.388972] [FATAL] [MAIN ] BAC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:25:16.389015] [WARN ] [MAIN ] BAC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:25:16.389083] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-22T17:25:16.389147] [DEBUG] [LOCAL ] BAC: No primary data file found to delete. [2025-10-22T17:25:16.389182] [INFO ] [LOCAL ] BAC: Starting deletion of derivative data. [2025-10-22T17:25:16.389341] [DEBUG] [LOCAL ] BAC: Deleted derivative data file. [2025-10-22T17:25:16.390060] [INFO ] [MAIN ] Update Progress: 206/2367 symbols completed. BAC took 31.9s. Estimated remaining: 4h 24m 19s. Rate: 8.2 symbols/min [2025-10-22T17:25:16.559851] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:25:16.610862] [DEBUG] [LOCAL ] BALL: Loaded 51939 existing records from primary storage. [2025-10-22T17:25:16.611180] [INFO ] [MAIN ] BALL: Loaded 51939 existing records. [2025-10-22T17:25:16.808811] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:25:16.809001] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-22T17:25:16.809047] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-22T17:25:16.809410] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-22T17:25:16.809475] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-22T17:25:16.922788] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-22T17:25:17.188820] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:25:17.216200] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-22T17:25:17.677542] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T17:25:17.717694] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-22T17:25:18.517729] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-22T17:25:19.198177] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T17:25:19.281788] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-22T17:25:19.317626] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-22T17:25:20.123426] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-22T17:25:20.143616] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T17:25:20.788383] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T17:25:20.917751] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-22T17:25:21.717630] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-22T17:25:22.015973] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T17:25:22.517717] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-22T17:25:22.915593] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T17:25:22.923709] [INFO ] [REMOTE ] BAH: Full fetch complete (74823 records). [2025-10-22T17:25:22.923851] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-22T17:25:22.924517] [FATAL] [VALIDATOR ] BAH: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:25:22.924606] [FATAL] [MAIN ] BAH: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:25:22.924683] [WARN ] [MAIN ] BAH: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:25:22.924756] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-22T17:25:22.924821] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-10-22T17:25:22.924860] [INFO ] [LOCAL ] BAH: Starting deletion of derivative data. [2025-10-22T17:25:22.924989] [DEBUG] [LOCAL ] BAH: Deleted derivative data file. [2025-10-22T17:25:22.925057] [INFO ] [MAIN ] Update Progress: 207/2367 symbols completed. BAH took 28.1s. Estimated remaining: 4h 24m 3s. Rate: 8.2 symbols/min [2025-10-22T17:25:23.096289] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:25:23.096470] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-22T17:25:23.096506] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-22T17:25:23.096638] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-22T17:25:23.096734] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-22T17:25:23.096787] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-22T17:25:23.096838] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-22T17:25:23.341701] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-22T17:25:23.462328] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:25:24.032445] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T17:25:24.039573] [INFO ] [REMOTE ] BAK: Full fetch complete (56803 records). [2025-10-22T17:25:24.039721] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-22T17:25:24.132092] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-22T17:25:24.446926] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-22T17:25:24.447086] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-22T17:25:24.447775] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-22T17:25:24.447851] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-22T17:25:24.449370] [DEBUG] [LOCAL ] BAK: Trimmed 56803 records to 39419 (keeping 200 days of data) [2025-10-22T17:25:24.670438] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-10-22T17:25:24.711447] [DEBUG] [LOCAL ] BAK: Primary data saved (39419 records). [2025-10-22T17:25:24.711585] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-22T17:25:24.711692] [INFO ] [MAIN ] Update Progress: 208/2367 symbols completed. BAK took 27.7s. Estimated remaining: 4h 22m 58s. Rate: 8.2 symbols/min [2025-10-22T17:25:24.880852] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:25:24.925253] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-22T17:25:24.928013] [DEBUG] [LOCAL ] BAM: Loaded 52090 existing records from primary storage. [2025-10-22T17:25:24.928401] [INFO ] [MAIN ] BAM: Loaded 52090 existing records. [2025-10-22T17:25:25.112087] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:25:25.112405] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-22T17:25:25.112620] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-22T17:25:25.122219] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-22T17:25:25.122398] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-22T17:25:25.195164] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-22T17:25:25.445472] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T17:25:25.530863] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:25:25.717720] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-22T17:25:26.171924] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T17:25:26.517725] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-22T17:25:27.317728] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-22T17:25:27.864575] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-22T17:25:27.899846] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.97 seconds). [2025-10-22T17:25:27.908886] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-22T17:25:27.909062] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-22T17:25:28.127138] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-22T17:25:28.332614] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-22T17:25:28.332777] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-22T17:25:28.333676] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-22T17:25:28.333861] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-22T17:25:28.362996] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-22T17:25:28.364097] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T17:25:28.704691] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-10-22T17:25:28.704846] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-22T17:25:28.704943] [INFO ] [MAIN ] Update Progress: 209/2367 symbols completed. BABA took 45.6s. Estimated remaining: 4h 22m 17s. Rate: 8.2 symbols/min [2025-10-22T17:25:28.869123] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:25:28.919355] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-22T17:25:28.922184] [DEBUG] [LOCAL ] BANC: Loaded 51384 existing records from primary storage. [2025-10-22T17:25:28.922632] [INFO ] [MAIN ] BANC: Loaded 51384 existing records. [2025-10-22T17:25:29.097445] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:25:29.097727] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-22T17:25:29.097783] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-22T17:25:29.098155] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-22T17:25:29.098209] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-22T17:25:29.469762] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:25:29.598682] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-22T17:25:29.717731] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-22T17:25:29.857860] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T17:25:30.386997] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-22T17:25:30.517738] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-22T17:25:31.317738] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-22T17:25:32.117738] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-22T17:25:32.166913] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T17:25:32.207006] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-22T17:25:32.917736] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-22T17:25:33.654416] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T17:25:33.717705] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-22T17:25:34.517630] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-22T17:25:34.687156] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T17:25:35.285430] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-22T17:25:35.313376] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T17:25:35.322535] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-22T17:25:35.982056] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-22T17:25:36.117717] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-22T17:25:36.917719] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-22T17:25:37.659712] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T17:25:37.717626] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-22T17:25:37.930613] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T17:25:38.517617] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-22T17:25:38.736387] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T17:25:38.739415] [INFO ] [REMOTE ] BALY: Full fetch complete (16206 records). [2025-10-22T17:25:38.739499] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-22T17:25:38.937835] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T17:25:38.938145] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:25:38.938212] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:25:38.938284] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-22T17:25:38.938349] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-22T17:25:38.938385] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-22T17:25:38.938424] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-22T17:25:38.938481] [INFO ] [MAIN ] Update Progress: 210/2367 symbols completed. BALY took 16.0s. Estimated remaining: 4h 22m 40s. Rate: 8.2 symbols/min [2025-10-22T17:25:39.122711] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:25:39.150989] [DEBUG] [LOCAL ] BAP: Loaded 25766 existing records from primary storage. [2025-10-22T17:25:39.151280] [INFO ] [MAIN ] BAP: Loaded 25766 existing records. [2025-10-22T17:25:39.336489] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-22T17:25:39.342428] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:25:39.343693] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-22T17:25:39.343758] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-22T17:25:39.343973] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-22T17:25:39.344030] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-22T17:25:39.698739] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:25:40.117750] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-22T17:25:40.431184] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T17:25:40.917727] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-22T17:25:41.152391] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T17:25:41.194820] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T17:25:41.717718] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-22T17:25:42.485299] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T17:25:42.517610] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-22T17:25:42.924756] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T17:25:43.317692] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-22T17:25:44.117704] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-22T17:25:44.249858] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T17:25:44.917688] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-22T17:25:44.973153] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T17:25:45.717684] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-22T17:25:45.937019] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T17:25:46.517690] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-22T17:25:46.801920] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T17:25:47.317785] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-22T17:25:47.471061] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T17:25:48.117635] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-22T17:25:48.239906] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T17:25:48.432604] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T17:25:48.917731] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-22T17:25:49.717734] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-22T17:25:49.811872] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T17:25:50.168111] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T17:25:50.517698] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-22T17:25:50.986002] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-22T17:25:51.317720] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-22T17:25:52.117761] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-22T17:25:52.258415] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T17:25:52.917710] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-22T17:25:52.975510] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T17:25:53.717729] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-22T17:25:53.784701] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T17:25:54.404169] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T17:25:54.517712] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-22T17:25:55.317719] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-22T17:25:55.585615] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-22T17:25:56.117724] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-22T17:25:56.569669] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-22T17:25:56.578958] [INFO ] [REMOTE ] BAM: Full fetch complete (75228 records). [2025-10-22T17:25:56.579087] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-22T17:25:56.871939] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T17:25:56.922866] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-22T17:25:57.002440] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-22T17:25:57.002546] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-22T17:25:57.003378] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-22T17:25:57.003450] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-22T17:25:57.004965] [DEBUG] [LOCAL ] BAM: Trimmed 75228 records to 52081 (keeping 200 days of data) [2025-10-22T17:25:57.314302] [DEBUG] [LOCAL ] BAM: Primary data saved (52081 records). [2025-10-22T17:25:57.314456] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-22T17:25:57.314534] [INFO ] [MAIN ] Update Progress: 211/2367 symbols completed. BAM took 32.6s. Estimated remaining: 4h 24m 25s. Rate: 8.2 symbols/min [2025-10-22T17:25:57.479464] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:25:57.517893] [DEBUG] [LOCAL ] BARK: Loaded 38230 existing records from primary storage. [2025-10-22T17:25:57.518217] [INFO ] [MAIN ] BARK: Loaded 38230 existing records. [2025-10-22T17:25:57.691278] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:25:57.691568] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-22T17:25:57.691625] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-22T17:25:57.691851] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-22T17:25:57.691906] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-22T17:25:57.722785] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-22T17:25:58.052100] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:25:58.188389] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T17:25:58.197417] [INFO ] [REMOTE ] BALL: Full fetch complete (75627 records). [2025-10-22T17:25:58.197589] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-22T17:25:58.530799] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-22T17:25:58.590498] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-22T17:25:58.590606] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-22T17:25:58.591591] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-22T17:25:58.591703] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-22T17:25:58.593126] [DEBUG] [LOCAL ] BALL: Trimmed 75627 records to 51932 (keeping 200 days of data) [2025-10-22T17:25:58.745168] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T17:25:58.949977] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-22T17:25:58.976470] [DEBUG] [LOCAL ] BALL: Primary data saved (51932 records). [2025-10-22T17:25:58.976599] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-22T17:25:58.977387] [INFO ] [MAIN ] Update Progress: 212/2367 symbols completed. BALL took 42.6s. Estimated remaining: 4h 23m 20s. Rate: 8.2 symbols/min [2025-10-22T17:25:59.151189] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:25:59.204855] [DEBUG] [LOCAL ] BAX: Loaded 53537 existing records from primary storage. [2025-10-22T17:25:59.205157] [INFO ] [MAIN ] BAX: Loaded 53537 existing records. [2025-10-22T17:25:59.322788] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-22T17:25:59.383773] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:25:59.384188] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-22T17:25:59.384272] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-22T17:25:59.384466] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-22T17:25:59.384506] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-22T17:25:59.745459] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:26:00.007910] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T17:26:00.117690] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-22T17:26:00.917712] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-22T17:26:01.200502] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T17:26:01.717737] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-22T17:26:01.874235] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T17:26:02.352153] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T17:26:02.517707] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-22T17:26:03.326605] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-22T17:26:03.332779] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T17:26:03.682396] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T17:26:04.117711] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-22T17:26:04.663153] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T17:26:04.917720] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-22T17:26:05.671056] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T17:26:05.717637] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-22T17:26:06.401434] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T17:26:06.517737] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-22T17:26:07.279524] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T17:26:07.288431] [INFO ] [REMOTE ] BANC: Full fetch complete (74632 records). [2025-10-22T17:26:07.288558] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-22T17:26:07.322735] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-22T17:26:07.698666] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-22T17:26:07.698778] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-22T17:26:07.699617] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-22T17:26:07.699707] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-22T17:26:07.701186] [DEBUG] [LOCAL ] BANC: Trimmed 74632 records to 51385 (keeping 200 days of data) [2025-10-22T17:26:07.907968] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T17:26:08.045172] [DEBUG] [LOCAL ] BANC: Primary data saved (51385 records). [2025-10-22T17:26:08.045293] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-22T17:26:08.045371] [INFO ] [MAIN ] Update Progress: 213/2367 symbols completed. BANC took 39.3s. Estimated remaining: 4h 23m 30s. Rate: 8.2 symbols/min [2025-10-22T17:26:08.122746] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-22T17:26:08.211760] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:26:08.259671] [DEBUG] [LOCAL ] BB: Loaded 52882 existing records from primary storage. [2025-10-22T17:26:08.260011] [INFO ] [MAIN ] BB: Loaded 52882 existing records. [2025-10-22T17:26:08.430474] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:26:08.430697] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-22T17:26:08.430753] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-22T17:26:08.430961] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-22T17:26:08.431017] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-22T17:26:08.774877] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:26:08.917620] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-22T17:26:09.269859] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T17:26:09.299213] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-22T17:26:09.717733] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-22T17:26:10.517740] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-22T17:26:10.566298] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T17:26:10.656758] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T17:26:10.661030] [INFO ] [REMOTE ] BAP: Full fetch complete (37348 records). [2025-10-22T17:26:10.661129] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-22T17:26:11.061599] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-22T17:26:11.061703] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-22T17:26:11.062225] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-22T17:26:11.062292] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-22T17:26:11.063157] [DEBUG] [LOCAL ] BAP: Trimmed 37348 records to 25563 (keeping 200 days of data) [2025-10-22T17:26:11.218476] [DEBUG] [LOCAL ] BAP: Primary data saved (25563 records). [2025-10-22T17:26:11.218601] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-22T17:26:11.218697] [INFO ] [MAIN ] Update Progress: 214/2367 symbols completed. BAP took 32.3s. Estimated remaining: 4h 22m 41s. Rate: 8.2 symbols/min [2025-10-22T17:26:11.322812] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-22T17:26:11.389858] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:26:11.439953] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-22T17:26:11.440269] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-22T17:26:11.617052] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:26:11.617274] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-22T17:26:11.617321] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-22T17:26:11.617508] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-22T17:26:11.617546] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-22T17:26:11.984190] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:26:12.117747] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-22T17:26:12.421176] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T17:26:12.917703] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-22T17:26:13.350690] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-22T17:26:13.717739] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-22T17:26:13.838419] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T17:26:14.517692] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-22T17:26:14.806202] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T17:26:15.317744] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-22T17:26:16.117740] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-22T17:26:16.370688] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T17:26:16.475729] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-10-22T17:26:16.917631] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-22T17:26:16.945173] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T17:26:17.698911] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T17:26:17.717615] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-22T17:26:18.517708] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-22T17:26:19.056506] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T17:26:19.166130] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-22T17:26:19.317718] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-22T17:26:20.117743] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-22T17:26:20.409368] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-22T17:26:20.917679] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-22T17:26:21.115472] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T17:26:21.189462] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T17:26:21.717729] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-22T17:26:22.517713] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-22T17:26:22.843733] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-22T17:26:23.269522] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-22T17:26:23.275901] [INFO ] [REMOTE ] BARK: Full fetch complete (56281 records). [2025-10-22T17:26:23.276022] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-22T17:26:23.322916] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-22T17:26:23.657080] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-22T17:26:23.657165] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-22T17:26:23.657799] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-22T17:26:23.657862] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-22T17:26:23.659023] [DEBUG] [LOCAL ] BARK: Trimmed 56281 records to 38227 (keeping 200 days of data) [2025-10-22T17:26:23.871017] [DEBUG] [LOCAL ] BARK: Primary data saved (38227 records). [2025-10-22T17:26:23.871187] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-22T17:26:23.871296] [INFO ] [MAIN ] Update Progress: 215/2367 symbols completed. BARK took 26.6s. Estimated remaining: 4h 23m 27s. Rate: 8.2 symbols/min [2025-10-22T17:26:24.035198] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:26:24.073764] [DEBUG] [LOCAL ] BBAR: Loaded 42660 existing records from primary storage. [2025-10-22T17:26:24.074046] [INFO ] [MAIN ] BBAR: Loaded 42660 existing records. [2025-10-22T17:26:24.137205] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-22T17:26:24.251060] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:26:24.251271] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-22T17:26:24.251317] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-22T17:26:24.251523] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-22T17:26:24.251577] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-22T17:26:24.610133] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:26:24.917696] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-22T17:26:25.139014] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-22T17:26:25.495712] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-22T17:26:25.717781] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-22T17:26:26.072626] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T17:26:26.517721] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-22T17:26:26.700293] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T17:26:27.317803] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-22T17:26:28.098798] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T17:26:28.117623] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-22T17:26:28.375942] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-22T17:26:28.762870] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T17:26:28.917636] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-22T17:26:29.717696] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-22T17:26:29.959404] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T17:26:30.215284] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T17:26:30.517686] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-22T17:26:31.317616] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-22T17:26:31.622192] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T17:26:31.631081] [INFO ] [REMOTE ] BAX: Full fetch complete (77620 records). [2025-10-22T17:26:31.631209] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-22T17:26:32.019804] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-22T17:26:32.019884] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-22T17:26:32.020631] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-22T17:26:32.020708] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-22T17:26:32.022154] [DEBUG] [LOCAL ] BAX: Trimmed 77620 records to 53537 (keeping 200 days of data) [2025-10-22T17:26:32.118695] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-22T17:26:32.344918] [DEBUG] [LOCAL ] BAX: Primary data saved (53537 records). [2025-10-22T17:26:32.345056] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-22T17:26:32.345818] [INFO ] [MAIN ] Update Progress: 216/2367 symbols completed. BAX took 33.4s. Estimated remaining: 4h 23m 31s. Rate: 8.2 symbols/min [2025-10-22T17:26:32.513915] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:26:32.564924] [DEBUG] [LOCAL ] BBD: Loaded 53271 existing records from primary storage. [2025-10-22T17:26:32.565235] [INFO ] [MAIN ] BBD: Loaded 53271 existing records. [2025-10-22T17:26:32.743507] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:26:32.743764] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-22T17:26:32.743844] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-22T17:26:32.744214] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-22T17:26:32.744271] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-22T17:26:33.141116] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:26:33.135586] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T17:26:33.141526] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-22T17:26:33.183350] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-22T17:26:33.717743] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-22T17:26:34.046204] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-22T17:26:34.517619] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-22T17:26:34.965211] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T17:26:35.008700] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T17:26:35.317710] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-22T17:26:36.117714] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-22T17:26:36.566791] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T17:26:36.815112] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-22T17:26:36.917689] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-22T17:26:37.717684] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-22T17:26:37.852248] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:26:38.436123] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T17:26:38.517620] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-22T17:26:39.317729] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-22T17:26:39.438793] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T17:26:40.117732] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-22T17:26:40.704073] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-22T17:26:40.713354] [INFO ] [REMOTE ] BB: Full fetch complete (76979 records). [2025-10-22T17:26:40.713526] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-22T17:26:40.927154] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-22T17:26:41.072793] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T17:26:41.154895] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-22T17:26:41.154977] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-22T17:26:41.155799] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-22T17:26:41.155862] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-22T17:26:41.157299] [DEBUG] [LOCAL ] BB: Trimmed 76979 records to 52882 (keeping 200 days of data) [2025-10-22T17:26:41.445222] [DEBUG] [LOCAL ] BB: Primary data saved (52882 records). [2025-10-22T17:26:41.445347] [INFO ] [MAIN ] BB: Full history saved. [2025-10-22T17:26:41.445424] [INFO ] [MAIN ] Update Progress: 217/2367 symbols completed. BB took 33.4s. Estimated remaining: 4h 23m 41s. Rate: 8.2 symbols/min [2025-10-22T17:26:41.611533] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:26:41.641380] [DEBUG] [LOCAL ] BBDC: Loaded 32985 existing records from primary storage. [2025-10-22T17:26:41.641667] [INFO ] [MAIN ] BBDC: Loaded 32985 existing records. [2025-10-22T17:26:41.719735] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-22T17:26:41.821426] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:26:41.821698] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-22T17:26:41.821756] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-22T17:26:41.821938] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-22T17:26:41.821975] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-22T17:26:42.224775] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:26:42.229329] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-22T17:26:42.517726] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-22T17:26:43.317704] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-22T17:26:43.424266] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T17:26:44.125679] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-22T17:26:44.176850] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T17:26:44.204117] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (3.28 seconds). [2025-10-22T17:26:44.640413] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T17:26:44.917695] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-22T17:26:45.717624] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-22T17:26:45.784908] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T17:26:45.792514] [INFO ] [REMOTE ] BBAR: Full fetch complete (61264 records). [2025-10-22T17:26:45.792723] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-22T17:26:46.173411] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-22T17:26:46.173514] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-22T17:26:46.174245] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-22T17:26:46.174316] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-22T17:26:46.175719] [DEBUG] [LOCAL ] BBAR: Trimmed 61264 records to 42605 (keeping 200 days of data) [2025-10-22T17:26:46.429590] [DEBUG] [LOCAL ] BBAR: Primary data saved (42605 records). [2025-10-22T17:26:46.429742] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-22T17:26:46.429825] [INFO ] [MAIN ] Update Progress: 218/2367 symbols completed. BBAR took 22.6s. Estimated remaining: 4h 23m 10s. Rate: 8.2 symbols/min [2025-10-22T17:26:46.526755] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-22T17:26:46.597844] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:26:46.604280] [DEBUG] [LOCAL ] BBDO: Loaded 4986 existing records from primary storage. [2025-10-22T17:26:46.604458] [INFO ] [MAIN ] BBDO: Loaded 4986 existing records. [2025-10-22T17:26:46.777541] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:26:46.777845] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-22T17:26:46.777896] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-22T17:26:46.778078] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-22T17:26:46.778134] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-22T17:26:47.157412] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:26:47.158469] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T17:26:47.317701] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-22T17:26:47.492771] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-10-22T17:26:48.117764] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-22T17:26:48.413028] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T17:26:48.758229] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T17:26:48.917713] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-22T17:26:49.717768] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-22T17:26:50.431493] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T17:26:50.517708] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-22T17:26:50.821286] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-10-22T17:26:51.126806] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-22T17:26:51.317761] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-22T17:26:51.412294] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T17:26:52.117782] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-22T17:26:52.297605] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T17:26:52.639184] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-22T17:26:52.917685] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-22T17:26:53.489124] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-22T17:26:53.717690] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-22T17:26:54.517753] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-22T17:26:55.317743] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-22T17:26:55.325433] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T17:26:56.117768] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-22T17:26:56.735499] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T17:26:56.871546] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (3.15 seconds). [2025-10-22T17:26:56.880248] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-22T17:26:56.880369] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-22T17:26:56.922792] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-22T17:26:57.189436] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T17:26:57.318351] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-22T17:26:57.318437] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-22T17:26:57.319271] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-22T17:26:57.319337] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-22T17:26:57.320900] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-22T17:26:57.629447] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-22T17:26:57.629595] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-22T17:26:57.630462] [INFO ] [MAIN ] Update Progress: 219/2367 symbols completed. BBAI took 46.4s. Estimated remaining: 4h 23m 41s. Rate: 8.1 symbols/min [2025-10-22T17:26:57.723630] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-22T17:26:57.809893] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:26:57.829029] [DEBUG] [LOCAL ] BBN: Loaded 17941 existing records from primary storage. [2025-10-22T17:26:57.829320] [INFO ] [MAIN ] BBN: Loaded 17941 existing records. [2025-10-22T17:26:58.017105] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:26:58.018071] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-22T17:26:58.018123] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-22T17:26:58.018326] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-22T17:26:58.018382] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-22T17:26:58.403880] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:26:58.501192] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T17:26:58.517615] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-22T17:26:59.318183] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-22T17:26:59.560033] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T17:26:59.788698] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-22T17:26:59.940332] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-22T17:27:00.117749] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-22T17:27:00.917758] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-22T17:27:01.661990] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T17:27:01.717634] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-22T17:27:02.517638] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-22T17:27:02.753888] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T17:27:02.785424] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T17:27:03.317727] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-22T17:27:03.594204] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T17:27:03.825621] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-22T17:27:04.117614] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-22T17:27:04.735704] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-22T17:27:04.917637] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-22T17:27:05.717692] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-22T17:27:06.338398] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-22T17:27:06.517726] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-22T17:27:06.886721] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-22T17:27:06.895248] [INFO ] [REMOTE ] BBD: Full fetch complete (76881 records). [2025-10-22T17:27:06.895414] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-22T17:27:06.896270] [FATAL] [VALIDATOR ] BBD: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:27:06.896365] [FATAL] [MAIN ] BBD: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:27:06.896407] [WARN ] [MAIN ] BBD: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:27:06.896470] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-22T17:27:06.896537] [DEBUG] [LOCAL ] BBD: No primary data file found to delete. [2025-10-22T17:27:06.896580] [INFO ] [LOCAL ] BBD: Starting deletion of derivative data. [2025-10-22T17:27:06.896905] [DEBUG] [LOCAL ] BBD: Deleted derivative data file. [2025-10-22T17:27:06.897618] [INFO ] [MAIN ] Update Progress: 220/2367 symbols completed. BBD took 34.6s. Estimated remaining: 4h 23m 52s. Rate: 8.1 symbols/min [2025-10-22T17:27:07.077931] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:07.078115] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-22T17:27:07.078153] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-22T17:27:07.078282] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-22T17:27:07.078334] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-22T17:27:07.078410] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-22T17:27:07.078445] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-22T17:27:07.322973] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-22T17:27:07.434125] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:08.034824] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T17:27:08.040775] [INFO ] [REMOTE ] BBDC: Full fetch complete (48899 records). [2025-10-22T17:27:08.040872] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-22T17:27:08.122934] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-22T17:27:08.335613] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T17:27:08.345459] [INFO ] [REMOTE ] BBDO: Full fetch complete (7423 records). [2025-10-22T17:27:08.350813] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-22T17:27:08.528603] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-22T17:27:08.534373] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-22T17:27:08.535043] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-22T17:27:08.545382] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-22T17:27:08.681250] [DEBUG] [LOCAL ] BBDC: Trimmed 48899 records to 32835 (keeping 200 days of data) [2025-10-22T17:27:08.881569] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-22T17:27:08.886335] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-22T17:27:08.892898] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-22T17:27:08.893519] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-22T17:27:08.901478] [DEBUG] [LOCAL ] BBDO: Trimmed 7423 records to 4953 (keeping 200 days of data) [2025-10-22T17:27:08.919676] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-10-22T17:27:08.970726] [DEBUG] [LOCAL ] BBDO: Primary data saved (4953 records). [2025-10-22T17:27:08.976841] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-22T17:27:08.977478] [INFO ] [MAIN ] Update Progress: 221/2367 symbols completed. BBDO took 22.5s. Estimated remaining: 4h 22m 53s. Rate: 8.2 symbols/min [2025-10-22T17:27:09.168670] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:27:09.173053] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-10-22T17:27:09.172947] [DEBUG] [LOCAL ] BBDC: Primary data saved (32835 records). [2025-10-22T17:27:09.192977] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:27:09.193929] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:09.193044] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-22T17:27:09.194250] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-22T17:27:09.194638] [INFO ] [MAIN ] Update Progress: 222/2367 symbols completed. BBDC took 27.7s. Estimated remaining: 4h 21m 37s. Rate: 8.2 symbols/min [2025-10-22T17:27:09.203825] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:27:09.204864] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T17:27:09.203963] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-22T17:27:09.213815] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-22T17:27:09.230464] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-22T17:27:09.263980] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-22T17:27:09.272460] [INFO ] [MAIN ] Update Progress: 223/2367 symbols completed. BBT took 2.4s. Estimated remaining: 4h 20m 20s. Rate: 8.2 symbols/min [2025-10-22T17:27:09.317143] [DEBUG] [LOCAL ] BBU: Loaded 5757 existing records from primary storage. [2025-10-22T17:27:09.339686] [INFO ] [MAIN ] BBU: Loaded 5757 existing records. [2025-10-22T17:27:09.591375] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:09.661824] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:09.722400] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-22T17:27:09.740380] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:27:09.747343] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-22T17:27:09.747432] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-22T17:27:09.747038] [DEBUG] [LOCAL ] BBUC: Loaded 13958 existing records from primary storage. [2025-10-22T17:27:09.747776] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-22T17:27:09.747847] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-22T17:27:09.747741] [INFO ] [MAIN ] BBUC: Loaded 13958 existing records. [2025-10-22T17:27:10.064913] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:27:10.137791] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-22T17:27:10.160247] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-22T17:27:10.191659] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-22T17:27:10.196854] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-22T17:27:10.309894] [DEBUG] [LOCAL ] BBVA: Loaded 49122 existing records from primary storage. [2025-10-22T17:27:10.412312] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:10.409369] [INFO ] [MAIN ] BBVA: Loaded 49122 existing records. [2025-10-22T17:27:10.532348] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-22T17:27:10.761062] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:27:10.768461] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-22T17:27:10.773782] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-22T17:27:10.804900] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T17:27:10.805282] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-22T17:27:10.829758] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-22T17:27:10.935208] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:11.246758] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:11.317715] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-22T17:27:11.385128] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-22T17:27:12.117622] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-22T17:27:12.676193] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-22T17:27:12.919587] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-22T17:27:12.924843] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T17:27:13.717728] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-22T17:27:14.057729] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T17:27:14.517753] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-22T17:27:14.684826] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T17:27:14.926853] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-22T17:27:15.317694] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-22T17:27:15.837073] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-22T17:27:16.117772] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-22T17:27:16.601820] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-22T17:27:16.917687] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-22T17:27:17.392206] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-22T17:27:17.717724] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-22T17:27:18.517682] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-22T17:27:18.530970] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-22T17:27:19.180237] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-22T17:27:19.317634] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-22T17:27:20.117634] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-22T17:27:20.240216] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-22T17:27:20.511550] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-22T17:27:20.917701] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-22T17:27:21.717633] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-22T17:27:21.942758] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T17:27:22.517635] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-22T17:27:22.636571] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T17:27:23.302576] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-22T17:27:23.317604] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-22T17:27:24.117622] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-22T17:27:24.481832] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T17:27:24.917725] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-22T17:27:24.965054] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-22T17:27:24.967527] [INFO ] [REMOTE ] BBU: Full fetch complete (7513 records). [2025-10-22T17:27:24.967597] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-22T17:27:25.329584] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-22T17:27:25.329683] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-22T17:27:25.329898] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-22T17:27:25.329938] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-22T17:27:25.330315] [DEBUG] [LOCAL ] BBU: Trimmed 7513 records to 5773 (keeping 200 days of data) [2025-10-22T17:27:25.363375] [DEBUG] [LOCAL ] BBU: Primary data saved (5773 records). [2025-10-22T17:27:25.363451] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-22T17:27:25.363522] [INFO ] [MAIN ] Update Progress: 224/2367 symbols completed. BBU took 16.4s. Estimated remaining: 4h 21m 37s. Rate: 8.2 symbols/min [2025-10-22T17:27:25.527134] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:25.555902] [DEBUG] [LOCAL ] BBW: Loaded 27246 existing records from primary storage. [2025-10-22T17:27:25.556211] [INFO ] [MAIN ] BBW: Loaded 27246 existing records. [2025-10-22T17:27:25.730228] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-22T17:27:25.736433] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:27:25.736719] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-22T17:27:25.737476] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-22T17:27:25.737752] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-22T17:27:25.737809] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-22T17:27:26.024804] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T17:27:26.044766] [INFO ] [REMOTE ] BBN: Full fetch complete (25124 records). [2025-10-22T17:27:26.044874] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-22T17:27:26.221479] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:26.475999] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-22T17:27:26.476075] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-22T17:27:26.476440] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-22T17:27:26.476479] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-22T17:27:26.477117] [DEBUG] [LOCAL ] BBN: Trimmed 25124 records to 17840 (keeping 200 days of data) [2025-10-22T17:27:26.523222] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-22T17:27:26.585674] [DEBUG] [LOCAL ] BBN: Primary data saved (17840 records). [2025-10-22T17:27:26.585797] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-22T17:27:26.585874] [INFO ] [MAIN ] Update Progress: 225/2367 symbols completed. BBN took 29.0s. Estimated remaining: 4h 20m 31s. Rate: 8.2 symbols/min [2025-10-22T17:27:26.753145] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:26.801964] [DEBUG] [LOCAL ] BBWI: Loaded 53591 existing records from primary storage. [2025-10-22T17:27:26.802272] [INFO ] [MAIN ] BBWI: Loaded 53591 existing records. [2025-10-22T17:27:26.971559] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:27:26.971805] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-22T17:27:26.971853] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-22T17:27:26.972044] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-22T17:27:26.972081] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-22T17:27:27.322865] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:27.319215] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-22T17:27:27.332835] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T17:27:27.518041] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T17:27:28.117761] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-22T17:27:28.716680] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T17:27:28.917692] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-22T17:27:29.717687] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-22T17:27:29.891815] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T17:27:30.476155] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T17:27:30.517617] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-22T17:27:30.898946] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T17:27:31.317761] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-22T17:27:32.117795] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-22T17:27:32.255392] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T17:27:32.922013] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-22T17:27:32.923686] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T17:27:33.122296] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T17:27:33.717732] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-22T17:27:34.517631] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-22T17:27:34.744043] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T17:27:35.317735] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-22T17:27:35.421181] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T17:27:35.843933] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T17:27:36.117873] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-22T17:27:36.285814] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-22T17:27:36.917639] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-22T17:27:37.671812] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T17:27:37.717725] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-22T17:27:37.981800] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T17:27:38.517725] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-22T17:27:39.317634] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-22T17:27:39.609227] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T17:27:39.958997] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T17:27:40.117704] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-22T17:27:40.917693] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-22T17:27:40.977353] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T17:27:41.070826] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T17:27:41.717714] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-22T17:27:42.517627] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-22T17:27:42.857762] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T17:27:42.886356] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T17:27:43.317639] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-22T17:27:43.435062] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-22T17:27:44.117620] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-22T17:27:44.917694] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-22T17:27:45.010131] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T17:27:45.109544] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T17:27:45.717593] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-22T17:27:46.272749] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T17:27:46.517733] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-22T17:27:46.646130] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T17:27:47.317623] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-22T17:27:47.621882] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T17:27:48.117722] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-22T17:27:48.917845] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-22T17:27:49.087971] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T17:27:49.717742] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-22T17:27:49.935952] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T17:27:50.127425] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-22T17:27:50.131070] [INFO ] [REMOTE ] BBUC: Full fetch complete (19315 records). [2025-10-22T17:27:50.131145] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-22T17:27:50.492914] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-22T17:27:50.493013] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-22T17:27:50.493350] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-22T17:27:50.493408] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-22T17:27:50.494011] [DEBUG] [LOCAL ] BBUC: Trimmed 19315 records to 13946 (keeping 200 days of data) [2025-10-22T17:27:50.528381] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-22T17:27:50.578625] [DEBUG] [LOCAL ] BBUC: Primary data saved (13946 records). [2025-10-22T17:27:50.578753] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-22T17:27:50.578840] [INFO ] [MAIN ] Update Progress: 226/2367 symbols completed. BBUC took 41.4s. Estimated remaining: 4h 23m 2s. Rate: 8.1 symbols/min [2025-10-22T17:27:50.743448] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:50.743613] [DEBUG] [LOCAL ] BBY: No existing data file found in primary storage. [2025-10-22T17:27:50.743676] [WARN ] [MAIN ] BBY: No existing data found, performing full refresh instead. [2025-10-22T17:27:50.743791] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-22T17:27:50.743831] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-22T17:27:50.743871] [DEBUG] [LOCAL ] BBY: No primary data file found to delete. [2025-10-22T17:27:50.743902] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-22T17:27:51.114673] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:51.130278] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T17:27:51.317637] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-22T17:27:52.117681] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-22T17:27:52.374662] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-22T17:27:52.678313] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T17:27:52.917725] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-22T17:27:53.717720] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-22T17:27:54.069471] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-22T17:27:54.276138] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T17:27:54.284159] [INFO ] [REMOTE ] BBW: Full fetch complete (39633 records). [2025-10-22T17:27:54.284347] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-22T17:27:54.525153] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-22T17:27:54.667704] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-22T17:27:54.667795] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-22T17:27:54.668295] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-22T17:27:54.668336] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-22T17:27:54.669149] [DEBUG] [LOCAL ] BBW: Trimmed 39633 records to 27233 (keeping 200 days of data) [2025-10-22T17:27:54.825928] [DEBUG] [LOCAL ] BBW: Primary data saved (27233 records). [2025-10-22T17:27:54.826050] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-22T17:27:54.826127] [INFO ] [MAIN ] Update Progress: 227/2367 symbols completed. BBW took 29.5s. Estimated remaining: 4h 22m 25s. Rate: 8.2 symbols/min [2025-10-22T17:27:54.991750] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:55.029470] [DEBUG] [LOCAL ] BC: Loaded 43912 existing records from primary storage. [2025-10-22T17:27:55.029810] [INFO ] [MAIN ] BC: Loaded 43912 existing records. [2025-10-22T17:27:55.201941] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:27:55.202114] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-22T17:27:55.202160] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-22T17:27:55.202332] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-22T17:27:55.202369] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-22T17:27:55.322669] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-22T17:27:55.564443] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:55.594527] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T17:27:56.117743] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-22T17:27:56.273823] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T17:27:56.917736] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-22T17:27:57.485571] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-22T17:27:57.494717] [INFO ] [REMOTE ] BBWI: Full fetch complete (77631 records). [2025-10-22T17:27:57.494895] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-22T17:27:57.727090] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-22T17:27:57.900781] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-22T17:27:57.901043] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-22T17:27:57.901909] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-22T17:27:57.901992] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-22T17:27:57.929765] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T17:27:57.940046] [DEBUG] [LOCAL ] BBWI: Trimmed 77631 records to 53591 (keeping 200 days of data) [2025-10-22T17:27:58.257010] [DEBUG] [LOCAL ] BBWI: Primary data saved (53591 records). [2025-10-22T17:27:58.257136] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-22T17:27:58.260859] [INFO ] [MAIN ] Update Progress: 228/2367 symbols completed. BBWI took 31.7s. Estimated remaining: 4h 21m 41s. Rate: 8.2 symbols/min [2025-10-22T17:27:58.435102] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:27:58.495807] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T17:27:58.506204] [DEBUG] [LOCAL ] BCAT: Loaded 34272 existing records from primary storage. [2025-10-22T17:27:58.506927] [INFO ] [MAIN ] BCAT: Loaded 34272 existing records. [2025-10-22T17:27:58.527804] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-22T17:27:58.689467] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:27:58.689705] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-22T17:27:58.689763] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-22T17:27:58.689953] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-22T17:27:58.689992] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-22T17:27:59.043695] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:27:59.317766] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-22T17:27:59.452360] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T17:27:59.460741] [INFO ] [REMOTE ] BBVA: Full fetch complete (71926 records). [2025-10-22T17:27:59.460872] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-22T17:27:59.849556] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-22T17:27:59.849680] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-22T17:27:59.850498] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-22T17:27:59.850543] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-22T17:27:59.852024] [DEBUG] [LOCAL ] BBVA: Trimmed 71926 records to 49107 (keeping 200 days of data) [2025-10-22T17:28:00.129144] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-22T17:28:00.169038] [DEBUG] [LOCAL ] BBVA: Primary data saved (49107 records). [2025-10-22T17:28:00.169434] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-22T17:28:00.171312] [INFO ] [MAIN ] Update Progress: 229/2367 symbols completed. BBVA took 50.9s. Estimated remaining: 4h 20m 43s. Rate: 8.2 symbols/min [2025-10-22T17:28:00.171196] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T17:28:00.345691] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:28:00.372974] [DEBUG] [LOCAL ] BCC: Loaded 28741 existing records from primary storage. [2025-10-22T17:28:00.373236] [INFO ] [MAIN ] BCC: Loaded 28741 existing records. [2025-10-22T17:28:00.548415] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:28:00.548606] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-22T17:28:00.548680] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-22T17:28:00.548887] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-22T17:28:00.548943] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-22T17:28:00.904078] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:28:00.921311] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-22T17:28:00.923606] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T17:28:01.717771] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-22T17:28:02.235862] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-22T17:28:02.261842] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T17:28:02.517734] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-22T17:28:03.120085] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T17:28:03.317696] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-22T17:28:03.825937] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:28:04.117742] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-22T17:28:04.778867] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T17:28:04.917702] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-22T17:28:05.560897] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T17:28:05.717737] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-22T17:28:06.337038] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T17:28:06.517618] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-22T17:28:07.040628] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T17:28:07.317702] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-22T17:28:07.996974] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T17:28:08.105901] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T17:28:08.117622] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-22T17:28:08.917753] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-22T17:28:09.573261] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T17:28:09.717715] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-22T17:28:10.517719] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-22T17:28:11.043586] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-22T17:28:11.295615] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T17:28:11.317637] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-22T17:28:11.600508] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T17:28:12.117718] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-22T17:28:12.917682] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-22T17:28:13.229147] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T17:28:13.411170] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-22T17:28:13.717708] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-22T17:28:14.517739] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-22T17:28:14.640244] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T17:28:15.317696] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-22T17:28:15.416135] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T17:28:16.117726] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-22T17:28:16.186440] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:28:16.381876] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T17:28:16.917725] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-22T17:28:17.448268] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T17:28:17.717718] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-22T17:28:18.517708] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-22T17:28:18.805756] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T17:28:19.122006] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-22T17:28:19.317703] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-22T17:28:20.006602] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T17:28:20.117638] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-22T17:28:20.490893] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-22T17:28:20.917685] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-22T17:28:21.717694] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-22T17:28:21.856721] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T17:28:22.407630] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T17:28:22.413311] [INFO ] [REMOTE ] BCC: Full fetch complete (41624 records). [2025-10-22T17:28:22.413429] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-22T17:28:22.522729] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-22T17:28:22.798028] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-22T17:28:22.798107] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-22T17:28:22.798595] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-22T17:28:22.798635] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-22T17:28:22.799474] [DEBUG] [LOCAL ] BCC: Trimmed 41624 records to 28624 (keeping 200 days of data) [2025-10-22T17:28:22.966555] [DEBUG] [LOCAL ] BCC: Primary data saved (28624 records). [2025-10-22T17:28:22.966704] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-22T17:28:22.967395] [INFO ] [MAIN ] Update Progress: 230/2367 symbols completed. BCC took 22.8s. Estimated remaining: 4h 22m 60s. Rate: 8.1 symbols/min [2025-10-22T17:28:23.132809] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:28:23.182591] [DEBUG] [LOCAL ] BCE: Loaded 52267 existing records from primary storage. [2025-10-22T17:28:23.182959] [INFO ] [MAIN ] BCE: Loaded 52267 existing records. [2025-10-22T17:28:23.326881] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-22T17:28:23.373535] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:28:23.374152] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-22T17:28:23.374204] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-22T17:28:23.374379] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-22T17:28:23.374432] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-22T17:28:23.823131] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-22T17:28:23.959924] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:28:24.117773] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-22T17:28:24.242506] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T17:28:24.250194] [INFO ] [REMOTE ] BCAT: Full fetch complete (50104 records). [2025-10-22T17:28:24.250402] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-22T17:28:24.707163] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-22T17:28:24.707251] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-22T17:28:24.707883] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-22T17:28:24.707946] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-22T17:28:24.709018] [DEBUG] [LOCAL ] BCAT: Trimmed 50104 records to 34203 (keeping 200 days of data) [2025-10-22T17:28:24.917496] [DEBUG] [LOCAL ] BCAT: Primary data saved (34203 records). [2025-10-22T17:28:24.917691] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-22T17:28:24.918676] [INFO ] [MAIN ] Update Progress: 231/2367 symbols completed. BCAT took 26.7s. Estimated remaining: 4h 22m 2s. Rate: 8.2 symbols/min [2025-10-22T17:28:24.918774] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-22T17:28:25.106029] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:28:25.134234] [DEBUG] [LOCAL ] BCH: Loaded 30256 existing records from primary storage. [2025-10-22T17:28:25.134491] [INFO ] [MAIN ] BCH: Loaded 30256 existing records. [2025-10-22T17:28:25.321235] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:28:25.321567] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-22T17:28:25.321729] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-22T17:28:25.322091] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-22T17:28:25.322170] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-22T17:28:25.529821] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-22T17:28:25.731462] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-22T17:28:25.737462] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:28:26.153634] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T17:28:26.517622] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-22T17:28:26.627632] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T17:28:27.060570] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T17:28:27.317782] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-22T17:28:27.752281] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T17:28:28.117748] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-22T17:28:28.892695] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T17:28:28.917625] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-22T17:28:29.717701] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-22T17:28:29.789345] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T17:28:30.517702] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-22T17:28:30.699623] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T17:28:30.706267] [INFO ] [REMOTE ] BC: Full fetch complete (63766 records). [2025-10-22T17:28:30.706369] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-22T17:28:31.127978] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-22T17:28:31.128516] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-22T17:28:31.128978] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-22T17:28:31.129715] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-22T17:28:31.134847] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-22T17:28:31.136185] [DEBUG] [LOCAL ] BC: Trimmed 63766 records to 43892 (keeping 200 days of data) [2025-10-22T17:28:31.337315] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-22T17:28:31.393122] [DEBUG] [LOCAL ] BC: Primary data saved (43892 records). [2025-10-22T17:28:31.393237] [INFO ] [MAIN ] BC: Full history saved. [2025-10-22T17:28:31.393312] [INFO ] [MAIN ] Update Progress: 232/2367 symbols completed. BC took 36.6s. Estimated remaining: 4h 21m 47s. Rate: 8.2 symbols/min [2025-10-22T17:28:31.556321] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:28:31.578954] [DEBUG] [LOCAL ] BCO: Loaded 25135 existing records from primary storage. [2025-10-22T17:28:31.579189] [INFO ] [MAIN ] BCO: Loaded 25135 existing records. [2025-10-22T17:28:31.774270] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:28:31.774479] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-22T17:28:31.774526] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-22T17:28:31.774731] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-22T17:28:31.774786] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-22T17:28:32.118692] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:28:32.118804] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-22T17:28:32.736073] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-22T17:28:32.744816] [INFO ] [REMOTE ] BBY: Full fetch complete (77403 records). [2025-10-22T17:28:32.744928] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-22T17:28:32.919304] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-22T17:28:33.138088] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-22T17:28:33.138215] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-22T17:28:33.139218] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-22T17:28:33.139403] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-22T17:28:33.141051] [DEBUG] [LOCAL ] BBY: Trimmed 77403 records to 53437 (keeping 200 days of data) [2025-10-22T17:28:33.250573] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T17:28:33.425126] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-22T17:28:33.557336] [DEBUG] [LOCAL ] BBY: Primary data saved (53437 records). [2025-10-22T17:28:33.557457] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-22T17:28:33.557523] [INFO ] [MAIN ] Update Progress: 233/2367 symbols completed. BBY took 43.0s. Estimated remaining: 4h 20m 52s. Rate: 8.2 symbols/min [2025-10-22T17:28:33.723931] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-22T17:28:33.723867] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:28:33.776831] [DEBUG] [LOCAL ] BCS: Loaded 53441 existing records from primary storage. [2025-10-22T17:28:33.777138] [INFO ] [MAIN ] BCS: Loaded 53441 existing records. [2025-10-22T17:28:33.949379] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:28:33.949571] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-22T17:28:33.949617] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-22T17:28:33.949888] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-22T17:28:33.949938] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-22T17:28:34.301556] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:28:34.315175] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T17:28:34.517714] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-22T17:28:35.317688] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-22T17:28:35.445053] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T17:28:35.932787] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T17:28:36.117694] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-22T17:28:36.917634] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-22T17:28:37.240537] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-22T17:28:37.303815] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T17:28:37.717712] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-22T17:28:38.245785] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T17:28:38.517699] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-22T17:28:39.317737] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-22T17:28:39.588452] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T17:28:39.651151] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T17:28:40.117692] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-22T17:28:40.314719] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T17:28:40.921658] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-22T17:28:41.507952] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T17:28:41.717705] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-22T17:28:42.288967] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T17:28:42.517712] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-22T17:28:43.009585] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T17:28:43.317687] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-22T17:28:43.619348] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T17:28:44.117710] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-22T17:28:44.589529] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T17:28:44.917745] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-22T17:28:45.717715] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-22T17:28:45.906234] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T17:28:46.517693] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-22T17:28:46.628911] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T17:28:46.777540] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T17:28:47.317703] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-22T17:28:47.682826] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T17:28:48.117733] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-22T17:28:48.917693] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-22T17:28:49.101970] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T17:28:49.640834] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T17:28:49.646495] [INFO ] [REMOTE ] BCH: Full fetch complete (41931 records). [2025-10-22T17:28:49.646587] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-22T17:28:49.722758] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-22T17:28:50.011093] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-22T17:28:50.011170] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-22T17:28:50.011696] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-22T17:28:50.011756] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-22T17:28:50.012617] [DEBUG] [LOCAL ] BCH: Trimmed 41931 records to 30088 (keeping 200 days of data) [2025-10-22T17:28:50.181122] [DEBUG] [LOCAL ] BCH: Primary data saved (30088 records). [2025-10-22T17:28:50.181252] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-22T17:28:50.181328] [INFO ] [MAIN ] Update Progress: 234/2367 symbols completed. BCH took 25.3s. Estimated remaining: 4h 22m 9s. Rate: 8.1 symbols/min [2025-10-22T17:28:50.354752] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:28:50.383817] [DEBUG] [LOCAL ] BCSF: Loaded 28246 existing records from primary storage. [2025-10-22T17:28:50.384076] [INFO ] [MAIN ] BCSF: Loaded 28246 existing records. [2025-10-22T17:28:50.521292] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-22T17:28:50.564044] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:28:50.564257] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-22T17:28:50.564305] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-22T17:28:50.564537] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-22T17:28:50.564594] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-22T17:28:50.927262] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:28:50.993740] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-22T17:28:51.032311] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T17:28:51.317716] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-22T17:28:52.117737] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-22T17:28:52.207125] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T17:28:52.401526] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T17:28:52.917752] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-22T17:28:53.717725] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-22T17:28:54.140816] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T17:28:54.489253] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T17:28:54.517615] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-22T17:28:54.909024] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-22T17:28:55.317772] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-22T17:28:56.117776] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-22T17:28:56.196186] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:28:56.204761] [INFO ] [REMOTE ] BCE: Full fetch complete (76119 records). [2025-10-22T17:28:56.204892] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-22T17:28:56.599323] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-22T17:28:56.599425] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-22T17:28:56.600231] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-22T17:28:56.600306] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-22T17:28:56.601942] [DEBUG] [LOCAL ] BCE: Trimmed 76119 records to 52266 (keeping 200 days of data) [2025-10-22T17:28:56.916238] [DEBUG] [LOCAL ] BCE: Primary data saved (52266 records). [2025-10-22T17:28:56.916366] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-22T17:28:56.917065] [INFO ] [MAIN ] Update Progress: 235/2367 symbols completed. BCE took 33.9s. Estimated remaining: 4h 21m 56s. Rate: 8.1 symbols/min [2025-10-22T17:28:56.928579] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-22T17:28:57.089033] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:28:57.112185] [DEBUG] [LOCAL ] BCX: Loaded 22127 existing records from primary storage. [2025-10-22T17:28:57.112432] [INFO ] [MAIN ] BCX: Loaded 22127 existing records. [2025-10-22T17:28:57.294413] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:28:57.294720] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-22T17:28:57.294799] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-22T17:28:57.295070] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-22T17:28:57.295139] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-22T17:28:57.484411] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-22T17:28:57.531666] [INFO ] [REMOTE ] BCO: Full fetch complete (36158 records). [2025-10-22T17:28:57.564513] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-22T17:28:57.587572] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-22T17:28:57.729798] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-22T17:28:57.840792] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:28:58.108081] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T17:28:58.107508] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-22T17:28:58.112503] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-22T17:28:58.113295] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-22T17:28:58.113349] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-22T17:28:58.114128] [DEBUG] [LOCAL ] BCO: Trimmed 36158 records to 24959 (keeping 200 days of data) [2025-10-22T17:28:58.259148] [DEBUG] [LOCAL ] BCO: Primary data saved (24959 records). [2025-10-22T17:28:58.259269] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-22T17:28:58.259345] [INFO ] [MAIN ] Update Progress: 236/2367 symbols completed. BCO took 26.9s. Estimated remaining: 4h 20m 54s. Rate: 8.2 symbols/min [2025-10-22T17:28:58.428907] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:28:58.453690] [DEBUG] [LOCAL ] BDC: Loaded 24193 existing records from primary storage. [2025-10-22T17:28:58.453990] [INFO ] [MAIN ] BDC: Loaded 24193 existing records. [2025-10-22T17:28:58.526720] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-22T17:28:58.630147] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:28:58.630362] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-22T17:28:58.630408] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-22T17:28:58.630735] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-22T17:28:58.630790] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-22T17:28:58.978077] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:28:59.317719] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-22T17:28:59.675426] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T17:28:59.892457] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T17:29:00.117712] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-22T17:29:00.545051] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T17:29:00.917733] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-22T17:29:01.453707] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T17:29:01.668081] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-22T17:29:01.717745] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-22T17:29:02.517746] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-22T17:29:02.996545] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T17:29:03.317703] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-22T17:29:04.117728] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-22T17:29:04.572885] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T17:29:04.656604] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-22T17:29:04.917726] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-22T17:29:05.176958] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T17:29:05.717686] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-22T17:29:06.015259] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-22T17:29:06.517722] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-22T17:29:06.943161] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T17:29:07.317702] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-22T17:29:08.117742] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-22T17:29:08.282207] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T17:29:08.404026] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T17:29:08.917627] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-22T17:29:09.228010] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T17:29:09.717695] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-22T17:29:10.111880] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T17:29:10.517693] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-22T17:29:10.871822] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T17:29:11.317701] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-22T17:29:11.931331] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T17:29:12.117630] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-22T17:29:12.507453] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T17:29:12.782562] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-22T17:29:12.917635] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-22T17:29:13.717814] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-22T17:29:14.052271] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-22T17:29:14.517715] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-22T17:29:14.674803] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T17:29:15.317692] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-22T17:29:16.117725] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-22T17:29:16.602542] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-22T17:29:16.628297] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-22T17:29:16.917711] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-22T17:29:17.262581] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T17:29:17.717685] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-22T17:29:17.958031] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T17:29:18.517695] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-22T17:29:18.972229] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T17:29:18.978146] [INFO ] [REMOTE ] BCSF: Full fetch complete (39762 records). [2025-10-22T17:29:18.978242] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-22T17:29:19.339872] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-22T17:29:19.356524] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-22T17:29:19.356608] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-22T17:29:19.357145] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-22T17:29:19.357205] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-22T17:29:19.358109] [DEBUG] [LOCAL ] BCSF: Trimmed 39762 records to 28115 (keeping 200 days of data) [2025-10-22T17:29:19.524770] [DEBUG] [LOCAL ] BCSF: Primary data saved (28115 records). [2025-10-22T17:29:19.524907] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-22T17:29:19.524986] [INFO ] [MAIN ] Update Progress: 237/2367 symbols completed. BCSF took 29.3s. Estimated remaining: 4h 22m 52s. Rate: 8.1 symbols/min [2025-10-22T17:29:19.547811] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T17:29:20.117736] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-22T17:29:20.917686] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-22T17:29:21.428293] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T17:29:21.444869] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-22T17:29:21.458337] [INFO ] [REMOTE ] BCS: Full fetch complete (77523 records). [2025-10-22T17:29:21.458464] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-22T17:29:21.724413] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-22T17:29:21.846009] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-22T17:29:21.846091] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-22T17:29:21.846887] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-22T17:29:21.846950] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-22T17:29:21.848356] [DEBUG] [LOCAL ] BCS: Trimmed 77523 records to 53441 (keeping 200 days of data) [2025-10-22T17:29:22.104097] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T17:29:22.164684] [INFO ] [REMOTE ] BCX: Full fetch complete (33688 records). [2025-10-22T17:29:22.182464] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-22T17:29:22.309829] [DEBUG] [LOCAL ] BCS: Primary data saved (53441 records). [2025-10-22T17:29:22.320581] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-22T17:29:22.331739] [INFO ] [MAIN ] Update Progress: 238/2367 symbols completed. BCS took 48.8s. Estimated remaining: 4h 22m 3s. Rate: 8.1 symbols/min [2025-10-22T17:29:22.622140] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-22T17:29:22.622226] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-22T17:29:22.622840] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-22T17:29:22.622904] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-22T17:29:22.623702] [DEBUG] [LOCAL ] BCX: Trimmed 33688 records to 22044 (keeping 200 days of data) [2025-10-22T17:29:22.765284] [DEBUG] [LOCAL ] BCX: Primary data saved (22044 records). [2025-10-22T17:29:22.765524] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-22T17:29:22.765795] [INFO ] [MAIN ] Update Progress: 239/2367 symbols completed. BCX took 25.8s. Estimated remaining: 4h 20m 54s. Rate: 8.2 symbols/min [2025-10-22T17:29:22.780773] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-22T17:29:22.786337] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-22T17:29:23.830283] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T17:29:23.835444] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-22T17:29:25.266966] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-22T17:29:25.270927] [INFO ] [REMOTE ] BDC: Full fetch complete (35786 records). [2025-10-22T17:29:25.271012] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-22T17:29:25.631817] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-22T17:29:25.631897] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-22T17:29:25.632357] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-22T17:29:25.632397] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-22T17:29:25.633237] [DEBUG] [LOCAL ] BDC: Trimmed 35786 records to 24000 (keeping 200 days of data) [2025-10-22T17:29:25.777060] [DEBUG] [LOCAL ] BDC: Primary data saved (24000 records). [2025-10-22T17:29:25.777192] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-22T17:29:25.777274] [INFO ] [MAIN ] Update Progress: 240/2367 symbols completed. BDC took 27.5s. Estimated remaining: 4h 20m 8s. Rate: 8.2 symbols/min [2025-10-22T17:29:26.429780] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:29:26.469477] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:29:26.463106] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:29:26.472771] [DEBUG] [LOCAL ] BE: No existing data file found in primary storage. [2025-10-22T17:29:26.494436] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:29:26.494529] [WARN ] [MAIN ] BE: No existing data found, performing full refresh instead. [2025-10-22T17:29:26.495082] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-22T17:29:26.495131] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-22T17:29:26.495265] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-10-22T17:29:26.495311] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-22T17:29:26.676440] [DEBUG] [LOCAL ] BDJ: Loaded 29386 existing records from primary storage. [2025-10-22T17:29:26.748892] [INFO ] [MAIN ] BDJ: Loaded 29386 existing records. [2025-10-22T17:29:26.918412] [DEBUG] [LOCAL ] BDN: Loaded 47633 existing records from primary storage. [2025-10-22T17:29:26.939353] [INFO ] [MAIN ] BDN: Loaded 47633 existing records. [2025-10-22T17:29:27.036939] [DEBUG] [LOCAL ] BDX: Loaded 52157 existing records from primary storage. [2025-10-22T17:29:27.088524] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:29:27.114701] [INFO ] [MAIN ] BDX: Loaded 52157 existing records. [2025-10-22T17:29:27.128225] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-22T17:29:27.268006] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:29:27.308778] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-22T17:29:27.314128] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-22T17:29:27.420799] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:29:27.421218] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-22T17:29:27.432195] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-22T17:29:27.437581] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-22T17:29:27.437727] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-22T17:29:27.448492] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-22T17:29:27.462180] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-22T17:29:27.517172] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:29:27.589958] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-22T17:29:27.607351] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-22T17:29:27.681252] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-22T17:29:27.704496] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-22T17:29:28.485277] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:29:28.582420] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-22T17:29:28.628063] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:29:28.641544] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-22T17:29:28.739164] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:29:28.739596] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-22T17:29:29.405780] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-22T17:29:29.416787] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-22T17:29:30.105602] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T17:29:30.112054] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-22T17:29:30.429876] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T17:29:30.439358] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-22T17:29:30.569709] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T17:29:30.579943] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-22T17:29:30.987403] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:29:30.998217] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-22T17:29:31.323342] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T17:29:31.332280] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-22T17:29:31.917754] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T17:29:32.028180] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T17:29:32.117734] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-22T17:29:32.365639] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-22T17:29:32.618253] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T17:29:32.917723] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-22T17:29:33.717716] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-22T17:29:33.824573] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T17:29:34.367582] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:29:34.517732] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-22T17:29:35.317721] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-22T17:29:35.761257] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-22T17:29:36.130209] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-22T17:29:36.132828] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T17:29:36.917620] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-22T17:29:37.120877] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T17:29:37.309288] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T17:29:37.717718] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-22T17:29:38.517779] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-22T17:29:39.015488] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-22T17:29:39.317680] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-22T17:29:39.623126] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T17:29:40.115888] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T17:29:40.121083] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-22T17:29:40.917731] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-22T17:29:41.196782] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T17:29:41.717755] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-22T17:29:41.965434] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T17:29:42.517695] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-22T17:29:42.794291] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T17:29:43.317618] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-22T17:29:43.581729] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T17:29:44.008779] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-22T17:29:44.117704] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-22T17:29:44.917632] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-22T17:29:45.231622] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-22T17:29:45.717815] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-22T17:29:45.854122] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T17:29:45.913496] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T17:29:46.517706] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-22T17:29:47.322851] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-22T17:29:47.338725] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T17:29:48.117717] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-22T17:29:48.557161] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T17:29:48.733088] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-22T17:29:48.917698] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-22T17:29:49.717732] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-22T17:29:49.850124] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:29:50.328176] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T17:29:50.333282] [INFO ] [REMOTE ] BDJ: Full fetch complete (42899 records). [2025-10-22T17:29:50.333364] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-22T17:29:50.528526] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-22T17:29:50.701262] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-22T17:29:50.701333] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-22T17:29:50.701862] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-22T17:29:50.701924] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-22T17:29:50.702755] [DEBUG] [LOCAL ] BDJ: Trimmed 42899 records to 29333 (keeping 200 days of data) [2025-10-22T17:29:50.866505] [DEBUG] [LOCAL ] BDJ: Primary data saved (29333 records). [2025-10-22T17:29:50.866626] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-22T17:29:50.866736] [INFO ] [MAIN ] Update Progress: 241/2367 symbols completed. BDJ took 25.1s. Estimated remaining: 4h 22m 37s. Rate: 8.1 symbols/min [2025-10-22T17:29:51.035590] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:29:51.035766] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-22T17:29:51.035812] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-22T17:29:51.035924] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-22T17:29:51.035966] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-22T17:29:51.036008] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-22T17:29:51.036041] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-22T17:29:51.322821] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-22T17:29:51.383933] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:29:52.117753] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-22T17:29:52.203963] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T17:29:52.339620] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-22T17:29:52.689471] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-22T17:29:52.917724] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-22T17:29:53.417752] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-22T17:29:53.425766] [INFO ] [REMOTE ] BDX: Full fetch complete (75481 records). [2025-10-22T17:29:53.425895] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-22T17:29:53.718310] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-22T17:29:53.814263] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-22T17:29:53.814346] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-22T17:29:53.815123] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-22T17:29:53.815187] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-22T17:29:53.816570] [DEBUG] [LOCAL ] BDX: Trimmed 75481 records to 52141 (keeping 200 days of data) [2025-10-22T17:29:54.133777] [DEBUG] [LOCAL ] BDX: Primary data saved (52141 records). [2025-10-22T17:29:54.133911] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-22T17:29:54.134912] [INFO ] [MAIN ] Update Progress: 242/2367 symbols completed. BDX took 28.3s. Estimated remaining: 4h 21m 54s. Rate: 8.1 symbols/min [2025-10-22T17:29:54.300404] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:29:54.352257] [DEBUG] [LOCAL ] BEKE: Loaded 53198 existing records from primary storage. [2025-10-22T17:29:54.352549] [INFO ] [MAIN ] BEKE: Loaded 53198 existing records. [2025-10-22T17:29:54.524546] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:29:54.521066] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-22T17:29:54.525477] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-22T17:29:54.525534] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-22T17:29:54.525769] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-22T17:29:54.525824] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-22T17:29:54.867722] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:29:54.923621] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-22T17:29:55.317636] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-22T17:29:55.414525] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T17:29:55.654467] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.74 seconds). [2025-10-22T17:29:55.663255] [INFO ] [REMOTE ] BE: Full fetch complete (77816 records). [2025-10-22T17:29:55.663391] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-22T17:29:56.044523] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-22T17:29:56.044596] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-22T17:29:56.045425] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-22T17:29:56.045487] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-22T17:29:56.046890] [DEBUG] [LOCAL ] BE: Trimmed 77816 records to 53661 (keeping 200 days of data) [2025-10-22T17:29:56.131167] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-22T17:29:56.357561] [DEBUG] [LOCAL ] BE: Primary data saved (53661 records). [2025-10-22T17:29:56.357748] [INFO ] [MAIN ] BE: Full history saved. [2025-10-22T17:29:56.357833] [INFO ] [MAIN ] Update Progress: 243/2367 symbols completed. BE took 30.6s. Estimated remaining: 4h 21m 1s. Rate: 8.1 symbols/min [2025-10-22T17:29:56.522810] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:29:56.568837] [DEBUG] [LOCAL ] BEN: Loaded 53118 existing records from primary storage. [2025-10-22T17:29:56.569135] [INFO ] [MAIN ] BEN: Loaded 53118 existing records. [2025-10-22T17:29:56.747032] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:29:56.747340] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-22T17:29:56.747399] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-22T17:29:56.747686] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-22T17:29:56.747742] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-22T17:29:56.926725] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-22T17:29:57.114425] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:29:57.143328] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T17:29:57.330546] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-22T17:29:57.420747] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-22T17:29:57.717695] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-22T17:29:58.517686] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-22T17:29:59.317628] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-22T17:29:59.653739] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-22T17:30:00.117696] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-22T17:30:00.318910] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T17:30:00.640591] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-22T17:30:00.917621] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-22T17:30:01.398462] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T17:30:01.717759] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-22T17:30:02.517741] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-22T17:30:03.317738] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-22T17:30:03.539277] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-22T17:30:03.542706] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (2.63 seconds). [2025-10-22T17:30:03.550339] [INFO ] [REMOTE ] BDN: Full fetch complete (69070 records). [2025-10-22T17:30:03.550440] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-22T17:30:03.551107] [FATAL] [VALIDATOR ] BDN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:30:03.551191] [FATAL] [MAIN ] BDN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:30:03.551234] [WARN ] [MAIN ] BDN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:30:03.551302] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-22T17:30:03.551368] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-10-22T17:30:03.551403] [INFO ] [LOCAL ] BDN: Starting deletion of derivative data. [2025-10-22T17:30:03.551553] [DEBUG] [LOCAL ] BDN: Deleted derivative data file. [2025-10-22T17:30:03.551674] [INFO ] [MAIN ] Update Progress: 244/2367 symbols completed. BDN took 37.8s. Estimated remaining: 4h 20m 52s. Rate: 8.1 symbols/min [2025-10-22T17:30:03.716592] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:30:03.754171] [DEBUG] [LOCAL ] BEP: Loaded 38965 existing records from primary storage. [2025-10-22T17:30:03.754508] [INFO ] [MAIN ] BEP: Loaded 38965 existing records. [2025-10-22T17:30:03.944273] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:30:03.944618] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-22T17:30:03.944802] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-22T17:30:03.945101] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-22T17:30:03.945162] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-22T17:30:04.117720] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-22T17:30:04.283583] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-22T17:30:04.367876] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:30:04.705973] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T17:30:04.917694] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-22T17:30:05.729921] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-22T17:30:05.739307] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-22T17:30:06.517743] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-22T17:30:06.844914] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-22T17:30:07.317732] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-22T17:30:07.620886] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-22T17:30:08.117612] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-22T17:30:08.386469] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (3.47 seconds). [2025-10-22T17:30:08.459193] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-10-22T17:30:08.487630] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-22T17:30:08.917683] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-22T17:30:09.554216] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T17:30:09.555079] [INFO ] [REMOTE ] BEDU: Full fetch complete (1330 records). [2025-10-22T17:30:09.555146] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-22T17:30:09.717952] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-22T17:30:09.730948] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-22T17:30:09.731869] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:30:09.731946] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:30:09.732020] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-22T17:30:09.732078] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-22T17:30:09.732113] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-22T17:30:09.732152] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-22T17:30:09.732205] [INFO ] [MAIN ] Update Progress: 245/2367 symbols completed. BEDU took 18.9s. Estimated remaining: 4h 20m 34s. Rate: 8.1 symbols/min [2025-10-22T17:30:09.902225] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:30:09.941872] [DEBUG] [LOCAL ] BEPC: Loaded 46391 existing records from primary storage. [2025-10-22T17:30:09.942257] [INFO ] [MAIN ] BEPC: Loaded 46391 existing records. [2025-10-22T17:30:10.141169] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:30:10.141388] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-22T17:30:10.141434] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-22T17:30:10.141795] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-22T17:30:10.142068] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-22T17:30:10.492967] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:30:10.517626] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-22T17:30:11.317787] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-22T17:30:11.887226] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T17:30:11.948754] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-22T17:30:12.117716] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-22T17:30:12.884161] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T17:30:12.917729] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-22T17:30:13.717742] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-22T17:30:13.891815] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T17:30:14.517726] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-22T17:30:14.721347] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T17:30:15.317628] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-22T17:30:15.371891] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T17:30:15.869889] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T17:30:16.117793] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-22T17:30:16.917634] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-22T17:30:17.087052] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T17:30:17.625041] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T17:30:17.717700] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-22T17:30:18.501525] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T17:30:18.517612] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-22T17:30:19.261039] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T17:30:19.317607] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-22T17:30:20.117754] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-22T17:30:20.190950] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:30:20.847776] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T17:30:20.917711] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-22T17:30:21.573630] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T17:30:21.717736] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-22T17:30:22.517735] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-22T17:30:22.848793] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-22T17:30:23.317700] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-22T17:30:23.778607] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-22T17:30:23.826887] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T17:30:24.117861] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-22T17:30:24.917741] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-22T17:30:25.047251] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T17:30:25.717627] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-22T17:30:25.859327] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T17:30:26.442050] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T17:30:26.517747] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-22T17:30:27.317728] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-22T17:30:27.537194] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T17:30:28.007243] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T17:30:28.117620] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-22T17:30:28.917627] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-22T17:30:29.231823] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T17:30:29.717692] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-22T17:30:29.956384] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T17:30:29.964029] [INFO ] [REMOTE ] BEP: Full fetch complete (59342 records). [2025-10-22T17:30:29.964162] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-22T17:30:30.347786] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-22T17:30:30.347879] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-22T17:30:30.348548] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-22T17:30:30.348591] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-22T17:30:30.349775] [DEBUG] [LOCAL ] BEP: Trimmed 59342 records to 38937 (keeping 200 days of data) [2025-10-22T17:30:30.519101] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-22T17:30:30.593225] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:30:30.611677] [INFO ] [REMOTE ] BEN: Full fetch complete (77068 records). [2025-10-22T17:30:30.612335] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-22T17:30:30.720771] [DEBUG] [LOCAL ] BEP: Primary data saved (38937 records). [2025-10-22T17:30:30.720936] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-22T17:30:30.721631] [INFO ] [MAIN ] Update Progress: 246/2367 symbols completed. BEP took 27.2s. Estimated remaining: 4h 22m 25s. Rate: 8.1 symbols/min [2025-10-22T17:30:31.100816] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:30:31.201314] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-22T17:30:31.182581] [DEBUG] [LOCAL ] BEPH: Loaded 4924 existing records from primary storage. [2025-10-22T17:30:31.201551] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-22T17:30:31.201770] [INFO ] [MAIN ] BEPH: Loaded 4924 existing records. [2025-10-22T17:30:31.202576] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-22T17:30:31.235268] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-22T17:30:31.335207] [DEBUG] [LOCAL ] BEN: Trimmed 77068 records to 53114 (keeping 200 days of data) [2025-10-22T17:30:31.390799] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:30:31.391534] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-22T17:30:31.391618] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-22T17:30:31.391920] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-22T17:30:31.391977] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-22T17:30:31.902991] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-22T17:30:32.023232] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-22T17:30:32.101554] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:30:32.127201] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-22T17:30:32.180566] [DEBUG] [LOCAL ] BEN: Primary data saved (53114 records). [2025-10-22T17:30:32.181380] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-22T17:30:32.182453] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T17:30:32.182576] [INFO ] [MAIN ] Update Progress: 247/2367 symbols completed. BEN took 35.8s. Estimated remaining: 4h 21m 26s. Rate: 8.1 symbols/min [2025-10-22T17:30:32.371041] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:30:32.377007] [DEBUG] [LOCAL ] BEPI: Loaded 3587 existing records from primary storage. [2025-10-22T17:30:32.377161] [INFO ] [MAIN ] BEPI: Loaded 3587 existing records. [2025-10-22T17:30:32.554323] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:30:32.554569] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-22T17:30:32.554670] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-22T17:30:32.554853] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-22T17:30:32.554907] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-22T17:30:32.922167] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-22T17:30:32.923057] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T17:30:32.922031] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:30:33.717738] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-22T17:30:34.283592] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-22T17:30:34.300826] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-22T17:30:34.304849] [INFO ] [REMOTE ] BEKE: Full fetch complete (77338 records). [2025-10-22T17:30:34.305102] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-22T17:30:34.532331] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-22T17:30:34.741499] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-22T17:30:34.741927] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-22T17:30:34.743341] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-22T17:30:34.745672] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-22T17:30:34.745551] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-22T17:30:34.756749] [DEBUG] [LOCAL ] BEKE: Trimmed 77338 records to 53197 (keeping 200 days of data) [2025-10-22T17:30:35.066317] [DEBUG] [LOCAL ] BEKE: Primary data saved (53197 records). [2025-10-22T17:30:35.066470] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-22T17:30:35.067194] [INFO ] [MAIN ] Update Progress: 248/2367 symbols completed. BEKE took 40.9s. Estimated remaining: 4h 20m 40s. Rate: 8.1 symbols/min [2025-10-22T17:30:35.241030] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:30:35.246178] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-22T17:30:35.252417] [DEBUG] [LOCAL ] BEPJ: Loaded 3070 existing records from primary storage. [2025-10-22T17:30:35.252669] [INFO ] [MAIN ] BEPJ: Loaded 3070 existing records. [2025-10-22T17:30:35.322877] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-22T17:30:35.462539] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:30:35.462773] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-22T17:30:35.462825] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-22T17:30:35.462988] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-22T17:30:35.463044] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-22T17:30:35.897756] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:30:35.988239] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-22T17:30:36.117750] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-22T17:30:36.766712] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-22T17:30:36.917748] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-22T17:30:37.570301] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T17:30:37.717631] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-22T17:30:38.335018] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-22T17:30:38.517700] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-22T17:30:39.317716] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-22T17:30:39.777717] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T17:30:40.102953] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T17:30:40.117617] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-22T17:30:40.917731] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-22T17:30:41.529270] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-22T17:30:41.637211] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T17:30:41.717703] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-22T17:30:42.264638] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T17:30:42.517715] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-22T17:30:43.171966] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-22T17:30:43.317730] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-22T17:30:43.749146] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-22T17:30:44.117719] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-22T17:30:44.714535] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T17:30:44.917757] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-22T17:30:45.717702] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-22T17:30:46.298295] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-22T17:30:46.509082] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T17:30:46.518810] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-22T17:30:47.144380] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-22T17:30:47.317753] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-22T17:30:48.117726] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-22T17:30:48.874474] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-22T17:30:48.917719] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-22T17:30:49.393781] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-22T17:30:49.403434] [INFO ] [REMOTE ] BEPC: Full fetch complete (68886 records). [2025-10-22T17:30:49.403616] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-22T17:30:49.674019] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-22T17:30:49.707960] [INFO ] [REMOTE ] BEPH: Full fetch complete (7503 records). [2025-10-22T17:30:49.708159] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-22T17:30:49.719792] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-22T17:30:49.714448] [FATAL] [VALIDATOR ] BEPH: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:30:49.735959] [FATAL] [MAIN ] BEPH: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:30:49.737314] [WARN ] [MAIN ] BEPH: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:30:49.766888] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-22T17:30:49.767088] [DEBUG] [LOCAL ] BEPH: No primary data file found to delete. [2025-10-22T17:30:49.767997] [INFO ] [LOCAL ] BEPH: Starting deletion of derivative data. [2025-10-22T17:30:49.772364] [DEBUG] [LOCAL ] BEPH: Deleted derivative data file. [2025-10-22T17:30:49.789687] [INFO ] [MAIN ] Update Progress: 249/2367 symbols completed. BEPH took 19.1s. Estimated remaining: 4h 21m 35s. Rate: 8.1 symbols/min [2025-10-22T17:30:49.857084] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-22T17:30:49.884087] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-22T17:30:49.916484] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-22T17:30:49.919553] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-22T17:30:49.991233] [DEBUG] [LOCAL ] BEPC: Trimmed 68886 records to 46357 (keeping 200 days of data) [2025-10-22T17:30:49.992879] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:30:50.226268] [DEBUG] [LOCAL ] BFAM: Loaded 33837 existing records from primary storage. [2025-10-22T17:30:50.230175] [INFO ] [MAIN ] BFAM: Loaded 33837 existing records. [2025-10-22T17:30:50.429284] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T17:30:50.423058] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:30:50.433236] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-22T17:30:50.434262] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-22T17:30:50.435830] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-22T17:30:50.436752] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-22T17:30:50.519479] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-22T17:30:50.869028] [DEBUG] [LOCAL ] BEPC: Primary data saved (46357 records). [2025-10-22T17:30:50.867840] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:30:50.869196] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-22T17:30:50.870311] [INFO ] [MAIN ] Update Progress: 250/2367 symbols completed. BEPC took 41.1s. Estimated remaining: 4h 20m 34s. Rate: 8.1 symbols/min [2025-10-22T17:30:50.980779] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-22T17:30:51.054265] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:30:51.093961] [DEBUG] [LOCAL ] BFH: Loaded 41425 existing records from primary storage. [2025-10-22T17:30:51.094294] [INFO ] [MAIN ] BFH: Loaded 41425 existing records. [2025-10-22T17:30:51.269689] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:30:51.269956] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-22T17:30:51.270016] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-22T17:30:51.270389] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-22T17:30:51.270444] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-22T17:30:51.322930] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-22T17:30:51.621938] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:30:51.821937] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-22T17:30:52.117732] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-22T17:30:52.917722] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-22T17:30:53.350807] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T17:30:53.505482] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-22T17:30:53.506740] [INFO ] [REMOTE ] BEPI: Full fetch complete (4687 records). [2025-10-22T17:30:53.506827] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-22T17:30:53.723680] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-22T17:30:53.898508] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-22T17:30:53.898592] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-22T17:30:53.898759] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-22T17:30:53.898822] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-22T17:30:53.899264] [DEBUG] [LOCAL ] BEPI: Trimmed 4687 records to 3563 (keeping 200 days of data) [2025-10-22T17:30:53.922429] [DEBUG] [LOCAL ] BEPI: Primary data saved (3563 records). [2025-10-22T17:30:53.922589] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-22T17:30:53.922701] [INFO ] [MAIN ] Update Progress: 251/2367 symbols completed. BEPI took 21.7s. Estimated remaining: 4h 19m 50s. Rate: 8.1 symbols/min [2025-10-22T17:30:54.101151] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:30:54.116855] [DEBUG] [LOCAL ] BFK: Loaded 13822 existing records from primary storage. [2025-10-22T17:30:54.117099] [INFO ] [MAIN ] BFK: Loaded 13822 existing records. [2025-10-22T17:30:54.305994] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:30:54.306305] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-22T17:30:54.306364] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-22T17:30:54.306861] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-22T17:30:54.306918] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-22T17:30:54.527607] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-22T17:30:54.664521] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:30:55.145724] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T17:30:55.317749] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-22T17:30:55.997370] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T17:30:56.117705] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-22T17:30:56.484725] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T17:30:56.917695] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-22T17:30:57.717700] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-22T17:30:57.727588] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T17:30:57.769718] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T17:30:58.517740] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-22T17:30:59.094942] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T17:30:59.204730] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-22T17:30:59.317702] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-22T17:30:59.790025] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-22T17:31:00.117703] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-22T17:31:00.917725] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-22T17:31:01.534203] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:31:01.717733] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-22T17:31:02.517788] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-22T17:31:03.317712] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-22T17:31:03.401433] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-22T17:31:04.117773] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-22T17:31:04.485790] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-22T17:31:04.917617] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-22T17:31:05.011255] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T17:31:05.166595] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T17:31:05.423192] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (4.51 seconds). [2025-10-22T17:31:05.717737] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-22T17:31:06.491572] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T17:31:06.517622] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-22T17:31:07.238691] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T17:31:07.317679] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-22T17:31:07.408743] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-22T17:31:08.081592] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T17:31:08.117624] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-22T17:31:08.917718] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-22T17:31:09.530730] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T17:31:09.717707] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-22T17:31:10.304611] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T17:31:10.517698] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-22T17:31:10.666594] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-22T17:31:11.317714] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-22T17:31:11.430368] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-22T17:31:12.117701] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-22T17:31:12.443183] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T17:31:12.917674] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-22T17:31:12.929366] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T17:31:13.392489] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-22T17:31:13.717693] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-22T17:31:14.517709] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-22T17:31:15.313634] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-22T17:31:15.322294] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-22T17:31:15.333105] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-22T17:31:15.941101] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T17:31:16.117766] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-22T17:31:16.917703] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-22T17:31:17.717684] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-22T17:31:17.804315] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T17:31:17.922089] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T17:31:18.517733] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-22T17:31:19.118602] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T17:31:19.317704] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-22T17:31:19.396774] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:31:19.403152] [INFO ] [REMOTE ] BFAM: Full fetch complete (47393 records). [2025-10-22T17:31:19.403323] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-22T17:31:19.809419] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-22T17:31:19.809533] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-22T17:31:19.810220] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-22T17:31:19.810284] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-22T17:31:19.811455] [DEBUG] [LOCAL ] BFAM: Trimmed 47393 records to 33784 (keeping 200 days of data) [2025-10-22T17:31:20.017732] [DEBUG] [LOCAL ] BFAM: Primary data saved (33784 records). [2025-10-22T17:31:20.017864] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-22T17:31:20.017945] [INFO ] [MAIN ] Update Progress: 252/2367 symbols completed. BFAM took 30.2s. Estimated remaining: 4h 22m 20s. Rate: 8.1 symbols/min [2025-10-22T17:31:20.119700] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-22T17:31:20.216850] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:31:20.261849] [DEBUG] [LOCAL ] BFLY: Loaded 51859 existing records from primary storage. [2025-10-22T17:31:20.262143] [INFO ] [MAIN ] BFLY: Loaded 51859 existing records. [2025-10-22T17:31:20.439029] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:31:20.439902] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-22T17:31:20.439966] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-22T17:31:20.440219] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-22T17:31:20.440262] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-22T17:31:20.596365] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-22T17:31:20.817688] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:31:20.853721] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T17:31:20.917626] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-22T17:31:21.717779] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-22T17:31:22.517690] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-22T17:31:22.576207] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T17:31:22.582568] [INFO ] [REMOTE ] BFH: Full fetch complete (59837 records). [2025-10-22T17:31:22.582692] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-22T17:31:22.583310] [FATAL] [VALIDATOR ] BFH: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:31:22.583396] [FATAL] [MAIN ] BFH: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:31:22.583439] [WARN ] [MAIN ] BFH: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:31:22.583479] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-22T17:31:22.583535] [DEBUG] [LOCAL ] BFH: No primary data file found to delete. [2025-10-22T17:31:22.583570] [INFO ] [LOCAL ] BFH: Starting deletion of derivative data. [2025-10-22T17:31:22.583723] [DEBUG] [LOCAL ] BFH: Deleted derivative data file. [2025-10-22T17:31:22.583807] [INFO ] [MAIN ] Update Progress: 253/2367 symbols completed. BFH took 31.7s. Estimated remaining: 4h 21m 32s. Rate: 8.1 symbols/min [2025-10-22T17:31:22.767282] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:31:22.778596] [DEBUG] [LOCAL ] BFS: Loaded 9585 existing records from primary storage. [2025-10-22T17:31:22.778845] [INFO ] [MAIN ] BFS: Loaded 9585 existing records. [2025-10-22T17:31:22.952534] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:31:22.952762] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-22T17:31:22.952813] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-22T17:31:22.952971] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-22T17:31:22.953016] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-22T17:31:23.317914] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-22T17:31:23.323451] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:31:23.450484] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T17:31:23.592915] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T17:31:23.741639] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-22T17:31:23.742487] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4346 records). [2025-10-22T17:31:23.742558] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-22T17:31:24.116563] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-22T17:31:24.116671] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-22T17:31:24.116843] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-22T17:31:24.116885] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-22T17:31:24.117285] [DEBUG] [LOCAL ] BEPJ: Trimmed 4346 records to 3041 (keeping 200 days of data) [2025-10-22T17:31:24.117624] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-22T17:31:24.138609] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3041 records). [2025-10-22T17:31:24.138800] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-22T17:31:24.138889] [INFO ] [MAIN ] Update Progress: 254/2367 symbols completed. BEPJ took 49.1s. Estimated remaining: 4h 20m 35s. Rate: 8.1 symbols/min [2025-10-22T17:31:24.323371] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:31:24.323562] [DEBUG] [LOCAL ] BFZ: No existing data file found in primary storage. [2025-10-22T17:31:24.323614] [WARN ] [MAIN ] BFZ: No existing data found, performing full refresh instead. [2025-10-22T17:31:24.323746] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-22T17:31:24.323786] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-22T17:31:24.323826] [DEBUG] [LOCAL ] BFZ: No primary data file found to delete. [2025-10-22T17:31:24.323857] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-22T17:31:24.688528] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:31:24.848257] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T17:31:24.917621] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-22T17:31:25.685027] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-22T17:31:25.717682] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-22T17:31:26.517709] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-22T17:31:26.733542] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T17:31:26.736403] [INFO ] [REMOTE ] BFK: Full fetch complete (19225 records). [2025-10-22T17:31:26.736475] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-22T17:31:27.090276] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-22T17:31:27.090351] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-22T17:31:27.090712] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-22T17:31:27.090774] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-22T17:31:27.091297] [DEBUG] [LOCAL ] BFK: Trimmed 19225 records to 13872 (keeping 200 days of data) [2025-10-22T17:31:27.172665] [DEBUG] [LOCAL ] BFK: Primary data saved (13872 records). [2025-10-22T17:31:27.172810] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-22T17:31:27.172890] [INFO ] [MAIN ] Update Progress: 255/2367 symbols completed. BFK took 33.3s. Estimated remaining: 4h 19m 52s. Rate: 8.1 symbols/min [2025-10-22T17:31:27.326422] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-22T17:31:27.346062] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:31:27.390910] [DEBUG] [LOCAL ] BG: Loaded 50586 existing records from primary storage. [2025-10-22T17:31:27.391271] [INFO ] [MAIN ] BG: Loaded 50586 existing records. [2025-10-22T17:31:27.565610] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:31:27.565821] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-22T17:31:27.565865] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-22T17:31:27.566144] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-22T17:31:27.566201] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-22T17:31:27.920831] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:31:28.117699] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-22T17:31:28.167429] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-22T17:31:28.236326] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T17:31:28.761585] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-22T17:31:28.917716] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-22T17:31:29.717631] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-22T17:31:29.729146] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T17:31:30.517756] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-22T17:31:31.165110] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T17:31:31.317729] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-22T17:31:31.488990] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T17:31:32.074298] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T17:31:32.117614] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-22T17:31:32.739369] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-22T17:31:32.917704] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-22T17:31:33.720561] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-22T17:31:33.723711] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T17:31:34.517735] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-22T17:31:35.288960] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-22T17:31:35.317705] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-22T17:31:35.587101] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T17:31:36.117698] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-22T17:31:36.715914] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T17:31:36.917718] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-22T17:31:36.991346] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T17:31:37.717759] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-22T17:31:37.821524] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-22T17:31:38.517711] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-22T17:31:39.317685] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-22T17:31:39.386328] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T17:31:39.632477] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T17:31:40.117724] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-22T17:31:40.907361] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T17:31:40.917685] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-22T17:31:41.001605] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T17:31:41.723326] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-22T17:31:41.726533] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-22T17:31:42.517716] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-22T17:31:43.130742] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T17:31:43.317720] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-22T17:31:43.378786] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T17:31:44.117697] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-22T17:31:44.917752] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-22T17:31:45.133760] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T17:31:45.714915] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T17:31:45.718043] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-22T17:31:45.804533] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T17:31:46.517737] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-22T17:31:46.727448] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T17:31:47.317736] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-22T17:31:48.117630] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-22T17:31:48.177338] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-22T17:31:48.179715] [INFO ] [REMOTE ] BFZ: Full fetch complete (17638 records). [2025-10-22T17:31:48.179785] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-22T17:31:48.570537] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-22T17:31:48.570858] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-22T17:31:48.571678] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-22T17:31:48.573454] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-22T17:31:48.573678] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-22T17:31:48.584912] [DEBUG] [LOCAL ] BFZ: Trimmed 17638 records to 12049 (keeping 200 days of data) [2025-10-22T17:31:48.655740] [DEBUG] [LOCAL ] BFZ: Primary data saved (12049 records). [2025-10-22T17:31:48.655867] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-22T17:31:48.655934] [INFO ] [MAIN ] Update Progress: 256/2367 symbols completed. BFZ took 24.5s. Estimated remaining: 4h 21m 41s. Rate: 8.1 symbols/min [2025-10-22T17:31:48.823414] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:31:48.841832] [DEBUG] [LOCAL ] BGB: Loaded 17799 existing records from primary storage. [2025-10-22T17:31:48.842062] [INFO ] [MAIN ] BGB: Loaded 17799 existing records. [2025-10-22T17:31:48.922883] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-22T17:31:49.019116] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:31:49.019339] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-22T17:31:49.019385] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-22T17:31:49.019543] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-22T17:31:49.019580] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-22T17:31:49.298468] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T17:31:49.306863] [INFO ] [REMOTE ] BFS: Full fetch complete (13093 records). [2025-10-22T17:31:49.312088] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-22T17:31:49.462631] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:31:49.725583] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-22T17:31:49.768334] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-22T17:31:49.768507] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-22T17:31:49.768879] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-22T17:31:49.768939] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-22T17:31:49.769422] [DEBUG] [LOCAL ] BFS: Trimmed 13093 records to 9560 (keeping 200 days of data) [2025-10-22T17:31:49.827729] [DEBUG] [LOCAL ] BFS: Primary data saved (9560 records). [2025-10-22T17:31:49.827884] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-22T17:31:49.827965] [INFO ] [MAIN ] Update Progress: 257/2367 symbols completed. BFS took 27.2s. Estimated remaining: 4h 20m 42s. Rate: 8.1 symbols/min [2025-10-22T17:31:49.996125] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:31:50.014461] [DEBUG] [LOCAL ] BGH: Loaded 17232 existing records from primary storage. [2025-10-22T17:31:50.014749] [INFO ] [MAIN ] BGH: Loaded 17232 existing records. [2025-10-22T17:31:50.185707] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:31:50.185900] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-22T17:31:50.185945] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-22T17:31:50.186100] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-22T17:31:50.186137] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-22T17:31:50.540765] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:31:50.535359] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-22T17:31:50.851843] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-22T17:31:51.317723] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-22T17:31:51.559198] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-22T17:31:51.605072] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T17:31:52.117724] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-22T17:31:52.917786] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-22T17:31:53.123676] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T17:31:53.249950] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T17:31:53.717732] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-22T17:31:53.798934] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T17:31:54.517709] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-22T17:31:55.317788] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-22T17:31:55.502749] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T17:31:56.117742] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-22T17:31:56.250334] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-22T17:31:56.461501] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-22T17:31:56.917701] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-22T17:31:57.720103] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-22T17:31:57.723318] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T17:31:58.139500] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T17:31:58.263333] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-22T17:31:58.517709] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-22T17:31:59.317694] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-22T17:32:00.117718] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-22T17:32:00.269948] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T17:32:00.380486] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T17:32:00.917719] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-22T17:32:01.717711] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-22T17:32:02.517627] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-22T17:32:02.842073] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T17:32:03.041453] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (2.92 seconds). [2025-10-22T17:32:03.050856] [INFO ] [REMOTE ] BFLY: Full fetch complete (75515 records). [2025-10-22T17:32:03.051054] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-22T17:32:03.337987] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-22T17:32:03.457398] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-22T17:32:03.492744] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-22T17:32:03.514683] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-22T17:32:03.516519] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-22T17:32:03.516680] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-22T17:32:03.519215] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-22T17:32:03.528214] [INFO ] [REMOTE ] BG: Full fetch complete (73094 records). [2025-10-22T17:32:03.528352] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-22T17:32:03.528419] [DEBUG] [LOCAL ] BFLY: Trimmed 75515 records to 51865 (keeping 200 days of data) [2025-10-22T17:32:04.099710] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-22T17:32:04.126176] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-22T17:32:04.128082] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-22T17:32:04.130314] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-22T17:32:04.130783] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-22T17:32:04.149242] [DEBUG] [LOCAL ] BG: Trimmed 73094 records to 50547 (keeping 200 days of data) [2025-10-22T17:32:04.325026] [DEBUG] [LOCAL ] BFLY: Primary data saved (51865 records). [2025-10-22T17:32:04.327059] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-22T17:32:04.328466] [INFO ] [MAIN ] Update Progress: 258/2367 symbols completed. BFLY took 44.3s. Estimated remaining: 4h 21m 32s. Rate: 8.1 symbols/min [2025-10-22T17:32:04.387295] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-22T17:32:04.533807] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:04.622920] [DEBUG] [LOCAL ] BGR: Loaded 13494 existing records from primary storage. [2025-10-22T17:32:04.648306] [INFO ] [MAIN ] BGR: Loaded 13494 existing records. [2025-10-22T17:32:04.840170] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:32:04.844298] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-22T17:32:04.845285] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-22T17:32:04.846922] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-22T17:32:04.847266] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-22T17:32:04.918628] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-22T17:32:05.283354] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:05.303428] [DEBUG] [LOCAL ] BG: Primary data saved (50547 records). [2025-10-22T17:32:05.303670] [INFO ] [MAIN ] BG: Full history saved. [2025-10-22T17:32:05.303790] [INFO ] [MAIN ] Update Progress: 259/2367 symbols completed. BG took 38.1s. Estimated remaining: 4h 20m 32s. Rate: 8.1 symbols/min [2025-10-22T17:32:05.393054] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T17:32:05.494320] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:05.545431] [DEBUG] [LOCAL ] BGS: Loaded 50552 existing records from primary storage. [2025-10-22T17:32:05.545767] [INFO ] [MAIN ] BGS: Loaded 50552 existing records. [2025-10-22T17:32:05.721577] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-22T17:32:05.721489] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:32:05.722718] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-22T17:32:05.722772] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-22T17:32:05.723160] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-22T17:32:05.723198] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-22T17:32:06.022718] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T17:32:06.092893] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:06.517620] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-22T17:32:06.607799] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-22T17:32:07.317724] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-22T17:32:07.569248] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T17:32:08.117775] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-22T17:32:08.360478] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T17:32:08.917748] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-22T17:32:09.606720] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T17:32:09.717733] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-22T17:32:09.779638] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T17:32:10.517716] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-22T17:32:10.769892] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T17:32:11.317725] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-22T17:32:11.571452] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T17:32:12.117719] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-22T17:32:12.855288] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T17:32:12.917719] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-22T17:32:13.016537] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T17:32:13.566585] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-22T17:32:13.717707] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-22T17:32:14.517683] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-22T17:32:14.825169] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T17:32:14.828701] [INFO ] [REMOTE ] BGB: Full fetch complete (26646 records). [2025-10-22T17:32:14.828784] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-22T17:32:15.203711] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-22T17:32:15.203828] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-22T17:32:15.204299] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-22T17:32:15.204361] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-22T17:32:15.205125] [DEBUG] [LOCAL ] BGB: Trimmed 26646 records to 17618 (keeping 200 days of data) [2025-10-22T17:32:15.308165] [DEBUG] [LOCAL ] BGB: Primary data saved (17618 records). [2025-10-22T17:32:15.308311] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-22T17:32:15.308412] [INFO ] [MAIN ] Update Progress: 260/2367 symbols completed. BGB took 26.7s. Estimated remaining: 4h 20m 46s. Rate: 8.1 symbols/min [2025-10-22T17:32:15.322776] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-22T17:32:15.483100] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:15.483289] [DEBUG] [LOCAL ] BGSF: No existing data file found in primary storage. [2025-10-22T17:32:15.483327] [WARN ] [MAIN ] BGSF: No existing data found, performing full refresh instead. [2025-10-22T17:32:15.483434] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-22T17:32:15.483473] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-22T17:32:15.483512] [DEBUG] [LOCAL ] BGSF: No primary data file found to delete. [2025-10-22T17:32:15.483543] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-22T17:32:15.863704] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:15.865138] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T17:32:15.869420] [INFO ] [REMOTE ] BGH: Full fetch complete (22998 records). [2025-10-22T17:32:15.869505] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-22T17:32:16.125699] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-22T17:32:16.315844] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-22T17:32:16.320521] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-22T17:32:16.324355] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-22T17:32:16.324698] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-22T17:32:16.325332] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-22T17:32:16.329535] [DEBUG] [LOCAL ] BGH: Trimmed 22998 records to 17133 (keeping 200 days of data) [2025-10-22T17:32:16.430321] [DEBUG] [LOCAL ] BGH: Primary data saved (17133 records). [2025-10-22T17:32:16.430447] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-22T17:32:16.430522] [INFO ] [MAIN ] Update Progress: 261/2367 symbols completed. BGH took 26.6s. Estimated remaining: 4h 19m 48s. Rate: 8.1 symbols/min [2025-10-22T17:32:16.616179] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:16.633480] [DEBUG] [LOCAL ] BGT: Loaded 16274 existing records from primary storage. [2025-10-22T17:32:16.633757] [INFO ] [MAIN ] BGT: Loaded 16274 existing records. [2025-10-22T17:32:16.807524] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:32:16.807755] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-22T17:32:16.807806] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-22T17:32:16.807987] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-22T17:32:16.808043] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-22T17:32:16.920364] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-22T17:32:16.929998] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T17:32:17.165954] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:17.717698] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-22T17:32:18.100350] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T17:32:18.360876] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T17:32:18.517710] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-22T17:32:19.317698] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-22T17:32:19.544918] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T17:32:20.117680] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-22T17:32:20.856306] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T17:32:20.917708] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-22T17:32:21.098874] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-22T17:32:21.717706] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-22T17:32:22.520554] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-22T17:32:22.523727] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T17:32:22.671682] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T17:32:23.317705] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-22T17:32:23.773354] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T17:32:23.916404] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T17:32:24.117920] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-22T17:32:24.632152] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-22T17:32:24.917713] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-22T17:32:25.717701] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-22T17:32:25.832749] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-22T17:32:26.517624] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-22T17:32:26.738361] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T17:32:27.317686] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-22T17:32:27.352592] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T17:32:28.117711] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-22T17:32:28.888845] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T17:32:28.917694] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-22T17:32:29.257338] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-22T17:32:29.617289] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-22T17:32:29.717690] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-22T17:32:30.402229] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-22T17:32:30.404747] [INFO ] [REMOTE ] BGR: Full fetch complete (19944 records). [2025-10-22T17:32:30.404854] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-22T17:32:30.522868] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-22T17:32:30.780047] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-22T17:32:30.780128] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-22T17:32:30.780478] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-22T17:32:30.780516] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-22T17:32:30.781157] [DEBUG] [LOCAL ] BGR: Trimmed 19944 records to 13405 (keeping 200 days of data) [2025-10-22T17:32:30.861294] [DEBUG] [LOCAL ] BGR: Primary data saved (13405 records). [2025-10-22T17:32:30.861420] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-22T17:32:30.861495] [INFO ] [MAIN ] Update Progress: 262/2367 symbols completed. BGR took 26.5s. Estimated remaining: 4h 20m 37s. Rate: 8.1 symbols/min [2025-10-22T17:32:31.030400] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:31.042551] [DEBUG] [LOCAL ] BGX: Loaded 11249 existing records from primary storage. [2025-10-22T17:32:31.042762] [INFO ] [MAIN ] BGX: Loaded 11249 existing records. [2025-10-22T17:32:31.229959] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:32:31.230180] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-22T17:32:31.230227] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-22T17:32:31.230376] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-22T17:32:31.230415] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-22T17:32:31.327825] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-22T17:32:31.586753] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:31.878513] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-22T17:32:32.117697] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-22T17:32:32.455938] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-22T17:32:32.797120] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-22T17:32:32.917709] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-22T17:32:33.716067] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T17:32:33.719009] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-22T17:32:34.517700] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-22T17:32:34.553224] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T17:32:35.248809] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-22T17:32:35.317732] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-22T17:32:36.117721] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-22T17:32:36.917686] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-22T17:32:37.065579] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T17:32:37.066410] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T17:32:37.471704] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-22T17:32:37.717695] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-22T17:32:38.517715] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-22T17:32:39.239582] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T17:32:39.250952] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-22T17:32:39.317696] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-22T17:32:40.092838] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-22T17:32:40.117615] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-22T17:32:40.761961] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T17:32:40.917696] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-22T17:32:41.723579] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-22T17:32:41.725446] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T17:32:42.386207] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-22T17:32:42.517690] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-22T17:32:42.952972] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-22T17:32:43.317753] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-22T17:32:44.076444] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-22T17:32:44.117612] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-22T17:32:44.917724] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-22T17:32:45.028041] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-22T17:32:45.717721] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-22T17:32:45.981575] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T17:32:46.517738] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-22T17:32:46.721840] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T17:32:47.317719] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-22T17:32:47.642378] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T17:32:47.645218] [INFO ] [REMOTE ] BGSF: Full fetch complete (9654 records). [2025-10-22T17:32:47.645297] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-22T17:32:48.013586] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-22T17:32:48.013680] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-22T17:32:48.013898] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-22T17:32:48.013937] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-22T17:32:48.014364] [DEBUG] [LOCAL ] BGSF: Trimmed 9654 records to 8227 (keeping 200 days of data) [2025-10-22T17:32:48.060852] [DEBUG] [LOCAL ] BGSF: Primary data saved (8227 records). [2025-10-22T17:32:48.060950] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-22T17:32:48.061017] [INFO ] [MAIN ] Update Progress: 263/2367 symbols completed. BGSF took 32.8s. Estimated remaining: 4h 21m 47s. Rate: 8.0 symbols/min [2025-10-22T17:32:48.125512] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-22T17:32:48.238940] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:48.258471] [DEBUG] [LOCAL ] BGY: Loaded 21500 existing records from primary storage. [2025-10-22T17:32:48.258716] [INFO ] [MAIN ] BGY: Loaded 21500 existing records. [2025-10-22T17:32:48.393382] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T17:32:48.422720] [INFO ] [REMOTE ] BGX: Full fetch complete (16462 records). [2025-10-22T17:32:48.432202] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-22T17:32:48.451794] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:32:48.525594] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-22T17:32:48.530886] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-22T17:32:48.550887] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-22T17:32:48.550990] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-22T17:32:48.927386] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-22T17:32:49.176738] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-22T17:32:49.176545] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:49.181058] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-22T17:32:49.182119] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-22T17:32:49.181801] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-22T17:32:49.185741] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-22T17:32:49.186463] [DEBUG] [LOCAL ] BGX: Trimmed 16462 records to 11188 (keeping 200 days of data) [2025-10-22T17:32:49.250394] [DEBUG] [LOCAL ] BGX: Primary data saved (11188 records). [2025-10-22T17:32:49.250509] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-22T17:32:49.250583] [INFO ] [MAIN ] Update Progress: 264/2367 symbols completed. BGX took 18.4s. Estimated remaining: 4h 20m 50s. Rate: 8.1 symbols/min [2025-10-22T17:32:49.414207] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:49.414402] [DEBUG] [LOCAL ] BH: No existing data file found in primary storage. [2025-10-22T17:32:49.414439] [WARN ] [MAIN ] BH: No existing data found, performing full refresh instead. [2025-10-22T17:32:49.414551] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-22T17:32:49.414591] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-22T17:32:49.414631] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-10-22T17:32:49.414701] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-22T17:32:49.722823] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-22T17:32:49.756955] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:50.523498] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T17:32:50.521063] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-22T17:32:50.801193] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-22T17:32:51.317707] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-22T17:32:51.369258] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-22T17:32:52.117713] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-22T17:32:52.528863] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T17:32:52.752044] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-22T17:32:52.917744] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-22T17:32:53.717688] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-22T17:32:53.756269] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-22T17:32:54.517750] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-22T17:32:55.317725] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-22T17:32:55.523095] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T17:32:55.531391] [INFO ] [REMOTE ] BGS: Full fetch complete (72664 records). [2025-10-22T17:32:55.531525] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-22T17:32:55.674224] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T17:32:55.937714] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-22T17:32:55.937808] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-22T17:32:55.938624] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-22T17:32:55.938711] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-22T17:32:55.940092] [DEBUG] [LOCAL ] BGS: Trimmed 72664 records to 50530 (keeping 200 days of data) [2025-10-22T17:32:56.137683] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-22T17:32:56.235821] [DEBUG] [LOCAL ] BGS: Primary data saved (50530 records). [2025-10-22T17:32:56.235965] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-22T17:32:56.236058] [INFO ] [MAIN ] Update Progress: 265/2367 symbols completed. BGS took 50.9s. Estimated remaining: 4h 20m 39s. Rate: 8.1 symbols/min [2025-10-22T17:32:56.421493] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T17:32:56.423740] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:56.428514] [INFO ] [REMOTE ] BGT: Full fetch complete (24243 records). [2025-10-22T17:32:56.428665] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-22T17:32:56.754462] [DEBUG] [LOCAL ] BHC: Loaded 46640 existing records from primary storage. [2025-10-22T17:32:56.808073] [INFO ] [MAIN ] BHC: Loaded 46640 existing records. [2025-10-22T17:32:56.855509] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-22T17:32:56.840138] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-22T17:32:56.872062] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-22T17:32:56.884685] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-22T17:32:56.918056] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-22T17:32:56.923385] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-22T17:32:56.967843] [DEBUG] [LOCAL ] BGT: Trimmed 24243 records to 16184 (keeping 200 days of data) [2025-10-22T17:32:57.138129] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:32:57.146993] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-22T17:32:57.152103] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-22T17:32:57.156791] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-22T17:32:57.159235] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-22T17:32:57.159305] [DEBUG] [LOCAL ] BGT: Primary data saved (16184 records). [2025-10-22T17:32:57.164550] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-22T17:32:57.190986] [INFO ] [MAIN ] Update Progress: 266/2367 symbols completed. BGT took 40.8s. Estimated remaining: 4h 19m 40s. Rate: 8.1 symbols/min [2025-10-22T17:32:57.512391] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:32:57.701404] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:57.710820] [DEBUG] [LOCAL ] BHE: Loaded 23786 existing records from primary storage. [2025-10-22T17:32:57.711027] [INFO ] [MAIN ] BHE: Loaded 23786 existing records. [2025-10-22T17:32:57.722904] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-22T17:32:57.821467] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-22T17:32:57.903961] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:32:57.904222] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-22T17:32:57.904277] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-22T17:32:57.904487] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-22T17:32:57.904543] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-22T17:32:58.252431] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:32:58.517716] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-22T17:32:59.020853] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T17:32:59.317721] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-22T17:33:00.117704] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-22T17:33:00.356064] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T17:33:00.395045] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T17:33:00.917683] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-22T17:33:01.639813] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T17:33:01.717704] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-22T17:33:01.851179] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T17:33:02.517740] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-22T17:33:03.059703] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-22T17:33:03.317769] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-22T17:33:03.669518] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T17:33:04.117744] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-22T17:33:04.463041] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T17:33:04.917687] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-22T17:33:05.576560] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T17:33:05.717687] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-22T17:33:05.800749] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-22T17:33:06.517693] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-22T17:33:07.146932] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T17:33:07.317688] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-22T17:33:07.800192] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T17:33:08.034768] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T17:33:08.117691] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-22T17:33:08.917685] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-22T17:33:09.717722] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-22T17:33:09.732593] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-22T17:33:10.036886] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T17:33:10.517721] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-22T17:33:10.778084] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T17:33:10.780985] [INFO ] [REMOTE ] BH: Full fetch complete (19431 records). [2025-10-22T17:33:10.781065] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-22T17:33:10.781687] [FATAL] [VALIDATOR ] BH: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:33:10.781795] [FATAL] [MAIN ] BH: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:33:10.781839] [WARN ] [MAIN ] BH: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:33:10.781880] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-22T17:33:10.781956] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-10-22T17:33:10.782013] [INFO ] [LOCAL ] BH: Starting deletion of derivative data. [2025-10-22T17:33:10.782065] [DEBUG] [LOCAL ] BH: No derivative data file found to delete. [2025-10-22T17:33:10.782130] [INFO ] [MAIN ] Update Progress: 267/2367 symbols completed. BH took 21.5s. Estimated remaining: 4h 20m 21s. Rate: 8.1 symbols/min [2025-10-22T17:33:10.962820] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:33:10.984108] [DEBUG] [LOCAL ] BHK: Loaded 23875 existing records from primary storage. [2025-10-22T17:33:10.984361] [INFO ] [MAIN ] BHK: Loaded 23875 existing records. [2025-10-22T17:33:11.165616] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:33:11.165869] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-22T17:33:11.165918] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-22T17:33:11.166243] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-22T17:33:11.166302] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-22T17:33:11.322915] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-22T17:33:11.543923] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:33:12.117676] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-22T17:33:12.197502] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T17:33:12.542739] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T17:33:12.917629] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-22T17:33:12.959914] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-22T17:33:13.717710] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-22T17:33:14.517677] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-22T17:33:14.566100] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T17:33:14.849226] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T17:33:15.297186] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T17:33:15.317695] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-22T17:33:16.117754] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-22T17:33:16.845130] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T17:33:16.917707] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-22T17:33:17.167996] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T17:33:17.717754] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-22T17:33:18.322368] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-22T17:33:18.353814] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T17:33:18.517707] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-22T17:33:19.317710] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-22T17:33:20.117737] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-22T17:33:20.232803] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T17:33:20.424268] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T17:33:20.905458] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-22T17:33:20.917607] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-22T17:33:21.717766] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-22T17:33:22.517691] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-22T17:33:22.868316] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T17:33:22.876265] [INFO ] [REMOTE ] BHC: Full fetch complete (67536 records). [2025-10-22T17:33:22.876411] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-22T17:33:23.072521] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T17:33:23.291970] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-22T17:33:23.292051] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-22T17:33:23.292801] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-22T17:33:23.292869] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-22T17:33:23.294173] [DEBUG] [LOCAL ] BHC: Trimmed 67536 records to 46589 (keeping 200 days of data) [2025-10-22T17:33:23.338484] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-22T17:33:23.569522] [DEBUG] [LOCAL ] BHC: Primary data saved (46589 records). [2025-10-22T17:33:23.569954] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-22T17:33:23.570063] [INFO ] [MAIN ] Update Progress: 268/2367 symbols completed. BHC took 27.3s. Estimated remaining: 4h 20m 56s. Rate: 8.0 symbols/min [2025-10-22T17:33:23.777382] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:33:23.795031] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-22T17:33:23.854127] [DEBUG] [LOCAL ] BHP: Loaded 53368 existing records from primary storage. [2025-10-22T17:33:23.854473] [INFO ] [MAIN ] BHP: Loaded 53368 existing records. [2025-10-22T17:33:24.076251] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:33:24.076560] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-22T17:33:24.076611] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-22T17:33:24.077120] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-22T17:33:24.077179] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-22T17:33:24.122866] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-22T17:33:24.460584] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:33:24.622725] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-22T17:33:24.917729] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-22T17:33:25.717619] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-22T17:33:25.822679] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T17:33:25.953867] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T17:33:26.517706] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-22T17:33:27.317746] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-22T17:33:27.625144] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T17:33:27.687622] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-22T17:33:28.117698] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-22T17:33:28.264396] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T17:33:28.917693] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-22T17:33:29.631378] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T17:33:29.717723] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-22T17:33:30.100256] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T17:33:30.517712] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-22T17:33:31.317620] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-22T17:33:31.468320] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T17:33:31.496951] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T17:33:31.500678] [INFO ] [REMOTE ] BGY: Full fetch complete (33037 records). [2025-10-22T17:33:31.500763] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-22T17:33:31.863121] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-22T17:33:31.863194] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-22T17:33:31.863629] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-22T17:33:31.863703] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-22T17:33:31.864416] [DEBUG] [LOCAL ] BGY: Trimmed 33037 records to 21389 (keeping 200 days of data) [2025-10-22T17:33:31.982136] [DEBUG] [LOCAL ] BGY: Primary data saved (21389 records). [2025-10-22T17:33:31.982255] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-22T17:33:31.982327] [INFO ] [MAIN ] Update Progress: 269/2367 symbols completed. BGY took 43.9s. Estimated remaining: 4h 20m 56s. Rate: 8.0 symbols/min [2025-10-22T17:33:32.119689] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-22T17:33:32.150723] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:33:32.150869] [DEBUG] [LOCAL ] BHR: No existing data file found in primary storage. [2025-10-22T17:33:32.150910] [WARN ] [MAIN ] BHR: No existing data found, performing full refresh instead. [2025-10-22T17:33:32.151014] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-22T17:33:32.151054] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-22T17:33:32.151095] [DEBUG] [LOCAL ] BHR: No primary data file found to delete. [2025-10-22T17:33:32.151355] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-22T17:33:32.516958] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T17:33:32.516476] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:33:32.917700] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-22T17:33:33.717726] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-22T17:33:34.021156] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T17:33:34.097576] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T17:33:34.517690] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-22T17:33:34.796376] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T17:33:34.800221] [INFO ] [REMOTE ] BHE: Full fetch complete (36459 records). [2025-10-22T17:33:34.800296] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-22T17:33:35.161592] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-22T17:33:35.161708] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-22T17:33:35.162207] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-22T17:33:35.162268] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-22T17:33:35.163055] [DEBUG] [LOCAL ] BHE: Trimmed 36459 records to 23698 (keeping 200 days of data) [2025-10-22T17:33:35.306534] [DEBUG] [LOCAL ] BHE: Primary data saved (23698 records). [2025-10-22T17:33:35.306676] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-22T17:33:35.306773] [INFO ] [MAIN ] Update Progress: 270/2367 symbols completed. BHE took 38.1s. Estimated remaining: 4h 20m 16s. Rate: 8.1 symbols/min [2025-10-22T17:33:35.322780] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-22T17:33:35.491394] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:33:35.489936] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T17:33:35.494840] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-22T17:33:35.495492] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-22T17:33:35.495607] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-22T17:33:35.495681] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-22T17:33:35.495745] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-22T17:33:35.495779] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-22T17:33:35.854456] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:33:36.117699] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-22T17:33:36.917693] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-22T17:33:37.568340] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T17:33:37.645703] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-22T17:33:37.717619] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-22T17:33:37.990031] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T17:33:38.517711] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-22T17:33:38.986206] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-22T17:33:39.317673] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-22T17:33:39.626245] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-22T17:33:39.735458] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-22T17:33:40.117700] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-22T17:33:40.917629] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-22T17:33:41.281336] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-22T17:33:41.298779] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T17:33:41.717721] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-22T17:33:42.517824] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-22T17:33:42.893048] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-22T17:33:43.317700] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-22T17:33:43.810662] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-22T17:33:44.117697] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-22T17:33:44.356485] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T17:33:44.360452] [INFO ] [REMOTE ] BHK: Full fetch complete (30624 records). [2025-10-22T17:33:44.360524] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-22T17:33:44.716520] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-22T17:33:44.716593] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-22T17:33:44.716996] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-22T17:33:44.717058] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-22T17:33:44.717761] [DEBUG] [LOCAL ] BHK: Trimmed 30624 records to 23957 (keeping 200 days of data) [2025-10-22T17:33:44.857250] [DEBUG] [LOCAL ] BHK: Primary data saved (23957 records). [2025-10-22T17:33:44.857412] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-22T17:33:44.857512] [INFO ] [MAIN ] Update Progress: 271/2367 symbols completed. BHK took 34.1s. Estimated remaining: 4h 20m 25s. Rate: 8.0 symbols/min [2025-10-22T17:33:44.922957] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-22T17:33:45.026330] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:33:45.072414] [DEBUG] [LOCAL ] BHVN: Loaded 50631 existing records from primary storage. [2025-10-22T17:33:45.072749] [INFO ] [MAIN ] BHVN: Loaded 50631 existing records. [2025-10-22T17:33:45.233388] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T17:33:45.266818] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:33:45.267019] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-22T17:33:45.267065] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-22T17:33:45.267275] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-22T17:33:45.267331] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-22T17:33:45.616174] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:33:45.717610] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-22T17:33:46.517732] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-22T17:33:46.992076] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-22T17:33:47.317690] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-22T17:33:47.576869] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T17:33:47.631155] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T17:33:47.757959] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-22T17:33:48.117693] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-22T17:33:48.469028] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-22T17:33:48.917704] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-22T17:33:49.717736] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-22T17:33:50.517706] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-22T17:33:50.683043] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-22T17:33:50.870841] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-22T17:33:51.317678] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-22T17:33:52.117739] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-22T17:33:52.552041] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-22T17:33:52.562000] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-22T17:33:52.917712] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-22T17:33:53.127291] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T17:33:53.135613] [INFO ] [REMOTE ] BHP: Full fetch complete (77047 records). [2025-10-22T17:33:53.135792] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-22T17:33:53.136687] [FATAL] [VALIDATOR ] BHP: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:33:53.136788] [FATAL] [MAIN ] BHP: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:33:53.136833] [WARN ] [MAIN ] BHP: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:33:53.136909] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-22T17:33:53.136994] [DEBUG] [LOCAL ] BHP: No primary data file found to delete. [2025-10-22T17:33:53.137042] [INFO ] [LOCAL ] BHP: Starting deletion of derivative data. [2025-10-22T17:33:53.137234] [DEBUG] [LOCAL ] BHP: Deleted derivative data file. [2025-10-22T17:33:53.137340] [INFO ] [MAIN ] Update Progress: 272/2367 symbols completed. BHP took 29.6s. Estimated remaining: 4h 20m 24s. Rate: 8.0 symbols/min [2025-10-22T17:33:53.306594] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:33:53.353008] [DEBUG] [LOCAL ] BILL: Loaded 52510 existing records from primary storage. [2025-10-22T17:33:53.353315] [INFO ] [MAIN ] BILL: Loaded 52510 existing records. [2025-10-22T17:33:53.533194] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:33:53.533420] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-22T17:33:53.533479] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-22T17:33:53.533704] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-22T17:33:53.533761] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-22T17:33:53.725439] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-22T17:33:53.902529] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:33:54.186009] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-22T17:33:54.524115] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-22T17:33:54.526993] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T17:33:55.317708] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-22T17:33:55.607750] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-22T17:33:56.117703] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-22T17:33:56.750753] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T17:33:56.917782] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-22T17:33:57.717705] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-22T17:33:57.949749] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T17:33:58.098286] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-22T17:33:58.517737] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-22T17:33:59.317723] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-22T17:33:59.357008] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T17:33:59.826385] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T17:33:59.830796] [INFO ] [REMOTE ] BHR: Full fetch complete (31164 records). [2025-10-22T17:33:59.830892] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-22T17:34:00.122930] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-22T17:34:00.201798] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-22T17:34:00.201883] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-22T17:34:00.202332] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-22T17:34:00.202371] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-22T17:34:00.203086] [DEBUG] [LOCAL ] BHR: Trimmed 31164 records to 21979 (keeping 200 days of data) [2025-10-22T17:34:00.334535] [DEBUG] [LOCAL ] BHR: Primary data saved (21979 records). [2025-10-22T17:34:00.334680] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-22T17:34:00.334766] [INFO ] [MAIN ] Update Progress: 273/2367 symbols completed. BHR took 28.4s. Estimated remaining: 4h 20m 15s. Rate: 8.0 symbols/min [2025-10-22T17:34:00.502833] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:34:00.525810] [DEBUG] [LOCAL ] BIO: Loaded 23888 existing records from primary storage. [2025-10-22T17:34:00.526059] [INFO ] [MAIN ] BIO: Loaded 23888 existing records. [2025-10-22T17:34:00.698803] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:34:00.698998] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-22T17:34:00.699044] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-22T17:34:00.699208] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-22T17:34:00.699244] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-22T17:34:00.925271] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-22T17:34:01.068451] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:34:01.097418] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T17:34:01.472845] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-22T17:34:01.717736] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-22T17:34:01.946891] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T17:34:02.315364] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T17:34:02.316572] [INFO ] [REMOTE ] BHV: Full fetch complete (1413 records). [2025-10-22T17:34:02.316689] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-22T17:34:02.317183] [FATAL] [VALIDATOR ] BHV: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:34:02.317284] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:34:02.317370] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:34:02.317462] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-22T17:34:02.317551] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-22T17:34:02.317602] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-22T17:34:02.317728] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-22T17:34:02.317815] [INFO ] [MAIN ] Update Progress: 274/2367 symbols completed. BHV took 27.0s. Estimated remaining: 4h 19m 25s. Rate: 8.1 symbols/min [2025-10-22T17:34:02.518834] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-22T17:34:02.519716] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:34:02.556807] [DEBUG] [LOCAL ] BIP: Loaded 39061 existing records from primary storage. [2025-10-22T17:34:02.557400] [INFO ] [MAIN ] BIP: Loaded 39061 existing records. [2025-10-22T17:34:02.734589] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:34:02.734837] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-22T17:34:02.734896] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-22T17:34:02.735169] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-22T17:34:02.735224] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-22T17:34:03.087621] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:34:03.317625] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-22T17:34:04.117622] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-22T17:34:04.202463] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T17:34:04.516354] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T17:34:04.917687] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-22T17:34:04.945904] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T17:34:05.717740] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-22T17:34:06.517620] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-22T17:34:06.854463] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T17:34:07.317687] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-22T17:34:07.629686] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T17:34:07.661172] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-22T17:34:08.117755] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-22T17:34:08.921759] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-22T17:34:09.258853] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T17:34:09.362088] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-22T17:34:09.717713] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-22T17:34:10.190198] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-22T17:34:10.517702] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-22T17:34:11.092619] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T17:34:11.317745] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-22T17:34:12.117709] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-22T17:34:12.318502] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:34:12.538995] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T17:34:12.917699] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-22T17:34:13.717702] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-22T17:34:14.517718] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-22T17:34:14.777885] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T17:34:15.317797] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-22T17:34:15.693679] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (3.58 seconds). [2025-10-22T17:34:16.072270] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T17:34:16.117746] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-22T17:34:16.917703] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-22T17:34:17.178516] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T17:34:17.188543] [INFO ] [REMOTE ] BHVN: Full fetch complete (70718 records). [2025-10-22T17:34:17.188819] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-22T17:34:17.624226] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-22T17:34:17.624354] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-22T17:34:17.625244] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-22T17:34:17.625341] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-22T17:34:17.626933] [DEBUG] [LOCAL ] BHVN: Trimmed 70718 records to 50633 (keeping 200 days of data) [2025-10-22T17:34:17.925431] [DEBUG] [LOCAL ] BHVN: Primary data saved (50633 records). [2025-10-22T17:34:17.925569] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-22T17:34:17.926529] [INFO ] [MAIN ] Update Progress: 275/2367 symbols completed. BHVN took 33.1s. Estimated remaining: 4h 20m 20s. Rate: 8.0 symbols/min [2025-10-22T17:34:18.094018] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:34:18.133936] [DEBUG] [LOCAL ] BIPC: Loaded 41184 existing records from primary storage. [2025-10-22T17:34:18.134245] [INFO ] [MAIN ] BIPC: Loaded 41184 existing records. [2025-10-22T17:34:18.318267] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:34:18.318852] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-22T17:34:18.318940] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-22T17:34:18.319161] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-22T17:34:18.319221] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-22T17:34:18.622745] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (4.91 seconds). [2025-10-22T17:34:18.675912] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-22T17:34:18.764332] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:34:18.765824] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T17:34:18.772493] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-22T17:34:19.317713] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-22T17:34:19.780855] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (3.66 seconds). [2025-10-22T17:34:20.117687] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-22T17:34:20.376091] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T17:34:20.589287] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-22T17:34:20.808135] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-22T17:34:20.917716] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-22T17:34:21.587413] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T17:34:21.717709] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-22T17:34:22.000245] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-22T17:34:22.517697] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-22T17:34:23.084228] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T17:34:23.317681] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-22T17:34:23.954152] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T17:34:24.117722] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-22T17:34:24.842520] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T17:34:24.917719] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-22T17:34:25.717748] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-22T17:34:26.034240] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-22T17:34:26.098586] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-22T17:34:26.517731] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-22T17:34:26.947713] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T17:34:27.317695] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-22T17:34:27.991978] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-22T17:34:28.117679] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-22T17:34:28.676223] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T17:34:28.917712] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-22T17:34:29.717684] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-22T17:34:30.085715] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-22T17:34:30.517720] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-22T17:34:30.725236] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T17:34:30.728797] [INFO ] [REMOTE ] BIO: Full fetch complete (34565 records). [2025-10-22T17:34:30.728907] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-22T17:34:31.013810] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-22T17:34:31.058364] [INFO ] [REMOTE ] BILL: Full fetch complete (76126 records). [2025-10-22T17:34:31.068830] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-22T17:34:31.237240] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-22T17:34:31.242454] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-22T17:34:31.253184] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-22T17:34:31.258383] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-22T17:34:31.289977] [DEBUG] [LOCAL ] BIO: Trimmed 34565 records to 23819 (keeping 200 days of data) [2025-10-22T17:34:31.330413] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-22T17:34:31.629534] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-22T17:34:31.633493] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-22T17:34:31.635787] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-22T17:34:31.636986] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-22T17:34:31.649410] [DEBUG] [LOCAL ] BILL: Trimmed 76126 records to 52500 (keeping 200 days of data) [2025-10-22T17:34:31.772620] [DEBUG] [LOCAL ] BIO: Primary data saved (23819 records). [2025-10-22T17:34:31.781862] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-22T17:34:31.786066] [INFO ] [MAIN ] Update Progress: 276/2367 symbols completed. BIO took 31.5s. Estimated remaining: 4h 21m 1s. Rate: 8.0 symbols/min [2025-10-22T17:34:32.130489] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:34:32.178519] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T17:34:32.187857] [DEBUG] [LOCAL ] BIPH: Loaded 2375 existing records from primary storage. [2025-10-22T17:34:32.188692] [INFO ] [MAIN ] BIPH: Loaded 2375 existing records. [2025-10-22T17:34:32.205786] [INFO ] [REMOTE ] BIP: Full fetch complete (57630 records). [2025-10-22T17:34:32.225750] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-22T17:34:32.239127] [DEBUG] [LOCAL ] BILL: Primary data saved (52500 records). [2025-10-22T17:34:32.251114] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-22T17:34:32.260457] [INFO ] [MAIN ] Update Progress: 277/2367 symbols completed. BILL took 39.1s. Estimated remaining: 4h 20m 1s. Rate: 8.0 symbols/min [2025-10-22T17:34:32.509795] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:34:32.520303] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-22T17:34:32.525525] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-22T17:34:32.545048] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-22T17:34:32.551070] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-22T17:34:33.111881] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-22T17:34:33.117212] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-22T17:34:33.156748] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-22T17:34:33.168101] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-22T17:34:33.188072] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:34:33.188591] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-22T17:34:33.190626] [DEBUG] [LOCAL ] BIP: Trimmed 57630 records to 38919 (keeping 200 days of data) [2025-10-22T17:34:33.329352] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T17:34:33.341226] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-22T17:34:33.464214] [DEBUG] [LOCAL ] BIP: Primary data saved (38919 records). [2025-10-22T17:34:33.464456] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-22T17:34:33.465180] [INFO ] [MAIN ] Update Progress: 278/2367 symbols completed. BIP took 31.1s. Estimated remaining: 4h 19m 6s. Rate: 8.1 symbols/min [2025-10-22T17:34:34.012558] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-22T17:34:34.014126] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-22T17:34:34.462894] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T17:34:34.517621] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-22T17:34:34.759909] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T17:34:34.840943] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-22T17:34:35.317679] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-22T17:34:36.117729] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-22T17:34:36.842723] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-22T17:34:36.880568] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T17:34:36.917721] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-22T17:34:37.717739] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-22T17:34:38.147379] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-22T17:34:38.187814] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T17:34:38.517738] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-22T17:34:38.962327] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-22T17:34:39.317718] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-22T17:34:39.757445] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-22T17:34:40.117741] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-22T17:34:40.564173] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-22T17:34:40.917700] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-22T17:34:41.717778] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-22T17:34:42.159368] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T17:34:42.517768] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-22T17:34:42.632996] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T17:34:42.930021] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-22T17:34:42.930929] [INFO ] [REMOTE ] BIPH: Full fetch complete (3879 records). [2025-10-22T17:34:42.930998] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-22T17:34:43.298253] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-22T17:34:43.298330] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-22T17:34:43.298469] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-22T17:34:43.298509] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-22T17:34:43.298880] [DEBUG] [LOCAL ] BIPH: Trimmed 3879 records to 2352 (keeping 200 days of data) [2025-10-22T17:34:43.312977] [DEBUG] [LOCAL ] BIPH: Primary data saved (2352 records). [2025-10-22T17:34:43.313043] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-22T17:34:43.313110] [INFO ] [MAIN ] Update Progress: 279/2367 symbols completed. BIPH took 11.5s. Estimated remaining: 4h 19m 17s. Rate: 8.1 symbols/min [2025-10-22T17:34:43.317725] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-22T17:34:45.100050] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T17:34:45.107086] [INFO ] [REMOTE ] BIPC: Full fetch complete (60289 records). [2025-10-22T17:34:45.107196] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-22T17:34:45.481215] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-22T17:34:45.481284] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-22T17:34:45.481960] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-22T17:34:45.482022] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-22T17:34:45.483160] [DEBUG] [LOCAL ] BIPC: Trimmed 60289 records to 41113 (keeping 200 days of data) [2025-10-22T17:34:45.725111] [DEBUG] [LOCAL ] BIPC: Primary data saved (41113 records). [2025-10-22T17:34:45.725235] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-22T17:34:45.725318] [INFO ] [MAIN ] Update Progress: 280/2367 symbols completed. BIPC took 27.8s. Estimated remaining: 4h 18m 32s. Rate: 8.1 symbols/min [2025-10-22T17:34:46.340083] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:34:46.403666] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:34:46.458131] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:34:46.461687] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:34:46.462396] [DEBUG] [LOCAL ] BIPI: Loaded 2845 existing records from primary storage. [2025-10-22T17:34:46.463115] [INFO ] [MAIN ] BIPI: Loaded 2845 existing records. [2025-10-22T17:34:46.539226] [DEBUG] [LOCAL ] BIPJ: Loaded 3124 existing records from primary storage. [2025-10-22T17:34:46.561934] [INFO ] [MAIN ] BIPJ: Loaded 3124 existing records. [2025-10-22T17:34:46.666897] [DEBUG] [LOCAL ] BIT: Loaded 23895 existing records from primary storage. [2025-10-22T17:34:46.732748] [INFO ] [MAIN ] BIT: Loaded 23895 existing records. [2025-10-22T17:34:46.810942] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:34:46.964729] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:34:46.921406] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-22T17:34:46.975632] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-22T17:34:46.987585] [DEBUG] [LOCAL ] BIRK: Loaded 51192 existing records from primary storage. [2025-10-22T17:34:46.993355] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-22T17:34:46.993612] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-22T17:34:46.999066] [INFO ] [MAIN ] BIRK: Loaded 51192 existing records. [2025-10-22T17:34:47.004566] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-22T17:34:47.009756] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-22T17:34:47.049416] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-22T17:34:47.072216] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-22T17:34:47.419808] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:34:47.440116] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-22T17:34:47.519156] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-22T17:34:47.574702] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-22T17:34:47.618209] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:34:47.619147] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-22T17:34:47.672964] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-22T17:34:47.689324] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-22T17:34:47.817099] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-22T17:34:47.830763] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-22T17:34:48.391683] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:34:48.431106] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-22T17:34:48.741613] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:34:48.752391] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-22T17:34:48.752054] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:34:48.767223] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-22T17:34:48.865071] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:34:48.865467] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-22T17:34:49.132884] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T17:34:49.134544] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-22T17:34:49.383571] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-22T17:34:49.385245] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-22T17:34:49.550134] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-22T17:34:49.551357] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-22T17:34:49.829435] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T17:34:49.830703] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-22T17:34:49.996505] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-22T17:34:50.030020] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T17:34:50.406876] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T17:34:50.517624] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-22T17:34:50.544069] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-22T17:34:51.317680] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-22T17:34:51.490070] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T17:34:52.117734] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-22T17:34:52.896304] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T17:34:52.917616] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-22T17:34:53.120709] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-22T17:34:53.717702] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-22T17:34:54.281346] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-22T17:34:54.517709] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-22T17:34:55.317719] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-22T17:34:55.396466] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-22T17:34:55.530808] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-22T17:34:55.763288] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-22T17:34:56.117714] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-22T17:34:56.570205] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-22T17:34:56.917802] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-22T17:34:57.318430] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-22T17:34:57.717723] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-22T17:34:58.517694] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-22T17:34:58.731584] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T17:34:59.020695] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-22T17:34:59.317624] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-22T17:34:59.841463] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-22T17:35:00.117711] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-22T17:35:00.761732] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T17:35:00.917819] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-22T17:35:01.612219] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-22T17:35:01.717701] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-22T17:35:02.216903] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-22T17:35:02.517699] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-22T17:35:03.082049] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T17:35:03.317742] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-22T17:35:04.117723] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-22T17:35:04.701004] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-22T17:35:04.702018] [INFO ] [REMOTE ] BIPI: Full fetch complete (4607 records). [2025-10-22T17:35:04.702088] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-22T17:35:04.922838] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-22T17:35:05.067615] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-22T17:35:05.067793] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-22T17:35:05.068076] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-22T17:35:05.068226] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-22T17:35:05.068827] [DEBUG] [LOCAL ] BIPI: Trimmed 4607 records to 2816 (keeping 200 days of data) [2025-10-22T17:35:05.114105] [DEBUG] [LOCAL ] BIPI: Primary data saved (2816 records). [2025-10-22T17:35:05.114342] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-22T17:35:05.115923] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T17:35:05.114821] [INFO ] [MAIN ] Update Progress: 281/2367 symbols completed. BIPI took 19.4s. Estimated remaining: 4h 19m 53s. Rate: 8.0 symbols/min [2025-10-22T17:35:05.313947] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:35:05.360667] [DEBUG] [LOCAL ] BJ: Loaded 51545 existing records from primary storage. [2025-10-22T17:35:05.360962] [INFO ] [MAIN ] BJ: Loaded 51545 existing records. [2025-10-22T17:35:05.538106] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-22T17:35:05.537856] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:35:05.539910] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-22T17:35:05.539972] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-22T17:35:05.540193] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-22T17:35:05.540231] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-22T17:35:05.723005] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-22T17:35:05.893300] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:35:06.517749] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-22T17:35:07.117930] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T17:35:07.317696] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-22T17:35:07.504896] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T17:35:08.117710] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-22T17:35:08.917683] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-22T17:35:09.064932] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T17:35:09.191126] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-22T17:35:09.717768] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-22T17:35:10.356013] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T17:35:10.357013] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4187 records). [2025-10-22T17:35:10.357084] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-22T17:35:10.519742] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-22T17:35:10.727708] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-22T17:35:10.727852] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-22T17:35:10.728083] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-22T17:35:10.728156] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-22T17:35:10.728724] [DEBUG] [LOCAL ] BIPJ: Trimmed 4187 records to 3106 (keeping 200 days of data) [2025-10-22T17:35:10.747860] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3106 records). [2025-10-22T17:35:10.747995] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-22T17:35:10.748235] [INFO ] [MAIN ] Update Progress: 282/2367 symbols completed. BIPJ took 25.0s. Estimated remaining: 4h 19m 32s. Rate: 8.0 symbols/min [2025-10-22T17:35:10.886958] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-22T17:35:10.960127] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:35:11.015016] [DEBUG] [LOCAL ] BK: Loaded 53546 existing records from primary storage. [2025-10-22T17:35:11.015388] [INFO ] [MAIN ] BK: Loaded 53546 existing records. [2025-10-22T17:35:11.188917] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:35:11.189140] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-22T17:35:11.189186] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-22T17:35:11.189368] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-22T17:35:11.189405] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-22T17:35:11.325012] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-22T17:35:11.540749] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:35:11.554311] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T17:35:12.117732] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-22T17:35:12.917739] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-22T17:35:13.116871] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T17:35:13.697417] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T17:35:13.717616] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-22T17:35:14.517670] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-22T17:35:14.628920] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T17:35:15.317718] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-22T17:35:15.432166] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T17:35:16.122839] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-22T17:35:16.143773] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T17:35:16.604490] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-22T17:35:16.917701] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-22T17:35:17.717699] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-22T17:35:17.978143] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T17:35:18.517690] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-22T17:35:18.725513] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T17:35:18.755608] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T17:35:19.317703] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-22T17:35:20.117719] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-22T17:35:20.256202] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T17:35:20.782255] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T17:35:20.917690] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-22T17:35:21.717731] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-22T17:35:21.974201] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T17:35:22.247921] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T17:35:22.252940] [INFO ] [REMOTE ] BIT: Full fetch complete (32317 records). [2025-10-22T17:35:22.253030] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-22T17:35:22.522738] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-22T17:35:22.629841] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-22T17:35:22.629946] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-22T17:35:22.630452] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-22T17:35:22.630515] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-22T17:35:22.631241] [DEBUG] [LOCAL ] BIT: Trimmed 32317 records to 23774 (keeping 200 days of data) [2025-10-22T17:35:22.771617] [DEBUG] [LOCAL ] BIT: Primary data saved (23774 records). [2025-10-22T17:35:22.771761] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-22T17:35:22.771838] [INFO ] [MAIN ] Update Progress: 283/2367 symbols completed. BIT took 37.0s. Estimated remaining: 4h 19m 58s. Rate: 8.0 symbols/min [2025-10-22T17:35:22.940705] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:35:22.982629] [DEBUG] [LOCAL ] BKD: Loaded 50448 existing records from primary storage. [2025-10-22T17:35:22.982953] [INFO ] [MAIN ] BKD: Loaded 50448 existing records. [2025-10-22T17:35:23.156147] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:35:23.156343] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-22T17:35:23.156388] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-22T17:35:23.156616] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-22T17:35:23.156699] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-22T17:35:23.330177] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-22T17:35:23.543006] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:35:23.566168] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T17:35:23.575219] [INFO ] [REMOTE ] BIRK: Full fetch complete (73449 records). [2025-10-22T17:35:23.575348] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-22T17:35:23.957804] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-22T17:35:23.957912] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-22T17:35:23.959031] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-22T17:35:23.959114] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-22T17:35:23.960696] [DEBUG] [LOCAL ] BIRK: Trimmed 73449 records to 51188 (keeping 200 days of data) [2025-10-22T17:35:24.125709] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-22T17:35:24.220493] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T17:35:24.295442] [DEBUG] [LOCAL ] BIRK: Primary data saved (51188 records). [2025-10-22T17:35:24.295561] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-22T17:35:24.295634] [INFO ] [MAIN ] Update Progress: 284/2367 symbols completed. BIRK took 38.6s. Estimated remaining: 4h 19m 7s. Rate: 8.0 symbols/min [2025-10-22T17:35:24.465296] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:35:24.495114] [DEBUG] [LOCAL ] BKE: Loaded 33720 existing records from primary storage. [2025-10-22T17:35:24.495402] [INFO ] [MAIN ] BKE: Loaded 33720 existing records. [2025-10-22T17:35:24.669548] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:35:24.669809] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-22T17:35:24.669857] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-22T17:35:24.670223] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-22T17:35:24.670281] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-22T17:35:24.923143] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-22T17:35:25.030054] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:35:25.344623] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T17:35:25.491421] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T17:35:25.717705] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-22T17:35:26.517711] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-22T17:35:26.862315] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T17:35:27.196196] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T17:35:27.317742] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-22T17:35:28.117617] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-22T17:35:28.917817] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-22T17:35:29.142711] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T17:35:29.171691] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-22T17:35:29.643799] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T17:35:29.717618] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-22T17:35:30.517737] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-22T17:35:30.572167] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T17:35:30.600700] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-22T17:35:31.317737] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-22T17:35:32.117722] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-22T17:35:32.442914] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T17:35:32.568468] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T17:35:32.917694] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-22T17:35:33.717707] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-22T17:35:34.455937] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-22T17:35:34.504984] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T17:35:34.517668] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-22T17:35:35.317625] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-22T17:35:35.579741] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T17:35:35.588314] [INFO ] [REMOTE ] BJ: Full fetch complete (74430 records). [2025-10-22T17:35:35.588435] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-22T17:35:36.012021] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-22T17:35:36.012117] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-22T17:35:36.012973] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-22T17:35:36.013076] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-22T17:35:36.014460] [DEBUG] [LOCAL ] BJ: Trimmed 74430 records to 51505 (keeping 200 days of data) [2025-10-22T17:35:36.123730] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-22T17:35:36.151386] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T17:35:36.352993] [DEBUG] [LOCAL ] BJ: Primary data saved (51505 records). [2025-10-22T17:35:36.353115] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-22T17:35:36.353191] [INFO ] [MAIN ] Update Progress: 285/2367 symbols completed. BJ took 31.2s. Estimated remaining: 4h 19m 33s. Rate: 8.0 symbols/min [2025-10-22T17:35:36.531951] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:35:36.563496] [DEBUG] [LOCAL ] BKH: Loaded 37390 existing records from primary storage. [2025-10-22T17:35:36.563818] [INFO ] [MAIN ] BKH: Loaded 37390 existing records. [2025-10-22T17:35:36.744636] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:35:36.744981] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-22T17:35:36.745062] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-22T17:35:36.745596] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-22T17:35:36.745752] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-22T17:35:36.895004] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T17:35:36.939444] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-22T17:35:37.140243] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:35:37.713200] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T17:35:37.723926] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-22T17:35:38.462983] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T17:35:38.517736] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-22T17:35:39.323490] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-22T17:35:39.346559] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:35:40.117727] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-22T17:35:40.378041] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T17:35:40.917617] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-22T17:35:41.099859] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T17:35:41.467288] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T17:35:41.717717] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-22T17:35:42.517729] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-22T17:35:42.640593] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T17:35:42.649359] [INFO ] [REMOTE ] BK: Full fetch complete (77678 records). [2025-10-22T17:35:42.649480] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-22T17:35:43.034307] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-22T17:35:43.034384] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-22T17:35:43.035190] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-22T17:35:43.035252] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-22T17:35:43.036751] [DEBUG] [LOCAL ] BK: Trimmed 77678 records to 53546 (keeping 200 days of data) [2025-10-22T17:35:43.273318] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T17:35:43.343976] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-22T17:35:43.391983] [DEBUG] [LOCAL ] BK: Primary data saved (53546 records). [2025-10-22T17:35:43.392087] [INFO ] [MAIN ] BK: Full history saved. [2025-10-22T17:35:43.392160] [INFO ] [MAIN ] Update Progress: 286/2367 symbols completed. BK took 32.6s. Estimated remaining: 4h 19m 22s. Rate: 8.0 symbols/min [2025-10-22T17:35:43.562980] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:35:43.598710] [DEBUG] [LOCAL ] BKKT: Loaded 37205 existing records from primary storage. [2025-10-22T17:35:43.599098] [INFO ] [MAIN ] BKKT: Loaded 37205 existing records. [2025-10-22T17:35:43.769322] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T17:35:43.801920] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:35:43.802854] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-22T17:35:43.802952] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-22T17:35:43.803473] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-22T17:35:43.803529] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-22T17:35:44.127904] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-22T17:35:44.159194] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:35:44.675296] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T17:35:44.917726] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-22T17:35:45.353893] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T17:35:45.717688] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-22T17:35:46.522766] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-22T17:35:46.543483] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T17:35:47.316701] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-22T17:35:47.323563] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-22T17:35:48.117688] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-22T17:35:48.340920] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T17:35:48.922747] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-22T17:35:48.938430] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T17:35:48.947542] [INFO ] [REMOTE ] BKD: Full fetch complete (72104 records). [2025-10-22T17:35:48.947735] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-22T17:35:49.347034] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-22T17:35:49.347148] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-22T17:35:49.347970] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-22T17:35:49.348050] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-22T17:35:49.367554] [DEBUG] [LOCAL ] BKD: Trimmed 72104 records to 50408 (keeping 200 days of data) [2025-10-22T17:35:49.369488] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-22T17:35:49.649212] [DEBUG] [LOCAL ] BKD: Primary data saved (50408 records). [2025-10-22T17:35:49.649379] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-22T17:35:49.650276] [INFO ] [MAIN ] Update Progress: 287/2367 symbols completed. BKD took 26.9s. Estimated remaining: 4h 19m 6s. Rate: 8.0 symbols/min [2025-10-22T17:35:49.724912] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-22T17:35:49.820245] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:35:49.830800] [DEBUG] [LOCAL ] BKN: Loaded 7286 existing records from primary storage. [2025-10-22T17:35:49.831016] [INFO ] [MAIN ] BKN: Loaded 7286 existing records. [2025-10-22T17:35:50.007722] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:35:50.007959] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-22T17:35:50.008036] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-22T17:35:50.008295] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-22T17:35:50.008348] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-22T17:35:50.298812] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T17:35:50.381497] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:35:50.517618] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-22T17:35:51.190544] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T17:35:51.317676] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-22T17:35:52.028954] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T17:35:52.117696] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-22T17:35:52.204302] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T17:35:52.917737] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-22T17:35:53.291920] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T17:35:53.717705] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-22T17:35:53.825307] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-22T17:35:54.517777] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-22T17:35:55.317742] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-22T17:35:55.451301] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T17:35:55.844442] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-22T17:35:55.944469] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T17:35:56.117705] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-22T17:35:56.917747] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-22T17:35:57.717720] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-22T17:35:57.816622] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T17:35:58.384837] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T17:35:58.517702] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-22T17:35:59.236478] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T17:35:59.317701] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-22T17:35:59.603130] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T17:36:00.117737] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-22T17:36:00.917713] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-22T17:36:01.605699] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-22T17:36:01.610992] [INFO ] [REMOTE ] BKE: Full fetch complete (50058 records). [2025-10-22T17:36:01.611120] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-22T17:36:01.611797] [FATAL] [VALIDATOR ] BKE: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:36:01.611886] [FATAL] [MAIN ] BKE: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:36:01.611928] [WARN ] [MAIN ] BKE: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:36:01.611996] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-22T17:36:01.612061] [DEBUG] [LOCAL ] BKE: No primary data file found to delete. [2025-10-22T17:36:01.612096] [INFO ] [LOCAL ] BKE: Starting deletion of derivative data. [2025-10-22T17:36:01.612255] [DEBUG] [LOCAL ] BKE: Deleted derivative data file. [2025-10-22T17:36:01.612986] [INFO ] [MAIN ] Update Progress: 288/2367 symbols completed. BKE took 37.3s. Estimated remaining: 4h 19m 31s. Rate: 8.0 symbols/min [2025-10-22T17:36:01.722852] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-22T17:36:01.818175] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:36:01.869785] [DEBUG] [LOCAL ] BKSY: Loaded 48901 existing records from primary storage. [2025-10-22T17:36:01.870132] [INFO ] [MAIN ] BKSY: Loaded 48901 existing records. [2025-10-22T17:36:02.058796] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:36:02.059055] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-22T17:36:02.059133] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-22T17:36:02.059587] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-22T17:36:02.059683] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-22T17:36:02.421756] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:36:02.496012] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-22T17:36:02.517607] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-22T17:36:03.317724] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-22T17:36:03.478231] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T17:36:03.908994] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (2.99 seconds). [2025-10-22T17:36:04.117691] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-22T17:36:04.804507] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-22T17:36:04.881053] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-22T17:36:04.917685] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-22T17:36:05.213875] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-22T17:36:05.717711] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-22T17:36:05.739520] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T17:36:06.517727] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-22T17:36:07.284570] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-22T17:36:07.317616] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-22T17:36:07.805034] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-22T17:36:07.939315] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T17:36:08.117706] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-22T17:36:08.917704] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-22T17:36:09.717740] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-22T17:36:10.332119] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T17:36:10.517709] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-22T17:36:10.603999] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T17:36:10.742484] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-22T17:36:10.751017] [INFO ] [REMOTE ] BKKT: Full fetch complete (51947 records). [2025-10-22T17:36:10.751126] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-22T17:36:11.131863] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-22T17:36:11.131940] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-22T17:36:11.132519] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-22T17:36:11.132560] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-22T17:36:11.133596] [DEBUG] [LOCAL ] BKKT: Trimmed 51947 records to 37391 (keeping 200 days of data) [2025-10-22T17:36:11.321004] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-22T17:36:11.350830] [DEBUG] [LOCAL ] BKKT: Primary data saved (37391 records). [2025-10-22T17:36:11.351468] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-22T17:36:11.352078] [INFO ] [MAIN ] Update Progress: 289/2367 symbols completed. BKKT took 28.0s. Estimated remaining: 4h 19m 39s. Rate: 8.0 symbols/min [2025-10-22T17:36:11.519299] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:36:11.534537] [DEBUG] [LOCAL ] BKT: Loaded 12824 existing records from primary storage. [2025-10-22T17:36:11.534795] [INFO ] [MAIN ] BKT: Loaded 12824 existing records. [2025-10-22T17:36:11.710225] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:36:11.710470] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-22T17:36:11.710546] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-22T17:36:11.710877] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-22T17:36:11.710929] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-22T17:36:12.020403] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T17:36:12.099532] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:36:12.117609] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-22T17:36:12.917683] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-22T17:36:13.283150] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T17:36:13.339893] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-22T17:36:13.717704] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-22T17:36:14.477601] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T17:36:14.511725] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T17:36:14.517822] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-22T17:36:14.519059] [INFO ] [REMOTE ] BKH: Full fetch complete (52918 records). [2025-10-22T17:36:14.519139] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-22T17:36:14.519873] [FATAL] [VALIDATOR ] BKH: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:36:14.519958] [FATAL] [MAIN ] BKH: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:36:14.520026] [WARN ] [MAIN ] BKH: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:36:14.520101] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-22T17:36:14.520165] [DEBUG] [LOCAL ] BKH: No primary data file found to delete. [2025-10-22T17:36:14.520204] [INFO ] [LOCAL ] BKH: Starting deletion of derivative data. [2025-10-22T17:36:14.520346] [DEBUG] [LOCAL ] BKH: Deleted derivative data file. [2025-10-22T17:36:14.520435] [INFO ] [MAIN ] Update Progress: 290/2367 symbols completed. BKH took 38.2s. Estimated remaining: 4h 19m 1s. Rate: 8.0 symbols/min [2025-10-22T17:36:14.695328] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:36:14.732448] [DEBUG] [LOCAL ] BKU: Loaded 42187 existing records from primary storage. [2025-10-22T17:36:14.732752] [INFO ] [MAIN ] BKU: Loaded 42187 existing records. [2025-10-22T17:36:14.920061] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:36:14.920280] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-22T17:36:14.920349] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-22T17:36:14.920530] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-22T17:36:14.920570] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-22T17:36:15.281058] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:36:15.317616] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-22T17:36:15.889180] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T17:36:16.117683] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-22T17:36:16.574329] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T17:36:16.917701] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-22T17:36:17.717687] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-22T17:36:17.831285] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-22T17:36:17.899871] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T17:36:18.456214] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-22T17:36:18.517747] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-22T17:36:19.304505] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-22T17:36:19.306418] [INFO ] [REMOTE ] BKN: Full fetch complete (11114 records). [2025-10-22T17:36:19.306495] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-22T17:36:19.327437] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-22T17:36:19.666533] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-22T17:36:19.666630] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-22T17:36:19.666921] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-22T17:36:19.666967] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-22T17:36:19.667421] [DEBUG] [LOCAL ] BKN: Trimmed 11114 records to 7279 (keeping 200 days of data) [2025-10-22T17:36:19.712495] [DEBUG] [LOCAL ] BKN: Primary data saved (7279 records). [2025-10-22T17:36:19.712720] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-22T17:36:19.712823] [INFO ] [MAIN ] Update Progress: 291/2367 symbols completed. BKN took 30.1s. Estimated remaining: 4h 18m 37s. Rate: 8.0 symbols/min [2025-10-22T17:36:19.881441] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:36:19.908880] [DEBUG] [LOCAL ] BKV: Loaded 29490 existing records from primary storage. [2025-10-22T17:36:19.909137] [INFO ] [MAIN ] BKV: Loaded 29490 existing records. [2025-10-22T17:36:20.084617] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:36:20.084840] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-22T17:36:20.084888] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-22T17:36:20.085062] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-22T17:36:20.085100] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-22T17:36:20.127122] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-22T17:36:20.469972] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:36:20.917702] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-22T17:36:20.951282] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T17:36:21.020547] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T17:36:21.717697] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-22T17:36:22.375279] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T17:36:22.517708] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-22T17:36:23.317721] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-22T17:36:23.481753] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-22T17:36:23.683093] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-22T17:36:24.117708] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-22T17:36:24.500204] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T17:36:24.917705] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-22T17:36:25.717685] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-22T17:36:25.753629] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T17:36:26.517749] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-22T17:36:26.652774] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T17:36:26.911753] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T17:36:27.317620] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-22T17:36:27.803015] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-22T17:36:28.117714] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-22T17:36:28.917677] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-22T17:36:29.427505] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-22T17:36:29.566896] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:36:29.717716] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-22T17:36:30.303724] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-22T17:36:30.398341] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T17:36:30.517713] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-22T17:36:31.317694] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-22T17:36:32.033402] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T17:36:32.117694] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-22T17:36:32.624108] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T17:36:32.917696] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-22T17:36:33.717700] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-22T17:36:34.225294] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T17:36:34.290356] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-22T17:36:34.452693] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-22T17:36:34.464388] [INFO ] [REMOTE ] BKSY: Full fetch complete (70576 records). [2025-10-22T17:36:34.464534] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-22T17:36:34.522710] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-22T17:36:34.850258] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-22T17:36:34.850336] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-22T17:36:34.851081] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-22T17:36:34.851144] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-22T17:36:34.852408] [DEBUG] [LOCAL ] BKSY: Trimmed 70576 records to 48912 (keeping 200 days of data) [2025-10-22T17:36:35.130859] [DEBUG] [LOCAL ] BKSY: Primary data saved (48912 records). [2025-10-22T17:36:35.130988] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-22T17:36:35.131616] [INFO ] [MAIN ] Update Progress: 292/2367 symbols completed. BKSY took 33.5s. Estimated remaining: 4h 19m 26s. Rate: 8.0 symbols/min [2025-10-22T17:36:35.304002] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:36:35.324263] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-22T17:36:35.340326] [DEBUG] [LOCAL ] BLCO: Loaded 35044 existing records from primary storage. [2025-10-22T17:36:35.340588] [INFO ] [MAIN ] BLCO: Loaded 35044 existing records. [2025-10-22T17:36:35.516085] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:36:35.516309] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-22T17:36:35.516358] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-22T17:36:35.516543] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-22T17:36:35.516582] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-22T17:36:35.868489] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:36:36.117728] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-22T17:36:36.220599] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T17:36:36.410617] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T17:36:36.917722] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-22T17:36:37.451585] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T17:36:37.717723] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-22T17:36:37.898954] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T17:36:37.904772] [INFO ] [REMOTE ] BKT: Full fetch complete (16717 records). [2025-10-22T17:36:37.904885] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-22T17:36:38.273793] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-22T17:36:38.273904] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-22T17:36:38.274280] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-22T17:36:38.274345] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-22T17:36:38.274931] [DEBUG] [LOCAL ] BKT: Trimmed 16717 records to 12833 (keeping 200 days of data) [2025-10-22T17:36:38.351554] [DEBUG] [LOCAL ] BKT: Primary data saved (12833 records). [2025-10-22T17:36:38.351708] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-22T17:36:38.351796] [INFO ] [MAIN ] Update Progress: 293/2367 symbols completed. BKT took 27.0s. Estimated remaining: 4h 18m 48s. Rate: 8.0 symbols/min [2025-10-22T17:36:38.517670] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:36:38.517749] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-22T17:36:38.543045] [DEBUG] [LOCAL ] BLD: Loaded 27198 existing records from primary storage. [2025-10-22T17:36:38.543289] [INFO ] [MAIN ] BLD: Loaded 27198 existing records. [2025-10-22T17:36:38.718977] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:36:38.719178] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-22T17:36:38.719227] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-22T17:36:38.719418] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-22T17:36:38.719473] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-22T17:36:39.079932] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:36:39.143495] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T17:36:39.317695] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-22T17:36:40.124593] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-22T17:36:40.141739] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T17:36:40.735349] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T17:36:40.917722] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-22T17:36:41.487768] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T17:36:41.717706] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-22T17:36:42.386172] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-22T17:36:42.517674] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-22T17:36:43.064603] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T17:36:43.317745] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-22T17:36:43.942155] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:36:44.117761] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-22T17:36:44.392114] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-22T17:36:44.917745] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-22T17:36:45.605058] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T17:36:45.717623] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-22T17:36:46.265102] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T17:36:46.517707] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-22T17:36:47.317735] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-22T17:36:47.516750] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T17:36:47.524580] [INFO ] [REMOTE ] BKU: Full fetch complete (61016 records). [2025-10-22T17:36:47.524723] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-22T17:36:47.914753] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-22T17:36:47.914945] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-22T17:36:47.920950] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-22T17:36:47.921024] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-22T17:36:47.943362] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T17:36:47.949484] [DEBUG] [LOCAL ] BKU: Trimmed 61016 records to 42169 (keeping 200 days of data) [2025-10-22T17:36:48.124679] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-22T17:36:48.208424] [DEBUG] [LOCAL ] BKU: Primary data saved (42169 records). [2025-10-22T17:36:48.208576] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-22T17:36:48.208699] [INFO ] [MAIN ] Update Progress: 294/2367 symbols completed. BKU took 33.7s. Estimated remaining: 4h 18m 58s. Rate: 8.0 symbols/min [2025-10-22T17:36:48.378988] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:36:48.428987] [DEBUG] [LOCAL ] BLDR: Loaded 51874 existing records from primary storage. [2025-10-22T17:36:48.429298] [INFO ] [MAIN ] BLDR: Loaded 51874 existing records. [2025-10-22T17:36:48.606680] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:36:48.606973] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-22T17:36:48.607036] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-22T17:36:48.607210] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-22T17:36:48.607249] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-22T17:36:48.899867] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T17:36:48.928375] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-22T17:36:48.996688] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:36:49.401436] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-22T17:36:49.717743] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-22T17:36:49.981952] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T17:36:50.517722] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-22T17:36:51.317702] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-22T17:36:51.790091] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-22T17:36:52.090173] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T17:36:52.117612] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-22T17:36:52.230809] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T17:36:52.917696] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-22T17:36:53.389392] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T17:36:53.717699] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-22T17:36:54.517714] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-22T17:36:54.564535] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T17:36:55.073015] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T17:36:55.317700] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-22T17:36:55.964044] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T17:36:55.969581] [INFO ] [REMOTE ] BKV: Full fetch complete (44760 records). [2025-10-22T17:36:55.969708] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-22T17:36:56.139633] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-22T17:36:56.346492] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-22T17:36:56.346568] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-22T17:36:56.347139] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-22T17:36:56.347201] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-22T17:36:56.348130] [DEBUG] [LOCAL ] BKV: Trimmed 44760 records to 29342 (keeping 200 days of data) [2025-10-22T17:36:56.512565] [DEBUG] [LOCAL ] BKV: Primary data saved (29342 records). [2025-10-22T17:36:56.512729] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-22T17:36:56.512817] [INFO ] [MAIN ] Update Progress: 295/2367 symbols completed. BKV took 36.8s. Estimated remaining: 4h 18m 56s. Rate: 8.0 symbols/min [2025-10-22T17:36:56.679342] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:36:56.692544] [DEBUG] [LOCAL ] BLE: Loaded 13755 existing records from primary storage. [2025-10-22T17:36:56.692813] [INFO ] [MAIN ] BLE: Loaded 13755 existing records. [2025-10-22T17:36:56.867200] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:36:56.867415] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-22T17:36:56.867461] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-22T17:36:56.867619] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-22T17:36:56.867722] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-22T17:36:56.934221] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-22T17:36:57.234571] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:36:57.287252] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T17:36:57.288413] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T17:36:57.717726] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-22T17:36:58.464877] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T17:36:58.517705] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-22T17:36:58.982628] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-22T17:36:59.317711] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-22T17:36:59.418843] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-22T17:37:00.117693] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-22T17:37:00.917700] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-22T17:37:01.236296] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T17:37:01.307530] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T17:37:01.717811] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-22T17:37:02.517738] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-22T17:37:02.664159] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T17:37:03.030078] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T17:37:03.317740] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-22T17:37:03.485114] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T17:37:04.117727] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-22T17:37:04.917720] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-22T17:37:04.999776] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T17:37:05.625158] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T17:37:05.630522] [INFO ] [REMOTE ] BLCO: Full fetch complete (52406 records). [2025-10-22T17:37:05.630618] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-22T17:37:05.726593] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-22T17:37:06.003764] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-22T17:37:06.003851] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-22T17:37:06.004454] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-22T17:37:06.004494] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-22T17:37:06.005613] [DEBUG] [LOCAL ] BLCO: Trimmed 52406 records to 34928 (keeping 200 days of data) [2025-10-22T17:37:06.205921] [DEBUG] [LOCAL ] BLCO: Primary data saved (34928 records). [2025-10-22T17:37:06.206067] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-22T17:37:06.206751] [INFO ] [MAIN ] Update Progress: 296/2367 symbols completed. BLCO took 31.1s. Estimated remaining: 4h 19m 4s. Rate: 8.0 symbols/min [2025-10-22T17:37:06.376004] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:06.411049] [DEBUG] [LOCAL ] BLK: Loaded 34328 existing records from primary storage. [2025-10-22T17:37:06.411319] [INFO ] [MAIN ] BLK: Loaded 34328 existing records. [2025-10-22T17:37:06.522913] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-22T17:37:06.590089] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:37:06.590394] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-22T17:37:06.590573] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-22T17:37:06.590802] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-22T17:37:06.590858] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-22T17:37:06.947956] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:06.978547] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T17:37:07.019530] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-22T17:37:07.023841] [INFO ] [REMOTE ] BLD: Full fetch complete (39949 records). [2025-10-22T17:37:07.023930] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-22T17:37:07.188104] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-22T17:37:07.325127] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-22T17:37:07.414754] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-22T17:37:07.414841] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-22T17:37:07.415447] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-22T17:37:07.415488] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-22T17:37:07.416350] [DEBUG] [LOCAL ] BLD: Trimmed 39949 records to 27046 (keeping 200 days of data) [2025-10-22T17:37:07.574969] [DEBUG] [LOCAL ] BLD: Primary data saved (27046 records). [2025-10-22T17:37:07.575114] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-22T17:37:07.575195] [INFO ] [MAIN ] Update Progress: 297/2367 symbols completed. BLD took 29.2s. Estimated remaining: 4h 18m 13s. Rate: 8.0 symbols/min [2025-10-22T17:37:07.737513] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:07.780716] [DEBUG] [LOCAL ] BLND: Loaded 49223 existing records from primary storage. [2025-10-22T17:37:07.781050] [INFO ] [MAIN ] BLND: Loaded 49223 existing records. [2025-10-22T17:37:07.972090] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:37:07.972322] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-22T17:37:07.972369] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-22T17:37:07.972562] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-22T17:37:07.972600] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-22T17:37:08.129053] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-22T17:37:08.324011] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:08.857753] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T17:37:08.917839] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-22T17:37:09.313104] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T17:37:09.717706] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-22T17:37:10.517676] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-22T17:37:10.657287] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T17:37:11.317671] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-22T17:37:11.390885] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T17:37:11.562386] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T17:37:12.117741] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-22T17:37:12.917683] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-22T17:37:13.024502] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T17:37:13.717619] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-22T17:37:13.894364] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-22T17:37:13.965875] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-22T17:37:14.517746] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-22T17:37:15.323165] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-22T17:37:15.324812] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T17:37:15.618348] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-22T17:37:16.117680] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-22T17:37:16.504536] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T17:37:16.917700] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-22T17:37:17.722875] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-22T17:37:17.737854] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T17:37:17.995455] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T17:37:17.998911] [INFO ] [REMOTE ] BLE: Full fetch complete (19555 records). [2025-10-22T17:37:17.999006] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-22T17:37:18.359114] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-22T17:37:18.359184] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-22T17:37:18.359539] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-22T17:37:18.359579] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-22T17:37:18.360115] [DEBUG] [LOCAL ] BLE: Trimmed 19555 records to 13616 (keeping 200 days of data) [2025-10-22T17:37:18.437758] [DEBUG] [LOCAL ] BLE: Primary data saved (13616 records). [2025-10-22T17:37:18.437891] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-22T17:37:18.437966] [INFO ] [MAIN ] Update Progress: 298/2367 symbols completed. BLE took 21.9s. Estimated remaining: 4h 18m 29s. Rate: 8.0 symbols/min [2025-10-22T17:37:18.526120] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-22T17:37:18.603994] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:18.604125] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-22T17:37:18.604161] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-22T17:37:18.604265] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-22T17:37:18.604305] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-22T17:37:18.604346] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-22T17:37:18.604377] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-22T17:37:18.947877] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:19.317619] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-10-22T17:37:19.494547] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T17:37:19.507513] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:37:19.507780] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-10-22T17:37:19.507866] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:37:19.507931] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-22T17:37:19.507996] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:37:19.508066] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-22T17:37:19.508127] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-22T17:37:19.508162] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-22T17:37:19.508201] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-22T17:37:19.508242] [INFO ] [MAIN ] Update Progress: 299/2367 symbols completed. BLSH took 1.1s. Estimated remaining: 4h 17m 37s. Rate: 8.0 symbols/min [2025-10-22T17:37:19.677754] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:19.692304] [DEBUG] [LOCAL ] BLW: Loaded 13120 existing records from primary storage. [2025-10-22T17:37:19.692564] [INFO ] [MAIN ] BLW: Loaded 13120 existing records. [2025-10-22T17:37:19.865882] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:37:19.866094] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-22T17:37:19.866140] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-22T17:37:19.866338] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-22T17:37:19.866393] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-22T17:37:20.122155] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-22T17:37:20.222171] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:20.505151] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T17:37:20.917711] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-22T17:37:21.717839] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-22T17:37:22.103168] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T17:37:22.517801] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-22T17:37:22.563148] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T17:37:23.317720] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-22T17:37:23.669012] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T17:37:23.677342] [INFO ] [REMOTE ] BLDR: Full fetch complete (74771 records). [2025-10-22T17:37:23.677466] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-22T17:37:24.057487] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-22T17:37:24.057623] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-22T17:37:24.058565] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-22T17:37:24.058680] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-22T17:37:24.060239] [DEBUG] [LOCAL ] BLDR: Trimmed 74771 records to 51855 (keeping 200 days of data) [2025-10-22T17:37:24.118739] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-22T17:37:24.177604] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T17:37:24.420705] [DEBUG] [LOCAL ] BLDR: Primary data saved (51855 records). [2025-10-22T17:37:24.420888] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-22T17:37:24.421023] [INFO ] [MAIN ] Update Progress: 300/2367 symbols completed. BLDR took 36.2s. Estimated remaining: 4h 17m 12s. Rate: 8.0 symbols/min [2025-10-22T17:37:24.594438] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:24.608836] [DEBUG] [LOCAL ] BLX: Loaded 15521 existing records from primary storage. [2025-10-22T17:37:24.609060] [INFO ] [MAIN ] BLX: Loaded 15521 existing records. [2025-10-22T17:37:24.788840] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:37:24.789332] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-22T17:37:24.789629] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-22T17:37:24.790236] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-22T17:37:24.795548] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-22T17:37:24.821695] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T17:37:24.918916] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-22T17:37:24.927305] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-22T17:37:25.211106] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:25.717690] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-22T17:37:25.812232] [DEBUG] [REMOTE ] BLW: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-22T17:37:25.812482] [WARN ] [REMOTE ] BLW: No data returned for month 2025-02 [2025-10-22T17:37:25.812585] [FATAL] [REMOTE ] BLW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:37:25.812726] [FATAL] [MAIN ] BLW: Failed to fetch primary data. [2025-10-22T17:37:25.812812] [WARN ] [MAIN ] BLW: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:37:25.812908] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-22T17:37:25.812990] [DEBUG] [LOCAL ] BLW: No primary data file found to delete. [2025-10-22T17:37:25.813028] [INFO ] [LOCAL ] BLW: Starting deletion of derivative data. [2025-10-22T17:37:25.813158] [DEBUG] [LOCAL ] BLW: Deleted derivative data file. [2025-10-22T17:37:25.813238] [INFO ] [MAIN ] Update Progress: 301/2367 symbols completed. BLW took 6.3s. Estimated remaining: 4h 16m 23s. Rate: 8.1 symbols/min [2025-10-22T17:37:25.981283] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:26.014691] [DEBUG] [LOCAL ] BMA: Loaded 36526 existing records from primary storage. [2025-10-22T17:37:26.014991] [INFO ] [MAIN ] BMA: Loaded 36526 existing records. [2025-10-22T17:37:26.188634] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:37:26.189022] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-22T17:37:26.189079] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-22T17:37:26.189634] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-22T17:37:26.189722] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-22T17:37:26.528896] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-22T17:37:26.557538] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T17:37:26.560636] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:27.317732] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-22T17:37:28.117728] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-22T17:37:28.202401] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-22T17:37:28.917755] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-22T17:37:29.221051] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T17:37:29.562081] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T17:37:29.717745] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-22T17:37:30.039508] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T17:37:30.517704] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-22T17:37:31.051953] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T17:37:31.317716] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-22T17:37:32.064500] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T17:37:32.117657] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-22T17:37:32.904180] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T17:37:32.917602] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-22T17:37:33.513529] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T17:37:33.717758] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-22T17:37:34.512261] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T17:37:34.518926] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-22T17:37:35.051070] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T17:37:35.317694] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-22T17:37:35.996822] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T17:37:36.117775] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-22T17:37:36.917751] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-22T17:37:37.143139] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T17:37:37.149556] [INFO ] [REMOTE ] BLK: Full fetch complete (53057 records). [2025-10-22T17:37:37.149719] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-22T17:37:37.621770] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-22T17:37:37.622915] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-22T17:37:37.623601] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-22T17:37:37.625038] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-22T17:37:37.628840] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-22T17:37:37.630158] [DEBUG] [LOCAL ] BLK: Trimmed 53057 records to 34184 (keeping 200 days of data) [2025-10-22T17:37:37.740229] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-22T17:37:37.793946] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T17:37:37.909576] [DEBUG] [LOCAL ] BLK: Primary data saved (34184 records). [2025-10-22T17:37:37.909748] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-22T17:37:37.910469] [INFO ] [MAIN ] Update Progress: 302/2367 symbols completed. BLK took 31.7s. Estimated remaining: 4h 16m 47s. Rate: 8.0 symbols/min [2025-10-22T17:37:38.075260] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:38.088634] [DEBUG] [LOCAL ] BME: Loaded 11279 existing records from primary storage. [2025-10-22T17:37:38.088900] [INFO ] [MAIN ] BME: Loaded 11279 existing records. [2025-10-22T17:37:38.263216] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:37:38.263472] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-22T17:37:38.263519] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-22T17:37:38.263737] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-22T17:37:38.263794] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-22T17:37:38.524426] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-22T17:37:38.612712] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:39.219922] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T17:37:39.317729] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-22T17:37:40.117709] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-22T17:37:40.314244] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T17:37:40.322987] [INFO ] [REMOTE ] BLND: Full fetch complete (72224 records). [2025-10-22T17:37:40.323138] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-22T17:37:40.751547] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-22T17:37:40.751882] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-22T17:37:40.770521] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-22T17:37:40.772184] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T17:37:40.771230] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-22T17:37:40.780834] [DEBUG] [LOCAL ] BLND: Trimmed 72224 records to 49215 (keeping 200 days of data) [2025-10-22T17:37:40.943946] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-22T17:37:41.057379] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T17:37:41.073321] [DEBUG] [LOCAL ] BLND: Primary data saved (49215 records). [2025-10-22T17:37:41.073401] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-22T17:37:41.073946] [INFO ] [MAIN ] Update Progress: 303/2367 symbols completed. BLND took 33.5s. Estimated remaining: 4h 16m 11s. Rate: 8.1 symbols/min [2025-10-22T17:37:41.236551] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:41.261232] [DEBUG] [LOCAL ] BMEZ: Loaded 25212 existing records from primary storage. [2025-10-22T17:37:41.261481] [INFO ] [MAIN ] BMEZ: Loaded 25212 existing records. [2025-10-22T17:37:41.454226] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:37:41.454489] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-22T17:37:41.454542] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-22T17:37:41.454755] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-22T17:37:41.454810] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-22T17:37:41.718372] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-22T17:37:41.831588] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:42.021946] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T17:37:42.517706] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-22T17:37:42.960384] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T17:37:43.317752] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-22T17:37:43.815032] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T17:37:44.117724] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-22T17:37:44.752262] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T17:37:44.918157] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-22T17:37:44.918024] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-22T17:37:45.717694] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-22T17:37:46.325873] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T17:37:46.517721] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-22T17:37:47.055379] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T17:37:47.317749] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-22T17:37:47.549865] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-22T17:37:48.117755] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-22T17:37:48.914545] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T17:37:48.917809] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-22T17:37:48.973089] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T17:37:49.717672] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-22T17:37:49.993244] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T17:37:50.517720] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-22T17:37:51.317687] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-22T17:37:51.632208] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T17:37:52.083335] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-22T17:37:52.090932] [INFO ] [REMOTE ] BMA: Full fetch complete (52378 records). [2025-10-22T17:37:52.091064] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-22T17:37:52.122991] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-22T17:37:52.411325] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T17:37:52.511747] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-22T17:37:52.511835] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-22T17:37:52.512502] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-22T17:37:52.512544] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-22T17:37:52.513623] [DEBUG] [LOCAL ] BMA: Trimmed 52378 records to 36532 (keeping 200 days of data) [2025-10-22T17:37:52.732946] [DEBUG] [LOCAL ] BMA: Primary data saved (36532 records). [2025-10-22T17:37:52.733082] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-22T17:37:52.733734] [INFO ] [MAIN ] Update Progress: 304/2367 symbols completed. BMA took 26.9s. Estimated remaining: 4h 16m 32s. Rate: 8.0 symbols/min [2025-10-22T17:37:52.904619] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:37:52.920182] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-22T17:37:52.932483] [DEBUG] [LOCAL ] BMI: Loaded 24889 existing records from primary storage. [2025-10-22T17:37:52.932784] [INFO ] [MAIN ] BMI: Loaded 24889 existing records. [2025-10-22T17:37:53.128190] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:37:53.128569] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-22T17:37:53.128719] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-22T17:37:53.129011] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-22T17:37:53.129123] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-22T17:37:53.300446] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T17:37:53.677975] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:37:53.717769] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-22T17:37:53.947130] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T17:37:54.218686] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-22T17:37:54.517691] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-22T17:37:55.317735] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-22T17:37:56.112233] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T17:37:56.117604] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-22T17:37:56.813757] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T17:37:56.917614] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-22T17:37:57.181952] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T17:37:57.646100] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-22T17:37:57.717606] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-22T17:37:58.517739] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-22T17:37:58.954963] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T17:37:59.317698] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-22T17:37:59.495035] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-22T17:38:00.113184] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-22T17:38:00.117617] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-22T17:38:00.917692] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-22T17:38:01.717751] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-22T17:38:02.131480] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T17:38:02.216635] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-22T17:38:02.219635] [INFO ] [REMOTE ] BLX: Full fetch complete (22543 records). [2025-10-22T17:38:02.219736] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-22T17:38:02.522810] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-22T17:38:02.585466] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-22T17:38:02.585541] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-22T17:38:02.586001] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-22T17:38:02.586065] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-22T17:38:02.586731] [DEBUG] [LOCAL ] BLX: Trimmed 22543 records to 15410 (keeping 200 days of data) [2025-10-22T17:38:02.676907] [DEBUG] [LOCAL ] BLX: Primary data saved (15410 records). [2025-10-22T17:38:02.677024] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-22T17:38:02.677098] [INFO ] [MAIN ] Update Progress: 305/2367 symbols completed. BLX took 38.3s. Estimated remaining: 4h 16m 41s. Rate: 8.0 symbols/min [2025-10-22T17:38:02.844340] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:38:02.849108] [DEBUG] [LOCAL ] BMN: Loaded 2581 existing records from primary storage. [2025-10-22T17:38:02.849286] [INFO ] [MAIN ] BMN: Loaded 2581 existing records. [2025-10-22T17:38:03.034957] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:38:03.046007] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-22T17:38:03.046941] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T17:38:03.047038] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-22T17:38:03.051417] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-22T17:38:03.051478] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-22T17:38:03.081729] [INFO ] [REMOTE ] BMEZ: Full fetch complete (39529 records). [2025-10-22T17:38:03.113944] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-22T17:38:03.321909] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-22T17:38:03.607452] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T17:38:03.737456] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:38:03.835417] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-22T17:38:03.835509] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-22T17:38:03.836165] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-22T17:38:03.836229] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-22T17:38:03.837152] [DEBUG] [LOCAL ] BMEZ: Trimmed 39529 records to 25062 (keeping 200 days of data) [2025-10-22T17:38:04.003039] [DEBUG] [LOCAL ] BMEZ: Primary data saved (25062 records). [2025-10-22T17:38:04.003175] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-22T17:38:04.003259] [INFO ] [MAIN ] Update Progress: 306/2367 symbols completed. BMEZ took 22.9s. Estimated remaining: 4h 15m 52s. Rate: 8.1 symbols/min [2025-10-22T17:38:04.128036] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-22T17:38:04.200219] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:38:04.200426] [DEBUG] [LOCAL ] BMO: No existing data file found in primary storage. [2025-10-22T17:38:04.200472] [WARN ] [MAIN ] BMO: No existing data found, performing full refresh instead. [2025-10-22T17:38:04.200583] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-22T17:38:04.200623] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-22T17:38:04.200704] [DEBUG] [LOCAL ] BMO: No primary data file found to delete. [2025-10-22T17:38:04.200748] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-22T17:38:04.571809] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T17:38:04.571129] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:38:04.762542] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-22T17:38:04.917680] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-22T17:38:05.350695] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-22T17:38:05.717717] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-22T17:38:06.517745] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-22T17:38:06.745804] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-22T17:38:07.317730] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-22T17:38:08.117726] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-22T17:38:08.182898] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T17:38:08.491287] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-22T17:38:08.514682] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-22T17:38:08.917734] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-22T17:38:09.516226] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-22T17:38:09.717700] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-22T17:38:10.517687] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-22T17:38:10.604913] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T17:38:11.317769] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-22T17:38:11.966228] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T17:38:12.117712] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-22T17:38:12.460468] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T17:38:12.917739] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-22T17:38:13.668713] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T17:38:13.690953] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-22T17:38:13.717609] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-22T17:38:14.517692] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-22T17:38:14.622610] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-22T17:38:15.317703] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-22T17:38:15.900447] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T17:38:16.117684] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-22T17:38:16.143065] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T17:38:16.917763] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-22T17:38:17.431817] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T17:38:17.546763] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-22T17:38:17.717718] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-22T17:38:18.517716] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-22T17:38:18.577446] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T17:38:19.317728] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-22T17:38:19.681055] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T17:38:20.117737] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-22T17:38:20.262531] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T17:38:20.265518] [INFO ] [REMOTE ] BME: Full fetch complete (15694 records). [2025-10-22T17:38:20.265690] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-22T17:38:20.436762] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-22T17:38:20.641144] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-22T17:38:20.641240] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-22T17:38:20.641634] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-22T17:38:20.641718] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-22T17:38:20.642422] [DEBUG] [LOCAL ] BME: Trimmed 15694 records to 11221 (keeping 200 days of data) [2025-10-22T17:38:20.711524] [DEBUG] [LOCAL ] BME: Primary data saved (11221 records). [2025-10-22T17:38:20.711698] [INFO ] [MAIN ] BME: Full history saved. [2025-10-22T17:38:20.711796] [INFO ] [MAIN ] Update Progress: 307/2367 symbols completed. BME took 42.8s. Estimated remaining: 4h 16m 47s. Rate: 8.0 symbols/min [2025-10-22T17:38:20.878631] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:38:20.924670] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-22T17:38:20.927296] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-22T17:38:20.927539] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-22T17:38:21.105282] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:38:21.105505] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-22T17:38:21.105563] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-22T17:38:21.105945] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-22T17:38:21.106002] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-22T17:38:21.467003] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:38:21.717697] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-22T17:38:22.493456] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T17:38:22.517685] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-22T17:38:22.661462] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-22T17:38:23.008663] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-22T17:38:23.317738] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-22T17:38:24.117733] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-22T17:38:24.665638] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T17:38:24.917716] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-22T17:38:25.717714] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-22T17:38:26.107980] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-22T17:38:26.180723] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-22T17:38:26.449251] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T17:38:26.517610] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-22T17:38:27.317739] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-22T17:38:28.118406] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-22T17:38:28.118318] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T17:38:28.917671] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-22T17:38:29.098476] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T17:38:29.528135] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T17:38:29.533134] [INFO ] [REMOTE ] BMI: Full fetch complete (34166 records). [2025-10-22T17:38:29.533256] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-22T17:38:29.724692] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-22T17:38:29.922875] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-22T17:38:29.922951] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-22T17:38:29.923421] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-22T17:38:29.923461] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-22T17:38:29.924317] [DEBUG] [LOCAL ] BMI: Trimmed 34166 records to 24901 (keeping 200 days of data) [2025-10-22T17:38:30.074617] [DEBUG] [LOCAL ] BMI: Primary data saved (24901 records). [2025-10-22T17:38:30.074899] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-22T17:38:30.074992] [INFO ] [MAIN ] Update Progress: 308/2367 symbols completed. BMI took 37.3s. Estimated remaining: 4h 16m 52s. Rate: 8.0 symbols/min [2025-10-22T17:38:30.247666] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:38:30.296236] [DEBUG] [LOCAL ] BN: Loaded 52984 existing records from primary storage. [2025-10-22T17:38:30.296547] [INFO ] [MAIN ] BN: Loaded 52984 existing records. [2025-10-22T17:38:30.478962] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:38:30.479207] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-22T17:38:30.479370] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-22T17:38:30.479909] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-22T17:38:30.479998] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-22T17:38:30.519279] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-22T17:38:30.537340] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T17:38:30.579627] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T17:38:30.870010] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:38:31.317686] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-22T17:38:32.117684] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-22T17:38:32.647555] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-22T17:38:32.648573] [INFO ] [REMOTE ] BMN: Full fetch complete (3723 records). [2025-10-22T17:38:32.648661] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-22T17:38:32.806385] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-22T17:38:32.920281] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-22T17:38:33.077594] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-22T17:38:33.077754] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-22T17:38:33.083938] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-22T17:38:33.084523] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-22T17:38:33.084807] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-22T17:38:33.086080] [INFO ] [REMOTE ] BMO: Full fetch complete (60019 records). [2025-10-22T17:38:33.086194] [DEBUG] [LOCAL ] BMN: Trimmed 3723 records to 2644 (keeping 200 days of data) [2025-10-22T17:38:33.086251] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-22T17:38:33.202689] [DEBUG] [LOCAL ] BMN: Primary data saved (2644 records). [2025-10-22T17:38:33.202806] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-22T17:38:33.203169] [INFO ] [MAIN ] Update Progress: 309/2367 symbols completed. BMN took 30.5s. Estimated remaining: 4h 16m 16s. Rate: 8.0 symbols/min [2025-10-22T17:38:33.573634] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:38:33.678781] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-22T17:38:33.686225] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-22T17:38:33.686949] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-22T17:38:33.687073] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-22T17:38:33.688367] [DEBUG] [LOCAL ] BMO: Trimmed 60019 records to 40992 (keeping 200 days of data) [2025-10-22T17:38:33.742602] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-22T17:38:33.762548] [DEBUG] [LOCAL ] BNED: Loaded 28324 existing records from primary storage. [2025-10-22T17:38:33.795352] [INFO ] [MAIN ] BNED: Loaded 28324 existing records. [2025-10-22T17:38:34.104677] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:38:34.115911] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-22T17:38:34.117018] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-22T17:38:34.120757] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-22T17:38:34.122063] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-22T17:38:34.206212] [DEBUG] [LOCAL ] BMO: Primary data saved (40992 records). [2025-10-22T17:38:34.225861] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-22T17:38:34.237476] [INFO ] [MAIN ] Update Progress: 310/2367 symbols completed. BMO took 30.2s. Estimated remaining: 4h 15m 25s. Rate: 8.1 symbols/min [2025-10-22T17:38:34.589603] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:38:34.668249] [DEBUG] [LOCAL ] BNH: Loaded 4741 existing records from primary storage. [2025-10-22T17:38:34.689794] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:38:34.690437] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-22T17:38:34.690182] [INFO ] [MAIN ] BNH: Loaded 4741 existing records. [2025-10-22T17:38:34.876900] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:38:34.902972] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-22T17:38:34.905817] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-22T17:38:34.906044] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-22T17:38:34.906542] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-22T17:38:34.907506] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-22T17:38:35.290826] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:38:35.317612] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-22T17:38:35.484389] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T17:38:35.893690] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T17:38:36.117689] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-22T17:38:36.798222] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-22T17:38:36.917684] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-22T17:38:37.014415] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T17:38:37.717738] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-22T17:38:38.517681] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-22T17:38:38.885159] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T17:38:39.070053] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T17:38:39.317721] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-22T17:38:40.117730] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-22T17:38:40.370368] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T17:38:40.446126] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T17:38:40.917713] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-22T17:38:41.690377] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T17:38:41.717667] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-22T17:38:42.347728] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T17:38:42.517781] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-22T17:38:43.317686] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-22T17:38:43.696508] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-22T17:38:43.740192] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T17:38:44.117669] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-22T17:38:44.917696] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-22T17:38:45.001296] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T17:38:45.565618] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T17:38:45.575834] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-22T17:38:45.717846] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-22T17:38:46.308115] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T17:38:46.517719] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-22T17:38:47.317700] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-22T17:38:48.118306] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-22T17:38:48.118213] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-22T17:38:48.140509] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T17:38:48.917752] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-22T17:38:49.717735] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-22T17:38:50.304340] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-22T17:38:50.312335] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-22T17:38:50.517773] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-22T17:38:50.588167] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:38:51.081079] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-22T17:38:51.317743] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-22T17:38:52.117718] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-22T17:38:52.917730] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-22T17:38:53.276769] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T17:38:53.442352] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T17:38:53.717730] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-22T17:38:54.517727] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-22T17:38:54.817327] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-22T17:38:55.317632] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-22T17:38:55.421035] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T17:38:55.873780] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T17:38:55.890058] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-22T17:38:56.117743] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-22T17:38:56.677619] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T17:38:56.917701] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-22T17:38:57.525099] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-22T17:38:57.717709] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-22T17:38:58.517705] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-22T17:38:58.589553] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T17:38:58.598756] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-22T17:38:58.598882] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-22T17:38:58.982710] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-22T17:38:58.982816] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-22T17:38:58.983705] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-22T17:38:58.983771] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-22T17:38:58.985349] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 53757 (keeping 200 days of data) [2025-10-22T17:38:59.319639] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-10-22T17:38:59.319786] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-22T17:38:59.321016] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-22T17:38:59.321838] [INFO ] [MAIN ] Update Progress: 311/2367 symbols completed. BMY took 38.6s. Estimated remaining: 4h 17m 15s. Rate: 8.0 symbols/min [2025-10-22T17:38:59.492763] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:38:59.499589] [DEBUG] [LOCAL ] BNJ: Loaded 2517 existing records from primary storage. [2025-10-22T17:38:59.499883] [INFO ] [MAIN ] BNJ: Loaded 2517 existing records. [2025-10-22T17:38:59.673412] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:38:59.673619] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-22T17:38:59.673697] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-22T17:38:59.673866] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-22T17:38:59.673920] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-22T17:39:00.038506] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:00.117685] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-22T17:39:00.269202] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-22T17:39:00.270593] [INFO ] [REMOTE ] BNH: Full fetch complete (6864 records). [2025-10-22T17:39:00.270685] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-22T17:39:00.670724] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-22T17:39:00.681937] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-22T17:39:00.682258] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-22T17:39:00.687458] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-22T17:39:00.709361] [DEBUG] [LOCAL ] BNH: Trimmed 6864 records to 4701 (keeping 200 days of data) [2025-10-22T17:39:00.723874] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-22T17:39:00.753509] [DEBUG] [LOCAL ] BNH: Primary data saved (4701 records). [2025-10-22T17:39:00.753639] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-22T17:39:00.753765] [INFO ] [MAIN ] Update Progress: 312/2367 symbols completed. BNH took 26.5s. Estimated remaining: 4h 16m 27s. Rate: 8.0 symbols/min [2025-10-22T17:39:00.916307] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:00.917692] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-22T17:39:00.958598] [DEBUG] [LOCAL ] BNL: Loaded 47118 existing records from primary storage. [2025-10-22T17:39:00.958944] [INFO ] [MAIN ] BNL: Loaded 47118 existing records. [2025-10-22T17:39:01.137823] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:39:01.138049] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-22T17:39:01.138097] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-22T17:39:01.138467] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-22T17:39:01.138522] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-22T17:39:01.540761] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:01.597069] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T17:39:01.717724] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-22T17:39:02.356131] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T17:39:02.517729] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-22T17:39:02.989414] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-22T17:39:03.317692] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-22T17:39:03.440539] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-22T17:39:04.117729] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-22T17:39:04.359277] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T17:39:04.363722] [INFO ] [REMOTE ] BNED: Full fetch complete (41971 records). [2025-10-22T17:39:04.363867] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-22T17:39:04.748944] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-22T17:39:04.749035] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-22T17:39:04.749566] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-22T17:39:04.749609] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-22T17:39:04.750611] [DEBUG] [LOCAL ] BNED: Trimmed 41971 records to 28217 (keeping 200 days of data) [2025-10-22T17:39:04.909042] [DEBUG] [LOCAL ] BNED: Primary data saved (28217 records). [2025-10-22T17:39:04.909182] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-22T17:39:04.909263] [INFO ] [MAIN ] Update Progress: 313/2367 symbols completed. BNED took 31.7s. Estimated remaining: 4h 15m 58s. Rate: 8.0 symbols/min [2025-10-22T17:39:04.922827] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-22T17:39:05.080829] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:05.128668] [DEBUG] [LOCAL ] BNS: Loaded 51426 existing records from primary storage. [2025-10-22T17:39:05.128987] [INFO ] [MAIN ] BNS: Loaded 51426 existing records. [2025-10-22T17:39:05.305130] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:39:05.305419] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-22T17:39:05.305557] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-22T17:39:05.305843] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-22T17:39:05.305904] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-22T17:39:05.663037] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:05.687077] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:39:05.717678] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-22T17:39:06.517738] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-22T17:39:06.991763] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-22T17:39:07.105531] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-22T17:39:07.114901] [INFO ] [REMOTE ] BN: Full fetch complete (76957 records). [2025-10-22T17:39:07.115028] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-22T17:39:07.336974] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-22T17:39:07.511019] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-22T17:39:07.511147] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-22T17:39:07.512008] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-22T17:39:07.512087] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-22T17:39:07.539913] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T17:39:07.538676] [DEBUG] [LOCAL ] BN: Trimmed 76957 records to 52983 (keeping 200 days of data) [2025-10-22T17:39:07.864438] [DEBUG] [LOCAL ] BN: Primary data saved (52983 records). [2025-10-22T17:39:07.864565] [INFO ] [MAIN ] BN: Full history saved. [2025-10-22T17:39:07.865480] [INFO ] [MAIN ] Update Progress: 314/2367 symbols completed. BN took 37.8s. Estimated remaining: 4h 15m 21s. Rate: 8.0 symbols/min [2025-10-22T17:39:08.030732] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:08.037936] [DEBUG] [LOCAL ] BNT: Loaded 3550 existing records from primary storage. [2025-10-22T17:39:08.038153] [INFO ] [MAIN ] BNT: Loaded 3550 existing records. [2025-10-22T17:39:08.126170] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-22T17:39:08.214131] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:39:08.214373] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-22T17:39:08.214431] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-22T17:39:08.214556] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-22T17:39:08.214595] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-22T17:39:08.566932] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:08.578769] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-22T17:39:08.917721] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-22T17:39:09.166624] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T17:39:09.393577] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-22T17:39:09.717749] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-22T17:39:10.103190] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-22T17:39:10.517730] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-22T17:39:10.937821] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-22T17:39:11.317698] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-22T17:39:11.831286] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-22T17:39:12.117709] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-22T17:39:12.477893] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-22T17:39:12.917715] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-22T17:39:13.518339] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T17:39:13.717720] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-22T17:39:14.371283] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-22T17:39:14.517701] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-22T17:39:15.075726] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-22T17:39:15.317695] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-22T17:39:16.117673] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-22T17:39:16.745583] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-22T17:39:16.885128] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T17:39:16.917618] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-22T17:39:17.717722] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-22T17:39:18.265047] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-22T17:39:18.517719] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-22T17:39:18.588014] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T17:39:18.886330] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-22T17:39:19.317755] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-22T17:39:20.117777] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-22T17:39:20.671181] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-22T17:39:20.672177] [INFO ] [REMOTE ] BNJ: Full fetch complete (3879 records). [2025-10-22T17:39:20.672245] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-22T17:39:20.923116] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-22T17:39:21.044427] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-22T17:39:21.044619] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-22T17:39:21.044848] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-22T17:39:21.044960] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-22T17:39:21.045397] [DEBUG] [LOCAL ] BNJ: Trimmed 3879 records to 2500 (keeping 200 days of data) [2025-10-22T17:39:21.061219] [DEBUG] [LOCAL ] BNJ: Primary data saved (2500 records). [2025-10-22T17:39:21.061295] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-22T17:39:21.061379] [INFO ] [MAIN ] Update Progress: 315/2367 symbols completed. BNJ took 21.7s. Estimated remaining: 4h 15m 50s. Rate: 8.0 symbols/min [2025-10-22T17:39:21.231410] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:21.265701] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T17:39:21.280614] [DEBUG] [LOCAL ] BNY: Loaded 7268 existing records from primary storage. [2025-10-22T17:39:21.280869] [INFO ] [MAIN ] BNY: Loaded 7268 existing records. [2025-10-22T17:39:21.452415] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:39:21.452675] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-22T17:39:21.452735] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-22T17:39:21.452899] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-22T17:39:21.452937] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-22T17:39:21.722850] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-22T17:39:21.853836] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:22.321380] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T17:39:22.517696] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-22T17:39:23.209718] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-22T17:39:23.317721] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-22T17:39:23.753755] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-22T17:39:24.034583] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-22T17:39:24.117698] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-22T17:39:24.917737] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-22T17:39:25.613601] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T17:39:25.717703] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-22T17:39:26.199543] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-22T17:39:26.517669] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-22T17:39:27.317745] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-22T17:39:27.381410] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T17:39:27.809623] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-22T17:39:27.840228] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-22T17:39:28.117723] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-22T17:39:28.861157] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-22T17:39:28.917611] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-22T17:39:29.717700] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-22T17:39:30.403361] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-22T17:39:30.487422] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T17:39:30.517670] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-22T17:39:31.218369] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-22T17:39:31.317720] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-22T17:39:32.117715] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-22T17:39:32.753405] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T17:39:32.926534] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-22T17:39:32.946873] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T17:39:33.717739] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-22T17:39:33.795328] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T17:39:34.243074] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-22T17:39:34.517738] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-22T17:39:35.317757] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-22T17:39:35.907264] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-22T17:39:36.117727] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-22T17:39:36.431688] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-22T17:39:36.728229] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-22T17:39:36.729723] [INFO ] [REMOTE ] BNT: Full fetch complete (4857 records). [2025-10-22T17:39:36.729795] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-22T17:39:36.922920] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-22T17:39:37.103218] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-22T17:39:37.103296] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-22T17:39:37.103449] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-22T17:39:37.103539] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-22T17:39:37.103940] [DEBUG] [LOCAL ] BNT: Trimmed 4857 records to 3527 (keeping 200 days of data) [2025-10-22T17:39:37.125029] [DEBUG] [LOCAL ] BNT: Primary data saved (3527 records). [2025-10-22T17:39:37.125105] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-22T17:39:37.125176] [INFO ] [MAIN ] Update Progress: 316/2367 symbols completed. BNT took 29.3s. Estimated remaining: 4h 16m 39s. Rate: 8.0 symbols/min [2025-10-22T17:39:37.297997] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:37.318331] [DEBUG] [LOCAL ] BOC: Loaded 18280 existing records from primary storage. [2025-10-22T17:39:37.318589] [INFO ] [MAIN ] BOC: Loaded 18280 existing records. [2025-10-22T17:39:37.493497] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:39:37.493735] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-22T17:39:37.493796] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-22T17:39:37.493956] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-22T17:39:37.493993] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-22T17:39:37.723920] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-22T17:39:37.784684] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T17:39:37.890102] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:38.517717] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-22T17:39:38.957321] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T17:39:39.317736] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-22T17:39:39.571837] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-22T17:39:39.944340] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-22T17:39:39.946456] [INFO ] [REMOTE ] BNY: Full fetch complete (10392 records). [2025-10-22T17:39:39.946527] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-22T17:39:40.124210] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-22T17:39:40.308603] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-22T17:39:40.308709] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-22T17:39:40.308983] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-22T17:39:40.309024] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-22T17:39:40.309441] [DEBUG] [LOCAL ] BNY: Trimmed 10392 records to 7253 (keeping 200 days of data) [2025-10-22T17:39:40.352019] [DEBUG] [LOCAL ] BNY: Primary data saved (7253 records). [2025-10-22T17:39:40.352135] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-22T17:39:40.352211] [INFO ] [MAIN ] Update Progress: 317/2367 symbols completed. BNY took 19.3s. Estimated remaining: 4h 16m 4s. Rate: 8.0 symbols/min [2025-10-22T17:39:40.917721] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-22T17:39:41.356767] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T17:39:41.717715] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-22T17:39:42.517709] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-22T17:39:42.551220] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T17:39:43.143744] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-22T17:39:43.317669] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-22T17:39:43.531295] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T17:39:43.540018] [INFO ] [REMOTE ] BNL: Full fetch complete (67287 records). [2025-10-22T17:39:43.540175] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-22T17:39:43.927185] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-22T17:39:43.927269] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-22T17:39:43.928242] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-22T17:39:43.928305] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-22T17:39:43.929614] [DEBUG] [LOCAL ] BNL: Trimmed 67287 records to 47073 (keeping 200 days of data) [2025-10-22T17:39:44.144935] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-22T17:39:44.236512] [DEBUG] [LOCAL ] BNL: Primary data saved (47073 records). [2025-10-22T17:39:44.236675] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-22T17:39:44.237489] [INFO ] [MAIN ] Update Progress: 318/2367 symbols completed. BNL took 43.5s. Estimated remaining: 4h 15m 33s. Rate: 8.0 symbols/min [2025-10-22T17:39:44.457261] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T17:39:44.917763] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-22T17:39:45.991557] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T17:39:46.000233] [INFO ] [REMOTE ] BNS: Full fetch complete (74644 records). [2025-10-22T17:39:46.000362] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-22T17:39:46.158536] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-22T17:39:46.193618] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-22T17:39:46.435291] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-22T17:39:46.435421] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-22T17:39:46.436270] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-22T17:39:46.436333] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-22T17:39:46.437727] [DEBUG] [LOCAL ] BNS: Trimmed 74644 records to 51416 (keeping 200 days of data) [2025-10-22T17:39:46.742003] [DEBUG] [LOCAL ] BNS: Primary data saved (51416 records). [2025-10-22T17:39:46.742116] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-22T17:39:46.742193] [INFO ] [MAIN ] Update Progress: 319/2367 symbols completed. BNS took 41.8s. Estimated remaining: 4h 14m 53s. Rate: 8.0 symbols/min [2025-10-22T17:39:47.167007] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-22T17:39:47.170981] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-22T17:39:48.061119] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-22T17:39:48.065159] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-22T17:39:49.056784] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T17:39:49.061584] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-22T17:39:50.046474] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-22T17:39:50.051971] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-22T17:39:50.997389] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T17:39:51.001734] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-22T17:39:52.228759] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T17:39:52.232180] [INFO ] [REMOTE ] BOC: Full fetch complete (25831 records). [2025-10-22T17:39:52.232259] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-22T17:39:52.591840] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-22T17:39:52.591916] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-22T17:39:52.592343] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-22T17:39:52.592382] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-22T17:39:52.593020] [DEBUG] [LOCAL ] BOC: Trimmed 25831 records to 18186 (keeping 200 days of data) [2025-10-22T17:39:52.693927] [DEBUG] [LOCAL ] BOC: Primary data saved (18186 records). [2025-10-22T17:39:52.694063] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-22T17:39:52.694137] [INFO ] [MAIN ] Update Progress: 320/2367 symbols completed. BOC took 15.6s. Estimated remaining: 4h 14m 36s. Rate: 8.0 symbols/min [2025-10-22T17:39:53.268788] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:53.369175] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:53.399332] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:53.399627] [DEBUG] [LOCAL ] BOE: No existing data file found in primary storage. [2025-10-22T17:39:53.354587] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:39:53.400267] [WARN ] [MAIN ] BOE: No existing data found, performing full refresh instead. [2025-10-22T17:39:53.400376] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-22T17:39:53.400420] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-22T17:39:53.400569] [DEBUG] [LOCAL ] BOE: No primary data file found to delete. [2025-10-22T17:39:53.400619] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-22T17:39:53.635466] [DEBUG] [LOCAL ] BOND: Loaded 32458 existing records from primary storage. [2025-10-22T17:39:53.649788] [DEBUG] [LOCAL ] BOH: Loaded 30727 existing records from primary storage. [2025-10-22T17:39:53.660077] [INFO ] [MAIN ] BOH: Loaded 30727 existing records. [2025-10-22T17:39:53.689547] [INFO ] [MAIN ] BOND: Loaded 32458 existing records. [2025-10-22T17:39:53.708737] [DEBUG] [LOCAL ] BOOT: Loaded 39541 existing records from primary storage. [2025-10-22T17:39:53.789239] [INFO ] [MAIN ] BOOT: Loaded 39541 existing records. [2025-10-22T17:39:54.154418] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:54.192457] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-22T17:39:54.265217] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:39:54.269277] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-22T17:39:54.277461] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-22T17:39:54.300211] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-22T17:39:54.317108] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-22T17:39:54.316986] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:39:54.377047] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-22T17:39:54.459507] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-22T17:39:54.465755] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-22T17:39:54.454312] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:39:54.473196] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-22T17:39:54.476450] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-22T17:39:54.506359] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-22T17:39:54.570566] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-22T17:39:54.598474] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-22T17:39:55.217754] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:55.238954] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-22T17:39:55.370693] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:55.386734] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-22T17:39:55.451966] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:39:55.452405] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-22T17:39:55.470081] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T17:39:55.475588] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-22T17:39:56.457509] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T17:39:56.462603] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-22T17:39:56.561091] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T17:39:56.568135] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-22T17:39:56.637046] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T17:39:56.644492] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-22T17:39:56.715907] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T17:39:56.917750] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-22T17:39:57.283110] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T17:39:57.717678] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-22T17:39:57.808822] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-22T17:39:57.845269] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T17:39:58.433403] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T17:39:58.473691] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-22T17:39:58.517694] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-22T17:39:59.317722] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-22T17:39:59.726237] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T17:40:00.117709] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-22T17:40:00.785908] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T17:40:00.917716] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-22T17:40:01.442491] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T17:40:01.717735] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-22T17:40:02.517750] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-22T17:40:03.069096] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-22T17:40:03.249799] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T17:40:03.317715] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-22T17:40:04.019495] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T17:40:04.117619] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-22T17:40:04.734817] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T17:40:04.917735] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-22T17:40:05.532756] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T17:40:05.717663] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-22T17:40:05.897153] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-22T17:40:06.517821] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-22T17:40:07.317687] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-22T17:40:07.457308] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T17:40:07.536704] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T17:40:08.117719] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-22T17:40:08.775573] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T17:40:08.917682] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-22T17:40:09.108525] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T17:40:09.112812] [INFO ] [REMOTE ] BOE: Full fetch complete (26969 records). [2025-10-22T17:40:09.112903] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-22T17:40:09.475085] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-22T17:40:09.475193] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-22T17:40:09.475582] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-22T17:40:09.475622] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-22T17:40:09.476433] [DEBUG] [LOCAL ] BOE: Trimmed 26969 records to 18068 (keeping 200 days of data) [2025-10-22T17:40:09.581283] [DEBUG] [LOCAL ] BOE: Primary data saved (18068 records). [2025-10-22T17:40:09.581416] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-22T17:40:09.581483] [INFO ] [MAIN ] Update Progress: 321/2367 symbols completed. BOE took 16.9s. Estimated remaining: 4h 15m 29s. Rate: 8.0 symbols/min [2025-10-22T17:40:09.723171] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-22T17:40:09.749128] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:40:09.797063] [DEBUG] [LOCAL ] BORR: Loaded 51097 existing records from primary storage. [2025-10-22T17:40:09.797397] [INFO ] [MAIN ] BORR: Loaded 51097 existing records. [2025-10-22T17:40:09.992736] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:40:09.993014] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-22T17:40:09.993066] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-22T17:40:09.993373] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-22T17:40:09.993432] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-22T17:40:10.346010] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:40:10.517736] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-22T17:40:11.002677] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-22T17:40:11.165350] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-22T17:40:11.317682] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-22T17:40:12.122901] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-22T17:40:12.148305] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T17:40:12.528507] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T17:40:12.917690] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-22T17:40:13.558069] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T17:40:13.717710] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-22T17:40:14.231691] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:40:14.517739] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-22T17:40:15.105498] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T17:40:15.317707] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-22T17:40:16.117694] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-22T17:40:16.468992] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T17:40:16.519475] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T17:40:16.917684] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-22T17:40:17.245536] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T17:40:17.717748] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-22T17:40:18.408867] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T17:40:18.517707] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-22T17:40:19.317770] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-22T17:40:19.624002] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T17:40:19.862673] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T17:40:20.117759] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-22T17:40:20.770165] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T17:40:20.917681] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-22T17:40:21.449922] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T17:40:21.717729] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-22T17:40:22.456210] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T17:40:22.517714] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-22T17:40:23.317679] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-22T17:40:23.510258] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T17:40:24.053410] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T17:40:24.059056] [INFO ] [REMOTE ] BOH: Full fetch complete (45456 records). [2025-10-22T17:40:24.059146] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-22T17:40:24.122764] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-22T17:40:24.440539] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-22T17:40:24.440756] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-22T17:40:24.441401] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-22T17:40:24.441450] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-22T17:40:24.442534] [DEBUG] [LOCAL ] BOH: Trimmed 45456 records to 30638 (keeping 200 days of data) [2025-10-22T17:40:24.624847] [DEBUG] [LOCAL ] BOH: Primary data saved (30638 records). [2025-10-22T17:40:24.625024] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-22T17:40:24.625118] [INFO ] [MAIN ] Update Progress: 322/2367 symbols completed. BOH took 31.9s. Estimated remaining: 4h 16m 9s. Rate: 8.0 symbols/min [2025-10-22T17:40:24.797925] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:40:24.819441] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T17:40:24.844172] [DEBUG] [LOCAL ] BOW: Loaded 22908 existing records from primary storage. [2025-10-22T17:40:24.844419] [INFO ] [MAIN ] BOW: Loaded 22908 existing records. [2025-10-22T17:40:24.922782] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-22T17:40:25.027758] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:40:25.027967] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-22T17:40:25.028015] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-22T17:40:25.028270] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-22T17:40:25.028310] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-22T17:40:25.389216] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:40:25.643663] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T17:40:25.717617] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-22T17:40:26.517713] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-22T17:40:26.929018] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-22T17:40:26.934961] [INFO ] [REMOTE ] BOOT: Full fetch complete (59938 records). [2025-10-22T17:40:26.935068] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-22T17:40:27.321904] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-22T17:40:27.321622] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-22T17:40:27.322035] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-22T17:40:27.324329] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-22T17:40:27.324485] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-22T17:40:27.325720] [DEBUG] [LOCAL ] BOOT: Trimmed 59938 records to 39419 (keeping 200 days of data) [2025-10-22T17:40:27.475024] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T17:40:27.599342] [DEBUG] [LOCAL ] BOOT: Primary data saved (39419 records). [2025-10-22T17:40:27.599484] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-22T17:40:27.599563] [INFO ] [MAIN ] Update Progress: 323/2367 symbols completed. BOOT took 34.9s. Estimated remaining: 4h 15m 33s. Rate: 8.0 symbols/min [2025-10-22T17:40:27.777095] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:40:27.817768] [DEBUG] [LOCAL ] BOX: Loaded 50139 existing records from primary storage. [2025-10-22T17:40:27.818063] [INFO ] [MAIN ] BOX: Loaded 50139 existing records. [2025-10-22T17:40:28.005137] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:40:28.005434] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-22T17:40:28.005542] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-22T17:40:28.011457] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-22T17:40:28.020331] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-22T17:40:28.088617] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T17:40:28.122619] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-22T17:40:28.152307] [INFO ] [REMOTE ] BOND: Full fetch complete (46645 records). [2025-10-22T17:40:28.203966] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-22T17:40:28.490397] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T17:40:28.599093] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:40:28.824619] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-22T17:40:28.824759] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-22T17:40:28.825567] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-22T17:40:28.825672] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-22T17:40:28.827104] [DEBUG] [LOCAL ] BOND: Trimmed 46645 records to 32409 (keeping 200 days of data) [2025-10-22T17:40:28.931082] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-22T17:40:29.032163] [DEBUG] [LOCAL ] BOND: Primary data saved (32409 records). [2025-10-22T17:40:29.032347] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-22T17:40:29.032459] [INFO ] [MAIN ] Update Progress: 324/2367 symbols completed. BOND took 36.3s. Estimated remaining: 4h 14m 47s. Rate: 8.0 symbols/min [2025-10-22T17:40:29.201575] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:40:29.248732] [DEBUG] [LOCAL ] BP: Loaded 53706 existing records from primary storage. [2025-10-22T17:40:29.249080] [INFO ] [MAIN ] BP: Loaded 53706 existing records. [2025-10-22T17:40:29.447296] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:40:29.447525] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-22T17:40:29.447581] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-22T17:40:29.447847] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-22T17:40:29.447903] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-22T17:40:29.721399] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-22T17:40:29.816014] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:40:29.826185] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T17:40:29.971874] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-22T17:40:30.517710] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-22T17:40:31.317679] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-22T17:40:31.586630] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-22T17:40:32.117712] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-22T17:40:32.188562] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T17:40:32.218971] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-22T17:40:32.917681] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-22T17:40:33.627829] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T17:40:33.717606] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-22T17:40:34.517715] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-22T17:40:34.956478] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T17:40:35.317751] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-22T17:40:35.442625] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T17:40:35.664091] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T17:40:36.117699] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-22T17:40:36.917782] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-22T17:40:37.724238] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-22T17:40:37.736291] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-22T17:40:37.867072] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T17:40:37.875026] [INFO ] [REMOTE ] BORR: Full fetch complete (74161 records). [2025-10-22T17:40:37.875181] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-22T17:40:37.876044] [FATAL] [VALIDATOR ] BORR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:40:37.876138] [FATAL] [MAIN ] BORR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:40:37.876181] [WARN ] [MAIN ] BORR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:40:37.876244] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-22T17:40:37.876329] [DEBUG] [LOCAL ] BORR: No primary data file found to delete. [2025-10-22T17:40:37.876384] [INFO ] [LOCAL ] BORR: Starting deletion of derivative data. [2025-10-22T17:40:37.876549] [DEBUG] [LOCAL ] BORR: Deleted derivative data file. [2025-10-22T17:40:37.877286] [INFO ] [MAIN ] Update Progress: 325/2367 symbols completed. BORR took 28.3s. Estimated remaining: 4h 14m 48s. Rate: 8.0 symbols/min [2025-10-22T17:40:38.042512] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:40:38.075761] [DEBUG] [LOCAL ] BR: Loaded 34606 existing records from primary storage. [2025-10-22T17:40:38.076045] [INFO ] [MAIN ] BR: Loaded 34606 existing records. [2025-10-22T17:40:38.256848] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:40:38.257212] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-22T17:40:38.257314] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-22T17:40:38.257904] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-22T17:40:38.258067] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-22T17:40:38.523464] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-22T17:40:38.575622] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T17:40:38.670154] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:40:39.049214] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T17:40:39.317716] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-22T17:40:40.117735] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-22T17:40:40.462322] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-22T17:40:40.642006] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T17:40:40.819052] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T17:40:40.917675] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-22T17:40:41.717721] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-22T17:40:41.898440] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-22T17:40:42.517771] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-22T17:40:43.170226] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T17:40:43.274962] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-22T17:40:43.317701] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-22T17:40:44.117732] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-22T17:40:44.628607] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:40:44.917709] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-22T17:40:45.717762] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-22T17:40:46.170802] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T17:40:46.227614] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T17:40:46.517729] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-22T17:40:46.649016] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T17:40:47.317728] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-22T17:40:48.037316] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T17:40:48.117711] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-22T17:40:48.603347] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-22T17:40:48.608314] [INFO ] [REMOTE ] BOW: Full fetch complete (32111 records). [2025-10-22T17:40:48.608447] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-22T17:40:48.932207] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-22T17:40:48.980870] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-22T17:40:48.981101] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-22T17:40:48.981577] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-22T17:40:48.981621] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-22T17:40:48.982457] [DEBUG] [LOCAL ] BOW: Trimmed 32111 records to 22829 (keeping 200 days of data) [2025-10-22T17:40:49.115523] [DEBUG] [LOCAL ] BOW: Primary data saved (22829 records). [2025-10-22T17:40:49.115688] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-22T17:40:49.115788] [INFO ] [MAIN ] Update Progress: 326/2367 symbols completed. BOW took 24.5s. Estimated remaining: 4h 15m 4s. Rate: 8.0 symbols/min [2025-10-22T17:40:49.287713] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:40:49.337504] [DEBUG] [LOCAL ] BRBR: Loaded 51828 existing records from primary storage. [2025-10-22T17:40:49.337870] [INFO ] [MAIN ] BRBR: Loaded 51828 existing records. [2025-10-22T17:40:49.516090] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:40:49.516330] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-22T17:40:49.516495] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-22T17:40:49.516836] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-22T17:40:49.516916] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-22T17:40:49.712374] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T17:40:49.720562] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-22T17:40:49.900066] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:40:50.517692] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-22T17:40:50.829022] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-22T17:40:51.317676] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-22T17:40:51.779340] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T17:40:51.895181] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-22T17:40:52.117735] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-22T17:40:52.816702] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T17:40:52.917694] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-22T17:40:53.719353] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-22T17:40:53.723512] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T17:40:54.522562] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-22T17:40:54.529004] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T17:40:55.325099] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-22T17:40:55.341672] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:40:56.117741] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-22T17:40:56.704467] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-22T17:40:56.917676] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-22T17:40:57.054598] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:40:57.236478] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-22T17:40:57.717743] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-22T17:40:58.473583] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T17:40:58.517612] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-22T17:40:59.317700] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-22T17:40:59.672142] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T17:40:59.680602] [INFO ] [REMOTE ] BOX: Full fetch complete (72350 records). [2025-10-22T17:40:59.680793] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-22T17:41:00.084988] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-22T17:41:00.085214] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-22T17:41:00.086030] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-22T17:41:00.086110] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-22T17:41:00.087809] [DEBUG] [LOCAL ] BOX: Trimmed 72350 records to 50125 (keeping 200 days of data) [2025-10-22T17:41:00.135574] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-22T17:41:00.213003] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T17:41:00.422881] [DEBUG] [LOCAL ] BOX: Primary data saved (50125 records). [2025-10-22T17:41:00.423026] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-22T17:41:00.423799] [INFO ] [MAIN ] Update Progress: 327/2367 symbols completed. BOX took 32.8s. Estimated remaining: 4h 15m 21s. Rate: 8.0 symbols/min [2025-10-22T17:41:00.597538] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:00.617130] [DEBUG] [LOCAL ] BRC: Loaded 18420 existing records from primary storage. [2025-10-22T17:41:00.617355] [INFO ] [MAIN ] BRC: Loaded 18420 existing records. [2025-10-22T17:41:00.793450] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:41:00.793693] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-22T17:41:00.793752] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-22T17:41:00.793990] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-22T17:41:00.794046] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-22T17:41:00.932074] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-22T17:41:01.145273] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:01.717718] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-22T17:41:02.039597] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-10-22T17:41:02.078955] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-22T17:41:02.517726] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-22T17:41:02.670371] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T17:41:03.196594] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T17:41:03.317733] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-22T17:41:04.117741] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-22T17:41:04.786497] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-22T17:41:04.875258] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T17:41:04.883255] [INFO ] [REMOTE ] BR: Full fetch complete (50030 records). [2025-10-22T17:41:04.883567] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-22T17:41:04.927800] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-22T17:41:05.305050] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-22T17:41:05.305166] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-22T17:41:05.305876] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-22T17:41:05.305941] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-22T17:41:05.307162] [DEBUG] [LOCAL ] BR: Trimmed 50030 records to 34554 (keeping 200 days of data) [2025-10-22T17:41:05.535867] [DEBUG] [LOCAL ] BR: Primary data saved (34554 records). [2025-10-22T17:41:05.536007] [INFO ] [MAIN ] BR: Full history saved. [2025-10-22T17:41:05.536816] [INFO ] [MAIN ] Update Progress: 328/2367 symbols completed. BR took 27.7s. Estimated remaining: 4h 14m 58s. Rate: 8.0 symbols/min [2025-10-22T17:41:05.729323] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-22T17:41:05.733290] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:05.794552] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T17:41:05.822172] [DEBUG] [LOCAL ] BRCC: Loaded 40061 existing records from primary storage. [2025-10-22T17:41:05.822491] [INFO ] [MAIN ] BRCC: Loaded 40061 existing records. [2025-10-22T17:41:05.998098] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:41:05.998305] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-22T17:41:05.998351] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-22T17:41:05.998708] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-22T17:41:05.998767] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-22T17:41:06.344074] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:06.460815] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T17:41:06.517614] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-22T17:41:07.317720] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-22T17:41:08.005555] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T17:41:08.117697] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-22T17:41:08.353923] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-22T17:41:08.917706] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-22T17:41:09.214012] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-22T17:41:09.520682] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-22T17:41:09.717757] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-22T17:41:10.517704] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-22T17:41:11.032233] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-22T17:41:11.279376] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T17:41:11.317638] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-22T17:41:11.624157] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T17:41:12.117683] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-22T17:41:12.733135] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:41:12.794034] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-22T17:41:12.917669] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-22T17:41:13.717686] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-22T17:41:13.863968] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T17:41:14.517714] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-22T17:41:15.317812] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-22T17:41:15.549556] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-22T17:41:15.583320] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T17:41:16.117720] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-22T17:41:16.917678] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-22T17:41:17.159465] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T17:41:17.205425] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T17:41:17.717725] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-22T17:41:18.517711] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-22T17:41:18.963402] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-22T17:41:19.068545] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-22T17:41:19.078632] [INFO ] [REMOTE ] BP: Full fetch complete (77881 records). [2025-10-22T17:41:19.079081] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-22T17:41:19.322932] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-22T17:41:19.523904] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-22T17:41:19.524002] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-22T17:41:19.524945] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-22T17:41:19.525015] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-22T17:41:19.534956] [DEBUG] [LOCAL ] BP: Trimmed 77881 records to 53706 (keeping 200 days of data) [2025-10-22T17:41:19.536030] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T17:41:19.540240] [INFO ] [REMOTE ] BRC: Full fetch complete (28398 records). [2025-10-22T17:41:19.540377] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-22T17:41:20.057033] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-22T17:41:20.063332] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-22T17:41:20.064017] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-22T17:41:20.064102] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-22T17:41:20.122850] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-22T17:41:20.151378] [DEBUG] [LOCAL ] BRC: Trimmed 28398 records to 18341 (keeping 200 days of data) [2025-10-22T17:41:20.361268] [DEBUG] [LOCAL ] BRC: Primary data saved (18341 records). [2025-10-22T17:41:20.372076] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-22T17:41:20.372455] [INFO ] [MAIN ] Update Progress: 329/2367 symbols completed. BRC took 19.9s. Estimated remaining: 4h 15m 36s. Rate: 8.0 symbols/min [2025-10-22T17:41:20.462788] [DEBUG] [LOCAL ] BP: Primary data saved (53706 records). [2025-10-22T17:41:20.482407] [INFO ] [MAIN ] BP: Full history saved. [2025-10-22T17:41:20.485021] [INFO ] [MAIN ] Update Progress: 330/2367 symbols completed. BP took 51.5s. Estimated remaining: 4h 14m 43s. Rate: 8.0 symbols/min [2025-10-22T17:41:20.671346] [INFO ] [MAIN ] BRCE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:20.694144] [DEBUG] [LOCAL ] BRCE: No existing data file found in primary storage. [2025-10-22T17:41:20.703019] [WARN ] [MAIN ] BRCE: No existing data found, performing full refresh instead. [2025-10-22T17:41:20.707502] [INFO ] [MAIN ] BRCE: Wiping existing primary data before full refresh. [2025-10-22T17:41:20.729076] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-22T17:41:20.728993] [INFO ] [MAIN ] BRIE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:20.729382] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-22T17:41:20.729480] [INFO ] [MAIN ] BRCE: Starting full primary refresh. [2025-10-22T17:41:20.761458] [DEBUG] [LOCAL ] BRIE: No existing data file found in primary storage. [2025-10-22T17:41:20.799679] [WARN ] [MAIN ] BRIE: No existing data found, performing full refresh instead. [2025-10-22T17:41:20.824261] [INFO ] [MAIN ] BRIE: Wiping existing primary data before full refresh. [2025-10-22T17:41:20.835759] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-22T17:41:20.835891] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-22T17:41:20.835940] [INFO ] [MAIN ] BRIE: Starting full primary refresh. [2025-10-22T17:41:21.431983] [INFO ] [REMOTE ] BRCE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:21.432527] [INFO ] [REMOTE ] BRCE: Fetching primary data for 2025-01. [2025-10-22T17:41:21.515780] [INFO ] [REMOTE ] BRIE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:21.547919] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-22T17:41:21.677180] [DEBUG] [REMOTE ] BRCE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:41:21.677672] [WARN ] [REMOTE ] BRCE: No data returned for month 2025-01 [2025-10-22T17:41:21.677778] [FATAL] [REMOTE ] BRCE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:41:21.677831] [FATAL] [MAIN ] BRCE: Failed to fetch primary data. [2025-10-22T17:41:21.677869] [WARN ] [MAIN ] BRCE: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:41:21.677941] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-22T17:41:21.678016] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-22T17:41:21.678056] [INFO ] [LOCAL ] BRCE: Starting deletion of derivative data. [2025-10-22T17:41:21.678292] [DEBUG] [LOCAL ] BRCE: No derivative data file found to delete. [2025-10-22T17:41:21.678513] [INFO ] [MAIN ] Update Progress: 331/2367 symbols completed. BRCE took 1.3s. Estimated remaining: 4h 13m 56s. Rate: 8.0 symbols/min [2025-10-22T17:41:21.722879] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-22T17:41:21.892710] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:21.921052] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T17:41:21.990944] [DEBUG] [LOCAL ] BRO: Loaded 52096 existing records from primary storage. [2025-10-22T17:41:21.991324] [INFO ] [MAIN ] BRO: Loaded 52096 existing records. [2025-10-22T17:41:22.179173] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:41:22.179404] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-22T17:41:22.179458] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-22T17:41:22.179698] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-22T17:41:22.179756] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-22T17:41:22.528606] [INFO ] [REMOTE ] BRIE: Fetching primary data for 2025-01. [2025-10-22T17:41:22.535402] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:22.747858] [DEBUG] [REMOTE ] BRIE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:41:22.748166] [WARN ] [REMOTE ] BRIE: No data returned for month 2025-01 [2025-10-22T17:41:22.748255] [FATAL] [REMOTE ] BRIE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:41:22.748314] [FATAL] [MAIN ] BRIE: Failed to fetch primary data. [2025-10-22T17:41:22.748387] [WARN ] [MAIN ] BRIE: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:41:22.748461] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-22T17:41:22.748527] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-22T17:41:22.748565] [INFO ] [LOCAL ] BRIE: Starting deletion of derivative data. [2025-10-22T17:41:22.748628] [DEBUG] [LOCAL ] BRIE: No derivative data file found to delete. [2025-10-22T17:41:22.748716] [INFO ] [MAIN ] Update Progress: 332/2367 symbols completed. BRIE took 2.3s. Estimated remaining: 4h 13m 10s. Rate: 8.0 symbols/min [2025-10-22T17:41:22.923467] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:22.972138] [DEBUG] [LOCAL ] BROS: Loaded 53301 existing records from primary storage. [2025-10-22T17:41:22.972458] [INFO ] [MAIN ] BROS: Loaded 53301 existing records. [2025-10-22T17:41:23.155409] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:41:23.155713] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-22T17:41:23.155789] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-22T17:41:23.156167] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-22T17:41:23.156243] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-22T17:41:23.318308] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-22T17:41:23.525359] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:23.560097] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T17:41:24.117714] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-22T17:41:24.917738] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-22T17:41:25.203079] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T17:41:25.717671] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-22T17:41:26.033962] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-22T17:41:26.042847] [INFO ] [REMOTE ] BRBR: Full fetch complete (73224 records). [2025-10-22T17:41:26.042988] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-22T17:41:26.374004] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T17:41:26.474504] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-22T17:41:26.474595] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-22T17:41:26.475434] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-22T17:41:26.475499] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-22T17:41:26.476979] [DEBUG] [LOCAL ] BRBR: Trimmed 73224 records to 51828 (keeping 200 days of data) [2025-10-22T17:41:26.524639] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-22T17:41:26.777662] [DEBUG] [LOCAL ] BRBR: Primary data saved (51828 records). [2025-10-22T17:41:26.777808] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-22T17:41:26.778394] [INFO ] [MAIN ] Update Progress: 333/2367 symbols completed. BRBR took 37.7s. Estimated remaining: 4h 12m 41s. Rate: 8.0 symbols/min [2025-10-22T17:41:26.968385] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:26.968572] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-22T17:41:26.968609] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-22T17:41:26.968740] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-22T17:41:26.968781] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-22T17:41:26.968822] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-22T17:41:26.968853] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-22T17:41:27.317250] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:27.317561] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-10-22T17:41:27.578386] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:41:27.578688] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-10-22T17:41:27.578778] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:41:27.578825] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-22T17:41:27.578885] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:41:27.578956] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-22T17:41:27.579020] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-22T17:41:27.579055] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-22T17:41:27.579097] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-22T17:41:27.579143] [INFO ] [MAIN ] Update Progress: 334/2367 symbols completed. BRSL took 0.8s. Estimated remaining: 4h 11m 53s. Rate: 8.1 symbols/min [2025-10-22T17:41:27.770301] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:27.783540] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-22T17:41:27.826517] [DEBUG] [LOCAL ] BRSP: Loaded 36602 existing records from primary storage. [2025-10-22T17:41:27.826852] [INFO ] [MAIN ] BRSP: Loaded 36602 existing records. [2025-10-22T17:41:28.014741] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:41:28.014967] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-22T17:41:28.015015] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-22T17:41:28.015195] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-22T17:41:28.015233] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-22T17:41:28.120262] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-22T17:41:28.382152] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:28.414012] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T17:41:28.917709] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-22T17:41:29.717729] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-22T17:41:29.934546] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T17:41:30.517772] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-22T17:41:30.914835] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-22T17:41:31.035556] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T17:41:31.317737] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-22T17:41:32.117712] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-22T17:41:32.300319] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T17:41:32.711556] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T17:41:32.917713] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-22T17:41:33.535294] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T17:41:33.717792] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-22T17:41:34.436530] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T17:41:34.517750] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-22T17:41:34.881483] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T17:41:35.317691] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-22T17:41:35.991366] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T17:41:36.117702] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-22T17:41:36.817573] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T17:41:36.917668] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-22T17:41:37.405414] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T17:41:37.717726] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-22T17:41:38.517744] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-22T17:41:39.059084] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-22T17:41:39.317669] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-22T17:41:39.560871] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T17:41:39.667587] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T17:41:39.674380] [INFO ] [REMOTE ] BRCC: Full fetch complete (57339 records). [2025-10-22T17:41:39.674528] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-22T17:41:40.117209] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-22T17:41:40.117307] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-22T17:41:40.118182] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-22T17:41:40.118292] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-22T17:41:40.119567] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-22T17:41:40.121319] [DEBUG] [LOCAL ] BRCC: Trimmed 57339 records to 40024 (keeping 200 days of data) [2025-10-22T17:41:40.358729] [DEBUG] [LOCAL ] BRCC: Primary data saved (40024 records). [2025-10-22T17:41:40.358859] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-22T17:41:40.359530] [INFO ] [MAIN ] Update Progress: 335/2367 symbols completed. BRCC took 34.8s. Estimated remaining: 4h 12m 18s. Rate: 8.1 symbols/min [2025-10-22T17:41:40.556207] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:40.566808] [DEBUG] [LOCAL ] BRT: Loaded 5264 existing records from primary storage. [2025-10-22T17:41:40.567025] [INFO ] [MAIN ] BRT: Loaded 5264 existing records. [2025-10-22T17:41:40.767850] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:41:40.768087] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-22T17:41:40.768134] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-22T17:41:40.768357] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-22T17:41:40.768412] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-22T17:41:40.925842] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-22T17:41:41.142005] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:41.181428] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T17:41:41.717694] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-22T17:41:41.869706] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T17:41:42.516988] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T17:41:42.524207] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-22T17:41:43.317689] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-22T17:41:43.662849] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T17:41:44.008127] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T17:41:44.117704] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-22T17:41:44.750281] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T17:41:44.815015] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T17:41:44.917714] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-22T17:41:45.565761] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T17:41:45.717717] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-22T17:41:46.517733] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-22T17:41:47.220553] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T17:41:47.317717] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-22T17:41:47.912891] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T17:41:48.117714] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-22T17:41:48.228526] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T17:41:48.917718] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-22T17:41:49.392518] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-22T17:41:49.717682] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-22T17:41:49.990948] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T17:41:50.517724] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-22T17:41:51.150012] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-22T17:41:51.149854] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T17:41:51.317713] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-22T17:41:52.117697] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-22T17:41:52.917681] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-22T17:41:52.999241] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:41:53.005724] [INFO ] [REMOTE ] BRSP: Full fetch complete (54058 records). [2025-10-22T17:41:53.005855] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-22T17:41:53.401990] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-22T17:41:53.402069] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-22T17:41:53.402765] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-22T17:41:53.402831] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-22T17:41:53.404175] [DEBUG] [LOCAL ] BRSP: Trimmed 54058 records to 36477 (keeping 200 days of data) [2025-10-22T17:41:53.615984] [DEBUG] [LOCAL ] BRSP: Primary data saved (36477 records). [2025-10-22T17:41:53.616129] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-22T17:41:53.616674] [INFO ] [MAIN ] Update Progress: 336/2367 symbols completed. BRSP took 26.0s. Estimated remaining: 4h 12m 46s. Rate: 8.0 symbols/min [2025-10-22T17:41:53.721684] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-22T17:41:53.804876] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:53.848773] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:41:53.879933] [DEBUG] [LOCAL ] BRW: Loaded 21018 existing records from primary storage. [2025-10-22T17:41:53.880254] [INFO ] [MAIN ] BRW: Loaded 21018 existing records. [2025-10-22T17:41:54.074851] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:41:54.075148] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-22T17:41:54.075210] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-22T17:41:54.075792] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-22T17:41:54.075852] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-22T17:41:54.422501] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T17:41:54.456049] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:54.517719] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-22T17:41:55.120575] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-22T17:41:55.212754] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-22T17:41:55.317704] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-22T17:41:56.117752] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-22T17:41:56.917670] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-22T17:41:56.956103] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T17:41:56.964511] [INFO ] [REMOTE ] BRO: Full fetch complete (75108 records). [2025-10-22T17:41:56.964621] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-22T17:41:57.359125] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-22T17:41:57.359315] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-22T17:41:57.360185] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-22T17:41:57.360274] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-22T17:41:57.361715] [DEBUG] [LOCAL ] BRO: Trimmed 75108 records to 52096 (keeping 200 days of data) [2025-10-22T17:41:57.488707] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T17:41:57.613774] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-22T17:41:57.709921] [DEBUG] [LOCAL ] BRO: Primary data saved (52096 records). [2025-10-22T17:41:57.710060] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-22T17:41:57.710806] [INFO ] [MAIN ] Update Progress: 337/2367 symbols completed. BRO took 36.0s. Estimated remaining: 4h 12m 18s. Rate: 8.0 symbols/min [2025-10-22T17:41:57.722946] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-22T17:41:57.878308] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:41:57.926121] [DEBUG] [LOCAL ] BRX: Loaded 51823 existing records from primary storage. [2025-10-22T17:41:57.926422] [INFO ] [MAIN ] BRX: Loaded 51823 existing records. [2025-10-22T17:41:58.097496] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:41:58.097740] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-22T17:41:58.097791] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-22T17:41:58.098012] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-22T17:41:58.098068] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-22T17:41:58.442136] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:41:58.517607] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-22T17:41:59.317637] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-22T17:41:59.899425] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-22T17:41:59.997766] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T17:42:00.121191] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-22T17:42:00.127217] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T17:42:00.917720] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-22T17:42:01.717734] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-22T17:42:02.517688] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-22T17:42:02.705288] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-10-22T17:42:02.806884] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T17:42:03.317723] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-22T17:42:04.117722] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-22T17:42:04.200898] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T17:42:04.202635] [INFO ] [REMOTE ] BRT: Full fetch complete (7151 records). [2025-10-22T17:42:04.202742] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-22T17:42:04.574925] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-22T17:42:04.575032] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-22T17:42:04.575394] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-22T17:42:04.575580] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-22T17:42:04.576164] [DEBUG] [LOCAL ] BRT: Trimmed 7151 records to 5261 (keeping 200 days of data) [2025-10-22T17:42:04.607939] [DEBUG] [LOCAL ] BRT: Primary data saved (5261 records). [2025-10-22T17:42:04.608009] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-22T17:42:04.608081] [INFO ] [MAIN ] Update Progress: 338/2367 symbols completed. BRT took 24.2s. Estimated remaining: 4h 12m 7s. Rate: 8.0 symbols/min [2025-10-22T17:42:04.780031] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:42:04.807163] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (3.09 seconds). [2025-10-22T17:42:04.842904] [DEBUG] [LOCAL ] BSAC: Loaded 32912 existing records from primary storage. [2025-10-22T17:42:04.843392] [INFO ] [MAIN ] BSAC: Loaded 32912 existing records. [2025-10-22T17:42:04.922763] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-22T17:42:05.024281] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:42:05.024584] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-22T17:42:05.024699] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-22T17:42:05.024949] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-22T17:42:05.025020] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-22T17:42:05.129502] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-22T17:42:05.395488] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:42:05.717734] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-22T17:42:06.248353] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.93 seconds). [2025-10-22T17:42:06.257416] [INFO ] [REMOTE ] BROS: Full fetch complete (77271 records). [2025-10-22T17:42:06.257798] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-22T17:42:06.522849] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-22T17:42:06.657524] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-22T17:42:06.660735] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-22T17:42:06.661808] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-22T17:42:06.661874] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-22T17:42:06.663341] [DEBUG] [LOCAL ] BROS: Trimmed 77271 records to 53301 (keeping 200 days of data) [2025-10-22T17:42:06.887136] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T17:42:06.988229] [DEBUG] [LOCAL ] BROS: Primary data saved (53301 records). [2025-10-22T17:42:06.988366] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-22T17:42:06.988444] [INFO ] [MAIN ] Update Progress: 339/2367 symbols completed. BROS took 44.2s. Estimated remaining: 4h 11m 30s. Rate: 8.1 symbols/min [2025-10-22T17:42:07.150808] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:42:07.181153] [DEBUG] [LOCAL ] BSBR: Loaded 35863 existing records from primary storage. [2025-10-22T17:42:07.181422] [INFO ] [MAIN ] BSBR: Loaded 35863 existing records. [2025-10-22T17:42:07.326738] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-22T17:42:07.356602] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:42:07.356880] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-22T17:42:07.356934] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-22T17:42:07.357136] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-22T17:42:07.357193] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-22T17:42:07.720178] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:42:07.731538] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T17:42:07.788049] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-10-22T17:42:08.117722] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-22T17:42:08.390020] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T17:42:08.917777] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-22T17:42:09.705816] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-22T17:42:09.717608] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-22T17:42:09.891399] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T17:42:10.517701] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-22T17:42:10.748338] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T17:42:11.317692] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-22T17:42:11.674773] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T17:42:12.117719] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-22T17:42:12.917687] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-22T17:42:13.174330] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T17:42:13.465242] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T17:42:13.717679] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-22T17:42:13.772340] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-22T17:42:14.517698] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-22T17:42:15.317717] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-22T17:42:15.396096] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T17:42:15.874767] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-22T17:42:16.117699] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-22T17:42:16.830183] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T17:42:16.917740] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-22T17:42:17.157199] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T17:42:17.717735] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-22T17:42:18.475713] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T17:42:18.517717] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-22T17:42:18.694434] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T17:42:19.317730] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-22T17:42:20.117743] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-22T17:42:20.322315] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T17:42:20.639155] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T17:42:20.917835] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-22T17:42:21.494740] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T17:42:21.717883] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-22T17:42:22.280600] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T17:42:22.517698] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-22T17:42:23.322819] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-22T17:42:23.343156] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T17:42:23.580159] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T17:42:24.117686] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-22T17:42:24.491879] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T17:42:24.496634] [INFO ] [REMOTE ] BRW: Full fetch complete (30010 records). [2025-10-22T17:42:24.496796] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-22T17:42:24.497477] [FATAL] [VALIDATOR ] BRW: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:42:24.497566] [FATAL] [MAIN ] BRW: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:42:24.497612] [WARN ] [MAIN ] BRW: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:42:24.497755] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-22T17:42:24.497829] [DEBUG] [LOCAL ] BRW: No primary data file found to delete. [2025-10-22T17:42:24.497867] [INFO ] [LOCAL ] BRW: Starting deletion of derivative data. [2025-10-22T17:42:24.498252] [DEBUG] [LOCAL ] BRW: Deleted derivative data file. [2025-10-22T17:42:24.498553] [INFO ] [MAIN ] Update Progress: 340/2367 symbols completed. BRW took 30.9s. Estimated remaining: 4h 12m 22s. Rate: 8.0 symbols/min [2025-10-22T17:42:24.668586] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:42:24.679108] [DEBUG] [LOCAL ] BSL: Loaded 8084 existing records from primary storage. [2025-10-22T17:42:24.679341] [INFO ] [MAIN ] BSL: Loaded 8084 existing records. [2025-10-22T17:42:24.862981] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:42:24.863205] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-22T17:42:24.863257] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-22T17:42:24.863419] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-22T17:42:24.863476] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-22T17:42:24.922867] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-22T17:42:25.238469] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:42:25.564330] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T17:42:25.717718] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-22T17:42:26.420859] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T17:42:26.517669] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-22T17:42:27.085182] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T17:42:27.317732] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-22T17:42:27.975101] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-22T17:42:27.998856] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T17:42:28.117722] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-22T17:42:28.917735] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-22T17:42:29.426141] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T17:42:29.717724] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-22T17:42:30.296738] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T17:42:30.446133] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T17:42:30.517779] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-22T17:42:31.302771] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-22T17:42:31.317602] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-22T17:42:32.117683] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-22T17:42:32.209922] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T17:42:32.917740] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-22T17:42:33.479425] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T17:42:33.717690] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-22T17:42:34.318509] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T17:42:34.517723] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-22T17:42:35.037784] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T17:42:35.047933] [INFO ] [REMOTE ] BRX: Full fetch complete (75150 records). [2025-10-22T17:42:35.048184] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-22T17:42:35.321493] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-22T17:42:35.310131] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-22T17:42:35.477094] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-22T17:42:35.477177] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-22T17:42:35.478017] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-22T17:42:35.478080] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-22T17:42:35.479444] [DEBUG] [LOCAL ] BRX: Trimmed 75150 records to 51818 (keeping 200 days of data) [2025-10-22T17:42:35.789952] [DEBUG] [LOCAL ] BRX: Primary data saved (51818 records). [2025-10-22T17:42:35.790095] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-22T17:42:35.790920] [INFO ] [MAIN ] Update Progress: 341/2367 symbols completed. BRX took 38.1s. Estimated remaining: 4h 12m 37s. Rate: 8.0 symbols/min [2025-10-22T17:42:35.961981] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:42:35.994788] [DEBUG] [LOCAL ] BSM: Loaded 32421 existing records from primary storage. [2025-10-22T17:42:35.995046] [INFO ] [MAIN ] BSM: Loaded 32421 existing records. [2025-10-22T17:42:36.129874] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-22T17:42:36.173418] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:42:36.173739] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-22T17:42:36.173790] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-22T17:42:36.173975] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-22T17:42:36.174029] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-22T17:42:36.538484] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:42:36.917723] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-22T17:42:37.025593] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T17:42:37.031849] [INFO ] [REMOTE ] BSBR: Full fetch complete (51142 records). [2025-10-22T17:42:37.031970] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-22T17:42:37.413443] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-22T17:42:37.413673] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-22T17:42:37.414372] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-22T17:42:37.414447] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-22T17:42:37.415624] [DEBUG] [LOCAL ] BSBR: Trimmed 51142 records to 35877 (keeping 200 days of data) [2025-10-22T17:42:37.543042] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T17:42:37.642756] [DEBUG] [LOCAL ] BSBR: Primary data saved (35877 records). [2025-10-22T17:42:37.642904] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-22T17:42:37.642991] [INFO ] [MAIN ] Update Progress: 342/2367 symbols completed. BSBR took 30.7s. Estimated remaining: 4h 11m 57s. Rate: 8.0 symbols/min [2025-10-22T17:42:37.728130] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-22T17:42:37.752074] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-22T17:42:37.854178] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:42:37.872476] [DEBUG] [LOCAL ] BST: Loaded 18592 existing records from primary storage. [2025-10-22T17:42:37.872929] [INFO ] [MAIN ] BST: Loaded 18592 existing records. [2025-10-22T17:42:38.049229] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:42:38.049447] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-22T17:42:38.049494] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-22T17:42:38.049694] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-22T17:42:38.049750] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-22T17:42:38.395235] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:42:38.517680] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-22T17:42:39.098427] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-22T17:42:39.104012] [INFO ] [REMOTE ] BSAC: Full fetch complete (44988 records). [2025-10-22T17:42:39.104185] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-22T17:42:39.104870] [FATAL] [VALIDATOR ] BSAC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:42:39.104961] [FATAL] [MAIN ] BSAC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:42:39.105003] [WARN ] [MAIN ] BSAC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:42:39.105043] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-22T17:42:39.105100] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-10-22T17:42:39.105136] [INFO ] [LOCAL ] BSAC: Starting deletion of derivative data. [2025-10-22T17:42:39.105265] [DEBUG] [LOCAL ] BSAC: Deleted derivative data file. [2025-10-22T17:42:39.105336] [INFO ] [MAIN ] Update Progress: 343/2367 symbols completed. BSAC took 34.5s. Estimated remaining: 4h 11m 14s. Rate: 8.1 symbols/min [2025-10-22T17:42:39.275258] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:42:39.299259] [DEBUG] [LOCAL ] BSTZ: Loaded 24579 existing records from primary storage. [2025-10-22T17:42:39.299519] [INFO ] [MAIN ] BSTZ: Loaded 24579 existing records. [2025-10-22T17:42:39.329995] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-22T17:42:39.485521] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:42:39.485790] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-22T17:42:39.485853] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-22T17:42:39.486076] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-22T17:42:39.486132] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-22T17:42:39.853323] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:42:39.872368] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T17:42:40.117706] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-22T17:42:40.508804] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T17:42:40.917788] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-22T17:42:41.364506] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T17:42:41.717759] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-22T17:42:42.321850] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T17:42:42.517690] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-22T17:42:42.893579] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T17:42:43.317752] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-22T17:42:43.813155] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T17:42:44.117680] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-22T17:42:44.263257] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-22T17:42:44.917734] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-22T17:42:45.519466] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T17:42:45.717671] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-22T17:42:46.039509] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T17:42:46.517713] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-22T17:42:46.779616] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T17:42:47.317713] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-22T17:42:47.666047] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T17:42:48.117680] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-22T17:42:48.174005] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T17:42:48.917718] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-22T17:42:49.219892] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T17:42:49.717741] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-22T17:42:50.130252] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T17:42:50.504237] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-22T17:42:50.517605] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-22T17:42:51.263528] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-22T17:42:51.317615] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-22T17:42:52.117719] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-22T17:42:52.212384] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-22T17:42:52.214548] [INFO ] [REMOTE ] BSL: Full fetch complete (12978 records). [2025-10-22T17:42:52.214616] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-22T17:42:52.575811] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-22T17:42:52.575897] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-22T17:42:52.576223] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-22T17:42:52.576263] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-22T17:42:52.576724] [DEBUG] [LOCAL ] BSL: Trimmed 12978 records to 7898 (keeping 200 days of data) [2025-10-22T17:42:52.623454] [DEBUG] [LOCAL ] BSL: Primary data saved (7898 records). [2025-10-22T17:42:52.623581] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-22T17:42:52.623677] [INFO ] [MAIN ] Update Progress: 344/2367 symbols completed. BSL took 28.1s. Estimated remaining: 4h 11m 42s. Rate: 8.0 symbols/min [2025-10-22T17:42:52.789696] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:42:52.841307] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-22T17:42:52.841614] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-10-22T17:42:52.922750] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-22T17:42:53.028339] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:42:53.028545] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-22T17:42:53.028601] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-22T17:42:53.028813] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-22T17:42:53.028868] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-22T17:42:53.397573] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:42:53.408766] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-22T17:42:53.717678] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-22T17:42:54.455195] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T17:42:54.517684] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-22T17:42:54.926838] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T17:42:55.157530] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T17:42:55.317705] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-22T17:42:56.117722] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-22T17:42:56.917773] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-22T17:42:57.352270] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-22T17:42:57.453313] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-22T17:42:57.717714] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-22T17:42:58.042679] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T17:42:58.517706] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-22T17:42:58.995530] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T17:42:59.001049] [INFO ] [REMOTE ] BSM: Full fetch complete (46877 records). [2025-10-22T17:42:59.001220] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-22T17:42:59.322921] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-22T17:42:59.371384] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-22T17:42:59.371467] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-22T17:42:59.372101] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-22T17:42:59.372164] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-22T17:42:59.373112] [DEBUG] [LOCAL ] BSM: Trimmed 46877 records to 32282 (keeping 200 days of data) [2025-10-22T17:42:59.564077] [DEBUG] [LOCAL ] BSM: Primary data saved (32282 records). [2025-10-22T17:42:59.564206] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-22T17:42:59.564282] [INFO ] [MAIN ] Update Progress: 345/2367 symbols completed. BSM took 23.8s. Estimated remaining: 4h 11m 31s. Rate: 8.0 symbols/min [2025-10-22T17:42:59.733714] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:42:59.741446] [DEBUG] [LOCAL ] BTA: Loaded 5770 existing records from primary storage. [2025-10-22T17:42:59.741627] [INFO ] [MAIN ] BTA: Loaded 5770 existing records. [2025-10-22T17:42:59.916857] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:42:59.917183] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-22T17:42:59.917350] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-22T17:42:59.917544] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-22T17:42:59.917730] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-22T17:43:00.124543] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-22T17:43:00.287214] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:00.315536] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T17:43:00.667583] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-22T17:43:00.917700] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-22T17:43:01.246949] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T17:43:01.717742] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-22T17:43:01.904556] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T17:43:02.517734] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-22T17:43:03.317721] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-22T17:43:03.646208] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T17:43:03.653388] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T17:43:04.117756] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-22T17:43:04.532614] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T17:43:04.917715] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-22T17:43:05.019183] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T17:43:05.717746] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-22T17:43:06.517692] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-22T17:43:06.758395] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T17:43:06.950059] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-22T17:43:07.317758] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-22T17:43:07.941804] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-22T17:43:07.948689] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36427 records). [2025-10-22T17:43:07.948879] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-22T17:43:08.119435] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-22T17:43:08.350026] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-22T17:43:08.350199] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-22T17:43:08.350865] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-22T17:43:08.350949] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-22T17:43:08.363042] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T17:43:08.367350] [DEBUG] [LOCAL ] BSTZ: Trimmed 36427 records to 24418 (keeping 200 days of data) [2025-10-22T17:43:08.514707] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24418 records). [2025-10-22T17:43:08.514845] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-22T17:43:08.514925] [INFO ] [MAIN ] Update Progress: 346/2367 symbols completed. BSTZ took 29.4s. Estimated remaining: 4h 11m 33s. Rate: 8.0 symbols/min [2025-10-22T17:43:08.685611] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:43:08.685813] [DEBUG] [LOCAL ] BTE: No existing data file found in primary storage. [2025-10-22T17:43:08.685858] [WARN ] [MAIN ] BTE: No existing data found, performing full refresh instead. [2025-10-22T17:43:08.685972] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-22T17:43:08.686084] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-22T17:43:08.686145] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-10-22T17:43:08.686181] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-22T17:43:08.869986] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-22T17:43:08.921338] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-22T17:43:09.087409] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:09.717720] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-22T17:43:10.109845] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-22T17:43:10.517774] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-22T17:43:11.317717] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-22T17:43:11.681786] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-22T17:43:11.685000] [INFO ] [REMOTE ] BST: Full fetch complete (28298 records). [2025-10-22T17:43:11.685079] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-22T17:43:12.025822] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-22T17:43:12.123965] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-22T17:43:12.126932] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-22T17:43:12.127012] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-22T17:43:12.127474] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-22T17:43:12.127516] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-22T17:43:12.128346] [DEBUG] [LOCAL ] BST: Trimmed 28298 records to 18388 (keeping 200 days of data) [2025-10-22T17:43:12.242697] [DEBUG] [LOCAL ] BST: Primary data saved (18388 records). [2025-10-22T17:43:12.242845] [INFO ] [MAIN ] BST: Full history saved. [2025-10-22T17:43:12.242922] [INFO ] [MAIN ] Update Progress: 347/2367 symbols completed. BST took 34.6s. Estimated remaining: 4h 11m 3s. Rate: 8.0 symbols/min [2025-10-22T17:43:12.425036] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:43:12.425246] [DEBUG] [LOCAL ] BTI: No existing data file found in primary storage. [2025-10-22T17:43:12.425294] [WARN ] [MAIN ] BTI: No existing data found, performing full refresh instead. [2025-10-22T17:43:12.425414] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-22T17:43:12.425457] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-22T17:43:12.425498] [DEBUG] [LOCAL ] BTI: No primary data file found to delete. [2025-10-22T17:43:12.425530] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-22T17:43:12.859105] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:12.917703] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-22T17:43:13.101967] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T17:43:13.717681] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-22T17:43:14.063437] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T17:43:14.225873] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-22T17:43:14.478554] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T17:43:14.517612] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-22T17:43:15.317677] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-22T17:43:15.993078] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-22T17:43:16.117689] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-22T17:43:16.282445] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T17:43:16.693440] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-22T17:43:16.917685] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-22T17:43:17.717734] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-22T17:43:18.517758] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-22T17:43:18.778491] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T17:43:19.317740] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-22T17:43:19.747122] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-22T17:43:19.788970] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-22T17:43:19.929442] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T17:43:20.117749] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-22T17:43:20.917733] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-22T17:43:21.717719] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-22T17:43:22.231669] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-22T17:43:22.299684] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T17:43:22.373471] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-22T17:43:22.517735] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-22T17:43:23.317722] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-22T17:43:23.860278] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-22T17:43:24.117613] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-22T17:43:24.450345] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T17:43:24.917674] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-22T17:43:24.949053] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-22T17:43:24.950706] [INFO ] [REMOTE ] BTA: Full fetch complete (9297 records). [2025-10-22T17:43:24.950777] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-22T17:43:25.310143] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-22T17:43:25.310217] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-22T17:43:25.310435] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-22T17:43:25.310473] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-22T17:43:25.310887] [DEBUG] [LOCAL ] BTA: Trimmed 9297 records to 5760 (keeping 200 days of data) [2025-10-22T17:43:25.343786] [DEBUG] [LOCAL ] BTA: Primary data saved (5760 records). [2025-10-22T17:43:25.343881] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-22T17:43:25.343953] [INFO ] [MAIN ] Update Progress: 348/2367 symbols completed. BTA took 25.8s. Estimated remaining: 4h 11m 29s. Rate: 8.0 symbols/min [2025-10-22T17:43:25.507930] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:43:25.516587] [DEBUG] [LOCAL ] BTO: Loaded 8841 existing records from primary storage. [2025-10-22T17:43:25.516837] [INFO ] [MAIN ] BTO: Loaded 8841 existing records. [2025-10-22T17:43:25.692844] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:43:25.693079] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-22T17:43:25.693132] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-22T17:43:25.693301] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-22T17:43:25.693354] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-22T17:43:25.722987] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-22T17:43:26.039499] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:26.517674] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-22T17:43:26.872551] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T17:43:27.317709] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-22T17:43:27.805197] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-22T17:43:28.043420] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-22T17:43:28.117715] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-22T17:43:28.166212] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-22T17:43:28.917765] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-22T17:43:29.434102] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-22T17:43:29.717721] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-22T17:43:30.517692] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-22T17:43:30.621194] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-22T17:43:30.630599] [INFO ] [REMOTE ] BSX: Full fetch complete (77865 records). [2025-10-22T17:43:30.630765] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-22T17:43:31.020726] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-22T17:43:31.020804] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-22T17:43:31.021723] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-22T17:43:31.021818] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-22T17:43:31.023358] [DEBUG] [LOCAL ] BSX: Trimmed 77865 records to 53688 (keeping 200 days of data) [2025-10-22T17:43:31.318418] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-22T17:43:31.343097] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-10-22T17:43:31.343197] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-22T17:43:31.343868] [INFO ] [MAIN ] Update Progress: 349/2367 symbols completed. BSX took 38.7s. Estimated remaining: 4h 11m 13s. Rate: 8.0 symbols/min [2025-10-22T17:43:31.514445] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:43:31.530847] [DEBUG] [LOCAL ] BTT: Loaded 15421 existing records from primary storage. [2025-10-22T17:43:31.531077] [INFO ] [MAIN ] BTT: Loaded 15421 existing records. [2025-10-22T17:43:31.714996] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:43:31.715187] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-22T17:43:31.715301] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-22T17:43:31.715569] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-22T17:43:31.715694] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-22T17:43:31.879662] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-22T17:43:32.130954] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-22T17:43:32.136715] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:32.189030] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-22T17:43:32.202200] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-22T17:43:32.917721] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-22T17:43:33.717703] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-22T17:43:34.146332] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T17:43:34.403306] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-22T17:43:34.517730] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-22T17:43:34.596391] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T17:43:35.273568] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T17:43:35.317738] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-22T17:43:36.117673] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-22T17:43:36.252554] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-22T17:43:36.917725] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-22T17:43:37.717694] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-22T17:43:37.871446] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-22T17:43:37.912528] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T17:43:38.517721] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-22T17:43:38.655964] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T17:43:39.317754] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-22T17:43:40.089408] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-22T17:43:40.117699] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-22T17:43:40.186944] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T17:43:40.917748] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-22T17:43:41.057972] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T17:43:41.717790] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-22T17:43:42.320937] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T17:43:42.517729] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-22T17:43:43.125518] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-22T17:43:43.314107] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T17:43:43.317684] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-22T17:43:44.067136] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T17:43:44.069829] [INFO ] [REMOTE ] BTO: Full fetch complete (13258 records). [2025-10-22T17:43:44.069924] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-22T17:43:44.122971] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-22T17:43:44.471552] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-22T17:43:44.471701] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-22T17:43:44.472291] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-22T17:43:44.472355] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-22T17:43:44.473100] [DEBUG] [LOCAL ] BTO: Trimmed 13258 records to 8703 (keeping 200 days of data) [2025-10-22T17:43:44.533762] [DEBUG] [LOCAL ] BTO: Primary data saved (8703 records). [2025-10-22T17:43:44.533959] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-22T17:43:44.534082] [INFO ] [MAIN ] Update Progress: 350/2367 symbols completed. BTO took 19.2s. Estimated remaining: 4h 11m 38s. Rate: 8.0 symbols/min [2025-10-22T17:43:44.718471] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:43:44.777285] [DEBUG] [LOCAL ] BTU: Loaded 53337 existing records from primary storage. [2025-10-22T17:43:44.777768] [INFO ] [MAIN ] BTU: Loaded 53337 existing records. [2025-10-22T17:43:44.924143] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-22T17:43:44.969105] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:43:44.969509] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-22T17:43:44.969612] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-22T17:43:44.970150] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-22T17:43:44.970211] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-22T17:43:45.332206] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:45.717760] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-22T17:43:45.896046] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T17:43:46.065874] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T17:43:46.517745] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-22T17:43:47.317746] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-22T17:43:47.484969] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T17:43:48.111272] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T17:43:48.121893] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-22T17:43:48.923403] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-22T17:43:48.944294] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-22T17:43:48.954356] [INFO ] [REMOTE ] BTE: Full fetch complete (76347 records). [2025-10-22T17:43:48.954681] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-22T17:43:49.372587] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-22T17:43:49.372736] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-22T17:43:49.373950] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-22T17:43:49.374021] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-22T17:43:49.376199] [DEBUG] [LOCAL ] BTE: Trimmed 76347 records to 52696 (keeping 200 days of data) [2025-10-22T17:43:49.708193] [DEBUG] [LOCAL ] BTE: Primary data saved (52696 records). [2025-10-22T17:43:49.708414] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-22T17:43:49.708565] [INFO ] [MAIN ] Update Progress: 351/2367 symbols completed. BTE took 41.2s. Estimated remaining: 4h 11m 17s. Rate: 8.0 symbols/min [2025-10-22T17:43:49.722960] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-22T17:43:49.898266] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:43:49.898587] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-22T17:43:49.898637] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-22T17:43:49.898794] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-22T17:43:49.898837] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-22T17:43:49.898880] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-22T17:43:49.898913] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-22T17:43:50.268010] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:50.295550] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-22T17:43:50.305698] [INFO ] [REMOTE ] BTI: Full fetch complete (77651 records). [2025-10-22T17:43:50.305959] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-22T17:43:50.455670] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T17:43:50.524873] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-22T17:43:50.798803] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-22T17:43:50.799482] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-22T17:43:50.801009] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-22T17:43:50.801088] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-22T17:43:50.803219] [DEBUG] [LOCAL ] BTI: Trimmed 77651 records to 53592 (keeping 200 days of data) [2025-10-22T17:43:50.921866] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-22T17:43:51.200119] [DEBUG] [LOCAL ] BTI: Primary data saved (53592 records). [2025-10-22T17:43:51.200331] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-22T17:43:51.200425] [INFO ] [MAIN ] Update Progress: 352/2367 symbols completed. BTI took 39.0s. Estimated remaining: 4h 10m 36s. Rate: 8.0 symbols/min [2025-10-22T17:43:51.322830] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-10-22T17:43:51.374060] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:43:51.397173] [DEBUG] [LOCAL ] BTZ: Loaded 22540 existing records from primary storage. [2025-10-22T17:43:51.397430] [INFO ] [MAIN ] BTZ: Loaded 22540 existing records. [2025-10-22T17:43:51.574785] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:43:51.609307] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:43:51.610106] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-22T17:43:51.609864] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-10-22T17:43:51.610315] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-22T17:43:51.610379] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:43:51.610607] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-22T17:43:51.610764] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:43:51.610845] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-22T17:43:51.610931] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-22T17:43:51.610973] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-22T17:43:51.611014] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-22T17:43:51.611093] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-22T17:43:51.611072] [INFO ] [MAIN ] Update Progress: 353/2367 symbols completed. BTX took 1.9s. Estimated remaining: 4h 9m 48s. Rate: 8.1 symbols/min [2025-10-22T17:43:51.611262] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-22T17:43:52.006768] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:43:52.135805] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-22T17:43:52.159454] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:52.209087] [DEBUG] [LOCAL ] BUD: Loaded 52604 existing records from primary storage. [2025-10-22T17:43:52.209579] [INFO ] [MAIN ] BUD: Loaded 52604 existing records. [2025-10-22T17:43:52.403413] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:43:52.403860] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-22T17:43:52.403937] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-22T17:43:52.404381] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-22T17:43:52.404500] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-22T17:43:52.620977] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-22T17:43:52.846542] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:43:52.917748] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-22T17:43:53.100786] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T17:43:53.717718] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-22T17:43:54.196804] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T17:43:54.517702] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-22T17:43:55.320611] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-22T17:43:55.515046] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T17:43:55.567921] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T17:43:56.117697] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-22T17:43:56.917682] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-22T17:43:57.068902] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T17:43:57.300814] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T17:43:57.717714] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-22T17:43:58.517682] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-22T17:43:58.724628] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T17:43:58.872209] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T17:43:59.248791] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-22T17:43:59.317675] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-22T17:44:00.117720] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-22T17:44:00.223957] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-22T17:44:00.917716] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-22T17:44:01.717712] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-22T17:44:01.764610] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-22T17:44:01.767259] [INFO ] [REMOTE ] BTT: Full fetch complete (22497 records). [2025-10-22T17:44:01.767341] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-22T17:44:02.177499] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-22T17:44:02.177576] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-22T17:44:02.178021] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-22T17:44:02.178082] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-22T17:44:02.178727] [DEBUG] [LOCAL ] BTT: Trimmed 22497 records to 15359 (keeping 200 days of data) [2025-10-22T17:44:02.279548] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-22T17:44:02.312901] [DEBUG] [LOCAL ] BTT: Primary data saved (15359 records). [2025-10-22T17:44:02.313013] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-22T17:44:02.313090] [INFO ] [MAIN ] Update Progress: 354/2367 symbols completed. BTT took 31.0s. Estimated remaining: 4h 9m 59s. Rate: 8.1 symbols/min [2025-10-22T17:44:02.484297] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:44:02.497193] [DEBUG] [LOCAL ] BUI: Loaded 11926 existing records from primary storage. [2025-10-22T17:44:02.497406] [INFO ] [MAIN ] BUI: Loaded 11926 existing records. [2025-10-22T17:44:02.529119] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-22T17:44:02.690519] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:44:02.690995] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-22T17:44:02.691126] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-22T17:44:02.696919] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-22T17:44:02.706919] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-22T17:44:02.708072] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T17:44:03.069840] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:44:03.317688] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-22T17:44:04.117694] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-22T17:44:04.539754] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-22T17:44:04.917742] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-22T17:44:05.058270] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T17:44:05.188976] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T17:44:05.717709] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-22T17:44:06.517693] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-22T17:44:06.629630] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T17:44:07.317742] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-22T17:44:07.399302] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T17:44:07.491213] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-22T17:44:08.117735] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-22T17:44:08.917734] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-22T17:44:08.981162] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T17:44:09.717699] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-22T17:44:09.752464] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T17:44:09.882595] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T17:44:10.517702] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-22T17:44:11.299517] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T17:44:11.317613] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-22T17:44:11.496311] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T17:44:12.118450] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-22T17:44:12.120497] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-22T17:44:12.917685] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-22T17:44:13.283752] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T17:44:13.717699] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-22T17:44:14.517693] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-22T17:44:14.702554] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T17:44:14.736075] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T17:44:15.317694] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-22T17:44:15.369394] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T17:44:16.117700] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-22T17:44:16.316111] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T17:44:16.917711] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-22T17:44:17.694299] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T17:44:17.717613] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-22T17:44:18.517755] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-22T17:44:18.956443] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T17:44:18.966755] [INFO ] [REMOTE ] BTU: Full fetch complete (77302 records). [2025-10-22T17:44:18.967035] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-22T17:44:19.137764] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T17:44:19.323821] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-22T17:44:19.438137] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-22T17:44:19.438244] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-22T17:44:19.439808] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-22T17:44:19.439889] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-22T17:44:19.441777] [DEBUG] [LOCAL ] BTU: Trimmed 77302 records to 53337 (keeping 200 days of data) [2025-10-22T17:44:19.609767] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T17:44:19.880585] [DEBUG] [LOCAL ] BTU: Primary data saved (53337 records). [2025-10-22T17:44:19.880846] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-22T17:44:19.880986] [INFO ] [MAIN ] Update Progress: 355/2367 symbols completed. BTU took 35.3s. Estimated remaining: 4h 10m 49s. Rate: 8.0 symbols/min [2025-10-22T17:44:20.064121] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:44:20.113615] [DEBUG] [LOCAL ] BUR: Loaded 45478 existing records from primary storage. [2025-10-22T17:44:20.114174] [INFO ] [MAIN ] BUR: Loaded 45478 existing records. [2025-10-22T17:44:20.126243] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-22T17:44:20.303682] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:44:20.303893] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-22T17:44:20.303940] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-22T17:44:20.304138] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-22T17:44:20.304176] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-22T17:44:20.695451] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:44:20.709176] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T17:44:20.714028] [INFO ] [REMOTE ] BTZ: Full fetch complete (33309 records). [2025-10-22T17:44:20.714157] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-22T17:44:20.919177] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-22T17:44:21.150223] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-22T17:44:21.150376] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-22T17:44:21.159264] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-22T17:44:21.160338] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T17:44:21.159990] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-22T17:44:21.164680] [DEBUG] [LOCAL ] BTZ: Trimmed 33309 records to 22396 (keeping 200 days of data) [2025-10-22T17:44:21.317227] [DEBUG] [LOCAL ] BTZ: Primary data saved (22396 records). [2025-10-22T17:44:21.317364] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-22T17:44:21.317443] [INFO ] [MAIN ] Update Progress: 356/2367 symbols completed. BTZ took 30.1s. Estimated remaining: 4h 10m 7s. Rate: 8.0 symbols/min [2025-10-22T17:44:21.491540] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:44:21.533373] [DEBUG] [LOCAL ] BURL: Loaded 45509 existing records from primary storage. [2025-10-22T17:44:21.533719] [INFO ] [MAIN ] BURL: Loaded 45509 existing records. [2025-10-22T17:44:21.712229] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:44:21.712437] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-22T17:44:21.712484] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-22T17:44:21.712765] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-22T17:44:21.712822] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-22T17:44:21.723971] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-22T17:44:22.072032] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:44:22.517711] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-22T17:44:22.806162] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T17:44:23.317683] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-22T17:44:23.374080] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T17:44:23.402835] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-22T17:44:24.117730] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-22T17:44:24.917731] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-22T17:44:25.275787] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T17:44:25.284989] [INFO ] [REMOTE ] BUD: Full fetch complete (76485 records). [2025-10-22T17:44:25.285169] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-22T17:44:25.702884] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-22T17:44:25.702989] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-22T17:44:25.703912] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-22T17:44:25.704036] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-22T17:44:25.705435] [DEBUG] [LOCAL ] BUD: Trimmed 76485 records to 52597 (keeping 200 days of data) [2025-10-22T17:44:25.755770] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-22T17:44:25.934491] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T17:44:26.046095] [DEBUG] [LOCAL ] BUD: Primary data saved (52597 records). [2025-10-22T17:44:26.046244] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-22T17:44:26.047018] [INFO ] [MAIN ] Update Progress: 357/2367 symbols completed. BUD took 34.4s. Estimated remaining: 4h 9m 44s. Rate: 8.0 symbols/min [2025-10-22T17:44:26.439762] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T17:44:26.455608] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-22T17:44:26.517613] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-22T17:44:27.317676] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-22T17:44:27.407298] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T17:44:28.117719] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-22T17:44:28.917713] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-22T17:44:28.951296] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T17:44:28.973424] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-22T17:44:28.975898] [INFO ] [REMOTE ] BUI: Full fetch complete (16555 records). [2025-10-22T17:44:28.975967] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-22T17:44:29.343571] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-22T17:44:29.343677] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-22T17:44:29.344081] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-22T17:44:29.344124] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-22T17:44:29.344626] [DEBUG] [LOCAL ] BUI: Trimmed 16555 records to 11824 (keeping 200 days of data) [2025-10-22T17:44:29.414621] [DEBUG] [LOCAL ] BUI: Primary data saved (11824 records). [2025-10-22T17:44:29.414782] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-22T17:44:29.414862] [INFO ] [MAIN ] Update Progress: 358/2367 symbols completed. BUI took 27.1s. Estimated remaining: 4h 9m 14s. Rate: 8.1 symbols/min [2025-10-22T17:44:29.717759] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-22T17:44:30.570104] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T17:44:30.579804] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-22T17:44:30.982135] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T17:44:31.317751] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-22T17:44:32.041977] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T17:44:32.117707] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-22T17:44:32.962891] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T17:44:32.973161] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-22T17:44:33.947187] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T17:44:33.958884] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-22T17:44:34.865170] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-22T17:44:34.874480] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-22T17:44:35.419899] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T17:44:35.430587] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-22T17:44:36.291930] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T17:44:36.302242] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-22T17:44:37.198493] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T17:44:37.207716] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-22T17:44:38.550351] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-22T17:44:38.563788] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-22T17:44:38.841763] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T17:44:38.851602] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-22T17:44:39.996566] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T17:44:40.006105] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-22T17:44:40.622499] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T17:44:40.635230] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-22T17:44:41.554075] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-22T17:44:41.561771] [INFO ] [REMOTE ] BUR: Full fetch complete (64544 records). [2025-10-22T17:44:41.561883] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-22T17:44:41.944559] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-22T17:44:41.944762] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-22T17:44:41.945479] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-22T17:44:41.945520] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-22T17:44:41.946802] [DEBUG] [LOCAL ] BUR: Trimmed 64544 records to 45446 (keeping 200 days of data) [2025-10-22T17:44:42.213037] [DEBUG] [LOCAL ] BUR: Primary data saved (45446 records). [2025-10-22T17:44:42.213372] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-22T17:44:42.213473] [INFO ] [MAIN ] Update Progress: 359/2367 symbols completed. BUR took 22.3s. Estimated remaining: 4h 9m 37s. Rate: 8.0 symbols/min [2025-10-22T17:44:42.239030] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T17:44:42.249850] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-22T17:44:43.905572] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T17:44:43.912631] [INFO ] [REMOTE ] BURL: Full fetch complete (65791 records). [2025-10-22T17:44:43.912760] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-22T17:44:44.291203] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-22T17:44:44.291288] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-22T17:44:44.292039] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-22T17:44:44.292103] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-22T17:44:44.293395] [DEBUG] [LOCAL ] BURL: Trimmed 65791 records to 45416 (keeping 200 days of data) [2025-10-22T17:44:44.571759] [DEBUG] [LOCAL ] BURL: Primary data saved (45416 records). [2025-10-22T17:44:44.571911] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-22T17:44:44.571996] [INFO ] [MAIN ] Update Progress: 360/2367 symbols completed. BURL took 23.3s. Estimated remaining: 4h 9m 1s. Rate: 8.1 symbols/min [2025-10-22T17:44:45.267274] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:44:45.228612] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:44:45.264227] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:44:45.287708] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:44:45.288094] [DEBUG] [LOCAL ] BVN: No existing data file found in primary storage. [2025-10-22T17:44:45.288595] [WARN ] [MAIN ] BVN: No existing data found, performing full refresh instead. [2025-10-22T17:44:45.288842] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-22T17:44:45.288907] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-22T17:44:45.288964] [DEBUG] [LOCAL ] BVN: No primary data file found to delete. [2025-10-22T17:44:45.289006] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-22T17:44:45.409032] [DEBUG] [LOCAL ] BUXX: Loaded 15430 existing records from primary storage. [2025-10-22T17:44:45.440930] [INFO ] [MAIN ] BUXX: Loaded 15430 existing records. [2025-10-22T17:44:45.636594] [DEBUG] [LOCAL ] BW: Loaded 40403 existing records from primary storage. [2025-10-22T17:44:45.685720] [INFO ] [MAIN ] BW: Loaded 40403 existing records. [2025-10-22T17:44:45.714358] [DEBUG] [LOCAL ] BV: Loaded 38499 existing records from primary storage. [2025-10-22T17:44:45.779443] [INFO ] [MAIN ] BV: Loaded 38499 existing records. [2025-10-22T17:44:45.901030] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:44:46.091968] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-22T17:44:46.144321] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-22T17:44:46.217143] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:44:46.261050] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:44:46.234560] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-22T17:44:46.261405] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-22T17:44:46.280246] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-22T17:44:46.281282] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-22T17:44:46.281411] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-22T17:44:46.286792] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-22T17:44:46.298553] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-22T17:44:46.420911] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:44:46.447345] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-22T17:44:46.460265] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-22T17:44:46.545159] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-22T17:44:46.571898] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-22T17:44:47.266919] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:44:47.284276] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-22T17:44:47.367309] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:44:47.384847] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-22T17:44:47.475639] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:44:47.476005] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-22T17:44:47.957682] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T17:44:47.966047] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-22T17:44:48.230616] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-22T17:44:48.233515] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-22T17:44:48.426134] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-22T17:44:48.432195] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-22T17:44:48.818747] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-22T17:44:48.821715] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-22T17:44:49.245264] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T17:44:49.255399] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-22T17:44:49.285015] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-22T17:44:49.293518] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-22T17:44:49.670715] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-22T17:44:49.717616] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-22T17:44:49.794803] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T17:44:50.515067] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-22T17:44:50.520183] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-22T17:44:50.548674] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-22T17:44:50.756054] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T17:44:51.317714] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-22T17:44:52.117731] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-22T17:44:52.264748] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T17:44:52.732061] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T17:44:52.917723] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-22T17:44:53.531399] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T17:44:53.717724] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-22T17:44:53.892730] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T17:44:54.517705] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-22T17:44:55.237544] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T17:44:55.317665] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-22T17:44:55.343283] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-22T17:44:56.117717] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-22T17:44:56.922726] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-22T17:44:56.934372] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T17:44:57.405144] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-22T17:44:57.717660] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-22T17:44:57.927335] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T17:44:58.517712] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-22T17:44:59.317718] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-22T17:44:59.364577] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T17:45:00.075169] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T17:45:00.117674] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-22T17:45:00.805440] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T17:45:00.917709] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-22T17:45:01.625024] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T17:45:01.717702] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-22T17:45:02.517737] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-22T17:45:02.567559] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T17:45:03.317764] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-22T17:45:03.445860] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-22T17:45:03.758459] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-22T17:45:04.117719] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-22T17:45:04.709153] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-22T17:45:04.917774] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-22T17:45:05.474141] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T17:45:05.717745] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-22T17:45:06.517727] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-22T17:45:06.575147] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T17:45:07.144924] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T17:45:07.195291] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T17:45:07.317715] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-22T17:45:08.117721] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-22T17:45:08.680040] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T17:45:08.686202] [INFO ] [REMOTE ] BV: Full fetch complete (54688 records). [2025-10-22T17:45:08.686344] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-22T17:45:08.686970] [FATAL] [VALIDATOR ] BV: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:45:08.687056] [FATAL] [MAIN ] BV: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:45:08.687099] [WARN ] [MAIN ] BV: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:45:08.687163] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-22T17:45:08.687243] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-22T17:45:08.687281] [INFO ] [LOCAL ] BV: Starting deletion of derivative data. [2025-10-22T17:45:08.687442] [DEBUG] [LOCAL ] BV: Deleted derivative data file. [2025-10-22T17:45:08.687532] [INFO ] [MAIN ] Update Progress: 361/2367 symbols completed. BV took 24.1s. Estimated remaining: 4h 10m 26s. Rate: 8.0 symbols/min [2025-10-22T17:45:08.855853] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:45:08.904958] [DEBUG] [LOCAL ] BWA: Loaded 52084 existing records from primary storage. [2025-10-22T17:45:08.905291] [INFO ] [MAIN ] BWA: Loaded 52084 existing records. [2025-10-22T17:45:08.925696] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-22T17:45:09.092831] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:45:09.093041] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-22T17:45:09.093088] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-22T17:45:09.093304] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-22T17:45:09.093361] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-22T17:45:09.495454] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:45:09.717724] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-22T17:45:09.790938] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T17:45:10.507527] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-22T17:45:10.510424] [INFO ] [REMOTE ] BUXX: Full fetch complete (20744 records). [2025-10-22T17:45:10.510508] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-22T17:45:10.522947] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-22T17:45:10.892539] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T17:45:10.932256] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-22T17:45:10.932965] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-22T17:45:10.933530] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-22T17:45:10.933575] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-22T17:45:10.934220] [DEBUG] [LOCAL ] BUXX: Trimmed 20744 records to 15332 (keeping 200 days of data) [2025-10-22T17:45:11.026247] [DEBUG] [LOCAL ] BUXX: Primary data saved (15332 records). [2025-10-22T17:45:11.026404] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-22T17:45:11.026483] [INFO ] [MAIN ] Update Progress: 362/2367 symbols completed. BUXX took 26.5s. Estimated remaining: 4h 9m 50s. Rate: 8.0 symbols/min [2025-10-22T17:45:11.193355] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:45:11.209738] [DEBUG] [LOCAL ] BWG: Loaded 12632 existing records from primary storage. [2025-10-22T17:45:11.209933] [INFO ] [MAIN ] BWG: Loaded 12632 existing records. [2025-10-22T17:45:11.322859] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-22T17:45:11.383521] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:45:11.383867] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-22T17:45:11.383917] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-22T17:45:11.384066] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-22T17:45:11.384104] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-22T17:45:11.726560] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:45:12.117696] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-22T17:45:12.427088] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-22T17:45:12.917716] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-22T17:45:13.084594] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T17:45:13.480117] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T17:45:13.717699] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-22T17:45:14.495302] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T17:45:14.500511] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T17:45:14.517613] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-22T17:45:15.317726] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-22T17:45:16.117710] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-22T17:45:16.336835] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T17:45:16.876495] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T17:45:16.909282] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T17:45:16.917307] [INFO ] [REMOTE ] BW: Full fetch complete (59048 records). [2025-10-22T17:45:16.917453] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-22T17:45:16.917680] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-22T17:45:16.919197] [FATAL] [VALIDATOR ] BW: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:45:16.919296] [FATAL] [MAIN ] BW: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:45:16.919348] [WARN ] [MAIN ] BW: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:45:16.919388] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-22T17:45:16.919447] [DEBUG] [LOCAL ] BW: No primary data file found to delete. [2025-10-22T17:45:16.919482] [INFO ] [LOCAL ] BW: Starting deletion of derivative data. [2025-10-22T17:45:16.919735] [DEBUG] [LOCAL ] BW: Deleted derivative data file. [2025-10-22T17:45:16.919828] [INFO ] [MAIN ] Update Progress: 363/2367 symbols completed. BW took 32.3s. Estimated remaining: 4h 9m 34s. Rate: 8.0 symbols/min [2025-10-22T17:45:17.097190] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:45:17.097449] [DEBUG] [LOCAL ] BWLP: No existing data file found in primary storage. [2025-10-22T17:45:17.097505] [WARN ] [MAIN ] BWLP: No existing data found, performing full refresh instead. [2025-10-22T17:45:17.097670] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-22T17:45:17.097728] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-22T17:45:17.097772] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-10-22T17:45:17.097805] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-22T17:45:17.452587] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:45:17.717711] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-22T17:45:18.517722] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-22T17:45:18.921882] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T17:45:19.232885] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-22T17:45:19.317686] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-22T17:45:19.726494] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-22T17:45:19.734711] [INFO ] [REMOTE ] BVN: Full fetch complete (63486 records). [2025-10-22T17:45:19.734833] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-22T17:45:20.118119] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-22T17:45:20.130660] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T17:45:20.130904] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-22T17:45:20.134666] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-22T17:45:20.135555] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-22T17:45:20.135602] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-22T17:45:20.137014] [DEBUG] [LOCAL ] BVN: Trimmed 63486 records to 44515 (keeping 200 days of data) [2025-10-22T17:45:20.398823] [DEBUG] [LOCAL ] BVN: Primary data saved (44515 records). [2025-10-22T17:45:20.398953] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-22T17:45:20.399022] [INFO ] [MAIN ] Update Progress: 364/2367 symbols completed. BVN took 35.8s. Estimated remaining: 4h 9m 4s. Rate: 8.0 symbols/min [2025-10-22T17:45:20.561785] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:45:20.571155] [DEBUG] [LOCAL ] BWMX: Loaded 7868 existing records from primary storage. [2025-10-22T17:45:20.571342] [INFO ] [MAIN ] BWMX: Loaded 7868 existing records. [2025-10-22T17:45:20.741293] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:45:20.741492] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-22T17:45:20.741539] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-22T17:45:20.741706] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-22T17:45:20.741762] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-22T17:45:20.925976] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-22T17:45:21.089955] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:45:21.679378] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T17:45:21.717612] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-22T17:45:21.948060] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-22T17:45:22.517708] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-22T17:45:23.317819] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-22T17:45:23.379241] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T17:45:23.586282] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-22T17:45:24.117734] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-22T17:45:24.596500] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T17:45:24.917685] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-22T17:45:25.049678] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T17:45:25.693220] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T17:45:25.717732] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-22T17:45:26.517741] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-22T17:45:27.179344] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-22T17:45:27.278629] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T17:45:27.317711] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-22T17:45:27.974213] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-22T17:45:28.117724] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-22T17:45:28.917729] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-22T17:45:29.717764] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-22T17:45:29.801791] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T17:45:30.435904] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T17:45:30.517742] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-22T17:45:30.548784] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T17:45:31.317783] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-22T17:45:31.914054] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T17:45:32.117739] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-22T17:45:32.917767] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-22T17:45:33.082613] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T17:45:33.365417] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-22T17:45:33.539190] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T17:45:33.717750] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-22T17:45:34.460522] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T17:45:34.517727] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-22T17:45:35.317699] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-22T17:45:36.018610] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T17:45:36.117667] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-22T17:45:36.273172] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-22T17:45:36.917684] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-22T17:45:37.432146] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T17:45:37.453401] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-22T17:45:37.717708] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-22T17:45:38.517715] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-22T17:45:39.258896] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-22T17:45:39.317742] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-22T17:45:39.730700] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-22T17:45:40.117702] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-22T17:45:40.404115] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T17:45:40.405950] [INFO ] [REMOTE ] BWG: Full fetch complete (17703 records). [2025-10-22T17:45:40.406146] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-22T17:45:40.774364] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-22T17:45:40.774458] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-22T17:45:40.775076] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-22T17:45:40.775150] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-22T17:45:40.775985] [DEBUG] [LOCAL ] BWG: Trimmed 17703 records to 12559 (keeping 200 days of data) [2025-10-22T17:45:40.850458] [DEBUG] [LOCAL ] BWG: Primary data saved (12559 records). [2025-10-22T17:45:40.850592] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-22T17:45:40.850695] [INFO ] [MAIN ] Update Progress: 365/2367 symbols completed. BWG took 29.8s. Estimated remaining: 4h 10m 8s. Rate: 8.0 symbols/min [2025-10-22T17:45:40.924705] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-22T17:45:40.977047] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T17:45:41.070689] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:45:41.077029] [DEBUG] [LOCAL ] BWNB: Loaded 4079 existing records from primary storage. [2025-10-22T17:45:41.077194] [INFO ] [MAIN ] BWNB: Loaded 4079 existing records. [2025-10-22T17:45:41.255899] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:45:41.256130] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-22T17:45:41.256202] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-22T17:45:41.256540] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-22T17:45:41.256579] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-22T17:45:41.643221] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:45:41.717698] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-22T17:45:42.232058] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-22T17:45:42.517731] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-22T17:45:43.042926] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T17:45:43.051912] [INFO ] [REMOTE ] BWA: Full fetch complete (75894 records). [2025-10-22T17:45:43.052073] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-22T17:45:43.323024] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-22T17:45:43.466300] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-22T17:45:43.466389] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-22T17:45:43.467350] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-22T17:45:43.467423] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-22T17:45:43.469009] [DEBUG] [LOCAL ] BWA: Trimmed 75894 records to 52078 (keeping 200 days of data) [2025-10-22T17:45:43.809750] [DEBUG] [LOCAL ] BWA: Primary data saved (52078 records). [2025-10-22T17:45:43.810013] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-22T17:45:43.810905] [INFO ] [MAIN ] Update Progress: 366/2367 symbols completed. BWA took 35.1s. Estimated remaining: 4h 9m 36s. Rate: 8.0 symbols/min [2025-10-22T17:45:44.013028] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:45:44.013269] [DEBUG] [LOCAL ] BWSN: No existing data file found in primary storage. [2025-10-22T17:45:44.013314] [WARN ] [MAIN ] BWSN: No existing data found, performing full refresh instead. [2025-10-22T17:45:44.013443] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-22T17:45:44.013483] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-22T17:45:44.013524] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-10-22T17:45:44.013556] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-22T17:45:44.120400] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-22T17:45:44.142706] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T17:45:44.170261] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T17:45:44.417111] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:45:44.719857] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-22T17:45:44.917682] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-22T17:45:45.720250] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-22T17:45:45.722987] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T17:45:45.724850] [INFO ] [REMOTE ] BWMX: Full fetch complete (9901 records). [2025-10-22T17:45:45.724917] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-22T17:45:45.725288] [FATAL] [VALIDATOR ] BWMX: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:45:45.725367] [FATAL] [MAIN ] BWMX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:45:45.725433] [WARN ] [MAIN ] BWMX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:45:45.725501] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-22T17:45:45.725558] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-10-22T17:45:45.725592] [INFO ] [LOCAL ] BWMX: Starting deletion of derivative data. [2025-10-22T17:45:45.725774] [DEBUG] [LOCAL ] BWMX: Deleted derivative data file. [2025-10-22T17:45:45.725856] [INFO ] [MAIN ] Update Progress: 367/2367 symbols completed. BWMX took 25.3s. Estimated remaining: 4h 8m 58s. Rate: 8.0 symbols/min [2025-10-22T17:45:45.898682] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:45:45.941747] [DEBUG] [LOCAL ] BWXT: Loaded 47258 existing records from primary storage. [2025-10-22T17:45:45.942210] [INFO ] [MAIN ] BWXT: Loaded 47258 existing records. [2025-10-22T17:45:46.118993] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:45:46.119293] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-22T17:45:46.119339] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-22T17:45:46.119584] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-22T17:45:46.119679] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-22T17:45:46.198900] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-22T17:45:46.471505] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:45:46.517636] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-22T17:45:47.317795] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-22T17:45:48.117715] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-22T17:45:48.474833] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T17:45:48.485504] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-22T17:45:48.512283] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-22T17:45:48.917694] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-22T17:45:49.717741] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-22T17:45:50.148816] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T17:45:50.154442] [INFO ] [REMOTE ] BWLP: Full fetch complete (47857 records). [2025-10-22T17:45:50.154552] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-22T17:45:50.522808] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-22T17:45:50.611793] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-22T17:45:50.612125] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-22T17:45:50.612817] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-22T17:45:50.612884] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-22T17:45:50.614024] [DEBUG] [LOCAL ] BWLP: Trimmed 47857 records to 32092 (keeping 200 days of data) [2025-10-22T17:45:50.809674] [DEBUG] [LOCAL ] BWLP: Primary data saved (32092 records). [2025-10-22T17:45:50.809813] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-22T17:45:50.809884] [INFO ] [MAIN ] Update Progress: 368/2367 symbols completed. BWLP took 33.9s. Estimated remaining: 4h 8m 37s. Rate: 8.0 symbols/min [2025-10-22T17:45:50.988910] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:45:51.044172] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-22T17:45:51.045419] [DEBUG] [LOCAL ] BX: Loaded 53483 existing records from primary storage. [2025-10-22T17:45:51.047672] [INFO ] [MAIN ] BX: Loaded 53483 existing records. [2025-10-22T17:45:51.227762] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:45:51.228112] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-22T17:45:51.228162] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-22T17:45:51.228530] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-22T17:45:51.228588] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-22T17:45:51.319686] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-22T17:45:51.595220] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:45:51.632716] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T17:45:51.925696] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-22T17:45:52.117685] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-22T17:45:52.917768] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-22T17:45:53.501030] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-22T17:45:53.717785] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-22T17:45:54.127596] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T17:45:54.517739] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-22T17:45:55.056358] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T17:45:55.218405] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-22T17:45:55.317720] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-22T17:45:56.117720] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-22T17:45:56.917763] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-22T17:45:56.957849] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T17:45:57.491949] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T17:45:57.717697] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-22T17:45:57.788447] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-22T17:45:58.517697] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-22T17:45:59.317689] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-22T17:45:59.347019] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-22T17:45:59.607025] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T17:45:59.705182] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-22T17:46:00.117738] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-22T17:46:00.917698] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-22T17:46:01.717692] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-22T17:46:02.461330] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-22T17:46:02.517723] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-22T17:46:03.046441] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-22T17:46:03.317761] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-22T17:46:03.490557] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-22T17:46:03.510468] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T17:46:04.117707] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-22T17:46:04.168300] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-22T17:46:04.917743] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-22T17:46:05.717707] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-22T17:46:05.758726] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T17:46:06.517693] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-22T17:46:06.739660] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T17:46:06.959303] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-22T17:46:07.149067] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-22T17:46:07.317675] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-22T17:46:07.806594] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-22T17:46:08.117730] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-22T17:46:08.917764] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-22T17:46:09.543901] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-22T17:46:09.545040] [INFO ] [REMOTE ] BWNB: Full fetch complete (5594 records). [2025-10-22T17:46:09.545114] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-22T17:46:09.725218] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-22T17:46:09.931619] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-22T17:46:09.931772] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-22T17:46:09.932025] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-22T17:46:09.932076] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-22T17:46:09.932444] [DEBUG] [LOCAL ] BWNB: Trimmed 5594 records to 4051 (keeping 200 days of data) [2025-10-22T17:46:09.957891] [DEBUG] [LOCAL ] BWNB: Primary data saved (4051 records). [2025-10-22T17:46:09.958041] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-22T17:46:09.958123] [INFO ] [MAIN ] Update Progress: 369/2367 symbols completed. BWNB took 29.1s. Estimated remaining: 4h 9m 33s. Rate: 8.0 symbols/min [2025-10-22T17:46:10.128245] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:46:10.142950] [DEBUG] [LOCAL ] BXC: Loaded 13531 existing records from primary storage. [2025-10-22T17:46:10.143200] [INFO ] [MAIN ] BXC: Loaded 13531 existing records. [2025-10-22T17:46:10.322134] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:46:10.322442] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-22T17:46:10.322499] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-22T17:46:10.322734] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-22T17:46:10.322792] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-22T17:46:10.521610] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-22T17:46:10.649782] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-22T17:46:10.651676] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-22T17:46:10.663752] [INFO ] [REMOTE ] BWSN: Full fetch complete (6381 records). [2025-10-22T17:46:10.679701] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-22T17:46:10.847003] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:46:11.106776] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-22T17:46:11.106856] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-22T17:46:11.107037] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-22T17:46:11.107077] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-22T17:46:11.107509] [DEBUG] [LOCAL ] BWSN: Trimmed 6381 records to 5048 (keeping 200 days of data) [2025-10-22T17:46:11.138537] [DEBUG] [LOCAL ] BWSN: Primary data saved (5048 records). [2025-10-22T17:46:11.138691] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-22T17:46:11.138778] [INFO ] [MAIN ] Update Progress: 370/2367 symbols completed. BWSN took 27.3s. Estimated remaining: 4h 8m 52s. Rate: 8.0 symbols/min [2025-10-22T17:46:11.314852] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:46:11.317692] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-22T17:46:11.362178] [DEBUG] [LOCAL ] BXMT: Loaded 47278 existing records from primary storage. [2025-10-22T17:46:11.362477] [INFO ] [MAIN ] BXMT: Loaded 47278 existing records. [2025-10-22T17:46:11.538579] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:46:11.538854] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-22T17:46:11.538901] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-22T17:46:11.539068] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-22T17:46:11.539106] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-22T17:46:11.889420] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:46:12.117707] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-22T17:46:12.737523] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-22T17:46:12.917724] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-22T17:46:13.179085] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-22T17:46:13.717734] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-22T17:46:13.998482] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T17:46:14.517705] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-22T17:46:14.908773] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T17:46:15.317697] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-22T17:46:15.739625] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T17:46:15.955347] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T17:46:16.117756] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-22T17:46:16.401190] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T17:46:16.917728] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-22T17:46:17.717742] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-22T17:46:18.021524] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-22T17:46:18.517743] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-22T17:46:18.701339] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T17:46:19.317688] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-22T17:46:19.606035] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T17:46:20.117673] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-22T17:46:20.216199] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T17:46:20.917671] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-22T17:46:21.037518] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T17:46:21.717713] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-22T17:46:22.370500] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-22T17:46:22.378702] [INFO ] [REMOTE ] BWXT: Full fetch complete (68100 records). [2025-10-22T17:46:22.378878] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-22T17:46:22.524952] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-22T17:46:22.788018] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-22T17:46:22.788190] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-22T17:46:22.789045] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-22T17:46:22.789131] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-22T17:46:22.790594] [DEBUG] [LOCAL ] BWXT: Trimmed 68100 records to 47260 (keeping 200 days of data) [2025-10-22T17:46:22.932788] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T17:46:22.974320] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-22T17:46:22.988208] [INFO ] [REMOTE ] BX: Full fetch complete (77218 records). [2025-10-22T17:46:22.988393] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-22T17:46:22.989756] [FATAL] [VALIDATOR ] BX: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:46:23.044004] [FATAL] [MAIN ] BX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:46:23.053884] [WARN ] [MAIN ] BX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:46:23.080750] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-22T17:46:23.081816] [DEBUG] [LOCAL ] BX: No primary data file found to delete. [2025-10-22T17:46:23.082108] [INFO ] [LOCAL ] BX: Starting deletion of derivative data. [2025-10-22T17:46:23.083213] [DEBUG] [LOCAL ] BX: Deleted derivative data file. [2025-10-22T17:46:23.083720] [INFO ] [MAIN ] Update Progress: 371/2367 symbols completed. BX took 32.3s. Estimated remaining: 4h 9m 8s. Rate: 8.0 symbols/min [2025-10-22T17:46:23.275575] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:46:23.325076] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-22T17:46:23.353255] [DEBUG] [LOCAL ] BWXT: Primary data saved (47260 records). [2025-10-22T17:46:23.354682] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-22T17:46:23.354815] [INFO ] [MAIN ] Update Progress: 372/2367 symbols completed. BWXT took 37.6s. Estimated remaining: 4h 8m 22s. Rate: 8.0 symbols/min [2025-10-22T17:46:23.354231] [DEBUG] [LOCAL ] BXMX: Loaded 19175 existing records from primary storage. [2025-10-22T17:46:23.389876] [INFO ] [MAIN ] BXMX: Loaded 19175 existing records. [2025-10-22T17:46:23.534007] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T17:46:23.700067] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:46:23.753579] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:46:23.753768] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-22T17:46:23.753816] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-22T17:46:23.754046] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-22T17:46:23.754097] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-22T17:46:24.060373] [DEBUG] [LOCAL ] BXP: Loaded 49875 existing records from primary storage. [2025-10-22T17:46:24.066257] [INFO ] [MAIN ] BXP: Loaded 49875 existing records. [2025-10-22T17:46:24.138062] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-22T17:46:24.239638] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:46:24.318808] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:46:24.318971] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-22T17:46:24.319019] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-22T17:46:24.319239] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-22T17:46:24.319293] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-22T17:46:24.660319] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:46:24.917667] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-22T17:46:25.090631] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T17:46:25.283171] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-22T17:46:25.717733] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-22T17:46:26.258029] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T17:46:26.517683] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-22T17:46:27.308093] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T17:46:27.317738] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-22T17:46:28.117712] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-22T17:46:28.181253] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T17:46:28.225103] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-22T17:46:28.917735] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-22T17:46:29.101267] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T17:46:29.717752] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-22T17:46:30.517732] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-22T17:46:30.566997] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T17:46:30.858937] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-22T17:46:31.317720] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-22T17:46:32.128197] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-22T17:46:32.156380] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T17:46:32.477895] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T17:46:32.917708] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-22T17:46:33.717760] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-22T17:46:33.959342] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T17:46:34.021556] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-22T17:46:34.517694] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-22T17:46:35.317884] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-22T17:46:35.361463] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T17:46:35.495022] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T17:46:36.117725] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-22T17:46:36.912973] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T17:46:36.917602] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-22T17:46:37.231805] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T17:46:37.717729] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-22T17:46:37.936212] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-22T17:46:38.517707] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-22T17:46:38.714685] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T17:46:39.317692] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-22T17:46:39.528088] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-22T17:46:40.117722] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-22T17:46:40.188115] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T17:46:40.917698] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-22T17:46:41.575054] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-22T17:46:41.717851] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-22T17:46:41.883175] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T17:46:42.517713] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-22T17:46:42.610373] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T17:46:43.317728] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-22T17:46:43.935104] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-22T17:46:43.937361] [INFO ] [REMOTE ] BXC: Full fetch complete (18287 records). [2025-10-22T17:46:43.937433] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-22T17:46:43.938135] [FATAL] [VALIDATOR ] BXC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:46:43.938239] [FATAL] [MAIN ] BXC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:46:43.938311] [WARN ] [MAIN ] BXC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:46:43.938360] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-22T17:46:43.938414] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-10-22T17:46:43.938447] [INFO ] [LOCAL ] BXC: Starting deletion of derivative data. [2025-10-22T17:46:43.938571] [DEBUG] [LOCAL ] BXC: Deleted derivative data file. [2025-10-22T17:46:43.938637] [INFO ] [MAIN ] Update Progress: 373/2367 symbols completed. BXC took 34.0s. Estimated remaining: 4h 9m 25s. Rate: 8.0 symbols/min [2025-10-22T17:46:44.109897] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:46:44.117683] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-22T17:46:44.153386] [DEBUG] [LOCAL ] BXSL: Loaded 48203 existing records from primary storage. [2025-10-22T17:46:44.153720] [INFO ] [MAIN ] BXSL: Loaded 48203 existing records. [2025-10-22T17:46:44.337690] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:46:44.338167] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-22T17:46:44.338233] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-22T17:46:44.367700] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-22T17:46:44.367959] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-22T17:46:44.403428] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-22T17:46:44.742988] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:46:44.917714] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-22T17:46:45.202304] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T17:46:45.717715] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-22T17:46:46.517679] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-22T17:46:46.667265] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T17:46:46.675113] [INFO ] [REMOTE ] BXMT: Full fetch complete (69497 records). [2025-10-22T17:46:46.675226] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-22T17:46:46.676007] [FATAL] [VALIDATOR ] BXMT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:46:46.676094] [FATAL] [MAIN ] BXMT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:46:46.676137] [WARN ] [MAIN ] BXMT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:46:46.676174] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-22T17:46:46.676232] [DEBUG] [LOCAL ] BXMT: No primary data file found to delete. [2025-10-22T17:46:46.676267] [INFO ] [LOCAL ] BXMT: Starting deletion of derivative data. [2025-10-22T17:46:46.676433] [DEBUG] [LOCAL ] BXMT: Deleted derivative data file. [2025-10-22T17:46:46.676917] [INFO ] [MAIN ] Update Progress: 374/2367 symbols completed. BXMT took 35.5s. Estimated remaining: 4h 8m 52s. Rate: 8.0 symbols/min [2025-10-22T17:46:46.841561] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:46:46.863033] [DEBUG] [LOCAL ] BY: Loaded 21802 existing records from primary storage. [2025-10-22T17:46:46.863268] [INFO ] [MAIN ] BY: Loaded 21802 existing records. [2025-10-22T17:46:47.039844] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:46:47.040091] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-22T17:46:47.040147] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-22T17:46:47.040311] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-22T17:46:47.040348] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-22T17:46:47.323604] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-22T17:46:47.411461] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:46:47.458323] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T17:46:47.698979] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T17:46:47.702334] [INFO ] [REMOTE ] BXMX: Full fetch complete (28406 records). [2025-10-22T17:46:47.702450] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-22T17:46:47.703015] [FATAL] [VALIDATOR ] BXMX: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:46:47.703102] [FATAL] [MAIN ] BXMX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:46:47.703144] [WARN ] [MAIN ] BXMX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:46:47.703183] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-22T17:46:47.703240] [DEBUG] [LOCAL ] BXMX: No primary data file found to delete. [2025-10-22T17:46:47.703275] [INFO ] [LOCAL ] BXMX: Starting deletion of derivative data. [2025-10-22T17:46:47.703413] [DEBUG] [LOCAL ] BXMX: Deleted derivative data file. [2025-10-22T17:46:47.703480] [INFO ] [MAIN ] Update Progress: 375/2367 symbols completed. BXMX took 24.6s. Estimated remaining: 4h 8m 10s. Rate: 8.0 symbols/min [2025-10-22T17:46:47.878800] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:46:47.919876] [DEBUG] [LOCAL ] BYD: Loaded 44943 existing records from primary storage. [2025-10-22T17:46:47.920229] [INFO ] [MAIN ] BYD: Loaded 44943 existing records. [2025-10-22T17:46:48.098989] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:46:48.099202] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-22T17:46:48.099250] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-22T17:46:48.099438] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-22T17:46:48.099479] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-22T17:46:48.122905] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-22T17:46:48.468913] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:46:48.917698] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-22T17:46:49.156731] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T17:46:49.268808] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T17:46:49.717732] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-22T17:46:50.394819] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-22T17:46:50.522850] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-22T17:46:50.538495] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:46:51.317782] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-22T17:46:52.117742] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-22T17:46:52.568460] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-22T17:46:52.736093] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:46:52.917705] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-22T17:46:53.690446] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:46:53.717701] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-22T17:46:54.283169] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-22T17:46:54.517694] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-22T17:46:55.317680] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-22T17:46:55.544634] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T17:46:55.820529] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-22T17:46:55.945547] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T17:46:56.117686] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-22T17:46:56.917723] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-22T17:46:57.717700] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-22T17:46:58.453670] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-22T17:46:58.462611] [INFO ] [REMOTE ] BXP: Full fetch complete (72275 records). [2025-10-22T17:46:58.462798] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-22T17:46:58.526256] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-22T17:46:58.881047] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-22T17:46:58.881317] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-22T17:46:58.882284] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-22T17:46:58.882392] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-22T17:46:58.900634] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T17:46:58.933855] [DEBUG] [LOCAL ] BXP: Trimmed 72275 records to 49849 (keeping 200 days of data) [2025-10-22T17:46:58.935238] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-22T17:46:59.236167] [DEBUG] [LOCAL ] BXP: Primary data saved (49849 records). [2025-10-22T17:46:59.236296] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-22T17:46:59.236370] [INFO ] [MAIN ] Update Progress: 376/2367 symbols completed. BXP took 35.9s. Estimated remaining: 4h 8m 24s. Rate: 8.0 symbols/min [2025-10-22T17:46:59.323865] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-22T17:46:59.417089] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:46:59.432888] [DEBUG] [LOCAL ] BYM: Loaded 11430 existing records from primary storage. [2025-10-22T17:46:59.433208] [INFO ] [MAIN ] BYM: Loaded 11430 existing records. [2025-10-22T17:46:59.622045] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:46:59.622285] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-22T17:46:59.622332] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-22T17:46:59.622517] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-22T17:46:59.622572] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-22T17:46:59.976174] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:47:00.117732] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-22T17:47:00.217401] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T17:47:00.362970] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-22T17:47:00.917712] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-22T17:47:01.717745] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-22T17:47:01.914810] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:47:02.133317] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T17:47:02.517704] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-22T17:47:03.317720] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-22T17:47:03.547000] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T17:47:03.646913] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T17:47:04.117727] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-22T17:47:04.789409] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T17:47:04.917676] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-22T17:47:05.225153] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T17:47:05.717641] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-22T17:47:06.517686] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-22T17:47:06.680637] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T17:47:06.765516] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T17:47:07.317723] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-22T17:47:08.013335] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T17:47:08.117720] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-22T17:47:08.486800] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T17:47:08.490399] [INFO ] [REMOTE ] BY: Full fetch complete (29623 records). [2025-10-22T17:47:08.490484] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-22T17:47:08.869705] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-22T17:47:08.869807] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-22T17:47:08.870266] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-22T17:47:08.870309] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-22T17:47:08.871092] [DEBUG] [LOCAL ] BY: Trimmed 29623 records to 21636 (keeping 200 days of data) [2025-10-22T17:47:08.924229] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-22T17:47:09.006190] [DEBUG] [LOCAL ] BY: Primary data saved (21636 records). [2025-10-22T17:47:09.006319] [INFO ] [MAIN ] BY: Full history saved. [2025-10-22T17:47:09.006399] [INFO ] [MAIN ] Update Progress: 377/2367 symbols completed. BY took 22.3s. Estimated remaining: 4h 8m 29s. Rate: 8.0 symbols/min [2025-10-22T17:47:09.174756] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:47:09.174978] [DEBUG] [LOCAL ] BZH: No existing data file found in primary storage. [2025-10-22T17:47:09.175071] [WARN ] [MAIN ] BZH: No existing data found, performing full refresh instead. [2025-10-22T17:47:09.175168] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-22T17:47:09.175233] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-22T17:47:09.175311] [DEBUG] [LOCAL ] BZH: No primary data file found to delete. [2025-10-22T17:47:09.175364] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-22T17:47:09.535426] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:47:09.717678] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-22T17:47:09.995613] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T17:47:10.176374] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T17:47:10.517693] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-22T17:47:10.927787] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T17:47:11.317708] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-22T17:47:12.117769] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-22T17:47:12.153776] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T17:47:12.370344] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T17:47:12.917703] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-22T17:47:13.230817] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T17:47:13.673275] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T17:47:13.717691] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-22T17:47:14.517761] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-22T17:47:14.959226] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-22T17:47:15.317703] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-22T17:47:15.454851] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T17:47:16.117714] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-22T17:47:16.917713] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-22T17:47:17.136972] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T17:47:17.136250] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-22T17:47:17.149168] [INFO ] [REMOTE ] BXSL: Full fetch complete (69687 records). [2025-10-22T17:47:17.149277] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-22T17:47:17.150010] [FATAL] [VALIDATOR ] BXSL: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:47:17.150097] [FATAL] [MAIN ] BXSL: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:47:17.150139] [WARN ] [MAIN ] BXSL: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:47:17.150177] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-22T17:47:17.150232] [DEBUG] [LOCAL ] BXSL: No primary data file found to delete. [2025-10-22T17:47:17.150267] [INFO ] [LOCAL ] BXSL: Starting deletion of derivative data. [2025-10-22T17:47:17.150430] [DEBUG] [LOCAL ] BXSL: Deleted derivative data file. [2025-10-22T17:47:17.151102] [INFO ] [MAIN ] Update Progress: 378/2367 symbols completed. BXSL took 33.2s. Estimated remaining: 4h 8m 24s. Rate: 8.0 symbols/min [2025-10-22T17:47:17.332004] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:47:17.383431] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-10-22T17:47:17.383756] [INFO ] [MAIN ] C: Loaded 53741 existing records. [2025-10-22T17:47:17.555238] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:47:17.555470] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-22T17:47:17.555516] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-22T17:47:17.555728] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-22T17:47:17.555787] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-22T17:47:17.728555] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-22T17:47:17.909792] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:47:18.480413] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-22T17:47:18.511941] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T17:47:18.520952] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-22T17:47:19.317692] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-22T17:47:19.917512] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T17:47:20.117684] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-22T17:47:20.192475] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-22T17:47:20.917732] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-22T17:47:21.712326] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T17:47:21.719591] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-22T17:47:22.509880] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T17:47:22.518597] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-22T17:47:23.317700] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-22T17:47:23.445570] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T17:47:23.946060] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-22T17:47:24.117671] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-22T17:47:24.889854] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T17:47:24.897724] [INFO ] [REMOTE ] BYD: Full fetch complete (65439 records). [2025-10-22T17:47:24.897884] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-22T17:47:24.930392] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-22T17:47:25.293266] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-22T17:47:25.293356] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-22T17:47:25.294145] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-22T17:47:25.294207] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-22T17:47:25.295432] [DEBUG] [LOCAL ] BYD: Trimmed 65439 records to 44941 (keeping 200 days of data) [2025-10-22T17:47:25.562822] [DEBUG] [LOCAL ] BYD: Primary data saved (44941 records). [2025-10-22T17:47:25.562945] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-22T17:47:25.563028] [INFO ] [MAIN ] Update Progress: 379/2367 symbols completed. BYD took 37.9s. Estimated remaining: 4h 8m 22s. Rate: 8.0 symbols/min [2025-10-22T17:47:25.729944] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:47:25.727517] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-22T17:47:25.748897] [DEBUG] [LOCAL ] CAAP: Loaded 19895 existing records from primary storage. [2025-10-22T17:47:25.749125] [INFO ] [MAIN ] CAAP: Loaded 19895 existing records. [2025-10-22T17:47:25.933791] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:47:25.934015] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-22T17:47:25.934188] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-22T17:47:25.934461] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-22T17:47:25.934596] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-22T17:47:26.265953] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-22T17:47:26.396183] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-22T17:47:26.395128] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:47:26.419985] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T17:47:26.517727] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-22T17:47:27.317716] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-22T17:47:28.117709] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-22T17:47:28.377608] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-22T17:47:28.636777] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-22T17:47:28.917716] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-22T17:47:28.936031] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T17:47:29.717708] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-22T17:47:30.517744] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-22T17:47:30.569914] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-22T17:47:30.572122] [INFO ] [REMOTE ] BYM: Full fetch complete (17305 records). [2025-10-22T17:47:30.572192] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-22T17:47:30.925516] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-22T17:47:30.925595] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-22T17:47:30.925994] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-22T17:47:30.926057] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-22T17:47:30.926682] [DEBUG] [LOCAL ] BYM: Trimmed 17305 records to 11369 (keeping 200 days of data) [2025-10-22T17:47:30.995261] [DEBUG] [LOCAL ] BYM: Primary data saved (11369 records). [2025-10-22T17:47:30.995395] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-22T17:47:30.995473] [INFO ] [MAIN ] Update Progress: 380/2367 symbols completed. BYM took 31.8s. Estimated remaining: 4h 8m 4s. Rate: 8.0 symbols/min [2025-10-22T17:47:31.166249] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:47:31.182720] [DEBUG] [LOCAL ] CABO: Loaded 16710 existing records from primary storage. [2025-10-22T17:47:31.182961] [INFO ] [MAIN ] CABO: Loaded 16710 existing records. [2025-10-22T17:47:31.333612] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-22T17:47:31.364759] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:47:31.366070] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-22T17:47:31.366144] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-22T17:47:31.366445] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-22T17:47:31.366725] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-22T17:47:31.490433] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T17:47:31.598014] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-22T17:47:31.784590] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:47:32.117716] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-22T17:47:32.891078] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T17:47:32.917677] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-22T17:47:33.033406] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T17:47:33.717785] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-22T17:47:34.130380] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T17:47:34.517749] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-22T17:47:34.678569] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-22T17:47:35.317710] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-22T17:47:35.400595] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-22T17:47:36.117733] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-22T17:47:36.917734] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-22T17:47:36.955975] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-22T17:47:37.310468] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-22T17:47:37.717716] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-22T17:47:37.900750] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-22T17:47:38.436936] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-22T17:47:38.517708] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-22T17:47:39.316734] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-22T17:47:39.320121] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-22T17:47:40.117713] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-22T17:47:40.814028] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T17:47:40.819150] [INFO ] [REMOTE ] BZH: Full fetch complete (47248 records). [2025-10-22T17:47:40.819300] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-22T17:47:40.922700] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-22T17:47:41.193258] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-22T17:47:41.193340] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-22T17:47:41.193936] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-22T17:47:41.193999] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-22T17:47:41.195039] [DEBUG] [LOCAL ] BZH: Trimmed 47248 records to 32065 (keeping 200 days of data) [2025-10-22T17:47:41.376630] [DEBUG] [LOCAL ] BZH: Primary data saved (32065 records). [2025-10-22T17:47:41.376820] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-22T17:47:41.376895] [INFO ] [MAIN ] Update Progress: 381/2367 symbols completed. BZH took 32.4s. Estimated remaining: 4h 8m 11s. Rate: 8.0 symbols/min [2025-10-22T17:47:41.542200] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:47:41.563738] [DEBUG] [LOCAL ] CACI: Loaded 22510 existing records from primary storage. [2025-10-22T17:47:41.564001] [INFO ] [MAIN ] CACI: Loaded 22510 existing records. [2025-10-22T17:47:41.721981] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-22T17:47:41.744362] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:47:41.744630] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-22T17:47:41.744875] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-22T17:47:41.745047] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-22T17:47:41.745086] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-22T17:47:42.129033] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:47:42.148350] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T17:47:42.183622] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-22T17:47:42.517698] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-22T17:47:42.823580] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T17:47:43.317718] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-22T17:47:43.525724] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-22T17:47:44.117721] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-22T17:47:44.878067] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T17:47:44.917718] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-22T17:47:45.717765] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-22T17:47:46.107611] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T17:47:46.398970] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-22T17:47:46.517721] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-22T17:47:47.206517] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T17:47:47.317666] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-22T17:47:48.117721] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-22T17:47:48.624832] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-22T17:47:48.882422] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T17:47:48.917733] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-22T17:47:49.189080] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-22T17:47:49.717741] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-22T17:47:50.445620] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T17:47:50.517764] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-22T17:47:51.317737] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-22T17:47:51.517704] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T17:47:51.570565] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T17:47:52.117706] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-22T17:47:52.495399] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T17:47:52.797404] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T17:47:52.917714] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-22T17:47:53.717709] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-22T17:47:53.825586] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T17:47:54.517706] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-22T17:47:54.640076] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-22T17:47:55.317677] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-22T17:47:55.551128] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-22T17:47:56.117692] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-22T17:47:56.433812] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T17:47:56.917667] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-22T17:47:57.317231] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T17:47:57.717681] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-22T17:47:58.041930] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-22T17:47:58.517695] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-22T17:47:58.927743] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-22T17:47:58.933578] [INFO ] [REMOTE ] CAAP: Full fetch complete (27906 records). [2025-10-22T17:47:58.933756] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-22T17:47:59.337448] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-22T17:47:59.350376] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-22T17:47:59.350459] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-22T17:47:59.350947] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-22T17:47:59.351010] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-22T17:47:59.351904] [DEBUG] [LOCAL ] CAAP: Trimmed 27906 records to 19805 (keeping 200 days of data) [2025-10-22T17:47:59.469160] [DEBUG] [LOCAL ] CAAP: Primary data saved (19805 records). [2025-10-22T17:47:59.469322] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-22T17:47:59.469407] [INFO ] [MAIN ] Update Progress: 382/2367 symbols completed. CAAP took 33.9s. Estimated remaining: 4h 8m 59s. Rate: 8.0 symbols/min [2025-10-22T17:47:59.672947] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:47:59.685788] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-22T17:47:59.731662] [DEBUG] [LOCAL ] CADE: Loaded 49677 existing records from primary storage. [2025-10-22T17:47:59.731979] [INFO ] [MAIN ] CADE: Loaded 49677 existing records. [2025-10-22T17:47:59.908120] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:47:59.908427] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-22T17:47:59.908484] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-22T17:47:59.908902] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-22T17:47:59.908958] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-22T17:48:00.122930] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-22T17:48:00.250510] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:00.917748] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-22T17:48:01.289987] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T17:48:01.292500] [INFO ] [REMOTE ] CABO: Full fetch complete (23184 records). [2025-10-22T17:48:01.292670] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-22T17:48:01.686398] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-22T17:48:01.686618] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-22T17:48:01.687230] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-22T17:48:01.687298] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-22T17:48:01.688188] [DEBUG] [LOCAL ] CABO: Trimmed 23184 records to 16659 (keeping 200 days of data) [2025-10-22T17:48:01.730346] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-22T17:48:01.792442] [DEBUG] [LOCAL ] CABO: Primary data saved (16659 records). [2025-10-22T17:48:01.792756] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-22T17:48:01.792857] [INFO ] [MAIN ] Update Progress: 383/2367 symbols completed. CABO took 30.8s. Estimated remaining: 4h 8m 24s. Rate: 8.0 symbols/min [2025-10-22T17:48:01.975637] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:01.975876] [DEBUG] [LOCAL ] CAE: No existing data file found in primary storage. [2025-10-22T17:48:01.975945] [WARN ] [MAIN ] CAE: No existing data found, performing full refresh instead. [2025-10-22T17:48:01.976160] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-22T17:48:01.976272] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-22T17:48:01.976376] [DEBUG] [LOCAL ] CAE: No primary data file found to delete. [2025-10-22T17:48:01.976445] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-22T17:48:02.088201] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-22T17:48:02.123880] [INFO ] [REMOTE ] C: Full fetch complete (77528 records). [2025-10-22T17:48:02.137804] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-22T17:48:02.140946] [FATAL] [VALIDATOR ] C: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:48:02.151623] [FATAL] [MAIN ] C: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:48:02.179728] [WARN ] [MAIN ] C: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:48:02.179824] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-22T17:48:02.201136] [DEBUG] [LOCAL ] C: No primary data file found to delete. [2025-10-22T17:48:02.204703] [INFO ] [LOCAL ] C: Starting deletion of derivative data. [2025-10-22T17:48:02.224669] [DEBUG] [LOCAL ] C: Deleted derivative data file. [2025-10-22T17:48:02.225397] [INFO ] [MAIN ] Update Progress: 384/2367 symbols completed. C took 45.1s. Estimated remaining: 4h 7m 40s. Rate: 8.0 symbols/min [2025-10-22T17:48:02.633186] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:02.640735] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:02.641930] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-22T17:48:02.649451] [DEBUG] [LOCAL ] CAF: Loaded 3490 existing records from primary storage. [2025-10-22T17:48:02.649736] [INFO ] [MAIN ] CAF: Loaded 3490 existing records. [2025-10-22T17:48:02.890057] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:48:02.890803] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-22T17:48:02.892415] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-22T17:48:02.892626] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-22T17:48:02.903325] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-22T17:48:02.903391] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-22T17:48:03.036837] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T17:48:03.071509] [INFO ] [REMOTE ] CACI: Full fetch complete (38357 records). [2025-10-22T17:48:03.078048] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-22T17:48:03.325717] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-22T17:48:03.429927] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:03.648779] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-22T17:48:03.648863] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-22T17:48:03.649389] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-22T17:48:03.649428] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-22T17:48:03.650266] [DEBUG] [LOCAL ] CACI: Trimmed 38357 records to 22378 (keeping 200 days of data) [2025-10-22T17:48:03.790835] [DEBUG] [LOCAL ] CACI: Primary data saved (22378 records). [2025-10-22T17:48:03.790972] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-22T17:48:03.791100] [INFO ] [MAIN ] Update Progress: 385/2367 symbols completed. CACI took 22.4s. Estimated remaining: 4h 7m 2s. Rate: 8.0 symbols/min [2025-10-22T17:48:03.988418] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:04.008610] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T17:48:04.064101] [DEBUG] [LOCAL ] CAG: Loaded 53666 existing records from primary storage. [2025-10-22T17:48:04.064453] [INFO ] [MAIN ] CAG: Loaded 53666 existing records. [2025-10-22T17:48:04.123153] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-22T17:48:04.248212] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:48:04.248563] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-22T17:48:04.248622] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-22T17:48:04.249331] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-22T17:48:04.249390] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-22T17:48:04.606198] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:04.726524] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T17:48:04.912804] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T17:48:04.917615] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-22T17:48:05.717718] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-22T17:48:06.497117] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T17:48:06.497352] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T17:48:06.517599] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-22T17:48:07.317714] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-22T17:48:08.117671] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-22T17:48:08.370945] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T17:48:08.709478] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T17:48:08.710544] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T17:48:08.917700] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-22T17:48:09.717698] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-22T17:48:10.297275] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-22T17:48:10.517720] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-22T17:48:10.687393] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T17:48:11.128551] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-22T17:48:11.317696] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-22T17:48:12.117704] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-22T17:48:12.888037] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T17:48:12.917608] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-22T17:48:13.717732] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-22T17:48:13.785112] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T17:48:14.176492] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T17:48:14.517749] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-22T17:48:15.317759] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-22T17:48:15.962279] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T17:48:15.969052] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-22T17:48:16.103220] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T17:48:16.117684] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-22T17:48:16.920551] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-22T17:48:17.568307] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T17:48:17.717737] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-22T17:48:18.517717] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-22T17:48:18.801153] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T17:48:19.292052] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T17:48:19.317611] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-22T17:48:20.117679] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-22T17:48:20.302718] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T17:48:20.807593] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T17:48:20.917717] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-22T17:48:21.717755] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-22T17:48:21.788170] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T17:48:21.930573] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T17:48:22.111030] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-22T17:48:22.517718] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-22T17:48:22.988439] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-22T17:48:23.317704] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-22T17:48:23.998743] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T17:48:24.117716] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-22T17:48:24.687161] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-22T17:48:24.688559] [INFO ] [REMOTE ] CAF: Full fetch complete (5507 records). [2025-10-22T17:48:24.688671] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-22T17:48:24.689138] [FATAL] [VALIDATOR ] CAF: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:48:24.689261] [FATAL] [MAIN ] CAF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:48:24.689306] [WARN ] [MAIN ] CAF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:48:24.689384] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-22T17:48:24.689448] [DEBUG] [LOCAL ] CAF: No primary data file found to delete. [2025-10-22T17:48:24.689486] [INFO ] [LOCAL ] CAF: Starting deletion of derivative data. [2025-10-22T17:48:24.689609] [DEBUG] [LOCAL ] CAF: Deleted derivative data file. [2025-10-22T17:48:24.689729] [INFO ] [MAIN ] Update Progress: 386/2367 symbols completed. CAF took 22.5s. Estimated remaining: 4h 8m 3s. Rate: 8.0 symbols/min [2025-10-22T17:48:24.857273] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:24.905273] [DEBUG] [LOCAL ] CAH: Loaded 51443 existing records from primary storage. [2025-10-22T17:48:24.905557] [INFO ] [MAIN ] CAH: Loaded 51443 existing records. [2025-10-22T17:48:24.925399] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-22T17:48:25.088471] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:48:25.088754] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-22T17:48:25.088829] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-22T17:48:25.089158] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-22T17:48:25.089195] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-22T17:48:25.445534] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:25.717686] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-22T17:48:26.517724] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-22T17:48:26.935791] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-22T17:48:27.317714] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-22T17:48:27.749606] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-22T17:48:28.117704] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-22T17:48:28.262401] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T17:48:28.917678] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-22T17:48:29.093674] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T17:48:29.102133] [INFO ] [REMOTE ] CADE: Full fetch complete (70745 records). [2025-10-22T17:48:29.102251] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-22T17:48:29.484865] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-22T17:48:29.484960] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-22T17:48:29.485736] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-22T17:48:29.485797] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-22T17:48:29.487123] [DEBUG] [LOCAL ] CADE: Trimmed 70745 records to 49685 (keeping 200 days of data) [2025-10-22T17:48:29.718004] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-22T17:48:29.793577] [DEBUG] [LOCAL ] CADE: Primary data saved (49685 records). [2025-10-22T17:48:29.793734] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-22T17:48:29.793819] [INFO ] [MAIN ] Update Progress: 387/2367 symbols completed. CADE took 30.3s. Estimated remaining: 4h 7m 44s. Rate: 8.0 symbols/min [2025-10-22T17:48:29.931549] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T17:48:29.981411] [INFO ] [REMOTE ] CAE: Full fetch complete (56582 records). [2025-10-22T17:48:29.999556] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:29.998033] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-22T17:48:30.410460] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-22T17:48:30.410564] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-22T17:48:30.411267] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-22T17:48:30.413513] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-22T17:48:30.415025] [DEBUG] [LOCAL ] CAL: Loaded 42780 existing records from primary storage. [2025-10-22T17:48:30.415789] [INFO ] [MAIN ] CAL: Loaded 42780 existing records. [2025-10-22T17:48:30.473139] [DEBUG] [LOCAL ] CAE: Trimmed 56582 records to 39045 (keeping 200 days of data) [2025-10-22T17:48:30.577453] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T17:48:30.677028] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-22T17:48:30.722738] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:48:30.725692] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-22T17:48:30.727680] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-22T17:48:30.731348] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-22T17:48:30.732886] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-22T17:48:31.199597] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:31.216358] [DEBUG] [LOCAL ] CAE: Primary data saved (39045 records). [2025-10-22T17:48:31.216523] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-22T17:48:31.216602] [INFO ] [MAIN ] Update Progress: 388/2367 symbols completed. CAE took 29.4s. Estimated remaining: 4h 7m 5s. Rate: 8.0 symbols/min [2025-10-22T17:48:31.320850] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-22T17:48:31.410510] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:31.449926] [DEBUG] [LOCAL ] CALX: Loaded 37319 existing records from primary storage. [2025-10-22T17:48:31.450317] [INFO ] [MAIN ] CALX: Loaded 37319 existing records. [2025-10-22T17:48:31.669367] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:48:31.669675] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-22T17:48:31.669828] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-22T17:48:31.670173] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-22T17:48:31.670241] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-22T17:48:31.995514] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-22T17:48:32.086928] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:32.117683] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-22T17:48:32.564339] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T17:48:32.691866] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T17:48:32.917728] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-22T17:48:33.717720] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-22T17:48:33.762349] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T17:48:34.332162] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T17:48:34.517721] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-22T17:48:35.179579] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T17:48:35.317684] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-22T17:48:36.117715] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-22T17:48:36.289784] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T17:48:36.816570] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T17:48:36.917758] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-22T17:48:37.717703] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-22T17:48:37.986030] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T17:48:38.517701] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-22T17:48:39.167808] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-22T17:48:39.168929] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T17:48:39.317694] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-22T17:48:39.732694] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-22T17:48:40.117708] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-22T17:48:40.862523] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T17:48:40.917757] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-22T17:48:41.717704] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-22T17:48:41.827903] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T17:48:42.139281] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T17:48:42.517677] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-22T17:48:43.309911] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T17:48:43.318500] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-22T17:48:43.913353] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T17:48:44.117695] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-22T17:48:44.871809] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T17:48:44.917613] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-22T17:48:45.717723] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-22T17:48:45.800600] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T17:48:46.517715] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-22T17:48:46.881716] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-22T17:48:46.912077] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T17:48:47.317718] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-22T17:48:48.087522] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T17:48:48.117611] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-22T17:48:48.859497] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T17:48:48.917671] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-22T17:48:49.598782] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T17:48:49.717676] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-22T17:48:50.311887] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-22T17:48:50.517739] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-22T17:48:51.280164] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T17:48:51.317617] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-22T17:48:52.117727] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-22T17:48:52.358583] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T17:48:52.917760] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-22T17:48:52.947202] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T17:48:53.717691] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-22T17:48:53.903688] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T17:48:53.912334] [INFO ] [REMOTE ] CAG: Full fetch complete (77827 records). [2025-10-22T17:48:53.912461] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-22T17:48:54.294195] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-22T17:48:54.294296] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-22T17:48:54.295162] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-22T17:48:54.295241] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-22T17:48:54.296954] [DEBUG] [LOCAL ] CAG: Trimmed 77827 records to 53666 (keeping 200 days of data) [2025-10-22T17:48:54.526252] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-22T17:48:54.555566] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T17:48:54.672511] [DEBUG] [LOCAL ] CAG: Primary data saved (53666 records). [2025-10-22T17:48:54.672711] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-22T17:48:54.673355] [INFO ] [MAIN ] Update Progress: 389/2367 symbols completed. CAG took 50.9s. Estimated remaining: 4h 8m 19s. Rate: 8.0 symbols/min [2025-10-22T17:48:54.842612] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:54.867876] [DEBUG] [LOCAL ] CANG: Loaded 27080 existing records from primary storage. [2025-10-22T17:48:54.868138] [INFO ] [MAIN ] CANG: Loaded 27080 existing records. [2025-10-22T17:48:55.049050] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:48:55.049371] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-22T17:48:55.049602] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-22T17:48:55.056343] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-22T17:48:55.065279] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-22T17:48:55.152173] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T17:48:55.324943] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-22T17:48:55.442004] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:56.117707] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-22T17:48:56.199314] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T17:48:56.206306] [INFO ] [REMOTE ] CAL: Full fetch complete (61875 records). [2025-10-22T17:48:56.206427] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-22T17:48:56.595455] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-22T17:48:56.595533] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-22T17:48:56.596249] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-22T17:48:56.596311] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-22T17:48:56.597448] [DEBUG] [LOCAL ] CAL: Trimmed 61875 records to 42762 (keeping 200 days of data) [2025-10-22T17:48:56.850174] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T17:48:56.866463] [INFO ] [REMOTE ] CALX: Full fetch complete (54055 records). [2025-10-22T17:48:56.878103] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-22T17:48:56.882429] [DEBUG] [LOCAL ] CAL: Primary data saved (42762 records). [2025-10-22T17:48:56.882940] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-22T17:48:56.883064] [INFO ] [MAIN ] Update Progress: 390/2367 symbols completed. CAL took 27.1s. Estimated remaining: 4h 7m 44s. Rate: 8.0 symbols/min [2025-10-22T17:48:56.926188] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-22T17:48:57.211418] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:57.347260] [DEBUG] [LOCAL ] CAPL: Loaded 5485 existing records from primary storage. [2025-10-22T17:48:57.358703] [INFO ] [MAIN ] CAPL: Loaded 5485 existing records. [2025-10-22T17:48:57.628309] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-22T17:48:57.634748] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-22T17:48:57.664330] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-22T17:48:57.664528] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-22T17:48:57.676795] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:48:57.678016] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-22T17:48:57.678355] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-22T17:48:57.678889] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-22T17:48:57.679020] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-22T17:48:57.679172] [DEBUG] [LOCAL ] CALX: Trimmed 54055 records to 37238 (keeping 200 days of data) [2025-10-22T17:48:58.098169] [DEBUG] [LOCAL ] CALX: Primary data saved (37238 records). [2025-10-22T17:48:58.121353] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-22T17:48:58.127352] [INFO ] [MAIN ] Update Progress: 391/2367 symbols completed. CALX took 26.9s. Estimated remaining: 4h 7m 5s. Rate: 8.0 symbols/min [2025-10-22T17:48:58.121174] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-22T17:48:58.298947] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-22T17:48:58.540252] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:58.518572] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:48:58.540870] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-22T17:48:58.568606] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T17:48:58.624253] [DEBUG] [LOCAL ] CARR: Loaded 53603 existing records from primary storage. [2025-10-22T17:48:58.624632] [INFO ] [MAIN ] CARR: Loaded 53603 existing records. [2025-10-22T17:48:58.802017] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:48:58.802262] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-22T17:48:58.802311] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-22T17:48:58.802794] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-22T17:48:58.802862] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-22T17:48:59.146969] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:48:59.317688] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-22T17:48:59.398925] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-22T17:49:00.117700] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-22T17:49:00.315950] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-22T17:49:00.325091] [INFO ] [REMOTE ] CAH: Full fetch complete (74839 records). [2025-10-22T17:49:00.325226] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-22T17:49:00.667802] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T17:49:00.802495] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-22T17:49:00.802588] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-22T17:49:00.803431] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-22T17:49:00.803496] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-22T17:49:00.805060] [DEBUG] [LOCAL ] CAH: Trimmed 74839 records to 51420 (keeping 200 days of data) [2025-10-22T17:49:00.910690] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T17:49:00.926837] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-22T17:49:01.139181] [DEBUG] [LOCAL ] CAH: Primary data saved (51420 records). [2025-10-22T17:49:01.139381] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-22T17:49:01.139493] [INFO ] [MAIN ] Update Progress: 392/2367 symbols completed. CAH took 36.4s. Estimated remaining: 4h 6m 35s. Rate: 8.0 symbols/min [2025-10-22T17:49:01.304919] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:49:01.305135] [DEBUG] [LOCAL ] CARS: No existing data file found in primary storage. [2025-10-22T17:49:01.305194] [WARN ] [MAIN ] CARS: No existing data found, performing full refresh instead. [2025-10-22T17:49:01.305310] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-22T17:49:01.305352] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-22T17:49:01.305397] [DEBUG] [LOCAL ] CARS: No primary data file found to delete. [2025-10-22T17:49:01.305430] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-22T17:49:01.649089] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:49:01.717726] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-22T17:49:02.517673] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-22T17:49:02.966554] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-22T17:49:03.124936] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T17:49:03.183989] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-22T17:49:03.317681] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-22T17:49:04.117692] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-22T17:49:04.905741] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T17:49:04.917613] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-22T17:49:05.650757] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-22T17:49:05.717758] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-22T17:49:05.939495] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-22T17:49:06.517682] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-22T17:49:06.801300] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T17:49:07.317713] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-22T17:49:07.842212] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T17:49:08.117747] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-22T17:49:08.489813] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T17:49:08.742377] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T17:49:08.917724] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-22T17:49:09.717713] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-22T17:49:10.517693] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-22T17:49:10.774803] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T17:49:11.165160] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-22T17:49:11.196804] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T17:49:11.317768] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-22T17:49:12.117701] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-22T17:49:12.797703] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T17:49:12.917672] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-22T17:49:13.717679] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-22T17:49:14.074529] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T17:49:14.408842] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T17:49:14.517679] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-22T17:49:14.842166] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T17:49:15.317738] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-22T17:49:15.846110] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T17:49:16.117727] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-22T17:49:16.864556] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-22T17:49:16.917731] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-22T17:49:17.172955] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T17:49:17.717689] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-22T17:49:18.184947] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-22T17:49:18.334204] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T17:49:18.517765] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-22T17:49:19.060150] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-22T17:49:19.317694] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-22T17:49:20.117723] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-22T17:49:20.804099] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T17:49:20.917720] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-22T17:49:21.717835] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-22T17:49:21.749562] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T17:49:22.310008] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-22T17:49:22.519290] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-22T17:49:22.521732] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-22T17:49:22.523374] [INFO ] [REMOTE ] CAPL: Full fetch complete (8709 records). [2025-10-22T17:49:22.523482] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-22T17:49:22.877515] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-22T17:49:22.877618] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-22T17:49:22.877870] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-22T17:49:22.877914] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-22T17:49:22.878294] [DEBUG] [LOCAL ] CAPL: Trimmed 8709 records to 5383 (keeping 200 days of data) [2025-10-22T17:49:22.910479] [DEBUG] [LOCAL ] CAPL: Primary data saved (5383 records). [2025-10-22T17:49:22.910622] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-22T17:49:22.910739] [INFO ] [MAIN ] Update Progress: 393/2367 symbols completed. CAPL took 26.0s. Estimated remaining: 4h 7m 39s. Rate: 8.0 symbols/min [2025-10-22T17:49:23.077003] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:49:23.123893] [DEBUG] [LOCAL ] CAT: Loaded 52953 existing records from primary storage. [2025-10-22T17:49:23.124187] [INFO ] [MAIN ] CAT: Loaded 52953 existing records. [2025-10-22T17:49:23.303737] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:49:23.303960] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-22T17:49:23.304007] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-22T17:49:23.304325] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-22T17:49:23.304381] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-22T17:49:23.325481] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-22T17:49:23.660119] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:49:24.117733] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-22T17:49:24.578586] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-22T17:49:24.688594] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T17:49:24.917717] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-22T17:49:25.361274] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-22T17:49:25.717736] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-22T17:49:26.517700] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-22T17:49:27.098486] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T17:49:27.210158] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-22T17:49:27.317677] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-22T17:49:27.995239] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T17:49:28.117720] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-22T17:49:28.917640] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-22T17:49:29.294907] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-22T17:49:29.442811] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T17:49:29.449954] [INFO ] [REMOTE ] CARS: Full fetch complete (56564 records). [2025-10-22T17:49:29.450082] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-22T17:49:29.725310] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-22T17:49:29.823771] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-22T17:49:29.823842] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-22T17:49:29.824490] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-22T17:49:29.824529] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-22T17:49:29.825594] [DEBUG] [LOCAL ] CARS: Trimmed 56564 records to 39772 (keeping 200 days of data) [2025-10-22T17:49:30.047201] [DEBUG] [LOCAL ] CARS: Primary data saved (39772 records). [2025-10-22T17:49:30.047346] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-22T17:49:30.047433] [INFO ] [MAIN ] Update Progress: 394/2367 symbols completed. CARS took 28.9s. Estimated remaining: 4h 7m 30s. Rate: 8.0 symbols/min [2025-10-22T17:49:30.212904] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:49:30.221040] [DEBUG] [LOCAL ] CATO: Loaded 6616 existing records from primary storage. [2025-10-22T17:49:30.221192] [INFO ] [MAIN ] CATO: Loaded 6616 existing records. [2025-10-22T17:49:30.392960] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:49:30.393131] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-22T17:49:30.393176] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-22T17:49:30.393330] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-22T17:49:30.393384] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-22T17:49:30.529711] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-22T17:49:30.753457] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:49:30.792965] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T17:49:31.317734] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-22T17:49:31.568280] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T17:49:32.014624] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-22T17:49:32.019426] [INFO ] [REMOTE ] CANG: Full fetch complete (39519 records). [2025-10-22T17:49:32.019511] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-22T17:49:32.120256] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-22T17:49:32.246836] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-22T17:49:32.397415] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-22T17:49:32.397488] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-22T17:49:32.398046] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-22T17:49:32.398110] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-22T17:49:32.398946] [DEBUG] [LOCAL ] CANG: Trimmed 39519 records to 27031 (keeping 200 days of data) [2025-10-22T17:49:32.542231] [DEBUG] [LOCAL ] CANG: Primary data saved (27031 records). [2025-10-22T17:49:32.542338] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-22T17:49:32.542416] [INFO ] [MAIN ] Update Progress: 395/2367 symbols completed. CANG took 37.9s. Estimated remaining: 4h 6m 57s. Rate: 8.0 symbols/min [2025-10-22T17:49:32.729034] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:49:32.778961] [DEBUG] [LOCAL ] CAVA: Loaded 53551 existing records from primary storage. [2025-10-22T17:49:32.779288] [INFO ] [MAIN ] CAVA: Loaded 53551 existing records. [2025-10-22T17:49:32.925997] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-22T17:49:32.956747] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:49:32.957049] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-22T17:49:32.957096] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-22T17:49:32.957329] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-22T17:49:32.957371] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-22T17:49:33.301144] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:49:33.717741] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-22T17:49:34.206682] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-22T17:49:34.215531] [INFO ] [REMOTE ] CARR: Full fetch complete (77772 records). [2025-10-22T17:49:34.215690] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-22T17:49:34.482727] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T17:49:34.522811] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-22T17:49:34.617529] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-22T17:49:34.617612] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-22T17:49:34.618580] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-22T17:49:34.618667] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-22T17:49:34.620105] [DEBUG] [LOCAL ] CARR: Trimmed 77772 records to 53603 (keeping 200 days of data) [2025-10-22T17:49:34.947239] [DEBUG] [LOCAL ] CARR: Primary data saved (53603 records). [2025-10-22T17:49:34.947470] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-22T17:49:34.947585] [INFO ] [MAIN ] Update Progress: 396/2367 symbols completed. CARR took 36.8s. Estimated remaining: 4h 6m 24s. Rate: 8.0 symbols/min [2025-10-22T17:49:35.120349] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:49:35.162954] [DEBUG] [LOCAL ] CB: Loaded 49973 existing records from primary storage. [2025-10-22T17:49:35.163255] [INFO ] [MAIN ] CB: Loaded 49973 existing records. [2025-10-22T17:49:35.319478] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-22T17:49:35.341117] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:49:35.342406] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-22T17:49:35.342456] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-22T17:49:35.342633] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-22T17:49:35.342707] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-22T17:49:35.558338] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-22T17:49:35.739908] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:49:36.117721] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-22T17:49:36.175136] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-22T17:49:36.726183] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-22T17:49:36.917691] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-22T17:49:37.387163] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-22T17:49:37.717712] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-22T17:49:37.995468] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T17:49:38.517724] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-22T17:49:39.317711] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-22T17:49:39.533036] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T17:49:39.930679] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-22T17:49:40.117697] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-22T17:49:40.281462] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T17:49:40.917720] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-22T17:49:41.717683] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-22T17:49:41.789482] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T17:49:42.308755] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T17:49:42.517723] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-22T17:49:42.882277] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-22T17:49:43.155731] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-22T17:49:43.317729] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-22T17:49:44.117711] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-22T17:49:44.917737] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-22T17:49:45.435028] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-22T17:49:45.717710] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-22T17:49:46.034853] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T17:49:46.517716] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-22T17:49:46.815392] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-22T17:49:47.317723] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-22T17:49:47.910494] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-22T17:49:48.117740] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-22T17:49:48.702907] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-22T17:49:48.917693] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-22T17:49:49.033189] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T17:49:49.717677] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-22T17:49:50.271612] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-22T17:49:50.517727] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-22T17:49:51.072177] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T17:49:51.278357] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T17:49:51.294753] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-22T17:49:51.317609] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-22T17:49:52.117725] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-22T17:49:52.866219] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T17:49:52.903472] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T17:49:52.917609] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-22T17:49:53.597948] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-22T17:49:53.599483] [INFO ] [REMOTE ] CATO: Full fetch complete (10717 records). [2025-10-22T17:49:53.599556] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-22T17:49:53.722738] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-22T17:49:53.961620] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-22T17:49:53.961718] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-22T17:49:53.961971] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-22T17:49:53.962028] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-22T17:49:53.962458] [DEBUG] [LOCAL ] CATO: Trimmed 10717 records to 6647 (keeping 200 days of data) [2025-10-22T17:49:53.997581] [DEBUG] [LOCAL ] CATO: Primary data saved (6647 records). [2025-10-22T17:49:53.997691] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-22T17:49:53.998174] [INFO ] [MAIN ] Update Progress: 397/2367 symbols completed. CATO took 24.0s. Estimated remaining: 4h 7m 14s. Rate: 8.0 symbols/min [2025-10-22T17:49:54.517713] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-22T17:49:55.317757] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-22T17:49:55.757730] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-22T17:49:56.117707] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-22T17:49:56.872882] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-22T17:49:56.882259] [INFO ] [REMOTE ] CAT: Full fetch complete (76893 records). [2025-10-22T17:49:56.882399] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-22T17:49:57.292604] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-22T17:49:57.292784] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-22T17:49:57.294401] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-22T17:49:57.294514] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-22T17:49:57.296891] [DEBUG] [LOCAL ] CAT: Trimmed 76893 records to 52953 (keeping 200 days of data) [2025-10-22T17:49:57.421063] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-22T17:49:57.456315] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-22T17:49:57.686271] [DEBUG] [LOCAL ] CAT: Primary data saved (52953 records). [2025-10-22T17:49:57.686458] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-22T17:49:57.686684] [INFO ] [MAIN ] Update Progress: 398/2367 symbols completed. CAT took 34.8s. Estimated remaining: 4h 6m 47s. Rate: 8.0 symbols/min [2025-10-22T17:49:57.717177] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T17:49:57.727574] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-22T17:49:59.476002] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T17:49:59.491173] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-22T17:49:59.751461] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-22T17:49:59.762960] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-22T17:50:01.375894] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T17:50:01.389563] [INFO ] [REMOTE ] CB: Full fetch complete (72875 records). [2025-10-22T17:50:01.389802] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-22T17:50:01.877354] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-22T17:50:01.877550] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-22T17:50:01.878570] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-22T17:50:01.878714] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-22T17:50:01.880284] [DEBUG] [LOCAL ] CB: Trimmed 72875 records to 49964 (keeping 200 days of data) [2025-10-22T17:50:02.030516] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-22T17:50:02.048971] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-22T17:50:02.256589] [DEBUG] [LOCAL ] CB: Primary data saved (49964 records). [2025-10-22T17:50:02.256771] [INFO ] [MAIN ] CB: Full history saved. [2025-10-22T17:50:02.256866] [INFO ] [MAIN ] Update Progress: 399/2367 symbols completed. CB took 27.3s. Estimated remaining: 4h 6m 25s. Rate: 8.0 symbols/min [2025-10-22T17:50:04.453867] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-22T17:50:04.465239] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-22T17:50:07.092140] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (2.63 seconds). [2025-10-22T17:50:07.100812] [INFO ] [REMOTE ] CAVA: Full fetch complete (77457 records). [2025-10-22T17:50:07.100954] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-22T17:50:07.496562] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-22T17:50:07.496681] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-22T17:50:07.497553] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-22T17:50:07.497618] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-22T17:50:07.499234] [DEBUG] [LOCAL ] CAVA: Trimmed 77457 records to 53551 (keeping 200 days of data) [2025-10-22T17:50:07.820436] [DEBUG] [LOCAL ] CAVA: Primary data saved (53551 records). [2025-10-22T17:50:07.820573] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-22T17:50:07.821224] [INFO ] [MAIN ] Update Progress: 400/2367 symbols completed. CAVA took 35.3s. Estimated remaining: 4h 6m 8s. Rate: 8.0 symbols/min [2025-10-22T17:50:08.457755] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:08.494532] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:08.538335] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:08.554179] [DEBUG] [LOCAL ] CBL: No existing data file found in primary storage. [2025-10-22T17:50:08.557867] [WARN ] [MAIN ] CBL: No existing data found, performing full refresh instead. [2025-10-22T17:50:08.539792] [DEBUG] [LOCAL ] CBAN: No existing data file found in primary storage. [2025-10-22T17:50:08.559839] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-22T17:50:08.559613] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:08.560241] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-22T17:50:08.560155] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-22T17:50:08.560632] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-22T17:50:08.560331] [WARN ] [MAIN ] CBAN: No existing data found, performing full refresh instead. [2025-10-22T17:50:08.561386] [DEBUG] [LOCAL ] CBL: No primary data file found to delete. [2025-10-22T17:50:08.561201] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-22T17:50:08.561824] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-22T17:50:08.561752] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-22T17:50:08.562094] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-22T17:50:08.562005] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-22T17:50:08.562276] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-22T17:50:08.562182] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-22T17:50:08.650966] [DEBUG] [LOCAL ] CBNA: Loaded 2888 existing records from primary storage. [2025-10-22T17:50:08.628576] [DEBUG] [LOCAL ] CBAN: No primary data file found to delete. [2025-10-22T17:50:08.722765] [INFO ] [MAIN ] CBNA: Loaded 2888 existing records. [2025-10-22T17:50:08.722412] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-22T17:50:09.407569] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:50:09.602010] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-22T17:50:09.622255] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-22T17:50:09.702215] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-22T17:50:09.754191] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-22T17:50:09.998033] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:10.051499] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-10-22T17:50:10.115178] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:10.089604] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:10.115508] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-22T17:50:10.131601] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-22T17:50:10.368426] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:10.368737] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-22T17:50:10.468995] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:50:10.469305] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-10-22T17:50:10.469415] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:50:10.469465] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-22T17:50:10.469502] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:50:10.469551] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-22T17:50:10.469622] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-22T17:50:10.469755] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-22T17:50:10.469837] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-22T17:50:10.469903] [INFO ] [MAIN ] Update Progress: 401/2367 symbols completed. CBO took 2.6s. Estimated remaining: 4h 5m 37s. Rate: 8.0 symbols/min [2025-10-22T17:50:10.643129] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:10.693138] [DEBUG] [LOCAL ] CBRE: Loaded 50283 existing records from primary storage. [2025-10-22T17:50:10.693453] [INFO ] [MAIN ] CBRE: Loaded 50283 existing records. [2025-10-22T17:50:10.875600] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:50:10.875856] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-22T17:50:10.875913] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-22T17:50:10.876124] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-22T17:50:10.876195] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-22T17:50:11.240038] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:11.244143] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-22T17:50:11.245481] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T17:50:11.247158] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-22T17:50:11.255514] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T17:50:11.258879] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-22T17:50:11.402773] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-22T17:50:11.407084] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-22T17:50:11.728205] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-22T17:50:11.730098] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-22T17:50:11.903952] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T17:50:11.907459] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-22T17:50:12.235165] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-22T17:50:12.236346] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-22T17:50:12.302716] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T17:50:12.306815] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-22T17:50:12.549254] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-22T17:50:12.552839] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-22T17:50:12.559753] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-22T17:50:12.561007] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-22T17:50:12.896188] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T17:50:12.917611] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-22T17:50:13.213860] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T17:50:13.326614] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T17:50:13.438426] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T17:50:13.717692] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-22T17:50:14.303948] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T17:50:14.517720] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-22T17:50:14.765848] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T17:50:15.317755] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-22T17:50:16.117690] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-22T17:50:16.135923] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T17:50:16.447259] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T17:50:16.734392] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-22T17:50:16.917712] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-22T17:50:17.717735] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-22T17:50:18.081406] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-22T17:50:18.517737] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-22T17:50:18.700131] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T17:50:19.317719] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-22T17:50:19.339494] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T17:50:20.117696] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-22T17:50:20.917674] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-22T17:50:21.029979] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T17:50:21.121437] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T17:50:21.717721] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-22T17:50:22.012059] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T17:50:22.517722] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-22T17:50:23.317678] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-22T17:50:23.395111] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T17:50:23.415131] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-22T17:50:24.117678] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-22T17:50:24.302082] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-22T17:50:24.917693] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-22T17:50:24.963151] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-22T17:50:25.498840] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T17:50:25.717681] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-22T17:50:26.171371] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-22T17:50:26.517740] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-22T17:50:27.317704] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-22T17:50:27.494594] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-22T17:50:27.983045] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-22T17:50:28.117707] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-22T17:50:28.917724] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-22T17:50:29.717728] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-22T17:50:29.800915] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T17:50:30.000495] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T17:50:30.002435] [INFO ] [REMOTE ] CBAN: Full fetch complete (16225 records). [2025-10-22T17:50:30.002547] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-22T17:50:30.390332] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-22T17:50:30.390434] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-22T17:50:30.390856] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-22T17:50:30.390917] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-22T17:50:30.391551] [DEBUG] [LOCAL ] CBAN: Trimmed 16225 records to 10154 (keeping 200 days of data) [2025-10-22T17:50:30.454019] [DEBUG] [LOCAL ] CBAN: Primary data saved (10154 records). [2025-10-22T17:50:30.454149] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-22T17:50:30.454222] [INFO ] [MAIN ] Update Progress: 402/2367 symbols completed. CBAN took 22.6s. Estimated remaining: 4h 6m 30s. Rate: 8.0 symbols/min [2025-10-22T17:50:30.522862] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-22T17:50:30.631422] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:30.660209] [DEBUG] [LOCAL ] CBT: Loaded 31053 existing records from primary storage. [2025-10-22T17:50:30.660483] [INFO ] [MAIN ] CBT: Loaded 31053 existing records. [2025-10-22T17:50:30.769796] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T17:50:30.857316] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:50:30.857561] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-22T17:50:30.857613] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-22T17:50:30.857869] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-22T17:50:30.857925] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-22T17:50:31.220152] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:31.317741] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-22T17:50:31.775969] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-22T17:50:31.776857] [INFO ] [REMOTE ] CBNA: Full fetch complete (4312 records). [2025-10-22T17:50:31.776926] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-22T17:50:32.127028] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-22T17:50:32.134252] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-22T17:50:32.134328] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-22T17:50:32.135195] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-22T17:50:32.135253] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-22T17:50:32.135595] [DEBUG] [LOCAL ] CBNA: Trimmed 4312 records to 2864 (keeping 200 days of data) [2025-10-22T17:50:32.153224] [DEBUG] [LOCAL ] CBNA: Primary data saved (2864 records). [2025-10-22T17:50:32.153317] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-22T17:50:32.153391] [INFO ] [MAIN ] Update Progress: 403/2367 symbols completed. CBNA took 24.3s. Estimated remaining: 4h 5m 54s. Rate: 8.0 symbols/min [2025-10-22T17:50:32.323134] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:32.378425] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T17:50:32.403532] [DEBUG] [LOCAL ] CBU: Loaded 22773 existing records from primary storage. [2025-10-22T17:50:32.403799] [INFO ] [MAIN ] CBU: Loaded 22773 existing records. [2025-10-22T17:50:32.581568] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:50:32.581863] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-22T17:50:32.581950] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-22T17:50:32.582179] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-22T17:50:32.582233] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-22T17:50:32.923374] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-22T17:50:32.928825] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:33.564975] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T17:50:33.677101] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T17:50:33.679959] [INFO ] [REMOTE ] CBL: Full fetch complete (24793 records). [2025-10-22T17:50:33.680029] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-22T17:50:33.722877] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-22T17:50:34.046349] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-22T17:50:34.046470] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-22T17:50:34.046939] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-22T17:50:34.047002] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-22T17:50:34.047822] [DEBUG] [LOCAL ] CBL: Trimmed 24793 records to 16048 (keeping 200 days of data) [2025-10-22T17:50:34.144142] [DEBUG] [LOCAL ] CBL: Primary data saved (16048 records). [2025-10-22T17:50:34.144285] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-22T17:50:34.144356] [INFO ] [MAIN ] Update Progress: 404/2367 symbols completed. CBL took 26.3s. Estimated remaining: 4h 5m 20s. Rate: 8.0 symbols/min [2025-10-22T17:50:34.314230] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:34.314423] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-22T17:50:34.314462] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-22T17:50:34.314575] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-22T17:50:34.314617] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-22T17:50:34.314696] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-22T17:50:34.314746] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-22T17:50:34.522915] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-22T17:50:34.677423] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:35.317681] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-22T17:50:35.576982] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T17:50:35.945982] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:50:36.117702] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-22T17:50:36.484843] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T17:50:36.917720] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-22T17:50:37.368808] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T17:50:37.717681] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-22T17:50:38.034619] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T17:50:38.517706] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-22T17:50:38.926539] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-22T17:50:39.317706] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-22T17:50:40.117672] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-22T17:50:40.212720] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T17:50:40.221120] [INFO ] [REMOTE ] CBRE: Full fetch complete (73767 records). [2025-10-22T17:50:40.221273] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-22T17:50:40.617185] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T17:50:40.643771] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-22T17:50:40.643856] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-22T17:50:40.644973] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-22T17:50:40.645037] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-22T17:50:40.646304] [DEBUG] [LOCAL ] CBRE: Trimmed 73767 records to 50278 (keeping 200 days of data) [2025-10-22T17:50:40.922751] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-10-22T17:50:40.941406] [DEBUG] [LOCAL ] CBRE: Primary data saved (50278 records). [2025-10-22T17:50:40.941612] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-22T17:50:40.942286] [INFO ] [MAIN ] Update Progress: 405/2367 symbols completed. CBRE took 30.5s. Estimated remaining: 4h 5m 9s. Rate: 8.0 symbols/min [2025-10-22T17:50:41.108327] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:41.130491] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:50:41.139699] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-10-22T17:50:41.140690] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:50:41.140806] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-22T17:50:41.141348] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:50:41.141305] [DEBUG] [LOCAL ] CBZ: Loaded 34322 existing records from primary storage. [2025-10-22T17:50:41.141472] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-22T17:50:41.141703] [INFO ] [MAIN ] CBZ: Loaded 34322 existing records. [2025-10-22T17:50:41.141806] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-22T17:50:41.172925] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-22T17:50:41.209797] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-22T17:50:41.232032] [INFO ] [MAIN ] Update Progress: 406/2367 symbols completed. CBX took 7.1s. Estimated remaining: 4h 4m 27s. Rate: 8.0 symbols/min [2025-10-22T17:50:41.440556] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:50:41.464923] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-22T17:50:41.479611] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-22T17:50:41.500499] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:41.500603] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-22T17:50:41.501330] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-22T17:50:41.723256] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-22T17:50:41.815046] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T17:50:41.907518] [DEBUG] [LOCAL ] CC: Loaded 53021 existing records from primary storage. [2025-10-22T17:50:41.933766] [INFO ] [MAIN ] CC: Loaded 53021 existing records. [2025-10-22T17:50:41.976194] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:42.120755] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:50:42.121036] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-22T17:50:42.121090] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-22T17:50:42.121262] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-22T17:50:42.121299] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-22T17:50:42.469272] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:42.517693] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-22T17:50:42.986104] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T17:50:43.317676] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-22T17:50:44.117689] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-22T17:50:44.206190] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T17:50:44.373598] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-22T17:50:44.753943] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T17:50:44.917701] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-22T17:50:45.717726] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-22T17:50:46.023137] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T17:50:46.517733] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-22T17:50:47.317700] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-22T17:50:47.405458] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T17:50:47.641403] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T17:50:48.117703] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-22T17:50:48.191808] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T17:50:48.917685] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-22T17:50:49.239830] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T17:50:49.717710] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-22T17:50:50.522909] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-22T17:50:50.545434] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T17:50:50.796731] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T17:50:51.317747] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-22T17:50:51.394719] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T17:50:52.117687] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-22T17:50:52.917686] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-22T17:50:53.078744] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T17:50:53.144150] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T17:50:53.717764] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-22T17:50:54.069495] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T17:50:54.516372] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-22T17:50:54.523568] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-22T17:50:54.525858] [INFO ] [REMOTE ] CBU: Full fetch complete (32722 records). [2025-10-22T17:50:54.526028] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-22T17:50:54.920495] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-22T17:50:54.920598] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-22T17:50:54.921215] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-22T17:50:54.921276] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-22T17:50:54.922250] [DEBUG] [LOCAL ] CBU: Trimmed 32722 records to 22633 (keeping 200 days of data) [2025-10-22T17:50:55.061938] [DEBUG] [LOCAL ] CBU: Primary data saved (22633 records). [2025-10-22T17:50:55.062075] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-22T17:50:55.062153] [INFO ] [MAIN ] Update Progress: 407/2367 symbols completed. CBU took 22.9s. Estimated remaining: 4h 4m 50s. Rate: 8.0 symbols/min [2025-10-22T17:50:55.235048] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:50:55.284626] [DEBUG] [LOCAL ] CCI: Loaded 53111 existing records from primary storage. [2025-10-22T17:50:55.284977] [INFO ] [MAIN ] CCI: Loaded 53111 existing records. [2025-10-22T17:50:55.322866] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-22T17:50:55.486036] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:50:55.486262] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-22T17:50:55.486310] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-22T17:50:55.486497] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-22T17:50:55.486536] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-22T17:50:55.851583] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:50:56.117690] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-22T17:50:56.332284] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T17:50:56.917680] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-22T17:50:56.997143] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T17:50:57.533669] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T17:50:57.717701] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-22T17:50:58.053740] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T17:50:58.517710] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-22T17:50:59.076107] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T17:50:59.317699] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-22T17:51:00.099282] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-22T17:51:00.117682] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-22T17:51:00.327585] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T17:51:00.917712] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-22T17:51:01.556547] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T17:51:01.717779] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-22T17:51:02.517720] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-22T17:51:03.016129] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-22T17:51:03.048965] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T17:51:03.317727] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-22T17:51:03.933376] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T17:51:04.117698] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-22T17:51:04.759684] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T17:51:04.917759] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-22T17:51:05.603632] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T17:51:05.717700] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-22T17:51:06.493218] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T17:51:06.519686] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-22T17:51:06.866797] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T17:51:06.872169] [INFO ] [REMOTE ] CBT: Full fetch complete (45785 records). [2025-10-22T17:51:06.872278] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-22T17:51:07.251009] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-22T17:51:07.251087] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-22T17:51:07.251682] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-22T17:51:07.251743] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-22T17:51:07.252733] [DEBUG] [LOCAL ] CBT: Trimmed 45785 records to 30925 (keeping 200 days of data) [2025-10-22T17:51:07.341316] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-22T17:51:07.455518] [DEBUG] [LOCAL ] CBT: Primary data saved (30925 records). [2025-10-22T17:51:07.455618] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-22T17:51:07.455725] [INFO ] [MAIN ] Update Progress: 408/2367 symbols completed. CBT took 37.0s. Estimated remaining: 4h 5m 6s. Rate: 8.0 symbols/min [2025-10-22T17:51:07.623398] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:51:07.623768] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-22T17:51:07.623814] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-22T17:51:07.623921] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-22T17:51:07.623961] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-22T17:51:07.624002] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-22T17:51:07.624033] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-22T17:51:07.976175] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:51:08.034386] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T17:51:08.117705] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-22T17:51:08.917677] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-22T17:51:09.255986] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T17:51:09.717722] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-22T17:51:09.846677] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T17:51:10.076379] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-22T17:51:10.082558] [INFO ] [REMOTE ] CBZ: Full fetch complete (46368 records). [2025-10-22T17:51:10.082716] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-22T17:51:10.479688] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-22T17:51:10.479802] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-22T17:51:10.480545] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-22T17:51:10.480614] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-22T17:51:10.481966] [DEBUG] [LOCAL ] CBZ: Trimmed 46368 records to 34267 (keeping 200 days of data) [2025-10-22T17:51:10.536109] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-22T17:51:10.697176] [DEBUG] [LOCAL ] CBZ: Primary data saved (34267 records). [2025-10-22T17:51:10.697341] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-22T17:51:10.697445] [INFO ] [MAIN ] Update Progress: 409/2367 symbols completed. CBZ took 29.8s. Estimated remaining: 4h 4m 38s. Rate: 8.0 symbols/min [2025-10-22T17:51:10.890319] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:51:10.905329] [DEBUG] [LOCAL ] CCIF: Loaded 15216 existing records from primary storage. [2025-10-22T17:51:10.905563] [INFO ] [MAIN ] CCIF: Loaded 15216 existing records. [2025-10-22T17:51:11.093903] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:51:11.094122] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-22T17:51:11.094171] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-22T17:51:11.094378] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-22T17:51:11.094416] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-22T17:51:11.322793] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-22T17:51:11.506727] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:51:11.546635] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-22T17:51:11.888753] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-22T17:51:12.008700] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T17:51:12.117709] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-22T17:51:12.917709] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-22T17:51:13.717696] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-22T17:51:14.085851] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-22T17:51:14.137915] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-22T17:51:14.196718] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-22T17:51:14.205324] [INFO ] [REMOTE ] CC: Full fetch complete (76204 records). [2025-10-22T17:51:14.205449] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-22T17:51:14.522950] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-22T17:51:14.599595] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-22T17:51:14.599700] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-22T17:51:14.600515] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-22T17:51:14.600559] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-22T17:51:14.601983] [DEBUG] [LOCAL ] CC: Trimmed 76204 records to 53015 (keeping 200 days of data) [2025-10-22T17:51:14.919619] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-22T17:51:14.926953] [DEBUG] [LOCAL ] CC: Primary data saved (53015 records). [2025-10-22T17:51:14.927045] [INFO ] [MAIN ] CC: Full history saved. [2025-10-22T17:51:14.927114] [INFO ] [MAIN ] Update Progress: 410/2367 symbols completed. CC took 33.7s. Estimated remaining: 4h 4m 15s. Rate: 8.0 symbols/min [2025-10-22T17:51:15.100317] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:51:15.148111] [DEBUG] [LOCAL ] CCJ: Loaded 53690 existing records from primary storage. [2025-10-22T17:51:15.148454] [INFO ] [MAIN ] CCJ: Loaded 53690 existing records. [2025-10-22T17:51:15.325803] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:51:15.322148] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-22T17:51:15.326122] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-22T17:51:15.327088] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-22T17:51:15.327315] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-22T17:51:15.327370] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-22T17:51:15.675252] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:51:16.117706] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-22T17:51:16.226395] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T17:51:16.528387] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-22T17:51:16.917732] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-22T17:51:17.717727] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-22T17:51:18.178189] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-22T17:51:18.517718] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-22T17:51:18.815914] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-22T17:51:18.942815] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-22T17:51:19.317702] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-22T17:51:19.673051] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-22T17:51:20.117688] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-22T17:51:20.917728] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-22T17:51:21.717719] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-22T17:51:21.919250] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-22T17:51:21.922083] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T17:51:22.112720] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-22T17:51:22.517674] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-22T17:51:22.963322] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-22T17:51:23.317702] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-22T17:51:24.117741] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-22T17:51:24.544138] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-22T17:51:24.917732] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-22T17:51:25.487455] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-22T17:51:25.488453] [INFO ] [REMOTE ] CCIA: Full fetch complete (2184 records). [2025-10-22T17:51:25.488522] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-22T17:51:25.675084] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-22T17:51:25.675306] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:51:25.675387] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:51:25.675469] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-22T17:51:25.675546] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-22T17:51:25.675596] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-22T17:51:25.675682] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-22T17:51:25.675775] [INFO ] [MAIN ] Update Progress: 411/2367 symbols completed. CCIA took 18.2s. Estimated remaining: 4h 4m 23s. Rate: 8.0 symbols/min [2025-10-22T17:51:25.718025] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-22T17:51:25.857748] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:51:25.901459] [DEBUG] [LOCAL ] CCK: Loaded 46497 existing records from primary storage. [2025-10-22T17:51:25.901839] [INFO ] [MAIN ] CCK: Loaded 46497 existing records. [2025-10-22T17:51:26.079181] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:51:26.079466] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-22T17:51:26.079532] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-22T17:51:26.079934] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-22T17:51:26.080008] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-22T17:51:26.308131] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-22T17:51:26.503969] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:51:26.517609] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-22T17:51:26.790946] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T17:51:27.317707] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-22T17:51:28.117672] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-22T17:51:28.219752] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T17:51:28.917691] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-22T17:51:29.029804] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T17:51:29.160873] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T17:51:29.717735] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-22T17:51:30.517680] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-22T17:51:30.757379] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T17:51:30.819046] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T17:51:31.317695] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-22T17:51:32.117736] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-22T17:51:32.656637] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-22T17:51:32.776990] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-22T17:51:32.917692] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-22T17:51:32.966537] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T17:51:33.717683] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-22T17:51:33.869088] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T17:51:34.517729] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-22T17:51:35.317815] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-22T17:51:35.442500] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T17:51:35.931966] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T17:51:36.117698] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-22T17:51:36.917785] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-22T17:51:37.551227] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-22T17:51:37.622411] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T17:51:37.717721] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-22T17:51:38.517690] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-22T17:51:38.576986] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T17:51:39.317726] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-22T17:51:39.642109] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T17:51:39.644742] [INFO ] [REMOTE ] CCIF: Full fetch complete (21887 records). [2025-10-22T17:51:39.644819] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-22T17:51:40.044662] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-22T17:51:40.104716] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-22T17:51:40.104806] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-22T17:51:40.105270] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-22T17:51:40.105689] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-22T17:51:40.106323] [DEBUG] [LOCAL ] CCIF: Trimmed 21887 records to 15143 (keeping 200 days of data) [2025-10-22T17:51:40.142893] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-22T17:51:40.200336] [DEBUG] [LOCAL ] CCIF: Primary data saved (15143 records). [2025-10-22T17:51:40.200509] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-22T17:51:40.200597] [INFO ] [MAIN ] Update Progress: 412/2367 symbols completed. CCIF took 29.5s. Estimated remaining: 4h 4m 49s. Rate: 8.0 symbols/min [2025-10-22T17:51:40.383450] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:51:40.383635] [DEBUG] [LOCAL ] CCL: No existing data file found in primary storage. [2025-10-22T17:51:40.383722] [WARN ] [MAIN ] CCL: No existing data found, performing full refresh instead. [2025-10-22T17:51:40.383855] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-22T17:51:40.383899] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-22T17:51:40.383943] [DEBUG] [LOCAL ] CCL: No primary data file found to delete. [2025-10-22T17:51:40.383978] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-22T17:51:40.789821] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:51:40.908923] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T17:51:40.918222] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-22T17:51:41.717932] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-22T17:51:42.341322] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-22T17:51:42.517663] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-22T17:51:42.997931] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-22T17:51:43.006794] [INFO ] [REMOTE ] CCI: Full fetch complete (77100 records). [2025-10-22T17:51:43.006959] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-22T17:51:43.318960] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-22T17:51:43.416601] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-22T17:51:43.416718] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-22T17:51:43.417715] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-22T17:51:43.417834] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-22T17:51:43.441739] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T17:51:43.450345] [DEBUG] [LOCAL ] CCI: Trimmed 77100 records to 53109 (keeping 200 days of data) [2025-10-22T17:51:43.792708] [DEBUG] [LOCAL ] CCI: Primary data saved (53109 records). [2025-10-22T17:51:43.792854] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-22T17:51:43.792960] [INFO ] [MAIN ] Update Progress: 413/2367 symbols completed. CCI took 48.7s. Estimated remaining: 4h 4m 23s. Rate: 8.0 symbols/min [2025-10-22T17:51:44.001320] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:51:44.044207] [DEBUG] [LOCAL ] CCO: Loaded 48523 existing records from primary storage. [2025-10-22T17:51:44.044520] [INFO ] [MAIN ] CCO: Loaded 48523 existing records. [2025-10-22T17:51:44.122723] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-22T17:51:44.244434] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:51:44.244661] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-22T17:51:44.244722] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-22T17:51:44.244900] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-22T17:51:44.244938] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-22T17:51:44.594979] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:51:44.858276] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-22T17:51:44.917713] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-22T17:51:45.676961] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-22T17:51:45.717677] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-22T17:51:45.829195] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T17:51:46.517706] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-22T17:51:47.273578] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T17:51:47.317673] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-22T17:51:47.369427] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-22T17:51:47.378242] [INFO ] [REMOTE ] CCJ: Full fetch complete (77840 records). [2025-10-22T17:51:47.378415] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-22T17:51:47.772929] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-22T17:51:47.773015] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-22T17:51:47.774024] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-22T17:51:47.774091] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-22T17:51:47.775545] [DEBUG] [LOCAL ] CCJ: Trimmed 77840 records to 53690 (keeping 200 days of data) [2025-10-22T17:51:48.093380] [DEBUG] [LOCAL ] CCJ: Primary data saved (53690 records). [2025-10-22T17:51:48.093692] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-22T17:51:48.093818] [INFO ] [MAIN ] Update Progress: 414/2367 symbols completed. CCJ took 33.2s. Estimated remaining: 4h 4m 0s. Rate: 8.0 symbols/min [2025-10-22T17:51:48.127365] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-22T17:51:48.307024] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:51:48.309785] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T17:51:48.329343] [DEBUG] [LOCAL ] CCRD: Loaded 9582 existing records from primary storage. [2025-10-22T17:51:48.329631] [INFO ] [MAIN ] CCRD: Loaded 9582 existing records. [2025-10-22T17:51:48.512767] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:51:48.513083] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-22T17:51:48.513150] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-22T17:51:48.513372] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-22T17:51:48.513418] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-22T17:51:48.892214] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:51:48.917676] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-22T17:51:49.424743] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-22T17:51:49.592551] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T17:51:49.592740] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-22T17:51:49.717674] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-22T17:51:50.517716] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-22T17:51:51.175257] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T17:51:51.317732] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-22T17:51:52.117700] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-22T17:51:52.916308] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T17:51:52.925446] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-22T17:51:53.286076] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T17:51:53.298574] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-10-22T17:51:53.514208] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-22T17:51:53.717715] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-22T17:51:54.517757] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-22T17:51:55.317674] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-22T17:51:55.372067] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T17:51:55.894715] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-22T17:51:56.117713] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-22T17:51:56.917722] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-22T17:51:56.969531] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-22T17:51:57.717698] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-22T17:51:57.763936] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-22T17:51:57.771786] [INFO ] [REMOTE ] CCK: Full fetch complete (68149 records). [2025-10-22T17:51:57.771900] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-22T17:51:58.162241] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-22T17:51:58.162385] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-22T17:51:58.163199] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-22T17:51:58.163264] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-22T17:51:58.165597] [DEBUG] [LOCAL ] CCK: Trimmed 68149 records to 46505 (keeping 200 days of data) [2025-10-22T17:51:58.415780] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T17:51:58.496083] [DEBUG] [LOCAL ] CCK: Primary data saved (46505 records). [2025-10-22T17:51:58.496256] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-22T17:51:58.496356] [INFO ] [MAIN ] Update Progress: 415/2367 symbols completed. CCK took 32.8s. Estimated remaining: 4h 4m 6s. Rate: 8.0 symbols/min [2025-10-22T17:51:58.527687] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-22T17:51:58.675587] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:51:58.705087] [DEBUG] [LOCAL ] CCS: Loaded 30011 existing records from primary storage. [2025-10-22T17:51:58.705362] [INFO ] [MAIN ] CCS: Loaded 30011 existing records. [2025-10-22T17:51:58.897677] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:51:58.897957] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-22T17:51:58.898006] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-22T17:51:58.898414] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-22T17:51:58.898474] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-22T17:51:59.243394] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-22T17:51:59.271490] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:51:59.317616] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-22T17:52:00.047249] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T17:52:00.121089] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-22T17:52:00.117749] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-22T17:52:00.917741] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-22T17:52:01.717741] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-22T17:52:01.755594] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T17:52:02.517698] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-22T17:52:02.577115] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T17:52:03.317698] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-22T17:52:04.089480] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-22T17:52:04.117667] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-22T17:52:04.202003] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T17:52:04.247372] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T17:52:04.917713] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-22T17:52:05.717697] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-22T17:52:06.460922] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-22T17:52:06.517702] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-22T17:52:06.747328] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T17:52:06.808102] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T17:52:07.317704] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-22T17:52:08.117693] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-22T17:52:08.180321] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T17:52:08.657215] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-22T17:52:08.917711] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-22T17:52:09.685158] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T17:52:09.693034] [INFO ] [REMOTE ] CCO: Full fetch complete (67295 records). [2025-10-22T17:52:09.693147] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-22T17:52:09.724036] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-22T17:52:10.073030] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-22T17:52:10.073104] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-22T17:52:10.073841] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-22T17:52:10.073903] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-22T17:52:10.075098] [DEBUG] [LOCAL ] CCO: Trimmed 67295 records to 48537 (keeping 200 days of data) [2025-10-22T17:52:10.333442] [DEBUG] [LOCAL ] CCO: Primary data saved (48537 records). [2025-10-22T17:52:10.333594] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-22T17:52:10.333693] [INFO ] [MAIN ] Update Progress: 416/2367 symbols completed. CCO took 26.5s. Estimated remaining: 4h 4m 19s. Rate: 8.0 symbols/min [2025-10-22T17:52:10.498399] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:52:10.519013] [DEBUG] [LOCAL ] CCU: Loaded 21804 existing records from primary storage. [2025-10-22T17:52:10.518619] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-22T17:52:10.519986] [INFO ] [MAIN ] CCU: Loaded 21804 existing records. [2025-10-22T17:52:10.693742] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:52:10.693929] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-22T17:52:10.693975] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-22T17:52:10.694160] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-22T17:52:10.694214] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-22T17:52:11.059914] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:52:11.200315] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T17:52:11.323096] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-22T17:52:11.341528] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-22T17:52:11.491991] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T17:52:12.117745] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-22T17:52:12.922841] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-22T17:52:12.932777] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T17:52:13.172963] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T17:52:13.174831] [INFO ] [REMOTE ] CCRD: Full fetch complete (11782 records). [2025-10-22T17:52:13.174900] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-22T17:52:13.522963] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-22T17:52:13.523063] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-22T17:52:13.523347] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-22T17:52:13.523399] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-22T17:52:13.523898] [DEBUG] [LOCAL ] CCRD: Trimmed 11782 records to 9562 (keeping 200 days of data) [2025-10-22T17:52:13.577090] [DEBUG] [LOCAL ] CCRD: Primary data saved (9562 records). [2025-10-22T17:52:13.577193] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-22T17:52:13.577270] [INFO ] [MAIN ] Update Progress: 417/2367 symbols completed. CCRD took 25.5s. Estimated remaining: 4h 3m 52s. Rate: 8.0 symbols/min [2025-10-22T17:52:13.725717] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-22T17:52:13.743220] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:52:13.743619] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-22T17:52:13.744914] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-22T17:52:13.745075] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-22T17:52:13.745122] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-22T17:52:13.745167] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-22T17:52:13.745200] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-22T17:52:14.093751] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:52:14.517699] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-22T17:52:14.880623] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-22T17:52:15.125911] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T17:52:15.225475] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-22T17:52:15.234563] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-10-22T17:52:15.234760] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-22T17:52:15.322895] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-22T17:52:15.623009] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-22T17:52:15.623118] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-22T17:52:15.623996] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-22T17:52:15.624060] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-22T17:52:15.625513] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 53800 (keeping 200 days of data) [2025-10-22T17:52:15.943414] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-10-22T17:52:15.943543] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-22T17:52:15.943611] [INFO ] [MAIN ] Update Progress: 418/2367 symbols completed. CCL took 35.7s. Estimated remaining: 4h 3m 20s. Rate: 8.0 symbols/min [2025-10-22T17:52:16.108028] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:52:16.117721] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-22T17:52:16.157986] [DEBUG] [LOCAL ] CDE: Loaded 53644 existing records from primary storage. [2025-10-22T17:52:16.158303] [INFO ] [MAIN ] CDE: Loaded 53644 existing records. [2025-10-22T17:52:16.336159] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:52:16.336461] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-22T17:52:16.336512] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-22T17:52:16.336786] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-22T17:52:16.336843] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-22T17:52:16.497499] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T17:52:16.704272] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:52:16.917673] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-22T17:52:17.133892] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-22T17:52:17.337404] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T17:52:17.717739] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-22T17:52:17.941455] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-22T17:52:18.517692] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-22T17:52:19.317709] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-22T17:52:19.628566] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-22T17:52:19.835183] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T17:52:20.117710] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-22T17:52:20.917687] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-22T17:52:21.384109] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-22T17:52:21.717925] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-22T17:52:21.894326] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T17:52:22.517725] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-22T17:52:23.317707] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-22T17:52:23.543968] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T17:52:23.821410] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-22T17:52:24.117713] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-22T17:52:24.283214] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-22T17:52:24.422749] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-22T17:52:24.917702] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-22T17:52:25.717709] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-22T17:52:26.229127] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T17:52:26.517688] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-22T17:52:27.317743] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-22T17:52:27.676279] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-22T17:52:27.687002] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:52:27.687547] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-22T17:52:27.687696] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:52:27.687788] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-22T17:52:27.687855] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:52:27.687925] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-22T17:52:27.687987] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-22T17:52:27.688023] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-22T17:52:27.688062] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-22T17:52:27.688105] [INFO ] [MAIN ] Update Progress: 419/2367 symbols completed. CCZ took 14.1s. Estimated remaining: 4h 3m 33s. Rate: 8.0 symbols/min [2025-10-22T17:52:27.857220] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:52:27.870867] [DEBUG] [LOCAL ] CDLR: Loaded 10233 existing records from primary storage. [2025-10-22T17:52:27.871121] [INFO ] [MAIN ] CDLR: Loaded 10233 existing records. [2025-10-22T17:52:27.996545] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T17:52:28.091296] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:52:28.091534] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-22T17:52:28.091612] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-22T17:52:28.091844] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-22T17:52:28.091891] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-22T17:52:28.122763] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-22T17:52:28.449867] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:52:28.917715] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-22T17:52:29.608248] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-22T17:52:29.717716] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-22T17:52:30.099057] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-22T17:52:30.360704] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T17:52:30.517719] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-22T17:52:31.317714] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-22T17:52:31.746457] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T17:52:32.117681] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-22T17:52:32.199426] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-22T17:52:32.917687] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-22T17:52:32.958172] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T17:52:33.655890] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-22T17:52:33.717672] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-22T17:52:34.503913] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T17:52:34.517614] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-22T17:52:35.318531] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-22T17:52:35.319417] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T17:52:36.117689] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-22T17:52:36.415922] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T17:52:36.917780] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-22T17:52:37.717704] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-22T17:52:38.119998] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T17:52:38.405237] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T17:52:38.409749] [INFO ] [REMOTE ] CCS: Full fetch complete (44700 records). [2025-10-22T17:52:38.409833] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-22T17:52:38.519580] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-22T17:52:38.576496] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T17:52:38.816781] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-22T17:52:38.816894] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-22T17:52:38.817521] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-22T17:52:38.817563] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-22T17:52:38.818788] [DEBUG] [LOCAL ] CCS: Trimmed 44700 records to 29903 (keeping 200 days of data) [2025-10-22T17:52:39.003407] [DEBUG] [LOCAL ] CCS: Primary data saved (29903 records). [2025-10-22T17:52:39.003552] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-22T17:52:39.003632] [INFO ] [MAIN ] Update Progress: 420/2367 symbols completed. CCS took 40.5s. Estimated remaining: 4h 3m 43s. Rate: 8.0 symbols/min [2025-10-22T17:52:39.168449] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:52:39.205918] [DEBUG] [LOCAL ] CDP: Loaded 42295 existing records from primary storage. [2025-10-22T17:52:39.206211] [INFO ] [MAIN ] CDP: Loaded 42295 existing records. [2025-10-22T17:52:39.322856] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-22T17:52:39.379504] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:52:39.379886] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-22T17:52:39.379935] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-22T17:52:39.380128] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-22T17:52:39.380213] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-22T17:52:39.727066] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:52:40.117760] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-22T17:52:40.564288] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-22T17:52:40.607713] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-22T17:52:40.731722] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T17:52:40.917723] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-22T17:52:41.717694] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-22T17:52:42.517740] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-22T17:52:42.661133] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T17:52:43.234987] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-22T17:52:43.287240] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T17:52:43.317611] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-22T17:52:44.117707] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-22T17:52:44.777241] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T17:52:44.917729] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-22T17:52:45.173905] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T17:52:45.177462] [INFO ] [REMOTE ] CCU: Full fetch complete (32429 records). [2025-10-22T17:52:45.177580] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-22T17:52:45.537458] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-22T17:52:45.537538] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-22T17:52:45.538154] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-22T17:52:45.538218] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-22T17:52:45.539008] [DEBUG] [LOCAL ] CCU: Trimmed 32429 records to 21640 (keeping 200 days of data) [2025-10-22T17:52:45.663566] [DEBUG] [LOCAL ] CCU: Primary data saved (21640 records). [2025-10-22T17:52:45.663723] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-22T17:52:45.663814] [INFO ] [MAIN ] Update Progress: 421/2367 symbols completed. CCU took 35.3s. Estimated remaining: 4h 3m 31s. Rate: 8.0 symbols/min [2025-10-22T17:52:45.728099] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-22T17:52:45.845489] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:52:45.847556] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T17:52:45.874035] [DEBUG] [LOCAL ] CDRE: Loaded 24817 existing records from primary storage. [2025-10-22T17:52:45.874323] [INFO ] [MAIN ] CDRE: Loaded 24817 existing records. [2025-10-22T17:52:46.046174] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:52:46.046423] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-22T17:52:46.046481] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-22T17:52:46.046714] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-22T17:52:46.046770] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-22T17:52:46.391052] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:52:46.517732] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-22T17:52:47.313119] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T17:52:47.321996] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-22T17:52:47.372881] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-22T17:52:48.117741] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-22T17:52:48.917773] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-22T17:52:48.953419] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-22T17:52:49.193757] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T17:52:49.717712] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-22T17:52:50.239436] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T17:52:50.517724] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-22T17:52:51.317670] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-22T17:52:51.635591] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T17:52:51.691357] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T17:52:52.117702] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-22T17:52:52.275399] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T17:52:52.278277] [INFO ] [REMOTE ] CDLR: Full fetch complete (14215 records). [2025-10-22T17:52:52.278347] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-22T17:52:52.681719] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-22T17:52:52.681841] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-22T17:52:52.682371] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-22T17:52:52.682447] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-22T17:52:52.683356] [DEBUG] [LOCAL ] CDLR: Trimmed 14215 records to 10195 (keeping 200 days of data) [2025-10-22T17:52:52.751001] [DEBUG] [LOCAL ] CDLR: Primary data saved (10195 records). [2025-10-22T17:52:52.751158] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-22T17:52:52.751244] [INFO ] [MAIN ] Update Progress: 422/2367 symbols completed. CDLR took 25.1s. Estimated remaining: 4h 3m 22s. Rate: 8.0 symbols/min [2025-10-22T17:52:52.920876] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-22T17:52:53.032176] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:52:53.100597] [DEBUG] [LOCAL ] CE: Loaded 51289 existing records from primary storage. [2025-10-22T17:52:53.101097] [INFO ] [MAIN ] CE: Loaded 51289 existing records. [2025-10-22T17:52:53.325180] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:52:53.325419] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-22T17:52:53.325468] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-22T17:52:53.325719] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-22T17:52:53.325780] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-22T17:52:53.726818] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-22T17:52:53.733417] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:52:53.759463] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T17:52:54.059394] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T17:52:54.517692] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-22T17:52:55.317732] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-22T17:52:55.893511] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T17:52:56.004077] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-22T17:52:56.117706] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-22T17:52:56.917724] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-22T17:52:57.105530] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T17:52:57.717764] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-22T17:52:58.329919] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-22T17:52:58.339020] [INFO ] [REMOTE ] CDE: Full fetch complete (77794 records). [2025-10-22T17:52:58.339141] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-22T17:52:58.521571] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-22T17:52:58.706884] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T17:52:58.813972] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-22T17:52:58.814077] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-22T17:52:58.814960] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-22T17:52:58.815027] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-22T17:52:58.816480] [DEBUG] [LOCAL ] CDE: Trimmed 77794 records to 53644 (keeping 200 days of data) [2025-10-22T17:52:59.138373] [DEBUG] [LOCAL ] CDE: Primary data saved (53644 records). [2025-10-22T17:52:59.138634] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-22T17:52:59.139346] [INFO ] [MAIN ] Update Progress: 423/2367 symbols completed. CDE took 43.2s. Estimated remaining: 4h 3m 9s. Rate: 8.0 symbols/min [2025-10-22T17:52:59.282770] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T17:52:59.328573] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-22T17:52:59.388584] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:52:59.396474] [DEBUG] [LOCAL ] CEE: Loaded 5247 existing records from primary storage. [2025-10-22T17:52:59.396706] [INFO ] [MAIN ] CEE: Loaded 5247 existing records. [2025-10-22T17:52:59.577239] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:52:59.577588] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-22T17:52:59.577763] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-22T17:52:59.578028] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-22T17:52:59.578167] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-22T17:52:59.736166] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T17:52:59.999220] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:00.117709] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-22T17:53:00.598330] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T17:53:00.899188] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T17:53:00.917667] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-22T17:53:01.717699] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-22T17:53:01.821721] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T17:53:02.517711] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-22T17:53:03.045691] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T17:53:03.317697] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-22T17:53:04.117719] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-22T17:53:04.463935] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-22T17:53:04.552889] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-22T17:53:04.917683] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-22T17:53:05.147539] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-22T17:53:05.717695] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-22T17:53:06.400811] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-22T17:53:06.517687] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-22T17:53:06.662313] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T17:53:07.116870] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T17:53:07.317708] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-22T17:53:08.117694] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-22T17:53:08.380993] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T17:53:08.917698] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-22T17:53:09.717683] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-22T17:53:09.810311] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T17:53:09.817437] [INFO ] [REMOTE ] CDP: Full fetch complete (62082 records). [2025-10-22T17:53:09.817573] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-22T17:53:10.210573] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-22T17:53:10.224813] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T17:53:10.224172] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-22T17:53:10.230996] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-22T17:53:10.231474] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-22T17:53:10.232634] [DEBUG] [LOCAL ] CDP: Trimmed 62082 records to 42262 (keeping 200 days of data) [2025-10-22T17:53:10.351459] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-22T17:53:10.498423] [DEBUG] [LOCAL ] CDP: Primary data saved (42262 records). [2025-10-22T17:53:10.498565] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-22T17:53:10.498684] [INFO ] [MAIN ] Update Progress: 424/2367 symbols completed. CDP took 31.5s. Estimated remaining: 4h 3m 19s. Rate: 8.0 symbols/min [2025-10-22T17:53:10.527926] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-22T17:53:10.666735] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:53:10.692821] [DEBUG] [LOCAL ] CEPU: Loaded 27014 existing records from primary storage. [2025-10-22T17:53:10.693084] [INFO ] [MAIN ] CEPU: Loaded 27014 existing records. [2025-10-22T17:53:10.862614] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:53:10.862863] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-22T17:53:10.862909] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-22T17:53:10.863081] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-22T17:53:10.863119] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-22T17:53:11.206907] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:11.317753] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-22T17:53:12.117701] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-22T17:53:12.409941] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T17:53:12.519438] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-22T17:53:12.829631] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T17:53:12.917731] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-22T17:53:13.717695] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-22T17:53:14.518960] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-22T17:53:14.535496] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T17:53:14.542715] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T17:53:15.317711] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-22T17:53:16.045398] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-22T17:53:16.117712] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-22T17:53:16.250755] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T17:53:16.610614] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-22T17:53:16.611733] [INFO ] [REMOTE ] CEE: Full fetch complete (10154 records). [2025-10-22T17:53:16.611802] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-22T17:53:16.612160] [FATAL] [VALIDATOR ] CEE: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:53:16.612240] [FATAL] [MAIN ] CEE: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:53:16.612307] [WARN ] [MAIN ] CEE: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:53:16.612379] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-22T17:53:16.612440] [DEBUG] [LOCAL ] CEE: No primary data file found to delete. [2025-10-22T17:53:16.612476] [INFO ] [LOCAL ] CEE: Starting deletion of derivative data. [2025-10-22T17:53:16.612628] [DEBUG] [LOCAL ] CEE: Deleted derivative data file. [2025-10-22T17:53:16.612736] [INFO ] [MAIN ] Update Progress: 425/2367 symbols completed. CEE took 17.5s. Estimated remaining: 4h 3m 6s. Rate: 8.0 symbols/min [2025-10-22T17:53:16.777918] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:53:16.829375] [DEBUG] [LOCAL ] CF: Loaded 52111 existing records from primary storage. [2025-10-22T17:53:16.829802] [INFO ] [MAIN ] CF: Loaded 52111 existing records. [2025-10-22T17:53:16.924609] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-22T17:53:17.005214] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:53:17.005442] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-22T17:53:17.005521] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-22T17:53:17.005793] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-22T17:53:17.005854] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-22T17:53:17.361288] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:17.717722] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-22T17:53:18.131914] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-22T17:53:18.136590] [INFO ] [REMOTE ] CDRE: Full fetch complete (35019 records). [2025-10-22T17:53:18.136726] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-22T17:53:18.514949] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-22T17:53:18.515106] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-22T17:53:18.516051] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-22T17:53:18.516118] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-22T17:53:18.517318] [DEBUG] [LOCAL ] CDRE: Trimmed 35019 records to 24728 (keeping 200 days of data) [2025-10-22T17:53:18.517833] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-22T17:53:18.682307] [DEBUG] [LOCAL ] CDRE: Primary data saved (24728 records). [2025-10-22T17:53:18.682567] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-22T17:53:18.682712] [INFO ] [MAIN ] Update Progress: 426/2367 symbols completed. CDRE took 33.0s. Estimated remaining: 4h 2m 33s. Rate: 8.0 symbols/min [2025-10-22T17:53:18.860669] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:53:18.913559] [DEBUG] [LOCAL ] CFG: Loaded 53623 existing records from primary storage. [2025-10-22T17:53:18.914037] [INFO ] [MAIN ] CFG: Loaded 53623 existing records. [2025-10-22T17:53:19.096077] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:53:19.096460] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-22T17:53:19.096516] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-22T17:53:19.096942] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-22T17:53:19.097004] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-22T17:53:19.318603] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-22T17:53:19.485238] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:19.524708] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T17:53:20.117716] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-22T17:53:20.193775] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T17:53:20.243491] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-22T17:53:20.917681] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-22T17:53:21.717749] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-22T17:53:21.772759] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T17:53:22.025116] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T17:53:22.517685] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-22T17:53:23.317699] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-22T17:53:23.482951] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T17:53:24.117675] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-22T17:53:24.436492] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-22T17:53:24.463195] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T17:53:24.917726] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-22T17:53:25.717705] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-22T17:53:25.859145] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T17:53:26.378589] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T17:53:26.517714] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-22T17:53:27.192113] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T17:53:27.317708] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-22T17:53:28.117707] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-22T17:53:28.568027] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-22T17:53:28.579809] [INFO ] [REMOTE ] CE: Full fetch complete (74805 records). [2025-10-22T17:53:28.580000] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-22T17:53:28.928155] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-22T17:53:28.976542] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-22T17:53:28.976848] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-22T17:53:28.977829] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-22T17:53:28.977970] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-22T17:53:28.979415] [DEBUG] [LOCAL ] CE: Trimmed 74805 records to 51253 (keeping 200 days of data) [2025-10-22T17:53:29.102546] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T17:53:29.312428] [DEBUG] [LOCAL ] CE: Primary data saved (51253 records). [2025-10-22T17:53:29.312562] [INFO ] [MAIN ] CE: Full history saved. [2025-10-22T17:53:29.312660] [INFO ] [MAIN ] Update Progress: 427/2367 symbols completed. CE took 36.6s. Estimated remaining: 4h 2m 40s. Rate: 8.0 symbols/min [2025-10-22T17:53:29.477357] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:53:29.477499] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-22T17:53:29.477537] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-22T17:53:29.477682] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-22T17:53:29.477734] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-22T17:53:29.477776] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-22T17:53:29.477808] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-22T17:53:29.720562] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-22T17:53:29.830086] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:30.038306] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T17:53:30.382528] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T17:53:30.517733] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-22T17:53:31.317685] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-10-22T17:53:31.464210] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-22T17:53:31.464512] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-10-22T17:53:31.464598] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:53:31.464691] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-22T17:53:31.464769] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:53:31.464852] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-22T17:53:31.464932] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-22T17:53:31.464980] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-22T17:53:31.465037] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-22T17:53:31.465100] [INFO ] [MAIN ] Update Progress: 428/2367 symbols completed. CFND took 2.2s. Estimated remaining: 4h 2m 8s. Rate: 8.0 symbols/min [2025-10-22T17:53:31.644940] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:53:31.678926] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T17:53:31.723008] [DEBUG] [LOCAL ] CFR: Loaded 32535 existing records from primary storage. [2025-10-22T17:53:31.723435] [INFO ] [MAIN ] CFR: Loaded 32535 existing records. [2025-10-22T17:53:31.918842] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:53:31.919264] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-22T17:53:31.919331] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-22T17:53:31.919527] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-22T17:53:31.919589] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-22T17:53:32.125332] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-22T17:53:32.317902] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:32.320002] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T17:53:32.917699] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-22T17:53:33.186838] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-22T17:53:33.717700] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-22T17:53:34.457510] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-22T17:53:34.517671] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-22T17:53:35.123033] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T17:53:35.317692] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-22T17:53:36.055471] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T17:53:36.117614] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-22T17:53:36.674314] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T17:53:36.917725] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-22T17:53:37.717710] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-22T17:53:37.844245] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T17:53:38.517671] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-22T17:53:38.733292] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T17:53:39.205792] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T17:53:39.317674] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-22T17:53:40.036814] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T17:53:40.117698] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-22T17:53:40.758371] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T17:53:40.917690] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-22T17:53:41.717615] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-22T17:53:41.822068] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T17:53:42.517693] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-22T17:53:42.811623] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T17:53:42.869020] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T17:53:43.317700] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-22T17:53:44.117707] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-22T17:53:44.335666] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T17:53:44.557340] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T17:53:44.917785] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-22T17:53:45.440477] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T17:53:45.717754] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-22T17:53:46.517736] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-22T17:53:46.995099] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-22T17:53:47.004091] [INFO ] [REMOTE ] CFG: Full fetch complete (77775 records). [2025-10-22T17:53:47.004240] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-22T17:53:47.325832] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-22T17:53:47.431076] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-22T17:53:47.431421] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-22T17:53:47.432331] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-22T17:53:47.435093] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T17:53:47.433183] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-22T17:53:47.448050] [DEBUG] [LOCAL ] CFG: Trimmed 77775 records to 53623 (keeping 200 days of data) [2025-10-22T17:53:47.558496] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T17:53:47.782823] [DEBUG] [LOCAL ] CFG: Primary data saved (53623 records). [2025-10-22T17:53:47.782957] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-22T17:53:47.783033] [INFO ] [MAIN ] Update Progress: 429/2367 symbols completed. CFG took 29.1s. Estimated remaining: 4h 2m 41s. Rate: 8.0 symbols/min [2025-10-22T17:53:47.947234] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:53:47.984898] [DEBUG] [LOCAL ] CGAU: Loaded 43896 existing records from primary storage. [2025-10-22T17:53:47.985197] [INFO ] [MAIN ] CGAU: Loaded 43896 existing records. [2025-10-22T17:53:48.122779] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-22T17:53:48.159882] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:53:48.160236] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-22T17:53:48.160291] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-22T17:53:48.160493] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-22T17:53:48.160549] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-22T17:53:48.509635] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:48.917685] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-22T17:53:48.950136] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T17:53:49.543511] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T17:53:49.717702] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-22T17:53:50.517750] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-22T17:53:50.732137] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T17:53:50.740474] [INFO ] [REMOTE ] CF: Full fetch complete (75209 records). [2025-10-22T17:53:50.740678] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-22T17:53:50.741506] [FATAL] [VALIDATOR ] CF: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:53:50.741603] [FATAL] [MAIN ] CF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:53:50.741683] [WARN ] [MAIN ] CF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:53:50.741762] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-22T17:53:50.741831] [DEBUG] [LOCAL ] CF: No primary data file found to delete. [2025-10-22T17:53:50.741869] [INFO ] [LOCAL ] CF: Starting deletion of derivative data. [2025-10-22T17:53:50.742059] [DEBUG] [LOCAL ] CF: Deleted derivative data file. [2025-10-22T17:53:50.742602] [INFO ] [MAIN ] Update Progress: 430/2367 symbols completed. CF took 34.1s. Estimated remaining: 4h 2m 13s. Rate: 8.0 symbols/min [2025-10-22T17:53:50.919281] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:53:50.923265] [DEBUG] [LOCAL ] CGV: Loaded 1377 existing records from primary storage. [2025-10-22T17:53:50.923433] [INFO ] [MAIN ] CGV: Loaded 1377 existing records. [2025-10-22T17:53:51.105136] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:53:51.105355] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-22T17:53:51.105558] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-22T17:53:51.105728] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-22T17:53:51.105783] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-22T17:53:51.322946] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-22T17:53:51.351783] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T17:53:51.522695] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:51.904311] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T17:53:51.910199] [INFO ] [REMOTE ] CEPU: Full fetch complete (39731 records). [2025-10-22T17:53:51.910330] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-22T17:53:52.130096] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-22T17:53:52.311826] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-22T17:53:52.311908] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-22T17:53:52.312469] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-22T17:53:52.312512] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-22T17:53:52.313503] [DEBUG] [LOCAL ] CEPU: Trimmed 39731 records to 27008 (keeping 200 days of data) [2025-10-22T17:53:52.467459] [DEBUG] [LOCAL ] CEPU: Primary data saved (27008 records). [2025-10-22T17:53:52.467586] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-22T17:53:52.471400] [INFO ] [MAIN ] Update Progress: 431/2367 symbols completed. CEPU took 42.0s. Estimated remaining: 4h 1m 39s. Rate: 8.0 symbols/min [2025-10-22T17:53:52.645163] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:53:52.670195] [DEBUG] [LOCAL ] CHCT: Loaded 24339 existing records from primary storage. [2025-10-22T17:53:52.670468] [INFO ] [MAIN ] CHCT: Loaded 24339 existing records. [2025-10-22T17:53:52.851610] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:53:52.852102] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-22T17:53:52.852181] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-22T17:53:52.852478] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-22T17:53:52.852624] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-22T17:53:52.921547] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-22T17:53:53.014348] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T17:53:53.293592] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:53:53.539312] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-22T17:53:53.634272] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T17:53:53.717670] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-22T17:53:54.517735] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-22T17:53:55.168425] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T17:53:55.317672] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-22T17:53:55.600415] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T17:53:56.117700] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-22T17:53:56.551940] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-22T17:53:56.767023] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:53:56.917738] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-22T17:53:57.717712] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-22T17:53:58.416424] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T17:53:58.517662] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-22T17:53:58.870263] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T17:53:59.317720] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-22T17:53:59.841920] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T17:54:00.117699] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-22T17:54:00.563400] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-22T17:54:00.734082] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T17:54:00.917712] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-22T17:54:01.717672] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-22T17:54:02.162031] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-22T17:54:02.517701] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-22T17:54:02.776238] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-22T17:54:02.873862] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-22T17:54:02.878836] [INFO ] [REMOTE ] CFR: Full fetch complete (48373 records). [2025-10-22T17:54:02.878961] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-22T17:54:02.879596] [FATAL] [VALIDATOR ] CFR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:54:02.879723] [FATAL] [MAIN ] CFR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:54:02.879798] [WARN ] [MAIN ] CFR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:54:02.879901] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-22T17:54:02.879986] [DEBUG] [LOCAL ] CFR: No primary data file found to delete. [2025-10-22T17:54:02.880035] [INFO ] [LOCAL ] CFR: Starting deletion of derivative data. [2025-10-22T17:54:02.880183] [DEBUG] [LOCAL ] CFR: Deleted derivative data file. [2025-10-22T17:54:02.880278] [INFO ] [MAIN ] Update Progress: 432/2367 symbols completed. CFR took 31.4s. Estimated remaining: 4h 1m 45s. Rate: 8.0 symbols/min [2025-10-22T17:54:03.077686] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:54:03.125170] [DEBUG] [LOCAL ] CHD: Loaded 52328 existing records from primary storage. [2025-10-22T17:54:03.125468] [INFO ] [MAIN ] CHD: Loaded 52328 existing records. [2025-10-22T17:54:03.300893] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:54:03.301115] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-22T17:54:03.301192] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-22T17:54:03.301395] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-22T17:54:03.301453] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-22T17:54:03.323061] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-22T17:54:03.660781] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:54:04.117701] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-22T17:54:04.917710] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-22T17:54:05.075488] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T17:54:05.300434] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T17:54:05.717671] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-22T17:54:06.149795] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-22T17:54:06.347291] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T17:54:06.517702] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-22T17:54:07.317697] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-22T17:54:08.032765] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T17:54:08.117674] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-22T17:54:08.509993] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T17:54:08.917688] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-22T17:54:09.355911] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-22T17:54:09.726226] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-22T17:54:09.732356] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T17:54:10.159233] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-22T17:54:10.517714] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-22T17:54:10.884436] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-22T17:54:11.317721] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-22T17:54:12.117732] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-22T17:54:12.854861] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T17:54:12.917609] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-22T17:54:13.717753] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-22T17:54:14.021355] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T17:54:14.029580] [INFO ] [REMOTE ] CGAU: Full fetch complete (62121 records). [2025-10-22T17:54:14.029727] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-22T17:54:14.413884] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-22T17:54:14.414016] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-22T17:54:14.414799] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-22T17:54:14.414862] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-22T17:54:14.416082] [DEBUG] [LOCAL ] CGAU: Trimmed 62121 records to 43921 (keeping 200 days of data) [2025-10-22T17:54:14.533562] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-22T17:54:14.680428] [DEBUG] [LOCAL ] CGAU: Primary data saved (43921 records). [2025-10-22T17:54:14.680626] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-22T17:54:14.680860] [INFO ] [MAIN ] Update Progress: 433/2367 symbols completed. CGAU took 26.9s. Estimated remaining: 4h 1m 56s. Rate: 8.0 symbols/min [2025-10-22T17:54:14.826838] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-22T17:54:14.912629] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:54:14.929303] [DEBUG] [LOCAL ] CHE: Loaded 15306 existing records from primary storage. [2025-10-22T17:54:14.929551] [INFO ] [MAIN ] CHE: Loaded 15306 existing records. [2025-10-22T17:54:15.025696] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-22T17:54:15.083914] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T17:54:15.148500] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:54:15.149124] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-22T17:54:15.149258] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-22T17:54:15.149570] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-22T17:54:15.149630] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-22T17:54:15.328936] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-22T17:54:15.536976] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:54:16.117728] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-22T17:54:16.652591] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T17:54:16.917691] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-22T17:54:17.095798] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T17:54:17.717671] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-22T17:54:17.987426] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-22T17:54:18.308192] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-22T17:54:18.309036] [INFO ] [REMOTE ] CGV: Full fetch complete (2227 records). [2025-10-22T17:54:18.309105] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-22T17:54:18.524170] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-22T17:54:18.675297] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-22T17:54:18.675380] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-22T17:54:18.675485] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-22T17:54:18.675526] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-22T17:54:18.675878] [DEBUG] [LOCAL ] CGV: Trimmed 2227 records to 1359 (keeping 200 days of data) [2025-10-22T17:54:18.684900] [DEBUG] [LOCAL ] CGV: Primary data saved (1359 records). [2025-10-22T17:54:18.684959] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-22T17:54:18.685024] [INFO ] [MAIN ] Update Progress: 434/2367 symbols completed. CGV took 27.9s. Estimated remaining: 4h 1m 33s. Rate: 8.0 symbols/min [2025-10-22T17:54:18.861272] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:54:18.861705] [DEBUG] [LOCAL ] CHGG: No existing data file found in primary storage. [2025-10-22T17:54:18.861756] [WARN ] [MAIN ] CHGG: No existing data found, performing full refresh instead. [2025-10-22T17:54:18.861895] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-22T17:54:18.861938] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-22T17:54:18.861980] [DEBUG] [LOCAL ] CHGG: No primary data file found to delete. [2025-10-22T17:54:18.862012] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-22T17:54:19.221631] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:54:19.317685] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-22T17:54:19.593987] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T17:54:20.117699] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-22T17:54:20.917704] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-22T17:54:21.088582] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T17:54:21.379441] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T17:54:21.384112] [INFO ] [REMOTE ] CHCT: Full fetch complete (34774 records). [2025-10-22T17:54:21.384261] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-22T17:54:21.722827] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-22T17:54:21.784248] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-22T17:54:21.784328] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-22T17:54:21.784849] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-22T17:54:21.784910] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-22T17:54:21.785842] [DEBUG] [LOCAL ] CHCT: Trimmed 34774 records to 24266 (keeping 200 days of data) [2025-10-22T17:54:21.931206] [DEBUG] [LOCAL ] CHCT: Primary data saved (24266 records). [2025-10-22T17:54:21.931350] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-22T17:54:21.931435] [INFO ] [MAIN ] Update Progress: 435/2367 symbols completed. CHCT took 29.5s. Estimated remaining: 4h 1m 7s. Rate: 8.0 symbols/min [2025-10-22T17:54:22.099190] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:54:22.132273] [DEBUG] [LOCAL ] CHH: Loaded 32272 existing records from primary storage. [2025-10-22T17:54:22.132539] [INFO ] [MAIN ] CHH: Loaded 32272 existing records. [2025-10-22T17:54:22.312232] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:54:22.312471] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-22T17:54:22.312519] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-22T17:54:22.312794] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-22T17:54:22.312851] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-22T17:54:22.529846] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-22T17:54:22.686757] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:54:22.780700] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T17:54:22.815227] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T17:54:23.317706] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-22T17:54:24.117666] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-22T17:54:24.181261] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-22T17:54:24.754103] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-22T17:54:24.917680] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-22T17:54:25.717676] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-22T17:54:25.769542] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T17:54:25.785317] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-22T17:54:26.517744] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-22T17:54:27.317686] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-22T17:54:27.583877] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T17:54:28.117751] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-22T17:54:28.409997] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-22T17:54:28.917685] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-22T17:54:29.033737] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T17:54:29.072225] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T17:54:29.717751] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-22T17:54:30.517740] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-22T17:54:31.126343] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-22T17:54:31.324473] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-22T17:54:31.341983] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T17:54:31.830283] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T17:54:32.033845] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T17:54:32.117695] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-22T17:54:32.917683] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-22T17:54:33.542622] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T17:54:33.717675] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-22T17:54:33.933250] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T17:54:34.517700] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-22T17:54:34.995585] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T17:54:35.317691] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-22T17:54:36.118185] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-22T17:54:36.125507] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T17:54:36.376216] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T17:54:36.917738] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-22T17:54:37.717751] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-22T17:54:37.882836] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T17:54:38.168147] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T17:54:38.517688] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-22T17:54:38.845029] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T17:54:39.317747] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-22T17:54:39.886477] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T17:54:40.117746] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-22T17:54:40.917746] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-22T17:54:41.046894] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T17:54:41.695436] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T17:54:41.717673] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-22T17:54:42.241519] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T17:54:42.517713] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-22T17:54:43.317727] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-22T17:54:43.399044] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T17:54:44.117666] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-22T17:54:44.394611] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T17:54:44.397827] [INFO ] [REMOTE ] CHE: Full fetch complete (20480 records). [2025-10-22T17:54:44.397903] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-22T17:54:44.794018] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-22T17:54:44.841711] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-22T17:54:44.841796] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-22T17:54:44.842225] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-22T17:54:44.842266] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-22T17:54:44.842928] [DEBUG] [LOCAL ] CHE: Trimmed 20480 records to 15327 (keeping 200 days of data) [2025-10-22T17:54:44.917794] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-22T17:54:44.946582] [DEBUG] [LOCAL ] CHE: Primary data saved (15327 records). [2025-10-22T17:54:44.946741] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-22T17:54:44.946840] [INFO ] [MAIN ] Update Progress: 436/2367 symbols completed. CHE took 30.3s. Estimated remaining: 4h 2m 8s. Rate: 8.0 symbols/min [2025-10-22T17:54:45.124275] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:54:45.144262] [DEBUG] [LOCAL ] CHMI: Loaded 21355 existing records from primary storage. [2025-10-22T17:54:45.144507] [INFO ] [MAIN ] CHMI: Loaded 21355 existing records. [2025-10-22T17:54:45.332490] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:54:45.332790] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-22T17:54:45.332864] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-22T17:54:45.333061] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-22T17:54:45.333118] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-22T17:54:45.616399] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T17:54:45.726381] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:54:45.722603] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-22T17:54:46.517685] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-22T17:54:47.293714] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-22T17:54:47.302195] [INFO ] [REMOTE ] CHD: Full fetch complete (75002 records). [2025-10-22T17:54:47.302317] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-22T17:54:47.333807] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-22T17:54:47.700323] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-22T17:54:47.700441] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-22T17:54:47.701349] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-22T17:54:47.701430] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-22T17:54:47.702947] [DEBUG] [LOCAL ] CHD: Trimmed 75002 records to 52320 (keeping 200 days of data) [2025-10-22T17:54:48.026241] [DEBUG] [LOCAL ] CHD: Primary data saved (52320 records). [2025-10-22T17:54:48.026390] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-22T17:54:48.026471] [INFO ] [MAIN ] Update Progress: 437/2367 symbols completed. CHD took 45.1s. Estimated remaining: 4h 1m 41s. Rate: 8.0 symbols/min [2025-10-22T17:54:48.067735] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-22T17:54:48.117703] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-22T17:54:48.593895] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T17:54:48.917705] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-22T17:54:49.052929] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T17:54:49.060227] [INFO ] [REMOTE ] CHH: Full fetch complete (47525 records). [2025-10-22T17:54:49.060468] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-22T17:54:49.469937] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-22T17:54:49.470042] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-22T17:54:49.470907] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-22T17:54:49.470973] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-22T17:54:49.472314] [DEBUG] [LOCAL ] CHH: Trimmed 47525 records to 32225 (keeping 200 days of data) [2025-10-22T17:54:49.704124] [DEBUG] [LOCAL ] CHH: Primary data saved (32225 records). [2025-10-22T17:54:49.704462] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-22T17:54:49.704688] [INFO ] [MAIN ] Update Progress: 438/2367 symbols completed. CHH took 27.8s. Estimated remaining: 4h 1m 8s. Rate: 8.0 symbols/min [2025-10-22T17:54:49.779782] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T17:54:49.790584] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-22T17:54:49.856923] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-22T17:54:50.517687] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-22T17:54:51.581222] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T17:54:51.589081] [INFO ] [REMOTE ] CHGG: Full fetch complete (70042 records). [2025-10-22T17:54:51.589207] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-22T17:54:51.787145] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-22T17:54:51.878519] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-22T17:54:52.003353] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-22T17:54:52.003444] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-22T17:54:52.004292] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-22T17:54:52.004357] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-22T17:54:52.005764] [DEBUG] [LOCAL ] CHGG: Trimmed 70042 records to 47586 (keeping 200 days of data) [2025-10-22T17:54:52.271734] [DEBUG] [LOCAL ] CHGG: Primary data saved (47586 records). [2025-10-22T17:54:52.271885] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-22T17:54:52.271974] [INFO ] [MAIN ] Update Progress: 439/2367 symbols completed. CHGG took 33.6s. Estimated remaining: 4h 0m 39s. Rate: 8.0 symbols/min [2025-10-22T17:54:53.299406] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T17:54:53.305576] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-22T17:54:54.280165] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-22T17:54:54.284561] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-22T17:54:55.356468] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-22T17:54:55.361318] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-22T17:54:56.366160] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T17:54:56.373479] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-22T17:54:57.457319] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-22T17:54:57.461907] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-22T17:54:58.553322] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T17:54:58.558542] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-22T17:54:59.729173] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T17:54:59.732728] [INFO ] [REMOTE ] CHMI: Full fetch complete (31493 records). [2025-10-22T17:54:59.732810] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-22T17:55:00.100060] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-22T17:55:00.100147] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-22T17:55:00.100684] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-22T17:55:00.100746] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-22T17:55:00.101484] [DEBUG] [LOCAL ] CHMI: Trimmed 31493 records to 21188 (keeping 200 days of data) [2025-10-22T17:55:00.225661] [DEBUG] [LOCAL ] CHMI: Primary data saved (21188 records). [2025-10-22T17:55:00.225795] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-22T17:55:00.225874] [INFO ] [MAIN ] Update Progress: 440/2367 symbols completed. CHMI took 15.3s. Estimated remaining: 4h 0m 33s. Rate: 8.0 symbols/min [2025-10-22T17:55:00.822169] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:00.842624] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:00.883906] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:00.935192] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:00.940287] [DEBUG] [LOCAL ] CHN: Loaded 4994 existing records from primary storage. [2025-10-22T17:55:00.940675] [INFO ] [MAIN ] CHN: Loaded 4994 existing records. [2025-10-22T17:55:01.121831] [DEBUG] [LOCAL ] CHT: Loaded 19274 existing records from primary storage. [2025-10-22T17:55:01.176796] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:55:01.153260] [INFO ] [MAIN ] CHT: Loaded 19274 existing records. [2025-10-22T17:55:01.199780] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-22T17:55:01.189563] [DEBUG] [LOCAL ] CHPT: Loaded 47136 existing records from primary storage. [2025-10-22T17:55:01.219390] [INFO ] [MAIN ] CHPT: Loaded 47136 existing records. [2025-10-22T17:55:01.208712] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-22T17:55:01.259242] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-22T17:55:01.283191] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-22T17:55:01.374618] [DEBUG] [LOCAL ] CHWY: Loaded 53656 existing records from primary storage. [2025-10-22T17:55:01.457238] [INFO ] [MAIN ] CHWY: Loaded 53656 existing records. [2025-10-22T17:55:01.703926] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:55:01.827615] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-22T17:55:01.831757] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:55:01.831906] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-22T17:55:01.870240] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-22T17:55:01.918850] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-22T17:55:01.939547] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-22T17:55:01.939679] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-22T17:55:02.085386] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-22T17:55:02.094119] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:55:02.099735] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-22T17:55:02.128625] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-22T17:55:02.137673] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-22T17:55:02.264557] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-22T17:55:02.345852] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:02.313850] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-22T17:55:02.361794] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-22T17:55:03.049887] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:03.096467] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-22T17:55:03.306500] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:03.373616] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-22T17:55:03.381896] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:03.383838] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-22T17:55:03.391912] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-22T17:55:03.394515] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-22T17:55:04.033879] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T17:55:04.035774] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-22T17:55:04.536364] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T17:55:04.540408] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-22T17:55:04.639400] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T17:55:04.641425] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-22T17:55:05.278582] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-22T17:55:05.280426] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-22T17:55:05.419960] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-22T17:55:05.430544] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-22T17:55:05.515013] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-22T17:55:05.525447] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-22T17:55:05.565829] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-22T17:55:05.717638] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-22T17:55:05.896798] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T17:55:06.517713] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-22T17:55:06.763610] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T17:55:07.097823] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-22T17:55:07.324559] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-22T17:55:07.326456] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T17:55:07.533903] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-22T17:55:07.937491] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T17:55:08.117737] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-22T17:55:08.917749] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-22T17:55:09.717726] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-22T17:55:10.313553] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-22T17:55:10.422461] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-22T17:55:10.517697] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-22T17:55:10.767338] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T17:55:11.317699] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-22T17:55:12.117613] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-22T17:55:12.211027] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T17:55:12.455254] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-22T17:55:12.822583] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-22T17:55:12.917711] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-22T17:55:13.675725] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-22T17:55:13.717693] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-22T17:55:14.517704] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-22T17:55:14.580133] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-22T17:55:14.581561] [INFO ] [REMOTE ] CHN: Full fetch complete (7542 records). [2025-10-22T17:55:14.581638] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-22T17:55:14.941618] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-22T17:55:14.941735] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-22T17:55:14.941960] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-22T17:55:14.942003] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-22T17:55:14.942504] [DEBUG] [LOCAL ] CHN: Trimmed 7542 records to 4983 (keeping 200 days of data) [2025-10-22T17:55:14.975078] [DEBUG] [LOCAL ] CHN: Primary data saved (4983 records). [2025-10-22T17:55:14.975244] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-22T17:55:14.975379] [INFO ] [MAIN ] Update Progress: 441/2367 symbols completed. CHN took 14.7s. Estimated remaining: 4h 0m 57s. Rate: 8.0 symbols/min [2025-10-22T17:55:15.160921] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:15.207191] [DEBUG] [LOCAL ] CI: Loaded 49617 existing records from primary storage. [2025-10-22T17:55:15.207503] [INFO ] [MAIN ] CI: Loaded 49617 existing records. [2025-10-22T17:55:15.322987] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-22T17:55:15.414493] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:55:15.414744] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-22T17:55:15.414800] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-22T17:55:15.414992] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-22T17:55:15.415032] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-22T17:55:15.811863] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:16.117693] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-22T17:55:16.473461] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-22T17:55:16.812137] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-22T17:55:16.917688] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-22T17:55:17.717685] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-22T17:55:17.935871] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-22T17:55:18.119040] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T17:55:18.517712] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-22T17:55:19.317639] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-22T17:55:19.689562] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T17:55:19.996537] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-22T17:55:20.117615] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-22T17:55:20.917787] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-22T17:55:21.200630] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T17:55:21.717779] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-22T17:55:21.836525] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T17:55:22.373557] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-22T17:55:22.517697] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-22T17:55:23.317688] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-22T17:55:23.686312] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-22T17:55:24.117681] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-22T17:55:24.311939] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T17:55:24.630925] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T17:55:24.634185] [INFO ] [REMOTE ] CHT: Full fetch complete (27549 records). [2025-10-22T17:55:24.634272] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-22T17:55:24.634832] [FATAL] [VALIDATOR ] CHT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:55:24.634916] [FATAL] [MAIN ] CHT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:55:24.634960] [WARN ] [MAIN ] CHT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:55:24.635047] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-22T17:55:24.635127] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-22T17:55:24.635164] [INFO ] [LOCAL ] CHT: Starting deletion of derivative data. [2025-10-22T17:55:24.635309] [DEBUG] [LOCAL ] CHT: Deleted derivative data file. [2025-10-22T17:55:24.635395] [INFO ] [MAIN ] Update Progress: 442/2367 symbols completed. CHT took 24.4s. Estimated remaining: 4h 0m 59s. Rate: 8.0 symbols/min [2025-10-22T17:55:24.807183] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:24.822903] [DEBUG] [LOCAL ] CIA: Loaded 16533 existing records from primary storage. [2025-10-22T17:55:24.823143] [INFO ] [MAIN ] CIA: Loaded 16533 existing records. [2025-10-22T17:55:24.926297] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-22T17:55:25.008624] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:55:25.008883] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-22T17:55:25.008935] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-22T17:55:25.009087] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-22T17:55:25.009123] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-22T17:55:25.356467] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:25.717677] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-22T17:55:26.018306] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T17:55:26.517697] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-22T17:55:26.609987] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T17:55:26.923590] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T17:55:27.317716] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-22T17:55:28.117669] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-22T17:55:28.171373] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T17:55:28.362537] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-22T17:55:28.917758] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-22T17:55:29.717722] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-22T17:55:29.907276] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T17:55:30.517811] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-22T17:55:30.659522] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T17:55:30.699840] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-22T17:55:31.317703] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-22T17:55:32.117699] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-22T17:55:32.363801] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T17:55:32.917730] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-22T17:55:32.954853] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-22T17:55:32.963791] [INFO ] [REMOTE ] CHPT: Full fetch complete (71128 records). [2025-10-22T17:55:32.963965] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-22T17:55:33.377608] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-22T17:55:33.377764] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-22T17:55:33.378629] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-22T17:55:33.378718] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-22T17:55:33.380118] [DEBUG] [LOCAL ] CHPT: Trimmed 71128 records to 47004 (keeping 200 days of data) [2025-10-22T17:55:33.662082] [DEBUG] [LOCAL ] CHPT: Primary data saved (47004 records). [2025-10-22T17:55:33.662215] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-22T17:55:33.662298] [INFO ] [MAIN ] Update Progress: 443/2367 symbols completed. CHPT took 33.4s. Estimated remaining: 4h 0m 58s. Rate: 8.0 symbols/min [2025-10-22T17:55:33.721705] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-22T17:55:33.789565] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-22T17:55:33.862958] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:33.863226] [DEBUG] [LOCAL ] CIB: No existing data file found in primary storage. [2025-10-22T17:55:33.863290] [WARN ] [MAIN ] CIB: No existing data found, performing full refresh instead. [2025-10-22T17:55:33.863433] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-22T17:55:33.863489] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-22T17:55:33.863534] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-22T17:55:33.863567] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-22T17:55:34.241788] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:34.272578] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-22T17:55:34.517719] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-22T17:55:35.317692] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-22T17:55:35.391104] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T17:55:36.117732] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-22T17:55:36.318809] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T17:55:36.917711] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-22T17:55:37.230000] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-22T17:55:37.238263] [INFO ] [REMOTE ] CHWY: Full fetch complete (77391 records). [2025-10-22T17:55:37.238387] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-22T17:55:37.239201] [FATAL] [VALIDATOR ] CHWY: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:55:37.239294] [FATAL] [MAIN ] CHWY: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:55:37.239336] [WARN ] [MAIN ] CHWY: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:55:37.239377] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-22T17:55:37.239435] [DEBUG] [LOCAL ] CHWY: No primary data file found to delete. [2025-10-22T17:55:37.239470] [INFO ] [LOCAL ] CHWY: Starting deletion of derivative data. [2025-10-22T17:55:37.239596] [DEBUG] [LOCAL ] CHWY: Deleted derivative data file. [2025-10-22T17:55:37.239711] [INFO ] [MAIN ] Update Progress: 444/2367 symbols completed. CHWY took 37.0s. Estimated remaining: 4h 0m 34s. Rate: 8.0 symbols/min [2025-10-22T17:55:37.405296] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:37.405461] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-22T17:55:37.405498] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-22T17:55:37.405604] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-22T17:55:37.405665] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-22T17:55:37.405745] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-22T17:55:37.405797] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-22T17:55:37.723687] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-22T17:55:37.756854] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:38.207847] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-22T17:55:38.283054] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-22T17:55:38.517691] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-22T17:55:39.117608] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-22T17:55:39.118637] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T17:55:39.317669] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-22T17:55:40.117696] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-22T17:55:40.309160] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T17:55:40.917699] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-22T17:55:41.300267] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-22T17:55:41.717743] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-22T17:55:41.890720] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T17:55:42.517775] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-22T17:55:43.162756] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T17:55:43.317714] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-22T17:55:43.723921] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-22T17:55:43.952739] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T17:55:44.117736] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-22T17:55:44.917740] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-22T17:55:45.033465] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T17:55:45.717732] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-22T17:55:46.409249] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T17:55:46.517696] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-22T17:55:46.758767] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T17:55:46.761413] [INFO ] [REMOTE ] CIA: Full fetch complete (23386 records). [2025-10-22T17:55:46.761491] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-22T17:55:47.007893] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-22T17:55:47.124951] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-22T17:55:47.125023] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-22T17:55:47.125463] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-22T17:55:47.125504] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-22T17:55:47.126108] [DEBUG] [LOCAL ] CIA: Trimmed 23386 records to 16492 (keeping 200 days of data) [2025-10-22T17:55:47.212854] [DEBUG] [LOCAL ] CIA: Primary data saved (16492 records). [2025-10-22T17:55:47.212988] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-22T17:55:47.213067] [INFO ] [MAIN ] Update Progress: 445/2367 symbols completed. CIA took 22.6s. Estimated remaining: 4h 0m 37s. Rate: 8.0 symbols/min [2025-10-22T17:55:47.322822] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-22T17:55:47.379761] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:47.428221] [DEBUG] [LOCAL ] CIEN: Loaded 52126 existing records from primary storage. [2025-10-22T17:55:47.428501] [INFO ] [MAIN ] CIEN: Loaded 52126 existing records. [2025-10-22T17:55:47.603358] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:55:47.603545] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-22T17:55:47.603591] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-22T17:55:47.603791] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-22T17:55:47.603876] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-22T17:55:47.949527] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:48.117686] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-22T17:55:48.753110] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T17:55:48.917706] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-22T17:55:49.494180] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-22T17:55:49.717670] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-22T17:55:50.070468] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T17:55:50.517692] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-22T17:55:51.033559] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T17:55:51.317698] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-22T17:55:51.676770] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-22T17:55:52.117681] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-22T17:55:52.238474] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T17:55:52.917712] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-22T17:55:53.207829] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-22T17:55:53.233775] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T17:55:53.717702] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-22T17:55:54.215091] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-22T17:55:54.517692] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-22T17:55:54.846330] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-22T17:55:55.317693] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-22T17:55:55.666397] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-22T17:55:56.117721] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-22T17:55:56.585717] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-22T17:55:56.586464] [INFO ] [REMOTE ] CICB: Full fetch complete (1947 records). [2025-10-22T17:55:56.586531] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-22T17:55:56.771422] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-22T17:55:56.771664] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:55:56.771735] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:55:56.771811] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-22T17:55:56.771884] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-22T17:55:56.771937] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-22T17:55:56.771980] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-22T17:55:56.772036] [INFO ] [MAIN ] Update Progress: 446/2367 symbols completed. CICB took 19.5s. Estimated remaining: 4h 0m 38s. Rate: 8.0 symbols/min [2025-10-22T17:55:56.921575] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-22T17:55:56.939804] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:55:56.940762] [DEBUG] [LOCAL ] CIF: No existing data file found in primary storage. [2025-10-22T17:55:56.940805] [WARN ] [MAIN ] CIF: No existing data found, performing full refresh instead. [2025-10-22T17:55:56.940914] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-22T17:55:56.940954] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-22T17:55:56.940997] [DEBUG] [LOCAL ] CIF: No primary data file found to delete. [2025-10-22T17:55:56.941028] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-22T17:55:57.293515] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:55:57.717723] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-22T17:55:58.517717] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-22T17:55:58.682836] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T17:55:59.180376] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-22T17:55:59.317722] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-22T17:55:59.866857] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-22T17:56:00.117699] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-22T17:56:00.821709] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T17:56:00.917700] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-22T17:56:01.717727] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-22T17:56:01.747360] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T17:56:02.088888] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-22T17:56:02.517685] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-22T17:56:02.788128] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T17:56:02.795419] [INFO ] [REMOTE ] CI: Full fetch complete (71709 records). [2025-10-22T17:56:02.795525] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-22T17:56:02.796167] [FATAL] [VALIDATOR ] CI: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:56:02.796270] [FATAL] [MAIN ] CI: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:56:02.796346] [WARN ] [MAIN ] CI: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:56:02.796443] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-22T17:56:02.796523] [DEBUG] [LOCAL ] CI: No primary data file found to delete. [2025-10-22T17:56:02.796561] [INFO ] [LOCAL ] CI: Starting deletion of derivative data. [2025-10-22T17:56:02.796721] [DEBUG] [LOCAL ] CI: Deleted derivative data file. [2025-10-22T17:56:02.796808] [INFO ] [MAIN ] Update Progress: 447/2367 symbols completed. CI took 47.8s. Estimated remaining: 4h 0m 24s. Rate: 8.0 symbols/min [2025-10-22T17:56:02.967152] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:03.005808] [DEBUG] [LOCAL ] CIG: Loaded 44458 existing records from primary storage. [2025-10-22T17:56:03.006093] [INFO ] [MAIN ] CIG: Loaded 44458 existing records. [2025-10-22T17:56:03.180038] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:56:03.180288] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-22T17:56:03.180342] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-22T17:56:03.180523] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-22T17:56:03.180560] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-22T17:56:03.327979] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-22T17:56:03.551224] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:03.854356] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T17:56:03.859712] [INFO ] [REMOTE ] CIB: Full fetch complete (45442 records). [2025-10-22T17:56:03.859828] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-22T17:56:04.122979] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-22T17:56:04.226908] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-22T17:56:04.226989] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-22T17:56:04.227554] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-22T17:56:04.227594] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-22T17:56:04.228587] [DEBUG] [LOCAL ] CIB: Trimmed 45442 records to 30292 (keeping 200 days of data) [2025-10-22T17:56:04.399695] [DEBUG] [LOCAL ] CIB: Primary data saved (30292 records). [2025-10-22T17:56:04.399875] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-22T17:56:04.399969] [INFO ] [MAIN ] Update Progress: 448/2367 symbols completed. CIB took 30.7s. Estimated remaining: 3h 59m 52s. Rate: 8.0 symbols/min [2025-10-22T17:56:04.607789] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:04.623932] [DEBUG] [LOCAL ] CII: Loaded 15235 existing records from primary storage. [2025-10-22T17:56:04.624175] [INFO ] [MAIN ] CII: Loaded 15235 existing records. [2025-10-22T17:56:04.821765] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:56:04.821998] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-22T17:56:04.822085] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-22T17:56:04.822256] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-22T17:56:04.822295] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-22T17:56:04.926987] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-22T17:56:05.204493] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:05.308911] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-22T17:56:05.565736] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T17:56:05.668992] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T17:56:05.717617] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-22T17:56:06.517690] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-22T17:56:07.197023] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T17:56:07.317726] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-22T17:56:08.117639] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-22T17:56:08.210487] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T17:56:08.487063] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T17:56:08.772627] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-22T17:56:08.917675] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-22T17:56:09.717695] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-22T17:56:09.877510] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-22T17:56:10.517734] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-22T17:56:11.281206] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T17:56:11.317617] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-22T17:56:12.117678] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-22T17:56:12.349992] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T17:56:12.807330] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-22T17:56:12.839427] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T17:56:12.917664] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-22T17:56:13.717709] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-22T17:56:14.452618] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-22T17:56:14.517614] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-22T17:56:14.922003] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T17:56:15.317710] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-22T17:56:15.590099] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-22T17:56:15.917715] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T17:56:16.117712] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-22T17:56:16.551984] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-22T17:56:16.917708] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-22T17:56:17.717691] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-22T17:56:17.830497] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-22T17:56:18.361435] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-22T17:56:18.517673] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-22T17:56:19.317702] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-22T17:56:19.517667] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T17:56:20.117734] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-22T17:56:20.917709] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-22T17:56:20.963451] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T17:56:21.722813] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-22T17:56:21.741992] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T17:56:21.835347] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-22T17:56:22.427872] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-22T17:56:22.517671] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-22T17:56:23.243198] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-22T17:56:23.317669] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-22T17:56:23.951571] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-22T17:56:23.952702] [INFO ] [REMOTE ] CIF: Full fetch complete (6565 records). [2025-10-22T17:56:23.952795] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-22T17:56:24.130218] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-22T17:56:24.317839] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-22T17:56:24.317914] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-22T17:56:24.318103] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-22T17:56:24.318142] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-22T17:56:24.318522] [DEBUG] [LOCAL ] CIF: Trimmed 6565 records to 3978 (keeping 200 days of data) [2025-10-22T17:56:24.341500] [DEBUG] [LOCAL ] CIF: Primary data saved (3978 records). [2025-10-22T17:56:24.341567] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-22T17:56:24.341632] [INFO ] [MAIN ] Update Progress: 449/2367 symbols completed. CIF took 27.6s. Estimated remaining: 4h 0m 37s. Rate: 8.0 symbols/min [2025-10-22T17:56:24.510028] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:24.548409] [DEBUG] [LOCAL ] CIM: Loaded 37513 existing records from primary storage. [2025-10-22T17:56:24.548712] [INFO ] [MAIN ] CIM: Loaded 37513 existing records. [2025-10-22T17:56:24.720248] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:56:24.720465] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-22T17:56:24.720513] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-22T17:56:24.720745] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-22T17:56:24.720802] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-22T17:56:24.928923] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-22T17:56:25.092536] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:25.717708] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-22T17:56:25.819364] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T17:56:26.517729] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-22T17:56:26.541950] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-22T17:56:26.890243] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T17:56:27.317733] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-22T17:56:28.058032] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T17:56:28.117721] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-22T17:56:28.917730] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-22T17:56:29.044472] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T17:56:29.112448] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T17:56:29.717665] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-22T17:56:30.134096] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T17:56:30.517725] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-22T17:56:31.317729] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-22T17:56:31.596357] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T17:56:32.112496] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-22T17:56:32.115990] [INFO ] [REMOTE ] CII: Full fetch complete (22886 records). [2025-10-22T17:56:32.116091] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-22T17:56:32.127822] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-22T17:56:32.409102] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T17:56:32.537840] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-22T17:56:32.537909] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-22T17:56:32.538296] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-22T17:56:32.538335] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-22T17:56:32.538978] [DEBUG] [LOCAL ] CII: Trimmed 22886 records to 15134 (keeping 200 days of data) [2025-10-22T17:56:32.628824] [DEBUG] [LOCAL ] CII: Primary data saved (15134 records). [2025-10-22T17:56:32.628960] [INFO ] [MAIN ] CII: Full history saved. [2025-10-22T17:56:32.629039] [INFO ] [MAIN ] Update Progress: 450/2367 symbols completed. CII took 28.2s. Estimated remaining: 4h 0m 33s. Rate: 8.0 symbols/min [2025-10-22T17:56:32.814811] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:32.820886] [DEBUG] [LOCAL ] CIMN: Loaded 2746 existing records from primary storage. [2025-10-22T17:56:32.821045] [INFO ] [MAIN ] CIMN: Loaded 2746 existing records. [2025-10-22T17:56:32.923712] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-22T17:56:33.031760] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:56:33.031982] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-22T17:56:33.032028] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-22T17:56:33.032183] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-22T17:56:33.032236] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-22T17:56:33.412728] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:33.717756] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-22T17:56:34.235250] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-22T17:56:34.244059] [INFO ] [REMOTE ] CIEN: Full fetch complete (75850 records). [2025-10-22T17:56:34.244197] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-22T17:56:34.519317] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-22T17:56:34.620888] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T17:56:34.678409] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-22T17:56:34.678482] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-22T17:56:34.679279] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-22T17:56:34.679343] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-22T17:56:34.680632] [DEBUG] [LOCAL ] CIEN: Trimmed 75850 records to 52121 (keeping 200 days of data) [2025-10-22T17:56:34.988035] [DEBUG] [LOCAL ] CIEN: Primary data saved (52121 records). [2025-10-22T17:56:34.988168] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-22T17:56:34.988777] [INFO ] [MAIN ] Update Progress: 451/2367 symbols completed. CIEN took 47.8s. Estimated remaining: 4h 0m 3s. Rate: 8.0 symbols/min [2025-10-22T17:56:35.162816] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:35.163357] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-22T17:56:35.163534] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-22T17:56:35.163790] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-22T17:56:35.163849] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-22T17:56:35.163894] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-22T17:56:35.163928] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-22T17:56:35.249608] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T17:56:35.324546] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-22T17:56:35.319257] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T17:56:35.577612] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:35.833676] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-22T17:56:36.117706] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-22T17:56:36.618769] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-22T17:56:36.917672] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-22T17:56:37.344164] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-22T17:56:37.717796] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-22T17:56:38.517724] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-22T17:56:38.980141] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T17:56:39.226446] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T17:56:39.317695] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-22T17:56:40.117754] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-22T17:56:40.917716] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-22T17:56:41.132384] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T17:56:41.162022] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T17:56:41.171278] [INFO ] [REMOTE ] CIG: Full fetch complete (62727 records). [2025-10-22T17:56:41.171387] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-22T17:56:41.456163] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-22T17:56:41.556489] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-22T17:56:41.556574] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-22T17:56:41.557281] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-22T17:56:41.557343] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-22T17:56:41.558620] [DEBUG] [LOCAL ] CIG: Trimmed 62727 records to 44526 (keeping 200 days of data) [2025-10-22T17:56:41.717960] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-22T17:56:41.819350] [DEBUG] [LOCAL ] CIG: Primary data saved (44526 records). [2025-10-22T17:56:41.819515] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-22T17:56:41.819615] [INFO ] [MAIN ] Update Progress: 452/2367 symbols completed. CIG took 39.0s. Estimated remaining: 3h 59m 53s. Rate: 8.0 symbols/min [2025-10-22T17:56:41.999992] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:42.000158] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-22T17:56:42.000195] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-22T17:56:42.000302] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-22T17:56:42.000343] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-22T17:56:42.000387] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-22T17:56:42.000445] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-22T17:56:42.344807] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:42.517683] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-22T17:56:42.590050] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-22T17:56:43.317733] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-22T17:56:43.722030] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T17:56:43.881774] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-22T17:56:44.117778] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-22T17:56:44.734340] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T17:56:44.917718] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-22T17:56:45.486702] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-22T17:56:45.717720] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-22T17:56:46.216304] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-22T17:56:46.517719] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-22T17:56:46.995129] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-22T17:56:47.317727] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-22T17:56:47.774735] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-22T17:56:48.117716] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-10-22T17:56:48.320833] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:56:48.321182] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-10-22T17:56:48.321307] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:56:48.321391] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-22T17:56:48.321469] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:56:48.321554] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-22T17:56:48.321630] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-22T17:56:48.321723] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-22T17:56:48.321786] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-22T17:56:48.321844] [INFO ] [MAIN ] Update Progress: 453/2367 symbols completed. CIMP took 6.5s. Estimated remaining: 3h 59m 41s. Rate: 8.0 symbols/min [2025-10-22T17:56:48.506122] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:48.525543] [DEBUG] [LOCAL ] CINT: Loaded 20318 existing records from primary storage. [2025-10-22T17:56:48.525818] [INFO ] [MAIN ] CINT: Loaded 20318 existing records. [2025-10-22T17:56:48.705575] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:56:48.705816] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-22T17:56:48.705864] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-22T17:56:48.706129] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-22T17:56:48.706184] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-22T17:56:48.922894] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-22T17:56:49.060063] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:49.717707] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-22T17:56:50.517690] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-22T17:56:50.549443] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T17:56:50.816895] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T17:56:50.954303] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-22T17:56:51.317713] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-22T17:56:51.801072] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-22T17:56:52.117719] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-22T17:56:52.554338] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T17:56:52.917740] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-22T17:56:53.554766] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T17:56:53.555814] [INFO ] [REMOTE ] CIMN: Full fetch complete (3914 records). [2025-10-22T17:56:53.555882] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-22T17:56:53.721023] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-22T17:56:53.922870] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-22T17:56:53.922945] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-22T17:56:53.923075] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-22T17:56:53.923114] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-22T17:56:53.923452] [DEBUG] [LOCAL ] CIMN: Trimmed 3914 records to 2705 (keeping 200 days of data) [2025-10-22T17:56:53.939761] [DEBUG] [LOCAL ] CIMN: Primary data saved (2705 records). [2025-10-22T17:56:53.939840] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-22T17:56:53.939909] [INFO ] [MAIN ] Update Progress: 454/2367 symbols completed. CIMN took 21.3s. Estimated remaining: 3h 59m 26s. Rate: 8.0 symbols/min [2025-10-22T17:56:54.111180] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:54.136055] [DEBUG] [LOCAL ] CIO: Loaded 21132 existing records from primary storage. [2025-10-22T17:56:54.136299] [INFO ] [MAIN ] CIO: Loaded 21132 existing records. [2025-10-22T17:56:54.312197] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:56:54.312439] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-22T17:56:54.312498] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-22T17:56:54.312711] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-22T17:56:54.312767] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-22T17:56:54.524631] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-22T17:56:54.676819] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:54.860604] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-22T17:56:54.969410] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-22T17:56:55.317743] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-22T17:56:56.117706] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-22T17:56:56.199303] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-22T17:56:56.804025] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-22T17:56:56.917679] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-22T17:56:57.639042] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-22T17:56:57.640143] [INFO ] [REMOTE ] CIMO: Full fetch complete (4559 records). [2025-10-22T17:56:57.640211] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-22T17:56:57.722874] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-22T17:56:57.818828] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T17:56:57.819044] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:56:57.819098] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:56:57.819138] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-22T17:56:57.819200] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-22T17:56:57.819236] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-22T17:56:57.819276] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-22T17:56:57.819330] [INFO ] [MAIN ] Update Progress: 455/2367 symbols completed. CIMO took 22.8s. Estimated remaining: 3h 59m 3s. Rate: 8.0 symbols/min [2025-10-22T17:56:57.987452] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:56:58.015090] [DEBUG] [LOCAL ] CION: Loaded 28277 existing records from primary storage. [2025-10-22T17:56:58.015331] [INFO ] [MAIN ] CION: Loaded 28277 existing records. [2025-10-22T17:56:58.193567] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:56:58.193822] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-22T17:56:58.193871] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-22T17:56:58.194061] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-22T17:56:58.194115] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-22T17:56:58.519356] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-22T17:56:58.540639] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:56:58.895266] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T17:56:59.317703] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-22T17:56:59.895759] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T17:57:00.117730] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-22T17:57:00.319926] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-22T17:57:00.917759] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-22T17:57:01.594213] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T17:57:01.717708] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-22T17:57:02.517683] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-22T17:57:02.829784] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T17:57:03.317696] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-22T17:57:03.456989] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-22T17:57:04.117739] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-22T17:57:04.655435] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-22T17:57:04.917725] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-22T17:57:05.370816] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-22T17:57:05.618998] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T17:57:05.650094] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T17:57:05.717678] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-22T17:57:06.517702] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-22T17:57:07.061490] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T17:57:07.317705] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-22T17:57:07.467046] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T17:57:08.117696] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-22T17:57:08.811093] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T17:57:08.917686] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-22T17:57:09.297964] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T17:57:09.717731] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-22T17:57:10.062731] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T17:57:10.517716] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-22T17:57:10.877718] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T17:57:11.317617] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-22T17:57:11.744100] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T17:57:12.117696] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-22T17:57:12.505932] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T17:57:12.511057] [INFO ] [REMOTE ] CINT: Full fetch complete (28413 records). [2025-10-22T17:57:12.511142] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-22T17:57:12.895879] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-22T17:57:12.895958] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-22T17:57:12.896466] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-22T17:57:12.896509] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-22T17:57:12.897261] [DEBUG] [LOCAL ] CINT: Trimmed 28413 records to 20384 (keeping 200 days of data) [2025-10-22T17:57:12.940158] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-22T17:57:13.011397] [DEBUG] [LOCAL ] CINT: Primary data saved (20384 records). [2025-10-22T17:57:13.011517] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-22T17:57:13.011594] [INFO ] [MAIN ] Update Progress: 456/2367 symbols completed. CINT took 24.7s. Estimated remaining: 3h 59m 28s. Rate: 8.0 symbols/min [2025-10-22T17:57:13.190231] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:57:13.238684] [DEBUG] [LOCAL ] CIVI: Loaded 52734 existing records from primary storage. [2025-10-22T17:57:13.239006] [INFO ] [MAIN ] CIVI: Loaded 52734 existing records. [2025-10-22T17:57:13.449369] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T17:57:13.448355] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:57:13.455901] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-22T17:57:13.456234] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-22T17:57:13.456434] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-22T17:57:13.456472] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-22T17:57:13.726570] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-22T17:57:13.814771] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:57:14.451346] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T17:57:14.458062] [INFO ] [REMOTE ] CIM: Full fetch complete (54834 records). [2025-10-22T17:57:14.458216] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-22T17:57:14.522768] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-22T17:57:14.838155] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-22T17:57:14.838254] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-22T17:57:14.838923] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-22T17:57:14.838984] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-22T17:57:14.840243] [DEBUG] [LOCAL ] CIM: Trimmed 54834 records to 37394 (keeping 200 days of data) [2025-10-22T17:57:15.058864] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T17:57:15.091246] [DEBUG] [LOCAL ] CIM: Primary data saved (37394 records). [2025-10-22T17:57:15.091370] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-22T17:57:15.091446] [INFO ] [MAIN ] Update Progress: 457/2367 symbols completed. CIM took 50.7s. Estimated remaining: 3h 58m 57s. Rate: 8.0 symbols/min [2025-10-22T17:57:15.262923] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:57:15.312333] [DEBUG] [LOCAL ] CL: Loaded 53649 existing records from primary storage. [2025-10-22T17:57:15.312718] [INFO ] [MAIN ] CL: Loaded 53649 existing records. [2025-10-22T17:57:15.317674] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-22T17:57:15.498540] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:57:15.498816] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-22T17:57:15.498872] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-22T17:57:15.499083] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-22T17:57:15.499174] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-22T17:57:15.862737] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:57:16.117743] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-22T17:57:16.382094] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T17:57:16.512050] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T17:57:16.917715] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-22T17:57:17.661301] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T17:57:17.717682] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-22T17:57:17.788330] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-22T17:57:18.517740] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-22T17:57:19.308918] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T17:57:19.318630] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-22T17:57:20.117710] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-22T17:57:20.193147] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T17:57:20.218305] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-22T17:57:20.917711] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-22T17:57:21.674681] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T17:57:21.717737] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-22T17:57:22.517741] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-22T17:57:22.720989] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T17:57:23.002007] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T17:57:23.006590] [INFO ] [REMOTE ] CION: Full fetch complete (40618 records). [2025-10-22T17:57:23.006696] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-22T17:57:23.324637] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-22T17:57:23.374283] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-22T17:57:23.374369] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-22T17:57:23.374925] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-22T17:57:23.374986] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-22T17:57:23.375826] [DEBUG] [LOCAL ] CION: Trimmed 40618 records to 28073 (keeping 200 days of data) [2025-10-22T17:57:23.539528] [DEBUG] [LOCAL ] CION: Primary data saved (28073 records). [2025-10-22T17:57:23.539694] [INFO ] [MAIN ] CION: Full history saved. [2025-10-22T17:57:23.539786] [INFO ] [MAIN ] Update Progress: 458/2367 symbols completed. CION took 25.7s. Estimated remaining: 3h 58m 54s. Rate: 8.0 symbols/min [2025-10-22T17:57:23.705611] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:57:23.743064] [DEBUG] [LOCAL ] CLB: Loaded 33495 existing records from primary storage. [2025-10-22T17:57:23.743354] [INFO ] [MAIN ] CLB: Loaded 33495 existing records. [2025-10-22T17:57:23.916845] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:57:23.917067] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-22T17:57:23.917114] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-22T17:57:23.917318] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-22T17:57:23.917374] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-22T17:57:24.122757] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-22T17:57:24.273012] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:57:24.552701] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T17:57:24.781710] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-22T17:57:24.917667] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-22T17:57:25.717705] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-22T17:57:25.892362] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T17:57:25.949403] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-22T17:57:26.517718] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-22T17:57:26.936363] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T17:57:27.317691] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-22T17:57:28.117610] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-22T17:57:28.199249] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T17:57:28.565729] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T17:57:28.917714] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-22T17:57:29.694034] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T17:57:29.717724] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-22T17:57:30.096051] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T17:57:30.517757] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-22T17:57:31.317693] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-22T17:57:31.521592] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:57:31.586210] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T17:57:32.117731] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-22T17:57:32.917722] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-22T17:57:33.102204] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T17:57:33.236396] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T17:57:33.727281] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-22T17:57:33.728634] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T17:57:34.517718] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-22T17:57:35.317763] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-22T17:57:35.628315] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T17:57:35.766414] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T17:57:36.117763] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-22T17:57:36.856533] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T17:57:36.861806] [INFO ] [REMOTE ] CIO: Full fetch complete (29790 records). [2025-10-22T17:57:36.861901] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-22T17:57:36.925380] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-22T17:57:37.269951] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-22T17:57:37.270080] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-22T17:57:37.270616] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-22T17:57:37.270704] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-22T17:57:37.271499] [DEBUG] [LOCAL ] CIO: Trimmed 29790 records to 21207 (keeping 200 days of data) [2025-10-22T17:57:37.386127] [DEBUG] [LOCAL ] CIO: Primary data saved (21207 records). [2025-10-22T17:57:37.386250] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-22T17:57:37.386324] [INFO ] [MAIN ] Update Progress: 459/2367 symbols completed. CIO took 43.4s. Estimated remaining: 3h 59m 13s. Rate: 8.0 symbols/min [2025-10-22T17:57:37.555067] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:57:37.568534] [DEBUG] [LOCAL ] CLCO: Loaded 13154 existing records from primary storage. [2025-10-22T17:57:37.569039] [INFO ] [MAIN ] CLCO: Loaded 13154 existing records. [2025-10-22T17:57:37.722421] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-22T17:57:37.755414] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:57:37.756842] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-22T17:57:37.756963] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-22T17:57:37.757205] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-22T17:57:37.757353] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-22T17:57:38.190891] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:57:38.195815] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-22T17:57:38.517691] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-22T17:57:38.722271] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T17:57:39.179890] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T17:57:39.317721] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-22T17:57:40.117748] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-22T17:57:40.499762] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T17:57:40.917749] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-22T17:57:41.109207] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T17:57:41.368078] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T17:57:41.717702] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-22T17:57:42.517751] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-22T17:57:42.872150] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T17:57:42.881317] [INFO ] [REMOTE ] CL: Full fetch complete (77818 records). [2025-10-22T17:57:42.881471] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-22T17:57:43.259676] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T17:57:43.329587] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-22T17:57:43.334323] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-22T17:57:43.335266] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-22T17:57:43.336350] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-22T17:57:43.336533] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-22T17:57:43.338118] [DEBUG] [LOCAL ] CL: Trimmed 77818 records to 53649 (keeping 200 days of data) [2025-10-22T17:57:43.665994] [DEBUG] [LOCAL ] CL: Primary data saved (53649 records). [2025-10-22T17:57:43.666130] [INFO ] [MAIN ] CL: Full history saved. [2025-10-22T17:57:43.666252] [INFO ] [MAIN ] Update Progress: 460/2367 symbols completed. CL took 28.6s. Estimated remaining: 3h 58m 60s. Rate: 8.0 symbols/min [2025-10-22T17:57:43.831686] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:57:43.855302] [DEBUG] [LOCAL ] CLDT: Loaded 25283 existing records from primary storage. [2025-10-22T17:57:43.855539] [INFO ] [MAIN ] CLDT: Loaded 25283 existing records. [2025-10-22T17:57:44.048320] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:57:44.048593] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-22T17:57:44.048677] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-22T17:57:44.048874] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-22T17:57:44.048913] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-22T17:57:44.123570] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-22T17:57:44.448369] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:57:44.483397] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-22T17:57:44.484428] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T17:57:44.497716] [INFO ] [REMOTE ] CIVI: Full fetch complete (76084 records). [2025-10-22T17:57:44.497842] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-22T17:57:44.890423] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-22T17:57:44.890505] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-22T17:57:44.891360] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-22T17:57:44.891425] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-22T17:57:44.892813] [DEBUG] [LOCAL ] CIVI: Trimmed 76084 records to 52730 (keeping 200 days of data) [2025-10-22T17:57:44.950160] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-22T17:57:45.231811] [DEBUG] [LOCAL ] CIVI: Primary data saved (52730 records). [2025-10-22T17:57:45.232029] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-22T17:57:45.232224] [INFO ] [MAIN ] Update Progress: 461/2367 symbols completed. CIVI took 32.2s. Estimated remaining: 3h 58m 28s. Rate: 8.0 symbols/min [2025-10-22T17:57:45.405570] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:57:45.455472] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-22T17:57:45.455825] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-22T17:57:45.636935] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:57:45.637263] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-22T17:57:45.637455] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-22T17:57:45.644111] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-22T17:57:45.655169] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-22T17:57:45.720603] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-22T17:57:45.699619] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T17:57:46.033722] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:57:46.161146] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T17:57:46.503880] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T17:57:46.517616] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-22T17:57:47.317715] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-22T17:57:47.615613] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T17:57:48.107068] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T17:57:48.117613] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-22T17:57:48.917727] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-22T17:57:49.092038] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-22T17:57:49.717795] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-22T17:57:50.152448] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T17:57:50.517764] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-22T17:57:50.944711] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-22T17:57:51.317691] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-22T17:57:51.942389] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-22T17:57:51.948314] [INFO ] [REMOTE ] CLB: Full fetch complete (47321 records). [2025-10-22T17:57:51.948410] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-22T17:57:52.125510] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-22T17:57:52.324989] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-22T17:57:52.325073] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-22T17:57:52.325677] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-22T17:57:52.325738] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-22T17:57:52.326708] [DEBUG] [LOCAL ] CLB: Trimmed 47321 records to 33453 (keeping 200 days of data) [2025-10-22T17:57:52.520496] [DEBUG] [LOCAL ] CLB: Primary data saved (33453 records). [2025-10-22T17:57:52.520614] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-22T17:57:52.521216] [INFO ] [MAIN ] Update Progress: 462/2367 symbols completed. CLB took 29.0s. Estimated remaining: 3h 58m 19s. Rate: 8.0 symbols/min [2025-10-22T17:57:52.688639] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:57:52.715970] [DEBUG] [LOCAL ] CLH: Loaded 27711 existing records from primary storage. [2025-10-22T17:57:52.716221] [INFO ] [MAIN ] CLH: Loaded 27711 existing records. [2025-10-22T17:57:52.892481] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:57:52.892770] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-22T17:57:52.892851] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-22T17:57:52.893065] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-22T17:57:52.893132] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-22T17:57:52.923176] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-22T17:57:53.014543] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T17:57:53.267483] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:57:53.557768] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-22T17:57:53.717672] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-22T17:57:53.846375] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-22T17:57:54.517694] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-22T17:57:54.618863] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-22T17:57:55.317715] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-22T17:57:56.117729] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-22T17:57:56.431860] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T17:57:56.877809] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-22T17:57:56.914636] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T17:57:56.923463] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-22T17:57:57.717712] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-22T17:57:58.081825] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T17:57:58.517722] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-22T17:57:59.317697] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-22T17:57:59.483920] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T17:57:59.599812] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T17:58:00.117716] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-22T17:58:00.149933] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T17:58:00.917753] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-22T17:58:01.671758] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T17:58:01.717849] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-22T17:58:02.320169] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T17:58:02.517777] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-22T17:58:03.317743] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-22T17:58:03.972608] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T17:58:03.976349] [INFO ] [REMOTE ] CLCO: Full fetch complete (22657 records). [2025-10-22T17:58:03.976424] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-22T17:58:03.976899] [FATAL] [VALIDATOR ] CLCO: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T17:58:03.976996] [FATAL] [MAIN ] CLCO: Fetched primary data is invalid. Refusing to save it. [2025-10-22T17:58:03.977067] [WARN ] [MAIN ] CLCO: Deleting existing primary and derivative data due to validation failure. [2025-10-22T17:58:03.977168] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-22T17:58:03.977247] [DEBUG] [LOCAL ] CLCO: No primary data file found to delete. [2025-10-22T17:58:03.977285] [INFO ] [LOCAL ] CLCO: Starting deletion of derivative data. [2025-10-22T17:58:03.977434] [DEBUG] [LOCAL ] CLCO: Deleted derivative data file. [2025-10-22T17:58:03.977518] [INFO ] [MAIN ] Update Progress: 463/2367 symbols completed. CLCO took 26.6s. Estimated remaining: 3h 58m 28s. Rate: 8.0 symbols/min [2025-10-22T17:58:04.123028] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-22T17:58:04.150891] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:58:04.165170] [DEBUG] [LOCAL ] CLPR: Loaded 10065 existing records from primary storage. [2025-10-22T17:58:04.165379] [INFO ] [MAIN ] CLPR: Loaded 10065 existing records. [2025-10-22T17:58:04.345705] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:58:04.346221] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-22T17:58:04.346320] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-22T17:58:04.357893] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-22T17:58:04.363114] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-22T17:58:04.444431] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-10-22T17:58:04.756530] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:58:04.773458] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T17:58:04.917684] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-22T17:58:05.717675] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-22T17:58:05.800604] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T17:58:05.848527] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-22T17:58:06.517717] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-22T17:58:07.076977] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T17:58:07.317695] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-22T17:58:07.609838] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T17:58:08.059754] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-22T17:58:08.117619] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-22T17:58:08.917751] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-22T17:58:09.127365] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-22T17:58:09.717713] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-22T17:58:10.188313] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T17:58:10.192946] [INFO ] [REMOTE ] CLDT: Full fetch complete (37642 records). [2025-10-22T17:58:10.193032] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-22T17:58:10.522812] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-22T17:58:10.596784] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-22T17:58:10.596866] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-22T17:58:10.597466] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-22T17:58:10.597508] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-22T17:58:10.598535] [DEBUG] [LOCAL ] CLDT: Trimmed 37642 records to 25165 (keeping 200 days of data) [2025-10-22T17:58:10.669167] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-22T17:58:10.762025] [DEBUG] [LOCAL ] CLDT: Primary data saved (25165 records). [2025-10-22T17:58:10.762172] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-22T17:58:10.762252] [INFO ] [MAIN ] Update Progress: 464/2367 symbols completed. CLDT took 27.1s. Estimated remaining: 3h 58m 18s. Rate: 8.0 symbols/min [2025-10-22T17:58:10.926324] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:58:10.975414] [DEBUG] [LOCAL ] CLS: Loaded 53563 existing records from primary storage. [2025-10-22T17:58:10.975762] [INFO ] [MAIN ] CLS: Loaded 53563 existing records. [2025-10-22T17:58:11.147796] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:58:11.147990] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-22T17:58:11.148035] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-22T17:58:11.148216] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-22T17:58:11.148252] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-22T17:58:11.320606] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-22T17:58:11.500021] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:58:12.008742] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T17:58:12.117681] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-22T17:58:12.161684] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-22T17:58:12.917709] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-22T17:58:13.717699] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-22T17:58:14.069834] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T17:58:14.254401] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-22T17:58:14.463609] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-22T17:58:14.517709] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-22T17:58:15.317713] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-22T17:58:15.723799] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T17:58:16.117676] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-22T17:58:16.267849] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T17:58:16.917729] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-22T17:58:17.717719] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-22T17:58:17.923269] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T17:58:18.029674] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-22T17:58:18.517678] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-22T17:58:18.526868] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-22T17:58:19.317677] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-22T17:58:20.117697] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-22T17:58:20.701502] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-22T17:58:20.775732] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-22T17:58:20.917712] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-22T17:58:21.606894] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-22T17:58:21.717697] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-22T17:58:22.137953] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-22T17:58:22.517725] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-22T17:58:23.317765] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-22T17:58:23.496961] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T17:58:24.117755] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-22T17:58:24.553909] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-22T17:58:24.554457] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-22T17:58:24.917735] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-22T17:58:25.717676] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-22T17:58:26.261370] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-22T17:58:26.286751] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-22T17:58:26.291915] [INFO ] [REMOTE ] CLH: Full fetch complete (42203 records). [2025-10-22T17:58:26.292001] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-22T17:58:26.524356] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-22T17:58:26.653875] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-22T17:58:26.653950] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-22T17:58:26.654468] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-22T17:58:26.654508] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-22T17:58:26.655352] [DEBUG] [LOCAL ] CLH: Trimmed 42203 records to 27584 (keeping 200 days of data) [2025-10-22T17:58:26.816790] [DEBUG] [LOCAL ] CLH: Primary data saved (27584 records). [2025-10-22T17:58:26.816923] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-22T17:58:26.817002] [INFO ] [MAIN ] Update Progress: 465/2367 symbols completed. CLH took 34.3s. Estimated remaining: 3h 58m 45s. Rate: 8.0 symbols/min [2025-10-22T17:58:26.980305] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:58:27.033541] [DEBUG] [LOCAL ] CLVT: Loaded 51913 existing records from primary storage. [2025-10-22T17:58:27.033903] [INFO ] [MAIN ] CLVT: Loaded 51913 existing records. [2025-10-22T17:58:27.205881] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:58:27.206064] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-22T17:58:27.206109] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-22T17:58:27.206293] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-22T17:58:27.206329] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-22T17:58:27.322843] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-22T17:58:27.581742] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:58:27.739091] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-22T17:58:28.117780] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-22T17:58:28.370352] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T17:58:28.372159] [INFO ] [REMOTE ] CLPR: Full fetch complete (15908 records). [2025-10-22T17:58:28.372258] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-22T17:58:28.754817] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-22T17:58:28.755008] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-22T17:58:28.755528] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-22T17:58:28.755629] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-22T17:58:28.756399] [DEBUG] [LOCAL ] CLPR: Trimmed 15908 records to 9996 (keeping 200 days of data) [2025-10-22T17:58:28.812717] [DEBUG] [LOCAL ] CLPR: Primary data saved (9996 records). [2025-10-22T17:58:28.812844] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-22T17:58:28.812920] [INFO ] [MAIN ] Update Progress: 466/2367 symbols completed. CLPR took 24.8s. Estimated remaining: 3h 58m 15s. Rate: 8.0 symbols/min [2025-10-22T17:58:28.917770] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-22T17:58:28.990939] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:58:29.017575] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-22T17:58:29.031675] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-22T17:58:29.031870] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-22T17:58:29.133582] [DEBUG] [LOCAL ] CLW: Loaded 21289 existing records from primary storage. [2025-10-22T17:58:29.144015] [INFO ] [MAIN ] CLW: Loaded 21289 existing records. [2025-10-22T17:58:29.498193] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:58:29.516311] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-22T17:58:29.524483] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-22T17:58:29.527138] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-22T17:58:29.527198] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-22T17:58:29.774897] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-22T17:58:29.810148] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-22T17:58:29.846257] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-22T17:58:29.858490] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-22T17:58:29.994246] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 53741 (keeping 200 days of data) [2025-10-22T17:58:30.039664] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:58:30.043195] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-22T17:58:30.047245] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T17:58:30.373958] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-10-22T17:58:30.374102] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-22T17:58:30.374182] [INFO ] [MAIN ] Update Progress: 467/2367 symbols completed. CLF took 45.1s. Estimated remaining: 3h 57m 43s. Rate: 8.0 symbols/min [2025-10-22T17:58:30.522742] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-22T17:58:30.604508] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:58:30.656264] [DEBUG] [LOCAL ] CLX: Loaded 51811 existing records from primary storage. [2025-10-22T17:58:30.656627] [INFO ] [MAIN ] CLX: Loaded 51811 existing records. [2025-10-22T17:58:30.843123] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:58:30.843394] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-22T17:58:30.843443] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-22T17:58:30.843685] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-22T17:58:30.843743] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-22T17:58:31.245896] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:58:31.285249] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-22T17:58:31.317714] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-22T17:58:31.457679] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T17:58:32.117688] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-22T17:58:32.189076] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T17:58:32.917673] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-22T17:58:32.951662] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T17:58:33.282605] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T17:58:33.717705] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-22T17:58:34.517713] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-22T17:58:34.725356] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T17:58:35.317691] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-22T17:58:35.478092] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T17:58:35.637175] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T17:58:36.117738] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-22T17:58:36.917739] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-22T17:58:36.970441] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-22T17:58:37.717745] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-22T17:58:37.854008] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T17:58:38.517733] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-22T17:58:38.953595] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-22T17:58:38.991316] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-22T17:58:39.317772] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-22T17:58:40.117688] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-22T17:58:40.222732] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T17:58:40.437683] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T17:58:40.921584] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-22T17:58:41.717789] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-22T17:58:42.070476] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T17:58:42.517699] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-22T17:58:42.801527] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T17:58:43.317712] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-22T17:58:43.576279] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-22T17:58:43.882166] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-22T17:58:44.117727] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-22T17:58:44.917734] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-22T17:58:45.679330] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-22T17:58:45.717694] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-22T17:58:45.914999] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T17:58:46.517695] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-22T17:58:46.651927] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T17:58:47.171607] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T17:58:47.317751] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-22T17:58:47.840560] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-22T17:58:48.117744] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-22T17:58:48.500493] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T17:58:48.917703] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-22T17:58:49.717695] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-22T17:58:49.949756] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T17:58:50.437370] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-22T17:58:50.517691] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-22T17:58:51.291397] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T17:58:51.317618] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-22T17:58:52.117747] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-22T17:58:52.707039] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-22T17:58:52.716157] [INFO ] [REMOTE ] CLS: Full fetch complete (77714 records). [2025-10-22T17:58:52.716309] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-22T17:58:52.924534] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-22T17:58:53.056865] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T17:58:53.135949] [INFO ] [REMOTE ] CLW: Full fetch complete (33622 records). [2025-10-22T17:58:53.157199] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-22T17:58:53.161195] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-22T17:58:53.161670] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-22T17:58:53.162859] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-22T17:58:53.162983] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-22T17:58:53.291565] [DEBUG] [LOCAL ] CLS: Trimmed 77714 records to 53563 (keeping 200 days of data) [2025-10-22T17:58:53.453470] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-22T17:58:53.760220] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-22T17:58:53.809414] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-22T17:58:53.810247] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-22T17:58:53.810791] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-22T17:58:53.811401] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-22T17:58:53.819724] [DEBUG] [LOCAL ] CLW: Trimmed 33622 records to 21127 (keeping 200 days of data) [2025-10-22T17:58:54.039387] [DEBUG] [LOCAL ] CLS: Primary data saved (53563 records). [2025-10-22T17:58:54.041009] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-22T17:58:54.041391] [INFO ] [MAIN ] Update Progress: 468/2367 symbols completed. CLS took 43.3s. Estimated remaining: 3h 58m 41s. Rate: 8.0 symbols/min [2025-10-22T17:58:54.164488] [DEBUG] [LOCAL ] CLW: Primary data saved (21127 records). [2025-10-22T17:58:54.170258] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-22T17:58:54.180667] [INFO ] [MAIN ] Update Progress: 469/2367 symbols completed. CLW took 25.4s. Estimated remaining: 3h 58m 4s. Rate: 8.0 symbols/min [2025-10-22T17:58:54.309907] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:58:54.408598] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:58:54.444679] [DEBUG] [LOCAL ] CM: Loaded 48468 existing records from primary storage. [2025-10-22T17:58:54.445063] [INFO ] [MAIN ] CM: Loaded 48468 existing records. [2025-10-22T17:58:54.645846] [DEBUG] [LOCAL ] CMA: Loaded 50177 existing records from primary storage. [2025-10-22T17:58:54.668067] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:58:54.668550] [INFO ] [MAIN ] CMA: Loaded 50177 existing records. [2025-10-22T17:58:54.701569] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-22T17:58:54.726982] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-22T17:58:54.764631] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-22T17:58:54.782092] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-22T17:58:54.997823] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:58:54.998387] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-22T17:58:54.998465] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-22T17:58:55.009851] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-22T17:58:55.015167] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-22T17:58:55.237534] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-22T17:58:55.337383] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-22T17:58:55.549890] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:58:55.594472] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-22T17:58:55.720494] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:58:55.752356] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T17:58:56.117709] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-22T17:58:56.917662] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-22T17:58:57.112666] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T17:58:57.121321] [INFO ] [REMOTE ] CLX: Full fetch complete (73878 records). [2025-10-22T17:58:57.121488] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-22T17:58:57.457026] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-22T17:58:57.564247] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-22T17:58:57.564359] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-22T17:58:57.565204] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-22T17:58:57.565383] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-22T17:58:57.566845] [DEBUG] [LOCAL ] CLX: Trimmed 73878 records to 51814 (keeping 200 days of data) [2025-10-22T17:58:57.682519] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-22T17:58:57.720682] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-22T17:58:57.934531] [DEBUG] [LOCAL ] CLX: Primary data saved (51814 records). [2025-10-22T17:58:57.934715] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-22T17:58:57.934810] [INFO ] [MAIN ] Update Progress: 470/2367 symbols completed. CLX took 27.6s. Estimated remaining: 3h 57m 41s. Rate: 8.0 symbols/min [2025-10-22T17:58:58.110458] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:58:58.138779] [DEBUG] [LOCAL ] CMBT: Loaded 27244 existing records from primary storage. [2025-10-22T17:58:58.139154] [INFO ] [MAIN ] CMBT: Loaded 27244 existing records. [2025-10-22T17:58:58.319172] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:58:58.319379] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-22T17:58:58.319427] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-22T17:58:58.319619] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-22T17:58:58.319706] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-22T17:58:58.523165] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-22T17:58:58.696925] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:58:58.728475] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T17:58:59.072191] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T17:58:59.317759] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-22T17:59:00.117702] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-22T17:59:00.180825] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T17:59:00.201974] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T17:59:00.917712] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-22T17:59:01.717705] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-22T17:59:02.007408] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T17:59:02.355001] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T17:59:02.517722] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-22T17:59:03.317734] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-22T17:59:04.117772] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-22T17:59:04.305881] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T17:59:04.917845] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-22T17:59:05.376970] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (3.66 seconds). [2025-10-22T17:59:05.385386] [INFO ] [REMOTE ] CLVT: Full fetch complete (75419 records). [2025-10-22T17:59:05.385540] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-22T17:59:05.789829] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-22T17:59:05.790301] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-22T17:59:05.815567] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-22T17:59:05.819234] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-22T17:59:05.822056] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-22T17:59:05.833294] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-22T17:59:05.845749] [DEBUG] [LOCAL ] CLVT: Trimmed 75419 records to 51912 (keeping 200 days of data) [2025-10-22T17:59:05.866341] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T17:59:06.084533] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T17:59:06.179529] [DEBUG] [LOCAL ] CLVT: Primary data saved (51912 records). [2025-10-22T17:59:06.179706] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-22T17:59:06.180389] [INFO ] [MAIN ] Update Progress: 471/2367 symbols completed. CLVT took 39.4s. Estimated remaining: 3h 57m 36s. Rate: 8.0 symbols/min [2025-10-22T17:59:06.345217] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:59:06.393351] [DEBUG] [LOCAL ] CMC: Loaded 45567 existing records from primary storage. [2025-10-22T17:59:06.393680] [INFO ] [MAIN ] CMC: Loaded 45567 existing records. [2025-10-22T17:59:06.533376] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-22T17:59:06.577824] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:59:06.578130] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-22T17:59:06.578199] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-22T17:59:06.578417] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-22T17:59:06.578472] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-22T17:59:06.926444] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:59:07.317720] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-22T17:59:07.683196] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T17:59:08.117745] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-22T17:59:08.408674] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T17:59:08.464019] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-22T17:59:08.917776] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-22T17:59:09.542507] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T17:59:09.717700] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-22T17:59:09.959703] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T17:59:10.517781] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-22T17:59:11.317724] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-22T17:59:11.395765] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T17:59:12.117718] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-22T17:59:12.282318] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T17:59:12.922752] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-22T17:59:12.941432] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T17:59:12.961900] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-22T17:59:13.717664] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-22T17:59:14.517733] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-22T17:59:14.569778] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T17:59:15.190156] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-22T17:59:15.317674] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-22T17:59:16.122854] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-22T17:59:16.146044] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T17:59:16.917693] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-22T17:59:17.096131] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T17:59:17.717681] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-22T17:59:17.834414] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T17:59:18.437577] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T17:59:18.517686] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-22T17:59:19.317689] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-22T17:59:19.620736] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T17:59:19.628822] [INFO ] [REMOTE ] CMBT: Full fetch complete (33874 records). [2025-10-22T17:59:19.628940] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-22T17:59:19.997327] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-22T17:59:19.997406] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-22T17:59:19.997944] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-22T17:59:19.998006] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-22T17:59:19.998856] [DEBUG] [LOCAL ] CMBT: Trimmed 33874 records to 27509 (keeping 200 days of data) [2025-10-22T17:59:20.117730] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-22T17:59:20.197038] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T17:59:20.211175] [DEBUG] [LOCAL ] CMBT: Primary data saved (27509 records). [2025-10-22T17:59:20.211299] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-22T17:59:20.211372] [INFO ] [MAIN ] Update Progress: 472/2367 symbols completed. CMBT took 22.3s. Estimated remaining: 3h 57m 55s. Rate: 8.0 symbols/min [2025-10-22T17:59:20.376298] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:59:20.382962] [DEBUG] [LOCAL ] CMCM: Loaded 4857 existing records from primary storage. [2025-10-22T17:59:20.383131] [INFO ] [MAIN ] CMCM: Loaded 4857 existing records. [2025-10-22T17:59:20.561680] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:59:20.561923] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-22T17:59:20.561976] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-22T17:59:20.562122] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-22T17:59:20.562471] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-22T17:59:20.926490] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:59:20.920868] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-22T17:59:20.954924] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T17:59:21.717683] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-22T17:59:22.219394] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-22T17:59:22.517705] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-22T17:59:22.618699] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-22T17:59:22.687608] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T17:59:23.317697] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-22T17:59:24.117734] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-22T17:59:24.435690] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T17:59:24.667770] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-22T17:59:24.917731] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-22T17:59:25.717735] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-22T17:59:25.865995] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T17:59:26.517671] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-22T17:59:26.801362] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T17:59:26.808956] [INFO ] [REMOTE ] CM: Full fetch complete (69861 records). [2025-10-22T17:59:26.809061] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-22T17:59:27.186017] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-22T17:59:27.186134] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-22T17:59:27.186995] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-22T17:59:27.187099] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-22T17:59:27.188437] [DEBUG] [LOCAL ] CM: Trimmed 69861 records to 48431 (keeping 200 days of data) [2025-10-22T17:59:27.362311] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-22T17:59:27.450791] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T17:59:27.522578] [DEBUG] [LOCAL ] CM: Primary data saved (48431 records). [2025-10-22T17:59:27.522729] [INFO ] [MAIN ] CM: Full history saved. [2025-10-22T17:59:27.522812] [INFO ] [MAIN ] Update Progress: 473/2367 symbols completed. CM took 33.5s. Estimated remaining: 3h 57m 47s. Rate: 8.0 symbols/min [2025-10-22T17:59:27.690745] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:59:27.690935] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-22T17:59:27.691073] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-22T17:59:27.691211] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-22T17:59:27.691313] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-22T17:59:27.691473] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-22T17:59:27.691537] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-22T17:59:27.961540] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T17:59:28.087419] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:59:28.088491] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T17:59:28.117611] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-22T17:59:28.917690] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-10-22T17:59:29.120478] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T17:59:29.120776] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-10-22T17:59:29.120865] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T17:59:29.120913] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-22T17:59:29.120955] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T17:59:29.120994] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-22T17:59:29.121052] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-22T17:59:29.121090] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-22T17:59:29.121138] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-22T17:59:29.121185] [INFO ] [MAIN ] Update Progress: 474/2367 symbols completed. CMDB took 1.6s. Estimated remaining: 3h 57m 15s. Rate: 8.0 symbols/min [2025-10-22T17:59:29.313888] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:59:29.314251] [DEBUG] [LOCAL ] CMG: No existing data file found in primary storage. [2025-10-22T17:59:29.314309] [WARN ] [MAIN ] CMG: No existing data found, performing full refresh instead. [2025-10-22T17:59:29.314420] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-22T17:59:29.314462] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-22T17:59:29.314506] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-10-22T17:59:29.314539] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-22T17:59:29.728993] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-22T17:59:29.737294] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:59:29.764271] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T17:59:30.517764] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-22T17:59:31.136667] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T17:59:31.317695] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-22T17:59:31.486079] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-22T17:59:31.495759] [INFO ] [REMOTE ] CMA: Full fetch complete (73522 records). [2025-10-22T17:59:31.495934] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-22T17:59:31.886274] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-22T17:59:31.886356] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-22T17:59:31.887146] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-22T17:59:31.887207] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-22T17:59:31.888868] [DEBUG] [LOCAL ] CMA: Trimmed 73522 records to 50170 (keeping 200 days of data) [2025-10-22T17:59:32.117767] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-22T17:59:32.202054] [DEBUG] [LOCAL ] CMA: Primary data saved (50170 records). [2025-10-22T17:59:32.202678] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-22T17:59:32.202782] [INFO ] [MAIN ] Update Progress: 475/2367 symbols completed. CMA took 38.0s. Estimated remaining: 3h 56m 50s. Rate: 8.0 symbols/min [2025-10-22T17:59:32.366171] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:59:32.403083] [DEBUG] [LOCAL ] CMI: Loaded 41706 existing records from primary storage. [2025-10-22T17:59:32.403410] [INFO ] [MAIN ] CMI: Loaded 41706 existing records. [2025-10-22T17:59:32.585830] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:59:32.586189] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-22T17:59:32.586335] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-22T17:59:32.586720] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-22T17:59:32.586874] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-22T17:59:32.689739] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-22T17:59:32.927123] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T17:59:32.918351] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-22T17:59:33.007352] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:59:33.717703] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-22T17:59:34.517733] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-22T17:59:35.134291] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-22T17:59:35.171919] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T17:59:35.199945] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-22T17:59:35.208203] [INFO ] [REMOTE ] CMC: Full fetch complete (67264 records). [2025-10-22T17:59:35.208369] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-22T17:59:35.322779] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-22T17:59:35.592123] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-22T17:59:35.592199] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-22T17:59:35.592988] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-22T17:59:35.593050] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-22T17:59:35.594268] [DEBUG] [LOCAL ] CMC: Trimmed 67264 records to 45548 (keeping 200 days of data) [2025-10-22T17:59:35.854135] [DEBUG] [LOCAL ] CMC: Primary data saved (45548 records). [2025-10-22T17:59:35.854259] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-22T17:59:35.854873] [INFO ] [MAIN ] Update Progress: 476/2367 symbols completed. CMC took 29.7s. Estimated remaining: 3h 56m 27s. Rate: 8.0 symbols/min [2025-10-22T17:59:36.019557] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T17:59:36.051954] [DEBUG] [LOCAL ] CMP: Loaded 35783 existing records from primary storage. [2025-10-22T17:59:36.052245] [INFO ] [MAIN ] CMP: Loaded 35783 existing records. [2025-10-22T17:59:36.124420] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-22T17:59:36.226573] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T17:59:36.226797] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-22T17:59:36.226845] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-22T17:59:36.227056] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-22T17:59:36.227094] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-22T17:59:36.573214] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T17:59:36.735841] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-22T17:59:36.917687] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-22T17:59:37.152820] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-22T17:59:37.563716] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T17:59:37.717731] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-22T17:59:38.517733] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-22T17:59:39.122440] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T17:59:39.187881] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T17:59:39.317637] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-22T17:59:40.098700] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T17:59:40.117612] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-22T17:59:40.917716] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-22T17:59:41.641521] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-22T17:59:41.659768] [INFO ] [REMOTE ] CMCM: Full fetch complete (7086 records). [2025-10-22T17:59:41.660300] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-22T17:59:41.660954] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T17:59:41.722889] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-22T17:59:42.018198] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-22T17:59:42.018270] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-22T17:59:42.018447] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-22T17:59:42.018486] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-22T17:59:42.018881] [DEBUG] [LOCAL ] CMCM: Trimmed 7086 records to 4828 (keeping 200 days of data) [2025-10-22T17:59:42.044432] [DEBUG] [LOCAL ] CMCM: Primary data saved (4828 records). [2025-10-22T17:59:42.044506] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-22T17:59:42.044574] [INFO ] [MAIN ] Update Progress: 477/2367 symbols completed. CMCM took 21.8s. Estimated remaining: 3h 56m 15s. Rate: 8.0 symbols/min [2025-10-22T17:59:42.517719] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-22T17:59:42.962398] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-22T17:59:43.317686] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-22T17:59:44.047758] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T17:59:44.117675] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-22T17:59:44.917719] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-22T17:59:45.574251] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-22T17:59:45.717717] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-22T17:59:45.995086] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T17:59:46.317877] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T17:59:46.517694] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-22T17:59:47.317717] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-22T17:59:48.189264] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T17:59:48.199317] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-22T17:59:48.671832] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T17:59:48.917776] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-22T17:59:49.944538] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T17:59:49.953494] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-22T17:59:50.740697] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T17:59:50.750000] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-22T17:59:51.406931] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T17:59:51.415102] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-22T17:59:51.552206] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (5.83 seconds). [2025-10-22T17:59:52.117669] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-22T17:59:52.208002] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T17:59:52.917747] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-22T17:59:52.999271] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T17:59:53.717669] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-22T17:59:54.215492] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-22T17:59:54.344514] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T17:59:54.517692] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-22T17:59:55.317703] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-22T17:59:55.373911] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T17:59:55.823235] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T17:59:56.117701] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-22T17:59:56.917766] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-22T17:59:57.489164] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-22T17:59:57.490115] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T17:59:57.717744] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-22T17:59:58.466961] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T17:59:58.517678] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-22T17:59:59.317713] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-22T17:59:59.996623] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-22T18:00:00.117619] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-22T18:00:00.413971] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T18:00:00.421445] [INFO ] [REMOTE ] CMI: Full fetch complete (61144 records). [2025-10-22T18:00:00.421673] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-22T18:00:00.535497] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-22T18:00:00.566765] [INFO ] [REMOTE ] CMP: Full fetch complete (51613 records). [2025-10-22T18:00:00.584329] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-22T18:00:01.154200] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-22T18:00:01.164526] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-22T18:00:01.170402] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-22T18:00:01.170492] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-22T18:00:01.237261] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-22T18:00:01.237675] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-22T18:00:01.238168] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-22T18:00:01.237587] [DEBUG] [LOCAL ] CMI: Trimmed 61144 records to 41637 (keeping 200 days of data) [2025-10-22T18:00:01.238295] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-22T18:00:01.240084] [DEBUG] [LOCAL ] CMP: Trimmed 51613 records to 35683 (keeping 200 days of data) [2025-10-22T18:00:01.573006] [DEBUG] [LOCAL ] CMP: Primary data saved (35683 records). [2025-10-22T18:00:01.624303] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-22T18:00:01.634123] [INFO ] [MAIN ] Update Progress: 478/2367 symbols completed. CMP took 25.8s. Estimated remaining: 3h 56m 55s. Rate: 8.0 symbols/min [2025-10-22T18:00:01.703435] [DEBUG] [LOCAL ] CMI: Primary data saved (41637 records). [2025-10-22T18:00:01.703564] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-22T18:00:01.703639] [INFO ] [MAIN ] Update Progress: 479/2367 symbols completed. CMI took 29.5s. Estimated remaining: 3h 56m 18s. Rate: 8.0 symbols/min [2025-10-22T18:00:03.166325] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (3.05 seconds). [2025-10-22T18:00:03.178484] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-22T18:00:06.726472] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (3.55 seconds). [2025-10-22T18:00:06.737615] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-22T18:00:07.938248] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T18:00:07.946460] [INFO ] [REMOTE ] CMG: Full fetch complete (77503 records). [2025-10-22T18:00:07.946600] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-22T18:00:07.947402] [FATAL] [VALIDATOR ] CMG: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:00:07.947496] [FATAL] [MAIN ] CMG: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:00:07.947539] [WARN ] [MAIN ] CMG: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:00:07.947578] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-22T18:00:07.947679] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-10-22T18:00:07.947734] [INFO ] [LOCAL ] CMG: Starting deletion of derivative data. [2025-10-22T18:00:07.947777] [DEBUG] [LOCAL ] CMG: No derivative data file found to delete. [2025-10-22T18:00:07.947835] [INFO ] [MAIN ] Update Progress: 480/2367 symbols completed. CMG took 38.8s. Estimated remaining: 3h 56m 6s. Rate: 8.0 symbols/min [2025-10-22T18:00:08.594403] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:08.567545] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:08.600870] [DEBUG] [LOCAL ] CMS: No existing data file found in primary storage. [2025-10-22T18:00:08.595147] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:08.606099] [WARN ] [MAIN ] CMS: No existing data found, performing full refresh instead. [2025-10-22T18:00:08.651770] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:08.618886] [DEBUG] [LOCAL ] CMRE: No existing data file found in primary storage. [2025-10-22T18:00:08.652337] [WARN ] [MAIN ] CMRE: No existing data found, performing full refresh instead. [2025-10-22T18:00:08.648189] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-22T18:00:08.652750] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-22T18:00:08.652628] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-22T18:00:08.652842] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-22T18:00:08.652939] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-22T18:00:08.653078] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-22T18:00:08.653035] [DEBUG] [LOCAL ] CMRE: No primary data file found to delete. [2025-10-22T18:00:08.653192] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-22T18:00:08.855057] [DEBUG] [LOCAL ] CMSA: Loaded 3497 existing records from primary storage. [2025-10-22T18:00:08.874870] [INFO ] [MAIN ] CMSA: Loaded 3497 existing records. [2025-10-22T18:00:09.020898] [DEBUG] [LOCAL ] CMPO: Loaded 38539 existing records from primary storage. [2025-10-22T18:00:09.109299] [INFO ] [MAIN ] CMPO: Loaded 38539 existing records. [2025-10-22T18:00:09.602953] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:00:09.660484] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-22T18:00:09.665816] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-22T18:00:09.713456] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:09.743905] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-22T18:00:09.797688] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:00:09.797932] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-22T18:00:09.818222] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-22T18:00:09.818002] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:09.818374] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-22T18:00:09.818559] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-22T18:00:09.824073] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-22T18:00:09.824146] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-22T18:00:09.857148] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-22T18:00:10.525949] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:10.545373] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-22T18:00:10.545143] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:10.546336] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-22T18:00:11.334870] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T18:00:11.336286] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-22T18:00:11.704076] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-22T18:00:11.714557] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-22T18:00:11.809331] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T18:00:11.818167] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-22T18:00:11.831070] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-22T18:00:11.832380] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-22T18:00:12.230062] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-22T18:00:12.231874] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-22T18:00:12.668314] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-22T18:00:12.670729] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-22T18:00:13.298075] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T18:00:13.308097] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-22T18:00:13.405812] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T18:00:13.407320] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-22T18:00:13.456590] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T18:00:13.464964] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-22T18:00:13.950369] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (4.13 seconds). [2025-10-22T18:00:13.956859] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-22T18:00:14.029360] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-22T18:00:14.030853] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-22T18:00:14.589544] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T18:00:14.591030] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-22T18:00:15.049901] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T18:00:15.075193] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-22T18:00:15.101534] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T18:00:15.317670] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-22T18:00:15.394418] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T18:00:16.117703] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-22T18:00:16.498209] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T18:00:16.917691] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-22T18:00:17.717637] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-22T18:00:18.010284] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-22T18:00:18.288707] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-22T18:00:18.517719] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-22T18:00:19.029624] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T18:00:19.121636] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T18:00:19.317690] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-22T18:00:19.991387] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-22T18:00:19.992773] [INFO ] [REMOTE ] CMSA: Full fetch complete (4827 records). [2025-10-22T18:00:19.992860] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-22T18:00:20.122810] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-22T18:00:20.358864] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-22T18:00:20.358939] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-22T18:00:20.359079] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-22T18:00:20.359119] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-22T18:00:20.359472] [DEBUG] [LOCAL ] CMSA: Trimmed 4827 records to 3471 (keeping 200 days of data) [2025-10-22T18:00:20.379907] [DEBUG] [LOCAL ] CMSA: Primary data saved (3471 records). [2025-10-22T18:00:20.379983] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-22T18:00:20.380053] [INFO ] [MAIN ] Update Progress: 481/2367 symbols completed. CMSA took 12.4s. Estimated remaining: 3h 56m 17s. Rate: 8.0 symbols/min [2025-10-22T18:00:20.542014] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:20.548500] [DEBUG] [LOCAL ] CMSC: Loaded 4835 existing records from primary storage. [2025-10-22T18:00:20.548679] [INFO ] [MAIN ] CMSC: Loaded 4835 existing records. [2025-10-22T18:00:20.723081] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:00:20.723281] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-22T18:00:20.723327] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-22T18:00:20.723459] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-22T18:00:20.723509] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-22T18:00:20.923707] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-22T18:00:21.092485] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:21.391278] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-22T18:00:21.717711] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-22T18:00:22.517913] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-22T18:00:23.317730] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-22T18:00:23.411041] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T18:00:23.611111] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-22T18:00:23.859175] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-22T18:00:24.091356] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T18:00:24.117665] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-22T18:00:24.917704] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-22T18:00:25.724342] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-22T18:00:25.729774] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T18:00:26.220320] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-22T18:00:26.428181] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T18:00:26.517730] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-22T18:00:27.317736] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-22T18:00:28.117721] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-22T18:00:28.537349] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-22T18:00:28.917700] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-22T18:00:29.333213] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-22T18:00:29.717678] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-22T18:00:29.815001] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T18:00:30.517687] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-22T18:00:30.579133] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T18:00:31.317676] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-22T18:00:31.604388] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T18:00:32.117704] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-22T18:00:32.142912] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:00:32.601111] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T18:00:32.606929] [INFO ] [REMOTE ] CMPO: Full fetch complete (58144 records). [2025-10-22T18:00:32.607042] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-22T18:00:32.922878] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-22T18:00:32.987123] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-22T18:00:32.987195] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-22T18:00:32.987900] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-22T18:00:32.987962] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-22T18:00:32.989031] [DEBUG] [LOCAL ] CMPO: Trimmed 58144 records to 38424 (keeping 200 days of data) [2025-10-22T18:00:33.202629] [DEBUG] [LOCAL ] CMPO: Primary data saved (38424 records). [2025-10-22T18:00:33.202801] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-22T18:00:33.202880] [INFO ] [MAIN ] Update Progress: 482/2367 symbols completed. CMPO took 25.3s. Estimated remaining: 3h 56m 31s. Rate: 8.0 symbols/min [2025-10-22T18:00:33.370018] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:33.379093] [DEBUG] [LOCAL ] CMSD: Loaded 7668 existing records from primary storage. [2025-10-22T18:00:33.379274] [INFO ] [MAIN ] CMSD: Loaded 7668 existing records. [2025-10-22T18:00:33.554003] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:00:33.554236] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-22T18:00:33.554304] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-22T18:00:33.554477] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-22T18:00:33.554531] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-22T18:00:33.720685] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-22T18:00:33.922552] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:34.102487] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T18:00:34.170429] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T18:00:34.517675] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-22T18:00:34.537727] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T18:00:35.171305] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-22T18:00:35.317704] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-22T18:00:36.079672] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-22T18:00:36.117673] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-22T18:00:36.699605] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-22T18:00:36.917702] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-22T18:00:37.574477] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-22T18:00:37.717711] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-22T18:00:38.517749] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-22T18:00:39.317704] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-22T18:00:39.501591] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T18:00:39.507911] [INFO ] [REMOTE ] CMRE: Full fetch complete (51260 records). [2025-10-22T18:00:39.508059] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-22T18:00:39.880770] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-22T18:00:39.880845] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-22T18:00:39.881457] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-22T18:00:39.881498] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-22T18:00:39.882476] [DEBUG] [LOCAL ] CMRE: Trimmed 51260 records to 35651 (keeping 200 days of data) [2025-10-22T18:00:40.098249] [DEBUG] [LOCAL ] CMRE: Primary data saved (35651 records). [2025-10-22T18:00:40.098432] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-22T18:00:40.099205] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-22T18:00:40.101502] [INFO ] [MAIN ] Update Progress: 483/2367 symbols completed. CMRE took 32.1s. Estimated remaining: 3h 56m 21s. Rate: 8.0 symbols/min [2025-10-22T18:00:40.122705] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-22T18:00:40.294783] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:40.325123] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T18:00:40.360750] [DEBUG] [LOCAL ] CMTG: Loaded 35328 existing records from primary storage. [2025-10-22T18:00:40.361009] [INFO ] [MAIN ] CMTG: Loaded 35328 existing records. [2025-10-22T18:00:40.535736] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:00:40.535895] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-22T18:00:40.535943] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-22T18:00:40.536113] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-22T18:00:40.536152] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-22T18:00:40.890942] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:40.917642] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-22T18:00:40.983464] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-22T18:00:41.717710] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-22T18:00:42.114772] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T18:00:42.517766] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-22T18:00:42.657874] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T18:00:42.666729] [INFO ] [REMOTE ] CMS: Full fetch complete (76248 records). [2025-10-22T18:00:42.666852] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-22T18:00:43.047020] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-22T18:00:43.047101] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-22T18:00:43.047948] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-22T18:00:43.048013] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-22T18:00:43.049484] [DEBUG] [LOCAL ] CMS: Trimmed 76248 records to 52551 (keeping 200 days of data) [2025-10-22T18:00:43.321491] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-22T18:00:43.359673] [DEBUG] [LOCAL ] CMS: Primary data saved (52551 records). [2025-10-22T18:00:43.359778] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-22T18:00:43.359850] [INFO ] [MAIN ] Update Progress: 484/2367 symbols completed. CMS took 35.4s. Estimated remaining: 3h 55m 56s. Rate: 8.0 symbols/min [2025-10-22T18:00:43.526589] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:43.526749] [DEBUG] [LOCAL ] CMU: No existing data file found in primary storage. [2025-10-22T18:00:43.526794] [WARN ] [MAIN ] CMU: No existing data found, performing full refresh instead. [2025-10-22T18:00:43.526898] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-22T18:00:43.526938] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-22T18:00:43.526997] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-10-22T18:00:43.527066] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-22T18:00:43.900272] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:43.921051] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T18:00:44.124239] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-22T18:00:44.126024] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T18:00:44.849730] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T18:00:44.917670] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-22T18:00:45.478498] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-22T18:00:45.717714] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-22T18:00:46.496940] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-22T18:00:46.517607] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-22T18:00:47.317690] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-22T18:00:47.672600] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T18:00:48.053533] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-22T18:00:48.117669] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-22T18:00:48.741512] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T18:00:48.917694] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-22T18:00:49.521199] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T18:00:49.717730] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-22T18:00:50.517724] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-22T18:00:51.119911] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-22T18:00:51.260436] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T18:00:51.317703] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-22T18:00:52.060062] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-22T18:00:52.117743] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-22T18:00:52.917712] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-22T18:00:53.548862] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-22T18:00:53.717691] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-22T18:00:53.826298] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T18:00:54.314162] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T18:00:54.517755] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-22T18:00:55.150074] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-22T18:00:55.317685] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-22T18:00:56.107616] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T18:00:56.117599] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-22T18:00:56.621973] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-22T18:00:56.917706] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-22T18:00:57.717716] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-22T18:00:57.735044] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-22T18:00:57.736573] [INFO ] [REMOTE ] CMSD: Full fetch complete (11464 records). [2025-10-22T18:00:57.736674] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-22T18:00:58.097249] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-22T18:00:58.097324] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-22T18:00:58.097599] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-22T18:00:58.097702] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-22T18:00:58.098140] [DEBUG] [LOCAL ] CMSD: Trimmed 11464 records to 7603 (keeping 200 days of data) [2025-10-22T18:00:58.142502] [DEBUG] [LOCAL ] CMSD: Primary data saved (7603 records). [2025-10-22T18:00:58.142610] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-22T18:00:58.142719] [INFO ] [MAIN ] Update Progress: 485/2367 symbols completed. CMSD took 24.9s. Estimated remaining: 3h 56m 17s. Rate: 8.0 symbols/min [2025-10-22T18:00:58.317841] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:58.349699] [DEBUG] [LOCAL ] CNA: Loaded 32604 existing records from primary storage. [2025-10-22T18:00:58.349980] [INFO ] [MAIN ] CNA: Loaded 32604 existing records. [2025-10-22T18:00:58.522064] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-22T18:00:58.526550] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T18:00:58.533548] [INFO ] [REMOTE ] CMSC: Full fetch complete (6926 records). [2025-10-22T18:00:58.531333] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:00:58.533668] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-22T18:00:58.545715] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-22T18:00:58.555426] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-22T18:00:58.610814] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-22T18:00:58.627020] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-22T18:00:59.189398] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-22T18:00:59.189718] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-22T18:00:59.200325] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-22T18:00:59.205519] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-22T18:00:59.233436] [DEBUG] [LOCAL ] CMSC: Trimmed 6926 records to 4809 (keeping 200 days of data) [2025-10-22T18:00:59.288283] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:00:59.296475] [DEBUG] [LOCAL ] CMSC: Primary data saved (4809 records). [2025-10-22T18:00:59.296541] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-22T18:00:59.296607] [INFO ] [MAIN ] Update Progress: 486/2367 symbols completed. CMSC took 38.9s. Estimated remaining: 3h 55m 45s. Rate: 8.0 symbols/min [2025-10-22T18:00:59.326360] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-22T18:00:59.463684] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:00:59.512842] [DEBUG] [LOCAL ] CNC: Loaded 53779 existing records from primary storage. [2025-10-22T18:00:59.513144] [INFO ] [MAIN ] CNC: Loaded 53779 existing records. [2025-10-22T18:00:59.686757] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:00:59.687017] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-22T18:00:59.687067] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-22T18:00:59.687326] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-22T18:00:59.687381] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-22T18:01:00.038255] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:01:00.067700] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T18:01:00.117615] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-22T18:01:00.188968] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T18:01:00.917706] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-22T18:01:01.722709] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-22T18:01:01.736638] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T18:01:01.840145] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-22T18:01:02.517777] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-22T18:01:03.317702] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-22T18:01:03.431380] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-22T18:01:03.660527] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T18:01:04.117724] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-22T18:01:04.573836] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T18:01:04.917820] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-22T18:01:05.717767] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-22T18:01:05.827585] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T18:01:06.158867] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T18:01:06.517713] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-22T18:01:07.046521] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T18:01:07.317706] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-22T18:01:08.117859] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-22T18:01:08.360301] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T18:01:08.720567] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T18:01:08.917696] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-22T18:01:09.260635] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T18:01:09.717705] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-22T18:01:10.517731] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-22T18:01:10.769603] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T18:01:10.806224] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T18:01:10.811252] [INFO ] [REMOTE ] CMTG: Full fetch complete (52953 records). [2025-10-22T18:01:10.811380] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-22T18:01:11.195176] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-22T18:01:11.195263] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-22T18:01:11.195923] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-22T18:01:11.195987] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-22T18:01:11.197125] [DEBUG] [LOCAL ] CMTG: Trimmed 52953 records to 35217 (keeping 200 days of data) [2025-10-22T18:01:11.338156] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-22T18:01:11.395714] [DEBUG] [LOCAL ] CMTG: Primary data saved (35217 records). [2025-10-22T18:01:11.396797] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-22T18:01:11.396932] [INFO ] [MAIN ] Update Progress: 487/2367 symbols completed. CMTG took 31.3s. Estimated remaining: 3h 55m 55s. Rate: 8.0 symbols/min [2025-10-22T18:01:11.566249] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:01:11.576264] [DEBUG] [LOCAL ] CNF: Loaded 10592 existing records from primary storage. [2025-10-22T18:01:11.576463] [INFO ] [MAIN ] CNF: Loaded 10592 existing records. [2025-10-22T18:01:11.751760] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:01:11.751985] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-22T18:01:11.752033] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-22T18:01:11.752243] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-22T18:01:11.752299] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-22T18:01:12.122875] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:01:12.119036] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-22T18:01:12.278793] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T18:01:12.279962] [INFO ] [REMOTE ] CMU: Full fetch complete (9483 records). [2025-10-22T18:01:12.280029] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-22T18:01:12.639677] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-22T18:01:12.640009] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-22T18:01:12.640277] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-22T18:01:12.640319] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-22T18:01:12.640784] [DEBUG] [LOCAL ] CMU: Trimmed 9483 records to 6348 (keeping 200 days of data) [2025-10-22T18:01:12.696952] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-22T18:01:12.718701] [DEBUG] [LOCAL ] CMU: Primary data saved (6348 records). [2025-10-22T18:01:12.718814] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-22T18:01:12.718896] [INFO ] [MAIN ] Update Progress: 488/2367 symbols completed. CMU took 29.4s. Estimated remaining: 3h 55m 24s. Rate: 8.0 symbols/min [2025-10-22T18:01:12.886488] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:01:12.917713] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-22T18:01:12.939606] [DEBUG] [LOCAL ] CNH: Loaded 53547 existing records from primary storage. [2025-10-22T18:01:12.939945] [INFO ] [MAIN ] CNH: Loaded 53547 existing records. [2025-10-22T18:01:13.119335] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:01:13.119585] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-22T18:01:13.119632] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-22T18:01:13.120045] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-22T18:01:13.120108] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-22T18:01:13.476188] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:01:13.717683] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-22T18:01:13.895604] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T18:01:14.517762] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-22T18:01:15.241522] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T18:01:15.245362] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-22T18:01:15.317742] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-22T18:01:15.399876] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T18:01:16.117708] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-22T18:01:16.917687] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-22T18:01:17.326283] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-22T18:01:17.571413] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T18:01:17.717674] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-22T18:01:18.439828] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T18:01:18.517617] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-22T18:01:19.317705] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-22T18:01:19.431509] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T18:01:19.670908] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-22T18:01:20.074496] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T18:01:20.117690] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-22T18:01:20.917721] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-22T18:01:21.566947] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T18:01:21.717706] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-22T18:01:22.517731] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-22T18:01:23.300339] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-22T18:01:23.317677] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-22T18:01:23.564468] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-22T18:01:23.597488] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T18:01:23.706519] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-22T18:01:24.117719] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-22T18:01:24.917718] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-22T18:01:25.717734] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-22T18:01:25.901384] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T18:01:25.947359] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T18:01:26.517709] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-22T18:01:27.317708] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-22T18:01:27.945876] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T18:01:28.034343] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-22T18:01:28.117716] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-22T18:01:28.917667] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-22T18:01:29.116563] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T18:01:29.419952] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-22T18:01:29.717712] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-22T18:01:30.517776] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-22T18:01:31.186629] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-22T18:01:31.317689] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-22T18:01:31.518461] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T18:01:31.655831] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-22T18:01:31.664398] [INFO ] [REMOTE ] CNA: Full fetch complete (46142 records). [2025-10-22T18:01:31.664597] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-22T18:01:32.082813] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-22T18:01:32.082932] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-22T18:01:32.083553] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-22T18:01:32.083616] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-22T18:01:32.084693] [DEBUG] [LOCAL ] CNA: Trimmed 46142 records to 32534 (keeping 200 days of data) [2025-10-22T18:01:32.136260] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-22T18:01:32.206960] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-22T18:01:32.227833] [INFO ] [REMOTE ] CNC: Full fetch complete (77861 records). [2025-10-22T18:01:32.230301] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-22T18:01:32.732595] [DEBUG] [LOCAL ] CNA: Primary data saved (32534 records). [2025-10-22T18:01:32.752947] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-22T18:01:32.772479] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-22T18:01:32.772565] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-22T18:01:32.773628] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-22T18:01:32.773730] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-22T18:01:32.772723] [INFO ] [MAIN ] Update Progress: 489/2367 symbols completed. CNA took 34.6s. Estimated remaining: 3h 56m 4s. Rate: 8.0 symbols/min [2025-10-22T18:01:32.879850] [DEBUG] [LOCAL ] CNC: Trimmed 77861 records to 53779 (keeping 200 days of data) [2025-10-22T18:01:32.922564] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-22T18:01:33.099021] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:01:33.292977] [DEBUG] [LOCAL ] CNI: Loaded 51658 existing records from primary storage. [2025-10-22T18:01:33.337480] [INFO ] [MAIN ] CNI: Loaded 51658 existing records. [2025-10-22T18:01:33.594218] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:01:33.596083] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-22T18:01:33.596532] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-22T18:01:33.597496] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-22T18:01:33.597909] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-22T18:01:33.721538] [DEBUG] [LOCAL ] CNC: Primary data saved (53779 records). [2025-10-22T18:01:33.737274] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-22T18:01:33.762443] [INFO ] [MAIN ] Update Progress: 490/2367 symbols completed. CNC took 34.5s. Estimated remaining: 3h 55m 32s. Rate: 8.0 symbols/min [2025-10-22T18:01:34.169397] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:01:34.180146] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:01:34.180966] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-22T18:01:34.183199] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T18:01:34.220557] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-22T18:01:34.268759] [DEBUG] [LOCAL ] CNK: Loaded 52908 existing records from primary storage. [2025-10-22T18:01:34.269071] [INFO ] [MAIN ] CNK: Loaded 52908 existing records. [2025-10-22T18:01:34.444179] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:01:34.444392] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-22T18:01:34.444439] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-22T18:01:34.444886] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-22T18:01:34.444941] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-22T18:01:34.522851] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-22T18:01:34.801020] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:01:35.317732] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-22T18:01:36.072316] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T18:01:36.117676] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-22T18:01:36.319109] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T18:01:36.352238] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-22T18:01:36.917732] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-22T18:01:37.717752] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-22T18:01:37.801354] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T18:01:38.517675] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-22T18:01:38.733365] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T18:01:39.317767] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-22T18:01:39.483260] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T18:01:40.117691] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-22T18:01:40.276750] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-22T18:01:40.526907] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-22T18:01:40.917741] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-22T18:01:41.717686] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-22T18:01:41.880029] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T18:01:42.517726] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-22T18:01:42.790613] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T18:01:42.807445] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T18:01:42.809459] [INFO ] [REMOTE ] CNF: Full fetch complete (12986 records). [2025-10-22T18:01:42.809530] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-22T18:01:42.809976] [FATAL] [VALIDATOR ] CNF: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:01:42.810059] [FATAL] [MAIN ] CNF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:01:42.810104] [WARN ] [MAIN ] CNF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:01:42.810146] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-22T18:01:42.810202] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-22T18:01:42.810238] [INFO ] [LOCAL ] CNF: Starting deletion of derivative data. [2025-10-22T18:01:42.810382] [DEBUG] [LOCAL ] CNF: Deleted derivative data file. [2025-10-22T18:01:42.810469] [INFO ] [MAIN ] Update Progress: 491/2367 symbols completed. CNF took 31.4s. Estimated remaining: 3h 55m 30s. Rate: 8.0 symbols/min [2025-10-22T18:01:43.007953] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:01:43.057803] [DEBUG] [LOCAL ] CNM: Loaded 51017 existing records from primary storage. [2025-10-22T18:01:43.058143] [INFO ] [MAIN ] CNM: Loaded 51017 existing records. [2025-10-22T18:01:43.236888] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:01:43.237126] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-22T18:01:43.237172] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-22T18:01:43.237443] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-22T18:01:43.237480] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-22T18:01:43.322868] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-22T18:01:43.602387] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:01:44.117697] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-22T18:01:44.410260] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T18:01:44.917713] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-22T18:01:45.214752] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T18:01:45.717699] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-22T18:01:46.175277] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-22T18:01:46.188690] [INFO ] [REMOTE ] CNH: Full fetch complete (77315 records). [2025-10-22T18:01:46.188876] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-22T18:01:46.189852] [FATAL] [VALIDATOR ] CNH: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:01:46.189961] [FATAL] [MAIN ] CNH: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:01:46.190016] [WARN ] [MAIN ] CNH: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:01:46.190094] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-22T18:01:46.190187] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-22T18:01:46.190255] [INFO ] [LOCAL ] CNH: Starting deletion of derivative data. [2025-10-22T18:01:46.190420] [DEBUG] [LOCAL ] CNH: Deleted derivative data file. [2025-10-22T18:01:46.190526] [INFO ] [MAIN ] Update Progress: 492/2367 symbols completed. CNH took 33.5s. Estimated remaining: 3h 55m 7s. Rate: 8.0 symbols/min [2025-10-22T18:01:46.383078] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:01:46.416707] [DEBUG] [LOCAL ] CNMD: Loaded 32081 existing records from primary storage. [2025-10-22T18:01:46.417248] [INFO ] [MAIN ] CNMD: Loaded 32081 existing records. [2025-10-22T18:01:46.518549] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-22T18:01:46.616757] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:01:46.617347] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-22T18:01:46.617417] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-22T18:01:46.617796] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-22T18:01:46.617856] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-22T18:01:46.870588] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T18:01:47.026906] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:01:47.317763] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-22T18:01:47.432761] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T18:01:48.117718] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-22T18:01:48.335177] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T18:01:48.807188] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T18:01:48.917688] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-22T18:01:49.551615] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T18:01:49.717699] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-22T18:01:49.887698] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T18:01:50.517711] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-22T18:01:51.317696] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-22T18:01:51.558624] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T18:01:52.041823] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T18:01:52.117719] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-22T18:01:52.695589] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T18:01:52.917719] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-22T18:01:53.644872] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T18:01:53.717691] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-22T18:01:54.517723] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-22T18:01:54.612947] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T18:01:54.672946] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-22T18:01:55.317722] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-22T18:01:56.117698] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-22T18:01:56.406742] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T18:01:56.917702] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-22T18:01:57.042044] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T18:01:57.470748] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T18:01:57.717698] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-22T18:01:58.517722] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-22T18:01:58.656841] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T18:01:59.278680] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T18:01:59.317673] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-22T18:02:00.117726] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-22T18:02:00.377337] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T18:02:00.917694] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-22T18:02:01.458659] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-22T18:02:01.650735] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T18:02:01.717692] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-22T18:02:02.517754] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-22T18:02:02.909973] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T18:02:03.317668] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-22T18:02:03.636409] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-22T18:02:03.918908] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-22T18:02:04.117682] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-22T18:02:04.917725] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-22T18:02:05.288907] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-22T18:02:05.297126] [INFO ] [REMOTE ] CNI: Full fetch complete (74858 records). [2025-10-22T18:02:05.297236] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-22T18:02:05.682451] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-22T18:02:05.682566] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-22T18:02:05.683409] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-22T18:02:05.683473] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-22T18:02:05.684945] [DEBUG] [LOCAL ] CNI: Trimmed 74858 records to 51658 (keeping 200 days of data) [2025-10-22T18:02:05.748269] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-22T18:02:06.033221] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-22T18:02:06.061337] [DEBUG] [LOCAL ] CNI: Primary data saved (51658 records). [2025-10-22T18:02:06.061488] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-22T18:02:06.061572] [INFO ] [MAIN ] Update Progress: 493/2367 symbols completed. CNI took 33.3s. Estimated remaining: 3h 55m 46s. Rate: 7.9 symbols/min [2025-10-22T18:02:06.232382] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:02:06.272978] [DEBUG] [LOCAL ] CNNE: Loaded 35869 existing records from primary storage. [2025-10-22T18:02:06.273283] [INFO ] [MAIN ] CNNE: Loaded 35869 existing records. [2025-10-22T18:02:06.531237] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:02:06.531524] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-22T18:02:06.527000] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-22T18:02:06.531609] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-22T18:02:06.532171] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-22T18:02:06.532255] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-22T18:02:06.930138] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T18:02:06.946569] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T18:02:07.168958] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:02:07.317715] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-22T18:02:08.122712] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-22T18:02:08.138810] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T18:02:08.149557] [INFO ] [REMOTE ] CNK: Full fetch complete (76278 records). [2025-10-22T18:02:08.149724] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-22T18:02:08.533600] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-22T18:02:08.533706] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-22T18:02:08.534524] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-22T18:02:08.534585] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-22T18:02:08.536010] [DEBUG] [LOCAL ] CNK: Trimmed 76278 records to 52908 (keeping 200 days of data) [2025-10-22T18:02:08.853043] [DEBUG] [LOCAL ] CNK: Primary data saved (52908 records). [2025-10-22T18:02:08.853256] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-22T18:02:08.853345] [INFO ] [MAIN ] Update Progress: 494/2367 symbols completed. CNK took 35.1s. Estimated remaining: 3h 55m 20s. Rate: 8.0 symbols/min [2025-10-22T18:02:08.927228] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-22T18:02:09.024717] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:02:09.054687] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T18:02:09.097223] [DEBUG] [LOCAL ] CNO: Loaded 40420 existing records from primary storage. [2025-10-22T18:02:09.097495] [INFO ] [MAIN ] CNO: Loaded 40420 existing records. [2025-10-22T18:02:09.271515] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:02:09.271765] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-22T18:02:09.271814] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-22T18:02:09.271999] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-22T18:02:09.272037] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-22T18:02:09.631815] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T18:02:09.636684] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:02:09.717615] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-22T18:02:10.503605] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-22T18:02:10.508758] [INFO ] [REMOTE ] CNMD: Full fetch complete (47370 records). [2025-10-22T18:02:10.508853] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-22T18:02:10.522850] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-22T18:02:10.888541] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-22T18:02:10.888662] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-22T18:02:10.889442] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-22T18:02:10.889545] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-22T18:02:10.890625] [DEBUG] [LOCAL ] CNMD: Trimmed 47370 records to 32058 (keeping 200 days of data) [2025-10-22T18:02:11.096771] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T18:02:11.124586] [DEBUG] [LOCAL ] CNMD: Primary data saved (32058 records). [2025-10-22T18:02:11.124791] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-22T18:02:11.124875] [INFO ] [MAIN ] Update Progress: 495/2367 symbols completed. CNMD took 24.9s. Estimated remaining: 3h 54m 53s. Rate: 8.0 symbols/min [2025-10-22T18:02:11.292689] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:02:11.292880] [DEBUG] [LOCAL ] CNP: No existing data file found in primary storage. [2025-10-22T18:02:11.292918] [WARN ] [MAIN ] CNP: No existing data found, performing full refresh instead. [2025-10-22T18:02:11.293028] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-22T18:02:11.293068] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-22T18:02:11.293109] [DEBUG] [LOCAL ] CNP: No primary data file found to delete. [2025-10-22T18:02:11.293139] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-22T18:02:11.323907] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-22T18:02:11.646900] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:02:12.117721] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-22T18:02:12.298840] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T18:02:12.569303] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T18:02:12.917847] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-22T18:02:13.717784] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-22T18:02:13.805442] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T18:02:14.479136] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T18:02:14.517761] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-22T18:02:15.090768] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T18:02:15.317747] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-22T18:02:15.896979] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T18:02:16.117707] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-22T18:02:16.917881] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-22T18:02:17.163034] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T18:02:17.171294] [INFO ] [REMOTE ] CNM: Full fetch complete (73397 records). [2025-10-22T18:02:17.171446] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-22T18:02:17.172290] [FATAL] [VALIDATOR ] CNM: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:02:17.172385] [FATAL] [MAIN ] CNM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:02:17.172462] [WARN ] [MAIN ] CNM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:02:17.172548] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-22T18:02:17.172630] [DEBUG] [LOCAL ] CNM: No primary data file found to delete. [2025-10-22T18:02:17.172724] [INFO ] [LOCAL ] CNM: Starting deletion of derivative data. [2025-10-22T18:02:17.172932] [DEBUG] [LOCAL ] CNM: Deleted derivative data file. [2025-10-22T18:02:17.173631] [INFO ] [MAIN ] Update Progress: 496/2367 symbols completed. CNM took 34.4s. Estimated remaining: 3h 54m 40s. Rate: 8.0 symbols/min [2025-10-22T18:02:17.359268] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:02:17.414122] [DEBUG] [LOCAL ] CNQ: Loaded 53582 existing records from primary storage. [2025-10-22T18:02:17.414450] [INFO ] [MAIN ] CNQ: Loaded 53582 existing records. [2025-10-22T18:02:17.616240] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:02:17.616441] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-22T18:02:17.616489] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-22T18:02:17.616721] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-22T18:02:17.616778] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-22T18:02:17.722761] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-22T18:02:18.037494] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:02:18.098410] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T18:02:18.101389] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-22T18:02:18.517736] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-22T18:02:19.317720] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-22T18:02:19.473828] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-22T18:02:19.924529] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T18:02:20.117745] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-22T18:02:20.917988] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-22T18:02:21.156559] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T18:02:21.717907] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-22T18:02:21.984216] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T18:02:22.354906] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T18:02:22.517743] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-22T18:02:23.317716] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-22T18:02:23.422185] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T18:02:24.117686] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-22T18:02:24.484202] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T18:02:24.930066] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-22T18:02:24.935144] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T18:02:25.717712] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-22T18:02:25.930821] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T18:02:26.517726] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-22T18:02:26.790574] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T18:02:27.317709] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-22T18:02:27.422484] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T18:02:28.117724] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-22T18:02:28.422009] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T18:02:28.917742] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-22T18:02:29.058100] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T18:02:29.628387] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T18:02:29.717701] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-22T18:02:30.517686] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-22T18:02:30.939129] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-22T18:02:31.133701] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T18:02:31.317708] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-22T18:02:31.964173] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T18:02:32.117689] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-22T18:02:32.844299] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T18:02:32.849976] [INFO ] [REMOTE ] CNNE: Full fetch complete (50332 records). [2025-10-22T18:02:32.850126] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-22T18:02:32.850801] [FATAL] [VALIDATOR ] CNNE: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:02:32.850890] [FATAL] [MAIN ] CNNE: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:02:32.850946] [WARN ] [MAIN ] CNNE: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:02:32.851034] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-22T18:02:32.851113] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-22T18:02:32.851163] [INFO ] [LOCAL ] CNNE: Starting deletion of derivative data. [2025-10-22T18:02:32.851312] [DEBUG] [LOCAL ] CNNE: Deleted derivative data file. [2025-10-22T18:02:32.851410] [INFO ] [MAIN ] Update Progress: 497/2367 symbols completed. CNNE took 26.8s. Estimated remaining: 3h 55m 3s. Rate: 8.0 symbols/min [2025-10-22T18:02:32.922830] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-22T18:02:33.047039] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:02:33.047274] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-22T18:02:33.047329] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-22T18:02:33.047441] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-22T18:02:33.047484] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-22T18:02:33.047526] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-22T18:02:33.047558] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-22T18:02:33.396235] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:02:33.636909] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T18:02:33.717728] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-22T18:02:34.522746] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-10-22T18:02:34.538917] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T18:02:35.317760] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-22T18:02:35.640796] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T18:02:35.679489] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T18:02:36.117715] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-22T18:02:36.917698] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-10-22T18:02:37.288899] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-22T18:02:37.493281] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T18:02:37.717683] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-22T18:02:38.472395] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T18:02:38.517676] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-22T18:02:39.317695] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-10-22T18:02:39.544398] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T18:02:40.117712] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-22T18:02:40.569912] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-22T18:02:40.917706] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-22T18:02:41.206927] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T18:02:41.567721] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T18:02:41.717730] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-22T18:02:42.517757] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-10-22T18:02:42.812440] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T18:02:42.822574] [INFO ] [REMOTE ] CNP: Full fetch complete (77549 records). [2025-10-22T18:02:42.822786] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-22T18:02:43.169620] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T18:02:43.283362] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-22T18:02:43.283462] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-22T18:02:43.284489] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-22T18:02:43.284560] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-22T18:02:43.286148] [DEBUG] [LOCAL ] CNP: Trimmed 77549 records to 53475 (keeping 200 days of data) [2025-10-22T18:02:43.342043] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-22T18:02:43.631195] [DEBUG] [LOCAL ] CNP: Primary data saved (53475 records). [2025-10-22T18:02:43.631341] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-22T18:02:43.631420] [INFO ] [MAIN ] Update Progress: 498/2367 symbols completed. CNP took 32.5s. Estimated remaining: 3h 55m 8s. Rate: 7.9 symbols/min [2025-10-22T18:02:43.813815] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:02:43.814066] [DEBUG] [LOCAL ] CNS: No existing data file found in primary storage. [2025-10-22T18:02:43.814121] [WARN ] [MAIN ] CNS: No existing data found, performing full refresh instead. [2025-10-22T18:02:43.814427] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-22T18:02:43.814490] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-22T18:02:43.814533] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-22T18:02:43.814565] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-22T18:02:44.117898] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-22T18:02:44.200542] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:02:44.225990] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T18:02:44.707679] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-22T18:02:44.714354] [INFO ] [REMOTE ] CNO: Full fetch complete (60821 records). [2025-10-22T18:02:44.714514] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-22T18:02:44.930261] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-10-22T18:02:45.151892] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-22T18:02:45.151972] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-22T18:02:45.152700] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-22T18:02:45.152767] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-22T18:02:45.154041] [DEBUG] [LOCAL ] CNO: Trimmed 60821 records to 40344 (keeping 200 days of data) [2025-10-22T18:02:45.403521] [DEBUG] [LOCAL ] CNO: Primary data saved (40344 records). [2025-10-22T18:02:45.403680] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-22T18:02:45.403774] [INFO ] [MAIN ] Update Progress: 499/2367 symbols completed. CNO took 36.6s. Estimated remaining: 3h 54m 38s. Rate: 8.0 symbols/min [2025-10-22T18:02:45.588129] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:02:45.639922] [DEBUG] [LOCAL ] CNX: Loaded 51346 existing records from primary storage. [2025-10-22T18:02:45.640304] [INFO ] [MAIN ] CNX: Loaded 51346 existing records. [2025-10-22T18:02:45.723117] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-22T18:02:45.843176] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:02:45.843565] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-22T18:02:45.843759] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-22T18:02:45.844118] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-22T18:02:45.844164] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-22T18:02:46.002968] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T18:02:46.275145] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:02:46.517720] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-22T18:02:46.769805] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T18:02:47.078725] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-22T18:02:47.317711] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-10-22T18:02:48.130597] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-22T18:02:48.136736] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T18:02:48.917682] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-22T18:02:48.952235] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T18:02:49.717727] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-10-22T18:02:49.995352] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T18:02:50.021438] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T18:02:50.030791] [INFO ] [REMOTE ] CNQ: Full fetch complete (77741 records). [2025-10-22T18:02:50.030912] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-22T18:02:50.442821] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-22T18:02:50.442890] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-22T18:02:50.443847] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-22T18:02:50.443924] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-22T18:02:50.445470] [DEBUG] [LOCAL ] CNQ: Trimmed 77741 records to 53582 (keeping 200 days of data) [2025-10-22T18:02:50.534772] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-22T18:02:50.769941] [DEBUG] [LOCAL ] CNQ: Primary data saved (53582 records). [2025-10-22T18:02:50.770068] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-22T18:02:50.770725] [INFO ] [MAIN ] Update Progress: 500/2367 symbols completed. CNQ took 33.6s. Estimated remaining: 3h 54m 23s. Rate: 8.0 symbols/min [2025-10-22T18:02:50.944034] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:02:51.015748] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-22T18:02:51.040175] [DEBUG] [LOCAL ] CODI: Loaded 41906 existing records from primary storage. [2025-10-22T18:02:51.040467] [INFO ] [MAIN ] CODI: Loaded 41906 existing records. [2025-10-22T18:02:51.220132] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:02:51.220351] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-22T18:02:51.220414] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-22T18:02:51.220705] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-22T18:02:51.220777] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-22T18:02:51.321205] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-22T18:02:51.578031] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:02:51.679285] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T18:02:52.117712] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-22T18:02:52.917699] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-22T18:02:52.998519] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T18:02:53.364046] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T18:02:53.717639] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-22T18:02:54.114028] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-22T18:02:54.517695] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-22T18:02:54.777544] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T18:02:55.317696] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-10-22T18:02:55.935592] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T18:02:56.117751] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-22T18:02:56.587076] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T18:02:56.917754] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-22T18:02:57.717707] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-10-22T18:02:57.788138] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T18:02:57.920956] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-22T18:02:58.517733] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-22T18:02:59.317691] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-22T18:02:59.361883] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T18:02:59.504262] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T18:03:00.117725] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-22T18:03:00.917678] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-22T18:03:01.168956] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T18:03:01.462956] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T18:03:01.717714] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-22T18:03:02.387320] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T18:03:02.517736] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-10. [2025-10-22T18:03:03.317729] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-22T18:03:03.534141] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-22T18:03:04.117735] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-22T18:03:04.248135] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T18:03:04.255431] [INFO ] [REMOTE ] CNR: Full fetch complete (62554 records). [2025-10-22T18:03:04.255611] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-10-22T18:03:04.256450] [FATAL] [VALIDATOR ] CNR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:03:04.256535] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:03:04.256602] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:03:04.256782] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-22T18:03:04.256862] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-22T18:03:04.256901] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-22T18:03:04.256941] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-22T18:03:04.256998] [INFO ] [MAIN ] Update Progress: 501/2367 symbols completed. CNR took 31.4s. Estimated remaining: 3h 54m 37s. Rate: 8.0 symbols/min [2025-10-22T18:03:04.425505] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:03:04.425695] [DEBUG] [LOCAL ] COF: No existing data file found in primary storage. [2025-10-22T18:03:04.425748] [WARN ] [MAIN ] COF: No existing data found, performing full refresh instead. [2025-10-22T18:03:04.425865] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-22T18:03:04.425906] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-22T18:03:04.425948] [DEBUG] [LOCAL ] COF: No primary data file found to delete. [2025-10-22T18:03:04.425981] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-22T18:03:04.785921] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:03:04.808370] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T18:03:04.917710] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-22T18:03:05.180086] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-22T18:03:05.717713] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-22T18:03:06.517677] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-22T18:03:06.767043] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T18:03:06.875212] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T18:03:07.317718] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-22T18:03:08.117690] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-22T18:03:08.360635] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T18:03:08.537518] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T18:03:08.917716] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-22T18:03:09.717744] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-22T18:03:09.782165] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T18:03:10.517765] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-22T18:03:10.663681] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T18:03:11.317687] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-22T18:03:11.635097] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-22T18:03:11.893328] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T18:03:11.899926] [INFO ] [REMOTE ] CNS: Full fetch complete (31113 records). [2025-10-22T18:03:11.900057] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-22T18:03:11.900757] [FATAL] [VALIDATOR ] CNS: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:03:11.900862] [FATAL] [MAIN ] CNS: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:03:11.900925] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:03:11.900980] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-22T18:03:11.901053] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-22T18:03:11.901101] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-10-22T18:03:11.901158] [DEBUG] [LOCAL ] CNS: No derivative data file found to delete. [2025-10-22T18:03:11.901233] [INFO ] [MAIN ] Update Progress: 502/2367 symbols completed. CNS took 28.3s. Estimated remaining: 3h 54m 30s. Rate: 8.0 symbols/min [2025-10-22T18:03:12.080742] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:03:12.128704] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-22T18:03:12.131599] [DEBUG] [LOCAL ] COHR: Loaded 53377 existing records from primary storage. [2025-10-22T18:03:12.132054] [INFO ] [MAIN ] COHR: Loaded 53377 existing records. [2025-10-22T18:03:12.307757] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:03:12.307973] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-22T18:03:12.308019] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-22T18:03:12.308209] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-22T18:03:12.308248] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-22T18:03:12.656508] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:03:12.925486] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-22T18:03:12.951709] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T18:03:13.717734] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-22T18:03:13.959033] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T18:03:14.517674] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-22T18:03:14.619792] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T18:03:15.317690] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-22T18:03:15.489482] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T18:03:16.117735] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-22T18:03:16.806510] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-22T18:03:16.917703] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-22T18:03:17.271081] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-22T18:03:17.717696] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-22T18:03:17.814144] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T18:03:17.822260] [INFO ] [REMOTE ] CNX: Full fetch complete (74571 records). [2025-10-22T18:03:17.822409] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-22T18:03:17.823235] [FATAL] [VALIDATOR ] CNX: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:03:17.823355] [FATAL] [MAIN ] CNX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:03:17.823399] [WARN ] [MAIN ] CNX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:03:17.823438] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-22T18:03:17.823494] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-10-22T18:03:17.823528] [INFO ] [LOCAL ] CNX: Starting deletion of derivative data. [2025-10-22T18:03:17.823713] [DEBUG] [LOCAL ] CNX: Deleted derivative data file. [2025-10-22T18:03:17.823803] [INFO ] [MAIN ] Update Progress: 503/2367 symbols completed. CNX took 32.4s. Estimated remaining: 3h 54m 17s. Rate: 8.0 symbols/min [2025-10-22T18:03:18.002456] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:03:18.002743] [DEBUG] [LOCAL ] COLD: No existing data file found in primary storage. [2025-10-22T18:03:18.002803] [WARN ] [MAIN ] COLD: No existing data found, performing full refresh instead. [2025-10-22T18:03:18.002920] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-22T18:03:18.002963] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-22T18:03:18.003003] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-10-22T18:03:18.003078] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-22T18:03:18.380208] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:03:18.517741] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-22T18:03:18.887939] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-22T18:03:19.186466] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T18:03:19.317759] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-22T18:03:20.117731] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-22T18:03:20.513156] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T18:03:20.917683] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-22T18:03:21.392561] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-22T18:03:21.717705] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-22T18:03:22.117391] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T18:03:22.125613] [INFO ] [REMOTE ] CODI: Full fetch complete (53805 records). [2025-10-22T18:03:22.125856] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-22T18:03:22.525956] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-22T18:03:22.543850] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-22T18:03:22.544914] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-22T18:03:22.545706] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-22T18:03:22.545815] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-22T18:03:22.547149] [DEBUG] [LOCAL ] CODI: Trimmed 53805 records to 41954 (keeping 200 days of data) [2025-10-22T18:03:22.738831] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T18:03:22.827790] [DEBUG] [LOCAL ] CODI: Primary data saved (41954 records). [2025-10-22T18:03:22.827924] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-22T18:03:22.828494] [INFO ] [MAIN ] Update Progress: 504/2367 symbols completed. CODI took 32.1s. Estimated remaining: 3h 53m 60s. Rate: 8.0 symbols/min [2025-10-22T18:03:22.998005] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:03:23.048424] [DEBUG] [LOCAL ] COMP: Loaded 53404 existing records from primary storage. [2025-10-22T18:03:23.048775] [INFO ] [MAIN ] COMP: Loaded 53404 existing records. [2025-10-22T18:03:23.224228] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:03:23.224504] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-22T18:03:23.224578] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-22T18:03:23.225221] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-22T18:03:23.225290] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-22T18:03:23.325432] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-22T18:03:23.668142] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T18:03:23.719509] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:03:24.117707] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-22T18:03:24.521820] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-22T18:03:24.917707] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-22T18:03:25.010612] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T18:03:25.717763] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-22T18:03:26.082774] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-22T18:03:26.517761] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-22T18:03:26.911447] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-22T18:03:27.317694] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-22T18:03:27.469396] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T18:03:28.117707] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-22T18:03:28.310880] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T18:03:28.917717] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-22T18:03:29.169962] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T18:03:29.717735] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-22T18:03:30.171798] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-22T18:03:30.517729] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-22T18:03:30.749861] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T18:03:31.317732] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-22T18:03:31.392736] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T18:03:32.117781] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-22T18:03:32.280499] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T18:03:32.917677] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-22T18:03:33.316047] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-22T18:03:33.717748] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-22T18:03:34.109825] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T18:03:34.517708] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-22T18:03:34.864788] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T18:03:35.317693] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-22T18:03:35.655991] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-22T18:03:36.117727] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-22T18:03:36.379787] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T18:03:36.917749] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-22T18:03:37.557207] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-22T18:03:37.717700] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-22T18:03:37.905422] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T18:03:38.243014] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T18:03:38.517707] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-22T18:03:39.317747] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-22T18:03:39.659035] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T18:03:39.667262] [INFO ] [REMOTE ] COHR: Full fetch complete (77076 records). [2025-10-22T18:03:39.667432] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-22T18:03:39.668328] [FATAL] [VALIDATOR ] COHR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:03:39.668434] [FATAL] [MAIN ] COHR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:03:39.668501] [WARN ] [MAIN ] COHR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:03:39.668575] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-22T18:03:39.668664] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-22T18:03:39.668723] [INFO ] [LOCAL ] COHR: Starting deletion of derivative data. [2025-10-22T18:03:39.668953] [DEBUG] [LOCAL ] COHR: Deleted derivative data file. [2025-10-22T18:03:39.669045] [INFO ] [MAIN ] Update Progress: 505/2367 symbols completed. COHR took 27.8s. Estimated remaining: 3h 54m 27s. Rate: 7.9 symbols/min [2025-10-22T18:03:39.833898] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:03:39.868319] [DEBUG] [LOCAL ] CON: Loaded 38811 existing records from primary storage. [2025-10-22T18:03:39.868590] [INFO ] [MAIN ] CON: Loaded 38811 existing records. [2025-10-22T18:03:40.041976] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:03:40.042205] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-22T18:03:40.042254] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-22T18:03:40.043160] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-22T18:03:40.043218] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-22T18:03:40.121704] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-22T18:03:40.421603] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:03:40.457276] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T18:03:40.917686] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-22T18:03:41.021312] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T18:03:41.141495] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T18:03:41.150264] [INFO ] [REMOTE ] COF: Full fetch complete (77705 records). [2025-10-22T18:03:41.150396] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-22T18:03:41.555430] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-22T18:03:41.555517] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-22T18:03:41.556357] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-22T18:03:41.556424] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-22T18:03:41.557924] [DEBUG] [LOCAL ] COF: Trimmed 77705 records to 53625 (keeping 200 days of data) [2025-10-22T18:03:41.737564] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-22T18:03:41.888908] [DEBUG] [LOCAL ] COF: Primary data saved (53625 records). [2025-10-22T18:03:41.889044] [INFO ] [MAIN ] COF: Full history saved. [2025-10-22T18:03:41.889114] [INFO ] [MAIN ] Update Progress: 506/2367 symbols completed. COF took 37.6s. Estimated remaining: 3h 53m 59s. Rate: 8.0 symbols/min [2025-10-22T18:03:42.057234] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:03:42.080185] [DEBUG] [LOCAL ] COOK: Loaded 24899 existing records from primary storage. [2025-10-22T18:03:42.080405] [INFO ] [MAIN ] COOK: Loaded 24899 existing records. [2025-10-22T18:03:42.254673] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:03:42.254911] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-22T18:03:42.254959] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-22T18:03:42.255123] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-22T18:03:42.255161] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-22T18:03:42.521364] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-22T18:03:42.619165] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:03:42.646548] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T18:03:43.317705] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-22T18:03:43.513238] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T18:03:44.117747] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-22T18:03:44.436576] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T18:03:44.917705] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-22T18:03:44.958126] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-22T18:03:45.463460] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T18:03:45.717673] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-22T18:03:45.772516] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-22T18:03:46.517752] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-22T18:03:47.247223] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T18:03:47.317710] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-22T18:03:48.107973] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T18:03:48.118834] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-22T18:03:48.796859] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T18:03:48.917715] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-22T18:03:49.185055] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T18:03:49.717701] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-22T18:03:50.517725] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-22T18:03:50.633124] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T18:03:50.642023] [INFO ] [REMOTE ] COLD: Full fetch complete (74866 records). [2025-10-22T18:03:50.642150] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-22T18:03:50.903031] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-22T18:03:51.105069] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-22T18:03:51.105153] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-22T18:03:51.105983] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-22T18:03:51.106043] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-22T18:03:51.107392] [DEBUG] [LOCAL ] COLD: Trimmed 74866 records to 52485 (keeping 200 days of data) [2025-10-22T18:03:51.317692] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-22T18:03:51.417949] [DEBUG] [LOCAL ] COLD: Primary data saved (52485 records). [2025-10-22T18:03:51.418080] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-22T18:03:51.418149] [INFO ] [MAIN ] Update Progress: 507/2367 symbols completed. COLD took 33.6s. Estimated remaining: 3h 53m 59s. Rate: 7.9 symbols/min [2025-10-22T18:03:51.583773] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:03:51.629758] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-22T18:03:51.630064] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-10-22T18:03:51.809143] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:03:51.809391] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-22T18:03:51.809461] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-22T18:03:51.809693] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-22T18:03:51.809748] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-22T18:03:52.121880] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-22T18:03:52.181779] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:03:52.216204] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T18:03:52.465445] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T18:03:52.917689] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-22T18:03:53.717742] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-22T18:03:53.740848] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T18:03:54.006870] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T18:03:54.517695] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-22T18:03:55.228737] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T18:03:55.317723] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-22T18:03:55.592553] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-22T18:03:56.117687] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-22T18:03:56.450692] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T18:03:56.917730] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-22T18:03:57.717636] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-22T18:03:58.056808] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T18:03:58.066533] [INFO ] [REMOTE ] COMP: Full fetch complete (77407 records). [2025-10-22T18:03:58.066779] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-22T18:03:58.401958] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T18:03:58.519108] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-22T18:03:58.539481] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-22T18:03:58.539559] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-22T18:03:58.540579] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-22T18:03:58.540777] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-22T18:03:58.542477] [DEBUG] [LOCAL ] COMP: Trimmed 77407 records to 53404 (keeping 200 days of data) [2025-10-22T18:03:58.842448] [DEBUG] [LOCAL ] COMP: Primary data saved (53404 records). [2025-10-22T18:03:58.842586] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-22T18:03:58.843205] [INFO ] [MAIN ] Update Progress: 508/2367 symbols completed. COMP took 36.0s. Estimated remaining: 3h 53m 51s. Rate: 7.9 symbols/min [2025-10-22T18:03:59.028715] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:03:59.029813] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T18:03:59.079619] [DEBUG] [LOCAL ] COR: Loaded 46340 existing records from primary storage. [2025-10-22T18:03:59.079970] [INFO ] [MAIN ] COR: Loaded 46340 existing records. [2025-10-22T18:03:59.250752] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:03:59.250961] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-22T18:03:59.251009] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-22T18:03:59.251201] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-22T18:03:59.251239] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-22T18:03:59.322814] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-22T18:03:59.596171] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:04:00.117714] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-22T18:04:00.672742] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-22T18:04:00.879404] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T18:04:00.917661] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-22T18:04:01.621038] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T18:04:01.717677] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-22T18:04:02.138438] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T18:04:02.517710] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-22T18:04:03.013887] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-22T18:04:03.018300] [INFO ] [REMOTE ] COOK: Full fetch complete (33095 records). [2025-10-22T18:04:03.018373] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-22T18:04:03.322795] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-22T18:04:03.384571] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-22T18:04:03.384681] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-22T18:04:03.385210] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-22T18:04:03.385253] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-22T18:04:03.386083] [DEBUG] [LOCAL ] COOK: Trimmed 33095 records to 24851 (keeping 200 days of data) [2025-10-22T18:04:03.519150] [DEBUG] [LOCAL ] COOK: Primary data saved (24851 records). [2025-10-22T18:04:03.519278] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-22T18:04:03.519356] [INFO ] [MAIN ] Update Progress: 509/2367 symbols completed. COOK took 21.6s. Estimated remaining: 3h 53m 33s. Rate: 8.0 symbols/min [2025-10-22T18:04:03.688736] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:04:03.688932] [DEBUG] [LOCAL ] COTY: No existing data file found in primary storage. [2025-10-22T18:04:03.688978] [WARN ] [MAIN ] COTY: No existing data found, performing full refresh instead. [2025-10-22T18:04:03.689098] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-22T18:04:03.689138] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-22T18:04:03.689178] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-22T18:04:03.689210] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-22T18:04:04.058411] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T18:04:04.057396] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:04:04.064710] [INFO ] [REMOTE ] CON: Full fetch complete (56411 records). [2025-10-22T18:04:04.064789] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-22T18:04:04.065356] [FATAL] [VALIDATOR ] CON: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:04:04.065439] [FATAL] [MAIN ] CON: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:04:04.065481] [WARN ] [MAIN ] CON: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:04:04.065543] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-22T18:04:04.065612] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-22T18:04:04.065706] [INFO ] [LOCAL ] CON: Starting deletion of derivative data. [2025-10-22T18:04:04.065862] [DEBUG] [LOCAL ] CON: Deleted derivative data file. [2025-10-22T18:04:04.065947] [INFO ] [MAIN ] Update Progress: 510/2367 symbols completed. CON took 24.4s. Estimated remaining: 3h 53m 0s. Rate: 8.0 symbols/min [2025-10-22T18:04:04.128228] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-22T18:04:04.235053] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:04:04.235215] [DEBUG] [LOCAL ] COUR: No existing data file found in primary storage. [2025-10-22T18:04:04.235253] [WARN ] [MAIN ] COUR: No existing data found, performing full refresh instead. [2025-10-22T18:04:04.235361] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-22T18:04:04.235402] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-22T18:04:04.235445] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-10-22T18:04:04.235475] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-22T18:04:04.576954] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:04:04.917711] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-22T18:04:05.137361] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T18:04:05.717720] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-22T18:04:05.991443] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T18:04:06.517673] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-22T18:04:06.833728] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-22T18:04:07.317721] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-22T18:04:07.776446] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-22T18:04:08.117781] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-22T18:04:08.301435] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T18:04:08.424275] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T18:04:08.917743] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-22T18:04:09.717755] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-22T18:04:10.010438] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T18:04:10.517735] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-22T18:04:11.271958] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-22T18:04:11.317719] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-22T18:04:11.393693] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T18:04:12.117698] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-22T18:04:12.167988] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T18:04:12.917671] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-22T18:04:13.461888] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-22T18:04:13.717717] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-22T18:04:13.916710] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T18:04:14.443196] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T18:04:14.517614] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-22T18:04:15.317759] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-22T18:04:15.465145] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T18:04:16.117738] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-22T18:04:16.497539] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T18:04:16.917782] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-22T18:04:17.155704] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T18:04:17.717695] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-22T18:04:17.832169] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T18:04:18.212178] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T18:04:18.517752] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-22T18:04:19.317673] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-22T18:04:19.492267] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T18:04:20.119988] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-22T18:04:20.123115] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T18:04:20.579775] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T18:04:20.917798] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-22T18:04:21.717677] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-22T18:04:21.991499] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-22T18:04:22.517739] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-22T18:04:23.104134] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-22T18:04:23.317702] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-22T18:04:23.443150] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T18:04:24.117705] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-22T18:04:24.334062] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T18:04:24.917743] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-22T18:04:24.972668] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T18:04:25.717322] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T18:04:25.727614] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-22T18:04:26.517750] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-22T18:04:26.753686] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T18:04:27.317687] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-22T18:04:27.677563] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T18:04:28.115781] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T18:04:28.124503] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-22T18:04:28.917618] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-22T18:04:29.119214] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T18:04:29.638401] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T18:04:29.717716] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-22T18:04:30.517747] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-22T18:04:30.548545] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T18:04:31.317695] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-22T18:04:31.578073] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T18:04:31.586698] [INFO ] [REMOTE ] COTY: Full fetch complete (76906 records). [2025-10-22T18:04:31.586856] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-22T18:04:31.587711] [FATAL] [VALIDATOR ] COTY: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:04:31.587820] [FATAL] [MAIN ] COTY: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:04:31.587896] [WARN ] [MAIN ] COTY: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:04:31.587991] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-22T18:04:31.588077] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-22T18:04:31.588117] [INFO ] [LOCAL ] COTY: Starting deletion of derivative data. [2025-10-22T18:04:31.588158] [DEBUG] [LOCAL ] COTY: No derivative data file found to delete. [2025-10-22T18:04:31.588216] [INFO ] [MAIN ] Update Progress: 511/2367 symbols completed. COTY took 28.1s. Estimated remaining: 3h 54m 5s. Rate: 7.9 symbols/min [2025-10-22T18:04:31.755211] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:04:31.804311] [DEBUG] [LOCAL ] CP: Loaded 53233 existing records from primary storage. [2025-10-22T18:04:31.804670] [INFO ] [MAIN ] CP: Loaded 53233 existing records. [2025-10-22T18:04:31.980345] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:04:31.980566] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-22T18:04:31.980616] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-22T18:04:31.980859] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-22T18:04:31.980915] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-22T18:04:32.120535] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-22T18:04:32.330670] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:04:32.680110] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-22T18:04:32.917724] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-22T18:04:33.288269] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-22T18:04:33.717704] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-22T18:04:33.988949] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T18:04:33.996781] [INFO ] [REMOTE ] COR: Full fetch complete (68464 records). [2025-10-22T18:04:33.996981] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-22T18:04:34.388957] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-22T18:04:34.389063] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-22T18:04:34.389920] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-22T18:04:34.389987] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-22T18:04:34.391416] [DEBUG] [LOCAL ] COR: Trimmed 68464 records to 46258 (keeping 200 days of data) [2025-10-22T18:04:34.568470] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-22T18:04:34.679128] [DEBUG] [LOCAL ] COR: Primary data saved (46258 records). [2025-10-22T18:04:34.679338] [INFO ] [MAIN ] COR: Full history saved. [2025-10-22T18:04:34.679889] [INFO ] [MAIN ] Update Progress: 512/2367 symbols completed. COR took 35.8s. Estimated remaining: 3h 53m 41s. Rate: 7.9 symbols/min [2025-10-22T18:04:34.853795] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:04:34.854163] [DEBUG] [LOCAL ] CPA: No existing data file found in primary storage. [2025-10-22T18:04:34.854323] [WARN ] [MAIN ] CPA: No existing data found, performing full refresh instead. [2025-10-22T18:04:34.870095] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-22T18:04:34.883143] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-22T18:04:34.883356] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-10-22T18:04:34.883446] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-22T18:04:34.929423] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T18:04:35.250277] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:04:35.317708] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-22T18:04:35.546130] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T18:04:35.554978] [INFO ] [REMOTE ] COUR: Full fetch complete (71181 records). [2025-10-22T18:04:35.555143] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-22T18:04:35.843598] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T18:04:35.892436] [INFO ] [REMOTE ] COP: Full fetch complete (77906 records). [2025-10-22T18:04:35.898385] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-22T18:04:36.097080] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-22T18:04:36.102320] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-22T18:04:36.108352] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-22T18:04:36.108443] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-22T18:04:36.126214] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-22T18:04:36.257994] [DEBUG] [LOCAL ] COUR: Trimmed 71181 records to 49401 (keeping 200 days of data) [2025-10-22T18:04:36.461177] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-22T18:04:36.465492] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-22T18:04:36.466464] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-22T18:04:36.475117] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-22T18:04:36.491332] [DEBUG] [LOCAL ] COP: Trimmed 77906 records to 53727 (keeping 200 days of data) [2025-10-22T18:04:36.786144] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:04:36.868501] [DEBUG] [LOCAL ] COUR: Primary data saved (49401 records). [2025-10-22T18:04:36.876150] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-22T18:04:36.903900] [INFO ] [MAIN ] Update Progress: 513/2367 symbols completed. COUR took 32.8s. Estimated remaining: 3h 53m 15s. Rate: 7.9 symbols/min [2025-10-22T18:04:36.925723] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-22T18:04:37.103694] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:04:37.108729] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-22T18:04:37.108792] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-22T18:04:37.108910] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-22T18:04:37.108952] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-22T18:04:37.108992] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-22T18:04:37.109023] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-22T18:04:37.334929] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-10-22T18:04:37.344162] [INFO ] [MAIN ] COP: Full history saved. [2025-10-22T18:04:37.359614] [INFO ] [MAIN ] Update Progress: 514/2367 symbols completed. COP took 45.9s. Estimated remaining: 3h 52m 41s. Rate: 8.0 symbols/min [2025-10-22T18:04:37.694269] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:04:37.720327] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-22T18:04:37.720017] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:04:37.751082] [DEBUG] [LOCAL ] CPAY: Loaded 30239 existing records from primary storage. [2025-10-22T18:04:37.751468] [INFO ] [MAIN ] CPAY: Loaded 30239 existing records. [2025-10-22T18:04:37.938014] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:04:37.953420] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-22T18:04:37.953582] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-22T18:04:37.954947] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-22T18:04:37.954905] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-22T18:04:37.955079] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-22T18:04:38.109619] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-22T18:04:38.337927] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:04:38.352793] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T18:04:38.517683] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-22T18:04:38.874807] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-22T18:04:39.317714] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-22T18:04:40.117713] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-22T18:04:40.701104] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T18:04:40.917735] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-22T18:04:41.195629] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T18:04:41.717729] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-22T18:04:42.251603] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-22T18:04:42.517717] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-22T18:04:43.115429] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T18:04:43.317684] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-22T18:04:43.745609] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-22T18:04:44.117708] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-22T18:04:44.288469] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T18:04:44.417125] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-22T18:04:44.917689] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-22T18:04:45.717736] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-22T18:04:46.517669] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-22T18:04:46.846612] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T18:04:47.083347] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-22T18:04:47.185503] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T18:04:47.317704] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-22T18:04:48.117698] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-22T18:04:48.478395] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-22T18:04:48.639011] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T18:04:48.917675] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-22T18:04:49.356518] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-22T18:04:49.717718] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-22T18:04:50.517667] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-22T18:04:50.948332] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-22T18:04:51.317683] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-22T18:04:52.117709] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-22T18:04:52.311462] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T18:04:52.828088] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T18:04:52.917674] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-22T18:04:53.032692] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-22T18:04:53.717704] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-22T18:04:54.080585] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-22T18:04:54.391572] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T18:04:54.517680] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-22T18:04:55.035797] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-22T18:04:55.317675] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-22T18:04:56.117731] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-22T18:04:56.627010] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T18:04:56.917720] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-22T18:04:57.129027] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T18:04:57.717716] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-22T18:04:58.360311] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T18:04:58.361350] [INFO ] [REMOTE ] CPAC: Full fetch complete (1790 records). [2025-10-22T18:04:58.361423] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-22T18:04:58.550431] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T18:04:58.550817] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:04:58.519451] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-22T18:04:58.551626] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:04:58.551723] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-22T18:04:58.551790] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-22T18:04:58.551941] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-22T18:04:58.552030] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-22T18:04:58.552123] [INFO ] [MAIN ] Update Progress: 515/2367 symbols completed. CPAC took 21.6s. Estimated remaining: 3h 53m 23s. Rate: 7.9 symbols/min [2025-10-22T18:04:58.729813] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:04:58.729982] [DEBUG] [LOCAL ] CPF: No existing data file found in primary storage. [2025-10-22T18:04:58.730084] [WARN ] [MAIN ] CPF: No existing data found, performing full refresh instead. [2025-10-22T18:04:58.730314] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-22T18:04:58.730384] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-22T18:04:58.730546] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-10-22T18:04:58.730605] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-22T18:04:58.920107] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-22T18:04:59.133268] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:04:59.317691] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-22T18:04:59.766464] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T18:05:00.117752] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-22T18:05:00.917709] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-22T18:05:01.324303] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T18:05:01.364084] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T18:05:01.717729] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-22T18:05:02.297682] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T18:05:02.301888] [INFO ] [REMOTE ] CPA: Full fetch complete (41143 records). [2025-10-22T18:05:02.301990] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-22T18:05:02.527257] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-22T18:05:02.701532] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-22T18:05:02.701623] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-22T18:05:02.702217] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-22T18:05:02.702271] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-22T18:05:02.703341] [DEBUG] [LOCAL ] CPA: Trimmed 41143 records to 27769 (keeping 200 days of data) [2025-10-22T18:05:02.875861] [DEBUG] [LOCAL ] CPA: Primary data saved (27769 records). [2025-10-22T18:05:02.876004] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-22T18:05:02.876077] [INFO ] [MAIN ] Update Progress: 516/2367 symbols completed. CPA took 28.2s. Estimated remaining: 3h 53m 4s. Rate: 7.9 symbols/min [2025-10-22T18:05:03.041826] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:05:03.057171] [DEBUG] [LOCAL ] CPK: Loaded 13991 existing records from primary storage. [2025-10-22T18:05:03.057389] [INFO ] [MAIN ] CPK: Loaded 13991 existing records. [2025-10-22T18:05:03.232786] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:05:03.233004] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-22T18:05:03.233049] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-22T18:05:03.233200] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-22T18:05:03.233237] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-22T18:05:03.323577] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-22T18:05:03.590827] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:05:03.608110] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T18:05:04.117679] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-22T18:05:04.442899] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T18:05:04.450179] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T18:05:04.917706] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-22T18:05:05.011109] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T18:05:05.717696] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-22T18:05:05.898177] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-22T18:05:06.517722] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-22T18:05:07.155458] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T18:05:07.314376] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-22T18:05:07.317607] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-22T18:05:08.117712] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-22T18:05:08.236409] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-22T18:05:08.917748] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-22T18:05:09.468255] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T18:05:09.717722] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-22T18:05:10.517615] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-22T18:05:10.881690] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T18:05:10.990916] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T18:05:10.999576] [INFO ] [REMOTE ] CP: Full fetch complete (77304 records). [2025-10-22T18:05:10.999727] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-22T18:05:11.322741] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-22T18:05:11.402919] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-22T18:05:11.402995] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-22T18:05:11.403831] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-22T18:05:11.403893] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-22T18:05:11.405249] [DEBUG] [LOCAL ] CP: Trimmed 77304 records to 53228 (keeping 200 days of data) [2025-10-22T18:05:11.739277] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T18:05:11.752458] [DEBUG] [LOCAL ] CP: Primary data saved (53228 records). [2025-10-22T18:05:11.752622] [INFO ] [MAIN ] CP: Full history saved. [2025-10-22T18:05:11.752952] [INFO ] [MAIN ] Update Progress: 517/2367 symbols completed. CP took 40.2s. Estimated remaining: 3h 53m 1s. Rate: 7.9 symbols/min [2025-10-22T18:05:12.117691] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-22T18:05:12.917708] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-22T18:05:12.988716] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T18:05:12.994002] [INFO ] [REMOTE ] CPAY: Full fetch complete (44761 records). [2025-10-22T18:05:12.994136] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-22T18:05:13.356711] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-22T18:05:13.401022] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-22T18:05:13.401133] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-22T18:05:13.401895] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-22T18:05:13.401961] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-22T18:05:13.403008] [DEBUG] [LOCAL ] CPAY: Trimmed 44761 records to 30086 (keeping 200 days of data) [2025-10-22T18:05:13.592540] [DEBUG] [LOCAL ] CPAY: Primary data saved (30086 records). [2025-10-22T18:05:13.592715] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-22T18:05:13.592803] [INFO ] [MAIN ] Update Progress: 518/2367 symbols completed. CPAY took 36.2s. Estimated remaining: 3h 52m 33s. Rate: 8.0 symbols/min [2025-10-22T18:05:13.717689] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-22T18:05:13.950273] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T18:05:14.517711] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-22T18:05:14.644492] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-22T18:05:15.317752] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-22T18:05:15.645769] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-22T18:05:16.036576] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-22T18:05:16.117724] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-22T18:05:16.917710] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-22T18:05:17.119893] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T18:05:17.703784] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T18:05:17.717681] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-22T18:05:18.517686] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-22T18:05:18.554052] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-22T18:05:19.317670] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-22T18:05:19.780542] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-22T18:05:20.117688] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-22T18:05:20.186580] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-22T18:05:20.917680] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-22T18:05:21.139565] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T18:05:21.717996] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-22T18:05:21.783856] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T18:05:21.787135] [INFO ] [REMOTE ] CPK: Full fetch complete (18761 records). [2025-10-22T18:05:21.787211] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-22T18:05:22.178728] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-22T18:05:22.178828] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-22T18:05:22.179268] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-22T18:05:22.179309] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-22T18:05:22.179945] [DEBUG] [LOCAL ] CPK: Trimmed 18761 records to 13889 (keeping 200 days of data) [2025-10-22T18:05:22.264208] [DEBUG] [LOCAL ] CPK: Primary data saved (13889 records). [2025-10-22T18:05:22.264335] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-22T18:05:22.264413] [INFO ] [MAIN ] Update Progress: 519/2367 symbols completed. CPK took 19.4s. Estimated remaining: 3h 52m 30s. Rate: 7.9 symbols/min [2025-10-22T18:05:22.598023] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-22T18:05:22.601085] [INFO ] [REMOTE ] CPF: Full fetch complete (23317 records). [2025-10-22T18:05:22.601175] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-22T18:05:22.963316] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-22T18:05:22.963392] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-22T18:05:22.963833] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-22T18:05:22.963893] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-22T18:05:22.964748] [DEBUG] [LOCAL ] CPF: Trimmed 23317 records to 15178 (keeping 200 days of data) [2025-10-22T18:05:23.052386] [DEBUG] [LOCAL ] CPF: Primary data saved (15178 records). [2025-10-22T18:05:23.052517] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-22T18:05:23.052587] [INFO ] [MAIN ] Update Progress: 520/2367 symbols completed. CPF took 24.5s. Estimated remaining: 3h 51m 58s. Rate: 8.0 symbols/min [2025-10-22T18:05:23.689123] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:05:23.706362] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:05:23.753994] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:05:23.758059] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:05:23.784892] [DEBUG] [LOCAL ] CPS: Loaded 24974 existing records from primary storage. [2025-10-22T18:05:23.785463] [INFO ] [MAIN ] CPS: Loaded 24974 existing records. [2025-10-22T18:05:24.026334] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:05:24.027823] [DEBUG] [LOCAL ] CPRI: Loaded 52438 existing records from primary storage. [2025-10-22T18:05:24.041980] [INFO ] [MAIN ] CPRI: Loaded 52438 existing records. [2025-10-22T18:05:24.042138] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-22T18:05:24.053303] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-22T18:05:24.084879] [DEBUG] [LOCAL ] CPNG: Loaded 53679 existing records from primary storage. [2025-10-22T18:05:24.084197] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-22T18:05:24.101242] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-22T18:05:24.085412] [DEBUG] [LOCAL ] CPT: Loaded 44521 existing records from primary storage. [2025-10-22T18:05:24.115760] [INFO ] [MAIN ] CPNG: Loaded 53679 existing records. [2025-10-22T18:05:24.131522] [INFO ] [MAIN ] CPT: Loaded 44521 existing records. [2025-10-22T18:05:24.673008] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:05:24.738197] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-22T18:05:24.741740] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-22T18:05:24.811396] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-22T18:05:24.826803] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:05:24.833765] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-22T18:05:24.842392] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:05:24.902556] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-22T18:05:24.918741] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-22T18:05:24.962194] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-22T18:05:24.962270] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-22T18:05:25.025342] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-22T18:05:25.034496] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-22T18:05:25.034319] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-22T18:05:25.086858] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-22T18:05:25.326240] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:05:25.429256] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-22T18:05:25.967158] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:05:26.017013] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-22T18:05:26.195774] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:05:26.198927] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:05:26.199258] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-22T18:05:26.200250] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-22T18:05:27.219562] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T18:05:27.224234] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-22T18:05:27.875006] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T18:05:27.883915] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-22T18:05:27.912554] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-22T18:05:27.923475] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-22T18:05:27.970938] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T18:05:28.011445] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T18:05:28.117671] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-22T18:05:28.917698] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-22T18:05:29.415115] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T18:05:29.506223] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T18:05:29.558159] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T18:05:29.717733] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-22T18:05:30.517781] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-22T18:05:31.068879] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-22T18:05:31.317702] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-22T18:05:31.405880] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T18:05:31.854503] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T18:05:32.117712] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-22T18:05:32.917715] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-22T18:05:33.530433] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-22T18:05:33.717687] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-22T18:05:34.001874] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T18:05:34.055509] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T18:05:34.517694] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-22T18:05:35.317693] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-22T18:05:35.710378] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T18:05:36.117695] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-22T18:05:36.360582] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T18:05:36.762539] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T18:05:36.917691] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-22T18:05:37.717727] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-22T18:05:38.231897] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-22T18:05:38.517778] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-22T18:05:38.740463] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T18:05:38.741636] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-22T18:05:39.317743] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-22T18:05:40.117734] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-22T18:05:40.234054] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T18:05:40.491993] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-22T18:05:40.917746] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-22T18:05:41.717702] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-22T18:05:42.315859] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-22T18:05:42.517714] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-22T18:05:42.736432] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T18:05:43.068319] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T18:05:43.317782] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-22T18:05:44.117696] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-22T18:05:44.917674] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-22T18:05:45.042885] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-22T18:05:45.045364] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T18:05:45.379308] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-22T18:05:45.702048] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T18:05:45.717693] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-22T18:05:46.517681] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-22T18:05:47.317723] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-22T18:05:48.116315] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T18:05:48.125822] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-22T18:05:48.178746] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-22T18:05:48.917664] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-22T18:05:49.110154] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T18:05:49.386566] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T18:05:49.717691] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-22T18:05:50.517728] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-22T18:05:50.656319] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T18:05:50.664256] [INFO ] [REMOTE ] CPT: Full fetch complete (64746 records). [2025-10-22T18:05:50.664455] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-22T18:05:51.039935] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-22T18:05:51.040033] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-22T18:05:51.040907] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-22T18:05:51.040982] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-22T18:05:51.042215] [DEBUG] [LOCAL ] CPT: Trimmed 64746 records to 44485 (keeping 200 days of data) [2025-10-22T18:05:51.316846] [DEBUG] [LOCAL ] CPT: Primary data saved (44485 records). [2025-10-22T18:05:51.316991] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-22T18:05:51.318108] [INFO ] [MAIN ] Update Progress: 521/2367 symbols completed. CPT took 28.2s. Estimated remaining: 3h 53m 4s. Rate: 7.9 symbols/min [2025-10-22T18:05:51.318198] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-22T18:05:51.489878] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:05:51.505405] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T18:05:51.526437] [DEBUG] [LOCAL ] CQP: Loaded 18719 existing records from primary storage. [2025-10-22T18:05:51.526697] [INFO ] [MAIN ] CQP: Loaded 18719 existing records. [2025-10-22T18:05:51.703240] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:05:51.703680] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-22T18:05:51.703798] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-22T18:05:51.704302] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-22T18:05:51.704396] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-22T18:05:52.021635] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-22T18:05:52.110209] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:05:52.117605] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-22T18:05:52.917883] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-22T18:05:53.157254] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T18:05:53.169924] [INFO ] [REMOTE ] CPRI: Full fetch complete (76231 records). [2025-10-22T18:05:53.170137] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-22T18:05:53.516252] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T18:05:53.720973] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-22T18:05:53.784107] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-22T18:05:53.894107] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-22T18:05:53.894233] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-22T18:05:53.895697] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-22T18:05:53.895781] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-22T18:05:53.897824] [DEBUG] [LOCAL ] CPRI: Trimmed 76231 records to 52430 (keeping 200 days of data) [2025-10-22T18:05:54.266341] [DEBUG] [LOCAL ] CPRI: Primary data saved (52430 records). [2025-10-22T18:05:54.266521] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-22T18:05:54.266675] [INFO ] [MAIN ] Update Progress: 522/2367 symbols completed. CPRI took 31.2s. Estimated remaining: 3h 52m 40s. Rate: 7.9 symbols/min [2025-10-22T18:05:54.472355] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:05:54.496240] [DEBUG] [LOCAL ] CR: Loaded 23996 existing records from primary storage. [2025-10-22T18:05:54.496495] [INFO ] [MAIN ] CR: Loaded 23996 existing records. [2025-10-22T18:05:54.525943] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-22T18:05:54.681272] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:05:54.681509] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-22T18:05:54.681559] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-22T18:05:54.681770] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-22T18:05:54.681827] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-22T18:05:55.060280] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T18:05:55.065707] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:05:55.317710] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-22T18:05:56.117700] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-22T18:05:56.478232] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T18:05:56.741511] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-22T18:05:56.749807] [INFO ] [REMOTE ] CPNG: Full fetch complete (77400 records). [2025-10-22T18:05:56.749928] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-22T18:05:56.750747] [FATAL] [VALIDATOR ] CPNG: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:05:56.750835] [FATAL] [MAIN ] CPNG: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:05:56.750878] [WARN ] [MAIN ] CPNG: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:05:56.750916] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-22T18:05:56.750985] [DEBUG] [LOCAL ] CPNG: No primary data file found to delete. [2025-10-22T18:05:56.751041] [INFO ] [LOCAL ] CPNG: Starting deletion of derivative data. [2025-10-22T18:05:56.751183] [DEBUG] [LOCAL ] CPNG: Deleted derivative data file. [2025-10-22T18:05:56.751285] [INFO ] [MAIN ] Update Progress: 523/2367 symbols completed. CPNG took 33.7s. Estimated remaining: 3h 52m 14s. Rate: 7.9 symbols/min [2025-10-22T18:05:56.917373] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:05:56.917562] [DEBUG] [LOCAL ] CRBD: No existing data file found in primary storage. [2025-10-22T18:05:56.917616] [WARN ] [MAIN ] CRBD: No existing data found, performing full refresh instead. [2025-10-22T18:05:56.917979] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-22T18:05:56.918049] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-22T18:05:56.917715] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-22T18:05:56.918481] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-10-22T18:05:56.919279] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-22T18:05:57.272184] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:05:57.364026] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T18:05:57.717712] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-22T18:05:57.836998] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-22T18:05:58.517724] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-22T18:05:58.857421] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T18:05:59.317672] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-22T18:05:59.671299] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T18:06:00.117707] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-22T18:06:00.826200] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T18:06:00.830351] [INFO ] [REMOTE ] CPS: Full fetch complete (36557 records). [2025-10-22T18:06:00.830479] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-22T18:06:00.922718] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-22T18:06:00.960999] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-22T18:06:01.217115] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-22T18:06:01.217212] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-22T18:06:01.217851] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-22T18:06:01.217915] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-22T18:06:01.218889] [DEBUG] [LOCAL ] CPS: Trimmed 36557 records to 24879 (keeping 200 days of data) [2025-10-22T18:06:01.358670] [DEBUG] [LOCAL ] CPS: Primary data saved (24879 records). [2025-10-22T18:06:01.358804] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-22T18:06:01.358883] [INFO ] [MAIN ] Update Progress: 524/2367 symbols completed. CPS took 38.3s. Estimated remaining: 3h 51m 57s. Rate: 7.9 symbols/min [2025-10-22T18:06:01.530687] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:06:01.580020] [DEBUG] [LOCAL ] CRBG: Loaded 52602 existing records from primary storage. [2025-10-22T18:06:01.580382] [INFO ] [MAIN ] CRBG: Loaded 52602 existing records. [2025-10-22T18:06:01.722841] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-22T18:06:01.785101] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:06:01.785368] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-22T18:06:01.785418] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-22T18:06:01.785831] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-22T18:06:01.785890] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-22T18:06:02.131515] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T18:06:02.190126] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:06:02.517688] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-22T18:06:02.942548] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T18:06:03.317706] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-22T18:06:04.117693] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-22T18:06:04.358113] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T18:06:04.564506] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T18:06:04.917701] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-22T18:06:05.378781] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T18:06:05.717727] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-22T18:06:05.902775] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T18:06:06.517707] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-22T18:06:06.641112] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-22T18:06:07.317720] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-22T18:06:07.790953] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T18:06:08.117697] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-22T18:06:08.743965] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T18:06:08.917732] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-22T18:06:09.128064] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T18:06:09.717734] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-22T18:06:09.737840] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T18:06:10.517724] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-22T18:06:10.610172] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T18:06:11.317678] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-22T18:06:11.433676] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-22T18:06:11.436602] [INFO ] [REMOTE ] CQP: Full fetch complete (29693 records). [2025-10-22T18:06:11.436712] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-22T18:06:11.813875] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-22T18:06:11.813966] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-22T18:06:11.814850] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-22T18:06:11.814921] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-22T18:06:11.815866] [DEBUG] [LOCAL ] CQP: Trimmed 29693 records to 18676 (keeping 200 days of data) [2025-10-22T18:06:11.936963] [DEBUG] [LOCAL ] CQP: Primary data saved (18676 records). [2025-10-22T18:06:11.937116] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-22T18:06:11.937198] [INFO ] [MAIN ] Update Progress: 525/2367 symbols completed. CQP took 20.6s. Estimated remaining: 3h 51m 60s. Rate: 7.9 symbols/min [2025-10-22T18:06:12.095540] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-22T18:06:12.113555] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:06:12.117611] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-22T18:06:12.160135] [DEBUG] [LOCAL ] CRC: Loaded 44159 existing records from primary storage. [2025-10-22T18:06:12.160421] [INFO ] [MAIN ] CRC: Loaded 44159 existing records. [2025-10-22T18:06:12.331603] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:06:12.331872] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-22T18:06:12.331928] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-22T18:06:12.332293] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-22T18:06:12.332348] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-22T18:06:12.709900] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:06:12.870752] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-22T18:06:12.917701] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-22T18:06:13.710352] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T18:06:13.717612] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-22T18:06:14.479212] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-22T18:06:14.517692] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-22T18:06:15.317677] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-22T18:06:15.615440] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-22T18:06:16.117693] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-22T18:06:16.689019] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T18:06:16.917714] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-22T18:06:17.639996] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-22T18:06:17.717707] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-22T18:06:17.902973] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T18:06:18.503224] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-22T18:06:18.505696] [INFO ] [REMOTE ] CRBD: Full fetch complete (12984 records). [2025-10-22T18:06:18.505795] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-22T18:06:18.522889] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-22T18:06:18.882577] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-22T18:06:18.882676] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-22T18:06:18.882978] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-22T18:06:18.883018] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-22T18:06:18.883460] [DEBUG] [LOCAL ] CRBD: Trimmed 12984 records to 8761 (keeping 200 days of data) [2025-10-22T18:06:18.937963] [DEBUG] [LOCAL ] CRBD: Primary data saved (8761 records). [2025-10-22T18:06:18.938117] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-22T18:06:18.938192] [INFO ] [MAIN ] Update Progress: 526/2367 symbols completed. CRBD took 22.2s. Estimated remaining: 3h 51m 50s. Rate: 7.9 symbols/min [2025-10-22T18:06:19.111676] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:06:19.111823] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-22T18:06:19.111860] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-22T18:06:19.111966] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-22T18:06:19.112007] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-22T18:06:19.112048] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-22T18:06:19.112079] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-22T18:06:19.322735] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-22T18:06:19.467906] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:06:19.739783] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T18:06:20.117705] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-22T18:06:20.917675] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-10-22T18:06:21.091869] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T18:06:21.116392] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T18:06:21.117464] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T18:06:21.122433] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-10-22T18:06:21.123006] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:06:21.123090] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-22T18:06:21.123430] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:06:21.123504] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-22T18:06:21.123569] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-22T18:06:21.123605] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-22T18:06:21.123671] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-22T18:06:21.123738] [INFO ] [MAIN ] Update Progress: 527/2367 symbols completed. CRCL took 2.2s. Estimated remaining: 3h 51m 24s. Rate: 8.0 symbols/min [2025-10-22T18:06:21.290038] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:06:21.336351] [DEBUG] [LOCAL ] CRGY: Loaded 52503 existing records from primary storage. [2025-10-22T18:06:21.336724] [INFO ] [MAIN ] CRGY: Loaded 52503 existing records. [2025-10-22T18:06:21.513890] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:06:21.514157] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-22T18:06:21.514205] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-22T18:06:21.514516] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-22T18:06:21.514572] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-22T18:06:21.722937] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-22T18:06:21.876076] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:06:22.517709] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-22T18:06:23.188400] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T18:06:23.317700] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-22T18:06:24.117749] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-22T18:06:24.275596] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T18:06:24.917798] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-22T18:06:25.096304] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T18:06:25.252835] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T18:06:25.717695] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-22T18:06:26.333618] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T18:06:26.517741] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-22T18:06:26.712837] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T18:06:26.716795] [INFO ] [REMOTE ] CR: Full fetch complete (34779 records). [2025-10-22T18:06:26.716895] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-22T18:06:27.086882] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-22T18:06:27.086967] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-22T18:06:27.087472] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-22T18:06:27.087512] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-22T18:06:27.088292] [DEBUG] [LOCAL ] CR: Trimmed 34779 records to 23949 (keeping 200 days of data) [2025-10-22T18:06:27.232822] [DEBUG] [LOCAL ] CR: Primary data saved (23949 records). [2025-10-22T18:06:27.232950] [INFO ] [MAIN ] CR: Full history saved. [2025-10-22T18:06:27.233027] [INFO ] [MAIN ] Update Progress: 528/2367 symbols completed. CR took 33.0s. Estimated remaining: 3h 51m 11s. Rate: 8.0 symbols/min [2025-10-22T18:06:27.322810] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-22T18:06:27.400275] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:06:27.452254] [DEBUG] [LOCAL ] CRH: Loaded 53435 existing records from primary storage. [2025-10-22T18:06:27.452587] [INFO ] [MAIN ] CRH: Loaded 53435 existing records. [2025-10-22T18:06:27.641753] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:06:27.642393] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-22T18:06:27.642462] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-22T18:06:27.642739] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-22T18:06:27.642797] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-22T18:06:27.993080] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:06:28.117638] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-22T18:06:28.142498] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T18:06:28.917673] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-22T18:06:29.095895] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-22T18:06:29.717684] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-22T18:06:30.141257] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-22T18:06:30.517726] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-22T18:06:30.586117] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T18:06:31.317639] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-22T18:06:31.550176] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T18:06:32.118548] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-22T18:06:32.118712] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-22T18:06:32.710199] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-22T18:06:32.917715] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-22T18:06:33.717712] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-22T18:06:33.798049] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T18:06:34.323588] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T18:06:34.517714] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-22T18:06:35.077886] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T18:06:35.317728] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-22T18:06:36.102248] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T18:06:36.117679] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-22T18:06:36.917687] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-22T18:06:37.027546] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T18:06:37.717726] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-22T18:06:37.777166] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T18:06:38.517696] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-22T18:06:38.631688] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T18:06:39.317717] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-22T18:06:39.484500] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T18:06:40.117677] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-22T18:06:40.600998] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-22T18:06:40.815675] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T18:06:40.917696] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-22T18:06:41.717676] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-22T18:06:41.877973] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T18:06:42.517703] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-22T18:06:42.976839] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-22T18:06:42.985455] [INFO ] [REMOTE ] CRBG: Full fetch complete (76048 records). [2025-10-22T18:06:42.985575] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-22T18:06:43.319579] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-22T18:06:43.376820] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-22T18:06:43.377027] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-22T18:06:43.377921] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-22T18:06:43.392080] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-22T18:06:43.404312] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T18:06:43.413539] [DEBUG] [LOCAL ] CRBG: Trimmed 76048 records to 52600 (keeping 200 days of data) [2025-10-22T18:06:43.723660] [DEBUG] [LOCAL ] CRBG: Primary data saved (52600 records). [2025-10-22T18:06:43.723799] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-22T18:06:43.724425] [INFO ] [MAIN ] Update Progress: 529/2367 symbols completed. CRBG took 42.4s. Estimated remaining: 3h 51m 35s. Rate: 7.9 symbols/min [2025-10-22T18:06:43.898779] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:06:43.943683] [DEBUG] [LOCAL ] CRI: Loaded 49512 existing records from primary storage. [2025-10-22T18:06:43.944004] [INFO ] [MAIN ] CRI: Loaded 49512 existing records. [2025-10-22T18:06:44.122767] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:06:44.122996] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-22T18:06:44.119122] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-22T18:06:44.124059] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-22T18:06:44.124287] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-22T18:06:44.124344] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-22T18:06:44.486548] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:06:44.514299] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-22T18:06:44.917614] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-22T18:06:45.310582] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T18:06:45.717726] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-22T18:06:45.907502] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T18:06:45.914775] [INFO ] [REMOTE ] CRC: Full fetch complete (62997 records). [2025-10-22T18:06:45.914879] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-22T18:06:46.327603] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-22T18:06:46.327761] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-22T18:06:46.328503] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-22T18:06:46.328582] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-22T18:06:46.329932] [DEBUG] [LOCAL ] CRC: Trimmed 62997 records to 44118 (keeping 200 days of data) [2025-10-22T18:06:46.521709] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-22T18:06:46.473209] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T18:06:46.621720] [DEBUG] [LOCAL ] CRC: Primary data saved (44118 records). [2025-10-22T18:06:46.621891] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-22T18:06:46.621977] [INFO ] [MAIN ] Update Progress: 530/2367 symbols completed. CRC took 34.7s. Estimated remaining: 3h 51m 11s. Rate: 7.9 symbols/min [2025-10-22T18:06:46.787573] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:06:46.835536] [DEBUG] [LOCAL ] CRK: Loaded 52233 existing records from primary storage. [2025-10-22T18:06:46.835878] [INFO ] [MAIN ] CRK: Loaded 52233 existing records. [2025-10-22T18:06:47.018538] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:06:47.018899] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-22T18:06:47.018952] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-22T18:06:47.019186] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-22T18:06:47.019245] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-22T18:06:47.322851] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-22T18:06:47.390978] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:06:47.695973] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-22T18:06:48.117690] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-22T18:06:48.371593] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T18:06:48.874394] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T18:06:48.917680] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-22T18:06:49.717765] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-22T18:06:50.038376] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-22T18:06:50.517718] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-22T18:06:51.046774] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-22T18:06:51.056134] [INFO ] [REMOTE ] CRGY: Full fetch complete (76158 records). [2025-10-22T18:06:51.056294] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-22T18:06:51.317862] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-22T18:06:51.488232] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-22T18:06:51.488499] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-22T18:06:51.489434] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-22T18:06:51.489632] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-22T18:06:51.500693] [DEBUG] [LOCAL ] CRGY: Trimmed 76158 records to 52497 (keeping 200 days of data) [2025-10-22T18:06:51.520787] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T18:06:51.830322] [DEBUG] [LOCAL ] CRGY: Primary data saved (52497 records). [2025-10-22T18:06:51.830460] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-22T18:06:51.830540] [INFO ] [MAIN ] Update Progress: 531/2367 symbols completed. CRGY took 30.7s. Estimated remaining: 3h 50m 55s. Rate: 8.0 symbols/min [2025-10-22T18:06:51.995235] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:06:52.034565] [DEBUG] [LOCAL ] CRL: Loaded 42659 existing records from primary storage. [2025-10-22T18:06:52.034878] [INFO ] [MAIN ] CRL: Loaded 42659 existing records. [2025-10-22T18:06:52.123303] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-22T18:06:52.212241] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:06:52.212437] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-22T18:06:52.212484] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-22T18:06:52.212707] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-22T18:06:52.212762] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-22T18:06:52.563052] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:06:52.593404] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-22T18:06:52.917639] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-22T18:06:53.255344] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T18:06:53.717728] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-22T18:06:53.872739] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T18:06:54.517706] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-22T18:06:54.551493] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T18:06:55.317638] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-22T18:06:55.675677] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-22T18:06:56.124153] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-22T18:06:56.129368] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T18:06:56.870689] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T18:06:56.917708] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-22T18:06:57.717716] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-22T18:06:57.864867] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T18:06:58.464350] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T18:06:58.517615] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-22T18:06:59.317685] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-22T18:06:59.502173] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T18:07:00.117787] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-22T18:07:00.805796] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-22T18:07:00.816440] [INFO ] [REMOTE ] CRH: Full fetch complete (77541 records). [2025-10-22T18:07:00.816718] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-22T18:07:00.925018] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-22T18:07:01.144975] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T18:07:01.503585] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-22T18:07:01.503711] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-22T18:07:01.504601] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-22T18:07:01.504672] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-22T18:07:01.506296] [DEBUG] [LOCAL ] CRH: Trimmed 77541 records to 53422 (keeping 200 days of data) [2025-10-22T18:07:01.737171] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-22T18:07:01.791591] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T18:07:01.896037] [DEBUG] [LOCAL ] CRH: Primary data saved (53422 records). [2025-10-22T18:07:01.896184] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-22T18:07:01.896262] [INFO ] [MAIN ] Update Progress: 532/2367 symbols completed. CRH took 34.7s. Estimated remaining: 3h 50m 57s. Rate: 7.9 symbols/min [2025-10-22T18:07:02.062638] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:07:02.128327] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-22T18:07:02.128690] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-22T18:07:02.311666] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:07:02.311897] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-22T18:07:02.311964] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-22T18:07:02.312260] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-22T18:07:02.312417] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-22T18:07:02.524494] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-22T18:07:02.701588] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T18:07:02.705261] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:07:03.317613] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-22T18:07:03.667985] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T18:07:04.117710] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-22T18:07:04.390203] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T18:07:04.850215] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T18:07:04.917700] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-22T18:07:05.717707] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-22T18:07:06.014456] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T18:07:06.517680] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-22T18:07:06.701909] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T18:07:07.317755] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-22T18:07:07.469604] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T18:07:08.117745] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-22T18:07:08.917764] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-22T18:07:09.270866] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T18:07:09.327983] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-10-22T18:07:09.717710] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-22T18:07:09.958147] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T18:07:09.966152] [INFO ] [REMOTE ] CRI: Full fetch complete (70966 records). [2025-10-22T18:07:09.966356] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-22T18:07:10.367601] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-22T18:07:10.367721] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-22T18:07:10.368501] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-22T18:07:10.368543] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-22T18:07:10.369954] [DEBUG] [LOCAL ] CRI: Trimmed 70966 records to 49486 (keeping 200 days of data) [2025-10-22T18:07:10.568495] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-22T18:07:10.620573] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T18:07:10.712874] [DEBUG] [LOCAL ] CRI: Primary data saved (49486 records). [2025-10-22T18:07:10.713026] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-22T18:07:10.713701] [INFO ] [MAIN ] Update Progress: 533/2367 symbols completed. CRI took 27.0s. Estimated remaining: 3h 50m 53s. Rate: 7.9 symbols/min [2025-10-22T18:07:10.877051] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:07:10.917453] [DEBUG] [LOCAL ] CRS: Loaded 43115 existing records from primary storage. [2025-10-22T18:07:10.917819] [INFO ] [MAIN ] CRS: Loaded 43115 existing records. [2025-10-22T18:07:11.091121] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:07:11.091318] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-22T18:07:11.091368] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-22T18:07:11.091564] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-22T18:07:11.091619] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-22T18:07:11.324565] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-22T18:07:11.440451] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:07:11.562045] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T18:07:12.117771] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-22T18:07:12.848314] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-22T18:07:12.925250] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-22T18:07:12.943020] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T18:07:13.717716] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-22T18:07:13.873362] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T18:07:14.517719] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-22T18:07:15.057565] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T18:07:15.257457] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-22T18:07:15.317665] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-22T18:07:16.117706] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-22T18:07:16.548495] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-22T18:07:16.917722] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-22T18:07:17.717729] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-22T18:07:17.764576] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T18:07:17.839292] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-22T18:07:18.517775] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-22T18:07:18.615983] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T18:07:18.624866] [INFO ] [REMOTE ] CRK: Full fetch complete (75819 records). [2025-10-22T18:07:18.625021] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-22T18:07:19.016163] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-22T18:07:19.016298] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-22T18:07:19.017195] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-22T18:07:19.017310] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-22T18:07:19.026771] [DEBUG] [LOCAL ] CRK: Trimmed 75819 records to 52226 (keeping 200 days of data) [2025-10-22T18:07:19.042127] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T18:07:19.324977] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-22T18:07:19.347283] [DEBUG] [LOCAL ] CRK: Primary data saved (52226 records). [2025-10-22T18:07:19.347385] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-22T18:07:19.347474] [INFO ] [MAIN ] Update Progress: 534/2367 symbols completed. CRK took 32.7s. Estimated remaining: 3h 50m 50s. Rate: 7.9 symbols/min [2025-10-22T18:07:19.526759] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:07:19.532176] [DEBUG] [LOCAL ] CRT: Loaded 4791 existing records from primary storage. [2025-10-22T18:07:19.532324] [INFO ] [MAIN ] CRT: Loaded 4791 existing records. [2025-10-22T18:07:19.714727] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:07:19.714949] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-22T18:07:19.715003] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-22T18:07:19.715134] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-22T18:07:19.715172] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-22T18:07:20.079825] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:07:20.117615] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-22T18:07:20.912711] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T18:07:20.917602] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-22T18:07:21.082086] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T18:07:21.169674] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-22T18:07:21.556551] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T18:07:21.717738] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-22T18:07:22.389870] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-22T18:07:22.517731] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-22T18:07:23.317734] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-22T18:07:24.088127] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T18:07:24.117711] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-22T18:07:24.917756] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-22T18:07:25.611065] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-22T18:07:25.714309] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-22T18:07:25.724401] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-22T18:07:25.866330] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T18:07:25.874619] [INFO ] [REMOTE ] CRL: Full fetch complete (63654 records). [2025-10-22T18:07:25.874801] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-22T18:07:26.211043] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-22T18:07:26.306975] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-22T18:07:26.307079] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-22T18:07:26.307939] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-22T18:07:26.308005] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-22T18:07:26.309312] [DEBUG] [LOCAL ] CRL: Trimmed 63654 records to 42624 (keeping 200 days of data) [2025-10-22T18:07:26.520656] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-22T18:07:26.576714] [DEBUG] [LOCAL ] CRL: Primary data saved (42624 records). [2025-10-22T18:07:26.576840] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-22T18:07:26.576919] [INFO ] [MAIN ] Update Progress: 535/2367 symbols completed. CRL took 34.7s. Estimated remaining: 3h 50m 41s. Rate: 7.9 symbols/min [2025-10-22T18:07:26.772058] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:07:26.812553] [DEBUG] [LOCAL ] CSAN: Loaded 42270 existing records from primary storage. [2025-10-22T18:07:26.812879] [INFO ] [MAIN ] CSAN: Loaded 42270 existing records. [2025-10-22T18:07:27.003516] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:07:27.003829] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-22T18:07:27.003883] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-22T18:07:27.004182] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-22T18:07:27.004241] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-22T18:07:27.322858] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-22T18:07:27.389771] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:07:27.967876] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-22T18:07:28.117711] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-22T18:07:28.734300] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T18:07:28.917708] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-22T18:07:28.981057] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-22T18:07:29.649706] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-22T18:07:29.717721] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-22T18:07:30.517700] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-22T18:07:31.284687] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T18:07:31.314688] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T18:07:31.317600] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-22T18:07:32.002075] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-22T18:07:32.003368] [INFO ] [REMOTE ] CRT: Full fetch complete (7337 records). [2025-10-22T18:07:32.003434] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-22T18:07:32.122834] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-22T18:07:32.378808] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-22T18:07:32.378905] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-22T18:07:32.379106] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-22T18:07:32.379167] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-22T18:07:32.379577] [DEBUG] [LOCAL ] CRT: Trimmed 7337 records to 4763 (keeping 200 days of data) [2025-10-22T18:07:32.407270] [DEBUG] [LOCAL ] CRT: Primary data saved (4763 records). [2025-10-22T18:07:32.407397] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-22T18:07:32.407474] [INFO ] [MAIN ] Update Progress: 536/2367 symbols completed. CRT took 13.1s. Estimated remaining: 3h 50m 27s. Rate: 7.9 symbols/min [2025-10-22T18:07:32.572395] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:07:32.601692] [DEBUG] [LOCAL ] CSL: Loaded 31256 existing records from primary storage. [2025-10-22T18:07:32.601987] [INFO ] [MAIN ] CSL: Loaded 31256 existing records. [2025-10-22T18:07:32.772694] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:07:32.772885] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-22T18:07:32.772931] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-22T18:07:32.773144] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-22T18:07:32.773199] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-22T18:07:32.926313] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-22T18:07:33.126838] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:07:33.717704] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-22T18:07:34.044116] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T18:07:34.319204] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T18:07:34.517782] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-22T18:07:35.317729] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-22T18:07:35.653710] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T18:07:36.117734] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-22T18:07:36.235263] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-22T18:07:36.917689] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-22T18:07:37.100516] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T18:07:37.567861] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T18:07:37.717724] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-22T18:07:38.517736] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-22T18:07:39.267494] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T18:07:39.317609] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-22T18:07:39.393883] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-22T18:07:40.117703] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-22T18:07:40.207534] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T18:07:40.538176] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T18:07:40.824684] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T18:07:40.833382] [INFO ] [REMOTE ] CRM: Full fetch complete (77946 records). [2025-10-22T18:07:40.833526] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-22T18:07:40.922855] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-22T18:07:41.231156] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-22T18:07:41.231262] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-22T18:07:41.232245] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-22T18:07:41.232364] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-22T18:07:41.233941] [DEBUG] [LOCAL ] CRM: Trimmed 77946 records to 53770 (keeping 200 days of data) [2025-10-22T18:07:41.576757] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-10-22T18:07:41.576902] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-22T18:07:41.577002] [INFO ] [MAIN ] Update Progress: 537/2367 symbols completed. CRM took 39.7s. Estimated remaining: 3h 50m 25s. Rate: 7.9 symbols/min [2025-10-22T18:07:41.726858] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-22T18:07:41.747693] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:07:41.764283] [DEBUG] [LOCAL ] CSR: Loaded 13477 existing records from primary storage. [2025-10-22T18:07:41.764531] [INFO ] [MAIN ] CSR: Loaded 13477 existing records. [2025-10-22T18:07:41.943004] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:07:41.943235] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-22T18:07:41.943280] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-22T18:07:41.943532] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-22T18:07:41.943588] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-22T18:07:42.303082] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:07:42.384154] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T18:07:42.517691] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-22T18:07:43.282562] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T18:07:43.317663] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-22T18:07:44.117765] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-22T18:07:44.191230] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T18:07:44.853574] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T18:07:44.917699] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-22T18:07:45.717917] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-22T18:07:45.719534] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-22T18:07:46.308145] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-22T18:07:46.517709] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-22T18:07:47.319193] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T18:07:47.319384] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-22T18:07:48.122767] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-22T18:07:48.138104] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T18:07:48.235479] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T18:07:48.917715] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-22T18:07:49.618834] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T18:07:49.717679] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-22T18:07:49.999095] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T18:07:50.207913] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-22T18:07:50.517699] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-22T18:07:51.317725] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-22T18:07:52.117729] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-22T18:07:52.223378] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T18:07:52.230232] [INFO ] [REMOTE ] CRS: Full fetch complete (62638 records). [2025-10-22T18:07:52.230347] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-22T18:07:52.603253] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-22T18:07:52.603391] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-22T18:07:52.604157] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-22T18:07:52.604225] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-22T18:07:52.605491] [DEBUG] [LOCAL ] CRS: Trimmed 62638 records to 43101 (keeping 200 days of data) [2025-10-22T18:07:52.871683] [DEBUG] [LOCAL ] CRS: Primary data saved (43101 records). [2025-10-22T18:07:52.871808] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-22T18:07:52.872430] [INFO ] [MAIN ] Update Progress: 538/2367 symbols completed. CRS took 42.2s. Estimated remaining: 3h 50m 31s. Rate: 7.9 symbols/min [2025-10-22T18:07:52.925938] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-22T18:07:53.070211] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:07:53.089014] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T18:07:53.096284] [INFO ] [REMOTE ] CSAN: Full fetch complete (60263 records). [2025-10-22T18:07:53.096478] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-22T18:07:53.370688] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T18:07:53.377326] [DEBUG] [LOCAL ] CSTM: Loaded 47446 existing records from primary storage. [2025-10-22T18:07:53.405732] [INFO ] [MAIN ] CSTM: Loaded 47446 existing records. [2025-10-22T18:07:53.692935] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:07:53.724882] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-22T18:07:53.729747] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-22T18:07:53.730001] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-22T18:07:53.731096] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-22T18:07:53.731163] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-22T18:07:53.731313] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-22T18:07:53.731600] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-22T18:07:53.732107] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-22T18:07:53.732212] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-22T18:07:53.785526] [DEBUG] [LOCAL ] CSAN: Trimmed 60263 records to 42220 (keeping 200 days of data) [2025-10-22T18:07:53.969155] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T18:07:54.520368] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-22T18:07:54.663009] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:07:54.692763] [DEBUG] [LOCAL ] CSAN: Primary data saved (42220 records). [2025-10-22T18:07:54.692967] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-22T18:07:54.693071] [INFO ] [MAIN ] Update Progress: 539/2367 symbols completed. CSAN took 28.1s. Estimated remaining: 3h 50m 3s. Rate: 7.9 symbols/min [2025-10-22T18:07:54.896363] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:07:54.908171] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T18:07:54.926077] [DEBUG] [LOCAL ] CSV: Loaded 12501 existing records from primary storage. [2025-10-22T18:07:54.926342] [INFO ] [MAIN ] CSV: Loaded 12501 existing records. [2025-10-22T18:07:55.102725] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:07:55.102979] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-22T18:07:55.103036] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-22T18:07:55.103178] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-22T18:07:55.103217] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-22T18:07:55.320746] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-22T18:07:55.457799] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:07:55.589586] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-22T18:07:56.117713] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-22T18:07:56.917689] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-22T18:07:57.062494] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T18:07:57.113849] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-22T18:07:57.582495] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-22T18:07:57.717727] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-22T18:07:58.517637] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-22T18:07:58.590886] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-22T18:07:59.317697] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-22T18:07:59.999024] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T18:08:00.117716] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-22T18:08:00.717255] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-22T18:08:00.883992] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T18:08:00.917678] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-22T18:08:01.717741] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-22T18:08:02.517679] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-22T18:08:02.618665] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T18:08:02.730342] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-22T18:08:03.317747] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-22T18:08:03.670449] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T18:08:03.873785] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-22T18:08:04.117707] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-22T18:08:04.917707] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-22T18:08:05.198659] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T18:08:05.201498] [INFO ] [REMOTE ] CSR: Full fetch complete (17971 records). [2025-10-22T18:08:05.201567] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-22T18:08:05.568474] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-22T18:08:05.568556] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-22T18:08:05.569022] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-22T18:08:05.569085] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-22T18:08:05.569747] [DEBUG] [LOCAL ] CSR: Trimmed 17971 records to 13395 (keeping 200 days of data) [2025-10-22T18:08:05.656893] [DEBUG] [LOCAL ] CSR: Primary data saved (13395 records). [2025-10-22T18:08:05.657063] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-22T18:08:05.657171] [INFO ] [MAIN ] Update Progress: 540/2367 symbols completed. CSR took 24.1s. Estimated remaining: 3h 50m 7s. Rate: 7.9 symbols/min [2025-10-22T18:08:05.728342] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-22T18:08:05.845815] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:05.845982] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-22T18:08:05.846020] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-22T18:08:05.846136] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-22T18:08:05.846197] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-22T18:08:05.846247] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-22T18:08:05.846281] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-22T18:08:06.244158] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:06.350540] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T18:08:06.517730] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-22T18:08:07.317707] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-22T18:08:07.692257] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T18:08:08.117712] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-22T18:08:08.152718] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-22T18:08:08.158127] [INFO ] [REMOTE ] CSL: Full fetch complete (45708 records). [2025-10-22T18:08:08.158229] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-22T18:08:08.501521] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T18:08:08.557535] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-22T18:08:08.557669] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-22T18:08:08.558320] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-22T18:08:08.558363] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-22T18:08:08.559591] [DEBUG] [LOCAL ] CSL: Trimmed 45708 records to 31148 (keeping 200 days of data) [2025-10-22T18:08:08.753906] [DEBUG] [LOCAL ] CSL: Primary data saved (31148 records). [2025-10-22T18:08:08.754037] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-22T18:08:08.754112] [INFO ] [MAIN ] Update Progress: 541/2367 symbols completed. CSL took 36.3s. Estimated remaining: 3h 49m 45s. Rate: 7.9 symbols/min [2025-10-22T18:08:08.918708] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-22T18:08:08.928775] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:08.938501] [DEBUG] [LOCAL ] CTBB: Loaded 6539 existing records from primary storage. [2025-10-22T18:08:08.938751] [INFO ] [MAIN ] CTBB: Loaded 6539 existing records. [2025-10-22T18:08:09.120968] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:08:09.121185] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-22T18:08:09.121231] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-22T18:08:09.121396] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-22T18:08:09.121451] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-22T18:08:09.494322] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:09.652614] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T18:08:09.717723] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-22T18:08:09.992470] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T18:08:10.517697] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-10-22T18:08:10.708877] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T18:08:10.709176] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-10-22T18:08:10.709266] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:08:10.709313] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-22T18:08:10.709347] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:08:10.709414] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-22T18:08:10.709476] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-22T18:08:10.709510] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-22T18:08:10.709548] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-22T18:08:10.709593] [INFO ] [MAIN ] Update Progress: 542/2367 symbols completed. CSW took 5.1s. Estimated remaining: 3h 49m 18s. Rate: 8.0 symbols/min [2025-10-22T18:08:10.884026] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:10.891358] [DEBUG] [LOCAL ] CTDD: Loaded 5258 existing records from primary storage. [2025-10-22T18:08:10.891558] [INFO ] [MAIN ] CTDD: Loaded 5258 existing records. [2025-10-22T18:08:11.077494] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:08:11.077808] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-22T18:08:11.077871] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-22T18:08:11.078031] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-22T18:08:11.078074] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-22T18:08:11.326206] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-22T18:08:11.449399] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:11.490232] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T18:08:12.117739] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-22T18:08:12.444888] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T18:08:12.838312] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-22T18:08:12.917713] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-22T18:08:13.717727] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-22T18:08:13.767799] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T18:08:14.517671] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-22T18:08:15.085525] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-22T18:08:15.323254] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-22T18:08:15.329589] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T18:08:16.117712] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-22T18:08:16.162329] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T18:08:16.917732] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-22T18:08:17.682926] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-22T18:08:17.717706] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-22T18:08:18.006698] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T18:08:18.455627] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-22T18:08:18.517708] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-22T18:08:19.255401] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-22T18:08:19.317695] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-22T18:08:20.117694] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-22T18:08:20.178332] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T18:08:20.917733] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-22T18:08:21.688551] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T18:08:21.717704] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-22T18:08:21.857073] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-22T18:08:22.517788] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-22T18:08:23.317686] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-22T18:08:23.350634] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-22T18:08:23.357939] [INFO ] [REMOTE ] CSTM: Full fetch complete (69171 records). [2025-10-22T18:08:23.358081] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-22T18:08:23.358881] [FATAL] [VALIDATOR ] CSTM: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:08:23.358970] [FATAL] [MAIN ] CSTM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:08:23.359013] [WARN ] [MAIN ] CSTM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:08:23.359088] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-22T18:08:23.359152] [DEBUG] [LOCAL ] CSTM: No primary data file found to delete. [2025-10-22T18:08:23.359187] [INFO ] [LOCAL ] CSTM: Starting deletion of derivative data. [2025-10-22T18:08:23.359339] [DEBUG] [LOCAL ] CSTM: Deleted derivative data file. [2025-10-22T18:08:23.359427] [INFO ] [MAIN ] Update Progress: 543/2367 symbols completed. CSTM took 30.5s. Estimated remaining: 3h 49m 28s. Rate: 7.9 symbols/min [2025-10-22T18:08:23.467304] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-22T18:08:23.541435] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:23.541626] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-22T18:08:23.541697] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-22T18:08:23.541825] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-22T18:08:23.541867] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-22T18:08:23.541907] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-22T18:08:23.541938] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-22T18:08:23.926787] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:23.994015] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-22T18:08:24.117737] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-22T18:08:24.779669] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-22T18:08:24.917717] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-22T18:08:25.542291] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T18:08:25.717696] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-22T18:08:26.517725] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-10-22T18:08:26.638669] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-22T18:08:26.913365] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T18:08:26.913746] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-10-22T18:08:26.913851] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:08:26.913901] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-22T18:08:26.913959] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:08:26.914030] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-22T18:08:26.914095] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-22T18:08:26.914130] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-22T18:08:26.914169] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-22T18:08:26.914215] [INFO ] [MAIN ] Update Progress: 544/2367 symbols completed. CTEV took 3.6s. Estimated remaining: 3h 49m 7s. Rate: 8.0 symbols/min [2025-10-22T18:08:27.080202] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:27.107444] [DEBUG] [LOCAL ] CTO: Loaded 27425 existing records from primary storage. [2025-10-22T18:08:27.107737] [INFO ] [MAIN ] CTO: Loaded 27425 existing records. [2025-10-22T18:08:27.278397] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:08:27.278618] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-22T18:08:27.278694] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-22T18:08:27.278904] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-22T18:08:27.278941] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-22T18:08:27.322909] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-22T18:08:27.627012] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:28.117745] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-22T18:08:28.313153] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T18:08:28.315280] [INFO ] [REMOTE ] CSV: Full fetch complete (19052 records). [2025-10-22T18:08:28.315348] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-22T18:08:28.672575] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-22T18:08:28.672684] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-22T18:08:28.673127] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-22T18:08:28.673169] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-22T18:08:28.673708] [DEBUG] [LOCAL ] CSV: Trimmed 19052 records to 12427 (keeping 200 days of data) [2025-10-22T18:08:28.750736] [DEBUG] [LOCAL ] CSV: Primary data saved (12427 records). [2025-10-22T18:08:28.750914] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-22T18:08:28.751012] [INFO ] [MAIN ] Update Progress: 545/2367 symbols completed. CSV took 34.1s. Estimated remaining: 3h 48m 41s. Rate: 8.0 symbols/min [2025-10-22T18:08:28.866237] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-22T18:08:28.936240] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:28.933133] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-22T18:08:28.936429] [DEBUG] [LOCAL ] CTOS: No existing data file found in primary storage. [2025-10-22T18:08:28.936502] [WARN ] [MAIN ] CTOS: No existing data found, performing full refresh instead. [2025-10-22T18:08:28.936639] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-22T18:08:28.937396] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-22T18:08:28.937464] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-22T18:08:28.937499] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-22T18:08:29.293017] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:29.700420] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T18:08:29.717618] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-22T18:08:30.305625] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-22T18:08:30.306741] [INFO ] [REMOTE ] CTDD: Full fetch complete (7919 records). [2025-10-22T18:08:30.306842] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-22T18:08:30.522730] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-22T18:08:30.660975] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-22T18:08:30.661049] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-22T18:08:30.661261] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-22T18:08:30.661301] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-22T18:08:30.661716] [DEBUG] [LOCAL ] CTDD: Trimmed 7919 records to 5135 (keeping 200 days of data) [2025-10-22T18:08:30.691661] [DEBUG] [LOCAL ] CTDD: Primary data saved (5135 records). [2025-10-22T18:08:30.691739] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-22T18:08:30.691808] [INFO ] [MAIN ] Update Progress: 546/2367 symbols completed. CTDD took 20.0s. Estimated remaining: 3h 48m 14s. Rate: 8.0 symbols/min [2025-10-22T18:08:30.861439] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:30.911385] [DEBUG] [LOCAL ] CTRA: Loaded 53647 existing records from primary storage. [2025-10-22T18:08:30.911745] [INFO ] [MAIN ] CTRA: Loaded 53647 existing records. [2025-10-22T18:08:31.086757] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:08:31.086972] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-22T18:08:31.087029] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-22T18:08:31.087348] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-22T18:08:31.087404] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-22T18:08:31.323367] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-22T18:08:31.394386] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T18:08:31.454226] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:32.117699] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-22T18:08:32.917678] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-22T18:08:33.053936] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T18:08:33.174245] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-22T18:08:33.717679] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-22T18:08:33.802012] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-22T18:08:34.517700] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-22T18:08:35.238399] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T18:08:35.317736] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-22T18:08:35.934936] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-22T18:08:36.117744] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-22T18:08:36.480732] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T18:08:36.917686] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-22T18:08:37.092683] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T18:08:37.717723] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-22T18:08:38.517699] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-22T18:08:38.695074] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T18:08:39.317709] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-22T18:08:39.562011] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T18:08:39.629910] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T18:08:40.117698] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-22T18:08:40.219680] [DEBUG] [REMOTE ] CTO: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-22T18:08:40.219973] [WARN ] [REMOTE ] CTO: No data returned for month 2025-04 [2025-10-22T18:08:40.220073] [FATAL] [REMOTE ] CTO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:08:40.220150] [FATAL] [MAIN ] CTO: Failed to fetch primary data. [2025-10-22T18:08:40.220213] [WARN ] [MAIN ] CTO: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:08:40.220293] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-22T18:08:40.220373] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-10-22T18:08:40.220410] [INFO ] [LOCAL ] CTO: Starting deletion of derivative data. [2025-10-22T18:08:40.220550] [DEBUG] [LOCAL ] CTO: Deleted derivative data file. [2025-10-22T18:08:40.220632] [INFO ] [MAIN ] Update Progress: 547/2367 symbols completed. CTO took 13.3s. Estimated remaining: 3h 48m 14s. Rate: 8.0 symbols/min [2025-10-22T18:08:40.388148] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:40.458714] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T18:08:40.470204] [DEBUG] [LOCAL ] CTRE: Loaded 49466 existing records from primary storage. [2025-10-22T18:08:40.471313] [INFO ] [MAIN ] CTRE: Loaded 49466 existing records. [2025-10-22T18:08:40.643634] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:08:40.643860] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-22T18:08:40.643910] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-22T18:08:40.644103] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-22T18:08:40.644149] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-22T18:08:40.922805] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-22T18:08:40.999524] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:41.717687] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-22T18:08:42.517689] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-22T18:08:42.956017] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-22T18:08:42.980063] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T18:08:43.317695] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-22T18:08:44.117670] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-22T18:08:44.284186] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T18:08:44.917700] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-22T18:08:45.312916] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T18:08:45.591613] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T18:08:45.717695] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-22T18:08:46.111458] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T18:08:46.517723] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-22T18:08:47.191784] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T18:08:47.317686] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-22T18:08:48.117634] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-22T18:08:48.580450] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T18:08:48.664436] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T18:08:48.917692] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-22T18:08:49.717689] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-22T18:08:49.808172] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T18:08:50.517678] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-22T18:08:50.938183] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-22T18:08:50.981398] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-22T18:08:51.156378] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-22T18:08:51.317725] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-22T18:08:52.117726] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-22T18:08:52.917712] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-22T18:08:53.110184] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T18:08:53.310875] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-22T18:08:53.649341] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T18:08:53.656731] [INFO ] [REMOTE ] CTOS: Full fetch complete (53973 records). [2025-10-22T18:08:53.656911] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-22T18:08:53.722795] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-22T18:08:54.042484] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-22T18:08:54.042586] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-22T18:08:54.043335] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-22T18:08:54.043419] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-22T18:08:54.044578] [DEBUG] [LOCAL ] CTOS: Trimmed 53973 records to 37221 (keeping 200 days of data) [2025-10-22T18:08:54.260834] [DEBUG] [LOCAL ] CTOS: Primary data saved (37221 records). [2025-10-22T18:08:54.260967] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-22T18:08:54.261037] [INFO ] [MAIN ] Update Progress: 548/2367 symbols completed. CTOS took 25.5s. Estimated remaining: 3h 48m 28s. Rate: 8.0 symbols/min [2025-10-22T18:08:54.452502] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:54.490361] [DEBUG] [LOCAL ] CTRI: Loaded 40676 existing records from primary storage. [2025-10-22T18:08:54.490697] [INFO ] [MAIN ] CTRI: Loaded 40676 existing records. [2025-10-22T18:08:54.522787] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-22T18:08:54.599931] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-22T18:08:54.686534] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:08:54.686779] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-22T18:08:54.686830] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-22T18:08:54.687138] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-22T18:08:54.687197] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-22T18:08:55.059036] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:55.317715] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-22T18:08:56.117699] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-22T18:08:56.505367] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-22T18:08:56.685440] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-22T18:08:56.686851] [INFO ] [REMOTE ] CTBB: Full fetch complete (10074 records). [2025-10-22T18:08:56.686920] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-22T18:08:56.926985] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-22T18:08:57.057226] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-22T18:08:57.057340] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-22T18:08:57.057767] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-22T18:08:57.057843] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-22T18:08:57.058464] [DEBUG] [LOCAL ] CTBB: Trimmed 10074 records to 6394 (keeping 200 days of data) [2025-10-22T18:08:57.111417] [DEBUG] [LOCAL ] CTBB: Primary data saved (6394 records). [2025-10-22T18:08:57.121327] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-22T18:08:57.121435] [INFO ] [MAIN ] Update Progress: 549/2367 symbols completed. CTBB took 48.4s. Estimated remaining: 3h 48m 5s. Rate: 8.0 symbols/min [2025-10-22T18:08:57.153827] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T18:08:57.298028] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:08:57.314725] [DEBUG] [LOCAL ] CTS: Loaded 19552 existing records from primary storage. [2025-10-22T18:08:57.314944] [INFO ] [MAIN ] CTS: Loaded 19552 existing records. [2025-10-22T18:08:57.484810] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:08:57.485010] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-22T18:08:57.485056] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-22T18:08:57.485222] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-22T18:08:57.485260] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-22T18:08:57.726542] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-22T18:08:57.851505] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:08:57.938998] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T18:08:58.517721] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-22T18:08:59.319112] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-22T18:08:59.321516] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T18:08:59.862428] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T18:09:00.117725] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-22T18:09:00.917733] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-22T18:09:01.502729] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-22T18:09:01.570558] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T18:09:01.717769] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-22T18:09:01.806035] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T18:09:02.517747] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-22T18:09:03.317698] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-22T18:09:03.542560] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T18:09:03.957615] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T18:09:04.065847] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-22T18:09:04.117690] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-22T18:09:04.917717] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-22T18:09:05.164165] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T18:09:05.717753] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-22T18:09:06.517760] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-22T18:09:06.784149] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T18:09:06.996487] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T18:09:07.317676] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-22T18:09:07.726044] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-22T18:09:08.117738] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-22T18:09:08.917742] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-22T18:09:09.157256] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T18:09:09.187515] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T18:09:09.717751] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-22T18:09:10.517700] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-22T18:09:10.651346] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T18:09:10.873182] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-22T18:09:11.317698] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-22T18:09:12.058951] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T18:09:12.117700] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-22T18:09:12.917739] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-22T18:09:13.162315] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T18:09:13.170555] [INFO ] [REMOTE ] CTRE: Full fetch complete (71317 records). [2025-10-22T18:09:13.170729] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-22T18:09:13.501248] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T18:09:13.597437] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-22T18:09:13.597527] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-22T18:09:13.598358] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-22T18:09:13.598447] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-22T18:09:13.599886] [DEBUG] [LOCAL ] CTRE: Trimmed 71317 records to 49425 (keeping 200 days of data) [2025-10-22T18:09:13.720378] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-22T18:09:13.893573] [DEBUG] [LOCAL ] CTRE: Primary data saved (49425 records). [2025-10-22T18:09:13.893717] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-22T18:09:13.894333] [INFO ] [MAIN ] Update Progress: 550/2367 symbols completed. CTRE took 33.7s. Estimated remaining: 3h 48m 28s. Rate: 8.0 symbols/min [2025-10-22T18:09:14.061781] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:09:14.112792] [DEBUG] [LOCAL ] CTVA: Loaded 53305 existing records from primary storage. [2025-10-22T18:09:14.113086] [INFO ] [MAIN ] CTVA: Loaded 53305 existing records. [2025-10-22T18:09:14.247830] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T18:09:14.313791] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:09:14.313977] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-22T18:09:14.314022] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-22T18:09:14.314212] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-22T18:09:14.314258] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-22T18:09:14.527809] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-22T18:09:14.662948] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:09:15.248856] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T18:09:15.317636] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-22T18:09:16.117734] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-22T18:09:16.715941] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-22T18:09:16.724946] [INFO ] [REMOTE ] CTRA: Full fetch complete (77820 records). [2025-10-22T18:09:16.725106] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-22T18:09:16.926951] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-22T18:09:17.116045] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T18:09:17.163492] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-22T18:09:17.163741] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-22T18:09:17.164674] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-22T18:09:17.164783] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-22T18:09:17.166257] [DEBUG] [LOCAL ] CTRA: Trimmed 77820 records to 53647 (keeping 200 days of data) [2025-10-22T18:09:17.490374] [DEBUG] [LOCAL ] CTRA: Primary data saved (53647 records). [2025-10-22T18:09:17.490495] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-22T18:09:17.490582] [INFO ] [MAIN ] Update Progress: 551/2367 symbols completed. CTRA took 46.8s. Estimated remaining: 3h 48m 7s. Rate: 8.0 symbols/min [2025-10-22T18:09:17.659878] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:09:17.660007] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-22T18:09:17.660044] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-22T18:09:17.660174] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-22T18:09:17.660240] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-22T18:09:17.660293] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-22T18:09:17.660334] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-22T18:09:17.722842] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-22T18:09:18.017215] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:09:18.098449] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-22T18:09:18.204464] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-22T18:09:18.517733] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-22T18:09:18.928686] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-22T18:09:19.198994] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T18:09:19.317703] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-22T18:09:20.117750] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-22T18:09:20.917674] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-22T18:09:21.159698] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T18:09:21.183538] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T18:09:21.183632] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-22T18:09:21.717828] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-22T18:09:22.517706] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-22T18:09:23.317685] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-22T18:09:23.519254] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T18:09:23.526771] [INFO ] [REMOTE ] CTRI: Full fetch complete (53943 records). [2025-10-22T18:09:23.526872] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-22T18:09:23.527445] [FATAL] [VALIDATOR ] CTRI: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:09:23.527529] [FATAL] [MAIN ] CTRI: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:09:23.527570] [WARN ] [MAIN ] CTRI: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:09:23.527609] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-22T18:09:23.527724] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-22T18:09:23.527767] [INFO ] [LOCAL ] CTRI: Starting deletion of derivative data. [2025-10-22T18:09:23.527936] [DEBUG] [LOCAL ] CTRI: Deleted derivative data file. [2025-10-22T18:09:23.528021] [INFO ] [MAIN ] Update Progress: 552/2367 symbols completed. CTRI took 29.3s. Estimated remaining: 3h 47m 55s. Rate: 8.0 symbols/min [2025-10-22T18:09:23.698759] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-22T18:09:23.701838] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:09:23.703524] [DEBUG] [LOCAL ] CUBE: No existing data file found in primary storage. [2025-10-22T18:09:23.703569] [WARN ] [MAIN ] CUBE: No existing data found, performing full refresh instead. [2025-10-22T18:09:23.703706] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-22T18:09:23.703757] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-22T18:09:23.703799] [DEBUG] [LOCAL ] CUBE: No primary data file found to delete. [2025-10-22T18:09:23.703831] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-22T18:09:24.058770] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:09:24.117613] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-22T18:09:24.345017] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T18:09:24.917774] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-22T18:09:25.284209] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-22T18:09:25.717738] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-22T18:09:25.864534] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T18:09:26.055240] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-22T18:09:26.517885] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-22T18:09:27.317779] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-22T18:09:27.567369] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-22T18:09:28.117696] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-22T18:09:28.400531] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T18:09:28.917772] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-22T18:09:29.327555] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-22T18:09:29.339349] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-22T18:09:29.343054] [INFO ] [REMOTE ] CTS: Full fetch complete (27317 records). [2025-10-22T18:09:29.343128] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-22T18:09:29.706467] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-22T18:09:29.706543] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-22T18:09:29.707037] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-22T18:09:29.707098] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-22T18:09:29.707804] [DEBUG] [LOCAL ] CTS: Trimmed 27317 records to 19510 (keeping 200 days of data) [2025-10-22T18:09:29.757060] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-22T18:09:29.825737] [DEBUG] [LOCAL ] CTS: Primary data saved (19510 records). [2025-10-22T18:09:29.825877] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-22T18:09:29.825955] [INFO ] [MAIN ] Update Progress: 553/2367 symbols completed. CTS took 32.7s. Estimated remaining: 3h 47m 43s. Rate: 8.0 symbols/min [2025-10-22T18:09:29.996769] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:09:30.020234] [DEBUG] [LOCAL ] CUBI: Loaded 27119 existing records from primary storage. [2025-10-22T18:09:30.020477] [INFO ] [MAIN ] CUBI: Loaded 27119 existing records. [2025-10-22T18:09:30.195811] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:09:30.196048] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-22T18:09:30.196103] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-22T18:09:30.196379] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-22T18:09:30.196435] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-22T18:09:30.519945] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-22T18:09:30.546760] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:09:31.317695] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-22T18:09:31.565580] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T18:09:31.649538] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-22T18:09:32.117725] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-22T18:09:32.154589] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T18:09:32.917752] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-22T18:09:33.717723] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-22T18:09:33.912528] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T18:09:33.992509] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-22T18:09:34.517681] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-22T18:09:34.671382] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T18:09:35.001338] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-22T18:09:35.002081] [INFO ] [REMOTE ] CUBB: Full fetch complete (952 records). [2025-10-22T18:09:35.002146] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-22T18:09:35.172411] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-22T18:09:35.172560] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:09:35.172605] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:09:35.172693] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-22T18:09:35.172762] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-22T18:09:35.172844] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-22T18:09:35.172894] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-22T18:09:35.172948] [INFO ] [MAIN ] Update Progress: 554/2367 symbols completed. CUBB took 17.7s. Estimated remaining: 3h 47m 28s. Rate: 8.0 symbols/min [2025-10-22T18:09:35.321504] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-22T18:09:35.338607] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:09:35.384493] [DEBUG] [LOCAL ] CUK: Loaded 51065 existing records from primary storage. [2025-10-22T18:09:35.384812] [INFO ] [MAIN ] CUK: Loaded 51065 existing records. [2025-10-22T18:09:35.556677] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:09:35.556887] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-22T18:09:35.556932] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-22T18:09:35.557973] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-22T18:09:35.558031] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-22T18:09:35.908949] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:09:36.117681] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-22T18:09:36.733609] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T18:09:36.917719] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-22T18:09:37.717694] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-22T18:09:37.987016] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-22T18:09:38.022902] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T18:09:38.517741] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-22T18:09:39.298557] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T18:09:39.317608] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-22T18:09:39.766518] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T18:09:40.117712] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-22T18:09:40.917685] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-22T18:09:41.202390] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T18:09:41.238316] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-22T18:09:41.717703] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-22T18:09:42.517680] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-22T18:09:42.713744] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T18:09:43.209408] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T18:09:43.317699] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-22T18:09:44.117677] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-22T18:09:44.213326] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T18:09:44.372177] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T18:09:44.917699] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-22T18:09:45.717637] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-22T18:09:45.887267] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-22T18:09:46.056609] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T18:09:46.517700] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-22T18:09:47.133190] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T18:09:47.317691] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-22T18:09:48.117699] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-22T18:09:48.351296] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T18:09:48.426257] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T18:09:48.917713] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-22T18:09:49.717698] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-22T18:09:49.997517] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T18:09:50.067535] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T18:09:50.517667] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-22T18:09:51.317676] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-22T18:09:51.654694] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-22T18:09:51.893347] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T18:09:52.117716] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-22T18:09:52.583321] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-22T18:09:52.917744] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-22T18:09:53.717698] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-22T18:09:54.101410] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T18:09:54.142057] [INFO ] [REMOTE ] CUBI: Full fetch complete (39101 records). [2025-10-22T18:09:54.142223] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-22T18:09:54.144420] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-22T18:09:54.519127] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-22T18:09:54.529883] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-22T18:09:54.529950] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-22T18:09:54.530713] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-22T18:09:54.530887] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-22T18:09:54.532016] [DEBUG] [LOCAL ] CUBI: Trimmed 39101 records to 26998 (keeping 200 days of data) [2025-10-22T18:09:54.685477] [DEBUG] [LOCAL ] CUBI: Primary data saved (26998 records). [2025-10-22T18:09:54.685603] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-22T18:09:54.685701] [INFO ] [MAIN ] Update Progress: 555/2367 symbols completed. CUBI took 24.9s. Estimated remaining: 3h 47m 60s. Rate: 7.9 symbols/min [2025-10-22T18:09:54.850249] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:09:54.850420] [DEBUG] [LOCAL ] CULP: No existing data file found in primary storage. [2025-10-22T18:09:54.850457] [WARN ] [MAIN ] CULP: No existing data found, performing full refresh instead. [2025-10-22T18:09:54.850583] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-22T18:09:54.850623] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-22T18:09:54.850698] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-22T18:09:54.850750] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-22T18:09:55.207661] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:09:55.317612] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-22T18:09:55.430367] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T18:09:55.438768] [INFO ] [REMOTE ] CUBE: Full fetch complete (73337 records). [2025-10-22T18:09:55.438911] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-22T18:09:55.817824] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-22T18:09:55.817902] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-22T18:09:55.818711] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-22T18:09:55.818775] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-22T18:09:55.820077] [DEBUG] [LOCAL ] CUBE: Trimmed 73337 records to 50871 (keeping 200 days of data) [2025-10-22T18:09:56.119919] [DEBUG] [LOCAL ] CUBE: Primary data saved (50871 records). [2025-10-22T18:09:56.119834] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-22T18:09:56.120836] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-22T18:09:56.120920] [INFO ] [MAIN ] Update Progress: 556/2367 symbols completed. CUBE took 32.6s. Estimated remaining: 3h 47m 33s. Rate: 8.0 symbols/min [2025-10-22T18:09:56.293326] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:09:56.323743] [DEBUG] [LOCAL ] CURB: Loaded 32813 existing records from primary storage. [2025-10-22T18:09:56.323987] [INFO ] [MAIN ] CURB: Loaded 32813 existing records. [2025-10-22T18:09:56.530457] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:09:56.530733] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-22T18:09:56.530789] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-22T18:09:56.531038] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-22T18:09:56.531097] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-22T18:09:56.854443] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T18:09:56.875046] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-22T18:09:56.920675] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-22T18:09:56.954166] [INFO ] [REMOTE ] CTVA: Full fetch complete (77235 records). [2025-10-22T18:09:56.953871] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:09:56.954713] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-22T18:09:57.084441] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T18:09:57.402831] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-22T18:09:57.402926] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-22T18:09:57.403840] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-22T18:09:57.403909] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-22T18:09:57.405448] [DEBUG] [LOCAL ] CTVA: Trimmed 77235 records to 53308 (keeping 200 days of data) [2025-10-22T18:09:57.499212] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-22T18:09:57.717951] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-22T18:09:57.743404] [DEBUG] [LOCAL ] CTVA: Primary data saved (53308 records). [2025-10-22T18:09:57.743550] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-22T18:09:57.744256] [INFO ] [MAIN ] Update Progress: 557/2367 symbols completed. CTVA took 43.8s. Estimated remaining: 3h 47m 6s. Rate: 8.0 symbols/min [2025-10-22T18:09:58.517721] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-22T18:09:59.173452] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T18:09:59.183637] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-22T18:09:59.317609] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-22T18:10:00.117714] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-22T18:10:00.540580] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T18:10:00.765805] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-22T18:10:00.917724] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-22T18:10:01.717761] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-22T18:10:02.483041] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-22T18:10:02.517711] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-22T18:10:02.545271] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:10:03.317754] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-22T18:10:04.076621] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-22T18:10:04.117737] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-22T18:10:04.840318] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-22T18:10:04.917613] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-22T18:10:04.952461] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-22T18:10:05.717714] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-22T18:10:06.517735] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-22T18:10:07.152964] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-22T18:10:07.156502] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-22T18:10:07.222152] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T18:10:07.317678] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-22T18:10:08.117677] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-22T18:10:08.481833] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T18:10:08.917723] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-22T18:10:09.372414] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T18:10:09.717715] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-22T18:10:10.427422] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T18:10:10.517720] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-22T18:10:11.106704] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-22T18:10:11.107844] [INFO ] [REMOTE ] CULP: Full fetch complete (4499 records). [2025-10-22T18:10:11.107914] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-22T18:10:11.318593] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-22T18:10:11.474289] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-22T18:10:11.474462] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-22T18:10:11.474698] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-22T18:10:11.474782] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-22T18:10:11.475320] [DEBUG] [LOCAL ] CULP: Trimmed 4499 records to 2843 (keeping 200 days of data) [2025-10-22T18:10:11.520615] [DEBUG] [LOCAL ] CULP: Primary data saved (2843 records). [2025-10-22T18:10:11.520856] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-22T18:10:11.521184] [INFO ] [MAIN ] Update Progress: 558/2367 symbols completed. CULP took 16.8s. Estimated remaining: 3h 47m 18s. Rate: 8.0 symbols/min [2025-10-22T18:10:11.523350] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T18:10:12.117750] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-22T18:10:12.826919] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T18:10:12.917757] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-22T18:10:13.918936] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T18:10:13.930224] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-22T18:10:13.981118] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-22T18:10:14.517717] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-22T18:10:15.950591] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T18:10:15.957489] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-22T18:10:16.814467] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (2.88 seconds). [2025-10-22T18:10:16.824348] [INFO ] [REMOTE ] CUK: Full fetch complete (74369 records). [2025-10-22T18:10:16.824488] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-22T18:10:17.237186] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-22T18:10:17.237318] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-22T18:10:17.238288] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-22T18:10:17.238431] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-22T18:10:17.239914] [DEBUG] [LOCAL ] CUK: Trimmed 74369 records to 51064 (keeping 200 days of data) [2025-10-22T18:10:17.548943] [DEBUG] [LOCAL ] CUK: Primary data saved (51064 records). [2025-10-22T18:10:17.549635] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-22T18:10:17.550454] [INFO ] [MAIN ] Update Progress: 559/2367 symbols completed. CUK took 42.4s. Estimated remaining: 3h 47m 6s. Rate: 8.0 symbols/min [2025-10-22T18:10:17.550323] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T18:10:17.560317] [INFO ] [REMOTE ] CURB: Full fetch complete (47560 records). [2025-10-22T18:10:17.560514] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-22T18:10:17.954348] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-22T18:10:17.954438] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-22T18:10:17.955135] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-22T18:10:17.955203] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-22T18:10:17.956323] [DEBUG] [LOCAL ] CURB: Trimmed 47560 records to 32786 (keeping 200 days of data) [2025-10-22T18:10:18.154816] [DEBUG] [LOCAL ] CURB: Primary data saved (32786 records). [2025-10-22T18:10:18.154980] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-22T18:10:18.155078] [INFO ] [MAIN ] Update Progress: 560/2367 symbols completed. CURB took 22.0s. Estimated remaining: 3h 46m 36s. Rate: 8.0 symbols/min [2025-10-22T18:10:18.796126] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:10:18.882872] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:10:18.884023] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:10:18.939693] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:10:18.940270] [DEBUG] [LOCAL ] CUZ: No existing data file found in primary storage. [2025-10-22T18:10:18.940315] [WARN ] [MAIN ] CUZ: No existing data found, performing full refresh instead. [2025-10-22T18:10:18.940404] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-22T18:10:18.940440] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-22T18:10:18.940478] [DEBUG] [LOCAL ] CUZ: No primary data file found to delete. [2025-10-22T18:10:18.940510] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-22T18:10:19.042137] [DEBUG] [LOCAL ] CVEO: Loaded 15250 existing records from primary storage. [2025-10-22T18:10:19.059638] [INFO ] [MAIN ] CVEO: Loaded 15250 existing records. [2025-10-22T18:10:19.187289] [DEBUG] [LOCAL ] CURV: Loaded 27190 existing records from primary storage. [2025-10-22T18:10:19.278769] [INFO ] [MAIN ] CURV: Loaded 27190 existing records. [2025-10-22T18:10:19.337378] [DEBUG] [LOCAL ] CVE: Loaded 53567 existing records from primary storage. [2025-10-22T18:10:19.431109] [INFO ] [MAIN ] CVE: Loaded 53567 existing records. [2025-10-22T18:10:19.645677] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:10:19.730096] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-22T18:10:19.819579] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:10:19.802320] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-22T18:10:19.819909] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-22T18:10:19.839500] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-22T18:10:19.879815] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-22T18:10:19.895809] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:10:19.901352] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-22T18:10:19.935779] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-22T18:10:19.973816] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:10:20.015624] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-22T18:10:20.020867] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-22T18:10:20.027095] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-22T18:10:20.049718] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-22T18:10:20.060526] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-22T18:10:20.082447] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-22T18:10:20.790130] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:10:20.810288] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-22T18:10:20.966084] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:10:20.966360] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-22T18:10:21.045812] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:10:21.046119] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-22T18:10:21.548092] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T18:10:21.558827] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-22T18:10:21.834103] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-22T18:10:21.836209] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-22T18:10:22.422536] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-22T18:10:22.425860] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-22T18:10:22.597857] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T18:10:22.608337] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-22T18:10:23.072861] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-22T18:10:23.076529] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-22T18:10:23.627015] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-22T18:10:23.632496] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-22T18:10:23.930553] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T18:10:24.040528] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-22T18:10:24.083737] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T18:10:24.117712] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-22T18:10:24.692926] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T18:10:24.917697] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-22T18:10:25.717700] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-22T18:10:25.892574] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T18:10:26.171717] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T18:10:26.517702] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-22T18:10:27.317671] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-22T18:10:27.362011] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T18:10:27.728537] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T18:10:28.117673] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-22T18:10:28.439898] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T18:10:28.917685] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-22T18:10:29.135183] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T18:10:29.717733] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-22T18:10:30.517670] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-22T18:10:30.844256] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T18:10:31.066951] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T18:10:31.317695] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-22T18:10:31.407473] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T18:10:32.117700] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-22T18:10:32.418976] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T18:10:32.917708] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-22T18:10:33.717674] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-22T18:10:33.969667] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T18:10:34.034801] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T18:10:34.517720] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-22T18:10:35.317694] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-22T18:10:35.688712] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T18:10:36.117675] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-22T18:10:36.229294] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-22T18:10:36.312257] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T18:10:36.917697] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-22T18:10:37.694530] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T18:10:37.717676] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-22T18:10:38.517695] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-22T18:10:38.602623] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T18:10:39.317680] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-22T18:10:39.413628] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T18:10:39.445200] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T18:10:39.447996] [INFO ] [REMOTE ] CVEO: Full fetch complete (20833 records). [2025-10-22T18:10:39.448073] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-22T18:10:39.448513] [FATAL] [VALIDATOR ] CVEO: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:10:39.448599] [FATAL] [MAIN ] CVEO: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:10:39.448668] [WARN ] [MAIN ] CVEO: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:10:39.448730] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-22T18:10:39.448788] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-22T18:10:39.448825] [INFO ] [LOCAL ] CVEO: Starting deletion of derivative data. [2025-10-22T18:10:39.448963] [DEBUG] [LOCAL ] CVEO: Deleted derivative data file. [2025-10-22T18:10:39.449030] [INFO ] [MAIN ] Update Progress: 561/2367 symbols completed. CVEO took 21.3s. Estimated remaining: 3h 47m 13s. Rate: 7.9 symbols/min [2025-10-22T18:10:39.622850] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:10:39.664109] [DEBUG] [LOCAL ] CVI: Loaded 46730 existing records from primary storage. [2025-10-22T18:10:39.664414] [INFO ] [MAIN ] CVI: Loaded 46730 existing records. [2025-10-22T18:10:39.836823] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:10:39.837026] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-22T18:10:39.837071] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-22T18:10:39.837278] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-22T18:10:39.837332] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-22T18:10:40.122966] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-22T18:10:40.188089] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:10:40.917713] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-22T18:10:41.149463] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T18:10:41.374499] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-22T18:10:41.717718] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-22T18:10:42.134911] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-22T18:10:42.517676] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-22T18:10:42.840856] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T18:10:43.317727] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-22T18:10:44.109724] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T18:10:44.117688] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-22T18:10:44.869138] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T18:10:44.917727] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-22T18:10:45.717722] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-22T18:10:45.997547] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T18:10:46.517704] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-22T18:10:46.937798] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-22T18:10:47.195145] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-22T18:10:47.317759] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-22T18:10:48.117706] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-22T18:10:48.244973] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T18:10:48.917691] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-22T18:10:49.353310] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T18:10:49.362458] [INFO ] [REMOTE ] CVE: Full fetch complete (77718 records). [2025-10-22T18:10:49.362615] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-22T18:10:49.723866] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-22T18:10:49.731687] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T18:10:49.819347] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-22T18:10:49.819437] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-22T18:10:49.820395] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-22T18:10:49.820472] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-22T18:10:49.821977] [DEBUG] [LOCAL ] CVE: Trimmed 77718 records to 53567 (keeping 200 days of data) [2025-10-22T18:10:50.145398] [DEBUG] [LOCAL ] CVE: Primary data saved (53567 records). [2025-10-22T18:10:50.145539] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-22T18:10:50.145627] [INFO ] [MAIN ] Update Progress: 562/2367 symbols completed. CVE took 32.0s. Estimated remaining: 3h 47m 16s. Rate: 7.9 symbols/min [2025-10-22T18:10:50.313164] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:10:50.328473] [DEBUG] [LOCAL ] CVLG: Loaded 15331 existing records from primary storage. [2025-10-22T18:10:50.328702] [INFO ] [MAIN ] CVLG: Loaded 15331 existing records. [2025-10-22T18:10:50.504308] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:10:50.504564] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-22T18:10:50.504625] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-22T18:10:50.504952] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-22T18:10:50.505054] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-22T18:10:50.535789] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-22T18:10:50.651239] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T18:10:50.899443] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:10:51.317726] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-22T18:10:51.504734] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T18:10:51.512619] [INFO ] [REMOTE ] CUZ: Full fetch complete (70793 records). [2025-10-22T18:10:51.512769] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-22T18:10:51.900362] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-22T18:10:51.900487] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-22T18:10:51.901328] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-22T18:10:51.901430] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-22T18:10:51.902885] [DEBUG] [LOCAL ] CUZ: Trimmed 70793 records to 49436 (keeping 200 days of data) [2025-10-22T18:10:52.136111] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-22T18:10:52.140191] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-22T18:10:52.152174] [INFO ] [REMOTE ] CURV: Full fetch complete (38929 records). [2025-10-22T18:10:52.154365] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-22T18:10:52.399957] [DEBUG] [LOCAL ] CUZ: Primary data saved (49436 records). [2025-10-22T18:10:52.473354] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-22T18:10:52.499471] [INFO ] [MAIN ] Update Progress: 563/2367 symbols completed. CUZ took 34.3s. Estimated remaining: 3h 46m 51s. Rate: 8.0 symbols/min [2025-10-22T18:10:52.556617] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T18:10:52.795778] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-22T18:10:52.801939] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-22T18:10:52.812609] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-22T18:10:52.827906] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-22T18:10:52.831469] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:10:52.832446] [DEBUG] [LOCAL ] CURV: Trimmed 38929 records to 27192 (keeping 200 days of data) [2025-10-22T18:10:52.919944] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-22T18:10:52.979281] [DEBUG] [LOCAL ] CVNA: Loaded 52839 existing records from primary storage. [2025-10-22T18:10:53.007754] [INFO ] [MAIN ] CVNA: Loaded 52839 existing records. [2025-10-22T18:10:53.119297] [DEBUG] [LOCAL ] CURV: Primary data saved (27192 records). [2025-10-22T18:10:53.124976] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-22T18:10:53.135317] [INFO ] [MAIN ] Update Progress: 564/2367 symbols completed. CURV took 35.0s. Estimated remaining: 3h 46m 22s. Rate: 8.0 symbols/min [2025-10-22T18:10:53.297096] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:10:53.297286] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-22T18:10:53.297357] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-22T18:10:53.303044] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-22T18:10:53.308207] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-22T18:10:53.453352] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:10:53.656558] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-22T18:10:53.731554] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-22T18:10:53.761865] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:10:53.813853] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-22T18:10:53.812841] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T18:10:53.823499] [INFO ] [MAIN ] CVS: Loaded 53694 existing records. [2025-10-22T18:10:54.009662] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:10:54.009858] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-22T18:10:54.009905] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-22T18:10:54.010110] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-22T18:10:54.010166] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-22T18:10:54.352938] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:10:54.517679] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-22T18:10:54.620877] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-22T18:10:55.317690] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-22T18:10:56.117715] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-22T18:10:56.674848] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-22T18:10:56.917716] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-22T18:10:57.176329] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T18:10:57.585532] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T18:10:57.717764] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-22T18:10:58.517714] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-22T18:10:58.598219] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T18:10:59.317745] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-22T18:10:59.676971] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-22T18:10:59.776839] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T18:11:00.117708] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-22T18:11:00.917732] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-22T18:11:01.717730] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-22T18:11:01.794048] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-22T18:11:02.517726] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-22T18:11:02.969356] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-10-22T18:11:03.317769] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-22T18:11:03.331886] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-22T18:11:04.117759] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-22T18:11:04.418365] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-22T18:11:04.736612] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (3.02 seconds). [2025-10-22T18:11:04.917691] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-22T18:11:05.331316] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T18:11:05.421412] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T18:11:05.717698] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-22T18:11:06.517700] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-22T18:11:06.985217] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-22T18:11:07.317759] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-22T18:11:07.788382] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-22T18:11:08.117677] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-22T18:11:08.241422] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-22T18:11:08.241120] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T18:11:08.917716] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-22T18:11:09.717713] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-22T18:11:10.341439] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-22T18:11:10.517607] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-22T18:11:10.686046] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T18:11:10.703208] [INFO ] [REMOTE ] CVI: Full fetch complete (66871 records). [2025-10-22T18:11:10.703572] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T18:11:10.706497] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-22T18:11:10.707571] [FATAL] [VALIDATOR ] CVI: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:11:10.707716] [FATAL] [MAIN ] CVI: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:11:10.707764] [WARN ] [MAIN ] CVI: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:11:10.707831] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-22T18:11:10.707908] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-22T18:11:10.707962] [INFO ] [LOCAL ] CVI: Starting deletion of derivative data. [2025-10-22T18:11:10.708530] [DEBUG] [LOCAL ] CVI: Deleted derivative data file. [2025-10-22T18:11:10.708617] [INFO ] [MAIN ] Update Progress: 565/2367 symbols completed. CVI took 31.3s. Estimated remaining: 3h 46m 46s. Rate: 7.9 symbols/min [2025-10-22T18:11:10.883475] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:11:10.934173] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-22T18:11:10.934495] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-10-22T18:11:11.119079] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:11:11.119289] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-22T18:11:11.119337] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-22T18:11:11.119520] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-22T18:11:11.119557] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-22T18:11:11.320085] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-22T18:11:11.509502] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:11:12.117684] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-22T18:11:12.331337] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T18:11:12.363766] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T18:11:12.917738] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-22T18:11:13.717737] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-22T18:11:14.142536] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T18:11:14.517700] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-22T18:11:14.558280] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-22T18:11:14.560964] [INFO ] [REMOTE ] CVLG: Full fetch complete (21317 records). [2025-10-22T18:11:14.561076] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-22T18:11:14.949858] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-22T18:11:14.950065] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-22T18:11:14.950543] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-22T18:11:14.950758] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-22T18:11:14.951544] [DEBUG] [LOCAL ] CVLG: Trimmed 21317 records to 15231 (keeping 200 days of data) [2025-10-22T18:11:15.050486] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T18:11:15.085962] [DEBUG] [LOCAL ] CVLG: Primary data saved (15231 records). [2025-10-22T18:11:15.086106] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-22T18:11:15.086190] [INFO ] [MAIN ] Update Progress: 566/2367 symbols completed. CVLG took 24.9s. Estimated remaining: 3h 46m 29s. Rate: 8.0 symbols/min [2025-10-22T18:11:15.256241] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:11:15.276995] [DEBUG] [LOCAL ] CW: Loaded 21993 existing records from primary storage. [2025-10-22T18:11:15.277241] [INFO ] [MAIN ] CW: Loaded 21993 existing records. [2025-10-22T18:11:15.330007] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-22T18:11:15.460314] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:11:15.460505] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-22T18:11:15.460553] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-22T18:11:15.460770] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-22T18:11:15.460825] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-22T18:11:15.809702] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:11:16.117808] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-22T18:11:16.807933] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-22T18:11:16.917701] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-22T18:11:17.519174] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T18:11:17.715378] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-22T18:11:17.725969] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-22T18:11:18.517774] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-22T18:11:19.223391] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-22T18:11:19.317616] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-22T18:11:19.857488] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-22T18:11:20.117670] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-22T18:11:20.217311] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T18:11:20.917732] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-22T18:11:21.253783] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-22T18:11:21.461613] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T18:11:21.717700] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-22T18:11:22.517638] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-22T18:11:23.002485] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-22T18:11:23.317708] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-22T18:11:23.943568] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-22T18:11:23.953250] [INFO ] [REMOTE ] CVNA: Full fetch complete (76742 records). [2025-10-22T18:11:23.953389] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-22T18:11:24.117945] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-22T18:11:24.397765] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-22T18:11:24.397931] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-22T18:11:24.398993] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-22T18:11:24.399114] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-22T18:11:24.401347] [DEBUG] [LOCAL ] CVNA: Trimmed 76742 records to 52837 (keeping 200 days of data) [2025-10-22T18:11:24.559271] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-22T18:11:24.571257] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T18:11:24.774220] [DEBUG] [LOCAL ] CVNA: Primary data saved (52837 records). [2025-10-22T18:11:24.774350] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-22T18:11:24.774429] [INFO ] [MAIN ] Update Progress: 567/2367 symbols completed. CVNA took 32.2s. Estimated remaining: 3h 46m 28s. Rate: 7.9 symbols/min [2025-10-22T18:11:24.922821] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-22T18:11:24.972201] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:11:25.023331] [DEBUG] [LOCAL ] CWAN: Loaded 52682 existing records from primary storage. [2025-10-22T18:11:25.023682] [INFO ] [MAIN ] CWAN: Loaded 52682 existing records. [2025-10-22T18:11:25.224205] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:11:25.226096] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T18:11:25.234630] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-22T18:11:25.235090] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-22T18:11:25.235294] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-22T18:11:25.235334] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-22T18:11:25.277679] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-22T18:11:25.303731] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-22T18:11:25.731826] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-22T18:11:25.954758] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:11:26.001127] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-22T18:11:26.001222] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-22T18:11:26.002158] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-22T18:11:26.002226] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-22T18:11:26.003742] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 53694 (keeping 200 days of data) [2025-10-22T18:11:26.323094] [DEBUG] [LOCAL ] CVS: Primary data saved (53694 records). [2025-10-22T18:11:26.323246] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-22T18:11:26.323334] [INFO ] [MAIN ] Update Progress: 568/2367 symbols completed. CVS took 33.2s. Estimated remaining: 3h 46m 1s. Rate: 8.0 symbols/min [2025-10-22T18:11:26.495296] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:11:26.517719] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-22T18:11:26.536443] [DEBUG] [LOCAL ] CWEN: Loaded 45297 existing records from primary storage. [2025-10-22T18:11:26.536798] [INFO ] [MAIN ] CWEN: Loaded 45297 existing records. [2025-10-22T18:11:26.714848] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:11:26.715051] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-22T18:11:26.715098] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-22T18:11:26.715357] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-22T18:11:26.715397] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-22T18:11:27.038457] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T18:11:27.098254] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:11:27.317689] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-22T18:11:27.444845] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-22T18:11:27.874946] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-22T18:11:28.117722] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-22T18:11:28.745360] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T18:11:28.917746] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-22T18:11:29.713772] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T18:11:29.722216] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-22T18:11:30.517698] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-22T18:11:31.298609] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T18:11:31.317609] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-22T18:11:32.117718] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-22T18:11:32.525363] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (3.61 seconds). [2025-10-22T18:11:32.592099] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-22T18:11:32.684734] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T18:11:32.917690] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-22T18:11:33.650115] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T18:11:33.717673] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-22T18:11:34.517741] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-22T18:11:35.317723] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-22T18:11:35.384253] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-22T18:11:35.644977] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T18:11:36.117670] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-22T18:11:36.145471] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:11:36.472132] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T18:11:36.917732] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-22T18:11:37.717760] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-22T18:11:38.542948] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-22T18:11:38.571709] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-22T18:11:38.576365] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-22T18:11:39.038823] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-22T18:11:39.317618] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-22T18:11:40.117681] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-22T18:11:40.277453] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T18:11:40.865557] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T18:11:40.917618] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-22T18:11:41.266260] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T18:11:41.269691] [INFO ] [REMOTE ] CW: Full fetch complete (33010 records). [2025-10-22T18:11:41.269772] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-22T18:11:41.629486] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-22T18:11:41.629580] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-22T18:11:41.630113] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-22T18:11:41.630179] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-22T18:11:41.631101] [DEBUG] [LOCAL ] CW: Trimmed 33010 records to 21935 (keeping 200 days of data) [2025-10-22T18:11:41.728700] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-22T18:11:41.782999] [DEBUG] [LOCAL ] CW: Primary data saved (21935 records). [2025-10-22T18:11:41.783156] [INFO ] [MAIN ] CW: Full history saved. [2025-10-22T18:11:41.783262] [INFO ] [MAIN ] Update Progress: 569/2367 symbols completed. CW took 26.7s. Estimated remaining: 3h 46m 19s. Rate: 7.9 symbols/min [2025-10-22T18:11:41.950987] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:11:41.951556] [DEBUG] [LOCAL ] CWH: No existing data file found in primary storage. [2025-10-22T18:11:41.951632] [WARN ] [MAIN ] CWH: No existing data found, performing full refresh instead. [2025-10-22T18:11:41.951838] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-22T18:11:41.951881] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-22T18:11:41.951923] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-22T18:11:41.951960] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-22T18:11:42.316527] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:11:42.450131] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T18:11:42.517690] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-22T18:11:43.317694] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-22T18:11:43.391800] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T18:11:44.117767] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-22T18:11:44.323799] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T18:11:44.917685] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-22T18:11:45.016738] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T18:11:45.630459] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T18:11:45.717686] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-22T18:11:46.485585] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T18:11:46.517680] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-22T18:11:47.317682] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-22T18:11:47.551226] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T18:11:48.117666] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-22T18:11:48.626807] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-22T18:11:48.917690] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-22T18:11:49.331006] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-22T18:11:49.717695] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-22T18:11:49.929765] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T18:11:50.477757] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T18:11:50.517714] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-22T18:11:51.317761] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-22T18:11:51.443056] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T18:11:51.981892] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T18:11:52.117704] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-22T18:11:52.917737] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-22T18:11:53.358278] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T18:11:53.717713] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-22T18:11:53.803697] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T18:11:54.159526] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-22T18:11:54.517687] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-22T18:11:55.278173] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T18:11:55.317679] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-22T18:11:56.117733] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-22T18:11:56.917743] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-22T18:11:57.094967] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T18:11:57.129980] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-22T18:11:57.138997] [INFO ] [REMOTE ] CVX: Full fetch complete (77940 records). [2025-10-22T18:11:57.139195] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-22T18:11:57.544253] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-22T18:11:57.544388] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-22T18:11:57.545358] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-22T18:11:57.545426] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-22T18:11:57.546927] [DEBUG] [LOCAL ] CVX: Trimmed 77940 records to 53760 (keeping 200 days of data) [2025-10-22T18:11:57.726861] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-22T18:11:57.910557] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-10-22T18:11:57.911361] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-22T18:11:57.912215] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T18:11:57.912361] [INFO ] [MAIN ] Update Progress: 570/2367 symbols completed. CVX took 47.2s. Estimated remaining: 3h 46m 38s. Rate: 7.9 symbols/min [2025-10-22T18:11:57.998049] [INFO ] [REMOTE ] CWEN: Full fetch complete (65670 records). [2025-10-22T18:11:58.023068] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-22T18:11:58.214342] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:11:58.503840] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-22T18:11:58.503953] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-22T18:11:58.504770] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-22T18:11:58.504852] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-22T18:11:58.506570] [DEBUG] [LOCAL ] CWEN: Trimmed 65670 records to 45287 (keeping 200 days of data) [2025-10-22T18:11:58.584771] [DEBUG] [LOCAL ] CWK: Loaded 49650 existing records from primary storage. [2025-10-22T18:11:58.636881] [INFO ] [MAIN ] CWK: Loaded 49650 existing records. [2025-10-22T18:11:58.694584] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T18:11:58.763930] [INFO ] [REMOTE ] CWAN: Full fetch complete (75609 records). [2025-10-22T18:11:58.794381] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-22T18:11:58.955066] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:11:59.021867] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-22T18:11:59.036272] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-22T18:11:59.053164] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-22T18:11:59.059799] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-22T18:11:59.519729] [DEBUG] [LOCAL ] CWEN: Primary data saved (45287 records). [2025-10-22T18:11:59.560809] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-22T18:11:59.631962] [INFO ] [MAIN ] Update Progress: 571/2367 symbols completed. CWEN took 33.3s. Estimated remaining: 3h 46m 12s. Rate: 7.9 symbols/min [2025-10-22T18:11:59.947101] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-22T18:12:00.021561] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-22T18:12:00.008241] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:00.036790] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-22T18:12:00.051083] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-22T18:12:00.084553] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-22T18:12:00.098404] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-22T18:12:00.098128] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:00.098789] [DEBUG] [LOCAL ] CWT: No existing data file found in primary storage. [2025-10-22T18:12:00.099584] [WARN ] [MAIN ] CWT: No existing data found, performing full refresh instead. [2025-10-22T18:12:00.099875] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-22T18:12:00.099942] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-22T18:12:00.100037] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-22T18:12:00.100104] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-22T18:12:00.122567] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-22T18:12:00.204511] [DEBUG] [LOCAL ] CWAN: Trimmed 75609 records to 52687 (keeping 200 days of data) [2025-10-22T18:12:00.577190] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:00.591806] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-22T18:12:00.784572] [DEBUG] [LOCAL ] CWAN: Primary data saved (52687 records). [2025-10-22T18:12:00.784795] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-22T18:12:00.784996] [INFO ] [MAIN ] Update Progress: 572/2367 symbols completed. CWAN took 36.0s. Estimated remaining: 3h 45m 45s. Rate: 8.0 symbols/min [2025-10-22T18:12:00.957334] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:01.007442] [DEBUG] [LOCAL ] CX: Loaded 52833 existing records from primary storage. [2025-10-22T18:12:01.007848] [INFO ] [MAIN ] CX: Loaded 52833 existing records. [2025-10-22T18:12:01.184247] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:12:01.184456] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-22T18:12:01.184502] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-22T18:12:01.184761] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-22T18:12:01.184817] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-22T18:12:01.560861] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:01.561222] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-22T18:12:02.053454] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T18:12:02.062862] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-22T18:12:02.620118] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-22T18:12:02.626630] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-22T18:12:02.733010] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-22T18:12:03.317722] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-22T18:12:03.889520] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-22T18:12:04.117672] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-22T18:12:04.139217] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T18:12:04.294044] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-22T18:12:04.917702] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-22T18:12:05.045842] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T18:12:05.053904] [INFO ] [REMOTE ] CWH: Full fetch complete (73203 records). [2025-10-22T18:12:05.054060] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-22T18:12:05.460031] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-22T18:12:05.460175] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-22T18:12:05.461285] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-22T18:12:05.461352] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-22T18:12:05.463668] [DEBUG] [LOCAL ] CWH: Trimmed 73203 records to 51271 (keeping 200 days of data) [2025-10-22T18:12:05.718900] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-22T18:12:05.801355] [DEBUG] [LOCAL ] CWH: Primary data saved (51271 records). [2025-10-22T18:12:05.801692] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-22T18:12:05.801802] [INFO ] [MAIN ] Update Progress: 573/2367 symbols completed. CWH took 24.0s. Estimated remaining: 3h 45m 29s. Rate: 8.0 symbols/min [2025-10-22T18:12:06.008319] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:06.011530] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T18:12:06.028955] [DEBUG] [LOCAL ] CXE: Loaded 6372 existing records from primary storage. [2025-10-22T18:12:06.029145] [INFO ] [MAIN ] CXE: Loaded 6372 existing records. [2025-10-22T18:12:06.212625] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:12:06.212919] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-22T18:12:06.213038] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-22T18:12:06.219186] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-22T18:12:06.228730] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-22T18:12:06.274456] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T18:12:06.517723] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-22T18:12:06.600807] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:07.250541] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T18:12:07.317680] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-22T18:12:07.887975] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T18:12:08.117730] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-22T18:12:08.283254] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T18:12:08.917697] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-22T18:12:09.717716] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-22T18:12:09.733549] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T18:12:09.909093] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T18:12:10.517684] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-22T18:12:11.047924] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T18:12:11.317711] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-22T18:12:12.120622] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-22T18:12:12.298669] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T18:12:12.917668] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-22T18:12:13.101236] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T18:12:13.509376] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T18:12:13.717613] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-22T18:12:13.726846] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T18:12:14.517705] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-22T18:12:15.317735] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-22T18:12:15.718636] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T18:12:16.117702] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-22T18:12:16.279700] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-22T18:12:16.565805] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T18:12:16.847373] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-22T18:12:16.917734] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-22T18:12:17.717734] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-22T18:12:18.460542] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T18:12:18.525299] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-22T18:12:18.542519] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T18:12:19.317692] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-22T18:12:19.923544] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-22T18:12:20.117710] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-22T18:12:20.306705] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T18:12:20.508050] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-22T18:12:20.917707] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-22T18:12:21.522264] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T18:12:21.717682] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-22T18:12:22.517757] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-22T18:12:23.317752] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-22T18:12:23.445502] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T18:12:23.964315] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T18:12:24.060173] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T18:12:24.117701] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-22T18:12:24.917737] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-22T18:12:25.717708] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-22T18:12:26.088953] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T18:12:26.457981] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T18:12:26.459670] [INFO ] [REMOTE ] CXE: Full fetch complete (11439 records). [2025-10-22T18:12:26.459756] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-22T18:12:26.522766] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-22T18:12:26.681975] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T18:12:26.903343] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-22T18:12:26.903425] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-22T18:12:26.903695] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-22T18:12:26.903754] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-22T18:12:26.904173] [DEBUG] [LOCAL ] CXE: Trimmed 11439 records to 6414 (keeping 200 days of data) [2025-10-22T18:12:26.942446] [DEBUG] [LOCAL ] CXE: Primary data saved (6414 records). [2025-10-22T18:12:26.942604] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-22T18:12:26.942726] [INFO ] [MAIN ] Update Progress: 574/2367 symbols completed. CXE took 21.1s. Estimated remaining: 3h 46m 4s. Rate: 7.9 symbols/min [2025-10-22T18:12:27.122076] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:27.127915] [DEBUG] [LOCAL ] CXH: Loaded 4418 existing records from primary storage. [2025-10-22T18:12:27.128103] [INFO ] [MAIN ] CXH: Loaded 4418 existing records. [2025-10-22T18:12:27.298228] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:12:27.298430] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-22T18:12:27.298476] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-22T18:12:27.298622] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-22T18:12:27.298706] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-22T18:12:27.328510] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-22T18:12:27.667957] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:27.737429] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T18:12:28.117700] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-22T18:12:28.917690] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-22T18:12:28.962351] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T18:12:29.430463] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-22T18:12:29.449234] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T18:12:29.454693] [INFO ] [REMOTE ] CWT: Full fetch complete (41362 records). [2025-10-22T18:12:29.454830] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-22T18:12:29.722862] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-22T18:12:29.857103] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-22T18:12:29.857192] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-22T18:12:29.857994] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-22T18:12:29.858068] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-22T18:12:29.859138] [DEBUG] [LOCAL ] CWT: Trimmed 41362 records to 28062 (keeping 200 days of data) [2025-10-22T18:12:30.035508] [DEBUG] [LOCAL ] CWT: Primary data saved (28062 records). [2025-10-22T18:12:30.035673] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-22T18:12:30.035764] [INFO ] [MAIN ] Update Progress: 575/2367 symbols completed. CWT took 30.4s. Estimated remaining: 3h 45m 43s. Rate: 7.9 symbols/min [2025-10-22T18:12:30.200783] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:30.242488] [DEBUG] [LOCAL ] CXM: Loaded 47468 existing records from primary storage. [2025-10-22T18:12:30.242845] [INFO ] [MAIN ] CXM: Loaded 47468 existing records. [2025-10-22T18:12:30.428609] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:12:30.428875] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-22T18:12:30.428923] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-22T18:12:30.429110] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-22T18:12:30.429148] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-22T18:12:30.523106] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-22T18:12:30.930029] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:31.327469] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-22T18:12:31.355140] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:12:32.117707] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-22T18:12:32.414323] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T18:12:32.423444] [INFO ] [REMOTE ] CX: Full fetch complete (76587 records). [2025-10-22T18:12:32.423590] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-22T18:12:32.653347] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-22T18:12:32.826120] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-22T18:12:32.826223] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-22T18:12:32.827115] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-22T18:12:32.827189] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-22T18:12:32.828786] [DEBUG] [LOCAL ] CX: Trimmed 76587 records to 52826 (keeping 200 days of data) [2025-10-22T18:12:32.922353] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-22T18:12:32.948210] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T18:12:33.170375] [DEBUG] [LOCAL ] CX: Primary data saved (52826 records). [2025-10-22T18:12:33.170510] [INFO ] [MAIN ] CX: Full history saved. [2025-10-22T18:12:33.170588] [INFO ] [MAIN ] Update Progress: 576/2367 symbols completed. CX took 32.4s. Estimated remaining: 3h 45m 21s. Rate: 7.9 symbols/min [2025-10-22T18:12:33.335320] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:33.365621] [DEBUG] [LOCAL ] CXT: Loaded 30841 existing records from primary storage. [2025-10-22T18:12:33.365947] [INFO ] [MAIN ] CXT: Loaded 30841 existing records. [2025-10-22T18:12:33.437370] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-22T18:12:33.548386] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:12:33.548670] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-22T18:12:33.548730] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-22T18:12:33.548922] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-22T18:12:33.548978] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-22T18:12:33.723945] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-22T18:12:33.893357] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:34.352504] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-22T18:12:34.517705] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-22T18:12:35.317724] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-22T18:12:36.117684] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-22T18:12:36.166576] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T18:12:36.740093] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T18:12:36.917722] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-22T18:12:37.583916] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T18:12:37.717744] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-22T18:12:38.253334] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T18:12:38.517702] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-22T18:12:39.317684] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-22T18:12:39.468481] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T18:12:39.476948] [INFO ] [REMOTE ] CWK: Full fetch complete (71367 records). [2025-10-22T18:12:39.477124] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-22T18:12:39.890982] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-22T18:12:39.891149] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-22T18:12:39.891988] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-22T18:12:39.892052] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-22T18:12:39.893384] [DEBUG] [LOCAL ] CWK: Trimmed 71367 records to 49638 (keeping 200 days of data) [2025-10-22T18:12:40.122870] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-22T18:12:40.195822] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T18:12:40.224715] [DEBUG] [LOCAL ] CWK: Primary data saved (49638 records). [2025-10-22T18:12:40.224850] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-22T18:12:40.224931] [INFO ] [MAIN ] Update Progress: 577/2367 symbols completed. CWK took 42.3s. Estimated remaining: 3h 45m 12s. Rate: 7.9 symbols/min [2025-10-22T18:12:40.401827] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:40.441410] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T18:12:40.462456] [DEBUG] [LOCAL ] CXW: Loaded 43650 existing records from primary storage. [2025-10-22T18:12:40.462812] [INFO ] [MAIN ] CXW: Loaded 43650 existing records. [2025-10-22T18:12:40.636743] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:12:40.636998] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-22T18:12:40.637047] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-22T18:12:40.637271] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-22T18:12:40.637327] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-22T18:12:40.919671] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-22T18:12:40.927224] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T18:12:41.000735] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:41.717707] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-22T18:12:42.292857] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T18:12:42.517674] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-22T18:12:43.317671] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-22T18:12:43.877947] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T18:12:43.963747] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-22T18:12:43.963574] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-22T18:12:44.117668] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-22T18:12:44.917706] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-22T18:12:45.726662] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-22T18:12:45.731569] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T18:12:46.270921] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T18:12:46.517702] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-22T18:12:47.317760] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-22T18:12:47.397801] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T18:12:47.478826] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-22T18:12:48.117704] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-22T18:12:48.922836] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-22T18:12:48.943911] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:12:49.679598] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T18:12:49.705538] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-22T18:12:49.717610] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-22T18:12:50.517772] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-22T18:12:51.082701] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T18:12:51.317771] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-22T18:12:52.117676] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-22T18:12:52.171307] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T18:12:52.714168] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T18:12:52.719384] [INFO ] [REMOTE ] CXT: Full fetch complete (45673 records). [2025-10-22T18:12:52.719477] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-22T18:12:52.924940] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-22T18:12:53.090840] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-22T18:12:53.090917] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-22T18:12:53.091550] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-22T18:12:53.091591] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-22T18:12:53.092564] [DEBUG] [LOCAL ] CXT: Trimmed 45673 records to 30698 (keeping 200 days of data) [2025-10-22T18:12:53.275991] [DEBUG] [LOCAL ] CXT: Primary data saved (30698 records). [2025-10-22T18:12:53.276134] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-22T18:12:53.276211] [INFO ] [MAIN ] Update Progress: 578/2367 symbols completed. CXT took 20.1s. Estimated remaining: 3h 45m 22s. Rate: 7.9 symbols/min [2025-10-22T18:12:53.451341] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:53.451531] [DEBUG] [LOCAL ] CYD: No existing data file found in primary storage. [2025-10-22T18:12:53.451584] [WARN ] [MAIN ] CYD: No existing data found, performing full refresh instead. [2025-10-22T18:12:53.451717] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-22T18:12:53.451764] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-22T18:12:53.451806] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-22T18:12:53.451837] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-22T18:12:53.676497] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-22T18:12:53.727032] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-22T18:12:53.816337] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:53.941750] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T18:12:54.517715] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-22T18:12:54.948337] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-22T18:12:55.133263] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T18:12:55.317682] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-22T18:12:56.117681] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-22T18:12:56.474422] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T18:12:56.917686] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-22T18:12:57.600512] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T18:12:57.717682] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-22T18:12:57.796853] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T18:12:58.151497] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-22T18:12:58.152392] [INFO ] [REMOTE ] CXH: Full fetch complete (5303 records). [2025-10-22T18:12:58.152462] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-22T18:12:58.510425] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-22T18:12:58.510501] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-22T18:12:58.510662] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-22T18:12:58.510723] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-22T18:12:58.511093] [DEBUG] [LOCAL ] CXH: Trimmed 5303 records to 4392 (keeping 200 days of data) [2025-10-22T18:12:58.521489] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-22T18:12:58.539637] [DEBUG] [LOCAL ] CXH: Primary data saved (4392 records). [2025-10-22T18:12:58.539791] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-22T18:12:58.539893] [INFO ] [MAIN ] Update Progress: 579/2367 symbols completed. CXH took 31.6s. Estimated remaining: 3h 45m 7s. Rate: 7.9 symbols/min [2025-10-22T18:12:58.705207] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:12:58.748223] [DEBUG] [LOCAL ] CYH: Loaded 47712 existing records from primary storage. [2025-10-22T18:12:58.748528] [INFO ] [MAIN ] CYH: Loaded 47712 existing records. [2025-10-22T18:12:58.929853] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:12:58.930096] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-22T18:12:58.930176] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-22T18:12:58.930446] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-22T18:12:58.930513] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-22T18:12:59.274902] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:12:59.317615] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-22T18:13:00.117684] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-22T18:13:00.160051] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T18:13:00.917720] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-22T18:13:01.556535] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-22T18:13:01.717727] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-22T18:13:01.909948] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T18:13:02.517719] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-22T18:13:02.818481] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-22T18:13:03.317701] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-22T18:13:03.444303] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T18:13:04.079023] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T18:13:04.117711] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-22T18:13:04.909340] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T18:13:04.917126] [INFO ] [REMOTE ] CXM: Full fetch complete (68626 records). [2025-10-22T18:13:04.917302] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-22T18:13:04.917689] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-22T18:13:05.319950] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-22T18:13:05.320038] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-22T18:13:05.320854] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-22T18:13:05.320948] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-22T18:13:05.322327] [DEBUG] [LOCAL ] CXM: Trimmed 68626 records to 47404 (keeping 200 days of data) [2025-10-22T18:13:05.588814] [DEBUG] [LOCAL ] CXM: Primary data saved (47404 records). [2025-10-22T18:13:05.588939] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-22T18:13:05.589539] [INFO ] [MAIN ] Update Progress: 580/2367 symbols completed. CXM took 35.6s. Estimated remaining: 3h 44m 58s. Rate: 7.9 symbols/min [2025-10-22T18:13:05.717673] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-22T18:13:05.742860] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:13:05.799247] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:13:05.866612] [DEBUG] [LOCAL ] D: Loaded 53649 existing records from primary storage. [2025-10-22T18:13:05.867123] [INFO ] [MAIN ] D: Loaded 53649 existing records. [2025-10-22T18:13:06.057095] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:13:06.057536] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-22T18:13:06.057734] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-22T18:13:06.058187] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-22T18:13:06.058246] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-22T18:13:06.433458] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:13:06.460692] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-22T18:13:06.517676] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-22T18:13:07.033720] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T18:13:07.317937] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-22T18:13:08.117722] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-22T18:13:08.170104] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T18:13:08.917797] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-22T18:13:08.952048] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T18:13:09.717694] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-22T18:13:09.890874] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T18:13:09.947930] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T18:13:10.521802] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-22T18:13:11.317699] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-22T18:13:11.384937] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T18:13:11.838086] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T18:13:12.080689] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-22T18:13:12.117668] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-22T18:13:12.917700] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-22T18:13:13.317083] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T18:13:13.717694] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-22T18:13:14.427814] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T18:13:14.517613] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-22T18:13:15.317683] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-22T18:13:15.365585] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T18:13:16.117677] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-22T18:13:16.283178] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T18:13:16.613617] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-22T18:13:16.917717] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-22T18:13:17.717706] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-22T18:13:17.830379] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T18:13:18.262226] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-22T18:13:18.517697] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-22T18:13:19.291384] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T18:13:19.301904] [INFO ] [REMOTE ] CXW: Full fetch complete (64840 records). [2025-10-22T18:13:19.302107] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-22T18:13:19.325346] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-22T18:13:19.685457] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-22T18:13:19.685577] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-22T18:13:19.686395] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-22T18:13:19.686463] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-22T18:13:19.687845] [DEBUG] [LOCAL ] CXW: Trimmed 64840 records to 43639 (keeping 200 days of data) [2025-10-22T18:13:19.950870] [DEBUG] [LOCAL ] CXW: Primary data saved (43639 records). [2025-10-22T18:13:19.951274] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-22T18:13:19.951382] [INFO ] [MAIN ] Update Progress: 581/2367 symbols completed. CXW took 39.7s. Estimated remaining: 3h 45m 11s. Rate: 7.9 symbols/min [2025-10-22T18:13:20.118005] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:13:20.118145] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-22T18:13:20.131879] [DEBUG] [LOCAL ] DAC: Loaded 12508 existing records from primary storage. [2025-10-22T18:13:20.132070] [INFO ] [MAIN ] DAC: Loaded 12508 existing records. [2025-10-22T18:13:20.308096] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:13:20.308435] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-22T18:13:20.308489] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-22T18:13:20.309053] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-22T18:13:20.318994] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-22T18:13:20.437912] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-22T18:13:20.715998] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:13:20.917680] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-22T18:13:21.413905] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-22T18:13:21.503457] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T18:13:21.508991] [INFO ] [REMOTE ] CYD: Full fetch complete (36025 records). [2025-10-22T18:13:21.509104] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-22T18:13:21.725128] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-22T18:13:21.880854] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-22T18:13:21.942809] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-22T18:13:21.942877] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-22T18:13:21.943426] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-22T18:13:21.943465] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-22T18:13:21.944243] [DEBUG] [LOCAL ] CYD: Trimmed 36025 records to 27277 (keeping 200 days of data) [2025-10-22T18:13:22.102504] [DEBUG] [LOCAL ] CYD: Primary data saved (27277 records). [2025-10-22T18:13:22.102627] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-22T18:13:22.102731] [INFO ] [MAIN ] Update Progress: 582/2367 symbols completed. CYD took 28.8s. Estimated remaining: 3h 44m 47s. Rate: 7.9 symbols/min [2025-10-22T18:13:22.270434] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:13:22.315489] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-22T18:13:22.315822] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-22T18:13:22.485879] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:13:22.486048] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-22T18:13:22.486093] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-22T18:13:22.486473] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-22T18:13:22.486527] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-22T18:13:22.527288] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-22T18:13:22.840404] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:13:23.317750] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-22T18:13:23.605078] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T18:13:23.690494] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T18:13:24.117702] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-22T18:13:24.917743] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-22T18:13:25.081818] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T18:13:25.717756] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-22T18:13:25.843141] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-22T18:13:26.021805] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-22T18:13:26.517711] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-22T18:13:27.317671] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-22T18:13:27.554274] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-22T18:13:27.834870] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-22T18:13:28.117699] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-22T18:13:28.917723] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-22T18:13:29.188986] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T18:13:29.449108] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T18:13:29.717729] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-22T18:13:30.517702] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-22T18:13:30.916748] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-22T18:13:31.159583] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T18:13:31.225751] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T18:13:31.234376] [INFO ] [REMOTE ] CYH: Full fetch complete (69788 records). [2025-10-22T18:13:31.234575] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-22T18:13:31.322868] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-22T18:13:31.636296] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-22T18:13:31.636404] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-22T18:13:31.637237] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-22T18:13:31.637298] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-22T18:13:31.638523] [DEBUG] [LOCAL ] CYH: Trimmed 69788 records to 47658 (keeping 200 days of data) [2025-10-22T18:13:31.897860] [DEBUG] [LOCAL ] CYH: Primary data saved (47658 records). [2025-10-22T18:13:31.897996] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-22T18:13:31.898072] [INFO ] [MAIN ] Update Progress: 583/2367 symbols completed. CYH took 33.4s. Estimated remaining: 3h 44m 46s. Rate: 7.9 symbols/min [2025-10-22T18:13:32.062169] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:13:32.106639] [DEBUG] [LOCAL ] DAN: Loaded 49394 existing records from primary storage. [2025-10-22T18:13:32.106989] [INFO ] [MAIN ] DAN: Loaded 49394 existing records. [2025-10-22T18:13:32.122897] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-22T18:13:32.286286] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:13:32.286498] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-22T18:13:32.286544] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-22T18:13:32.286841] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-22T18:13:32.286896] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-22T18:13:32.635004] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:13:32.917715] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-22T18:13:33.239798] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T18:13:33.641822] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-22T18:13:33.717720] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-22T18:13:34.517705] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-22T18:13:34.951089] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-22T18:13:35.256416] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-22T18:13:35.317680] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-22T18:13:35.872621] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-22T18:13:36.117726] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-22T18:13:36.143290] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T18:13:36.917709] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-22T18:13:37.717726] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-22T18:13:38.025496] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-22T18:13:38.491489] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T18:13:38.517718] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-22T18:13:38.853975] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-22T18:13:39.317702] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-22T18:13:40.117698] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-22T18:13:40.174028] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-22T18:13:40.182960] [INFO ] [REMOTE ] D: Full fetch complete (77812 records). [2025-10-22T18:13:40.183091] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-22T18:13:40.594573] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-22T18:13:40.594733] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-22T18:13:40.595734] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-22T18:13:40.595839] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-22T18:13:40.623779] [DEBUG] [LOCAL ] D: Trimmed 77812 records to 53649 (keeping 200 days of data) [2025-10-22T18:13:40.625321] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-22T18:13:40.931504] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-22T18:13:40.957809] [DEBUG] [LOCAL ] D: Primary data saved (53649 records). [2025-10-22T18:13:40.957916] [INFO ] [MAIN ] D: Full history saved. [2025-10-22T18:13:40.957990] [INFO ] [MAIN ] Update Progress: 584/2367 symbols completed. D took 35.4s. Estimated remaining: 3h 44m 43s. Rate: 7.9 symbols/min [2025-10-22T18:13:41.128843] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:13:41.145610] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T18:13:41.149013] [INFO ] [REMOTE ] DAC: Full fetch complete (19136 records). [2025-10-22T18:13:41.149094] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-22T18:13:41.237933] [DEBUG] [LOCAL ] DAO: Loaded 19753 existing records from primary storage. [2025-10-22T18:13:41.264083] [INFO ] [MAIN ] DAO: Loaded 19753 existing records. [2025-10-22T18:13:41.642015] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:13:41.669935] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-22T18:13:41.682871] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-22T18:13:41.699188] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-22T18:13:41.710114] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-22T18:13:41.710234] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-22T18:13:41.710329] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-22T18:13:41.710805] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-22T18:13:41.731466] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-22T18:13:41.723688] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-22T18:13:41.793801] [DEBUG] [LOCAL ] DAC: Trimmed 19136 records to 12381 (keeping 200 days of data) [2025-10-22T18:13:42.081913] [DEBUG] [LOCAL ] DAC: Primary data saved (12381 records). [2025-10-22T18:13:42.096963] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-22T18:13:42.097152] [INFO ] [MAIN ] Update Progress: 585/2367 symbols completed. DAC took 22.1s. Estimated remaining: 3h 44m 16s. Rate: 7.9 symbols/min [2025-10-22T18:13:42.283036] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:13:42.351857] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:13:42.399399] [DEBUG] [LOCAL ] DAR: Loaded 52006 existing records from primary storage. [2025-10-22T18:13:42.399769] [INFO ] [MAIN ] DAR: Loaded 52006 existing records. [2025-10-22T18:13:42.521904] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-22T18:13:42.579201] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:13:42.580940] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-22T18:13:42.581000] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-22T18:13:42.591792] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-22T18:13:42.608941] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-22T18:13:42.648328] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T18:13:42.982912] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:13:43.317698] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-22T18:13:43.720261] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T18:13:43.896989] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-22T18:13:44.117703] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-22T18:13:44.923698] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-22T18:13:44.942316] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T18:13:45.717739] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-22T18:13:46.406689] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-22T18:13:46.466518] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T18:13:46.517672] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-22T18:13:47.317682] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-22T18:13:47.409802] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T18:13:48.117704] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-22T18:13:48.228981] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T18:13:48.663750] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T18:13:48.917696] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-22T18:13:49.717674] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-22T18:13:49.983705] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T18:13:50.517682] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-22T18:13:50.679947] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T18:13:51.093778] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T18:13:51.317738] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-22T18:13:52.117704] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-22T18:13:52.191927] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T18:13:52.917767] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-22T18:13:53.264615] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T18:13:53.506493] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-22T18:13:53.717710] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-22T18:13:54.517712] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-22T18:13:54.691355] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T18:13:54.852388] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T18:13:55.317698] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-22T18:13:56.117727] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-22T18:13:56.512627] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T18:13:56.711334] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T18:13:56.905566] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T18:13:56.917614] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-22T18:13:57.717697] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-22T18:13:58.491593] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T18:13:58.517612] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-22T18:13:59.317705] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-22T18:13:59.507464] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T18:14:00.117686] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-22T18:14:00.195087] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-22T18:14:00.203760] [INFO ] [REMOTE ] DAL: Full fetch complete (77931 records). [2025-10-22T18:14:00.203888] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-22T18:14:00.557802] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T18:14:00.592574] [INFO ] [REMOTE ] DAN: Full fetch complete (71386 records). [2025-10-22T18:14:00.616899] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-22T18:14:00.741009] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-22T18:14:00.747576] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-22T18:14:00.754081] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-22T18:14:00.764774] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-22T18:14:00.824189] [DEBUG] [LOCAL ] DAL: Trimmed 77931 records to 53753 (keeping 200 days of data) [2025-10-22T18:14:00.958908] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-22T18:14:01.312535] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-22T18:14:01.319985] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-22T18:14:01.321794] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-22T18:14:01.323687] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-22T18:14:01.360935] [DEBUG] [LOCAL ] DAN: Trimmed 71386 records to 49384 (keeping 200 days of data) [2025-10-22T18:14:01.556708] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-10-22T18:14:01.562131] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-22T18:14:01.562624] [INFO ] [MAIN ] Update Progress: 586/2367 symbols completed. DAL took 39.5s. Estimated remaining: 3h 44m 45s. Rate: 7.9 symbols/min [2025-10-22T18:14:01.875928] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:01.962548] [DEBUG] [LOCAL ] DAN: Primary data saved (49384 records). [2025-10-22T18:14:01.962731] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-22T18:14:01.962833] [INFO ] [MAIN ] Update Progress: 587/2367 symbols completed. DAN took 30.1s. Estimated remaining: 3h 44m 16s. Rate: 7.9 symbols/min [2025-10-22T18:14:02.109708] [DEBUG] [LOCAL ] DAVA: Loaded 41991 existing records from primary storage. [2025-10-22T18:14:02.115512] [INFO ] [MAIN ] DAVA: Loaded 41991 existing records. [2025-10-22T18:14:02.251554] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:02.350762] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:14:02.351097] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-22T18:14:02.351229] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-22T18:14:02.351455] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-22T18:14:02.351513] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-22T18:14:02.509471] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T18:14:02.606486] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-22T18:14:02.647495] [DEBUG] [LOCAL ] DAY: Loaded 49140 existing records from primary storage. [2025-10-22T18:14:02.695373] [INFO ] [MAIN ] DAY: Loaded 49140 existing records. [2025-10-22T18:14:02.799556] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-22T18:14:02.858819] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-22T18:14:02.986225] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:03.040206] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:14:03.040395] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-22T18:14:03.040443] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-22T18:14:03.040632] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-22T18:14:03.040723] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-22T18:14:03.322717] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-22T18:14:03.389440] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:04.117590] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-22T18:14:04.135618] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T18:14:04.917711] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-22T18:14:05.131301] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T18:14:05.538240] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-22T18:14:05.717710] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-22T18:14:06.044343] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T18:14:06.517693] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-22T18:14:06.723257] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-22T18:14:06.788712] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-22T18:14:07.317720] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-22T18:14:08.117729] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-22T18:14:08.281462] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T18:14:08.763236] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T18:14:08.917706] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-22T18:14:09.725381] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-22T18:14:09.742245] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T18:14:10.517685] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-22T18:14:11.233298] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T18:14:11.236943] [INFO ] [REMOTE ] DAO: Full fetch complete (32416 records). [2025-10-22T18:14:11.237021] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-22T18:14:11.317828] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-22T18:14:11.651791] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-10-22T18:14:11.650213] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-22T18:14:11.662157] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-22T18:14:11.662879] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-22T18:14:11.663134] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-22T18:14:11.665314] [DEBUG] [LOCAL ] DAO: Trimmed 32416 records to 19714 (keeping 200 days of data) [2025-10-22T18:14:11.779188] [DEBUG] [LOCAL ] DAO: Primary data saved (19714 records). [2025-10-22T18:14:11.779371] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-22T18:14:11.779478] [INFO ] [MAIN ] Update Progress: 588/2367 symbols completed. DAO took 30.8s. Estimated remaining: 3h 44m 15s. Rate: 7.9 symbols/min [2025-10-22T18:14:11.958321] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:11.972335] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T18:14:12.026142] [DEBUG] [LOCAL ] DB: Loaded 52474 existing records from primary storage. [2025-10-22T18:14:12.026455] [INFO ] [MAIN ] DB: Loaded 52474 existing records. [2025-10-22T18:14:12.123497] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-22T18:14:12.214695] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:14:12.214912] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-22T18:14:12.214961] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-22T18:14:12.215141] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-22T18:14:12.215180] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-22T18:14:12.588741] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:12.917685] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-22T18:14:13.039443] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T18:14:13.717676] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-22T18:14:13.908503] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T18:14:14.522861] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-22T18:14:14.543474] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T18:14:15.317719] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-22T18:14:15.430579] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T18:14:16.076386] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T18:14:16.117694] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-22T18:14:16.917721] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-22T18:14:17.224175] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-22T18:14:17.233245] [INFO ] [REMOTE ] DAR: Full fetch complete (75074 records). [2025-10-22T18:14:17.233397] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-22T18:14:17.625443] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-22T18:14:17.625555] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-22T18:14:17.626489] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-22T18:14:17.626549] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-22T18:14:17.628011] [DEBUG] [LOCAL ] DAR: Trimmed 75074 records to 51998 (keeping 200 days of data) [2025-10-22T18:14:17.733867] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-22T18:14:17.956772] [DEBUG] [LOCAL ] DAR: Primary data saved (51998 records). [2025-10-22T18:14:17.957463] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-22T18:14:17.958562] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T18:14:17.958709] [INFO ] [MAIN ] Update Progress: 589/2367 symbols completed. DAR took 35.9s. Estimated remaining: 3h 44m 3s. Rate: 7.9 symbols/min [2025-10-22T18:14:18.155804] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:18.155966] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-22T18:14:18.156004] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-22T18:14:18.156112] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-22T18:14:18.156154] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-22T18:14:18.156195] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-22T18:14:18.156228] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-22T18:14:18.519856] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-22T18:14:18.551932] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:18.580204] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T18:14:19.240496] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T18:14:19.317700] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-22T18:14:20.016060] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T18:14:20.117822] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-22T18:14:20.127412] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-22T18:14:20.917743] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-22T18:14:21.376626] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T18:14:21.717678] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-22T18:14:21.899099] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T18:14:22.517713] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-22T18:14:23.158549] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T18:14:23.317699] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-22T18:14:24.117711] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-22T18:14:24.291084] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T18:14:24.917734] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-22T18:14:25.209794] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T18:14:25.259621] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T18:14:25.717729] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-22T18:14:26.207178] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-22T18:14:26.517724] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-22T18:14:26.950784] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T18:14:27.317689] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-22T18:14:28.117702] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-22T18:14:28.659092] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-22T18:14:28.917729] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-22T18:14:29.123113] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T18:14:29.176610] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T18:14:29.717734] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-22T18:14:30.517751] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-22T18:14:30.750232] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T18:14:30.763911] [INFO ] [REMOTE ] DAY: Full fetch complete (71858 records). [2025-10-22T18:14:30.764154] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-22T18:14:31.298216] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-22T18:14:31.298449] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-22T18:14:31.299512] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-22T18:14:31.299684] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-22T18:14:31.301249] [DEBUG] [LOCAL ] DAY: Trimmed 71858 records to 49122 (keeping 200 days of data) [2025-10-22T18:14:31.349948] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-22T18:14:31.423252] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-22T18:14:31.618772] [DEBUG] [LOCAL ] DAY: Primary data saved (49122 records). [2025-10-22T18:14:31.618900] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-22T18:14:31.618985] [INFO ] [MAIN ] Update Progress: 590/2367 symbols completed. DAY took 29.7s. Estimated remaining: 3h 44m 14s. Rate: 7.9 symbols/min [2025-10-22T18:14:31.788785] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:31.828912] [DEBUG] [LOCAL ] DBI: Loaded 43510 existing records from primary storage. [2025-10-22T18:14:31.829212] [INFO ] [MAIN ] DBI: Loaded 43510 existing records. [2025-10-22T18:14:31.989082] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-22T18:14:32.036758] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:14:32.036909] [INFO ] [REMOTE ] DAVA: Full fetch complete (57331 records). [2025-10-22T18:14:32.037197] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-22T18:14:32.037325] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-22T18:14:32.037426] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-22T18:14:32.037880] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-22T18:14:32.037940] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-22T18:14:32.123608] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-22T18:14:32.766734] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:32.807015] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-22T18:14:32.807103] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-22T18:14:32.807939] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-22T18:14:32.808003] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-22T18:14:32.809238] [DEBUG] [LOCAL ] DAVA: Trimmed 57331 records to 41943 (keeping 200 days of data) [2025-10-22T18:14:32.920694] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-22T18:14:33.054797] [DEBUG] [LOCAL ] DAVA: Primary data saved (41943 records). [2025-10-22T18:14:33.054922] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-22T18:14:33.055000] [INFO ] [MAIN ] Update Progress: 591/2367 symbols completed. DAVA took 31.5s. Estimated remaining: 3h 43m 48s. Rate: 7.9 symbols/min [2025-10-22T18:14:33.226141] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:33.237001] [DEBUG] [LOCAL ] DBL: Loaded 9364 existing records from primary storage. [2025-10-22T18:14:33.237177] [INFO ] [MAIN ] DBL: Loaded 9364 existing records. [2025-10-22T18:14:33.417480] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:14:33.418260] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-22T18:14:33.418419] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-22T18:14:33.423959] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-22T18:14:33.432804] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-22T18:14:33.477812] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T18:14:33.620552] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-22T18:14:33.722751] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-22T18:14:33.838110] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:34.517685] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-22T18:14:34.753276] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T18:14:35.215272] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T18:14:35.317713] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-22T18:14:35.375248] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T18:14:36.117701] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-22T18:14:36.807728] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T18:14:36.917638] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-22T18:14:36.955684] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-22T18:14:37.717698] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-22T18:14:38.517821] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-22T18:14:38.591749] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T18:14:38.656166] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T18:14:39.225579] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-22T18:14:39.317705] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-22T18:14:40.117693] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-22T18:14:40.441601] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-22T18:14:40.917718] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-22T18:14:41.607838] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-22T18:14:41.717718] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-22T18:14:41.777320] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T18:14:42.485154] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-22T18:14:42.517678] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-22T18:14:43.317702] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-22T18:14:44.120301] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-22T18:14:44.123063] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T18:14:44.127883] [INFO ] [REMOTE ] DBD: Full fetch complete (31871 records). [2025-10-22T18:14:44.127959] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-22T18:14:44.128411] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:14:44.128491] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:14:44.128556] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:14:44.128628] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-22T18:14:44.128725] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-22T18:14:44.128767] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-22T18:14:44.128807] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-22T18:14:44.128860] [INFO ] [MAIN ] Update Progress: 592/2367 symbols completed. DBD took 26.2s. Estimated remaining: 3h 43m 51s. Rate: 7.9 symbols/min [2025-10-22T18:14:44.296516] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:44.339742] [DEBUG] [LOCAL ] DBRG: Loaded 49982 existing records from primary storage. [2025-10-22T18:14:44.340049] [INFO ] [MAIN ] DBRG: Loaded 49982 existing records. [2025-10-22T18:14:44.514994] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:14:44.515256] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-22T18:14:44.515326] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-22T18:14:44.515675] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-22T18:14:44.515734] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-22T18:14:44.805564] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-22T18:14:44.912512] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:44.917609] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-22T18:14:44.999098] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T18:14:45.717698] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-22T18:14:46.517710] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-22T18:14:46.708866] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T18:14:47.317672] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-22T18:14:47.358408] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T18:14:47.544975] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T18:14:48.117687] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-22T18:14:48.917725] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-22T18:14:48.944467] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T18:14:49.554412] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-22T18:14:49.717639] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-22T18:14:50.517677] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-22T18:14:50.774053] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T18:14:51.317690] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-22T18:14:51.364955] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T18:14:52.117677] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-22T18:14:52.218247] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T18:14:52.917707] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-22T18:14:53.249282] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T18:14:53.258092] [INFO ] [REMOTE ] DB: Full fetch complete (75639 records). [2025-10-22T18:14:53.258202] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-22T18:14:53.677418] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T18:14:53.682182] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-22T18:14:53.691299] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-22T18:14:53.692852] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-22T18:14:53.693211] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-22T18:14:53.695171] [DEBUG] [LOCAL ] DB: Trimmed 75639 records to 52466 (keeping 200 days of data) [2025-10-22T18:14:53.764118] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-22T18:14:53.906571] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T18:14:54.038413] [DEBUG] [LOCAL ] DB: Primary data saved (52466 records). [2025-10-22T18:14:54.038564] [INFO ] [MAIN ] DB: Full history saved. [2025-10-22T18:14:54.038671] [INFO ] [MAIN ] Update Progress: 593/2367 symbols completed. DB took 42.3s. Estimated remaining: 3h 43m 50s. Rate: 7.9 symbols/min [2025-10-22T18:14:54.202569] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:54.236802] [DEBUG] [LOCAL ] DCI: Loaded 36912 existing records from primary storage. [2025-10-22T18:14:54.237075] [INFO ] [MAIN ] DCI: Loaded 36912 existing records. [2025-10-22T18:14:54.417860] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:14:54.418107] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-22T18:14:54.418167] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-22T18:14:54.418389] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-22T18:14:54.418448] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-22T18:14:54.519802] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-22T18:14:54.775390] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:55.247956] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T18:14:55.317693] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-22T18:14:55.397416] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T18:14:56.117706] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-22T18:14:56.884545] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T18:14:56.917665] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-22T18:14:57.075129] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T18:14:57.712818] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-22T18:14:57.714568] [INFO ] [REMOTE ] DBL: Full fetch complete (12709 records). [2025-10-22T18:14:57.714636] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-22T18:14:57.725716] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-22T18:14:58.075576] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-22T18:14:58.075679] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-22T18:14:58.075976] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-22T18:14:58.076016] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-22T18:14:58.076473] [DEBUG] [LOCAL ] DBL: Trimmed 12709 records to 9247 (keeping 200 days of data) [2025-10-22T18:14:58.133445] [DEBUG] [LOCAL ] DBL: Primary data saved (9247 records). [2025-10-22T18:14:58.133576] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-22T18:14:58.133674] [INFO ] [MAIN ] Update Progress: 594/2367 symbols completed. DBL took 25.1s. Estimated remaining: 3h 43m 32s. Rate: 7.9 symbols/min [2025-10-22T18:14:58.298738] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:14:58.312380] [DEBUG] [LOCAL ] DCO: Loaded 14899 existing records from primary storage. [2025-10-22T18:14:58.312590] [INFO ] [MAIN ] DCO: Loaded 14899 existing records. [2025-10-22T18:14:58.488722] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:14:58.488951] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-22T18:14:58.488998] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-22T18:14:58.489158] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-22T18:14:58.489219] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-22T18:14:58.522936] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-22T18:14:58.836451] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:14:59.317685] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-22T18:14:59.355460] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T18:15:00.117706] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-22T18:15:00.167444] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T18:15:00.917722] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-22T18:15:01.107431] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T18:15:01.124855] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T18:15:01.717691] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-22T18:15:02.517710] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-22T18:15:03.173784] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-22T18:15:03.179856] [INFO ] [REMOTE ] DBI: Full fetch complete (64817 records). [2025-10-22T18:15:03.179952] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-22T18:15:03.322760] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-22T18:15:03.569443] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-22T18:15:03.569519] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-22T18:15:03.570323] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-22T18:15:03.570396] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-22T18:15:03.571615] [DEBUG] [LOCAL ] DBI: Trimmed 64817 records to 43370 (keeping 200 days of data) [2025-10-22T18:15:03.818802] [DEBUG] [LOCAL ] DBI: Primary data saved (43370 records). [2025-10-22T18:15:03.818929] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-22T18:15:03.819031] [INFO ] [MAIN ] Update Progress: 595/2367 symbols completed. DBI took 32.2s. Estimated remaining: 3h 43m 19s. Rate: 7.9 symbols/min [2025-10-22T18:15:03.986070] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:15:04.022734] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T18:15:04.042932] [DEBUG] [LOCAL ] DD: Loaded 52933 existing records from primary storage. [2025-10-22T18:15:04.043256] [INFO ] [MAIN ] DD: Loaded 52933 existing records. [2025-10-22T18:15:04.121944] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-22T18:15:04.224246] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:15:04.224494] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-22T18:15:04.224574] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-22T18:15:04.224869] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-22T18:15:04.224938] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-22T18:15:04.567903] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (2.85 seconds). [2025-10-22T18:15:04.630531] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:15:04.917702] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-22T18:15:05.350298] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-22T18:15:05.717696] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-22T18:15:05.943482] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T18:15:06.517710] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-22T18:15:07.317680] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-22T18:15:07.517409] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-22T18:15:07.982786] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-22T18:15:08.015292] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-22T18:15:08.117695] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-22T18:15:08.894293] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-22T18:15:08.917669] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-22T18:15:08.926816] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-22T18:15:09.717696] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-22T18:15:10.427190] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T18:15:10.517714] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-22T18:15:11.317677] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-22T18:15:11.510697] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T18:15:11.599504] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T18:15:12.117778] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-22T18:15:12.917716] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-22T18:15:13.025172] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T18:15:13.317834] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T18:15:13.717705] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-22T18:15:14.517739] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-22T18:15:14.666948] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T18:15:15.030702] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T18:15:15.317777] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-22T18:15:15.594539] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T18:15:16.117786] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-22T18:15:16.917697] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-22T18:15:17.466474] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-22T18:15:17.475243] [INFO ] [REMOTE ] DBRG: Full fetch complete (72550 records). [2025-10-22T18:15:17.475396] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-22T18:15:17.741978] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-22T18:15:17.805370] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T18:15:17.911244] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-22T18:15:17.911337] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-22T18:15:17.912204] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-22T18:15:17.912275] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-22T18:15:17.913756] [DEBUG] [LOCAL ] DBRG: Trimmed 72550 records to 49979 (keeping 200 days of data) [2025-10-22T18:15:18.212569] [DEBUG] [LOCAL ] DBRG: Primary data saved (49979 records). [2025-10-22T18:15:18.212956] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-22T18:15:18.213041] [INFO ] [MAIN ] Update Progress: 596/2367 symbols completed. DBRG took 34.1s. Estimated remaining: 3h 43m 32s. Rate: 7.9 symbols/min [2025-10-22T18:15:18.408922] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:15:18.457223] [DEBUG] [LOCAL ] DDD: Loaded 50947 existing records from primary storage. [2025-10-22T18:15:18.457518] [INFO ] [MAIN ] DDD: Loaded 50947 existing records. [2025-10-22T18:15:18.526764] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-22T18:15:18.635961] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:15:18.636236] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-22T18:15:18.636283] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-22T18:15:18.636836] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-22T18:15:18.636893] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-22T18:15:19.018437] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:15:19.029902] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-22T18:15:19.062357] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-22T18:15:19.317731] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-22T18:15:20.122748] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-22T18:15:20.136727] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T18:15:20.917722] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-22T18:15:21.061315] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T18:15:21.717745] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-22T18:15:21.822883] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T18:15:22.517748] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-22T18:15:22.565918] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T18:15:23.317683] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-22T18:15:23.481689] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T18:15:24.101737] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-22T18:15:24.117603] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-22T18:15:24.234159] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T18:15:24.917718] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-22T18:15:25.717742] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-22T18:15:25.977075] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T18:15:26.478905] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T18:15:26.484984] [INFO ] [REMOTE ] DCI: Full fetch complete (53641 records). [2025-10-22T18:15:26.485133] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-22T18:15:26.522768] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-22T18:15:26.883327] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-22T18:15:26.883407] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-22T18:15:26.884089] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-22T18:15:26.884152] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-22T18:15:26.885221] [DEBUG] [LOCAL ] DCI: Trimmed 53641 records to 36843 (keeping 200 days of data) [2025-10-22T18:15:27.104872] [DEBUG] [LOCAL ] DCI: Primary data saved (36843 records). [2025-10-22T18:15:27.105056] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-22T18:15:27.105169] [INFO ] [MAIN ] Update Progress: 597/2367 symbols completed. DCI took 33.1s. Estimated remaining: 3h 43m 28s. Rate: 7.9 symbols/min [2025-10-22T18:15:27.317695] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-22T18:15:27.506126] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T18:15:27.531499] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T18:15:28.117696] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-22T18:15:28.917672] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-22T18:15:29.343138] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T18:15:29.346687] [INFO ] [REMOTE ] DCO: Full fetch complete (19712 records). [2025-10-22T18:15:29.346797] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-22T18:15:29.568251] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-22T18:15:29.731082] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-22T18:15:29.781335] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-22T18:15:29.781421] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-22T18:15:29.781873] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-22T18:15:29.781940] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-22T18:15:29.782526] [DEBUG] [LOCAL ] DCO: Trimmed 19712 records to 14967 (keeping 200 days of data) [2025-10-22T18:15:29.870609] [DEBUG] [LOCAL ] DCO: Primary data saved (14967 records). [2025-10-22T18:15:29.870788] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-22T18:15:29.870870] [INFO ] [MAIN ] Update Progress: 598/2367 symbols completed. DCO took 31.7s. Estimated remaining: 3h 43m 7s. Rate: 7.9 symbols/min [2025-10-22T18:15:30.547817] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:15:30.559194] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-22T18:15:31.498587] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T18:15:31.509382] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-22T18:15:32.316026] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T18:15:32.327071] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-22T18:15:32.942149] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T18:15:32.953113] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-22T18:15:33.312009] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T18:15:33.320433] [INFO ] [REMOTE ] DD: Full fetch complete (76236 records). [2025-10-22T18:15:33.320568] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-22T18:15:33.321425] [FATAL] [VALIDATOR ] DD: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:15:33.321523] [FATAL] [MAIN ] DD: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:15:33.321565] [WARN ] [MAIN ] DD: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:15:33.321628] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-22T18:15:33.321731] [DEBUG] [LOCAL ] DD: No primary data file found to delete. [2025-10-22T18:15:33.321775] [INFO ] [LOCAL ] DD: Starting deletion of derivative data. [2025-10-22T18:15:33.321939] [DEBUG] [LOCAL ] DD: Deleted derivative data file. [2025-10-22T18:15:33.322036] [INFO ] [MAIN ] Update Progress: 599/2367 symbols completed. DD took 29.5s. Estimated remaining: 3h 42m 47s. Rate: 7.9 symbols/min [2025-10-22T18:15:34.630592] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T18:15:34.641500] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-22T18:15:36.549520] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T18:15:36.560526] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-22T18:15:38.483034] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-22T18:15:38.494095] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-22T18:15:40.795430] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-22T18:15:40.804098] [INFO ] [REMOTE ] DDD: Full fetch complete (73969 records). [2025-10-22T18:15:40.804233] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-22T18:15:41.219256] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-22T18:15:41.219386] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-22T18:15:41.220323] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-22T18:15:41.220577] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-22T18:15:41.222149] [DEBUG] [LOCAL ] DDD: Trimmed 73969 records to 50948 (keeping 200 days of data) [2025-10-22T18:15:41.509616] [DEBUG] [LOCAL ] DDD: Primary data saved (50948 records). [2025-10-22T18:15:41.509787] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-22T18:15:41.509869] [INFO ] [MAIN ] Update Progress: 600/2367 symbols completed. DDD took 23.3s. Estimated remaining: 3h 42m 41s. Rate: 7.9 symbols/min [2025-10-22T18:15:42.180863] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:15:42.233903] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:15:42.235145] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:15:42.233081] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:15:42.235473] [DEBUG] [LOCAL ] DDT: No existing data file found in primary storage. [2025-10-22T18:15:42.235956] [WARN ] [MAIN ] DDT: No existing data found, performing full refresh instead. [2025-10-22T18:15:42.236073] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-22T18:15:42.236116] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-22T18:15:42.236252] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-22T18:15:42.236313] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-22T18:15:42.364762] [DEBUG] [LOCAL ] DDS: Loaded 12448 existing records from primary storage. [2025-10-22T18:15:42.365306] [INFO ] [MAIN ] DDS: Loaded 12448 existing records. [2025-10-22T18:15:42.623884] [DEBUG] [LOCAL ] DDL: Loaded 37279 existing records from primary storage. [2025-10-22T18:15:42.660126] [INFO ] [MAIN ] DDL: Loaded 37279 existing records. [2025-10-22T18:15:42.660009] [DEBUG] [LOCAL ] DE: Loaded 47547 existing records from primary storage. [2025-10-22T18:15:42.708368] [INFO ] [MAIN ] DE: Loaded 47547 existing records. [2025-10-22T18:15:42.915737] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:15:42.942811] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-22T18:15:42.990193] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-22T18:15:43.102604] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-22T18:15:43.132845] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-22T18:15:43.205195] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:15:43.254333] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:15:43.200027] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:15:43.254626] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-22T18:15:43.263465] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-22T18:15:43.268728] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-22T18:15:43.279373] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-22T18:15:43.274164] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-22T18:15:43.303667] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-22T18:15:43.303767] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-22T18:15:43.353843] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-22T18:15:43.367813] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-22T18:15:44.041284] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T18:15:44.110692] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-22T18:15:44.287599] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:15:44.336600] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:15:44.331157] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-22T18:15:44.348953] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-22T18:15:44.412665] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:15:44.413564] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-22T18:15:44.547681] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T18:15:44.548730] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-22T18:15:45.015414] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-22T18:15:45.016636] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-22T18:15:45.377416] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T18:15:45.380492] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-22T18:15:45.526958] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-22T18:15:45.528846] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-22T18:15:45.548035] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-22T18:15:45.555217] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-22T18:15:45.996284] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-22T18:15:45.997325] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-22T18:15:46.163417] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T18:15:46.173198] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-22T18:15:46.265915] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-22T18:15:46.269100] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-22T18:15:46.430611] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-22T18:15:46.517724] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-22T18:15:46.896200] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T18:15:46.997807] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-22T18:15:47.174186] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-22T18:15:47.317693] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-22T18:15:47.695360] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T18:15:47.780401] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-22T18:15:48.117721] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-22T18:15:48.580875] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-22T18:15:48.917735] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-22T18:15:49.370902] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-22T18:15:49.371768] [INFO ] [REMOTE ] DDT: Full fetch complete (2815 records). [2025-10-22T18:15:49.371837] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-22T18:15:49.372178] [FATAL] [VALIDATOR ] DDT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:15:49.372277] [FATAL] [MAIN ] DDT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:15:49.372350] [WARN ] [MAIN ] DDT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:15:49.372477] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-22T18:15:49.372554] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-22T18:15:49.372598] [INFO ] [LOCAL ] DDT: Starting deletion of derivative data. [2025-10-22T18:15:49.372686] [DEBUG] [LOCAL ] DDT: No derivative data file found to delete. [2025-10-22T18:15:49.372782] [INFO ] [MAIN ] Update Progress: 601/2367 symbols completed. DDT took 7.9s. Estimated remaining: 3h 42m 34s. Rate: 7.9 symbols/min [2025-10-22T18:15:49.541457] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:15:49.541620] [DEBUG] [LOCAL ] DEA: No existing data file found in primary storage. [2025-10-22T18:15:49.541690] [WARN ] [MAIN ] DEA: No existing data found, performing full refresh instead. [2025-10-22T18:15:49.541805] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-22T18:15:49.541846] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-22T18:15:49.541889] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-22T18:15:49.541921] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-22T18:15:49.726084] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-22T18:15:49.895253] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:15:50.517681] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-22T18:15:51.317726] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-22T18:15:51.725476] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T18:15:51.792032] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-22T18:15:52.117729] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-22T18:15:52.369126] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T18:15:52.917739] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-22T18:15:53.566381] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T18:15:53.717700] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-22T18:15:53.980857] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T18:15:54.517715] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-22T18:15:55.317694] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-22T18:15:55.522559] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T18:15:56.117704] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-22T18:15:56.155034] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T18:15:56.872902] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T18:15:56.917706] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-22T18:15:57.058323] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T18:15:57.717701] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-22T18:15:58.473929] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-22T18:15:58.517615] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-22T18:15:58.558473] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T18:15:59.317708] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-22T18:15:59.539956] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T18:16:00.117741] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-22T18:16:00.917745] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-22T18:16:01.717803] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-22T18:16:02.300887] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-10-22T18:16:02.517744] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-22T18:16:02.547572] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-22T18:16:03.317715] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-22T18:16:03.980835] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-22T18:16:04.117683] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-22T18:16:04.357758] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (3.44 seconds). [2025-10-22T18:16:04.736426] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T18:16:04.917741] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-22T18:16:05.388031] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-10-22T18:16:05.717723] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-22T18:16:06.015749] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T18:16:06.017600] [INFO ] [REMOTE ] DDS: Full fetch complete (18488 records). [2025-10-22T18:16:06.017743] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-22T18:16:06.398319] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-22T18:16:06.398415] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-22T18:16:06.398837] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-22T18:16:06.398897] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-22T18:16:06.399401] [DEBUG] [LOCAL ] DDS: Trimmed 18488 records to 12375 (keeping 200 days of data) [2025-10-22T18:16:06.476870] [DEBUG] [LOCAL ] DDS: Primary data saved (12375 records). [2025-10-22T18:16:06.477000] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-22T18:16:06.477080] [INFO ] [MAIN ] Update Progress: 602/2367 symbols completed. DDS took 24.9s. Estimated remaining: 3h 42m 55s. Rate: 7.9 symbols/min [2025-10-22T18:16:06.534998] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-22T18:16:06.659044] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:16:06.659208] [DEBUG] [LOCAL ] DEC: No existing data file found in primary storage. [2025-10-22T18:16:06.659246] [WARN ] [MAIN ] DEC: No existing data found, performing full refresh instead. [2025-10-22T18:16:06.659380] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-22T18:16:06.659438] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-22T18:16:06.659484] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-22T18:16:06.659517] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-22T18:16:07.030850] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:16:07.058569] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-22T18:16:07.129292] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T18:16:07.317725] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-22T18:16:07.770962] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T18:16:08.117616] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-22T18:16:08.185795] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T18:16:08.917732] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-22T18:16:09.717715] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-22T18:16:10.127301] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T18:16:10.518507] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-22T18:16:10.521132] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T18:16:10.939697] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-22T18:16:11.317681] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-22T18:16:12.072661] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T18:16:12.117714] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-22T18:16:12.917710] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-22T18:16:13.060626] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T18:16:13.069948] [INFO ] [REMOTE ] DDL: Full fetch complete (53636 records). [2025-10-22T18:16:13.070110] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-22T18:16:13.474791] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T18:16:13.473918] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-22T18:16:13.480526] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-22T18:16:13.481554] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-22T18:16:13.481923] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-22T18:16:13.482927] [DEBUG] [LOCAL ] DDL: Trimmed 53636 records to 37179 (keeping 200 days of data) [2025-10-22T18:16:13.685843] [DEBUG] [LOCAL ] DDL: Primary data saved (37179 records). [2025-10-22T18:16:13.685972] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-22T18:16:13.686050] [INFO ] [MAIN ] Update Progress: 603/2367 symbols completed. DDL took 32.2s. Estimated remaining: 3h 42m 46s. Rate: 7.9 symbols/min [2025-10-22T18:16:13.722854] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-22T18:16:13.855297] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:16:13.855435] [DEBUG] [LOCAL ] DECK: No existing data file found in primary storage. [2025-10-22T18:16:13.855472] [WARN ] [MAIN ] DECK: No existing data found, performing full refresh instead. [2025-10-22T18:16:13.855577] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-22T18:16:13.855617] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-22T18:16:13.855701] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-22T18:16:13.855760] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-22T18:16:14.204785] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:16:14.226388] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T18:16:14.517729] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-22T18:16:15.309539] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T18:16:15.323177] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-22T18:16:15.835670] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T18:16:16.117806] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-22T18:16:16.917702] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-22T18:16:17.362772] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T18:16:17.717672] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-22T18:16:18.023462] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T18:16:18.075788] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-22T18:16:18.517748] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-22T18:16:19.317726] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-22T18:16:19.758165] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T18:16:19.766113] [INFO ] [REMOTE ] DE: Full fetch complete (69923 records). [2025-10-22T18:16:19.766264] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-22T18:16:20.118933] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-22T18:16:20.113256] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T18:16:20.249691] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-22T18:16:20.249972] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-22T18:16:20.250894] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-22T18:16:20.250992] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-22T18:16:20.252881] [DEBUG] [LOCAL ] DE: Trimmed 69923 records to 47533 (keeping 200 days of data) [2025-10-22T18:16:20.366767] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T18:16:20.576141] [DEBUG] [LOCAL ] DE: Primary data saved (47533 records). [2025-10-22T18:16:20.576288] [INFO ] [MAIN ] DE: Full history saved. [2025-10-22T18:16:20.576370] [INFO ] [MAIN ] Update Progress: 604/2367 symbols completed. DE took 39.1s. Estimated remaining: 3h 42m 37s. Rate: 7.9 symbols/min [2025-10-22T18:16:20.749571] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:16:20.792494] [DEBUG] [LOCAL ] DEI: Loaded 48305 existing records from primary storage. [2025-10-22T18:16:20.792865] [INFO ] [MAIN ] DEI: Loaded 48305 existing records. [2025-10-22T18:16:20.929328] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-22T18:16:20.971273] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:16:20.971534] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-22T18:16:20.971585] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-22T18:16:20.971811] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-22T18:16:20.971868] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-22T18:16:21.320062] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:16:21.717639] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-22T18:16:22.209750] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-22T18:16:22.389131] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T18:16:22.517693] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-22T18:16:23.236821] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T18:16:23.317672] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-22T18:16:23.850745] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T18:16:24.117704] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-22T18:16:24.862465] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T18:16:24.923067] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-22T18:16:24.933738] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-22T18:16:25.717727] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-22T18:16:26.517709] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-22T18:16:26.702688] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T18:16:26.708951] [INFO ] [REMOTE ] DEA: Full fetch complete (61373 records). [2025-10-22T18:16:26.709063] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-22T18:16:26.709797] [FATAL] [VALIDATOR ] DEA: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:16:26.709883] [FATAL] [MAIN ] DEA: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:16:26.709926] [WARN ] [MAIN ] DEA: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:16:26.709963] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-22T18:16:26.710020] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-22T18:16:26.710055] [INFO ] [LOCAL ] DEA: Starting deletion of derivative data. [2025-10-22T18:16:26.710093] [DEBUG] [LOCAL ] DEA: No derivative data file found to delete. [2025-10-22T18:16:26.710146] [INFO ] [MAIN ] Update Progress: 605/2367 symbols completed. DEA took 37.3s. Estimated remaining: 3h 42m 25s. Rate: 7.9 symbols/min [2025-10-22T18:16:26.877530] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:16:26.877729] [DEBUG] [LOCAL ] DELL: No existing data file found in primary storage. [2025-10-22T18:16:26.877777] [WARN ] [MAIN ] DELL: No existing data found, performing full refresh instead. [2025-10-22T18:16:26.877884] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-22T18:16:26.877925] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-22T18:16:26.877965] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-10-22T18:16:26.877997] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-22T18:16:27.220333] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T18:16:27.254722] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:16:27.317611] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-22T18:16:28.117723] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-22T18:16:28.146240] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:16:28.917734] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-22T18:16:29.717697] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-22T18:16:29.860355] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-22T18:16:29.962435] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T18:16:30.517735] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-22T18:16:30.624750] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T18:16:31.055077] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T18:16:31.061815] [INFO ] [REMOTE ] DEC: Full fetch complete (44363 records). [2025-10-22T18:16:31.061986] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-22T18:16:31.062608] [FATAL] [VALIDATOR ] DEC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:16:31.062726] [FATAL] [MAIN ] DEC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:16:31.062770] [WARN ] [MAIN ] DEC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:16:31.062834] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-22T18:16:31.062897] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-22T18:16:31.062932] [INFO ] [LOCAL ] DEC: Starting deletion of derivative data. [2025-10-22T18:16:31.062972] [DEBUG] [LOCAL ] DEC: No derivative data file found to delete. [2025-10-22T18:16:31.063028] [INFO ] [MAIN ] Update Progress: 606/2367 symbols completed. DEC took 24.6s. Estimated remaining: 3h 42m 8s. Rate: 7.9 symbols/min [2025-10-22T18:16:31.229523] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:16:31.229762] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-10-22T18:16:31.229814] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-10-22T18:16:31.229925] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-22T18:16:31.229967] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-22T18:16:31.230009] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-22T18:16:31.230042] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-22T18:16:31.322853] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-22T18:16:31.593899] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:16:32.117697] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-22T18:16:32.586219] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-22T18:16:32.917689] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-22T18:16:33.608265] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-22T18:16:33.717693] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-22T18:16:34.003090] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T18:16:34.517693] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-22T18:16:34.618546] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T18:16:35.317690] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-22T18:16:36.101478] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-22T18:16:36.117613] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-22T18:16:36.151242] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T18:16:36.919115] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-22T18:16:36.924777] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T18:16:37.717688] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-22T18:16:38.506095] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-22T18:16:38.517599] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-22T18:16:38.586778] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T18:16:39.317697] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-22T18:16:39.397726] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T18:16:40.117712] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-22T18:16:40.917707] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-22T18:16:41.157865] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-22T18:16:41.482523] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-22T18:16:41.717724] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-22T18:16:42.003304] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T18:16:42.517733] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-22T18:16:42.577235] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T18:16:43.317736] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-22T18:16:44.008485] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-22T18:16:44.117735] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-22T18:16:44.384256] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T18:16:44.917682] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-22T18:16:44.954528] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T18:16:45.717673] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-22T18:16:46.029129] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T18:16:46.517739] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-22T18:16:47.189543] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T18:16:47.269000] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-22T18:16:47.317718] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-22T18:16:48.117711] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-22T18:16:48.229233] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T18:16:48.917708] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-22T18:16:49.062178] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T18:16:49.070041] [INFO ] [REMOTE ] DEI: Full fetch complete (69976 records). [2025-10-22T18:16:49.070154] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-22T18:16:49.447264] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-22T18:16:49.447340] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-22T18:16:49.448150] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-22T18:16:49.448214] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-22T18:16:49.449508] [DEBUG] [LOCAL ] DEI: Trimmed 69976 records to 48295 (keeping 200 days of data) [2025-10-22T18:16:49.719724] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-22T18:16:49.735523] [DEBUG] [LOCAL ] DEI: Primary data saved (48295 records). [2025-10-22T18:16:49.735619] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-22T18:16:49.735728] [INFO ] [MAIN ] Update Progress: 607/2367 symbols completed. DEI took 29.2s. Estimated remaining: 3h 42m 33s. Rate: 7.9 symbols/min [2025-10-22T18:16:49.899762] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:16:49.929120] [DEBUG] [LOCAL ] DFH: Loaded 31847 existing records from primary storage. [2025-10-22T18:16:49.929374] [INFO ] [MAIN ] DFH: Loaded 31847 existing records. [2025-10-22T18:16:50.103385] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:16:50.103606] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-22T18:16:50.103699] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-22T18:16:50.103948] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-22T18:16:50.103998] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-22T18:16:50.463797] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:16:50.492986] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-22T18:16:50.517601] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-22T18:16:50.615907] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T18:16:51.317697] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-22T18:16:51.833168] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-22T18:16:51.885717] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T18:16:52.117705] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-22T18:16:52.917724] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-22T18:16:53.478477] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T18:16:53.725559] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-22T18:16:53.750545] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-22T18:16:54.517714] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-22T18:16:54.888612] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-22T18:16:55.317699] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-22T18:16:55.934772] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T18:16:56.128236] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-22T18:16:56.131026] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-22T18:16:56.140220] [INFO ] [REMOTE ] DECK: Full fetch complete (77177 records). [2025-10-22T18:16:56.140331] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-22T18:16:56.554632] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-22T18:16:56.554743] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-22T18:16:56.555585] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-22T18:16:56.555627] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-22T18:16:56.557078] [DEBUG] [LOCAL ] DECK: Trimmed 77177 records to 53301 (keeping 200 days of data) [2025-10-22T18:16:56.870782] [DEBUG] [LOCAL ] DECK: Primary data saved (53301 records). [2025-10-22T18:16:56.870920] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-22T18:16:56.870994] [INFO ] [MAIN ] Update Progress: 608/2367 symbols completed. DECK took 43.2s. Estimated remaining: 3h 42m 24s. Rate: 7.9 symbols/min [2025-10-22T18:16:56.944357] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-22T18:16:57.059063] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:16:57.081022] [DEBUG] [LOCAL ] DFIN: Loaded 22406 existing records from primary storage. [2025-10-22T18:16:57.081284] [INFO ] [MAIN ] DFIN: Loaded 22406 existing records. [2025-10-22T18:16:57.264508] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:16:57.264832] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-22T18:16:57.264923] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-22T18:16:57.265180] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-22T18:16:57.281492] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-22T18:16:57.357722] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-22T18:16:57.656522] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:16:57.717679] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-22T18:16:57.750101] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T18:16:58.517738] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-22T18:16:58.862454] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T18:16:59.317718] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-22T18:16:59.471767] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.53 seconds). [2025-10-22T18:16:59.480876] [INFO ] [REMOTE ] DELL: Full fetch complete (77915 records). [2025-10-22T18:16:59.481060] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-22T18:16:59.868808] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-22T18:16:59.868917] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-22T18:16:59.869794] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-22T18:16:59.869858] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-22T18:16:59.871338] [DEBUG] [LOCAL ] DELL: Trimmed 77915 records to 53736 (keeping 200 days of data) [2025-10-22T18:17:00.121777] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-22T18:17:00.191150] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-22T18:17:00.242571] [DEBUG] [LOCAL ] DELL: Primary data saved (53736 records). [2025-10-22T18:17:00.242748] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-22T18:17:00.242831] [INFO ] [MAIN ] Update Progress: 609/2367 symbols completed. DELL took 33.5s. Estimated remaining: 3h 42m 4s. Rate: 7.9 symbols/min [2025-10-22T18:17:00.410970] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:17:00.443998] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T18:17:00.459365] [DEBUG] [LOCAL ] DFP: Loaded 11074 existing records from primary storage. [2025-10-22T18:17:00.459583] [INFO ] [MAIN ] DFP: Loaded 11074 existing records. [2025-10-22T18:17:00.634257] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:17:00.634525] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-22T18:17:00.634586] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-22T18:17:00.634770] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-22T18:17:00.634827] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-22T18:17:00.922864] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-22T18:17:00.994523] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:17:01.616058] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T18:17:01.717663] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-22T18:17:02.517724] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-22T18:17:03.130004] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T18:17:03.166831] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-22T18:17:03.175798] [INFO ] [REMOTE ] DEO: Full fetch complete (71721 records). [2025-10-22T18:17:03.175944] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-22T18:17:03.320622] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-22T18:17:03.575693] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-22T18:17:03.575796] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-22T18:17:03.576601] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-22T18:17:03.576666] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-22T18:17:03.578091] [DEBUG] [LOCAL ] DEO: Trimmed 71721 records to 49185 (keeping 200 days of data) [2025-10-22T18:17:03.832695] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T18:17:03.916960] [DEBUG] [LOCAL ] DEO: Primary data saved (49185 records). [2025-10-22T18:17:03.917103] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-22T18:17:03.917174] [INFO ] [MAIN ] Update Progress: 610/2367 symbols completed. DEO took 32.9s. Estimated remaining: 3h 41m 45s. Rate: 7.9 symbols/min [2025-10-22T18:17:04.084995] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:17:04.117689] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-22T18:17:04.136527] [DEBUG] [LOCAL ] DG: Loaded 53258 existing records from primary storage. [2025-10-22T18:17:04.136933] [INFO ] [MAIN ] DG: Loaded 53258 existing records. [2025-10-22T18:17:04.313561] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:17:04.314097] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-22T18:17:04.314168] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-22T18:17:04.314515] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-22T18:17:04.314574] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-22T18:17:04.670882] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:17:04.919856] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-22T18:17:04.921826] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T18:17:05.512038] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T18:17:05.717707] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-22T18:17:06.517675] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-22T18:17:06.629208] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T18:17:07.299562] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T18:17:07.321311] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-22T18:17:07.320245] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-22T18:17:08.117735] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-22T18:17:08.401018] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T18:17:08.917698] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-22T18:17:09.717711] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-22T18:17:10.517749] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-22T18:17:11.214177] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (3.10 seconds). [2025-10-22T18:17:11.317609] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-22T18:17:11.371140] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-22T18:17:11.448023] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T18:17:12.117669] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-22T18:17:12.225178] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (3.31 seconds). [2025-10-22T18:17:12.550004] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T18:17:12.917700] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-22T18:17:13.717730] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-22T18:17:14.514199] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-22T18:17:14.518250] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-22T18:17:14.685882] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-22T18:17:15.317723] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-22T18:17:16.117741] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-22T18:17:16.191152] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T18:17:16.196212] [INFO ] [REMOTE ] DFH: Full fetch complete (47313 records). [2025-10-22T18:17:16.196338] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-22T18:17:16.196956] [FATAL] [VALIDATOR ] DFH: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:17:16.197062] [FATAL] [MAIN ] DFH: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:17:16.197144] [WARN ] [MAIN ] DFH: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:17:16.197227] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-22T18:17:16.197307] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-10-22T18:17:16.197358] [INFO ] [LOCAL ] DFH: Starting deletion of derivative data. [2025-10-22T18:17:16.197571] [DEBUG] [LOCAL ] DFH: Deleted derivative data file. [2025-10-22T18:17:16.197727] [INFO ] [MAIN ] Update Progress: 611/2367 symbols completed. DFH took 26.5s. Estimated remaining: 3h 41m 51s. Rate: 7.9 symbols/min [2025-10-22T18:17:16.310744] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T18:17:16.415590] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (4.30 seconds). [2025-10-22T18:17:16.418344] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:17:16.418589] [DEBUG] [LOCAL ] DGX: No existing data file found in primary storage. [2025-10-22T18:17:16.418733] [WARN ] [MAIN ] DGX: No existing data found, performing full refresh instead. [2025-10-22T18:17:16.429729] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-22T18:17:16.430089] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-22T18:17:16.430161] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-22T18:17:16.430198] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-22T18:17:16.778381] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:17:16.917664] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-22T18:17:16.979519] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T18:17:17.717708] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-22T18:17:18.517683] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-22T18:17:18.682512] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T18:17:19.296612] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T18:17:19.317613] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-22T18:17:19.552738] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T18:17:20.117678] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-22T18:17:20.167884] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-22T18:17:20.917698] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-22T18:17:21.318771] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T18:17:21.717697] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-22T18:17:22.056041] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T18:17:22.517722] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-22T18:17:23.317752] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-22T18:17:23.408826] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T18:17:23.625620] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-22T18:17:24.117704] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-22T18:17:24.297770] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T18:17:24.301256] [INFO ] [REMOTE ] DFIN: Full fetch complete (33182 records). [2025-10-22T18:17:24.301339] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-22T18:17:24.301901] [FATAL] [VALIDATOR ] DFIN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:17:24.302008] [FATAL] [MAIN ] DFIN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:17:24.302074] [WARN ] [MAIN ] DFIN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:17:24.302145] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-22T18:17:24.302210] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-10-22T18:17:24.302247] [INFO ] [LOCAL ] DFIN: Starting deletion of derivative data. [2025-10-22T18:17:24.302410] [DEBUG] [LOCAL ] DFIN: Deleted derivative data file. [2025-10-22T18:17:24.302498] [INFO ] [MAIN ] Update Progress: 612/2367 symbols completed. DFIN took 27.4s. Estimated remaining: 3h 41m 45s. Rate: 7.9 symbols/min [2025-10-22T18:17:24.488747] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:17:24.488907] [DEBUG] [LOCAL ] DHF: No existing data file found in primary storage. [2025-10-22T18:17:24.488951] [WARN ] [MAIN ] DHF: No existing data found, performing full refresh instead. [2025-10-22T18:17:24.489062] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-22T18:17:24.489139] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-22T18:17:24.489192] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-22T18:17:24.489226] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-22T18:17:24.872701] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:17:24.917619] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-22T18:17:25.718144] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-22T18:17:25.873486] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-22T18:17:26.517674] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-22T18:17:26.571977] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-22T18:17:27.194803] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (3.08 seconds). [2025-10-22T18:17:27.317707] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-22T18:17:28.117710] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-22T18:17:28.300737] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T18:17:28.360981] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T18:17:28.917712] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-22T18:17:29.717692] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-22T18:17:30.211529] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-22T18:17:30.517693] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-22T18:17:30.724111] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T18:17:30.976728] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T18:17:31.286414] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-22T18:17:31.288100] [INFO ] [REMOTE ] DFP: Full fetch complete (15693 records). [2025-10-22T18:17:31.288170] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-22T18:17:31.288552] [FATAL] [VALIDATOR ] DFP: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:17:31.288637] [FATAL] [MAIN ] DFP: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:17:31.288719] [WARN ] [MAIN ] DFP: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:17:31.288791] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-22T18:17:31.288897] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-10-22T18:17:31.288950] [INFO ] [LOCAL ] DFP: Starting deletion of derivative data. [2025-10-22T18:17:31.289306] [DEBUG] [LOCAL ] DFP: Deleted derivative data file. [2025-10-22T18:17:31.289466] [INFO ] [MAIN ] Update Progress: 613/2367 symbols completed. DFP took 31.0s. Estimated remaining: 3h 41m 36s. Rate: 7.9 symbols/min [2025-10-22T18:17:31.321757] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-22T18:17:31.461402] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:17:31.512631] [DEBUG] [LOCAL ] DHI: Loaded 53364 existing records from primary storage. [2025-10-22T18:17:31.513075] [INFO ] [MAIN ] DHI: Loaded 53364 existing records. [2025-10-22T18:17:31.691464] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:17:31.691718] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-22T18:17:31.691775] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-22T18:17:31.691988] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-22T18:17:31.692042] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-22T18:17:32.075107] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:17:32.117618] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-22T18:17:32.853681] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T18:17:32.917676] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-22T18:17:33.478068] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T18:17:33.717707] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-22T18:17:34.517708] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-22T18:17:34.624900] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T18:17:35.317716] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-22T18:17:35.456789] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T18:17:36.117751] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-22T18:17:36.684715] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-22T18:17:36.809213] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T18:17:36.917692] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-22T18:17:37.239529] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T18:17:37.717684] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-22T18:17:38.429711] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T18:17:38.517672] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-22T18:17:38.735158] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T18:17:39.317669] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-22T18:17:40.117726] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-22T18:17:40.292821] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T18:17:40.304245] [INFO ] [REMOTE ] DGX: Full fetch complete (65676 records). [2025-10-22T18:17:40.304520] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-22T18:17:40.698295] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-22T18:17:40.698396] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-22T18:17:40.699326] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-22T18:17:40.699421] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-22T18:17:40.700853] [DEBUG] [LOCAL ] DGX: Trimmed 65676 records to 44610 (keeping 200 days of data) [2025-10-22T18:17:40.919439] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-22T18:17:40.985972] [DEBUG] [LOCAL ] DGX: Primary data saved (44610 records). [2025-10-22T18:17:40.986201] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-22T18:17:40.986306] [INFO ] [MAIN ] Update Progress: 614/2367 symbols completed. DGX took 24.8s. Estimated remaining: 3h 41m 34s. Rate: 7.9 symbols/min [2025-10-22T18:17:41.156107] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:17:41.193490] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T18:17:41.217245] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T18:17:41.262012] [DEBUG] [LOCAL ] DHR: Loaded 53381 existing records from primary storage. [2025-10-22T18:17:41.262324] [INFO ] [MAIN ] DHR: Loaded 53381 existing records. [2025-10-22T18:17:41.434424] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:17:41.434710] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-22T18:17:41.434803] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-22T18:17:41.435037] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-22T18:17:41.435093] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-22T18:17:41.722850] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-22T18:17:41.782872] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:17:42.517713] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-22T18:17:42.833452] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T18:17:43.317678] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-22T18:17:43.631853] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-22T18:17:43.656445] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T18:17:44.117697] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-22T18:17:44.917716] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-22T18:17:44.957182] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T18:17:45.717707] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-22T18:17:46.174325] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T18:17:46.353388] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-22T18:17:46.517705] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-22T18:17:47.032063] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-22T18:17:47.317710] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-22T18:17:48.117614] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-22T18:17:48.195079] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T18:17:48.410703] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T18:17:48.419453] [INFO ] [REMOTE ] DG: Full fetch complete (77335 records). [2025-10-22T18:17:48.419595] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-22T18:17:48.798308] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-22T18:17:48.798389] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-22T18:17:48.799244] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-22T18:17:48.799325] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-22T18:17:48.800744] [DEBUG] [LOCAL ] DG: Trimmed 77335 records to 53259 (keeping 200 days of data) [2025-10-22T18:17:48.918468] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-22T18:17:49.136118] [DEBUG] [LOCAL ] DG: Primary data saved (53259 records). [2025-10-22T18:17:49.136286] [INFO ] [MAIN ] DG: Full history saved. [2025-10-22T18:17:49.136377] [INFO ] [MAIN ] Update Progress: 615/2367 symbols completed. DG took 45.2s. Estimated remaining: 3h 41m 28s. Rate: 7.9 symbols/min [2025-10-22T18:17:49.304512] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:17:49.304721] [DEBUG] [LOCAL ] DHT: No existing data file found in primary storage. [2025-10-22T18:17:49.304769] [WARN ] [MAIN ] DHT: No existing data found, performing full refresh instead. [2025-10-22T18:17:49.304905] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-22T18:17:49.304973] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-22T18:17:49.305023] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-10-22T18:17:49.305056] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-22T18:17:49.653060] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:17:49.717611] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-22T18:17:49.897821] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T18:17:50.517682] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-22T18:17:50.647827] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T18:17:51.317694] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-22T18:17:51.652945] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T18:17:52.117703] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-22T18:17:52.451661] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T18:17:52.917713] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-22T18:17:53.717712] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-22T18:17:53.769052] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T18:17:54.133392] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-22T18:17:54.137038] [INFO ] [REMOTE ] DHF: Full fetch complete (29995 records). [2025-10-22T18:17:54.137116] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-22T18:17:54.371315] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (3.05 seconds). [2025-10-22T18:17:54.522763] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-22T18:17:54.597524] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-22T18:17:54.597603] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-22T18:17:54.598225] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-22T18:17:54.598278] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-22T18:17:54.599055] [DEBUG] [LOCAL ] DHF: Trimmed 29995 records to 20878 (keeping 200 days of data) [2025-10-22T18:17:54.724257] [DEBUG] [LOCAL ] DHF: Primary data saved (20878 records). [2025-10-22T18:17:54.724405] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-22T18:17:54.724499] [INFO ] [MAIN ] Update Progress: 616/2367 symbols completed. DHF took 30.4s. Estimated remaining: 3h 41m 15s. Rate: 7.9 symbols/min [2025-10-22T18:17:54.889946] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:17:54.890280] [DEBUG] [LOCAL ] DHX: No existing data file found in primary storage. [2025-10-22T18:17:54.890369] [WARN ] [MAIN ] DHX: No existing data found, performing full refresh instead. [2025-10-22T18:17:54.890486] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-22T18:17:54.890526] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-22T18:17:54.890566] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-10-22T18:17:54.890597] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-22T18:17:55.230756] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:17:55.317615] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-22T18:17:55.769303] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-22T18:17:56.117675] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-22T18:17:56.364017] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T18:17:56.853374] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-22T18:17:56.917711] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-22T18:17:57.717704] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-22T18:17:58.067912] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T18:17:58.517704] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-22T18:17:58.620435] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T18:17:59.317698] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-22T18:17:59.531469] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T18:17:59.600799] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T18:18:00.117695] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-22T18:18:00.917769] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-22T18:18:01.717781] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-22T18:18:02.361987] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-22T18:18:02.517784] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-22T18:18:02.546327] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (3.23 seconds). [2025-10-22T18:18:02.555216] [INFO ] [REMOTE ] DHI: Full fetch complete (77400 records). [2025-10-22T18:18:02.555361] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-22T18:18:02.742089] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T18:18:02.961064] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-22T18:18:02.961147] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-22T18:18:02.962104] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-22T18:18:02.962171] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-22T18:18:02.963587] [DEBUG] [LOCAL ] DHI: Trimmed 77400 records to 53363 (keeping 200 days of data) [2025-10-22T18:18:03.293886] [DEBUG] [LOCAL ] DHI: Primary data saved (53363 records). [2025-10-22T18:18:03.294033] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-22T18:18:03.294134] [INFO ] [MAIN ] Update Progress: 617/2367 symbols completed. DHI took 32.0s. Estimated remaining: 3h 41m 10s. Rate: 7.9 symbols/min [2025-10-22T18:18:03.325108] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-22T18:18:03.466272] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:18:03.466447] [DEBUG] [LOCAL ] DIAX: No existing data file found in primary storage. [2025-10-22T18:18:03.466488] [WARN ] [MAIN ] DIAX: No existing data found, performing full refresh instead. [2025-10-22T18:18:03.466600] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-22T18:18:03.466685] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-22T18:18:03.466752] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-10-22T18:18:03.466788] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-22T18:18:03.821911] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:18:03.855019] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-10-22T18:18:04.117709] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-22T18:18:04.376983] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T18:18:04.531675] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T18:18:04.917763] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-22T18:18:05.717718] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-22T18:18:05.780080] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T18:18:06.517758] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-22T18:18:06.629965] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-22T18:18:06.947881] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-22T18:18:07.317698] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-22T18:18:08.126804] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-22T18:18:08.132113] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T18:18:08.148021] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-22T18:18:08.917707] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-22T18:18:09.146613] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-22T18:18:09.717714] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-22T18:18:10.409753] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T18:18:10.517692] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-22T18:18:11.317734] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-22T18:18:11.842364] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-22T18:18:11.862982] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-22T18:18:11.972090] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T18:18:12.117742] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-22T18:18:12.917717] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-22T18:18:13.125966] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-22T18:18:13.717282] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T18:18:13.719796] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-22T18:18:14.517692] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-22T18:18:15.251407] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T18:18:15.317778] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-22T18:18:15.867119] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-22T18:18:16.117719] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-22T18:18:16.174944] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T18:18:16.917709] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-22T18:18:17.717688] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-22T18:18:17.870024] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T18:18:18.517614] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-22T18:18:18.590349] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T18:18:19.253695] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-22T18:18:19.317677] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-22T18:18:19.931982] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (3.81 seconds). [2025-10-22T18:18:19.940716] [INFO ] [REMOTE ] DHR: Full fetch complete (77055 records). [2025-10-22T18:18:19.940887] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-22T18:18:19.941750] [FATAL] [VALIDATOR ] DHR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:18:19.941843] [FATAL] [MAIN ] DHR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:18:19.941886] [WARN ] [MAIN ] DHR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:18:19.941953] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-22T18:18:19.942022] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-10-22T18:18:19.942057] [INFO ] [LOCAL ] DHR: Starting deletion of derivative data. [2025-10-22T18:18:19.942201] [DEBUG] [LOCAL ] DHR: Deleted derivative data file. [2025-10-22T18:18:19.942274] [INFO ] [MAIN ] Update Progress: 618/2367 symbols completed. DHR took 39.0s. Estimated remaining: 3h 41m 28s. Rate: 7.9 symbols/min [2025-10-22T18:18:20.109211] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:18:20.117719] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-22T18:18:20.144273] [DEBUG] [LOCAL ] DIN: Loaded 36831 existing records from primary storage. [2025-10-22T18:18:20.144560] [INFO ] [MAIN ] DIN: Loaded 36831 existing records. [2025-10-22T18:18:20.328366] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:18:20.332701] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T18:18:20.332894] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-22T18:18:20.335991] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-22T18:18:20.336436] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-22T18:18:20.336483] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-22T18:18:20.678967] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:18:20.917698] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-22T18:18:21.575338] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T18:18:21.583202] [INFO ] [REMOTE ] DHT: Full fetch complete (69940 records). [2025-10-22T18:18:21.583323] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-22T18:18:21.583997] [FATAL] [VALIDATOR ] DHT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:18:21.584090] [FATAL] [MAIN ] DHT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:18:21.584133] [WARN ] [MAIN ] DHT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:18:21.584196] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-22T18:18:21.584259] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-10-22T18:18:21.584294] [INFO ] [LOCAL ] DHT: Starting deletion of derivative data. [2025-10-22T18:18:21.584352] [DEBUG] [LOCAL ] DHT: No derivative data file found to delete. [2025-10-22T18:18:21.584407] [INFO ] [MAIN ] Update Progress: 619/2367 symbols completed. DHT took 32.4s. Estimated remaining: 3h 41m 4s. Rate: 7.9 symbols/min [2025-10-22T18:18:21.722805] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-22T18:18:21.767771] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:18:21.817003] [DEBUG] [LOCAL ] DINO: Loaded 52837 existing records from primary storage. [2025-10-22T18:18:21.817328] [INFO ] [MAIN ] DINO: Loaded 52837 existing records. [2025-10-22T18:18:21.993282] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:18:21.993491] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-22T18:18:21.993538] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-22T18:18:21.993761] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-22T18:18:21.993815] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-22T18:18:22.280614] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T18:18:22.359256] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:18:22.517696] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-22T18:18:22.708517] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T18:18:23.317695] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-22T18:18:23.572607] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T18:18:23.575792] [INFO ] [REMOTE ] DHX: Full fetch complete (21382 records). [2025-10-22T18:18:23.575876] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-22T18:18:23.576389] [FATAL] [VALIDATOR ] DHX: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:18:23.576475] [FATAL] [MAIN ] DHX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:18:23.576517] [WARN ] [MAIN ] DHX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:18:23.576580] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-22T18:18:23.576671] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-10-22T18:18:23.576733] [INFO ] [LOCAL ] DHX: Starting deletion of derivative data. [2025-10-22T18:18:23.576781] [DEBUG] [LOCAL ] DHX: No derivative data file found to delete. [2025-10-22T18:18:23.576836] [INFO ] [MAIN ] Update Progress: 620/2367 symbols completed. DHX took 28.9s. Estimated remaining: 3h 40m 40s. Rate: 7.9 symbols/min [2025-10-22T18:18:23.746128] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:18:23.797725] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-22T18:18:23.798037] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-22T18:18:23.986367] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:18:23.986555] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-22T18:18:23.986601] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-22T18:18:23.986820] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-22T18:18:23.986876] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-22T18:18:24.130830] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-22T18:18:24.298696] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T18:18:24.331357] [INFO ] [REMOTE ] DIAX: Full fetch complete (17655 records). [2025-10-22T18:18:24.340711] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-22T18:18:24.370842] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:18:24.770480] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-22T18:18:24.770561] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-22T18:18:24.770992] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-22T18:18:24.771078] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-22T18:18:24.771682] [DEBUG] [LOCAL ] DIAX: Trimmed 17655 records to 12723 (keeping 200 days of data) [2025-10-22T18:18:24.846618] [DEBUG] [LOCAL ] DIAX: Primary data saved (12723 records). [2025-10-22T18:18:24.846768] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-22T18:18:24.846838] [INFO ] [MAIN ] Update Progress: 621/2367 symbols completed. DIAX took 21.6s. Estimated remaining: 3h 40m 15s. Rate: 7.9 symbols/min [2025-10-22T18:18:24.922759] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-22T18:18:25.028394] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:18:25.028562] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-22T18:18:25.028599] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-22T18:18:25.028733] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-22T18:18:25.028775] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-22T18:18:25.028816] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-22T18:18:25.028892] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-22T18:18:25.404001] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:18:25.732742] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-22T18:18:25.740499] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T18:18:26.490234] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T18:18:26.517689] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-22T18:18:26.872508] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-22T18:18:27.317700] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-22T18:18:27.592002] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-22T18:18:28.117693] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-22T18:18:28.923688] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-22T18:18:28.926370] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T18:18:29.717732] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-22T18:18:30.194299] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-22T18:18:30.196277] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-22T18:18:30.517692] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-22T18:18:31.317722] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-22T18:18:31.424428] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-22T18:18:31.750805] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-22T18:18:32.117721] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-22T18:18:32.922855] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-22T18:18:32.938623] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-22T18:18:33.313614] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-22T18:18:33.584348] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T18:18:33.717706] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-22T18:18:34.517679] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-22T18:18:34.642120] [DEBUG] [REMOTE ] DIVY: Error fetching primary data for 2025-06: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [2025-10-22T18:18:34.642243] [WARN ] [REMOTE ] DIVY: No data returned for month 2025-06 [2025-10-22T18:18:34.642319] [FATAL] [REMOTE ] DIVY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:18:34.642363] [FATAL] [MAIN ] DIVY: Failed to fetch primary data. [2025-10-22T18:18:34.642424] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:18:34.642493] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-22T18:18:34.642556] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-22T18:18:34.642592] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-22T18:18:34.642632] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-22T18:18:34.642728] [INFO ] [MAIN ] Update Progress: 622/2367 symbols completed. DIVY took 9.8s. Estimated remaining: 3h 40m 14s. Rate: 7.9 symbols/min [2025-10-22T18:18:34.813834] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:18:34.814024] [DEBUG] [LOCAL ] DK: No existing data file found in primary storage. [2025-10-22T18:18:34.814073] [WARN ] [MAIN ] DK: No existing data found, performing full refresh instead. [2025-10-22T18:18:34.814189] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-22T18:18:34.814250] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-22T18:18:34.814321] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-10-22T18:18:34.814357] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-22T18:18:35.222082] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:18:35.256218] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T18:18:35.317725] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-22T18:18:36.117746] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-22T18:18:36.917667] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-22T18:18:37.377070] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T18:18:37.519457] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T18:18:37.717741] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-22T18:18:38.517751] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-22T18:18:39.317735] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-22T18:18:39.494789] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T18:18:39.640496] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-22T18:18:39.887742] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-22T18:18:40.117727] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-22T18:18:40.917758] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-22T18:18:41.049205] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T18:18:41.717730] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-22T18:18:41.862150] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T18:18:42.276889] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T18:18:42.517770] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-22T18:18:43.078036] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T18:18:43.317728] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-22T18:18:44.117733] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-22T18:18:44.917747] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-22T18:18:44.995095] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-22T18:18:45.074826] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T18:18:45.717685] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-22T18:18:45.756419] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T18:18:46.341782] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T18:18:46.517710] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-22T18:18:47.317759] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-22T18:18:47.610099] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T18:18:48.117723] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-22T18:18:48.171697] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-22T18:18:48.917710] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-22T18:18:49.515571] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-22T18:18:49.717667] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-22T18:18:49.845283] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T18:18:50.350586] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T18:18:50.517741] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-22T18:18:51.317749] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-22T18:18:52.117717] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-22T18:18:52.444948] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T18:18:52.453559] [INFO ] [REMOTE ] DINO: Full fetch complete (76718 records). [2025-10-22T18:18:52.453741] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-22T18:18:52.868608] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (3.15 seconds). [2025-10-22T18:18:52.897891] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-22T18:18:52.898717] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-22T18:18:52.899844] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-22T18:18:52.899989] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-22T18:18:52.901768] [DEBUG] [LOCAL ] DINO: Trimmed 76718 records to 52825 (keeping 200 days of data) [2025-10-22T18:18:52.953480] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-22T18:18:53.048087] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T18:18:53.250099] [DEBUG] [LOCAL ] DINO: Primary data saved (52825 records). [2025-10-22T18:18:53.250322] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-22T18:18:53.250416] [INFO ] [MAIN ] Update Progress: 623/2367 symbols completed. DINO took 31.7s. Estimated remaining: 3h 40m 37s. Rate: 7.9 symbols/min [2025-10-22T18:18:53.418810] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:18:53.444131] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T18:18:53.465699] [DEBUG] [LOCAL ] DKL: Loaded 17059 existing records from primary storage. [2025-10-22T18:18:53.466024] [INFO ] [MAIN ] DKL: Loaded 17059 existing records. [2025-10-22T18:18:53.637967] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:18:53.638200] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-22T18:18:53.638246] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-22T18:18:53.638430] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-22T18:18:53.638485] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-22T18:18:53.725552] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-22T18:18:53.982773] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:18:54.517697] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-22T18:18:55.312551] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T18:18:55.321684] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-22T18:18:55.353126] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-22T18:18:56.084206] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T18:18:56.117672] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-22T18:18:56.517447] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T18:18:56.917737] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-22T18:18:57.611203] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T18:18:57.617369] [INFO ] [REMOTE ] DIN: Full fetch complete (54768 records). [2025-10-22T18:18:57.617519] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-22T18:18:57.726085] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-22T18:18:58.028113] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-22T18:18:58.028210] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-22T18:18:58.028989] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-22T18:18:58.029107] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-22T18:18:58.043608] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T18:18:58.049255] [DEBUG] [LOCAL ] DIN: Trimmed 54768 records to 36752 (keeping 200 days of data) [2025-10-22T18:18:58.266315] [DEBUG] [LOCAL ] DIN: Primary data saved (36752 records). [2025-10-22T18:18:58.266445] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-22T18:18:58.266520] [INFO ] [MAIN ] Update Progress: 624/2367 symbols completed. DIN took 38.3s. Estimated remaining: 3h 40m 22s. Rate: 7.9 symbols/min [2025-10-22T18:18:58.434818] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:18:58.477857] [DEBUG] [LOCAL ] DKS: Loaded 49449 existing records from primary storage. [2025-10-22T18:18:58.478201] [INFO ] [MAIN ] DKS: Loaded 49449 existing records. [2025-10-22T18:18:58.525165] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-22T18:18:58.664333] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:18:58.664537] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-22T18:18:58.664584] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-22T18:18:58.664814] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-22T18:18:58.664872] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-22T18:18:59.017318] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:18:59.285331] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T18:18:59.317671] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-22T18:18:59.376448] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-22T18:19:00.117765] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-22T18:19:00.828405] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T18:19:00.917716] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-22T18:19:01.717706] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-22T18:19:02.326412] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-22T18:19:02.410996] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T18:19:02.517736] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-22T18:19:03.317712] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-22T18:19:03.524629] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T18:19:04.117708] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-22T18:19:04.168360] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T18:19:04.902845] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T18:19:04.917607] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-22T18:19:05.654598] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-22T18:19:05.663065] [INFO ] [REMOTE ] DIS: Full fetch complete (77577 records). [2025-10-22T18:19:05.663248] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-22T18:19:05.664295] [FATAL] [VALIDATOR ] DIS: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:19:05.664401] [FATAL] [MAIN ] DIS: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:19:05.664446] [WARN ] [MAIN ] DIS: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:19:05.664516] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-22T18:19:05.664583] [DEBUG] [LOCAL ] DIS: No primary data file found to delete. [2025-10-22T18:19:05.664618] [INFO ] [LOCAL ] DIS: Starting deletion of derivative data. [2025-10-22T18:19:05.664894] [DEBUG] [LOCAL ] DIS: Deleted derivative data file. [2025-10-22T18:19:05.665444] [INFO ] [MAIN ] Update Progress: 625/2367 symbols completed. DIS took 42.1s. Estimated remaining: 3h 40m 14s. Rate: 7.9 symbols/min [2025-10-22T18:19:05.726859] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-22T18:19:05.841092] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:19:05.874548] [DEBUG] [LOCAL ] DLB: Loaded 32289 existing records from primary storage. [2025-10-22T18:19:05.874864] [INFO ] [MAIN ] DLB: Loaded 32289 existing records. [2025-10-22T18:19:05.989483] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-22T18:19:06.070590] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:19:06.070860] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-22T18:19:06.070911] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-22T18:19:06.071097] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-22T18:19:06.071136] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-22T18:19:06.438810] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:19:06.517700] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-22T18:19:07.317768] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-22T18:19:07.444146] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T18:19:07.677311] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T18:19:08.117725] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-22T18:19:08.728309] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T18:19:08.917685] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-22T18:19:09.079347] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-22T18:19:09.717698] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-22T18:19:10.517664] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-22T18:19:10.591928] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-22T18:19:10.663673] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T18:19:11.317731] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-22T18:19:12.117714] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-22T18:19:12.152513] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T18:19:12.917686] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-22T18:19:13.327096] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-22T18:19:13.532704] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-22T18:19:13.717703] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-22T18:19:13.755390] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-22T18:19:13.757592] [INFO ] [REMOTE ] DKL: Full fetch complete (27575 records). [2025-10-22T18:19:13.757725] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-22T18:19:14.120891] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-22T18:19:14.120965] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-22T18:19:14.121466] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-22T18:19:14.121526] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-22T18:19:14.122242] [DEBUG] [LOCAL ] DKL: Trimmed 27575 records to 16871 (keeping 200 days of data) [2025-10-22T18:19:14.220534] [DEBUG] [LOCAL ] DKL: Primary data saved (16871 records). [2025-10-22T18:19:14.220684] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-22T18:19:14.220773] [INFO ] [MAIN ] Update Progress: 626/2367 symbols completed. DKL took 21.0s. Estimated remaining: 3h 40m 9s. Rate: 7.9 symbols/min [2025-10-22T18:19:14.390713] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:19:14.397047] [DEBUG] [LOCAL ] DLNG: Loaded 6106 existing records from primary storage. [2025-10-22T18:19:14.397197] [INFO ] [MAIN ] DLNG: Loaded 6106 existing records. [2025-10-22T18:19:14.522800] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-22T18:19:14.581293] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:19:14.581550] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-22T18:19:14.581610] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-22T18:19:14.581793] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-22T18:19:14.581842] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-22T18:19:14.939515] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:19:15.317733] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-22T18:19:15.580870] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-22T18:19:16.117700] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-22T18:19:16.700991] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T18:19:16.809176] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-22T18:19:16.816845] [INFO ] [REMOTE ] DK: Full fetch complete (70772 records). [2025-10-22T18:19:16.816969] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-22T18:19:16.922911] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-22T18:19:17.199511] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-22T18:19:17.199587] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-22T18:19:17.200533] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-22T18:19:17.200595] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-22T18:19:17.201871] [DEBUG] [LOCAL ] DK: Trimmed 70772 records to 49230 (keeping 200 days of data) [2025-10-22T18:19:17.496339] [DEBUG] [LOCAL ] DK: Primary data saved (49230 records). [2025-10-22T18:19:17.496508] [INFO ] [MAIN ] DK: Full history saved. [2025-10-22T18:19:17.496603] [INFO ] [MAIN ] Update Progress: 627/2367 symbols completed. DK took 42.9s. Estimated remaining: 3h 39m 50s. Rate: 7.9 symbols/min [2025-10-22T18:19:17.664407] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:19:17.713523] [DEBUG] [LOCAL ] DLR: Loaded 50634 existing records from primary storage. [2025-10-22T18:19:17.713879] [INFO ] [MAIN ] DLR: Loaded 50634 existing records. [2025-10-22T18:19:17.745362] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-22T18:19:17.894058] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:19:17.894266] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-22T18:19:17.894315] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-22T18:19:17.894551] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-22T18:19:17.894606] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-22T18:19:18.251613] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:19:18.284568] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-22T18:19:18.517692] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-22T18:19:18.796943] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-22T18:19:19.317767] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-22T18:19:19.411637] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T18:19:19.952162] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T18:19:20.117738] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-22T18:19:20.519199] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T18:19:20.917744] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-22T18:19:21.675205] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-22T18:19:21.717685] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-22T18:19:21.864012] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T18:19:22.260896] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-22T18:19:22.517699] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-22T18:19:23.317744] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-22T18:19:23.896937] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T18:19:24.117694] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-22T18:19:24.917718] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-22T18:19:25.222142] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-22T18:19:25.619954] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T18:19:25.717715] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-22T18:19:25.900971] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T18:19:26.517704] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-22T18:19:27.317729] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-22T18:19:27.873204] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T18:19:27.955301] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-22T18:19:27.962838] [INFO ] [REMOTE ] DKS: Full fetch complete (71332 records). [2025-10-22T18:19:27.962999] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-22T18:19:27.963718] [FATAL] [VALIDATOR ] DKS: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:19:27.963809] [FATAL] [MAIN ] DKS: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:19:27.963851] [WARN ] [MAIN ] DKS: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:19:27.963890] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-22T18:19:27.963947] [DEBUG] [LOCAL ] DKS: No primary data file found to delete. [2025-10-22T18:19:27.963984] [INFO ] [LOCAL ] DKS: Starting deletion of derivative data. [2025-10-22T18:19:27.964170] [DEBUG] [LOCAL ] DKS: Deleted derivative data file. [2025-10-22T18:19:27.964262] [INFO ] [MAIN ] Update Progress: 628/2367 symbols completed. DKS took 29.7s. Estimated remaining: 3h 39m 50s. Rate: 7.9 symbols/min [2025-10-22T18:19:28.067495] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-22T18:19:28.118392] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-22T18:19:28.137097] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:19:28.165949] [DEBUG] [LOCAL ] DLX: Loaded 28165 existing records from primary storage. [2025-10-22T18:19:28.166240] [INFO ] [MAIN ] DLX: Loaded 28165 existing records. [2025-10-22T18:19:28.343420] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:19:28.344471] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-22T18:19:28.344531] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-22T18:19:28.345187] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-22T18:19:28.345245] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-22T18:19:28.690531] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:19:28.734942] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-22T18:19:28.917679] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-22T18:19:29.517711] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T18:19:29.717703] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-22T18:19:30.442975] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-22T18:19:30.445142] [INFO ] [REMOTE ] DLNG: Full fetch complete (11318 records). [2025-10-22T18:19:30.445236] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-22T18:19:30.527592] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-22T18:19:30.853143] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-22T18:19:30.853247] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-22T18:19:30.853603] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-22T18:19:30.853720] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-22T18:19:30.854198] [DEBUG] [LOCAL ] DLNG: Trimmed 11318 records to 6048 (keeping 200 days of data) [2025-10-22T18:19:30.892020] [DEBUG] [LOCAL ] DLNG: Primary data saved (6048 records). [2025-10-22T18:19:30.892113] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-22T18:19:30.892191] [INFO ] [MAIN ] Update Progress: 629/2367 symbols completed. DLNG took 16.7s. Estimated remaining: 3h 39m 30s. Rate: 7.9 symbols/min [2025-10-22T18:19:31.062298] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:19:31.086137] [DEBUG] [LOCAL ] DLY: Loaded 20743 existing records from primary storage. [2025-10-22T18:19:31.086422] [INFO ] [MAIN ] DLY: Loaded 20743 existing records. [2025-10-22T18:19:31.308667] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:19:31.308928] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-22T18:19:31.308989] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-22T18:19:31.309183] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-22T18:19:31.309238] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-22T18:19:31.322780] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-22T18:19:31.775921] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:19:31.843632] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T18:19:32.117694] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-22T18:19:32.917705] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-22T18:19:33.471894] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-22T18:19:33.553121] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T18:19:33.717724] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-22T18:19:34.517688] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-22T18:19:34.750007] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-22T18:19:34.818619] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T18:19:35.317610] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-22T18:19:35.968584] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T18:19:36.117689] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-22T18:19:36.917690] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-22T18:19:37.081953] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T18:19:37.649455] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-22T18:19:37.717681] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-22T18:19:38.157399] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-22T18:19:38.517683] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-22T18:19:38.747289] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-22T18:19:39.317706] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-22T18:19:40.117716] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-22T18:19:40.908480] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-22T18:19:40.918779] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-22T18:19:40.953724] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T18:19:40.959295] [INFO ] [REMOTE ] DLB: Full fetch complete (47435 records). [2025-10-22T18:19:40.959379] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-22T18:19:41.330926] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-22T18:19:41.331002] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-22T18:19:41.331623] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-22T18:19:41.331696] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-22T18:19:41.332613] [DEBUG] [LOCAL ] DLB: Trimmed 47435 records to 32217 (keeping 200 days of data) [2025-10-22T18:19:41.527490] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T18:19:41.551006] [DEBUG] [LOCAL ] DLB: Primary data saved (32217 records). [2025-10-22T18:19:41.551112] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-22T18:19:41.551181] [INFO ] [MAIN ] Update Progress: 630/2367 symbols completed. DLB took 35.9s. Estimated remaining: 3h 39m 31s. Rate: 7.9 symbols/min [2025-10-22T18:19:41.721020] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-22T18:19:41.722494] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:19:41.732890] [DEBUG] [LOCAL ] DMA: Loaded 4729 existing records from primary storage. [2025-10-22T18:19:41.733359] [INFO ] [MAIN ] DMA: Loaded 4729 existing records. [2025-10-22T18:19:41.922056] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:19:41.922347] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-22T18:19:41.922419] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-22T18:19:41.922671] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-22T18:19:41.922728] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-22T18:19:42.203432] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T18:19:42.293014] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:19:42.517726] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-22T18:19:43.153051] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-22T18:19:43.154123] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T18:19:43.317746] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-22T18:19:44.117697] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-22T18:19:44.917706] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-22T18:19:45.369568] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-22T18:19:45.403720] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-22T18:19:45.480898] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-22T18:19:45.717676] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-22T18:19:46.043853] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-22T18:19:46.517705] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-22T18:19:47.317715] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-22T18:19:48.117702] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-22T18:19:48.419310] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T18:19:48.648625] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T18:19:48.917620] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-22T18:19:49.284314] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T18:19:49.717728] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-22T18:19:50.517683] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-22T18:19:50.682456] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T18:19:50.710991] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T18:19:51.317724] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-22T18:19:51.496741] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T18:19:52.117703] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-22T18:19:52.917680] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-22T18:19:53.014578] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T18:19:53.318958] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T18:19:53.560994] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-22T18:19:53.717618] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-22T18:19:54.366801] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T18:19:54.517715] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-22T18:19:54.977672] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-22T18:19:55.317706] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-22T18:19:55.885562] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-22T18:19:56.117728] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-22T18:19:56.917730] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-22T18:19:57.073719] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T18:19:57.523316] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T18:19:57.717713] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-22T18:19:58.517773] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-22T18:19:58.930453] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-22T18:19:58.936696] [INFO ] [REMOTE ] DLX: Full fetch complete (41338 records). [2025-10-22T18:19:58.936855] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-22T18:19:59.322914] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-22T18:19:59.530544] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-22T18:19:59.530777] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-22T18:19:59.531821] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-22T18:19:59.531901] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-22T18:19:59.533289] [DEBUG] [LOCAL ] DLX: Trimmed 41338 records to 28049 (keeping 200 days of data) [2025-10-22T18:19:59.792840] [DEBUG] [LOCAL ] DLX: Primary data saved (28049 records). [2025-10-22T18:19:59.814147] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-22T18:19:59.814754] [INFO ] [MAIN ] Update Progress: 631/2367 symbols completed. DLX took 31.9s. Estimated remaining: 3h 39m 52s. Rate: 7.9 symbols/min [2025-10-22T18:19:59.835403] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T18:20:00.046023] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:00.057925] [DEBUG] [LOCAL ] DMB: Loaded 10482 existing records from primary storage. [2025-10-22T18:20:00.058151] [INFO ] [MAIN ] DMB: Loaded 10482 existing records. [2025-10-22T18:20:00.125297] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-22T18:20:00.242166] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:20:00.242431] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-22T18:20:00.242506] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-22T18:20:00.242804] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-22T18:20:00.242877] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-22T18:20:00.602521] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:00.917732] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-22T18:20:01.278089] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T18:20:01.354482] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-22T18:20:01.717748] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-22T18:20:02.375579] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T18:20:02.517701] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-22T18:20:02.582363] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T18:20:03.317714] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-22T18:20:03.457526] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T18:20:03.466340] [INFO ] [REMOTE ] DLR: Full fetch complete (74166 records). [2025-10-22T18:20:03.466475] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-22T18:20:03.896333] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-22T18:20:03.896449] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-22T18:20:03.897451] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-22T18:20:03.897529] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-22T18:20:03.899081] [DEBUG] [LOCAL ] DLR: Trimmed 74166 records to 50597 (keeping 200 days of data) [2025-10-22T18:20:04.120894] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-22T18:20:04.123199] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T18:20:04.237715] [DEBUG] [LOCAL ] DLR: Primary data saved (50597 records). [2025-10-22T18:20:04.237878] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-22T18:20:04.237963] [INFO ] [MAIN ] Update Progress: 632/2367 symbols completed. DLR took 46.7s. Estimated remaining: 3h 39m 36s. Rate: 7.9 symbols/min [2025-10-22T18:20:04.405301] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:04.417491] [DEBUG] [LOCAL ] DMO: Loaded 9862 existing records from primary storage. [2025-10-22T18:20:04.417776] [INFO ] [MAIN ] DMO: Loaded 9862 existing records. [2025-10-22T18:20:04.596993] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:20:04.597205] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-22T18:20:04.597253] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-22T18:20:04.597411] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-22T18:20:04.597449] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-22T18:20:04.923197] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-22T18:20:04.955121] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:05.431463] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T18:20:05.717749] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-22T18:20:05.727995] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-22T18:20:05.729450] [INFO ] [REMOTE ] DMA: Full fetch complete (6578 records). [2025-10-22T18:20:05.729518] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-22T18:20:06.077791] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-22T18:20:06.077871] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-22T18:20:06.078151] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-22T18:20:06.078215] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-22T18:20:06.078624] [DEBUG] [LOCAL ] DMA: Trimmed 6578 records to 4714 (keeping 200 days of data) [2025-10-22T18:20:06.105892] [DEBUG] [LOCAL ] DMA: Primary data saved (4714 records). [2025-10-22T18:20:06.105989] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-22T18:20:06.106063] [INFO ] [MAIN ] Update Progress: 633/2367 symbols completed. DMA took 24.6s. Estimated remaining: 3h 39m 13s. Rate: 7.9 symbols/min [2025-10-22T18:20:06.271531] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:06.316793] [DEBUG] [LOCAL ] DNA: Loaded 48547 existing records from primary storage. [2025-10-22T18:20:06.317110] [INFO ] [MAIN ] DNA: Loaded 48547 existing records. [2025-10-22T18:20:06.497412] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:20:06.497702] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-22T18:20:06.497761] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-22T18:20:06.497963] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-22T18:20:06.498019] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-22T18:20:06.526541] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-22T18:20:06.590671] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T18:20:06.862931] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:07.317926] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-22T18:20:07.883987] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T18:20:07.888780] [INFO ] [REMOTE ] DLY: Full fetch complete (28365 records). [2025-10-22T18:20:07.888865] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-22T18:20:07.889321] [FATAL] [VALIDATOR ] DLY: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:20:07.889414] [FATAL] [MAIN ] DLY: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:20:07.889467] [WARN ] [MAIN ] DLY: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:20:07.889513] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-22T18:20:07.889582] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-10-22T18:20:07.889620] [INFO ] [LOCAL ] DLY: Starting deletion of derivative data. [2025-10-22T18:20:07.889838] [DEBUG] [LOCAL ] DLY: Deleted derivative data file. [2025-10-22T18:20:07.889952] [INFO ] [MAIN ] Update Progress: 634/2367 symbols completed. DLY took 37.0s. Estimated remaining: 3h 38m 49s. Rate: 7.9 symbols/min [2025-10-22T18:20:08.059136] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:08.098075] [DEBUG] [LOCAL ] DNOW: Loaded 43799 existing records from primary storage. [2025-10-22T18:20:08.098358] [INFO ] [MAIN ] DNOW: Loaded 43799 existing records. [2025-10-22T18:20:08.126876] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-22T18:20:08.241500] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-22T18:20:08.300838] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:20:08.301013] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-22T18:20:08.301057] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-22T18:20:08.301226] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-22T18:20:08.301263] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-22T18:20:08.649438] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:08.917746] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-22T18:20:09.213862] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-22T18:20:09.717710] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-22T18:20:10.463346] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-22T18:20:10.517692] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-22T18:20:10.773807] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T18:20:11.011316] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-22T18:20:11.317720] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-22T18:20:12.013295] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-22T18:20:12.117684] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-22T18:20:12.917670] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-22T18:20:12.999128] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T18:20:13.717725] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-22T18:20:14.365861] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T18:20:14.416039] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-22T18:20:14.517695] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-22T18:20:15.317698] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-22T18:20:16.052632] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T18:20:16.089381] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T18:20:16.117614] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-22T18:20:16.917717] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-22T18:20:17.490542] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-22T18:20:17.717703] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-22T18:20:17.758220] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T18:20:18.517721] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-22T18:20:19.317703] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-22T18:20:19.432268] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T18:20:19.680017] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-22T18:20:20.117697] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-22T18:20:20.919932] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-22T18:20:20.922622] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T18:20:21.717722] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-22T18:20:21.989614] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T18:20:22.517719] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-22T18:20:22.920002] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T18:20:22.985741] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T18:20:23.317719] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-22T18:20:23.426965] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T18:20:24.117712] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-22T18:20:24.917714] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-22T18:20:25.019387] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-22T18:20:25.717716] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-22T18:20:25.771557] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-22T18:20:26.413400] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T18:20:26.517672] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-22T18:20:26.575102] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T18:20:27.317711] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-22T18:20:28.117664] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-22T18:20:28.295030] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T18:20:28.895485] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T18:20:28.917616] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-22T18:20:29.052931] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T18:20:29.717699] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-22T18:20:29.882997] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-22T18:20:29.884966] [INFO ] [REMOTE ] DMO: Full fetch complete (14479 records). [2025-10-22T18:20:29.885047] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-22T18:20:30.244215] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-22T18:20:30.244311] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-22T18:20:30.244629] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-22T18:20:30.244714] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-22T18:20:30.245194] [DEBUG] [LOCAL ] DMO: Trimmed 14479 records to 9788 (keeping 200 days of data) [2025-10-22T18:20:30.304507] [DEBUG] [LOCAL ] DMO: Primary data saved (9788 records). [2025-10-22T18:20:30.304635] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-22T18:20:30.304749] [INFO ] [MAIN ] Update Progress: 635/2367 symbols completed. DMO took 26.1s. Estimated remaining: 3h 39m 22s. Rate: 7.9 symbols/min [2025-10-22T18:20:30.471961] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:30.482796] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-22T18:20:30.485008] [INFO ] [REMOTE ] DMB: Full fetch complete (14652 records). [2025-10-22T18:20:30.485088] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-22T18:20:30.485533] [FATAL] [VALIDATOR ] DMB: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:20:30.485627] [FATAL] [MAIN ] DMB: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:20:30.485739] [WARN ] [MAIN ] DMB: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:20:30.485821] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-22T18:20:30.485912] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-22T18:20:30.485957] [INFO ] [LOCAL ] DMB: Starting deletion of derivative data. [2025-10-22T18:20:30.486083] [DEBUG] [LOCAL ] DMB: Deleted derivative data file. [2025-10-22T18:20:30.486168] [INFO ] [MAIN ] Update Progress: 636/2367 symbols completed. DMB took 30.7s. Estimated remaining: 3h 38m 55s. Rate: 7.9 symbols/min [2025-10-22T18:20:30.518709] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-22T18:20:30.630437] [DEBUG] [LOCAL ] DNP: Loaded 33093 existing records from primary storage. [2025-10-22T18:20:30.653968] [INFO ] [MAIN ] DNP: Loaded 33093 existing records. [2025-10-22T18:20:30.755130] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:30.861825] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:20:30.862096] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-22T18:20:30.862152] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-22T18:20:30.862370] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-22T18:20:30.862427] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-22T18:20:31.107484] [DEBUG] [LOCAL ] DOC: Loaded 53555 existing records from primary storage. [2025-10-22T18:20:31.151861] [INFO ] [MAIN ] DOC: Loaded 53555 existing records. [2025-10-22T18:20:31.319559] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-22T18:20:31.460522] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:31.481911] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:20:31.482116] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-22T18:20:31.482162] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-22T18:20:31.482341] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-22T18:20:31.482378] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-22T18:20:31.852971] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:32.117757] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-22T18:20:32.151413] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:20:32.917744] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-22T18:20:33.357806] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-22T18:20:33.717676] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-22T18:20:33.954242] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T18:20:34.517690] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-22T18:20:34.565719] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T18:20:35.317679] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-22T18:20:35.774429] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-22T18:20:36.117705] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-22T18:20:36.188829] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T18:20:36.253514] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-22T18:20:36.917753] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-22T18:20:37.717712] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-22T18:20:37.886093] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-22T18:20:38.268458] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T18:20:38.517762] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-22T18:20:39.317709] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-22T18:20:39.696966] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T18:20:40.117728] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-22T18:20:40.247340] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T18:20:40.255054] [INFO ] [REMOTE ] DNOW: Full fetch complete (63628 records). [2025-10-22T18:20:40.255200] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-22T18:20:40.648609] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-22T18:20:40.648841] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-22T18:20:40.649597] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-22T18:20:40.649670] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-22T18:20:40.650952] [DEBUG] [LOCAL ] DNOW: Trimmed 63628 records to 43752 (keeping 200 days of data) [2025-10-22T18:20:40.913335] [DEBUG] [LOCAL ] DNOW: Primary data saved (43752 records). [2025-10-22T18:20:40.913612] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-22T18:20:40.924116] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-22T18:20:40.924298] [INFO ] [MAIN ] Update Progress: 637/2367 symbols completed. DNOW took 33.0s. Estimated remaining: 3h 38m 55s. Rate: 7.9 symbols/min [2025-10-22T18:20:40.947722] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:20:41.667993] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T18:20:41.717611] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-22T18:20:42.517693] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-22T18:20:42.910709] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T18:20:43.262546] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T18:20:43.317683] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-22T18:20:44.121199] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-22T18:20:44.524999] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T18:20:44.917829] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-22T18:20:45.706013] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T18:20:45.717608] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-22T18:20:45.794508] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-22T18:20:45.802566] [INFO ] [REMOTE ] DNA: Full fetch complete (70871 records). [2025-10-22T18:20:45.802766] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-22T18:20:45.803587] [FATAL] [VALIDATOR ] DNA: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:20:45.803711] [FATAL] [MAIN ] DNA: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:20:45.803761] [WARN ] [MAIN ] DNA: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:20:45.803827] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-22T18:20:45.803897] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-10-22T18:20:45.803935] [INFO ] [LOCAL ] DNA: Starting deletion of derivative data. [2025-10-22T18:20:45.804111] [DEBUG] [LOCAL ] DNA: Deleted derivative data file. [2025-10-22T18:20:45.804806] [INFO ] [MAIN ] Update Progress: 638/2367 symbols completed. DNA took 39.7s. Estimated remaining: 3h 38m 40s. Rate: 7.9 symbols/min [2025-10-22T18:20:46.560422] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T18:20:46.572001] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-22T18:20:47.068135] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T18:20:47.317764] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-22T18:20:48.318003] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T18:20:48.328923] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-22T18:20:48.591515] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T18:20:48.917730] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-22T18:20:49.908329] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T18:20:49.920012] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-22T18:20:50.573411] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T18:20:50.580375] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-22T18:20:51.762873] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T18:20:51.774872] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-22T18:20:52.069056] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T18:20:52.074229] [INFO ] [REMOTE ] DNP: Full fetch complete (48481 records). [2025-10-22T18:20:52.074319] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-22T18:20:52.505491] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-22T18:20:52.505581] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-22T18:20:52.506349] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-22T18:20:52.506414] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-22T18:20:52.507533] [DEBUG] [LOCAL ] DNP: Trimmed 48481 records to 32937 (keeping 200 days of data) [2025-10-22T18:20:52.704082] [DEBUG] [LOCAL ] DNP: Primary data saved (32937 records). [2025-10-22T18:20:52.704258] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-22T18:20:52.704355] [INFO ] [MAIN ] Update Progress: 639/2367 symbols completed. DNP took 22.4s. Estimated remaining: 3h 38m 30s. Rate: 7.9 symbols/min [2025-10-22T18:20:53.814565] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T18:20:53.830973] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-22T18:20:56.161603] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-22T18:20:56.172577] [INFO ] [REMOTE ] DOC: Full fetch complete (77595 records). [2025-10-22T18:20:56.172787] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-22T18:20:56.569524] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-22T18:20:56.569617] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-22T18:20:56.570507] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-22T18:20:56.570566] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-22T18:20:56.572092] [DEBUG] [LOCAL ] DOC: Trimmed 77595 records to 53555 (keeping 200 days of data) [2025-10-22T18:20:56.893384] [DEBUG] [LOCAL ] DOC: Primary data saved (53555 records). [2025-10-22T18:20:56.893519] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-22T18:20:56.893596] [INFO ] [MAIN ] Update Progress: 640/2367 symbols completed. DOC took 26.4s. Estimated remaining: 3h 38m 14s. Rate: 7.9 symbols/min [2025-10-22T18:20:57.417219] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:57.531286] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:57.512148] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:57.548038] [DEBUG] [LOCAL ] DOLE: No existing data file found in primary storage. [2025-10-22T18:20:57.571087] [WARN ] [MAIN ] DOLE: No existing data found, performing full refresh instead. [2025-10-22T18:20:57.603310] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-22T18:20:57.603087] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:20:57.603815] [DEBUG] [LOCAL ] DOCS: No existing data file found in primary storage. [2025-10-22T18:20:57.603732] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-22T18:20:57.603944] [WARN ] [MAIN ] DOCS: No existing data found, performing full refresh instead. [2025-10-22T18:20:57.604157] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-22T18:20:57.604207] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-22T18:20:57.604249] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-22T18:20:57.604281] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-22T18:20:57.604056] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-10-22T18:20:57.624943] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-22T18:20:57.893855] [DEBUG] [LOCAL ] DOUG: Loaded 33846 existing records from primary storage. [2025-10-22T18:20:57.928734] [INFO ] [MAIN ] DOUG: Loaded 33846 existing records. [2025-10-22T18:20:58.145453] [DEBUG] [LOCAL ] DOCN: Loaded 51135 existing records from primary storage. [2025-10-22T18:20:58.217132] [INFO ] [MAIN ] DOCN: Loaded 51135 existing records. [2025-10-22T18:20:58.642736] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:20:58.669880] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:58.712020] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-22T18:20:58.731225] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-22T18:20:58.776441] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-22T18:20:58.812859] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:20:58.784343] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-22T18:20:58.837083] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-22T18:20:58.836593] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-22T18:20:58.842741] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:58.854302] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-22T18:20:58.874269] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-22T18:20:58.912125] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-22T18:20:58.919192] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-22T18:20:59.533917] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:59.535327] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-22T18:20:59.554977] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:20:59.555356] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-22T18:21:00.480052] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T18:21:00.490022] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-22T18:21:00.574180] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T18:21:00.583933] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-22T18:21:01.618359] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T18:21:01.626169] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-22T18:21:01.747537] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-22T18:21:01.757296] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-22T18:21:02.461883] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-22T18:21:02.468417] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-22T18:21:02.958696] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-22T18:21:02.969106] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-22T18:21:03.544696] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-22T18:21:03.553115] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-22T18:21:03.646496] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T18:21:03.656420] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-22T18:21:03.999202] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T18:21:04.006489] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-22T18:21:04.910761] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T18:21:04.921614] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-22T18:21:04.962365] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T18:21:04.970570] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-22T18:21:05.005716] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T18:21:05.016815] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-22T18:21:05.510704] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T18:21:05.717780] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-22T18:21:06.367153] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T18:21:06.480504] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-22T18:21:06.527352] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-22T18:21:06.547867] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T18:21:07.328526] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-22T18:21:07.334168] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T18:21:08.127861] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-22T18:21:08.132698] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T18:21:08.917711] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-22T18:21:09.174562] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T18:21:09.717755] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-22T18:21:10.024567] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T18:21:10.074871] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-22T18:21:10.517753] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-22T18:21:11.317731] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-22T18:21:11.613517] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-22T18:21:12.049409] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T18:21:12.117617] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-22T18:21:12.782303] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T18:21:12.917617] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-22T18:21:13.000208] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T18:21:13.717737] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-22T18:21:14.517705] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-22T18:21:14.736563] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T18:21:15.317065] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T18:21:15.323957] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-22T18:21:15.447193] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T18:21:16.117739] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-22T18:21:16.917721] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-22T18:21:17.324977] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-22T18:21:17.472431] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T18:21:17.477616] [INFO ] [REMOTE ] DOUG: Full fetch complete (50003 records). [2025-10-22T18:21:17.477835] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-22T18:21:17.729005] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-22T18:21:17.856899] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-22T18:21:17.856978] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-22T18:21:17.857616] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-22T18:21:17.857724] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-22T18:21:17.858688] [DEBUG] [LOCAL ] DOUG: Trimmed 50003 records to 33811 (keeping 200 days of data) [2025-10-22T18:21:18.043257] [DEBUG] [LOCAL ] DOUG: Primary data saved (33811 records). [2025-10-22T18:21:18.043397] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-22T18:21:18.043475] [INFO ] [MAIN ] Update Progress: 641/2367 symbols completed. DOUG took 21.1s. Estimated remaining: 3h 38m 42s. Rate: 7.9 symbols/min [2025-10-22T18:21:18.210545] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:21:18.252961] [DEBUG] [LOCAL ] DOV: Loaded 45577 existing records from primary storage. [2025-10-22T18:21:18.253275] [INFO ] [MAIN ] DOV: Loaded 45577 existing records. [2025-10-22T18:21:18.434464] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:21:18.434794] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-22T18:21:18.434897] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-22T18:21:18.435153] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-22T18:21:18.435213] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-22T18:21:18.531804] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-22T18:21:18.561848] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T18:21:18.817920] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:21:19.185234] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-22T18:21:19.317700] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-22T18:21:20.117617] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-22T18:21:20.625829] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-22T18:21:20.917875] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-22T18:21:20.920505] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T18:21:21.233901] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-22T18:21:21.717733] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-22T18:21:22.517716] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-22T18:21:22.599895] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T18:21:23.317719] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-22T18:21:23.705958] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-22T18:21:24.117713] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-22T18:21:24.245318] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T18:21:24.917777] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-22T18:21:25.474455] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-22T18:21:25.483371] [INFO ] [REMOTE ] DOCN: Full fetch complete (72961 records). [2025-10-22T18:21:25.483515] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-22T18:21:25.723962] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-22T18:21:25.906628] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-22T18:21:25.919563] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-22T18:21:25.928070] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-22T18:21:25.928224] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-22T18:21:25.930339] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T18:21:25.939484] [DEBUG] [LOCAL ] DOCN: Trimmed 72961 records to 51129 (keeping 200 days of data) [2025-10-22T18:21:26.244270] [DEBUG] [LOCAL ] DOCN: Primary data saved (51129 records). [2025-10-22T18:21:26.244841] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-22T18:21:26.244943] [INFO ] [MAIN ] Update Progress: 642/2367 symbols completed. DOCN took 29.4s. Estimated remaining: 3h 38m 36s. Rate: 7.9 symbols/min [2025-10-22T18:21:26.425156] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:21:26.425437] [DEBUG] [LOCAL ] DOW: No existing data file found in primary storage. [2025-10-22T18:21:26.425498] [WARN ] [MAIN ] DOW: No existing data found, performing full refresh instead. [2025-10-22T18:21:26.425680] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-22T18:21:26.425925] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-22T18:21:26.425972] [DEBUG] [LOCAL ] DOW: No primary data file found to delete. [2025-10-22T18:21:26.426005] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-22T18:21:26.522159] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-22T18:21:26.747417] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T18:21:26.794351] [INFO ] [REMOTE ] DOLE: Full fetch complete (54407 records). [2025-10-22T18:21:26.831949] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-22T18:21:26.835764] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:21:26.837123] [FATAL] [VALIDATOR ] DOLE: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:21:26.837259] [FATAL] [MAIN ] DOLE: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:21:26.837323] [WARN ] [MAIN ] DOLE: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:21:26.837586] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-22T18:21:26.837714] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-10-22T18:21:26.837775] [INFO ] [LOCAL ] DOLE: Starting deletion of derivative data. [2025-10-22T18:21:26.837823] [DEBUG] [LOCAL ] DOLE: No derivative data file found to delete. [2025-10-22T18:21:26.837884] [INFO ] [MAIN ] Update Progress: 643/2367 symbols completed. DOLE took 29.9s. Estimated remaining: 3h 38m 10s. Rate: 7.9 symbols/min [2025-10-22T18:21:27.025773] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:21:27.041369] [DEBUG] [LOCAL ] DPG: Loaded 13478 existing records from primary storage. [2025-10-22T18:21:27.041600] [INFO ] [MAIN ] DPG: Loaded 13478 existing records. [2025-10-22T18:21:27.227002] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:21:27.227263] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-22T18:21:27.227319] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-22T18:21:27.227513] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-22T18:21:27.227569] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-22T18:21:27.324068] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-22T18:21:27.586114] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:21:27.839509] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T18:21:27.847340] [INFO ] [REMOTE ] DOCS: Full fetch complete (73764 records). [2025-10-22T18:21:27.847484] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-22T18:21:28.122877] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-22T18:21:28.280083] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-22T18:21:28.280211] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-22T18:21:28.281234] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-22T18:21:28.281620] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-22T18:21:28.283792] [DEBUG] [LOCAL ] DOCS: Trimmed 73764 records to 50353 (keeping 200 days of data) [2025-10-22T18:21:28.539135] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-22T18:21:28.655044] [DEBUG] [LOCAL ] DOCS: Primary data saved (50353 records). [2025-10-22T18:21:28.655161] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-22T18:21:28.655233] [INFO ] [MAIN ] Update Progress: 644/2367 symbols completed. DOCS took 31.8s. Estimated remaining: 3h 37m 47s. Rate: 7.9 symbols/min [2025-10-22T18:21:28.825777] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:21:28.868112] [DEBUG] [LOCAL ] DQ: Loaded 43827 existing records from primary storage. [2025-10-22T18:21:28.868405] [INFO ] [MAIN ] DQ: Loaded 43827 existing records. [2025-10-22T18:21:28.944900] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-22T18:21:29.044233] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T18:21:29.076668] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:21:29.076925] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-22T18:21:29.077024] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-22T18:21:29.077387] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-22T18:21:29.077447] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-22T18:21:29.212405] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T18:21:29.483181] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:21:29.717753] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-22T18:21:30.512335] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T18:21:30.517602] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-22T18:21:30.919892] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T18:21:31.317701] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-22T18:21:31.419474] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-22T18:21:32.117693] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-22T18:21:32.908162] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T18:21:32.917611] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-22T18:21:33.717674] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-22T18:21:34.398839] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-22T18:21:34.517092] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T18:21:34.525820] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-22T18:21:34.629731] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-22T18:21:35.317714] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-22T18:21:36.117683] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-22T18:21:36.169554] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T18:21:36.247951] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T18:21:36.917735] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-22T18:21:37.667138] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T18:21:37.717687] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-22T18:21:38.517726] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-22T18:21:38.641206] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-22T18:21:38.833176] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T18:21:39.317724] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-22T18:21:40.122783] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-22T18:21:40.138923] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T18:21:40.382456] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T18:21:40.917736] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-22T18:21:41.717731] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-22T18:21:41.862268] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T18:21:42.393153] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-22T18:21:42.517714] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-22T18:21:43.317734] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-22T18:21:43.381016] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T18:21:44.117614] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-22T18:21:44.234322] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T18:21:44.683775] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-22T18:21:44.917755] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-22T18:21:45.717737] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-22T18:21:45.930186] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T18:21:46.517719] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-22T18:21:46.982129] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-22T18:21:47.317681] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-22T18:21:47.355221] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T18:21:47.517855] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T18:21:47.520374] [INFO ] [REMOTE ] DPG: Full fetch complete (19007 records). [2025-10-22T18:21:47.520443] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-22T18:21:47.880017] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-22T18:21:47.880094] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-22T18:21:47.880609] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-22T18:21:47.880710] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-22T18:21:47.881470] [DEBUG] [LOCAL ] DPG: Trimmed 19007 records to 13345 (keeping 200 days of data) [2025-10-22T18:21:47.962308] [DEBUG] [LOCAL ] DPG: Primary data saved (13345 records). [2025-10-22T18:21:47.962440] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-22T18:21:47.962520] [INFO ] [MAIN ] Update Progress: 645/2367 symbols completed. DPG took 21.1s. Estimated remaining: 3h 38m 11s. Rate: 7.9 symbols/min [2025-10-22T18:21:48.135732] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:21:48.132202] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-22T18:21:48.174273] [DEBUG] [LOCAL ] DRD: Loaded 37887 existing records from primary storage. [2025-10-22T18:21:48.174560] [INFO ] [MAIN ] DRD: Loaded 37887 existing records. [2025-10-22T18:21:48.351829] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:21:48.352076] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-22T18:21:48.352125] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-22T18:21:48.352412] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-22T18:21:48.352472] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-22T18:21:48.720925] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:21:48.917723] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-22T18:21:49.527109] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-22T18:21:49.593240] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T18:21:49.717686] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-22T18:21:50.120521] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T18:21:50.517710] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-22T18:21:50.983537] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T18:21:51.317719] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-22T18:21:52.117742] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-22T18:21:52.586378] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-22T18:21:52.910189] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T18:21:52.919573] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-22T18:21:53.448115] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T18:21:53.717709] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-22T18:21:54.517710] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-22T18:21:55.091946] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-22T18:21:55.124514] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-22T18:21:55.317711] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-22T18:21:56.117674] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-22T18:21:56.353205] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T18:21:56.361088] [INFO ] [REMOTE ] DOV: Full fetch complete (66122 records). [2025-10-22T18:21:56.361236] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-22T18:21:56.746198] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-22T18:21:56.746420] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-22T18:21:56.747275] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-22T18:21:56.747352] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-22T18:21:56.748637] [DEBUG] [LOCAL ] DOV: Trimmed 66122 records to 45584 (keeping 200 days of data) [2025-10-22T18:21:56.927178] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-22T18:21:56.999091] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T18:21:57.065516] [DEBUG] [LOCAL ] DOV: Primary data saved (45584 records). [2025-10-22T18:21:57.065692] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-22T18:21:57.065791] [INFO ] [MAIN ] Update Progress: 646/2367 symbols completed. DOV took 39.0s. Estimated remaining: 3h 38m 7s. Rate: 7.9 symbols/min [2025-10-22T18:21:57.238294] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:21:57.281214] [DEBUG] [LOCAL ] DRH: Loaded 50269 existing records from primary storage. [2025-10-22T18:21:57.281519] [INFO ] [MAIN ] DRH: Loaded 50269 existing records. [2025-10-22T18:21:57.457363] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:21:57.457587] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-22T18:21:57.457686] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-22T18:21:57.457924] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-22T18:21:57.457979] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-22T18:21:57.728146] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-22T18:21:57.820286] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:21:57.846430] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T18:21:58.517712] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-22T18:21:59.293070] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-22T18:21:59.302735] [INFO ] [REMOTE ] DOW: Full fetch complete (77910 records). [2025-10-22T18:21:59.326212] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-22T18:21:59.323517] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-22T18:21:59.328498] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T18:21:59.781363] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-22T18:21:59.781458] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-22T18:21:59.782412] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-22T18:21:59.782483] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-22T18:21:59.784050] [DEBUG] [LOCAL ] DOW: Trimmed 77910 records to 53733 (keeping 200 days of data) [2025-10-22T18:22:00.119688] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-22T18:22:00.121993] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-10-22T18:22:00.122275] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-22T18:22:00.123243] [INFO ] [MAIN ] Update Progress: 647/2367 symbols completed. DOW took 33.9s. Estimated remaining: 3h 37m 47s. Rate: 7.9 symbols/min [2025-10-22T18:22:00.300682] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:22:00.344258] [DEBUG] [LOCAL ] DRI: Loaded 47615 existing records from primary storage. [2025-10-22T18:22:00.344568] [INFO ] [MAIN ] DRI: Loaded 47615 existing records. [2025-10-22T18:22:00.526437] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:22:00.526737] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-22T18:22:00.526823] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-22T18:22:00.527011] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-22T18:22:00.527051] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-22T18:22:00.675330] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-22T18:22:00.922775] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-22T18:22:00.987144] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:22:01.395448] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-22T18:22:01.717695] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-22T18:22:01.760875] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T18:22:02.517765] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-22T18:22:02.793378] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T18:22:02.805219] [INFO ] [REMOTE ] DQ: Full fetch complete (63304 records). [2025-10-22T18:22:02.805444] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-22T18:22:02.806552] [FATAL] [VALIDATOR ] DQ: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:22:02.806711] [FATAL] [MAIN ] DQ: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:22:02.807084] [WARN ] [MAIN ] DQ: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:22:02.807185] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-22T18:22:02.807282] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-10-22T18:22:02.807345] [INFO ] [LOCAL ] DQ: Starting deletion of derivative data. [2025-10-22T18:22:02.807522] [DEBUG] [LOCAL ] DQ: Deleted derivative data file. [2025-10-22T18:22:02.809939] [INFO ] [MAIN ] Update Progress: 648/2367 symbols completed. DQ took 34.2s. Estimated remaining: 3h 37m 27s. Rate: 7.9 symbols/min [2025-10-22T18:22:03.063973] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:22:03.078926] [DEBUG] [LOCAL ] DRLL: Loaded 8769 existing records from primary storage. [2025-10-22T18:22:03.079187] [INFO ] [MAIN ] DRLL: Loaded 8769 existing records. [2025-10-22T18:22:03.280033] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:22:03.280750] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-22T18:22:03.280938] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-22T18:22:03.281251] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-22T18:22:03.281359] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-22T18:22:03.322922] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-22T18:22:03.576411] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T18:22:03.699109] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:22:03.886286] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T18:22:04.117714] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-22T18:22:04.909481] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T18:22:04.922957] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-22T18:22:05.015476] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-22T18:22:05.717718] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-22T18:22:06.347818] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T18:22:06.517705] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-22T18:22:07.317620] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-22T18:22:07.743291] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-22T18:22:08.117675] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-22T18:22:08.263060] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-22T18:22:08.501934] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T18:22:08.917699] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-22T18:22:09.501593] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T18:22:09.717703] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-22T18:22:10.326101] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T18:22:10.517706] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-22T18:22:11.317885] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-22T18:22:11.344224] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-22T18:22:11.391343] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T18:22:12.117676] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-22T18:22:12.917686] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-22T18:22:13.039234] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-22T18:22:13.345961] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-22T18:22:13.353903] [INFO ] [REMOTE ] DRD: Full fetch complete (52158 records). [2025-10-22T18:22:13.354116] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-22T18:22:13.722718] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-22T18:22:13.739912] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-22T18:22:13.741091] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-22T18:22:13.741939] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-22T18:22:13.742008] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-22T18:22:13.743181] [DEBUG] [LOCAL ] DRD: Trimmed 52158 records to 37899 (keeping 200 days of data) [2025-10-22T18:22:13.979221] [DEBUG] [LOCAL ] DRD: Primary data saved (37899 records). [2025-10-22T18:22:13.979357] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-22T18:22:13.979447] [INFO ] [MAIN ] Update Progress: 649/2367 symbols completed. DRD took 26.0s. Estimated remaining: 3h 37m 29s. Rate: 7.9 symbols/min [2025-10-22T18:22:14.158067] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:22:14.158272] [DEBUG] [LOCAL ] DSL: No existing data file found in primary storage. [2025-10-22T18:22:14.158326] [WARN ] [MAIN ] DSL: No existing data found, performing full refresh instead. [2025-10-22T18:22:14.158458] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-22T18:22:14.158510] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-22T18:22:14.158552] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-10-22T18:22:14.158585] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-22T18:22:14.510259] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:22:14.517611] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-22T18:22:14.856334] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-22T18:22:15.317720] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-22T18:22:15.555623] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T18:22:15.638027] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T18:22:16.117697] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-22T18:22:16.917700] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-22T18:22:17.275544] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-22T18:22:17.352261] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T18:22:17.717721] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-22T18:22:18.212026] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-22T18:22:18.430854] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-22T18:22:18.517673] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-22T18:22:19.272763] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T18:22:19.317720] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-22T18:22:20.117715] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-22T18:22:20.675909] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T18:22:20.917710] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-22T18:22:21.381810] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-22T18:22:21.717693] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-22T18:22:21.839052] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T18:22:22.517730] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-22T18:22:23.317734] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-22T18:22:23.384724] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T18:22:23.756553] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-22T18:22:24.122943] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-22T18:22:24.131735] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T18:22:24.917714] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-22T18:22:25.717700] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-22T18:22:25.923275] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T18:22:26.060882] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T18:22:26.517711] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-22T18:22:27.317689] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-22T18:22:27.433594] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T18:22:28.117618] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-22T18:22:28.168077] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T18:22:28.344990] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T18:22:28.917714] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-22T18:22:29.034352] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-22T18:22:29.717696] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-22T18:22:30.323322] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T18:22:30.517709] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-22T18:22:30.561176] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T18:22:30.569630] [INFO ] [REMOTE ] DRI: Full fetch complete (69505 records). [2025-10-22T18:22:30.569842] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-22T18:22:30.992319] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-22T18:22:30.992418] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-22T18:22:30.993326] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-22T18:22:30.993401] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-22T18:22:30.994902] [DEBUG] [LOCAL ] DRI: Trimmed 69505 records to 47513 (keeping 200 days of data) [2025-10-22T18:22:31.320367] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-22T18:22:31.323094] [DEBUG] [LOCAL ] DRI: Primary data saved (47513 records). [2025-10-22T18:22:31.323594] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-22T18:22:31.324474] [INFO ] [MAIN ] Update Progress: 650/2367 symbols completed. DRI took 31.2s. Estimated remaining: 3h 37m 47s. Rate: 7.9 symbols/min [2025-10-22T18:22:31.436730] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T18:22:31.508061] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:22:31.521331] [DEBUG] [LOCAL ] DSM: Loaded 14103 existing records from primary storage. [2025-10-22T18:22:31.521583] [INFO ] [MAIN ] DSM: Loaded 14103 existing records. [2025-10-22T18:22:31.694425] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:22:31.694689] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-22T18:22:31.694747] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-22T18:22:31.694970] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-22T18:22:31.695008] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-22T18:22:32.056036] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:22:32.117690] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-22T18:22:32.857320] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T18:22:32.859041] [INFO ] [REMOTE ] DRLL: Full fetch complete (14510 records). [2025-10-22T18:22:32.859129] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-22T18:22:32.859527] [FATAL] [VALIDATOR ] DRLL: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:22:32.859613] [FATAL] [MAIN ] DRLL: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:22:32.859711] [WARN ] [MAIN ] DRLL: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:22:32.859766] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-22T18:22:32.859846] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-22T18:22:32.859900] [INFO ] [LOCAL ] DRLL: Starting deletion of derivative data. [2025-10-22T18:22:32.860052] [DEBUG] [LOCAL ] DRLL: Deleted derivative data file. [2025-10-22T18:22:32.860136] [INFO ] [MAIN ] Update Progress: 651/2367 symbols completed. DRLL took 30.0s. Estimated remaining: 3h 37m 23s. Rate: 7.9 symbols/min [2025-10-22T18:22:32.920834] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-22T18:22:33.047680] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:22:33.047877] [DEBUG] [LOCAL ] DSMC: No existing data file found in primary storage. [2025-10-22T18:22:33.048020] [WARN ] [MAIN ] DSMC: No existing data found, performing full refresh instead. [2025-10-22T18:22:33.048167] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-22T18:22:33.048264] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-22T18:22:33.048382] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-22T18:22:33.048504] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-22T18:22:33.181991] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T18:22:33.246047] [INFO ] [REMOTE ] DRH: Full fetch complete (71605 records). [2025-10-22T18:22:33.263529] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-22T18:22:33.334351] [FATAL] [VALIDATOR ] DRH: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:22:33.352052] [FATAL] [MAIN ] DRH: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:22:33.363993] [WARN ] [MAIN ] DRH: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:22:33.377694] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-22T18:22:33.377817] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-10-22T18:22:33.382302] [INFO ] [LOCAL ] DRH: Starting deletion of derivative data. [2025-10-22T18:22:33.382627] [DEBUG] [LOCAL ] DRH: Deleted derivative data file. [2025-10-22T18:22:33.401223] [INFO ] [MAIN ] Update Progress: 652/2367 symbols completed. DRH took 36.3s. Estimated remaining: 3h 36m 57s. Rate: 7.9 symbols/min [2025-10-22T18:22:33.549691] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:22:33.638362] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:22:33.659112] [DEBUG] [LOCAL ] DSU: Loaded 23023 existing records from primary storage. [2025-10-22T18:22:33.659359] [INFO ] [MAIN ] DSU: Loaded 23023 existing records. [2025-10-22T18:22:33.722872] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-22T18:22:33.836970] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:22:33.837218] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-22T18:22:33.837283] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-22T18:22:33.837496] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-22T18:22:33.837555] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-22T18:22:34.154457] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T18:22:34.222048] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:22:34.318531] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-22T18:22:34.517710] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-22T18:22:35.317727] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-22T18:22:35.954924] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T18:22:36.117709] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-22T18:22:36.216045] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-22T18:22:36.591895] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-22T18:22:36.917755] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-22T18:22:37.717733] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-22T18:22:38.044054] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T18:22:38.517685] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-22T18:22:38.762779] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T18:22:39.317725] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-22T18:22:39.345898] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T18:22:39.867238] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-22T18:22:40.117706] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-22T18:22:40.917695] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-22T18:22:41.538921] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T18:22:41.638582] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-22T18:22:41.717734] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-22T18:22:42.517696] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-22T18:22:42.823494] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T18:22:43.317703] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-22T18:22:43.435479] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-22T18:22:44.117741] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-22T18:22:44.529405] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T18:22:44.917717] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-22T18:22:45.252892] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T18:22:45.717744] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-22T18:22:46.170317] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T18:22:46.517678] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-22T18:22:46.843989] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T18:22:47.317689] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-22T18:22:47.755998] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T18:22:47.762667] [INFO ] [REMOTE ] DSL: Full fetch complete (41780 records). [2025-10-22T18:22:47.762770] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-22T18:22:48.125606] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-22T18:22:48.181242] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-22T18:22:48.181354] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-22T18:22:48.182054] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-22T18:22:48.182118] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-22T18:22:48.183132] [DEBUG] [LOCAL ] DSL: Trimmed 41780 records to 28887 (keeping 200 days of data) [2025-10-22T18:22:48.371891] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-22T18:22:48.382176] [DEBUG] [LOCAL ] DSL: Primary data saved (28887 records). [2025-10-22T18:22:48.382278] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-22T18:22:48.382381] [INFO ] [MAIN ] Update Progress: 653/2367 symbols completed. DSL took 34.4s. Estimated remaining: 3h 37m 9s. Rate: 7.9 symbols/min [2025-10-22T18:22:48.563930] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:22:48.586180] [DEBUG] [LOCAL ] DSX: Loaded 23594 existing records from primary storage. [2025-10-22T18:22:48.586451] [INFO ] [MAIN ] DSX: Loaded 23594 existing records. [2025-10-22T18:22:48.766905] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:22:48.767175] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-22T18:22:48.767228] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-22T18:22:48.767397] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-22T18:22:48.767434] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-22T18:22:48.853052] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-22T18:22:48.917955] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-22T18:22:49.126047] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:22:49.455758] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-22T18:22:49.717708] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-22T18:22:50.517514] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-22T18:22:50.517726] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-22T18:22:51.317706] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-22T18:22:51.697914] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T18:22:52.117686] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-22T18:22:52.201134] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T18:22:52.917748] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-22T18:22:53.286375] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-22T18:22:53.309113] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T18:22:53.717726] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-22T18:22:54.517777] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-22T18:22:54.805450] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T18:22:54.949178] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-22T18:22:55.317819] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-22T18:22:56.117745] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-22T18:22:56.602279] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T18:22:56.917738] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-22T18:22:57.043691] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T18:22:57.717744] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-22T18:22:58.296853] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T18:22:58.517788] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-22T18:22:58.920444] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-22T18:22:59.317671] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-22T18:23:00.117756] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-22T18:23:00.917780] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-22T18:23:05.126601] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (6.61 seconds). [2025-10-22T18:23:05.128984] [INFO ] [REMOTE ] DSM: Full fetch complete (23985 records). [2025-10-22T18:23:05.129059] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-22T18:23:05.414622] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (6.10 seconds). [2025-10-22T18:23:05.433213] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-22T18:23:05.504810] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-22T18:23:05.504912] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-22T18:23:05.505398] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-22T18:23:05.505439] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-22T18:23:05.506843] [DEBUG] [LOCAL ] DSM: Trimmed 23985 records to 14178 (keeping 200 days of data) [2025-10-22T18:23:05.587901] [DEBUG] [LOCAL ] DSM: Primary data saved (14178 records). [2025-10-22T18:23:05.588045] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-22T18:23:05.588123] [INFO ] [MAIN ] Update Progress: 654/2367 symbols completed. DSM took 34.3s. Estimated remaining: 3h 37m 26s. Rate: 7.9 symbols/min [2025-10-22T18:23:05.755878] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:05.769563] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (4.85 seconds). [2025-10-22T18:23:05.774774] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-22T18:23:05.821305] [DEBUG] [LOCAL ] DT: Loaded 52954 existing records from primary storage. [2025-10-22T18:23:05.821603] [INFO ] [MAIN ] DT: Loaded 52954 existing records. [2025-10-22T18:23:05.997747] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:23:05.997940] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-22T18:23:05.997987] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-22T18:23:05.998171] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-22T18:23:05.998208] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-22T18:23:06.287268] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (6.17 seconds). [2025-10-22T18:23:06.298464] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-22T18:23:06.300410] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-22T18:23:06.301048] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-22T18:23:06.381243] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:06.381743] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-22T18:23:06.832578] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-22T18:23:06.833436] [INFO ] [REMOTE ] DSMC: Full fetch complete (2859 records). [2025-10-22T18:23:06.833503] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-22T18:23:06.833867] [FATAL] [VALIDATOR ] DSMC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:23:06.833947] [FATAL] [MAIN ] DSMC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:23:06.833990] [WARN ] [MAIN ] DSMC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:23:06.834029] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-22T18:23:06.834160] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-22T18:23:06.834211] [INFO ] [LOCAL ] DSMC: Starting deletion of derivative data. [2025-10-22T18:23:06.834252] [DEBUG] [LOCAL ] DSMC: No derivative data file found to delete. [2025-10-22T18:23:06.834303] [INFO ] [MAIN ] Update Progress: 655/2367 symbols completed. DSMC took 34.0s. Estimated remaining: 3h 37m 2s. Rate: 7.9 symbols/min [2025-10-22T18:23:07.003168] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:07.019686] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-22T18:23:07.027827] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-22T18:23:07.031436] [DEBUG] [LOCAL ] DTB: Loaded 4919 existing records from primary storage. [2025-10-22T18:23:07.031668] [INFO ] [MAIN ] DTB: Loaded 4919 existing records. [2025-10-22T18:23:07.232743] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:23:07.232984] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-22T18:23:07.233033] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-22T18:23:07.233198] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-22T18:23:07.233256] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-22T18:23:07.584464] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:07.584833] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-22T18:23:07.854291] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T18:23:07.860171] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-22T18:23:08.065955] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-22T18:23:08.117615] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-22T18:23:08.328708] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T18:23:08.569039] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T18:23:08.648792] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T18:23:08.896347] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T18:23:08.900750] [INFO ] [REMOTE ] DSU: Full fetch complete (33150 records). [2025-10-22T18:23:08.900833] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-22T18:23:08.922841] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-22T18:23:09.284985] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-22T18:23:09.285068] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-22T18:23:09.285676] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-22T18:23:09.285738] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-22T18:23:09.286587] [DEBUG] [LOCAL ] DSU: Trimmed 33150 records to 22871 (keeping 200 days of data) [2025-10-22T18:23:09.425901] [DEBUG] [LOCAL ] DSU: Primary data saved (22871 records). [2025-10-22T18:23:09.426038] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-22T18:23:09.426160] [INFO ] [MAIN ] Update Progress: 656/2367 symbols completed. DSU took 36.0s. Estimated remaining: 3h 36m 42s. Rate: 7.9 symbols/min [2025-10-22T18:23:09.593759] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:09.637315] [DEBUG] [LOCAL ] DTE: Loaded 47181 existing records from primary storage. [2025-10-22T18:23:09.637706] [INFO ] [MAIN ] DTE: Loaded 47181 existing records. [2025-10-22T18:23:09.726271] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-22T18:23:09.816003] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:23:09.816239] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-22T18:23:09.816302] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-22T18:23:09.816514] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-22T18:23:09.816571] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-22T18:23:10.175228] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:10.464038] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-22T18:23:10.517683] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-22T18:23:11.227180] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-22T18:23:11.317620] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-22T18:23:12.117705] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-22T18:23:12.742288] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T18:23:12.924904] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-22T18:23:12.930168] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-22T18:23:13.500077] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-22T18:23:13.717710] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-22T18:23:14.297830] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-22T18:23:14.297599] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-22T18:23:14.517672] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-22T18:23:15.117950] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-22T18:23:15.317696] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-22T18:23:16.117716] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-22T18:23:16.472892] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T18:23:16.917716] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-22T18:23:17.621189] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T18:23:17.717641] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-22T18:23:18.098130] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T18:23:18.102292] [INFO ] [REMOTE ] DSX: Full fetch complete (35513 records). [2025-10-22T18:23:18.102372] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-22T18:23:18.479736] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-22T18:23:18.479825] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-22T18:23:18.480439] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-22T18:23:18.480487] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-22T18:23:18.481306] [DEBUG] [LOCAL ] DSX: Trimmed 35513 records to 23496 (keeping 200 days of data) [2025-10-22T18:23:18.530499] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-22T18:23:18.545214] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-22T18:23:18.625545] [DEBUG] [LOCAL ] DSX: Primary data saved (23496 records). [2025-10-22T18:23:18.625709] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-22T18:23:18.625800] [INFO ] [MAIN ] Update Progress: 657/2367 symbols completed. DSX took 30.2s. Estimated remaining: 3h 36m 38s. Rate: 7.9 symbols/min [2025-10-22T18:23:18.809059] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:18.809300] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-22T18:23:18.809356] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-22T18:23:18.809482] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-22T18:23:18.809535] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-22T18:23:18.809581] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-22T18:23:18.809614] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-22T18:23:19.171135] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:19.317740] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-22T18:23:19.897173] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T18:23:20.117723] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-22T18:23:20.564853] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-22T18:23:20.917715] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-22T18:23:21.434903] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-22T18:23:21.717683] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-22T18:23:21.850214] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T18:23:22.517637] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-22T18:23:22.590969] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-22T18:23:22.818842] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-22T18:23:23.317691] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-22T18:23:24.117688] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-22T18:23:24.573269] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-22T18:23:24.917698] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-22T18:23:25.240740] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T18:23:25.489130] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-22T18:23:25.490254] [INFO ] [REMOTE ] DTB: Full fetch complete (6512 records). [2025-10-22T18:23:25.490320] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-22T18:23:25.490756] [FATAL] [VALIDATOR ] DTB: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:23:25.490837] [FATAL] [MAIN ] DTB: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:23:25.490878] [WARN ] [MAIN ] DTB: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:23:25.490944] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-22T18:23:25.491005] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-22T18:23:25.491039] [INFO ] [LOCAL ] DTB: Starting deletion of derivative data. [2025-10-22T18:23:25.491190] [DEBUG] [LOCAL ] DTB: Deleted derivative data file. [2025-10-22T18:23:25.491273] [INFO ] [MAIN ] Update Progress: 658/2367 symbols completed. DTB took 18.7s. Estimated remaining: 3h 36m 29s. Rate: 7.9 symbols/min [2025-10-22T18:23:25.663626] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:25.663828] [DEBUG] [LOCAL ] DTG: No existing data file found in primary storage. [2025-10-22T18:23:25.663886] [WARN ] [MAIN ] DTG: No existing data found, performing full refresh instead. [2025-10-22T18:23:25.663997] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-22T18:23:25.664038] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-22T18:23:25.664120] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-22T18:23:25.664176] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-22T18:23:25.724695] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-22T18:23:26.023006] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:26.517594] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-22T18:23:27.036276] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-22T18:23:27.317760] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-22T18:23:27.526929] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T18:23:28.090882] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T18:23:28.117610] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-22T18:23:28.797691] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-22T18:23:28.917740] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-22T18:23:29.635108] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-22T18:23:29.717711] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-22T18:23:30.517727] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-22T18:23:31.241117] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T18:23:31.283137] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T18:23:31.317620] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-22T18:23:32.117713] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-22T18:23:32.607413] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-22T18:23:32.917679] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-22T18:23:33.055851] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T18:23:33.274242] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-22T18:23:33.717717] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-22T18:23:34.364081] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-22T18:23:34.517703] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-22T18:23:35.317710] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-22T18:23:35.753837] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-22T18:23:36.117677] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-22T18:23:36.389045] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T18:23:36.684123] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-22T18:23:36.917688] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-22T18:23:37.587099] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-22T18:23:37.717734] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-22T18:23:38.517729] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-22T18:23:39.317742] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-22T18:23:39.716792] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-22T18:23:39.859686] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-22T18:23:40.056360] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T18:23:40.117620] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-22T18:23:40.917738] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-22T18:23:41.422434] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-22T18:23:41.423263] [INFO ] [REMOTE ] DTF: Full fetch complete (1746 records). [2025-10-22T18:23:41.423333] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-22T18:23:41.613607] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-22T18:23:41.613839] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:23:41.613910] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:23:41.613990] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-22T18:23:41.614097] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-22T18:23:41.614167] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-22T18:23:41.614231] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-22T18:23:41.614306] [INFO ] [MAIN ] Update Progress: 659/2367 symbols completed. DTF took 23.0s. Estimated remaining: 3h 36m 43s. Rate: 7.9 symbols/min [2025-10-22T18:23:41.723947] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-22T18:23:41.799526] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:41.799928] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-22T18:23:41.800001] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-22T18:23:41.800118] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-22T18:23:41.800160] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-22T18:23:41.800204] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-22T18:23:41.800282] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-22T18:23:42.192620] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T18:23:42.196684] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:42.204753] [INFO ] [REMOTE ] DTE: Full fetch complete (68912 records). [2025-10-22T18:23:42.204909] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-22T18:23:42.518544] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-22T18:23:42.536548] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T18:23:42.620247] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-22T18:23:42.620327] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-22T18:23:42.621168] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-22T18:23:42.621230] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-22T18:23:42.622454] [DEBUG] [LOCAL ] DTE: Trimmed 68912 records to 47121 (keeping 200 days of data) [2025-10-22T18:23:42.907842] [DEBUG] [LOCAL ] DTE: Primary data saved (47121 records). [2025-10-22T18:23:42.907966] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-22T18:23:42.908042] [INFO ] [MAIN ] Update Progress: 660/2367 symbols completed. DTE took 33.5s. Estimated remaining: 3h 36m 19s. Rate: 7.9 symbols/min [2025-10-22T18:23:43.076185] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:43.118717] [DEBUG] [LOCAL ] DTM: Loaded 43736 existing records from primary storage. [2025-10-22T18:23:43.119085] [INFO ] [MAIN ] DTM: Loaded 43736 existing records. [2025-10-22T18:23:43.289557] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:23:43.289820] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-22T18:23:43.289891] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-22T18:23:43.290130] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-22T18:23:43.290320] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-22T18:23:43.322873] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-10-22T18:23:43.601270] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T18:23:43.635985] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-10-22T18:23:43.637717] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:23:43.640793] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:43.640915] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-22T18:23:43.641061] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:23:43.641403] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-22T18:23:43.641490] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-22T18:23:43.641530] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-22T18:23:43.641570] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-22T18:23:43.641621] [INFO ] [MAIN ] Update Progress: 661/2367 symbols completed. DTK took 2.0s. Estimated remaining: 3h 35m 54s. Rate: 7.9 symbols/min [2025-10-22T18:23:43.828431] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:43.828724] [DEBUG] [LOCAL ] DTW: No existing data file found in primary storage. [2025-10-22T18:23:43.828781] [WARN ] [MAIN ] DTW: No existing data found, performing full refresh instead. [2025-10-22T18:23:43.828907] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-22T18:23:43.828955] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-22T18:23:43.829002] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-22T18:23:43.829037] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-22T18:23:44.118318] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-22T18:23:44.241392] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:44.274939] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T18:23:44.873218] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-22T18:23:44.917713] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-22T18:23:45.549959] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-22T18:23:45.717755] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-22T18:23:46.507712] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T18:23:46.517615] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-22T18:23:47.085759] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-22T18:23:47.317739] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-22T18:23:48.117766] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-22T18:23:48.917713] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-22T18:23:48.978095] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T18:23:49.646039] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-22T18:23:49.647747] [INFO ] [REMOTE ] DTG: Full fetch complete (8574 records). [2025-10-22T18:23:49.647822] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-22T18:23:49.727921] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-22T18:23:50.031822] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-22T18:23:50.031992] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-22T18:23:50.032429] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-22T18:23:50.050760] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-22T18:23:50.067605] [DEBUG] [LOCAL ] DTG: Trimmed 8574 records to 5687 (keeping 200 days of data) [2025-10-22T18:23:50.070882] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T18:23:50.122627] [DEBUG] [LOCAL ] DTG: Primary data saved (5687 records). [2025-10-22T18:23:50.122812] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-22T18:23:50.122890] [INFO ] [MAIN ] Update Progress: 662/2367 symbols completed. DTG took 24.6s. Estimated remaining: 3h 35m 43s. Rate: 7.9 symbols/min [2025-10-22T18:23:50.301637] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:23:50.367618] [DEBUG] [LOCAL ] DUK: Loaded 53437 existing records from primary storage. [2025-10-22T18:23:50.368009] [INFO ] [MAIN ] DUK: Loaded 53437 existing records. [2025-10-22T18:23:50.454917] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-22T18:23:50.522820] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-22T18:23:50.562954] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:23:50.563230] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-22T18:23:50.563288] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-22T18:23:50.563740] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-22T18:23:50.563796] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-22T18:23:50.909388] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:23:51.317728] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-22T18:23:51.989930] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-22T18:23:52.117793] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-22T18:23:52.709921] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-22T18:23:52.917726] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-22T18:23:53.511315] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-22T18:23:53.717671] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-22T18:23:53.903895] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T18:23:54.517706] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-22T18:23:55.317685] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-22T18:23:55.386993] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T18:23:56.117730] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-22T18:23:56.261417] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T18:23:56.634462] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-22T18:23:56.917673] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-22T18:23:56.994084] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T18:23:57.585217] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-22T18:23:57.717731] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-22T18:23:58.517693] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-22T18:23:59.317744] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-22T18:23:59.540238] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T18:23:59.951168] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-22T18:24:00.117688] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-22T18:24:00.284083] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T18:24:00.917696] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-22T18:24:01.722740] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-22T18:24:01.740938] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-22T18:24:01.750080] [INFO ] [REMOTE ] DT: Full fetch complete (76914 records). [2025-10-22T18:24:01.750207] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-22T18:24:02.138569] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-22T18:24:02.138673] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-22T18:24:02.139540] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-22T18:24:02.139582] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-22T18:24:02.140986] [DEBUG] [LOCAL ] DT: Trimmed 76914 records to 52954 (keeping 200 days of data) [2025-10-22T18:24:02.450738] [DEBUG] [LOCAL ] DT: Primary data saved (52954 records). [2025-10-22T18:24:02.450878] [INFO ] [MAIN ] DT: Full history saved. [2025-10-22T18:24:02.450983] [INFO ] [MAIN ] Update Progress: 663/2367 symbols completed. DT took 56.9s. Estimated remaining: 3h 35m 48s. Rate: 7.9 symbols/min [2025-10-22T18:24:02.525216] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-22T18:24:02.621516] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:24:02.629133] [DEBUG] [LOCAL ] DUKB: Loaded 6174 existing records from primary storage. [2025-10-22T18:24:02.629296] [INFO ] [MAIN ] DUKB: Loaded 6174 existing records. [2025-10-22T18:24:02.805812] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:24:02.806146] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-22T18:24:02.806275] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-22T18:24:02.806464] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-22T18:24:02.806579] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-22T18:24:03.191234] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:24:03.193140] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-22T18:24:03.208844] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T18:24:03.317620] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-22T18:24:03.550417] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T18:24:04.117725] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-22T18:24:04.804174] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T18:24:04.917735] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-22T18:24:05.531989] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-22T18:24:05.533361] [INFO ] [REMOTE ] DTW: Full fetch complete (6952 records). [2025-10-22T18:24:05.533465] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-22T18:24:05.728790] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-22T18:24:05.951070] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-22T18:24:05.951171] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-22T18:24:05.951370] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-22T18:24:05.951409] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-22T18:24:05.951854] [DEBUG] [LOCAL ] DTW: Trimmed 6952 records to 4713 (keeping 200 days of data) [2025-10-22T18:24:05.981312] [DEBUG] [LOCAL ] DTW: Primary data saved (4713 records). [2025-10-22T18:24:05.981446] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-22T18:24:05.981520] [INFO ] [MAIN ] Update Progress: 664/2367 symbols completed. DTW took 22.3s. Estimated remaining: 3h 35m 30s. Rate: 7.9 symbols/min [2025-10-22T18:24:06.150310] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-22T18:24:06.192904] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:24:06.242883] [DEBUG] [LOCAL ] DV: Loaded 51247 existing records from primary storage. [2025-10-22T18:24:06.243211] [INFO ] [MAIN ] DV: Loaded 51247 existing records. [2025-10-22T18:24:06.417758] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:24:06.418003] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-22T18:24:06.418052] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-22T18:24:06.418233] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-22T18:24:06.418271] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-22T18:24:06.520851] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-22T18:24:06.800711] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T18:24:06.804717] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:24:07.317686] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-22T18:24:08.117713] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-22T18:24:08.566071] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-22T18:24:08.917719] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-22T18:24:08.966398] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T18:24:09.527998] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T18:24:09.608699] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T18:24:09.717694] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-22T18:24:10.517759] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-22T18:24:11.133548] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T18:24:11.317712] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-22T18:24:11.850149] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-22T18:24:12.117742] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-22T18:24:12.917680] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-22T18:24:13.048280] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T18:24:13.315543] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T18:24:13.717716] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-22T18:24:14.517695] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-22T18:24:14.931279] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-22T18:24:15.317728] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-22T18:24:15.372600] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T18:24:16.117735] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-22T18:24:16.317023] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T18:24:16.917711] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-22T18:24:17.228390] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-22T18:24:17.325501] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T18:24:17.717687] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-22T18:24:18.440623] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T18:24:18.517702] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-22T18:24:19.089631] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T18:24:19.317728] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-22T18:24:20.117718] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-22T18:24:20.461621] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T18:24:20.470092] [INFO ] [REMOTE ] DUK: Full fetch complete (77182 records). [2025-10-22T18:24:20.470245] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-22T18:24:20.471116] [FATAL] [VALIDATOR ] DUK: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:24:20.471214] [FATAL] [MAIN ] DUK: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:24:20.471262] [WARN ] [MAIN ] DUK: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:24:20.471341] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-22T18:24:20.471421] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-22T18:24:20.471471] [INFO ] [LOCAL ] DUK: Starting deletion of derivative data. [2025-10-22T18:24:20.471710] [DEBUG] [LOCAL ] DUK: Deleted derivative data file. [2025-10-22T18:24:20.472422] [INFO ] [MAIN ] Update Progress: 665/2367 symbols completed. DUK took 30.3s. Estimated remaining: 3h 35m 40s. Rate: 7.9 symbols/min [2025-10-22T18:24:20.644488] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:24:20.687063] [DEBUG] [LOCAL ] DVA: Loaded 40739 existing records from primary storage. [2025-10-22T18:24:20.687338] [INFO ] [MAIN ] DVA: Loaded 40739 existing records. [2025-10-22T18:24:20.868897] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:24:20.869119] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-22T18:24:20.869276] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-22T18:24:20.869803] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-22T18:24:20.869861] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-22T18:24:20.928763] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-22T18:24:21.160677] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T18:24:21.280845] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:24:21.616128] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-22T18:24:21.717691] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-22T18:24:21.886204] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T18:24:21.894017] [INFO ] [REMOTE ] DTM: Full fetch complete (65140 records). [2025-10-22T18:24:21.894195] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-22T18:24:22.290528] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-22T18:24:22.296711] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-22T18:24:22.296935] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-22T18:24:22.300401] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-22T18:24:22.300469] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-22T18:24:22.301559] [DEBUG] [LOCAL ] DTM: Trimmed 65140 records to 43686 (keeping 200 days of data) [2025-10-22T18:24:22.520784] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-22T18:24:22.566752] [DEBUG] [LOCAL ] DTM: Primary data saved (43686 records). [2025-10-22T18:24:22.566852] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-22T18:24:22.566926] [INFO ] [MAIN ] Update Progress: 666/2367 symbols completed. DTM took 39.7s. Estimated remaining: 3h 35m 18s. Rate: 7.9 symbols/min [2025-10-22T18:24:22.732595] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:24:22.732787] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-10-22T18:24:22.732829] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-10-22T18:24:22.732934] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-22T18:24:22.732975] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-22T18:24:22.733016] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-22T18:24:22.733048] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-22T18:24:23.081587] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:24:23.317690] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-22T18:24:23.922548] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T18:24:23.996867] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-22T18:24:24.117669] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-22T18:24:24.917690] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-22T18:24:25.508558] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-22T18:24:25.717695] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-22T18:24:25.830452] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T18:24:26.517725] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-22T18:24:27.105033] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-22T18:24:27.317693] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-22T18:24:27.773518] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-22T18:24:28.117711] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-22T18:24:28.864390] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T18:24:28.917693] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-22T18:24:29.717680] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-22T18:24:30.041674] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-22T18:24:30.388136] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-22T18:24:30.389786] [INFO ] [REMOTE ] DUKB: Full fetch complete (8985 records). [2025-10-22T18:24:30.390017] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-22T18:24:30.519843] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-22T18:24:30.765144] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-22T18:24:30.773401] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-22T18:24:30.787915] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-22T18:24:30.788078] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-22T18:24:30.789888] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T18:24:30.799025] [DEBUG] [LOCAL ] DUKB: Trimmed 8985 records to 6134 (keeping 200 days of data) [2025-10-22T18:24:30.837158] [DEBUG] [LOCAL ] DUKB: Primary data saved (6134 records). [2025-10-22T18:24:30.837284] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-22T18:24:30.837361] [INFO ] [MAIN ] Update Progress: 667/2367 symbols completed. DUKB took 28.4s. Estimated remaining: 3h 35m 12s. Rate: 7.9 symbols/min [2025-10-22T18:24:31.001398] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:24:31.001554] [DEBUG] [LOCAL ] DX: No existing data file found in primary storage. [2025-10-22T18:24:31.001591] [WARN ] [MAIN ] DX: No existing data found, performing full refresh instead. [2025-10-22T18:24:31.001749] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-22T18:24:31.001821] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-22T18:24:31.001876] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-22T18:24:31.001910] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-22T18:24:31.322816] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-22T18:24:31.354405] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:24:32.117728] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-22T18:24:32.413130] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T18:24:32.917738] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-22T18:24:33.070731] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T18:24:33.717717] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-22T18:24:33.925005] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T18:24:34.517716] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-22T18:24:34.914388] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T18:24:35.322747] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-22T18:24:35.343094] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T18:24:36.117690] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-22T18:24:36.220715] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T18:24:36.917724] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-22T18:24:36.951065] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T18:24:37.717738] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-22T18:24:38.282084] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-22T18:24:38.321358] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T18:24:38.517718] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-22T18:24:39.317685] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-22T18:24:39.646276] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T18:24:39.724895] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T18:24:40.117758] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-22T18:24:40.917707] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-22T18:24:41.279186] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-22T18:24:41.717727] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-22T18:24:42.159582] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T18:24:42.502484] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T18:24:42.517610] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-22T18:24:43.317714] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-22T18:24:43.934924] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-22T18:24:44.039274] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T18:24:44.117682] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-22T18:24:44.917697] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-22T18:24:45.249138] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T18:24:45.260764] [INFO ] [REMOTE ] DV: Full fetch complete (73883 records). [2025-10-22T18:24:45.260918] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-22T18:24:45.655473] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-22T18:24:45.655717] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-22T18:24:45.656670] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-22T18:24:45.656824] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-22T18:24:45.658331] [DEBUG] [LOCAL ] DV: Trimmed 73883 records to 51241 (keeping 200 days of data) [2025-10-22T18:24:45.720382] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-22T18:24:45.774900] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T18:24:45.785807] [INFO ] [REMOTE ] DVA: Full fetch complete (59594 records). [2025-10-22T18:24:45.787990] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-22T18:24:46.316525] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-22T18:24:46.316637] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-22T18:24:46.317511] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-22T18:24:46.321543] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-22T18:24:46.331723] [DEBUG] [LOCAL ] DVA: Trimmed 59594 records to 40649 (keeping 200 days of data) [2025-10-22T18:24:46.494619] [DEBUG] [LOCAL ] DV: Primary data saved (51241 records). [2025-10-22T18:24:46.496687] [INFO ] [MAIN ] DV: Full history saved. [2025-10-22T18:24:46.496840] [INFO ] [MAIN ] Update Progress: 668/2367 symbols completed. DV took 40.5s. Estimated remaining: 3h 35m 25s. Rate: 7.9 symbols/min [2025-10-22T18:24:46.748888] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:24:46.824856] [DEBUG] [LOCAL ] DVA: Primary data saved (40649 records). [2025-10-22T18:24:46.825168] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-22T18:24:46.825890] [INFO ] [MAIN ] Update Progress: 669/2367 symbols completed. DVA took 26.4s. Estimated remaining: 3h 34m 59s. Rate: 7.9 symbols/min [2025-10-22T18:24:47.007872] [DEBUG] [LOCAL ] DXC: Loaded 49925 existing records from primary storage. [2025-10-22T18:24:47.034511] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:24:47.034930] [DEBUG] [LOCAL ] DXYZ: No existing data file found in primary storage. [2025-10-22T18:24:47.035213] [INFO ] [MAIN ] DXC: Loaded 49925 existing records. [2025-10-22T18:24:47.035105] [WARN ] [MAIN ] DXYZ: No existing data found, performing full refresh instead. [2025-10-22T18:24:47.090951] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-22T18:24:47.111754] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-22T18:24:47.138737] [DEBUG] [LOCAL ] DXYZ: No primary data file found to delete. [2025-10-22T18:24:47.139060] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-22T18:24:47.343791] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-22T18:24:47.362833] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:24:47.394974] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-22T18:24:47.479719] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-22T18:24:47.480240] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-22T18:24:47.534458] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-22T18:24:47.534621] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-22T18:24:47.864517] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:24:47.897343] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-22T18:24:48.046335] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:24:48.081634] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-22T18:24:48.117720] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-22T18:24:48.917774] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-22T18:24:49.461292] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T18:24:49.567598] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T18:24:49.717720] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-22T18:24:50.375530] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T18:24:50.517667] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-22T18:24:50.580007] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-22T18:24:51.317723] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-22T18:24:51.351664] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T18:24:52.122728] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-22T18:24:52.134767] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T18:24:52.917731] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-22T18:24:52.988210] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T18:24:53.717711] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-22T18:24:54.417372] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-22T18:24:54.427327] [INFO ] [REMOTE ] DVN: Full fetch complete (77489 records). [2025-10-22T18:24:54.427563] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-22T18:24:54.429216] [FATAL] [VALIDATOR ] DVN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:24:54.429382] [FATAL] [MAIN ] DVN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:24:54.429675] [WARN ] [MAIN ] DVN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:24:54.429756] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-22T18:24:54.429837] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-22T18:24:54.429879] [INFO ] [LOCAL ] DVN: Starting deletion of derivative data. [2025-10-22T18:24:54.429921] [DEBUG] [LOCAL ] DVN: No derivative data file found to delete. [2025-10-22T18:24:54.429999] [INFO ] [MAIN ] Update Progress: 670/2367 symbols completed. DVN took 31.9s. Estimated remaining: 3h 34m 52s. Rate: 7.9 symbols/min [2025-10-22T18:24:54.524817] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-22T18:24:54.628716] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:24:54.668238] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T18:24:54.701729] [DEBUG] [LOCAL ] DY: Loaded 28120 existing records from primary storage. [2025-10-22T18:24:54.702013] [INFO ] [MAIN ] DY: Loaded 28120 existing records. [2025-10-22T18:24:54.888058] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:24:54.888321] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-22T18:24:54.888380] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-22T18:24:54.888575] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-22T18:24:54.888632] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-22T18:24:55.263943] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:24:55.317640] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-22T18:24:55.602283] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T18:24:56.117743] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-22T18:24:56.502274] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-22T18:24:56.531970] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T18:24:56.917757] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-22T18:24:57.718632] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T18:24:57.717695] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-22T18:24:57.834248] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-22T18:24:58.517704] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-22T18:24:59.317722] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-22T18:24:59.747577] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-22T18:25:00.117783] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-22T18:25:00.748869] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-22T18:25:00.917721] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-22T18:25:01.217897] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T18:25:01.717724] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-22T18:25:02.517701] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-22T18:25:02.747509] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-22T18:25:03.317769] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-22T18:25:03.686785] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-10-22T18:25:03.726386] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-22T18:25:04.117705] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-22T18:25:04.378197] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T18:25:04.917765] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-22T18:25:05.717744] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-22T18:25:05.826436] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-22T18:25:06.466220] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T18:25:06.528195] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-22T18:25:06.529783] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-22T18:25:06.539125] [INFO ] [REMOTE ] DX: Full fetch complete (75506 records). [2025-10-22T18:25:06.539259] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-22T18:25:06.540061] [FATAL] [VALIDATOR ] DX: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:25:06.540153] [FATAL] [MAIN ] DX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:25:06.540211] [WARN ] [MAIN ] DX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:25:06.540323] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-22T18:25:06.540565] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-22T18:25:06.540707] [INFO ] [LOCAL ] DX: Starting deletion of derivative data. [2025-10-22T18:25:06.540788] [DEBUG] [LOCAL ] DX: No derivative data file found to delete. [2025-10-22T18:25:06.540870] [INFO ] [MAIN ] Update Progress: 671/2367 symbols completed. DX took 35.7s. Estimated remaining: 3h 34m 55s. Rate: 7.9 symbols/min [2025-10-22T18:25:06.708323] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:25:06.738716] [DEBUG] [LOCAL ] E: Loaded 33282 existing records from primary storage. [2025-10-22T18:25:06.739029] [INFO ] [MAIN ] E: Loaded 33282 existing records. [2025-10-22T18:25:06.913300] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:25:06.913575] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-22T18:25:06.913673] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-22T18:25:06.914014] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-22T18:25:06.914072] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-22T18:25:07.262138] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:25:07.317678] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-22T18:25:07.723351] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T18:25:08.117732] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-22T18:25:08.504838] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-22T18:25:08.729977] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T18:25:08.917700] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-22T18:25:09.238097] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T18:25:09.717728] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-22T18:25:10.517666] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-22T18:25:10.712687] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T18:25:11.063425] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T18:25:11.317732] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-22T18:25:12.117734] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-22T18:25:12.460877] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T18:25:12.917681] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-22T18:25:13.124202] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T18:25:13.361583] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T18:25:13.717694] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-22T18:25:14.162523] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-22T18:25:14.517710] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-22T18:25:14.958551] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T18:25:15.317687] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-22T18:25:16.102095] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T18:25:16.117608] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-22T18:25:16.631775] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T18:25:16.917712] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-22T18:25:17.567992] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T18:25:17.717673] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-22T18:25:18.517701] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-22T18:25:18.817696] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T18:25:18.826879] [INFO ] [REMOTE ] DXC: Full fetch complete (70315 records). [2025-10-22T18:25:18.827004] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-22T18:25:19.087065] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T18:25:19.243868] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-22T18:25:19.243945] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-22T18:25:19.244747] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-22T18:25:19.244811] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-22T18:25:19.246110] [DEBUG] [LOCAL ] DXC: Trimmed 70315 records to 49919 (keeping 200 days of data) [2025-10-22T18:25:19.327735] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-22T18:25:19.535115] [DEBUG] [LOCAL ] DXC: Primary data saved (49919 records). [2025-10-22T18:25:19.535257] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-22T18:25:19.535340] [INFO ] [MAIN ] Update Progress: 672/2367 symbols completed. DXC took 33.0s. Estimated remaining: 3h 35m 1s. Rate: 7.9 symbols/min [2025-10-22T18:25:19.729396] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:25:19.729632] [DEBUG] [LOCAL ] EAF: No existing data file found in primary storage. [2025-10-22T18:25:19.729747] [WARN ] [MAIN ] EAF: No existing data found, performing full refresh instead. [2025-10-22T18:25:19.729912] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-22T18:25:19.729965] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-22T18:25:19.730010] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-10-22T18:25:19.730042] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-22T18:25:20.092614] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:25:20.117678] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-22T18:25:20.240954] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T18:25:20.885737] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T18:25:20.917611] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-22T18:25:21.292413] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T18:25:21.717713] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-22T18:25:22.247291] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T18:25:22.517707] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-22T18:25:22.868540] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T18:25:22.872394] [INFO ] [REMOTE ] DY: Full fetch complete (43274 records). [2025-10-22T18:25:22.872495] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-22T18:25:23.241180] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-22T18:25:23.241257] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-22T18:25:23.241900] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-22T18:25:23.241963] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-22T18:25:23.242817] [DEBUG] [LOCAL ] DY: Trimmed 43274 records to 28046 (keeping 200 days of data) [2025-10-22T18:25:23.326104] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-22T18:25:23.407601] [DEBUG] [LOCAL ] DY: Primary data saved (28046 records). [2025-10-22T18:25:23.407787] [INFO ] [MAIN ] DY: Full history saved. [2025-10-22T18:25:23.407875] [INFO ] [MAIN ] Update Progress: 673/2367 symbols completed. DY took 29.0s. Estimated remaining: 3h 34m 44s. Rate: 7.9 symbols/min [2025-10-22T18:25:23.576170] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:25:23.576351] [DEBUG] [LOCAL ] EAI: No existing data file found in primary storage. [2025-10-22T18:25:23.576390] [WARN ] [MAIN ] EAI: No existing data found, performing full refresh instead. [2025-10-22T18:25:23.576501] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-22T18:25:23.576543] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-22T18:25:23.576585] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-22T18:25:23.576619] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-22T18:25:23.932021] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:25:24.117720] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-22T18:25:24.386498] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-22T18:25:24.685275] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T18:25:24.709284] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-22T18:25:24.917731] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-22T18:25:25.717712] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-22T18:25:26.484223] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T18:25:26.517620] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-22T18:25:27.317685] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-22T18:25:27.507045] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T18:25:28.117730] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-22T18:25:28.158953] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T18:25:28.568561] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T18:25:28.917738] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-22T18:25:29.717710] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-22T18:25:30.390291] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-22T18:25:30.394369] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-22T18:25:30.401876] [INFO ] [REMOTE ] DXYZ: Full fetch complete (56824 records). [2025-10-22T18:25:30.402372] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-22T18:25:30.526918] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-22T18:25:30.687462] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T18:25:30.862052] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-22T18:25:30.862134] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-22T18:25:30.863005] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-22T18:25:30.863088] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-22T18:25:30.864255] [DEBUG] [LOCAL ] DXYZ: Trimmed 56824 records to 37126 (keeping 200 days of data) [2025-10-22T18:25:31.100250] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37126 records). [2025-10-22T18:25:31.100400] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-22T18:25:31.100474] [INFO ] [MAIN ] Update Progress: 674/2367 symbols completed. DXYZ took 44.3s. Estimated remaining: 3h 34m 37s. Rate: 7.9 symbols/min [2025-10-22T18:25:31.289287] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:25:31.289486] [DEBUG] [LOCAL ] EARN: No existing data file found in primary storage. [2025-10-22T18:25:31.289535] [WARN ] [MAIN ] EARN: No existing data found, performing full refresh instead. [2025-10-22T18:25:31.289706] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-22T18:25:31.289774] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-22T18:25:31.289832] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-10-22T18:25:31.289877] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-22T18:25:31.328894] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-22T18:25:31.701701] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:25:31.962738] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T18:25:31.967979] [INFO ] [REMOTE ] E: Full fetch complete (47425 records). [2025-10-22T18:25:31.968105] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-22T18:25:31.968714] [FATAL] [VALIDATOR ] E: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:25:31.968808] [FATAL] [MAIN ] E: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:25:31.968851] [WARN ] [MAIN ] E: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:25:31.968925] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-22T18:25:31.968991] [DEBUG] [LOCAL ] E: No primary data file found to delete. [2025-10-22T18:25:31.969028] [INFO ] [LOCAL ] E: Starting deletion of derivative data. [2025-10-22T18:25:31.969175] [DEBUG] [LOCAL ] E: Deleted derivative data file. [2025-10-22T18:25:31.969263] [INFO ] [MAIN ] Update Progress: 675/2367 symbols completed. E took 25.4s. Estimated remaining: 3h 34m 13s. Rate: 7.9 symbols/min [2025-10-22T18:25:32.123729] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-22T18:25:32.155458] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:25:32.202591] [DEBUG] [LOCAL ] EAT: Loaded 49741 existing records from primary storage. [2025-10-22T18:25:32.202959] [INFO ] [MAIN ] EAT: Loaded 49741 existing records. [2025-10-22T18:25:32.379739] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:25:32.380003] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-22T18:25:32.380073] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-22T18:25:32.380266] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-22T18:25:32.380302] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-22T18:25:32.744173] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:25:32.759175] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-22T18:25:32.917730] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-22T18:25:33.136235] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-22T18:25:33.287298] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-22T18:25:33.717743] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-22T18:25:34.520688] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-22T18:25:35.105421] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-22T18:25:35.317727] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-22T18:25:35.526511] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T18:25:36.117725] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-22T18:25:36.917726] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-22T18:25:37.355023] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-22T18:25:37.633927] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T18:25:37.717673] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-22T18:25:38.337612] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T18:25:38.517709] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-22T18:25:39.180554] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T18:25:39.317728] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-22T18:25:39.943838] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T18:25:40.117715] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-22T18:25:40.917682] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-22T18:25:40.950789] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:25:41.463230] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-22T18:25:41.717738] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-22T18:25:42.517618] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-22T18:25:42.796675] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T18:25:43.053279] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T18:25:43.058279] [INFO ] [REMOTE ] EAF: Full fetch complete (61911 records). [2025-10-22T18:25:43.058380] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-22T18:25:43.059096] [FATAL] [VALIDATOR ] EAF: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:25:43.059186] [FATAL] [MAIN ] EAF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:25:43.059229] [WARN ] [MAIN ] EAF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:25:43.059287] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-22T18:25:43.059383] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-10-22T18:25:43.059435] [INFO ] [LOCAL ] EAF: Starting deletion of derivative data. [2025-10-22T18:25:43.059491] [DEBUG] [LOCAL ] EAF: No derivative data file found to delete. [2025-10-22T18:25:43.059565] [INFO ] [MAIN ] Update Progress: 676/2367 symbols completed. EAF took 23.5s. Estimated remaining: 3h 34m 14s. Rate: 7.9 symbols/min [2025-10-22T18:25:43.226155] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:25:43.238368] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-22T18:25:43.266715] [DEBUG] [LOCAL ] EB: Loaded 36257 existing records from primary storage. [2025-10-22T18:25:43.266979] [INFO ] [MAIN ] EB: Loaded 36257 existing records. [2025-10-22T18:25:43.326757] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-22T18:25:43.446455] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:25:43.446691] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-22T18:25:43.446766] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-22T18:25:43.446968] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-22T18:25:43.447023] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-22T18:25:43.795233] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:25:44.117772] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-22T18:25:44.702848] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-22T18:25:44.917717] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-22T18:25:45.030404] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T18:25:45.717686] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-22T18:25:46.504951] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T18:25:46.517611] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-22T18:25:47.289822] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T18:25:47.317729] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-22T18:25:47.573608] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T18:25:47.875137] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T18:25:48.117729] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-22T18:25:48.539320] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-22T18:25:48.917690] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-22T18:25:49.482923] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-22T18:25:49.484491] [INFO ] [REMOTE ] EAI: Full fetch complete (5818 records). [2025-10-22T18:25:49.484580] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-22T18:25:49.485066] [FATAL] [VALIDATOR ] EAI: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:25:49.485163] [FATAL] [MAIN ] EAI: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:25:49.485213] [WARN ] [MAIN ] EAI: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:25:49.485288] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-22T18:25:49.485364] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-22T18:25:49.485416] [INFO ] [LOCAL ] EAI: Starting deletion of derivative data. [2025-10-22T18:25:49.485469] [DEBUG] [LOCAL ] EAI: No derivative data file found to delete. [2025-10-22T18:25:49.485534] [INFO ] [MAIN ] Update Progress: 677/2367 symbols completed. EAI took 26.1s. Estimated remaining: 3h 34m 3s. Rate: 7.9 symbols/min [2025-10-22T18:25:49.717750] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-22T18:25:50.517727] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-22T18:25:51.053088] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T18:25:51.317712] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-22T18:25:52.117809] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-22T18:25:52.437467] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-22T18:25:52.493763] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T18:25:52.917732] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-22T18:25:53.690715] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T18:25:53.717670] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-22T18:25:54.517672] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-22T18:25:54.627202] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T18:25:55.308863] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T18:25:55.317897] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-22T18:25:55.743427] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-22T18:25:56.117733] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-22T18:25:56.677293] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T18:25:56.917695] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-22T18:25:57.580267] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T18:25:57.717717] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-22T18:25:57.819417] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-22T18:25:58.517698] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-22T18:25:59.317683] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-22T18:25:59.427334] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T18:25:59.549458] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T18:26:00.117731] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-22T18:26:00.493611] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-22T18:26:00.917735] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-22T18:26:01.717785] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-22T18:26:02.368740] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-22T18:26:02.517705] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-22T18:26:02.994427] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-22T18:26:03.317731] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-22T18:26:03.600316] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T18:26:03.604968] [INFO ] [REMOTE ] EARN: Full fetch complete (45014 records). [2025-10-22T18:26:03.605049] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-22T18:26:03.605635] [FATAL] [VALIDATOR ] EARN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:26:03.605772] [FATAL] [MAIN ] EARN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:26:03.605815] [WARN ] [MAIN ] EARN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:26:03.605854] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-22T18:26:03.605911] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-10-22T18:26:03.605947] [INFO ] [LOCAL ] EARN: Starting deletion of derivative data. [2025-10-22T18:26:03.605985] [DEBUG] [LOCAL ] EARN: No derivative data file found to delete. [2025-10-22T18:26:03.606040] [INFO ] [MAIN ] Update Progress: 678/2367 symbols completed. EARN took 32.5s. Estimated remaining: 3h 34m 12s. Rate: 7.9 symbols/min [2025-10-22T18:26:05.031334] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-22T18:26:05.041461] [INFO ] [REMOTE ] EAT: Full fetch complete (72394 records). [2025-10-22T18:26:05.041599] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-22T18:26:05.292152] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T18:26:05.363243] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-22T18:26:05.479076] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-22T18:26:05.479160] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-22T18:26:05.480059] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-22T18:26:05.480129] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-22T18:26:05.481554] [DEBUG] [LOCAL ] EAT: Trimmed 72394 records to 49719 (keeping 200 days of data) [2025-10-22T18:26:05.776624] [DEBUG] [LOCAL ] EAT: Primary data saved (49719 records). [2025-10-22T18:26:05.776911] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-22T18:26:05.776990] [INFO ] [MAIN ] Update Progress: 679/2367 symbols completed. EAT took 33.8s. Estimated remaining: 3h 33m 51s. Rate: 7.9 symbols/min [2025-10-22T18:26:06.854694] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T18:26:06.862129] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-22T18:26:08.209640] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T18:26:08.214796] [INFO ] [REMOTE ] EB: Full fetch complete (54722 records). [2025-10-22T18:26:08.214887] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-22T18:26:08.215466] [FATAL] [VALIDATOR ] EB: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:26:08.215548] [FATAL] [MAIN ] EB: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:26:08.215591] [WARN ] [MAIN ] EB: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:26:08.215628] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-22T18:26:08.215721] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-22T18:26:08.215765] [INFO ] [LOCAL ] EB: Starting deletion of derivative data. [2025-10-22T18:26:08.215960] [DEBUG] [LOCAL ] EB: Deleted derivative data file. [2025-10-22T18:26:08.216048] [INFO ] [MAIN ] Update Progress: 680/2367 symbols completed. EB took 25.2s. Estimated remaining: 3h 33m 30s. Rate: 7.9 symbols/min [2025-10-22T18:26:08.770445] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:26:08.859247] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:26:08.892873] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:26:08.920912] [DEBUG] [LOCAL ] EBS: No existing data file found in primary storage. [2025-10-22T18:26:08.920435] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:26:08.921048] [WARN ] [MAIN ] EBS: No existing data found, performing full refresh instead. [2025-10-22T18:26:08.921946] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-22T18:26:08.922067] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-22T18:26:08.922127] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-10-22T18:26:08.922279] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-22T18:26:09.089439] [DEBUG] [LOCAL ] EBF: Loaded 19191 existing records from primary storage. [2025-10-22T18:26:09.119578] [INFO ] [MAIN ] EBF: Loaded 19191 existing records. [2025-10-22T18:26:09.346024] [DEBUG] [LOCAL ] EC: Loaded 48909 existing records from primary storage. [2025-10-22T18:26:09.432459] [DEBUG] [LOCAL ] EBR: Loaded 43373 existing records from primary storage. [2025-10-22T18:26:09.508786] [INFO ] [MAIN ] EBR: Loaded 43373 existing records. [2025-10-22T18:26:09.394513] [INFO ] [MAIN ] EC: Loaded 48909 existing records. [2025-10-22T18:26:09.534767] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:26:09.559118] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-22T18:26:09.604667] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:26:09.649663] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-22T18:26:09.649820] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-22T18:26:09.706612] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-22T18:26:09.734939] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-22T18:26:09.933065] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:26:10.013156] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-22T18:26:10.013046] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:26:10.031179] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-22T18:26:10.031286] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-22T18:26:10.034420] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-22T18:26:10.040116] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-22T18:26:10.034880] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-22T18:26:10.055627] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-22T18:26:10.078388] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-22T18:26:10.781664] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:26:10.838150] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-22T18:26:11.005419] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:26:11.008011] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-22T18:26:11.033329] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:26:11.033741] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-22T18:26:11.418408] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T18:26:11.427145] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-22T18:26:12.019230] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T18:26:12.022864] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-22T18:26:12.584529] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T18:26:12.594090] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-22T18:26:12.677855] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T18:26:12.686748] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-22T18:26:12.821188] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T18:26:12.831145] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-22T18:26:12.870189] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-22T18:26:12.917711] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-22T18:26:14.020320] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T18:26:14.028324] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-22T18:26:14.082591] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T18:26:14.134509] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T18:26:14.172299] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T18:26:14.517690] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-22T18:26:15.115917] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T18:26:15.317683] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-22T18:26:16.117760] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-22T18:26:16.441795] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T18:26:16.917707] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-22T18:26:17.456013] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-22T18:26:17.717726] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-22T18:26:18.240711] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T18:26:18.517786] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-22T18:26:18.680013] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-10-22T18:26:19.297574] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T18:26:19.317685] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-22T18:26:20.108969] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T18:26:20.117614] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-22T18:26:20.749490] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T18:26:20.917675] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-22T18:26:21.173684] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-22T18:26:21.717723] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-22T18:26:22.526801] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-22T18:26:22.529862] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T18:26:22.846661] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T18:26:23.317843] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-22T18:26:23.745155] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T18:26:24.117770] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-22T18:26:24.917692] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-22T18:26:25.131796] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T18:26:25.196924] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-22T18:26:25.717699] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-22T18:26:26.517721] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-22T18:26:26.874970] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T18:26:27.245701] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T18:26:27.317739] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-22T18:26:28.097210] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T18:26:28.117620] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-22T18:26:28.703755] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-22T18:26:28.917717] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-22T18:26:29.717725] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-22T18:26:29.926987] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T18:26:29.936091] [INFO ] [REMOTE ] EBS: Full fetch complete (67336 records). [2025-10-22T18:26:29.936259] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-22T18:26:30.331991] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-22T18:26:30.332096] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-22T18:26:30.332925] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-22T18:26:30.332992] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-22T18:26:30.334476] [DEBUG] [LOCAL ] EBS: Trimmed 67336 records to 46589 (keeping 200 days of data) [2025-10-22T18:26:30.522400] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-22T18:26:30.591911] [DEBUG] [LOCAL ] EBS: Primary data saved (46589 records). [2025-10-22T18:26:30.592078] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-22T18:26:30.592155] [INFO ] [MAIN ] Update Progress: 681/2367 symbols completed. EBS took 22.4s. Estimated remaining: 3h 33m 59s. Rate: 7.9 symbols/min [2025-10-22T18:26:30.766951] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:26:30.799385] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T18:26:30.841728] [DEBUG] [LOCAL ] ECAT: Loaded 29262 existing records from primary storage. [2025-10-22T18:26:30.842041] [INFO ] [MAIN ] ECAT: Loaded 29262 existing records. [2025-10-22T18:26:31.030949] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:26:31.031199] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-22T18:26:31.031397] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-22T18:26:31.031740] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-22T18:26:31.031809] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-22T18:26:31.182254] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-22T18:26:31.322326] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-22T18:26:31.438623] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:26:31.477509] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-22T18:26:32.117680] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-22T18:26:32.917733] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-22T18:26:33.106680] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T18:26:33.385172] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-22T18:26:33.717697] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-22T18:26:33.851986] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T18:26:33.856178] [INFO ] [REMOTE ] EBF: Full fetch complete (28312 records). [2025-10-22T18:26:33.856276] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-22T18:26:34.212188] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-22T18:26:34.212263] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-22T18:26:34.212756] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-22T18:26:34.212817] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-22T18:26:34.213443] [DEBUG] [LOCAL ] EBF: Trimmed 28312 records to 19250 (keeping 200 days of data) [2025-10-22T18:26:34.326965] [DEBUG] [LOCAL ] EBF: Primary data saved (19250 records). [2025-10-22T18:26:34.327075] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-22T18:26:34.327148] [INFO ] [MAIN ] Update Progress: 682/2367 symbols completed. EBF took 26.1s. Estimated remaining: 3h 33m 42s. Rate: 7.9 symbols/min [2025-10-22T18:26:34.491042] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:26:34.526620] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-22T18:26:34.529872] [DEBUG] [LOCAL ] ECC: Loaded 43432 existing records from primary storage. [2025-10-22T18:26:34.530189] [INFO ] [MAIN ] ECC: Loaded 43432 existing records. [2025-10-22T18:26:34.703111] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:26:34.703286] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-22T18:26:34.703334] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-22T18:26:34.703526] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-22T18:26:34.703563] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-22T18:26:35.045956] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:26:35.317775] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-22T18:26:35.509587] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T18:26:35.520001] [INFO ] [REMOTE ] EBR: Full fetch complete (62493 records). [2025-10-22T18:26:35.520160] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-22T18:26:35.901783] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-22T18:26:35.901893] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-22T18:26:35.902754] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-22T18:26:35.902818] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-22T18:26:35.904117] [DEBUG] [LOCAL ] EBR: Trimmed 62493 records to 43347 (keeping 200 days of data) [2025-10-22T18:26:36.119838] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-22T18:26:36.152870] [DEBUG] [LOCAL ] EBR: Primary data saved (43347 records). [2025-10-22T18:26:36.153066] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-22T18:26:36.153812] [INFO ] [MAIN ] Update Progress: 683/2367 symbols completed. EBR took 27.9s. Estimated remaining: 3h 33m 20s. Rate: 7.9 symbols/min [2025-10-22T18:26:36.347597] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:26:36.347917] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-22T18:26:36.348086] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-22T18:26:36.348272] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-22T18:26:36.348342] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-22T18:26:36.348457] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-22T18:26:36.348566] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-22T18:26:36.486414] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-22T18:26:36.734471] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T18:26:36.777073] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:26:36.917709] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-22T18:26:37.447683] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T18:26:37.717752] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-22T18:26:38.166310] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-22T18:26:38.369278] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T18:26:38.517704] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-22T18:26:39.317700] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-22T18:26:40.117764] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-22T18:26:40.172234] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T18:26:40.304524] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-22T18:26:40.485233] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-22T18:26:40.917812] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-22T18:26:41.287129] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-22T18:26:41.717723] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-22T18:26:42.069604] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-22T18:26:42.517726] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-22T18:26:43.317730] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-22T18:26:44.117710] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-22T18:26:44.351239] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T18:26:44.917710] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-22T18:26:44.960457] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T18:26:45.197589] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T18:26:45.248276] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-22T18:26:45.717726] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-22T18:26:46.517615] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-22T18:26:46.992619] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-22T18:26:47.317729] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-22T18:26:47.597982] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-22T18:26:48.117706] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-22T18:26:48.310216] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T18:26:48.318099] [INFO ] [REMOTE ] EC: Full fetch complete (71535 records). [2025-10-22T18:26:48.318220] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-22T18:26:48.319017] [FATAL] [VALIDATOR ] EC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:26:48.319105] [FATAL] [MAIN ] EC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:26:48.319146] [WARN ] [MAIN ] EC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:26:48.319184] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-22T18:26:48.319240] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-22T18:26:48.319277] [INFO ] [LOCAL ] EC: Starting deletion of derivative data. [2025-10-22T18:26:48.319395] [DEBUG] [LOCAL ] EC: Deleted derivative data file. [2025-10-22T18:26:48.319465] [INFO ] [MAIN ] Update Progress: 684/2367 symbols completed. EC took 40.1s. Estimated remaining: 3h 33m 24s. Rate: 7.9 symbols/min [2025-10-22T18:26:48.485026] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:26:48.485202] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-10-22T18:26:48.485238] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-10-22T18:26:48.485345] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-22T18:26:48.485386] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-22T18:26:48.485445] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-22T18:26:48.485477] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-22T18:26:48.835027] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:26:48.917717] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-22T18:26:49.183332] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T18:26:49.431793] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-22T18:26:49.717749] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-22T18:26:50.517720] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-22T18:26:50.915218] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-22T18:26:50.999484] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-22T18:26:51.317684] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-22T18:26:51.932665] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T18:26:52.117712] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-22T18:26:52.917711] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-22T18:26:53.631416] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-22T18:26:53.717689] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-22T18:26:54.025250] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T18:26:54.181531] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-22T18:26:54.517727] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-22T18:26:54.935084] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-22T18:26:55.317709] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-22T18:26:55.761490] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-22T18:26:56.117746] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-22T18:26:56.441679] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-22T18:26:56.917703] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-22T18:26:57.717728] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-22T18:26:58.123934] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-22T18:26:58.294273] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T18:26:58.517691] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-22T18:26:59.317697] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-22T18:26:59.673279] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T18:26:59.881973] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T18:27:00.117698] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-22T18:27:00.917689] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-22T18:27:01.051767] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T18:27:01.052506] [INFO ] [REMOTE ] ECCC: Full fetch complete (1309 records). [2025-10-22T18:27:01.052573] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-22T18:27:01.231284] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-22T18:27:01.231492] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:27:01.231542] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:27:01.231603] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-22T18:27:01.231687] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-22T18:27:01.231741] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-22T18:27:01.231784] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-22T18:27:01.231838] [INFO ] [MAIN ] Update Progress: 685/2367 symbols completed. ECCC took 25.1s. Estimated remaining: 3h 33m 29s. Rate: 7.9 symbols/min [2025-10-22T18:27:01.405760] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:01.405985] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-22T18:27:01.406032] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-22T18:27:01.406157] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-22T18:27:01.406209] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-22T18:27:01.406254] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-22T18:27:01.406287] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-22T18:27:01.722936] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-22T18:27:01.781512] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:27:02.517705] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-22T18:27:03.075173] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-22T18:27:03.317748] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-22T18:27:03.802088] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-22T18:27:04.117676] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-22T18:27:04.185710] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-22T18:27:04.331267] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T18:27:04.721509] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T18:27:04.722325] [INFO ] [REMOTE ] ECCU: Full fetch complete (4240 records). [2025-10-22T18:27:04.722393] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-22T18:27:04.922849] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-22T18:27:05.090040] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-22T18:27:05.090115] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-22T18:27:05.090244] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-22T18:27:05.090282] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-22T18:27:05.090614] [DEBUG] [LOCAL ] ECCU: Trimmed 4240 records to 2152 (keeping 200 days of data) [2025-10-22T18:27:05.103854] [DEBUG] [LOCAL ] ECCU: Primary data saved (2152 records). [2025-10-22T18:27:05.103929] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-22T18:27:05.103994] [INFO ] [MAIN ] Update Progress: 686/2367 symbols completed. ECCU took 16.8s. Estimated remaining: 3h 33m 12s. Rate: 7.9 symbols/min [2025-10-22T18:27:05.268621] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:05.268807] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-22T18:27:05.268849] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-22T18:27:05.268958] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-22T18:27:05.269000] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-22T18:27:05.269041] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-22T18:27:05.269092] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-22T18:27:05.341952] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-22T18:27:05.626347] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:27:05.717729] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-22T18:27:06.221205] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-22T18:27:06.517704] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-22T18:27:07.317713] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-22T18:27:07.606622] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-22T18:27:07.921089] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T18:27:07.925917] [INFO ] [REMOTE ] ECAT: Full fetch complete (42914 records). [2025-10-22T18:27:07.926035] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-22T18:27:08.122791] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-22T18:27:08.302439] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-22T18:27:08.302519] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-22T18:27:08.303187] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-22T18:27:08.303249] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-22T18:27:08.304324] [DEBUG] [LOCAL ] ECAT: Trimmed 42914 records to 29135 (keeping 200 days of data) [2025-10-22T18:27:08.482300] [DEBUG] [LOCAL ] ECAT: Primary data saved (29135 records). [2025-10-22T18:27:08.482440] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-22T18:27:08.482523] [INFO ] [MAIN ] Update Progress: 687/2367 symbols completed. ECAT took 37.9s. Estimated remaining: 3h 32m 54s. Rate: 7.9 symbols/min [2025-10-22T18:27:08.611977] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-22T18:27:08.720459] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:08.759177] [DEBUG] [LOCAL ] ECG: Loaded 32804 existing records from primary storage. [2025-10-22T18:27:08.759445] [INFO ] [MAIN ] ECG: Loaded 32804 existing records. [2025-10-22T18:27:08.927244] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-22T18:27:08.932141] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:27:08.933352] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-22T18:27:08.933455] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-22T18:27:08.933727] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-22T18:27:08.933794] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-22T18:27:09.290405] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:27:09.485001] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-22T18:27:09.717705] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-22T18:27:10.047022] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-22T18:27:10.517727] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-22T18:27:10.864211] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-22T18:27:11.317690] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-22T18:27:11.655020] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-22T18:27:12.117719] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-22T18:27:12.917703] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-22T18:27:13.448526] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-22T18:27:13.717708] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-22T18:27:13.919074] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T18:27:14.050768] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-22T18:27:14.517719] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-22T18:27:14.953635] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-22T18:27:14.954400] [INFO ] [REMOTE ] ECCW: Full fetch complete (1424 records). [2025-10-22T18:27:14.954466] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-22T18:27:15.142335] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-22T18:27:15.142544] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:27:15.142612] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:27:15.142706] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-22T18:27:15.142770] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-22T18:27:15.142807] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-22T18:27:15.142846] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-22T18:27:15.142900] [INFO ] [MAIN ] Update Progress: 688/2367 symbols completed. ECCW took 13.9s. Estimated remaining: 3h 32m 45s. Rate: 7.9 symbols/min [2025-10-22T18:27:15.308816] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:15.317711] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-22T18:27:15.353816] [DEBUG] [LOCAL ] ECL: Loaded 46734 existing records from primary storage. [2025-10-22T18:27:15.354135] [INFO ] [MAIN ] ECL: Loaded 46734 existing records. [2025-10-22T18:27:15.537411] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:27:15.537661] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-22T18:27:15.537725] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-22T18:27:15.537963] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-22T18:27:15.538021] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-22T18:27:15.809774] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-22T18:27:15.910696] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:27:16.117674] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-22T18:27:16.917698] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-22T18:27:17.425687] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-22T18:27:17.717704] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-22T18:27:17.916315] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T18:27:18.517739] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-22T18:27:19.317732] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-22T18:27:19.485670] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T18:27:19.672517] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-22T18:27:20.094842] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-22T18:27:20.117614] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-22T18:27:20.917759] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-22T18:27:21.719210] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-22T18:27:21.724272] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T18:27:22.517733] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-22T18:27:22.571441] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T18:27:22.946617] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-22T18:27:23.317740] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-22T18:27:23.386351] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T18:27:24.117701] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-22T18:27:24.781740] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T18:27:24.917713] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-22T18:27:25.647384] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T18:27:25.717698] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-22T18:27:26.517322] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T18:27:26.525835] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-22T18:27:26.893559] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-22T18:27:27.157007] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T18:27:27.317676] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-22T18:27:28.117699] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-22T18:27:28.917715] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-22T18:27:29.056120] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T18:27:29.532686] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T18:27:29.540322] [INFO ] [REMOTE ] ECC: Full fetch complete (61600 records). [2025-10-22T18:27:29.540449] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-22T18:27:29.718013] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-22T18:27:29.962870] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-22T18:27:29.962960] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-22T18:27:29.963771] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-22T18:27:29.963872] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-22T18:27:29.965161] [DEBUG] [LOCAL ] ECC: Trimmed 61600 records to 43377 (keeping 200 days of data) [2025-10-22T18:27:30.193960] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T18:27:30.254457] [DEBUG] [LOCAL ] ECC: Primary data saved (43377 records). [2025-10-22T18:27:30.254591] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-22T18:27:30.254690] [INFO ] [MAIN ] Update Progress: 689/2367 symbols completed. ECC took 55.9s. Estimated remaining: 3h 32m 55s. Rate: 7.9 symbols/min [2025-10-22T18:27:30.422331] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:30.440775] [DEBUG] [LOCAL ] ECO: Loaded 18099 existing records from primary storage. [2025-10-22T18:27:30.441022] [INFO ] [MAIN ] ECO: Loaded 18099 existing records. [2025-10-22T18:27:30.522937] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-22T18:27:30.618695] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:27:30.618914] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-22T18:27:30.618964] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-22T18:27:30.619145] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-22T18:27:30.619182] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-22T18:27:30.975757] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:27:31.020760] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-22T18:27:31.317729] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-22T18:27:31.521550] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T18:27:32.117723] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-22T18:27:32.748392] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T18:27:32.917756] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-22T18:27:33.246826] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-22T18:27:33.622350] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T18:27:33.717712] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-22T18:27:34.517689] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-22T18:27:34.874695] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-22T18:27:34.892166] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-22T18:27:35.317709] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-22T18:27:36.117723] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-22T18:27:36.322535] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-22T18:27:36.675888] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-22T18:27:36.676585] [INFO ] [REMOTE ] ECCX: Full fetch complete (1456 records). [2025-10-22T18:27:36.676674] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-22T18:27:36.856872] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-22T18:27:36.857070] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:27:36.857139] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:27:36.857212] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-22T18:27:36.857276] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-22T18:27:36.857312] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-22T18:27:36.857352] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-22T18:27:36.857406] [INFO ] [MAIN ] Update Progress: 690/2367 symbols completed. ECCX took 31.8s. Estimated remaining: 3h 32m 45s. Rate: 7.9 symbols/min [2025-10-22T18:27:36.922890] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-22T18:27:37.028234] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:37.028415] [DEBUG] [LOCAL ] ECVT: No existing data file found in primary storage. [2025-10-22T18:27:37.028469] [WARN ] [MAIN ] ECVT: No existing data found, performing full refresh instead. [2025-10-22T18:27:37.028617] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-22T18:27:37.028710] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-22T18:27:37.028769] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-22T18:27:37.028803] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-22T18:27:37.389227] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:27:37.717618] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-22T18:27:38.115447] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-22T18:27:38.517740] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-22T18:27:39.317671] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-22T18:27:39.345355] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T18:27:39.923844] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T18:27:40.117723] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-22T18:27:40.694969] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T18:27:40.917791] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-22T18:27:41.292250] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T18:27:41.717719] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-22T18:27:42.481459] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T18:27:42.517611] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-22T18:27:43.317683] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-22T18:27:43.378008] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T18:27:43.764129] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T18:27:44.117621] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-22T18:27:44.174004] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T18:27:44.917734] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-22T18:27:45.502310] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T18:27:45.717713] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-22T18:27:46.517677] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-22T18:27:46.675746] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T18:27:47.170758] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T18:27:47.317681] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-22T18:27:47.705116] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T18:27:48.117704] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-22T18:27:48.917710] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-22T18:27:49.181283] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T18:27:49.189867] [INFO ] [REMOTE ] ECL: Full fetch complete (68395 records). [2025-10-22T18:27:49.195850] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-22T18:27:49.200805] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-22T18:27:49.600438] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-22T18:27:49.600520] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-22T18:27:49.601321] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-22T18:27:49.601384] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-22T18:27:49.602706] [DEBUG] [LOCAL ] ECL: Trimmed 68395 records to 46689 (keeping 200 days of data) [2025-10-22T18:27:49.718563] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-22T18:27:49.896364] [DEBUG] [LOCAL ] ECL: Primary data saved (46689 records). [2025-10-22T18:27:49.896490] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-22T18:27:49.897350] [INFO ] [MAIN ] Update Progress: 691/2367 symbols completed. ECL took 34.8s. Estimated remaining: 3h 32m 51s. Rate: 7.9 symbols/min [2025-10-22T18:27:50.072089] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:50.123903] [DEBUG] [LOCAL ] ED: Loaded 52606 existing records from primary storage. [2025-10-22T18:27:50.124202] [INFO ] [MAIN ] ED: Loaded 52606 existing records. [2025-10-22T18:27:50.298250] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:27:50.298486] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-22T18:27:50.298562] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-22T18:27:50.298909] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-22T18:27:50.298966] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-22T18:27:50.452159] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T18:27:50.530793] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-22T18:27:50.530989] [INFO ] [REMOTE ] ECG: Full fetch complete (50891 records). [2025-10-22T18:27:50.568282] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-22T18:27:50.804821] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:27:51.073887] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-22T18:27:51.073985] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-22T18:27:51.074734] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-22T18:27:51.074802] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-22T18:27:51.076001] [DEBUG] [LOCAL ] ECG: Trimmed 50891 records to 32780 (keeping 200 days of data) [2025-10-22T18:27:51.265414] [DEBUG] [LOCAL ] ECG: Primary data saved (32780 records). [2025-10-22T18:27:51.265566] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-22T18:27:51.265677] [INFO ] [MAIN ] Update Progress: 692/2367 symbols completed. ECG took 42.8s. Estimated remaining: 3h 32m 28s. Rate: 7.9 symbols/min [2025-10-22T18:27:51.328758] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-22T18:27:51.444984] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:51.471423] [DEBUG] [LOCAL ] EDD: Loaded 27227 existing records from primary storage. [2025-10-22T18:27:51.471816] [INFO ] [MAIN ] EDD: Loaded 27227 existing records. [2025-10-22T18:27:51.683918] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:27:51.687029] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T18:27:51.687869] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-22T18:27:51.691686] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-22T18:27:51.703406] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-22T18:27:51.709084] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-22T18:27:51.715771] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T18:27:52.072586] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:27:52.117711] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-22T18:27:52.917707] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-22T18:27:53.062085] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T18:27:53.223605] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-22T18:27:53.717751] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-22T18:27:54.390437] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T18:27:54.517673] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-22T18:27:55.317714] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-22T18:27:55.575691] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T18:27:55.941530] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T18:27:56.117677] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-22T18:27:56.478849] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T18:27:56.917694] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-22T18:27:57.717715] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-22T18:27:57.801168] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T18:27:58.510546] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T18:27:58.520126] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-22T18:27:58.847942] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-22T18:27:58.851508] [INFO ] [REMOTE ] ECO: Full fetch complete (28298 records). [2025-10-22T18:27:58.851596] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-22T18:27:59.223086] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-22T18:27:59.223227] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-22T18:27:59.224066] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-22T18:27:59.224129] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-22T18:27:59.224974] [DEBUG] [LOCAL ] ECO: Trimmed 28298 records to 18017 (keeping 200 days of data) [2025-10-22T18:27:59.317759] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-22T18:27:59.339954] [DEBUG] [LOCAL ] ECO: Primary data saved (18017 records). [2025-10-22T18:27:59.340154] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-22T18:27:59.340261] [INFO ] [MAIN ] Update Progress: 693/2367 symbols completed. ECO took 29.1s. Estimated remaining: 3h 32m 22s. Rate: 7.9 symbols/min [2025-10-22T18:27:59.516077] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:27:59.531128] [DEBUG] [LOCAL ] EDF: Loaded 12901 existing records from primary storage. [2025-10-22T18:27:59.531404] [INFO ] [MAIN ] EDF: Loaded 12901 existing records. [2025-10-22T18:27:59.732420] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:27:59.732818] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-22T18:27:59.732882] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-22T18:27:59.733140] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-22T18:27:59.733200] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-22T18:28:00.122785] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-22T18:28:00.189317] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:28:00.456063] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-22T18:28:00.467867] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T18:28:00.917716] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-22T18:28:01.717909] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-22T18:28:02.138614] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-22T18:28:02.517718] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-22T18:28:02.622559] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T18:28:03.320617] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-22T18:28:03.576413] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T18:28:04.112382] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T18:28:04.121311] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-22T18:28:04.158878] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-22T18:28:04.917763] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-22T18:28:05.717742] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-22T18:28:05.938593] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-22T18:28:06.142519] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-22T18:28:06.517746] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-22T18:28:06.638061] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-22T18:28:07.317721] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-22T18:28:08.117710] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-22T18:28:08.297879] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T18:28:08.491462] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T18:28:08.917697] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-22T18:28:09.717623] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-22T18:28:09.871531] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T18:28:09.878533] [INFO ] [REMOTE ] ECVT: Full fetch complete (60383 records). [2025-10-22T18:28:09.878670] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-22T18:28:10.253783] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-22T18:28:10.253866] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-22T18:28:10.254575] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-22T18:28:10.254612] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-22T18:28:10.255784] [DEBUG] [LOCAL ] ECVT: Trimmed 60383 records to 43112 (keeping 200 days of data) [2025-10-22T18:28:10.516900] [DEBUG] [LOCAL ] ECVT: Primary data saved (43112 records). [2025-10-22T18:28:10.517011] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-22T18:28:10.517089] [INFO ] [MAIN ] Update Progress: 694/2367 symbols completed. ECVT took 33.7s. Estimated remaining: 3h 32m 23s. Rate: 7.9 symbols/min [2025-10-22T18:28:10.540064] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-22T18:28:10.624422] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-22T18:28:10.708600] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:28:10.728510] [DEBUG] [LOCAL ] EDN: Loaded 19252 existing records from primary storage. [2025-10-22T18:28:10.728786] [INFO ] [MAIN ] EDN: Loaded 19252 existing records. [2025-10-22T18:28:10.876336] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-22T18:28:10.955256] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:28:10.955456] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-22T18:28:10.955503] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-22T18:28:10.955777] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-22T18:28:10.955836] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-22T18:28:11.294715] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:28:11.317604] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-22T18:28:11.860351] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T18:28:12.117712] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-22T18:28:12.761886] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T18:28:12.810746] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-22T18:28:12.917622] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-22T18:28:13.652724] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-22T18:28:13.717746] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-22T18:28:14.517699] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-22T18:28:15.303376] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T18:28:15.317596] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-22T18:28:15.580926] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T18:28:16.117689] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-22T18:28:16.917700] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-22T18:28:17.340957] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-22T18:28:17.542779] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-22T18:28:17.551634] [INFO ] [REMOTE ] ED: Full fetch complete (76351 records). [2025-10-22T18:28:17.551796] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-22T18:28:17.726815] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-22T18:28:17.861630] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-22T18:28:17.959563] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-22T18:28:17.959667] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-22T18:28:17.960517] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-22T18:28:17.960559] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-22T18:28:17.962007] [DEBUG] [LOCAL ] ED: Trimmed 76351 records to 52572 (keeping 200 days of data) [2025-10-22T18:28:18.281944] [DEBUG] [LOCAL ] ED: Primary data saved (52572 records). [2025-10-22T18:28:18.282118] [INFO ] [MAIN ] ED: Full history saved. [2025-10-22T18:28:18.282879] [INFO ] [MAIN ] Update Progress: 695/2367 symbols completed. ED took 28.4s. Estimated remaining: 3h 32m 15s. Rate: 7.9 symbols/min [2025-10-22T18:28:18.453124] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:28:18.499791] [DEBUG] [LOCAL ] EDU: Loaded 44834 existing records from primary storage. [2025-10-22T18:28:18.500132] [INFO ] [MAIN ] EDU: Loaded 44834 existing records. [2025-10-22T18:28:18.522908] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-22T18:28:18.678130] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:28:18.678342] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-22T18:28:18.678388] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-22T18:28:18.678615] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-22T18:28:18.678699] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-22T18:28:19.032506] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:28:19.067487] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-22T18:28:19.317699] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-22T18:28:19.372864] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-22T18:28:20.117718] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-22T18:28:20.920376] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-22T18:28:20.926863] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T18:28:20.949967] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T18:28:21.717702] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-22T18:28:21.954307] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-22T18:28:22.517677] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-22T18:28:23.029458] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T18:28:23.317711] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-22T18:28:24.117665] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-22T18:28:24.216751] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T18:28:24.469969] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T18:28:24.917781] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-22T18:28:25.136841] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T18:28:25.139871] [INFO ] [REMOTE ] EDF: Full fetch complete (20184 records). [2025-10-22T18:28:25.140050] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-22T18:28:25.586820] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-22T18:28:25.586897] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-22T18:28:25.587431] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-22T18:28:25.587473] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-22T18:28:25.588060] [DEBUG] [LOCAL ] EDF: Trimmed 20184 records to 12838 (keeping 200 days of data) [2025-10-22T18:28:25.665233] [DEBUG] [LOCAL ] EDF: Primary data saved (12838 records). [2025-10-22T18:28:25.665409] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-22T18:28:25.665517] [INFO ] [MAIN ] Update Progress: 696/2367 symbols completed. EDF took 26.3s. Estimated remaining: 3h 32m 7s. Rate: 7.9 symbols/min [2025-10-22T18:28:25.727245] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-22T18:28:25.838742] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:28:25.839161] [DEBUG] [LOCAL ] EE: No existing data file found in primary storage. [2025-10-22T18:28:25.839275] [WARN ] [MAIN ] EE: No existing data found, performing full refresh instead. [2025-10-22T18:28:25.839497] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-22T18:28:25.839604] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-22T18:28:25.839801] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-10-22T18:28:25.839862] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-22T18:28:25.963829] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T18:28:26.220269] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:28:26.517667] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-22T18:28:26.535720] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T18:28:27.317730] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-22T18:28:27.766128] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T18:28:28.117722] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-22T18:28:28.917678] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-22T18:28:29.112747] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T18:28:29.134251] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-22T18:28:29.717724] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-22T18:28:29.955749] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T18:28:29.960697] [INFO ] [REMOTE ] EDD: Full fetch complete (39096 records). [2025-10-22T18:28:29.960801] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-22T18:28:30.329482] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-22T18:28:30.329563] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-22T18:28:30.330219] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-22T18:28:30.330282] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-22T18:28:30.331262] [DEBUG] [LOCAL ] EDD: Trimmed 39096 records to 27270 (keeping 200 days of data) [2025-10-22T18:28:30.491846] [DEBUG] [LOCAL ] EDD: Primary data saved (27270 records). [2025-10-22T18:28:30.492028] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-22T18:28:30.492147] [INFO ] [MAIN ] Update Progress: 697/2367 symbols completed. EDD took 39.2s. Estimated remaining: 3h 31m 53s. Rate: 7.9 symbols/min [2025-10-22T18:28:30.522868] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-22T18:28:30.663472] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:28:30.663626] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-22T18:28:30.663694] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-22T18:28:30.663807] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-22T18:28:30.663868] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-22T18:28:30.663935] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-22T18:28:30.664009] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-22T18:28:31.013064] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:28:31.317712] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-22T18:28:31.615292] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T18:28:31.815515] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-22T18:28:31.963107] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-22T18:28:32.117727] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-22T18:28:32.917716] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-22T18:28:33.120491] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T18:28:33.717743] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-22T18:28:34.012555] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T18:28:34.517690] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-22T18:28:35.222764] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T18:28:35.317740] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-22T18:28:35.828311] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T18:28:36.117699] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-22T18:28:36.422180] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T18:28:36.917750] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-22T18:28:37.530974] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T18:28:37.717706] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-22T18:28:38.445146] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T18:28:38.517719] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-22T18:28:38.612137] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T18:28:39.317710] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-22T18:28:39.769451] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T18:28:40.117689] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-22T18:28:40.229959] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T18:28:40.917743] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-22T18:28:41.476762] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T18:28:41.483261] [INFO ] [REMOTE ] EDN: Full fetch complete (29815 records). [2025-10-22T18:28:41.483412] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-22T18:28:41.723759] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-22T18:28:41.896412] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-22T18:28:41.896490] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-22T18:28:41.897008] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-22T18:28:41.897093] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-22T18:28:41.897794] [DEBUG] [LOCAL ] EDN: Trimmed 29815 records to 19304 (keeping 200 days of data) [2025-10-22T18:28:42.005191] [DEBUG] [LOCAL ] EDN: Primary data saved (19304 records). [2025-10-22T18:28:42.005320] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-22T18:28:42.005396] [INFO ] [MAIN ] Update Progress: 698/2367 symbols completed. EDN took 31.5s. Estimated remaining: 3h 31m 54s. Rate: 7.9 symbols/min [2025-10-22T18:28:42.170475] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:28:42.181479] [DEBUG] [LOCAL ] EEX: Loaded 9972 existing records from primary storage. [2025-10-22T18:28:42.181716] [INFO ] [MAIN ] EEX: Loaded 9972 existing records. [2025-10-22T18:28:42.366144] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-22T18:28:42.371312] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:28:42.373840] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-22T18:28:42.373963] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-22T18:28:42.374167] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-22T18:28:42.374226] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-22T18:28:42.521260] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-22T18:28:42.736214] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T18:28:42.768611] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:28:43.178116] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-22T18:28:43.317719] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-22T18:28:43.871904] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-22T18:28:44.117695] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-22T18:28:44.917709] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-22T18:28:45.464791] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-22T18:28:45.492248] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T18:28:45.717700] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-22T18:28:46.517689] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-22T18:28:46.830119] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T18:28:46.913010] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-22T18:28:47.317706] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-22T18:28:48.117753] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-22T18:28:48.732456] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T18:28:48.917764] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-22T18:28:49.717726] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-22T18:28:49.830585] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T18:28:50.288374] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T18:28:50.341508] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-22T18:28:50.517700] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-22T18:28:51.317723] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-22T18:28:52.117683] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-22T18:28:52.254368] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T18:28:52.262107] [INFO ] [REMOTE ] EDU: Full fetch complete (67193 records). [2025-10-22T18:28:52.262268] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-22T18:28:52.650154] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-22T18:28:52.650260] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-22T18:28:52.651200] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-22T18:28:52.651283] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-22T18:28:52.652759] [DEBUG] [LOCAL ] EDU: Trimmed 67193 records to 44813 (keeping 200 days of data) [2025-10-22T18:28:52.755255] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T18:28:52.923205] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-22T18:28:52.932166] [DEBUG] [LOCAL ] EDU: Primary data saved (44813 records). [2025-10-22T18:28:52.932303] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-22T18:28:52.932997] [INFO ] [MAIN ] Update Progress: 699/2367 symbols completed. EDU took 34.6s. Estimated remaining: 3h 31m 55s. Rate: 7.9 symbols/min [2025-10-22T18:28:53.101961] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:28:53.158442] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T18:28:53.159344] [DEBUG] [LOCAL ] EFC: Loaded 46334 existing records from primary storage. [2025-10-22T18:28:53.164823] [INFO ] [MAIN ] EFC: Loaded 46334 existing records. [2025-10-22T18:28:53.338694] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:28:53.338910] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-22T18:28:53.338958] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-22T18:28:53.339171] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-22T18:28:53.339227] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-22T18:28:53.694527] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:28:53.717703] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-22T18:28:54.386580] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T18:28:54.393231] [INFO ] [REMOTE ] EE: Full fetch complete (44516 records). [2025-10-22T18:28:54.393445] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-22T18:28:54.522948] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-22T18:28:54.815944] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-22T18:28:54.816626] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-22T18:28:54.817726] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-22T18:28:54.818338] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-22T18:28:54.818238] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-22T18:28:54.824278] [DEBUG] [LOCAL ] EE: Trimmed 44516 records to 32539 (keeping 200 days of data) [2025-10-22T18:28:55.041080] [DEBUG] [LOCAL ] EE: Primary data saved (32539 records). [2025-10-22T18:28:55.041286] [INFO ] [MAIN ] EE: Full history saved. [2025-10-22T18:28:55.041379] [INFO ] [MAIN ] Update Progress: 700/2367 symbols completed. EE took 29.4s. Estimated remaining: 3h 31m 34s. Rate: 7.9 symbols/min [2025-10-22T18:28:55.259317] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:28:55.278566] [DEBUG] [LOCAL ] EFR: Loaded 15065 existing records from primary storage. [2025-10-22T18:28:55.278931] [INFO ] [MAIN ] EFR: Loaded 15065 existing records. [2025-10-22T18:28:55.323008] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-22T18:28:55.460907] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:28:55.461196] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-22T18:28:55.461248] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-22T18:28:55.461447] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-22T18:28:55.461488] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-22T18:28:55.821385] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:28:56.117683] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-22T18:28:56.198409] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T18:28:56.218718] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-22T18:28:56.917685] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-22T18:28:57.040551] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T18:28:57.717681] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-22T18:28:57.870375] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T18:28:58.442220] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T18:28:58.517701] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-22T18:28:59.123587] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T18:28:59.317725] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-22T18:29:00.092911] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-22T18:29:00.117612] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-22T18:29:00.917689] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-22T18:29:01.397043] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T18:29:01.717706] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-22T18:29:02.431338] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T18:29:02.517620] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-22T18:29:02.610837] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T18:29:03.317690] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-22T18:29:03.851584] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-22T18:29:03.852368] [INFO ] [REMOTE ] EEA: Full fetch complete (3734 records). [2025-10-22T18:29:03.852434] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-22T18:29:03.852804] [FATAL] [VALIDATOR ] EEA: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:29:03.852884] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:29:03.852926] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:29:03.852992] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-22T18:29:03.853052] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-22T18:29:03.853086] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-22T18:29:03.853125] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-22T18:29:03.853174] [INFO ] [MAIN ] Update Progress: 701/2367 symbols completed. EEA took 33.4s. Estimated remaining: 3h 31m 29s. Rate: 7.9 symbols/min [2025-10-22T18:29:03.992313] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T18:29:04.056165] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:29:04.071087] [DEBUG] [LOCAL ] EFT: Loaded 13016 existing records from primary storage. [2025-10-22T18:29:04.071330] [INFO ] [MAIN ] EFT: Loaded 13016 existing records. [2025-10-22T18:29:04.125796] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-22T18:29:04.255723] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:29:04.256001] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-22T18:29:04.256058] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-22T18:29:04.256236] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-22T18:29:04.256290] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-22T18:29:04.614065] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:29:04.792612] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-22T18:29:04.917672] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-22T18:29:05.659015] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T18:29:05.717705] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-22T18:29:06.517714] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-22T18:29:06.712886] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-22T18:29:06.959978] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T18:29:07.317708] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-22T18:29:08.117707] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-22T18:29:08.920597] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-22T18:29:09.012017] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-22T18:29:09.013879] [INFO ] [REMOTE ] EEX: Full fetch complete (18293 records). [2025-10-22T18:29:09.013970] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-22T18:29:09.299906] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-22T18:29:09.409383] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-22T18:29:09.409465] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-22T18:29:09.409907] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-22T18:29:09.409971] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-22T18:29:09.410512] [DEBUG] [LOCAL ] EEX: Trimmed 18293 records to 9811 (keeping 200 days of data) [2025-10-22T18:29:09.464697] [DEBUG] [LOCAL ] EEX: Primary data saved (9811 records). [2025-10-22T18:29:09.464817] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-22T18:29:09.464892] [INFO ] [MAIN ] Update Progress: 702/2367 symbols completed. EEX took 27.5s. Estimated remaining: 3h 31m 17s. Rate: 7.9 symbols/min [2025-10-22T18:29:09.630274] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:29:09.670108] [DEBUG] [LOCAL ] EFX: Loaded 44767 existing records from primary storage. [2025-10-22T18:29:09.670407] [INFO ] [MAIN ] EFX: Loaded 44767 existing records. [2025-10-22T18:29:09.723137] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-22T18:29:09.848439] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:29:09.848619] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-22T18:29:09.848696] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-22T18:29:09.848886] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-22T18:29:09.848925] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-22T18:29:09.956692] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T18:29:10.207993] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:29:10.517749] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-22T18:29:11.317710] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-22T18:29:11.443236] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T18:29:11.646955] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T18:29:12.094810] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T18:29:12.117681] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-22T18:29:12.917705] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-22T18:29:13.717663] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-22T18:29:13.830775] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T18:29:13.960052] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T18:29:14.234549] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-22T18:29:14.517714] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-22T18:29:15.317673] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-22T18:29:15.372008] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-22T18:29:16.117681] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-22T18:29:16.339350] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-22T18:29:16.917695] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-22T18:29:17.717679] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-22T18:29:17.867823] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T18:29:17.950977] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T18:29:17.954365] [INFO ] [REMOTE ] EFR: Full fetch complete (19695 records). [2025-10-22T18:29:17.954467] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-22T18:29:18.363375] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-22T18:29:18.363468] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-22T18:29:18.363900] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-22T18:29:18.363960] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-22T18:29:18.364496] [DEBUG] [LOCAL ] EFR: Trimmed 19695 records to 15025 (keeping 200 days of data) [2025-10-22T18:29:18.453336] [DEBUG] [LOCAL ] EFR: Primary data saved (15025 records). [2025-10-22T18:29:18.453481] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-22T18:29:18.453561] [INFO ] [MAIN ] Update Progress: 703/2367 symbols completed. EFR took 23.4s. Estimated remaining: 3h 31m 13s. Rate: 7.9 symbols/min [2025-10-22T18:29:18.522860] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-22T18:29:18.629511] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:29:18.629741] [DEBUG] [LOCAL ] EFXT: No existing data file found in primary storage. [2025-10-22T18:29:18.629794] [WARN ] [MAIN ] EFXT: No existing data found, performing full refresh instead. [2025-10-22T18:29:18.629926] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-22T18:29:18.629971] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-22T18:29:18.630012] [DEBUG] [LOCAL ] EFXT: No primary data file found to delete. [2025-10-22T18:29:18.630044] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-22T18:29:18.973199] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:29:19.317759] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-22T18:29:19.365708] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T18:29:20.121497] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-22T18:29:20.140363] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T18:29:20.349989] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T18:29:20.917701] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-22T18:29:21.654781] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T18:29:21.717699] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-22T18:29:22.517675] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-22T18:29:22.569575] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T18:29:22.854070] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-22T18:29:23.317623] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-22T18:29:23.475469] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T18:29:24.117754] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-22T18:29:24.917684] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-22T18:29:25.139774] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T18:29:25.717684] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-22T18:29:25.980015] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T18:29:26.052276] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T18:29:26.517705] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-22T18:29:27.317707] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-22T18:29:27.566224] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T18:29:27.811167] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-22T18:29:28.117705] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-22T18:29:28.917622] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-22T18:29:29.040166] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T18:29:29.717733] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-22T18:29:29.799919] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T18:29:29.857580] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-22T18:29:30.517723] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-22T18:29:30.565637] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-22T18:29:31.317728] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-22T18:29:31.740712] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T18:29:32.117764] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-22T18:29:32.837474] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T18:29:32.917726] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-22T18:29:33.717662] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-22T18:29:33.881981] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-22T18:29:33.890550] [INFO ] [REMOTE ] EFC: Full fetch complete (66659 records). [2025-10-22T18:29:33.890699] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-22T18:29:34.197126] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-22T18:29:34.293716] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-22T18:29:34.293858] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-22T18:29:34.294756] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-22T18:29:34.294864] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-22T18:29:34.296216] [DEBUG] [LOCAL ] EFC: Trimmed 66659 records to 46280 (keeping 200 days of data) [2025-10-22T18:29:34.393608] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-22T18:29:34.517719] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-22T18:29:34.589482] [DEBUG] [LOCAL ] EFC: Primary data saved (46280 records). [2025-10-22T18:29:34.589625] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-22T18:29:34.590436] [INFO ] [MAIN ] Update Progress: 704/2367 symbols completed. EFC took 41.7s. Estimated remaining: 3h 31m 25s. Rate: 7.9 symbols/min [2025-10-22T18:29:34.771869] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:29:34.801392] [DEBUG] [LOCAL ] EG: Loaded 27710 existing records from primary storage. [2025-10-22T18:29:34.801704] [INFO ] [MAIN ] EG: Loaded 27710 existing records. [2025-10-22T18:29:34.988332] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:29:34.988543] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-22T18:29:34.988589] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-22T18:29:34.988814] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-22T18:29:34.988871] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-22T18:29:35.317674] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-22T18:29:35.337221] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:29:35.403196] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T18:29:36.117699] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-22T18:29:36.701215] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T18:29:36.917624] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-22T18:29:37.717712] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-22T18:29:37.877912] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T18:29:38.101506] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T18:29:38.517695] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-22T18:29:38.930172] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T18:29:39.317752] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-22T18:29:39.667448] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T18:29:40.117743] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-22T18:29:40.914193] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T18:29:40.922843] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-22T18:29:41.526601] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T18:29:41.717739] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-22T18:29:42.062160] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-22T18:29:42.064588] [INFO ] [REMOTE ] EFT: Full fetch complete (17666 records). [2025-10-22T18:29:42.064691] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-22T18:29:42.065147] [FATAL] [VALIDATOR ] EFT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:29:42.065228] [FATAL] [MAIN ] EFT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:29:42.065297] [WARN ] [MAIN ] EFT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:29:42.065368] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-22T18:29:42.065430] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-10-22T18:29:42.065465] [INFO ] [LOCAL ] EFT: Starting deletion of derivative data. [2025-10-22T18:29:42.065623] [DEBUG] [LOCAL ] EFT: Deleted derivative data file. [2025-10-22T18:29:42.065732] [INFO ] [MAIN ] Update Progress: 705/2367 symbols completed. EFT took 38.2s. Estimated remaining: 3h 31m 17s. Rate: 7.9 symbols/min [2025-10-22T18:29:42.231394] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:29:42.279773] [DEBUG] [LOCAL ] EGO: Loaded 51738 existing records from primary storage. [2025-10-22T18:29:42.280095] [INFO ] [MAIN ] EGO: Loaded 51738 existing records. [2025-10-22T18:29:42.459871] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:29:42.460059] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-22T18:29:42.460101] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-22T18:29:42.460280] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-22T18:29:42.460319] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-22T18:29:42.522932] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-22T18:29:42.818424] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:29:43.326870] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-22T18:29:43.332476] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T18:29:44.009061] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T18:29:44.016874] [INFO ] [REMOTE ] EFXT: Full fetch complete (44270 records). [2025-10-22T18:29:44.017026] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-22T18:29:44.126042] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-22T18:29:44.406995] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-22T18:29:44.407070] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-22T18:29:44.407735] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-22T18:29:44.407795] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-22T18:29:44.408636] [DEBUG] [LOCAL ] EFXT: Trimmed 44270 records to 29466 (keeping 200 days of data) [2025-10-22T18:29:44.573537] [DEBUG] [LOCAL ] EFXT: Primary data saved (29466 records). [2025-10-22T18:29:44.573715] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-22T18:29:44.573833] [INFO ] [MAIN ] Update Progress: 706/2367 symbols completed. EFXT took 26.1s. Estimated remaining: 3h 30m 57s. Rate: 7.9 symbols/min [2025-10-22T18:29:44.753698] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:29:44.786103] [DEBUG] [LOCAL ] EGP: Loaded 30323 existing records from primary storage. [2025-10-22T18:29:44.786414] [INFO ] [MAIN ] EGP: Loaded 30323 existing records. [2025-10-22T18:29:44.933432] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-22T18:29:44.974248] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:29:44.974960] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-22T18:29:44.975046] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-22T18:29:44.975407] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-22T18:29:44.975481] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-22T18:29:45.291789] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-22T18:29:45.384681] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:29:45.455068] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-22T18:29:45.717713] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-22T18:29:46.517670] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-22T18:29:46.730915] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T18:29:46.738333] [INFO ] [REMOTE ] EFX: Full fetch complete (64777 records). [2025-10-22T18:29:46.738450] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-22T18:29:46.739249] [FATAL] [VALIDATOR ] EFX: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:29:46.739332] [FATAL] [MAIN ] EFX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:29:46.739373] [WARN ] [MAIN ] EFX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:29:46.739448] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-22T18:29:46.739510] [DEBUG] [LOCAL ] EFX: No primary data file found to delete. [2025-10-22T18:29:46.739544] [INFO ] [LOCAL ] EFX: Starting deletion of derivative data. [2025-10-22T18:29:46.739708] [DEBUG] [LOCAL ] EFX: Deleted derivative data file. [2025-10-22T18:29:46.739798] [INFO ] [MAIN ] Update Progress: 707/2367 symbols completed. EFX took 37.3s. Estimated remaining: 3h 30m 37s. Rate: 7.9 symbols/min [2025-10-22T18:29:46.910659] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:29:46.931177] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T18:29:46.967591] [DEBUG] [LOCAL ] EGY: Loaded 41354 existing records from primary storage. [2025-10-22T18:29:46.967917] [INFO ] [MAIN ] EGY: Loaded 41354 existing records. [2025-10-22T18:29:47.143249] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:29:47.143465] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-22T18:29:47.143511] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-22T18:29:47.143727] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-22T18:29:47.143782] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-22T18:29:47.328849] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-22T18:29:47.495869] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:29:48.117726] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-22T18:29:48.326502] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T18:29:48.917719] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-22T18:29:49.077617] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T18:29:49.717734] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-22T18:29:49.826576] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T18:29:50.517741] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-22T18:29:50.928454] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-22T18:29:50.995416] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-22T18:29:51.317697] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-22T18:29:51.968175] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T18:29:52.117706] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-22T18:29:52.561015] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T18:29:52.917714] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-22T18:29:53.609963] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T18:29:53.717712] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-22T18:29:54.402918] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T18:29:54.517675] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-22T18:29:55.096701] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T18:29:55.317695] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-22T18:29:55.998478] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-22T18:29:56.117679] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-22T18:29:56.760765] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T18:29:56.917687] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-22T18:29:57.700805] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T18:29:57.717616] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-22T18:29:58.062140] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T18:29:58.517770] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-22T18:29:59.317683] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-22T18:29:59.392948] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T18:30:00.117709] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-22T18:30:00.338526] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T18:30:00.917670] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-22T18:30:01.276863] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-22T18:30:01.717701] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-22T18:30:02.179185] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-22T18:30:02.517710] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-22T18:30:03.317708] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-22T18:30:04.833581] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T18:30:04.840113] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-22T18:30:06.189916] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T18:30:06.194144] [INFO ] [REMOTE ] EG: Full fetch complete (42936 records). [2025-10-22T18:30:06.194245] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-22T18:30:06.478413] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (5.56 seconds). [2025-10-22T18:30:06.517938] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-22T18:30:06.600959] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-22T18:30:06.601041] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-22T18:30:06.601616] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-22T18:30:06.601686] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-22T18:30:06.602590] [DEBUG] [LOCAL ] EG: Trimmed 42936 records to 27544 (keeping 200 days of data) [2025-10-22T18:30:06.777352] [DEBUG] [LOCAL ] EG: Primary data saved (27544 records). [2025-10-22T18:30:06.777589] [INFO ] [MAIN ] EG: Full history saved. [2025-10-22T18:30:06.777734] [INFO ] [MAIN ] Update Progress: 708/2367 symbols completed. EG took 32.2s. Estimated remaining: 3h 30m 58s. Rate: 7.9 symbols/min [2025-10-22T18:30:06.951786] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:30:06.979621] [DEBUG] [LOCAL ] EHAB: Loaded 29287 existing records from primary storage. [2025-10-22T18:30:06.979938] [INFO ] [MAIN ] EHAB: Loaded 29287 existing records. [2025-10-22T18:30:07.154983] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:30:07.155241] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-22T18:30:07.155288] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-22T18:30:07.155557] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-22T18:30:07.155613] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-22T18:30:07.525125] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:30:07.525547] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-22T18:30:07.774862] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (5.26 seconds). [2025-10-22T18:30:07.784067] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-22T18:30:07.842152] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T18:30:07.848905] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-22T18:30:07.909064] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (6.19 seconds). [2025-10-22T18:30:08.117759] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-22T18:30:08.684862] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T18:30:08.917686] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-22T18:30:09.308436] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T18:30:09.369881] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T18:30:09.598160] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T18:30:09.717681] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-22T18:30:10.198453] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T18:30:10.517733] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-22T18:30:11.317682] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-22T18:30:11.632117] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-22T18:30:11.740337] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-22T18:30:12.117683] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-22T18:30:12.917680] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-22T18:30:12.982073] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T18:30:13.428841] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T18:30:13.717716] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-22T18:30:14.517700] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-22T18:30:15.317667] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-22T18:30:15.541134] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T18:30:16.034826] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T18:30:16.042057] [INFO ] [REMOTE ] EGY: Full fetch complete (60732 records). [2025-10-22T18:30:16.042282] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-22T18:30:16.119989] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-22T18:30:16.342987] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T18:30:16.421319] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (3.50 seconds). [2025-10-22T18:30:16.467480] [INFO ] [REMOTE ] EGO: Full fetch complete (74574 records). [2025-10-22T18:30:16.488459] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-22T18:30:16.503179] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-22T18:30:16.503278] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-22T18:30:16.504118] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-22T18:30:16.504202] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-22T18:30:16.604846] [DEBUG] [LOCAL ] EGY: Trimmed 60732 records to 41231 (keeping 200 days of data) [2025-10-22T18:30:16.918358] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-22T18:30:17.005328] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-22T18:30:17.005940] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-22T18:30:17.007411] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-22T18:30:17.008063] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-22T18:30:17.012140] [DEBUG] [LOCAL ] EGO: Trimmed 74574 records to 51739 (keeping 200 days of data) [2025-10-22T18:30:17.355473] [DEBUG] [LOCAL ] EGY: Primary data saved (41231 records). [2025-10-22T18:30:17.356117] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-22T18:30:17.357005] [INFO ] [MAIN ] Update Progress: 709/2367 symbols completed. EGY took 30.6s. Estimated remaining: 3h 30m 58s. Rate: 7.9 symbols/min [2025-10-22T18:30:17.608143] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:30:17.610442] [DEBUG] [LOCAL ] EGO: Primary data saved (51739 records). [2025-10-22T18:30:17.610564] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-22T18:30:17.610759] [INFO ] [MAIN ] Update Progress: 710/2367 symbols completed. EGO took 35.5s. Estimated remaining: 3h 30m 33s. Rate: 7.9 symbols/min [2025-10-22T18:30:17.826673] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:30:17.840485] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T18:30:17.849809] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-22T18:30:17.864988] [DEBUG] [LOCAL ] EHC: Loaded 40976 existing records from primary storage. [2025-10-22T18:30:17.865558] [INFO ] [MAIN ] EHC: Loaded 40976 existing records. [2025-10-22T18:30:17.919983] [DEBUG] [LOCAL ] EHI: Loaded 10531 existing records from primary storage. [2025-10-22T18:30:17.953458] [INFO ] [MAIN ] EHI: Loaded 10531 existing records. [2025-10-22T18:30:18.179768] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:30:18.236771] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:30:18.236971] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-22T18:30:18.232566] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-22T18:30:18.237096] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-22T18:30:18.237263] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-22T18:30:18.242682] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-22T18:30:18.249929] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-22T18:30:18.251988] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-22T18:30:18.252087] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-22T18:30:18.318327] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T18:30:18.521318] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-22T18:30:18.960591] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:30:18.981427] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:30:19.317618] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-22T18:30:19.401630] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-22T18:30:19.406581] [INFO ] [REMOTE ] EGP: Full fetch complete (45594 records). [2025-10-22T18:30:19.406700] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-22T18:30:19.806850] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-22T18:30:19.807170] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-22T18:30:19.807863] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-22T18:30:19.807929] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-22T18:30:19.809051] [DEBUG] [LOCAL ] EGP: Trimmed 45594 records to 30227 (keeping 200 days of data) [2025-10-22T18:30:19.998756] [DEBUG] [LOCAL ] EGP: Primary data saved (30227 records). [2025-10-22T18:30:19.998925] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-22T18:30:19.999005] [INFO ] [MAIN ] Update Progress: 711/2367 symbols completed. EGP took 35.4s. Estimated remaining: 3h 30m 13s. Rate: 7.9 symbols/min [2025-10-22T18:30:20.122745] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-22T18:30:20.164732] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:30:20.186528] [DEBUG] [LOCAL ] EIC: Loaded 22643 existing records from primary storage. [2025-10-22T18:30:20.186786] [INFO ] [MAIN ] EIC: Loaded 22643 existing records. [2025-10-22T18:30:20.360554] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:30:20.360720] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-22T18:30:20.360787] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-22T18:30:20.361148] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-22T18:30:20.361204] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-22T18:30:20.709528] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:30:20.917610] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-22T18:30:21.721055] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T18:30:21.729185] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-22T18:30:21.972417] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-10-22T18:30:22.129855] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T18:30:22.284300] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (3.76 seconds). [2025-10-22T18:30:22.517788] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-22T18:30:22.815391] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T18:30:23.072673] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-22T18:30:23.317740] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-22T18:30:24.122122] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-22T18:30:24.127605] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T18:30:24.917758] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-22T18:30:25.717746] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-22T18:30:26.099410] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T18:30:26.290799] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-22T18:30:26.517714] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-22T18:30:27.067157] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T18:30:27.317737] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-22T18:30:28.117704] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-22T18:30:28.196285] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T18:30:28.473595] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T18:30:28.917719] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-22T18:30:29.419744] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-22T18:30:29.717765] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-22T18:30:30.517707] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-22T18:30:30.566000] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T18:30:30.605444] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T18:30:31.317693] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-22T18:30:31.703740] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-22T18:30:32.117724] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-22T18:30:32.841305] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T18:30:32.917613] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-22T18:30:33.053983] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T18:30:33.717723] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-22T18:30:34.522777] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-22T18:30:34.554038] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T18:30:34.574230] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T18:30:35.317762] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-22T18:30:35.915311] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T18:30:35.919959] [INFO ] [REMOTE ] EHAB: Full fetch complete (41200 records). [2025-10-22T18:30:35.920064] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-22T18:30:36.126360] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-22T18:30:36.292869] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-22T18:30:36.292944] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-22T18:30:36.293517] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-22T18:30:36.293556] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-22T18:30:36.294378] [DEBUG] [LOCAL ] EHAB: Trimmed 41200 records to 29342 (keeping 200 days of data) [2025-10-22T18:30:36.455090] [DEBUG] [LOCAL ] EHAB: Primary data saved (29342 records). [2025-10-22T18:30:36.455217] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-22T18:30:36.455295] [INFO ] [MAIN ] Update Progress: 712/2367 symbols completed. EHAB took 29.7s. Estimated remaining: 3h 30m 26s. Rate: 7.9 symbols/min [2025-10-22T18:30:36.623619] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:30:36.623867] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-22T18:30:36.623979] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-22T18:30:36.624115] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-22T18:30:36.624157] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-22T18:30:36.624197] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-22T18:30:36.624229] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-22T18:30:36.923594] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-22T18:30:37.029869] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:30:37.145903] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T18:30:37.553796] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T18:30:37.717694] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-22T18:30:37.758665] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-22T18:30:38.219256] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-22T18:30:38.517666] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-22T18:30:39.317755] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-22T18:30:39.327312] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T18:30:40.117694] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-22T18:30:40.657246] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-22T18:30:40.917720] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-22T18:30:41.525059] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T18:30:41.717687] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-22T18:30:41.762946] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-22T18:30:41.765569] [INFO ] [REMOTE ] EHI: Full fetch complete (15810 records). [2025-10-22T18:30:41.765672] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-22T18:30:42.130129] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-22T18:30:42.130236] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-22T18:30:42.130578] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-22T18:30:42.130617] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-22T18:30:42.131206] [DEBUG] [LOCAL ] EHI: Trimmed 15810 records to 10532 (keeping 200 days of data) [2025-10-22T18:30:42.189877] [DEBUG] [LOCAL ] EHI: Primary data saved (10532 records). [2025-10-22T18:30:42.190004] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-22T18:30:42.190086] [INFO ] [MAIN ] Update Progress: 713/2367 symbols completed. EHI took 24.6s. Estimated remaining: 3h 30m 14s. Rate: 7.9 symbols/min [2025-10-22T18:30:42.355092] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:30:42.355269] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-22T18:30:42.355353] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-22T18:30:42.355433] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-22T18:30:42.355468] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-22T18:30:42.355507] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-22T18:30:42.355537] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-22T18:30:42.525193] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-22T18:30:42.711661] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:30:42.928422] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-22T18:30:42.959941] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T18:30:43.317741] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-22T18:30:44.117746] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-22T18:30:44.460845] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-22T18:30:44.917742] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-22T18:30:45.090216] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T18:30:45.096603] [INFO ] [REMOTE ] EHC: Full fetch complete (58781 records). [2025-10-22T18:30:45.096733] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-22T18:30:45.487690] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-22T18:30:45.487789] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-22T18:30:45.488518] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-22T18:30:45.488561] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-22T18:30:45.489841] [DEBUG] [LOCAL ] EHC: Trimmed 58781 records to 40923 (keeping 200 days of data) [2025-10-22T18:30:45.721757] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-22T18:30:45.759017] [DEBUG] [LOCAL ] EHC: Primary data saved (40923 records). [2025-10-22T18:30:45.759142] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-22T18:30:45.759218] [INFO ] [MAIN ] Update Progress: 714/2367 symbols completed. EHC took 28.4s. Estimated remaining: 3h 29m 57s. Rate: 7.9 symbols/min [2025-10-22T18:30:45.925882] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:30:45.926125] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-22T18:30:45.926177] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-22T18:30:45.926283] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-22T18:30:45.926324] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-22T18:30:45.926365] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-22T18:30:45.926422] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-22T18:30:46.300730] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:30:46.307462] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-22T18:30:46.311520] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-22T18:30:46.517708] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-22T18:30:47.099604] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-22T18:30:47.317794] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-22T18:30:48.117736] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-22T18:30:48.495916] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-22T18:30:48.513855] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-22T18:30:48.917773] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-22T18:30:49.717748] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-22T18:30:49.890678] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T18:30:50.083066] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-22T18:30:50.517697] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-22T18:30:51.317747] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-22T18:30:51.669101] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T18:30:51.672905] [INFO ] [REMOTE ] EIC: Full fetch complete (34169 records). [2025-10-22T18:30:51.673035] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-22T18:30:51.794860] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-22T18:30:52.076269] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-22T18:30:52.076396] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-22T18:30:52.077003] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-22T18:30:52.077069] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-22T18:30:52.078108] [DEBUG] [LOCAL ] EIC: Trimmed 34169 records to 22441 (keeping 200 days of data) [2025-10-22T18:30:52.130887] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-22T18:30:52.220103] [DEBUG] [LOCAL ] EIC: Primary data saved (22441 records). [2025-10-22T18:30:52.220269] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-22T18:30:52.220365] [INFO ] [MAIN ] Update Progress: 715/2367 symbols completed. EIC took 32.2s. Estimated remaining: 3h 29m 47s. Rate: 7.9 symbols/min [2025-10-22T18:30:52.387275] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:30:52.407186] [DEBUG] [LOCAL ] EIG: Loaded 20185 existing records from primary storage. [2025-10-22T18:30:52.407444] [INFO ] [MAIN ] EIG: Loaded 20185 existing records. [2025-10-22T18:30:52.533815] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-22T18:30:52.594224] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:30:52.594535] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-22T18:30:52.594593] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-22T18:30:52.595001] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-22T18:30:52.595224] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-22T18:30:52.922868] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-22T18:30:52.963611] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:30:53.530883] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T18:30:53.717695] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-22T18:30:54.135696] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-22T18:30:54.517690] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-22T18:30:54.861384] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-22T18:30:55.317682] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-22T18:30:55.922734] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T18:30:56.117698] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-22T18:30:56.642608] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-22T18:30:56.917697] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-22T18:30:57.376171] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-22T18:30:57.717722] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-22T18:30:58.191732] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-22T18:30:58.517707] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-22T18:30:59.229214] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-22T18:30:59.317722] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-22T18:31:00.117692] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-22T18:31:00.296211] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T18:31:00.765691] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T18:31:00.917709] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-22T18:31:01.717702] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-22T18:31:02.486509] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T18:31:02.517625] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-22T18:31:03.119174] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T18:31:03.243543] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T18:31:03.317669] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-22T18:31:03.844126] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-22T18:31:04.117725] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-22T18:31:04.737782] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-22T18:31:04.917724] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-22T18:31:05.375360] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-22T18:31:05.717689] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-22T18:31:06.052090] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-22T18:31:06.517720] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-22T18:31:07.209924] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-22T18:31:07.317686] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-22T18:31:08.105958] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-22T18:31:08.117614] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-22T18:31:08.797275] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T18:31:08.917706] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-22T18:31:09.364713] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-22T18:31:09.365429] [INFO ] [REMOTE ] EICA: Full fetch complete (1252 records). [2025-10-22T18:31:09.365495] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-22T18:31:09.540070] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-22T18:31:09.540244] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:31:09.540311] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:31:09.540380] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-22T18:31:09.540443] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-22T18:31:09.540478] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-22T18:31:09.540517] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-22T18:31:09.540568] [INFO ] [MAIN ] Update Progress: 716/2367 symbols completed. EICA took 33.1s. Estimated remaining: 3h 30m 1s. Rate: 7.9 symbols/min [2025-10-22T18:31:09.716835] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:31:09.717007] [DEBUG] [LOCAL ] EIX: No existing data file found in primary storage. [2025-10-22T18:31:09.717050] [WARN ] [MAIN ] EIX: No existing data found, performing full refresh instead. [2025-10-22T18:31:09.717160] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-22T18:31:09.717201] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-22T18:31:09.717243] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-10-22T18:31:09.717277] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-22T18:31:09.722750] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-22T18:31:10.079157] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:31:10.517710] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-22T18:31:10.941073] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-22T18:31:11.317729] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-22T18:31:11.940266] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-22T18:31:11.941147] [INFO ] [REMOTE ] EICB: Full fetch complete (2680 records). [2025-10-22T18:31:11.941215] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-22T18:31:11.941536] [FATAL] [VALIDATOR ] EICB: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:31:11.941616] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:31:11.941701] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:31:11.941771] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-22T18:31:11.941839] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-22T18:31:11.941874] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-22T18:31:11.941913] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-22T18:31:11.942001] [INFO ] [MAIN ] Update Progress: 717/2367 symbols completed. EICB took 29.8s. Estimated remaining: 3h 29m 42s. Rate: 7.9 symbols/min [2025-10-22T18:31:12.117725] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-22T18:31:12.674415] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-22T18:31:12.774991] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-22T18:31:12.776867] [INFO ] [REMOTE ] EICC: Full fetch complete (8463 records). [2025-10-22T18:31:12.776971] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-22T18:31:12.777381] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:31:12.777464] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:31:12.777514] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:31:12.777598] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-22T18:31:12.777737] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-22T18:31:12.777798] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-22T18:31:12.777859] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-22T18:31:12.777938] [INFO ] [MAIN ] Update Progress: 718/2367 symbols completed. EICC took 27.0s. Estimated remaining: 3h 29m 18s. Rate: 7.9 symbols/min [2025-10-22T18:31:12.917724] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-22T18:31:13.717701] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-22T18:31:14.796773] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T18:31:14.807971] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-22T18:31:14.839987] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T18:31:15.317727] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-22T18:31:16.417138] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T18:31:16.425105] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-22T18:31:16.739169] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T18:31:16.917842] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-22T18:31:17.417849] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T18:31:17.717691] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-22T18:31:18.674869] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T18:31:18.686792] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-22T18:31:18.779230] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T18:31:19.317773] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-22T18:31:20.475039] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T18:31:20.481809] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-22T18:31:20.572307] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T18:31:20.917733] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-22T18:31:21.616002] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T18:31:21.717820] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-22T18:31:22.615417] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-22T18:31:22.619358] [INFO ] [REMOTE ] EIG: Full fetch complete (27312 records). [2025-10-22T18:31:22.619523] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-22T18:31:23.068790] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-22T18:31:23.133913] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-22T18:31:23.134577] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-22T18:31:23.135141] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-22T18:31:23.134485] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-22T18:31:23.135302] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-22T18:31:23.137218] [DEBUG] [LOCAL ] EIG: Trimmed 27312 records to 20065 (keeping 200 days of data) [2025-10-22T18:31:23.261612] [DEBUG] [LOCAL ] EIG: Primary data saved (20065 records). [2025-10-22T18:31:23.261772] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-22T18:31:23.261854] [INFO ] [MAIN ] Update Progress: 719/2367 symbols completed. EIG took 31.0s. Estimated remaining: 3h 29m 17s. Rate: 7.9 symbols/min [2025-10-22T18:31:25.275008] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-22T18:31:25.288090] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-22T18:31:27.227879] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T18:31:27.239187] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-22T18:31:29.253500] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-22T18:31:29.264824] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-22T18:31:30.174018] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T18:31:30.182675] [INFO ] [REMOTE ] EIX: Full fetch complete (77445 records). [2025-10-22T18:31:30.182804] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-22T18:31:30.574463] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-22T18:31:30.574783] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-22T18:31:30.575673] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-22T18:31:30.575736] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-22T18:31:30.577182] [DEBUG] [LOCAL ] EIX: Trimmed 77445 records to 53348 (keeping 200 days of data) [2025-10-22T18:31:30.915349] [DEBUG] [LOCAL ] EIX: Primary data saved (53348 records). [2025-10-22T18:31:30.915504] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-22T18:31:30.915603] [INFO ] [MAIN ] Update Progress: 720/2367 symbols completed. EIX took 21.4s. Estimated remaining: 3h 29m 10s. Rate: 7.9 symbols/min [2025-10-22T18:31:31.474292] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:31:31.602150] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:31:31.634768] [DEBUG] [LOCAL ] EL: No existing data file found in primary storage. [2025-10-22T18:31:31.653184] [WARN ] [MAIN ] EL: No existing data found, performing full refresh instead. [2025-10-22T18:31:31.687593] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-22T18:31:31.701086] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-22T18:31:31.716027] [DEBUG] [LOCAL ] EL: No primary data file found to delete. [2025-10-22T18:31:31.740227] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-22T18:31:31.755165] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:31:31.772687] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:31:31.803546] [DEBUG] [LOCAL ] ELC: No existing data file found in primary storage. [2025-10-22T18:31:31.839060] [WARN ] [MAIN ] ELC: No existing data found, performing full refresh instead. [2025-10-22T18:31:31.860513] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-22T18:31:31.886139] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-22T18:31:31.886281] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-10-22T18:31:31.886425] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-22T18:31:32.042975] [DEBUG] [LOCAL ] ELAN: Loaded 53313 existing records from primary storage. [2025-10-22T18:31:32.115931] [INFO ] [MAIN ] ELAN: Loaded 53313 existing records. [2025-10-22T18:31:32.487463] [DEBUG] [LOCAL ] ELF: Loaded 51917 existing records from primary storage. [2025-10-22T18:31:32.518950] [INFO ] [MAIN ] ELF: Loaded 51917 existing records. [2025-10-22T18:31:32.750516] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:31:32.815964] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:31:32.853173] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-22T18:31:32.852797] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-22T18:31:32.853795] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-22T18:31:32.869432] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-22T18:31:32.874770] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-22T18:31:33.029615] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:31:33.039807] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:31:33.062022] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-22T18:31:33.071073] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-22T18:31:33.121425] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-22T18:31:33.160431] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-22T18:31:33.253157] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-22T18:31:33.518914] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:31:33.540358] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-22T18:31:33.781103] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:31:33.781502] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-22T18:31:33.806508] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-22T18:31:33.807950] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-22T18:31:34.295615] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-22T18:31:34.296920] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-22T18:31:34.859735] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-22T18:31:34.861083] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-22T18:31:35.041030] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-22T18:31:35.051488] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-22T18:31:35.214232] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T18:31:35.224800] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-22T18:31:35.424064] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-22T18:31:35.425819] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-22T18:31:35.912561] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-22T18:31:35.925027] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-22T18:31:36.051184] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-22T18:31:36.052745] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-22T18:31:36.440794] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-22T18:31:36.442459] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-22T18:31:36.858598] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T18:31:36.868976] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-22T18:31:36.885407] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-22T18:31:36.913114] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T18:31:36.925164] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-22T18:31:37.485521] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T18:31:37.717709] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-22T18:31:38.130949] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-22T18:31:38.517709] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-22T18:31:38.818616] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T18:31:39.317692] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-22T18:31:39.806783] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-22T18:31:39.809166] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-22T18:31:40.117709] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-22T18:31:40.473192] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T18:31:40.917680] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-22T18:31:41.522220] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T18:31:41.523317] [INFO ] [REMOTE ] ELC: Full fetch complete (4925 records). [2025-10-22T18:31:41.523386] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-22T18:31:41.718705] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-22T18:31:41.899570] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-22T18:31:41.899736] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-22T18:31:41.899897] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-22T18:31:41.899961] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-22T18:31:41.900336] [DEBUG] [LOCAL ] ELC: Trimmed 4925 records to 3431 (keeping 200 days of data) [2025-10-22T18:31:41.921079] [DEBUG] [LOCAL ] ELC: Primary data saved (3431 records). [2025-10-22T18:31:41.921142] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-22T18:31:41.921202] [INFO ] [MAIN ] Update Progress: 721/2367 symbols completed. ELC took 11.0s. Estimated remaining: 3h 29m 10s. Rate: 7.9 symbols/min [2025-10-22T18:31:42.100746] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:31:42.100879] [DEBUG] [LOCAL ] ELME: No existing data file found in primary storage. [2025-10-22T18:31:42.100916] [WARN ] [MAIN ] ELME: No existing data found, performing full refresh instead. [2025-10-22T18:31:42.101056] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-22T18:31:42.101113] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-22T18:31:42.101157] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-22T18:31:42.101189] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-22T18:31:42.490814] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:31:42.492984] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-22T18:31:42.517604] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-22T18:31:43.317696] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-22T18:31:43.911490] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-22T18:31:44.117684] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-22T18:31:44.209492] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T18:31:44.813554] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T18:31:44.917676] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-22T18:31:45.717616] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-22T18:31:45.952634] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T18:31:46.021495] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T18:31:46.517700] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-22T18:31:47.317690] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-22T18:31:47.832027] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-22T18:31:48.117709] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-22T18:31:48.855008] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-22T18:31:48.917754] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-22T18:31:49.163151] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T18:31:49.717707] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-22T18:31:50.296597] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-22T18:31:50.413326] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T18:31:50.517732] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-22T18:31:51.317728] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-22T18:31:51.844901] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T18:31:52.117687] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-22T18:31:52.196900] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T18:31:52.917756] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-22T18:31:53.474017] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-22T18:31:53.717740] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-22T18:31:54.254425] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-22T18:31:54.379113] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T18:31:54.517718] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-22T18:31:55.324158] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-22T18:31:55.349823] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T18:31:56.117760] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-22T18:31:56.569690] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-22T18:31:56.901355] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T18:31:56.917623] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-22T18:31:57.717717] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-22T18:31:58.239337] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-22T18:31:58.429604] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T18:31:58.517749] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-22T18:31:59.317690] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-22T18:31:59.584385] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T18:32:00.117713] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-22T18:32:00.557930] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T18:32:00.917765] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-22T18:32:01.494555] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-22T18:32:01.717772] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-22T18:32:01.792807] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T18:32:02.517721] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-22T18:32:02.990432] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T18:32:02.999053] [INFO ] [REMOTE ] ELF: Full fetch complete (75145 records). [2025-10-22T18:32:02.999228] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-22T18:32:03.000046] [FATAL] [VALIDATOR ] ELF: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:32:03.000150] [FATAL] [MAIN ] ELF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:32:03.000226] [WARN ] [MAIN ] ELF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:32:03.000302] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-22T18:32:03.000374] [DEBUG] [LOCAL ] ELF: No primary data file found to delete. [2025-10-22T18:32:03.000414] [INFO ] [LOCAL ] ELF: Starting deletion of derivative data. [2025-10-22T18:32:03.000573] [DEBUG] [LOCAL ] ELF: Deleted derivative data file. [2025-10-22T18:32:03.000693] [INFO ] [MAIN ] Update Progress: 722/2367 symbols completed. ELF took 32.1s. Estimated remaining: 3h 29m 33s. Rate: 7.9 symbols/min [2025-10-22T18:32:03.181159] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:03.181370] [DEBUG] [LOCAL ] ELP: No existing data file found in primary storage. [2025-10-22T18:32:03.181419] [WARN ] [MAIN ] ELP: No existing data found, performing full refresh instead. [2025-10-22T18:32:03.181900] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-22T18:32:03.182066] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-22T18:32:03.182234] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-10-22T18:32:03.182302] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-22T18:32:03.337396] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-22T18:32:03.437873] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T18:32:03.638867] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:03.668952] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T18:32:03.678958] [INFO ] [REMOTE ] EL: Full fetch complete (77439 records). [2025-10-22T18:32:03.679150] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-22T18:32:04.093691] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-22T18:32:04.093789] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-22T18:32:04.094676] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-22T18:32:04.094744] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-22T18:32:04.096217] [DEBUG] [LOCAL ] EL: Trimmed 77439 records to 53385 (keeping 200 days of data) [2025-10-22T18:32:04.151533] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-22T18:32:04.443927] [DEBUG] [LOCAL ] EL: Primary data saved (53385 records). [2025-10-22T18:32:04.444127] [INFO ] [MAIN ] EL: Full history saved. [2025-10-22T18:32:04.444250] [INFO ] [MAIN ] Update Progress: 723/2367 symbols completed. EL took 33.5s. Estimated remaining: 3h 29m 11s. Rate: 7.9 symbols/min [2025-10-22T18:32:04.628436] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:04.628694] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-22T18:32:04.628750] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-22T18:32:04.628863] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-22T18:32:04.628905] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-22T18:32:04.628947] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-22T18:32:04.628979] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-22T18:32:04.930330] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-22T18:32:05.054684] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:05.271283] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T18:32:05.471834] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T18:32:05.717735] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-22T18:32:06.285982] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-22T18:32:06.517742] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-22T18:32:06.676820] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T18:32:06.684317] [INFO ] [REMOTE ] ELME: Full fetch complete (56078 records). [2025-10-22T18:32:06.684517] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-22T18:32:07.062562] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-22T18:32:07.062663] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-22T18:32:07.063408] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-22T18:32:07.063452] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-22T18:32:07.064666] [DEBUG] [LOCAL ] ELME: Trimmed 56078 records to 39292 (keeping 200 days of data) [2025-10-22T18:32:07.307737] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T18:32:07.317891] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-22T18:32:07.333933] [DEBUG] [LOCAL ] ELME: Primary data saved (39292 records). [2025-10-22T18:32:07.334065] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-22T18:32:07.334159] [INFO ] [MAIN ] Update Progress: 724/2367 symbols completed. ELME took 25.4s. Estimated remaining: 3h 28m 53s. Rate: 7.9 symbols/min [2025-10-22T18:32:07.506333] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:07.506519] [DEBUG] [LOCAL ] ELS: No existing data file found in primary storage. [2025-10-22T18:32:07.506556] [WARN ] [MAIN ] ELS: No existing data found, performing full refresh instead. [2025-10-22T18:32:07.506694] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-22T18:32:07.506746] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-22T18:32:07.506788] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-10-22T18:32:07.506819] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-22T18:32:07.850025] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:08.117719] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-22T18:32:08.917740] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-22T18:32:09.206407] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T18:32:09.252178] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T18:32:09.263892] [INFO ] [REMOTE ] ELAN: Full fetch complete (77098 records). [2025-10-22T18:32:09.264131] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-22T18:32:09.720519] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-22T18:32:09.841460] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-22T18:32:09.841574] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-22T18:32:09.842614] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-22T18:32:09.842708] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-22T18:32:09.844469] [DEBUG] [LOCAL ] ELAN: Trimmed 77098 records to 53314 (keeping 200 days of data) [2025-10-22T18:32:10.107875] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-22T18:32:10.231130] [DEBUG] [LOCAL ] ELAN: Primary data saved (53314 records). [2025-10-22T18:32:10.231334] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-22T18:32:10.231452] [INFO ] [MAIN ] Update Progress: 725/2367 symbols completed. ELAN took 39.3s. Estimated remaining: 3h 28m 35s. Rate: 7.9 symbols/min [2025-10-22T18:32:10.444125] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:10.444357] [DEBUG] [LOCAL ] ELV: No existing data file found in primary storage. [2025-10-22T18:32:10.444402] [WARN ] [MAIN ] ELV: No existing data found, performing full refresh instead. [2025-10-22T18:32:10.444743] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-22T18:32:10.444800] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-22T18:32:10.444845] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-22T18:32:10.444879] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-22T18:32:10.522793] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-22T18:32:10.855111] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:10.857980] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T18:32:10.894246] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-22T18:32:11.320702] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-22T18:32:11.772952] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-22T18:32:12.117696] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-22T18:32:12.917705] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-22T18:32:13.346613] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-22T18:32:13.717718] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-22T18:32:14.083329] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-22T18:32:14.523106] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-22T18:32:14.537228] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T18:32:14.873203] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-22T18:32:15.317731] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-22T18:32:16.117879] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-22T18:32:16.696682] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-22T18:32:16.911506] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T18:32:16.920898] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-22T18:32:17.230383] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-22T18:32:17.717697] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-22T18:32:18.517724] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-22T18:32:18.758848] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-22T18:32:19.317715] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-22T18:32:19.648626] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T18:32:20.117725] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-22T18:32:20.460591] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-22T18:32:20.461475] [INFO ] [REMOTE ] ELPC: Full fetch complete (1348 records). [2025-10-22T18:32:20.461557] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-22T18:32:20.462045] [FATAL] [VALIDATOR ] ELPC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:32:20.462134] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:32:20.462217] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:32:20.462301] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-22T18:32:20.462374] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-22T18:32:20.462416] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-22T18:32:20.462463] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-22T18:32:20.462524] [INFO ] [MAIN ] Update Progress: 726/2367 symbols completed. ELPC took 16.0s. Estimated remaining: 3h 28m 33s. Rate: 7.9 symbols/min [2025-10-22T18:32:20.632092] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:20.632236] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-22T18:32:20.632272] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-22T18:32:20.632390] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-22T18:32:20.632455] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-22T18:32:20.632513] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-22T18:32:20.632565] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-22T18:32:20.922884] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-22T18:32:20.999068] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:21.153574] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T18:32:21.717735] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-22T18:32:22.517728] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-22T18:32:22.667240] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T18:32:23.067878] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-22T18:32:23.317741] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-22T18:32:23.860221] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-22T18:32:24.117615] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-10-22T18:32:24.153303] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T18:32:24.416269] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T18:32:24.416630] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-10-22T18:32:24.416784] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:32:24.416837] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-22T18:32:24.416877] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:32:24.416952] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-22T18:32:24.417045] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-22T18:32:24.417089] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-22T18:32:24.417138] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-22T18:32:24.417192] [INFO ] [MAIN ] Update Progress: 727/2367 symbols completed. EMA took 4.0s. Estimated remaining: 3h 28m 17s. Rate: 7.9 symbols/min [2025-10-22T18:32:24.620023] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:24.638838] [DEBUG] [LOCAL ] EMD: Loaded 20913 existing records from primary storage. [2025-10-22T18:32:24.639099] [INFO ] [MAIN ] EMD: Loaded 20913 existing records. [2025-10-22T18:32:24.852536] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:32:24.852779] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-22T18:32:24.852827] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-22T18:32:24.853915] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-22T18:32:24.853972] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-22T18:32:24.923055] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-22T18:32:25.250560] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:25.717744] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-22T18:32:26.517624] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-22T18:32:26.978684] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T18:32:27.197599] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-22T18:32:27.317678] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-22T18:32:27.894745] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T18:32:28.117729] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-22T18:32:28.144428] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T18:32:28.917695] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-22T18:32:29.717696] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-22T18:32:30.068612] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T18:32:30.242763] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-22T18:32:30.517696] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-22T18:32:31.317686] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-22T18:32:32.117838] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-22T18:32:32.210436] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-22T18:32:32.620427] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T18:32:32.917727] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-22T18:32:33.106238] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-22T18:32:33.717705] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-22T18:32:34.104194] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-22T18:32:34.139524] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T18:32:34.517733] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-22T18:32:35.317696] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-22T18:32:35.357555] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T18:32:36.058935] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T18:32:36.117685] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-22T18:32:36.527182] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T18:32:36.917698] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-22T18:32:37.717802] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-22T18:32:37.957285] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T18:32:37.961189] [INFO ] [REMOTE ] ELP: Full fetch complete (36643 records). [2025-10-22T18:32:37.961272] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-22T18:32:37.961791] [FATAL] [VALIDATOR ] ELP: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:32:37.961876] [FATAL] [MAIN ] ELP: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:32:37.961921] [WARN ] [MAIN ] ELP: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:32:37.961963] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-22T18:32:37.962020] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-10-22T18:32:37.962057] [INFO ] [LOCAL ] ELP: Starting deletion of derivative data. [2025-10-22T18:32:37.962148] [DEBUG] [LOCAL ] ELP: No derivative data file found to delete. [2025-10-22T18:32:37.962210] [INFO ] [MAIN ] Update Progress: 728/2367 symbols completed. ELP took 35.0s. Estimated remaining: 3h 28m 23s. Rate: 7.9 symbols/min [2025-10-22T18:32:38.129291] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:38.157950] [DEBUG] [LOCAL ] EME: Loaded 30734 existing records from primary storage. [2025-10-22T18:32:38.158235] [INFO ] [MAIN ] EME: Loaded 30734 existing records. [2025-10-22T18:32:38.338401] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:32:38.338636] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-22T18:32:38.338730] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-22T18:32:38.339233] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-22T18:32:38.339293] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-22T18:32:38.522722] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-22T18:32:38.703086] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:38.825592] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T18:32:39.317675] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-22T18:32:39.426761] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-22T18:32:40.117741] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-22T18:32:40.798543] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T18:32:40.917713] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-22T18:32:41.588843] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (3.07 seconds). [2025-10-22T18:32:41.717706] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-22T18:32:42.517625] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-22T18:32:42.768248] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-22T18:32:42.798223] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T18:32:43.317725] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-22T18:32:43.614965] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T18:32:44.117696] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-22T18:32:44.514572] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-10-22T18:32:44.917718] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-22T18:32:45.269684] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-22T18:32:45.717625] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-22T18:32:45.821195] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T18:32:46.517781] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-22T18:32:47.172301] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-22T18:32:47.180532] [INFO ] [REMOTE ] ELS: Full fetch complete (70919 records). [2025-10-22T18:32:47.180736] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-22T18:32:47.181580] [FATAL] [VALIDATOR ] ELS: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:32:47.181731] [FATAL] [MAIN ] ELS: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:32:47.181823] [WARN ] [MAIN ] ELS: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:32:47.181918] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-22T18:32:47.182002] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-10-22T18:32:47.182041] [INFO ] [LOCAL ] ELS: Starting deletion of derivative data. [2025-10-22T18:32:47.182084] [DEBUG] [LOCAL ] ELS: No derivative data file found to delete. [2025-10-22T18:32:47.182145] [INFO ] [MAIN ] Update Progress: 729/2367 symbols completed. ELS took 39.8s. Estimated remaining: 3h 28m 19s. Rate: 7.9 symbols/min [2025-10-22T18:32:47.325670] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-22T18:32:47.358681] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:47.363971] [DEBUG] [LOCAL ] EMF: Loaded 3131 existing records from primary storage. [2025-10-22T18:32:47.364143] [INFO ] [MAIN ] EMF: Loaded 3131 existing records. [2025-10-22T18:32:47.546454] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:32:47.546780] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-22T18:32:47.546889] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-22T18:32:47.547103] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-22T18:32:47.547172] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-22T18:32:47.738707] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-22T18:32:47.814768] [INFO ] [REMOTE ] ELV: Full fetch complete (72946 records). [2025-10-22T18:32:47.846800] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-22T18:32:47.873481] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:32:47.889245] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:32:47.894425] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:32:47.913032] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-22T18:32:47.923498] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-22T18:32:47.926436] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-10-22T18:32:47.934174] [DEBUG] [LOCAL ] ELV: No derivative data file found to delete. [2025-10-22T18:32:47.934274] [INFO ] [MAIN ] Update Progress: 730/2367 symbols completed. ELV took 37.7s. Estimated remaining: 3h 27m 56s. Rate: 7.9 symbols/min [2025-10-22T18:32:47.997266] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:48.127355] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:48.123532] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-22T18:32:48.174849] [DEBUG] [LOCAL ] EMN: Loaded 50825 existing records from primary storage. [2025-10-22T18:32:48.175250] [INFO ] [MAIN ] EMN: Loaded 50825 existing records. [2025-10-22T18:32:48.303891] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T18:32:48.387918] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:32:48.388127] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-22T18:32:48.388180] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-22T18:32:48.388365] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-22T18:32:48.388420] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-22T18:32:48.699020] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T18:32:48.764489] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:48.916378] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T18:32:48.918280] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-22T18:32:49.717690] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-22T18:32:50.235869] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T18:32:50.240398] [INFO ] [REMOTE ] EMD: Full fetch complete (31859 records). [2025-10-22T18:32:50.240568] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-22T18:32:50.241157] [FATAL] [VALIDATOR ] EMD: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:32:50.241245] [FATAL] [MAIN ] EMD: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:32:50.241287] [WARN ] [MAIN ] EMD: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:32:50.241326] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-22T18:32:50.241426] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-10-22T18:32:50.241468] [INFO ] [LOCAL ] EMD: Starting deletion of derivative data. [2025-10-22T18:32:50.241610] [DEBUG] [LOCAL ] EMD: Deleted derivative data file. [2025-10-22T18:32:50.241724] [INFO ] [MAIN ] Update Progress: 731/2367 symbols completed. EMD took 25.8s. Estimated remaining: 3h 27m 36s. Rate: 7.9 symbols/min [2025-10-22T18:32:50.409518] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:32:50.423400] [DEBUG] [LOCAL ] EMO: Loaded 13345 existing records from primary storage. [2025-10-22T18:32:50.423587] [INFO ] [MAIN ] EMO: Loaded 13345 existing records. [2025-10-22T18:32:50.525575] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-22T18:32:50.528769] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T18:32:50.607600] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:32:50.610809] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-22T18:32:50.610882] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-22T18:32:50.611060] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-22T18:32:50.611114] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-22T18:32:50.960042] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:32:51.317620] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-22T18:32:51.994907] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-22T18:32:52.117685] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-22T18:32:52.168217] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T18:32:52.909019] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T18:32:52.917600] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-22T18:32:53.717624] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-22T18:32:53.779682] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T18:32:54.519695] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-22T18:32:54.521559] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-22T18:32:55.317697] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-22T18:32:55.845074] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-22T18:32:56.117690] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-22T18:32:56.523547] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T18:32:56.917717] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-22T18:32:57.717699] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-22T18:32:58.270577] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-22T18:32:58.397474] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-22T18:32:58.517706] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-22T18:32:59.171720] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-22T18:32:59.317709] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-22T18:33:00.117755] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-22T18:33:00.213090] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T18:33:00.823199] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T18:33:00.823800] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T18:33:00.917693] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-22T18:33:01.717709] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-22T18:33:02.522250] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-22T18:33:02.526367] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T18:33:03.317709] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-22T18:33:03.348038] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-22T18:33:03.582476] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T18:33:03.877214] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T18:33:04.117691] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-22T18:33:04.917722] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-22T18:33:04.936420] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T18:33:05.513165] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T18:33:05.717708] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-22T18:33:06.508574] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-22T18:33:06.517602] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-22T18:33:07.134339] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-22T18:33:07.135379] [INFO ] [REMOTE ] EMF: Full fetch complete (6089 records). [2025-10-22T18:33:07.135446] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-22T18:33:07.327160] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-22T18:33:07.484532] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-22T18:33:07.484605] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-22T18:33:07.484788] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-22T18:33:07.484849] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-22T18:33:07.485201] [DEBUG] [LOCAL ] EMF: Trimmed 6089 records to 3081 (keeping 200 days of data) [2025-10-22T18:33:07.503714] [DEBUG] [LOCAL ] EMF: Primary data saved (3081 records). [2025-10-22T18:33:07.503786] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-22T18:33:07.503853] [INFO ] [MAIN ] Update Progress: 732/2367 symbols completed. EMF took 20.3s. Estimated remaining: 3h 27m 50s. Rate: 7.9 symbols/min [2025-10-22T18:33:07.673301] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:33:07.673472] [DEBUG] [LOCAL ] EMP: No existing data file found in primary storage. [2025-10-22T18:33:07.673520] [WARN ] [MAIN ] EMP: No existing data found, performing full refresh instead. [2025-10-22T18:33:07.673634] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-22T18:33:07.673715] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-22T18:33:07.673764] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-10-22T18:33:07.673802] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-22T18:33:08.014302] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:33:08.117624] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-22T18:33:08.589537] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-22T18:33:08.917708] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-22T18:33:09.428615] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-22T18:33:09.717617] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-22T18:33:10.070497] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T18:33:10.517714] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-22T18:33:11.317619] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-22T18:33:11.357592] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T18:33:11.389310] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T18:33:11.770250] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T18:33:12.117684] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-22T18:33:12.917810] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-22T18:33:13.385309] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T18:33:13.717675] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-22T18:33:14.170093] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-22T18:33:14.517625] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-22T18:33:14.872029] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T18:33:15.317677] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-22T18:33:16.117721] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-22T18:33:16.161101] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T18:33:16.371755] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T18:33:16.638237] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-22T18:33:16.917729] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-22T18:33:17.717747] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-22T18:33:18.475785] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T18:33:18.480844] [INFO ] [REMOTE ] EME: Full fetch complete (47067 records). [2025-10-22T18:33:18.480927] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-22T18:33:18.522871] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-22T18:33:18.787302] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T18:33:18.811019] [INFO ] [REMOTE ] EMO: Full fetch complete (17601 records). [2025-10-22T18:33:18.829712] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-22T18:33:18.850362] [FATAL] [VALIDATOR ] EMO: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:33:18.850944] [FATAL] [MAIN ] EMO: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:33:18.871257] [WARN ] [MAIN ] EMO: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:33:18.880352] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-22T18:33:18.882837] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-10-22T18:33:18.883056] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-22T18:33:18.882987] [INFO ] [LOCAL ] EMO: Starting deletion of derivative data. [2025-10-22T18:33:18.883204] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-22T18:33:18.884039] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-22T18:33:18.884122] [DEBUG] [LOCAL ] EMO: Deleted derivative data file. [2025-10-22T18:33:18.884320] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-22T18:33:18.884256] [INFO ] [MAIN ] Update Progress: 733/2367 symbols completed. EMO took 28.6s. Estimated remaining: 3h 27m 51s. Rate: 7.9 symbols/min [2025-10-22T18:33:18.987333] [DEBUG] [LOCAL ] EME: Trimmed 47067 records to 30650 (keeping 200 days of data) [2025-10-22T18:33:19.186911] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:33:19.193305] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-22T18:33:19.302241] [DEBUG] [LOCAL ] EME: Primary data saved (30650 records). [2025-10-22T18:33:19.302439] [INFO ] [MAIN ] EME: Full history saved. [2025-10-22T18:33:19.302541] [INFO ] [MAIN ] Update Progress: 734/2367 symbols completed. EME took 41.3s. Estimated remaining: 3h 27m 27s. Rate: 7.9 symbols/min [2025-10-22T18:33:19.324052] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-22T18:33:19.426987] [DEBUG] [LOCAL ] EMR: Loaded 53171 existing records from primary storage. [2025-10-22T18:33:19.443048] [INFO ] [MAIN ] EMR: Loaded 53171 existing records. [2025-10-22T18:33:19.599186] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:33:19.680218] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:33:19.680483] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-22T18:33:19.680534] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-22T18:33:19.680838] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-22T18:33:19.680937] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-22T18:33:19.914635] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T18:33:20.014945] [DEBUG] [LOCAL ] ENB: Loaded 53511 existing records from primary storage. [2025-10-22T18:33:20.026038] [INFO ] [MAIN ] ENB: Loaded 53511 existing records. [2025-10-22T18:33:20.124345] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-22T18:33:20.189373] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:33:20.282910] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:33:20.283101] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-22T18:33:20.283147] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-22T18:33:20.283334] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-22T18:33:20.283371] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-22T18:33:20.625065] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:33:20.917709] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-22T18:33:21.717685] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-22T18:33:22.035258] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-22T18:33:22.517695] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-22T18:33:22.801292] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T18:33:23.317733] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-22T18:33:23.693243] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-22T18:33:24.117693] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-22T18:33:24.288633] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T18:33:24.524676] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T18:33:24.917711] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-22T18:33:25.717732] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-22T18:33:25.927114] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T18:33:26.517687] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-22T18:33:26.639374] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T18:33:27.317693] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-22T18:33:27.349231] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-22T18:33:27.638973] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T18:33:28.117733] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-22T18:33:28.917733] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-22T18:33:29.113940] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T18:33:29.379710] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-22T18:33:29.717683] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-22T18:33:30.011688] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T18:33:30.019404] [INFO ] [REMOTE ] EMN: Full fetch complete (72040 records). [2025-10-22T18:33:30.019521] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-22T18:33:30.020296] [FATAL] [VALIDATOR ] EMN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:33:30.020425] [FATAL] [MAIN ] EMN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:33:30.020492] [WARN ] [MAIN ] EMN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:33:30.020571] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-22T18:33:30.020668] [DEBUG] [LOCAL ] EMN: No primary data file found to delete. [2025-10-22T18:33:30.020727] [INFO ] [LOCAL ] EMN: Starting deletion of derivative data. [2025-10-22T18:33:30.020846] [DEBUG] [LOCAL ] EMN: Deleted derivative data file. [2025-10-22T18:33:30.020915] [INFO ] [MAIN ] Update Progress: 735/2367 symbols completed. EMN took 42.1s. Estimated remaining: 3h 27m 26s. Rate: 7.9 symbols/min [2025-10-22T18:33:30.187861] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:33:30.188014] [DEBUG] [LOCAL ] ENIC: No existing data file found in primary storage. [2025-10-22T18:33:30.188053] [WARN ] [MAIN ] ENIC: No existing data found, performing full refresh instead. [2025-10-22T18:33:30.188163] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-22T18:33:30.188206] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-22T18:33:30.188248] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-10-22T18:33:30.188281] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-22T18:33:30.317103] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T18:33:30.529184] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-22T18:33:30.548984] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:33:31.129563] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T18:33:31.130503] [INFO ] [REMOTE ] EMP: Full fetch complete (4061 records). [2025-10-22T18:33:31.130572] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-22T18:33:31.326352] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-22T18:33:31.492894] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-22T18:33:31.492974] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-22T18:33:31.493117] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-22T18:33:31.493157] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-22T18:33:31.493502] [DEBUG] [LOCAL ] EMP: Trimmed 4061 records to 2888 (keeping 200 days of data) [2025-10-22T18:33:31.511288] [DEBUG] [LOCAL ] EMP: Primary data saved (2888 records). [2025-10-22T18:33:31.511356] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-22T18:33:31.511414] [INFO ] [MAIN ] Update Progress: 736/2367 symbols completed. EMP took 24.0s. Estimated remaining: 3h 27m 5s. Rate: 7.9 symbols/min [2025-10-22T18:33:31.678600] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:33:31.678775] [DEBUG] [LOCAL ] ENO: No existing data file found in primary storage. [2025-10-22T18:33:31.678819] [WARN ] [MAIN ] ENO: No existing data found, performing full refresh instead. [2025-10-22T18:33:31.678954] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-22T18:33:31.679012] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-22T18:33:31.679057] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-22T18:33:31.679092] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-22T18:33:32.039307] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:33:32.117692] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-22T18:33:32.671217] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-22T18:33:32.919624] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-22T18:33:32.924074] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T18:33:33.717682] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-22T18:33:34.237171] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-22T18:33:34.517678] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-22T18:33:34.768730] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T18:33:35.317689] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-22T18:33:35.745314] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T18:33:36.117712] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-22T18:33:36.582712] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-22T18:33:36.917671] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-22T18:33:37.193450] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T18:33:37.717756] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-22T18:33:38.307873] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-22T18:33:38.329595] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T18:33:38.517775] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-22T18:33:39.317732] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-22T18:33:40.117726] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-22T18:33:40.409927] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-22T18:33:40.729396] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T18:33:40.917789] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-22T18:33:41.717890] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-22T18:33:42.002478] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T18:33:42.410570] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T18:33:42.517624] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-22T18:33:43.317681] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-22T18:33:43.539465] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T18:33:43.864425] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T18:33:44.117718] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-22T18:33:44.799978] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-22T18:33:44.917684] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-22T18:33:45.717705] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-22T18:33:46.354350] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T18:33:46.517699] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-22T18:33:46.665719] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-22T18:33:47.060549] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-22T18:33:47.317711] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-22T18:33:47.791606] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-22T18:33:47.946155] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T18:33:48.117711] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-22T18:33:48.917689] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-22T18:33:49.449048] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-22T18:33:49.514327] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-22T18:33:49.717724] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-22T18:33:50.517733] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-22T18:33:51.152281] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T18:33:51.317703] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-22T18:33:52.117698] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-22T18:33:52.354445] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T18:33:52.790607] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-22T18:33:52.796208] [INFO ] [REMOTE ] ENIC: Full fetch complete (51296 records). [2025-10-22T18:33:52.796334] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-22T18:33:52.922926] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-22T18:33:53.234547] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-22T18:33:53.234674] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-22T18:33:53.235593] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-22T18:33:53.235656] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-22T18:33:53.236963] [DEBUG] [LOCAL ] ENIC: Trimmed 51296 records to 36415 (keeping 200 days of data) [2025-10-22T18:33:53.461787] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-22T18:33:53.466086] [DEBUG] [LOCAL ] ENIC: Primary data saved (36415 records). [2025-10-22T18:33:53.467872] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-22T18:33:53.467984] [INFO ] [MAIN ] Update Progress: 737/2367 symbols completed. ENIC took 23.4s. Estimated remaining: 3h 27m 29s. Rate: 7.9 symbols/min [2025-10-22T18:33:53.647837] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:33:53.648032] [DEBUG] [LOCAL ] ENOV: No existing data file found in primary storage. [2025-10-22T18:33:53.648089] [WARN ] [MAIN ] ENOV: No existing data found, performing full refresh instead. [2025-10-22T18:33:53.648228] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-22T18:33:53.648289] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-22T18:33:53.648337] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-22T18:33:53.648371] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-22T18:33:53.718597] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-22T18:33:54.020349] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:33:54.054280] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T18:33:54.517730] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-22T18:33:55.317718] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-22T18:33:55.347490] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-22T18:33:55.355826] [INFO ] [REMOTE ] EMR: Full fetch complete (76831 records). [2025-10-22T18:33:55.356001] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-22T18:33:55.356916] [FATAL] [VALIDATOR ] EMR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:33:55.357035] [FATAL] [MAIN ] EMR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:33:55.357078] [WARN ] [MAIN ] EMR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:33:55.357170] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-22T18:33:55.357239] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-10-22T18:33:55.357274] [INFO ] [LOCAL ] EMR: Starting deletion of derivative data. [2025-10-22T18:33:55.357393] [DEBUG] [LOCAL ] EMR: Deleted derivative data file. [2025-10-22T18:33:55.357470] [INFO ] [MAIN ] Update Progress: 738/2367 symbols completed. EMR took 36.5s. Estimated remaining: 3h 27m 9s. Rate: 7.9 symbols/min [2025-10-22T18:33:55.525838] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:33:55.565015] [DEBUG] [LOCAL ] ENR: Loaded 43882 existing records from primary storage. [2025-10-22T18:33:55.565283] [INFO ] [MAIN ] ENR: Loaded 43882 existing records. [2025-10-22T18:33:55.735988] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:33:55.736217] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-22T18:33:55.736264] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-22T18:33:55.736477] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-22T18:33:55.736532] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-22T18:33:56.096145] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:33:56.117679] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-22T18:33:56.179010] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T18:33:56.917736] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-22T18:33:57.149695] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T18:33:57.717670] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-22T18:33:57.795309] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T18:33:58.517721] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-22T18:33:58.766169] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T18:33:58.940874] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-22T18:33:59.109212] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T18:33:59.317710] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-22T18:34:00.117712] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-22T18:34:00.917723] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-22T18:34:01.559375] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T18:34:01.560291] [INFO ] [REMOTE ] ENO: Full fetch complete (2991 records). [2025-10-22T18:34:01.560362] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-22T18:34:01.721409] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-22T18:34:01.990388] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-22T18:34:01.990911] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-22T18:34:01.991092] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-22T18:34:01.992909] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-22T18:34:01.992822] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-22T18:34:02.002091] [DEBUG] [LOCAL ] ENO: Trimmed 2991 records to 1737 (keeping 200 days of data) [2025-10-22T18:34:02.014163] [DEBUG] [LOCAL ] ENO: Primary data saved (1737 records). [2025-10-22T18:34:02.014232] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-22T18:34:02.014298] [INFO ] [MAIN ] Update Progress: 739/2367 symbols completed. ENO took 30.5s. Estimated remaining: 3h 26m 59s. Rate: 7.9 symbols/min [2025-10-22T18:34:02.190292] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:34:02.219682] [DEBUG] [LOCAL ] ENS: Loaded 29741 existing records from primary storage. [2025-10-22T18:34:02.219950] [INFO ] [MAIN ] ENS: Loaded 29741 existing records. [2025-10-22T18:34:02.393141] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:34:02.393348] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-22T18:34:02.393399] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-22T18:34:02.393588] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-22T18:34:02.393676] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-22T18:34:02.529153] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-22T18:34:02.744311] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:34:03.317715] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-22T18:34:05.573600] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (3.85 seconds). [2025-10-22T18:34:05.580901] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-22T18:34:06.200853] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (2.88 seconds). [2025-10-22T18:34:06.206402] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-22T18:34:07.328823] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (6.41 seconds). [2025-10-22T18:34:07.337521] [INFO ] [REMOTE ] ENB: Full fetch complete (77662 records). [2025-10-22T18:34:07.337700] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-22T18:34:07.728997] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-22T18:34:07.729076] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-22T18:34:07.729936] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-22T18:34:07.729999] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-22T18:34:07.731375] [DEBUG] [LOCAL ] ENB: Trimmed 77662 records to 53511 (keeping 200 days of data) [2025-10-22T18:34:08.054079] [DEBUG] [LOCAL ] ENB: Primary data saved (53511 records). [2025-10-22T18:34:08.054211] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-22T18:34:08.054292] [INFO ] [MAIN ] Update Progress: 740/2367 symbols completed. ENB took 48.8s. Estimated remaining: 3h 26m 48s. Rate: 7.9 symbols/min [2025-10-22T18:34:08.218899] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:34:08.244254] [DEBUG] [LOCAL ] ENVA: Loaded 25267 existing records from primary storage. [2025-10-22T18:34:08.244496] [INFO ] [MAIN ] ENVA: Loaded 25267 existing records. [2025-10-22T18:34:08.419549] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:34:08.419863] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-22T18:34:08.419992] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-22T18:34:08.420251] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-22T18:34:08.420323] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-22T18:34:08.534093] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (6.00 seconds). [2025-10-22T18:34:08.554139] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-22T18:34:08.828256] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:34:08.828619] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-22T18:34:09.493713] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (3.91 seconds). [2025-10-22T18:34:09.502903] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-22T18:34:09.614630] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (3.41 seconds). [2025-10-22T18:34:09.622218] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-22T18:34:11.244243] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-22T18:34:11.253885] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-22T18:34:11.467973] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T18:34:11.474393] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-22T18:34:11.517305] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-10-22T18:34:11.522049] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-22T18:34:12.049457] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-22T18:34:12.058621] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-22T18:34:12.700202] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T18:34:12.706791] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-22T18:34:12.826579] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T18:34:12.864076] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T18:34:12.917674] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-22T18:34:13.401497] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-22T18:34:13.468970] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-22T18:34:13.717700] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-22T18:34:14.332844] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T18:34:14.517686] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-22T18:34:15.036576] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T18:34:15.317709] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-22T18:34:16.116583] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T18:34:16.125887] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-22T18:34:16.917679] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-22T18:34:17.341369] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T18:34:17.620629] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T18:34:17.717753] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-22T18:34:18.446889] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T18:34:18.517691] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-22T18:34:19.317621] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-22T18:34:19.388579] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T18:34:19.758561] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T18:34:20.117677] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-22T18:34:20.394129] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T18:34:20.917685] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-22T18:34:21.438567] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T18:34:21.717701] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-22T18:34:22.170447] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T18:34:22.517725] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-22T18:34:23.081262] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T18:34:23.317702] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-22T18:34:23.855629] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T18:34:24.117706] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-22T18:34:24.924385] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-22T18:34:24.925532] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T18:34:24.932856] [INFO ] [REMOTE ] ENOV: Full fetch complete (63077 records). [2025-10-22T18:34:24.933002] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-22T18:34:24.933956] [FATAL] [VALIDATOR ] ENOV: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:34:24.934052] [FATAL] [MAIN ] ENOV: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:34:24.934098] [WARN ] [MAIN ] ENOV: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:34:24.934139] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-22T18:34:24.934196] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-22T18:34:24.934232] [INFO ] [LOCAL ] ENOV: Starting deletion of derivative data. [2025-10-22T18:34:24.934273] [DEBUG] [LOCAL ] ENOV: No derivative data file found to delete. [2025-10-22T18:34:24.934334] [INFO ] [MAIN ] Update Progress: 741/2367 symbols completed. ENOV took 31.5s. Estimated remaining: 3h 27m 1s. Rate: 7.9 symbols/min [2025-10-22T18:34:25.108983] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:34:25.124821] [DEBUG] [LOCAL ] EOD: Loaded 15024 existing records from primary storage. [2025-10-22T18:34:25.125031] [INFO ] [MAIN ] EOD: Loaded 15024 existing records. [2025-10-22T18:34:25.303224] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:34:25.303453] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-22T18:34:25.303505] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-22T18:34:25.303688] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-22T18:34:25.303744] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-22T18:34:25.665353] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:34:25.693080] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T18:34:25.717617] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-22T18:34:25.850147] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T18:34:26.517722] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-22T18:34:27.021312] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T18:34:27.317692] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-22T18:34:28.003738] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T18:34:28.117673] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-22T18:34:28.237514] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-22T18:34:28.917681] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-22T18:34:29.281119] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T18:34:29.717733] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-22T18:34:30.517734] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-22T18:34:30.563588] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-22T18:34:30.606505] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T18:34:30.613539] [INFO ] [REMOTE ] ENR: Full fetch complete (59703 records). [2025-10-22T18:34:30.613701] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-22T18:34:30.997266] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-22T18:34:30.997335] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-22T18:34:30.998171] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-22T18:34:30.998237] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-22T18:34:30.999504] [DEBUG] [LOCAL ] ENR: Trimmed 59703 records to 43819 (keeping 200 days of data) [2025-10-22T18:34:31.260447] [DEBUG] [LOCAL ] ENR: Primary data saved (43819 records). [2025-10-22T18:34:31.260570] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-22T18:34:31.260666] [INFO ] [MAIN ] Update Progress: 742/2367 symbols completed. ENR took 35.9s. Estimated remaining: 3h 26m 50s. Rate: 7.9 symbols/min [2025-10-22T18:34:31.327021] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-22T18:34:31.438522] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:34:31.489306] [DEBUG] [LOCAL ] EOG: Loaded 53390 existing records from primary storage. [2025-10-22T18:34:31.489626] [INFO ] [MAIN ] EOG: Loaded 53390 existing records. [2025-10-22T18:34:31.666944] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:34:31.667152] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-22T18:34:31.667200] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-22T18:34:31.667385] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-22T18:34:31.667424] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-22T18:34:32.011134] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T18:34:32.098092] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:34:32.117713] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-22T18:34:32.858375] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T18:34:32.863744] [INFO ] [REMOTE ] ENS: Full fetch complete (42573 records). [2025-10-22T18:34:32.864035] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-22T18:34:32.864584] [FATAL] [VALIDATOR ] ENS: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:34:32.864691] [FATAL] [MAIN ] ENS: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:34:32.864758] [WARN ] [MAIN ] ENS: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:34:32.864829] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-22T18:34:32.864892] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-10-22T18:34:32.864927] [INFO ] [LOCAL ] ENS: Starting deletion of derivative data. [2025-10-22T18:34:32.865079] [DEBUG] [LOCAL ] ENS: Deleted derivative data file. [2025-10-22T18:34:32.865163] [INFO ] [MAIN ] Update Progress: 743/2367 symbols completed. ENS took 30.9s. Estimated remaining: 3h 26m 29s. Rate: 7.9 symbols/min [2025-10-22T18:34:32.936669] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-22T18:34:32.997719] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-22T18:34:33.046731] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:34:33.057974] [DEBUG] [LOCAL ] EOI: Loaded 10545 existing records from primary storage. [2025-10-22T18:34:33.058150] [INFO ] [MAIN ] EOI: Loaded 10545 existing records. [2025-10-22T18:34:33.233809] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:34:33.234032] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-22T18:34:33.234096] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-22T18:34:33.234264] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-22T18:34:33.234302] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-22T18:34:33.577337] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:34:33.717717] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-22T18:34:34.517696] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-22T18:34:34.777908] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-22T18:34:34.809405] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-22T18:34:35.317698] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-22T18:34:35.809964] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-22T18:34:35.813963] [INFO ] [REMOTE ] ENVA: Full fetch complete (36595 records). [2025-10-22T18:34:35.814046] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-22T18:34:36.122736] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-22T18:34:36.194988] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-22T18:34:36.200667] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-22T18:34:36.202546] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-22T18:34:36.203440] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-22T18:34:36.203564] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-22T18:34:36.208629] [DEBUG] [LOCAL ] ENVA: Trimmed 36595 records to 25234 (keeping 200 days of data) [2025-10-22T18:34:36.362453] [DEBUG] [LOCAL ] ENVA: Primary data saved (25234 records). [2025-10-22T18:34:36.362608] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-22T18:34:36.362721] [INFO ] [MAIN ] Update Progress: 744/2367 symbols completed. ENVA took 28.3s. Estimated remaining: 3h 26m 13s. Rate: 7.9 symbols/min [2025-10-22T18:34:36.533184] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:34:36.549274] [DEBUG] [LOCAL ] EOS: Loaded 14817 existing records from primary storage. [2025-10-22T18:34:36.549523] [INFO ] [MAIN ] EOS: Loaded 14817 existing records. [2025-10-22T18:34:36.724496] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:34:36.724730] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-22T18:34:36.724784] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-22T18:34:36.724943] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-22T18:34:36.724982] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-22T18:34:36.932564] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-22T18:34:37.082466] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:34:37.236253] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T18:34:37.717698] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-22T18:34:38.517698] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-22T18:34:38.652315] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T18:34:38.828662] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-22T18:34:39.074222] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-22T18:34:39.317692] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-22T18:34:40.117670] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-22T18:34:40.277421] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-22T18:34:40.917700] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-22T18:34:41.510396] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T18:34:41.579467] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-22T18:34:41.717725] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-22T18:34:42.438206] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-22T18:34:42.517696] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-22T18:34:43.291154] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-22T18:34:43.317620] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-22T18:34:44.056885] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T18:34:44.117761] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-22T18:34:44.917686] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-22T18:34:45.084258] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T18:34:45.717712] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-22T18:34:46.517729] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-22T18:34:46.761862] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T18:34:46.927188] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T18:34:47.298698] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T18:34:47.317606] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-22T18:34:48.117676] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-22T18:34:48.433353] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T18:34:48.917671] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-22T18:34:49.142715] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T18:34:49.145093] [INFO ] [REMOTE ] EOI: Full fetch complete (16074 records). [2025-10-22T18:34:49.145167] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-22T18:34:49.503063] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-22T18:34:49.503166] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-22T18:34:49.503668] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-22T18:34:49.503730] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-22T18:34:49.504199] [DEBUG] [LOCAL ] EOI: Trimmed 16074 records to 10436 (keeping 200 days of data) [2025-10-22T18:34:49.565915] [DEBUG] [LOCAL ] EOI: Primary data saved (10436 records). [2025-10-22T18:34:49.566047] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-22T18:34:49.566129] [INFO ] [MAIN ] Update Progress: 745/2367 symbols completed. EOI took 16.7s. Estimated remaining: 3h 26m 17s. Rate: 7.9 symbols/min [2025-10-22T18:34:49.733419] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:34:49.729570] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-22T18:34:49.742474] [DEBUG] [LOCAL ] EOT: Loaded 7050 existing records from primary storage. [2025-10-22T18:34:49.742680] [INFO ] [MAIN ] EOT: Loaded 7050 existing records. [2025-10-22T18:34:49.928164] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:34:49.938241] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-22T18:34:49.938138] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T18:34:49.938427] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-22T18:34:49.941697] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-22T18:34:49.942432] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-22T18:34:50.302251] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:34:50.517789] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-22T18:34:50.751808] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-22T18:34:51.323857] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-22T18:34:51.327154] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T18:34:52.117694] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-22T18:34:52.357872] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-22T18:34:52.917703] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-22T18:34:53.717678] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-22T18:34:53.908807] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T18:34:54.173087] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T18:34:54.517679] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-22T18:34:54.732549] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T18:34:54.735684] [INFO ] [REMOTE ] EOD: Full fetch complete (20733 records). [2025-10-22T18:34:54.735774] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-22T18:34:54.736234] [FATAL] [VALIDATOR ] EOD: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:34:54.736335] [FATAL] [MAIN ] EOD: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:34:54.736378] [WARN ] [MAIN ] EOD: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:34:54.736418] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-22T18:34:54.736473] [DEBUG] [LOCAL ] EOD: No primary data file found to delete. [2025-10-22T18:34:54.736508] [INFO ] [LOCAL ] EOD: Starting deletion of derivative data. [2025-10-22T18:34:54.736814] [DEBUG] [LOCAL ] EOD: Deleted derivative data file. [2025-10-22T18:34:54.736902] [INFO ] [MAIN ] Update Progress: 746/2367 symbols completed. EOD took 29.8s. Estimated remaining: 3h 26m 4s. Rate: 7.9 symbols/min [2025-10-22T18:34:54.915900] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:34:54.947307] [DEBUG] [LOCAL ] EPAC: Loaded 26483 existing records from primary storage. [2025-10-22T18:34:54.947599] [INFO ] [MAIN ] EPAC: Loaded 26483 existing records. [2025-10-22T18:34:55.124723] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:34:55.124923] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-22T18:34:55.124970] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-22T18:34:55.125196] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-22T18:34:55.125250] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-22T18:34:55.325530] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-22T18:34:55.509389] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:34:56.090805] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-22T18:34:56.117615] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-22T18:34:56.387789] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T18:34:56.514310] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-22T18:34:56.917699] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-22T18:34:57.717697] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-22T18:34:57.739231] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T18:34:58.517623] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-22T18:34:58.596300] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T18:34:59.132953] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T18:34:59.317722] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-22T18:35:00.117708] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-22T18:35:00.917728] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-22T18:35:01.717765] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-22T18:35:01.890415] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-22T18:35:02.006241] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T18:35:02.517716] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-22T18:35:03.305793] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T18:35:03.317602] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-22T18:35:03.439818] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-22T18:35:04.117700] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-22T18:35:04.920536] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-22T18:35:05.268894] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-22T18:35:05.671607] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-22T18:35:05.717626] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-22T18:35:06.006320] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T18:35:06.060043] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-22T18:35:06.517692] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-22T18:35:07.317710] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-22T18:35:07.799487] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-22T18:35:08.096911] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-22T18:35:08.117997] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-22T18:35:08.118071] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-22T18:35:08.917748] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-22T18:35:09.169801] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T18:35:09.717703] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-22T18:35:10.025825] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T18:35:10.517673] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-22T18:35:11.261416] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T18:35:11.263274] [INFO ] [REMOTE ] EOT: Full fetch complete (10631 records). [2025-10-22T18:35:11.263424] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-22T18:35:11.263851] [FATAL] [VALIDATOR ] EOT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:35:11.263932] [FATAL] [MAIN ] EOT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:35:11.263975] [WARN ] [MAIN ] EOT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:35:11.264015] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-22T18:35:11.264069] [DEBUG] [LOCAL ] EOT: No primary data file found to delete. [2025-10-22T18:35:11.264103] [INFO ] [LOCAL ] EOT: Starting deletion of derivative data. [2025-10-22T18:35:11.264270] [DEBUG] [LOCAL ] EOT: Deleted derivative data file. [2025-10-22T18:35:11.264352] [INFO ] [MAIN ] Update Progress: 747/2367 symbols completed. EOT took 21.7s. Estimated remaining: 3h 26m 16s. Rate: 7.9 symbols/min [2025-10-22T18:35:11.325953] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-22T18:35:11.433810] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:35:11.434012] [DEBUG] [LOCAL ] EPAM: No existing data file found in primary storage. [2025-10-22T18:35:11.434066] [WARN ] [MAIN ] EPAM: No existing data found, performing full refresh instead. [2025-10-22T18:35:11.434278] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-22T18:35:11.434426] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-22T18:35:11.434491] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-10-22T18:35:11.434603] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-22T18:35:11.829008] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:35:11.831171] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-22T18:35:12.117724] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-22T18:35:12.594749] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T18:35:12.917670] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-22T18:35:13.717749] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-22T18:35:13.941003] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T18:35:14.334102] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-22T18:35:14.342981] [INFO ] [REMOTE ] EOG: Full fetch complete (77466 records). [2025-10-22T18:35:14.343124] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-22T18:35:14.519464] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-22T18:35:14.756994] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-22T18:35:14.757736] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-22T18:35:14.759268] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-22T18:35:14.759359] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-22T18:35:14.758247] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T18:35:14.766579] [DEBUG] [LOCAL ] EOG: Trimmed 77466 records to 53390 (keeping 200 days of data) [2025-10-22T18:35:15.101227] [DEBUG] [LOCAL ] EOG: Primary data saved (53390 records). [2025-10-22T18:35:15.101356] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-22T18:35:15.101434] [INFO ] [MAIN ] Update Progress: 748/2367 symbols completed. EOG took 43.8s. Estimated remaining: 3h 25m 60s. Rate: 7.9 symbols/min [2025-10-22T18:35:15.271225] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:35:15.306744] [DEBUG] [LOCAL ] EPC: Loaded 39777 existing records from primary storage. [2025-10-22T18:35:15.307013] [INFO ] [MAIN ] EPC: Loaded 39777 existing records. [2025-10-22T18:35:15.327234] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-22T18:35:15.481740] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:35:15.481960] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-22T18:35:15.482007] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-22T18:35:15.482181] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-22T18:35:15.482217] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-22T18:35:15.825058] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:35:16.117676] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-22T18:35:16.254583] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T18:35:16.917729] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-22T18:35:16.996397] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T18:35:17.431086] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T18:35:17.434091] [INFO ] [REMOTE ] EOS: Full fetch complete (22853 records). [2025-10-22T18:35:17.434160] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-22T18:35:17.721539] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-22T18:35:17.805399] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-22T18:35:17.805480] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-22T18:35:17.805997] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-22T18:35:17.806060] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-22T18:35:17.806633] [DEBUG] [LOCAL ] EOS: Trimmed 22853 records to 14668 (keeping 200 days of data) [2025-10-22T18:35:17.902197] [DEBUG] [LOCAL ] EOS: Primary data saved (14668 records). [2025-10-22T18:35:17.902355] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-22T18:35:17.902458] [INFO ] [MAIN ] Update Progress: 749/2367 symbols completed. EOS took 41.5s. Estimated remaining: 3h 25m 42s. Rate: 7.9 symbols/min [2025-10-22T18:35:18.066908] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:35:18.115135] [DEBUG] [LOCAL ] EPD: Loaded 53609 existing records from primary storage. [2025-10-22T18:35:18.115450] [INFO ] [MAIN ] EPD: Loaded 53609 existing records. [2025-10-22T18:35:18.292321] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:35:18.293130] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-22T18:35:18.293412] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-22T18:35:18.293824] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-22T18:35:18.293884] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-22T18:35:18.503377] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T18:35:18.522768] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-22T18:35:18.687103] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:35:19.202563] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T18:35:19.317627] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-22T18:35:19.779459] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-22T18:35:20.117698] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-22T18:35:20.675063] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T18:35:20.917694] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-22T18:35:21.717704] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-22T18:35:22.126543] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T18:35:22.201429] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T18:35:22.517695] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-22T18:35:23.284233] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T18:35:23.317700] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-22T18:35:23.774153] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T18:35:23.781396] [INFO ] [REMOTE ] EPAC: Full fetch complete (38732 records). [2025-10-22T18:35:23.781759] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-22T18:35:23.782993] [FATAL] [VALIDATOR ] EPAC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:35:23.783176] [FATAL] [MAIN ] EPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:35:23.783242] [WARN ] [MAIN ] EPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:35:23.783334] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-22T18:35:23.783432] [DEBUG] [LOCAL ] EPAC: No primary data file found to delete. [2025-10-22T18:35:23.783489] [INFO ] [LOCAL ] EPAC: Starting deletion of derivative data. [2025-10-22T18:35:23.783708] [DEBUG] [LOCAL ] EPAC: Deleted derivative data file. [2025-10-22T18:35:23.784011] [INFO ] [MAIN ] Update Progress: 750/2367 symbols completed. EPAC took 29.0s. Estimated remaining: 3h 25m 31s. Rate: 7.9 symbols/min [2025-10-22T18:35:23.954817] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:35:23.996302] [DEBUG] [LOCAL ] EPR: Loaded 43777 existing records from primary storage. [2025-10-22T18:35:23.996622] [INFO ] [MAIN ] EPR: Loaded 43777 existing records. [2025-10-22T18:35:24.122804] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-22T18:35:24.180671] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:35:24.180880] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-22T18:35:24.180930] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-22T18:35:24.181115] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-22T18:35:24.181155] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-22T18:35:24.538782] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:35:24.838177] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T18:35:24.917740] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-22T18:35:25.717698] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-22T18:35:26.023529] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-22T18:35:26.517731] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-22T18:35:26.574967] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T18:35:27.317682] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-22T18:35:27.551959] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T18:35:28.117776] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-22T18:35:28.461979] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T18:35:28.917780] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-22T18:35:28.949753] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T18:35:29.651234] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T18:35:29.717716] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-22T18:35:30.517692] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-22T18:35:31.027323] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-22T18:35:31.065994] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T18:35:31.317709] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-22T18:35:32.092225] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T18:35:32.117690] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-22T18:35:32.876169] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T18:35:32.917619] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-22T18:35:33.643932] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T18:35:33.717700] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-22T18:35:34.517688] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-22T18:35:34.551280] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:35:34.974969] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T18:35:35.317695] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-22T18:35:36.117734] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-22T18:35:36.423606] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T18:35:36.503688] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-22T18:35:36.917721] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-22T18:35:37.717716] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-22T18:35:37.822201] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T18:35:38.517758] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-22T18:35:38.732005] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T18:35:39.317736] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-22T18:35:39.609866] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-22T18:35:39.801935] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T18:35:39.808167] [INFO ] [REMOTE ] EPAM: Full fetch complete (56623 records). [2025-10-22T18:35:39.808307] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-22T18:35:40.122854] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-22T18:35:40.195252] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-22T18:35:40.195338] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-22T18:35:40.196133] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-22T18:35:40.196197] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-22T18:35:40.197397] [DEBUG] [LOCAL ] EPAM: Trimmed 56623 records to 39328 (keeping 200 days of data) [2025-10-22T18:35:40.441101] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-22T18:35:40.461270] [DEBUG] [LOCAL ] EPAM: Primary data saved (39328 records). [2025-10-22T18:35:40.461415] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-22T18:35:40.461487] [INFO ] [MAIN ] Update Progress: 751/2367 symbols completed. EPAM took 29.2s. Estimated remaining: 3h 25m 42s. Rate: 7.9 symbols/min [2025-10-22T18:35:40.643232] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:35:40.685756] [DEBUG] [LOCAL ] EPRT: Loaded 48476 existing records from primary storage. [2025-10-22T18:35:40.686041] [INFO ] [MAIN ] EPRT: Loaded 48476 existing records. [2025-10-22T18:35:40.867191] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:35:40.867396] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-22T18:35:40.867444] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-22T18:35:40.867671] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-22T18:35:40.867730] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-22T18:35:40.923010] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-22T18:35:41.231051] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:35:41.717720] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-22T18:35:42.185223] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-22T18:35:42.226889] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-22T18:35:42.517708] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-22T18:35:43.002064] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T18:35:43.317719] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-22T18:35:44.117737] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-22T18:35:44.511163] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T18:35:44.917717] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-22T18:35:44.962593] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T18:35:44.971158] [INFO ] [REMOTE ] EPC: Full fetch complete (57372 records). [2025-10-22T18:35:44.971350] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-22T18:35:45.363799] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-22T18:35:45.363900] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-22T18:35:45.365177] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-22T18:35:45.365295] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-22T18:35:45.366969] [DEBUG] [LOCAL ] EPC: Trimmed 57372 records to 39741 (keeping 200 days of data) [2025-10-22T18:35:45.625916] [DEBUG] [LOCAL ] EPC: Primary data saved (39741 records). [2025-10-22T18:35:45.626060] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-22T18:35:45.626142] [INFO ] [MAIN ] Update Progress: 752/2367 symbols completed. EPC took 30.5s. Estimated remaining: 3h 25m 29s. Rate: 7.9 symbols/min [2025-10-22T18:35:45.734806] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-22T18:35:45.807456] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:35:45.835349] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T18:35:45.852401] [DEBUG] [LOCAL ] EQBK: Loaded 11388 existing records from primary storage. [2025-10-22T18:35:45.852671] [INFO ] [MAIN ] EQBK: Loaded 11388 existing records. [2025-10-22T18:35:46.036074] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:35:46.036331] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-22T18:35:46.036381] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-22T18:35:46.036548] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-22T18:35:46.036604] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-22T18:35:46.379761] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:35:46.517675] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-22T18:35:46.883543] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-22T18:35:47.317681] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-22T18:35:47.383476] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T18:35:48.090752] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T18:35:48.117683] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-22T18:35:48.392252] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T18:35:48.917710] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-22T18:35:49.717670] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-22T18:35:49.894613] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T18:35:50.489135] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-22T18:35:50.517691] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-22T18:35:50.945064] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-22T18:35:50.954169] [INFO ] [REMOTE ] EPD: Full fetch complete (77776 records). [2025-10-22T18:35:50.954308] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-22T18:35:51.318358] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-22T18:35:51.338392] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-22T18:35:51.338474] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-22T18:35:51.339383] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-22T18:35:51.339587] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-22T18:35:51.341054] [DEBUG] [LOCAL ] EPD: Trimmed 77776 records to 53608 (keeping 200 days of data) [2025-10-22T18:35:51.658236] [DEBUG] [LOCAL ] EPD: Primary data saved (53608 records). [2025-10-22T18:35:51.658424] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-22T18:35:51.659046] [INFO ] [MAIN ] Update Progress: 753/2367 symbols completed. EPD took 33.8s. Estimated remaining: 3h 25m 18s. Rate: 7.9 symbols/min [2025-10-22T18:35:51.827341] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:35:51.876689] [DEBUG] [LOCAL ] EQH: Loaded 52705 existing records from primary storage. [2025-10-22T18:35:51.877007] [INFO ] [MAIN ] EQH: Loaded 52705 existing records. [2025-10-22T18:35:52.056771] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:35:52.057079] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-22T18:35:52.057131] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-22T18:35:52.057364] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-22T18:35:52.057533] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-22T18:35:52.120315] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-22T18:35:52.188992] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T18:35:52.453973] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T18:35:52.457617] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:35:52.917691] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-22T18:35:53.720739] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-22T18:35:53.725247] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T18:35:54.517743] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-22T18:35:54.595474] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T18:35:54.620421] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-22T18:35:55.317735] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-22T18:35:56.053262] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T18:35:56.117711] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-22T18:35:56.578522] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-22T18:35:56.917709] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-22T18:35:57.648276] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T18:35:57.717609] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-22T18:35:57.731999] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T18:35:58.517706] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-22T18:35:59.258137] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T18:35:59.317613] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-22T18:35:59.621281] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T18:36:00.117697] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-22T18:36:00.917716] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-22T18:36:01.717836] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-22T18:36:02.082928] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-22T18:36:02.517626] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-22T18:36:02.693579] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-22T18:36:03.317751] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-22T18:36:04.548414] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (3.63 seconds). [2025-10-22T18:36:04.551551] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-22T18:36:06.016186] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T18:36:06.019803] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-22T18:36:06.047040] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (3.53 seconds). [2025-10-22T18:36:06.057975] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-22T18:36:06.139815] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (4.42 seconds). [2025-10-22T18:36:06.146825] [INFO ] [REMOTE ] EPR: Full fetch complete (63331 records). [2025-10-22T18:36:06.146947] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-22T18:36:06.494838] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (3.18 seconds). [2025-10-22T18:36:06.546712] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-22T18:36:06.583453] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-22T18:36:06.583582] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-22T18:36:06.584426] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-22T18:36:06.584491] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-22T18:36:06.585844] [DEBUG] [LOCAL ] EPR: Trimmed 63331 records to 43707 (keeping 200 days of data) [2025-10-22T18:36:06.850956] [DEBUG] [LOCAL ] EPR: Primary data saved (43707 records). [2025-10-22T18:36:06.851110] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-22T18:36:06.851203] [INFO ] [MAIN ] Update Progress: 754/2367 symbols completed. EPR took 43.1s. Estimated remaining: 3h 25m 27s. Rate: 7.9 symbols/min [2025-10-22T18:36:07.026523] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:36:07.034053] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T18:36:07.036999] [INFO ] [REMOTE ] EQBK: Full fetch complete (15698 records). [2025-10-22T18:36:07.037082] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-22T18:36:07.381706] [DEBUG] [LOCAL ] EQNR: Loaded 53055 existing records from primary storage. [2025-10-22T18:36:07.411721] [INFO ] [MAIN ] EQNR: Loaded 53055 existing records. [2025-10-22T18:36:07.474793] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-22T18:36:07.486900] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-22T18:36:07.498997] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-22T18:36:07.512698] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-22T18:36:07.546224] [DEBUG] [LOCAL ] EQBK: Trimmed 15698 records to 11303 (keeping 200 days of data) [2025-10-22T18:36:07.679259] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:36:07.681313] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-22T18:36:07.681952] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-22T18:36:07.682392] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-22T18:36:07.683088] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-22T18:36:07.839024] [DEBUG] [LOCAL ] EQBK: Primary data saved (11303 records). [2025-10-22T18:36:07.844577] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-22T18:36:07.844898] [INFO ] [MAIN ] Update Progress: 755/2367 symbols completed. EQBK took 22.2s. Estimated remaining: 3h 25m 5s. Rate: 7.9 symbols/min [2025-10-22T18:36:07.851975] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T18:36:07.997461] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-22T18:36:08.275336] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:36:08.279996] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:36:08.280693] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-22T18:36:08.327325] [DEBUG] [LOCAL ] EQR: Loaded 51808 existing records from primary storage. [2025-10-22T18:36:08.327702] [INFO ] [MAIN ] EQR: Loaded 51808 existing records. [2025-10-22T18:36:08.505343] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:36:08.505590] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-22T18:36:08.505665] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-22T18:36:08.505882] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-22T18:36:08.505943] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-22T18:36:08.876145] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:36:08.917609] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-22T18:36:09.374095] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-10-22T18:36:09.717723] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-22T18:36:09.884507] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T18:36:10.342119] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-22T18:36:10.517680] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-22T18:36:10.749465] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T18:36:11.317711] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-22T18:36:11.419114] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T18:36:12.117739] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-22T18:36:12.917718] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-22T18:36:13.397815] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-10-22T18:36:13.717724] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-22T18:36:14.031104] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-10-22T18:36:14.517695] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-22T18:36:14.822408] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-10-22T18:36:15.317731] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-22T18:36:15.636566] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-10-22T18:36:15.693006] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T18:36:15.702780] [INFO ] [REMOTE ] EPRT: Full fetch complete (69540 records). [2025-10-22T18:36:15.702977] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-22T18:36:16.085636] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-22T18:36:16.085742] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-22T18:36:16.086596] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-22T18:36:16.086636] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-22T18:36:16.087904] [DEBUG] [LOCAL ] EPRT: Trimmed 69540 records to 48479 (keeping 200 days of data) [2025-10-22T18:36:16.140344] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-22T18:36:16.379835] [DEBUG] [LOCAL ] EPRT: Primary data saved (48479 records). [2025-10-22T18:36:16.380075] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-22T18:36:16.380193] [INFO ] [MAIN ] Update Progress: 756/2367 symbols completed. EPRT took 35.9s. Estimated remaining: 3h 24m 59s. Rate: 7.9 symbols/min [2025-10-22T18:36:16.549884] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:36:16.550107] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-22T18:36:16.550178] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-22T18:36:16.550328] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-22T18:36:16.550396] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-22T18:36:16.550548] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-22T18:36:16.550599] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-22T18:36:16.691080] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-22T18:36:16.922729] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-22T18:36:16.961499] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:36:17.192513] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T18:36:17.631086] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T18:36:17.717679] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-22T18:36:18.517776] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-22T18:36:18.723102] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T18:36:19.317747] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-22T18:36:19.682730] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T18:36:20.117678] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-22T18:36:20.206439] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T18:36:20.917751] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-22T18:36:21.119793] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T18:36:21.717732] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-22T18:36:22.077292] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-22T18:36:22.517687] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-22T18:36:22.616187] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T18:36:23.331760] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-22T18:36:23.334520] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T18:36:24.083228] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-22T18:36:24.117688] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-22T18:36:24.364468] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T18:36:24.917737] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-22T18:36:25.314181] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-22T18:36:25.717699] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-22T18:36:25.877808] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T18:36:26.517733] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-22T18:36:27.317730] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-22T18:36:27.710934] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-22T18:36:27.719526] [INFO ] [REMOTE ] EQH: Full fetch complete (76641 records). [2025-10-22T18:36:27.719717] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-22T18:36:28.102078] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-22T18:36:28.102166] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-22T18:36:28.103399] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-22T18:36:28.103484] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-22T18:36:28.105078] [DEBUG] [LOCAL ] EQH: Trimmed 76641 records to 52699 (keeping 200 days of data) [2025-10-22T18:36:28.117684] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-22T18:36:28.434274] [DEBUG] [LOCAL ] EQH: Primary data saved (52699 records). [2025-10-22T18:36:28.434413] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-22T18:36:28.435003] [INFO ] [MAIN ] Update Progress: 757/2367 symbols completed. EQH took 36.8s. Estimated remaining: 3h 25m 1s. Rate: 7.9 symbols/min [2025-10-22T18:36:28.677906] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-22T18:36:28.850705] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-22T18:36:28.917623] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-22T18:36:29.125306] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T18:36:29.717755] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-22T18:36:30.022228] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-22T18:36:30.518085] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-22T18:36:30.520687] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T18:36:31.317741] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-22T18:36:32.117717] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-22T18:36:32.475782] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-22T18:36:32.695181] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-22T18:36:32.917695] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-22T18:36:33.267600] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T18:36:33.276865] [INFO ] [REMOTE ] EQR: Full fetch complete (74602 records). [2025-10-22T18:36:33.276996] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-22T18:36:33.700951] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-22T18:36:33.701056] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-22T18:36:33.702006] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-22T18:36:33.702070] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-22T18:36:33.703507] [DEBUG] [LOCAL ] EQR: Trimmed 74602 records to 51810 (keeping 200 days of data) [2025-10-22T18:36:33.760252] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-22T18:36:34.030902] [DEBUG] [LOCAL ] EQR: Primary data saved (51810 records). [2025-10-22T18:36:34.031037] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-22T18:36:34.031117] [INFO ] [MAIN ] Update Progress: 758/2367 symbols completed. EQR took 26.2s. Estimated remaining: 3h 24m 49s. Rate: 7.9 symbols/min [2025-10-22T18:36:34.262549] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-22T18:36:34.517743] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-22T18:36:34.686254] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T18:36:34.909102] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-22T18:36:35.317732] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-22T18:36:35.926759] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T18:36:36.117730] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-22T18:36:36.787945] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-22T18:36:36.917738] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-22T18:36:37.437409] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-22T18:36:37.438280] [INFO ] [REMOTE ] EQS: Full fetch complete (2379 records). [2025-10-22T18:36:37.438347] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-22T18:36:37.438707] [FATAL] [VALIDATOR ] EQS: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:36:37.438788] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:36:37.438830] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:36:37.438891] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-22T18:36:37.438951] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-22T18:36:37.438987] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-22T18:36:37.439025] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-22T18:36:37.439075] [INFO ] [MAIN ] Update Progress: 759/2367 symbols completed. EQS took 21.1s. Estimated remaining: 3h 24m 33s. Rate: 7.9 symbols/min [2025-10-22T18:36:37.717730] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-22T18:36:39.839732] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T18:36:39.848541] [INFO ] [REMOTE ] EQNR: Full fetch complete (77014 records). [2025-10-22T18:36:39.848697] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-22T18:36:40.230530] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-22T18:36:40.230618] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-22T18:36:40.231496] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-22T18:36:40.231553] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-22T18:36:40.233069] [DEBUG] [LOCAL ] EQNR: Trimmed 77014 records to 53050 (keeping 200 days of data) [2025-10-22T18:36:40.553016] [DEBUG] [LOCAL ] EQNR: Primary data saved (53050 records). [2025-10-22T18:36:40.553157] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-22T18:36:40.553237] [INFO ] [MAIN ] Update Progress: 760/2367 symbols completed. EQNR took 33.7s. Estimated remaining: 3h 24m 15s. Rate: 7.9 symbols/min [2025-10-22T18:36:41.201303] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:36:41.226959] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:36:41.277777] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:36:41.280764] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:36:41.284190] [DEBUG] [LOCAL ] EQV: Loaded 2740 existing records from primary storage. [2025-10-22T18:36:41.284807] [INFO ] [MAIN ] EQV: Loaded 2740 existing records. [2025-10-22T18:36:41.488842] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:36:41.498471] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-22T18:36:41.498554] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-22T18:36:41.498742] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-22T18:36:41.498808] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-22T18:36:41.626172] [DEBUG] [LOCAL ] ERO: Loaded 42158 existing records from primary storage. [2025-10-22T18:36:41.659492] [DEBUG] [LOCAL ] ERJ: Loaded 50293 existing records from primary storage. [2025-10-22T18:36:41.666102] [DEBUG] [LOCAL ] EQT: Loaded 53685 existing records from primary storage. [2025-10-22T18:36:41.676768] [INFO ] [MAIN ] ERO: Loaded 42158 existing records. [2025-10-22T18:36:41.682193] [INFO ] [MAIN ] EQT: Loaded 53685 existing records. [2025-10-22T18:36:41.711115] [INFO ] [MAIN ] ERJ: Loaded 50293 existing records. [2025-10-22T18:36:42.309700] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:36:42.406520] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:36:42.397475] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:36:42.422081] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-22T18:36:42.440427] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-22T18:36:42.440690] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-22T18:36:42.460274] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-22T18:36:42.460156] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-22T18:36:42.454306] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-22T18:36:42.479337] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-22T18:36:42.482600] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-22T18:36:42.479248] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-22T18:36:42.479295] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-22T18:36:42.482512] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:36:42.499449] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-22T18:36:42.525217] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-22T18:36:42.573063] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-22T18:36:43.515365] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:36:43.521736] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-22T18:36:43.597526] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:36:43.613510] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-22T18:36:43.638069] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T18:36:43.667994] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:36:43.671007] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-22T18:36:43.671867] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-22T18:36:44.264595] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-22T18:36:44.267043] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-22T18:36:44.831735] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-22T18:36:44.833250] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-22T18:36:45.327149] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T18:36:45.335311] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-22T18:36:45.361376] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T18:36:45.371320] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-22T18:36:45.459536] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-22T18:36:45.717707] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-22T18:36:45.893506] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-22T18:36:46.045031] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-22T18:36:46.517754] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-22T18:36:46.637820] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-22T18:36:47.192886] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-22T18:36:47.317711] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-22T18:36:48.117683] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-22T18:36:48.314890] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T18:36:48.917719] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-22T18:36:49.229195] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-22T18:36:49.575570] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T18:36:49.717626] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-22T18:36:50.517701] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-22T18:36:51.050742] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-22T18:36:51.317720] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-22T18:36:51.529733] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T18:36:51.986774] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-22T18:36:52.013539] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T18:36:52.117712] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-22T18:36:52.917686] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-22T18:36:53.717746] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-22T18:36:53.919635] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T18:36:54.356112] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-22T18:36:54.517717] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-22T18:36:55.293940] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T18:36:55.317616] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-22T18:36:56.117709] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-22T18:36:56.296163] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T18:36:56.547239] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-22T18:36:56.667387] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T18:36:56.917720] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-22T18:36:57.717720] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-22T18:36:58.517724] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-22T18:36:58.769265] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-22T18:36:59.171804] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-22T18:36:59.317734] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-22T18:36:59.793543] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-22T18:36:59.799297] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-22T18:37:00.117683] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-22T18:37:00.917713] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-22T18:37:01.717779] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-22T18:37:01.749426] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-22T18:37:01.751109] [INFO ] [REMOTE ] EQV: Full fetch complete (4878 records). [2025-10-22T18:37:01.751203] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-22T18:37:02.265876] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-22T18:37:02.265993] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-22T18:37:02.266170] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-22T18:37:02.266216] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-22T18:37:02.266633] [DEBUG] [LOCAL ] EQV: Trimmed 4878 records to 2702 (keeping 200 days of data) [2025-10-22T18:37:02.284035] [DEBUG] [LOCAL ] EQV: Primary data saved (2702 records). [2025-10-22T18:37:02.284176] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-22T18:37:02.284262] [INFO ] [MAIN ] Update Progress: 761/2367 symbols completed. EQV took 21.7s. Estimated remaining: 3h 24m 37s. Rate: 7.8 symbols/min [2025-10-22T18:37:02.454912] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:02.455087] [DEBUG] [LOCAL ] ES: No existing data file found in primary storage. [2025-10-22T18:37:02.455125] [WARN ] [MAIN ] ES: No existing data found, performing full refresh instead. [2025-10-22T18:37:02.455310] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-22T18:37:02.455360] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-22T18:37:02.455403] [DEBUG] [LOCAL ] ES: No primary data file found to delete. [2025-10-22T18:37:02.455435] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-22T18:37:02.523298] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-22T18:37:02.802809] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:03.317706] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-22T18:37:05.855741] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-22T18:37:05.866551] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-22T18:37:05.974714] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (5.06 seconds). [2025-10-22T18:37:05.984322] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-22T18:37:06.271116] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (4.55 seconds). [2025-10-22T18:37:06.282113] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-22T18:37:06.885271] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (4.36 seconds). [2025-10-22T18:37:06.901868] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-22T18:37:08.659892] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-22T18:37:08.676172] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-22T18:37:08.738128] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T18:37:08.753316] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-10-22T18:37:08.753940] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-22T18:37:08.806950] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (2.94 seconds). [2025-10-22T18:37:08.917723] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-22T18:37:09.717740] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-22T18:37:10.712155] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T18:37:10.722080] [INFO ] [REMOTE ] ERJ: Full fetch complete (73050 records). [2025-10-22T18:37:10.722328] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-22T18:37:11.191096] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-22T18:37:11.191210] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-22T18:37:11.192332] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-22T18:37:11.197892] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-22T18:37:11.198153] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-22T18:37:11.216076] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-22T18:37:11.224115] [DEBUG] [LOCAL ] ERJ: Trimmed 73050 records to 50289 (keeping 200 days of data) [2025-10-22T18:37:11.241353] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-22T18:37:11.351982] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-22T18:37:11.503562] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T18:37:11.602332] [DEBUG] [LOCAL ] ERJ: Primary data saved (50289 records). [2025-10-22T18:37:11.602500] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-22T18:37:11.602591] [INFO ] [MAIN ] Update Progress: 762/2367 symbols completed. ERJ took 31.0s. Estimated remaining: 3h 24m 33s. Rate: 7.8 symbols/min [2025-10-22T18:37:11.768596] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:11.795085] [DEBUG] [LOCAL ] ESAB: Loaded 25989 existing records from primary storage. [2025-10-22T18:37:11.795350] [INFO ] [MAIN ] ESAB: Loaded 25989 existing records. [2025-10-22T18:37:11.989910] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:37:11.990141] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-22T18:37:11.990186] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-22T18:37:11.990392] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-22T18:37:11.990446] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-22T18:37:12.125424] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-22T18:37:12.341011] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:12.917798] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-22T18:37:13.078532] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T18:37:13.566559] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-22T18:37:13.717617] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-22T18:37:14.062746] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T18:37:14.070754] [INFO ] [REMOTE ] ERO: Full fetch complete (60648 records). [2025-10-22T18:37:14.070855] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-22T18:37:14.232023] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T18:37:14.463616] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-22T18:37:14.463729] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-22T18:37:14.464479] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-22T18:37:14.464522] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-22T18:37:14.465785] [DEBUG] [LOCAL ] ERO: Trimmed 60648 records to 42159 (keeping 200 days of data) [2025-10-22T18:37:14.522753] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-22T18:37:14.710287] [DEBUG] [LOCAL ] ERO: Primary data saved (42159 records). [2025-10-22T18:37:14.710626] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-22T18:37:14.710745] [INFO ] [MAIN ] Update Progress: 763/2367 symbols completed. ERO took 34.1s. Estimated remaining: 3h 24m 16s. Rate: 7.9 symbols/min [2025-10-22T18:37:14.872383] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:14.888831] [DEBUG] [LOCAL ] ESE: Loaded 16514 existing records from primary storage. [2025-10-22T18:37:14.889061] [INFO ] [MAIN ] ESE: Loaded 16514 existing records. [2025-10-22T18:37:15.059415] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:37:15.059615] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-22T18:37:15.059691] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-22T18:37:15.060216] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-22T18:37:15.060272] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-22T18:37:15.323799] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-22T18:37:15.405922] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:15.861470] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-22T18:37:15.870440] [INFO ] [REMOTE ] EQT: Full fetch complete (77860 records). [2025-10-22T18:37:15.870591] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-22T18:37:16.123285] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-22T18:37:16.258493] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-22T18:37:16.258706] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-22T18:37:16.259707] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-22T18:37:16.259811] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-22T18:37:16.261225] [DEBUG] [LOCAL ] EQT: Trimmed 77860 records to 53685 (keeping 200 days of data) [2025-10-22T18:37:16.608283] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-22T18:37:16.632393] [DEBUG] [LOCAL ] EQT: Primary data saved (53685 records). [2025-10-22T18:37:16.638320] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-22T18:37:16.638860] [INFO ] [MAIN ] Update Progress: 764/2367 symbols completed. EQT took 36.1s. Estimated remaining: 3h 23m 57s. Rate: 7.9 symbols/min [2025-10-22T18:37:16.645544] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T18:37:16.810926] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:16.818461] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T18:37:16.862302] [DEBUG] [LOCAL ] ESI: Loaded 50624 existing records from primary storage. [2025-10-22T18:37:16.862615] [INFO ] [MAIN ] ESI: Loaded 50624 existing records. [2025-10-22T18:37:16.922856] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-22T18:37:17.036701] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:37:17.036948] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-22T18:37:17.036995] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-22T18:37:17.037271] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-22T18:37:17.037326] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-22T18:37:17.386501] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:17.717731] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-22T18:37:18.199740] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T18:37:18.517745] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-22T18:37:18.778740] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T18:37:19.317736] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-22T18:37:20.117726] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-22T18:37:20.280917] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T18:37:20.517756] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-22T18:37:20.917764] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-22T18:37:21.717699] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-22T18:37:22.124036] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T18:37:22.367067] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T18:37:22.517686] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-22T18:37:23.317709] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-22T18:37:23.698536] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-22T18:37:24.117709] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-22T18:37:24.212026] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T18:37:24.264972] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-22T18:37:24.917685] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-22T18:37:25.276264] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T18:37:25.717711] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-22T18:37:26.517708] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-22T18:37:26.825881] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T18:37:27.317676] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-22T18:37:27.466489] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T18:37:27.579037] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-22T18:37:28.120515] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-22T18:37:28.917707] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-22T18:37:29.075522] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T18:37:29.351960] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-22T18:37:29.717766] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-22T18:37:30.517725] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-22T18:37:30.679566] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T18:37:30.935429] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T18:37:31.317736] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-22T18:37:32.117711] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-22T18:37:32.550452] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-22T18:37:32.559299] [INFO ] [REMOTE ] ES: Full fetch complete (76477 records). [2025-10-22T18:37:32.559439] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-22T18:37:32.918991] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-22T18:37:32.985094] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-22T18:37:32.985760] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-22T18:37:32.986897] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-22T18:37:32.987058] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-22T18:37:32.988789] [DEBUG] [LOCAL ] ES: Trimmed 76477 records to 52699 (keeping 200 days of data) [2025-10-22T18:37:33.228323] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T18:37:33.267594] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T18:37:33.386516] [DEBUG] [LOCAL ] ES: Primary data saved (52699 records). [2025-10-22T18:37:33.386725] [INFO ] [MAIN ] ES: Full history saved. [2025-10-22T18:37:33.386851] [INFO ] [MAIN ] Update Progress: 765/2367 symbols completed. ES took 31.1s. Estimated remaining: 3h 24m 8s. Rate: 7.8 symbols/min [2025-10-22T18:37:33.552341] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:33.587519] [DEBUG] [LOCAL ] ESNT: Loaded 38064 existing records from primary storage. [2025-10-22T18:37:33.587843] [INFO ] [MAIN ] ESNT: Loaded 38064 existing records. [2025-10-22T18:37:33.727420] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-22T18:37:33.769585] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:37:33.769882] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-22T18:37:33.769938] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-22T18:37:33.770138] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-22T18:37:33.770194] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-22T18:37:34.121465] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:34.353687] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T18:37:34.517700] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-22T18:37:35.317741] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-22T18:37:35.448784] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T18:37:35.957276] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T18:37:36.117749] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-22T18:37:36.917677] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-22T18:37:37.172071] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T18:37:37.522006] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T18:37:37.717702] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-22T18:37:37.828440] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T18:37:38.517678] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-22T18:37:38.997537] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T18:37:39.004499] [INFO ] [REMOTE ] ESAB: Full fetch complete (36440 records). [2025-10-22T18:37:39.004718] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-22T18:37:39.322866] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-22T18:37:39.397589] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-22T18:37:39.397702] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-22T18:37:39.398256] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-22T18:37:39.398295] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-22T18:37:39.399057] [DEBUG] [LOCAL ] ESAB: Trimmed 36440 records to 25928 (keeping 200 days of data) [2025-10-22T18:37:39.561437] [DEBUG] [LOCAL ] ESAB: Primary data saved (25928 records). [2025-10-22T18:37:39.561597] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-22T18:37:39.561728] [INFO ] [MAIN ] Update Progress: 766/2367 symbols completed. ESAB took 28.0s. Estimated remaining: 3h 23m 57s. Rate: 7.8 symbols/min [2025-10-22T18:37:39.730759] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:39.749812] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T18:37:39.790162] [DEBUG] [LOCAL ] ESRT: Loaded 46538 existing records from primary storage. [2025-10-22T18:37:39.790462] [INFO ] [MAIN ] ESRT: Loaded 46538 existing records. [2025-10-22T18:37:39.968732] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:37:39.968944] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-22T18:37:39.968992] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-22T18:37:39.969284] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-22T18:37:39.969341] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-22T18:37:40.122936] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-22T18:37:40.345204] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:40.917733] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-22T18:37:40.950908] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:37:41.657309] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T18:37:41.717726] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-22T18:37:42.517749] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-22T18:37:42.764416] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T18:37:43.243457] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T18:37:43.317695] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-22T18:37:44.117713] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-22T18:37:44.239964] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T18:37:44.902802] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T18:37:44.917620] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-22T18:37:45.333518] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T18:37:45.717715] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-22T18:37:46.020967] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T18:37:46.520579] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-22T18:37:47.309184] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T18:37:47.317696] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-22T18:37:47.319016] [INFO ] [REMOTE ] ESI: Full fetch complete (73266 records). [2025-10-22T18:37:47.319158] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-22T18:37:47.741847] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-22T18:37:47.741925] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-22T18:37:47.742772] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-22T18:37:47.742834] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-22T18:37:47.744125] [DEBUG] [LOCAL ] ESI: Trimmed 73266 records to 50618 (keeping 200 days of data) [2025-10-22T18:37:48.049972] [DEBUG] [LOCAL ] ESI: Primary data saved (50618 records). [2025-10-22T18:37:48.050175] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-22T18:37:48.050818] [INFO ] [MAIN ] Update Progress: 767/2367 symbols completed. ESI took 31.4s. Estimated remaining: 3h 23m 51s. Rate: 7.8 symbols/min [2025-10-22T18:37:48.122240] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-22T18:37:48.260843] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T18:37:48.259220] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:48.311842] [DEBUG] [LOCAL ] ESS: Loaded 30188 existing records from primary storage. [2025-10-22T18:37:48.312122] [INFO ] [MAIN ] ESS: Loaded 30188 existing records. [2025-10-22T18:37:48.491736] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:37:48.500678] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-22T18:37:48.500542] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T18:37:48.500980] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-22T18:37:48.504531] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-22T18:37:48.504627] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-22T18:37:48.504476] [INFO ] [REMOTE ] ESE: Full fetch complete (22948 records). [2025-10-22T18:37:48.548584] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-22T18:37:48.942863] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-22T18:37:49.227366] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:49.269332] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-22T18:37:49.269453] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-22T18:37:49.270048] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-22T18:37:49.270112] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-22T18:37:49.270753] [DEBUG] [LOCAL ] ESE: Trimmed 22948 records to 16465 (keeping 200 days of data) [2025-10-22T18:37:49.372230] [DEBUG] [LOCAL ] ESE: Primary data saved (16465 records). [2025-10-22T18:37:49.372371] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-22T18:37:49.372452] [INFO ] [MAIN ] Update Progress: 768/2367 symbols completed. ESE took 34.7s. Estimated remaining: 3h 23m 31s. Rate: 7.9 symbols/min [2025-10-22T18:37:49.549765] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:49.550122] [DEBUG] [LOCAL ] ESTC: No existing data file found in primary storage. [2025-10-22T18:37:49.550175] [WARN ] [MAIN ] ESTC: No existing data found, performing full refresh instead. [2025-10-22T18:37:49.550285] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-22T18:37:49.550329] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-22T18:37:49.550371] [DEBUG] [LOCAL ] ESTC: No primary data file found to delete. [2025-10-22T18:37:49.550405] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-22T18:37:49.729390] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T18:37:49.723895] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-22T18:37:49.943460] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:50.517675] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-22T18:37:50.650572] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T18:37:51.322826] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-22T18:37:51.334326] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T18:37:52.117703] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-22T18:37:52.593617] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T18:37:52.917691] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-22T18:37:53.058922] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T18:37:53.563311] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T18:37:53.717743] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-22T18:37:54.517720] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-22T18:37:54.656081] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T18:37:55.317669] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-22T18:37:55.449394] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T18:37:55.991486] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T18:37:56.117611] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-22T18:37:56.240195] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-22T18:37:56.917702] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-22T18:37:57.324406] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-22T18:37:57.330803] [INFO ] [REMOTE ] ESNT: Full fetch complete (57199 records). [2025-10-22T18:37:57.330896] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-22T18:37:57.719908] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-22T18:37:57.720152] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-22T18:37:57.720263] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-22T18:37:57.721753] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-22T18:37:57.721896] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-22T18:37:57.723029] [DEBUG] [LOCAL ] ESNT: Trimmed 57199 records to 37977 (keeping 200 days of data) [2025-10-22T18:37:57.944013] [DEBUG] [LOCAL ] ESNT: Primary data saved (37977 records). [2025-10-22T18:37:57.944145] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-22T18:37:57.944243] [INFO ] [MAIN ] Update Progress: 769/2367 symbols completed. ESNT took 24.6s. Estimated remaining: 3h 23m 25s. Rate: 7.9 symbols/min [2025-10-22T18:37:58.110193] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:37:58.110377] [DEBUG] [LOCAL ] ET: No existing data file found in primary storage. [2025-10-22T18:37:58.110426] [WARN ] [MAIN ] ET: No existing data found, performing full refresh instead. [2025-10-22T18:37:58.110536] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-22T18:37:58.110576] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-22T18:37:58.110618] [DEBUG] [LOCAL ] ET: No primary data file found to delete. [2025-10-22T18:37:58.110712] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-22T18:37:58.458451] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:37:58.482487] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T18:37:58.517612] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-22T18:37:59.317725] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-22T18:37:59.468957] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T18:38:00.042623] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T18:38:00.117608] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-22T18:38:00.698068] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T18:38:00.917683] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-22T18:38:01.717714] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-22T18:38:02.517709] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-22T18:38:02.991585] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-10-22T18:38:03.317707] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-22T18:38:05.293728] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (4.38 seconds). [2025-10-22T18:38:05.301138] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-22T18:38:05.520810] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (3.00 seconds). [2025-10-22T18:38:05.531301] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-22T18:38:05.976416] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (4.26 seconds). [2025-10-22T18:38:05.986823] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-22T18:38:06.870088] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T18:38:06.876000] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-22T18:38:07.266364] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (3.95 seconds). [2025-10-22T18:38:07.317605] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-22T18:38:07.683418] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T18:38:08.117715] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-22T18:38:08.351356] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T18:38:08.721236] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T18:38:08.917620] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-22T18:38:09.206972] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (3.22 seconds). [2025-10-22T18:38:09.717626] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-22T18:38:09.862885] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T18:38:10.323164] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T18:38:10.517733] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-22T18:38:11.317686] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-22T18:38:11.485187] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T18:38:11.493329] [INFO ] [REMOTE ] ESRT: Full fetch complete (66741 records). [2025-10-22T18:38:11.493480] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-22T18:38:11.880719] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-22T18:38:11.880804] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-22T18:38:11.881576] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-22T18:38:11.881615] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-22T18:38:11.882883] [DEBUG] [LOCAL ] ESRT: Trimmed 66741 records to 46546 (keeping 200 days of data) [2025-10-22T18:38:12.118337] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-22T18:38:12.155097] [DEBUG] [LOCAL ] ESRT: Primary data saved (46546 records). [2025-10-22T18:38:12.155254] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-22T18:38:12.155385] [INFO ] [MAIN ] Update Progress: 770/2367 symbols completed. ESRT took 32.6s. Estimated remaining: 3h 23m 31s. Rate: 7.8 symbols/min [2025-10-22T18:38:12.352731] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T18:38:12.355217] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:38:12.365951] [DEBUG] [LOCAL ] ETB: No existing data file found in primary storage. [2025-10-22T18:38:12.366008] [WARN ] [MAIN ] ETB: No existing data found, performing full refresh instead. [2025-10-22T18:38:12.366471] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-22T18:38:12.366525] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-22T18:38:12.366568] [DEBUG] [LOCAL ] ETB: No primary data file found to delete. [2025-10-22T18:38:12.366599] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-22T18:38:12.715059] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:38:12.917693] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-22T18:38:13.428443] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T18:38:13.465316] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-22T18:38:13.717689] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-22T18:38:14.517715] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-22T18:38:14.733707] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T18:38:15.150127] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T18:38:15.317698] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-22T18:38:16.117760] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-22T18:38:16.880302] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-22T18:38:16.917678] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-22T18:38:16.975771] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T18:38:17.683291] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T18:38:17.689479] [INFO ] [REMOTE ] ESS: Full fetch complete (43882 records). [2025-10-22T18:38:17.689614] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-22T18:38:17.723026] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-22T18:38:18.062167] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-22T18:38:18.062244] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-22T18:38:18.062863] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-22T18:38:18.062928] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-22T18:38:18.063889] [DEBUG] [LOCAL ] ESS: Trimmed 43882 records to 30164 (keeping 200 days of data) [2025-10-22T18:38:18.254771] [DEBUG] [LOCAL ] ESS: Primary data saved (30164 records). [2025-10-22T18:38:18.254919] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-22T18:38:18.255009] [INFO ] [MAIN ] Update Progress: 771/2367 symbols completed. ESS took 30.2s. Estimated remaining: 3h 23m 20s. Rate: 7.8 symbols/min [2025-10-22T18:38:18.421166] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:38:18.446776] [DEBUG] [LOCAL ] ETD: Loaded 27258 existing records from primary storage. [2025-10-22T18:38:18.447017] [INFO ] [MAIN ] ETD: Loaded 27258 existing records. [2025-10-22T18:38:18.522833] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-22T18:38:18.626343] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:38:18.626507] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-22T18:38:18.626554] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-22T18:38:18.626780] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-22T18:38:18.626838] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-22T18:38:18.979772] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:38:19.317708] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-22T18:38:19.359693] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-22T18:38:19.654608] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-22T18:38:19.767908] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T18:38:19.776212] [INFO ] [REMOTE ] ESTC: Full fetch complete (72495 records). [2025-10-22T18:38:19.776321] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-22T18:38:20.124275] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-22T18:38:20.163601] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-22T18:38:20.163716] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-22T18:38:20.164802] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-22T18:38:20.164866] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-22T18:38:20.166617] [DEBUG] [LOCAL ] ESTC: Trimmed 72495 records to 50253 (keeping 200 days of data) [2025-10-22T18:38:20.460595] [DEBUG] [LOCAL ] ESTC: Primary data saved (50253 records). [2025-10-22T18:38:20.460751] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-22T18:38:20.460839] [INFO ] [MAIN ] Update Progress: 772/2367 symbols completed. ESTC took 31.1s. Estimated remaining: 3h 23m 1s. Rate: 7.9 symbols/min [2025-10-22T18:38:20.651993] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:38:20.670181] [DEBUG] [LOCAL ] ETG: Loaded 16586 existing records from primary storage. [2025-10-22T18:38:20.670453] [INFO ] [MAIN ] ETG: Loaded 16586 existing records. [2025-10-22T18:38:20.914850] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:38:20.915146] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-22T18:38:20.915223] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-22T18:38:20.920578] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-22T18:38:20.929330] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-22T18:38:20.929477] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-22T18:38:20.953491] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T18:38:21.291130] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T18:38:21.362724] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:38:21.717698] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-22T18:38:22.517740] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-22T18:38:23.157471] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-22T18:38:23.262627] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T18:38:23.317743] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-22T18:38:23.331316] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T18:38:24.117684] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-22T18:38:24.345297] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-22T18:38:24.917704] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-22T18:38:25.074431] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-22T18:38:25.717701] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-22T18:38:25.873578] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-22T18:38:26.517705] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-22T18:38:26.971363] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T18:38:27.317721] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-22T18:38:28.117764] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-22T18:38:28.301577] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T18:38:28.917720] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-22T18:38:28.991448] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-22T18:38:29.164995] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T18:38:29.717720] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-22T18:38:29.994446] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T18:38:30.517681] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-22T18:38:30.676344] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-22T18:38:31.317735] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-22T18:38:31.931569] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T18:38:32.117702] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-22T18:38:32.917699] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-22T18:38:33.168796] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T18:38:33.609097] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-22T18:38:33.717719] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-22T18:38:34.166279] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T18:38:34.517698] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-22T18:38:35.317745] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-22T18:38:35.597763] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T18:38:36.020556] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-22T18:38:36.117717] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-22T18:38:36.487354] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T18:38:36.917721] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-22T18:38:37.717702] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-22T18:38:37.897704] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-22T18:38:38.481397] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-22T18:38:38.490322] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-10-22T18:38:38.490482] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-22T18:38:38.522948] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-22T18:38:38.911000] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-22T18:38:38.911068] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-22T18:38:38.911956] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-22T18:38:38.912019] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-22T18:38:38.913497] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 53789 (keeping 200 days of data) [2025-10-22T18:38:39.047864] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T18:38:39.276400] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-10-22T18:38:39.276553] [INFO ] [MAIN ] ET: Full history saved. [2025-10-22T18:38:39.276631] [INFO ] [MAIN ] Update Progress: 773/2367 symbols completed. ET took 41.3s. Estimated remaining: 3h 23m 17s. Rate: 7.8 symbols/min [2025-10-22T18:38:39.334422] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-22T18:38:39.456433] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:38:39.468131] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T18:38:39.485613] [DEBUG] [LOCAL ] ETJ: Loaded 16565 existing records from primary storage. [2025-10-22T18:38:39.485908] [INFO ] [MAIN ] ETJ: Loaded 16565 existing records. [2025-10-22T18:38:39.667622] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:38:39.667873] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-22T18:38:39.667921] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-22T18:38:39.668074] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-22T18:38:39.668111] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-22T18:38:40.023938] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:38:40.117710] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-22T18:38:40.293535] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-22T18:38:40.917734] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-22T18:38:41.471611] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T18:38:41.544766] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-22T18:38:41.717737] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-22T18:38:42.517771] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-22T18:38:43.205250] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T18:38:43.317686] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-22T18:38:43.474275] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T18:38:43.478790] [INFO ] [REMOTE ] ETG: Full fetch complete (24513 records). [2025-10-22T18:38:43.478908] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-22T18:38:43.479513] [FATAL] [VALIDATOR ] ETG: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:38:43.479618] [FATAL] [MAIN ] ETG: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:38:43.479716] [WARN ] [MAIN ] ETG: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:38:43.479782] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-22T18:38:43.479864] [DEBUG] [LOCAL ] ETG: No primary data file found to delete. [2025-10-22T18:38:43.479913] [INFO ] [LOCAL ] ETG: Starting deletion of derivative data. [2025-10-22T18:38:43.480104] [DEBUG] [LOCAL ] ETG: Deleted derivative data file. [2025-10-22T18:38:43.480221] [INFO ] [MAIN ] Update Progress: 774/2367 symbols completed. ETG took 23.0s. Estimated remaining: 3h 23m 2s. Rate: 7.8 symbols/min [2025-10-22T18:38:43.653859] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:38:43.704584] [DEBUG] [LOCAL ] ETN: Loaded 52573 existing records from primary storage. [2025-10-22T18:38:43.704973] [INFO ] [MAIN ] ETN: Loaded 52573 existing records. [2025-10-22T18:38:43.876679] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:38:43.876879] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-22T18:38:43.876925] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-22T18:38:43.877110] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-22T18:38:43.877147] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-22T18:38:44.125589] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-22T18:38:44.233779] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:38:44.286301] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-22T18:38:44.917681] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-22T18:38:45.118917] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T18:38:45.123371] [INFO ] [REMOTE ] ETD: Full fetch complete (38603 records). [2025-10-22T18:38:45.123456] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-22T18:38:45.503629] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-22T18:38:45.504016] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-22T18:38:45.513160] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-22T18:38:45.513280] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-22T18:38:45.514498] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T18:38:45.519362] [DEBUG] [LOCAL ] ETD: Trimmed 38603 records to 27141 (keeping 200 days of data) [2025-10-22T18:38:45.683129] [DEBUG] [LOCAL ] ETD: Primary data saved (27141 records). [2025-10-22T18:38:45.683270] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-22T18:38:45.683350] [INFO ] [MAIN ] Update Progress: 775/2367 symbols completed. ETD took 27.4s. Estimated remaining: 3h 22m 43s. Rate: 7.9 symbols/min [2025-10-22T18:38:45.722878] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-22T18:38:45.926955] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:38:45.940260] [DEBUG] [LOCAL ] ETO: Loaded 6981 existing records from primary storage. [2025-10-22T18:38:45.940562] [INFO ] [MAIN ] ETO: Loaded 6981 existing records. [2025-10-22T18:38:46.224228] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:38:46.224508] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-22T18:38:46.224580] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-22T18:38:46.224975] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-22T18:38:46.225048] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-22T18:38:46.523004] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-22T18:38:46.657560] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:38:47.317795] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-22T18:38:47.663506] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-22T18:38:47.846501] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-22T18:38:48.117620] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-22T18:38:48.389040] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T18:38:48.917729] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-22T18:38:49.012887] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-22T18:38:49.717726] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-22T18:38:50.517735] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-22T18:38:50.759091] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T18:38:50.848741] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-22T18:38:51.119329] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-22T18:38:51.317710] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-22T18:38:52.117684] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-22T18:38:52.260481] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-22T18:38:52.917725] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-22T18:38:53.717695] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-22T18:38:53.811869] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-22T18:38:54.152867] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-22T18:38:54.361747] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-22T18:38:54.517702] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-22T18:38:55.317673] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-22T18:38:56.117673] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-22T18:38:56.309788] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T18:38:56.572605] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-22T18:38:56.699031] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-22T18:38:56.917686] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-22T18:38:57.711569] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T18:38:57.717605] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-22T18:38:58.517681] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-22T18:38:58.571582] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T18:38:59.317720] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-22T18:39:00.117686] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-22T18:39:00.275441] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T18:39:00.278102] [INFO ] [REMOTE ] ETB: Full fetch complete (18472 records). [2025-10-22T18:39:00.278175] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-22T18:39:00.647294] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-22T18:39:00.647392] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-22T18:39:00.647832] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-22T18:39:00.647911] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-22T18:39:00.648564] [DEBUG] [LOCAL ] ETB: Trimmed 18472 records to 11764 (keeping 200 days of data) [2025-10-22T18:39:00.751350] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-22T18:39:00.769728] [DEBUG] [LOCAL ] ETB: Primary data saved (11764 records). [2025-10-22T18:39:00.769864] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-22T18:39:00.769936] [INFO ] [MAIN ] Update Progress: 776/2367 symbols completed. ETB took 48.6s. Estimated remaining: 3h 22m 51s. Rate: 7.8 symbols/min [2025-10-22T18:39:00.918566] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-22T18:39:00.941489] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:01.000317] [DEBUG] [LOCAL ] ETR: Loaded 53193 existing records from primary storage. [2025-10-22T18:39:01.000702] [INFO ] [MAIN ] ETR: Loaded 53193 existing records. [2025-10-22T18:39:01.249613] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:01.249941] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-22T18:39:01.250003] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-22T18:39:01.250235] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-22T18:39:01.250306] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-22T18:39:01.672952] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:01.717709] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-22T18:39:02.043939] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-22T18:39:02.517761] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-22T18:39:03.317684] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-22T18:39:04.171622] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (3.25 seconds). [2025-10-22T18:39:04.175702] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-22T18:39:04.710127] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-22T18:39:04.917710] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-22T18:39:05.308628] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (3.59 seconds). [2025-10-22T18:39:05.415738] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-22T18:39:05.434389] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-22T18:39:05.548409] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-22T18:39:05.717678] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-22T18:39:06.517731] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-22T18:39:06.778989] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T18:39:06.783054] [INFO ] [REMOTE ] ETJ: Full fetch complete (25557 records). [2025-10-22T18:39:06.783291] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-22T18:39:07.158516] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-22T18:39:07.158615] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-22T18:39:07.159253] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-22T18:39:07.159304] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-22T18:39:07.160333] [DEBUG] [LOCAL ] ETJ: Trimmed 25557 records to 16449 (keeping 200 days of data) [2025-10-22T18:39:07.258866] [DEBUG] [LOCAL ] ETJ: Primary data saved (16449 records). [2025-10-22T18:39:07.259012] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-22T18:39:07.259098] [INFO ] [MAIN ] Update Progress: 777/2367 symbols completed. ETJ took 28.0s. Estimated remaining: 3h 22m 41s. Rate: 7.8 symbols/min [2025-10-22T18:39:07.323583] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-22T18:39:07.436729] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:07.485712] [DEBUG] [LOCAL ] ETSY: Loaded 53569 existing records from primary storage. [2025-10-22T18:39:07.486020] [INFO ] [MAIN ] ETSY: Loaded 53569 existing records. [2025-10-22T18:39:07.659742] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:07.659954] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-22T18:39:07.659999] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-22T18:39:07.660181] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-22T18:39:07.660218] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-22T18:39:08.016494] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:08.021263] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T18:39:08.117606] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-22T18:39:08.238726] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T18:39:08.917731] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-22T18:39:09.096894] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T18:39:09.099281] [INFO ] [REMOTE ] ETO: Full fetch complete (9709 records). [2025-10-22T18:39:09.099404] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-22T18:39:09.472561] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-22T18:39:09.472683] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-22T18:39:09.472984] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-22T18:39:09.473033] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-22T18:39:09.473753] [DEBUG] [LOCAL ] ETO: Trimmed 9709 records to 6892 (keeping 200 days of data) [2025-10-22T18:39:09.523698] [DEBUG] [LOCAL ] ETO: Primary data saved (6892 records). [2025-10-22T18:39:09.523844] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-22T18:39:09.523926] [INFO ] [MAIN ] Update Progress: 778/2367 symbols completed. ETO took 23.8s. Estimated remaining: 3h 22m 22s. Rate: 7.9 symbols/min [2025-10-22T18:39:09.704212] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:09.704463] [DEBUG] [LOCAL ] ETV: No existing data file found in primary storage. [2025-10-22T18:39:09.704514] [WARN ] [MAIN ] ETV: No existing data found, performing full refresh instead. [2025-10-22T18:39:09.704671] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-22T18:39:09.704725] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-22T18:39:09.704806] [DEBUG] [LOCAL ] ETV: No primary data file found to delete. [2025-10-22T18:39:09.704854] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-22T18:39:09.725230] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-22T18:39:10.055549] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:10.517723] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-22T18:39:11.044633] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-22T18:39:11.317698] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-22T18:39:11.739257] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T18:39:12.117623] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-22T18:39:12.420701] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-22T18:39:12.917751] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-22T18:39:13.635087] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-22T18:39:13.717621] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-22T18:39:13.905515] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T18:39:14.517716] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-22T18:39:14.814130] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T18:39:15.297586] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T18:39:15.317623] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-22T18:39:15.970039] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T18:39:16.117685] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-22T18:39:16.917762] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-22T18:39:17.549914] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-22T18:39:17.717678] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-22T18:39:18.513051] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-22T18:39:18.523433] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-22T18:39:19.091095] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-22T18:39:19.099795] [INFO ] [REMOTE ] ETN: Full fetch complete (76646 records). [2025-10-22T18:39:19.099963] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-22T18:39:19.332412] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-22T18:39:19.503393] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-22T18:39:19.503511] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-22T18:39:19.504456] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-22T18:39:19.504545] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-22T18:39:19.506700] [DEBUG] [LOCAL ] ETN: Trimmed 76646 records to 52571 (keeping 200 days of data) [2025-10-22T18:39:19.656250] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T18:39:19.664864] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T18:39:19.892761] [DEBUG] [LOCAL ] ETN: Primary data saved (52571 records). [2025-10-22T18:39:19.892905] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-22T18:39:19.892987] [INFO ] [MAIN ] Update Progress: 779/2367 symbols completed. ETN took 36.4s. Estimated remaining: 3h 22m 20s. Rate: 7.8 symbols/min [2025-10-22T18:39:20.057034] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:20.081841] [DEBUG] [LOCAL ] ETW: Loaded 25249 existing records from primary storage. [2025-10-22T18:39:20.082219] [INFO ] [MAIN ] ETW: Loaded 25249 existing records. [2025-10-22T18:39:20.123745] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-22T18:39:20.261594] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:20.261834] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-22T18:39:20.261880] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-22T18:39:20.262243] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-22T18:39:20.262300] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-22T18:39:20.603849] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:20.917738] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-22T18:39:21.352293] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T18:39:21.717878] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-22T18:39:21.956785] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T18:39:22.068167] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T18:39:22.517730] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-22T18:39:23.317759] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-22T18:39:23.804328] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-22T18:39:24.033392] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T18:39:24.084845] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-22T18:39:24.117626] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-22T18:39:24.917698] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-22T18:39:25.106270] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-22T18:39:25.717719] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-22T18:39:26.517698] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-22T18:39:26.573835] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T18:39:26.938420] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-22T18:39:27.241597] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T18:39:27.317682] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-22T18:39:27.961315] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T18:39:28.117720] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-22T18:39:28.917730] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-22T18:39:29.717703] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-22T18:39:29.942447] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-22T18:39:30.376936] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T18:39:30.517742] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-22T18:39:30.801914] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T18:39:31.317761] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-22T18:39:32.117733] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-22T18:39:32.432124] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-22T18:39:32.440754] [INFO ] [REMOTE ] ETR: Full fetch complete (76888 records). [2025-10-22T18:39:32.440950] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-22T18:39:32.441782] [FATAL] [VALIDATOR ] ETR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:39:32.441872] [FATAL] [MAIN ] ETR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:39:32.441915] [WARN ] [MAIN ] ETR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:39:32.441956] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-22T18:39:32.442013] [DEBUG] [LOCAL ] ETR: No primary data file found to delete. [2025-10-22T18:39:32.442048] [INFO ] [LOCAL ] ETR: Starting deletion of derivative data. [2025-10-22T18:39:32.442219] [DEBUG] [LOCAL ] ETR: Deleted derivative data file. [2025-10-22T18:39:32.442308] [INFO ] [MAIN ] Update Progress: 780/2367 symbols completed. ETR took 31.7s. Estimated remaining: 3h 22m 22s. Rate: 7.8 symbols/min [2025-10-22T18:39:32.617265] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:32.632355] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T18:39:32.642928] [DEBUG] [LOCAL ] ETX: Loaded 5311 existing records from primary storage. [2025-10-22T18:39:32.643154] [INFO ] [MAIN ] ETX: Loaded 5311 existing records. [2025-10-22T18:39:32.822609] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:32.822834] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-22T18:39:32.822881] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-22T18:39:32.823041] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-22T18:39:32.823096] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-22T18:39:32.921882] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-22T18:39:33.178929] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:33.717709] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-22T18:39:33.883919] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T18:39:33.911503] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T18:39:34.517782] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-22T18:39:34.634443] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T18:39:35.317757] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-22T18:39:35.755961] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T18:39:35.765774] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T18:39:36.117727] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-22T18:39:36.627049] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-22T18:39:36.917710] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-22T18:39:37.480634] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-22T18:39:37.717744] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-22T18:39:38.359630] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T18:39:38.517757] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-22T18:39:39.232098] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-22T18:39:39.317628] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-22T18:39:40.117759] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-22T18:39:40.732490] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T18:39:40.917719] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-22T18:39:41.239120] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T18:39:41.717721] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-22T18:39:42.234850] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T18:39:42.517731] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-22T18:39:42.767116] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T18:39:43.317744] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-22T18:39:44.117710] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-22T18:39:44.542590] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-22T18:39:44.569082] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T18:39:44.917742] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-22T18:39:45.166342] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T18:39:45.717711] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-22T18:39:46.157210] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T18:39:46.162371] [INFO ] [REMOTE ] ETW: Full fetch complete (36495 records). [2025-10-22T18:39:46.162526] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-22T18:39:46.524597] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-22T18:39:46.526932] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-22T18:39:46.527943] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-22T18:39:46.528571] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-22T18:39:46.528634] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-22T18:39:46.529699] [DEBUG] [LOCAL ] ETW: Trimmed 36495 records to 25106 (keeping 200 days of data) [2025-10-22T18:39:46.677438] [DEBUG] [LOCAL ] ETW: Primary data saved (25106 records). [2025-10-22T18:39:46.677572] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-22T18:39:46.677693] [INFO ] [MAIN ] Update Progress: 781/2367 symbols completed. ETW took 26.8s. Estimated remaining: 3h 22m 28s. Rate: 7.8 symbols/min [2025-10-22T18:39:46.850000] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:46.865324] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-22T18:39:46.888888] [DEBUG] [LOCAL ] ETY: Loaded 22546 existing records from primary storage. [2025-10-22T18:39:46.889164] [INFO ] [MAIN ] ETY: Loaded 22546 existing records. [2025-10-22T18:39:47.060519] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:47.060756] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-22T18:39:47.060813] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-22T18:39:47.060997] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-22T18:39:47.061052] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-22T18:39:47.320231] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-22T18:39:47.427777] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-22T18:39:47.427428] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:48.117723] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-22T18:39:48.369442] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T18:39:48.374283] [INFO ] [REMOTE ] ETV: Full fetch complete (32259 records). [2025-10-22T18:39:48.374388] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-22T18:39:48.749370] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-22T18:39:48.749445] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-22T18:39:48.749980] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-22T18:39:48.750041] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-22T18:39:48.750828] [DEBUG] [LOCAL ] ETV: Trimmed 32259 records to 21830 (keeping 200 days of data) [2025-10-22T18:39:48.884602] [DEBUG] [LOCAL ] ETV: Primary data saved (21830 records). [2025-10-22T18:39:48.884761] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-22T18:39:48.884851] [INFO ] [MAIN ] Update Progress: 782/2367 symbols completed. ETV took 39.4s. Estimated remaining: 3h 22m 9s. Rate: 7.8 symbols/min [2025-10-22T18:39:48.927246] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-22T18:39:49.058466] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:49.075240] [DEBUG] [LOCAL ] EVC: Loaded 17976 existing records from primary storage. [2025-10-22T18:39:49.075482] [INFO ] [MAIN ] EVC: Loaded 17976 existing records. [2025-10-22T18:39:49.254075] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:49.254266] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-22T18:39:49.254312] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-22T18:39:49.254582] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-22T18:39:49.254637] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-22T18:39:49.619801] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:49.663706] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T18:39:49.717711] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-22T18:39:49.729798] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T18:39:50.517721] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-22T18:39:51.163167] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T18:39:51.212882] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-22T18:39:51.214765] [INFO ] [REMOTE ] ETX: Full fetch complete (6815 records). [2025-10-22T18:39:51.214852] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-22T18:39:51.319168] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-22T18:39:51.567175] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-22T18:39:51.567249] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-22T18:39:51.567427] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-22T18:39:51.567466] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-22T18:39:51.567874] [DEBUG] [LOCAL ] ETX: Trimmed 6815 records to 5336 (keeping 200 days of data) [2025-10-22T18:39:51.598926] [DEBUG] [LOCAL ] ETX: Primary data saved (5336 records). [2025-10-22T18:39:51.599010] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-22T18:39:51.599082] [INFO ] [MAIN ] Update Progress: 783/2367 symbols completed. ETX took 19.2s. Estimated remaining: 3h 21m 52s. Rate: 7.8 symbols/min [2025-10-22T18:39:51.764869] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:51.794865] [DEBUG] [LOCAL ] EVEX: Loaded 33007 existing records from primary storage. [2025-10-22T18:39:51.795162] [INFO ] [MAIN ] EVEX: Loaded 33007 existing records. [2025-10-22T18:39:51.965990] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:51.966235] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-22T18:39:51.966317] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-22T18:39:51.966490] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-22T18:39:51.966529] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-22T18:39:52.119207] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-22T18:39:52.311183] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:52.478559] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T18:39:52.917706] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-22T18:39:53.717696] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-22T18:39:53.824276] [DEBUG] [REMOTE ] ETY: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-22T18:39:53.824581] [WARN ] [REMOTE ] ETY: No data returned for month 2025-02 [2025-10-22T18:39:53.824827] [FATAL] [REMOTE ] ETY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:39:53.824924] [FATAL] [MAIN ] ETY: Failed to fetch primary data. [2025-10-22T18:39:53.824991] [WARN ] [MAIN ] ETY: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:39:53.825061] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-22T18:39:53.825124] [DEBUG] [LOCAL ] ETY: No primary data file found to delete. [2025-10-22T18:39:53.825161] [INFO ] [LOCAL ] ETY: Starting deletion of derivative data. [2025-10-22T18:39:53.825285] [DEBUG] [LOCAL ] ETY: Deleted derivative data file. [2025-10-22T18:39:53.825347] [INFO ] [MAIN ] Update Progress: 784/2367 symbols completed. ETY took 7.1s. Estimated remaining: 3h 21m 33s. Rate: 7.9 symbols/min [2025-10-22T18:39:54.002927] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:54.015008] [DEBUG] [LOCAL ] EVF: Loaded 9793 existing records from primary storage. [2025-10-22T18:39:54.015418] [INFO ] [MAIN ] EVF: Loaded 9793 existing records. [2025-10-22T18:39:54.202557] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:54.202937] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-22T18:39:54.203165] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-22T18:39:54.203537] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-22T18:39:54.203673] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-22T18:39:54.263243] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T18:39:54.400522] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-22T18:39:54.521310] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-22T18:39:54.549124] [INFO ] [REMOTE ] ETSY: Full fetch complete (77665 records). [2025-10-22T18:39:54.560331] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-22T18:39:54.708572] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:55.041229] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-22T18:39:55.041328] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-22T18:39:55.042272] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-22T18:39:55.042340] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-22T18:39:55.043874] [DEBUG] [LOCAL ] ETSY: Trimmed 77665 records to 53569 (keeping 200 days of data) [2025-10-22T18:39:55.334389] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-22T18:39:55.359308] [DEBUG] [LOCAL ] ETSY: Primary data saved (53569 records). [2025-10-22T18:39:55.359423] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-22T18:39:55.359521] [INFO ] [MAIN ] Update Progress: 785/2367 symbols completed. ETSY took 48.1s. Estimated remaining: 3h 21m 13s. Rate: 7.9 symbols/min [2025-10-22T18:39:55.535356] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:39:55.542243] [DEBUG] [LOCAL ] EVG: Loaded 5831 existing records from primary storage. [2025-10-22T18:39:55.542388] [INFO ] [MAIN ] EVG: Loaded 5831 existing records. [2025-10-22T18:39:55.724731] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T18:39:55.747487] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:39:55.751922] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-22T18:39:55.752177] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-22T18:39:55.752757] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-22T18:39:55.752817] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-22T18:39:56.121468] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:39:56.117751] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-22T18:39:56.566345] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T18:39:56.917707] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-22T18:39:57.381230] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T18:39:57.717707] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-22T18:39:58.006415] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T18:39:58.441149] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-22T18:39:58.517695] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-22T18:39:59.317619] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-22T18:39:59.569548] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T18:39:59.958413] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T18:40:00.117732] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-22T18:40:00.917704] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-22T18:40:01.717742] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-22T18:40:02.517715] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-22T18:40:02.718335] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-22T18:40:03.317695] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-22T18:40:03.468478] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T18:40:03.871771] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (2.95 seconds). [2025-10-22T18:40:04.117694] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-22T18:40:04.538226] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T18:40:04.552791] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-10-22T18:40:04.624298] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-22T18:40:04.917730] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-22T18:40:05.588248] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-22T18:40:05.717705] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-22T18:40:06.517622] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-22T18:40:06.794986] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T18:40:07.317726] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-22T18:40:07.529830] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T18:40:08.117696] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-22T18:40:08.320881] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T18:40:08.917732] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-22T18:40:09.132363] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T18:40:09.624293] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-22T18:40:09.717698] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-22T18:40:10.519782] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-22T18:40:10.522582] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T18:40:11.317734] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-22T18:40:11.953530] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T18:40:11.955433] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T18:40:12.117704] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-22T18:40:12.917716] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-22T18:40:13.554637] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T18:40:13.717714] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-22T18:40:13.744889] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-22T18:40:14.517683] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-22T18:40:15.317723] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-22T18:40:15.375595] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T18:40:15.504970] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T18:40:16.117725] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-22T18:40:16.125366] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T18:40:16.917752] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-22T18:40:17.717784] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-22T18:40:17.908008] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T18:40:18.170527] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-22T18:40:18.178212] [INFO ] [REMOTE ] EVEX: Full fetch complete (44149 records). [2025-10-22T18:40:18.178299] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-22T18:40:18.521523] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-22T18:40:18.553602] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-22T18:40:18.553695] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-22T18:40:18.554389] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-22T18:40:18.554565] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-22T18:40:18.555543] [DEBUG] [LOCAL ] EVEX: Trimmed 44149 records to 33091 (keeping 200 days of data) [2025-10-22T18:40:18.647177] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-22T18:40:18.749338] [DEBUG] [LOCAL ] EVEX: Primary data saved (33091 records). [2025-10-22T18:40:18.749469] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-22T18:40:18.749561] [INFO ] [MAIN ] Update Progress: 786/2367 symbols completed. EVEX took 27.2s. Estimated remaining: 3h 21m 37s. Rate: 7.8 symbols/min [2025-10-22T18:40:18.913149] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:40:18.955302] [DEBUG] [LOCAL ] EVH: Loaded 49597 existing records from primary storage. [2025-10-22T18:40:18.955622] [INFO ] [MAIN ] EVH: Loaded 49597 existing records. [2025-10-22T18:40:19.130749] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:40:19.130931] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-22T18:40:19.130976] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-22T18:40:19.131245] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-22T18:40:19.131282] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-22T18:40:19.316801] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-22T18:40:19.323057] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-22T18:40:19.510509] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:40:20.117743] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-22T18:40:20.429086] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T18:40:20.431907] [INFO ] [REMOTE ] EVC: Full fetch complete (28817 records). [2025-10-22T18:40:20.431977] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-22T18:40:20.792970] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-22T18:40:20.793047] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-22T18:40:20.793529] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-22T18:40:20.793570] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-22T18:40:20.794211] [DEBUG] [LOCAL ] EVC: Trimmed 28817 records to 17862 (keeping 200 days of data) [2025-10-22T18:40:20.894095] [DEBUG] [LOCAL ] EVC: Primary data saved (17862 records). [2025-10-22T18:40:20.894222] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-22T18:40:20.894300] [INFO ] [MAIN ] Update Progress: 787/2367 symbols completed. EVC took 32.0s. Estimated remaining: 3h 21m 18s. Rate: 7.8 symbols/min [2025-10-22T18:40:20.929617] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-22T18:40:21.006516] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T18:40:21.074231] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:40:21.089224] [DEBUG] [LOCAL ] EVN: Loaded 10747 existing records from primary storage. [2025-10-22T18:40:21.089468] [INFO ] [MAIN ] EVN: Loaded 10747 existing records. [2025-10-22T18:40:21.260530] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:40:21.260782] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-22T18:40:21.260840] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-22T18:40:21.260998] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-22T18:40:21.261054] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-22T18:40:21.604969] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:40:21.717687] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-22T18:40:22.517674] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-22T18:40:22.688826] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T18:40:22.957405] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T18:40:23.156180] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-22T18:40:23.317749] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-22T18:40:24.117703] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-22T18:40:24.171820] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-22T18:40:24.917705] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-22T18:40:24.939230] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T18:40:25.717756] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-22T18:40:26.100202] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T18:40:26.102730] [INFO ] [REMOTE ] EVF: Full fetch complete (12857 records). [2025-10-22T18:40:26.102816] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-22T18:40:26.460843] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-22T18:40:26.460915] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-22T18:40:26.461182] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-22T18:40:26.461220] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-22T18:40:26.461738] [DEBUG] [LOCAL ] EVF: Trimmed 12857 records to 9694 (keeping 200 days of data) [2025-10-22T18:40:26.518544] [DEBUG] [LOCAL ] EVF: Primary data saved (9694 records). [2025-10-22T18:40:26.518785] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-22T18:40:26.519017] [INFO ] [MAIN ] Update Progress: 788/2367 symbols completed. EVF took 32.7s. Estimated remaining: 3h 21m 7s. Rate: 7.9 symbols/min [2025-10-22T18:40:26.518862] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-22T18:40:26.687760] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:40:26.719951] [DEBUG] [LOCAL ] EVR: Loaded 33850 existing records from primary storage. [2025-10-22T18:40:26.720208] [INFO ] [MAIN ] EVR: Loaded 33850 existing records. [2025-10-22T18:40:26.893723] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:40:26.893929] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-22T18:40:26.893998] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-22T18:40:26.894215] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-22T18:40:26.894278] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-22T18:40:27.245860] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:40:27.283767] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T18:40:27.317615] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-22T18:40:27.337221] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T18:40:28.117766] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-22T18:40:28.757339] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-22T18:40:28.917665] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-22T18:40:29.019796] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T18:40:29.718010] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-22T18:40:29.719868] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T18:40:30.517736] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-22T18:40:31.317672] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-22T18:40:31.424989] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T18:40:32.117620] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-22T18:40:32.177930] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T18:40:32.268797] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T18:40:32.917693] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-22T18:40:33.555154] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-22T18:40:33.584178] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T18:40:33.717628] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-22T18:40:34.517718] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-22T18:40:34.605041] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-22T18:40:34.606491] [INFO ] [REMOTE ] EVG: Full fetch complete (8093 records). [2025-10-22T18:40:34.606560] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-22T18:40:34.960480] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-22T18:40:34.960561] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-22T18:40:34.960806] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-22T18:40:34.960873] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-22T18:40:34.961286] [DEBUG] [LOCAL ] EVG: Trimmed 8093 records to 5750 (keeping 200 days of data) [2025-10-22T18:40:34.996413] [DEBUG] [LOCAL ] EVG: Primary data saved (5750 records). [2025-10-22T18:40:34.996535] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-22T18:40:34.996618] [INFO ] [MAIN ] Update Progress: 789/2367 symbols completed. EVG took 39.6s. Estimated remaining: 3h 21m 1s. Rate: 7.9 symbols/min [2025-10-22T18:40:35.173772] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:40:35.173987] [DEBUG] [LOCAL ] EVT: No existing data file found in primary storage. [2025-10-22T18:40:35.174031] [WARN ] [MAIN ] EVT: No existing data found, performing full refresh instead. [2025-10-22T18:40:35.174168] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-22T18:40:35.174230] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-22T18:40:35.174279] [DEBUG] [LOCAL ] EVT: No primary data file found to delete. [2025-10-22T18:40:35.174313] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-22T18:40:35.322817] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-22T18:40:35.483827] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T18:40:35.596694] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:40:36.117727] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-22T18:40:36.882366] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T18:40:36.917748] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-22T18:40:37.523951] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T18:40:37.717694] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-22T18:40:37.960332] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T18:40:38.517723] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-22T18:40:38.923707] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T18:40:39.317688] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-22T18:40:39.478926] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T18:40:39.481309] [INFO ] [REMOTE ] EVN: Full fetch complete (17111 records). [2025-10-22T18:40:39.481395] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-22T18:40:39.843245] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-22T18:40:39.843316] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-22T18:40:39.843688] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-22T18:40:39.843748] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-22T18:40:39.844223] [DEBUG] [LOCAL ] EVN: Trimmed 17111 records to 10780 (keeping 200 days of data) [2025-10-22T18:40:39.907812] [DEBUG] [LOCAL ] EVN: Primary data saved (10780 records). [2025-10-22T18:40:39.907933] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-22T18:40:39.908009] [INFO ] [MAIN ] Update Progress: 790/2367 symbols completed. EVN took 19.0s. Estimated remaining: 3h 20m 48s. Rate: 7.9 symbols/min [2025-10-22T18:40:40.070942] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:40:40.096265] [DEBUG] [LOCAL ] EVTC: Loaded 26869 existing records from primary storage. [2025-10-22T18:40:40.096503] [INFO ] [MAIN ] EVTC: Loaded 26869 existing records. [2025-10-22T18:40:40.126450] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-22T18:40:40.275553] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:40:40.275829] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-22T18:40:40.275881] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-22T18:40:40.276065] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-22T18:40:40.276106] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-22T18:40:40.656457] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:40:40.845514] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T18:40:40.917700] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-22T18:40:41.603719] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T18:40:41.717691] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-22T18:40:42.517690] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-22T18:40:42.744091] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T18:40:43.317687] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-22T18:40:43.369895] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T18:40:43.559919] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T18:40:44.117738] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-22T18:40:44.594976] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-22T18:40:44.917728] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-22T18:40:45.717678] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-22T18:40:45.904386] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T18:40:46.313153] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T18:40:46.517720] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-22T18:40:46.992929] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T18:40:47.317789] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-22T18:40:48.019551] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T18:40:48.117704] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-22T18:40:48.371751] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T18:40:48.917717] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-22T18:40:49.271013] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T18:40:49.717701] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-22T18:40:50.125386] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T18:40:50.356448] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T18:40:50.517718] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-22T18:40:51.317694] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-22T18:40:52.117677] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-22T18:40:52.196872] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T18:40:52.650062] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T18:40:52.917699] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-22T18:40:53.009396] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-22T18:40:53.717712] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-22T18:40:54.104789] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T18:40:54.109669] [INFO ] [REMOTE ] EVR: Full fetch complete (50626 records). [2025-10-22T18:40:54.109766] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-22T18:40:54.481766] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-22T18:40:54.481859] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-22T18:40:54.482547] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-22T18:40:54.482591] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-22T18:40:54.483591] [DEBUG] [LOCAL ] EVR: Trimmed 50626 records to 33601 (keeping 200 days of data) [2025-10-22T18:40:54.540557] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-22T18:40:54.704260] [DEBUG] [LOCAL ] EVR: Primary data saved (33601 records). [2025-10-22T18:40:54.704620] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T18:40:54.708690] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-22T18:40:54.709324] [INFO ] [MAIN ] Update Progress: 791/2367 symbols completed. EVR took 28.2s. Estimated remaining: 3h 20m 54s. Rate: 7.8 symbols/min [2025-10-22T18:40:54.892340] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:40:54.928465] [DEBUG] [LOCAL ] EVTL: Loaded 41214 existing records from primary storage. [2025-10-22T18:40:54.928767] [INFO ] [MAIN ] EVTL: Loaded 41214 existing records. [2025-10-22T18:40:55.099880] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:40:55.100075] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-22T18:40:55.100125] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-22T18:40:55.100293] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-22T18:40:55.100330] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-22T18:40:55.322874] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-22T18:40:55.453010] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:40:55.904579] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T18:40:56.117752] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-22T18:40:56.917686] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-22T18:40:57.084023] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-22T18:40:57.431722] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-22T18:40:57.440449] [INFO ] [REMOTE ] EVH: Full fetch complete (71867 records). [2025-10-22T18:40:57.440624] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-22T18:40:57.727383] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-22T18:40:57.873566] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-22T18:40:57.873677] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-22T18:40:57.874884] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-22T18:40:57.874951] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-22T18:40:57.876337] [DEBUG] [LOCAL ] EVH: Trimmed 71867 records to 49602 (keeping 200 days of data) [2025-10-22T18:40:58.171725] [DEBUG] [LOCAL ] EVH: Primary data saved (49602 records). [2025-10-22T18:40:58.171877] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-22T18:40:58.171961] [INFO ] [MAIN ] Update Progress: 792/2367 symbols completed. EVH took 39.4s. Estimated remaining: 3h 20m 38s. Rate: 7.8 symbols/min [2025-10-22T18:40:58.348173] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:40:58.366197] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T18:40:58.396007] [DEBUG] [LOCAL ] EVTR: Loaded 25297 existing records from primary storage. [2025-10-22T18:40:58.396289] [INFO ] [MAIN ] EVTR: Loaded 25297 existing records. [2025-10-22T18:40:58.522875] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-22T18:40:58.574744] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:40:58.575160] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-22T18:40:58.575214] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-22T18:40:58.575397] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-22T18:40:58.575437] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-22T18:40:58.927678] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:40:59.295875] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T18:40:59.317604] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-22T18:40:59.723478] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-22T18:41:00.117705] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-22T18:41:00.917690] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-22T18:41:01.207022] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T18:41:01.603106] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T18:41:01.717729] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-22T18:41:02.517748] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-22T18:41:02.720761] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T18:41:03.317678] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-22T18:41:03.438881] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T18:41:03.500822] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T18:41:03.503628] [INFO ] [REMOTE ] EVT: Full fetch complete (25082 records). [2025-10-22T18:41:03.503731] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-22T18:41:03.907904] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-22T18:41:03.907972] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-22T18:41:03.908489] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-22T18:41:03.908529] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-22T18:41:03.909245] [DEBUG] [LOCAL ] EVT: Trimmed 25082 records to 16515 (keeping 200 days of data) [2025-10-22T18:41:04.005663] [DEBUG] [LOCAL ] EVT: Primary data saved (16515 records). [2025-10-22T18:41:04.005801] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-22T18:41:04.005872] [INFO ] [MAIN ] Update Progress: 793/2367 symbols completed. EVT took 29.0s. Estimated remaining: 3h 20m 27s. Rate: 7.9 symbols/min [2025-10-22T18:41:04.122753] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-22T18:41:04.173790] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:41:04.220688] [DEBUG] [LOCAL ] EW: Loaded 53399 existing records from primary storage. [2025-10-22T18:41:04.220990] [INFO ] [MAIN ] EW: Loaded 53399 existing records. [2025-10-22T18:41:04.419356] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:41:04.419581] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-22T18:41:04.419753] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-22T18:41:04.420031] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-22T18:41:04.420086] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-22T18:41:04.684792] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T18:41:04.797330] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:41:04.917618] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-22T18:41:05.292202] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T18:41:05.717731] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-22T18:41:05.778798] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T18:41:06.517741] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-22T18:41:07.007164] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T18:41:07.317701] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-22T18:41:08.117700] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-22T18:41:08.384669] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-22T18:41:08.592852] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T18:41:08.917737] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-22T18:41:09.247833] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-22T18:41:09.717707] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-22T18:41:10.300597] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T18:41:10.305822] [INFO ] [REMOTE ] EVTC: Full fetch complete (38496 records). [2025-10-22T18:41:10.306004] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-22T18:41:10.529028] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-22T18:41:10.689076] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-22T18:41:10.689150] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-22T18:41:10.689737] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-22T18:41:10.689798] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-22T18:41:10.690618] [DEBUG] [LOCAL ] EVTC: Trimmed 38496 records to 26785 (keeping 200 days of data) [2025-10-22T18:41:10.861276] [DEBUG] [LOCAL ] EVTC: Primary data saved (26785 records). [2025-10-22T18:41:10.861433] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-22T18:41:10.861537] [INFO ] [MAIN ] Update Progress: 794/2367 symbols completed. EVTC took 31.0s. Estimated remaining: 3h 20m 18s. Rate: 7.9 symbols/min [2025-10-22T18:41:11.031038] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:41:11.062683] [DEBUG] [LOCAL ] EXG: Loaded 33695 existing records from primary storage. [2025-10-22T18:41:11.062961] [INFO ] [MAIN ] EXG: Loaded 33695 existing records. [2025-10-22T18:41:11.243254] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:41:11.243586] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-22T18:41:11.243755] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-22T18:41:11.244070] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-22T18:41:11.244141] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-22T18:41:11.346585] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-22T18:41:11.607347] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-22T18:41:11.652393] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:41:12.117700] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-22T18:41:12.250002] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T18:41:12.407454] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T18:41:12.917667] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-22T18:41:13.717704] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-22T18:41:13.914354] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-22T18:41:14.084506] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-22T18:41:14.517696] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-22T18:41:15.317677] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-22T18:41:15.348126] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T18:41:15.633476] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T18:41:16.117683] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-22T18:41:16.917704] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-22T18:41:16.974979] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T18:41:17.193273] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T18:41:17.717690] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-22T18:41:18.517623] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-22T18:41:18.751544] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T18:41:18.962845] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T18:41:19.317726] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-22T18:41:20.117628] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-22T18:41:20.445092] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T18:41:20.570080] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T18:41:20.917694] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-22T18:41:21.717722] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-22T18:41:22.445505] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-22T18:41:22.517712] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-22T18:41:22.589490] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T18:41:23.165471] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T18:41:23.317695] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-22T18:41:24.117796] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-22T18:41:24.729084] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T18:41:24.881700] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-22T18:41:24.890353] [INFO ] [REMOTE ] EVTL: Full fetch complete (54902 records). [2025-10-22T18:41:24.890501] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-22T18:41:24.923117] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-22T18:41:25.289903] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-22T18:41:25.290046] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-22T18:41:25.290847] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-22T18:41:25.290920] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-22T18:41:25.292393] [DEBUG] [LOCAL ] EVTL: Trimmed 54902 records to 41363 (keeping 200 days of data) [2025-10-22T18:41:25.395341] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T18:41:25.547484] [DEBUG] [LOCAL ] EVTL: Primary data saved (41363 records). [2025-10-22T18:41:25.547612] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-22T18:41:25.547741] [INFO ] [MAIN ] Update Progress: 795/2367 symbols completed. EVTL took 30.8s. Estimated remaining: 3h 20m 24s. Rate: 7.8 symbols/min [2025-10-22T18:41:25.711174] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:41:25.717719] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-22T18:41:25.761290] [DEBUG] [LOCAL ] EXK: Loaded 53186 existing records from primary storage. [2025-10-22T18:41:25.761685] [INFO ] [MAIN ] EXK: Loaded 53186 existing records. [2025-10-22T18:41:25.946760] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:41:25.947009] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-22T18:41:25.947056] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-22T18:41:25.947326] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-22T18:41:25.947384] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-22T18:41:26.323704] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:41:26.517705] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-22T18:41:26.805295] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T18:41:27.191260] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T18:41:27.317766] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-22T18:41:28.117695] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-22T18:41:28.598682] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T18:41:28.785856] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T18:41:28.917713] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-22T18:41:29.502015] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T18:41:29.508889] [INFO ] [REMOTE ] EVTR: Full fetch complete (33922 records). [2025-10-22T18:41:29.509001] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-22T18:41:29.726750] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-22T18:41:29.910094] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-22T18:41:29.910198] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-22T18:41:29.910785] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-22T18:41:29.910848] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-22T18:41:29.911777] [DEBUG] [LOCAL ] EVTR: Trimmed 33922 records to 25397 (keeping 200 days of data) [2025-10-22T18:41:30.063994] [DEBUG] [LOCAL ] EVTR: Primary data saved (25397 records). [2025-10-22T18:41:30.064114] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-22T18:41:30.064189] [INFO ] [MAIN ] Update Progress: 796/2367 symbols completed. EVTR took 31.9s. Estimated remaining: 3h 20m 10s. Rate: 7.8 symbols/min [2025-10-22T18:41:30.234720] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:41:30.262427] [DEBUG] [LOCAL ] EXP: Loaded 29339 existing records from primary storage. [2025-10-22T18:41:30.262707] [INFO ] [MAIN ] EXP: Loaded 29339 existing records. [2025-10-22T18:41:30.443144] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:41:30.443451] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-22T18:41:30.443520] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-22T18:41:30.443735] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-22T18:41:30.443797] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-22T18:41:30.522066] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-22T18:41:30.594450] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T18:41:30.848251] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:41:31.317617] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-22T18:41:31.425322] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T18:41:31.902330] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T18:41:32.117623] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-22T18:41:32.927820] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-22T18:41:32.933611] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T18:41:33.502055] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T18:41:33.717710] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-22T18:41:34.517780] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-22T18:41:34.581466] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T18:41:35.317695] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-22T18:41:35.606037] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T18:41:36.117715] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-22T18:41:36.368507] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T18:41:36.787589] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T18:41:36.917617] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-22T18:41:37.499463] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T18:41:37.717686] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-22T18:41:38.094219] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T18:41:38.517719] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-22T18:41:39.045561] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T18:41:39.323235] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-22T18:41:39.334040] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T18:41:40.117736] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-22T18:41:40.917734] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-22T18:41:41.434474] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T18:41:41.439874] [INFO ] [REMOTE ] EXG: Full fetch complete (49605 records). [2025-10-22T18:41:41.439966] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-22T18:41:41.717845] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-22T18:41:41.762625] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-22T18:41:41.863666] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-22T18:41:41.863768] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-22T18:41:41.864445] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-22T18:41:41.864487] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-22T18:41:41.865618] [DEBUG] [LOCAL ] EXG: Trimmed 49605 records to 33614 (keeping 200 days of data) [2025-10-22T18:41:42.058996] [DEBUG] [LOCAL ] EXG: Primary data saved (33614 records). [2025-10-22T18:41:42.059123] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-22T18:41:42.059199] [INFO ] [MAIN ] Update Progress: 797/2367 symbols completed. EXG took 31.2s. Estimated remaining: 3h 20m 11s. Rate: 7.8 symbols/min [2025-10-22T18:41:42.517722] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-22T18:41:42.738520] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T18:41:42.747311] [INFO ] [REMOTE ] EW: Full fetch complete (77515 records). [2025-10-22T18:41:42.747435] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-22T18:41:43.105106] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T18:41:43.172563] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-22T18:41:43.172639] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-22T18:41:43.173798] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-22T18:41:43.173881] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-22T18:41:43.175872] [DEBUG] [LOCAL ] EW: Trimmed 77515 records to 53399 (keeping 200 days of data) [2025-10-22T18:41:43.343934] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-22T18:41:43.493364] [DEBUG] [LOCAL ] EW: Primary data saved (53399 records). [2025-10-22T18:41:43.493508] [INFO ] [MAIN ] EW: Full history saved. [2025-10-22T18:41:43.493585] [INFO ] [MAIN ] Update Progress: 798/2367 symbols completed. EW took 39.5s. Estimated remaining: 3h 19m 51s. Rate: 7.9 symbols/min [2025-10-22T18:41:43.981000] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T18:41:44.117694] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-22T18:41:44.834571] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T18:41:44.917700] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-22T18:41:45.848147] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T18:41:45.858802] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-22T18:41:46.126392] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T18:41:46.517732] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-22T18:41:47.883521] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T18:41:47.900411] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-22T18:41:47.939776] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T18:41:48.117694] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-22T18:41:49.345736] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T18:41:49.351705] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-22T18:41:49.786137] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T18:41:49.797427] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-22T18:41:50.316919] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T18:41:50.517724] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-22T18:41:51.768968] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-22T18:41:51.780430] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-22T18:41:51.981438] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T18:41:51.986114] [INFO ] [REMOTE ] EXP: Full fetch complete (43031 records). [2025-10-22T18:41:51.986200] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-22T18:41:52.364257] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-22T18:41:52.364340] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-22T18:41:52.364972] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-22T18:41:52.365034] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-22T18:41:52.366000] [DEBUG] [LOCAL ] EXP: Trimmed 43031 records to 29175 (keeping 200 days of data) [2025-10-22T18:41:52.541950] [DEBUG] [LOCAL ] EXP: Primary data saved (29175 records). [2025-10-22T18:41:52.542076] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-22T18:41:52.542156] [INFO ] [MAIN ] Update Progress: 799/2367 symbols completed. EXP took 22.5s. Estimated remaining: 3h 19m 46s. Rate: 7.8 symbols/min [2025-10-22T18:41:54.154919] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-22T18:41:54.164094] [INFO ] [REMOTE ] EXK: Full fetch complete (76846 records). [2025-10-22T18:41:54.164230] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-22T18:41:54.585673] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-22T18:41:54.585763] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-22T18:41:54.586710] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-22T18:41:54.586777] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-22T18:41:54.588250] [DEBUG] [LOCAL ] EXK: Trimmed 76846 records to 53187 (keeping 200 days of data) [2025-10-22T18:41:54.892591] [DEBUG] [LOCAL ] EXK: Primary data saved (53187 records). [2025-10-22T18:41:54.892767] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-22T18:41:54.892856] [INFO ] [MAIN ] Update Progress: 800/2367 symbols completed. EXK took 29.3s. Estimated remaining: 3h 19m 28s. Rate: 7.9 symbols/min [2025-10-22T18:41:55.429166] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:41:55.550568] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:41:55.514392] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:41:55.600838] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:41:55.671342] [DEBUG] [LOCAL ] FAF: Loaded 41479 existing records from primary storage. [2025-10-22T18:41:55.671980] [INFO ] [MAIN ] FAF: Loaded 41479 existing records. [2025-10-22T18:41:55.801639] [DEBUG] [LOCAL ] EXPD: Loaded 47765 existing records from primary storage. [2025-10-22T18:41:55.802763] [DEBUG] [LOCAL ] EXR: Loaded 45544 existing records from primary storage. [2025-10-22T18:41:55.823377] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-22T18:41:55.823612] [INFO ] [MAIN ] EXR: Loaded 45544 existing records. [2025-10-22T18:41:55.822684] [INFO ] [MAIN ] EXPD: Loaded 47765 existing records. [2025-10-22T18:41:55.861224] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-22T18:41:56.083304] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:41:56.225962] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-22T18:41:56.234543] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-22T18:41:56.276573] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-22T18:41:56.306124] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-22T18:41:56.505463] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:41:56.509010] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:41:56.541860] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-22T18:41:56.502819] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:41:56.542478] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-22T18:41:56.542274] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-22T18:41:56.542673] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-22T18:41:56.542351] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-22T18:41:56.542855] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-22T18:41:56.558470] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-22T18:41:56.563748] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-22T18:41:56.569064] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-22T18:41:56.574667] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-22T18:41:56.574613] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-22T18:41:56.574545] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-22T18:41:57.839000] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:41:57.883989] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:41:57.921830] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-22T18:41:57.922205] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-22T18:41:57.970125] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:41:58.000584] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-22T18:41:58.029816] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:41:58.030112] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-22T18:41:59.401397] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T18:41:59.409082] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-22T18:41:59.675519] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T18:41:59.685593] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-22T18:41:59.713056] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T18:41:59.724164] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-22T18:42:00.462951] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-10-22T18:42:00.474054] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-22T18:42:01.205121] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T18:42:01.212037] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-22T18:42:01.751166] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-22T18:42:01.760213] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-22T18:42:01.803988] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-22T18:42:01.812973] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-22T18:42:03.201934] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T18:42:03.211242] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-22T18:42:03.337580] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.86 seconds). [2025-10-22T18:42:03.347597] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-22T18:42:03.404128] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T18:42:03.414554] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-22T18:42:04.147479] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-22T18:42:04.157216] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-22T18:42:04.841080] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T18:42:04.850264] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-22T18:42:05.220053] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T18:42:05.230372] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-22T18:42:05.691422] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-22T18:42:05.717728] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-22T18:42:05.784513] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T18:42:06.353945] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T18:42:06.517674] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-22T18:42:06.840804] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T18:42:07.317677] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-22T18:42:08.047329] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T18:42:08.117613] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-22T18:42:08.309943] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-22T18:42:08.609162] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T18:42:08.917720] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-22T18:42:09.717714] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-22T18:42:09.836187] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T18:42:10.517694] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-22T18:42:11.317681] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-22T18:42:11.425231] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T18:42:11.589951] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-22T18:42:11.972328] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T18:42:12.117711] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-22T18:42:12.583783] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T18:42:12.917728] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-22T18:42:13.121069] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T18:42:13.717695] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-22T18:42:14.517729] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-22T18:42:15.317898] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-22T18:42:15.393497] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-22T18:42:15.438501] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T18:42:16.117694] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-22T18:42:16.294624] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T18:42:16.300982] [INFO ] [REMOTE ] FAF: Full fetch complete (58302 records). [2025-10-22T18:42:16.301065] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-22T18:42:16.678033] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-22T18:42:16.678114] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-22T18:42:16.678873] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-22T18:42:16.678944] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-22T18:42:16.680070] [DEBUG] [LOCAL ] FAF: Trimmed 58302 records to 41432 (keeping 200 days of data) [2025-10-22T18:42:16.917687] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-22T18:42:16.933036] [DEBUG] [LOCAL ] FAF: Primary data saved (41432 records). [2025-10-22T18:42:16.933269] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-22T18:42:16.933475] [INFO ] [MAIN ] Update Progress: 801/2367 symbols completed. FAF took 22.0s. Estimated remaining: 3h 19m 49s. Rate: 7.8 symbols/min [2025-10-22T18:42:17.103241] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:42:17.134884] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T18:42:17.184168] [DEBUG] [LOCAL ] FBIN: Loaded 50399 existing records from primary storage. [2025-10-22T18:42:17.184485] [INFO ] [MAIN ] FBIN: Loaded 50399 existing records. [2025-10-22T18:42:17.362769] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:42:17.363009] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-22T18:42:17.363065] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-22T18:42:17.363271] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-22T18:42:17.363334] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-22T18:42:17.713495] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:42:17.726128] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-22T18:42:17.743742] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:42:18.517706] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-22T18:42:19.317717] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-22T18:42:19.561812] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-22T18:42:19.769792] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-22T18:42:20.117684] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-22T18:42:20.315822] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T18:42:20.489228] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-22T18:42:20.917698] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-22T18:42:21.722424] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-22T18:42:21.728540] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T18:42:22.517676] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-22T18:42:22.727130] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T18:42:22.734914] [INFO ] [REMOTE ] EXPD: Full fetch complete (69479 records). [2025-10-22T18:42:22.735031] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-22T18:42:23.115146] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-22T18:42:23.115228] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-22T18:42:23.116055] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-22T18:42:23.116118] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-22T18:42:23.117380] [DEBUG] [LOCAL ] EXPD: Trimmed 69479 records to 47729 (keeping 200 days of data) [2025-10-22T18:42:23.323892] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-22T18:42:23.402836] [DEBUG] [LOCAL ] EXPD: Primary data saved (47729 records). [2025-10-22T18:42:23.402949] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-22T18:42:23.403038] [INFO ] [MAIN ] Update Progress: 802/2367 symbols completed. EXPD took 28.5s. Estimated remaining: 3h 19m 39s. Rate: 7.8 symbols/min [2025-10-22T18:42:23.567097] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:42:23.593084] [DEBUG] [LOCAL ] FBK: Loaded 27486 existing records from primary storage. [2025-10-22T18:42:23.593338] [INFO ] [MAIN ] FBK: Loaded 27486 existing records. [2025-10-22T18:42:23.777088] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:42:23.777319] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-22T18:42:23.777368] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-22T18:42:23.777534] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-22T18:42:23.777574] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-22T18:42:24.160508] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:42:24.161221] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-22T18:42:24.203407] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T18:42:24.289161] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-22T18:42:24.733036] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T18:42:24.917704] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-22T18:42:25.343123] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T18:42:25.717710] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-22T18:42:26.517681] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-22T18:42:26.724361] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T18:42:27.317692] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-22T18:42:27.375719] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-22T18:42:28.123070] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-22T18:42:28.143557] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-22T18:42:28.151604] [INFO ] [REMOTE ] EXR: Full fetch complete (66241 records). [2025-10-22T18:42:28.151747] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-22T18:42:28.322716] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T18:42:28.581296] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-22T18:42:28.581380] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-22T18:42:28.582184] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-22T18:42:28.582249] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-22T18:42:28.583549] [DEBUG] [LOCAL ] EXR: Trimmed 66241 records to 45503 (keeping 200 days of data) [2025-10-22T18:42:28.855972] [DEBUG] [LOCAL ] EXR: Primary data saved (45503 records). [2025-10-22T18:42:28.856103] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-22T18:42:28.856184] [INFO ] [MAIN ] Update Progress: 803/2367 symbols completed. EXR took 34.0s. Estimated remaining: 3h 19m 27s. Rate: 7.8 symbols/min [2025-10-22T18:42:28.918699] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-22T18:42:29.023198] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:42:29.062825] [DEBUG] [LOCAL ] FBP: Loaded 45626 existing records from primary storage. [2025-10-22T18:42:29.063119] [INFO ] [MAIN ] FBP: Loaded 45626 existing records. [2025-10-22T18:42:29.236984] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:42:29.248033] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-22T18:42:29.248167] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-22T18:42:29.249218] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T18:42:29.253778] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-22T18:42:29.254152] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-22T18:42:29.591598] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:42:29.717616] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-22T18:42:29.942207] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T18:42:29.950967] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-22T18:42:29.951126] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-22T18:42:30.360462] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-22T18:42:30.360553] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-22T18:42:30.361492] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-22T18:42:30.361563] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-22T18:42:30.363061] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-22T18:42:30.547613] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-22T18:42:30.705090] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-22T18:42:30.705241] [INFO ] [MAIN ] F: Full history saved. [2025-10-22T18:42:30.705321] [INFO ] [MAIN ] Update Progress: 804/2367 symbols completed. F took 35.8s. Estimated remaining: 3h 19m 8s. Rate: 7.8 symbols/min [2025-10-22T18:42:30.880132] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:42:30.880296] [DEBUG] [LOCAL ] FBRT: No existing data file found in primary storage. [2025-10-22T18:42:30.880335] [WARN ] [MAIN ] FBRT: No existing data found, performing full refresh instead. [2025-10-22T18:42:30.880443] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-22T18:42:30.880485] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-22T18:42:30.880527] [DEBUG] [LOCAL ] FBRT: No primary data file found to delete. [2025-10-22T18:42:30.880560] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-22T18:42:31.242835] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:42:31.317670] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-22T18:42:31.351622] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T18:42:32.117789] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-22T18:42:32.478203] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-22T18:42:32.682906] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T18:42:32.917746] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-22T18:42:33.001740] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-22T18:42:33.717708] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-22T18:42:34.518609] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-22T18:42:34.518527] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T18:42:35.266151] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T18:42:35.317711] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-22T18:42:35.865140] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T18:42:36.117695] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-22T18:42:36.396478] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T18:42:36.917749] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-22T18:42:37.717692] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-22T18:42:37.821802] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T18:42:37.869768] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T18:42:38.517701] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-22T18:42:39.002180] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T18:42:39.317728] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-22T18:42:40.117733] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-22T18:42:40.190973] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T18:42:40.805123] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T18:42:40.917727] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-22T18:42:41.683935] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T18:42:41.717609] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-22T18:42:42.517688] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-22T18:42:42.744993] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T18:42:43.322791] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-22T18:42:43.335283] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T18:42:44.117618] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-22T18:42:44.159021] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T18:42:44.917723] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-22T18:42:45.006550] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T18:42:45.456192] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-22T18:42:45.717751] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-22T18:42:46.517678] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-22T18:42:46.563561] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T18:42:47.317623] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-22T18:42:47.419826] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T18:42:47.427332] [INFO ] [REMOTE ] FBIN: Full fetch complete (72655 records). [2025-10-22T18:42:47.427450] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-22T18:42:47.428310] [FATAL] [VALIDATOR ] FBIN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:42:47.428400] [FATAL] [MAIN ] FBIN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:42:47.428443] [WARN ] [MAIN ] FBIN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:42:47.428483] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-22T18:42:47.428540] [DEBUG] [LOCAL ] FBIN: No primary data file found to delete. [2025-10-22T18:42:47.428575] [INFO ] [LOCAL ] FBIN: Starting deletion of derivative data. [2025-10-22T18:42:47.428748] [DEBUG] [LOCAL ] FBIN: Deleted derivative data file. [2025-10-22T18:42:47.428839] [INFO ] [MAIN ] Update Progress: 805/2367 symbols completed. FBIN took 30.5s. Estimated remaining: 3h 19m 18s. Rate: 7.8 symbols/min [2025-10-22T18:42:47.597341] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:42:47.612884] [DEBUG] [LOCAL ] FC: Loaded 14475 existing records from primary storage. [2025-10-22T18:42:47.613116] [INFO ] [MAIN ] FC: Loaded 14475 existing records. [2025-10-22T18:42:47.794215] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:42:47.794505] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-22T18:42:47.794745] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-22T18:42:47.794928] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-22T18:42:47.794971] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-22T18:42:48.102331] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T18:42:48.124356] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-22T18:42:48.189421] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:42:48.579789] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T18:42:48.917707] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-22T18:42:49.574037] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T18:42:49.717628] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-22T18:42:50.309822] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T18:42:50.517700] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-22T18:42:51.053597] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T18:42:51.317626] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-22T18:42:51.532086] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T18:42:52.117722] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-22T18:42:52.618116] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T18:42:52.917726] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-22T18:42:53.264121] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T18:42:53.717716] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-22T18:42:54.314531] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T18:42:54.320381] [INFO ] [REMOTE ] FBK: Full fetch complete (35562 records). [2025-10-22T18:42:54.320507] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-22T18:42:54.522799] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-22T18:42:54.707185] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-22T18:42:54.707256] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-22T18:42:54.707860] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-22T18:42:54.707922] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-22T18:42:54.708726] [DEBUG] [LOCAL ] FBK: Trimmed 35562 records to 27466 (keeping 200 days of data) [2025-10-22T18:42:54.869474] [DEBUG] [LOCAL ] FBK: Primary data saved (27466 records). [2025-10-22T18:42:54.869594] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-22T18:42:54.869690] [INFO ] [MAIN ] Update Progress: 806/2367 symbols completed. FBK took 31.5s. Estimated remaining: 3h 19m 10s. Rate: 7.8 symbols/min [2025-10-22T18:42:55.036810] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:42:55.073255] [DEBUG] [LOCAL ] FCF: Loaded 39218 existing records from primary storage. [2025-10-22T18:42:55.073534] [INFO ] [MAIN ] FCF: Loaded 39218 existing records. [2025-10-22T18:42:55.253371] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:42:55.253599] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-22T18:42:55.253673] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-22T18:42:55.253866] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-22T18:42:55.253904] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-22T18:42:55.326753] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-22T18:42:55.560245] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-22T18:42:55.681664] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:42:55.686633] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T18:42:56.117694] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-22T18:42:56.917712] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-22T18:42:57.021477] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T18:42:57.028411] [INFO ] [REMOTE ] FBRT: Full fetch complete (49526 records). [2025-10-22T18:42:57.028557] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-22T18:42:57.176997] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-22T18:42:57.412940] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-22T18:42:57.413018] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-22T18:42:57.413687] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-22T18:42:57.413750] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-22T18:42:57.414835] [DEBUG] [LOCAL ] FBRT: Trimmed 49526 records to 35216 (keeping 200 days of data) [2025-10-22T18:42:57.626674] [DEBUG] [LOCAL ] FBRT: Primary data saved (35216 records). [2025-10-22T18:42:57.626821] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-22T18:42:57.626911] [INFO ] [MAIN ] Update Progress: 807/2367 symbols completed. FBRT took 26.9s. Estimated remaining: 3h 18m 53s. Rate: 7.8 symbols/min [2025-10-22T18:42:57.722776] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-22T18:42:57.803597] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:42:57.829039] [DEBUG] [LOCAL ] FCN: Loaded 25874 existing records from primary storage. [2025-10-22T18:42:57.829280] [INFO ] [MAIN ] FCN: Loaded 25874 existing records. [2025-10-22T18:42:58.002391] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:42:58.002608] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-22T18:42:58.002682] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-22T18:42:58.002870] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-22T18:42:58.002909] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-22T18:42:58.369177] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:42:58.392435] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:42:58.517684] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-22T18:42:59.317722] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-22T18:42:59.477390] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T18:42:59.694687] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T18:43:00.117702] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-22T18:43:00.696186] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T18:43:00.917687] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-22T18:43:01.717694] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-22T18:43:01.853282] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T18:43:01.860965] [INFO ] [REMOTE ] FBP: Full fetch complete (66781 records). [2025-10-22T18:43:01.861068] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-22T18:43:02.284571] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-22T18:43:02.285966] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T18:43:02.285392] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-22T18:43:02.292133] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-22T18:43:02.292214] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-22T18:43:02.293427] [DEBUG] [LOCAL ] FBP: Trimmed 66781 records to 45588 (keeping 200 days of data) [2025-10-22T18:43:02.519676] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-22T18:43:02.565460] [DEBUG] [LOCAL ] FBP: Primary data saved (45588 records). [2025-10-22T18:43:02.565571] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-22T18:43:02.565676] [INFO ] [MAIN ] Update Progress: 808/2367 symbols completed. FBP took 33.7s. Estimated remaining: 3h 18m 40s. Rate: 7.8 symbols/min [2025-10-22T18:43:02.728343] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:43:02.762951] [DEBUG] [LOCAL ] FCPT: Loaded 37077 existing records from primary storage. [2025-10-22T18:43:02.763217] [INFO ] [MAIN ] FCPT: Loaded 37077 existing records. [2025-10-22T18:43:02.940303] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:43:02.940524] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-22T18:43:02.940581] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-22T18:43:02.940831] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-22T18:43:02.940888] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-22T18:43:03.299937] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:43:03.317623] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-22T18:43:03.393861] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T18:43:03.805354] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-22T18:43:04.117687] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-22T18:43:04.396966] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T18:43:04.919996] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-22T18:43:04.921960] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T18:43:05.717720] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-22T18:43:06.305429] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T18:43:06.517678] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-22T18:43:07.314377] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T18:43:07.320927] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-22T18:43:07.425135] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-22T18:43:08.117707] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-22T18:43:08.201918] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T18:43:08.917750] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-22T18:43:09.717707] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-22T18:43:09.838454] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T18:43:10.219526] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T18:43:10.396896] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-22T18:43:10.517626] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-22T18:43:11.317757] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-22T18:43:11.416947] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-22T18:43:12.117694] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-22T18:43:12.427099] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T18:43:12.917733] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-22T18:43:13.531695] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-22T18:43:13.717680] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-22T18:43:14.517708] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-22T18:43:15.112479] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-22T18:43:15.317719] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-22T18:43:16.123437] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-22T18:43:16.125198] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-22T18:43:16.150675] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:43:16.922865] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-22T18:43:16.938542] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T18:43:17.137021] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T18:43:17.139535] [INFO ] [REMOTE ] FC: Full fetch complete (21790 records). [2025-10-22T18:43:17.139616] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-22T18:43:17.140104] [FATAL] [VALIDATOR ] FC: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:43:17.140186] [FATAL] [MAIN ] FC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:43:17.140229] [WARN ] [MAIN ] FC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:43:17.140341] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-22T18:43:17.140417] [DEBUG] [LOCAL ] FC: No primary data file found to delete. [2025-10-22T18:43:17.140455] [INFO ] [LOCAL ] FC: Starting deletion of derivative data. [2025-10-22T18:43:17.140604] [DEBUG] [LOCAL ] FC: Deleted derivative data file. [2025-10-22T18:43:17.140724] [INFO ] [MAIN ] Update Progress: 809/2367 symbols completed. FC took 29.7s. Estimated remaining: 3h 18m 46s. Rate: 7.8 symbols/min [2025-10-22T18:43:17.307381] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:43:17.307615] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-22T18:43:17.307719] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-22T18:43:17.307852] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-22T18:43:17.307901] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-22T18:43:17.307950] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-22T18:43:17.307987] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-22T18:43:17.655874] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:43:17.717621] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-22T18:43:18.349942] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-22T18:43:18.517743] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-22T18:43:18.712594] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T18:43:19.317726] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-22T18:43:19.736946] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T18:43:20.117684] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-22T18:43:20.823875] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T18:43:20.917712] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-22T18:43:21.588373] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T18:43:21.717700] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-22T18:43:22.029597] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T18:43:22.034550] [INFO ] [REMOTE ] FCN: Full fetch complete (36298 records). [2025-10-22T18:43:22.034681] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-22T18:43:22.415731] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-22T18:43:22.415809] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-22T18:43:22.416599] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-22T18:43:22.416637] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-22T18:43:22.417393] [DEBUG] [LOCAL ] FCN: Trimmed 36298 records to 25886 (keeping 200 days of data) [2025-10-22T18:43:22.520577] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-22T18:43:22.570767] [DEBUG] [LOCAL ] FCN: Primary data saved (25886 records). [2025-10-22T18:43:22.570899] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-22T18:43:22.570978] [INFO ] [MAIN ] Update Progress: 810/2367 symbols completed. FCN took 24.9s. Estimated remaining: 3h 18m 34s. Rate: 7.8 symbols/min [2025-10-22T18:43:22.735855] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:43:22.750126] [DEBUG] [LOCAL ] FCT: Loaded 14677 existing records from primary storage. [2025-10-22T18:43:22.750299] [INFO ] [MAIN ] FCT: Loaded 14677 existing records. [2025-10-22T18:43:22.921491] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:43:22.921734] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-22T18:43:22.921786] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-22T18:43:22.922067] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-22T18:43:22.922123] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-22T18:43:23.275217] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:43:23.289274] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T18:43:23.317615] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-22T18:43:24.117756] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-22T18:43:24.335415] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T18:43:24.668008] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T18:43:24.917731] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-22T18:43:25.366469] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T18:43:25.629457] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T18:43:25.717672] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-22T18:43:26.517729] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-22T18:43:26.865230] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-22T18:43:27.125117] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T18:43:27.317701] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-22T18:43:28.117681] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-22T18:43:28.832957] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T18:43:28.917615] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-22T18:43:29.513429] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T18:43:29.717681] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-22T18:43:30.384928] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-22T18:43:30.384528] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T18:43:30.517689] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-22T18:43:31.317715] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-22T18:43:32.117678] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-22T18:43:32.226632] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-22T18:43:32.231571] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T18:43:32.238002] [INFO ] [REMOTE ] FCF: Full fetch complete (57913 records). [2025-10-22T18:43:32.238104] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-22T18:43:32.238811] [FATAL] [VALIDATOR ] FCF: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T18:43:32.238899] [FATAL] [MAIN ] FCF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:43:32.238943] [WARN ] [MAIN ] FCF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:43:32.239009] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-22T18:43:32.239075] [DEBUG] [LOCAL ] FCF: No primary data file found to delete. [2025-10-22T18:43:32.239110] [INFO ] [LOCAL ] FCF: Starting deletion of derivative data. [2025-10-22T18:43:32.239244] [DEBUG] [LOCAL ] FCF: Deleted derivative data file. [2025-10-22T18:43:32.239836] [INFO ] [MAIN ] Update Progress: 811/2367 symbols completed. FCF took 37.4s. Estimated remaining: 3h 18m 30s. Rate: 7.8 symbols/min [2025-10-22T18:43:32.404072] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:43:32.454360] [DEBUG] [LOCAL ] FCX: Loaded 53701 existing records from primary storage. [2025-10-22T18:43:32.454709] [INFO ] [MAIN ] FCX: Loaded 53701 existing records. [2025-10-22T18:43:32.626617] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:43:32.626846] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-22T18:43:32.626892] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-22T18:43:32.627915] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-22T18:43:32.627973] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-22T18:43:32.698057] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-22T18:43:32.922797] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-22T18:43:32.984295] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:43:33.289330] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-22T18:43:33.717707] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-22T18:43:34.517688] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-22T18:43:34.740268] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-22T18:43:35.317718] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-22T18:43:36.117677] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-22T18:43:36.647570] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-22T18:43:36.680056] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-22T18:43:36.917711] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-22T18:43:36.990079] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T18:43:36.996490] [INFO ] [REMOTE ] FCPT: Full fetch complete (53864 records). [2025-10-22T18:43:36.996581] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-22T18:43:37.445253] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-22T18:43:37.445331] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-22T18:43:37.446026] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-22T18:43:37.446087] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-22T18:43:37.447146] [DEBUG] [LOCAL ] FCPT: Trimmed 53864 records to 36980 (keeping 200 days of data) [2025-10-22T18:43:37.671265] [DEBUG] [LOCAL ] FCPT: Primary data saved (36980 records). [2025-10-22T18:43:37.671409] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-22T18:43:37.671738] [INFO ] [MAIN ] Update Progress: 812/2367 symbols completed. FCPT took 35.1s. Estimated remaining: 3h 18m 18s. Rate: 7.8 symbols/min [2025-10-22T18:43:37.734535] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-22T18:43:37.844167] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:43:37.870101] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T18:43:37.883202] [DEBUG] [LOCAL ] FDP: Loaded 29749 existing records from primary storage. [2025-10-22T18:43:37.883458] [INFO ] [MAIN ] FDP: Loaded 29749 existing records. [2025-10-22T18:43:38.059071] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:43:38.059715] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-22T18:43:38.059812] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-22T18:43:38.060088] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-22T18:43:38.060164] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-22T18:43:38.241880] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-22T18:43:38.458217] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:43:38.517613] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-22T18:43:39.317746] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-22T18:43:40.117886] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-22T18:43:40.301578] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T18:43:40.923472] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-22T18:43:40.937496] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T18:43:41.094419] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-22T18:43:41.717881] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-22T18:43:41.942625] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-22T18:43:42.517736] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-22T18:43:42.587615] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T18:43:43.317708] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-22T18:43:43.905012] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-22T18:43:44.117622] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-22T18:43:44.273929] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-22T18:43:44.917731] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-22T18:43:45.506303] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T18:43:45.717741] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-22T18:43:46.139455] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-22T18:43:46.142590] [INFO ] [REMOTE ] FCT: Full fetch complete (21289 records). [2025-10-22T18:43:46.142716] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-22T18:43:46.512290] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-22T18:43:46.512392] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-22T18:43:46.512870] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-22T18:43:46.512950] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-22T18:43:46.513484] [DEBUG] [LOCAL ] FCT: Trimmed 21289 records to 14722 (keeping 200 days of data) [2025-10-22T18:43:46.549385] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-22T18:43:46.600229] [DEBUG] [LOCAL ] FCT: Primary data saved (14722 records). [2025-10-22T18:43:46.600335] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-22T18:43:46.600408] [INFO ] [MAIN ] Update Progress: 813/2367 symbols completed. FCT took 24.0s. Estimated remaining: 3h 18m 13s. Rate: 7.8 symbols/min [2025-10-22T18:43:46.765364] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:43:46.791960] [DEBUG] [LOCAL ] FDS: Loaded 28015 existing records from primary storage. [2025-10-22T18:43:46.792241] [INFO ] [MAIN ] FDS: Loaded 28015 existing records. [2025-10-22T18:43:46.963452] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:43:46.963701] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-22T18:43:46.963821] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-22T18:43:46.964026] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-22T18:43:46.964081] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-22T18:43:47.309874] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:43:47.317612] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-22T18:43:47.919101] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-22T18:43:48.042180] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-22T18:43:48.117620] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-22T18:43:48.742867] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T18:43:48.917693] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-22T18:43:49.717624] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-22T18:43:50.007477] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T18:43:50.160356] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-22T18:43:50.287228] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-22T18:43:50.517692] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-22T18:43:51.317736] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-22T18:43:51.885419] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-22T18:43:52.117726] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-22T18:43:52.632822] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T18:43:52.917716] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-22T18:43:53.381938] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T18:43:53.717704] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-22T18:43:54.342480] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T18:43:54.517624] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-22T18:43:54.860182] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-22T18:43:55.317697] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-22T18:43:55.617341] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T18:43:55.663075] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-22T18:43:56.117696] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-22T18:43:56.917705] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-22T18:43:57.266846] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-22T18:43:57.426331] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T18:43:57.717682] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-22T18:43:58.517733] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-22T18:43:59.032088] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T18:43:59.036757] [INFO ] [REMOTE ] FDP: Full fetch complete (42930 records). [2025-10-22T18:43:59.036846] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-22T18:43:59.322828] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-22T18:43:59.436748] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-22T18:43:59.436834] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-22T18:43:59.437443] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-22T18:43:59.437516] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-22T18:43:59.438740] [DEBUG] [LOCAL ] FDP: Trimmed 42930 records to 29707 (keeping 200 days of data) [2025-10-22T18:43:59.628237] [DEBUG] [LOCAL ] FDP: Primary data saved (29707 records). [2025-10-22T18:43:59.628363] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-22T18:43:59.628442] [INFO ] [MAIN ] Update Progress: 814/2367 symbols completed. FDP took 22.0s. Estimated remaining: 3h 18m 16s. Rate: 7.8 symbols/min [2025-10-22T18:43:59.800417] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:43:59.825487] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-22T18:43:59.880128] [DEBUG] [LOCAL ] FDX: Loaded 51271 existing records from primary storage. [2025-10-22T18:43:59.880460] [INFO ] [MAIN ] FDX: Loaded 51271 existing records. [2025-10-22T18:44:00.058713] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:44:00.058931] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-22T18:44:00.058978] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-22T18:44:00.059181] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-22T18:44:00.059236] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-22T18:44:00.123737] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-22T18:44:00.423269] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:00.917703] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-22T18:44:01.574115] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T18:44:01.615342] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-22T18:44:01.616023] [INFO ] [REMOTE ] FCRX: Full fetch complete (1642 records). [2025-10-22T18:44:01.616089] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-22T18:44:01.722747] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-22T18:44:01.794518] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-22T18:44:01.794771] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:44:01.794904] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:44:01.794991] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-22T18:44:01.795109] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-22T18:44:01.795204] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-22T18:44:01.795341] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-22T18:44:01.795427] [INFO ] [MAIN ] Update Progress: 815/2367 symbols completed. FCRX took 44.7s. Estimated remaining: 3h 17m 57s. Rate: 7.8 symbols/min [2025-10-22T18:44:01.962829] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:01.995332] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-22T18:44:02.047214] [DEBUG] [LOCAL ] FE: Loaded 53434 existing records from primary storage. [2025-10-22T18:44:02.047526] [INFO ] [MAIN ] FE: Loaded 53434 existing records. [2025-10-22T18:44:02.222063] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:44:02.222282] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-22T18:44:02.222338] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-22T18:44:02.222530] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-22T18:44:02.222567] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-22T18:44:02.531811] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-22T18:44:02.573980] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:03.281244] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T18:44:03.317610] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-22T18:44:04.117694] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-22T18:44:04.440443] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T18:44:04.896786] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T18:44:04.917691] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-22T18:44:05.717696] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-22T18:44:05.926682] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T18:44:06.517622] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-22T18:44:06.761476] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T18:44:06.768186] [INFO ] [REMOTE ] FDS: Full fetch complete (39426 records). [2025-10-22T18:44:06.768279] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-22T18:44:07.134572] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-22T18:44:07.134688] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-22T18:44:07.135289] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-22T18:44:07.135330] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-22T18:44:07.136171] [DEBUG] [LOCAL ] FDS: Trimmed 39426 records to 28003 (keeping 200 days of data) [2025-10-22T18:44:07.305522] [DEBUG] [LOCAL ] FDS: Primary data saved (28003 records). [2025-10-22T18:44:07.305752] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-22T18:44:07.305837] [INFO ] [MAIN ] Update Progress: 816/2367 symbols completed. FDS took 20.7s. Estimated remaining: 3h 17m 46s. Rate: 7.8 symbols/min [2025-10-22T18:44:07.326592] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-22T18:44:07.479490] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:07.479687] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-22T18:44:07.479747] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-22T18:44:07.479978] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-22T18:44:07.480059] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-22T18:44:07.480196] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-22T18:44:07.480301] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-22T18:44:07.787001] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-22T18:44:07.878101] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:07.910990] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T18:44:08.117625] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-22T18:44:08.874280] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T18:44:08.917712] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-22T18:44:09.455161] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T18:44:09.717711] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-22T18:44:10.517698] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-22T18:44:10.866083] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T18:44:10.954149] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T18:44:11.317676] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-22T18:44:11.948130] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T18:44:12.118989] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-22T18:44:12.119076] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-22T18:44:12.917701] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-22T18:44:13.432377] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-22T18:44:13.717792] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-22T18:44:13.789376] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T18:44:14.517729] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-22T18:44:14.976272] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-22T18:44:15.317693] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-22T18:44:15.881338] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-22T18:44:15.937311] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-22T18:44:16.117628] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-22T18:44:16.917748] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-22T18:44:17.268505] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-22T18:44:17.722813] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-22T18:44:17.738578] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T18:44:18.071202] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-22T18:44:18.517606] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-22T18:44:19.317745] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-22T18:44:20.117716] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-22T18:44:20.507116] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T18:44:20.749060] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-22T18:44:20.917669] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-22T18:44:21.248119] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T18:44:21.458682] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-22T18:44:21.459831] [INFO ] [REMOTE ] FENG: Full fetch complete (2276 records). [2025-10-22T18:44:21.459916] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-22T18:44:21.670505] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T18:44:21.670744] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:44:21.670796] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:44:21.670843] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-22T18:44:21.670898] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-22T18:44:21.670931] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-22T18:44:21.670969] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-22T18:44:21.671027] [INFO ] [MAIN ] Update Progress: 817/2367 symbols completed. FENG took 14.4s. Estimated remaining: 3h 17m 51s. Rate: 7.8 symbols/min [2025-10-22T18:44:21.725636] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-22T18:44:21.861412] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:21.906633] [DEBUG] [LOCAL ] FERG: Loaded 48749 existing records from primary storage. [2025-10-22T18:44:21.906994] [INFO ] [MAIN ] FERG: Loaded 48749 existing records. [2025-10-22T18:44:22.083322] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:44:22.083573] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-22T18:44:22.083666] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-22T18:44:22.083972] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-22T18:44:22.084029] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-22T18:44:22.432729] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:22.517715] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-22T18:44:23.317678] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-22T18:44:23.611461] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T18:44:24.117744] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-22T18:44:24.848514] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-22T18:44:24.917691] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-22T18:44:25.418381] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-22T18:44:25.717674] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-22T18:44:26.183420] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-22T18:44:26.517730] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-22T18:44:27.321350] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-22T18:44:27.578681] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-22T18:44:27.588208] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-22T18:44:27.588418] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-22T18:44:28.008733] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-22T18:44:28.009048] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-22T18:44:28.011472] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-22T18:44:28.010345] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-22T18:44:28.022035] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-22T18:44:28.023896] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 53701 (keeping 200 days of data) [2025-10-22T18:44:28.117778] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-22T18:44:28.353565] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-22T18:44:28.388158] [DEBUG] [LOCAL ] FCX: Primary data saved (53701 records). [2025-10-22T18:44:28.388263] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-22T18:44:28.388826] [INFO ] [MAIN ] Update Progress: 818/2367 symbols completed. FCX took 56.1s. Estimated remaining: 3h 17m 41s. Rate: 7.8 symbols/min [2025-10-22T18:44:28.559292] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:28.574228] [DEBUG] [LOCAL ] FET: Loaded 12922 existing records from primary storage. [2025-10-22T18:44:28.574454] [INFO ] [MAIN ] FET: Loaded 12922 existing records. [2025-10-22T18:44:28.749636] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:44:28.749990] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-22T18:44:28.750086] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-22T18:44:28.750250] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-22T18:44:28.750303] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-22T18:44:28.910120] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T18:44:28.920433] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-22T18:44:29.131445] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:29.717704] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-22T18:44:29.915114] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T18:44:30.517727] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-22T18:44:30.768628] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-22T18:44:31.317746] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-22T18:44:31.405520] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T18:44:31.580398] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T18:44:32.117766] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-22T18:44:32.870252] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T18:44:32.917710] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-22T18:44:33.717748] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-22T18:44:34.034092] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-22T18:44:34.517628] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-22T18:44:34.560564] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T18:44:35.317675] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-22T18:44:35.584704] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T18:44:36.117691] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-22T18:44:36.515344] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T18:44:36.523372] [INFO ] [REMOTE ] FDX: Full fetch complete (74225 records). [2025-10-22T18:44:36.523485] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-22T18:44:36.912324] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-22T18:44:36.912439] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-22T18:44:36.913542] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-22T18:44:36.913606] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-22T18:44:36.915199] [DEBUG] [LOCAL ] FDX: Trimmed 74225 records to 51182 (keeping 200 days of data) [2025-10-22T18:44:36.928589] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-22T18:44:37.002374] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T18:44:37.040798] [INFO ] [REMOTE ] FE: Full fetch complete (77480 records). [2025-10-22T18:44:37.042863] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-22T18:44:37.582129] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-22T18:44:37.582949] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-22T18:44:37.584362] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-22T18:44:37.585614] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-22T18:44:37.603184] [DEBUG] [LOCAL ] FE: Trimmed 77480 records to 53433 (keeping 200 days of data) [2025-10-22T18:44:37.797490] [DEBUG] [LOCAL ] FDX: Primary data saved (51182 records). [2025-10-22T18:44:37.797860] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-22T18:44:37.798098] [INFO ] [MAIN ] Update Progress: 819/2367 symbols completed. FDX took 38.2s. Estimated remaining: 3h 17m 37s. Rate: 7.8 symbols/min [2025-10-22T18:44:38.075154] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T18:44:38.077490] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:38.091182] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-22T18:44:38.112136] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-22T18:44:38.148972] [DEBUG] [LOCAL ] FF: Loaded 23879 existing records from primary storage. [2025-10-22T18:44:38.157330] [INFO ] [MAIN ] FF: Loaded 23879 existing records. [2025-10-22T18:44:38.391439] [DEBUG] [LOCAL ] FE: Primary data saved (53433 records). [2025-10-22T18:44:38.411240] [INFO ] [MAIN ] FE: Full history saved. [2025-10-22T18:44:38.411368] [INFO ] [MAIN ] Update Progress: 820/2367 symbols completed. FE took 36.6s. Estimated remaining: 3h 17m 16s. Rate: 7.8 symbols/min [2025-10-22T18:44:38.411172] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:44:38.454328] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-22T18:44:38.474536] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-22T18:44:38.490705] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-22T18:44:38.501385] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-22T18:44:38.522878] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-22T18:44:38.684031] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:38.689764] [DEBUG] [LOCAL ] FFA: No existing data file found in primary storage. [2025-10-22T18:44:38.694970] [WARN ] [MAIN ] FFA: No existing data found, performing full refresh instead. [2025-10-22T18:44:38.706073] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-22T18:44:38.711261] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-22T18:44:38.736085] [DEBUG] [LOCAL ] FFA: No primary data file found to delete. [2025-10-22T18:44:38.771703] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-22T18:44:39.064011] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:39.125674] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-22T18:44:39.323063] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-22T18:44:39.327867] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:40.117694] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-22T18:44:40.188511] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-22T18:44:40.237603] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T18:44:40.917691] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-22T18:44:41.529189] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T18:44:41.717699] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-22T18:44:42.522715] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-22T18:44:42.528768] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T18:44:42.742303] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-22T18:44:43.172172] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T18:44:43.317705] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-22T18:44:43.892432] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-22T18:44:44.117732] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-22T18:44:44.721511] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T18:44:44.917789] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-22T18:44:45.688683] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-22T18:44:45.717613] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-22T18:44:46.308711] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-22T18:44:46.517681] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-22T18:44:47.317671] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-22T18:44:47.397111] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T18:44:47.970184] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-22T18:44:48.117706] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-22T18:44:48.724199] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T18:44:48.917705] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-22T18:44:49.717697] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-22T18:44:50.119153] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T18:44:50.517732] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-22T18:44:51.317699] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-22T18:44:51.365717] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T18:44:51.427073] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T18:44:52.117703] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-22T18:44:52.711388] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-22T18:44:52.917722] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-22T18:44:53.719904] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-22T18:44:53.725286] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T18:44:53.741115] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-22T18:44:54.517624] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-22T18:44:54.718479] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T18:44:55.317743] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-22T18:44:56.117710] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-22T18:44:56.269353] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T18:44:56.277371] [INFO ] [REMOTE ] FERG: Full fetch complete (71260 records). [2025-10-22T18:44:56.277492] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-22T18:44:56.442068] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-22T18:44:56.627441] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-22T18:44:56.698769] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-22T18:44:56.698884] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-22T18:44:56.699836] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-22T18:44:56.699902] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-22T18:44:56.701332] [DEBUG] [LOCAL ] FERG: Trimmed 71260 records to 48718 (keeping 200 days of data) [2025-10-22T18:44:56.920554] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-22T18:44:57.009246] [DEBUG] [LOCAL ] FERG: Primary data saved (48718 records). [2025-10-22T18:44:57.009383] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-22T18:44:57.009489] [INFO ] [MAIN ] Update Progress: 821/2367 symbols completed. FERG took 35.3s. Estimated remaining: 3h 17m 29s. Rate: 7.8 symbols/min [2025-10-22T18:44:57.173919] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:57.192616] [DEBUG] [LOCAL ] FFC: Loaded 16617 existing records from primary storage. [2025-10-22T18:44:57.192893] [INFO ] [MAIN ] FFC: Loaded 16617 existing records. [2025-10-22T18:44:57.370374] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:44:57.370625] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-22T18:44:57.370706] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-22T18:44:57.370875] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-22T18:44:57.370913] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-22T18:44:57.720758] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-22T18:44:57.724259] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:57.918271] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T18:44:57.921043] [INFO ] [REMOTE ] FET: Full fetch complete (18470 records). [2025-10-22T18:44:57.921121] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-22T18:44:58.286923] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-22T18:44:58.287000] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-22T18:44:58.287441] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-22T18:44:58.287482] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-22T18:44:58.288053] [DEBUG] [LOCAL ] FET: Trimmed 18470 records to 12875 (keeping 200 days of data) [2025-10-22T18:44:58.362105] [DEBUG] [LOCAL ] FET: Primary data saved (12875 records). [2025-10-22T18:44:58.362240] [INFO ] [MAIN ] FET: Full history saved. [2025-10-22T18:44:58.362348] [INFO ] [MAIN ] Update Progress: 822/2367 symbols completed. FET took 30.0s. Estimated remaining: 3h 17m 9s. Rate: 7.8 symbols/min [2025-10-22T18:44:58.531250] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-22T18:44:58.533844] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:58.534106] [DEBUG] [LOCAL ] FFWM: No existing data file found in primary storage. [2025-10-22T18:44:58.534752] [WARN ] [MAIN ] FFWM: No existing data found, performing full refresh instead. [2025-10-22T18:44:58.534868] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-22T18:44:58.534913] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-22T18:44:58.534956] [DEBUG] [LOCAL ] FFWM: No primary data file found to delete. [2025-10-22T18:44:58.534990] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-22T18:44:58.644497] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-22T18:44:58.667171] [INFO ] [REMOTE ] FFA: Full fetch complete (8682 records). [2025-10-22T18:44:58.686122] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-22T18:44:59.248139] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:44:59.322865] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-22T18:44:59.360620] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-22T18:44:59.360763] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-22T18:44:59.361196] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-22T18:44:59.361269] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-22T18:44:59.361859] [DEBUG] [LOCAL ] FFA: Trimmed 8682 records to 5586 (keeping 200 days of data) [2025-10-22T18:44:59.398299] [DEBUG] [LOCAL ] FFA: Primary data saved (5586 records). [2025-10-22T18:44:59.398446] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-22T18:44:59.398535] [INFO ] [MAIN ] Update Progress: 823/2367 symbols completed. FFA took 21.0s. Estimated remaining: 3h 16m 49s. Rate: 7.8 symbols/min [2025-10-22T18:44:59.580238] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:44:59.605343] [DEBUG] [LOCAL ] FG: Loaded 21549 existing records from primary storage. [2025-10-22T18:44:59.605693] [INFO ] [MAIN ] FG: Loaded 21549 existing records. [2025-10-22T18:44:59.790040] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:44:59.790345] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-22T18:44:59.790400] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-22T18:44:59.790622] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-22T18:44:59.790731] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-22T18:45:00.113118] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-22T18:45:00.118414] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-22T18:45:00.213741] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:45:00.430947] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T18:45:00.917740] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-22T18:45:01.717849] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-22T18:45:02.138186] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-22T18:45:02.517689] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-22T18:45:02.608032] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T18:45:02.830624] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T18:45:03.317716] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-22T18:45:03.569220] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T18:45:04.117699] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-22T18:45:04.593106] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T18:45:04.917696] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-22T18:45:05.128812] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-22T18:45:05.717738] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-22T18:45:05.742604] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T18:45:06.517776] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-22T18:45:07.177001] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T18:45:07.317681] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-22T18:45:07.703591] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-22T18:45:08.117730] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-22T18:45:08.172235] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T18:45:08.917678] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-22T18:45:09.718858] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-22T18:45:09.720827] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T18:45:10.402009] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T18:45:10.517744] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-22T18:45:10.698858] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T18:45:11.317678] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-22T18:45:11.678149] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T18:45:12.117714] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-22T18:45:12.370676] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-22T18:45:12.894032] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-22T18:45:12.917674] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-22T18:45:13.717735] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-22T18:45:14.057735] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T18:45:14.517740] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-22T18:45:14.724355] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T18:45:15.317737] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-22T18:45:15.586180] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T18:45:16.117731] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-22T18:45:16.917468] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T18:45:16.926052] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-22T18:45:16.989525] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-22T18:45:17.717716] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-22T18:45:17.815593] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-22T18:45:17.821493] [INFO ] [REMOTE ] FF: Full fetch complete (36517 records). [2025-10-22T18:45:17.821637] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-22T18:45:18.208036] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-22T18:45:18.208163] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-22T18:45:18.209046] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-22T18:45:18.209127] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-22T18:45:18.210587] [DEBUG] [LOCAL ] FF: Trimmed 36517 records to 23707 (keeping 200 days of data) [2025-10-22T18:45:18.361727] [DEBUG] [LOCAL ] FF: Primary data saved (23707 records). [2025-10-22T18:45:18.361855] [INFO ] [MAIN ] FF: Full history saved. [2025-10-22T18:45:18.361936] [INFO ] [MAIN ] Update Progress: 824/2367 symbols completed. FF took 40.6s. Estimated remaining: 3h 17m 3s. Rate: 7.8 symbols/min [2025-10-22T18:45:18.529277] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-22T18:45:18.532821] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:45:18.538559] [DEBUG] [LOCAL ] FGN: Loaded 3610 existing records from primary storage. [2025-10-22T18:45:18.538762] [INFO ] [MAIN ] FGN: Loaded 3610 existing records. [2025-10-22T18:45:18.760113] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:45:18.760321] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-22T18:45:18.760370] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-22T18:45:18.760532] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-22T18:45:18.760589] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-22T18:45:19.135866] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:45:19.204326] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T18:45:19.317691] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-22T18:45:19.502826] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T18:45:19.929207] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-22T18:45:20.117694] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-22T18:45:20.917733] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-22T18:45:21.133455] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-22T18:45:21.717672] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-22T18:45:22.177521] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T18:45:22.517612] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-22T18:45:22.831966] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T18:45:23.317697] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-22T18:45:23.985757] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T18:45:24.046667] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-22T18:45:24.117749] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-22T18:45:24.603930] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-22T18:45:24.917786] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-22T18:45:25.545046] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T18:45:25.717746] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-22T18:45:26.517753] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-22T18:45:27.042259] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T18:45:27.046521] [INFO ] [REMOTE ] FG: Full fetch complete (28977 records). [2025-10-22T18:45:27.046705] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-22T18:45:27.174503] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-22T18:45:27.323010] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-22T18:45:27.462105] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-22T18:45:27.462200] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-22T18:45:27.462761] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-22T18:45:27.462838] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-22T18:45:27.463785] [DEBUG] [LOCAL ] FG: Trimmed 28977 records to 21366 (keeping 200 days of data) [2025-10-22T18:45:27.591254] [DEBUG] [LOCAL ] FG: Primary data saved (21366 records). [2025-10-22T18:45:27.591402] [INFO ] [MAIN ] FG: Full history saved. [2025-10-22T18:45:27.591489] [INFO ] [MAIN ] Update Progress: 825/2367 symbols completed. FG took 28.2s. Estimated remaining: 3h 16m 58s. Rate: 7.8 symbols/min [2025-10-22T18:45:27.760402] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:45:27.760571] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-22T18:45:27.760610] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-22T18:45:27.760745] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-22T18:45:27.760789] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-22T18:45:27.760830] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-22T18:45:27.760862] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-22T18:45:28.101502] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:45:28.117615] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-10-22T18:45:28.841943] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T18:45:28.917769] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-22T18:45:29.026969] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-22T18:45:29.717625] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-22T18:45:30.185230] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-22T18:45:30.188232] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-22T18:45:30.517753] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-22T18:45:31.154382] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T18:45:31.317726] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-22T18:45:32.117775] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-10-22T18:45:32.691193] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-22T18:45:32.922876] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-22T18:45:32.931511] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T18:45:32.938466] [INFO ] [REMOTE ] FFWM: Full fetch complete (51951 records). [2025-10-22T18:45:32.938613] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-22T18:45:33.316621] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-22T18:45:33.316736] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-22T18:45:33.317461] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-22T18:45:33.317506] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-22T18:45:33.318677] [DEBUG] [LOCAL ] FFWM: Trimmed 51951 records to 35671 (keeping 200 days of data) [2025-10-22T18:45:33.511769] [DEBUG] [LOCAL ] FFWM: Primary data saved (35671 records). [2025-10-22T18:45:33.511900] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-22T18:45:33.511970] [INFO ] [MAIN ] Update Progress: 826/2367 symbols completed. FFWM took 35.1s. Estimated remaining: 3h 16m 47s. Rate: 7.8 symbols/min [2025-10-22T18:45:33.681292] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:45:33.716027] [DEBUG] [LOCAL ] FHI: Loaded 39612 existing records from primary storage. [2025-10-22T18:45:33.716327] [INFO ] [MAIN ] FHI: Loaded 39612 existing records. [2025-10-22T18:45:33.727389] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-22T18:45:33.893826] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:45:33.894048] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-22T18:45:33.894100] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-22T18:45:33.894343] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-22T18:45:33.894398] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-22T18:45:34.202839] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T18:45:34.265321] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:45:34.280867] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T18:45:34.517618] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-22T18:45:35.317730] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-22T18:45:36.117623] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-22T18:45:36.391117] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T18:45:36.394093] [INFO ] [REMOTE ] FFC: Full fetch complete (24518 records). [2025-10-22T18:45:36.394165] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-22T18:45:36.537167] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-22T18:45:36.717621] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T18:45:36.799678] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-22T18:45:36.799751] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-22T18:45:36.800218] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-22T18:45:36.800257] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-22T18:45:36.800857] [DEBUG] [LOCAL ] FFC: Trimmed 24518 records to 16583 (keeping 200 days of data) [2025-10-22T18:45:36.897267] [DEBUG] [LOCAL ] FFC: Primary data saved (16583 records). [2025-10-22T18:45:36.897388] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-22T18:45:36.897465] [INFO ] [MAIN ] Update Progress: 827/2367 symbols completed. FFC took 39.9s. Estimated remaining: 3h 16m 32s. Rate: 7.8 symbols/min [2025-10-22T18:45:36.926295] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-22T18:45:37.065379] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:45:37.114607] [DEBUG] [LOCAL ] FHN: Loaded 53399 existing records from primary storage. [2025-10-22T18:45:37.114912] [INFO ] [MAIN ] FHN: Loaded 53399 existing records. [2025-10-22T18:45:37.286611] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:45:37.286812] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-22T18:45:37.286877] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-22T18:45:37.287140] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-22T18:45:37.287211] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-22T18:45:37.632133] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:45:37.717617] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-22T18:45:38.435680] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T18:45:38.517615] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-22T18:45:39.317693] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-10-22T18:45:39.554183] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T18:45:40.009882] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-22T18:45:40.122851] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-22T18:45:40.144591] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:45:40.756861] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-22T18:45:40.917666] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-22T18:45:41.717683] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-22T18:45:42.349348] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T18:45:42.517730] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-22T18:45:43.317699] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-22T18:45:43.439467] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T18:45:43.697358] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T18:45:44.081466] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-22T18:45:44.082486] [INFO ] [REMOTE ] FGN: Full fetch complete (5510 records). [2025-10-22T18:45:44.082557] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-22T18:45:44.122912] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-22T18:45:44.444194] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-22T18:45:44.444276] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-22T18:45:44.444442] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-22T18:45:44.444562] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-22T18:45:44.444967] [DEBUG] [LOCAL ] FGN: Trimmed 5510 records to 3560 (keeping 200 days of data) [2025-10-22T18:45:44.466484] [DEBUG] [LOCAL ] FGN: Primary data saved (3560 records). [2025-10-22T18:45:44.466552] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-22T18:45:44.466622] [INFO ] [MAIN ] Update Progress: 828/2367 symbols completed. FGN took 26.1s. Estimated remaining: 3h 16m 24s. Rate: 7.8 symbols/min [2025-10-22T18:45:44.636284] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:45:44.684204] [DEBUG] [LOCAL ] FI: Loaded 53588 existing records from primary storage. [2025-10-22T18:45:44.684575] [INFO ] [MAIN ] FI: Loaded 53588 existing records. [2025-10-22T18:45:44.862474] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:45:44.862709] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-22T18:45:44.862767] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-22T18:45:44.863234] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-22T18:45:44.863292] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-22T18:45:44.926286] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-10-22T18:45:45.221608] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:45:45.702161] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-22T18:45:45.717604] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-10-22T18:45:45.960633] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T18:45:46.258721] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-22T18:45:46.517700] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-22T18:45:47.317748] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-22T18:45:48.117728] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-22T18:45:48.260000] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T18:45:48.917736] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-10-22T18:45:49.084695] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T18:45:49.614320] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T18:45:49.640913] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T18:45:49.717730] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-22T18:45:50.517745] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-22T18:45:51.206487] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T18:45:51.317679] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-10-22T18:45:51.752135] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-22T18:45:52.035062] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T18:45:52.117688] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-22T18:45:52.917694] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-22T18:45:53.717713] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-22T18:45:53.815885] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T18:45:54.525932] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-10-22T18:45:54.531262] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T18:45:54.931903] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-22T18:45:55.122856] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T18:45:55.317689] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-10-22T18:45:55.882186] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-22T18:45:56.117680] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-10. [2025-10-22T18:45:56.717225] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T18:45:56.718840] [INFO ] [REMOTE ] FGSN: Full fetch complete (8076 records). [2025-10-22T18:45:56.718964] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-10-22T18:45:56.907777] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-22T18:45:56.908045] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:45:56.908119] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:45:56.908167] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-22T18:45:56.908222] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-22T18:45:56.908260] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-22T18:45:56.908299] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-22T18:45:56.908352] [INFO ] [MAIN ] Update Progress: 829/2367 symbols completed. FGSN took 29.3s. Estimated remaining: 3h 16m 25s. Rate: 7.8 symbols/min [2025-10-22T18:45:56.922818] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-22T18:45:57.074905] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:45:57.097510] [DEBUG] [LOCAL ] FICO: Loaded 21911 existing records from primary storage. [2025-10-22T18:45:57.097811] [INFO ] [MAIN ] FICO: Loaded 21911 existing records. [2025-10-22T18:45:57.269099] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:45:57.269288] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-22T18:45:57.269335] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-22T18:45:57.269499] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-22T18:45:57.269536] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-22T18:45:57.616000] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:45:57.717708] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-22T18:45:58.517747] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-22T18:45:58.922678] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T18:45:59.137271] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T18:45:59.317711] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-22T18:45:59.652103] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-22T18:46:00.117691] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-22T18:46:00.733128] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-22T18:46:00.738822] [INFO ] [REMOTE ] FHI: Full fetch complete (57435 records). [2025-10-22T18:46:00.738919] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-22T18:46:00.924417] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-22T18:46:01.123700] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-22T18:46:01.123917] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-22T18:46:01.124931] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-22T18:46:01.125046] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-22T18:46:01.137739] [DEBUG] [LOCAL ] FHI: Trimmed 57435 records to 39410 (keeping 200 days of data) [2025-10-22T18:46:01.138671] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-22T18:46:01.373298] [DEBUG] [LOCAL ] FHI: Primary data saved (39410 records). [2025-10-22T18:46:01.373430] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-22T18:46:01.374040] [INFO ] [MAIN ] Update Progress: 830/2367 symbols completed. FHI took 27.9s. Estimated remaining: 3h 16m 11s. Rate: 7.8 symbols/min [2025-10-22T18:46:01.538910] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:46:01.539072] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-22T18:46:01.539108] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-22T18:46:01.539221] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-22T18:46:01.539262] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-22T18:46:01.539302] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-22T18:46:01.539334] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-22T18:46:01.728213] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-22T18:46:01.903117] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:46:02.517706] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-22T18:46:02.760155] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-22T18:46:02.962327] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-22T18:46:03.317691] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-22T18:46:03.449030] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-22T18:46:04.117743] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-22T18:46:04.428974] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-22T18:46:04.917737] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-22T18:46:05.215554] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T18:46:05.717731] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-22T18:46:06.517725] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-22T18:46:06.869796] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T18:46:06.989528] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-22T18:46:07.317695] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-22T18:46:08.117704] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-22T18:46:08.159177] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T18:46:08.438706] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-22T18:46:08.464735] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T18:46:08.917725] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-22T18:46:09.717682] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-22T18:46:10.045243] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-22T18:46:10.517690] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-22T18:46:10.731556] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T18:46:11.317720] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-22T18:46:12.117625] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-22T18:46:12.455448] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T18:46:12.474519] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-22T18:46:12.917726] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-22T18:46:13.361268] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T18:46:13.370545] [INFO ] [REMOTE ] FHN: Full fetch complete (77478 records). [2025-10-22T18:46:13.370791] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-22T18:46:13.719685] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-22T18:46:13.776214] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-22T18:46:13.776340] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-22T18:46:13.777727] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-22T18:46:13.777849] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-22T18:46:13.779870] [DEBUG] [LOCAL ] FHN: Trimmed 77478 records to 53399 (keeping 200 days of data) [2025-10-22T18:46:13.992775] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T18:46:13.997248] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-22T18:46:13.998234] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:46:13.998939] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-22T18:46:14.001464] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:46:14.005471] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-22T18:46:14.017047] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-22T18:46:14.032926] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-22T18:46:14.033152] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-22T18:46:14.033238] [INFO ] [MAIN ] Update Progress: 831/2367 symbols completed. FIG took 12.7s. Estimated remaining: 3h 16m 13s. Rate: 7.8 symbols/min [2025-10-22T18:46:14.267068] [DEBUG] [LOCAL ] FHN: Primary data saved (53399 records). [2025-10-22T18:46:14.277565] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-22T18:46:14.294294] [INFO ] [MAIN ] Update Progress: 832/2367 symbols completed. FHN took 37.4s. Estimated remaining: 3h 15m 52s. Rate: 7.8 symbols/min [2025-10-22T18:46:14.362070] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:46:14.509968] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:46:14.522967] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-22T18:46:14.544380] [DEBUG] [LOCAL ] FIGS: Loaded 48559 existing records from primary storage. [2025-10-22T18:46:14.544826] [INFO ] [MAIN ] FIGS: Loaded 48559 existing records. [2025-10-22T18:46:14.700474] [DEBUG] [LOCAL ] FIHL: Loaded 39140 existing records from primary storage. [2025-10-22T18:46:14.716420] [INFO ] [MAIN ] FIHL: Loaded 39140 existing records. [2025-10-22T18:46:14.838861] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:46:14.865570] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-22T18:46:14.889530] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-22T18:46:14.910867] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-22T18:46:14.911052] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-22T18:46:15.039236] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:46:15.074337] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-22T18:46:15.077780] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-22T18:46:15.083662] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-22T18:46:15.104316] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-22T18:46:15.613055] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:46:15.623781] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-22T18:46:15.609521] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-22T18:46:15.778470] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:46:15.789794] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T18:46:16.117765] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-22T18:46:16.917752] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-22T18:46:17.272100] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T18:46:17.632579] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T18:46:17.717629] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-22T18:46:18.517718] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-22T18:46:18.945730] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-22T18:46:18.989550] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T18:46:19.317729] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-22T18:46:19.978557] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T18:46:20.117720] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-22T18:46:20.917708] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-22T18:46:21.339468] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-22T18:46:21.729092] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-22T18:46:21.731792] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T18:46:22.285794] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T18:46:22.517700] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-22T18:46:22.900818] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-22T18:46:23.317738] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-22T18:46:24.117732] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-22T18:46:24.415606] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-22T18:46:24.917731] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-22T18:46:25.044206] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T18:46:25.049285] [INFO ] [REMOTE ] FICO: Full fetch complete (30038 records). [2025-10-22T18:46:25.049443] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-22T18:46:25.345195] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T18:46:25.390457] [INFO ] [REMOTE ] FI: Full fetch complete (77496 records). [2025-10-22T18:46:25.400886] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-22T18:46:25.605127] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-22T18:46:25.622246] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-22T18:46:25.632843] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-22T18:46:25.657051] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-22T18:46:25.721791] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-22T18:46:25.778046] [DEBUG] [LOCAL ] FICO: Trimmed 30038 records to 21963 (keeping 200 days of data) [2025-10-22T18:46:25.967131] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-22T18:46:25.967932] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-22T18:46:25.969184] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-22T18:46:25.972575] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-22T18:46:25.981859] [DEBUG] [LOCAL ] FI: Trimmed 77496 records to 53586 (keeping 200 days of data) [2025-10-22T18:46:26.117534] [DEBUG] [LOCAL ] FICO: Primary data saved (21963 records). [2025-10-22T18:46:26.128461] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-22T18:46:26.133912] [INFO ] [MAIN ] Update Progress: 833/2367 symbols completed. FICO took 29.2s. Estimated remaining: 3h 15m 52s. Rate: 7.8 symbols/min [2025-10-22T18:46:26.397310] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:46:26.413914] [DEBUG] [LOCAL ] FINS: Loaded 8297 existing records from primary storage. [2025-10-22T18:46:26.416620] [INFO ] [MAIN ] FINS: Loaded 8297 existing records. [2025-10-22T18:46:26.680771] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:46:26.681295] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-22T18:46:26.698982] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-22T18:46:26.700830] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-22T18:46:26.701134] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-22T18:46:26.805962] [DEBUG] [LOCAL ] FI: Primary data saved (53586 records). [2025-10-22T18:46:26.847598] [INFO ] [MAIN ] FI: Full history saved. [2025-10-22T18:46:26.850279] [INFO ] [MAIN ] Update Progress: 834/2367 symbols completed. FI took 42.4s. Estimated remaining: 3h 15m 31s. Rate: 7.8 symbols/min [2025-10-22T18:46:26.851918] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T18:46:26.959787] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-22T18:46:27.240073] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:46:27.298496] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:46:27.320403] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-22T18:46:27.341189] [DEBUG] [LOCAL ] FINV: Loaded 45256 existing records from primary storage. [2025-10-22T18:46:27.341497] [INFO ] [MAIN ] FINV: Loaded 45256 existing records. [2025-10-22T18:46:27.541384] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:46:27.541726] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-22T18:46:27.541931] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-22T18:46:27.542263] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-22T18:46:27.542334] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-22T18:46:27.843433] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-22T18:46:27.936945] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:46:27.943815] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-22T18:46:28.117612] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-22T18:46:28.684726] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T18:46:28.726084] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T18:46:28.917695] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-22T18:46:29.717683] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-22T18:46:30.517806] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-22T18:46:30.805889] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T18:46:31.015477] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T18:46:31.317742] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-22T18:46:32.076148] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T18:46:32.117716] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-22T18:46:32.699082] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T18:46:32.796590] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-22T18:46:32.917700] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-22T18:46:33.717679] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-22T18:46:34.363329] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T18:46:34.517627] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-22T18:46:34.880116] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-22T18:46:35.317735] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-22T18:46:35.959165] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T18:46:36.117684] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-22T18:46:36.125807] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T18:46:36.917684] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-22T18:46:37.722772] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-22T18:46:37.747829] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T18:46:38.517718] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-22T18:46:38.589922] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-22T18:46:38.618329] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T18:46:39.317719] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-22T18:46:40.117751] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-22T18:46:40.178967] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T18:46:40.871232] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T18:46:40.917626] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-22T18:46:41.570825] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T18:46:41.717627] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-22T18:46:42.006702] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T18:46:42.517726] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-22T18:46:43.290328] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-22T18:46:43.317613] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-22T18:46:43.388237] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T18:46:44.103794] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T18:46:44.117612] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-22T18:46:44.917697] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-22T18:46:45.717715] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-22T18:46:45.929144] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T18:46:45.937197] [INFO ] [REMOTE ] FIGS: Full fetch complete (70850 records). [2025-10-22T18:46:45.937333] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-22T18:46:46.333635] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-22T18:46:46.333757] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-22T18:46:46.334596] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-22T18:46:46.334680] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-22T18:46:46.336424] [DEBUG] [LOCAL ] FIGS: Trimmed 70850 records to 48545 (keeping 200 days of data) [2025-10-22T18:46:46.536371] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-22T18:46:46.539187] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T18:46:46.652349] [DEBUG] [LOCAL ] FIGS: Primary data saved (48545 records). [2025-10-22T18:46:46.652476] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-22T18:46:46.653056] [INFO ] [MAIN ] Update Progress: 835/2367 symbols completed. FIGS took 32.6s. Estimated remaining: 3h 15m 46s. Rate: 7.8 symbols/min [2025-10-22T18:46:46.819211] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:46:46.868695] [DEBUG] [LOCAL ] FIS: Loaded 53326 existing records from primary storage. [2025-10-22T18:46:46.868999] [INFO ] [MAIN ] FIS: Loaded 53326 existing records. [2025-10-22T18:46:47.052959] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:46:47.053289] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-22T18:46:47.053347] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-22T18:46:47.053534] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-22T18:46:47.053572] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-22T18:46:47.322882] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-22T18:46:47.323562] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-22T18:46:47.373875] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T18:46:47.460143] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:46:48.117707] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-22T18:46:48.917705] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-22T18:46:49.142042] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T18:46:49.648840] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T18:46:49.655284] [INFO ] [REMOTE ] FIHL: Full fetch complete (56360 records). [2025-10-22T18:46:49.655427] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-22T18:46:49.722932] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-22T18:46:50.041997] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-22T18:46:50.042082] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-22T18:46:50.042839] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-22T18:46:50.042911] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-22T18:46:50.044151] [DEBUG] [LOCAL ] FIHL: Trimmed 56360 records to 39044 (keeping 200 days of data) [2025-10-22T18:46:50.282446] [DEBUG] [LOCAL ] FIHL: Primary data saved (39044 records). [2025-10-22T18:46:50.282727] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-22T18:46:50.282879] [INFO ] [MAIN ] Update Progress: 836/2367 symbols completed. FIHL took 36.0s. Estimated remaining: 3h 15m 31s. Rate: 7.8 symbols/min [2025-10-22T18:46:50.456193] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:46:50.485957] [DEBUG] [LOCAL ] FIX: Loaded 28480 existing records from primary storage. [2025-10-22T18:46:50.486253] [INFO ] [MAIN ] FIX: Loaded 28480 existing records. [2025-10-22T18:46:50.523707] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-22T18:46:50.691618] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:46:50.711494] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-22T18:46:50.711887] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-22T18:46:50.715242] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T18:46:50.715347] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-22T18:46:50.715566] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-22T18:46:51.081450] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:46:51.278021] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-22T18:46:51.317690] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-22T18:46:51.477553] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T18:46:52.031962] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T18:46:52.033497] [INFO ] [REMOTE ] FINS: Full fetch complete (11609 records). [2025-10-22T18:46:52.033567] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-22T18:46:52.122897] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-22T18:46:52.390388] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-22T18:46:52.390464] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-22T18:46:52.390746] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-22T18:46:52.390806] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-22T18:46:52.391260] [DEBUG] [LOCAL ] FINS: Trimmed 11609 records to 8261 (keeping 200 days of data) [2025-10-22T18:46:52.442104] [DEBUG] [LOCAL ] FINS: Primary data saved (8261 records). [2025-10-22T18:46:52.442242] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-22T18:46:52.442321] [INFO ] [MAIN ] Update Progress: 837/2367 symbols completed. FINS took 26.3s. Estimated remaining: 3h 15m 13s. Rate: 7.8 symbols/min [2025-10-22T18:46:52.917693] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-22T18:46:53.717762] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-22T18:46:53.870700] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T18:46:54.469132] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T18:46:54.517726] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-22T18:46:55.317744] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-22T18:46:55.459068] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T18:46:56.117745] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-22T18:46:56.332343] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T18:46:56.339979] [INFO ] [REMOTE ] FINV: Full fetch complete (64964 records). [2025-10-22T18:46:56.340106] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-22T18:46:56.724288] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-22T18:46:56.724439] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-22T18:46:56.725391] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-22T18:46:56.732519] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-22T18:46:56.745637] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T18:46:56.754304] [DEBUG] [LOCAL ] FINV: Trimmed 64964 records to 45222 (keeping 200 days of data) [2025-10-22T18:46:56.921012] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-22T18:46:57.008787] [DEBUG] [LOCAL ] FINV: Primary data saved (45222 records). [2025-10-22T18:46:57.008921] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-22T18:46:57.008998] [INFO ] [MAIN ] Update Progress: 838/2367 symbols completed. FINV took 30.2s. Estimated remaining: 3h 14m 60s. Rate: 7.8 symbols/min [2025-10-22T18:46:57.887472] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T18:46:57.899205] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-22T18:46:58.611825] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T18:46:58.620517] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-22T18:46:59.769639] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T18:46:59.781380] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-22T18:47:00.195978] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T18:47:00.204042] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-22T18:47:01.582839] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T18:47:01.590169] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-22T18:47:01.690504] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T18:47:01.717614] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-22T18:47:02.841285] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T18:47:02.847201] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-22T18:47:03.456866] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T18:47:03.467619] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-22T18:47:04.307218] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T18:47:04.313945] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-22T18:47:05.292168] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T18:47:05.305301] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-22T18:47:05.325071] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-22T18:47:05.717725] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-22T18:47:07.087329] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T18:47:07.100047] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-22T18:47:07.133415] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T18:47:07.317755] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-22T18:47:08.793258] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-22T18:47:08.801757] [INFO ] [REMOTE ] FIX: Full fetch complete (45633 records). [2025-10-22T18:47:08.802051] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-22T18:47:09.108947] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-22T18:47:09.201844] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-22T18:47:09.466242] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-22T18:47:09.466341] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-22T18:47:09.467158] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-22T18:47:09.467227] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-22T18:47:09.468615] [DEBUG] [LOCAL ] FIX: Trimmed 45633 records to 28424 (keeping 200 days of data) [2025-10-22T18:47:09.672883] [DEBUG] [LOCAL ] FIX: Primary data saved (28424 records). [2025-10-22T18:47:09.673056] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-22T18:47:09.673155] [INFO ] [MAIN ] Update Progress: 839/2367 symbols completed. FIX took 19.4s. Estimated remaining: 3h 15m 1s. Rate: 7.8 symbols/min [2025-10-22T18:47:10.183564] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T18:47:10.193019] [INFO ] [REMOTE ] FIS: Full fetch complete (77393 records). [2025-10-22T18:47:10.193200] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-22T18:47:10.612156] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-22T18:47:10.612251] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-22T18:47:10.613184] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-22T18:47:10.613252] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-22T18:47:10.614761] [DEBUG] [LOCAL ] FIS: Trimmed 77393 records to 53325 (keeping 200 days of data) [2025-10-22T18:47:10.934755] [DEBUG] [LOCAL ] FIS: Primary data saved (53325 records). [2025-10-22T18:47:10.934900] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-22T18:47:10.934981] [INFO ] [MAIN ] Update Progress: 840/2367 symbols completed. FIS took 24.3s. Estimated remaining: 3h 14m 42s. Rate: 7.8 symbols/min [2025-10-22T18:47:11.469815] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:11.589692] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:11.599770] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-22T18:47:11.599872] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-22T18:47:11.619083] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:11.639700] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:11.639945] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-22T18:47:11.640538] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-22T18:47:11.640617] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-22T18:47:11.640713] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-22T18:47:11.751354] [DEBUG] [LOCAL ] FLC: Loaded 5426 existing records from primary storage. [2025-10-22T18:47:11.799883] [INFO ] [MAIN ] FLC: Loaded 5426 existing records. [2025-10-22T18:47:12.068821] [DEBUG] [LOCAL ] FLNG: Loaded 33491 existing records from primary storage. [2025-10-22T18:47:12.092687] [DEBUG] [LOCAL ] FLG: Loaded 53319 existing records from primary storage. [2025-10-22T18:47:12.109371] [INFO ] [MAIN ] FLNG: Loaded 33491 existing records. [2025-10-22T18:47:12.142934] [INFO ] [MAIN ] FLG: Loaded 53319 existing records. [2025-10-22T18:47:12.249322] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:12.319404] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-10-22T18:47:12.459738] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:47:12.479571] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-22T18:47:12.490767] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-22T18:47:12.516712] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-22T18:47:12.532691] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-22T18:47:12.671543] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:47:12.690374] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-22T18:47:12.685026] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:47:12.712626] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-22T18:47:12.731276] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T18:47:12.737218] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-22T18:47:12.737590] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-22T18:47:12.750709] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-22T18:47:12.731833] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-10-22T18:47:12.768368] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-22T18:47:12.774358] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:47:12.841458] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-22T18:47:12.841530] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-22T18:47:12.875552] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-22T18:47:12.868401] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:47:13.032391] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-22T18:47:13.125049] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-22T18:47:13.192379] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-22T18:47:13.224933] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-22T18:47:13.317310] [INFO ] [MAIN ] Update Progress: 841/2367 symbols completed. FIXT took 2.4s. Estimated remaining: 3h 14m 25s. Rate: 7.8 symbols/min [2025-10-22T18:47:13.667915] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:13.710481] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-22T18:47:13.878559] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:13.938699] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-22T18:47:13.941948] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:14.021985] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:14.022365] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-22T18:47:14.065966] [DEBUG] [LOCAL ] FLO: Loaded 52075 existing records from primary storage. [2025-10-22T18:47:14.066309] [INFO ] [MAIN ] FLO: Loaded 52075 existing records. [2025-10-22T18:47:14.238795] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:47:14.239010] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-22T18:47:14.239058] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-22T18:47:14.239245] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-22T18:47:14.239282] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-22T18:47:14.612294] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:14.612663] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-22T18:47:14.693277] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T18:47:14.695009] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-22T18:47:15.379959] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-22T18:47:15.382521] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-22T18:47:15.404897] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:47:15.412637] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-22T18:47:15.497248] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:47:15.508016] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-22T18:47:16.041767] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-22T18:47:16.117690] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-22T18:47:16.410760] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T18:47:16.848893] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-22T18:47:16.897433] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T18:47:16.917608] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-22T18:47:16.941178] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T18:47:17.717688] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-22T18:47:18.366388] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T18:47:18.517684] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-22T18:47:18.700681] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T18:47:19.317772] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-22T18:47:20.132986] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-22T18:47:20.139309] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T18:47:20.734423] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-22T18:47:20.899873] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T18:47:20.917603] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-22T18:47:21.717703] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-22T18:47:22.353459] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T18:47:22.517811] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-22T18:47:23.317686] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-22T18:47:23.669736] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T18:47:23.853553] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-22T18:47:23.909820] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-22T18:47:24.117740] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-22T18:47:24.917684] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-22T18:47:25.717687] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-22T18:47:25.879102] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-22T18:47:26.314667] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T18:47:26.317995] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T18:47:26.517728] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-22T18:47:27.155013] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-22T18:47:27.317689] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-22T18:47:28.101460] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-22T18:47:28.102785] [INFO ] [REMOTE ] FLC: Full fetch complete (7801 records). [2025-10-22T18:47:28.102870] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-22T18:47:28.123684] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-22T18:47:28.466569] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-22T18:47:28.466666] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-22T18:47:28.466925] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-22T18:47:28.466970] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-22T18:47:28.467358] [DEBUG] [LOCAL ] FLC: Trimmed 7801 records to 5396 (keeping 200 days of data) [2025-10-22T18:47:28.499979] [DEBUG] [LOCAL ] FLC: Primary data saved (5396 records). [2025-10-22T18:47:28.500088] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-22T18:47:28.500166] [INFO ] [MAIN ] Update Progress: 842/2367 symbols completed. FLC took 17.6s. Estimated remaining: 3h 14m 31s. Rate: 7.8 symbols/min [2025-10-22T18:47:28.667954] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:28.668104] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-22T18:47:28.668141] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-22T18:47:28.668251] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-22T18:47:28.668293] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-22T18:47:28.668334] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-22T18:47:28.668367] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-22T18:47:28.924165] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-22T18:47:29.033144] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:29.717732] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-10-22T18:47:29.845468] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T18:47:30.517729] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-22T18:47:30.757257] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-22T18:47:30.932057] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T18:47:31.317769] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-22T18:47:32.117727] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-10-22T18:47:32.208409] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T18:47:32.839337] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T18:47:32.917707] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-22T18:47:33.292062] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T18:47:33.717702] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-10-22T18:47:34.517730] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-22T18:47:34.722249] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T18:47:35.135008] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T18:47:35.317702] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-10-22T18:47:35.590900] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-22T18:47:36.117692] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-22T18:47:36.768031] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T18:47:36.917693] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-10-22T18:47:37.717716] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-22T18:47:37.773603] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T18:47:38.220231] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-22T18:47:38.517725] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-22T18:47:39.317681] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-22T18:47:39.665286] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T18:47:40.117620] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-10-22T18:47:40.414789] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T18:47:40.612428] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-22T18:47:40.917720] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-22T18:47:41.263942] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-22T18:47:41.717768] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-22T18:47:42.411965] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T18:47:42.417231] [INFO ] [REMOTE ] FLNG: Full fetch complete (49871 records). [2025-10-22T18:47:42.417328] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-22T18:47:42.523984] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-22T18:47:42.802453] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-22T18:47:42.802532] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-22T18:47:42.803217] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-22T18:47:42.803278] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-22T18:47:42.804310] [DEBUG] [LOCAL ] FLNG: Trimmed 49871 records to 33319 (keeping 200 days of data) [2025-10-22T18:47:43.004096] [DEBUG] [LOCAL ] FLNG: Primary data saved (33319 records). [2025-10-22T18:47:43.004224] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-22T18:47:43.004302] [INFO ] [MAIN ] Update Progress: 843/2367 symbols completed. FLNG took 32.1s. Estimated remaining: 3h 14m 36s. Rate: 7.8 symbols/min [2025-10-22T18:47:43.169425] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:43.217220] [DEBUG] [LOCAL ] FLR: Loaded 53260 existing records from primary storage. [2025-10-22T18:47:43.217542] [INFO ] [MAIN ] FLR: Loaded 53260 existing records. [2025-10-22T18:47:43.322896] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-10-22T18:47:43.393976] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:47:43.394180] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-22T18:47:43.394226] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-22T18:47:43.394448] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-22T18:47:43.394503] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-22T18:47:43.749218] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:43.781793] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-22T18:47:44.117699] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-22T18:47:44.338163] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T18:47:44.578981] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T18:47:44.917742] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-22T18:47:45.717697] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-10-22T18:47:45.807158] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T18:47:46.517707] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-22T18:47:46.991615] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-22T18:47:47.035678] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T18:47:47.317698] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-22T18:47:48.117731] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-22T18:47:48.522319] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T18:47:48.531365] [INFO ] [REMOTE ] FLG: Full fetch complete (77425 records). [2025-10-22T18:47:48.531534] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-22T18:47:48.922545] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-22T18:47:48.922882] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-22T18:47:48.922767] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-10-22T18:47:48.924843] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-22T18:47:48.925020] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-22T18:47:48.926738] [DEBUG] [LOCAL ] FLG: Trimmed 77425 records to 53319 (keeping 200 days of data) [2025-10-22T18:47:49.057994] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T18:47:49.284295] [DEBUG] [LOCAL ] FLG: Primary data saved (53319 records). [2025-10-22T18:47:49.284486] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-22T18:47:49.284591] [INFO ] [MAIN ] Update Progress: 844/2367 symbols completed. FLG took 38.3s. Estimated remaining: 3h 14m 25s. Rate: 7.8 symbols/min [2025-10-22T18:47:49.453485] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:49.497541] [DEBUG] [LOCAL ] FLS: Loaded 50413 existing records from primary storage. [2025-10-22T18:47:49.497917] [INFO ] [MAIN ] FLS: Loaded 50413 existing records. [2025-10-22T18:47:49.670870] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:47:49.671095] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-22T18:47:49.671142] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-22T18:47:49.671561] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-22T18:47:49.671617] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-22T18:47:49.727835] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-22T18:47:50.072914] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:50.207070] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T18:47:50.355596] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-22T18:47:50.364216] [INFO ] [REMOTE ] FLO: Full fetch complete (75395 records). [2025-10-22T18:47:50.364361] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-22T18:47:50.535146] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-22T18:47:50.750088] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-22T18:47:50.750176] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-22T18:47:50.751071] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-22T18:47:50.751138] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-22T18:47:50.752552] [DEBUG] [LOCAL ] FLO: Trimmed 75395 records to 52073 (keeping 200 days of data) [2025-10-22T18:47:51.075179] [DEBUG] [LOCAL ] FLO: Primary data saved (52073 records). [2025-10-22T18:47:51.075552] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-22T18:47:51.075681] [INFO ] [MAIN ] Update Progress: 845/2367 symbols completed. FLO took 37.7s. Estimated remaining: 3h 14m 7s. Rate: 7.8 symbols/min [2025-10-22T18:47:51.244061] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:51.273132] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T18:47:51.323480] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-22T18:47:51.326208] [DEBUG] [LOCAL ] FLUT: Loaded 50684 existing records from primary storage. [2025-10-22T18:47:51.326525] [INFO ] [MAIN ] FLUT: Loaded 50684 existing records. [2025-10-22T18:47:51.499879] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:47:51.500120] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-22T18:47:51.500164] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-22T18:47:51.500750] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-22T18:47:51.500812] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-22T18:47:51.855599] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:51.923493] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T18:47:52.117680] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-10. [2025-10-22T18:47:52.917785] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-22T18:47:53.096352] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T18:47:53.585192] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-22T18:47:53.589806] [INFO ] [REMOTE ] FLOC: Full fetch complete (40811 records). [2025-10-22T18:47:53.589899] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-10-22T18:47:53.725512] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-22T18:47:53.774306] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-22T18:47:53.774862] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:47:53.774933] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:47:53.775004] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-22T18:47:53.775067] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-22T18:47:53.775102] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-22T18:47:53.775141] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-22T18:47:53.775198] [INFO ] [MAIN ] Update Progress: 846/2367 symbols completed. FLOC took 25.3s. Estimated remaining: 3h 13m 51s. Rate: 7.8 symbols/min [2025-10-22T18:47:53.944263] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:47:53.944487] [DEBUG] [LOCAL ] FLXR: No existing data file found in primary storage. [2025-10-22T18:47:53.944556] [WARN ] [MAIN ] FLXR: No existing data found, performing full refresh instead. [2025-10-22T18:47:53.944849] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-22T18:47:53.944964] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-22T18:47:53.945021] [DEBUG] [LOCAL ] FLXR: No primary data file found to delete. [2025-10-22T18:47:53.945056] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-22T18:47:54.312153] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:47:54.336295] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T18:47:54.517720] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-22T18:47:55.101735] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T18:47:55.317705] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-22T18:47:56.120632] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-22T18:47:56.234015] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T18:47:56.917681] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-22T18:47:57.041537] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T18:47:57.717629] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-22T18:47:57.744022] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T18:47:57.800187] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T18:47:58.517692] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-22T18:47:59.317669] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-22T18:47:59.488545] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T18:47:59.796995] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-22T18:48:00.117714] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-22T18:48:00.217824] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T18:48:00.917732] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-22T18:48:01.131714] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-22T18:48:01.717942] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-22T18:48:02.517682] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-22T18:48:02.931388] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T18:48:03.317686] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-22T18:48:03.669427] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T18:48:04.111004] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T18:48:04.121476] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-22T18:48:04.917693] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-22T18:48:05.424419] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-22T18:48:05.703393] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T18:48:05.717613] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-22T18:48:05.810717] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T18:48:06.517624] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-22T18:48:06.689308] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-22T18:48:07.317698] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-22T18:48:08.117625] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-22T18:48:08.301965] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T18:48:08.917741] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-22T18:48:09.129387] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T18:48:09.717729] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-22T18:48:09.762004] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T18:48:10.041439] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T18:48:10.517711] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-22T18:48:11.317722] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-22T18:48:11.668365] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T18:48:11.701543] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T18:48:12.117743] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-22T18:48:12.917627] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-22T18:48:13.181171] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-22T18:48:13.314436] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T18:48:13.326765] [INFO ] [REMOTE ] FLR: Full fetch complete (76896 records). [2025-10-22T18:48:13.327012] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-22T18:48:13.721936] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-22T18:48:13.741244] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-22T18:48:13.742761] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-22T18:48:13.743876] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-22T18:48:13.743971] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-22T18:48:13.745675] [DEBUG] [LOCAL ] FLR: Trimmed 76896 records to 53263 (keeping 200 days of data) [2025-10-22T18:48:14.050598] [DEBUG] [LOCAL ] FLR: Primary data saved (53263 records). [2025-10-22T18:48:14.050789] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-22T18:48:14.050891] [INFO ] [MAIN ] Update Progress: 847/2367 symbols completed. FLR took 31.0s. Estimated remaining: 3h 14m 6s. Rate: 7.8 symbols/min [2025-10-22T18:48:14.248828] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:48:14.298666] [DEBUG] [LOCAL ] FMC: Loaded 51887 existing records from primary storage. [2025-10-22T18:48:14.299013] [INFO ] [MAIN ] FMC: Loaded 51887 existing records. [2025-10-22T18:48:14.498977] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:48:14.499422] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-22T18:48:14.499551] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-22T18:48:14.499940] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-22T18:48:14.499998] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-22T18:48:14.533327] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-22T18:48:14.911812] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-22T18:48:14.925781] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-22T18:48:14.952872] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:48:15.317716] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-22T18:48:16.117763] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-22T18:48:16.450174] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-22T18:48:16.917745] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-22T18:48:17.222074] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T18:48:17.514254] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T18:48:17.519190] [INFO ] [REMOTE ] FLXR: Full fetch complete (27570 records). [2025-10-22T18:48:17.519324] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-22T18:48:17.725414] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-22T18:48:17.890291] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-22T18:48:17.890377] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-22T18:48:17.890903] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-22T18:48:17.890966] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-22T18:48:17.891840] [DEBUG] [LOCAL ] FLXR: Trimmed 27570 records to 21360 (keeping 200 days of data) [2025-10-22T18:48:18.020921] [DEBUG] [LOCAL ] FLXR: Primary data saved (21360 records). [2025-10-22T18:48:18.021048] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-22T18:48:18.021115] [INFO ] [MAIN ] Update Progress: 848/2367 symbols completed. FLXR took 24.2s. Estimated remaining: 3h 13m 51s. Rate: 7.8 symbols/min [2025-10-22T18:48:18.185197] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:48:18.193958] [DEBUG] [LOCAL ] FMN: Loaded 5499 existing records from primary storage. [2025-10-22T18:48:18.194161] [INFO ] [MAIN ] FMN: Loaded 5499 existing records. [2025-10-22T18:48:18.400123] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:48:18.400403] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-22T18:48:18.400464] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-22T18:48:18.400806] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-22T18:48:18.400880] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-22T18:48:18.526839] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-22T18:48:18.758263] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T18:48:18.806741] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:48:19.317619] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-22T18:48:19.487060] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T18:48:20.040503] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-22T18:48:20.117616] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-22T18:48:20.304417] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T18:48:20.917704] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-22T18:48:21.661436] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-22T18:48:21.717619] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-22T18:48:21.847491] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T18:48:22.517630] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-22T18:48:22.674853] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-22T18:48:23.317744] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-22T18:48:24.117732] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-22T18:48:24.363581] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-22T18:48:24.917715] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-22T18:48:25.158255] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T18:48:25.167206] [INFO ] [REMOTE ] FLS: Full fetch complete (72537 records). [2025-10-22T18:48:25.167354] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-22T18:48:25.554332] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-22T18:48:25.554418] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-22T18:48:25.555343] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-22T18:48:25.555409] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-22T18:48:25.556837] [DEBUG] [LOCAL ] FLS: Trimmed 72537 records to 50409 (keeping 200 days of data) [2025-10-22T18:48:25.726548] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-22T18:48:25.863690] [DEBUG] [LOCAL ] FLS: Primary data saved (50409 records). [2025-10-22T18:48:25.863872] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-22T18:48:25.864212] [INFO ] [MAIN ] Update Progress: 849/2367 symbols completed. FLS took 36.6s. Estimated remaining: 3h 13m 44s. Rate: 7.8 symbols/min [2025-10-22T18:48:25.996285] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T18:48:26.074444] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:48:26.103034] [DEBUG] [LOCAL ] FMS: Loaded 30427 existing records from primary storage. [2025-10-22T18:48:26.103294] [INFO ] [MAIN ] FMS: Loaded 30427 existing records. [2025-10-22T18:48:26.277764] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:48:26.278014] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-22T18:48:26.278062] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-22T18:48:26.278244] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-22T18:48:26.278301] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-22T18:48:26.530439] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-22T18:48:26.579035] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T18:48:26.657585] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:48:26.992864] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-22T18:48:27.317732] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-22T18:48:28.117705] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-22T18:48:28.647989] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T18:48:28.676989] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-22T18:48:28.685883] [INFO ] [REMOTE ] FLUT: Full fetch complete (73382 records). [2025-10-22T18:48:28.686054] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-22T18:48:28.790445] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-22T18:48:28.922915] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-22T18:48:29.078813] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-22T18:48:29.078895] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-22T18:48:29.079757] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-22T18:48:29.079819] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-22T18:48:29.081209] [DEBUG] [LOCAL ] FLUT: Trimmed 73382 records to 50672 (keeping 200 days of data) [2025-10-22T18:48:29.379141] [DEBUG] [LOCAL ] FLUT: Primary data saved (50672 records). [2025-10-22T18:48:29.379286] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-22T18:48:29.379365] [INFO ] [MAIN ] Update Progress: 850/2367 symbols completed. FLUT took 38.3s. Estimated remaining: 3h 13m 29s. Rate: 7.8 symbols/min [2025-10-22T18:48:29.544171] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:48:29.578939] [DEBUG] [LOCAL ] FMX: Loaded 40553 existing records from primary storage. [2025-10-22T18:48:29.579229] [INFO ] [MAIN ] FMX: Loaded 40553 existing records. [2025-10-22T18:48:29.727328] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-22T18:48:29.757027] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:48:29.757304] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-22T18:48:29.757351] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-22T18:48:29.757602] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-22T18:48:29.757710] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-22T18:48:30.107715] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:48:30.427866] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T18:48:30.517760] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-22T18:48:31.183955] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-22T18:48:31.226761] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T18:48:31.317718] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-22T18:48:32.117745] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-22T18:48:32.917682] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-22T18:48:33.059780] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T18:48:33.283532] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T18:48:33.499530] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T18:48:33.717729] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-22T18:48:34.517908] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-22T18:48:35.140535] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T18:48:35.185754] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-22T18:48:35.317706] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-22T18:48:36.106362] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-22T18:48:36.108182] [INFO ] [REMOTE ] FMN: Full fetch complete (9940 records). [2025-10-22T18:48:36.108254] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-22T18:48:36.122871] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-22T18:48:36.471767] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-22T18:48:36.471927] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-22T18:48:36.472204] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-22T18:48:36.472246] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-22T18:48:36.472764] [DEBUG] [LOCAL ] FMN: Trimmed 9940 records to 5477 (keeping 200 days of data) [2025-10-22T18:48:36.508042] [DEBUG] [LOCAL ] FMN: Primary data saved (5477 records). [2025-10-22T18:48:36.508180] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-22T18:48:36.508279] [INFO ] [MAIN ] Update Progress: 851/2367 symbols completed. FMN took 18.5s. Estimated remaining: 3h 13m 20s. Rate: 7.8 symbols/min [2025-10-22T18:48:36.677964] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:48:36.681678] [DEBUG] [LOCAL ] FMY: Loaded 1377 existing records from primary storage. [2025-10-22T18:48:36.681834] [INFO ] [MAIN ] FMY: Loaded 1377 existing records. [2025-10-22T18:48:36.860773] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:48:36.861020] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-22T18:48:36.861068] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-22T18:48:36.861191] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-22T18:48:36.861229] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-22T18:48:36.929231] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-22T18:48:37.217302] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:48:37.622890] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T18:48:37.717719] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-22T18:48:38.118873] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-22T18:48:38.517722] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-22T18:48:38.644660] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T18:48:39.317714] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-22T18:48:39.970758] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T18:48:40.117700] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-22T18:48:40.917684] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-22T18:48:41.084869] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T18:48:41.552023] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-22T18:48:41.572511] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T18:48:41.717741] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-22T18:48:42.517723] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-22T18:48:43.317624] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-22T18:48:43.484155] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T18:48:43.773415] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T18:48:44.117714] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-22T18:48:44.505185] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T18:48:44.522111] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-22T18:48:44.917704] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-22T18:48:45.717705] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-22T18:48:46.517693] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-22T18:48:46.568560] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T18:48:46.991724] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-22T18:48:47.317678] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-22T18:48:47.612095] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T18:48:48.117679] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-22T18:48:48.562511] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T18:48:48.917685] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-22T18:48:49.283958] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-22T18:48:49.672946] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T18:48:49.717610] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-22T18:48:50.517692] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-22T18:48:51.224632] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T18:48:51.317724] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-22T18:48:51.770771] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-22T18:48:52.117767] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-22T18:48:52.719546] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T18:48:52.917711] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-22T18:48:53.267284] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-22T18:48:53.717725] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-22T18:48:54.055842] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T18:48:54.064452] [INFO ] [REMOTE ] FMC: Full fetch complete (75426 records). [2025-10-22T18:48:54.064574] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-22T18:48:54.264291] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T18:48:54.453727] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-22T18:48:54.453826] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-22T18:48:54.454712] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-22T18:48:54.454774] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-22T18:48:54.456171] [DEBUG] [LOCAL ] FMC: Trimmed 75426 records to 51883 (keeping 200 days of data) [2025-10-22T18:48:54.542153] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-22T18:48:54.768622] [DEBUG] [LOCAL ] FMC: Primary data saved (51883 records). [2025-10-22T18:48:54.768846] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-22T18:48:54.769764] [INFO ] [MAIN ] Update Progress: 852/2367 symbols completed. FMC took 40.7s. Estimated remaining: 3h 13m 32s. Rate: 7.8 symbols/min [2025-10-22T18:48:54.935968] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:48:54.973139] [DEBUG] [LOCAL ] FN: Loaded 37491 existing records from primary storage. [2025-10-22T18:48:54.973423] [INFO ] [MAIN ] FN: Loaded 37491 existing records. [2025-10-22T18:48:55.151587] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:48:55.151817] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-22T18:48:55.151863] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-22T18:48:55.152119] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-22T18:48:55.152166] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-22T18:48:55.318253] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-22T18:48:55.547090] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:48:55.873831] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T18:48:56.099935] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T18:48:56.117629] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-22T18:48:56.917723] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-22T18:48:57.359235] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T18:48:57.717760] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-22T18:48:57.904349] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T18:48:58.095559] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-22T18:48:58.096350] [INFO ] [REMOTE ] FMY: Full fetch complete (1943 records). [2025-10-22T18:48:58.096429] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-22T18:48:58.448941] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-22T18:48:58.449022] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-22T18:48:58.449110] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-22T18:48:58.449147] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-22T18:48:58.449460] [DEBUG] [LOCAL ] FMY: Trimmed 1943 records to 1360 (keeping 200 days of data) [2025-10-22T18:48:58.457931] [DEBUG] [LOCAL ] FMY: Primary data saved (1360 records). [2025-10-22T18:48:58.457990] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-22T18:48:58.458055] [INFO ] [MAIN ] Update Progress: 853/2367 symbols completed. FMY took 21.9s. Estimated remaining: 3h 13m 17s. Rate: 7.8 symbols/min [2025-10-22T18:48:58.522979] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-22T18:48:58.650501] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:48:58.709670] [DEBUG] [LOCAL ] FNB: Loaded 52603 existing records from primary storage. [2025-10-22T18:48:58.710198] [INFO ] [MAIN ] FNB: Loaded 52603 existing records. [2025-10-22T18:48:58.915878] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:48:58.916121] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-22T18:48:58.916171] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-22T18:48:58.916369] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-22T18:48:58.916408] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-22T18:48:59.272953] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:48:59.317700] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-22T18:49:00.083278] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T18:49:00.117722] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-22T18:49:00.917786] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-22T18:49:01.459236] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-22T18:49:01.717682] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-22T18:49:01.790681] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T18:49:02.517765] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-22T18:49:02.562214] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T18:49:03.317708] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-22T18:49:03.640560] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-22T18:49:04.117768] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-22T18:49:04.204317] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T18:49:04.850168] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T18:49:04.856292] [INFO ] [REMOTE ] FMX: Full fetch complete (58007 records). [2025-10-22T18:49:04.856393] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-22T18:49:04.924240] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-22T18:49:05.275953] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-22T18:49:05.276067] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-22T18:49:05.277016] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-22T18:49:05.277100] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-22T18:49:05.278467] [DEBUG] [LOCAL ] FMX: Trimmed 58007 records to 40436 (keeping 200 days of data) [2025-10-22T18:49:05.544710] [DEBUG] [LOCAL ] FMX: Primary data saved (40436 records). [2025-10-22T18:49:05.544847] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-22T18:49:05.544925] [INFO ] [MAIN ] Update Progress: 854/2367 symbols completed. FMX took 36.2s. Estimated remaining: 3h 13m 8s. Rate: 7.8 symbols/min [2025-10-22T18:49:05.714067] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:49:05.717742] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-22T18:49:05.763800] [DEBUG] [LOCAL ] FND: Loaded 52080 existing records from primary storage. [2025-10-22T18:49:05.764122] [INFO ] [MAIN ] FND: Loaded 52080 existing records. [2025-10-22T18:49:05.952051] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:49:05.952319] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-22T18:49:05.952367] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-22T18:49:05.952592] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-22T18:49:05.952684] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-22T18:49:06.348168] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T18:49:06.387422] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-22T18:49:06.392891] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:49:06.517705] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-22T18:49:07.329749] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-22T18:49:07.332291] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-22T18:49:08.117725] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-22T18:49:08.237374] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T18:49:08.537475] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T18:49:08.917758] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-22T18:49:09.586764] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-22T18:49:09.594839] [INFO ] [REMOTE ] FMS: Full fetch complete (43147 records). [2025-10-22T18:49:09.594962] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-22T18:49:09.731766] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-22T18:49:09.967990] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-22T18:49:09.968080] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-22T18:49:09.968752] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-22T18:49:09.968815] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-22T18:49:09.969869] [DEBUG] [LOCAL ] FMS: Trimmed 43147 records to 30344 (keeping 200 days of data) [2025-10-22T18:49:10.146794] [DEBUG] [LOCAL ] FMS: Primary data saved (30344 records). [2025-10-22T18:49:10.146933] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-22T18:49:10.147013] [INFO ] [MAIN ] Update Progress: 855/2367 symbols completed. FMS took 44.3s. Estimated remaining: 3h 12m 55s. Rate: 7.8 symbols/min [2025-10-22T18:49:10.317115] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:49:10.361218] [DEBUG] [LOCAL ] FNF: Loaded 48759 existing records from primary storage. [2025-10-22T18:49:10.361509] [INFO ] [MAIN ] FNF: Loaded 48759 existing records. [2025-10-22T18:49:10.518634] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-22T18:49:10.556854] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:49:10.571673] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-22T18:49:10.572897] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-22T18:49:10.574362] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T18:49:10.574539] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-22T18:49:10.584792] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-22T18:49:10.992518] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:49:11.317770] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-22T18:49:11.544217] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T18:49:12.117747] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-22T18:49:12.403553] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T18:49:12.466598] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T18:49:12.917725] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-22T18:49:13.681381] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T18:49:13.717722] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-22T18:49:14.316182] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T18:49:14.517720] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-22T18:49:15.317700] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-22T18:49:15.585688] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T18:49:16.117625] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-22T18:49:16.235250] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T18:49:16.412913] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T18:49:16.917746] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-22T18:49:17.717735] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-22T18:49:17.854137] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T18:49:18.517726] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-22T18:49:18.637730] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T18:49:19.114356] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T18:49:19.317700] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-22T18:49:20.117612] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-22T18:49:20.453532] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-22T18:49:20.917717] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-22T18:49:21.064895] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T18:49:21.696595] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T18:49:21.717606] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-22T18:49:22.517736] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-22T18:49:22.803082] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T18:49:22.812957] [INFO ] [REMOTE ] FNB: Full fetch complete (76231 records). [2025-10-22T18:49:22.813178] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-22T18:49:23.227255] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-22T18:49:23.227393] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-22T18:49:23.228765] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-22T18:49:23.228833] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-22T18:49:23.231194] [DEBUG] [LOCAL ] FNB: Trimmed 76231 records to 52602 (keeping 200 days of data) [2025-10-22T18:49:23.323015] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-22T18:49:23.585145] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T18:49:23.615552] [DEBUG] [LOCAL ] FNB: Primary data saved (52602 records). [2025-10-22T18:49:23.615698] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-22T18:49:23.615784] [INFO ] [MAIN ] Update Progress: 856/2367 symbols completed. FNB took 25.2s. Estimated remaining: 3h 12m 58s. Rate: 7.8 symbols/min [2025-10-22T18:49:23.785089] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:49:23.818334] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-22T18:49:23.864066] [DEBUG] [LOCAL ] FNV: Loaded 46145 existing records from primary storage. [2025-10-22T18:49:23.864354] [INFO ] [MAIN ] FNV: Loaded 46145 existing records. [2025-10-22T18:49:24.038607] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:49:24.038844] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-22T18:49:24.038892] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-22T18:49:24.039068] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-22T18:49:24.039105] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-22T18:49:24.127171] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-22T18:49:24.394447] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:49:24.925049] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-22T18:49:24.930925] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T18:49:25.717697] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-22T18:49:25.865337] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T18:49:26.518538] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-22T18:49:26.520808] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T18:49:27.175210] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T18:49:27.317720] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-22T18:49:28.117714] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-22T18:49:28.766160] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-22T18:49:28.917729] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-22T18:49:28.953243] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T18:49:29.705207] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T18:49:29.710868] [INFO ] [REMOTE ] FN: Full fetch complete (56451 records). [2025-10-22T18:49:29.710992] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-22T18:49:29.722954] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-22T18:49:30.102372] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-22T18:49:30.102475] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-22T18:49:30.103408] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-22T18:49:30.103474] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-22T18:49:30.104773] [DEBUG] [LOCAL ] FN: Trimmed 56451 records to 37392 (keeping 200 days of data) [2025-10-22T18:49:30.325193] [DEBUG] [LOCAL ] FN: Primary data saved (37392 records). [2025-10-22T18:49:30.325323] [INFO ] [MAIN ] FN: Full history saved. [2025-10-22T18:49:30.325886] [INFO ] [MAIN ] Update Progress: 857/2367 symbols completed. FN took 35.6s. Estimated remaining: 3h 12m 49s. Rate: 7.8 symbols/min [2025-10-22T18:49:30.493760] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:49:30.507701] [DEBUG] [LOCAL ] FOA: Loaded 13051 existing records from primary storage. [2025-10-22T18:49:30.507937] [INFO ] [MAIN ] FOA: Loaded 13051 existing records. [2025-10-22T18:49:30.538561] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-22T18:49:30.689937] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:49:30.690275] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-22T18:49:30.690405] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-22T18:49:30.690764] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-22T18:49:30.690845] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-22T18:49:30.906073] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T18:49:31.096559] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:49:31.169740] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T18:49:31.317629] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-22T18:49:32.117720] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-22T18:49:32.175227] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T18:49:32.474020] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T18:49:32.917740] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-22T18:49:33.448510] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T18:49:33.717708] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-22T18:49:34.517755] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-22T18:49:34.685493] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T18:49:35.250042] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T18:49:35.317706] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-22T18:49:35.357469] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T18:49:36.117710] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-22T18:49:36.917729] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-22T18:49:37.570583] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-22T18:49:37.579099] [INFO ] [REMOTE ] FND: Full fetch complete (75088 records). [2025-10-22T18:49:37.579211] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-22T18:49:37.720983] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-22T18:49:37.852701] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-22T18:49:38.009002] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-22T18:49:38.009202] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-22T18:49:38.010233] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-22T18:49:38.010368] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-22T18:49:38.011997] [DEBUG] [LOCAL ] FND: Trimmed 75088 records to 52075 (keeping 200 days of data) [2025-10-22T18:49:38.321902] [DEBUG] [LOCAL ] FND: Primary data saved (52075 records). [2025-10-22T18:49:38.322220] [INFO ] [MAIN ] FND: Full history saved. [2025-10-22T18:49:38.322403] [INFO ] [MAIN ] Update Progress: 858/2367 symbols completed. FND took 32.8s. Estimated remaining: 3h 12m 41s. Rate: 7.8 symbols/min [2025-10-22T18:49:38.507480] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:49:38.522617] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-22T18:49:38.535851] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-22T18:49:38.556287] [DEBUG] [LOCAL ] FOF: Loaded 8614 existing records from primary storage. [2025-10-22T18:49:38.556762] [INFO ] [MAIN ] FOF: Loaded 8614 existing records. [2025-10-22T18:49:38.744686] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:49:38.745054] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-22T18:49:38.745111] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-22T18:49:38.745352] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-22T18:49:38.745414] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-22T18:49:39.150115] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:49:39.317677] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-22T18:49:39.426320] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-22T18:49:39.603179] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T18:49:39.610927] [INFO ] [REMOTE ] FNF: Full fetch complete (70010 records). [2025-10-22T18:49:39.611060] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-22T18:49:39.990333] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-22T18:49:39.990438] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-22T18:49:39.991356] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-22T18:49:39.991431] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-22T18:49:39.992787] [DEBUG] [LOCAL ] FNF: Trimmed 70010 records to 48737 (keeping 200 days of data) [2025-10-22T18:49:40.161441] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-22T18:49:40.281977] [DEBUG] [LOCAL ] FNF: Primary data saved (48737 records). [2025-10-22T18:49:40.282120] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-22T18:49:40.282202] [INFO ] [MAIN ] Update Progress: 859/2367 symbols completed. FNF took 30.1s. Estimated remaining: 3h 12m 24s. Rate: 7.8 symbols/min [2025-10-22T18:49:40.446235] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:49:40.465767] [DEBUG] [LOCAL ] FOR: Loaded 19646 existing records from primary storage. [2025-10-22T18:49:40.466005] [INFO ] [MAIN ] FOR: Loaded 19646 existing records. [2025-10-22T18:49:40.641981] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:49:40.642239] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-22T18:49:40.642287] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-22T18:49:40.642518] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-22T18:49:40.642574] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-22T18:49:40.921994] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-22T18:49:41.008857] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:49:41.116830] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T18:49:41.133180] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T18:49:41.717706] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-22T18:49:41.810410] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T18:49:42.453543] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-22T18:49:42.517694] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-22T18:49:43.317687] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-22T18:49:44.073963] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-22T18:49:44.117626] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-22T18:49:44.215809] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T18:49:44.917632] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-22T18:49:45.184716] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T18:49:45.684335] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-22T18:49:45.717610] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-22T18:49:46.517632] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-22T18:49:46.624962] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-22T18:49:47.304045] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T18:49:47.317605] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-22T18:49:48.117619] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-22T18:49:48.362517] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T18:49:48.917690] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-22T18:49:49.548811] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T18:49:49.717631] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-22T18:49:49.970203] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T18:49:50.517632] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-22T18:49:50.788028] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-22T18:49:51.317720] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-22T18:49:51.731551] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-22T18:49:51.734184] [INFO ] [REMOTE ] FOA: Full fetch complete (21133 records). [2025-10-22T18:49:51.734257] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-22T18:49:52.115597] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-22T18:49:52.115834] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-22T18:49:52.116403] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-22T18:49:52.116482] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-22T18:49:52.122040] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-22T18:49:52.130910] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T18:49:52.130351] [DEBUG] [LOCAL ] FOA: Trimmed 21133 records to 13013 (keeping 200 days of data) [2025-10-22T18:49:52.212594] [DEBUG] [LOCAL ] FOA: Primary data saved (13013 records). [2025-10-22T18:49:52.212747] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-22T18:49:52.212832] [INFO ] [MAIN ] Update Progress: 860/2367 symbols completed. FOA took 21.9s. Estimated remaining: 3h 12m 24s. Rate: 7.8 symbols/min [2025-10-22T18:49:52.383085] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:49:52.428511] [DEBUG] [LOCAL ] FOUR: Loaded 49722 existing records from primary storage. [2025-10-22T18:49:52.428834] [INFO ] [MAIN ] FOUR: Loaded 49722 existing records. [2025-10-22T18:49:52.604993] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:49:52.605186] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-22T18:49:52.605236] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-22T18:49:52.605419] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-22T18:49:52.605458] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-22T18:49:52.926740] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-22T18:49:52.976465] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T18:49:52.975491] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:49:53.717694] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-22T18:49:54.250097] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T18:49:54.517702] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-22T18:49:55.311619] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T18:49:55.321156] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-22T18:49:55.550501] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T18:49:56.117696] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-22T18:49:56.888048] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T18:49:56.917610] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-22T18:49:57.059833] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T18:49:57.717802] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-22T18:49:58.335856] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T18:49:58.517688] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-22T18:49:59.317707] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-22T18:49:59.414406] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T18:50:00.117800] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-22T18:50:00.186085] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T18:50:00.368109] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-22T18:50:00.917743] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-22T18:50:01.717799] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-22T18:50:02.292473] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-22T18:50:02.517773] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-22T18:50:03.135937] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T18:50:03.318634] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-22T18:50:03.320903] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-22T18:50:03.329016] [INFO ] [REMOTE ] FNV: Full fetch complete (67016 records). [2025-10-22T18:50:03.329116] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-22T18:50:03.729256] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-22T18:50:03.729353] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-22T18:50:03.730189] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-22T18:50:03.730251] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-22T18:50:03.731576] [DEBUG] [LOCAL ] FNV: Trimmed 67016 records to 46129 (keeping 200 days of data) [2025-10-22T18:50:04.012493] [DEBUG] [LOCAL ] FNV: Primary data saved (46129 records). [2025-10-22T18:50:04.012611] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-22T18:50:04.012713] [INFO ] [MAIN ] Update Progress: 861/2367 symbols completed. FNV took 40.4s. Estimated remaining: 3h 12m 23s. Rate: 7.8 symbols/min [2025-10-22T18:50:04.122883] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-22T18:50:04.180131] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:50:04.198677] [DEBUG] [LOCAL ] FPF: Loaded 18753 existing records from primary storage. [2025-10-22T18:50:04.198916] [INFO ] [MAIN ] FPF: Loaded 18753 existing records. [2025-10-22T18:50:04.356349] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T18:50:04.385860] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:50:04.386069] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-22T18:50:04.386230] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-22T18:50:04.386507] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-22T18:50:04.386562] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-22T18:50:04.692868] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-22T18:50:04.777489] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:50:04.917611] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-22T18:50:05.104027] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-22T18:50:05.717734] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-22T18:50:06.266354] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T18:50:06.455692] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T18:50:06.517618] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-22T18:50:07.317704] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-22T18:50:07.369348] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-22T18:50:08.112300] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T18:50:08.117612] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-22T18:50:08.917705] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-22T18:50:09.717759] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-22T18:50:09.734034] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-22T18:50:09.736911] [INFO ] [REMOTE ] FOR: Full fetch complete (29650 records). [2025-10-22T18:50:09.736987] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-22T18:50:10.108552] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-22T18:50:10.108673] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-22T18:50:10.109265] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-22T18:50:10.109325] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-22T18:50:10.110048] [DEBUG] [LOCAL ] FOR: Trimmed 29650 records to 19506 (keeping 200 days of data) [2025-10-22T18:50:10.218177] [DEBUG] [LOCAL ] FOR: Primary data saved (19506 records). [2025-10-22T18:50:10.218323] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-22T18:50:10.218435] [INFO ] [MAIN ] Update Progress: 862/2367 symbols completed. FOR took 29.9s. Estimated remaining: 3h 12m 13s. Rate: 7.8 symbols/min [2025-10-22T18:50:10.382615] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:50:10.400590] [DEBUG] [LOCAL ] FPH: Loaded 19222 existing records from primary storage. [2025-10-22T18:50:10.400850] [INFO ] [MAIN ] FPH: Loaded 19222 existing records. [2025-10-22T18:50:10.522789] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-22T18:50:10.591807] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:50:10.592020] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-22T18:50:10.592069] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-22T18:50:10.592250] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-22T18:50:10.592307] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-22T18:50:10.957727] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:50:11.186283] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-22T18:50:11.270260] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-22T18:50:11.272154] [INFO ] [REMOTE ] FOF: Full fetch complete (11911 records). [2025-10-22T18:50:11.272223] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-22T18:50:11.325757] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-22T18:50:11.627764] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-22T18:50:11.627846] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-22T18:50:11.628200] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-22T18:50:11.628246] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-22T18:50:11.628704] [DEBUG] [LOCAL ] FOF: Trimmed 11911 records to 8391 (keeping 200 days of data) [2025-10-22T18:50:11.680585] [DEBUG] [LOCAL ] FOF: Primary data saved (8391 records). [2025-10-22T18:50:11.680790] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-22T18:50:11.680875] [INFO ] [MAIN ] Update Progress: 863/2367 symbols completed. FOF took 33.4s. Estimated remaining: 3h 11m 54s. Rate: 7.8 symbols/min [2025-10-22T18:50:11.847971] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T18:50:11.868176] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:50:11.899895] [DEBUG] [LOCAL ] FPI: Loaded 31413 existing records from primary storage. [2025-10-22T18:50:11.900151] [INFO ] [MAIN ] FPI: Loaded 31413 existing records. [2025-10-22T18:50:12.075051] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:50:12.075242] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-22T18:50:12.075288] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-22T18:50:12.075471] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-22T18:50:12.075526] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-22T18:50:12.128920] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-22T18:50:12.429550] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:50:12.917699] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-22T18:50:13.105633] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T18:50:13.509099] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T18:50:13.717698] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-22T18:50:14.325720] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T18:50:14.517701] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-22T18:50:14.599747] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-22T18:50:15.317628] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-22T18:50:15.395276] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-22T18:50:16.117698] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-22T18:50:16.637921] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T18:50:16.917734] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-22T18:50:17.059534] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T18:50:17.717739] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-22T18:50:18.517685] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-22T18:50:18.710533] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-22T18:50:18.879528] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-22T18:50:19.317761] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-22T18:50:19.830383] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T18:50:20.117697] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-22T18:50:20.917694] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-22T18:50:21.102445] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T18:50:21.175745] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T18:50:21.720687] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-22T18:50:22.304440] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T18:50:22.517760] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-22T18:50:23.317733] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-22T18:50:23.519758] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-22T18:50:23.802793] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-22T18:50:23.811392] [INFO ] [REMOTE ] FOUR: Full fetch complete (72260 records). [2025-10-22T18:50:23.811551] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-22T18:50:24.123299] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-22T18:50:24.221065] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-22T18:50:24.221142] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-22T18:50:24.221986] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-22T18:50:24.222047] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-22T18:50:24.223362] [DEBUG] [LOCAL ] FOUR: Trimmed 72260 records to 49712 (keeping 200 days of data) [2025-10-22T18:50:24.448996] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T18:50:24.548053] [DEBUG] [LOCAL ] FOUR: Primary data saved (49712 records). [2025-10-22T18:50:24.548229] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-22T18:50:24.548787] [INFO ] [MAIN ] Update Progress: 864/2367 symbols completed. FOUR took 32.3s. Estimated remaining: 3h 11m 56s. Rate: 7.8 symbols/min [2025-10-22T18:50:24.753811] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:50:24.795547] [DEBUG] [LOCAL ] FR: Loaded 46672 existing records from primary storage. [2025-10-22T18:50:24.795863] [INFO ] [MAIN ] FR: Loaded 46672 existing records. [2025-10-22T18:50:24.922750] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-22T18:50:24.986316] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:50:24.986596] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-22T18:50:24.986680] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-22T18:50:24.986874] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-22T18:50:24.986919] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-22T18:50:25.316992] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T18:50:25.382780] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:50:25.717742] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-22T18:50:25.975324] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T18:50:26.517695] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-22T18:50:26.692568] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-22T18:50:27.317746] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-22T18:50:27.989986] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:50:28.117705] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-22T18:50:28.678026] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T18:50:28.917626] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-22T18:50:29.103493] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T18:50:29.717747] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-22T18:50:30.146534] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T18:50:30.517722] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-22T18:50:31.110908] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-22T18:50:31.317696] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-22T18:50:31.530494] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T18:50:32.117707] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-22T18:50:32.498392] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T18:50:32.917629] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-22T18:50:33.243110] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T18:50:33.717730] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-22T18:50:34.517683] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-22T18:50:34.549321] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:50:34.739248] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T18:50:35.317623] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-22T18:50:35.467527] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-22T18:50:36.117727] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-22T18:50:36.917754] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-22T18:50:37.092853] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T18:50:37.120427] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T18:50:37.717706] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-22T18:50:38.214849] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T18:50:38.517720] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-22T18:50:39.103916] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T18:50:39.317716] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-22T18:50:39.794467] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T18:50:39.799807] [INFO ] [REMOTE ] FPI: Full fetch complete (43910 records). [2025-10-22T18:50:39.799922] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-22T18:50:40.126438] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-22T18:50:40.166335] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-22T18:50:40.166418] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-22T18:50:40.167093] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-22T18:50:40.167154] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-22T18:50:40.168187] [DEBUG] [LOCAL ] FPI: Trimmed 43910 records to 31375 (keeping 200 days of data) [2025-10-22T18:50:40.354518] [DEBUG] [LOCAL ] FPI: Primary data saved (31375 records). [2025-10-22T18:50:40.354718] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-22T18:50:40.354838] [INFO ] [MAIN ] Update Progress: 865/2367 symbols completed. FPI took 28.7s. Estimated remaining: 3h 12m 2s. Rate: 7.8 symbols/min [2025-10-22T18:50:40.521961] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:50:40.548345] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T18:50:40.570448] [DEBUG] [LOCAL ] FRA: Loaded 14225 existing records from primary storage. [2025-10-22T18:50:40.570704] [INFO ] [MAIN ] FRA: Loaded 14225 existing records. [2025-10-22T18:50:40.743195] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:50:40.743410] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-22T18:50:40.743467] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-22T18:50:40.743618] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-22T18:50:40.743696] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-22T18:50:40.925336] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-22T18:50:41.091793] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:50:41.152296] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T18:50:41.717690] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-22T18:50:42.238891] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T18:50:42.245042] [INFO ] [REMOTE ] FPF: Full fetch complete (26614 records). [2025-10-22T18:50:42.245166] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-22T18:50:42.522854] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-22T18:50:42.616639] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-22T18:50:42.616788] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-22T18:50:42.617295] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-22T18:50:42.617335] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-22T18:50:42.618169] [DEBUG] [LOCAL ] FPF: Trimmed 26614 records to 18735 (keeping 200 days of data) [2025-10-22T18:50:42.729999] [DEBUG] [LOCAL ] FPF: Primary data saved (18735 records). [2025-10-22T18:50:42.730135] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-22T18:50:42.730213] [INFO ] [MAIN ] Update Progress: 866/2367 symbols completed. FPF took 38.7s. Estimated remaining: 3h 11m 46s. Rate: 7.8 symbols/min [2025-10-22T18:50:42.899585] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:50:42.916186] [DEBUG] [LOCAL ] FRGE: Loaded 15653 existing records from primary storage. [2025-10-22T18:50:42.916408] [INFO ] [MAIN ] FRGE: Loaded 15653 existing records. [2025-10-22T18:50:43.096511] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:50:43.111129] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-22T18:50:43.111198] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-22T18:50:43.119581] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-22T18:50:43.119778] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-22T18:50:43.165461] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T18:50:43.323200] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-22T18:50:43.501268] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:50:43.523842] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T18:50:43.527181] [INFO ] [REMOTE ] FPH: Full fetch complete (30832 records). [2025-10-22T18:50:43.527256] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-22T18:50:43.881089] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-22T18:50:43.881160] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-22T18:50:43.881706] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-22T18:50:43.881767] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-22T18:50:43.882408] [DEBUG] [LOCAL ] FPH: Trimmed 30832 records to 19183 (keeping 200 days of data) [2025-10-22T18:50:43.985013] [DEBUG] [LOCAL ] FPH: Primary data saved (19183 records). [2025-10-22T18:50:43.985147] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-22T18:50:43.985225] [INFO ] [MAIN ] Update Progress: 867/2367 symbols completed. FPH took 33.8s. Estimated remaining: 3h 11m 27s. Rate: 7.8 symbols/min [2025-10-22T18:50:44.125390] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-22T18:50:44.157803] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:50:44.206387] [DEBUG] [LOCAL ] FRO: Loaded 51688 existing records from primary storage. [2025-10-22T18:50:44.206767] [INFO ] [MAIN ] FRO: Loaded 51688 existing records. [2025-10-22T18:50:44.384163] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:50:44.384339] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-22T18:50:44.384385] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-22T18:50:44.384549] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-22T18:50:44.384586] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-22T18:50:44.496831] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T18:50:44.771344] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:50:44.917720] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-22T18:50:45.438943] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T18:50:45.717699] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-22T18:50:46.365874] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T18:50:46.517737] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-22T18:50:47.085611] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T18:50:47.317629] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-22T18:50:48.117694] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-22T18:50:48.269319] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T18:50:48.375529] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T18:50:48.917735] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-22T18:50:49.717751] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-22T18:50:49.860398] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T18:50:49.908340] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T18:50:50.517782] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-22T18:50:51.082212] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T18:50:51.317782] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-22T18:50:51.993080] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T18:50:52.117748] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-22T18:50:52.565590] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-22T18:50:52.917720] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-22T18:50:53.676483] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T18:50:53.717760] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-22T18:50:53.978419] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T18:50:54.517755] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-22T18:50:55.317724] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-22T18:50:55.403805] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T18:50:55.423809] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T18:50:56.117796] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-22T18:50:56.850947] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T18:50:56.860151] [INFO ] [REMOTE ] FR: Full fetch complete (67234 records). [2025-10-22T18:50:56.860350] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-22T18:50:56.922946] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-22T18:50:56.999539] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T18:50:57.312788] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-22T18:50:57.312911] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-22T18:50:57.314841] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-22T18:50:57.314932] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-22T18:50:57.316936] [DEBUG] [LOCAL ] FR: Trimmed 67234 records to 46648 (keeping 200 days of data) [2025-10-22T18:50:57.635186] [DEBUG] [LOCAL ] FR: Primary data saved (46648 records). [2025-10-22T18:50:57.635389] [INFO ] [MAIN ] FR: Full history saved. [2025-10-22T18:50:57.636039] [INFO ] [MAIN ] Update Progress: 868/2367 symbols completed. FR took 33.1s. Estimated remaining: 3h 11m 29s. Rate: 7.8 symbols/min [2025-10-22T18:50:57.721278] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-22T18:50:57.832752] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:50:57.879123] [DEBUG] [LOCAL ] FRT: Loaded 41559 existing records from primary storage. [2025-10-22T18:50:57.879513] [INFO ] [MAIN ] FRT: Loaded 41559 existing records. [2025-10-22T18:50:57.976279] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-22T18:50:58.090359] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:50:58.090762] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-22T18:50:58.090834] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-22T18:50:58.091106] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-22T18:50:58.091182] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-22T18:50:58.475388] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:50:58.517687] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-22T18:50:58.754451] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T18:50:59.317714] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-22T18:50:59.675969] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T18:51:00.117743] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-22T18:51:00.854115] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T18:51:00.910003] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T18:51:00.917610] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-22T18:51:01.717741] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-22T18:51:01.896936] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T18:51:01.899356] [INFO ] [REMOTE ] FRGE: Full fetch complete (30170 records). [2025-10-22T18:51:01.899427] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-22T18:51:02.256978] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-22T18:51:02.257049] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-22T18:51:02.257557] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-22T18:51:02.257596] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-22T18:51:02.258258] [DEBUG] [LOCAL ] FRGE: Trimmed 30170 records to 15540 (keeping 200 days of data) [2025-10-22T18:51:02.345906] [DEBUG] [LOCAL ] FRGE: Primary data saved (15540 records). [2025-10-22T18:51:02.346035] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-22T18:51:02.346112] [INFO ] [MAIN ] Update Progress: 869/2367 symbols completed. FRGE took 19.6s. Estimated remaining: 3h 11m 17s. Rate: 7.8 symbols/min [2025-10-22T18:51:02.517615] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-22T18:51:02.517549] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:51:02.552142] [DEBUG] [LOCAL ] FSCO: Loaded 38651 existing records from primary storage. [2025-10-22T18:51:02.552405] [INFO ] [MAIN ] FSCO: Loaded 38651 existing records. [2025-10-22T18:51:02.723740] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:51:02.723986] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-22T18:51:02.724041] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-22T18:51:02.724206] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-22T18:51:02.724244] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-22T18:51:03.084017] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:51:03.317705] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-22T18:51:03.617611] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T18:51:03.943462] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T18:51:04.117789] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-22T18:51:04.499883] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T18:51:04.917756] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-22T18:51:05.397054] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T18:51:05.717745] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-22T18:51:06.026286] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T18:51:06.517715] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-22T18:51:07.317626] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-22T18:51:07.412956] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T18:51:07.906056] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T18:51:08.117693] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-22T18:51:08.917744] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-22T18:51:08.939586] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-22T18:51:09.282511] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-22T18:51:09.717746] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-22T18:51:09.999145] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T18:51:10.517706] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-22T18:51:11.317697] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-22T18:51:11.653866] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T18:51:11.735001] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T18:51:12.117723] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-22T18:51:12.501265] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T18:51:12.917730] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-22T18:51:13.613878] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T18:51:13.717637] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-22T18:51:13.780741] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T18:51:14.517685] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-22T18:51:15.317635] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-22T18:51:15.584980] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T18:51:15.935155] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T18:51:16.117722] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-22T18:51:16.362887] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T18:51:16.365550] [INFO ] [REMOTE ] FRA: Full fetch complete (23320 records). [2025-10-22T18:51:16.365622] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-22T18:51:16.724264] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-22T18:51:16.724341] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-22T18:51:16.724827] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-22T18:51:16.724890] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-22T18:51:16.725596] [DEBUG] [LOCAL ] FRA: Trimmed 23320 records to 14058 (keeping 200 days of data) [2025-10-22T18:51:16.808814] [DEBUG] [LOCAL ] FRA: Primary data saved (14058 records). [2025-10-22T18:51:16.808939] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-22T18:51:16.809020] [INFO ] [MAIN ] Update Progress: 870/2367 symbols completed. FRA took 36.5s. Estimated remaining: 3h 11m 21s. Rate: 7.8 symbols/min [2025-10-22T18:51:16.922768] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-22T18:51:16.984142] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:51:17.029853] [DEBUG] [LOCAL ] FSK: Loaded 49498 existing records from primary storage. [2025-10-22T18:51:17.030148] [INFO ] [MAIN ] FSK: Loaded 49498 existing records. [2025-10-22T18:51:17.246576] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:51:17.246888] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-22T18:51:17.246964] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-22T18:51:17.247206] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-22T18:51:17.247308] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-22T18:51:17.605698] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:51:17.717720] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-22T18:51:18.101395] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T18:51:18.247090] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T18:51:18.517695] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-22T18:51:19.182851] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:51:19.317753] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-22T18:51:20.075609] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T18:51:20.084420] [INFO ] [REMOTE ] FRO: Full fetch complete (75381 records). [2025-10-22T18:51:20.084591] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-22T18:51:20.127269] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-22T18:51:20.512187] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-22T18:51:20.512378] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-22T18:51:20.513504] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-22T18:51:20.513575] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-22T18:51:20.515230] [DEBUG] [LOCAL ] FRO: Trimmed 75381 records to 51679 (keeping 200 days of data) [2025-10-22T18:51:20.832828] [DEBUG] [LOCAL ] FRO: Primary data saved (51679 records). [2025-10-22T18:51:20.833012] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-22T18:51:20.833133] [INFO ] [MAIN ] Update Progress: 871/2367 symbols completed. FRO took 36.8s. Estimated remaining: 3h 11m 7s. Rate: 7.8 symbols/min [2025-10-22T18:51:20.932928] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-22T18:51:21.033277] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T18:51:21.032168] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:51:21.088250] [DEBUG] [LOCAL ] FSLY: Loaded 51318 existing records from primary storage. [2025-10-22T18:51:21.088602] [INFO ] [MAIN ] FSLY: Loaded 51318 existing records. [2025-10-22T18:51:21.260820] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:51:21.261048] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-22T18:51:21.261097] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-22T18:51:21.261303] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-22T18:51:21.261357] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-22T18:51:21.599409] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:51:21.717610] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-22T18:51:21.931268] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T18:51:22.021262] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T18:51:22.517745] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-22T18:51:23.317693] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-22T18:51:23.526833] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T18:51:23.902475] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T18:51:24.117677] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-22T18:51:24.795830] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T18:51:24.917766] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-22T18:51:25.377554] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T18:51:25.717761] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-22T18:51:26.517737] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-22T18:51:26.701594] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T18:51:27.317756] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-22T18:51:27.555533] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T18:51:28.117736] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-22T18:51:28.143587] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T18:51:28.917626] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-22T18:51:29.019565] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T18:51:29.724783] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-22T18:51:29.743011] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T18:51:30.520434] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-22T18:51:30.524393] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T18:51:31.317626] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-22T18:51:31.606030] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T18:51:32.117692] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-22T18:51:32.208073] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T18:51:32.215771] [INFO ] [REMOTE ] FSCO: Full fetch complete (55297 records). [2025-10-22T18:51:32.215915] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-22T18:51:32.606523] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-22T18:51:32.606621] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-22T18:51:32.607380] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-22T18:51:32.607430] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-22T18:51:32.608631] [DEBUG] [LOCAL ] FSCO: Trimmed 55297 records to 38527 (keeping 200 days of data) [2025-10-22T18:51:32.831543] [DEBUG] [LOCAL ] FSCO: Primary data saved (38527 records). [2025-10-22T18:51:32.831726] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-22T18:51:32.831819] [INFO ] [MAIN ] Update Progress: 872/2367 symbols completed. FSCO took 30.5s. Estimated remaining: 3h 11m 7s. Rate: 7.8 symbols/min [2025-10-22T18:51:32.928362] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-22T18:51:33.013429] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:51:33.041138] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T18:51:33.094920] [DEBUG] [LOCAL ] FSM: Loaded 53303 existing records from primary storage. [2025-10-22T18:51:33.095262] [INFO ] [MAIN ] FSM: Loaded 53303 existing records. [2025-10-22T18:51:33.274525] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:51:33.274778] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-22T18:51:33.274831] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-22T18:51:33.275052] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-22T18:51:33.275094] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-22T18:51:33.649204] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:51:33.717621] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-22T18:51:33.787803] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-22T18:51:34.148561] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T18:51:34.517706] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-22T18:51:35.317714] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-22T18:51:35.397250] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T18:51:36.091278] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T18:51:36.098134] [INFO ] [REMOTE ] FRT: Full fetch complete (60515 records). [2025-10-22T18:51:36.098420] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-22T18:51:36.123044] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-22T18:51:36.495408] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-22T18:51:36.495490] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-22T18:51:36.496288] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-22T18:51:36.496363] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-22T18:51:36.497565] [DEBUG] [LOCAL ] FRT: Trimmed 60515 records to 41468 (keeping 200 days of data) [2025-10-22T18:51:36.754587] [DEBUG] [LOCAL ] FRT: Primary data saved (41468 records). [2025-10-22T18:51:36.754746] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-22T18:51:36.755400] [INFO ] [MAIN ] Update Progress: 873/2367 symbols completed. FRT took 39.1s. Estimated remaining: 3h 10m 53s. Rate: 7.8 symbols/min [2025-10-22T18:51:36.919124] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-22T18:51:36.941402] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:51:36.971346] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T18:51:37.013073] [DEBUG] [LOCAL ] FSS: Loaded 33326 existing records from primary storage. [2025-10-22T18:51:37.013399] [INFO ] [MAIN ] FSS: Loaded 33326 existing records. [2025-10-22T18:51:37.198207] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:51:37.198470] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-22T18:51:37.198533] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-22T18:51:37.198821] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-22T18:51:37.198881] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-22T18:51:37.548807] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:51:37.717694] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-22T18:51:37.842284] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T18:51:38.517632] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-22T18:51:38.629983] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T18:51:38.982607] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T18:51:39.317681] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-22T18:51:40.117731] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-22T18:51:40.212070] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T18:51:40.917717] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-22T18:51:41.305287] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T18:51:41.717768] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-22T18:51:41.814339] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T18:51:42.475630] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T18:51:42.517635] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-22T18:51:43.317710] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-22T18:51:43.510349] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T18:51:44.117699] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-22T18:51:44.503259] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-22T18:51:44.511959] [INFO ] [REMOTE ] FSK: Full fetch complete (72130 records). [2025-10-22T18:51:44.512084] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-22T18:51:44.931857] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-22T18:51:44.956023] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-22T18:51:44.956434] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-22T18:51:44.958858] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-22T18:51:44.959163] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-22T18:51:44.984951] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T18:51:44.985137] [DEBUG] [LOCAL ] FSK: Trimmed 72130 records to 49476 (keeping 200 days of data) [2025-10-22T18:51:45.326157] [DEBUG] [LOCAL ] FSK: Primary data saved (49476 records). [2025-10-22T18:51:45.326434] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-22T18:51:45.326579] [INFO ] [MAIN ] Update Progress: 874/2367 symbols completed. FSK took 28.5s. Estimated remaining: 3h 10m 46s. Rate: 7.8 symbols/min [2025-10-22T18:51:45.499614] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:51:45.509273] [DEBUG] [LOCAL ] FT: Loaded 6765 existing records from primary storage. [2025-10-22T18:51:45.509494] [INFO ] [MAIN ] FT: Loaded 6765 existing records. [2025-10-22T18:51:45.686346] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:51:45.686690] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-22T18:51:45.686806] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-22T18:51:45.687042] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-22T18:51:45.687186] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-22T18:51:45.717888] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-22T18:51:45.970519] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T18:51:46.097162] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:51:46.517629] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-22T18:51:46.745151] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T18:51:47.161978] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-22T18:51:47.322757] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-22T18:51:47.337775] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T18:51:48.117690] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-22T18:51:48.749415] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-22T18:51:48.917756] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-22T18:51:49.170890] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T18:51:49.717709] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-22T18:51:50.337317] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T18:51:50.517729] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-22T18:51:51.293540] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T18:51:51.317619] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-22T18:51:51.816539] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T18:51:52.117718] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-22T18:51:52.724959] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T18:51:52.917634] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-22T18:51:53.023239] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T18:51:53.630948] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-22T18:51:53.717735] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-22T18:51:54.517714] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-22T18:51:55.317708] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-22T18:51:55.751387] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-22T18:51:55.760058] [INFO ] [REMOTE ] FSLY: Full fetch complete (74922 records). [2025-10-22T18:51:55.760189] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-22T18:51:56.117832] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-22T18:51:56.157304] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-22T18:51:56.157387] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-22T18:51:56.158549] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-22T18:51:56.158730] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-22T18:51:56.160319] [DEBUG] [LOCAL ] FSLY: Trimmed 74922 records to 51303 (keeping 200 days of data) [2025-10-22T18:51:56.261958] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T18:51:56.481842] [DEBUG] [LOCAL ] FSLY: Primary data saved (51303 records). [2025-10-22T18:51:56.482009] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-22T18:51:56.482121] [INFO ] [MAIN ] Update Progress: 875/2367 symbols completed. FSLY took 35.6s. Estimated remaining: 3h 10m 45s. Rate: 7.8 symbols/min [2025-10-22T18:51:56.648492] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:51:56.661797] [DEBUG] [LOCAL ] FTHY: Loaded 12518 existing records from primary storage. [2025-10-22T18:51:56.661994] [INFO ] [MAIN ] FTHY: Loaded 12518 existing records. [2025-10-22T18:51:56.844769] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:51:56.844930] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-22T18:51:56.844989] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-22T18:51:56.845143] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-22T18:51:56.845197] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-22T18:51:56.918752] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-22T18:51:57.009750] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T18:51:57.220575] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:51:57.253181] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T18:51:57.717768] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-22T18:51:58.282987] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T18:51:58.313166] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-22T18:51:58.517776] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-22T18:51:59.317705] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-22T18:52:00.117629] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-22T18:52:00.246889] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T18:52:00.289179] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T18:52:00.917718] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-22T18:52:01.281029] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T18:52:01.672932] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-22T18:52:01.717752] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-22T18:52:02.517744] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-22T18:52:02.604140] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-22T18:52:03.317693] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-22T18:52:03.351217] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T18:52:03.423278] [DEBUG] [REMOTE ] FSM: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-22T18:52:03.423736] [WARN ] [REMOTE ] FSM: No data returned for month 2025-09 [2025-10-22T18:52:03.423836] [FATAL] [REMOTE ] FSM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:52:03.423938] [FATAL] [MAIN ] FSM: Failed to fetch primary data. [2025-10-22T18:52:03.424007] [WARN ] [MAIN ] FSM: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:52:03.424060] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-22T18:52:03.424127] [DEBUG] [LOCAL ] FSM: No primary data file found to delete. [2025-10-22T18:52:03.424163] [INFO ] [LOCAL ] FSM: Starting deletion of derivative data. [2025-10-22T18:52:03.424549] [DEBUG] [LOCAL ] FSM: Deleted derivative data file. [2025-10-22T18:52:03.424950] [INFO ] [MAIN ] Update Progress: 876/2367 symbols completed. FSM took 30.6s. Estimated remaining: 3h 10m 36s. Rate: 7.8 symbols/min [2025-10-22T18:52:03.618123] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:52:03.665343] [DEBUG] [LOCAL ] FTI: Loaded 53293 existing records from primary storage. [2025-10-22T18:52:03.665711] [INFO ] [MAIN ] FTI: Loaded 53293 existing records. [2025-10-22T18:52:03.835897] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:52:03.836130] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-22T18:52:03.836211] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-22T18:52:03.836427] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-22T18:52:03.836482] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-22T18:52:04.122762] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-22T18:52:04.184546] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:52:04.917635] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-22T18:52:04.962022] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T18:52:05.427867] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-22T18:52:05.717728] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-22T18:52:06.517635] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-22T18:52:06.543608] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-22T18:52:06.545429] [INFO ] [REMOTE ] FT: Full fetch complete (9306 records). [2025-10-22T18:52:06.545519] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-22T18:52:06.894665] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-22T18:52:06.894767] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-22T18:52:06.895051] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-22T18:52:06.895098] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-22T18:52:06.895609] [DEBUG] [LOCAL ] FT: Trimmed 9306 records to 6800 (keeping 200 days of data) [2025-10-22T18:52:06.943918] [DEBUG] [LOCAL ] FT: Primary data saved (6800 records). [2025-10-22T18:52:06.944016] [INFO ] [MAIN ] FT: Full history saved. [2025-10-22T18:52:06.944090] [INFO ] [MAIN ] Update Progress: 877/2367 symbols completed. FT took 21.6s. Estimated remaining: 3h 10m 21s. Rate: 7.8 symbols/min [2025-10-22T18:52:07.317745] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-22T18:52:07.862348] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T18:52:07.867335] [INFO ] [REMOTE ] FSS: Full fetch complete (48525 records). [2025-10-22T18:52:07.867421] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-22T18:52:08.125046] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-22T18:52:08.235853] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-22T18:52:08.235936] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-22T18:52:08.236614] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-22T18:52:08.236685] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-22T18:52:08.237783] [DEBUG] [LOCAL ] FSS: Trimmed 48525 records to 33138 (keeping 200 days of data) [2025-10-22T18:52:08.439726] [DEBUG] [LOCAL ] FSS: Primary data saved (33138 records). [2025-10-22T18:52:08.439915] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-22T18:52:08.440489] [INFO ] [MAIN ] Update Progress: 878/2367 symbols completed. FSS took 31.7s. Estimated remaining: 3h 10m 3s. Rate: 7.8 symbols/min [2025-10-22T18:52:09.168683] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T18:52:09.181489] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-22T18:52:09.181952] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T18:52:09.717685] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-22T18:52:10.477138] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T18:52:10.517618] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-22T18:52:10.802596] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T18:52:11.271298] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-22T18:52:11.317730] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-22T18:52:11.873854] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T18:52:12.117703] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-22T18:52:12.917728] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-22T18:52:12.949465] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T18:52:13.717754] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-22T18:52:14.699601] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T18:52:14.720911] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-22T18:52:14.722525] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T18:52:15.317751] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-22T18:52:16.373325] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T18:52:16.376177] [INFO ] [REMOTE ] FTHY: Full fetch complete (17333 records). [2025-10-22T18:52:16.376250] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-22T18:52:16.708090] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T18:52:16.759606] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-22T18:52:16.784884] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-22T18:52:16.784948] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-22T18:52:16.785328] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-22T18:52:16.785365] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-22T18:52:16.785893] [DEBUG] [LOCAL ] FTHY: Trimmed 17333 records to 12294 (keeping 200 days of data) [2025-10-22T18:52:16.859239] [DEBUG] [LOCAL ] FTHY: Primary data saved (12294 records). [2025-10-22T18:52:16.859360] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-22T18:52:16.859435] [INFO ] [MAIN ] Update Progress: 879/2367 symbols completed. FTHY took 20.4s. Estimated remaining: 3h 9m 57s. Rate: 7.8 symbols/min [2025-10-22T18:52:18.673140] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T18:52:18.684843] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-22T18:52:20.413363] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T18:52:20.426212] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-22T18:52:22.091298] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T18:52:22.103877] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-22T18:52:23.898550] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T18:52:23.909948] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-22T18:52:25.503143] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T18:52:25.515408] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-22T18:52:27.727749] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-22T18:52:27.736527] [INFO ] [REMOTE ] FTI: Full fetch complete (77331 records). [2025-10-22T18:52:27.736718] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-22T18:52:28.120452] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-22T18:52:28.120555] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-22T18:52:28.121464] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-22T18:52:28.121525] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-22T18:52:28.123047] [DEBUG] [LOCAL ] FTI: Trimmed 77331 records to 53293 (keeping 200 days of data) [2025-10-22T18:52:28.431313] [DEBUG] [LOCAL ] FTI: Primary data saved (53293 records). [2025-10-22T18:52:28.431464] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-22T18:52:28.431545] [INFO ] [MAIN ] Update Progress: 880/2367 symbols completed. FTI took 25.0s. Estimated remaining: 3h 9m 55s. Rate: 7.8 symbols/min [2025-10-22T18:52:29.099364] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:52:29.047277] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:52:29.157457] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:52:29.190805] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:52:29.196474] [DEBUG] [LOCAL ] FTWO: Loaded 1964 existing records from primary storage. [2025-10-22T18:52:29.197014] [INFO ] [MAIN ] FTWO: Loaded 1964 existing records. [2025-10-22T18:52:29.380853] [DEBUG] [LOCAL ] FTK: Loaded 32948 existing records from primary storage. [2025-10-22T18:52:29.400720] [INFO ] [MAIN ] FTK: Loaded 32948 existing records. [2025-10-22T18:52:29.435670] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:52:29.548467] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-22T18:52:29.548181] [DEBUG] [LOCAL ] FTS: Loaded 42523 existing records from primary storage. [2025-10-22T18:52:29.559221] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-22T18:52:29.576181] [DEBUG] [LOCAL ] FTV: Loaded 53034 existing records from primary storage. [2025-10-22T18:52:29.576528] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-22T18:52:29.576396] [INFO ] [MAIN ] FTS: Loaded 42523 existing records. [2025-10-22T18:52:29.601683] [INFO ] [MAIN ] FTV: Loaded 53034 existing records. [2025-10-22T18:52:29.611679] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-22T18:52:29.991967] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:52:30.037928] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-22T18:52:30.038162] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-22T18:52:30.111923] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:52:30.166215] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-22T18:52:30.152484] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-22T18:52:30.198219] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-22T18:52:30.237922] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-22T18:52:30.247911] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:52:30.264344] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-22T18:52:30.264084] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-22T18:52:30.296120] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-22T18:52:30.380963] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-22T18:52:30.406957] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-22T18:52:30.457927] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-22T18:52:30.807108] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:52:30.894270] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-22T18:52:31.427704] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:52:31.526067] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:52:31.536776] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-22T18:52:31.521545] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-22T18:52:31.658679] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:52:31.661446] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-22T18:52:31.665508] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T18:52:31.671557] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-22T18:52:32.132740] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T18:52:32.134012] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-22T18:52:32.674603] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-22T18:52:32.675804] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-22T18:52:32.691154] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T18:52:32.696664] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-22T18:52:33.077129] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T18:52:33.085308] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-22T18:52:33.113037] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-22T18:52:33.114193] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-22T18:52:33.416614] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T18:52:33.426890] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-22T18:52:33.506117] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-22T18:52:33.507145] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-22T18:52:33.697763] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-22T18:52:33.702583] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-22T18:52:34.034437] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-22T18:52:34.035793] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-22T18:52:34.229401] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-22T18:52:34.237522] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-22T18:52:34.466494] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-22T18:52:34.467951] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-22T18:52:34.530811] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T18:52:34.537282] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-22T18:52:34.921487] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-22T18:52:34.922702] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-22T18:52:35.102388] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T18:52:35.317719] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-22T18:52:35.366682] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T18:52:35.644761] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T18:52:35.703411] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T18:52:36.117634] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-22T18:52:36.917625] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-22T18:52:37.076547] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T18:52:37.649006] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T18:52:37.717612] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-22T18:52:38.231621] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-22T18:52:38.232669] [INFO ] [REMOTE ] FTWO: Full fetch complete (3335 records). [2025-10-22T18:52:38.232740] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-22T18:52:38.428625] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T18:52:38.522711] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-22T18:52:38.629688] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-22T18:52:38.629773] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-22T18:52:38.629903] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-22T18:52:38.629943] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-22T18:52:38.630281] [DEBUG] [LOCAL ] FTWO: Trimmed 3335 records to 1949 (keeping 200 days of data) [2025-10-22T18:52:38.642345] [DEBUG] [LOCAL ] FTWO: Primary data saved (1949 records). [2025-10-22T18:52:38.642422] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-22T18:52:38.642493] [INFO ] [MAIN ] Update Progress: 881/2367 symbols completed. FTWO took 10.2s. Estimated remaining: 3h 9m 52s. Rate: 7.8 symbols/min [2025-10-22T18:52:38.809260] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:52:38.857729] [DEBUG] [LOCAL ] FUBO: Loaded 53718 existing records from primary storage. [2025-10-22T18:52:38.858083] [INFO ] [MAIN ] FUBO: Loaded 53718 existing records. [2025-10-22T18:52:39.036891] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:52:39.037108] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-22T18:52:39.037162] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-22T18:52:39.037374] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-22T18:52:39.037432] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-22T18:52:39.322729] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-22T18:52:39.389688] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:52:40.117614] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-22T18:52:40.153440] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T18:52:40.728562] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T18:52:40.917692] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-22T18:52:41.717626] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-22T18:52:41.895854] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T18:52:42.517737] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-22T18:52:42.766384] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T18:52:42.848067] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T18:52:43.317716] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-22T18:52:44.117617] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-22T18:52:44.620382] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-22T18:52:44.917730] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-22T18:52:44.987236] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T18:52:45.513911] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T18:52:45.717629] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-22T18:52:46.285880] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T18:52:46.517728] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-22T18:52:47.317687] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-22T18:52:47.482420] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T18:52:48.117711] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-22T18:52:48.917731] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-22T18:52:49.100058] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T18:52:49.308778] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.79 seconds). [2025-10-22T18:52:49.717731] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-22T18:52:50.414158] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T18:52:50.496983] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-22T18:52:50.517628] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-22T18:52:51.317699] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-22T18:52:51.853198] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-22T18:52:52.117755] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-22T18:52:52.333393] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T18:52:52.611946] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-22T18:52:52.617817] [INFO ] [REMOTE ] FTK: Full fetch complete (43995 records). [2025-10-22T18:52:52.618003] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-22T18:52:52.922777] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-22T18:52:52.996628] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-22T18:52:52.996758] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-22T18:52:52.997464] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-22T18:52:52.997508] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-22T18:52:52.998630] [DEBUG] [LOCAL ] FTK: Trimmed 43995 records to 32937 (keeping 200 days of data) [2025-10-22T18:52:53.187858] [DEBUG] [LOCAL ] FTK: Primary data saved (32937 records). [2025-10-22T18:52:53.188004] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-22T18:52:53.188087] [INFO ] [MAIN ] Update Progress: 882/2367 symbols completed. FTK took 24.8s. Estimated remaining: 3h 9m 56s. Rate: 7.8 symbols/min [2025-10-22T18:52:53.357900] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:52:53.389927] [DEBUG] [LOCAL ] FUL: Loaded 31998 existing records from primary storage. [2025-10-22T18:52:53.390231] [INFO ] [MAIN ] FUL: Loaded 31998 existing records. [2025-10-22T18:52:53.600411] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:52:53.600933] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-22T18:52:53.601059] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-22T18:52:53.601384] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-22T18:52:53.601463] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-22T18:52:53.647085] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-22T18:52:53.718343] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-22T18:52:54.131221] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:52:54.517764] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-22T18:52:55.268636] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-22T18:52:55.317599] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-22T18:52:55.513016] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T18:52:55.989860] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:52:56.117730] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-22T18:52:56.917742] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-22T18:52:57.547246] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-22T18:52:57.717639] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-22T18:52:57.867500] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T18:52:57.876075] [INFO ] [REMOTE ] FTV: Full fetch complete (76620 records). [2025-10-22T18:52:57.876196] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-22T18:52:58.280303] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-22T18:52:58.280417] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-22T18:52:58.281415] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-22T18:52:58.281562] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-22T18:52:58.299579] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T18:52:58.305929] [DEBUG] [LOCAL ] FTV: Trimmed 76620 records to 53022 (keeping 200 days of data) [2025-10-22T18:52:58.517719] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-22T18:52:58.622114] [DEBUG] [LOCAL ] FTV: Primary data saved (53022 records). [2025-10-22T18:52:58.622254] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-22T18:52:58.622334] [INFO ] [MAIN ] Update Progress: 883/2367 symbols completed. FTV took 30.2s. Estimated remaining: 3h 9m 45s. Rate: 7.8 symbols/min [2025-10-22T18:52:58.789157] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:52:58.841255] [DEBUG] [LOCAL ] FUN: Loaded 52023 existing records from primary storage. [2025-10-22T18:52:58.842485] [INFO ] [MAIN ] FUN: Loaded 52023 existing records. [2025-10-22T18:52:59.034563] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:52:59.034789] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-22T18:52:59.034838] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-22T18:52:59.035032] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-22T18:52:59.035085] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-22T18:52:59.317897] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-22T18:52:59.391677] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:52:59.410708] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T18:52:59.417958] [INFO ] [REMOTE ] FTS: Full fetch complete (60815 records). [2025-10-22T18:52:59.418077] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-22T18:52:59.822605] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-22T18:52:59.822709] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-22T18:52:59.823475] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-22T18:52:59.823515] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-22T18:52:59.824698] [DEBUG] [LOCAL ] FTS: Trimmed 60815 records to 42482 (keeping 200 days of data) [2025-10-22T18:53:00.087746] [DEBUG] [LOCAL ] FTS: Primary data saved (42482 records). [2025-10-22T18:53:00.087876] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-22T18:53:00.088311] [INFO ] [MAIN ] Update Progress: 884/2367 symbols completed. FTS took 31.7s. Estimated remaining: 3h 9m 27s. Rate: 7.8 symbols/min [2025-10-22T18:53:00.122881] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-22T18:53:00.279816] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:53:00.303513] [DEBUG] [LOCAL ] FVR: Loaded 20869 existing records from primary storage. [2025-10-22T18:53:00.303876] [INFO ] [MAIN ] FVR: Loaded 20869 existing records. [2025-10-22T18:53:00.497605] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:53:00.497926] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-22T18:53:00.497976] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-22T18:53:00.498163] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-22T18:53:00.498210] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-22T18:53:00.906567] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:53:00.909452] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-22T18:53:00.921610] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-22T18:53:00.946350] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:53:01.689682] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T18:53:01.717702] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-22T18:53:02.099678] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T18:53:02.517716] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-22T18:53:03.317713] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-22T18:53:03.342836] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T18:53:04.117735] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-22T18:53:04.847064] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T18:53:04.861565] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-22T18:53:04.917633] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-22T18:53:05.125211] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T18:53:05.717750] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-22T18:53:06.520183] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-22T18:53:06.523591] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T18:53:07.317757] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-22T18:53:07.797699] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-22T18:53:07.832972] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T18:53:08.117724] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-22T18:53:08.725729] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T18:53:08.917718] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-22T18:53:09.319391] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T18:53:09.717733] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-22T18:53:10.517637] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-22T18:53:10.596598] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T18:53:10.840273] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T18:53:11.317762] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-22T18:53:12.117781] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-22T18:53:12.777459] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-22T18:53:12.917750] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-22T18:53:13.085362] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T18:53:13.704488] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T18:53:13.717625] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-22T18:53:13.936740] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-22T18:53:14.517729] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-22T18:53:14.948769] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T18:53:15.317695] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-22T18:53:15.451100] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-22T18:53:16.117747] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-22T18:53:16.861834] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T18:53:16.917706] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-22T18:53:17.196861] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T18:53:17.717755] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-22T18:53:18.452183] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T18:53:18.517616] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-22T18:53:19.317750] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-22T18:53:20.117717] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-22T18:53:20.172741] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-22T18:53:20.181915] [INFO ] [REMOTE ] FUBO: Full fetch complete (77870 records). [2025-10-22T18:53:20.182069] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-22T18:53:20.496051] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T18:53:20.624784] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-22T18:53:20.624883] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-22T18:53:20.625841] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-22T18:53:20.625905] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-22T18:53:20.627563] [DEBUG] [LOCAL ] FUBO: Trimmed 77870 records to 53718 (keeping 200 days of data) [2025-10-22T18:53:20.872869] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T18:53:20.914437] [INFO ] [REMOTE ] FUL: Full fetch complete (47781 records). [2025-10-22T18:53:20.914893] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-22T18:53:20.933143] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-22T18:53:21.048542] [DEBUG] [LOCAL ] FUBO: Primary data saved (53718 records). [2025-10-22T18:53:21.080883] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-22T18:53:21.081015] [INFO ] [MAIN ] Update Progress: 885/2367 symbols completed. FUBO took 42.4s. Estimated remaining: 3h 9m 41s. Rate: 7.8 symbols/min [2025-10-22T18:53:21.429123] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:53:21.555503] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T18:53:21.631086] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-22T18:53:21.631173] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-22T18:53:21.631865] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-22T18:53:21.631929] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-22T18:53:21.633120] [DEBUG] [LOCAL ] FUL: Trimmed 47781 records to 31986 (keeping 200 days of data) [2025-10-22T18:53:21.736743] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-22T18:53:21.761841] [DEBUG] [LOCAL ] FVRR: Loaded 40625 existing records from primary storage. [2025-10-22T18:53:21.776581] [INFO ] [MAIN ] FVRR: Loaded 40625 existing records. [2025-10-22T18:53:22.002112] [DEBUG] [LOCAL ] FUL: Primary data saved (31986 records). [2025-10-22T18:53:22.010874] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-22T18:53:22.011317] [INFO ] [MAIN ] Update Progress: 886/2367 symbols completed. FUL took 28.8s. Estimated remaining: 3h 9m 22s. Rate: 7.8 symbols/min [2025-10-22T18:53:22.099739] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:53:22.126562] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-22T18:53:22.134472] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-22T18:53:22.137060] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-22T18:53:22.152734] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-22T18:53:22.313371] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:53:22.381399] [DEBUG] [LOCAL ] FXED: Loaded 1238 existing records from primary storage. [2025-10-22T18:53:22.398192] [INFO ] [MAIN ] FXED: Loaded 1238 existing records. [2025-10-22T18:53:22.722913] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:53:22.776876] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-22T18:53:22.777221] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-22T18:53:22.776765] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:53:22.777729] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-22T18:53:22.777878] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-22T18:53:22.778816] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-22T18:53:22.907059] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T18:53:23.162725] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:53:23.177780] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-22T18:53:23.186332] [INFO ] [REMOTE ] FUN: Full fetch complete (73532 records). [2025-10-22T18:53:23.186446] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-22T18:53:23.322727] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-22T18:53:23.573285] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-22T18:53:23.573367] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-22T18:53:23.574245] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-22T18:53:23.574308] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-22T18:53:23.575716] [DEBUG] [LOCAL ] FUN: Trimmed 73532 records to 52023 (keeping 200 days of data) [2025-10-22T18:53:23.856945] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-22T18:53:23.878797] [DEBUG] [LOCAL ] FUN: Primary data saved (52023 records). [2025-10-22T18:53:23.878941] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-22T18:53:23.879024] [INFO ] [MAIN ] Update Progress: 887/2367 symbols completed. FUN took 25.3s. Estimated remaining: 3h 9m 5s. Rate: 7.8 symbols/min [2025-10-22T18:53:24.051427] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:53:24.094817] [DEBUG] [LOCAL ] G: Loaded 50109 existing records from primary storage. [2025-10-22T18:53:24.095276] [INFO ] [MAIN ] G: Loaded 50109 existing records. [2025-10-22T18:53:24.124292] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-22T18:53:24.283430] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:53:24.283984] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-22T18:53:24.284224] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-22T18:53:24.295555] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-22T18:53:24.315220] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-22T18:53:24.381420] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T18:53:24.701745] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:53:24.917613] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-22T18:53:25.268391] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T18:53:25.717732] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-22T18:53:26.148806] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-22T18:53:26.442191] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T18:53:26.517747] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-22T18:53:26.870622] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-22T18:53:27.317691] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-22T18:53:28.117722] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-22T18:53:28.864943] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T18:53:28.917616] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-22T18:53:29.102361] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-22T18:53:29.717750] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-22T18:53:30.517632] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-22T18:53:30.578882] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T18:53:30.741592] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T18:53:30.744894] [INFO ] [REMOTE ] FVR: Full fetch complete (29331 records). [2025-10-22T18:53:30.744982] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-22T18:53:31.146001] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-22T18:53:31.146079] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-22T18:53:31.146731] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-22T18:53:31.146793] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-22T18:53:31.147604] [DEBUG] [LOCAL ] FVR: Trimmed 29331 records to 20820 (keeping 200 days of data) [2025-10-22T18:53:31.274858] [DEBUG] [LOCAL ] FVR: Primary data saved (20820 records). [2025-10-22T18:53:31.274980] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-22T18:53:31.275056] [INFO ] [MAIN ] Update Progress: 888/2367 symbols completed. FVR took 31.2s. Estimated remaining: 3h 8m 57s. Rate: 7.8 symbols/min [2025-10-22T18:53:31.322748] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-22T18:53:31.444748] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:53:31.470582] [DEBUG] [LOCAL ] GAB: Loaded 27631 existing records from primary storage. [2025-10-22T18:53:31.470891] [INFO ] [MAIN ] GAB: Loaded 27631 existing records. [2025-10-22T18:53:31.649509] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:53:31.649743] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-22T18:53:31.649796] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-22T18:53:31.650002] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-22T18:53:31.650057] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-22T18:53:31.765754] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-22T18:53:32.035711] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:53:32.117908] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-22T18:53:32.118847] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T18:53:32.917719] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-22T18:53:33.717627] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-22T18:53:33.871511] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T18:53:34.237698] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T18:53:34.517714] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-22T18:53:35.219356] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T18:53:35.317722] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-22T18:53:36.117744] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-22T18:53:36.248995] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T18:53:36.754293] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T18:53:36.898106] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T18:53:36.917611] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-22T18:53:37.717717] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-22T18:53:38.067774] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-22T18:53:38.400236] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-22T18:53:38.517705] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-22T18:53:39.317707] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-22T18:53:39.764368] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-22T18:53:39.904425] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T18:53:40.117698] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-22T18:53:40.539396] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-22T18:53:40.917692] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-22T18:53:41.339040] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-22T18:53:41.717713] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-22T18:53:42.517703] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-22T18:53:42.994595] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-22T18:53:42.995368] [INFO ] [REMOTE ] FXED: Full fetch complete (1791 records). [2025-10-22T18:53:42.995454] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-22T18:53:43.323315] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-22T18:53:43.353471] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-22T18:53:43.353627] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-22T18:53:43.353769] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-22T18:53:43.353843] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-22T18:53:43.354492] [DEBUG] [LOCAL ] FXED: Trimmed 1791 records to 1227 (keeping 200 days of data) [2025-10-22T18:53:43.363545] [DEBUG] [LOCAL ] FXED: Primary data saved (1227 records). [2025-10-22T18:53:43.363735] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-22T18:53:43.363836] [INFO ] [MAIN ] Update Progress: 889/2367 symbols completed. FXED took 21.4s. Estimated remaining: 3h 8m 56s. Rate: 7.8 symbols/min [2025-10-22T18:53:43.487838] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T18:53:43.581043] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:53:43.588028] [DEBUG] [LOCAL ] GAM: Loaded 3873 existing records from primary storage. [2025-10-22T18:53:43.588238] [INFO ] [MAIN ] GAM: Loaded 3873 existing records. [2025-10-22T18:53:43.771424] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:53:43.771678] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-22T18:53:43.771758] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-22T18:53:43.771944] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-22T18:53:43.772002] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-22T18:53:44.121313] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-22T18:53:44.125664] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:53:44.917751] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-22T18:53:45.098925] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T18:53:45.298520] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T18:53:45.717711] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-22T18:53:45.993308] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T18:53:46.517721] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-22T18:53:47.249370] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T18:53:47.317638] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-22T18:53:48.122775] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-22T18:53:48.137081] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T18:53:48.684678] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-22T18:53:48.761508] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T18:53:48.917741] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-22T18:53:49.628516] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-22T18:53:49.717701] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-22T18:53:50.517749] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-22T18:53:51.110341] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T18:53:51.317742] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-22T18:53:51.922162] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T18:53:52.117609] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-22T18:53:52.917696] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-22T18:53:53.073928] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T18:53:53.537987] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-22T18:53:53.717702] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-22T18:53:53.784735] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T18:53:53.791514] [INFO ] [REMOTE ] FVRR: Full fetch complete (59204 records). [2025-10-22T18:53:53.791634] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-22T18:53:54.172623] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-22T18:53:54.172744] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-22T18:53:54.173536] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-22T18:53:54.173598] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-22T18:53:54.174701] [DEBUG] [LOCAL ] FVRR: Trimmed 59204 records to 40496 (keeping 200 days of data) [2025-10-22T18:53:54.401710] [DEBUG] [LOCAL ] FVRR: Primary data saved (40496 records). [2025-10-22T18:53:54.401839] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-22T18:53:54.401914] [INFO ] [MAIN ] Update Progress: 890/2367 symbols completed. FVRR took 33.3s. Estimated remaining: 3h 8m 54s. Rate: 7.8 symbols/min [2025-10-22T18:53:54.522770] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-22T18:53:54.577461] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:53:54.627630] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-22T18:53:54.628004] [INFO ] [MAIN ] GAP: Loaded 53653 existing records. [2025-10-22T18:53:54.819429] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:53:54.819580] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-22T18:53:54.819629] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-22T18:53:54.820626] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-22T18:53:54.820710] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-22T18:53:55.210871] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:53:55.265792] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T18:53:55.317615] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-22T18:53:55.771858] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T18:53:56.117759] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-22T18:53:56.917712] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-22T18:53:57.164250] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T18:53:57.172857] [INFO ] [REMOTE ] G: Full fetch complete (72298 records). [2025-10-22T18:53:57.173015] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-22T18:53:57.560069] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-22T18:53:57.562631] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-22T18:53:57.563563] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-22T18:53:57.564729] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-22T18:53:57.565618] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T18:53:57.567976] [DEBUG] [LOCAL ] G: Trimmed 72298 records to 50090 (keeping 200 days of data) [2025-10-22T18:53:57.738614] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-22T18:53:57.827409] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T18:53:57.914794] [DEBUG] [LOCAL ] G: Primary data saved (50090 records). [2025-10-22T18:53:57.914924] [INFO ] [MAIN ] G: Full history saved. [2025-10-22T18:53:57.915003] [INFO ] [MAIN ] Update Progress: 891/2367 symbols completed. G took 34.0s. Estimated remaining: 3h 8m 40s. Rate: 7.8 symbols/min [2025-10-22T18:53:58.081244] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:53:58.098948] [DEBUG] [LOCAL ] GATX: Loaded 18144 existing records from primary storage. [2025-10-22T18:53:58.099181] [INFO ] [MAIN ] GATX: Loaded 18144 existing records. [2025-10-22T18:53:58.290955] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:53:58.291189] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-22T18:53:58.291235] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-22T18:53:58.291493] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-22T18:53:58.291530] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-22T18:53:58.525798] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-22T18:53:58.644135] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:53:58.926883] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T18:53:59.317698] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-22T18:53:59.904820] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T18:53:59.925388] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-22T18:54:00.120574] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-22T18:54:00.917630] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-22T18:54:01.438466] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T18:54:01.717695] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-22T18:54:02.287190] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-22T18:54:02.517734] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-22T18:54:02.855939] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T18:54:03.317633] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-22T18:54:03.648160] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T18:54:03.992937] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-22T18:54:04.117689] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-22T18:54:04.694104] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T18:54:04.917688] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-22T18:54:05.717639] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-22T18:54:05.775590] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T18:54:06.517716] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-22T18:54:07.317681] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-22T18:54:07.477350] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T18:54:07.535119] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T18:54:07.953593] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-22T18:54:08.117758] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-22T18:54:08.917728] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-22T18:54:09.432928] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T18:54:09.437710] [INFO ] [REMOTE ] GAB: Full fetch complete (39416 records). [2025-10-22T18:54:09.437823] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-22T18:54:09.724620] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-22T18:54:09.817131] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-22T18:54:09.817210] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-22T18:54:09.817930] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-22T18:54:09.817992] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-22T18:54:09.818871] [DEBUG] [LOCAL ] GAB: Trimmed 39416 records to 27447 (keeping 200 days of data) [2025-10-22T18:54:09.978345] [DEBUG] [LOCAL ] GAB: Primary data saved (27447 records). [2025-10-22T18:54:09.978476] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-22T18:54:09.978557] [INFO ] [MAIN ] Update Progress: 892/2367 symbols completed. GAB took 38.7s. Estimated remaining: 3h 8m 39s. Rate: 7.8 symbols/min [2025-10-22T18:54:10.145963] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:54:10.160083] [DEBUG] [LOCAL ] GBAB: Loaded 12766 existing records from primary storage. [2025-10-22T18:54:10.160307] [INFO ] [MAIN ] GBAB: Loaded 12766 existing records. [2025-10-22T18:54:10.334161] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:54:10.334358] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-22T18:54:10.334405] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-22T18:54:10.334546] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-22T18:54:10.334583] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-22T18:54:10.439007] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T18:54:10.448701] [INFO ] [REMOTE ] GAM: Full fetch complete (6464 records). [2025-10-22T18:54:10.448831] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-22T18:54:10.529608] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-22T18:54:10.964432] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:54:11.117349] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-22T18:54:11.117488] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-22T18:54:11.117811] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-22T18:54:11.117905] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-22T18:54:11.118494] [DEBUG] [LOCAL ] GAM: Trimmed 6464 records to 3825 (keeping 200 days of data) [2025-10-22T18:54:11.168565] [DEBUG] [LOCAL ] GAM: Primary data saved (3825 records). [2025-10-22T18:54:11.169312] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-22T18:54:11.170469] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-22T18:54:11.170725] [INFO ] [MAIN ] Update Progress: 893/2367 symbols completed. GAM took 27.8s. Estimated remaining: 3h 8m 21s. Rate: 7.8 symbols/min [2025-10-22T18:54:11.325476] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-22T18:54:11.359167] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:54:11.395553] [DEBUG] [LOCAL ] GBCI: Loaded 41232 existing records from primary storage. [2025-10-22T18:54:11.395883] [INFO ] [MAIN ] GBCI: Loaded 41232 existing records. [2025-10-22T18:54:11.575808] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:54:11.576095] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-22T18:54:11.576148] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-22T18:54:11.576400] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-22T18:54:11.576437] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-22T18:54:11.902119] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-22T18:54:11.970936] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:54:12.051439] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T18:54:12.117614] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-22T18:54:12.878579] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T18:54:12.917622] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-22T18:54:13.717721] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-22T18:54:14.366667] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T18:54:14.517730] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-22T18:54:15.317711] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-22T18:54:15.805099] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-22T18:54:16.117721] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-22T18:54:16.450678] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-22T18:54:16.494043] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-22T18:54:16.917702] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-22T18:54:17.717621] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-22T18:54:17.875786] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-22T18:54:18.064180] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T18:54:18.464420] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-22T18:54:18.517738] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-22T18:54:19.317693] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-22T18:54:19.516989] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T18:54:20.117761] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-22T18:54:20.777496] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T18:54:20.917718] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-22T18:54:21.189714] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-22T18:54:21.717752] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-22T18:54:21.806103] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T18:54:22.517752] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-22T18:54:23.196427] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-22T18:54:23.221450] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T18:54:23.317625] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-22T18:54:24.117746] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-22T18:54:24.814493] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T18:54:24.917620] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-22T18:54:25.211673] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T18:54:25.717770] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-22T18:54:26.300319] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T18:54:26.374183] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-22T18:54:26.517636] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-22T18:54:27.317635] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-22T18:54:27.617752] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T18:54:28.117745] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-22T18:54:28.472982] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T18:54:28.917735] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-22T18:54:29.708206] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T18:54:29.717765] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-22T18:54:30.517634] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-22T18:54:30.758567] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T18:54:30.761631] [INFO ] [REMOTE ] GATX: Full fetch complete (25071 records). [2025-10-22T18:54:30.761729] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-22T18:54:31.098025] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-22T18:54:31.183867] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-22T18:54:31.183957] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-22T18:54:31.184526] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-22T18:54:31.184567] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-22T18:54:31.185303] [DEBUG] [LOCAL ] GATX: Trimmed 25071 records to 18061 (keeping 200 days of data) [2025-10-22T18:54:31.298071] [DEBUG] [LOCAL ] GATX: Primary data saved (18061 records). [2025-10-22T18:54:31.298253] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-22T18:54:31.298369] [INFO ] [MAIN ] Update Progress: 894/2367 symbols completed. GATX took 33.4s. Estimated remaining: 3h 8m 34s. Rate: 7.8 symbols/min [2025-10-22T18:54:31.328221] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-22T18:54:31.431767] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-22T18:54:31.493585] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:54:31.493801] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-22T18:54:31.493853] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-22T18:54:31.493983] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-22T18:54:31.494031] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-22T18:54:31.494080] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-22T18:54:31.494121] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-22T18:54:31.857433] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:54:32.117696] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-22T18:54:32.886070] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T18:54:32.919188] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-22T18:54:32.922563] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T18:54:33.717735] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-22T18:54:34.456425] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T18:54:34.517611] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-22T18:54:35.317628] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-22T18:54:35.574836] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T18:54:36.117731] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-22T18:54:36.185018] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T18:54:36.188296] [INFO ] [REMOTE ] GBAB: Full fetch complete (18795 records). [2025-10-22T18:54:36.188437] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-22T18:54:36.357968] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T18:54:36.430592] [INFO ] [REMOTE ] GBCI: Full fetch complete (59526 records). [2025-10-22T18:54:36.479835] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-22T18:54:36.822571] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-22T18:54:36.839024] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-22T18:54:36.891348] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-22T18:54:36.925302] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-22T18:54:36.947983] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-22T18:54:36.967467] [DEBUG] [LOCAL ] GBAB: Trimmed 18795 records to 12735 (keeping 200 days of data) [2025-10-22T18:54:37.120325] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-22T18:54:37.124429] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-22T18:54:37.132406] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-22T18:54:37.132489] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-22T18:54:37.147895] [DEBUG] [LOCAL ] GBAB: Primary data saved (12735 records). [2025-10-22T18:54:37.148146] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-22T18:54:37.148328] [INFO ] [MAIN ] Update Progress: 895/2367 symbols completed. GBAB took 27.2s. Estimated remaining: 3h 8m 23s. Rate: 7.8 symbols/min [2025-10-22T18:54:37.191378] [DEBUG] [LOCAL ] GBCI: Trimmed 59526 records to 41187 (keeping 200 days of data) [2025-10-22T18:54:37.355024] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-22T18:54:37.421033] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:54:37.597966] [DEBUG] [LOCAL ] GBCI: Primary data saved (41187 records). [2025-10-22T18:54:37.598178] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-22T18:54:37.598301] [INFO ] [MAIN ] Update Progress: 896/2367 symbols completed. GBCI took 26.4s. Estimated remaining: 3h 8m 4s. Rate: 7.8 symbols/min [2025-10-22T18:54:37.610343] [DEBUG] [LOCAL ] GBTG: Loaded 40249 existing records from primary storage. [2025-10-22T18:54:37.632942] [INFO ] [MAIN ] GBTG: Loaded 40249 existing records. [2025-10-22T18:54:37.728410] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-22T18:54:37.922460] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:54:38.009488] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:54:38.010398] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-22T18:54:38.010468] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-22T18:54:38.010825] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-22T18:54:38.010887] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-22T18:54:38.052175] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T18:54:38.145305] [INFO ] [REMOTE ] GAP: Full fetch complete (77812 records). [2025-10-22T18:54:38.189717] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T18:54:38.188216] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-22T18:54:38.203692] [DEBUG] [LOCAL ] GBX: Loaded 28402 existing records from primary storage. [2025-10-22T18:54:38.209584] [INFO ] [MAIN ] GBX: Loaded 28402 existing records. [2025-10-22T18:54:38.528025] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-22T18:54:39.055259] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-22T18:54:39.107083] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:54:39.194234] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-22T18:54:39.232266] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:54:39.227925] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-22T18:54:39.268962] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-22T18:54:39.269324] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-22T18:54:39.322292] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-22T18:54:39.484251] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-22T18:54:39.484390] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-22T18:54:39.485359] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-22T18:54:39.485442] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-22T18:54:39.561768] [DEBUG] [LOCAL ] GAP: Trimmed 77812 records to 53653 (keeping 200 days of data) [2025-10-22T18:54:39.774092] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-22T18:54:39.854760] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:54:40.079554] [DEBUG] [LOCAL ] GAP: Primary data saved (53653 records). [2025-10-22T18:54:40.079693] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-22T18:54:40.079787] [INFO ] [MAIN ] Update Progress: 897/2367 symbols completed. GAP took 45.7s. Estimated remaining: 3h 7m 47s. Rate: 7.8 symbols/min [2025-10-22T18:54:40.122754] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-22T18:54:40.269492] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:54:40.306916] [DEBUG] [LOCAL ] GCI: Loaded 43632 existing records from primary storage. [2025-10-22T18:54:40.307196] [INFO ] [MAIN ] GCI: Loaded 43632 existing records. [2025-10-22T18:54:40.480870] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:54:40.481033] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-22T18:54:40.481080] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-22T18:54:40.481249] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-22T18:54:40.481287] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-22T18:54:40.552717] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-22T18:54:40.835299] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:54:40.917618] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-22T18:54:41.717708] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-22T18:54:41.976254] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-22T18:54:42.470285] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T18:54:42.517730] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-22T18:54:43.317746] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-22T18:54:43.915818] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T18:54:44.117732] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-22T18:54:44.632885] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-22T18:54:44.856311] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T18:54:44.917625] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-22T18:54:45.717730] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-22T18:54:46.239150] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T18:54:46.517691] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-22T18:54:47.176369] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T18:54:47.317744] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-22T18:54:47.448578] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-22T18:54:48.117742] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-22T18:54:48.838763] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T18:54:48.917739] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-22T18:54:49.375470] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-22T18:54:49.421070] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-22T18:54:49.717720] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-22T18:54:50.517754] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-22T18:54:51.246151] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T18:54:51.317687] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-22T18:54:51.679342] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-22T18:54:52.071776] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T18:54:52.117605] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-22T18:54:52.917713] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-22T18:54:53.605639] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T18:54:53.717707] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-22T18:54:54.186994] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T18:54:54.517707] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-22T18:54:55.157003] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T18:54:55.317631] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-22T18:54:55.703026] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T18:54:56.117699] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-22T18:54:56.922761] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-22T18:54:56.937085] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T18:54:57.382709] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-22T18:54:57.383392] [INFO ] [REMOTE ] GBLI: Full fetch complete (1280 records). [2025-10-22T18:54:57.383458] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-22T18:54:57.561096] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-10-22T18:54:57.561333] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-22T18:54:57.561432] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-22T18:54:57.561668] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-22T18:54:57.561806] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-22T18:54:57.561859] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-22T18:54:57.561916] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-22T18:54:57.561976] [INFO ] [MAIN ] Update Progress: 898/2367 symbols completed. GBLI took 26.3s. Estimated remaining: 3h 7m 56s. Rate: 7.8 symbols/min [2025-10-22T18:54:57.728381] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-22T18:54:57.731025] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:54:57.757093] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T18:54:57.783849] [DEBUG] [LOCAL ] GCO: Loaded 23035 existing records from primary storage. [2025-10-22T18:54:57.784090] [INFO ] [MAIN ] GCO: Loaded 23035 existing records. [2025-10-22T18:54:57.961308] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:54:57.961578] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-22T18:54:57.961679] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-22T18:54:57.961920] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-22T18:54:57.961979] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-22T18:54:58.308699] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:54:58.517714] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-22T18:54:59.317722] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-22T18:54:59.355455] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T18:54:59.892838] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T18:55:00.117697] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-22T18:55:00.917634] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-22T18:55:00.985910] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T18:55:01.706033] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T18:55:01.717752] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-22T18:55:01.856545] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T18:55:02.517738] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-22T18:55:02.953315] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-22T18:55:03.317713] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-22T18:55:03.667876] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T18:55:04.117717] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-22T18:55:04.712753] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T18:55:04.917690] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-22T18:55:05.261115] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T18:55:05.717704] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-22T18:55:06.364278] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T18:55:06.517712] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-22T18:55:07.313896] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T18:55:07.325985] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-22T18:55:08.004335] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T18:55:08.117741] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-22T18:55:08.435031] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T18:55:08.917729] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-22T18:55:09.290488] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T18:55:09.717746] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-22T18:55:10.517637] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-22T18:55:11.036027] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T18:55:11.043031] [INFO ] [REMOTE ] GCI: Full fetch complete (63291 records). [2025-10-22T18:55:11.043186] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-22T18:55:11.319771] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-22T18:55:11.405451] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T18:55:11.470080] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-22T18:55:11.470600] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-22T18:55:11.471548] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-22T18:55:11.471750] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-22T18:55:11.488015] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-22T18:55:11.487464] [DEBUG] [LOCAL ] GCI: Trimmed 63291 records to 43579 (keeping 200 days of data) [2025-10-22T18:55:11.731972] [DEBUG] [LOCAL ] GCI: Primary data saved (43579 records). [2025-10-22T18:55:11.732106] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-22T18:55:11.732212] [INFO ] [MAIN ] Update Progress: 899/2367 symbols completed. GCI took 31.7s. Estimated remaining: 3h 7m 59s. Rate: 7.8 symbols/min [2025-10-22T18:55:11.898489] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:55:11.918194] [DEBUG] [LOCAL ] GCTS: Loaded 20218 existing records from primary storage. [2025-10-22T18:55:11.918453] [INFO ] [MAIN ] GCTS: Loaded 20218 existing records. [2025-10-22T18:55:12.091021] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:55:12.091232] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-22T18:55:12.091285] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-22T18:55:12.091461] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-22T18:55:12.091517] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-22T18:55:12.122450] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-22T18:55:12.447829] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:55:12.461941] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T18:55:12.917629] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-22T18:55:13.630585] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T18:55:13.637104] [INFO ] [REMOTE ] GBTG: Full fetch complete (56931 records). [2025-10-22T18:55:13.637196] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-22T18:55:13.726022] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-22T18:55:14.038472] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T18:55:14.057112] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-22T18:55:14.057520] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-22T18:55:14.058368] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-22T18:55:14.058430] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-22T18:55:14.059523] [DEBUG] [LOCAL ] GBTG: Trimmed 56931 records to 40227 (keeping 200 days of data) [2025-10-22T18:55:14.276617] [DEBUG] [LOCAL ] GBTG: Primary data saved (40227 records). [2025-10-22T18:55:14.276763] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-22T18:55:14.277319] [INFO ] [MAIN ] Update Progress: 900/2367 symbols completed. GBTG took 37.1s. Estimated remaining: 3h 7m 43s. Rate: 7.8 symbols/min [2025-10-22T18:55:14.441258] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:55:14.451011] [DEBUG] [LOCAL ] GCV: Loaded 7809 existing records from primary storage. [2025-10-22T18:55:14.451228] [INFO ] [MAIN ] GCV: Loaded 7809 existing records. [2025-10-22T18:55:14.523255] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-22T18:55:14.625431] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:55:14.625623] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-22T18:55:14.625701] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-22T18:55:14.625859] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-22T18:55:14.625898] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-22T18:55:14.770548] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-22T18:55:14.980722] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:55:15.317711] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-22T18:55:15.943022] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-22T18:55:15.947420] [INFO ] [REMOTE ] GBX: Full fetch complete (42829 records). [2025-10-22T18:55:15.947519] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-22T18:55:16.128283] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-22T18:55:16.321460] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-22T18:55:16.321544] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-22T18:55:16.322210] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-22T18:55:16.322272] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-22T18:55:16.323267] [DEBUG] [LOCAL ] GBX: Trimmed 42829 records to 28211 (keeping 200 days of data) [2025-10-22T18:55:16.417157] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T18:55:16.502335] [DEBUG] [LOCAL ] GBX: Primary data saved (28211 records). [2025-10-22T18:55:16.502468] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-22T18:55:16.502582] [INFO ] [MAIN ] Update Progress: 901/2367 symbols completed. GBX took 38.9s. Estimated remaining: 3h 7m 26s. Rate: 7.8 symbols/min [2025-10-22T18:55:16.690557] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:55:16.731639] [DEBUG] [LOCAL ] GD: Loaded 46538 existing records from primary storage. [2025-10-22T18:55:16.731954] [INFO ] [MAIN ] GD: Loaded 46538 existing records. [2025-10-22T18:55:16.906071] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:55:16.906281] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-22T18:55:16.906336] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-22T18:55:16.906502] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-22T18:55:16.906541] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-22T18:55:16.926558] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-22T18:55:17.257188] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:55:17.283630] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T18:55:17.717630] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-22T18:55:17.901774] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-22T18:55:18.517617] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-22T18:55:18.910067] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-22T18:55:19.317717] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-22T18:55:19.405326] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T18:55:20.117637] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-22T18:55:20.357308] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T18:55:20.360370] [INFO ] [REMOTE ] GCO: Full fetch complete (34645 records). [2025-10-22T18:55:20.360449] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-22T18:55:20.724339] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-22T18:55:20.724433] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-22T18:55:20.725050] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-22T18:55:20.725114] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-22T18:55:20.726111] [DEBUG] [LOCAL ] GCO: Trimmed 34645 records to 22815 (keeping 200 days of data) [2025-10-22T18:55:20.856101] [DEBUG] [LOCAL ] GCO: Primary data saved (22815 records). [2025-10-22T18:55:20.856233] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-22T18:55:20.856314] [INFO ] [MAIN ] Update Progress: 902/2367 symbols completed. GCO took 23.3s. Estimated remaining: 3h 7m 13s. Rate: 7.8 symbols/min [2025-10-22T18:55:20.922884] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-22T18:55:21.030933] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:55:21.078470] [DEBUG] [LOCAL ] GDDY: Loaded 49671 existing records from primary storage. [2025-10-22T18:55:21.078869] [INFO ] [MAIN ] GDDY: Loaded 49671 existing records. [2025-10-22T18:55:21.271116] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:55:21.272314] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T18:55:21.272494] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-22T18:55:21.272671] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-22T18:55:21.277120] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-22T18:55:21.277175] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-22T18:55:21.619952] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:55:21.717620] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-22T18:55:22.517727] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-22T18:55:22.814752] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T18:55:22.928926] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-22T18:55:23.317720] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-22T18:55:23.483669] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T18:55:24.117712] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-22T18:55:24.910850] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-22T18:55:24.917611] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-22T18:55:24.943992] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T18:55:25.717631] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-22T18:55:25.837347] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-22T18:55:26.517686] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-22T18:55:26.787828] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T18:55:27.220632] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-22T18:55:27.317714] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-22T18:55:28.117737] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-22T18:55:28.917717] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-22T18:55:29.283238] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T18:55:29.717706] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-22T18:55:29.785414] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T18:55:30.022624] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-22T18:55:30.375553] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-22T18:55:30.517729] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-22T18:55:31.317631] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-22T18:55:31.664374] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T18:55:32.117693] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-22T18:55:32.917631] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-22T18:55:33.060544] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T18:55:33.652663] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T18:55:33.717638] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-22T18:55:34.090571] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T18:55:34.517707] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-22T18:55:35.317701] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-22T18:55:35.546787] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T18:55:35.737066] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T18:55:36.117727] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-22T18:55:36.917630] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-22T18:55:37.287419] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T18:55:37.445624] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T18:55:37.449034] [INFO ] [REMOTE ] GCTS: Full fetch complete (26762 records). [2025-10-22T18:55:37.449109] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-22T18:55:37.723737] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-22T18:55:37.826324] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-22T18:55:37.826403] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-22T18:55:37.827001] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-22T18:55:37.827063] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-22T18:55:37.827861] [DEBUG] [LOCAL ] GCTS: Trimmed 26762 records to 20286 (keeping 200 days of data) [2025-10-22T18:55:37.938953] [DEBUG] [LOCAL ] GCTS: Primary data saved (20286 records). [2025-10-22T18:55:37.939083] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-22T18:55:37.939159] [INFO ] [MAIN ] Update Progress: 903/2367 symbols completed. GCTS took 26.2s. Estimated remaining: 3h 7m 21s. Rate: 7.8 symbols/min [2025-10-22T18:55:38.107404] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:55:38.112434] [DEBUG] [LOCAL ] GDIV: Loaded 3542 existing records from primary storage. [2025-10-22T18:55:38.112580] [INFO ] [MAIN ] GDIV: Loaded 3542 existing records. [2025-10-22T18:55:38.284940] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:55:38.285174] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-22T18:55:38.285222] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-22T18:55:38.285408] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-22T18:55:38.285463] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-22T18:55:38.526127] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-22T18:55:38.674716] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:55:38.702582] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T18:55:39.317612] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-22T18:55:39.351937] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-22T18:55:39.639269] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-22T18:55:40.117638] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-22T18:55:40.898249] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T18:55:40.917682] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-22T18:55:41.338162] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T18:55:41.358797] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T18:55:41.717716] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-22T18:55:42.324493] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T18:55:42.517732] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-22T18:55:43.317741] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-22T18:55:43.944139] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-22T18:55:44.117742] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-22T18:55:44.203261] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T18:55:44.917695] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-22T18:55:45.719377] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-22T18:55:45.722469] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-22T18:55:45.771285] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T18:55:46.517731] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-22T18:55:47.317713] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-22T18:55:47.360145] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T18:55:47.563424] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T18:55:47.653589] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-22T18:55:48.117720] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-22T18:55:48.679224] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-22T18:55:48.917722] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-22T18:55:49.717669] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-22T18:55:50.266261] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T18:55:50.517633] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-22T18:55:50.609503] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T18:55:51.317639] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-22T18:55:51.384214] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T18:55:51.386288] [INFO ] [REMOTE ] GCV: Full fetch complete (9856 records). [2025-10-22T18:55:51.386360] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-22T18:55:51.738148] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-22T18:55:51.738420] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-22T18:55:51.738718] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-22T18:55:51.738811] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-22T18:55:51.739433] [DEBUG] [LOCAL ] GCV: Trimmed 9856 records to 7752 (keeping 200 days of data) [2025-10-22T18:55:51.786806] [DEBUG] [LOCAL ] GCV: Primary data saved (7752 records). [2025-10-22T18:55:51.786947] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-22T18:55:51.787031] [INFO ] [MAIN ] Update Progress: 904/2367 symbols completed. GCV took 37.5s. Estimated remaining: 3h 7m 23s. Rate: 7.8 symbols/min [2025-10-22T18:55:51.960704] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:55:51.964786] [DEBUG] [LOCAL ] GDL: Loaded 2519 existing records from primary storage. [2025-10-22T18:55:51.964948] [INFO ] [MAIN ] GDL: Loaded 2519 existing records. [2025-10-22T18:55:52.117990] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-22T18:55:52.140846] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:55:52.141294] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-22T18:55:52.141426] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-22T18:55:52.141621] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-22T18:55:52.141704] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-22T18:55:52.494266] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:55:52.917637] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-22T18:55:53.171870] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T18:55:53.179432] [INFO ] [REMOTE ] GD: Full fetch complete (69632 records). [2025-10-22T18:55:53.179602] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-22T18:55:53.278995] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-22T18:55:53.593758] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-22T18:55:53.593842] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-22T18:55:53.594966] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-22T18:55:53.595046] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-22T18:55:53.596530] [DEBUG] [LOCAL ] GD: Trimmed 69632 records to 46474 (keeping 200 days of data) [2025-10-22T18:55:53.719711] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-22T18:55:53.892357] [DEBUG] [LOCAL ] GD: Primary data saved (46474 records). [2025-10-22T18:55:53.892485] [INFO ] [MAIN ] GD: Full history saved. [2025-10-22T18:55:53.892563] [INFO ] [MAIN ] Update Progress: 905/2367 symbols completed. GD took 37.4s. Estimated remaining: 3h 7m 6s. Rate: 7.8 symbols/min [2025-10-22T18:55:54.071689] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:55:54.102976] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T18:55:54.116560] [DEBUG] [LOCAL ] GDO: Loaded 5860 existing records from primary storage. [2025-10-22T18:55:54.116898] [INFO ] [MAIN ] GDO: Loaded 5860 existing records. [2025-10-22T18:55:54.291908] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-22T18:55:54.313241] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:55:54.314631] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-22T18:55:54.314718] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-22T18:55:54.314882] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-22T18:55:54.314938] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-22T18:55:54.522887] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-22T18:55:54.699060] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:55:55.028606] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-22T18:55:55.317770] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-22T18:55:55.908603] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-22T18:55:55.909673] [INFO ] [REMOTE ] GDIV: Full fetch complete (5424 records). [2025-10-22T18:55:55.909757] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-22T18:55:56.122855] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-22T18:55:56.272326] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-22T18:55:56.272398] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-22T18:55:56.272549] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-22T18:55:56.272586] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-22T18:55:56.272965] [DEBUG] [LOCAL ] GDIV: Trimmed 5424 records to 3507 (keeping 200 days of data) [2025-10-22T18:55:56.294180] [DEBUG] [LOCAL ] GDIV: Primary data saved (3507 records). [2025-10-22T18:55:56.294247] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-22T18:55:56.294314] [INFO ] [MAIN ] Update Progress: 906/2367 symbols completed. GDIV took 18.4s. Estimated remaining: 3h 6m 50s. Rate: 7.8 symbols/min [2025-10-22T18:55:56.457382] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:55:56.492376] [DEBUG] [LOCAL ] GDOT: Loaded 37710 existing records from primary storage. [2025-10-22T18:55:56.492692] [INFO ] [MAIN ] GDOT: Loaded 37710 existing records. [2025-10-22T18:55:56.675297] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:55:56.675493] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-22T18:55:56.675540] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-22T18:55:56.675781] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-22T18:55:56.675838] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-22T18:55:56.922988] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-22T18:55:57.036446] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:55:57.618880] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T18:55:57.717740] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-22T18:55:58.338928] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-22T18:55:58.517739] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-22T18:55:58.811468] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T18:55:59.122824] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T18:55:59.317682] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-22T18:56:00.117729] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-22T18:56:00.581373] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T18:56:00.917756] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-22T18:56:01.010855] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T18:56:01.717736] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-22T18:56:02.238280] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T18:56:02.517700] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-22T18:56:03.225042] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-22T18:56:03.317639] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-22T18:56:03.490548] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T18:56:03.501066] [INFO ] [REMOTE ] GDDY: Full fetch complete (72139 records). [2025-10-22T18:56:03.501220] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-22T18:56:03.889015] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-22T18:56:03.889134] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-22T18:56:03.890114] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-22T18:56:03.890178] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-22T18:56:03.891618] [DEBUG] [LOCAL ] GDDY: Trimmed 72139 records to 49624 (keeping 200 days of data) [2025-10-22T18:56:03.956042] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T18:56:04.121717] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-22T18:56:04.193600] [DEBUG] [LOCAL ] GDDY: Primary data saved (49624 records). [2025-10-22T18:56:04.193761] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-22T18:56:04.193848] [INFO ] [MAIN ] Update Progress: 907/2367 symbols completed. GDDY took 43.3s. Estimated remaining: 3h 6m 43s. Rate: 7.8 symbols/min [2025-10-22T18:56:04.378484] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:56:04.398597] [DEBUG] [LOCAL ] GDV: Loaded 19319 existing records from primary storage. [2025-10-22T18:56:04.398894] [INFO ] [MAIN ] GDV: Loaded 19319 existing records. [2025-10-22T18:56:04.587532] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:56:04.587866] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-22T18:56:04.587938] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-22T18:56:04.588221] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-22T18:56:04.588277] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-22T18:56:04.935551] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-22T18:56:04.947924] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:56:05.416236] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-22T18:56:05.717634] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-22T18:56:05.815201] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T18:56:06.186946] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-22T18:56:06.517729] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-22T18:56:07.020854] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-22T18:56:07.317626] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-22T18:56:07.993971] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-22T18:56:08.117722] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-22T18:56:08.822690] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-22T18:56:08.917702] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-22T18:56:09.611743] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-22T18:56:09.717721] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-22T18:56:10.517732] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-22T18:56:11.012893] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-22T18:56:11.267637] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T18:56:11.317620] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-22T18:56:12.117707] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-22T18:56:12.728319] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T18:56:12.917691] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-22T18:56:13.426891] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T18:56:13.717717] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-22T18:56:14.223194] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-22T18:56:14.307941] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T18:56:14.517698] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-22T18:56:15.317737] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-22T18:56:16.001398] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-22T18:56:16.002867] [INFO ] [REMOTE ] GDO: Full fetch complete (8501 records). [2025-10-22T18:56:16.002937] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-22T18:56:16.118987] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-22T18:56:16.437928] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-22T18:56:16.429472] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-22T18:56:16.438088] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-22T18:56:16.446208] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-22T18:56:16.446516] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-22T18:56:16.447618] [DEBUG] [LOCAL ] GDO: Trimmed 8501 records to 5852 (keeping 200 days of data) [2025-10-22T18:56:16.485279] [DEBUG] [LOCAL ] GDO: Primary data saved (5852 records). [2025-10-22T18:56:16.485414] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-22T18:56:16.485503] [INFO ] [MAIN ] Update Progress: 908/2367 symbols completed. GDO took 22.6s. Estimated remaining: 3h 6m 43s. Rate: 7.8 symbols/min [2025-10-22T18:56:16.678405] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:56:16.728717] [DEBUG] [LOCAL ] GE: Loaded 53698 existing records from primary storage. [2025-10-22T18:56:16.729047] [INFO ] [MAIN ] GE: Loaded 53698 existing records. [2025-10-22T18:56:16.906313] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:56:16.906540] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-22T18:56:16.906612] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-22T18:56:16.906877] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-22T18:56:16.906945] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-22T18:56:16.922757] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-22T18:56:17.271540] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:56:17.504127] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T18:56:17.717723] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-22T18:56:18.257888] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-22T18:56:18.517635] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-22T18:56:18.594861] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T18:56:19.317752] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-22T18:56:19.649900] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T18:56:20.117709] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-22T18:56:20.917636] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-22T18:56:20.958405] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T18:56:21.356013] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-22T18:56:21.379637] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T18:56:21.717709] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-22T18:56:22.376346] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-22T18:56:22.517636] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-22T18:56:23.317701] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-22T18:56:24.117742] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-22T18:56:24.318130] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T18:56:24.325291] [INFO ] [REMOTE ] GDOT: Full fetch complete (53711 records). [2025-10-22T18:56:24.325459] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-22T18:56:24.627612] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T18:56:24.744952] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-22T18:56:24.745051] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-22T18:56:24.745824] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-22T18:56:24.745888] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-22T18:56:24.747092] [DEBUG] [LOCAL ] GDOT: Trimmed 53711 records to 37641 (keeping 200 days of data) [2025-10-22T18:56:24.929321] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-22T18:56:24.959796] [DEBUG] [LOCAL ] GDOT: Primary data saved (37641 records). [2025-10-22T18:56:24.960017] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-22T18:56:24.960109] [INFO ] [MAIN ] Update Progress: 909/2367 symbols completed. GDOT took 28.7s. Estimated remaining: 3h 6m 36s. Rate: 7.8 symbols/min [2025-10-22T18:56:25.129192] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:56:25.149716] [DEBUG] [LOCAL ] GEF: Loaded 20751 existing records from primary storage. [2025-10-22T18:56:25.149970] [INFO ] [MAIN ] GEF: Loaded 20751 existing records. [2025-10-22T18:56:25.341200] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:56:25.341450] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-22T18:56:25.341498] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-22T18:56:25.341706] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-22T18:56:25.341761] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-22T18:56:25.698176] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:56:25.717614] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-22T18:56:26.190496] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T18:56:26.396225] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-22T18:56:26.517616] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-22T18:56:26.952952] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T18:56:27.317741] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-22T18:56:28.117723] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-22T18:56:28.325043] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T18:56:28.594119] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-22T18:56:28.917681] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-22T18:56:29.202601] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-22T18:56:29.717749] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-22T18:56:29.954906] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T18:56:30.471350] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-22T18:56:30.517610] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-22T18:56:31.317622] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-22T18:56:31.563539] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T18:56:32.117626] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-22T18:56:32.363254] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T18:56:32.917637] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-22T18:56:33.362422] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T18:56:33.365568] [INFO ] [REMOTE ] GDV: Full fetch complete (28345 records). [2025-10-22T18:56:33.365665] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-22T18:56:33.722773] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-22T18:56:33.735911] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-22T18:56:33.735995] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-22T18:56:33.736530] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-22T18:56:33.736571] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-22T18:56:33.737364] [DEBUG] [LOCAL ] GDV: Trimmed 28345 records to 19143 (keeping 200 days of data) [2025-10-22T18:56:33.839107] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-22T18:56:33.864716] [DEBUG] [LOCAL ] GDV: Primary data saved (19143 records). [2025-10-22T18:56:33.864856] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-22T18:56:33.864933] [INFO ] [MAIN ] Update Progress: 910/2367 symbols completed. GDV took 29.7s. Estimated remaining: 3h 6m 30s. Rate: 7.8 symbols/min [2025-10-22T18:56:34.030549] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:56:34.061426] [DEBUG] [LOCAL ] GEL: Loaded 31309 existing records from primary storage. [2025-10-22T18:56:34.061717] [INFO ] [MAIN ] GEL: Loaded 31309 existing records. [2025-10-22T18:56:34.233066] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:56:34.233259] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-22T18:56:34.233306] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-22T18:56:34.233479] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-22T18:56:34.233517] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-22T18:56:34.406488] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-22T18:56:34.436093] [INFO ] [REMOTE ] GDL: Full fetch complete (3483 records). [2025-10-22T18:56:34.455203] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-22T18:56:34.528933] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-22T18:56:34.771523] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:56:34.954349] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-22T18:56:34.954428] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-22T18:56:34.954545] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-22T18:56:34.954582] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-22T18:56:34.954954] [DEBUG] [LOCAL ] GDL: Trimmed 3483 records to 2510 (keeping 200 days of data) [2025-10-22T18:56:34.969531] [DEBUG] [LOCAL ] GDL: Primary data saved (2510 records). [2025-10-22T18:56:34.969602] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-22T18:56:34.969693] [INFO ] [MAIN ] Update Progress: 911/2367 symbols completed. GDL took 43.2s. Estimated remaining: 3h 6m 12s. Rate: 7.8 symbols/min [2025-10-22T18:56:35.141496] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:56:35.193569] [DEBUG] [LOCAL ] GENI: Loaded 52937 existing records from primary storage. [2025-10-22T18:56:35.193921] [INFO ] [MAIN ] GENI: Loaded 52937 existing records. [2025-10-22T18:56:35.322754] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-22T18:56:35.376122] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:56:35.376328] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-22T18:56:35.376377] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-22T18:56:35.376561] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-22T18:56:35.376603] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-22T18:56:35.746865] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:56:36.117726] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-22T18:56:36.421454] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-22T18:56:36.792379] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:56:36.917722] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-22T18:56:37.717630] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-22T18:56:38.054083] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-22T18:56:38.205796] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-22T18:56:38.517774] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-22T18:56:39.317753] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-22T18:56:39.376982] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T18:56:40.117763] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-22T18:56:40.599027] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T18:56:40.741587] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-22T18:56:40.917721] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-22T18:56:41.693950] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T18:56:41.717611] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-22T18:56:41.754092] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-22T18:56:42.517735] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-22T18:56:43.317633] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-22T18:56:43.624017] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-22T18:56:43.658810] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T18:56:44.117624] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-22T18:56:44.917723] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-22T18:56:45.282220] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T18:56:45.620969] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-22T18:56:45.717723] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-22T18:56:46.333385] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T18:56:46.517694] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-22T18:56:47.317743] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-22T18:56:47.839141] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-22T18:56:47.869103] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-22T18:56:48.117598] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-22T18:56:48.917633] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-22T18:56:49.059758] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T18:56:49.589980] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T18:56:49.717747] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-22T18:56:50.517793] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-22T18:56:51.228680] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-22T18:56:51.277390] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T18:56:51.317617] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-22T18:56:52.059518] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T18:56:52.117792] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-22T18:56:52.713813] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-22T18:56:52.917716] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-22T18:56:53.352394] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T18:56:53.356157] [INFO ] [REMOTE ] GEF: Full fetch complete (29379 records). [2025-10-22T18:56:53.356238] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-22T18:56:53.721546] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-22T18:56:53.721966] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-22T18:56:53.722056] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-22T18:56:53.723610] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-22T18:56:53.723695] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-22T18:56:53.724510] [DEBUG] [LOCAL ] GEF: Trimmed 29379 records to 20692 (keeping 200 days of data) [2025-10-22T18:56:53.847324] [DEBUG] [LOCAL ] GEF: Primary data saved (20692 records). [2025-10-22T18:56:53.847453] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-22T18:56:53.847578] [INFO ] [MAIN ] Update Progress: 912/2367 symbols completed. GEF took 28.9s. Estimated remaining: 3h 6m 22s. Rate: 7.8 symbols/min [2025-10-22T18:56:54.011281] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:56:54.056472] [DEBUG] [LOCAL ] GEO: Loaded 51739 existing records from primary storage. [2025-10-22T18:56:54.056788] [INFO ] [MAIN ] GEO: Loaded 51739 existing records. [2025-10-22T18:56:54.229096] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:56:54.229308] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-22T18:56:54.229352] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-22T18:56:54.229532] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-22T18:56:54.229568] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-22T18:56:54.522898] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-22T18:56:54.586723] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:56:54.693350] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T18:56:55.317764] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-22T18:56:55.730044] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T18:56:56.032005] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-22T18:56:56.117712] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-22T18:56:56.917619] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-22T18:56:57.246241] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T18:56:57.294073] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T18:56:57.298388] [INFO ] [REMOTE ] GEL: Full fetch complete (48006 records). [2025-10-22T18:56:57.298491] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-22T18:56:57.684710] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-22T18:56:57.684796] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-22T18:56:57.685457] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-22T18:56:57.685496] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-22T18:56:57.686440] [DEBUG] [LOCAL ] GEL: Trimmed 48006 records to 31221 (keeping 200 days of data) [2025-10-22T18:56:57.737637] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-22T18:56:57.874943] [DEBUG] [LOCAL ] GEL: Primary data saved (31221 records). [2025-10-22T18:56:57.875106] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-22T18:56:57.875197] [INFO ] [MAIN ] Update Progress: 913/2367 symbols completed. GEL took 24.0s. Estimated remaining: 3h 6m 9s. Rate: 7.8 symbols/min [2025-10-22T18:56:58.038628] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:56:58.077262] [DEBUG] [LOCAL ] GES: Loaded 37978 existing records from primary storage. [2025-10-22T18:56:58.077574] [INFO ] [MAIN ] GES: Loaded 37978 existing records. [2025-10-22T18:56:58.280414] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:56:58.280693] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-22T18:56:58.280752] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-22T18:56:58.280949] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-22T18:56:58.281039] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-22T18:56:58.521929] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-22T18:56:58.673536] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:56:58.706127] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T18:56:59.317623] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-22T18:57:00.029343] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-22T18:57:00.117620] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-22T18:57:00.419384] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-22T18:57:00.917754] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-22T18:57:00.943964] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T18:57:01.717771] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-22T18:57:02.517630] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-22T18:57:02.980277] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.86 seconds). [2025-10-22T18:57:02.989120] [INFO ] [REMOTE ] GE: Full fetch complete (77864 records). [2025-10-22T18:57:02.989261] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-22T18:57:03.424543] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-22T18:57:03.424985] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-22T18:57:03.425954] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-22T18:57:03.426034] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-22T18:57:03.428673] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-22T18:57:03.440334] [DEBUG] [LOCAL ] GE: Trimmed 77864 records to 53697 (keeping 200 days of data) [2025-10-22T18:57:03.440217] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-22T18:57:03.703933] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-22T18:57:03.805707] [DEBUG] [LOCAL ] GE: Primary data saved (53697 records). [2025-10-22T18:57:03.805834] [INFO ] [MAIN ] GE: Full history saved. [2025-10-22T18:57:03.805910] [INFO ] [MAIN ] Update Progress: 914/2367 symbols completed. GE took 47.3s. Estimated remaining: 3h 5m 58s. Rate: 7.8 symbols/min [2025-10-22T18:57:03.970480] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:57:04.002885] [DEBUG] [LOCAL ] GETY: Loaded 35197 existing records from primary storage. [2025-10-22T18:57:04.003160] [INFO ] [MAIN ] GETY: Loaded 35197 existing records. [2025-10-22T18:57:04.125151] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-22T18:57:04.184439] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:57:04.185094] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-22T18:57:04.185238] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-22T18:57:04.185445] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-22T18:57:04.185490] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-22T18:57:04.471904] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T18:57:04.585701] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:57:04.917754] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-22T18:57:05.225750] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T18:57:05.717709] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-22T18:57:05.936033] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T18:57:06.517786] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-22T18:57:06.704739] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T18:57:07.254362] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T18:57:07.317689] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-22T18:57:08.117628] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-22T18:57:08.446057] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T18:57:08.456292] [INFO ] [REMOTE ] GENI: Full fetch complete (76102 records). [2025-10-22T18:57:08.456431] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-22T18:57:08.907289] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-22T18:57:08.907404] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-22T18:57:08.908400] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-22T18:57:08.908565] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-22T18:57:08.910208] [DEBUG] [LOCAL ] GENI: Trimmed 76102 records to 52937 (keeping 200 days of data) [2025-10-22T18:57:08.967709] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-22T18:57:09.043752] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T18:57:09.253063] [DEBUG] [LOCAL ] GENI: Primary data saved (52937 records). [2025-10-22T18:57:09.253204] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-22T18:57:09.253919] [INFO ] [MAIN ] Update Progress: 915/2367 symbols completed. GENI took 34.3s. Estimated remaining: 3h 5m 47s. Rate: 7.8 symbols/min [2025-10-22T18:57:09.428868] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:57:09.482486] [DEBUG] [LOCAL ] GEV: Loaded 52992 existing records from primary storage. [2025-10-22T18:57:09.482847] [INFO ] [MAIN ] GEV: Loaded 52992 existing records. [2025-10-22T18:57:09.663143] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:57:09.663461] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-22T18:57:09.663531] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-22T18:57:09.663874] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-22T18:57:09.663987] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-22T18:57:09.726714] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-22T18:57:09.799035] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T18:57:10.058476] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:57:10.517633] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-22T18:57:10.822233] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T18:57:11.317688] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-22T18:57:11.433630] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T18:57:12.117800] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-22T18:57:12.917753] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-22T18:57:12.973922] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-22T18:57:13.146088] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-22T18:57:13.653027] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T18:57:13.717608] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-22T18:57:14.377019] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T18:57:14.517700] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-22T18:57:15.076874] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T18:57:15.317707] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-22T18:57:16.117751] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-22T18:57:16.683020] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-22T18:57:16.812488] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T18:57:16.917694] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-22T18:57:17.717638] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-22T18:57:17.857043] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T18:57:18.517705] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-22T18:57:19.317820] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-22T18:57:19.890160] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-22T18:57:19.935466] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (3.02 seconds). [2025-10-22T18:57:20.117626] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-22T18:57:20.343725] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T18:57:20.917704] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-22T18:57:21.602389] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-22T18:57:21.707032] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T18:57:21.717610] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-22T18:57:22.304400] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-22T18:57:22.517685] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-22T18:57:23.232769] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T18:57:23.317619] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-22T18:57:24.117761] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-22T18:57:24.923513] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-22T18:57:24.929599] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-22T18:57:25.028483] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T18:57:25.202961] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T18:57:25.717698] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-22T18:57:26.517636] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-22T18:57:26.626883] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T18:57:27.317714] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-22T18:57:27.495064] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T18:57:27.500986] [INFO ] [REMOTE ] GES: Full fetch complete (58338 records). [2025-10-22T18:57:27.501108] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-22T18:57:27.890734] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-22T18:57:27.890833] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-22T18:57:27.891659] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-22T18:57:27.891721] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-22T18:57:27.892888] [DEBUG] [LOCAL ] GES: Trimmed 58338 records to 37820 (keeping 200 days of data) [2025-10-22T18:57:28.113069] [DEBUG] [LOCAL ] GES: Primary data saved (37820 records). [2025-10-22T18:57:28.113199] [INFO ] [MAIN ] GES: Full history saved. [2025-10-22T18:57:28.113276] [INFO ] [MAIN ] Update Progress: 916/2367 symbols completed. GES took 30.2s. Estimated remaining: 3h 5m 57s. Rate: 7.8 symbols/min [2025-10-22T18:57:28.124605] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-22T18:57:28.280285] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:57:28.284250] [DEBUG] [LOCAL ] GF: Loaded 2646 existing records from primary storage. [2025-10-22T18:57:28.284393] [INFO ] [MAIN ] GF: Loaded 2646 existing records. [2025-10-22T18:57:28.454816] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:57:28.455023] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-22T18:57:28.455070] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-22T18:57:28.455214] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-22T18:57:28.455251] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-22T18:57:28.808688] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:57:28.917723] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-22T18:57:29.172751] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-22T18:57:29.352999] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T18:57:29.362091] [INFO ] [REMOTE ] GEO: Full fetch complete (75510 records). [2025-10-22T18:57:29.362290] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-22T18:57:29.472792] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-22T18:57:29.559196] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-22T18:57:29.602758] [INFO ] [REMOTE ] GETY: Full fetch complete (55653 records). [2025-10-22T18:57:29.637564] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-22T18:57:29.722770] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-22T18:57:30.008080] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-22T18:57:30.008520] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-22T18:57:30.024961] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-22T18:57:30.027036] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-22T18:57:30.137125] [DEBUG] [LOCAL ] GEO: Trimmed 75510 records to 51707 (keeping 200 days of data) [2025-10-22T18:57:30.339771] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-22T18:57:30.344046] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-22T18:57:30.357628] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-22T18:57:30.357834] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-22T18:57:30.369064] [DEBUG] [LOCAL ] GETY: Trimmed 55653 records to 35237 (keeping 200 days of data) [2025-10-22T18:57:30.524692] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-22T18:57:30.900777] [DEBUG] [LOCAL ] GEO: Primary data saved (51707 records). [2025-10-22T18:57:30.922815] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-22T18:57:30.922985] [INFO ] [MAIN ] Update Progress: 917/2367 symbols completed. GEO took 37.1s. Estimated remaining: 3h 5m 42s. Rate: 7.8 symbols/min [2025-10-22T18:57:30.922702] [DEBUG] [LOCAL ] GETY: Primary data saved (35237 records). [2025-10-22T18:57:30.923335] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-22T18:57:30.923450] [INFO ] [MAIN ] Update Progress: 918/2367 symbols completed. GETY took 27.1s. Estimated remaining: 3h 5m 22s. Rate: 7.8 symbols/min [2025-10-22T18:57:31.213498] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-22T18:57:31.317699] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-22T18:57:32.094081] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-22T18:57:32.117614] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-22T18:57:32.173430] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-22T18:57:32.683220] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-22T18:57:32.917701] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-22T18:57:33.717751] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-22T18:57:34.383272] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-22T18:57:34.517707] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-22T18:57:35.141944] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-22T18:57:35.317788] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-22T18:57:35.607353] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-22T18:57:35.796464] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-22T18:57:36.117759] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-22T18:57:36.605028] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-22T18:57:36.917639] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-22T18:57:37.717746] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-22T18:57:38.187322] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-22T18:57:38.517700] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-22T18:57:39.312911] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-22T18:57:39.324152] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-22T18:57:39.333484] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-22T18:57:39.334266] [INFO ] [REMOTE ] GF: Full fetch complete (4789 records). [2025-10-22T18:57:39.334333] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-22T18:57:39.697901] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-22T18:57:39.697979] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-22T18:57:39.698180] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-22T18:57:39.698219] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-22T18:57:39.698565] [DEBUG] [LOCAL ] GF: Trimmed 4789 records to 2623 (keeping 200 days of data) [2025-10-22T18:57:39.714128] [DEBUG] [LOCAL ] GF: Primary data saved (2623 records). [2025-10-22T18:57:39.714195] [INFO ] [MAIN ] GF: Full history saved. [2025-10-22T18:57:39.714264] [INFO ] [MAIN ] Update Progress: 919/2367 symbols completed. GF took 11.6s. Estimated remaining: 3h 5m 16s. Rate: 7.8 symbols/min [2025-10-22T18:57:41.778316] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-22T18:57:41.789914] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-22T18:57:44.489030] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-22T18:57:44.498589] [INFO ] [REMOTE ] GEV: Full fetch complete (77050 records). [2025-10-22T18:57:44.498819] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-22T18:57:44.901158] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-22T18:57:44.901288] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-22T18:57:44.903006] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-22T18:57:44.903080] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-22T18:57:44.905306] [DEBUG] [LOCAL ] GEV: Trimmed 77050 records to 52992 (keeping 200 days of data) [2025-10-22T18:57:45.276882] [DEBUG] [LOCAL ] GEV: Primary data saved (52992 records). [2025-10-22T18:57:45.277251] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-22T18:57:45.277981] [INFO ] [MAIN ] Update Progress: 920/2367 symbols completed. GEV took 36.0s. Estimated remaining: 3h 5m 5s. Rate: 7.8 symbols/min [2025-10-22T18:57:45.917606] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:57:45.930403] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:57:45.969496] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:57:46.006828] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:57:46.015865] [DEBUG] [LOCAL ] GFR: Loaded 7423 existing records from primary storage. [2025-10-22T18:57:46.016281] [INFO ] [MAIN ] GFR: Loaded 7423 existing records. [2025-10-22T18:57:46.224444] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:57:46.225991] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-22T18:57:46.226051] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-22T18:57:46.226292] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-22T18:57:46.226358] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-22T18:57:46.225468] [DEBUG] [LOCAL ] GFF: Loaded 29542 existing records from primary storage. [2025-10-22T18:57:46.307040] [INFO ] [MAIN ] GFF: Loaded 29542 existing records. [2025-10-22T18:57:46.388379] [DEBUG] [LOCAL ] GFL: Loaded 47521 existing records from primary storage. [2025-10-22T18:57:46.412323] [INFO ] [MAIN ] GFL: Loaded 47521 existing records. [2025-10-22T18:57:46.546752] [DEBUG] [LOCAL ] GFI: Loaded 53116 existing records from primary storage. [2025-10-22T18:57:46.582621] [INFO ] [MAIN ] GFI: Loaded 53116 existing records. [2025-10-22T18:57:46.840467] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:57:46.956927] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-22T18:57:46.983312] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-22T18:57:46.977631] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:57:47.053525] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-22T18:57:47.058762] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-22T18:57:47.087854] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-22T18:57:47.099718] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-22T18:57:47.127484] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-22T18:57:47.183011] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:57:47.225075] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-22T18:57:47.239214] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-22T18:57:47.254749] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-22T18:57:47.316291] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-22T18:57:47.325363] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:57:47.393680] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-22T18:57:47.387181] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-22T18:57:48.187196] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:57:48.223033] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-22T18:57:48.336548] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T18:57:48.340865] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:57:48.371087] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-22T18:57:48.365584] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-22T18:57:48.479571] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:57:48.479970] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-22T18:57:49.111602] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-22T18:57:49.113872] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-22T18:57:49.390770] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T18:57:49.397346] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-22T18:57:49.935746] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T18:57:49.945447] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T18:57:49.946060] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-22T18:57:49.949258] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-22T18:57:50.259436] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T18:57:50.269953] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-22T18:57:50.287469] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-22T18:57:50.293671] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-22T18:57:50.831950] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-22T18:57:50.835188] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-22T18:57:51.196758] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T18:57:51.205733] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-22T18:57:51.275305] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-22T18:57:51.312874] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-22T18:57:51.317615] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-22T18:57:52.007266] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T18:57:52.117630] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-22T18:57:52.755282] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T18:57:52.915700] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T18:57:52.925558] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-22T18:57:53.717753] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-22T18:57:54.076031] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T18:57:54.334107] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T18:57:54.517739] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-22T18:57:54.980378] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T18:57:55.317631] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-22T18:57:55.693676] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T18:57:55.974906] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-22T18:57:56.117696] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-22T18:57:56.917732] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-22T18:57:57.717635] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-22T18:57:58.171428] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T18:57:58.261100] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-22T18:57:58.517702] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-22T18:57:59.327969] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-22T18:57:59.330532] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T18:58:00.117766] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-22T18:58:00.491687] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T18:58:00.560572] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T18:58:00.755302] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-22T18:58:00.917688] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-22T18:58:01.526864] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T18:58:01.717754] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-22T18:58:02.413204] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T18:58:02.517734] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-22T18:58:03.317636] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-22T18:58:04.117708] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-22T18:58:04.464958] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-22T18:58:04.470715] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T18:58:04.838499] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-22T18:58:04.840004] [INFO ] [REMOTE ] GFR: Full fetch complete (11976 records). [2025-10-22T18:58:04.840074] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-22T18:58:04.922925] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-22T18:58:05.204534] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-22T18:58:05.204608] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-22T18:58:05.204899] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-22T18:58:05.204960] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-22T18:58:05.205388] [DEBUG] [LOCAL ] GFR: Trimmed 11976 records to 7332 (keeping 200 days of data) [2025-10-22T18:58:05.244139] [DEBUG] [LOCAL ] GFR: Primary data saved (7332 records). [2025-10-22T18:58:05.244266] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-22T18:58:05.244352] [INFO ] [MAIN ] Update Progress: 921/2367 symbols completed. GFR took 20.0s. Estimated remaining: 3h 5m 17s. Rate: 7.8 symbols/min [2025-10-22T18:58:05.413377] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:05.459706] [DEBUG] [LOCAL ] GGB: Loaded 51551 existing records from primary storage. [2025-10-22T18:58:05.460048] [INFO ] [MAIN ] GGB: Loaded 51551 existing records. [2025-10-22T18:58:05.634930] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:05.635163] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-22T18:58:05.635210] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-22T18:58:05.635474] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-22T18:58:05.635532] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-22T18:58:05.725741] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-22T18:58:06.005811] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:06.517765] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-22T18:58:07.081841] [DEBUG] [REMOTE ] GGB: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-22T18:58:07.082147] [WARN ] [REMOTE ] GGB: No data returned for month 2025-01 [2025-10-22T18:58:07.082238] [FATAL] [REMOTE ] GGB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T18:58:07.082287] [FATAL] [MAIN ] GGB: Failed to fetch primary data. [2025-10-22T18:58:07.082321] [WARN ] [MAIN ] GGB: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T18:58:07.082357] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-22T18:58:07.082410] [DEBUG] [LOCAL ] GGB: No primary data file found to delete. [2025-10-22T18:58:07.082444] [INFO ] [LOCAL ] GGB: Starting deletion of derivative data. [2025-10-22T18:58:07.082606] [DEBUG] [LOCAL ] GGB: Deleted derivative data file. [2025-10-22T18:58:07.083206] [INFO ] [MAIN ] Update Progress: 922/2367 symbols completed. GGB took 1.8s. Estimated remaining: 3h 4m 60s. Rate: 7.8 symbols/min [2025-10-22T18:58:07.224372] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-22T18:58:07.295697] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:07.319514] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-22T18:58:07.324830] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T18:58:07.367257] [DEBUG] [LOCAL ] GGG: Loaded 40582 existing records from primary storage. [2025-10-22T18:58:07.367589] [INFO ] [MAIN ] GGG: Loaded 40582 existing records. [2025-10-22T18:58:07.542043] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:07.542303] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-22T18:58:07.542364] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-22T18:58:07.542570] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-22T18:58:07.542623] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-22T18:58:07.879856] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:08.117697] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-22T18:58:08.556841] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T18:58:08.561140] [INFO ] [REMOTE ] GFF: Full fetch complete (43724 records). [2025-10-22T18:58:08.561219] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-22T18:58:08.917921] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-22T18:58:08.953144] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-22T18:58:08.953237] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-22T18:58:08.954016] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-22T18:58:08.954112] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-22T18:58:08.955366] [DEBUG] [LOCAL ] GFF: Trimmed 43724 records to 29398 (keeping 200 days of data) [2025-10-22T18:58:09.136795] [DEBUG] [LOCAL ] GFF: Primary data saved (29398 records). [2025-10-22T18:58:09.136926] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-22T18:58:09.137006] [INFO ] [MAIN ] Update Progress: 923/2367 symbols completed. GFF took 23.9s. Estimated remaining: 3h 4m 43s. Rate: 7.8 symbols/min [2025-10-22T18:58:09.307738] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:09.332466] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T18:58:09.352032] [DEBUG] [LOCAL ] GGT: Loaded 14524 existing records from primary storage. [2025-10-22T18:58:09.352277] [INFO ] [MAIN ] GGT: Loaded 14524 existing records. [2025-10-22T18:58:09.525841] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:09.526076] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-22T18:58:09.526123] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-22T18:58:09.526271] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-22T18:58:09.526308] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-22T18:58:09.722963] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-22T18:58:09.877013] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:10.517790] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-22T18:58:11.041602] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-22T18:58:11.084874] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-22T18:58:11.132492] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T18:58:11.317719] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-22T18:58:12.117753] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-22T18:58:12.862744] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T18:58:12.917616] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-22T18:58:13.538185] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T18:58:13.717702] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-22T18:58:14.522766] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-22T18:58:14.537212] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T18:58:15.317723] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-22T18:58:15.337329] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T18:58:15.594784] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T18:58:16.117688] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-22T18:58:16.724056] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T18:58:16.826521] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T18:58:16.834600] [INFO ] [REMOTE ] GFL: Full fetch complete (69714 records). [2025-10-22T18:58:16.834789] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-22T18:58:16.922812] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-22T18:58:17.213472] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-22T18:58:17.213556] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-22T18:58:17.214430] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-22T18:58:17.214493] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-22T18:58:17.215785] [DEBUG] [LOCAL ] GFL: Trimmed 69714 records to 47496 (keeping 200 days of data) [2025-10-22T18:58:17.501076] [DEBUG] [LOCAL ] GFL: Primary data saved (47496 records). [2025-10-22T18:58:17.501207] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-22T18:58:17.501286] [INFO ] [MAIN ] Update Progress: 924/2367 symbols completed. GFL took 32.2s. Estimated remaining: 3h 4m 37s. Rate: 7.8 symbols/min [2025-10-22T18:58:17.668207] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:17.673309] [DEBUG] [LOCAL ] GGZ: Loaded 2395 existing records from primary storage. [2025-10-22T18:58:17.673533] [INFO ] [MAIN ] GGZ: Loaded 2395 existing records. [2025-10-22T18:58:17.726341] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-22T18:58:17.854760] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:17.854980] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-22T18:58:17.855029] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-22T18:58:17.855161] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-22T18:58:17.855199] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-22T18:58:18.222470] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:18.517727] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-22T18:58:18.602266] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T18:58:19.317451] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-22T18:58:19.320322] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-22T18:58:20.110636] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-22T18:58:20.118849] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-22T18:58:20.120558] [INFO ] [REMOTE ] GFI: Full fetch complete (76982 records). [2025-10-22T18:58:20.120774] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-22T18:58:20.506331] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-22T18:58:20.506408] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-22T18:58:20.507284] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-22T18:58:20.507346] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-22T18:58:20.508794] [DEBUG] [LOCAL ] GFI: Trimmed 76982 records to 53116 (keeping 200 days of data) [2025-10-22T18:58:20.816919] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T18:58:20.839175] [DEBUG] [LOCAL ] GFI: Primary data saved (53116 records). [2025-10-22T18:58:20.839286] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-22T18:58:20.839366] [INFO ] [MAIN ] Update Progress: 925/2367 symbols completed. GFI took 35.5s. Estimated remaining: 3h 4m 22s. Rate: 7.8 symbols/min [2025-10-22T18:58:20.926734] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-22T18:58:21.019514] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:21.025398] [DEBUG] [LOCAL ] GHC: Loaded 2964 existing records from primary storage. [2025-10-22T18:58:21.025610] [INFO ] [MAIN ] GHC: Loaded 2964 existing records. [2025-10-22T18:58:21.212496] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:21.234270] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-22T18:58:21.237109] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-22T18:58:21.237522] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-22T18:58:21.238855] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T18:58:21.237923] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-22T18:58:21.593426] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:21.717701] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-22T18:58:22.359752] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T18:58:22.517758] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-22T18:58:22.552314] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T18:58:23.317724] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-22T18:58:23.829978] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-22T18:58:24.024754] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T18:58:24.117711] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-22T18:58:24.659210] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-22T18:58:24.917729] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-22T18:58:25.380890] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T18:58:25.717705] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-22T18:58:26.517711] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-22T18:58:26.767389] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-22T18:58:27.300677] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-22T18:58:27.317614] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-22T18:58:27.815242] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-22T18:58:28.117723] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-22T18:58:28.775242] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-22T18:58:28.917689] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-22T18:58:29.717737] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-22T18:58:30.306182] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-22T18:58:30.331305] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T18:58:30.517712] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-22T18:58:31.317705] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-22T18:58:31.947715] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T18:58:32.117711] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-22T18:58:32.692132] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-22T18:58:32.917616] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-22T18:58:33.435254] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-22T18:58:33.465835] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-22T18:58:33.717696] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-22T18:58:34.320861] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T18:58:34.517712] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-22T18:58:35.317698] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-22T18:58:35.470871] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T18:58:35.802202] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-22T18:58:36.117698] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-22T18:58:36.688390] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-22T18:58:36.917734] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-22T18:58:37.717689] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-22T18:58:37.970723] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T18:58:37.973713] [INFO ] [REMOTE ] GGT: Full fetch complete (19022 records). [2025-10-22T18:58:37.973797] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-22T18:58:38.335175] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-22T18:58:38.335246] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-22T18:58:38.335714] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-22T18:58:38.335777] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-22T18:58:38.336327] [DEBUG] [LOCAL ] GGT: Trimmed 19022 records to 14455 (keeping 200 days of data) [2025-10-22T18:58:38.418890] [DEBUG] [LOCAL ] GGT: Primary data saved (14455 records). [2025-10-22T18:58:38.419022] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-22T18:58:38.419099] [INFO ] [MAIN ] Update Progress: 926/2367 symbols completed. GGT took 29.3s. Estimated remaining: 3h 4m 30s. Rate: 7.8 symbols/min [2025-10-22T18:58:38.491353] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-22T18:58:38.503731] [INFO ] [REMOTE ] GHC: Full fetch complete (3692 records). [2025-10-22T18:58:38.514344] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-22T18:58:38.527583] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-22T18:58:38.699303] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:38.761255] [DEBUG] [LOCAL ] GHG: Loaded 3279 existing records from primary storage. [2025-10-22T18:58:38.763046] [INFO ] [MAIN ] GHG: Loaded 3279 existing records. [2025-10-22T18:58:39.182512] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-22T18:58:39.182321] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:39.182698] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-22T18:58:39.182779] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-22T18:58:39.182929] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-22T18:58:39.183005] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-22T18:58:39.183048] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-22T18:58:39.183521] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-22T18:58:39.183807] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-22T18:58:39.183888] [DEBUG] [LOCAL ] GHC: Trimmed 3692 records to 2954 (keeping 200 days of data) [2025-10-22T18:58:39.310424] [DEBUG] [LOCAL ] GHC: Primary data saved (2954 records). [2025-10-22T18:58:39.313319] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-22T18:58:39.313409] [INFO ] [MAIN ] Update Progress: 927/2367 symbols completed. GHC took 18.5s. Estimated remaining: 3h 4m 12s. Rate: 7.8 symbols/min [2025-10-22T18:58:39.325003] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-22T18:58:39.693610] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:39.768433] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:39.773104] [DEBUG] [LOCAL ] GHI: Loaded 7700 existing records from primary storage. [2025-10-22T18:58:39.773383] [INFO ] [MAIN ] GHI: Loaded 7700 existing records. [2025-10-22T18:58:39.954914] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:39.955174] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-22T18:58:39.955250] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-22T18:58:39.955573] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-22T18:58:39.955704] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-22T18:58:40.035184] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-22T18:58:40.133076] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-22T18:58:40.138871] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T18:58:40.344229] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:40.618905] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-22T18:58:40.917726] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-22T18:58:41.714126] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T18:58:41.717602] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-22T18:58:42.357927] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T18:58:42.517713] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-22T18:58:43.033823] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-22T18:58:43.317713] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-22T18:58:43.763388] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-22T18:58:44.117697] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-22T18:58:44.564416] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-22T18:58:44.917702] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-22T18:58:45.376369] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T18:58:45.717702] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-22T18:58:46.168537] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-22T18:58:46.517634] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-22T18:58:47.317715] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-22T18:58:47.762739] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-22T18:58:47.929092] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T18:58:48.117691] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-22T18:58:48.775199] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-22T18:58:48.917690] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-22T18:58:49.487856] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-22T18:58:49.717732] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-22T18:58:50.517636] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-22T18:58:50.659142] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T18:58:51.317689] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-22T18:58:51.522406] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T18:58:51.523366] [INFO ] [REMOTE ] GGZ: Full fetch complete (3842 records). [2025-10-22T18:58:51.523433] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-22T18:58:51.870228] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-22T18:58:51.870302] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-22T18:58:51.870414] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-22T18:58:51.870453] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-22T18:58:51.870815] [DEBUG] [LOCAL ] GGZ: Trimmed 3842 records to 2348 (keeping 200 days of data) [2025-10-22T18:58:51.885046] [DEBUG] [LOCAL ] GGZ: Primary data saved (2348 records). [2025-10-22T18:58:51.885114] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-22T18:58:51.885178] [INFO ] [MAIN ] Update Progress: 928/2367 symbols completed. GGZ took 34.4s. Estimated remaining: 3h 4m 12s. Rate: 7.8 symbols/min [2025-10-22T18:58:52.047974] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:52.054674] [DEBUG] [LOCAL ] GHLD: Loaded 4289 existing records from primary storage. [2025-10-22T18:58:52.054874] [INFO ] [MAIN ] GHLD: Loaded 4289 existing records. [2025-10-22T18:58:52.122910] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-22T18:58:52.233638] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:52.233893] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-22T18:58:52.233943] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-22T18:58:52.234105] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-22T18:58:52.234159] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-22T18:58:52.586829] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:52.897564] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-22T18:58:52.905039] [INFO ] [REMOTE ] GGG: Full fetch complete (59524 records). [2025-10-22T18:58:52.905229] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-22T18:58:52.922762] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-22T18:58:53.038739] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-22T18:58:53.314817] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-22T18:58:53.314899] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-22T18:58:53.315687] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-22T18:58:53.315749] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-22T18:58:53.316861] [DEBUG] [LOCAL ] GGG: Trimmed 59524 records to 40560 (keeping 200 days of data) [2025-10-22T18:58:53.528375] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-22T18:58:53.566982] [DEBUG] [LOCAL ] GGG: Primary data saved (40560 records). [2025-10-22T18:58:53.567111] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-22T18:58:53.567728] [INFO ] [MAIN ] Update Progress: 929/2367 symbols completed. GGG took 46.5s. Estimated remaining: 3h 3m 55s. Rate: 7.8 symbols/min [2025-10-22T18:58:53.733371] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:58:53.729170] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-22T18:58:53.754161] [DEBUG] [LOCAL ] GHM: Loaded 14348 existing records from primary storage. [2025-10-22T18:58:53.754509] [INFO ] [MAIN ] GHM: Loaded 14348 existing records. [2025-10-22T18:58:53.988871] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:58:53.989118] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-22T18:58:53.989178] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-22T18:58:53.989336] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-22T18:58:53.989375] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-22T18:58:54.288318] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-22T18:58:54.402032] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:58:54.517619] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-22T18:58:55.317696] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-22T18:58:55.354202] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-22T18:58:55.933847] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T18:58:56.117739] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-22T18:58:56.917700] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-22T18:58:57.717737] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-22T18:58:57.745225] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T18:58:58.215132] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-22T18:58:58.363786] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-22T18:58:58.517706] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-22T18:58:58.865672] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-22T18:58:59.317692] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-22T18:58:59.781340] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-22T18:59:00.117627] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-22T18:59:00.917682] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-22T18:59:01.314195] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T18:59:01.717760] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-22T18:59:02.517757] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-22T18:59:02.742828] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T18:59:03.149113] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-22T18:59:03.317704] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-22T18:59:04.117618] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-22T18:59:04.256800] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T18:59:04.403194] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T18:59:04.660132] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-22T18:59:04.917705] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-22T18:59:05.717728] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-22T18:59:05.908471] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T18:59:05.909836] [INFO ] [REMOTE ] GHG: Full fetch complete (4190 records). [2025-10-22T18:59:05.909907] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-22T18:59:06.283831] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-22T18:59:06.283929] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-22T18:59:06.284081] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-22T18:59:06.284122] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-22T18:59:06.284461] [DEBUG] [LOCAL ] GHG: Trimmed 4190 records to 3269 (keeping 200 days of data) [2025-10-22T18:59:06.305147] [DEBUG] [LOCAL ] GHG: Primary data saved (3269 records). [2025-10-22T18:59:06.305222] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-22T18:59:06.305290] [INFO ] [MAIN ] Update Progress: 930/2367 symbols completed. GHG took 27.9s. Estimated remaining: 3h 3m 55s. Rate: 7.8 symbols/min [2025-10-22T18:59:06.475323] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:59:06.495747] [DEBUG] [LOCAL ] GHY: Loaded 20916 existing records from primary storage. [2025-10-22T18:59:06.495981] [INFO ] [MAIN ] GHY: Loaded 20916 existing records. [2025-10-22T18:59:06.522102] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-22T18:59:06.624399] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-22T18:59:06.700966] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:59:06.701200] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-22T18:59:06.701259] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-22T18:59:06.701421] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-22T18:59:06.701459] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-22T18:59:07.045526] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:59:07.317720] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-22T18:59:07.343342] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T18:59:08.117726] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-22T18:59:08.203042] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T18:59:08.554706] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-22T18:59:08.917773] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-22T18:59:09.717622] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-22T18:59:10.198032] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T18:59:10.302531] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-22T18:59:10.305123] [INFO ] [REMOTE ] GHI: Full fetch complete (11240 records). [2025-10-22T18:59:10.305193] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-22T18:59:10.522910] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-22T18:59:10.658823] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-22T18:59:10.658930] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-22T18:59:10.659231] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-22T18:59:10.659273] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-22T18:59:10.659729] [DEBUG] [LOCAL ] GHI: Trimmed 11240 records to 7763 (keeping 200 days of data) [2025-10-22T18:59:10.705048] [DEBUG] [LOCAL ] GHI: Primary data saved (7763 records). [2025-10-22T18:59:10.705186] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-22T18:59:10.705306] [INFO ] [MAIN ] Update Progress: 931/2367 symbols completed. GHI took 31.4s. Estimated remaining: 3h 3m 42s. Rate: 7.8 symbols/min [2025-10-22T18:59:10.871168] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:59:10.901165] [DEBUG] [LOCAL ] GIB: Loaded 31436 existing records from primary storage. [2025-10-22T18:59:10.901418] [INFO ] [MAIN ] GIB: Loaded 31436 existing records. [2025-10-22T18:59:11.072218] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:59:11.072407] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-22T18:59:11.072453] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-22T18:59:11.072621] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-22T18:59:11.072761] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-22T18:59:11.322990] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-22T18:59:11.418760] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:59:11.609511] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T18:59:12.117622] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-22T18:59:12.354720] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T18:59:12.917729] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-22T18:59:13.704468] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T18:59:13.717604] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-22T18:59:14.058292] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T18:59:14.517710] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-22T18:59:15.096426] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T18:59:15.123728] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-22T18:59:15.317697] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-22T18:59:15.938485] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T18:59:16.117701] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-22T18:59:16.917735] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-22T18:59:17.495128] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T18:59:17.717716] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-22T18:59:17.910389] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T18:59:18.517745] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-22T18:59:18.883200] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T18:59:19.283762] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-22T18:59:19.317618] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-22T18:59:19.884793] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-22T18:59:20.117700] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-22T18:59:20.917633] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-22T18:59:21.156299] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-22T18:59:21.717756] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-22T18:59:21.864221] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-22T18:59:22.517634] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-22T18:59:22.738531] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T18:59:22.739901] [INFO ] [REMOTE ] GHLD: Full fetch complete (5130 records). [2025-10-22T18:59:22.739968] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-22T18:59:23.094372] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-22T18:59:23.094452] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-22T18:59:23.094659] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-22T18:59:23.094724] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-22T18:59:23.095094] [DEBUG] [LOCAL ] GHLD: Trimmed 5130 records to 4327 (keeping 200 days of data) [2025-10-22T18:59:23.120690] [DEBUG] [LOCAL ] GHLD: Primary data saved (4327 records). [2025-10-22T18:59:23.120765] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-22T18:59:23.120835] [INFO ] [MAIN ] Update Progress: 932/2367 symbols completed. GHLD took 31.2s. Estimated remaining: 3h 3m 42s. Rate: 7.8 symbols/min [2025-10-22T18:59:23.294031] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:59:23.307341] [DEBUG] [LOCAL ] GIC: Loaded 13257 existing records from primary storage. [2025-10-22T18:59:23.307545] [INFO ] [MAIN ] GIC: Loaded 13257 existing records. [2025-10-22T18:59:23.327564] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-22T18:59:23.484795] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:59:23.485026] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-22T18:59:23.485080] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-22T18:59:23.485320] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-22T18:59:23.485376] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-22T18:59:23.830958] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:59:24.117747] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-22T18:59:24.270235] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T18:59:24.341554] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-22T18:59:24.761018] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-22T18:59:24.917742] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-22T18:59:25.717731] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-22T18:59:26.006210] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T18:59:26.009358] [INFO ] [REMOTE ] GHM: Full fetch complete (21956 records). [2025-10-22T18:59:26.009428] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-22T18:59:26.375497] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-22T18:59:26.375577] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-22T18:59:26.376090] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-22T18:59:26.376151] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-22T18:59:26.376826] [DEBUG] [LOCAL ] GHM: Trimmed 21956 records to 14307 (keeping 200 days of data) [2025-10-22T18:59:26.463669] [DEBUG] [LOCAL ] GHM: Primary data saved (14307 records). [2025-10-22T18:59:26.463822] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-22T18:59:26.463915] [INFO ] [MAIN ] Update Progress: 933/2367 symbols completed. GHM took 32.9s. Estimated remaining: 3h 3m 28s. Rate: 7.8 symbols/min [2025-10-22T18:59:26.527699] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-22T18:59:26.666302] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T18:59:26.669457] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:59:26.715706] [DEBUG] [LOCAL ] GIL: Loaded 43981 existing records from primary storage. [2025-10-22T18:59:26.716010] [INFO ] [MAIN ] GIL: Loaded 43981 existing records. [2025-10-22T18:59:26.886329] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:59:26.886561] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-22T18:59:26.886608] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-22T18:59:26.886819] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-22T18:59:26.886873] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-22T18:59:27.233099] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:59:27.317624] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-22T18:59:27.583566] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-22T18:59:28.117711] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-22T18:59:28.313764] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T18:59:28.917735] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-22T18:59:29.330898] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T18:59:29.717747] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-22T18:59:29.826708] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-22T18:59:30.517736] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-22T18:59:30.709023] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T18:59:31.317696] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-22T18:59:31.444039] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T18:59:32.117749] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-22T18:59:32.437034] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T18:59:32.441454] [INFO ] [REMOTE ] GHY: Full fetch complete (32399 records). [2025-10-22T18:59:32.441552] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-22T18:59:32.830669] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-22T18:59:32.830767] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-22T18:59:32.831341] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-22T18:59:32.831384] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-22T18:59:32.832290] [DEBUG] [LOCAL ] GHY: Trimmed 32399 records to 20840 (keeping 200 days of data) [2025-10-22T18:59:32.918111] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-22T18:59:32.956883] [DEBUG] [LOCAL ] GHY: Primary data saved (20840 records). [2025-10-22T18:59:32.956994] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-22T18:59:32.957070] [INFO ] [MAIN ] Update Progress: 934/2367 symbols completed. GHY took 26.7s. Estimated remaining: 3h 3m 18s. Rate: 7.8 symbols/min [2025-10-22T18:59:33.122188] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:59:33.169012] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-10-22T18:59:33.169303] [INFO ] [MAIN ] GIS: Loaded 53675 existing records. [2025-10-22T18:59:33.344210] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:59:33.344581] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-22T18:59:33.344752] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-22T18:59:33.344984] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-22T18:59:33.345040] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-22T18:59:33.697832] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:59:33.718198] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-22T18:59:33.720467] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T18:59:33.885689] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-22T18:59:34.517752] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-22T18:59:35.050501] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T18:59:35.317722] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-22T18:59:35.526875] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-22T18:59:36.117757] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-22T18:59:36.701322] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T18:59:36.917684] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-22T18:59:37.649111] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T18:59:37.717612] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-22T18:59:38.372950] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T18:59:38.517751] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-22T18:59:39.186699] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T18:59:39.311123] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T18:59:39.317598] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-22T18:59:40.115738] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T18:59:40.118717] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-22T18:59:40.917702] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-22T18:59:41.717724] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-22T18:59:42.054472] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-22T18:59:42.517698] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-22T18:59:42.816918] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-10-22T18:59:43.055284] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T18:59:43.060764] [INFO ] [REMOTE ] GIB: Full fetch complete (46463 records). [2025-10-22T18:59:43.060920] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-22T18:59:43.321282] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-22T18:59:43.450453] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-22T18:59:43.450612] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-22T18:59:43.451400] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-22T18:59:43.451478] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-22T18:59:43.452604] [DEBUG] [LOCAL ] GIB: Trimmed 46463 records to 31346 (keeping 200 days of data) [2025-10-22T18:59:43.602757] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T18:59:43.676465] [DEBUG] [LOCAL ] GIB: Primary data saved (31346 records). [2025-10-22T18:59:43.676671] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-22T18:59:43.676788] [INFO ] [MAIN ] Update Progress: 935/2367 symbols completed. GIB took 33.0s. Estimated remaining: 3h 3m 15s. Rate: 7.8 symbols/min [2025-10-22T18:59:43.848678] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:59:43.887350] [DEBUG] [LOCAL ] GKOS: Loaded 42499 existing records from primary storage. [2025-10-22T18:59:43.887726] [INFO ] [MAIN ] GKOS: Loaded 42499 existing records. [2025-10-22T18:59:44.073601] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:59:44.073861] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-22T18:59:44.073910] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-22T18:59:44.074201] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-22T18:59:44.074259] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-22T18:59:44.123008] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-22T18:59:44.451398] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:59:44.917729] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-22T18:59:45.002743] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-22T18:59:45.070289] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T18:59:45.717714] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-22T18:59:46.063873] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T18:59:46.517695] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-22T18:59:46.676411] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T18:59:46.678751] [INFO ] [REMOTE ] GIC: Full fetch complete (19821 records). [2025-10-22T18:59:46.678827] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-22T18:59:47.035758] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-22T18:59:47.035835] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-22T18:59:47.036240] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-22T18:59:47.036278] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-22T18:59:47.036829] [DEBUG] [LOCAL ] GIC: Trimmed 19821 records to 13184 (keeping 200 days of data) [2025-10-22T18:59:47.115323] [DEBUG] [LOCAL ] GIC: Primary data saved (13184 records). [2025-10-22T18:59:47.115450] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-22T18:59:47.115531] [INFO ] [MAIN ] Update Progress: 936/2367 symbols completed. GIC took 24.0s. Estimated remaining: 3h 3m 1s. Rate: 7.8 symbols/min [2025-10-22T18:59:47.278094] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T18:59:47.313771] [DEBUG] [LOCAL ] GL: Loaded 37443 existing records from primary storage. [2025-10-22T18:59:47.314055] [INFO ] [MAIN ] GL: Loaded 37443 existing records. [2025-10-22T18:59:47.325300] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-22T18:59:47.488806] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T18:59:47.489000] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-22T18:59:47.489056] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-22T18:59:47.489272] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-22T18:59:47.489309] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-22T18:59:47.846385] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T18:59:48.063711] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T18:59:48.117715] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-22T18:59:48.853158] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T18:59:48.917629] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-22T18:59:49.628439] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T18:59:49.717745] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-22T18:59:50.522803] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-22T18:59:50.543835] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T18:59:51.283418] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T18:59:51.317693] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-22T18:59:51.994421] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T18:59:52.117707] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-22T18:59:52.917712] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-22T18:59:52.984921] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T18:59:53.717757] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-22T18:59:53.895161] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T18:59:54.153942] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-22T18:59:54.517697] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-22T18:59:55.317770] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-22T18:59:55.370452] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T18:59:56.093351] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T18:59:56.117620] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-22T18:59:56.917756] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-22T18:59:57.284043] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T18:59:57.672857] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T18:59:57.717760] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-22T18:59:58.459366] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T18:59:58.517634] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-22T18:59:59.317729] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-22T18:59:59.694492] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T18:59:59.736634] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T19:00:00.117743] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-22T19:00:00.917729] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-22T19:00:00.994125] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T19:00:01.213544] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-22T19:00:01.717886] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-22T19:00:02.517792] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-22T19:00:03.318125] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-22T19:00:03.322133] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-22T19:00:03.333254] [INFO ] [REMOTE ] GIL: Full fetch complete (62589 records). [2025-10-22T19:00:03.333500] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-22T19:00:03.749783] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-22T19:00:03.850824] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-22T19:00:03.850944] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-22T19:00:03.852028] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-22T19:00:03.852101] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-22T19:00:03.853688] [DEBUG] [LOCAL ] GIL: Trimmed 62589 records to 43951 (keeping 200 days of data) [2025-10-22T19:00:04.121018] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-22T19:00:04.129217] [DEBUG] [LOCAL ] GIL: Primary data saved (43951 records). [2025-10-22T19:00:04.129307] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-22T19:00:04.130109] [INFO ] [MAIN ] Update Progress: 937/2367 symbols completed. GIL took 37.7s. Estimated remaining: 3h 3m 8s. Rate: 7.8 symbols/min [2025-10-22T19:00:04.315201] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:00:04.315365] [DEBUG] [LOCAL ] GLOB: No existing data file found in primary storage. [2025-10-22T19:00:04.315402] [WARN ] [MAIN ] GLOB: No existing data found, performing full refresh instead. [2025-10-22T19:00:04.315535] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-22T19:00:04.315596] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-22T19:00:04.315698] [DEBUG] [LOCAL ] GLOB: No primary data file found to delete. [2025-10-22T19:00:04.315745] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-22T19:00:04.673566] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:00:04.925381] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-22T19:00:04.932571] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-22T19:00:05.717781] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-22T19:00:06.262301] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.94 seconds). [2025-10-22T19:00:06.517690] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-22T19:00:07.297350] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T19:00:07.317614] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-22T19:00:07.419489] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (3.30 seconds). [2025-10-22T19:00:07.672057] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-22T19:00:08.036735] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T19:00:08.117632] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-22T19:00:08.876019] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T19:00:08.917701] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-22T19:00:09.680374] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T19:00:09.717621] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-22T19:00:10.517781] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-22T19:00:10.783557] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T19:00:10.790062] [INFO ] [REMOTE ] GL: Full fetch complete (54933 records). [2025-10-22T19:00:10.790179] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-22T19:00:11.173830] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-22T19:00:11.173911] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-22T19:00:11.174626] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-22T19:00:11.174700] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-22T19:00:11.175775] [DEBUG] [LOCAL ] GL: Trimmed 54933 records to 37380 (keeping 200 days of data) [2025-10-22T19:00:11.352619] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-22T19:00:11.438770] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T19:00:11.452907] [DEBUG] [LOCAL ] GL: Primary data saved (37380 records). [2025-10-22T19:00:11.453351] [INFO ] [MAIN ] GL: Full history saved. [2025-10-22T19:00:11.453444] [INFO ] [MAIN ] Update Progress: 938/2367 symbols completed. GL took 24.3s. Estimated remaining: 3h 2m 59s. Rate: 7.8 symbols/min [2025-10-22T19:00:11.624774] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:00:11.634989] [DEBUG] [LOCAL ] GLP: Loaded 9296 existing records from primary storage. [2025-10-22T19:00:11.635156] [INFO ] [MAIN ] GLP: Loaded 9296 existing records. [2025-10-22T19:00:11.813224] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:00:11.813596] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-22T19:00:11.813761] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-22T19:00:11.814173] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-22T19:00:11.814301] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-22T19:00:12.012137] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T19:00:12.123837] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-22T19:00:12.201558] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:00:12.917639] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-22T19:00:13.674367] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T19:00:13.719239] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-22T19:00:13.748515] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T19:00:13.746395] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-22T19:00:14.517717] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-22T19:00:15.317764] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-22T19:00:15.339376] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T19:00:16.117690] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-22T19:00:16.315100] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-22T19:00:16.322548] [INFO ] [REMOTE ] GKOS: Full fetch complete (60680 records). [2025-10-22T19:00:16.322796] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-22T19:00:16.773540] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-22T19:00:16.773722] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-22T19:00:16.774777] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-22T19:00:16.774915] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-22T19:00:16.776388] [DEBUG] [LOCAL ] GKOS: Trimmed 60680 records to 42465 (keeping 200 days of data) [2025-10-22T19:00:16.907358] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-22T19:00:16.918689] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-22T19:00:17.067968] [DEBUG] [LOCAL ] GKOS: Primary data saved (42465 records). [2025-10-22T19:00:17.068149] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-22T19:00:17.068253] [INFO ] [MAIN ] Update Progress: 939/2367 symbols completed. GKOS took 33.4s. Estimated remaining: 3h 2m 48s. Rate: 7.8 symbols/min [2025-10-22T19:00:17.229585] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T19:00:17.309490] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:00:17.363014] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-10-22T19:00:17.363402] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-10-22T19:00:17.573388] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:00:17.573621] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-22T19:00:17.573702] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-22T19:00:17.574067] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-22T19:00:17.574125] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-22T19:00:17.722785] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-22T19:00:17.988627] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:00:18.517742] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-22T19:00:19.317706] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-22T19:00:19.499566] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T19:00:19.506784] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-22T19:00:19.977716] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-22T19:00:20.117698] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-22T19:00:20.917707] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-22T19:00:21.467604] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-22T19:00:21.717714] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-22T19:00:21.964043] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T19:00:22.384030] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-22T19:00:22.517711] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-22T19:00:23.317713] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-22T19:00:23.957038] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T19:00:23.971451] [INFO ] [REMOTE ] GIS: Full fetch complete (77844 records). [2025-10-22T19:00:23.971711] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-22T19:00:24.132318] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-22T19:00:24.208091] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-22T19:00:24.565730] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-22T19:00:24.565833] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-22T19:00:24.566868] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-22T19:00:24.566933] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-22T19:00:24.568462] [DEBUG] [LOCAL ] GIS: Trimmed 77844 records to 53675 (keeping 200 days of data) [2025-10-22T19:00:24.887048] [DEBUG] [LOCAL ] GIS: Primary data saved (53675 records). [2025-10-22T19:00:24.887163] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-22T19:00:24.887237] [INFO ] [MAIN ] Update Progress: 940/2367 symbols completed. GIS took 51.9s. Estimated remaining: 3h 2m 41s. Rate: 7.8 symbols/min [2025-10-22T19:00:24.941982] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-22T19:00:25.057751] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:00:25.105385] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-22T19:00:25.105704] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-22T19:00:25.216518] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T19:00:25.297314] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:00:25.297508] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-22T19:00:25.297557] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-22T19:00:25.297791] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-22T19:00:25.297847] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-22T19:00:25.688759] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:00:25.682839] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-22T19:00:25.717618] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-22T19:00:26.517697] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-22T19:00:27.282894] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-22T19:00:27.326533] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-22T19:00:27.346147] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T19:00:27.531086] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-22T19:00:28.117697] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-22T19:00:28.917749] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-22T19:00:29.516931] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-22T19:00:29.717714] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-22T19:00:29.894893] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T19:00:30.517628] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-22T19:00:30.528467] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-22T19:00:30.991728] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-22T19:00:31.317715] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-22T19:00:31.963494] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T19:00:32.117617] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-22T19:00:32.195803] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-22T19:00:32.917698] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-22T19:00:33.717619] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-22T19:00:34.100544] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T19:00:34.102470] [INFO ] [REMOTE ] GLP: Full fetch complete (14257 records). [2025-10-22T19:00:34.102540] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-22T19:00:34.499264] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-22T19:00:34.487503] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-22T19:00:34.508568] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-22T19:00:34.509270] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-22T19:00:34.509349] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-22T19:00:34.510118] [DEBUG] [LOCAL ] GLP: Trimmed 14257 records to 9234 (keeping 200 days of data) [2025-10-22T19:00:34.532508] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-22T19:00:34.566356] [DEBUG] [LOCAL ] GLP: Primary data saved (9234 records). [2025-10-22T19:00:34.566535] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-22T19:00:34.566619] [INFO ] [MAIN ] Update Progress: 941/2367 symbols completed. GLP took 23.1s. Estimated remaining: 3h 2m 36s. Rate: 7.8 symbols/min [2025-10-22T19:00:34.756277] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:00:34.803987] [DEBUG] [LOCAL ] GME: Loaded 53781 existing records from primary storage. [2025-10-22T19:00:34.804338] [INFO ] [MAIN ] GME: Loaded 53781 existing records. [2025-10-22T19:00:34.978416] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:00:34.978612] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-22T19:00:34.978685] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-22T19:00:34.978962] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-22T19:00:34.979001] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-22T19:00:35.334304] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:00:35.329897] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-22T19:00:35.788936] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-22T19:00:36.117731] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-22T19:00:36.642157] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-22T19:00:36.917630] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-22T19:00:37.210844] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T19:00:37.218811] [INFO ] [REMOTE ] GLOB: Full fetch complete (66253 records). [2025-10-22T19:00:37.218927] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-22T19:00:37.609027] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-22T19:00:37.609122] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-22T19:00:37.610040] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-22T19:00:37.610115] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-22T19:00:37.611612] [DEBUG] [LOCAL ] GLOB: Trimmed 66253 records to 48049 (keeping 200 days of data) [2025-10-22T19:00:37.723678] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-22T19:00:37.726063] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T19:00:37.932729] [DEBUG] [LOCAL ] GLOB: Primary data saved (48049 records). [2025-10-22T19:00:37.932861] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-22T19:00:37.932930] [INFO ] [MAIN ] Update Progress: 942/2367 symbols completed. GLOB took 33.8s. Estimated remaining: 3h 2m 22s. Rate: 7.8 symbols/min [2025-10-22T19:00:38.098117] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:00:38.160088] [DEBUG] [LOCAL ] GMED: Loaded 48118 existing records from primary storage. [2025-10-22T19:00:38.160413] [INFO ] [MAIN ] GMED: Loaded 48118 existing records. [2025-10-22T19:00:38.332081] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:00:38.332294] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-22T19:00:38.332352] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-22T19:00:38.332553] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-22T19:00:38.332607] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-22T19:00:38.522771] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-22T19:00:38.725501] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:00:39.158845] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-22T19:00:39.317701] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-22T19:00:39.908619] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-22T19:00:40.117633] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-22T19:00:40.695404] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-22T19:00:40.853786] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T19:00:40.917617] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-22T19:00:41.717625] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-22T19:00:41.750817] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T19:00:42.517745] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-22T19:00:42.816580] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-22T19:00:43.317704] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-22T19:00:44.117629] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-22T19:00:44.255203] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-22T19:00:44.430913] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T19:00:44.631101] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-22T19:00:44.917699] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-22T19:00:45.717639] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-22T19:00:46.217841] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-22T19:00:46.517747] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-22T19:00:47.317741] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-22T19:00:47.506870] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-22T19:00:47.970741] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-22T19:00:48.117613] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-22T19:00:48.214205] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T19:00:48.917623] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-22T19:00:49.018382] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T19:00:49.717732] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-22T19:00:50.526628] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-22T19:00:50.529462] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-22T19:00:50.539214] [INFO ] [REMOTE ] GLW: Full fetch complete (77798 records). [2025-10-22T19:00:50.539336] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-22T19:00:50.928031] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T19:00:50.976494] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-22T19:00:50.976878] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-22T19:00:50.978162] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-22T19:00:50.978227] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-22T19:00:50.979509] [DEBUG] [LOCAL ] GLW: Trimmed 77798 records to 53635 (keeping 200 days of data) [2025-10-22T19:00:51.295235] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-10-22T19:00:51.295441] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-22T19:00:51.295531] [INFO ] [MAIN ] Update Progress: 943/2367 symbols completed. GLW took 34.2s. Estimated remaining: 3h 2m 23s. Rate: 7.8 symbols/min [2025-10-22T19:00:51.326554] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-22T19:00:51.471314] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:00:51.504801] [DEBUG] [LOCAL ] GMRE: Loaded 36650 existing records from primary storage. [2025-10-22T19:00:51.505071] [INFO ] [MAIN ] GMRE: Loaded 36650 existing records. [2025-10-22T19:00:51.686066] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:00:51.686289] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-22T19:00:51.686400] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-22T19:00:51.686693] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-22T19:00:51.686750] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-22T19:00:51.962542] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-22T19:00:52.092958] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:00:52.117634] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-22T19:00:52.917759] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-22T19:00:52.971145] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T19:00:53.222265] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-22T19:00:53.317770] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T19:00:53.415077] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-22T19:00:53.423740] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-22T19:00:53.423901] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-22T19:00:53.722952] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-22T19:00:53.804524] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-22T19:00:53.804610] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-22T19:00:53.805556] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-22T19:00:53.805617] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-22T19:00:53.807058] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 53729 (keeping 200 days of data) [2025-10-22T19:00:54.124959] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-22T19:00:54.125094] [INFO ] [MAIN ] GM: Full history saved. [2025-10-22T19:00:54.125198] [INFO ] [MAIN ] Update Progress: 944/2367 symbols completed. GM took 29.2s. Estimated remaining: 3h 2m 8s. Rate: 7.8 symbols/min [2025-10-22T19:00:54.288253] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:00:54.306038] [DEBUG] [LOCAL ] GNE: Loaded 18119 existing records from primary storage. [2025-10-22T19:00:54.306265] [INFO ] [MAIN ] GNE: Loaded 18119 existing records. [2025-10-22T19:00:54.478378] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:00:54.478567] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-22T19:00:54.478684] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-22T19:00:54.478883] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-22T19:00:54.478952] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-22T19:00:54.522722] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-22T19:00:54.849499] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:00:55.317704] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-22T19:00:55.346946] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T19:00:56.117760] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-22T19:00:56.141212] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-22T19:00:56.917700] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-22T19:00:57.098134] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-22T19:00:57.125423] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T19:00:57.380322] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T19:00:57.717712] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-22T19:00:58.517765] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-22T19:00:59.055884] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T19:00:59.069833] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-22T19:00:59.317716] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-22T19:01:00.117693] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-22T19:01:00.749445] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T19:01:00.917622] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-22T19:01:01.717632] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-22T19:01:02.015908] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T19:01:02.517703] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-22T19:01:02.557901] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T19:01:02.572283] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T19:01:03.317731] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-22T19:01:04.117709] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-22T19:01:04.188723] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T19:01:04.321568] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-22T19:01:04.917697] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-22T19:01:05.605369] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T19:01:05.717620] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-22T19:01:06.517666] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-22T19:01:06.665318] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T19:01:06.820831] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T19:01:07.317638] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-22T19:01:07.779636] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T19:01:08.117697] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-22T19:01:08.917696] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-22T19:01:09.057830] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T19:01:09.067873] [INFO ] [REMOTE ] GMED: Full fetch complete (70113 records). [2025-10-22T19:01:09.068254] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-22T19:01:09.262946] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T19:01:09.491734] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-22T19:01:09.491830] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-22T19:01:09.492703] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-22T19:01:09.492767] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-22T19:01:09.494186] [DEBUG] [LOCAL ] GMED: Trimmed 70113 records to 48094 (keeping 200 days of data) [2025-10-22T19:01:09.735757] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-22T19:01:09.765310] [DEBUG] [LOCAL ] GMED: Primary data saved (48094 records). [2025-10-22T19:01:09.765488] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-22T19:01:09.766113] [INFO ] [MAIN ] Update Progress: 945/2367 symbols completed. GMED took 31.8s. Estimated remaining: 3h 2m 12s. Rate: 7.8 symbols/min [2025-10-22T19:01:09.930052] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:01:09.969316] [DEBUG] [LOCAL ] GNK: Loaded 39630 existing records from primary storage. [2025-10-22T19:01:09.969575] [INFO ] [MAIN ] GNK: Loaded 39630 existing records. [2025-10-22T19:01:10.148664] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:01:10.148880] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-22T19:01:10.148934] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-22T19:01:10.149170] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-22T19:01:10.149224] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-22T19:01:10.490720] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:01:10.517609] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-22T19:01:11.317636] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-22T19:01:11.362116] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T19:01:11.604380] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-10-22T19:01:11.663522] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T19:01:12.117636] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-22T19:01:12.346131] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-22T19:01:12.917798] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-22T19:01:13.449622] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T19:01:13.717711] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-22T19:01:14.517711] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-22T19:01:15.296578] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T19:01:15.317607] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-22T19:01:15.487932] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-22T19:01:15.488939] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T19:01:16.117746] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-22T19:01:16.723918] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T19:01:16.862343] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T19:01:16.866040] [INFO ] [REMOTE ] GNE: Full fetch complete (22564 records). [2025-10-22T19:01:16.866253] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-22T19:01:16.927069] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-22T19:01:17.299142] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-22T19:01:17.299276] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-22T19:01:17.300062] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-22T19:01:17.300131] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-22T19:01:17.300926] [DEBUG] [LOCAL ] GNE: Trimmed 22564 records to 18074 (keeping 200 days of data) [2025-10-22T19:01:17.414240] [DEBUG] [LOCAL ] GNE: Primary data saved (18074 records). [2025-10-22T19:01:17.414384] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-22T19:01:17.414465] [INFO ] [MAIN ] Update Progress: 946/2367 symbols completed. GNE took 23.3s. Estimated remaining: 3h 2m 5s. Rate: 7.8 symbols/min [2025-10-22T19:01:17.586911] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:01:17.628675] [DEBUG] [LOCAL ] GNL: Loaded 46556 existing records from primary storage. [2025-10-22T19:01:17.628976] [INFO ] [MAIN ] GNL: Loaded 46556 existing records. [2025-10-22T19:01:17.723949] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-22T19:01:17.804964] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:01:17.805169] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-22T19:01:17.805216] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-22T19:01:17.805478] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-22T19:01:17.805534] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-22T19:01:18.154965] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:01:18.517699] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-22T19:01:19.317794] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-22T19:01:19.355799] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T19:01:19.488564] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-22T19:01:19.616688] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T19:01:20.117747] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-22T19:01:20.797910] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T19:01:20.917640] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-22T19:01:21.547092] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-22T19:01:21.551814] [INFO ] [REMOTE ] GMRE: Full fetch complete (51970 records). [2025-10-22T19:01:21.551952] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-22T19:01:21.722871] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-22T19:01:21.979895] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-22T19:01:21.979990] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-22T19:01:21.980780] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-22T19:01:21.980843] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-22T19:01:21.982017] [DEBUG] [LOCAL ] GMRE: Trimmed 51970 records to 36438 (keeping 200 days of data) [2025-10-22T19:01:22.198589] [DEBUG] [LOCAL ] GMRE: Primary data saved (36438 records). [2025-10-22T19:01:22.198742] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-22T19:01:22.198829] [INFO ] [MAIN ] Update Progress: 947/2367 symbols completed. GMRE took 30.9s. Estimated remaining: 3h 1m 53s. Rate: 7.8 symbols/min [2025-10-22T19:01:22.365790] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:01:22.408344] [DEBUG] [LOCAL ] GNRC: Loaded 45398 existing records from primary storage. [2025-10-22T19:01:22.408623] [INFO ] [MAIN ] GNRC: Loaded 45398 existing records. [2025-10-22T19:01:22.520428] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-22T19:01:22.599308] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T19:01:22.650035] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:01:22.650634] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-22T19:01:22.650727] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-22T19:01:22.650948] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-22T19:01:22.651005] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-22T19:01:23.003006] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:01:23.317754] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-22T19:01:24.094077] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T19:01:24.122816] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-22T19:01:24.143757] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-22T19:01:24.924073] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-22T19:01:24.940218] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T19:01:25.455760] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T19:01:25.717725] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-22T19:01:26.475151] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T19:01:26.517622] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-22T19:01:27.317698] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-22T19:01:27.845546] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T19:01:28.117703] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-22T19:01:28.281707] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-22T19:01:28.290465] [INFO ] [REMOTE ] GME: Full fetch complete (77923 records). [2025-10-22T19:01:28.290595] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-22T19:01:28.677589] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-22T19:01:28.677711] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-22T19:01:28.678680] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-22T19:01:28.678742] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-22T19:01:28.680161] [DEBUG] [LOCAL ] GME: Trimmed 77923 records to 53781 (keeping 200 days of data) [2025-10-22T19:01:28.945144] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-22T19:01:28.995521] [DEBUG] [LOCAL ] GME: Primary data saved (53781 records). [2025-10-22T19:01:28.995755] [INFO ] [MAIN ] GME: Full history saved. [2025-10-22T19:01:28.995844] [INFO ] [MAIN ] Update Progress: 948/2367 symbols completed. GME took 54.4s. Estimated remaining: 3h 1m 44s. Rate: 7.8 symbols/min [2025-10-22T19:01:29.127367] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T19:01:29.205218] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:01:29.213625] [DEBUG] [LOCAL ] GNT: Loaded 8676 existing records from primary storage. [2025-10-22T19:01:29.213829] [INFO ] [MAIN ] GNT: Loaded 8676 existing records. [2025-10-22T19:01:29.389319] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:01:29.389514] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-22T19:01:29.389560] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-22T19:01:29.389763] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-22T19:01:29.389818] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-22T19:01:29.725605] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-22T19:01:29.770706] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T19:01:29.806073] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:01:30.517717] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-22T19:01:30.815120] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-22T19:01:31.317705] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-22T19:01:31.378772] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T19:01:32.077423] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T19:01:32.087945] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T19:01:32.089977] [INFO ] [REMOTE ] GNK: Full fetch complete (57298 records). [2025-10-22T19:01:32.090579] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-22T19:01:32.122817] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-22T19:01:32.477360] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-22T19:01:32.477455] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-22T19:01:32.478269] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-22T19:01:32.478334] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-22T19:01:32.479569] [DEBUG] [LOCAL ] GNK: Trimmed 57298 records to 39524 (keeping 200 days of data) [2025-10-22T19:01:32.712533] [DEBUG] [LOCAL ] GNK: Primary data saved (39524 records). [2025-10-22T19:01:32.712720] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-22T19:01:32.713241] [INFO ] [MAIN ] Update Progress: 949/2367 symbols completed. GNK took 22.9s. Estimated remaining: 3h 1m 30s. Rate: 7.8 symbols/min [2025-10-22T19:01:32.884938] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:01:32.930173] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-22T19:01:32.933569] [DEBUG] [LOCAL ] GNW: Loaded 51379 existing records from primary storage. [2025-10-22T19:01:32.933954] [INFO ] [MAIN ] GNW: Loaded 51379 existing records. [2025-10-22T19:01:33.115031] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:01:33.115300] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-22T19:01:33.115365] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-22T19:01:33.115811] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-22T19:01:33.115866] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-22T19:01:33.486748] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:01:33.699675] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T19:01:33.717608] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-22T19:01:34.517738] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-22T19:01:34.609095] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T19:01:35.317921] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-22T19:01:35.475270] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T19:01:36.117729] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-22T19:01:36.163205] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T19:01:36.917665] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-22T19:01:37.048516] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T19:01:37.665449] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T19:01:37.717624] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-22T19:01:38.415635] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T19:01:38.517784] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-22T19:01:39.238333] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T19:01:39.317699] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-22T19:01:40.082923] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T19:01:40.117722] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-22T19:01:40.895311] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T19:01:40.919221] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-22T19:01:40.925215] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T19:01:41.543385] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T19:01:41.717726] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-22T19:01:42.465217] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-22T19:01:42.517708] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-22T19:01:43.317637] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-22T19:01:44.087429] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-22T19:01:44.117723] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-22T19:01:44.176957] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T19:01:44.917885] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T19:01:44.918013] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-22T19:01:45.717712] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-22T19:01:46.517622] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-22T19:01:46.626452] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T19:01:47.317693] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-22T19:01:47.353299] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T19:01:47.360926] [INFO ] [REMOTE ] GNL: Full fetch complete (68148 records). [2025-10-22T19:01:47.361071] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-22T19:01:47.752574] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-22T19:01:47.752693] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-22T19:01:47.754184] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-22T19:01:47.754250] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-22T19:01:47.755720] [DEBUG] [LOCAL ] GNL: Trimmed 68148 records to 46512 (keeping 200 days of data) [2025-10-22T19:01:48.026327] [DEBUG] [LOCAL ] GNL: Primary data saved (46512 records). [2025-10-22T19:01:48.026523] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-22T19:01:48.026610] [INFO ] [MAIN ] Update Progress: 950/2367 symbols completed. GNL took 30.6s. Estimated remaining: 3h 1m 34s. Rate: 7.8 symbols/min [2025-10-22T19:01:48.118127] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-22T19:01:48.118200] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-22T19:01:48.211474] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:01:48.251036] [DEBUG] [LOCAL ] GOF: Loaded 42730 existing records from primary storage. [2025-10-22T19:01:48.251355] [INFO ] [MAIN ] GOF: Loaded 42730 existing records. [2025-10-22T19:01:48.433197] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:01:48.433560] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-22T19:01:48.433638] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-22T19:01:48.444630] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-22T19:01:48.449877] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-22T19:01:48.555588] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-22T19:01:48.826027] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:01:48.917626] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-22T19:01:49.717667] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-22T19:01:49.927550] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T19:01:50.339628] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-22T19:01:50.517752] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-22T19:01:50.678803] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T19:01:51.317755] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-22T19:01:52.117705] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-22T19:01:52.525407] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-22T19:01:52.907880] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T19:01:52.917630] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-22T19:01:53.717748] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-22T19:01:53.781959] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T19:01:53.784456] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-22T19:01:54.517751] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-22T19:01:55.317756] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-22T19:01:55.595322] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T19:01:55.603359] [INFO ] [REMOTE ] GNRC: Full fetch complete (65712 records). [2025-10-22T19:01:55.603524] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-22T19:01:56.011008] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-22T19:01:56.011127] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-22T19:01:56.012079] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-22T19:01:56.012145] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-22T19:01:56.013810] [DEBUG] [LOCAL ] GNRC: Trimmed 65712 records to 45359 (keeping 200 days of data) [2025-10-22T19:01:56.117666] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-22T19:01:56.304682] [DEBUG] [LOCAL ] GNRC: Primary data saved (45359 records). [2025-10-22T19:01:56.304975] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-22T19:01:56.305077] [INFO ] [MAIN ] Update Progress: 951/2367 symbols completed. GNRC took 34.1s. Estimated remaining: 3h 1m 27s. Rate: 7.8 symbols/min [2025-10-22T19:01:56.507828] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:01:56.540275] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-22T19:01:56.575469] [DEBUG] [LOCAL ] GOLF: Loaded 30473 existing records from primary storage. [2025-10-22T19:01:56.575773] [INFO ] [MAIN ] GOLF: Loaded 30473 existing records. [2025-10-22T19:01:56.754178] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:01:56.754437] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-22T19:01:56.754484] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-22T19:01:56.754787] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-22T19:01:56.754843] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-22T19:01:56.930171] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-22T19:01:57.128834] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:01:57.428953] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-22T19:01:57.445524] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T19:01:57.448260] [INFO ] [REMOTE ] GNT: Full fetch complete (11455 records). [2025-10-22T19:01:57.448330] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-22T19:01:57.722796] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-22T19:01:57.837268] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-22T19:01:57.837354] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-22T19:01:57.837630] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-22T19:01:57.837730] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-22T19:01:57.838319] [DEBUG] [LOCAL ] GNT: Trimmed 11455 records to 8632 (keeping 200 days of data) [2025-10-22T19:01:57.896074] [DEBUG] [LOCAL ] GNT: Primary data saved (8632 records). [2025-10-22T19:01:57.896220] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-22T19:01:57.896303] [INFO ] [MAIN ] Update Progress: 952/2367 symbols completed. GNT took 28.9s. Estimated remaining: 3h 1m 10s. Rate: 7.8 symbols/min [2025-10-22T19:01:58.071669] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:01:58.113851] [DEBUG] [LOCAL ] GOOS: Loaded 44145 existing records from primary storage. [2025-10-22T19:01:58.114177] [INFO ] [MAIN ] GOOS: Loaded 44145 existing records. [2025-10-22T19:01:58.288814] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:01:58.289054] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-22T19:01:58.289101] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-22T19:01:58.289284] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-22T19:01:58.289321] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-22T19:01:58.528458] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-22T19:01:58.666424] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:01:58.931306] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T19:01:59.317631] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-22T19:01:59.579104] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T19:01:59.613008] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T19:02:00.117718] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-22T19:02:00.917732] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-22T19:02:01.238442] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-22T19:02:01.717736] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-22T19:02:02.362102] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-22T19:02:02.517787] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-22T19:02:03.317811] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-22T19:02:03.971044] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (3.05 seconds). [2025-10-22T19:02:04.117708] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-22T19:02:04.787858] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (3.07 seconds). [2025-10-22T19:02:04.818575] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-22T19:02:04.917753] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-22T19:02:05.479109] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-22T19:02:05.717730] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-22T19:02:06.517805] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-22T19:02:06.807387] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-22T19:02:07.238518] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-22T19:02:07.317666] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-22T19:02:07.797104] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-22T19:02:07.877534] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T19:02:08.117743] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-22T19:02:08.331238] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T19:02:08.917759] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-22T19:02:09.717767] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-22T19:02:10.182086] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-22T19:02:10.192471] [INFO ] [REMOTE ] GNW: Full fetch complete (73888 records). [2025-10-22T19:02:10.192755] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-22T19:02:10.522796] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-22T19:02:10.609494] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-22T19:02:10.609617] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-22T19:02:10.610818] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-22T19:02:10.610887] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-22T19:02:10.612921] [DEBUG] [LOCAL ] GNW: Trimmed 73888 records to 51369 (keeping 200 days of data) [2025-10-22T19:02:10.940240] [DEBUG] [LOCAL ] GNW: Primary data saved (51369 records). [2025-10-22T19:02:10.940467] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-22T19:02:10.941193] [INFO ] [MAIN ] Update Progress: 953/2367 symbols completed. GNW took 38.2s. Estimated remaining: 3h 1m 10s. Rate: 7.8 symbols/min [2025-10-22T19:02:11.140197] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:02:11.175709] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-22T19:02:11.216400] [DEBUG] [LOCAL ] GOTU: Loaded 37040 existing records from primary storage. [2025-10-22T19:02:11.216704] [INFO ] [MAIN ] GOTU: Loaded 37040 existing records. [2025-10-22T19:02:11.322860] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-22T19:02:11.452580] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:02:11.470423] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-22T19:02:11.472872] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T19:02:11.480807] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-22T19:02:11.481824] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-22T19:02:11.481886] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-22T19:02:11.867897] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:02:12.117773] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-22T19:02:12.632265] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-22T19:02:12.917797] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-22T19:02:13.161266] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T19:02:13.717738] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-22T19:02:13.838226] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-22T19:02:14.267515] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T19:02:14.517699] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-22T19:02:15.021024] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T19:02:15.317709] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-22T19:02:16.084661] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T19:02:16.117615] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-22T19:02:16.917630] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-22T19:02:17.311486] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-22T19:02:17.717700] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-22T19:02:18.141304] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-22T19:02:18.430852] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T19:02:18.517705] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-22T19:02:19.016947] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T19:02:19.317709] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-22T19:02:19.769165] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-22T19:02:20.117725] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-22T19:02:20.917742] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-22T19:02:21.259893] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T19:02:21.268001] [INFO ] [REMOTE ] GOF: Full fetch complete (62674 records). [2025-10-22T19:02:21.268160] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-22T19:02:21.641596] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T19:02:21.701250] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-22T19:02:21.701351] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-22T19:02:21.702218] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-22T19:02:21.702288] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-22T19:02:21.703735] [DEBUG] [LOCAL ] GOF: Trimmed 62674 records to 42713 (keeping 200 days of data) [2025-10-22T19:02:21.759300] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-22T19:02:21.988394] [DEBUG] [LOCAL ] GOF: Primary data saved (42713 records). [2025-10-22T19:02:21.988539] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-22T19:02:21.988623] [INFO ] [MAIN ] Update Progress: 954/2367 symbols completed. GOF took 34.0s. Estimated remaining: 3h 1m 8s. Rate: 7.8 symbols/min [2025-10-22T19:02:22.185007] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:02:22.232604] [DEBUG] [LOCAL ] GPC: Loaded 45944 existing records from primary storage. [2025-10-22T19:02:22.233042] [INFO ] [MAIN ] GPC: Loaded 45944 existing records. [2025-10-22T19:02:22.460735] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:02:22.461034] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-22T19:02:22.461100] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-22T19:02:22.461356] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-22T19:02:22.461425] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-22T19:02:22.524262] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-22T19:02:22.831678] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T19:02:22.916388] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:02:23.317742] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-22T19:02:23.464331] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T19:02:23.620346] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T19:02:24.117738] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-22T19:02:24.917666] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-22T19:02:25.268573] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T19:02:25.623144] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T19:02:25.717700] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-22T19:02:25.963447] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-22T19:02:26.517735] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-22T19:02:27.317741] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-22T19:02:27.493237] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T19:02:27.501010] [INFO ] [REMOTE ] GOOS: Full fetch complete (64671 records). [2025-10-22T19:02:27.501455] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-22T19:02:27.950196] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-22T19:02:27.950324] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-22T19:02:27.951406] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-22T19:02:27.951479] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-22T19:02:27.953337] [DEBUG] [LOCAL ] GOOS: Trimmed 64671 records to 44038 (keeping 200 days of data) [2025-10-22T19:02:28.132813] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-22T19:02:28.239518] [DEBUG] [LOCAL ] GOOS: Primary data saved (44038 records). [2025-10-22T19:02:28.239681] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-22T19:02:28.239779] [INFO ] [MAIN ] Update Progress: 955/2367 symbols completed. GOOS took 30.3s. Estimated remaining: 3h 0m 58s. Rate: 7.8 symbols/min [2025-10-22T19:02:28.412249] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:02:28.445723] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-22T19:02:28.461331] [DEBUG] [LOCAL ] GPI: Loaded 14752 existing records from primary storage. [2025-10-22T19:02:28.461570] [INFO ] [MAIN ] GPI: Loaded 14752 existing records. [2025-10-22T19:02:28.645310] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:02:28.645975] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-22T19:02:28.646079] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-22T19:02:28.646272] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-22T19:02:28.646340] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-22T19:02:28.829391] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T19:02:28.885963] [INFO ] [REMOTE ] GOLF: Full fetch complete (45310 records). [2025-10-22T19:02:28.905378] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-22T19:02:28.927939] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-22T19:02:29.279850] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:02:29.496934] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-22T19:02:29.497039] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-22T19:02:29.497741] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-22T19:02:29.497803] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-22T19:02:29.498738] [DEBUG] [LOCAL ] GOLF: Trimmed 45310 records to 30311 (keeping 200 days of data) [2025-10-22T19:02:29.698747] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T19:02:29.721332] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-22T19:02:29.730083] [DEBUG] [LOCAL ] GOLF: Primary data saved (30311 records). [2025-10-22T19:02:29.730447] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-22T19:02:29.730539] [INFO ] [MAIN ] Update Progress: 956/2367 symbols completed. GOLF took 33.4s. Estimated remaining: 3h 0m 41s. Rate: 7.8 symbols/min [2025-10-22T19:02:29.905478] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:02:29.912569] [DEBUG] [LOCAL ] GPJA: Loaded 4112 existing records from primary storage. [2025-10-22T19:02:29.912834] [INFO ] [MAIN ] GPJA: Loaded 4112 existing records. [2025-10-22T19:02:30.100939] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:02:30.101189] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-22T19:02:30.101237] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-22T19:02:30.101393] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-22T19:02:30.101449] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-22T19:02:30.523527] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-22T19:02:30.563996] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:02:30.775133] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T19:02:30.895045] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T19:02:31.317753] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-22T19:02:31.673570] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T19:02:32.074031] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T19:02:32.117770] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-22T19:02:32.917670] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-22T19:02:33.495874] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T19:02:33.717622] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-22T19:02:33.813435] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T19:02:34.517716] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-22T19:02:35.317630] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-22T19:02:35.405794] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T19:02:35.875884] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-22T19:02:36.001168] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-22T19:02:36.006801] [INFO ] [REMOTE ] GOTU: Full fetch complete (58322 records). [2025-10-22T19:02:36.006904] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-22T19:02:36.122718] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-22T19:02:36.398303] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-22T19:02:36.398377] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-22T19:02:36.399146] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-22T19:02:36.399206] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-22T19:02:36.400382] [DEBUG] [LOCAL ] GOTU: Trimmed 58322 records to 36876 (keeping 200 days of data) [2025-10-22T19:02:36.602910] [DEBUG] [LOCAL ] GOTU: Primary data saved (36876 records). [2025-10-22T19:02:36.603077] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-22T19:02:36.603352] [INFO ] [MAIN ] Update Progress: 957/2367 symbols completed. GOTU took 25.7s. Estimated remaining: 3h 0m 32s. Rate: 7.8 symbols/min [2025-10-22T19:02:36.917742] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-22T19:02:37.717742] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-22T19:02:37.764725] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T19:02:37.786235] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T19:02:38.269738] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-22T19:02:38.517699] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-22T19:02:39.317689] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-22T19:02:39.866028] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-22T19:02:39.965959] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T19:02:40.117668] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-22T19:02:40.917731] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-22T19:02:41.380919] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-22T19:02:41.717726] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-22T19:02:41.929687] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T19:02:42.366483] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-22T19:02:42.517701] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-22T19:02:43.168090] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T19:02:43.317692] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-22T19:02:43.886958] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-22T19:02:44.117690] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-22T19:02:44.917718] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-22T19:02:45.524691] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-22T19:02:45.584553] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-22T19:02:45.717696] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-22T19:02:46.517634] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-22T19:02:46.861997] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T19:02:47.317799] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-22T19:02:47.981722] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T19:02:48.023504] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-22T19:02:48.117743] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-22T19:02:48.917720] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-22T19:02:49.033696] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-22T19:02:49.717632] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-22T19:02:50.280593] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-22T19:02:50.281585] [INFO ] [REMOTE ] GPJA: Full fetch complete (6834 records). [2025-10-22T19:02:50.281676] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-22T19:02:50.527337] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-22T19:02:50.632866] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-22T19:02:50.632946] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-22T19:02:50.633118] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-22T19:02:50.633156] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-22T19:02:50.633630] [DEBUG] [LOCAL ] GPJA: Trimmed 6834 records to 4108 (keeping 200 days of data) [2025-10-22T19:02:50.657809] [DEBUG] [LOCAL ] GPJA: Primary data saved (4108 records). [2025-10-22T19:02:50.657869] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-22T19:02:50.657936] [INFO ] [MAIN ] Update Progress: 958/2367 symbols completed. GPJA took 20.9s. Estimated remaining: 3h 0m 34s. Rate: 7.8 symbols/min [2025-10-22T19:02:51.049954] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-22T19:02:51.061951] [INFO ] [REMOTE ] GPC: Full fetch complete (68689 records). [2025-10-22T19:02:51.062193] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-22T19:02:51.494316] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-22T19:02:51.494532] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-22T19:02:51.495409] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-22T19:02:51.495474] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-22T19:02:51.496789] [DEBUG] [LOCAL ] GPC: Trimmed 68689 records to 45916 (keeping 200 days of data) [2025-10-22T19:02:51.721160] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-22T19:02:51.729181] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-22T19:02:51.806559] [DEBUG] [LOCAL ] GPC: Primary data saved (45916 records). [2025-10-22T19:02:51.806722] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-22T19:02:51.806814] [INFO ] [MAIN ] Update Progress: 959/2367 symbols completed. GPC took 29.8s. Estimated remaining: 3h 0m 16s. Rate: 7.8 symbols/min [2025-10-22T19:02:52.590492] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T19:02:52.593843] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-22T19:02:53.546696] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T19:02:53.550545] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-22T19:02:54.634447] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T19:02:54.637760] [INFO ] [REMOTE ] GPI: Full fetch complete (21842 records). [2025-10-22T19:02:54.637840] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-22T19:02:55.030362] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-22T19:02:55.030453] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-22T19:02:55.031183] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-22T19:02:55.031248] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-22T19:02:55.032209] [DEBUG] [LOCAL ] GPI: Trimmed 21842 records to 14678 (keeping 200 days of data) [2025-10-22T19:02:55.123957] [DEBUG] [LOCAL ] GPI: Primary data saved (14678 records). [2025-10-22T19:02:55.124115] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-22T19:02:55.124201] [INFO ] [MAIN ] Update Progress: 960/2367 symbols completed. GPI took 26.9s. Estimated remaining: 3h 0m 2s. Rate: 7.8 symbols/min [2025-10-22T19:02:55.760239] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:02:55.759394] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:02:55.842404] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:02:55.860719] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:02:55.897478] [DEBUG] [LOCAL ] GPOR: Loaded 23342 existing records from primary storage. [2025-10-22T19:02:55.898374] [DEBUG] [LOCAL ] GPMT: Loaded 26021 existing records from primary storage. [2025-10-22T19:02:55.911283] [INFO ] [MAIN ] GPOR: Loaded 23342 existing records. [2025-10-22T19:02:55.917026] [INFO ] [MAIN ] GPMT: Loaded 26021 existing records. [2025-10-22T19:02:56.163418] [DEBUG] [LOCAL ] GPK: Loaded 52780 existing records from primary storage. [2025-10-22T19:02:56.224357] [INFO ] [MAIN ] GPK: Loaded 52780 existing records. [2025-10-22T19:02:56.254973] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:02:56.272998] [DEBUG] [LOCAL ] GPN: Loaded 51923 existing records from primary storage. [2025-10-22T19:02:56.292861] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-22T19:02:56.313723] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-22T19:02:56.298228] [INFO ] [MAIN ] GPN: Loaded 51923 existing records. [2025-10-22T19:02:56.434699] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-22T19:02:56.437337] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-22T19:02:56.579085] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:02:56.620436] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-22T19:02:56.641163] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-22T19:02:56.791689] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-22T19:02:56.851344] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:02:56.847955] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-22T19:02:56.872051] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-22T19:02:56.916405] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:02:56.949008] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-22T19:02:57.016008] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-22T19:02:57.042382] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-22T19:02:57.036990] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-22T19:02:57.062868] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-22T19:02:57.093049] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-22T19:02:57.092954] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-22T19:02:57.548853] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:02:57.672883] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-22T19:02:58.038582] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:02:58.099314] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-22T19:02:58.160835] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:02:58.173193] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-22T19:02:58.256413] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:02:58.256767] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-22T19:02:59.173144] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T19:02:59.179141] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-22T19:02:59.245904] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T19:02:59.251201] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-22T19:02:59.512638] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T19:02:59.522917] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-22T19:02:59.966314] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T19:02:59.976352] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-22T19:02:59.995605] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T19:03:00.117708] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-22T19:03:00.402369] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T19:03:00.917698] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-22T19:03:01.389811] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-22T19:03:01.423050] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-22T19:03:01.636378] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T19:03:01.717918] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-22T19:03:02.054452] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T19:03:02.517784] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-22T19:03:03.317770] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-22T19:03:03.459141] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T19:03:04.117750] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-22T19:03:04.148062] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T19:03:04.917723] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-22T19:03:05.024457] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T19:03:05.071180] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-22T19:03:05.717762] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-22T19:03:06.517720] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-22T19:03:06.627460] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T19:03:06.786099] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T19:03:07.317732] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-22T19:03:07.744764] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T19:03:08.117711] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-22T19:03:08.917635] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-22T19:03:09.119695] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T19:03:09.241025] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T19:03:09.717764] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-22T19:03:10.519752] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-22T19:03:10.525776] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-22T19:03:11.318200] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T19:03:11.318308] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-22T19:03:11.715880] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T19:03:12.117745] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-22T19:03:12.773575] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T19:03:12.917718] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-22T19:03:13.717665] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-22T19:03:13.885873] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T19:03:13.913629] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T19:03:14.517715] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-22T19:03:15.128397] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T19:03:15.317636] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-22T19:03:15.617474] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T19:03:16.117784] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-22T19:03:16.685791] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T19:03:16.917632] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-22T19:03:17.717731] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-22T19:03:17.881571] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T19:03:17.954059] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T19:03:18.517757] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-22T19:03:19.317704] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-22T19:03:19.505819] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T19:03:20.117629] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-22T19:03:20.320778] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T19:03:20.394149] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T19:03:20.399413] [INFO ] [REMOTE ] GPOR: Full fetch complete (34870 records). [2025-10-22T19:03:20.399605] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-22T19:03:20.800505] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-22T19:03:20.800675] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-22T19:03:20.801479] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-22T19:03:20.801524] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-22T19:03:20.802699] [DEBUG] [LOCAL ] GPOR: Trimmed 34870 records to 23317 (keeping 200 days of data) [2025-10-22T19:03:20.919725] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-22T19:03:20.967604] [DEBUG] [LOCAL ] GPOR: Primary data saved (23317 records). [2025-10-22T19:03:20.967886] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-22T19:03:20.968044] [INFO ] [MAIN ] Update Progress: 961/2367 symbols completed. GPOR took 25.8s. Estimated remaining: 3h 0m 21s. Rate: 7.8 symbols/min [2025-10-22T19:03:21.166310] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:03:21.208800] [DEBUG] [LOCAL ] GPRK: Loaded 39820 existing records from primary storage. [2025-10-22T19:03:21.209291] [INFO ] [MAIN ] GPRK: Loaded 39820 existing records. [2025-10-22T19:03:21.404473] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:03:21.404901] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-22T19:03:21.404962] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-22T19:03:21.405222] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-22T19:03:21.405280] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-22T19:03:21.718967] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-22T19:03:21.796987] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:03:21.947030] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T19:03:22.356730] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-22T19:03:22.517689] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-22T19:03:23.317631] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-22T19:03:23.678704] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T19:03:23.687428] [INFO ] [REMOTE ] GPK: Full fetch complete (76083 records). [2025-10-22T19:03:23.687607] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-22T19:03:24.107744] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-22T19:03:24.107914] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-22T19:03:24.114206] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-22T19:03:24.119676] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-22T19:03:24.121722] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-22T19:03:24.121381] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-22T19:03:24.126099] [INFO ] [REMOTE ] GPMT: Full fetch complete (36370 records). [2025-10-22T19:03:24.126301] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-22T19:03:24.147465] [DEBUG] [LOCAL ] GPK: Trimmed 76083 records to 52780 (keeping 200 days of data) [2025-10-22T19:03:24.722237] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-22T19:03:24.725412] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-22T19:03:24.749402] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-22T19:03:24.754253] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-22T19:03:24.760198] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-22T19:03:24.774928] [DEBUG] [LOCAL ] GPMT: Trimmed 36370 records to 25950 (keeping 200 days of data) [2025-10-22T19:03:24.938809] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-22T19:03:24.985428] [DEBUG] [LOCAL ] GPK: Primary data saved (52780 records). [2025-10-22T19:03:24.986314] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-22T19:03:24.986911] [INFO ] [MAIN ] Update Progress: 962/2367 symbols completed. GPK took 29.9s. Estimated remaining: 3h 0m 8s. Rate: 7.8 symbols/min [2025-10-22T19:03:25.190159] [DEBUG] [LOCAL ] GPMT: Primary data saved (25950 records). [2025-10-22T19:03:25.209675] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-22T19:03:25.215034] [INFO ] [MAIN ] Update Progress: 963/2367 symbols completed. GPMT took 30.1s. Estimated remaining: 2h 59m 50s. Rate: 7.8 symbols/min [2025-10-22T19:03:25.283125] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:03:25.422156] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:03:25.435579] [DEBUG] [LOCAL ] GRBK: Loaded 26836 existing records from primary storage. [2025-10-22T19:03:25.435961] [INFO ] [MAIN ] GRBK: Loaded 26836 existing records. [2025-10-22T19:03:25.487697] [DEBUG] [LOCAL ] GRC: Loaded 9277 existing records from primary storage. [2025-10-22T19:03:25.503913] [INFO ] [MAIN ] GRC: Loaded 9277 existing records. [2025-10-22T19:03:25.785814] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:03:25.810344] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-22T19:03:25.810127] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:03:25.810680] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-22T19:03:25.810601] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-22T19:03:25.811105] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-22T19:03:25.811207] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-22T19:03:25.811311] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-22T19:03:25.811407] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-22T19:03:25.816808] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-22T19:03:26.253016] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-22T19:03:26.354791] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-22T19:03:26.601233] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:03:26.617633] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-22T19:03:26.637955] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:03:26.786199] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T19:03:27.317766] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-22T19:03:27.839711] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-22T19:03:27.899610] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T19:03:28.101339] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T19:03:28.117625] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-22T19:03:28.913837] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-22T19:03:28.917603] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-22T19:03:29.717715] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-22T19:03:29.751682] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T19:03:30.517672] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-22T19:03:30.972215] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T19:03:31.317747] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-22T19:03:31.966981] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T19:03:32.117634] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-22T19:03:32.917777] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-22T19:03:33.020638] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T19:03:33.029589] [INFO ] [REMOTE ] GPN: Full fetch complete (75058 records). [2025-10-22T19:03:33.029814] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-22T19:03:33.447833] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-22T19:03:33.447928] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-22T19:03:33.449141] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-22T19:03:33.449207] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-22T19:03:33.450727] [DEBUG] [LOCAL ] GPN: Trimmed 75058 records to 51867 (keeping 200 days of data) [2025-10-22T19:03:33.729861] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-22T19:03:33.775602] [DEBUG] [LOCAL ] GPN: Primary data saved (51867 records). [2025-10-22T19:03:33.775801] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-22T19:03:33.775905] [INFO ] [MAIN ] Update Progress: 964/2367 symbols completed. GPN took 38.6s. Estimated remaining: 2h 59m 43s. Rate: 7.8 symbols/min [2025-10-22T19:03:33.905576] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T19:03:33.981091] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:03:34.000145] [DEBUG] [LOCAL ] GRDN: Loaded 21184 existing records from primary storage. [2025-10-22T19:03:34.000436] [INFO ] [MAIN ] GRDN: Loaded 21184 existing records. [2025-10-22T19:03:34.174433] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:03:34.174693] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-22T19:03:34.174752] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-22T19:03:34.174942] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-22T19:03:34.174982] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-22T19:03:34.524746] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-22T19:03:34.529440] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:03:34.718983] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T19:03:34.791803] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T19:03:35.317626] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-22T19:03:35.463232] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-22T19:03:36.117696] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-22T19:03:36.848295] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:03:36.917620] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-22T19:03:37.285804] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T19:03:37.717758] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-22T19:03:38.459421] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-22T19:03:38.484995] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-22T19:03:38.517628] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-22T19:03:39.319122] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-22T19:03:39.324060] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-22T19:03:40.117697] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-22T19:03:40.812956] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T19:03:40.826245] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-22T19:03:40.917672] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-22T19:03:41.717777] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-22T19:03:42.517702] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-22T19:03:42.790768] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T19:03:43.072552] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T19:03:43.317672] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-22T19:03:43.652823] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T19:03:44.117614] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-22T19:03:44.422018] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T19:03:44.917672] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-22T19:03:45.717707] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-22T19:03:46.409465] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-22T19:03:46.517734] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-22T19:03:46.869044] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T19:03:47.212904] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-22T19:03:47.317626] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-22T19:03:47.649803] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T19:03:48.117702] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-22T19:03:48.506329] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T19:03:48.514212] [INFO ] [REMOTE ] GPRK: Full fetch complete (58436 records). [2025-10-22T19:03:48.514365] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-22T19:03:48.906802] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-22T19:03:48.906951] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-22T19:03:48.907855] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-22T19:03:48.907934] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-22T19:03:48.922084] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-22T19:03:48.926313] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T19:03:48.932518] [DEBUG] [LOCAL ] GPRK: Trimmed 58436 records to 39851 (keeping 200 days of data) [2025-10-22T19:03:49.159796] [DEBUG] [LOCAL ] GPRK: Primary data saved (39851 records). [2025-10-22T19:03:49.159954] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-22T19:03:49.160057] [INFO ] [MAIN ] Update Progress: 965/2367 symbols completed. GPRK took 28.2s. Estimated remaining: 2h 59m 47s. Rate: 7.8 symbols/min [2025-10-22T19:03:49.324506] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:03:49.360593] [DEBUG] [LOCAL ] GRMN: Loaded 39939 existing records from primary storage. [2025-10-22T19:03:49.360907] [INFO ] [MAIN ] GRMN: Loaded 39939 existing records. [2025-10-22T19:03:49.534527] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:03:49.534796] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-22T19:03:49.534852] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-22T19:03:49.535037] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-22T19:03:49.535075] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-22T19:03:49.727285] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-22T19:03:49.839228] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-22T19:03:49.903061] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:03:50.517730] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-22T19:03:51.254265] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T19:03:51.317638] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-22T19:03:52.117736] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-22T19:03:52.361066] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T19:03:52.726530] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T19:03:52.731108] [INFO ] [REMOTE ] GRBK: Full fetch complete (39984 records). [2025-10-22T19:03:52.731200] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-22T19:03:52.900074] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T19:03:52.919018] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-22T19:03:53.118051] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-22T19:03:53.118128] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-22T19:03:53.118807] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-22T19:03:53.118870] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-22T19:03:53.119846] [DEBUG] [LOCAL ] GRBK: Trimmed 39984 records to 26691 (keeping 200 days of data) [2025-10-22T19:03:53.270810] [DEBUG] [LOCAL ] GRBK: Primary data saved (26691 records). [2025-10-22T19:03:53.270935] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-22T19:03:53.271022] [INFO ] [MAIN ] Update Progress: 966/2367 symbols completed. GRBK took 28.3s. Estimated remaining: 2h 59m 34s. Rate: 7.8 symbols/min [2025-10-22T19:03:53.434390] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:03:53.478380] [DEBUG] [LOCAL ] GRND: Loaded 50203 existing records from primary storage. [2025-10-22T19:03:53.478703] [INFO ] [MAIN ] GRND: Loaded 50203 existing records. [2025-10-22T19:03:53.653147] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:03:53.653365] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-22T19:03:53.653419] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-22T19:03:53.653595] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-22T19:03:53.653632] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-22T19:03:53.725221] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-22T19:03:54.053510] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:03:54.277412] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T19:03:54.517638] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-22T19:03:55.257371] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T19:03:55.260095] [INFO ] [REMOTE ] GRC: Full fetch complete (13470 records). [2025-10-22T19:03:55.260181] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-22T19:03:55.326020] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-22T19:03:55.629288] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-22T19:03:55.629364] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-22T19:03:55.629672] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-22T19:03:55.629734] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-22T19:03:55.630197] [DEBUG] [LOCAL ] GRC: Trimmed 13470 records to 9268 (keeping 200 days of data) [2025-10-22T19:03:55.685069] [DEBUG] [LOCAL ] GRC: Primary data saved (9268 records). [2025-10-22T19:03:55.685234] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-22T19:03:55.685366] [INFO ] [MAIN ] Update Progress: 967/2367 symbols completed. GRC took 30.5s. Estimated remaining: 2h 59m 19s. Rate: 7.8 symbols/min [2025-10-22T19:03:55.856985] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:03:55.893817] [DEBUG] [LOCAL ] GRNT: Loaded 34016 existing records from primary storage. [2025-10-22T19:03:55.894276] [INFO ] [MAIN ] GRNT: Loaded 34016 existing records. [2025-10-22T19:03:56.076385] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:03:56.076715] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-22T19:03:56.076804] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-22T19:03:56.077072] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-22T19:03:56.077207] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-22T19:03:56.120502] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-22T19:03:56.247622] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T19:03:56.476268] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-22T19:03:56.504430] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:03:56.917719] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-22T19:03:57.717751] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-22T19:03:58.311034] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-22T19:03:58.484671] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T19:03:58.517704] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-22T19:03:58.929195] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T19:03:59.317667] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-22T19:04:00.117628] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-22T19:04:00.147049] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T19:04:00.421815] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T19:04:00.917704] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-22T19:04:01.717745] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-22T19:04:02.335766] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-22T19:04:02.517718] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-22T19:04:03.317789] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-22T19:04:04.025104] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (3.11 seconds). [2025-10-22T19:04:04.092689] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-22T19:04:04.117618] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-22T19:04:04.917674] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-22T19:04:04.957561] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-22T19:04:05.716949] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-22T19:04:05.722113] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-22T19:04:05.723458] [INFO ] [REMOTE ] GRDN: Full fetch complete (26531 records). [2025-10-22T19:04:05.723550] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-22T19:04:06.050762] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-10-22T19:04:06.137184] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-22T19:04:06.137266] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-22T19:04:06.137812] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-22T19:04:06.137873] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-22T19:04:06.138618] [DEBUG] [LOCAL ] GRDN: Trimmed 26531 records to 21258 (keeping 200 days of data) [2025-10-22T19:04:06.261421] [DEBUG] [LOCAL ] GRDN: Primary data saved (21258 records). [2025-10-22T19:04:06.261575] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-22T19:04:06.261695] [INFO ] [MAIN ] Update Progress: 968/2367 symbols completed. GRDN took 32.5s. Estimated remaining: 2h 59m 15s. Rate: 7.8 symbols/min [2025-10-22T19:04:06.440708] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:04:06.450823] [DEBUG] [LOCAL ] GROV: Loaded 8701 existing records from primary storage. [2025-10-22T19:04:06.451044] [INFO ] [MAIN ] GROV: Loaded 8701 existing records. [2025-10-22T19:04:06.523486] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-22T19:04:06.624451] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:04:06.624677] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-22T19:04:06.624736] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-22T19:04:06.624914] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-22T19:04:06.624968] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-22T19:04:06.967390] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:04:07.317777] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-22T19:04:07.419061] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-22T19:04:08.117710] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-22T19:04:08.205152] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-22T19:04:08.595974] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-22T19:04:08.754799] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T19:04:08.917738] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-22T19:04:09.717738] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-22T19:04:09.983077] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-22T19:04:10.213463] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T19:04:10.517696] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-22T19:04:10.590445] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-22T19:04:11.317631] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-22T19:04:12.117632] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-22T19:04:12.540188] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T19:04:12.917732] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-22T19:04:13.032451] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-22T19:04:13.059566] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T19:04:13.717703] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-22T19:04:14.261387] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-22T19:04:14.517727] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-22T19:04:15.317632] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-22T19:04:15.393474] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T19:04:16.117740] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-22T19:04:16.313571] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T19:04:16.586051] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-22T19:04:16.917736] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-22T19:04:17.644369] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T19:04:17.717638] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-22T19:04:17.957469] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-22T19:04:18.461676] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-22T19:04:18.517673] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-22T19:04:19.317733] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-22T19:04:19.524084] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T19:04:20.117724] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-22T19:04:20.813894] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T19:04:20.917667] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-22T19:04:21.717702] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-22T19:04:21.905066] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T19:04:22.517739] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-22T19:04:22.876070] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-22T19:04:23.065469] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T19:04:23.317667] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-22T19:04:24.117720] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-22T19:04:24.608422] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-22T19:04:24.912584] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T19:04:24.918323] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-22T19:04:24.920063] [INFO ] [REMOTE ] GRMN: Full fetch complete (59556 records). [2025-10-22T19:04:24.920218] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-22T19:04:25.303120] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-22T19:04:25.303209] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-22T19:04:25.304044] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-22T19:04:25.304106] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-22T19:04:25.305271] [DEBUG] [LOCAL ] GRMN: Trimmed 59556 records to 39812 (keeping 200 days of data) [2025-10-22T19:04:25.559746] [DEBUG] [LOCAL ] GRMN: Primary data saved (39812 records). [2025-10-22T19:04:25.559894] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-22T19:04:25.559973] [INFO ] [MAIN ] Update Progress: 969/2367 symbols completed. GRMN took 36.4s. Estimated remaining: 2h 59m 24s. Rate: 7.8 symbols/min [2025-10-22T19:04:25.666692] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-22T19:04:25.713523] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T19:04:25.718803] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-22T19:04:25.782967] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:04:25.790205] [DEBUG] [LOCAL ] GRX: Loaded 4844 existing records from primary storage. [2025-10-22T19:04:25.790392] [INFO ] [MAIN ] GRX: Loaded 4844 existing records. [2025-10-22T19:04:25.963181] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:04:25.963415] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-22T19:04:25.963476] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-22T19:04:25.963691] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-22T19:04:25.963749] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-22T19:04:26.330107] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:04:26.517701] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-22T19:04:27.126962] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-22T19:04:27.317725] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-22T19:04:27.473889] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T19:04:27.855467] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-22T19:04:27.857102] [INFO ] [REMOTE ] GROV: Full fetch complete (13646 records). [2025-10-22T19:04:27.857192] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-22T19:04:28.122828] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-22T19:04:28.215894] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-22T19:04:28.216008] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-22T19:04:28.216336] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-22T19:04:28.216416] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-22T19:04:28.216915] [DEBUG] [LOCAL ] GROV: Trimmed 13646 records to 8616 (keeping 200 days of data) [2025-10-22T19:04:28.263397] [DEBUG] [LOCAL ] GROV: Primary data saved (8616 records). [2025-10-22T19:04:28.263492] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-22T19:04:28.263571] [INFO ] [MAIN ] Update Progress: 970/2367 symbols completed. GROV took 22.0s. Estimated remaining: 2h 59m 9s. Rate: 7.8 symbols/min [2025-10-22T19:04:28.428007] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:04:28.472832] [DEBUG] [LOCAL ] GS: Loaded 51777 existing records from primary storage. [2025-10-22T19:04:28.473122] [INFO ] [MAIN ] GS: Loaded 51777 existing records. [2025-10-22T19:04:28.644597] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:04:28.644819] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-22T19:04:28.644865] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-22T19:04:28.645127] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-22T19:04:28.645163] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-22T19:04:28.938916] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-22T19:04:29.018991] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:04:29.558761] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-22T19:04:29.717745] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-22T19:04:30.169037] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-22T19:04:30.177751] [INFO ] [REMOTE ] GRND: Full fetch complete (71824 records). [2025-10-22T19:04:30.177896] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-22T19:04:30.307822] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T19:04:30.526389] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-22T19:04:30.573747] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-22T19:04:30.573838] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-22T19:04:30.574764] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-22T19:04:30.574837] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-22T19:04:30.576222] [DEBUG] [LOCAL ] GRND: Trimmed 71824 records to 50191 (keeping 200 days of data) [2025-10-22T19:04:30.860717] [DEBUG] [LOCAL ] GRND: Primary data saved (50191 records). [2025-10-22T19:04:30.860853] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-22T19:04:30.861417] [INFO ] [MAIN ] Update Progress: 971/2367 symbols completed. GRND took 37.6s. Estimated remaining: 2h 58m 54s. Rate: 7.8 symbols/min [2025-10-22T19:04:31.026832] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:04:31.064982] [DEBUG] [LOCAL ] GSBD: Loaded 39579 existing records from primary storage. [2025-10-22T19:04:31.065269] [INFO ] [MAIN ] GSBD: Loaded 39579 existing records. [2025-10-22T19:04:31.241414] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:04:31.241625] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-22T19:04:31.241706] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-22T19:04:31.241973] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-22T19:04:31.242028] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-22T19:04:31.322786] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-22T19:04:31.597268] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:04:32.008637] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-22T19:04:32.117760] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-22T19:04:32.533385] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T19:04:32.917670] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-22T19:04:33.620848] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T19:04:33.717731] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-22T19:04:34.304928] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-22T19:04:34.372959] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T19:04:34.517709] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-22T19:04:35.317712] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-22T19:04:35.349214] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-22T19:04:36.117740] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-22T19:04:36.917701] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-22T19:04:37.495837] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-22T19:04:37.501736] [INFO ] [REMOTE ] GRNT: Full fetch complete (48355 records). [2025-10-22T19:04:37.501856] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-22T19:04:37.718561] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-22T19:04:37.735010] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T19:04:37.923689] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-22T19:04:37.923776] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-22T19:04:37.924517] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-22T19:04:37.924558] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-22T19:04:37.925549] [DEBUG] [LOCAL ] GRNT: Trimmed 48355 records to 33953 (keeping 200 days of data) [2025-10-22T19:04:38.117616] [DEBUG] [LOCAL ] GRNT: Primary data saved (33953 records). [2025-10-22T19:04:38.117786] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-22T19:04:38.117874] [INFO ] [MAIN ] Update Progress: 972/2367 symbols completed. GRNT took 42.4s. Estimated remaining: 2h 58m 46s. Rate: 7.8 symbols/min [2025-10-22T19:04:38.297448] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:04:38.345367] [DEBUG] [LOCAL ] GSK: Loaded 53512 existing records from primary storage. [2025-10-22T19:04:38.345814] [INFO ] [MAIN ] GSK: Loaded 53512 existing records. [2025-10-22T19:04:38.518694] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-22T19:04:38.519063] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-22T19:04:38.545384] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:04:38.545867] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-22T19:04:38.545919] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-22T19:04:38.546136] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-22T19:04:38.546189] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-22T19:04:38.911348] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:04:38.941193] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-22T19:04:39.317712] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-22T19:04:40.104029] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T19:04:40.117609] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-22T19:04:40.917675] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-22T19:04:41.625736] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-22T19:04:41.717637] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-22T19:04:41.843289] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T19:04:42.073731] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-22T19:04:42.517669] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-22T19:04:43.122391] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-22T19:04:43.317674] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-22T19:04:43.975164] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T19:04:44.117690] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-22T19:04:44.828396] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-22T19:04:44.917723] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-22T19:04:45.237368] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-22T19:04:45.683592] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-22T19:04:45.685039] [INFO ] [REMOTE ] GRX: Full fetch complete (6558 records). [2025-10-22T19:04:45.685111] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-22T19:04:45.723329] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-22T19:04:46.045152] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-22T19:04:46.045227] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-22T19:04:46.045398] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-22T19:04:46.045437] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-22T19:04:46.045841] [DEBUG] [LOCAL ] GRX: Trimmed 6558 records to 4839 (keeping 200 days of data) [2025-10-22T19:04:46.073831] [DEBUG] [LOCAL ] GRX: Primary data saved (4839 records). [2025-10-22T19:04:46.073944] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-22T19:04:46.074020] [INFO ] [MAIN ] Update Progress: 973/2367 symbols completed. GRX took 20.5s. Estimated remaining: 2h 58m 39s. Rate: 7.8 symbols/min [2025-10-22T19:04:46.238571] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:04:46.267735] [DEBUG] [LOCAL ] GSL: Loaded 33081 existing records from primary storage. [2025-10-22T19:04:46.268039] [INFO ] [MAIN ] GSL: Loaded 33081 existing records. [2025-10-22T19:04:46.440495] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:04:46.440712] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-22T19:04:46.440767] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-22T19:04:46.440996] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-22T19:04:46.441051] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-22T19:04:46.522885] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-22T19:04:46.790693] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:04:47.317742] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-22T19:04:48.059146] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-22T19:04:48.117634] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-22T19:04:48.509584] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T19:04:48.809673] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T19:04:48.917675] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-22T19:04:49.484143] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T19:04:49.717753] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-22T19:04:50.517712] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-22T19:04:51.317722] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-22T19:04:52.356929] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (3.44 seconds). [2025-10-22T19:04:52.368060] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-22T19:04:52.434556] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-22T19:04:52.675576] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-22T19:04:52.917708] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-22T19:04:53.093120] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T19:04:53.717717] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-22T19:04:54.517705] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-22T19:04:54.802844] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T19:04:54.914078] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-22T19:04:55.317712] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-22T19:04:55.753036] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-22T19:04:56.109222] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-22T19:04:56.120000] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-22T19:04:56.667914] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-22T19:04:56.917675] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-22T19:04:57.717734] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-22T19:04:58.351878] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-22T19:04:58.517736] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-22T19:04:59.317746] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-22T19:04:59.515972] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-22T19:04:59.524280] [INFO ] [REMOTE ] GSBD: Full fetch complete (58536 records). [2025-10-22T19:04:59.524418] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-22T19:04:59.898385] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-22T19:04:59.898483] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-22T19:04:59.899363] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-22T19:04:59.899434] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-22T19:04:59.900715] [DEBUG] [LOCAL ] GSBD: Trimmed 58536 records to 39527 (keeping 200 days of data) [2025-10-22T19:05:00.139713] [DEBUG] [LOCAL ] GSBD: Primary data saved (39527 records). [2025-10-22T19:05:00.139855] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-22T19:05:00.140685] [INFO ] [MAIN ] Update Progress: 974/2367 symbols completed. GSBD took 29.3s. Estimated remaining: 2h 58m 40s. Rate: 7.8 symbols/min [2025-10-22T19:05:00.309764] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:00.331026] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T19:05:00.338857] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-22T19:05:00.383294] [DEBUG] [LOCAL ] GTES: Loaded 50305 existing records from primary storage. [2025-10-22T19:05:00.383615] [INFO ] [MAIN ] GTES: Loaded 50305 existing records. [2025-10-22T19:05:00.572273] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:00.572796] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-22T19:05:00.572869] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-22T19:05:00.573112] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-22T19:05:00.573180] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-22T19:05:01.140818] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:01.141305] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-22T19:05:01.321956] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (3.60 seconds). [2025-10-22T19:05:01.717728] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-22T19:05:02.101035] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T19:05:02.199603] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (2.88 seconds). [2025-10-22T19:05:02.517747] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-22T19:05:03.317734] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-22T19:05:03.571144] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-22T19:05:04.117714] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-22T19:05:05.499009] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (3.78 seconds). [2025-10-22T19:05:05.510011] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-22T19:05:05.601270] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (3.08 seconds). [2025-10-22T19:05:05.625038] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-22T19:05:05.717671] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-22T19:05:06.517752] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-22T19:05:07.421449] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (3.30 seconds). [2025-10-22T19:05:07.431363] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-22T19:05:08.100344] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-22T19:05:08.117704] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-22T19:05:08.544796] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (3.03 seconds). [2025-10-22T19:05:08.917675] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-22T19:05:09.919121] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (3.40 seconds). [2025-10-22T19:05:09.930889] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-22T19:05:10.043155] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-22T19:05:10.517720] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-22T19:05:11.635006] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (3.52 seconds). [2025-10-22T19:05:11.643811] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-22T19:05:12.289705] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-22T19:05:12.302307] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-22T19:05:12.884076] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (3.97 seconds). [2025-10-22T19:05:12.893760] [INFO ] [REMOTE ] GS: Full fetch complete (75847 records). [2025-10-22T19:05:12.894028] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-22T19:05:13.334990] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-22T19:05:13.335261] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-22T19:05:13.336771] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-22T19:05:13.337037] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-22T19:05:13.354272] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T19:05:13.360101] [DEBUG] [LOCAL ] GS: Trimmed 75847 records to 51777 (keeping 200 days of data) [2025-10-22T19:05:13.391242] [INFO ] [REMOTE ] GSL: Full fetch complete (48242 records). [2025-10-22T19:05:13.393564] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (2.88 seconds). [2025-10-22T19:05:13.393740] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-22T19:05:13.537275] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-22T19:05:14.115373] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-22T19:05:14.146758] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-22T19:05:14.155627] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-22T19:05:14.156224] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-22T19:05:14.186530] [DEBUG] [LOCAL ] GSL: Trimmed 48242 records to 32919 (keeping 200 days of data) [2025-10-22T19:05:14.202815] [DEBUG] [LOCAL ] GS: Primary data saved (51777 records). [2025-10-22T19:05:14.203376] [INFO ] [MAIN ] GS: Full history saved. [2025-10-22T19:05:14.203796] [INFO ] [MAIN ] Update Progress: 975/2367 symbols completed. GS took 45.9s. Estimated remaining: 2h 58m 41s. Rate: 7.8 symbols/min [2025-10-22T19:05:14.594946] [DEBUG] [LOCAL ] GSL: Primary data saved (32919 records). [2025-10-22T19:05:14.611961] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-22T19:05:14.612105] [INFO ] [MAIN ] Update Progress: 976/2367 symbols completed. GSL took 28.5s. Estimated remaining: 2h 58m 23s. Rate: 7.8 symbols/min [2025-10-22T19:05:14.618515] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:14.807623] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:14.859306] [DEBUG] [LOCAL ] GTLS: Loaded 43183 existing records from primary storage. [2025-10-22T19:05:14.860126] [INFO ] [MAIN ] GTLS: Loaded 43183 existing records. [2025-10-22T19:05:14.996270] [DEBUG] [LOCAL ] GTN: Loaded 44864 existing records from primary storage. [2025-10-22T19:05:15.013424] [INFO ] [MAIN ] GTN: Loaded 44864 existing records. [2025-10-22T19:05:15.156399] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:15.195315] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-22T19:05:15.199409] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-22T19:05:15.256940] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-22T19:05:15.282362] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-22T19:05:15.281924] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:15.283020] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-22T19:05:15.288597] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-22T19:05:15.347921] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-22T19:05:15.374927] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-22T19:05:15.542011] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (3.24 seconds). [2025-10-22T19:05:15.654712] [INFO ] [REMOTE ] GSK: Full fetch complete (77635 records). [2025-10-22T19:05:15.670607] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-22T19:05:15.701636] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-22T19:05:16.011364] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-22T19:05:16.477629] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:16.560171] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-22T19:05:16.571260] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:16.583425] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-22T19:05:16.694105] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-22T19:05:16.694223] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-22T19:05:16.695730] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-22T19:05:16.695806] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-22T19:05:16.698031] [DEBUG] [LOCAL ] GSK: Trimmed 77635 records to 53511 (keeping 200 days of data) [2025-10-22T19:05:17.062836] [DEBUG] [LOCAL ] GSK: Primary data saved (53511 records). [2025-10-22T19:05:17.063040] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-22T19:05:17.063150] [INFO ] [MAIN ] Update Progress: 977/2367 symbols completed. GSK took 38.9s. Estimated remaining: 2h 58m 8s. Rate: 7.8 symbols/min [2025-10-22T19:05:17.243001] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:17.276259] [DEBUG] [LOCAL ] GTY: Loaded 30068 existing records from primary storage. [2025-10-22T19:05:17.276636] [INFO ] [MAIN ] GTY: Loaded 30068 existing records. [2025-10-22T19:05:17.483722] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:17.484057] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-22T19:05:17.484117] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-22T19:05:17.484409] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-22T19:05:17.484468] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-22T19:05:17.874612] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:17.875111] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-22T19:05:17.910876] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-22T19:05:17.923136] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-22T19:05:18.640170] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T19:05:18.649783] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-22T19:05:18.753720] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-22T19:05:18.763167] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-22T19:05:18.937971] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-22T19:05:19.317798] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-22T19:05:19.716018] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T19:05:19.972135] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T19:05:20.117742] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-22T19:05:20.409632] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T19:05:20.802532] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-22T19:05:20.917718] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-22T19:05:21.717766] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-22T19:05:22.209362] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-22T19:05:22.517745] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-22T19:05:23.317750] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-22T19:05:23.649969] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-22T19:05:23.943731] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-22T19:05:24.117732] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-22T19:05:24.917718] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-22T19:05:25.111506] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-22T19:05:25.418832] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-22T19:05:25.526436] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T19:05:25.717750] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-22T19:05:26.517745] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-22T19:05:26.649328] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T19:05:27.322790] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-22T19:05:27.337000] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T19:05:27.820955] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-22T19:05:28.117738] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-22T19:05:28.917701] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-22T19:05:29.286350] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T19:05:29.294773] [INFO ] [REMOTE ] GTES: Full fetch complete (73889 records). [2025-10-22T19:05:29.294920] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-22T19:05:29.716750] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-22T19:05:29.716589] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T19:05:29.722868] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-22T19:05:29.723962] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-22T19:05:29.724107] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-22T19:05:29.722698] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-22T19:05:29.726886] [DEBUG] [LOCAL ] GTES: Trimmed 73889 records to 50288 (keeping 200 days of data) [2025-10-22T19:05:30.019806] [DEBUG] [LOCAL ] GTES: Primary data saved (50288 records). [2025-10-22T19:05:30.019960] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-22T19:05:30.020834] [INFO ] [MAIN ] Update Progress: 978/2367 symbols completed. GTES took 29.9s. Estimated remaining: 2h 58m 8s. Rate: 7.8 symbols/min [2025-10-22T19:05:30.218455] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:30.233817] [DEBUG] [LOCAL ] GUG: Loaded 12192 existing records from primary storage. [2025-10-22T19:05:30.234053] [INFO ] [MAIN ] GUG: Loaded 12192 existing records. [2025-10-22T19:05:30.469939] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:30.470287] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-22T19:05:30.470456] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-22T19:05:30.470813] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-22T19:05:30.470931] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-22T19:05:30.522969] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-22T19:05:30.634066] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T19:05:30.913759] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:31.186092] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T19:05:31.317631] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-22T19:05:31.732462] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T19:05:32.117749] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-22T19:05:32.331740] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T19:05:32.917746] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-22T19:05:33.717628] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-22T19:05:33.879153] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T19:05:34.139808] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-22T19:05:34.517765] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-22T19:05:35.284573] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T19:05:35.317626] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-22T19:05:35.851751] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T19:05:36.117765] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-22T19:05:36.908699] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T19:05:36.917604] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-22T19:05:36.996359] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T19:05:37.717771] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-22T19:05:38.505914] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-22T19:05:38.517606] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-22T19:05:38.545904] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T19:05:39.317669] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-22T19:05:39.409912] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T19:05:40.117725] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-22T19:05:40.922806] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-22T19:05:40.938107] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T19:05:41.171575] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T19:05:41.177802] [INFO ] [REMOTE ] GTY: Full fetch complete (43843 records). [2025-10-22T19:05:41.177954] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-22T19:05:41.597863] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-22T19:05:41.597950] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-22T19:05:41.598625] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-22T19:05:41.598878] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-22T19:05:41.599955] [DEBUG] [LOCAL ] GTY: Trimmed 43843 records to 30006 (keeping 200 days of data) [2025-10-22T19:05:41.716526] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T19:05:41.722559] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-22T19:05:41.801346] [DEBUG] [LOCAL ] GTY: Primary data saved (30006 records). [2025-10-22T19:05:41.801502] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-22T19:05:41.801587] [INFO ] [MAIN ] Update Progress: 979/2367 symbols completed. GTY took 24.7s. Estimated remaining: 2h 58m 6s. Rate: 7.8 symbols/min [2025-10-22T19:05:41.998397] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:42.014563] [DEBUG] [LOCAL ] GUT: Loaded 15651 existing records from primary storage. [2025-10-22T19:05:42.014876] [INFO ] [MAIN ] GUT: Loaded 15651 existing records. [2025-10-22T19:05:42.210094] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:42.210371] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-22T19:05:42.210445] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-22T19:05:42.210616] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-22T19:05:42.210689] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-22T19:05:42.532318] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-22T19:05:42.574108] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:43.295065] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T19:05:43.317611] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-22T19:05:43.674635] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T19:05:44.117715] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-22T19:05:44.917714] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-22T19:05:45.253620] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T19:05:45.261039] [INFO ] [REMOTE ] GTLS: Full fetch complete (61576 records). [2025-10-22T19:05:45.261233] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-22T19:05:45.655286] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-22T19:05:45.655370] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-22T19:05:45.656189] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-22T19:05:45.656253] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-22T19:05:45.657514] [DEBUG] [LOCAL ] GTLS: Trimmed 61576 records to 43141 (keeping 200 days of data) [2025-10-22T19:05:45.743090] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-22T19:05:45.959512] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T19:05:45.964503] [DEBUG] [LOCAL ] GTLS: Primary data saved (43141 records). [2025-10-22T19:05:45.971100] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-22T19:05:45.971237] [INFO ] [MAIN ] Update Progress: 980/2367 symbols completed. GTLS took 31.8s. Estimated remaining: 2h 57m 53s. Rate: 7.8 symbols/min [2025-10-22T19:05:45.966855] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-22T19:05:46.153723] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:46.185866] [DEBUG] [LOCAL ] GVA: Loaded 32612 existing records from primary storage. [2025-10-22T19:05:46.186156] [INFO ] [MAIN ] GVA: Loaded 32612 existing records. [2025-10-22T19:05:46.364546] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:46.364976] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-22T19:05:46.365024] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-22T19:05:46.365206] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-22T19:05:46.365243] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-22T19:05:46.518181] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-22T19:05:46.727232] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:46.855724] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T19:05:47.317736] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-22T19:05:48.117743] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-22T19:05:48.227907] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-22T19:05:48.254722] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T19:05:48.917633] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-22T19:05:49.045916] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-22T19:05:49.717702] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-22T19:05:49.792309] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T19:05:50.516395] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T19:05:50.519314] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-22T19:05:51.317745] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-22T19:05:51.931522] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T19:05:52.117753] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-22T19:05:52.226829] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T19:05:52.229122] [INFO ] [REMOTE ] GUG: Full fetch complete (18808 records). [2025-10-22T19:05:52.229197] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-22T19:05:52.590939] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-22T19:05:52.591018] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-22T19:05:52.591398] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-22T19:05:52.591437] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-22T19:05:52.592074] [DEBUG] [LOCAL ] GUG: Trimmed 18808 records to 12168 (keeping 200 days of data) [2025-10-22T19:05:52.666179] [DEBUG] [LOCAL ] GUG: Primary data saved (12168 records). [2025-10-22T19:05:52.666326] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-22T19:05:52.666421] [INFO ] [MAIN ] Update Progress: 981/2367 symbols completed. GUG took 22.6s. Estimated remaining: 2h 57m 44s. Rate: 7.8 symbols/min [2025-10-22T19:05:52.837332] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:52.857133] [DEBUG] [LOCAL ] GWH: Loaded 19825 existing records from primary storage. [2025-10-22T19:05:52.857388] [INFO ] [MAIN ] GWH: Loaded 19825 existing records. [2025-10-22T19:05:52.920867] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-22T19:05:53.039120] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:53.039428] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-22T19:05:53.039549] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-22T19:05:53.039751] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-22T19:05:53.039806] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-22T19:05:53.330817] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-22T19:05:53.410583] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:53.717752] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-22T19:05:54.396831] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T19:05:54.517744] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-22T19:05:55.317746] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-22T19:05:55.367993] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-22T19:05:55.375288] [INFO ] [REMOTE ] GTN: Full fetch complete (65847 records). [2025-10-22T19:05:55.375492] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-22T19:05:55.544322] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T19:05:55.805287] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-22T19:05:55.805382] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-22T19:05:55.806235] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-22T19:05:55.806300] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-22T19:05:55.807620] [DEBUG] [LOCAL ] GTN: Trimmed 65847 records to 44840 (keeping 200 days of data) [2025-10-22T19:05:56.067135] [DEBUG] [LOCAL ] GTN: Primary data saved (44840 records). [2025-10-22T19:05:56.067282] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-22T19:05:56.067369] [INFO ] [MAIN ] Update Progress: 982/2367 symbols completed. GTN took 41.4s. Estimated remaining: 2h 57m 30s. Rate: 7.8 symbols/min [2025-10-22T19:05:56.133906] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-22T19:05:56.222818] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-22T19:05:56.257205] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:05:56.294874] [DEBUG] [LOCAL ] GWRE: Loaded 39681 existing records from primary storage. [2025-10-22T19:05:56.295160] [INFO ] [MAIN ] GWRE: Loaded 39681 existing records. [2025-10-22T19:05:56.466050] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:05:56.466265] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-22T19:05:56.466312] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-22T19:05:56.466526] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-22T19:05:56.466580] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-22T19:05:56.812993] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:05:56.917612] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-22T19:05:57.639210] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T19:05:57.717635] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-22T19:05:58.250902] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T19:05:58.517713] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-22T19:05:59.117078] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T19:05:59.317672] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-22T19:05:59.333505] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T19:06:00.117636] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-22T19:06:00.818958] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T19:06:00.917729] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-22T19:06:01.304984] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T19:06:01.717737] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-22T19:06:02.517756] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-22T19:06:02.607603] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-22T19:06:02.759729] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T19:06:03.317742] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-22T19:06:03.885420] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T19:06:04.117738] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-22T19:06:04.326240] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T19:06:04.917746] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-22T19:06:05.555463] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T19:06:05.717736] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-22T19:06:06.430126] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T19:06:06.517713] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-22T19:06:07.101603] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T19:06:07.310599] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T19:06:07.317600] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-22T19:06:08.117729] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-22T19:06:08.394710] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T19:06:08.917747] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-22T19:06:09.416414] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T19:06:09.717778] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-22T19:06:10.115521] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T19:06:10.517635] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-22T19:06:11.317728] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-22T19:06:11.889617] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T19:06:11.981294] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-22T19:06:11.986782] [INFO ] [REMOTE ] GVA: Full fetch complete (48473 records). [2025-10-22T19:06:11.986892] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-22T19:06:12.122722] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-22T19:06:12.434161] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-22T19:06:12.434243] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-22T19:06:12.435021] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-22T19:06:12.435085] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-22T19:06:12.436144] [DEBUG] [LOCAL ] GVA: Trimmed 48473 records to 32580 (keeping 200 days of data) [2025-10-22T19:06:12.667661] [DEBUG] [LOCAL ] GVA: Primary data saved (32580 records). [2025-10-22T19:06:12.667822] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-22T19:06:12.667906] [INFO ] [MAIN ] Update Progress: 983/2367 symbols completed. GVA took 26.7s. Estimated remaining: 2h 57m 35s. Rate: 7.8 symbols/min [2025-10-22T19:06:12.877901] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:06:12.899700] [DEBUG] [LOCAL ] GWW: Loaded 19293 existing records from primary storage. [2025-10-22T19:06:12.900047] [INFO ] [MAIN ] GWW: Loaded 19293 existing records. [2025-10-22T19:06:12.934435] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-22T19:06:13.098691] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:06:13.098962] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-22T19:06:13.099023] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-22T19:06:13.099352] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-22T19:06:13.099432] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-22T19:06:13.217101] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T19:06:13.501977] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-22T19:06:13.505234] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:06:13.717724] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-22T19:06:14.122513] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T19:06:14.517731] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-22T19:06:14.886298] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T19:06:15.259295] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T19:06:15.317619] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-22T19:06:16.117754] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-22T19:06:16.397947] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T19:06:16.401155] [INFO ] [REMOTE ] GUT: Full fetch complete (22465 records). [2025-10-22T19:06:16.401293] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-22T19:06:16.782089] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-22T19:06:16.782198] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-22T19:06:16.782768] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-22T19:06:16.782832] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-22T19:06:16.783485] [DEBUG] [LOCAL ] GUT: Trimmed 22465 records to 15487 (keeping 200 days of data) [2025-10-22T19:06:16.877109] [DEBUG] [LOCAL ] GUT: Primary data saved (15487 records). [2025-10-22T19:06:16.877253] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-22T19:06:16.877331] [INFO ] [MAIN ] Update Progress: 984/2367 symbols completed. GUT took 35.1s. Estimated remaining: 2h 57m 23s. Rate: 7.8 symbols/min [2025-10-22T19:06:16.919709] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-22T19:06:17.052890] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:06:17.093475] [DEBUG] [LOCAL ] GXO: Loaded 46525 existing records from primary storage. [2025-10-22T19:06:17.093810] [INFO ] [MAIN ] GXO: Loaded 46525 existing records. [2025-10-22T19:06:17.279374] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:06:17.294233] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-22T19:06:17.295046] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-22T19:06:17.295793] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T19:06:17.301866] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-22T19:06:17.302586] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-22T19:06:17.685575] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:06:17.717620] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-22T19:06:18.146811] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T19:06:18.517765] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-22T19:06:19.290315] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T19:06:19.317722] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-22T19:06:19.794956] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T19:06:20.117750] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-22T19:06:20.917707] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-22T19:06:21.017573] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T19:06:21.717739] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-22T19:06:21.909155] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T19:06:21.916181] [INFO ] [REMOTE ] GWH: Full fetch complete (24648 records). [2025-10-22T19:06:21.916272] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-22T19:06:22.327615] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T19:06:22.359697] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-22T19:06:22.359813] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-22T19:06:22.360360] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-22T19:06:22.360405] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-22T19:06:22.361350] [DEBUG] [LOCAL ] GWH: Trimmed 24648 records to 20115 (keeping 200 days of data) [2025-10-22T19:06:22.472295] [DEBUG] [LOCAL ] GWH: Primary data saved (20115 records). [2025-10-22T19:06:22.472414] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-22T19:06:22.472485] [INFO ] [MAIN ] Update Progress: 985/2367 symbols completed. GWH took 29.8s. Estimated remaining: 2h 57m 12s. Rate: 7.8 symbols/min [2025-10-22T19:06:22.526068] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-22T19:06:22.646417] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:06:22.650252] [DEBUG] [LOCAL ] GYLD: Loaded 1549 existing records from primary storage. [2025-10-22T19:06:22.650419] [INFO ] [MAIN ] GYLD: Loaded 1549 existing records. [2025-10-22T19:06:22.823245] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:06:22.823471] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-22T19:06:22.823518] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-22T19:06:22.823751] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-22T19:06:22.823808] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-22T19:06:23.174524] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:06:23.317678] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-22T19:06:23.420470] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T19:06:23.658621] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-22T19:06:24.117717] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-22T19:06:24.356398] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T19:06:24.917745] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-22T19:06:25.717631] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-22T19:06:25.792771] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T19:06:26.517676] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-22T19:06:26.794614] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T19:06:26.815034] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T19:06:26.890476] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-22T19:06:27.317664] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-22T19:06:28.117668] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-22T19:06:28.340318] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T19:06:28.917671] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-22T19:06:29.645451] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:06:29.717672] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-22T19:06:30.517673] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-22T19:06:30.648690] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T19:06:31.129704] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T19:06:31.317755] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-22T19:06:31.706329] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-22T19:06:32.117711] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-22T19:06:32.770141] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T19:06:32.917620] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-22T19:06:33.230903] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T19:06:33.717675] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-22T19:06:34.528255] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-22T19:06:34.533148] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T19:06:34.586053] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-22T19:06:34.975996] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-22T19:06:35.317678] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-22T19:06:35.808825] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-22T19:06:36.117678] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-22T19:06:36.917724] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-22T19:06:37.580182] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T19:06:37.586249] [INFO ] [REMOTE ] GWRE: Full fetch complete (60128 records). [2025-10-22T19:06:37.586394] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-22T19:06:37.728855] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-22T19:06:37.983916] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-22T19:06:37.984010] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-22T19:06:37.985067] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-22T19:06:37.985132] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-22T19:06:37.986326] [DEBUG] [LOCAL ] GWRE: Trimmed 60128 records to 39608 (keeping 200 days of data) [2025-10-22T19:06:38.107235] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T19:06:38.112012] [INFO ] [REMOTE ] GWW: Full fetch complete (29064 records). [2025-10-22T19:06:38.113392] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-22T19:06:38.291717] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-22T19:06:38.525619] [DEBUG] [LOCAL ] GWRE: Primary data saved (39608 records). [2025-10-22T19:06:38.536296] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-22T19:06:38.519227] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-22T19:06:38.553901] [INFO ] [MAIN ] Update Progress: 986/2367 symbols completed. GWRE took 42.5s. Estimated remaining: 2h 57m 16s. Rate: 7.8 symbols/min [2025-10-22T19:06:38.743766] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-22T19:06:38.743913] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-22T19:06:38.745018] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-22T19:06:38.750453] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-22T19:06:38.796151] [DEBUG] [LOCAL ] GWW: Trimmed 29064 records to 19181 (keeping 200 days of data) [2025-10-22T19:06:38.815207] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:06:38.951028] [DEBUG] [LOCAL ] GWW: Primary data saved (19181 records). [2025-10-22T19:06:38.951286] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-22T19:06:38.951384] [INFO ] [MAIN ] Update Progress: 987/2367 symbols completed. GWW took 26.3s. Estimated remaining: 2h 56m 58s. Rate: 7.8 symbols/min [2025-10-22T19:06:39.090457] [DEBUG] [LOCAL ] H: Loaded 44375 existing records from primary storage. [2025-10-22T19:06:39.127386] [INFO ] [MAIN ] H: Loaded 44375 existing records. [2025-10-22T19:06:39.136048] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:06:39.347834] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-22T19:06:39.352792] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:06:39.354438] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-22T19:06:39.354531] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-22T19:06:39.354869] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-22T19:06:39.354929] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-22T19:06:39.478169] [DEBUG] [LOCAL ] HAE: Loaded 39378 existing records from primary storage. [2025-10-22T19:06:39.484513] [INFO ] [MAIN ] HAE: Loaded 39378 existing records. [2025-10-22T19:06:39.912254] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:06:39.927979] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-22T19:06:39.928092] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-22T19:06:39.954955] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-22T19:06:39.966282] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-22T19:06:39.994097] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:06:40.125239] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-22T19:06:40.197749] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-22T19:06:40.415709] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:06:40.418093] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T19:06:40.917722] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-22T19:06:41.699289] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T19:06:41.717617] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-22T19:06:42.377201] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T19:06:42.517733] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-22T19:06:42.899699] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T19:06:43.317732] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-22T19:06:43.779469] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-22T19:06:43.781607] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-22T19:06:44.117730] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-22T19:06:44.568269] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-22T19:06:44.917736] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-22T19:06:45.376628] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-22T19:06:45.717629] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-22T19:06:46.517764] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-22T19:06:47.267200] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T19:06:47.268075] [INFO ] [REMOTE ] GYLD: Full fetch complete (2094 records). [2025-10-22T19:06:47.268142] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-22T19:06:47.328581] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-22T19:06:47.544227] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T19:06:47.653051] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-22T19:06:47.653121] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-22T19:06:47.653208] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-22T19:06:47.653246] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-22T19:06:47.653549] [DEBUG] [LOCAL ] GYLD: Trimmed 2094 records to 1532 (keeping 200 days of data) [2025-10-22T19:06:47.662904] [DEBUG] [LOCAL ] GYLD: Primary data saved (1532 records). [2025-10-22T19:06:47.662960] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-22T19:06:47.663020] [INFO ] [MAIN ] Update Progress: 988/2367 symbols completed. GYLD took 25.2s. Estimated remaining: 2h 56m 52s. Rate: 7.8 symbols/min [2025-10-22T19:06:47.826357] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:06:47.866487] [DEBUG] [LOCAL ] HAFN: Loaded 42724 existing records from primary storage. [2025-10-22T19:06:47.866802] [INFO ] [MAIN ] HAFN: Loaded 42724 existing records. [2025-10-22T19:06:48.037218] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:06:48.037416] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-22T19:06:48.037474] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-22T19:06:48.037717] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-22T19:06:48.037774] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-22T19:06:48.124374] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-22T19:06:48.381188] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:06:48.917705] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-22T19:06:48.978610] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T19:06:49.680507] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T19:06:49.717680] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-22T19:06:50.256274] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T19:06:50.517704] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-22T19:06:51.317734] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-22T19:06:51.444722] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T19:06:51.451969] [INFO ] [REMOTE ] GXO: Full fetch complete (69376 records). [2025-10-22T19:06:51.452087] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-22T19:06:51.827736] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-22T19:06:51.827824] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-22T19:06:51.828685] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-22T19:06:51.828766] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-22T19:06:51.830051] [DEBUG] [LOCAL ] GXO: Trimmed 69376 records to 46455 (keeping 200 days of data) [2025-10-22T19:06:52.097145] [DEBUG] [LOCAL ] GXO: Primary data saved (46455 records). [2025-10-22T19:06:52.097350] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-22T19:06:52.097470] [INFO ] [MAIN ] Update Progress: 989/2367 symbols completed. GXO took 35.2s. Estimated remaining: 2h 56m 40s. Rate: 7.8 symbols/min [2025-10-22T19:06:52.118374] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-22T19:06:52.272389] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:06:52.320050] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-22T19:06:52.320390] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-22T19:06:52.498772] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-22T19:06:52.525218] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:06:52.534461] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-22T19:06:52.535058] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-22T19:06:52.535869] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-22T19:06:52.535941] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-22T19:06:52.842797] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T19:06:52.924533] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-22T19:06:52.929168] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:06:53.717764] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-22T19:06:53.815551] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T19:06:54.309694] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T19:06:54.517667] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-22T19:06:55.317710] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-22T19:06:55.693184] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-22T19:06:56.117638] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-22T19:06:56.322564] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T19:06:56.407812] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T19:06:56.917757] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-22T19:06:57.717739] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-22T19:06:57.961861] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T19:06:58.488988] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T19:06:58.517614] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-22T19:06:59.144448] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T19:06:59.317678] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-22T19:07:00.033299] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T19:07:00.117617] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-22T19:07:00.917627] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-22T19:07:01.472102] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-22T19:07:01.517506] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T19:07:01.717731] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-22T19:07:02.517812] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-22T19:07:02.637960] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T19:07:03.317702] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-22T19:07:03.716191] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T19:07:03.832396] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T19:07:04.117713] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-22T19:07:04.816942] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T19:07:04.917704] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-22T19:07:05.717665] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-22T19:07:05.809247] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T19:07:06.517669] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-22T19:07:06.624612] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T19:07:07.257844] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T19:07:07.317615] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-22T19:07:08.117672] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-22T19:07:08.180369] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T19:07:08.917633] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-22T19:07:09.057341] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T19:07:09.064777] [INFO ] [REMOTE ] H: Full fetch complete (63416 records). [2025-10-22T19:07:09.064895] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-22T19:07:09.449941] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-22T19:07:09.450025] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-22T19:07:09.450893] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-22T19:07:09.450956] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-22T19:07:09.452149] [DEBUG] [LOCAL ] H: Trimmed 63416 records to 44372 (keeping 200 days of data) [2025-10-22T19:07:09.717842] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-22T19:07:09.745295] [DEBUG] [LOCAL ] H: Primary data saved (44372 records). [2025-10-22T19:07:09.745432] [INFO ] [MAIN ] H: Full history saved. [2025-10-22T19:07:09.745514] [INFO ] [MAIN ] Update Progress: 990/2367 symbols completed. H took 31.2s. Estimated remaining: 2h 56m 46s. Rate: 7.8 symbols/min [2025-10-22T19:07:09.915825] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:07:09.948046] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T19:07:09.994735] [DEBUG] [LOCAL ] HASI: Loaded 47751 existing records from primary storage. [2025-10-22T19:07:09.995072] [INFO ] [MAIN ] HASI: Loaded 47751 existing records. [2025-10-22T19:07:10.178744] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:07:10.178999] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-22T19:07:10.179050] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-22T19:07:10.179251] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-22T19:07:10.179308] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-22T19:07:10.527556] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-22T19:07:10.585756] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:07:10.610246] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T19:07:11.316428] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T19:07:11.325299] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-22T19:07:12.117682] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-22T19:07:12.600985] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-22T19:07:12.917734] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-22T19:07:12.957290] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T19:07:13.384698] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T19:07:13.717629] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-22T19:07:14.517630] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-22T19:07:14.556799] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T19:07:14.566171] [INFO ] [REMOTE ] HAE: Full fetch complete (59291 records). [2025-10-22T19:07:14.566330] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-22T19:07:14.942260] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-22T19:07:14.942402] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-22T19:07:14.943276] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-22T19:07:14.943356] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-22T19:07:14.944819] [DEBUG] [LOCAL ] HAE: Trimmed 59291 records to 39324 (keeping 200 days of data) [2025-10-22T19:07:15.171398] [DEBUG] [LOCAL ] HAE: Primary data saved (39324 records). [2025-10-22T19:07:15.171563] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-22T19:07:15.171693] [INFO ] [MAIN ] Update Progress: 991/2367 symbols completed. HAE took 36.2s. Estimated remaining: 2h 56m 35s. Rate: 7.8 symbols/min [2025-10-22T19:07:15.314332] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T19:07:15.331104] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-22T19:07:15.371198] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:07:15.414557] [DEBUG] [LOCAL ] HAYW: Loaded 48821 existing records from primary storage. [2025-10-22T19:07:15.414898] [INFO ] [MAIN ] HAYW: Loaded 48821 existing records. [2025-10-22T19:07:15.586929] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:07:15.587086] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-22T19:07:15.587132] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-22T19:07:15.587372] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-22T19:07:15.587410] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-22T19:07:15.942291] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:07:16.117759] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-22T19:07:16.444731] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-22T19:07:16.610855] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T19:07:16.917792] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-22T19:07:17.656196] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T19:07:17.717734] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-22T19:07:18.517724] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-22T19:07:18.694852] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T19:07:18.849590] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T19:07:19.317716] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-22T19:07:20.123723] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-22T19:07:20.144189] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-22T19:07:20.152187] [INFO ] [REMOTE ] HAFN: Full fetch complete (64630 records). [2025-10-22T19:07:20.152374] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-22T19:07:20.626812] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-22T19:07:20.626965] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-22T19:07:20.628288] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-22T19:07:20.628395] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-22T19:07:20.630180] [DEBUG] [LOCAL ] HAFN: Trimmed 64630 records to 42607 (keeping 200 days of data) [2025-10-22T19:07:20.908198] [DEBUG] [LOCAL ] HAFN: Primary data saved (42607 records). [2025-10-22T19:07:20.908415] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-22T19:07:20.908915] [INFO ] [MAIN ] Update Progress: 992/2367 symbols completed. HAFN took 33.2s. Estimated remaining: 2h 56m 25s. Rate: 7.8 symbols/min [2025-10-22T19:07:20.922786] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-22T19:07:21.092434] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:07:21.092807] [DEBUG] [LOCAL ] HBB: No existing data file found in primary storage. [2025-10-22T19:07:21.092986] [WARN ] [MAIN ] HBB: No existing data found, performing full refresh instead. [2025-10-22T19:07:21.093163] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-22T19:07:21.119832] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-22T19:07:21.120034] [DEBUG] [LOCAL ] HBB: No primary data file found to delete. [2025-10-22T19:07:21.120208] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-22T19:07:21.188532] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T19:07:21.483018] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:07:21.717629] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-22T19:07:22.209456] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-22T19:07:22.522359] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-22T19:07:22.527617] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-22T19:07:22.547128] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T19:07:23.321246] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-22T19:07:24.049391] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T19:07:24.058187] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-22T19:07:24.058317] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-22T19:07:24.125603] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-22T19:07:24.465883] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-22T19:07:24.465998] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-22T19:07:24.466937] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-22T19:07:24.466999] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-22T19:07:24.468416] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 53718 (keeping 200 days of data) [2025-10-22T19:07:24.789631] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-22T19:07:24.789789] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-22T19:07:24.789874] [INFO ] [MAIN ] Update Progress: 993/2367 symbols completed. HAL took 32.7s. Estimated remaining: 2h 56m 12s. Rate: 7.8 symbols/min [2025-10-22T19:07:24.929130] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-22T19:07:24.962529] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:07:25.013790] [DEBUG] [LOCAL ] HBI: Loaded 52933 existing records from primary storage. [2025-10-22T19:07:25.014176] [INFO ] [MAIN ] HBI: Loaded 52933 existing records. [2025-10-22T19:07:25.167543] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T19:07:25.228234] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:07:25.228434] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-22T19:07:25.228480] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-22T19:07:25.228684] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-22T19:07:25.228739] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-22T19:07:25.565192] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T19:07:25.587972] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:07:25.717628] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-22T19:07:26.196913] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-22T19:07:26.517678] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-22T19:07:27.317751] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-22T19:07:27.668297] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T19:07:28.126425] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-22T19:07:28.136171] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T19:07:28.141186] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T19:07:28.917712] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-22T19:07:29.717731] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-22T19:07:29.779000] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T19:07:29.814618] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-22T19:07:30.517721] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-22T19:07:31.317637] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-22T19:07:31.467021] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T19:07:32.035419] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T19:07:32.117674] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-22T19:07:32.397245] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T19:07:32.735926] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-22T19:07:32.917671] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-22T19:07:33.717724] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-22T19:07:33.799511] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-22T19:07:34.517667] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-22T19:07:35.217933] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-22T19:07:35.317716] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-22T19:07:36.018885] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-22T19:07:36.117674] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-22T19:07:36.707539] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-22T19:07:36.917663] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-22T19:07:37.028686] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T19:07:37.717684] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-22T19:07:38.517733] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-22T19:07:38.974886] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-22T19:07:39.273719] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-22T19:07:39.274955] [INFO ] [REMOTE ] HBB: Full fetch complete (9208 records). [2025-10-22T19:07:39.275026] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-22T19:07:39.317916] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-22T19:07:39.652584] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-22T19:07:39.652748] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-22T19:07:39.653175] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-22T19:07:39.653383] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-22T19:07:39.654289] [DEBUG] [LOCAL ] HBB: Trimmed 9208 records to 6298 (keeping 200 days of data) [2025-10-22T19:07:39.726617] [DEBUG] [LOCAL ] HBB: Primary data saved (6298 records). [2025-10-22T19:07:39.727247] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-22T19:07:39.728691] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T19:07:39.728829] [INFO ] [MAIN ] Update Progress: 994/2367 symbols completed. HBB took 18.8s. Estimated remaining: 2h 56m 14s. Rate: 7.8 symbols/min [2025-10-22T19:07:39.907782] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:07:39.907949] [DEBUG] [LOCAL ] HBM: No existing data file found in primary storage. [2025-10-22T19:07:39.907987] [WARN ] [MAIN ] HBM: No existing data found, performing full refresh instead. [2025-10-22T19:07:39.908099] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-22T19:07:39.908142] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-22T19:07:39.908188] [DEBUG] [LOCAL ] HBM: No primary data file found to delete. [2025-10-22T19:07:39.908262] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-22T19:07:40.123268] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-22T19:07:40.256962] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:07:40.917764] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-22T19:07:41.717749] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-22T19:07:41.774263] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-22T19:07:41.889338] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T19:07:42.517737] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-22T19:07:42.772706] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T19:07:43.214630] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T19:07:43.317726] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-22T19:07:44.117719] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-22T19:07:44.159330] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T19:07:44.917711] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-22T19:07:45.238406] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-22T19:07:45.717675] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-22T19:07:46.517835] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-22T19:07:47.058896] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (2.94 seconds). [2025-10-22T19:07:47.317764] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-22T19:07:47.411134] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-22T19:07:47.959321] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-22T19:07:48.117763] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-22T19:07:48.917757] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-22T19:07:49.089957] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T19:07:49.098571] [INFO ] [REMOTE ] HASI: Full fetch complete (68378 records). [2025-10-22T19:07:49.098809] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-22T19:07:49.385274] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-10-22T19:07:49.550275] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-22T19:07:49.550375] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-22T19:07:49.551258] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-22T19:07:49.551325] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-22T19:07:49.552814] [DEBUG] [LOCAL ] HASI: Trimmed 68378 records to 47728 (keeping 200 days of data) [2025-10-22T19:07:49.731527] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-22T19:07:49.847519] [DEBUG] [LOCAL ] HASI: Primary data saved (47728 records). [2025-10-22T19:07:49.847709] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-22T19:07:49.847824] [INFO ] [MAIN ] Update Progress: 995/2367 symbols completed. HASI took 40.1s. Estimated remaining: 2h 56m 10s. Rate: 7.8 symbols/min [2025-10-22T19:07:50.012687] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:07:50.052564] [DEBUG] [LOCAL ] HCA: Loaded 46914 existing records from primary storage. [2025-10-22T19:07:50.052907] [INFO ] [MAIN ] HCA: Loaded 46914 existing records. [2025-10-22T19:07:50.225791] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:07:50.225989] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-22T19:07:50.226035] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-22T19:07:50.226216] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-22T19:07:50.226252] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-22T19:07:50.588016] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:07:50.588394] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-22T19:07:50.766829] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-22T19:07:51.317625] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-22T19:07:51.387251] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-22T19:07:51.395340] [INFO ] [REMOTE ] HAYW: Full fetch complete (70911 records). [2025-10-22T19:07:51.395480] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-22T19:07:51.822039] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-22T19:07:51.835322] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-22T19:07:51.841746] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-22T19:07:51.841838] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-22T19:07:51.862200] [DEBUG] [LOCAL ] HAYW: Trimmed 70911 records to 48803 (keeping 200 days of data) [2025-10-22T19:07:51.865813] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-22T19:07:52.130874] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-22T19:07:52.165213] [DEBUG] [LOCAL ] HAYW: Primary data saved (48803 records). [2025-10-22T19:07:52.165552] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-22T19:07:52.165693] [INFO ] [MAIN ] Update Progress: 996/2367 symbols completed. HAYW took 37.0s. Estimated remaining: 2h 55m 54s. Rate: 7.8 symbols/min [2025-10-22T19:07:52.342433] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:07:52.377862] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T19:07:52.422339] [DEBUG] [LOCAL ] HCC: Loaded 45053 existing records from primary storage. [2025-10-22T19:07:52.422693] [INFO ] [MAIN ] HCC: Loaded 45053 existing records. [2025-10-22T19:07:52.594693] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:07:52.594901] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-22T19:07:52.594949] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-22T19:07:52.595133] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-22T19:07:52.595171] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-22T19:07:52.923887] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-22T19:07:52.954418] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:07:52.988258] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T19:07:53.717754] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-22T19:07:53.970687] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T19:07:54.517747] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-22T19:07:54.572464] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T19:07:55.317776] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-22T19:07:55.404357] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T19:07:56.117749] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-22T19:07:56.238829] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T19:07:56.917673] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-22T19:07:57.156476] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T19:07:57.363434] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T19:07:57.717761] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-22T19:07:58.517702] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-22T19:07:59.037913] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T19:07:59.046996] [INFO ] [REMOTE ] HBI: Full fetch complete (76969 records). [2025-10-22T19:07:59.047155] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-22T19:07:59.320719] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-22T19:07:59.463915] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-22T19:07:59.464047] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-22T19:07:59.465187] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-22T19:07:59.465280] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-22T19:07:59.467177] [DEBUG] [LOCAL ] HBI: Trimmed 76969 records to 52906 (keeping 200 days of data) [2025-10-22T19:07:59.798992] [DEBUG] [LOCAL ] HBI: Primary data saved (52906 records). [2025-10-22T19:07:59.799769] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-22T19:07:59.799901] [INFO ] [MAIN ] Update Progress: 997/2367 symbols completed. HBI took 35.0s. Estimated remaining: 2h 55m 47s. Rate: 7.8 symbols/min [2025-10-22T19:07:59.801007] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-22T19:08:00.117679] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-22T19:08:00.340954] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-22T19:08:00.917635] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-22T19:08:01.333560] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T19:08:01.717790] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-22T19:08:01.941913] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T19:08:02.517749] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-22T19:08:02.976710] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-22T19:08:03.247092] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T19:08:03.317790] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-22T19:08:04.117635] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-22T19:08:04.311475] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T19:08:04.917763] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-22T19:08:05.158397] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T19:08:05.717804] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-22T19:08:05.878427] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T19:08:06.517745] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-22T19:08:06.828809] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-22T19:08:07.317753] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-22T19:08:07.859639] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-22T19:08:07.868632] [INFO ] [REMOTE ] HBM: Full fetch complete (76740 records). [2025-10-22T19:08:07.868812] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-22T19:08:08.290762] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-22T19:08:08.291387] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-22T19:08:08.292377] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-22T19:08:08.293961] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-22T19:08:08.293880] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T19:08:08.304946] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-22T19:08:08.306507] [DEBUG] [LOCAL ] HBM: Trimmed 76740 records to 52980 (keeping 200 days of data) [2025-10-22T19:08:08.623429] [DEBUG] [LOCAL ] HBM: Primary data saved (52980 records). [2025-10-22T19:08:08.623684] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-22T19:08:08.623779] [INFO ] [MAIN ] Update Progress: 998/2367 symbols completed. HBM took 28.9s. Estimated remaining: 2h 55m 40s. Rate: 7.8 symbols/min [2025-10-22T19:08:09.044313] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T19:08:09.053997] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-22T19:08:09.910900] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T19:08:09.921146] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-22T19:08:10.657261] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T19:08:10.668640] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-22T19:08:11.760368] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T19:08:11.770583] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-22T19:08:12.529176] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T19:08:12.537922] [INFO ] [REMOTE ] HCA: Full fetch complete (68935 records). [2025-10-22T19:08:12.538053] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-22T19:08:12.924583] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-22T19:08:12.924685] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-22T19:08:12.925542] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-22T19:08:12.925605] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-22T19:08:12.926992] [DEBUG] [LOCAL ] HCA: Trimmed 68935 records to 46893 (keeping 200 days of data) [2025-10-22T19:08:13.217192] [DEBUG] [LOCAL ] HCA: Primary data saved (46893 records). [2025-10-22T19:08:13.217449] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-22T19:08:13.217583] [INFO ] [MAIN ] Update Progress: 999/2367 symbols completed. HCA took 23.4s. Estimated remaining: 2h 55m 29s. Rate: 7.8 symbols/min [2025-10-22T19:08:13.241989] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-22T19:08:13.251866] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-22T19:08:15.461340] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-22T19:08:15.470721] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-22T19:08:17.659475] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-22T19:08:17.666446] [INFO ] [REMOTE ] HCC: Full fetch complete (64877 records). [2025-10-22T19:08:17.666551] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-22T19:08:18.042477] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-22T19:08:18.042555] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-22T19:08:18.043348] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-22T19:08:18.043410] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-22T19:08:18.044624] [DEBUG] [LOCAL ] HCC: Trimmed 64877 records to 44974 (keeping 200 days of data) [2025-10-22T19:08:18.304258] [DEBUG] [LOCAL ] HCC: Primary data saved (44974 records). [2025-10-22T19:08:18.304383] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-22T19:08:18.304459] [INFO ] [MAIN ] Update Progress: 1000/2367 symbols completed. HCC took 26.1s. Estimated remaining: 2h 55m 17s. Rate: 7.8 symbols/min [2025-10-22T19:08:18.897459] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:19.023257] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-22T19:08:19.025704] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:19.057084] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:19.057667] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-22T19:08:19.078536] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-22T19:08:19.078760] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-22T19:08:19.078347] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:19.078915] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-22T19:08:19.078990] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-22T19:08:19.200340] [DEBUG] [LOCAL ] HCI: Loaded 14056 existing records from primary storage. [2025-10-22T19:08:19.206077] [INFO ] [MAIN ] HCI: Loaded 14056 existing records. [2025-10-22T19:08:19.537851] [DEBUG] [LOCAL ] HDB: Loaded 51909 existing records from primary storage. [2025-10-22T19:08:19.581987] [INFO ] [MAIN ] HDB: Loaded 51909 existing records. [2025-10-22T19:08:19.779152] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:08:19.779870] [DEBUG] [LOCAL ] HD: Loaded 53476 existing records from primary storage. [2025-10-22T19:08:19.789476] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:19.807448] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-22T19:08:19.812564] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-22T19:08:19.813066] [INFO ] [MAIN ] HD: Loaded 53476 existing records. [2025-10-22T19:08:19.828636] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-22T19:08:19.921547] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-22T19:08:19.985782] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:08:20.004339] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-22T19:08:20.036245] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-22T19:08:20.074125] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-22T19:08:20.208296] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-22T19:08:20.208472] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-22T19:08:20.204843] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:08:20.214266] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-22T19:08:20.236293] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-22T19:08:20.269543] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-22T19:08:20.329481] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-22T19:08:20.483067] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-22T19:08:20.534017] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-22T19:08:20.928280] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:20.973903] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-22T19:08:21.013294] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-22T19:08:21.014293] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-22T19:08:21.235815] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:21.254260] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-22T19:08:21.276498] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:21.276783] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-22T19:08:21.454373] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-22T19:08:21.455212] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-22T19:08:21.799846] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-22T19:08:21.800629] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-22T19:08:22.101454] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-22T19:08:22.102272] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-22T19:08:22.119511] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T19:08:22.122515] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-22T19:08:22.469165] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-22T19:08:22.470116] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-22T19:08:22.934021] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-22T19:08:22.935073] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-22T19:08:22.943314] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T19:08:23.152720] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-22T19:08:23.199932] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-22T19:08:23.317616] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-22T19:08:23.358921] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T19:08:24.117671] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-22T19:08:24.282270] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-22T19:08:24.383109] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-22T19:08:24.917729] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-22T19:08:25.717728] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-22T19:08:25.895544] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T19:08:26.139767] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-22T19:08:26.140678] [INFO ] [REMOTE ] HCXY: Full fetch complete (515 records). [2025-10-22T19:08:26.140765] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-22T19:08:26.318837] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-10-22T19:08:26.319016] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:08:26.319083] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:08:26.319155] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-22T19:08:26.319221] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-22T19:08:26.319256] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-22T19:08:26.319296] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-22T19:08:26.319351] [INFO ] [MAIN ] Update Progress: 1001/2367 symbols completed. HCXY took 8.0s. Estimated remaining: 2h 55m 10s. Rate: 7.8 symbols/min [2025-10-22T19:08:26.485807] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:26.517750] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-22T19:08:26.534496] [DEBUG] [LOCAL ] HE: Loaded 48826 existing records from primary storage. [2025-10-22T19:08:26.534852] [INFO ] [MAIN ] HE: Loaded 48826 existing records. [2025-10-22T19:08:26.717001] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:08:26.717215] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-22T19:08:26.717262] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-22T19:08:26.717444] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-22T19:08:26.717481] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-22T19:08:27.068031] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:27.317719] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-22T19:08:28.117675] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-22T19:08:28.241975] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T19:08:28.917727] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-22T19:08:29.030366] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T19:08:29.717733] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-22T19:08:29.787181] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T19:08:30.517788] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-22T19:08:31.297277] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-22T19:08:31.317619] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-22T19:08:31.367710] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T19:08:31.980613] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-22T19:08:32.117724] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-22T19:08:32.917632] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-22T19:08:33.152681] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T19:08:33.717738] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-22T19:08:34.001021] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T19:08:34.270476] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-22T19:08:34.517704] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-22T19:08:35.321302] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-22T19:08:35.494661] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T19:08:36.117678] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-22T19:08:36.534287] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-22T19:08:36.917664] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-22T19:08:37.333713] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-22T19:08:37.717772] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-22T19:08:38.438329] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-22T19:08:38.517624] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-22T19:08:39.323572] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-22T19:08:39.325163] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T19:08:39.704366] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.79 seconds). [2025-10-22T19:08:40.117624] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-22T19:08:40.789019] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-22T19:08:40.841606] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-22T19:08:40.917636] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-22T19:08:41.050948] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T19:08:41.717626] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-22T19:08:41.834677] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T19:08:42.517759] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-22T19:08:43.317746] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-22T19:08:43.942330] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-22T19:08:44.117637] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-22T19:08:44.228900] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T19:08:44.917734] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-22T19:08:44.996488] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T19:08:45.717667] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-22T19:08:45.960273] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T19:08:45.963272] [INFO ] [REMOTE ] HCI: Full fetch complete (19628 records). [2025-10-22T19:08:45.963352] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-22T19:08:46.344517] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-22T19:08:46.344633] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-22T19:08:46.345190] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-22T19:08:46.345267] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-22T19:08:46.346318] [DEBUG] [LOCAL ] HCI: Trimmed 19628 records to 14079 (keeping 200 days of data) [2025-10-22T19:08:46.464078] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-22T19:08:46.491195] [DEBUG] [LOCAL ] HCI: Primary data saved (14079 records). [2025-10-22T19:08:46.491364] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-22T19:08:46.491488] [INFO ] [MAIN ] Update Progress: 1002/2367 symbols completed. HCI took 28.2s. Estimated remaining: 2h 55m 19s. Rate: 7.8 symbols/min [2025-10-22T19:08:46.528075] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-22T19:08:46.751241] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:46.786483] [DEBUG] [LOCAL ] HEI: Loaded 30723 existing records from primary storage. [2025-10-22T19:08:46.786894] [INFO ] [MAIN ] HEI: Loaded 30723 existing records. [2025-10-22T19:08:47.048757] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:08:47.049016] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-22T19:08:47.049085] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-22T19:08:47.049352] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-22T19:08:47.049412] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-22T19:08:47.335707] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-22T19:08:47.498504] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:47.619122] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-22T19:08:48.117709] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-22T19:08:48.809023] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-22T19:08:48.917685] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-22T19:08:48.956982] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T19:08:49.668431] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T19:08:49.717629] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-22T19:08:50.517721] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-22T19:08:51.330405] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-22T19:08:51.332916] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-22T19:08:51.342566] [INFO ] [REMOTE ] HD: Full fetch complete (77550 records). [2025-10-22T19:08:51.342877] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-22T19:08:51.452166] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T19:08:51.789386] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-22T19:08:51.789517] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-22T19:08:51.790469] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-22T19:08:51.790543] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-22T19:08:51.791986] [DEBUG] [LOCAL ] HD: Trimmed 77550 records to 53467 (keeping 200 days of data) [2025-10-22T19:08:51.917519] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T19:08:52.120865] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-22T19:08:52.171396] [DEBUG] [LOCAL ] HD: Primary data saved (53467 records). [2025-10-22T19:08:52.171573] [INFO ] [MAIN ] HD: Full history saved. [2025-10-22T19:08:52.171704] [INFO ] [MAIN ] Update Progress: 1003/2367 symbols completed. HD took 33.9s. Estimated remaining: 2h 55m 9s. Rate: 7.8 symbols/min [2025-10-22T19:08:52.343812] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:52.352574] [DEBUG] [LOCAL ] HEQ: Loaded 6795 existing records from primary storage. [2025-10-22T19:08:52.352804] [INFO ] [MAIN ] HEQ: Loaded 6795 existing records. [2025-10-22T19:08:52.542323] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:08:52.542630] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-22T19:08:52.542719] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-22T19:08:52.542863] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-22T19:08:52.542903] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-22T19:08:52.910692] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:52.922740] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-22T19:08:52.935025] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T19:08:53.555248] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-22T19:08:53.717674] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-22T19:08:53.817635] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T19:08:53.826309] [INFO ] [REMOTE ] HDB: Full fetch complete (75653 records). [2025-10-22T19:08:53.826437] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-22T19:08:54.215447] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-22T19:08:54.215556] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-22T19:08:54.216724] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-22T19:08:54.216786] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-22T19:08:54.218309] [DEBUG] [LOCAL ] HDB: Trimmed 75653 records to 51909 (keeping 200 days of data) [2025-10-22T19:08:54.520360] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-22T19:08:54.536359] [DEBUG] [LOCAL ] HDB: Primary data saved (51909 records). [2025-10-22T19:08:54.536499] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-22T19:08:54.536583] [INFO ] [MAIN ] Update Progress: 1004/2367 symbols completed. HDB took 36.2s. Estimated remaining: 2h 54m 54s. Rate: 7.8 symbols/min [2025-10-22T19:08:54.701800] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:54.743782] [DEBUG] [LOCAL ] HESM: Loaded 48621 existing records from primary storage. [2025-10-22T19:08:54.744077] [INFO ] [MAIN ] HESM: Loaded 48621 existing records. [2025-10-22T19:08:54.923329] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:08:54.923601] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-22T19:08:54.923839] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-22T19:08:54.924060] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-22T19:08:54.924166] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-22T19:08:55.120353] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-22T19:08:55.223682] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T19:08:55.320951] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-22T19:08:55.348861] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:55.929590] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T19:08:56.117669] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-22T19:08:56.917718] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-22T19:08:57.650817] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-22T19:08:57.717728] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-22T19:08:57.956262] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T19:08:57.964305] [INFO ] [REMOTE ] HE: Full fetch complete (72101 records). [2025-10-22T19:08:57.964431] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-22T19:08:58.359973] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-22T19:08:58.360051] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-22T19:08:58.360973] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-22T19:08:58.361036] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-22T19:08:58.362338] [DEBUG] [LOCAL ] HE: Trimmed 72101 records to 48806 (keeping 200 days of data) [2025-10-22T19:08:58.525378] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-22T19:08:58.644335] [DEBUG] [LOCAL ] HE: Primary data saved (48806 records). [2025-10-22T19:08:58.644461] [INFO ] [MAIN ] HE: Full history saved. [2025-10-22T19:08:58.645003] [INFO ] [MAIN ] Update Progress: 1005/2367 symbols completed. HE took 32.3s. Estimated remaining: 2h 54m 41s. Rate: 7.8 symbols/min [2025-10-22T19:08:58.824197] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:08:58.824370] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-22T19:08:58.824513] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-22T19:08:58.824730] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-22T19:08:58.824879] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-22T19:08:58.824954] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-22T19:08:58.825130] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-22T19:08:59.147676] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T19:08:59.233991] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:08:59.317634] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-22T19:08:59.652268] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-22T19:09:00.065573] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T19:09:00.117610] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-22T19:09:00.917679] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-22T19:09:01.717779] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-22T19:09:02.368041] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-22T19:09:02.517745] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-22T19:09:03.317725] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-22T19:09:03.578528] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-10-22T19:09:03.648601] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-22T19:09:03.663781] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T19:09:04.117683] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-22T19:09:04.703243] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T19:09:04.917719] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-22T19:09:05.205860] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-22T19:09:05.632139] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T19:09:05.717716] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-22T19:09:06.517723] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-22T19:09:07.098259] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T19:09:07.128583] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T19:09:07.317618] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-22T19:09:08.117736] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-22T19:09:08.357842] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-22T19:09:08.800534] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T19:09:08.917677] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-22T19:09:09.658531] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T19:09:09.717617] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-22T19:09:10.517686] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-22T19:09:10.571559] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-22T19:09:10.573564] [INFO ] [REMOTE ] HEQ: Full fetch complete (9548 records). [2025-10-22T19:09:10.573633] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-22T19:09:10.921159] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-22T19:09:10.921235] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-22T19:09:10.921456] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-22T19:09:10.921495] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-22T19:09:10.921920] [DEBUG] [LOCAL ] HEQ: Trimmed 9548 records to 6756 (keeping 200 days of data) [2025-10-22T19:09:10.960558] [DEBUG] [LOCAL ] HEQ: Primary data saved (6756 records). [2025-10-22T19:09:10.960697] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-22T19:09:10.960787] [INFO ] [MAIN ] Update Progress: 1006/2367 symbols completed. HEQ took 18.8s. Estimated remaining: 2h 54m 40s. Rate: 7.8 symbols/min [2025-10-22T19:09:11.129830] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:09:11.130006] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-22T19:09:11.130062] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-22T19:09:11.130174] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-22T19:09:11.130220] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-22T19:09:11.130269] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-22T19:09:11.130307] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-22T19:09:11.326340] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-22T19:09:11.484225] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:09:11.821143] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-22T19:09:12.117688] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-22T19:09:12.358770] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-22T19:09:12.917733] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-22T19:09:13.163031] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T19:09:13.267685] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-22T19:09:13.717669] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-22T19:09:14.517718] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-22T19:09:14.936581] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-22T19:09:15.178448] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-22T19:09:15.317620] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-22T19:09:16.117724] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-22T19:09:16.862146] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T19:09:16.917624] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-22T19:09:17.611320] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-22T19:09:17.632897] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T19:09:17.717779] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-22T19:09:17.964104] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-22T19:09:18.517725] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-22T19:09:18.930497] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-22T19:09:19.317769] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-22T19:09:20.117681] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-22T19:09:20.578674] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-22T19:09:20.917723] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-22T19:09:21.621227] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T19:09:21.717790] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-22T19:09:22.291438] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-22T19:09:22.295434] [INFO ] [REMOTE ] HEI: Full fetch complete (47348 records). [2025-10-22T19:09:22.295522] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-22T19:09:22.523004] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-22T19:09:22.666343] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-22T19:09:22.666428] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-22T19:09:22.667197] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-22T19:09:22.667260] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-22T19:09:22.668241] [DEBUG] [LOCAL ] HEI: Trimmed 47348 records to 30521 (keeping 200 days of data) [2025-10-22T19:09:22.850059] [DEBUG] [LOCAL ] HEI: Primary data saved (30521 records). [2025-10-22T19:09:22.850190] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-22T19:09:22.850267] [INFO ] [MAIN ] Update Progress: 1007/2367 symbols completed. HEI took 36.4s. Estimated remaining: 2h 54m 38s. Rate: 7.8 symbols/min [2025-10-22T19:09:23.018827] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:09:23.021170] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-22T19:09:23.037530] [DEBUG] [LOCAL ] HFRO: Loaded 16466 existing records from primary storage. [2025-10-22T19:09:23.037798] [INFO ] [MAIN ] HFRO: Loaded 16466 existing records. [2025-10-22T19:09:23.211872] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:09:23.212081] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-22T19:09:23.212135] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-22T19:09:23.212294] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-22T19:09:23.212332] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-22T19:09:23.319816] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-22T19:09:23.577593] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:09:23.623441] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-22T19:09:23.639300] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-22T19:09:24.117673] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-22T19:09:24.462117] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-22T19:09:24.917717] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-22T19:09:25.717729] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-22T19:09:26.053862] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-22T19:09:26.259531] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T19:09:26.520118] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-22T19:09:27.317774] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-22T19:09:27.650493] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T19:09:28.117736] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-22T19:09:28.359603] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-22T19:09:28.917766] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-22T19:09:29.042529] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T19:09:29.139072] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-22T19:09:29.717728] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-22T19:09:30.079551] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-22T19:09:30.080213] [INFO ] [REMOTE ] HF: Full fetch complete (420 records). [2025-10-22T19:09:30.080280] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-22T19:09:30.255290] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-22T19:09:30.255506] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:09:30.255574] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:09:30.255665] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-22T19:09:30.255743] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-22T19:09:30.255781] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-22T19:09:30.255820] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-22T19:09:30.255874] [INFO ] [MAIN ] Update Progress: 1008/2367 symbols completed. HF took 31.6s. Estimated remaining: 2h 54m 30s. Rate: 7.8 symbols/min [2025-10-22T19:09:30.424345] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:09:30.440948] [DEBUG] [LOCAL ] HGER: Loaded 15479 existing records from primary storage. [2025-10-22T19:09:30.441170] [INFO ] [MAIN ] HGER: Loaded 15479 existing records. [2025-10-22T19:09:30.522837] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-22T19:09:30.617057] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:09:30.617267] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-22T19:09:30.617313] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-22T19:09:30.617498] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-22T19:09:30.617553] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-22T19:09:30.972074] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:09:31.317689] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-22T19:09:32.104531] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T19:09:32.117623] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-22T19:09:32.338394] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T19:09:32.544988] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-22T19:09:32.917731] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-22T19:09:33.717769] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-22T19:09:33.960338] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T19:09:34.153316] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-22T19:09:34.517633] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-22T19:09:35.317721] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-22T19:09:35.637793] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T19:09:35.745326] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-22T19:09:36.117677] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-22T19:09:36.770779] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T19:09:36.917725] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-22T19:09:37.717745] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-22T19:09:38.485762] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-22T19:09:38.517675] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-22T19:09:38.862999] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T19:09:38.874912] [INFO ] [REMOTE ] HESM: Full fetch complete (69880 records). [2025-10-22T19:09:38.875212] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-22T19:09:38.999180] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-22T19:09:39.030808] [INFO ] [REMOTE ] HFND: Full fetch complete (1771 records). [2025-10-22T19:09:39.046727] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-22T19:09:39.317724] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-22T19:09:39.541590] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-22T19:09:39.558193] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:09:39.579210] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:09:39.579368] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-22T19:09:39.590253] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-22T19:09:39.600695] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-22T19:09:39.618042] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-22T19:09:39.628014] [INFO ] [MAIN ] Update Progress: 1009/2367 symbols completed. HFND took 28.7s. Estimated remaining: 2h 54m 24s. Rate: 7.8 symbols/min [2025-10-22T19:09:39.720483] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-22T19:09:39.753977] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-22T19:09:39.766099] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-22T19:09:39.766181] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-22T19:09:39.803576] [DEBUG] [LOCAL ] HESM: Trimmed 69880 records to 48607 (keeping 200 days of data) [2025-10-22T19:09:39.949215] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:09:39.964139] [DEBUG] [LOCAL ] HGLB: Loaded 9704 existing records from primary storage. [2025-10-22T19:09:39.968524] [INFO ] [MAIN ] HGLB: Loaded 9704 existing records. [2025-10-22T19:09:40.119508] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-22T19:09:40.256543] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:09:40.257362] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-22T19:09:40.257688] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-22T19:09:40.258628] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-22T19:09:40.258790] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-22T19:09:40.359529] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-22T19:09:40.614034] [DEBUG] [LOCAL ] HESM: Primary data saved (48607 records). [2025-10-22T19:09:40.632505] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-22T19:09:40.634872] [INFO ] [MAIN ] Update Progress: 1010/2367 symbols completed. HESM took 46.1s. Estimated remaining: 2h 54m 8s. Rate: 7.8 symbols/min [2025-10-22T19:09:40.812294] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:09:40.878093] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:09:40.892431] [DEBUG] [LOCAL ] HGTY: Loaded 13379 existing records from primary storage. [2025-10-22T19:09:40.892633] [INFO ] [MAIN ] HGTY: Loaded 13379 existing records. [2025-10-22T19:09:40.922764] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-22T19:09:41.072889] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:09:41.073084] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-22T19:09:41.073138] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-22T19:09:41.073286] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-22T19:09:41.073322] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-22T19:09:41.192717] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T19:09:41.431407] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:09:41.717752] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-22T19:09:41.779873] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T19:09:42.517743] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-22T19:09:42.737217] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T19:09:43.317771] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-22T19:09:43.335280] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-22T19:09:44.092868] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T19:09:44.117607] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-22T19:09:44.736240] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T19:09:44.917639] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-22T19:09:45.717740] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-22T19:09:45.885468] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T19:09:46.517666] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-22T19:09:46.677805] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-22T19:09:47.166871] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T19:09:47.317720] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-22T19:09:48.117895] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-22T19:09:48.262266] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T19:09:48.917683] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-22T19:09:49.142310] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T19:09:49.717718] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-22T19:09:49.939801] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T19:09:50.517672] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-22T19:09:50.877156] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-22T19:09:50.882702] [INFO ] [REMOTE ] HGER: Full fetch complete (19019 records). [2025-10-22T19:09:50.882835] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-22T19:09:51.247859] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-22T19:09:51.247948] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-22T19:09:51.248310] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-22T19:09:51.248355] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-22T19:09:51.248921] [DEBUG] [LOCAL ] HGER: Trimmed 19019 records to 15543 (keeping 200 days of data) [2025-10-22T19:09:51.318690] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-22T19:09:51.340536] [DEBUG] [LOCAL ] HGER: Primary data saved (15543 records). [2025-10-22T19:09:51.340741] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-22T19:09:51.340835] [INFO ] [MAIN ] Update Progress: 1011/2367 symbols completed. HGER took 21.1s. Estimated remaining: 2h 54m 4s. Rate: 7.8 symbols/min [2025-10-22T19:09:51.506631] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:09:51.515573] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T19:09:51.518332] [INFO ] [REMOTE ] HFRO: Full fetch complete (26874 records). [2025-10-22T19:09:51.518417] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-22T19:09:51.809573] [DEBUG] [LOCAL ] HGV: Loaded 46110 existing records from primary storage. [2025-10-22T19:09:51.844835] [INFO ] [MAIN ] HGV: Loaded 46110 existing records. [2025-10-22T19:09:52.083031] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-22T19:09:52.099032] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-22T19:09:52.125805] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-22T19:09:52.125951] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-22T19:09:52.162596] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-22T19:09:52.157121] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:09:52.162881] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-22T19:09:52.163045] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-22T19:09:52.163269] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-22T19:09:52.163584] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-22T19:09:52.163763] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-22T19:09:52.185734] [DEBUG] [LOCAL ] HFRO: Trimmed 26874 records to 16376 (keeping 200 days of data) [2025-10-22T19:09:52.388110] [DEBUG] [LOCAL ] HFRO: Primary data saved (16376 records). [2025-10-22T19:09:52.429688] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-22T19:09:52.436513] [INFO ] [MAIN ] Update Progress: 1012/2367 symbols completed. HFRO took 29.6s. Estimated remaining: 2h 53m 47s. Rate: 7.8 symbols/min [2025-10-22T19:09:52.751723] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:09:52.799907] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:09:52.830741] [DEBUG] [LOCAL ] HHH: Loaded 33152 existing records from primary storage. [2025-10-22T19:09:52.831029] [INFO ] [MAIN ] HHH: Loaded 33152 existing records. [2025-10-22T19:09:52.922745] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-22T19:09:52.975966] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-22T19:09:53.033777] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:09:53.033979] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-22T19:09:53.034026] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-22T19:09:53.034230] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-22T19:09:53.034267] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-22T19:09:53.375927] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:09:53.717723] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-22T19:09:54.313392] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T19:09:54.517615] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-22T19:09:54.931258] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T19:09:55.317748] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-22T19:09:55.999523] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T19:09:56.117719] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-22T19:09:56.534150] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T19:09:56.917714] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-22T19:09:57.694626] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T19:09:57.717639] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-22T19:09:57.761844] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-22T19:09:58.517816] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-22T19:09:59.317675] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-22T19:09:59.414637] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T19:09:59.469135] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T19:10:00.066411] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-22T19:10:00.117674] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-22T19:10:00.917727] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-22T19:10:00.962425] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T19:10:01.641479] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T19:10:01.717748] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-22T19:10:02.517681] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-22T19:10:03.061668] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-22T19:10:03.303536] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T19:10:03.317610] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-22T19:10:04.117682] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-22T19:10:04.448391] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T19:10:04.917683] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-22T19:10:05.651211] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:10:05.717711] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-22T19:10:06.517719] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-22T19:10:06.636529] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T19:10:06.945095] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T19:10:07.290314] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-22T19:10:07.317679] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-22T19:10:08.117709] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-22T19:10:08.139785] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T19:10:08.917679] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-22T19:10:09.717731] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-22T19:10:09.747564] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T19:10:09.938676] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T19:10:10.517757] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-22T19:10:11.317738] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-22T19:10:11.575375] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T19:10:11.578157] [INFO ] [REMOTE ] HGTY: Full fetch complete (17589 records). [2025-10-22T19:10:11.578235] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-22T19:10:11.740020] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T19:10:11.992757] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-22T19:10:11.992913] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-22T19:10:11.993312] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-22T19:10:11.993372] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-22T19:10:11.993951] [DEBUG] [LOCAL ] HGTY: Trimmed 17589 records to 13361 (keeping 200 days of data) [2025-10-22T19:10:12.068303] [DEBUG] [LOCAL ] HGTY: Primary data saved (13361 records). [2025-10-22T19:10:12.068426] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-22T19:10:12.068501] [INFO ] [MAIN ] Update Progress: 1013/2367 symbols completed. HGTY took 31.4s. Estimated remaining: 2h 53m 56s. Rate: 7.8 symbols/min [2025-10-22T19:10:12.130931] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-22T19:10:12.236606] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:10:12.267949] [DEBUG] [LOCAL ] HI: Loaded 36113 existing records from primary storage. [2025-10-22T19:10:12.268208] [INFO ] [MAIN ] HI: Loaded 36113 existing records. [2025-10-22T19:10:12.440784] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:10:12.440984] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-22T19:10:12.441030] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-22T19:10:12.441427] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-22T19:10:12.441481] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-22T19:10:12.797204] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:10:12.861853] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T19:10:12.884372] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T19:10:12.917723] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-22T19:10:13.717661] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-22T19:10:14.405449] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T19:10:14.517676] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-22T19:10:15.120140] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T19:10:15.317749] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-22T19:10:16.066139] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-22T19:10:16.094208] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T19:10:16.117673] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-22T19:10:16.743019] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-22T19:10:16.917749] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-22T19:10:17.717722] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-22T19:10:18.525298] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-22T19:10:18.527672] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T19:10:18.535257] [INFO ] [REMOTE ] HGV: Full fetch complete (65933 records). [2025-10-22T19:10:18.535356] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-22T19:10:18.929401] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-22T19:10:18.929486] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-22T19:10:18.930350] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-22T19:10:18.930421] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-22T19:10:18.931807] [DEBUG] [LOCAL ] HGV: Trimmed 65933 records to 46058 (keeping 200 days of data) [2025-10-22T19:10:19.169697] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T19:10:19.228170] [DEBUG] [LOCAL ] HGV: Primary data saved (46058 records). [2025-10-22T19:10:19.228301] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-22T19:10:19.228814] [INFO ] [MAIN ] Update Progress: 1014/2367 symbols completed. HGV took 27.9s. Estimated remaining: 2h 53m 47s. Rate: 7.8 symbols/min [2025-10-22T19:10:19.324173] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-22T19:10:19.398326] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:10:19.449285] [DEBUG] [LOCAL ] HIG: Loaded 51173 existing records from primary storage. [2025-10-22T19:10:19.449577] [INFO ] [MAIN ] HIG: Loaded 51173 existing records. [2025-10-22T19:10:19.631771] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:10:19.632036] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-22T19:10:19.632173] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-22T19:10:19.632485] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-22T19:10:19.632574] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-22T19:10:19.830733] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T19:10:20.022176] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:10:20.117673] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-22T19:10:20.476560] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T19:10:20.917684] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-22T19:10:21.717669] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-22T19:10:21.802238] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T19:10:22.380288] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T19:10:22.510592] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-22T19:10:22.517605] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-22T19:10:23.317628] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-22T19:10:23.410865] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T19:10:24.117751] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-22T19:10:24.804793] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T19:10:24.917666] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-22T19:10:25.020353] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-22T19:10:25.022702] [INFO ] [REMOTE ] HGLB: Full fetch complete (14399 records). [2025-10-22T19:10:25.022773] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-22T19:10:25.391859] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-22T19:10:25.391942] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-22T19:10:25.392375] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-22T19:10:25.392415] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-22T19:10:25.392920] [DEBUG] [LOCAL ] HGLB: Trimmed 14399 records to 9621 (keeping 200 days of data) [2025-10-22T19:10:25.453355] [DEBUG] [LOCAL ] HGLB: Primary data saved (9621 records). [2025-10-22T19:10:25.453522] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-22T19:10:25.453639] [INFO ] [MAIN ] Update Progress: 1015/2367 symbols completed. HGLB took 45.8s. Estimated remaining: 2h 53m 37s. Rate: 7.8 symbols/min [2025-10-22T19:10:25.619607] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:10:25.649822] [DEBUG] [LOCAL ] HII: Loaded 33494 existing records from primary storage. [2025-10-22T19:10:25.650106] [INFO ] [MAIN ] HII: Loaded 33494 existing records. [2025-10-22T19:10:25.722920] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-22T19:10:25.831319] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:10:25.831522] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-22T19:10:25.831590] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-22T19:10:25.831925] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-22T19:10:25.831994] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-22T19:10:26.187419] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:10:26.415905] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T19:10:26.517684] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-22T19:10:27.317666] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-22T19:10:27.408382] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T19:10:27.881984] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T19:10:28.117684] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-22T19:10:28.803901] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T19:10:28.808947] [INFO ] [REMOTE ] HHH: Full fetch complete (46157 records). [2025-10-22T19:10:28.809029] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-22T19:10:28.922720] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-22T19:10:29.195719] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-22T19:10:29.195939] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-22T19:10:29.196704] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-22T19:10:29.196778] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-22T19:10:29.197891] [DEBUG] [LOCAL ] HHH: Trimmed 46157 records to 33047 (keeping 200 days of data) [2025-10-22T19:10:29.322839] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T19:10:29.417598] [DEBUG] [LOCAL ] HHH: Primary data saved (33047 records). [2025-10-22T19:10:29.417765] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-22T19:10:29.417854] [INFO ] [MAIN ] Update Progress: 1016/2367 symbols completed. HHH took 37.0s. Estimated remaining: 2h 53m 25s. Rate: 7.8 symbols/min [2025-10-22T19:10:29.609825] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:10:29.658769] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-22T19:10:29.659087] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-22T19:10:29.727629] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-22T19:10:29.860442] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:10:29.860694] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-22T19:10:29.860757] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-22T19:10:29.860998] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-22T19:10:29.861054] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-22T19:10:30.219599] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:10:30.517638] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-22T19:10:30.798205] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T19:10:31.278772] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T19:10:31.317676] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-22T19:10:32.117756] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-22T19:10:32.922266] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-22T19:10:32.927338] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-22T19:10:33.221855] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T19:10:33.692732] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T19:10:33.717612] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-22T19:10:34.249681] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T19:10:34.517668] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-22T19:10:35.003536] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-22T19:10:35.317713] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-22T19:10:36.117675] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-22T19:10:36.917670] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-22T19:10:37.004544] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T19:10:37.013346] [INFO ] [REMOTE ] HI: Full fetch complete (51262 records). [2025-10-22T19:10:37.030285] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-22T19:10:37.047909] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-22T19:10:37.434166] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-22T19:10:37.434245] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-22T19:10:37.434954] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-22T19:10:37.435015] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-22T19:10:37.436049] [DEBUG] [LOCAL ] HI: Trimmed 51262 records to 36110 (keeping 200 days of data) [2025-10-22T19:10:37.656876] [DEBUG] [LOCAL ] HI: Primary data saved (36110 records). [2025-10-22T19:10:37.657052] [INFO ] [MAIN ] HI: Full history saved. [2025-10-22T19:10:37.657158] [INFO ] [MAIN ] Update Progress: 1017/2367 symbols completed. HI took 25.6s. Estimated remaining: 2h 53m 18s. Rate: 7.8 symbols/min [2025-10-22T19:10:37.721464] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-22T19:10:37.831263] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:10:37.853636] [DEBUG] [LOCAL ] HIO: Loaded 24124 existing records from primary storage. [2025-10-22T19:10:37.853909] [INFO ] [MAIN ] HIO: Loaded 24124 existing records. [2025-10-22T19:10:38.034574] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:10:38.035005] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-22T19:10:38.049637] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-22T19:10:38.061889] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-22T19:10:38.062415] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-22T19:10:38.063785] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T19:10:38.430038] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:10:38.517677] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-22T19:10:38.614612] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T19:10:39.317716] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-22T19:10:40.117634] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-22T19:10:40.375548] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T19:10:40.716291] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.99 seconds). [2025-10-22T19:10:40.917620] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-22T19:10:41.339172] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-22T19:10:41.717747] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-22T19:10:41.901821] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T19:10:42.517632] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-22T19:10:42.921521] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T19:10:43.317672] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-22T19:10:43.642770] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-22T19:10:43.671324] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T19:10:44.117750] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-22T19:10:44.917936] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-22T19:10:45.717682] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-22T19:10:45.807675] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T19:10:46.259072] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-10-22T19:10:46.517797] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-22T19:10:46.640669] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T19:10:46.691256] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-22T19:10:47.317690] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-22T19:10:48.117639] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-22T19:10:48.502012] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T19:10:48.917625] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-22T19:10:49.279151] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-10-22T19:10:49.592454] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T19:10:49.717676] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-22T19:10:50.256488] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-22T19:10:50.517719] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-22T19:10:51.295024] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T19:10:51.317623] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-22T19:10:51.561852] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T19:10:52.117764] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-22T19:10:52.690472] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T19:10:52.917738] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-22T19:10:53.030545] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T19:10:53.717781] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-22T19:10:54.517753] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-22T19:10:55.216915] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-22T19:10:55.222273] [INFO ] [REMOTE ] HII: Full fetch complete (52326 records). [2025-10-22T19:10:55.222383] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-22T19:10:55.322494] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-22T19:10:55.617919] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-22T19:10:55.618038] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-22T19:10:55.619069] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-22T19:10:55.619181] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-22T19:10:55.620470] [DEBUG] [LOCAL ] HII: Trimmed 52326 records to 33319 (keeping 200 days of data) [2025-10-22T19:10:55.748273] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.83 seconds). [2025-10-22T19:10:55.873702] [DEBUG] [LOCAL ] HII: Primary data saved (33319 records). [2025-10-22T19:10:55.873967] [INFO ] [MAIN ] HII: Full history saved. [2025-10-22T19:10:55.874072] [INFO ] [MAIN ] Update Progress: 1018/2367 symbols completed. HII took 30.4s. Estimated remaining: 2h 53m 24s. Rate: 7.8 symbols/min [2025-10-22T19:10:56.046542] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:10:56.066499] [DEBUG] [LOCAL ] HIPO: Loaded 21512 existing records from primary storage. [2025-10-22T19:10:56.066794] [INFO ] [MAIN ] HIPO: Loaded 21512 existing records. [2025-10-22T19:10:56.133660] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-22T19:10:56.246718] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:10:56.247279] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-22T19:10:56.247547] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-22T19:10:56.248240] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-22T19:10:56.248430] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-22T19:10:56.395151] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-22T19:10:56.403540] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T19:10:56.664030] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:10:56.917677] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-22T19:10:57.717747] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-22T19:10:57.743826] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T19:10:58.517690] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-22T19:10:59.045799] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-10-22T19:10:59.317640] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-22T19:10:59.487813] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T19:10:59.495901] [INFO ] [REMOTE ] HIG: Full fetch complete (73718 records). [2025-10-22T19:10:59.496016] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-22T19:10:59.684900] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T19:10:59.900289] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-22T19:10:59.900363] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-22T19:10:59.901223] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-22T19:10:59.901285] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-22T19:10:59.902662] [DEBUG] [LOCAL ] HIG: Trimmed 73718 records to 51135 (keeping 200 days of data) [2025-10-22T19:11:00.117733] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-22T19:11:00.220482] [DEBUG] [LOCAL ] HIG: Primary data saved (51135 records). [2025-10-22T19:11:00.220615] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-22T19:11:00.221102] [INFO ] [MAIN ] Update Progress: 1019/2367 symbols completed. HIG took 41.0s. Estimated remaining: 2h 53m 12s. Rate: 7.8 symbols/min [2025-10-22T19:11:00.399515] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:11:00.439939] [DEBUG] [LOCAL ] HIW: Loaded 44457 existing records from primary storage. [2025-10-22T19:11:00.440224] [INFO ] [MAIN ] HIW: Loaded 44457 existing records. [2025-10-22T19:11:00.619886] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:11:00.620109] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-22T19:11:00.620184] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-22T19:11:00.620404] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-22T19:11:00.620460] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-22T19:11:00.922832] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-22T19:11:00.984747] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:11:01.451630] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T19:11:01.717667] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-22T19:11:02.095535] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-10-22T19:11:02.137769] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T19:11:02.517748] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-22T19:11:03.165712] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T19:11:03.317676] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-22T19:11:03.724961] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-22T19:11:04.117735] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-22T19:11:04.662580] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T19:11:04.917667] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-22T19:11:05.717755] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-22T19:11:06.260788] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T19:11:06.267597] [INFO ] [REMOTE ] HIO: Full fetch complete (38100 records). [2025-10-22T19:11:06.267793] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-22T19:11:06.528773] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-22T19:11:06.646874] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-22T19:11:06.647129] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-22T19:11:06.648033] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-22T19:11:06.648294] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-22T19:11:06.649509] [DEBUG] [LOCAL ] HIO: Trimmed 38100 records to 23941 (keeping 200 days of data) [2025-10-22T19:11:06.785005] [DEBUG] [LOCAL ] HIO: Primary data saved (23941 records). [2025-10-22T19:11:06.785183] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-22T19:11:06.785343] [INFO ] [MAIN ] Update Progress: 1020/2367 symbols completed. HIO took 29.1s. Estimated remaining: 2h 53m 3s. Rate: 7.8 symbols/min [2025-10-22T19:11:06.931031] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T19:11:07.018470] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:11:07.024736] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.91 seconds). [2025-10-22T19:11:07.053759] [DEBUG] [LOCAL ] HIX: Loaded 20379 existing records from primary storage. [2025-10-22T19:11:07.054020] [INFO ] [MAIN ] HIX: Loaded 20379 existing records. [2025-10-22T19:11:07.260431] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:11:07.260689] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-22T19:11:07.260747] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-22T19:11:07.260929] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-22T19:11:07.260967] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-22T19:11:07.324066] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-22T19:11:07.640415] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:11:07.990266] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T19:11:08.117695] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-22T19:11:08.917774] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-22T19:11:09.214612] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T19:11:09.717731] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-22T19:11:09.749091] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-22T19:11:10.271490] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.95 seconds). [2025-10-22T19:11:10.280529] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-22T19:11:10.280716] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-22T19:11:10.522820] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-22T19:11:10.690306] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-22T19:11:10.690383] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-22T19:11:10.691299] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-22T19:11:10.691360] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-22T19:11:10.692762] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 53817 (keeping 200 days of data) [2025-10-22T19:11:10.796005] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T19:11:11.023350] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-22T19:11:11.023473] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-22T19:11:11.023549] [INFO ] [MAIN ] Update Progress: 1021/2367 symbols completed. HIMS took 41.6s. Estimated remaining: 2h 52m 50s. Rate: 7.8 symbols/min [2025-10-22T19:11:11.204451] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:11:11.222195] [DEBUG] [LOCAL ] HKD: Loaded 18717 existing records from primary storage. [2025-10-22T19:11:11.222429] [INFO ] [MAIN ] HKD: Loaded 18717 existing records. [2025-10-22T19:11:11.322780] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-22T19:11:11.403918] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:11:11.404115] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-22T19:11:11.404161] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-22T19:11:11.404341] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-22T19:11:11.404395] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-22T19:11:11.773621] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:11:11.788506] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-22T19:11:12.117669] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-22T19:11:12.439254] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T19:11:12.917727] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-22T19:11:13.561059] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T19:11:13.717757] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-22T19:11:14.026871] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T19:11:14.517751] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-22T19:11:15.092704] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-22T19:11:15.317748] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-22T19:11:15.935993] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T19:11:16.117693] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-22T19:11:16.475295] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-22T19:11:16.917635] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-22T19:11:17.210766] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T19:11:17.717834] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-22T19:11:18.417192] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T19:11:18.517614] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-22T19:11:18.845099] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-22T19:11:19.317631] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-22T19:11:20.122782] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-22T19:11:20.134723] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T19:11:20.408284] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T19:11:20.917694] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-22T19:11:21.103630] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T19:11:21.717634] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-22T19:11:21.939852] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T19:11:22.517670] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-22T19:11:22.804155] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T19:11:23.317618] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-22T19:11:23.540005] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T19:11:24.117751] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-22T19:11:24.173103] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T19:11:24.917626] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-22T19:11:25.233502] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T19:11:25.236561] [INFO ] [REMOTE ] HIPO: Full fetch complete (31040 records). [2025-10-22T19:11:25.236670] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-22T19:11:25.602379] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-22T19:11:25.602453] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-22T19:11:25.603035] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-22T19:11:25.603096] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-22T19:11:25.603826] [DEBUG] [LOCAL ] HIPO: Trimmed 31040 records to 21379 (keeping 200 days of data) [2025-10-22T19:11:25.723994] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-22T19:11:25.723909] [DEBUG] [LOCAL ] HIPO: Primary data saved (21379 records). [2025-10-22T19:11:25.725064] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-22T19:11:25.725172] [INFO ] [MAIN ] Update Progress: 1022/2367 symbols completed. HIPO took 29.9s. Estimated remaining: 2h 52m 52s. Rate: 7.8 symbols/min [2025-10-22T19:11:25.904954] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:11:25.909687] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T19:11:25.964372] [DEBUG] [LOCAL ] HL: Loaded 53676 existing records from primary storage. [2025-10-22T19:11:25.964817] [INFO ] [MAIN ] HL: Loaded 53676 existing records. [2025-10-22T19:11:26.173219] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:11:26.173487] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-22T19:11:26.173541] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-22T19:11:26.173755] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-22T19:11:26.173810] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-22T19:11:26.528070] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-22T19:11:26.547182] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:11:27.163383] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T19:11:27.205165] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-22T19:11:27.317612] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-22T19:11:28.117737] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-22T19:11:28.551894] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T19:11:28.917746] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-22T19:11:29.289993] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T19:11:29.717693] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-22T19:11:30.161928] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T19:11:30.165587] [INFO ] [REMOTE ] HKD: Full fetch complete (27871 records). [2025-10-22T19:11:30.165721] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-22T19:11:30.523436] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-22T19:11:30.524150] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-22T19:11:30.524225] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-22T19:11:30.525452] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-22T19:11:30.525515] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-22T19:11:30.526314] [DEBUG] [LOCAL ] HKD: Trimmed 27871 records to 18679 (keeping 200 days of data) [2025-10-22T19:11:30.627749] [DEBUG] [LOCAL ] HKD: Primary data saved (18679 records). [2025-10-22T19:11:30.627866] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-22T19:11:30.627943] [INFO ] [MAIN ] Update Progress: 1023/2367 symbols completed. HKD took 19.6s. Estimated remaining: 2h 52m 40s. Rate: 7.8 symbols/min [2025-10-22T19:11:30.793985] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:11:30.815396] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T19:11:30.850409] [DEBUG] [LOCAL ] HLF: Loaded 48506 existing records from primary storage. [2025-10-22T19:11:30.850708] [INFO ] [MAIN ] HLF: Loaded 48506 existing records. [2025-10-22T19:11:31.025678] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:11:31.025856] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-22T19:11:31.025902] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-22T19:11:31.026094] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-22T19:11:31.026147] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-22T19:11:31.331281] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-22T19:11:31.370179] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:11:32.117634] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-22T19:11:32.413334] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T19:11:32.550173] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T19:11:32.917724] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-22T19:11:33.701502] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-22T19:11:33.717600] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-22T19:11:34.517733] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-22T19:11:34.732115] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T19:11:35.317631] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-22T19:11:35.351890] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T19:11:36.079431] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T19:11:36.117624] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-22T19:11:36.917693] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-22T19:11:37.280164] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T19:11:37.330740] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-22T19:11:37.337932] [INFO ] [REMOTE ] HIW: Full fetch complete (64882 records). [2025-10-22T19:11:37.338038] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-22T19:11:37.724947] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-22T19:11:37.725952] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-22T19:11:37.726274] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-22T19:11:37.727892] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-22T19:11:37.728066] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-22T19:11:37.729460] [DEBUG] [LOCAL ] HIW: Trimmed 64882 records to 44400 (keeping 200 days of data) [2025-10-22T19:11:37.991261] [DEBUG] [LOCAL ] HIW: Primary data saved (44400 records). [2025-10-22T19:11:37.991404] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-22T19:11:37.992039] [INFO ] [MAIN ] Update Progress: 1024/2367 symbols completed. HIW took 37.8s. Estimated remaining: 2h 52m 32s. Rate: 7.8 symbols/min [2025-10-22T19:11:38.161068] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:11:38.198438] [DEBUG] [LOCAL ] HLI: Loaded 30693 existing records from primary storage. [2025-10-22T19:11:38.198753] [INFO ] [MAIN ] HLI: Loaded 30693 existing records. [2025-10-22T19:11:38.476435] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:11:38.476828] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-22T19:11:38.476899] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-22T19:11:38.477216] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-22T19:11:38.477271] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-22T19:11:38.522931] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-22T19:11:38.922268] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T19:11:39.025332] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-22T19:11:39.074171] [INFO ] [REMOTE ] HIX: Full fetch complete (30029 records). [2025-10-22T19:11:39.092500] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-22T19:11:39.129051] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:11:39.322854] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-22T19:11:39.658030] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-22T19:11:39.658138] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-22T19:11:39.658728] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-22T19:11:39.658790] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-22T19:11:39.659487] [DEBUG] [LOCAL ] HIX: Trimmed 30029 records to 20442 (keeping 200 days of data) [2025-10-22T19:11:39.773121] [DEBUG] [LOCAL ] HIX: Primary data saved (20442 records). [2025-10-22T19:11:39.773239] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-22T19:11:39.773313] [INFO ] [MAIN ] Update Progress: 1025/2367 symbols completed. HIX took 33.0s. Estimated remaining: 2h 52m 17s. Rate: 7.8 symbols/min [2025-10-22T19:11:39.939336] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:11:39.966673] [DEBUG] [LOCAL ] HLIO: Loaded 28169 existing records from primary storage. [2025-10-22T19:11:39.966937] [INFO ] [MAIN ] HLIO: Loaded 28169 existing records. [2025-10-22T19:11:40.119101] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-22T19:11:40.151747] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:11:40.152944] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-22T19:11:40.153113] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-22T19:11:40.153389] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-22T19:11:40.153460] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-22T19:11:40.525032] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:11:40.539770] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T19:11:40.917633] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-22T19:11:40.987774] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T19:11:41.717681] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-22T19:11:41.864423] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T19:11:42.088399] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T19:11:42.517723] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-22T19:11:42.960046] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-22T19:11:43.317687] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-22T19:11:44.117623] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-22T19:11:44.364212] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T19:11:44.537682] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-22T19:11:44.917670] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-22T19:11:45.717680] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-22T19:11:45.872330] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T19:11:46.517754] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-22T19:11:46.551713] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T19:11:46.744344] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-22T19:11:47.317637] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-22T19:11:47.848919] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T19:11:48.117680] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-22T19:11:48.917631] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-22T19:11:49.333884] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T19:11:49.708456] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T19:11:49.718588] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-22T19:11:50.397746] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T19:11:50.517636] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-22T19:11:51.043076] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T19:11:51.317671] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-22T19:11:51.867965] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-22T19:11:52.117632] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-22T19:11:52.917740] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-22T19:11:53.040924] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T19:11:53.391669] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T19:11:53.717686] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-22T19:11:54.517795] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-22T19:11:54.988321] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-22T19:11:55.088613] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T19:11:55.317754] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-22T19:11:56.122780] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-22T19:11:56.144131] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T19:11:56.602830] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-22T19:11:56.917746] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-22T19:11:57.537995] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T19:11:57.717733] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-22T19:11:58.517787] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-22T19:11:59.128440] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-22T19:11:59.274019] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T19:11:59.317615] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-22T19:11:59.348723] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T19:12:00.117722] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-22T19:12:00.917620] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-22T19:12:01.107062] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T19:12:01.115626] [INFO ] [REMOTE ] HLF: Full fetch complete (70867 records). [2025-10-22T19:12:01.115912] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-22T19:12:01.562178] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-22T19:12:01.562364] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-22T19:12:01.563614] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-22T19:12:01.563761] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-22T19:12:01.565957] [DEBUG] [LOCAL ] HLF: Trimmed 70867 records to 48453 (keeping 200 days of data) [2025-10-22T19:12:01.698816] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T19:12:01.718461] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-22T19:12:01.906841] [DEBUG] [LOCAL ] HLF: Primary data saved (48453 records). [2025-10-22T19:12:01.907034] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-22T19:12:01.907141] [INFO ] [MAIN ] Update Progress: 1026/2367 symbols completed. HLF took 31.3s. Estimated remaining: 2h 52m 28s. Rate: 7.8 symbols/min [2025-10-22T19:12:02.083946] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:02.118394] [DEBUG] [LOCAL ] HLLY: Loaded 33260 existing records from primary storage. [2025-10-22T19:12:02.118811] [INFO ] [MAIN ] HLLY: Loaded 33260 existing records. [2025-10-22T19:12:02.309277] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:02.309613] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-22T19:12:02.309899] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-22T19:12:02.310195] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-22T19:12:02.310239] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-22T19:12:02.517678] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-22T19:12:02.525715] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-22T19:12:02.571879] [INFO ] [REMOTE ] HLI: Full fetch complete (45374 records). [2025-10-22T19:12:02.603765] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-22T19:12:02.816108] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:03.134452] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T19:12:03.160818] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-22T19:12:03.160958] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-22T19:12:03.162358] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-22T19:12:03.162428] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-22T19:12:03.163945] [DEBUG] [LOCAL ] HLI: Trimmed 45374 records to 30581 (keeping 200 days of data) [2025-10-22T19:12:03.327946] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-22T19:12:03.375884] [DEBUG] [LOCAL ] HLI: Primary data saved (30581 records). [2025-10-22T19:12:03.376091] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-22T19:12:03.376221] [INFO ] [MAIN ] Update Progress: 1027/2367 symbols completed. HLI took 25.4s. Estimated remaining: 2h 52m 12s. Rate: 7.8 symbols/min [2025-10-22T19:12:03.558154] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:03.613931] [DEBUG] [LOCAL ] HLN: Loaded 53131 existing records from primary storage. [2025-10-22T19:12:03.614354] [INFO ] [MAIN ] HLN: Loaded 53131 existing records. [2025-10-22T19:12:03.795750] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:03.796139] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-22T19:12:03.796230] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-22T19:12:03.796718] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-22T19:12:03.796777] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-22T19:12:04.123501] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-22T19:12:04.167853] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:04.755696] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T19:12:04.917769] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-22T19:12:05.082706] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-22T19:12:05.091472] [INFO ] [REMOTE ] HL: Full fetch complete (77826 records). [2025-10-22T19:12:05.091601] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-22T19:12:05.478494] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-22T19:12:05.478616] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-22T19:12:05.479668] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-22T19:12:05.479752] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-22T19:12:05.481331] [DEBUG] [LOCAL ] HL: Trimmed 77826 records to 53676 (keeping 200 days of data) [2025-10-22T19:12:05.584179] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-22T19:12:05.635878] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T19:12:05.721419] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-22T19:12:05.834875] [DEBUG] [LOCAL ] HL: Primary data saved (53676 records). [2025-10-22T19:12:05.835002] [INFO ] [MAIN ] HL: Full history saved. [2025-10-22T19:12:05.835079] [INFO ] [MAIN ] Update Progress: 1028/2367 symbols completed. HL took 40.1s. Estimated remaining: 2h 51m 58s. Rate: 7.8 symbols/min [2025-10-22T19:12:06.003283] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:06.046607] [DEBUG] [LOCAL ] HLT: Loaded 50463 existing records from primary storage. [2025-10-22T19:12:06.046934] [INFO ] [MAIN ] HLT: Loaded 50463 existing records. [2025-10-22T19:12:06.218824] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:06.219029] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-22T19:12:06.219075] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-22T19:12:06.219296] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-22T19:12:06.219356] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-22T19:12:06.522714] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-22T19:12:06.573195] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:06.926172] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-22T19:12:07.317684] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-22T19:12:08.117631] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-22T19:12:08.321234] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T19:12:08.365319] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T19:12:08.917673] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-22T19:12:09.471808] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T19:12:09.717683] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-22T19:12:10.084133] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T19:12:10.088769] [INFO ] [REMOTE ] HLIO: Full fetch complete (37208 records). [2025-10-22T19:12:10.088864] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-22T19:12:10.453593] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-22T19:12:10.453699] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-22T19:12:10.454355] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-22T19:12:10.454403] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-22T19:12:10.455272] [DEBUG] [LOCAL ] HLIO: Trimmed 37208 records to 28093 (keeping 200 days of data) [2025-10-22T19:12:10.543093] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-22T19:12:10.628842] [DEBUG] [LOCAL ] HLIO: Primary data saved (28093 records). [2025-10-22T19:12:10.628982] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-22T19:12:10.629063] [INFO ] [MAIN ] Update Progress: 1029/2367 symbols completed. HLIO took 30.9s. Estimated remaining: 2h 51m 46s. Rate: 7.8 symbols/min [2025-10-22T19:12:10.805326] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:10.845250] [DEBUG] [LOCAL ] HLX: Loaded 47394 existing records from primary storage. [2025-10-22T19:12:10.845560] [INFO ] [MAIN ] HLX: Loaded 47394 existing records. [2025-10-22T19:12:11.028608] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T19:12:11.048787] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:11.055774] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-22T19:12:11.055970] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-22T19:12:11.056870] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-22T19:12:11.056930] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-22T19:12:11.324099] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-22T19:12:11.413184] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:12.117763] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-22T19:12:12.206976] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T19:12:12.917669] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-22T19:12:13.181607] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T19:12:13.358770] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T19:12:13.717758] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-22T19:12:14.517751] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-22T19:12:14.661071] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T19:12:15.317761] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-22T19:12:15.702523] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-22T19:12:16.117772] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-22T19:12:16.697539] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-22T19:12:16.917726] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-22T19:12:17.703197] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-22T19:12:17.717610] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-22T19:12:18.517806] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-22T19:12:18.675239] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-22T19:12:19.317742] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-22T19:12:19.546675] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-10-22T19:12:19.610204] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T19:12:20.117699] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-22T19:12:20.592031] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.87 seconds). [2025-10-22T19:12:20.925605] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-22T19:12:20.932854] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T19:12:21.717632] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-22T19:12:21.928246] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T19:12:22.091891] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T19:12:22.517676] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-22T19:12:23.317631] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-22T19:12:23.592507] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T19:12:24.117736] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-22T19:12:24.268679] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T19:12:24.846469] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:12:24.917682] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-22T19:12:25.314473] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-22T19:12:25.717688] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-22T19:12:26.517630] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-22T19:12:26.698990] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T19:12:27.169542] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T19:12:27.317736] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-22T19:12:28.117680] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-22T19:12:28.307134] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T19:12:28.765289] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T19:12:28.771056] [INFO ] [REMOTE ] HLLY: Full fetch complete (46031 records). [2025-10-22T19:12:28.771201] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-22T19:12:28.920975] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-22T19:12:29.167245] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-22T19:12:29.167363] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-22T19:12:29.168340] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-22T19:12:29.168407] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-22T19:12:29.169514] [DEBUG] [LOCAL ] HLLY: Trimmed 46031 records to 33310 (keeping 200 days of data) [2025-10-22T19:12:29.356551] [DEBUG] [LOCAL ] HLLY: Primary data saved (33310 records). [2025-10-22T19:12:29.356715] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-22T19:12:29.356806] [INFO ] [MAIN ] Update Progress: 1030/2367 symbols completed. HLLY took 27.4s. Estimated remaining: 2h 51m 53s. Rate: 7.8 symbols/min [2025-10-22T19:12:29.536440] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:29.577250] [DEBUG] [LOCAL ] HMC: Loaded 46311 existing records from primary storage. [2025-10-22T19:12:29.577566] [INFO ] [MAIN ] HMC: Loaded 46311 existing records. [2025-10-22T19:12:29.720043] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-22T19:12:29.764243] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:29.764973] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-22T19:12:29.765055] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-22T19:12:29.765324] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-22T19:12:29.765365] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-22T19:12:30.209953] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:30.213010] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-22T19:12:30.259734] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T19:12:30.517752] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-22T19:12:31.282151] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T19:12:31.317740] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-22T19:12:32.117689] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-22T19:12:32.459012] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T19:12:32.866989] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T19:12:32.917634] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-22T19:12:33.717678] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-22T19:12:33.908866] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T19:12:34.517746] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-22T19:12:34.548340] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T19:12:35.317671] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-22T19:12:35.532220] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T19:12:35.541010] [INFO ] [REMOTE ] HLN: Full fetch complete (77041 records). [2025-10-22T19:12:35.541154] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-22T19:12:35.962368] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-22T19:12:35.962536] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-22T19:12:35.963477] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-22T19:12:35.963541] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-22T19:12:35.964947] [DEBUG] [LOCAL ] HLN: Trimmed 77041 records to 53128 (keeping 200 days of data) [2025-10-22T19:12:36.136294] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-22T19:12:36.305092] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T19:12:36.323021] [DEBUG] [LOCAL ] HLN: Primary data saved (53128 records). [2025-10-22T19:12:36.323493] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-22T19:12:36.324059] [INFO ] [MAIN ] Update Progress: 1031/2367 symbols completed. HLN took 32.9s. Estimated remaining: 2h 51m 44s. Rate: 7.8 symbols/min [2025-10-22T19:12:36.493941] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:36.515346] [DEBUG] [LOCAL ] HMN: Loaded 23409 existing records from primary storage. [2025-10-22T19:12:36.515584] [INFO ] [MAIN ] HMN: Loaded 23409 existing records. [2025-10-22T19:12:36.691608] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:36.691800] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-22T19:12:36.691847] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-22T19:12:36.692083] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-22T19:12:36.692139] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-22T19:12:36.923221] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-22T19:12:37.049359] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:37.121719] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T19:12:37.717728] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-22T19:12:38.265591] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-22T19:12:38.517735] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-22T19:12:38.996415] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T19:12:39.026327] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-22T19:12:39.317696] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-22T19:12:40.117669] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-22T19:12:40.369310] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T19:12:40.390756] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-22T19:12:40.917730] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-22T19:12:41.443568] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T19:12:41.717838] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-22T19:12:42.264067] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-22T19:12:42.517745] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-22T19:12:43.317626] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-22T19:12:43.419808] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T19:12:43.427138] [INFO ] [REMOTE ] HLX: Full fetch complete (69010 records). [2025-10-22T19:12:43.427265] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-22T19:12:43.730931] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-22T19:12:43.830424] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-22T19:12:43.830544] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-22T19:12:43.831442] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-22T19:12:43.831507] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-22T19:12:43.832815] [DEBUG] [LOCAL ] HLX: Trimmed 69010 records to 47326 (keeping 200 days of data) [2025-10-22T19:12:44.087326] [DEBUG] [LOCAL ] HLX: Primary data saved (47326 records). [2025-10-22T19:12:44.087447] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-22T19:12:44.087522] [INFO ] [MAIN ] Update Progress: 1032/2367 symbols completed. HLX took 33.5s. Estimated remaining: 2h 51m 36s. Rate: 7.8 symbols/min [2025-10-22T19:12:44.122918] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-22T19:12:44.257048] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:44.304347] [DEBUG] [LOCAL ] HMY: Loaded 53166 existing records from primary storage. [2025-10-22T19:12:44.304670] [INFO ] [MAIN ] HMY: Loaded 53166 existing records. [2025-10-22T19:12:44.480054] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:44.480278] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-22T19:12:44.480329] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-22T19:12:44.480716] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-22T19:12:44.480772] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-22T19:12:44.836792] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:44.860020] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-22T19:12:44.923308] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-22T19:12:44.926910] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-22T19:12:45.717767] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-22T19:12:46.517617] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-22T19:12:46.790796] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T19:12:46.974863] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-22T19:12:47.317690] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-22T19:12:48.117620] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-22T19:12:48.511462] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-22T19:12:48.519868] [INFO ] [REMOTE ] HLT: Full fetch complete (73660 records). [2025-10-22T19:12:48.520001] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-22T19:12:48.934385] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-22T19:12:48.930744] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-22T19:12:48.934544] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-22T19:12:48.935538] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-22T19:12:48.936684] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-22T19:12:48.938442] [DEBUG] [LOCAL ] HLT: Trimmed 73660 records to 50461 (keeping 200 days of data) [2025-10-22T19:12:49.067223] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T19:12:49.296458] [DEBUG] [LOCAL ] HLT: Primary data saved (50461 records). [2025-10-22T19:12:49.296587] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-22T19:12:49.296686] [INFO ] [MAIN ] Update Progress: 1033/2367 symbols completed. HLT took 43.5s. Estimated remaining: 2h 51m 25s. Rate: 7.8 symbols/min [2025-10-22T19:12:49.476247] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:49.476440] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-22T19:12:49.476548] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-22T19:12:49.476839] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-22T19:12:49.476909] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-22T19:12:49.477015] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-22T19:12:49.477083] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-22T19:12:49.754203] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-22T19:12:49.794991] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T19:12:49.875408] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:50.309090] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T19:12:50.520944] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-22T19:12:51.317693] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-10-22T19:12:51.545556] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:12:51.545882] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-10-22T19:12:51.545991] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:12:51.546077] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-22T19:12:51.546160] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:12:51.546253] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-22T19:12:51.546335] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-22T19:12:51.546373] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-22T19:12:51.546413] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-22T19:12:51.546458] [INFO ] [MAIN ] Update Progress: 1034/2367 symbols completed. HNGE took 2.2s. Estimated remaining: 2h 51m 11s. Rate: 7.8 symbols/min [2025-10-22T19:12:51.717619] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:51.744053] [DEBUG] [LOCAL ] HNI: Loaded 29744 existing records from primary storage. [2025-10-22T19:12:51.744342] [INFO ] [MAIN ] HNI: Loaded 29744 existing records. [2025-10-22T19:12:51.926692] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:51.926912] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-22T19:12:51.926963] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-22T19:12:51.927267] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-22T19:12:51.927322] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-22T19:12:52.130303] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-22T19:12:52.276045] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:52.641831] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (2.89 seconds). [2025-10-22T19:12:52.917735] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-22T19:12:53.348745] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-10-22T19:12:53.717758] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-22T19:12:53.803985] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T19:12:53.861382] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T19:12:54.517775] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-22T19:12:54.822722] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T19:12:55.317685] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-22T19:12:56.117759] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-22T19:12:56.425388] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-22T19:12:56.433815] [INFO ] [REMOTE ] HMC: Full fetch complete (68686 records). [2025-10-22T19:12:56.434213] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-22T19:12:56.633871] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T19:12:56.851724] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-22T19:12:56.851804] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-22T19:12:56.852687] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-22T19:12:56.852749] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-22T19:12:56.853987] [DEBUG] [LOCAL ] HMC: Trimmed 68686 records to 46285 (keeping 200 days of data) [2025-10-22T19:12:56.937418] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-22T19:12:57.125318] [DEBUG] [LOCAL ] HMC: Primary data saved (46285 records). [2025-10-22T19:12:57.125500] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-22T19:12:57.125670] [INFO ] [MAIN ] Update Progress: 1035/2367 symbols completed. HMC took 27.8s. Estimated remaining: 2h 51m 0s. Rate: 7.8 symbols/min [2025-10-22T19:12:57.307114] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-22T19:12:57.306563] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:57.357876] [DEBUG] [LOCAL ] HOG: Loaded 50674 existing records from primary storage. [2025-10-22T19:12:57.358187] [INFO ] [MAIN ] HOG: Loaded 50674 existing records. [2025-10-22T19:12:57.532539] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:57.532750] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-22T19:12:57.532805] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-22T19:12:57.533015] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-22T19:12:57.533070] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-22T19:12:57.726719] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-22T19:12:57.886902] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:12:58.517755] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-22T19:12:58.892426] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T19:12:58.896456] [INFO ] [REMOTE ] HMN: Full fetch complete (31603 records). [2025-10-22T19:12:58.896606] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-22T19:12:59.159034] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-22T19:12:59.322856] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-22T19:12:59.382851] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-22T19:12:59.383036] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-22T19:12:59.383854] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-22T19:12:59.383969] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-22T19:12:59.384856] [DEBUG] [LOCAL ] HMN: Trimmed 31603 records to 23255 (keeping 200 days of data) [2025-10-22T19:12:59.527305] [DEBUG] [LOCAL ] HMN: Primary data saved (23255 records). [2025-10-22T19:12:59.527443] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-22T19:12:59.527523] [INFO ] [MAIN ] Update Progress: 1036/2367 symbols completed. HMN took 23.2s. Estimated remaining: 2h 50m 46s. Rate: 7.8 symbols/min [2025-10-22T19:12:59.671348] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T19:12:59.728769] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:12:59.773033] [DEBUG] [LOCAL ] HOMB: Loaded 43717 existing records from primary storage. [2025-10-22T19:12:59.773457] [INFO ] [MAIN ] HOMB: Loaded 43717 existing records. [2025-10-22T19:12:59.945505] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:12:59.945740] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-22T19:12:59.945791] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-22T19:12:59.945971] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-22T19:12:59.946008] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-22T19:13:00.122391] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-22T19:13:00.299293] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:13:00.917771] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-22T19:13:01.156921] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T19:13:01.474121] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T19:13:01.717799] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-22T19:13:02.258776] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T19:13:02.517733] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-22T19:13:02.917194] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-22T19:13:03.317734] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-22T19:13:04.117632] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-22T19:13:04.397377] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T19:13:04.748338] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-22T19:13:04.917629] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-22T19:13:05.684569] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T19:13:05.717630] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-22T19:13:06.517737] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-22T19:13:06.789359] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-22T19:13:07.072269] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T19:13:07.317675] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-22T19:13:08.116086] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T19:13:08.125508] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-22T19:13:08.917665] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-22T19:13:09.440352] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-22T19:13:09.683886] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T19:13:09.717625] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-22T19:13:10.526619] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-22T19:13:10.546187] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T19:13:11.286446] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T19:13:11.317615] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-22T19:13:12.021862] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T19:13:12.117680] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-22T19:13:12.478471] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T19:13:12.917742] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-22T19:13:13.717695] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-22T19:13:14.073986] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-22T19:13:14.364742] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T19:13:14.517624] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-22T19:13:15.096491] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T19:13:15.102165] [INFO ] [REMOTE ] HNI: Full fetch complete (42195 records). [2025-10-22T19:13:15.102303] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-22T19:13:15.328941] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-22T19:13:15.492150] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-22T19:13:15.492230] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-22T19:13:15.492893] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-22T19:13:15.492957] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-22T19:13:15.493904] [DEBUG] [LOCAL ] HNI: Trimmed 42195 records to 29772 (keeping 200 days of data) [2025-10-22T19:13:15.673296] [DEBUG] [LOCAL ] HNI: Primary data saved (29772 records). [2025-10-22T19:13:15.673407] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-22T19:13:15.673483] [INFO ] [MAIN ] Update Progress: 1037/2367 symbols completed. HNI took 24.1s. Estimated remaining: 2h 50m 49s. Rate: 7.8 symbols/min [2025-10-22T19:13:16.117778] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-22T19:13:16.164217] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T19:13:16.917680] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-22T19:13:17.278775] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T19:13:17.717683] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-22T19:13:17.929194] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T19:13:18.151919] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T19:13:18.517771] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-22T19:13:19.311939] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T19:13:19.322274] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-22T19:13:20.117672] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-22T19:13:21.059405] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-22T19:13:21.070186] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-22T19:13:21.957152] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-22T19:13:21.966733] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-22T19:13:22.219777] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-22T19:13:22.517753] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-22T19:13:22.791494] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T19:13:23.317770] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-22T19:13:23.723539] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-22T19:13:23.732731] [INFO ] [REMOTE ] HOMB: Full fetch complete (64511 records). [2025-10-22T19:13:23.732913] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-22T19:13:24.190333] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-22T19:13:24.190414] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-22T19:13:24.191280] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-22T19:13:24.191344] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-22T19:13:24.192590] [DEBUG] [LOCAL ] HOMB: Trimmed 64511 records to 43676 (keeping 200 days of data) [2025-10-22T19:13:24.481108] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T19:13:24.501619] [DEBUG] [LOCAL ] HOMB: Primary data saved (43676 records). [2025-10-22T19:13:24.501977] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-22T19:13:24.502104] [INFO ] [MAIN ] Update Progress: 1038/2367 symbols completed. HOMB took 25.0s. Estimated remaining: 2h 50m 43s. Rate: 7.8 symbols/min [2025-10-22T19:13:24.503037] [INFO ] [REMOTE ] HMY: Full fetch complete (77131 records). [2025-10-22T19:13:24.503186] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-22T19:13:24.920005] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-22T19:13:24.920097] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-22T19:13:24.921063] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-22T19:13:24.921129] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-22T19:13:24.922631] [DEBUG] [LOCAL ] HMY: Trimmed 77131 records to 53166 (keeping 200 days of data) [2025-10-22T19:13:25.256803] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T19:13:25.287050] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-22T19:13:25.289058] [DEBUG] [LOCAL ] HMY: Primary data saved (53166 records). [2025-10-22T19:13:25.290131] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-22T19:13:25.290235] [INFO ] [MAIN ] Update Progress: 1039/2367 symbols completed. HMY took 41.2s. Estimated remaining: 2h 50m 26s. Rate: 7.8 symbols/min [2025-10-22T19:13:26.896636] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T19:13:26.907442] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-22T19:13:28.643526] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T19:13:28.655691] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-22T19:13:30.246018] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T19:13:30.254762] [INFO ] [REMOTE ] HOG: Full fetch complete (74290 records). [2025-10-22T19:13:30.254940] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-22T19:13:30.650563] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-22T19:13:30.650688] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-22T19:13:30.651606] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-22T19:13:30.651689] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-22T19:13:30.653213] [DEBUG] [LOCAL ] HOG: Trimmed 74290 records to 50639 (keeping 200 days of data) [2025-10-22T19:13:30.955205] [DEBUG] [LOCAL ] HOG: Primary data saved (50639 records). [2025-10-22T19:13:30.955345] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-22T19:13:30.955422] [INFO ] [MAIN ] Update Progress: 1040/2367 symbols completed. HOG took 33.8s. Estimated remaining: 2h 50m 16s. Rate: 7.8 symbols/min [2025-10-22T19:13:31.640624] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:13:31.704091] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:13:31.779441] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:13:31.777358] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:13:31.792323] [DEBUG] [LOCAL ] HOV: Loaded 13930 existing records from primary storage. [2025-10-22T19:13:31.792744] [INFO ] [MAIN ] HOV: Loaded 13930 existing records. [2025-10-22T19:13:32.021295] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:13:32.061353] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-22T19:13:32.077979] [DEBUG] [LOCAL ] HOUS: Loaded 45708 existing records from primary storage. [2025-10-22T19:13:32.079875] [INFO ] [MAIN ] HOUS: Loaded 45708 existing records. [2025-10-22T19:13:32.079672] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-22T19:13:32.080995] [DEBUG] [LOCAL ] HP: Loaded 51425 existing records from primary storage. [2025-10-22T19:13:32.093434] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-22T19:13:32.119434] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-22T19:13:32.104586] [INFO ] [MAIN ] HP: Loaded 51425 existing records. [2025-10-22T19:13:32.461682] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-22T19:13:32.582752] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-22T19:13:32.644604] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:13:32.714062] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-22T19:13:32.748876] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-22T19:13:32.856618] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-22T19:13:32.865269] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-22T19:13:32.899879] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:13:32.956970] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-22T19:13:32.988946] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-22T19:13:33.101697] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-22T19:13:33.176795] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-22T19:13:33.277593] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:13:33.308346] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:13:33.355555] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-22T19:13:33.350150] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-22T19:13:33.371183] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-22T19:13:33.420030] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-22T19:13:33.430538] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-22T19:13:34.067829] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:13:34.078627] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-22T19:13:34.273018] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:13:34.278747] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-22T19:13:34.377672] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:13:34.378122] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-22T19:13:34.429886] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T19:13:34.432850] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-22T19:13:35.167574] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T19:13:35.170959] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-22T19:13:35.483035] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T19:13:35.492182] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-22T19:13:35.519019] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T19:13:35.529153] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-22T19:13:35.969131] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-22T19:13:35.972061] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-22T19:13:36.220825] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T19:13:36.231301] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-22T19:13:36.635696] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-22T19:13:36.639037] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-22T19:13:36.927103] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T19:13:36.935116] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-22T19:13:37.075988] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T19:13:37.085807] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-22T19:13:37.510538] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-22T19:13:37.513286] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-22T19:13:38.044543] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T19:13:38.055219] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-22T19:13:38.114844] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-22T19:13:38.183788] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-22T19:13:38.517753] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-22T19:13:38.757299] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T19:13:39.317636] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-22T19:13:39.449036] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T19:13:40.108313] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T19:13:40.118820] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-22T19:13:40.917699] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-22T19:13:41.005727] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T19:13:41.060443] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T19:13:41.717671] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-22T19:13:42.519973] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-22T19:13:42.533500] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T19:13:42.575000] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T19:13:43.317742] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-22T19:13:44.117669] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-22T19:13:44.152459] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T19:13:44.851365] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:13:44.917686] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-22T19:13:45.114538] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T19:13:45.116784] [INFO ] [REMOTE ] HOV: Full fetch complete (18957 records). [2025-10-22T19:13:45.116852] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-22T19:13:45.489209] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-22T19:13:45.489284] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-22T19:13:45.489731] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-22T19:13:45.489796] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-22T19:13:45.490404] [DEBUG] [LOCAL ] HOV: Trimmed 18957 records to 13798 (keeping 200 days of data) [2025-10-22T19:13:45.572196] [DEBUG] [LOCAL ] HOV: Primary data saved (13798 records). [2025-10-22T19:13:45.572323] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-22T19:13:45.572563] [INFO ] [MAIN ] Update Progress: 1041/2367 symbols completed. HOV took 14.6s. Estimated remaining: 2h 50m 17s. Rate: 7.8 symbols/min [2025-10-22T19:13:45.739469] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-22T19:13:45.742789] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:13:45.754179] [DEBUG] [LOCAL ] HPF: Loaded 7532 existing records from primary storage. [2025-10-22T19:13:45.754447] [INFO ] [MAIN ] HPF: Loaded 7532 existing records. [2025-10-22T19:13:45.929785] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:13:45.930008] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-22T19:13:45.930055] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-22T19:13:45.930193] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-22T19:13:45.930229] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-22T19:13:46.285058] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:13:46.517626] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-22T19:13:47.282349] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-22T19:13:47.280506] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T19:13:47.317612] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-22T19:13:47.800850] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T19:13:48.117768] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-22T19:13:48.738441] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-22T19:13:48.917685] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-22T19:13:49.195538] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T19:13:49.717840] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-22T19:13:50.517695] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-22T19:13:50.895688] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-22T19:13:51.176124] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-22T19:13:51.317697] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-22T19:13:51.498993] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T19:13:52.117686] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-22T19:13:52.820491] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T19:13:52.917633] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-22T19:13:53.717808] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-22T19:13:53.769683] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T19:13:53.995453] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T19:13:54.517679] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-22T19:13:55.256305] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T19:13:55.317630] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-22T19:13:55.485322] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T19:13:56.042851] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-22T19:13:56.117624] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-22T19:13:56.917737] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-22T19:13:56.926213] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T19:13:57.717754] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-22T19:13:58.428588] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-22T19:13:58.517637] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-22T19:13:58.903713] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-22T19:13:59.317740] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-22T19:14:00.117664] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-22T19:14:00.434510] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-22T19:14:00.442526] [INFO ] [REMOTE ] HP: Full fetch complete (74108 records). [2025-10-22T19:14:00.442635] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-22T19:14:00.829321] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-22T19:14:00.829411] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-22T19:14:00.830312] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-22T19:14:00.830375] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-22T19:14:00.831753] [DEBUG] [LOCAL ] HP: Trimmed 74108 records to 51399 (keeping 200 days of data) [2025-10-22T19:14:00.919995] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-22T19:14:00.961085] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T19:14:01.148599] [DEBUG] [LOCAL ] HP: Primary data saved (51399 records). [2025-10-22T19:14:01.148754] [INFO ] [MAIN ] HP: Full history saved. [2025-10-22T19:14:01.148840] [INFO ] [MAIN ] Update Progress: 1042/2367 symbols completed. HP took 30.1s. Estimated remaining: 2h 50m 19s. Rate: 7.8 symbols/min [2025-10-22T19:14:01.360012] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:14:01.402529] [DEBUG] [LOCAL ] HPI: Loaded 10779 existing records from primary storage. [2025-10-22T19:14:01.402860] [INFO ] [MAIN ] HPI: Loaded 10779 existing records. [2025-10-22T19:14:01.410241] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-22T19:14:01.610081] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:14:01.610331] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-22T19:14:01.610382] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-22T19:14:01.610693] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-22T19:14:01.610753] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-22T19:14:01.720068] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-22T19:14:01.987879] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:14:02.517056] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-22T19:14:02.525565] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-22T19:14:02.550032] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-22T19:14:02.551776] [INFO ] [REMOTE ] HPF: Full fetch complete (10512 records). [2025-10-22T19:14:02.551880] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-22T19:14:02.928455] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-22T19:14:02.928540] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-22T19:14:02.928838] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-22T19:14:02.928921] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-22T19:14:02.929389] [DEBUG] [LOCAL ] HPF: Trimmed 10512 records to 7482 (keeping 200 days of data) [2025-10-22T19:14:02.975472] [DEBUG] [LOCAL ] HPF: Primary data saved (7482 records). [2025-10-22T19:14:02.975604] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-22T19:14:02.975705] [INFO ] [MAIN ] Update Progress: 1043/2367 symbols completed. HPF took 17.4s. Estimated remaining: 2h 50m 4s. Rate: 7.8 symbols/min [2025-10-22T19:14:03.153099] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:14:03.205143] [DEBUG] [LOCAL ] HPP: Loaded 51238 existing records from primary storage. [2025-10-22T19:14:03.205494] [INFO ] [MAIN ] HPP: Loaded 51238 existing records. [2025-10-22T19:14:03.322801] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-22T19:14:03.390457] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:14:03.390731] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-22T19:14:03.390792] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-22T19:14:03.391107] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-22T19:14:03.391163] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-22T19:14:03.753520] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:14:04.117749] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-22T19:14:04.917674] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-22T19:14:05.181068] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-22T19:14:05.717752] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-22T19:14:05.745740] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T19:14:05.779758] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-22T19:14:06.342110] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-22T19:14:06.517630] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-22T19:14:07.128428] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T19:14:07.317733] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-22T19:14:07.559114] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T19:14:07.568086] [INFO ] [REMOTE ] HPE: Full fetch complete (77876 records). [2025-10-22T19:14:07.568249] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-22T19:14:07.957506] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-22T19:14:07.957619] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-22T19:14:07.958573] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-22T19:14:07.958639] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-22T19:14:07.960043] [DEBUG] [LOCAL ] HPE: Trimmed 77876 records to 53697 (keeping 200 days of data) [2025-10-22T19:14:08.133616] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-22T19:14:08.286190] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-22T19:14:08.286316] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-22T19:14:08.286394] [INFO ] [MAIN ] Update Progress: 1044/2367 symbols completed. HPE took 37.3s. Estimated remaining: 2h 49m 53s. Rate: 7.8 symbols/min [2025-10-22T19:14:08.458786] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:14:08.505904] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-10-22T19:14:08.506230] [INFO ] [MAIN ] HPQ: Loaded 53669 existing records. [2025-10-22T19:14:08.681076] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:14:08.681268] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-22T19:14:08.681314] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-22T19:14:08.681497] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-22T19:14:08.681536] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-22T19:14:08.923481] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-22T19:14:08.971950] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-22T19:14:09.053837] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:14:09.080155] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T19:14:09.717739] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-22T19:14:10.517636] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-22T19:14:10.652347] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T19:14:11.042422] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-22T19:14:11.317634] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-22T19:14:11.627626] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T19:14:12.117770] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-22T19:14:12.716508] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T19:14:12.917626] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-22T19:14:13.717761] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-22T19:14:13.862749] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T19:14:14.517698] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-22T19:14:14.836132] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-22T19:14:14.845042] [INFO ] [REMOTE ] HOUS: Full fetch complete (64693 records). [2025-10-22T19:14:14.845171] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-22T19:14:15.133760] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T19:14:15.281400] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T19:14:15.279774] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-22T19:14:15.291608] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-22T19:14:15.292580] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-22T19:14:15.292706] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-22T19:14:15.293944] [DEBUG] [LOCAL ] HOUS: Trimmed 64693 records to 45734 (keeping 200 days of data) [2025-10-22T19:14:15.338764] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-22T19:14:15.553605] [DEBUG] [LOCAL ] HOUS: Primary data saved (45734 records). [2025-10-22T19:14:15.553771] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-22T19:14:15.553899] [INFO ] [MAIN ] Update Progress: 1045/2367 symbols completed. HOUS took 44.6s. Estimated remaining: 2h 49m 45s. Rate: 7.8 symbols/min [2025-10-22T19:14:15.717083] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:14:15.728541] [DEBUG] [LOCAL ] HPS: Loaded 10360 existing records from primary storage. [2025-10-22T19:14:15.728908] [INFO ] [MAIN ] HPS: Loaded 10360 existing records. [2025-10-22T19:14:15.899003] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:14:15.899239] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-22T19:14:15.899286] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-22T19:14:15.899463] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-22T19:14:15.899518] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-22T19:14:16.125820] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-22T19:14:16.247794] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:14:16.917626] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-22T19:14:17.041703] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T19:14:17.703414] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T19:14:17.717618] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-22T19:14:18.176327] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T19:14:18.274699] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-22T19:14:18.517620] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-22T19:14:19.033972] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-22T19:14:19.317676] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-22T19:14:20.117683] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-22T19:14:20.134142] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T19:14:20.917693] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-22T19:14:21.714617] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T19:14:21.717000] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T19:14:21.719777] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-22T19:14:22.512803] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-22T19:14:22.517605] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-22T19:14:23.317682] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-22T19:14:23.456801] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-22T19:14:24.064888] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-22T19:14:24.117758] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-22T19:14:24.917799] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-22T19:14:25.176696] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T19:14:25.717746] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-22T19:14:26.517672] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-22T19:14:26.609706] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T19:14:27.317691] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-22T19:14:27.653405] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T19:14:28.117691] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-22T19:14:28.755916] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (3.04 seconds). [2025-10-22T19:14:28.917619] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-22T19:14:28.960629] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T19:14:29.174777] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T19:14:29.717745] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-22T19:14:30.517761] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-22T19:14:30.726137] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T19:14:30.729542] [INFO ] [REMOTE ] HPI: Full fetch complete (13864 records). [2025-10-22T19:14:30.729748] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-22T19:14:31.217253] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-22T19:14:31.217429] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-22T19:14:31.217933] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-22T19:14:31.218110] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-22T19:14:31.218975] [DEBUG] [LOCAL ] HPI: Trimmed 13864 records to 10731 (keeping 200 days of data) [2025-10-22T19:14:31.288220] [DEBUG] [LOCAL ] HPI: Primary data saved (10731 records). [2025-10-22T19:14:31.310343] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-22T19:14:31.335449] [INFO ] [MAIN ] Update Progress: 1046/2367 symbols completed. HPI took 30.2s. Estimated remaining: 2h 49m 47s. Rate: 7.8 symbols/min [2025-10-22T19:14:31.331020] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-22T19:14:31.387441] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-22T19:14:31.544043] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:14:31.574116] [DEBUG] [LOCAL ] HQH: Loaded 25808 existing records from primary storage. [2025-10-22T19:14:31.574374] [INFO ] [MAIN ] HQH: Loaded 25808 existing records. [2025-10-22T19:14:31.761492] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:14:31.761746] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-22T19:14:31.761801] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-22T19:14:31.761997] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-22T19:14:31.762052] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-22T19:14:32.140979] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-22T19:14:32.144565] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:14:32.153683] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-22T19:14:32.366934] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T19:14:32.917694] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-22T19:14:33.717681] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-22T19:14:34.126424] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-22T19:14:34.201360] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T19:14:34.209678] [INFO ] [REMOTE ] HPP: Full fetch complete (73360 records). [2025-10-22T19:14:34.209803] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-22T19:14:34.522415] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-22T19:14:34.557219] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T19:14:34.619075] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-22T19:14:34.619155] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-22T19:14:34.620123] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-22T19:14:34.620186] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-22T19:14:34.621564] [DEBUG] [LOCAL ] HPP: Trimmed 73360 records to 51224 (keeping 200 days of data) [2025-10-22T19:14:34.897320] [DEBUG] [LOCAL ] HPP: Primary data saved (51224 records). [2025-10-22T19:14:34.897466] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-22T19:14:34.898050] [INFO ] [MAIN ] Update Progress: 1047/2367 symbols completed. HPP took 31.9s. Estimated remaining: 2h 49m 35s. Rate: 7.8 symbols/min [2025-10-22T19:14:35.064109] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:14:35.082411] [DEBUG] [LOCAL ] HQL: Loaded 16952 existing records from primary storage. [2025-10-22T19:14:35.082667] [INFO ] [MAIN ] HQL: Loaded 16952 existing records. [2025-10-22T19:14:35.257161] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:14:35.257414] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-22T19:14:35.257466] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-22T19:14:35.257682] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-22T19:14:35.257864] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-22T19:14:35.322963] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-22T19:14:35.603681] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:14:36.117622] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-22T19:14:36.203975] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T19:14:36.590229] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T19:14:36.592371] [INFO ] [REMOTE ] HPS: Full fetch complete (15108 records). [2025-10-22T19:14:36.592439] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-22T19:14:36.919158] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-22T19:14:36.957378] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-22T19:14:36.957497] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-22T19:14:36.957924] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-22T19:14:36.957985] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-22T19:14:36.958462] [DEBUG] [LOCAL ] HPS: Trimmed 15108 records to 10322 (keeping 200 days of data) [2025-10-22T19:14:37.021178] [DEBUG] [LOCAL ] HPS: Primary data saved (10322 records). [2025-10-22T19:14:37.021300] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-22T19:14:37.021376] [INFO ] [MAIN ] Update Progress: 1048/2367 symbols completed. HPS took 21.5s. Estimated remaining: 2h 49m 20s. Rate: 7.8 symbols/min [2025-10-22T19:14:37.186316] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:14:37.233418] [DEBUG] [LOCAL ] HR: Loaded 52114 existing records from primary storage. [2025-10-22T19:14:37.233763] [INFO ] [MAIN ] HR: Loaded 52114 existing records. [2025-10-22T19:14:37.410722] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:14:37.411000] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-22T19:14:37.411057] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-22T19:14:37.411265] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-22T19:14:37.411320] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-22T19:14:37.722916] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-22T19:14:37.789611] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:14:38.394315] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T19:14:38.517695] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-22T19:14:38.735961] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-22T19:14:38.849361] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T19:14:39.317744] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-22T19:14:40.122729] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-22T19:14:40.140450] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T19:14:40.449278] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T19:14:40.917633] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-22T19:14:41.306862] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T19:14:41.717748] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-22T19:14:42.024615] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T19:14:42.517668] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-22T19:14:42.927016] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-22T19:14:43.317678] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-22T19:14:44.117668] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-22T19:14:44.216748] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T19:14:44.612336] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T19:14:44.917706] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-22T19:14:44.936566] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T19:14:45.717639] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-22T19:14:46.519867] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-22T19:14:46.522820] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T19:14:47.317757] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-22T19:14:47.434293] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T19:14:47.655080] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T19:14:48.117680] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-22T19:14:48.249928] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T19:14:48.258860] [INFO ] [REMOTE ] HPQ: Full fetch complete (77842 records). [2025-10-22T19:14:48.259000] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-22T19:14:48.651447] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-22T19:14:48.651526] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-22T19:14:48.652536] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-22T19:14:48.652600] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-22T19:14:48.654121] [DEBUG] [LOCAL ] HPQ: Trimmed 77842 records to 53669 (keeping 200 days of data) [2025-10-22T19:14:48.932047] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-22T19:14:48.980153] [DEBUG] [LOCAL ] HPQ: Primary data saved (53669 records). [2025-10-22T19:14:48.980264] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-22T19:14:48.980341] [INFO ] [MAIN ] Update Progress: 1049/2367 symbols completed. HPQ took 40.7s. Estimated remaining: 2h 49m 17s. Rate: 7.8 symbols/min [2025-10-22T19:14:49.148403] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:14:49.188102] [DEBUG] [LOCAL ] HRB: Loaded 48267 existing records from primary storage. [2025-10-22T19:14:49.188421] [INFO ] [MAIN ] HRB: Loaded 48267 existing records. [2025-10-22T19:14:49.369727] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:14:49.370003] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-22T19:14:49.370062] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-22T19:14:49.370494] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-22T19:14:49.370550] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-22T19:14:49.736064] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-22T19:14:49.735941] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:14:49.988870] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T19:14:50.133026] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T19:14:50.517675] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-22T19:14:50.778674] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-22T19:14:51.317704] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-22T19:14:51.701673] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T19:14:52.117688] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-22T19:14:52.917629] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-22T19:14:53.105806] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T19:14:53.147777] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T19:14:53.717745] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-22T19:14:54.517674] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-22T19:14:54.689705] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T19:14:54.762514] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T19:14:55.317769] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-22T19:14:56.117637] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-22T19:14:56.283354] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T19:14:56.440140] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-22T19:14:56.917700] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-22T19:14:57.281081] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T19:14:57.717750] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-22T19:14:58.517738] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-22T19:14:58.585508] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T19:14:58.795199] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T19:14:59.317692] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-22T19:15:00.082153] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T19:15:00.117666] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-22T19:15:00.659436] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T19:15:00.663749] [INFO ] [REMOTE ] HQL: Full fetch complete (25304 records). [2025-10-22T19:15:00.663842] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-22T19:15:00.922801] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-22T19:15:01.034703] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-22T19:15:01.034797] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-22T19:15:01.035331] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-22T19:15:01.035372] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-22T19:15:01.036170] [DEBUG] [LOCAL ] HQL: Trimmed 25304 records to 16898 (keeping 200 days of data) [2025-10-22T19:15:01.139065] [DEBUG] [LOCAL ] HQL: Primary data saved (16898 records). [2025-10-22T19:15:01.139227] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-22T19:15:01.139310] [INFO ] [MAIN ] Update Progress: 1050/2367 symbols completed. HQL took 26.2s. Estimated remaining: 2h 49m 15s. Rate: 7.8 symbols/min [2025-10-22T19:15:01.312704] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:15:01.349551] [DEBUG] [LOCAL ] HRI: Loaded 32283 existing records from primary storage. [2025-10-22T19:15:01.349980] [INFO ] [MAIN ] HRI: Loaded 32283 existing records. [2025-10-22T19:15:01.623829] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:15:01.624234] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-22T19:15:01.624306] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-22T19:15:01.624689] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-22T19:15:01.624760] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-22T19:15:01.718688] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-22T19:15:02.042772] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:15:02.075140] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T19:15:02.517702] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-22T19:15:03.015464] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-22T19:15:03.163936] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T19:15:03.168912] [INFO ] [REMOTE ] HQH: Full fetch complete (36985 records). [2025-10-22T19:15:03.169016] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-22T19:15:03.343511] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-22T19:15:03.545961] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-22T19:15:03.546064] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-22T19:15:03.546765] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-22T19:15:03.546828] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-22T19:15:03.547638] [DEBUG] [LOCAL ] HQH: Trimmed 36985 records to 25772 (keeping 200 days of data) [2025-10-22T19:15:03.699562] [DEBUG] [LOCAL ] HQH: Primary data saved (25772 records). [2025-10-22T19:15:03.699717] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-22T19:15:03.699840] [INFO ] [MAIN ] Update Progress: 1051/2367 symbols completed. HQH took 32.4s. Estimated remaining: 2h 49m 1s. Rate: 7.8 symbols/min [2025-10-22T19:15:03.871535] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:15:03.886962] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T19:15:03.935625] [DEBUG] [LOCAL ] HRL: Loaded 53126 existing records from primary storage. [2025-10-22T19:15:03.935988] [INFO ] [MAIN ] HRL: Loaded 53126 existing records. [2025-10-22T19:15:04.111672] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:15:04.111911] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-22T19:15:04.111963] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-22T19:15:04.112304] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-22T19:15:04.112360] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-22T19:15:04.123407] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-22T19:15:04.461610] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:15:04.917633] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-22T19:15:05.196858] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T19:15:05.717690] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-22T19:15:06.046399] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T19:15:06.517774] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-22T19:15:06.754593] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T19:15:07.288554] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T19:15:07.317635] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-22T19:15:08.109684] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T19:15:08.120048] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-22T19:15:08.917665] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-22T19:15:09.000080] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T19:15:09.669175] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T19:15:09.717639] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-22T19:15:10.517750] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-22T19:15:11.317758] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-22T19:15:11.612869] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-22T19:15:11.622355] [INFO ] [REMOTE ] HR: Full fetch complete (75073 records). [2025-10-22T19:15:11.622510] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-22T19:15:12.043927] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-22T19:15:12.044196] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-22T19:15:12.045214] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-22T19:15:12.045297] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-22T19:15:12.068451] [DEBUG] [LOCAL ] HR: Trimmed 75073 records to 52108 (keeping 200 days of data) [2025-10-22T19:15:12.069956] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-22T19:15:12.139043] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-22T19:15:12.386628] [DEBUG] [LOCAL ] HR: Primary data saved (52108 records). [2025-10-22T19:15:12.386790] [INFO ] [MAIN ] HR: Full history saved. [2025-10-22T19:15:12.386867] [INFO ] [MAIN ] Update Progress: 1052/2367 symbols completed. HR took 35.4s. Estimated remaining: 2h 48m 55s. Rate: 7.8 symbols/min [2025-10-22T19:15:12.554283] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:15:12.586246] [DEBUG] [LOCAL ] HRTG: Loaded 34543 existing records from primary storage. [2025-10-22T19:15:12.586519] [INFO ] [MAIN ] HRTG: Loaded 34543 existing records. [2025-10-22T19:15:12.762685] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:15:12.763041] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-22T19:15:12.763226] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-22T19:15:12.763431] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-22T19:15:12.763471] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-22T19:15:13.133673] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:15:13.134284] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-22T19:15:13.196532] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-10-22T19:15:13.208701] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T19:15:13.717742] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-22T19:15:13.843110] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T19:15:14.326850] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-22T19:15:14.517695] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-22T19:15:15.317759] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-22T19:15:15.658210] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T19:15:15.702053] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T19:15:16.117685] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-22T19:15:16.917735] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-22T19:15:17.392249] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-22T19:15:17.717753] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-22T19:15:18.072162] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T19:15:18.297125] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T19:15:18.517664] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-22T19:15:18.772228] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T19:15:19.317705] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-22T19:15:20.124591] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-22T19:15:20.129770] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T19:15:20.917735] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-22T19:15:21.313614] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-22T19:15:21.685891] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T19:15:21.717614] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-22T19:15:22.517740] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-22T19:15:22.795809] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T19:15:23.108163] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T19:15:23.317776] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-22T19:15:24.117692] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-22T19:15:24.255418] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T19:15:24.263379] [INFO ] [REMOTE ] HRB: Full fetch complete (69974 records). [2025-10-22T19:15:24.263547] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-22T19:15:24.671536] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-22T19:15:24.671671] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-22T19:15:24.672619] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-22T19:15:24.672729] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-22T19:15:24.674341] [DEBUG] [LOCAL ] HRB: Trimmed 69974 records to 48219 (keeping 200 days of data) [2025-10-22T19:15:24.783837] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T19:15:24.917903] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-22T19:15:24.996350] [DEBUG] [LOCAL ] HRB: Primary data saved (48219 records). [2025-10-22T19:15:24.996476] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-22T19:15:24.996553] [INFO ] [MAIN ] Update Progress: 1053/2367 symbols completed. HRB took 36.0s. Estimated remaining: 2h 48m 53s. Rate: 7.8 symbols/min [2025-10-22T19:15:25.161075] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:15:25.205756] [DEBUG] [LOCAL ] HSBC: Loaded 50992 existing records from primary storage. [2025-10-22T19:15:25.206042] [INFO ] [MAIN ] HSBC: Loaded 50992 existing records. [2025-10-22T19:15:25.392146] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:15:25.392518] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-22T19:15:25.392631] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-22T19:15:25.392974] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-22T19:15:25.393110] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-22T19:15:25.530173] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T19:15:25.722767] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-22T19:15:25.778675] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:15:26.517769] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-22T19:15:27.034400] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-22T19:15:27.317746] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-22T19:15:27.430547] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T19:15:27.511070] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T19:15:28.117676] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-22T19:15:28.917757] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-22T19:15:29.240169] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-22T19:15:29.644407] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T19:15:29.717681] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-22T19:15:30.517637] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-22T19:15:30.868591] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T19:15:30.901796] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-22T19:15:31.317740] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-22T19:15:32.068431] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T19:15:32.117620] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-22T19:15:32.883674] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T19:15:32.889549] [INFO ] [REMOTE ] HRTG: Full fetch complete (44429 records). [2025-10-22T19:15:32.889667] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-22T19:15:32.922833] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-22T19:15:33.269916] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-22T19:15:33.269989] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-22T19:15:33.270627] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-22T19:15:33.270704] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-22T19:15:33.271628] [DEBUG] [LOCAL ] HRTG: Trimmed 44429 records to 34520 (keeping 200 days of data) [2025-10-22T19:15:33.464740] [DEBUG] [LOCAL ] HRTG: Primary data saved (34520 records). [2025-10-22T19:15:33.464858] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-22T19:15:33.464934] [INFO ] [MAIN ] Update Progress: 1054/2367 symbols completed. HRTG took 21.1s. Estimated remaining: 2h 48m 46s. Rate: 7.8 symbols/min [2025-10-22T19:15:33.633116] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:15:33.647415] [DEBUG] [LOCAL ] HSHP: Loaded 14708 existing records from primary storage. [2025-10-22T19:15:33.647609] [INFO ] [MAIN ] HSHP: Loaded 14708 existing records. [2025-10-22T19:15:33.722011] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-22T19:15:33.824277] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:15:33.824590] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-22T19:15:33.824673] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-22T19:15:33.824842] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-22T19:15:33.824882] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-22T19:15:34.208089] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:15:34.210011] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-22T19:15:34.517626] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-22T19:15:34.898772] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T19:15:34.924704] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T19:15:34.929703] [INFO ] [REMOTE ] HRI: Full fetch complete (46713 records). [2025-10-22T19:15:34.929798] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-22T19:15:35.308220] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-22T19:15:35.308298] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-22T19:15:35.309008] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-22T19:15:35.309069] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-22T19:15:35.310041] [DEBUG] [LOCAL ] HRI: Trimmed 46713 records to 32142 (keeping 200 days of data) [2025-10-22T19:15:35.367601] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-22T19:15:35.512088] [DEBUG] [LOCAL ] HRI: Primary data saved (32142 records). [2025-10-22T19:15:35.512251] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-22T19:15:35.512365] [INFO ] [MAIN ] Update Progress: 1055/2367 symbols completed. HRI took 34.4s. Estimated remaining: 2h 48m 32s. Rate: 7.8 symbols/min [2025-10-22T19:15:35.683335] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:15:35.693361] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T19:15:35.740436] [DEBUG] [LOCAL ] HSY: Loaded 50427 existing records from primary storage. [2025-10-22T19:15:35.740764] [INFO ] [MAIN ] HSY: Loaded 50427 existing records. [2025-10-22T19:15:35.915947] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:15:35.916146] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-22T19:15:35.916191] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-22T19:15:35.916468] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-22T19:15:35.916505] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-22T19:15:36.128625] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-22T19:15:36.314239] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:15:36.917674] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-22T19:15:37.593073] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-22T19:15:37.717702] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-22T19:15:37.891400] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T19:15:38.393493] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-22T19:15:38.517621] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-22T19:15:39.317741] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-22T19:15:39.941464] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-22T19:15:39.950431] [INFO ] [REMOTE ] HRL: Full fetch complete (77035 records). [2025-10-22T19:15:39.950583] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-22T19:15:40.139046] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-22T19:15:40.246371] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-22T19:15:40.380830] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-22T19:15:40.380921] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-22T19:15:40.381848] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-22T19:15:40.381911] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-22T19:15:40.383386] [DEBUG] [LOCAL ] HRL: Trimmed 77035 records to 53125 (keeping 200 days of data) [2025-10-22T19:15:40.705208] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-22T19:15:40.766951] [DEBUG] [LOCAL ] HRL: Primary data saved (53125 records). [2025-10-22T19:15:40.767130] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-22T19:15:40.767219] [INFO ] [MAIN ] Update Progress: 1056/2367 symbols completed. HRL took 37.1s. Estimated remaining: 2h 48m 21s. Rate: 7.8 symbols/min [2025-10-22T19:15:40.920793] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-22T19:15:40.940206] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:15:40.941332] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-22T19:15:40.941391] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-22T19:15:40.941758] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-22T19:15:40.941822] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-22T19:15:40.941882] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-22T19:15:40.941918] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-22T19:15:41.290241] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:15:41.717628] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-22T19:15:42.039599] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T19:15:42.086553] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T19:15:42.517749] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-10-22T19:15:42.723768] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:15:42.724075] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-10-22T19:15:42.724180] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:15:42.724270] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-22T19:15:42.724354] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:15:42.724450] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-22T19:15:42.724532] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-22T19:15:42.724570] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-22T19:15:42.724610] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-22T19:15:42.724683] [INFO ] [MAIN ] Update Progress: 1057/2367 symbols completed. HTB took 2.0s. Estimated remaining: 2h 48m 6s. Rate: 7.8 symbols/min [2025-10-22T19:15:42.906940] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:15:42.928308] [DEBUG] [LOCAL ] HTD: Loaded 14308 existing records from primary storage. [2025-10-22T19:15:42.928669] [INFO ] [MAIN ] HTD: Loaded 14308 existing records. [2025-10-22T19:15:43.134985] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:15:43.135219] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-22T19:15:43.135267] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-22T19:15:43.135497] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-22T19:15:43.135552] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-22T19:15:43.319873] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-22T19:15:43.505159] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:15:43.596316] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T19:15:44.117702] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-22T19:15:44.180131] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T19:15:44.917738] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-22T19:15:44.990895] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-22T19:15:45.717750] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-22T19:15:46.517667] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-22T19:15:46.959281] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-22T19:15:47.285725] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-22T19:15:47.317703] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-22T19:15:47.704425] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-22T19:15:48.117701] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-22T19:15:48.218571] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-22T19:15:48.917675] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-22T19:15:49.717757] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-22T19:15:49.745874] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-22T19:15:49.947385] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T19:15:50.517639] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-22T19:15:50.713041] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T19:15:51.317752] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-22T19:15:52.117615] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-22T19:15:52.310940] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T19:15:52.917842] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-22T19:15:53.024473] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-22T19:15:53.233639] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-22T19:15:53.717681] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-22T19:15:53.890622] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-22T19:15:54.517630] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-22T19:15:54.607669] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-22T19:15:55.317620] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-22T19:15:55.333679] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-22T19:15:56.117756] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-22T19:15:56.917636] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-22T19:15:57.080747] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-22T19:15:57.120426] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T19:15:57.717673] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-22T19:15:58.517627] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-22T19:15:58.733064] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T19:15:58.866502] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T19:15:59.317742] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-22T19:16:00.117628] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-22T19:16:00.511374] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T19:16:00.917621] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-22T19:16:01.202875] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T19:16:01.205634] [INFO ] [REMOTE ] HSHP: Full fetch complete (23143 records). [2025-10-22T19:16:01.205740] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-22T19:16:01.592626] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-22T19:16:01.592835] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-22T19:16:01.593435] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-22T19:16:01.593483] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-22T19:16:01.594267] [DEBUG] [LOCAL ] HSHP: Trimmed 23143 records to 14457 (keeping 200 days of data) [2025-10-22T19:16:01.694623] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-10-22T19:16:01.720831] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-22T19:16:01.731805] [DEBUG] [LOCAL ] HSHP: Primary data saved (14457 records). [2025-10-22T19:16:01.731949] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-22T19:16:01.732050] [INFO ] [MAIN ] Update Progress: 1058/2367 symbols completed. HSHP took 28.3s. Estimated remaining: 2h 48m 12s. Rate: 7.8 symbols/min [2025-10-22T19:16:01.928122] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:01.928288] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-22T19:16:01.928324] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-22T19:16:01.928439] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-22T19:16:01.928480] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-22T19:16:01.928521] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-22T19:16:01.928552] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-22T19:16:02.274557] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:02.507626] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-22T19:16:02.517607] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-22T19:16:02.744071] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T19:16:02.752507] [INFO ] [REMOTE ] HSBC: Full fetch complete (74209 records). [2025-10-22T19:16:02.752630] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-22T19:16:03.145663] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-22T19:16:03.145814] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-22T19:16:03.146775] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-22T19:16:03.146846] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-22T19:16:03.148230] [DEBUG] [LOCAL ] HSBC: Trimmed 74209 records to 50990 (keeping 200 days of data) [2025-10-22T19:16:03.329742] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-22T19:16:03.461066] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-22T19:16:03.480567] [DEBUG] [LOCAL ] HSBC: Primary data saved (50990 records). [2025-10-22T19:16:03.480729] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-22T19:16:03.480823] [INFO ] [MAIN ] Update Progress: 1059/2367 symbols completed. HSBC took 38.5s. Estimated remaining: 2h 47m 57s. Rate: 7.8 symbols/min [2025-10-22T19:16:03.649492] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:03.692248] [DEBUG] [LOCAL ] HTGC: Loaded 47716 existing records from primary storage. [2025-10-22T19:16:03.692529] [INFO ] [MAIN ] HTGC: Loaded 47716 existing records. [2025-10-22T19:16:03.870037] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:16:03.870281] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-22T19:16:03.870336] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-22T19:16:03.870587] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-22T19:16:03.870670] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-22T19:16:04.122759] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-22T19:16:04.225728] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:04.917708] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-22T19:16:05.190564] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T19:16:05.193830] [INFO ] [REMOTE ] HTD: Full fetch complete (19643 records). [2025-10-22T19:16:05.193909] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-22T19:16:05.372728] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-22T19:16:05.592137] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-22T19:16:05.630469] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-22T19:16:05.630890] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-22T19:16:05.631440] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-22T19:16:05.631694] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-22T19:16:05.632723] [DEBUG] [LOCAL ] HTD: Trimmed 19643 records to 14245 (keeping 200 days of data) [2025-10-22T19:16:05.719142] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-22T19:16:05.719316] [DEBUG] [LOCAL ] HTD: Primary data saved (14245 records). [2025-10-22T19:16:05.719610] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-22T19:16:05.719755] [INFO ] [MAIN ] Update Progress: 1060/2367 symbols completed. HTD took 23.0s. Estimated remaining: 2h 47m 43s. Rate: 7.8 symbols/min [2025-10-22T19:16:05.901718] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:05.931837] [DEBUG] [LOCAL ] HTH: Loaded 32547 existing records from primary storage. [2025-10-22T19:16:05.932095] [INFO ] [MAIN ] HTH: Loaded 32547 existing records. [2025-10-22T19:16:06.112615] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:16:06.112896] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-22T19:16:06.112957] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-22T19:16:06.113164] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-22T19:16:06.113230] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-22T19:16:06.461011] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:06.517621] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-22T19:16:07.317630] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-22T19:16:07.584403] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T19:16:07.649839] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-22T19:16:08.117759] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-22T19:16:08.917703] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-22T19:16:08.991896] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T19:16:09.299562] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-22T19:16:09.620910] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T19:16:09.717631] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-22T19:16:10.517676] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-22T19:16:10.993921] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T19:16:11.317665] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-22T19:16:12.033313] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T19:16:12.117674] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-22T19:16:12.868478] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T19:16:12.917665] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-22T19:16:13.007969] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-22T19:16:13.016040] [INFO ] [REMOTE ] HSY: Full fetch complete (73637 records). [2025-10-22T19:16:13.016162] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-22T19:16:13.397836] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-22T19:16:13.397927] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-22T19:16:13.398826] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-22T19:16:13.398889] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-22T19:16:13.400321] [DEBUG] [LOCAL ] HSY: Trimmed 73637 records to 50376 (keeping 200 days of data) [2025-10-22T19:16:13.706477] [DEBUG] [LOCAL ] HSY: Primary data saved (50376 records). [2025-10-22T19:16:13.706629] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-22T19:16:13.707154] [INFO ] [MAIN ] Update Progress: 1061/2367 symbols completed. HSY took 38.2s. Estimated remaining: 2h 47m 35s. Rate: 7.8 symbols/min [2025-10-22T19:16:13.727739] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-22T19:16:13.877148] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:13.911686] [DEBUG] [LOCAL ] HUBB: Loaded 36142 existing records from primary storage. [2025-10-22T19:16:13.911971] [INFO ] [MAIN ] HUBB: Loaded 36142 existing records. [2025-10-22T19:16:14.088195] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:16:14.088466] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-22T19:16:14.088520] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-22T19:16:14.088909] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-22T19:16:14.088964] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-22T19:16:14.442630] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T19:16:14.478050] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:14.517615] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-22T19:16:15.323782] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-22T19:16:15.345811] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T19:16:15.723938] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-22T19:16:16.001798] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T19:16:16.117622] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-22T19:16:16.917737] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-22T19:16:17.717758] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-22T19:16:17.847079] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T19:16:18.387430] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T19:16:18.517702] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-22T19:16:18.972050] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T19:16:19.317634] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-22T19:16:20.117631] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-22T19:16:20.312740] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T19:16:20.917621] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-22T19:16:21.022358] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T19:16:21.354272] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T19:16:21.401696] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-22T19:16:21.717702] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-22T19:16:22.517667] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-22T19:16:22.854439] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-22T19:16:22.882692] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-22T19:16:23.317638] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-22T19:16:24.117685] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-22T19:16:24.690293] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T19:16:24.917681] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-22T19:16:25.235797] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-22T19:16:25.637276] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T19:16:25.717627] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-22T19:16:26.517829] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-22T19:16:27.303107] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T19:16:27.317617] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-22T19:16:27.616247] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T19:16:28.117672] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-22T19:16:28.358567] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-22T19:16:28.917666] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-22T19:16:29.143740] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T19:16:29.717680] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-22T19:16:30.135542] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-22T19:16:30.140773] [INFO ] [REMOTE ] HTH: Full fetch complete (46858 records). [2025-10-22T19:16:30.140878] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-22T19:16:30.511341] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-22T19:16:30.511420] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-22T19:16:30.512133] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-22T19:16:30.512195] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-22T19:16:30.513296] [DEBUG] [LOCAL ] HTH: Trimmed 46858 records to 32437 (keeping 200 days of data) [2025-10-22T19:16:30.564609] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-22T19:16:30.704323] [DEBUG] [LOCAL ] HTH: Primary data saved (32437 records). [2025-10-22T19:16:30.704441] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-22T19:16:30.704515] [INFO ] [MAIN ] Update Progress: 1062/2367 symbols completed. HTH took 25.0s. Estimated remaining: 2h 47m 39s. Rate: 7.8 symbols/min [2025-10-22T19:16:30.874220] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:30.908470] [DEBUG] [LOCAL ] HUBS: Loaded 40052 existing records from primary storage. [2025-10-22T19:16:30.908915] [INFO ] [MAIN ] HUBS: Loaded 40052 existing records. [2025-10-22T19:16:31.082831] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:16:31.083144] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-22T19:16:31.083235] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-22T19:16:31.083749] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-22T19:16:31.083807] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-22T19:16:31.243153] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T19:16:31.320719] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-22T19:16:31.476410] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:32.117668] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-22T19:16:32.339444] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T19:16:32.352238] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-22T19:16:32.832924] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T19:16:32.917697] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-22T19:16:33.717738] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-22T19:16:34.065443] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-22T19:16:34.387387] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T19:16:34.517697] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-22T19:16:35.015383] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-22T19:16:35.016117] [INFO ] [REMOTE ] HTFC: Full fetch complete (823 records). [2025-10-22T19:16:35.016186] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-22T19:16:35.196335] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-22T19:16:35.196565] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:16:35.196674] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:16:35.196772] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-22T19:16:35.196854] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-22T19:16:35.196895] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-22T19:16:35.196936] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-22T19:16:35.196992] [INFO ] [MAIN ] Update Progress: 1063/2367 symbols completed. HTFC took 33.5s. Estimated remaining: 2h 47m 28s. Rate: 7.8 symbols/min [2025-10-22T19:16:35.322752] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-22T19:16:35.368839] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:35.412747] [DEBUG] [LOCAL ] HUM: Loaded 49322 existing records from primary storage. [2025-10-22T19:16:35.413069] [INFO ] [MAIN ] HUM: Loaded 49322 existing records. [2025-10-22T19:16:35.595826] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:16:35.596038] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-22T19:16:35.596085] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-22T19:16:35.596272] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-22T19:16:35.596310] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-22T19:16:35.945604] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:36.117684] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-22T19:16:36.917627] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-22T19:16:37.076336] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T19:16:37.478764] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T19:16:37.717638] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-22T19:16:37.975561] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T19:16:38.517682] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-22T19:16:39.317699] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-22T19:16:39.517622] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T19:16:40.110173] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T19:16:40.119171] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-22T19:16:40.739714] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T19:16:40.917675] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-22T19:16:41.717670] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-22T19:16:41.825227] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T19:16:42.517694] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-22T19:16:42.875076] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T19:16:42.883533] [INFO ] [REMOTE ] HTGC: Full fetch complete (68900 records). [2025-10-22T19:16:42.883713] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-22T19:16:43.277701] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T19:16:43.317917] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-22T19:16:43.322771] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-22T19:16:43.323123] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-22T19:16:43.324108] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-22T19:16:43.324278] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-22T19:16:43.325533] [DEBUG] [LOCAL ] HTGC: Trimmed 68900 records to 47694 (keeping 200 days of data) [2025-10-22T19:16:43.611732] [DEBUG] [LOCAL ] HTGC: Primary data saved (47694 records). [2025-10-22T19:16:43.611865] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-22T19:16:43.611953] [INFO ] [MAIN ] Update Progress: 1064/2367 symbols completed. HTGC took 40.1s. Estimated remaining: 2h 47m 21s. Rate: 7.8 symbols/min [2025-10-22T19:16:43.793519] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:43.845844] [DEBUG] [LOCAL ] HUN: Loaded 53211 existing records from primary storage. [2025-10-22T19:16:43.846177] [INFO ] [MAIN ] HUN: Loaded 53211 existing records. [2025-10-22T19:16:44.044085] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:16:44.044433] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-22T19:16:44.044553] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-22T19:16:44.044948] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-22T19:16:44.045010] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-22T19:16:44.131708] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-22T19:16:44.452680] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:44.456043] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T19:16:44.811328] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T19:16:44.817201] [INFO ] [REMOTE ] HUBB: Full fetch complete (54320 records). [2025-10-22T19:16:44.817322] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-22T19:16:44.920888] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-22T19:16:45.220978] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-22T19:16:45.221054] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-22T19:16:45.221813] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-22T19:16:45.221877] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-22T19:16:45.222984] [DEBUG] [LOCAL ] HUBB: Trimmed 54320 records to 36083 (keeping 200 days of data) [2025-10-22T19:16:45.448974] [DEBUG] [LOCAL ] HUBB: Primary data saved (36083 records). [2025-10-22T19:16:45.449114] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-22T19:16:45.449615] [INFO ] [MAIN ] Update Progress: 1065/2367 symbols completed. HUBB took 31.7s. Estimated remaining: 2h 47m 6s. Rate: 7.8 symbols/min [2025-10-22T19:16:45.618467] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:45.658747] [DEBUG] [LOCAL ] HUYA: Loaded 43629 existing records from primary storage. [2025-10-22T19:16:45.659041] [INFO ] [MAIN ] HUYA: Loaded 43629 existing records. [2025-10-22T19:16:45.723710] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-22T19:16:45.843987] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:16:45.844477] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-22T19:16:45.844560] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-22T19:16:45.844922] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-22T19:16:45.844988] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-22T19:16:46.173587] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-22T19:16:46.275971] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:46.517637] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-22T19:16:46.873713] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T19:16:47.317699] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-22T19:16:47.535872] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T19:16:48.050542] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:16:48.117677] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-22T19:16:48.917630] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-22T19:16:49.106103] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T19:16:49.480802] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T19:16:49.717695] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-22T19:16:50.222143] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-22T19:16:50.517700] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-22T19:16:51.182209] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T19:16:51.317674] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-22T19:16:51.674146] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T19:16:52.117689] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-22T19:16:52.728560] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T19:16:52.917703] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-22T19:16:53.727690] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-22T19:16:53.730143] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T19:16:54.200520] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T19:16:54.517768] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-22T19:16:55.317695] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-22T19:16:55.478545] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T19:16:55.958484] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T19:16:55.966494] [INFO ] [REMOTE ] HUBS: Full fetch complete (57063 records). [2025-10-22T19:16:55.966727] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-22T19:16:56.124000] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-22T19:16:56.390745] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-22T19:16:56.390893] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-22T19:16:56.392104] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-22T19:16:56.392202] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-22T19:16:56.394115] [DEBUG] [LOCAL ] HUBS: Trimmed 57063 records to 39936 (keeping 200 days of data) [2025-10-22T19:16:56.659514] [DEBUG] [LOCAL ] HUBS: Primary data saved (39936 records). [2025-10-22T19:16:56.659777] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-22T19:16:56.659895] [INFO ] [MAIN ] Update Progress: 1066/2367 symbols completed. HUBS took 26.0s. Estimated remaining: 2h 47m 2s. Rate: 7.8 symbols/min [2025-10-22T19:16:56.843786] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:16:56.863874] [DEBUG] [LOCAL ] HVT: Loaded 14899 existing records from primary storage. [2025-10-22T19:16:56.864260] [INFO ] [MAIN ] HVT: Loaded 14899 existing records. [2025-10-22T19:16:56.935366] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-22T19:16:57.061510] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:16:57.062019] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-22T19:16:57.062145] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-22T19:16:57.062439] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-22T19:16:57.062502] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-22T19:16:57.399889] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-22T19:16:57.492348] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:16:57.717708] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-22T19:16:57.871489] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T19:16:58.383852] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T19:16:58.517700] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-22T19:16:59.317666] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-22T19:16:59.469701] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T19:17:00.128474] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-22T19:17:00.134897] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T19:17:00.732226] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T19:17:00.917678] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-22T19:17:01.178733] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T19:17:01.717785] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-22T19:17:02.517755] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-22T19:17:02.641896] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T19:17:02.679880] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-22T19:17:03.317771] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-22T19:17:04.117688] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-22T19:17:04.424748] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-22T19:17:04.809957] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T19:17:04.917636] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-22T19:17:05.190825] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T19:17:05.717685] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-22T19:17:06.278285] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T19:17:06.517698] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-22T19:17:06.778957] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T19:17:07.318391] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-22T19:17:08.097100] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T19:17:08.117612] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-22T19:17:08.917690] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-22T19:17:09.073625] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T19:17:09.717749] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-22T19:17:09.932998] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T19:17:09.955146] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-22T19:17:10.517699] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-22T19:17:11.324156] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-22T19:17:11.345837] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T19:17:12.122912] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-22T19:17:12.137473] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T19:17:12.917628] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-22T19:17:13.028304] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T19:17:13.178039] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T19:17:13.186460] [INFO ] [REMOTE ] HUM: Full fetch complete (71165 records). [2025-10-22T19:17:13.186622] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-22T19:17:13.576245] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-22T19:17:13.576342] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-22T19:17:13.577345] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-22T19:17:13.577414] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-22T19:17:13.579075] [DEBUG] [LOCAL ] HUM: Trimmed 71165 records to 49274 (keeping 200 days of data) [2025-10-22T19:17:13.756134] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-22T19:17:13.886284] [DEBUG] [LOCAL ] HUM: Primary data saved (49274 records). [2025-10-22T19:17:13.886445] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-22T19:17:13.886557] [INFO ] [MAIN ] Update Progress: 1067/2367 symbols completed. HUM took 38.7s. Estimated remaining: 2h 47m 6s. Rate: 7.8 symbols/min [2025-10-22T19:17:14.056830] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:17:14.106497] [DEBUG] [LOCAL ] HWM: Loaded 52705 existing records from primary storage. [2025-10-22T19:17:14.106848] [INFO ] [MAIN ] HWM: Loaded 52705 existing records. [2025-10-22T19:17:14.281886] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:17:14.282082] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-22T19:17:14.282127] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-22T19:17:14.282313] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-22T19:17:14.282350] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-22T19:17:14.525394] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-22T19:17:14.673884] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T19:17:14.679231] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:17:15.317692] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-22T19:17:15.553915] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T19:17:15.572463] [INFO ] [REMOTE ] HUN: Full fetch complete (76999 records). [2025-10-22T19:17:15.573692] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-22T19:17:15.573251] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-22T19:17:15.964305] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-22T19:17:15.964383] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-22T19:17:15.965307] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-22T19:17:15.965368] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-22T19:17:15.966790] [DEBUG] [LOCAL ] HUN: Trimmed 76999 records to 53210 (keeping 200 days of data) [2025-10-22T19:17:16.136789] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-22T19:17:16.284556] [DEBUG] [LOCAL ] HUN: Primary data saved (53210 records). [2025-10-22T19:17:16.284728] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-22T19:17:16.284836] [INFO ] [MAIN ] Update Progress: 1068/2367 symbols completed. HUN took 32.7s. Estimated remaining: 2h 46m 52s. Rate: 7.8 symbols/min [2025-10-22T19:17:16.458417] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:17:16.499719] [DEBUG] [LOCAL ] HXL: Loaded 45797 existing records from primary storage. [2025-10-22T19:17:16.500008] [INFO ] [MAIN ] HXL: Loaded 45797 existing records. [2025-10-22T19:17:16.681113] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:17:16.681534] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-22T19:17:16.681749] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-22T19:17:16.681991] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-22T19:17:16.682041] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-22T19:17:16.931234] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-22T19:17:17.053745] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T19:17:17.092877] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:17:17.717631] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-22T19:17:17.910107] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T19:17:17.928854] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T19:17:18.517676] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-22T19:17:19.047056] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T19:17:19.317674] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-22T19:17:20.117621] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-22T19:17:20.525107] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-22T19:17:20.917636] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-22T19:17:20.984629] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T19:17:20.992124] [INFO ] [REMOTE ] HUYA: Full fetch complete (63992 records). [2025-10-22T19:17:20.992254] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-22T19:17:21.381292] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-22T19:17:21.381375] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-22T19:17:21.382288] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-22T19:17:21.382353] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-22T19:17:21.383628] [DEBUG] [LOCAL ] HUYA: Trimmed 63992 records to 43617 (keeping 200 days of data) [2025-10-22T19:17:21.614734] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T19:17:21.659951] [DEBUG] [LOCAL ] HUYA: Primary data saved (43617 records). [2025-10-22T19:17:21.660074] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-22T19:17:21.660559] [INFO ] [MAIN ] Update Progress: 1069/2367 symbols completed. HUYA took 36.2s. Estimated remaining: 2h 46m 42s. Rate: 7.8 symbols/min [2025-10-22T19:17:21.725573] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-22T19:17:21.840712] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:17:21.852397] [DEBUG] [LOCAL ] HY: Loaded 9945 existing records from primary storage. [2025-10-22T19:17:21.852630] [INFO ] [MAIN ] HY: Loaded 9945 existing records. [2025-10-22T19:17:21.962826] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T19:17:22.042678] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:17:22.042902] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-22T19:17:22.042951] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-22T19:17:22.043096] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-22T19:17:22.043135] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-22T19:17:22.392368] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:17:22.517665] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-22T19:17:23.290044] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T19:17:23.317637] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-22T19:17:23.468132] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T19:17:24.117665] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-22T19:17:24.139138] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T19:17:24.917743] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-22T19:17:25.717769] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-22T19:17:25.826264] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-22T19:17:26.029757] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-22T19:17:26.517665] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-22T19:17:26.773399] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T19:17:26.776105] [INFO ] [REMOTE ] HVT: Full fetch complete (23031 records). [2025-10-22T19:17:26.776180] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-22T19:17:27.149299] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-22T19:17:27.149454] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-22T19:17:27.150002] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-22T19:17:27.150064] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-22T19:17:27.150705] [DEBUG] [LOCAL ] HVT: Trimmed 23031 records to 14734 (keeping 200 days of data) [2025-10-22T19:17:27.237063] [DEBUG] [LOCAL ] HVT: Primary data saved (14734 records). [2025-10-22T19:17:27.237190] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-22T19:17:27.237269] [INFO ] [MAIN ] Update Progress: 1070/2367 symbols completed. HVT took 30.6s. Estimated remaining: 2h 46m 31s. Rate: 7.8 symbols/min [2025-10-22T19:17:27.322869] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-22T19:17:27.409322] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:17:27.409470] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-22T19:17:27.409509] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-22T19:17:27.409639] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-22T19:17:27.409718] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-22T19:17:27.409769] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-22T19:17:27.409804] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-22T19:17:27.762691] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:17:28.117670] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-22T19:17:28.200928] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-22T19:17:28.384038] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T19:17:28.917683] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-22T19:17:29.717663] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-22T19:17:29.822243] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T19:17:30.074406] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-22T19:17:30.517672] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-22T19:17:30.824214] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T19:17:31.024591] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-22T19:17:31.317686] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-22T19:17:32.117681] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-22T19:17:32.491520] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-22T19:17:32.917677] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-22T19:17:33.231495] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-22T19:17:33.636061] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-22T19:17:33.717696] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-22T19:17:34.517684] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-22T19:17:35.225688] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T19:17:35.317694] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-22T19:17:35.483683] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T19:17:36.117675] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-22T19:17:36.917636] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-22T19:17:36.963094] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T19:17:36.994905] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T19:17:37.717780] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-22T19:17:37.952894] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-22T19:17:38.517630] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-22T19:17:38.579432] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T19:17:38.833733] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-22T19:17:39.317696] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-22T19:17:39.639078] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-22T19:17:40.117713] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-22T19:17:40.917638] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-22T19:17:41.689808] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T19:17:41.717626] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-22T19:17:41.950921] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T19:17:42.517633] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-22T19:17:42.589793] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T19:17:42.591863] [INFO ] [REMOTE ] HY: Full fetch complete (14896 records). [2025-10-22T19:17:42.591938] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-22T19:17:42.962397] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-22T19:17:42.962474] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-22T19:17:42.962821] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-22T19:17:42.962882] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-22T19:17:42.963363] [DEBUG] [LOCAL ] HY: Trimmed 14896 records to 9852 (keeping 200 days of data) [2025-10-22T19:17:43.026689] [DEBUG] [LOCAL ] HY: Primary data saved (9852 records). [2025-10-22T19:17:43.027088] [INFO ] [MAIN ] HY: Full history saved. [2025-10-22T19:17:43.027177] [INFO ] [MAIN ] Update Progress: 1071/2367 symbols completed. HY took 21.4s. Estimated remaining: 2h 46m 33s. Rate: 7.8 symbols/min [2025-10-22T19:17:43.194602] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:17:43.194790] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-22T19:17:43.194934] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-22T19:17:43.195017] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-22T19:17:43.195056] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-22T19:17:43.195100] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-22T19:17:43.195133] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-22T19:17:43.332406] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-22T19:17:43.545056] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:17:44.086567] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T19:17:44.117621] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-22T19:17:44.917750] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-22T19:17:45.214466] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T19:17:45.225271] [INFO ] [REMOTE ] HWM: Full fetch complete (76634 records). [2025-10-22T19:17:45.225393] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-22T19:17:45.225718] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-22T19:17:45.625124] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-22T19:17:45.625228] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-22T19:17:45.626285] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-22T19:17:45.626367] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-22T19:17:45.651379] [DEBUG] [LOCAL ] HWM: Trimmed 76634 records to 52700 (keeping 200 days of data) [2025-10-22T19:17:45.656168] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T19:17:45.719801] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-22T19:17:45.989968] [DEBUG] [LOCAL ] HWM: Primary data saved (52700 records). [2025-10-22T19:17:45.990098] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-22T19:17:45.990175] [INFO ] [MAIN ] Update Progress: 1072/2367 symbols completed. HWM took 32.1s. Estimated remaining: 2h 46m 20s. Rate: 7.8 symbols/min [2025-10-22T19:17:46.096399] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-22T19:17:46.166178] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:17:46.177802] [DEBUG] [LOCAL ] HYI: Loaded 9697 existing records from primary storage. [2025-10-22T19:17:46.178022] [INFO ] [MAIN ] HYI: Loaded 9697 existing records. [2025-10-22T19:17:46.351168] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:17:46.351377] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-22T19:17:46.351423] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-22T19:17:46.351670] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-22T19:17:46.351729] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-22T19:17:46.523727] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-22T19:17:46.706204] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:17:47.317693] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-22T19:17:47.835162] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-22T19:17:48.117668] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-22T19:17:48.301595] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T19:17:48.350593] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-22T19:17:48.917764] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-22T19:17:49.717694] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-22T19:17:50.451533] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T19:17:50.484056] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T19:17:50.517669] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-22T19:17:51.317780] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-22T19:17:52.056974] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T19:17:52.064230] [INFO ] [REMOTE ] HXL: Full fetch complete (66707 records). [2025-10-22T19:17:52.064329] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-22T19:17:52.125702] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-22T19:17:52.174720] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-22T19:17:52.459963] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-22T19:17:52.460037] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-22T19:17:52.460888] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-22T19:17:52.460951] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-22T19:17:52.462107] [DEBUG] [LOCAL ] HXL: Trimmed 66707 records to 45788 (keeping 200 days of data) [2025-10-22T19:17:52.551921] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-22T19:17:52.734402] [DEBUG] [LOCAL ] HXL: Primary data saved (45788 records). [2025-10-22T19:17:52.734526] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-22T19:17:52.734601] [INFO ] [MAIN ] Update Progress: 1073/2367 symbols completed. HXL took 36.4s. Estimated remaining: 2h 46m 11s. Rate: 7.8 symbols/min [2025-10-22T19:17:52.902537] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:17:52.918218] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-22T19:17:52.932719] [DEBUG] [LOCAL ] HYT: Loaded 33741 existing records from primary storage. [2025-10-22T19:17:52.932983] [INFO ] [MAIN ] HYT: Loaded 33741 existing records. [2025-10-22T19:17:53.105537] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:17:53.105722] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-22T19:17:53.105773] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-22T19:17:53.106044] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-22T19:17:53.106098] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-22T19:17:53.351206] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-22T19:17:53.452039] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:17:53.717708] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-22T19:17:54.027612] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-22T19:17:54.517756] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-22T19:17:55.294194] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-22T19:17:55.317617] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-22T19:17:56.096459] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-22T19:17:56.117621] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-22T19:17:56.803406] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-22T19:17:56.917700] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-22T19:17:57.672437] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-22T19:17:57.717613] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-22T19:17:58.452894] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T19:17:58.517671] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-22T19:17:59.317635] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-22T19:17:59.349562] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T19:17:59.640884] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-22T19:18:00.117635] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-22T19:18:00.446523] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-22T19:18:00.917634] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-22T19:18:01.717747] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-22T19:18:02.517751] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-22T19:18:02.551759] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T19:18:02.790666] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T19:18:02.793332] [INFO ] [REMOTE ] HYI: Full fetch complete (13992 records). [2025-10-22T19:18:02.793436] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-22T19:18:03.000723] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-22T19:18:03.200712] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-22T19:18:03.200793] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-22T19:18:03.201095] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-22T19:18:03.201132] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-22T19:18:03.201593] [DEBUG] [LOCAL ] HYI: Trimmed 13992 records to 9586 (keeping 200 days of data) [2025-10-22T19:18:03.258456] [DEBUG] [LOCAL ] HYI: Primary data saved (9586 records). [2025-10-22T19:18:03.258588] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-22T19:18:03.258687] [INFO ] [MAIN ] Update Progress: 1074/2367 symbols completed. HYI took 17.3s. Estimated remaining: 2h 46m 7s. Rate: 7.8 symbols/min [2025-10-22T19:18:03.322853] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-22T19:18:03.427692] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:18:03.431747] [DEBUG] [LOCAL ] HYTR: Loaded 3074 existing records from primary storage. [2025-10-22T19:18:03.431887] [INFO ] [MAIN ] HYTR: Loaded 3074 existing records. [2025-10-22T19:18:03.607539] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:18:03.607834] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-22T19:18:03.607892] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-22T19:18:03.608062] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-22T19:18:03.608118] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-22T19:18:03.699885] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-22T19:18:03.959550] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:18:04.117702] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-22T19:18:04.917688] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-22T19:18:05.346522] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T19:18:05.396101] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-22T19:18:05.717686] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-22T19:18:06.517699] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-22T19:18:07.124272] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T19:18:07.143749] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T19:18:07.317763] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-22T19:18:07.855036] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-22T19:18:08.117637] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-22T19:18:08.357361] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-22T19:18:08.917790] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-22T19:18:09.717690] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-22T19:18:09.989871] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-22T19:18:10.471045] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T19:18:10.517626] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-22T19:18:11.317638] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-22T19:18:11.937012] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T19:18:12.023285] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T19:18:12.024128] [INFO ] [REMOTE ] HYAC: Full fetch complete (921 records). [2025-10-22T19:18:12.024195] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-22T19:18:12.122747] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-22T19:18:12.206488] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-10-22T19:18:12.206696] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:18:12.206766] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:18:12.206842] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-22T19:18:12.206911] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-22T19:18:12.206948] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-22T19:18:12.206987] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-22T19:18:12.207052] [INFO ] [MAIN ] Update Progress: 1075/2367 symbols completed. HYAC took 45.0s. Estimated remaining: 2h 46m 1s. Rate: 7.8 symbols/min [2025-10-22T19:18:12.388964] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:18:12.389184] [DEBUG] [LOCAL ] HZO: No existing data file found in primary storage. [2025-10-22T19:18:12.389227] [WARN ] [MAIN ] HZO: No existing data found, performing full refresh instead. [2025-10-22T19:18:12.389341] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-22T19:18:12.389382] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-22T19:18:12.389422] [DEBUG] [LOCAL ] HZO: No primary data file found to delete. [2025-10-22T19:18:12.389453] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-22T19:18:12.762970] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:18:12.917631] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-22T19:18:13.573100] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T19:18:13.717714] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-22T19:18:14.004144] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-22T19:18:14.067039] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-22T19:18:14.067764] [INFO ] [REMOTE ] HYBX: Full fetch complete (698 records). [2025-10-22T19:18:14.067834] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-22T19:18:14.243161] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-22T19:18:14.243352] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:18:14.243422] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:18:14.243493] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-22T19:18:14.243573] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-22T19:18:14.243609] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-22T19:18:14.243677] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-22T19:18:14.243751] [INFO ] [MAIN ] Update Progress: 1076/2367 symbols completed. HYBX took 31.2s. Estimated remaining: 2h 45m 46s. Rate: 7.8 symbols/min [2025-10-22T19:18:14.425113] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:18:14.433368] [DEBUG] [LOCAL ] IAE: Loaded 6338 existing records from primary storage. [2025-10-22T19:18:14.433566] [INFO ] [MAIN ] IAE: Loaded 6338 existing records. [2025-10-22T19:18:14.522724] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-22T19:18:14.611868] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:18:14.612069] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-22T19:18:14.612132] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-22T19:18:14.612290] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-22T19:18:14.612346] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-22T19:18:14.968574] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:18:15.317663] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-22T19:18:15.574085] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T19:18:15.911536] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-22T19:18:16.117711] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-22T19:18:16.917758] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-22T19:18:17.369339] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T19:18:17.717701] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-22T19:18:18.343441] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T19:18:18.363771] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T19:18:18.517626] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-22T19:18:19.317695] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-22T19:18:19.892398] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-22T19:18:19.934409] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T19:18:20.117637] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-22T19:18:20.680369] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-22T19:18:20.917675] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-22T19:18:21.387032] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-22T19:18:21.717666] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-22T19:18:22.272209] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T19:18:22.517676] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-22T19:18:23.012217] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-22T19:18:23.317638] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-22T19:18:24.117704] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-22T19:18:24.684353] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T19:18:24.917675] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-22T19:18:25.551012] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-22T19:18:25.717698] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-22T19:18:25.814805] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T19:18:26.039861] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-22T19:18:26.517692] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-22T19:18:27.154471] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T19:18:27.155620] [INFO ] [REMOTE ] HYTR: Full fetch complete (4707 records). [2025-10-22T19:18:27.155712] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-22T19:18:27.324216] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-22T19:18:27.516431] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-22T19:18:27.516508] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-22T19:18:27.516721] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-22T19:18:27.516787] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-22T19:18:27.517147] [DEBUG] [LOCAL ] HYTR: Trimmed 4707 records to 3093 (keeping 200 days of data) [2025-10-22T19:18:27.536675] [DEBUG] [LOCAL ] HYTR: Primary data saved (3093 records). [2025-10-22T19:18:27.536787] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-22T19:18:27.536870] [INFO ] [MAIN ] Update Progress: 1077/2367 symbols completed. HYTR took 24.3s. Estimated remaining: 2h 45m 45s. Rate: 7.8 symbols/min [2025-10-22T19:18:28.038600] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-22T19:18:28.117675] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-22T19:18:28.917699] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-22T19:18:29.522920] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-22T19:18:29.569147] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T19:18:29.717676] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-22T19:18:30.517628] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-22T19:18:30.875387] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-22T19:18:31.211974] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-22T19:18:31.317696] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-22T19:18:32.117691] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-22T19:18:32.632957] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T19:18:32.747808] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-22T19:18:32.917676] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-22T19:18:33.717687] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-22T19:18:34.051922] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T19:18:34.353876] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-22T19:18:34.517664] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-22T19:18:35.114861] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T19:18:35.317639] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-22T19:18:36.014626] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T19:18:36.117637] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-22T19:18:36.917697] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-22T19:18:37.410069] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-22T19:18:37.717621] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-22T19:18:38.328194] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T19:18:38.333923] [INFO ] [REMOTE ] HYT: Full fetch complete (47826 records). [2025-10-22T19:18:38.334009] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-22T19:18:38.522729] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-22T19:18:38.681163] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T19:18:38.711478] [INFO ] [REMOTE ] IAE: Full fetch complete (9033 records). [2025-10-22T19:18:38.713980] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-22T19:18:38.714054] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-22T19:18:38.714145] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-22T19:18:38.714882] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-22T19:18:38.714961] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-22T19:18:38.818532] [DEBUG] [LOCAL ] HYT: Trimmed 47826 records to 33567 (keeping 200 days of data) [2025-10-22T19:18:39.206221] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-22T19:18:39.206303] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-22T19:18:39.206551] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-22T19:18:39.206633] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-22T19:18:39.246888] [DEBUG] [LOCAL ] IAE: Trimmed 9033 records to 6307 (keeping 200 days of data) [2025-10-22T19:18:39.316558] [DEBUG] [LOCAL ] IAE: Primary data saved (6307 records). [2025-10-22T19:18:39.324433] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-22T19:18:39.327219] [INFO ] [MAIN ] Update Progress: 1078/2367 symbols completed. IAE took 25.1s. Estimated remaining: 2h 45m 42s. Rate: 7.8 symbols/min [2025-10-22T19:18:39.327014] [DEBUG] [LOCAL ] HYT: Primary data saved (33567 records). [2025-10-22T19:18:39.327470] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-22T19:18:39.327683] [INFO ] [MAIN ] Update Progress: 1079/2367 symbols completed. HYT took 46.6s. Estimated remaining: 2h 45m 25s. Rate: 7.8 symbols/min [2025-10-22T19:18:39.965047] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T19:18:39.969582] [INFO ] [REMOTE ] HZO: Full fetch complete (41256 records). [2025-10-22T19:18:39.969722] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-22T19:18:40.342230] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-22T19:18:40.342320] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-22T19:18:40.342983] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-22T19:18:40.343045] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-22T19:18:40.343966] [DEBUG] [LOCAL ] HZO: Trimmed 41256 records to 28526 (keeping 200 days of data) [2025-10-22T19:18:40.501119] [DEBUG] [LOCAL ] HZO: Primary data saved (28526 records). [2025-10-22T19:18:40.501238] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-22T19:18:40.501305] [INFO ] [MAIN ] Update Progress: 1080/2367 symbols completed. HZO took 28.3s. Estimated remaining: 2h 45m 10s. Rate: 7.8 symbols/min [2025-10-22T19:18:41.136246] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:18:41.214554] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:18:41.246876] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:18:41.268297] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:18:41.342430] [DEBUG] [LOCAL ] IBP: Loaded 28797 existing records from primary storage. [2025-10-22T19:18:41.358350] [INFO ] [MAIN ] IBP: Loaded 28797 existing records. [2025-10-22T19:18:41.500845] [DEBUG] [LOCAL ] IBN: Loaded 52838 existing records from primary storage. [2025-10-22T19:18:41.501604] [INFO ] [MAIN ] IBN: Loaded 52838 existing records. [2025-10-22T19:18:41.529154] [DEBUG] [LOCAL ] IBM: Loaded 53628 existing records from primary storage. [2025-10-22T19:18:41.598911] [DEBUG] [LOCAL ] IAG: Loaded 53492 existing records from primary storage. [2025-10-22T19:18:41.630227] [INFO ] [MAIN ] IAG: Loaded 53492 existing records. [2025-10-22T19:18:41.592194] [INFO ] [MAIN ] IBM: Loaded 53628 existing records. [2025-10-22T19:18:41.792741] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:18:41.922098] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-22T19:18:41.971013] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:18:41.942093] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-22T19:18:41.999894] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-22T19:18:42.000061] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-22T19:18:41.999982] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-22T19:18:42.000368] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-22T19:18:42.016284] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-22T19:18:42.027291] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-22T19:18:42.316422] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:18:42.351539] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-22T19:18:42.365890] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:18:42.437443] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-22T19:18:42.455687] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-22T19:18:42.456012] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-22T19:18:42.456923] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-22T19:18:42.477741] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-22T19:18:42.480701] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-22T19:18:42.480807] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-22T19:18:43.194305] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:18:43.263437] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-22T19:18:43.568821] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:18:43.574343] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-22T19:18:43.683177] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:18:43.700247] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-22T19:18:43.724635] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:18:43.725710] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-22T19:18:44.652443] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T19:18:44.658136] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-22T19:18:45.435972] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T19:18:45.447446] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-22T19:18:45.480680] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T19:18:45.492065] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-22T19:18:45.582910] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T19:18:45.593722] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-22T19:18:45.906798] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T19:18:45.915308] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-22T19:18:47.007415] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T19:18:47.018470] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-22T19:18:47.058691] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T19:18:47.091940] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T19:18:47.317635] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-22T19:18:47.417082] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-22T19:18:48.117768] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-22T19:18:48.693508] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T19:18:48.800044] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T19:18:48.917693] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-22T19:18:49.717688] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-22T19:18:50.234465] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T19:18:50.277473] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-22T19:18:50.517706] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-22T19:18:51.317695] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-22T19:18:51.590498] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-22T19:18:51.632705] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T19:18:52.117718] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-22T19:18:52.917624] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-22T19:18:52.998251] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T19:18:53.541028] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T19:18:53.717762] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-22T19:18:54.517742] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-22T19:18:55.115704] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-22T19:18:55.243390] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:18:55.317613] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-22T19:18:56.108305] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T19:18:56.118784] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-22T19:18:56.917700] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-22T19:18:57.125492] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-22T19:18:57.717669] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-22T19:18:58.231680] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T19:18:58.353042] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-22T19:18:58.517624] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-22T19:18:59.317744] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-22T19:18:59.611604] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T19:19:00.117669] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-22T19:19:00.543734] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T19:19:00.734412] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-22T19:19:00.917708] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-22T19:19:01.717712] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-22T19:19:01.929947] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T19:19:02.517638] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-22T19:19:02.980079] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T19:19:02.984913] [INFO ] [REMOTE ] IBP: Full fetch complete (41134 records). [2025-10-22T19:19:02.985167] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-22T19:19:03.326107] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-22T19:19:03.388299] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-22T19:19:03.388582] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-22T19:19:03.389336] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-22T19:19:03.389539] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-22T19:19:03.391093] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-22T19:19:03.403825] [DEBUG] [LOCAL ] IBP: Trimmed 41134 records to 28663 (keeping 200 days of data) [2025-10-22T19:19:03.575327] [DEBUG] [LOCAL ] IBP: Primary data saved (28663 records). [2025-10-22T19:19:03.575450] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-22T19:19:03.575524] [INFO ] [MAIN ] Update Progress: 1081/2367 symbols completed. IBP took 23.1s. Estimated remaining: 2h 45m 20s. Rate: 7.8 symbols/min [2025-10-22T19:19:03.741105] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:03.773522] [DEBUG] [LOCAL ] IBTA: Loaded 36220 existing records from primary storage. [2025-10-22T19:19:03.773807] [INFO ] [MAIN ] IBTA: Loaded 36220 existing records. [2025-10-22T19:19:03.950637] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:03.950964] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-22T19:19:03.951162] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-22T19:19:03.951405] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-22T19:19:03.951462] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-22T19:19:04.131934] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-22T19:19:04.223986] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T19:19:04.363084] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:04.917626] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-22T19:19:05.173611] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T19:19:05.717765] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-22T19:19:06.428937] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-22T19:19:06.517614] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-22T19:19:06.641147] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T19:19:07.317753] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-22T19:19:07.755350] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T19:19:07.764117] [INFO ] [REMOTE ] IAG: Full fetch complete (77507 records). [2025-10-22T19:19:07.764233] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-22T19:19:08.122176] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-22T19:19:08.144171] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-22T19:19:08.145409] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-22T19:19:08.146417] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-22T19:19:08.146560] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-22T19:19:08.148117] [DEBUG] [LOCAL ] IAG: Trimmed 77507 records to 53492 (keeping 200 days of data) [2025-10-22T19:19:08.466063] [DEBUG] [LOCAL ] IAG: Primary data saved (53492 records). [2025-10-22T19:19:08.466199] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-22T19:19:08.466280] [INFO ] [MAIN ] Update Progress: 1082/2367 symbols completed. IAG took 28.0s. Estimated remaining: 2h 45m 9s. Rate: 7.8 symbols/min [2025-10-22T19:19:08.728962] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:08.792984] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-22T19:19:08.869284] [DEBUG] [LOCAL ] ICE: Loaded 53011 existing records from primary storage. [2025-10-22T19:19:08.869776] [INFO ] [MAIN ] ICE: Loaded 53011 existing records. [2025-10-22T19:19:08.926435] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-22T19:19:09.148233] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:09.149216] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-22T19:19:09.149384] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-22T19:19:09.150450] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-22T19:19:09.150528] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-22T19:19:09.536006] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-22T19:19:09.561921] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T19:19:09.634933] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:09.717619] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-22T19:19:10.517693] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-22T19:19:11.289878] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T19:19:11.317611] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-22T19:19:11.703104] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T19:19:11.782622] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.86 seconds). [2025-10-22T19:19:11.791718] [INFO ] [REMOTE ] IBM: Full fetch complete (77742 records). [2025-10-22T19:19:11.791868] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-22T19:19:12.122884] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-22T19:19:12.201375] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-22T19:19:12.201468] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-22T19:19:12.202427] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-22T19:19:12.202520] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-22T19:19:12.204931] [DEBUG] [LOCAL ] IBM: Trimmed 77742 records to 53628 (keeping 200 days of data) [2025-10-22T19:19:12.533575] [DEBUG] [LOCAL ] IBM: Primary data saved (53628 records). [2025-10-22T19:19:12.533738] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-22T19:19:12.534192] [INFO ] [MAIN ] Update Progress: 1083/2367 symbols completed. IBM took 32.0s. Estimated remaining: 2h 44m 57s. Rate: 7.8 symbols/min [2025-10-22T19:19:12.718776] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:12.755059] [DEBUG] [LOCAL ] ICL: Loaded 38256 existing records from primary storage. [2025-10-22T19:19:12.755434] [INFO ] [MAIN ] ICL: Loaded 38256 existing records. [2025-10-22T19:19:12.927420] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-22T19:19:12.950895] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:12.952111] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-22T19:19:12.952191] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-22T19:19:12.952449] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-22T19:19:12.952523] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-22T19:19:13.336489] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:13.365329] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-22T19:19:13.609482] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T19:19:13.717630] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-22T19:19:14.064205] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T19:19:14.517624] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-22T19:19:15.082304] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T19:19:15.317694] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-22T19:19:16.117698] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-22T19:19:16.207176] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T19:19:16.917806] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-22T19:19:17.180669] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T19:19:17.189856] [INFO ] [REMOTE ] IBN: Full fetch complete (76644 records). [2025-10-22T19:19:17.189967] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-22T19:19:17.395505] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T19:19:17.628828] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-22T19:19:17.628917] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-22T19:19:17.630042] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-22T19:19:17.630109] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-22T19:19:17.631688] [DEBUG] [LOCAL ] IBN: Trimmed 76644 records to 52834 (keeping 200 days of data) [2025-10-22T19:19:17.723284] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-22T19:19:17.959553] [DEBUG] [LOCAL ] IBN: Primary data saved (52834 records). [2025-10-22T19:19:17.959731] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-22T19:19:17.959823] [INFO ] [MAIN ] Update Progress: 1084/2367 symbols completed. IBN took 37.5s. Estimated remaining: 2h 44m 47s. Rate: 7.8 symbols/min [2025-10-22T19:19:18.126910] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:18.157947] [DEBUG] [LOCAL ] IDA: Loaded 32767 existing records from primary storage. [2025-10-22T19:19:18.158212] [INFO ] [MAIN ] IDA: Loaded 32767 existing records. [2025-10-22T19:19:18.336025] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:18.336242] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-22T19:19:18.336289] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-22T19:19:18.336525] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-22T19:19:18.336562] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-22T19:19:18.531324] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-22T19:19:18.693328] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:18.785577] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T19:19:18.847607] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T19:19:19.317752] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-22T19:19:19.918556] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T19:19:20.117631] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-22T19:19:20.661498] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T19:19:20.917700] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-22T19:19:21.450862] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T19:19:21.717698] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-22T19:19:22.442773] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T19:19:22.517686] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-22T19:19:23.317681] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-22T19:19:23.439613] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T19:19:23.693569] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-22T19:19:24.117616] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-22T19:19:24.588271] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-22T19:19:24.917717] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-22T19:19:25.717620] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-22T19:19:26.022221] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T19:19:26.277704] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T19:19:26.517749] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-22T19:19:26.966504] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-22T19:19:27.317716] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-22T19:19:28.117682] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-22T19:19:28.338752] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-22T19:19:28.761975] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-22T19:19:28.917663] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-22T19:19:29.495326] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T19:19:29.717620] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-22T19:19:30.156505] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T19:19:30.517686] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-22T19:19:31.279633] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T19:19:31.317632] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-22T19:19:31.518106] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T19:19:32.117674] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-22T19:19:32.539192] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T19:19:32.917680] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-22T19:19:33.530104] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T19:19:33.535882] [INFO ] [REMOTE ] IBTA: Full fetch complete (51189 records). [2025-10-22T19:19:33.536000] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-22T19:19:33.723661] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-22T19:19:33.915776] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-22T19:19:33.915852] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-22T19:19:33.916562] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-22T19:19:33.916602] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-22T19:19:33.917617] [DEBUG] [LOCAL ] IBTA: Trimmed 51189 records to 36072 (keeping 200 days of data) [2025-10-22T19:19:34.120403] [DEBUG] [LOCAL ] IBTA: Primary data saved (36072 records). [2025-10-22T19:19:34.120526] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-22T19:19:34.120599] [INFO ] [MAIN ] Update Progress: 1085/2367 symbols completed. IBTA took 30.5s. Estimated remaining: 2h 44m 49s. Rate: 7.8 symbols/min [2025-10-22T19:19:34.290982] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:34.301636] [DEBUG] [LOCAL ] IDE: Loaded 9047 existing records from primary storage. [2025-10-22T19:19:34.301844] [INFO ] [MAIN ] IDE: Loaded 9047 existing records. [2025-10-22T19:19:34.481111] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:34.481553] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-22T19:19:34.488973] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-22T19:19:34.499690] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-22T19:19:34.502031] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-22T19:19:34.525997] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-22T19:19:34.562660] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T19:19:34.882323] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:35.317692] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-22T19:19:35.672413] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T19:19:35.705256] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T19:19:36.045139] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T19:19:36.117681] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-22T19:19:36.917695] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-22T19:19:37.555348] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T19:19:37.622181] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-22T19:19:37.717675] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-22T19:19:38.517700] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-22T19:19:39.048388] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T19:19:39.125201] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T19:19:39.317701] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-22T19:19:40.117669] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-22T19:19:40.137473] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T19:19:40.917748] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-22T19:19:41.437515] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-22T19:19:41.469358] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-22T19:19:41.717674] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-22T19:19:42.517706] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-22T19:19:43.103880] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T19:19:43.109667] [INFO ] [REMOTE ] IDA: Full fetch complete (45398 records). [2025-10-22T19:19:43.109790] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-22T19:19:43.325636] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-22T19:19:43.496822] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-22T19:19:43.496898] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-22T19:19:43.497711] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-22T19:19:43.497786] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-22T19:19:43.498710] [DEBUG] [LOCAL ] IDA: Trimmed 45398 records to 32728 (keeping 200 days of data) [2025-10-22T19:19:43.703060] [DEBUG] [LOCAL ] IDA: Primary data saved (32728 records). [2025-10-22T19:19:43.703479] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-22T19:19:43.703569] [INFO ] [MAIN ] Update Progress: 1086/2367 symbols completed. IDA took 25.7s. Estimated remaining: 2h 44m 44s. Rate: 7.8 symbols/min [2025-10-22T19:19:43.885097] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:43.902451] [DEBUG] [LOCAL ] IDT: Loaded 18558 existing records from primary storage. [2025-10-22T19:19:43.902717] [INFO ] [MAIN ] IDT: Loaded 18558 existing records. [2025-10-22T19:19:44.076928] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:44.077154] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-22T19:19:44.077201] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-22T19:19:44.077816] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-22T19:19:44.077872] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-22T19:19:44.120302] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-22T19:19:44.440712] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:44.469478] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-22T19:19:44.857163] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T19:19:44.915556] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T19:19:44.917864] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-22T19:19:45.717713] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-22T19:19:45.728500] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T19:19:46.517711] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-22T19:19:47.117577] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T19:19:47.317706] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-22T19:19:48.117685] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-22T19:19:48.293178] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T19:19:48.584546] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-22T19:19:48.756952] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T19:19:48.763093] [INFO ] [REMOTE ] ICL: Full fetch complete (55973 records). [2025-10-22T19:19:48.763189] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-22T19:19:48.920443] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-22T19:19:49.144566] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-22T19:19:49.144659] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-22T19:19:49.145429] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-22T19:19:49.145472] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-22T19:19:49.146515] [DEBUG] [LOCAL ] ICL: Trimmed 55973 records to 38132 (keeping 200 days of data) [2025-10-22T19:19:49.355686] [DEBUG] [LOCAL ] ICL: Primary data saved (38132 records). [2025-10-22T19:19:49.355825] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-22T19:19:49.356498] [INFO ] [MAIN ] Update Progress: 1087/2367 symbols completed. ICL took 36.8s. Estimated remaining: 2h 44m 33s. Rate: 7.8 symbols/min [2025-10-22T19:19:49.527381] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:49.565199] [DEBUG] [LOCAL ] IEX: Loaded 38376 existing records from primary storage. [2025-10-22T19:19:49.565522] [INFO ] [MAIN ] IEX: Loaded 38376 existing records. [2025-10-22T19:19:49.722678] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-22T19:19:49.742110] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:49.743190] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-22T19:19:49.743250] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-22T19:19:49.743416] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-22T19:19:49.743454] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-22T19:19:50.034714] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T19:19:50.115629] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:50.517720] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-22T19:19:51.266815] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-22T19:19:51.317610] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-22T19:19:51.666636] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T19:19:51.675463] [INFO ] [REMOTE ] ICE: Full fetch complete (77023 records). [2025-10-22T19:19:51.675600] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-22T19:19:52.068694] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-22T19:19:52.068811] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-22T19:19:52.069770] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-22T19:19:52.069832] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-22T19:19:52.071365] [DEBUG] [LOCAL ] ICE: Trimmed 77023 records to 53009 (keeping 200 days of data) [2025-10-22T19:19:52.126951] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-22T19:19:52.409195] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T19:19:52.428172] [DEBUG] [LOCAL ] ICE: Primary data saved (53009 records). [2025-10-22T19:19:52.428365] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-22T19:19:52.428465] [INFO ] [MAIN ] Update Progress: 1088/2367 symbols completed. ICE took 44.0s. Estimated remaining: 2h 44m 20s. Rate: 7.8 symbols/min [2025-10-22T19:19:52.602946] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:52.649177] [DEBUG] [LOCAL ] IFF: Loaded 51226 existing records from primary storage. [2025-10-22T19:19:52.649534] [INFO ] [MAIN ] IFF: Loaded 51226 existing records. [2025-10-22T19:19:52.831253] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:52.831459] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-22T19:19:52.831505] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-22T19:19:52.831735] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-22T19:19:52.831791] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-22T19:19:52.921173] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-22T19:19:52.946627] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T19:19:53.194816] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:53.717626] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-22T19:19:54.408311] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T19:19:54.517627] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-22T19:19:54.821102] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T19:19:54.823620] [INFO ] [REMOTE ] IDE: Full fetch complete (12834 records). [2025-10-22T19:19:54.823727] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-22T19:19:55.184040] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-22T19:19:55.184120] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-22T19:19:55.184496] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-22T19:19:55.184538] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-22T19:19:55.185153] [DEBUG] [LOCAL ] IDE: Trimmed 12834 records to 9050 (keeping 200 days of data) [2025-10-22T19:19:55.241794] [DEBUG] [LOCAL ] IDE: Primary data saved (9050 records). [2025-10-22T19:19:55.241920] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-22T19:19:55.242000] [INFO ] [MAIN ] Update Progress: 1089/2367 symbols completed. IDE took 21.1s. Estimated remaining: 2h 44m 7s. Rate: 7.8 symbols/min [2025-10-22T19:19:55.323003] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-22T19:19:55.449898] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:19:55.468899] [DEBUG] [LOCAL ] IFN: Loaded 18608 existing records from primary storage. [2025-10-22T19:19:55.469154] [INFO ] [MAIN ] IFN: Loaded 18608 existing records. [2025-10-22T19:19:55.667670] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:19:55.668050] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-22T19:19:55.668125] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-22T19:19:55.668407] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-22T19:19:55.668466] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-22T19:19:55.764615] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T19:19:56.075725] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-22T19:19:56.091494] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:19:56.117613] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-22T19:19:56.917637] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-22T19:19:57.110891] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T19:19:57.717696] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-22T19:19:58.522746] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-22T19:19:58.538280] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T19:19:58.599312] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T19:19:59.317706] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-22T19:19:59.358742] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-22T19:20:00.117710] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-22T19:20:00.326724] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T19:20:00.917817] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-22T19:20:01.066766] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-22T19:20:01.717682] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-22T19:20:01.951372] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-22T19:20:02.517760] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-22T19:20:03.238227] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T19:20:03.317812] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-22T19:20:03.654187] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T19:20:04.117633] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-22T19:20:04.345254] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-22T19:20:04.917746] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-22T19:20:05.717698] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-22T19:20:05.866456] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-22T19:20:06.210195] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-22T19:20:06.214408] [INFO ] [REMOTE ] IDT: Full fetch complete (24090 records). [2025-10-22T19:20:06.214481] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-22T19:20:06.523089] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-22T19:20:06.616971] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-22T19:20:06.617590] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-22T19:20:06.617980] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-22T19:20:06.623123] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-22T19:20:06.623481] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-22T19:20:06.624176] [DEBUG] [LOCAL ] IDT: Trimmed 24090 records to 18550 (keeping 200 days of data) [2025-10-22T19:20:06.735113] [DEBUG] [LOCAL ] IDT: Primary data saved (18550 records). [2025-10-22T19:20:06.735246] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-22T19:20:06.735323] [INFO ] [MAIN ] Update Progress: 1090/2367 symbols completed. IDT took 23.0s. Estimated remaining: 2h 44m 4s. Rate: 7.8 symbols/min [2025-10-22T19:20:06.899837] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:20:06.920177] [DEBUG] [LOCAL ] IFS: Loaded 22267 existing records from primary storage. [2025-10-22T19:20:06.920410] [INFO ] [MAIN ] IFS: Loaded 22267 existing records. [2025-10-22T19:20:07.092523] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:20:07.092740] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-22T19:20:07.092794] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-22T19:20:07.092951] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-22T19:20:07.092988] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-22T19:20:07.323806] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-22T19:20:07.449542] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:20:08.070715] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T19:20:08.117617] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-22T19:20:08.917696] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-22T19:20:09.053600] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T19:20:09.717766] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-22T19:20:09.876388] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T19:20:09.902780] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-22T19:20:10.517634] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-22T19:20:10.693980] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T19:20:11.317796] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-22T19:20:12.114101] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-22T19:20:12.124922] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-22T19:20:12.260988] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T19:20:12.917718] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-22T19:20:13.641434] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T19:20:13.717706] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-22T19:20:14.517669] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-22T19:20:14.662084] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T19:20:15.118140] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T19:20:15.305491] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T19:20:15.317599] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-22T19:20:16.117716] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-22T19:20:16.522072] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-22T19:20:16.917691] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-22T19:20:17.716548] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-22T19:20:17.724577] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-22T19:20:17.978492] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T19:20:18.517675] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-22T19:20:18.994401] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-22T19:20:19.317668] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-22T19:20:19.374921] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T19:20:20.117692] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-22T19:20:20.876205] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T19:20:20.917622] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-22T19:20:21.113259] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-22T19:20:21.717634] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-22T19:20:21.884430] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T19:20:22.517775] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-22T19:20:23.097851] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T19:20:23.317699] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-22T19:20:23.753798] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T19:20:23.757438] [INFO ] [REMOTE ] IFN: Full fetch complete (28367 records). [2025-10-22T19:20:23.757536] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-22T19:20:24.122879] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-22T19:20:24.123898] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-22T19:20:24.124898] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-22T19:20:24.125545] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-22T19:20:24.125695] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-22T19:20:24.126673] [DEBUG] [LOCAL ] IFN: Trimmed 28367 records to 18590 (keeping 200 days of data) [2025-10-22T19:20:24.240141] [DEBUG] [LOCAL ] IFN: Primary data saved (18590 records). [2025-10-22T19:20:24.240429] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-22T19:20:24.240517] [INFO ] [MAIN ] Update Progress: 1091/2367 symbols completed. IFN took 29.0s. Estimated remaining: 2h 44m 7s. Rate: 7.8 symbols/min [2025-10-22T19:20:24.413570] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:20:24.424502] [DEBUG] [LOCAL ] IGA: Loaded 10213 existing records from primary storage. [2025-10-22T19:20:24.424729] [INFO ] [MAIN ] IGA: Loaded 10213 existing records. [2025-10-22T19:20:24.619212] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:20:24.620400] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T19:20:24.620753] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-22T19:20:24.620874] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-22T19:20:24.627131] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-22T19:20:24.627205] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-22T19:20:24.922784] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-22T19:20:24.984867] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:20:25.717688] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-22T19:20:25.880450] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T19:20:26.017087] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T19:20:26.203217] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-22T19:20:26.517685] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-22T19:20:27.317757] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-22T19:20:28.117767] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-22T19:20:28.185893] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T19:20:28.349819] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-22T19:20:28.917680] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-22T19:20:29.584182] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-22T19:20:29.590038] [INFO ] [REMOTE ] IEX: Full fetch complete (53899 records). [2025-10-22T19:20:29.590167] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-22T19:20:29.722818] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-22T19:20:29.984123] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-22T19:20:29.984196] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-22T19:20:29.985081] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-22T19:20:29.985146] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-22T19:20:29.986328] [DEBUG] [LOCAL ] IEX: Trimmed 53899 records to 38271 (keeping 200 days of data) [2025-10-22T19:20:30.242172] [DEBUG] [LOCAL ] IEX: Primary data saved (38271 records). [2025-10-22T19:20:30.242342] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-22T19:20:30.242973] [INFO ] [MAIN ] Update Progress: 1092/2367 symbols completed. IEX took 40.9s. Estimated remaining: 2h 43m 58s. Rate: 7.8 symbols/min [2025-10-22T19:20:30.423257] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:20:30.441540] [DEBUG] [LOCAL ] IGD: Loaded 19195 existing records from primary storage. [2025-10-22T19:20:30.441815] [INFO ] [MAIN ] IGD: Loaded 19195 existing records. [2025-10-22T19:20:30.521090] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-22T19:20:30.631847] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:20:30.632265] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-22T19:20:30.632530] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-22T19:20:30.648073] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-22T19:20:30.658472] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-22T19:20:30.713361] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T19:20:30.797389] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T19:20:31.080284] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:20:31.294143] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-22T19:20:31.317617] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-22T19:20:32.117674] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-22T19:20:32.917669] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-22T19:20:32.992535] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T19:20:33.002121] [INFO ] [REMOTE ] IFF: Full fetch complete (73771 records). [2025-10-22T19:20:33.002300] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-22T19:20:33.316015] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T19:20:33.346114] [INFO ] [REMOTE ] IFS: Full fetch complete (32283 records). [2025-10-22T19:20:33.397801] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-22T19:20:33.416129] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-22T19:20:33.416223] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-22T19:20:33.417211] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-22T19:20:33.448947] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-22T19:20:33.521606] [DEBUG] [LOCAL ] IFF: Trimmed 73771 records to 51225 (keeping 200 days of data) [2025-10-22T19:20:33.733483] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-22T19:20:33.753511] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-22T19:20:33.942153] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-22T19:20:33.944998] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-22T19:20:33.949923] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-22T19:20:33.950034] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-22T19:20:34.002561] [DEBUG] [LOCAL ] IFS: Trimmed 32283 records to 22165 (keeping 200 days of data) [2025-10-22T19:20:34.196301] [DEBUG] [LOCAL ] IFS: Primary data saved (22165 records). [2025-10-22T19:20:34.201989] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-22T19:20:34.202092] [INFO ] [MAIN ] Update Progress: 1093/2367 symbols completed. IFS took 27.5s. Estimated remaining: 2h 43m 46s. Rate: 7.8 symbols/min [2025-10-22T19:20:34.444938] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:20:34.459762] [DEBUG] [LOCAL ] IFF: Primary data saved (51225 records). [2025-10-22T19:20:34.459932] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-22T19:20:34.462815] [INFO ] [MAIN ] Update Progress: 1094/2367 symbols completed. IFF took 42.0s. Estimated remaining: 2h 43m 29s. Rate: 7.8 symbols/min [2025-10-22T19:20:34.462668] [DEBUG] [LOCAL ] IGI: Loaded 4074 existing records from primary storage. [2025-10-22T19:20:34.495554] [INFO ] [MAIN ] IGI: Loaded 4074 existing records. [2025-10-22T19:20:34.528179] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-22T19:20:34.772851] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:20:34.830326] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:20:34.830700] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-22T19:20:34.830767] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-22T19:20:34.830913] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-22T19:20:34.830954] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-22T19:20:35.078369] [DEBUG] [LOCAL ] IGR: Loaded 30433 existing records from primary storage. [2025-10-22T19:20:35.111985] [INFO ] [MAIN ] IGR: Loaded 30433 existing records. [2025-10-22T19:20:35.142126] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T19:20:35.322596] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-22T19:20:35.417810] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T19:20:35.477495] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:20:35.484173] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-22T19:20:35.488804] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-22T19:20:35.488714] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:20:35.489202] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-22T19:20:35.489272] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-22T19:20:35.844083] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:20:36.117615] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-22T19:20:36.589775] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-22T19:20:36.895142] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-22T19:20:36.917622] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-22T19:20:37.630856] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-22T19:20:37.717777] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-22T19:20:38.517768] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-22T19:20:38.576282] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T19:20:39.057247] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-22T19:20:39.317769] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-22T19:20:40.041927] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-22T19:20:40.117688] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-22T19:20:40.628449] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-22T19:20:40.917701] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-22T19:20:41.364586] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T19:20:41.717886] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-22T19:20:42.386938] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-22T19:20:42.517689] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-22T19:20:43.317767] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-22T19:20:43.430708] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T19:20:43.433451] [INFO ] [REMOTE ] IGA: Full fetch complete (14335 records). [2025-10-22T19:20:43.433529] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-22T19:20:43.794985] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-22T19:20:43.795079] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-22T19:20:43.795402] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-22T19:20:43.795443] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-22T19:20:43.795924] [DEBUG] [LOCAL ] IGA: Trimmed 14335 records to 10128 (keeping 200 days of data) [2025-10-22T19:20:43.853694] [DEBUG] [LOCAL ] IGA: Primary data saved (10128 records). [2025-10-22T19:20:43.853822] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-22T19:20:43.853910] [INFO ] [MAIN ] Update Progress: 1095/2367 symbols completed. IGA took 19.6s. Estimated remaining: 2h 43m 23s. Rate: 7.8 symbols/min [2025-10-22T19:20:44.018075] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:20:44.022800] [DEBUG] [LOCAL ] IH: Loaded 2764 existing records from primary storage. [2025-10-22T19:20:44.023156] [INFO ] [MAIN ] IH: Loaded 2764 existing records. [2025-10-22T19:20:44.121373] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-22T19:20:44.198577] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:20:44.198778] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-22T19:20:44.198825] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-22T19:20:44.198965] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-22T19:20:44.199019] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-22T19:20:44.470565] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T19:20:44.570522] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:20:44.917689] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-22T19:20:45.423911] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-22T19:20:45.473593] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T19:20:45.717633] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-22T19:20:46.321603] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-22T19:20:46.517691] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-22T19:20:47.317627] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-22T19:20:47.713337] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T19:20:47.799044] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-22T19:20:48.117708] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-22T19:20:48.917682] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-22T19:20:49.516004] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T19:20:49.717760] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-22T19:20:49.726378] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T19:20:50.517694] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-22T19:20:50.764345] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T19:20:51.026730] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-22T19:20:51.317793] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-22T19:20:52.117753] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-22T19:20:52.425058] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T19:20:52.491259] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-22T19:20:52.917712] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-22T19:20:53.384509] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-22T19:20:53.717757] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-22T19:20:54.326952] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T19:20:54.517700] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-22T19:20:54.931614] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-22T19:20:55.317711] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-22T19:20:56.117706] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-22T19:20:56.530154] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T19:20:56.713528] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T19:20:56.917671] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-22T19:20:57.717637] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-22T19:20:58.094092] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T19:20:58.517702] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-22T19:20:59.005920] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-22T19:20:59.066986] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-22T19:20:59.317686] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-22T19:21:00.117667] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-22T19:21:00.608836] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T19:21:00.917622] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-22T19:21:00.990404] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T19:21:00.992091] [INFO ] [REMOTE ] IGI: Full fetch complete (5503 records). [2025-10-22T19:21:00.992163] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-22T19:21:01.356114] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-22T19:21:01.356194] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-22T19:21:01.356397] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-22T19:21:01.356439] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-22T19:21:01.356848] [DEBUG] [LOCAL ] IGI: Trimmed 5503 records to 4050 (keeping 200 days of data) [2025-10-22T19:21:01.383106] [DEBUG] [LOCAL ] IGI: Primary data saved (4050 records). [2025-10-22T19:21:01.383225] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-22T19:21:01.383323] [INFO ] [MAIN ] Update Progress: 1096/2367 symbols completed. IGI took 27.2s. Estimated remaining: 2h 43m 27s. Rate: 7.8 symbols/min [2025-10-22T19:21:01.575793] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:01.586113] [DEBUG] [LOCAL ] IHD: Loaded 7394 existing records from primary storage. [2025-10-22T19:21:01.586344] [INFO ] [MAIN ] IHD: Loaded 7394 existing records. [2025-10-22T19:21:01.722421] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-22T19:21:01.790338] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:01.790675] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-22T19:21:01.790742] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-22T19:21:01.790892] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-22T19:21:01.790969] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-22T19:21:02.142162] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T19:21:02.233189] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:21:02.517757] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-22T19:21:02.927321] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-22T19:21:03.317630] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-22T19:21:03.465702] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-22T19:21:04.117758] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-22T19:21:04.917637] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-22T19:21:04.968180] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T19:21:04.977925] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T19:21:05.402957] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-22T19:21:05.717798] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-22T19:21:06.463832] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-22T19:21:06.517698] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-22T19:21:07.135119] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T19:21:07.317709] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-22T19:21:07.943482] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-22T19:21:08.117673] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-22T19:21:08.614347] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-22T19:21:08.917722] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-22T19:21:09.395834] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-22T19:21:09.717681] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-22T19:21:10.281706] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-22T19:21:10.282735] [INFO ] [REMOTE ] IH: Full fetch complete (5047 records). [2025-10-22T19:21:10.282813] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-22T19:21:10.524143] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-22T19:21:10.638980] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-22T19:21:10.639060] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-22T19:21:10.639198] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-22T19:21:10.639235] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-22T19:21:10.639565] [DEBUG] [LOCAL ] IH: Trimmed 5047 records to 2722 (keeping 200 days of data) [2025-10-22T19:21:10.654529] [DEBUG] [LOCAL ] IH: Primary data saved (2722 records). [2025-10-22T19:21:10.654587] [INFO ] [MAIN ] IH: Full history saved. [2025-10-22T19:21:10.654671] [INFO ] [MAIN ] Update Progress: 1097/2367 symbols completed. IH took 26.8s. Estimated remaining: 2h 43m 21s. Rate: 7.8 symbols/min [2025-10-22T19:21:10.840160] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:10.862931] [DEBUG] [LOCAL ] IHG: Loaded 24119 existing records from primary storage. [2025-10-22T19:21:10.863191] [INFO ] [MAIN ] IHG: Loaded 24119 existing records. [2025-10-22T19:21:11.039726] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:11.039903] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-22T19:21:11.039948] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-22T19:21:11.040122] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-22T19:21:11.040177] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-22T19:21:11.322827] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-22T19:21:11.386601] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:21:11.935368] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T19:21:12.117681] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-22T19:21:12.423865] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T19:21:12.858556] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T19:21:12.917675] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-22T19:21:13.614130] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T19:21:13.717675] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-22T19:21:14.333274] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T19:21:14.517677] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-22T19:21:15.317687] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-22T19:21:15.789487] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T19:21:15.793535] [INFO ] [REMOTE ] IGD: Full fetch complete (30140 records). [2025-10-22T19:21:15.793678] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-22T19:21:16.122719] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-22T19:21:16.184361] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-22T19:21:16.184450] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-22T19:21:16.185093] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-22T19:21:16.185155] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-22T19:21:16.185963] [DEBUG] [LOCAL ] IGD: Trimmed 30140 records to 19135 (keeping 200 days of data) [2025-10-22T19:21:16.300201] [DEBUG] [LOCAL ] IGD: Primary data saved (19135 records). [2025-10-22T19:21:16.300357] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-22T19:21:16.300475] [INFO ] [MAIN ] Update Progress: 1098/2367 symbols completed. IGD took 46.1s. Estimated remaining: 2h 43m 11s. Rate: 7.8 symbols/min [2025-10-22T19:21:16.481166] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:16.514341] [DEBUG] [LOCAL ] IHS: Loaded 37245 existing records from primary storage. [2025-10-22T19:21:16.514606] [INFO ] [MAIN ] IHS: Loaded 37245 existing records. [2025-10-22T19:21:16.703284] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:16.703608] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-22T19:21:16.703784] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-22T19:21:16.709477] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-22T19:21:16.719145] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-22T19:21:16.732097] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T19:21:16.861675] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T19:21:16.922828] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-22T19:21:17.108607] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:21:17.717702] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-22T19:21:18.101718] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T19:21:18.191728] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-22T19:21:18.517695] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-22T19:21:19.317708] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-22T19:21:19.697221] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T19:21:20.117673] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-22T19:21:20.188898] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T19:21:20.191004] [INFO ] [REMOTE ] IHD: Full fetch complete (11783 records). [2025-10-22T19:21:20.191078] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-22T19:21:20.572957] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-22T19:21:20.573079] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-22T19:21:20.573425] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-22T19:21:20.573493] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-22T19:21:20.573993] [DEBUG] [LOCAL ] IHD: Trimmed 11783 records to 7364 (keeping 200 days of data) [2025-10-22T19:21:20.619971] [DEBUG] [LOCAL ] IHD: Primary data saved (7364 records). [2025-10-22T19:21:20.620130] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-22T19:21:20.620222] [INFO ] [MAIN ] Update Progress: 1099/2367 symbols completed. IHD took 19.2s. Estimated remaining: 2h 42m 59s. Rate: 7.8 symbols/min [2025-10-22T19:21:20.800613] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:20.807873] [DEBUG] [LOCAL ] IIF: Loaded 5353 existing records from primary storage. [2025-10-22T19:21:20.808104] [INFO ] [MAIN ] IIF: Loaded 5353 existing records. [2025-10-22T19:21:20.922859] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-22T19:21:20.984840] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:20.985130] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-22T19:21:20.985180] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-22T19:21:20.985372] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-22T19:21:20.985428] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-22T19:21:21.335218] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:21:21.463601] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T19:21:21.468611] [INFO ] [REMOTE ] IGR: Full fetch complete (44644 records). [2025-10-22T19:21:21.468727] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-22T19:21:21.725507] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-22T19:21:21.842546] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-22T19:21:21.842628] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-22T19:21:21.843400] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-22T19:21:21.843451] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-22T19:21:21.844412] [DEBUG] [LOCAL ] IGR: Trimmed 44644 records to 30409 (keeping 200 days of data) [2025-10-22T19:21:22.019237] [DEBUG] [LOCAL ] IGR: Primary data saved (30409 records). [2025-10-22T19:21:22.019389] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-22T19:21:22.019581] [INFO ] [MAIN ] Update Progress: 1100/2367 symbols completed. IGR took 47.6s. Estimated remaining: 2h 42m 44s. Rate: 7.8 symbols/min [2025-10-22T19:21:22.157260] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-22T19:21:22.212477] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:22.227986] [DEBUG] [LOCAL ] IIIN: Loaded 16300 existing records from primary storage. [2025-10-22T19:21:22.228218] [INFO ] [MAIN ] IIIN: Loaded 16300 existing records. [2025-10-22T19:21:22.405962] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:22.406199] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-22T19:21:22.406247] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-22T19:21:22.406519] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-22T19:21:22.406575] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-22T19:21:22.522923] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-22T19:21:22.774460] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:21:23.070550] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T19:21:23.317698] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-22T19:21:23.334418] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-22T19:21:24.117692] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-22T19:21:24.780317] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-22T19:21:24.782487] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-22T19:21:24.917698] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-22T19:21:25.717675] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-22T19:21:26.174456] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-22T19:21:26.517686] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-22T19:21:26.596383] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T19:21:27.317622] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-22T19:21:27.368764] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-22T19:21:27.909775] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T19:21:28.117674] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-22T19:21:28.766533] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T19:21:28.917670] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-22T19:21:29.717681] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-22T19:21:30.061943] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T19:21:30.517687] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-22T19:21:31.170354] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T19:21:31.231824] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-22T19:21:31.317628] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-22T19:21:32.117694] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-22T19:21:32.396316] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T19:21:32.917669] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-22T19:21:33.499922] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T19:21:33.717688] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-22T19:21:33.968567] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T19:21:34.502861] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T19:21:34.517622] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-22T19:21:35.317686] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-22T19:21:36.079355] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T19:21:36.107345] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T19:21:36.117609] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-22T19:21:36.917714] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-22T19:21:37.576091] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T19:21:37.717620] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-22T19:21:38.110957] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T19:21:38.517685] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-22T19:21:38.783243] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T19:21:39.317692] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-22T19:21:39.683337] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-22T19:21:40.117626] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-22T19:21:40.269908] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T19:21:40.917681] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-22T19:21:41.363587] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T19:21:41.367495] [INFO ] [REMOTE ] IHG: Full fetch complete (34294 records). [2025-10-22T19:21:41.367575] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-22T19:21:41.560463] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T19:21:41.726213] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-22T19:21:41.769837] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-22T19:21:41.769958] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-22T19:21:41.770743] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-22T19:21:41.770815] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-22T19:21:41.771912] [DEBUG] [LOCAL ] IHG: Trimmed 34294 records to 23951 (keeping 200 days of data) [2025-10-22T19:21:41.924019] [DEBUG] [LOCAL ] IHG: Primary data saved (23951 records). [2025-10-22T19:21:41.924144] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-22T19:21:41.924218] [INFO ] [MAIN ] Update Progress: 1101/2367 symbols completed. IHG took 31.3s. Estimated remaining: 2h 42m 51s. Rate: 7.8 symbols/min [2025-10-22T19:21:42.095447] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:42.112199] [DEBUG] [LOCAL ] IIM: Loaded 15540 existing records from primary storage. [2025-10-22T19:21:42.112464] [INFO ] [MAIN ] IIM: Loaded 15540 existing records. [2025-10-22T19:21:42.285680] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:42.285879] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-22T19:21:42.285925] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-22T19:21:42.286304] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-22T19:21:42.286360] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-22T19:21:42.524385] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-22T19:21:42.653230] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:21:42.921527] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T19:21:43.317689] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-22T19:21:44.052669] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T19:21:44.117706] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-22T19:21:44.388021] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T19:21:44.917686] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-22T19:21:44.938223] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-22T19:21:45.717633] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-22T19:21:46.006894] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T19:21:46.516504] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T19:21:46.521829] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-22T19:21:47.241537] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-22T19:21:47.317637] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-22T19:21:48.117680] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-22T19:21:48.374285] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T19:21:48.377493] [INFO ] [REMOTE ] IIIN: Full fetch complete (24936 records). [2025-10-22T19:21:48.377573] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-22T19:21:48.787410] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-22T19:21:48.787491] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-22T19:21:48.788136] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-22T19:21:48.788199] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-22T19:21:48.788965] [DEBUG] [LOCAL ] IIIN: Trimmed 24936 records to 16243 (keeping 200 days of data) [2025-10-22T19:21:48.891496] [DEBUG] [LOCAL ] IIIN: Primary data saved (16243 records). [2025-10-22T19:21:48.891639] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-22T19:21:48.891764] [INFO ] [MAIN ] Update Progress: 1102/2367 symbols completed. IIIN took 26.9s. Estimated remaining: 2h 42m 42s. Rate: 7.8 symbols/min [2025-10-22T19:21:48.923490] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-22T19:21:49.062895] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:49.090500] [DEBUG] [LOCAL ] IIPR: Loaded 28934 existing records from primary storage. [2025-10-22T19:21:49.101929] [INFO ] [MAIN ] IIPR: Loaded 28934 existing records. [2025-10-22T19:21:49.182210] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-22T19:21:49.290221] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:49.290484] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-22T19:21:49.290533] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-22T19:21:49.290752] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-22T19:21:49.290808] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-22T19:21:49.658055] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:21:49.717615] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-22T19:21:50.522827] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-22T19:21:50.536671] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T19:21:50.815146] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T19:21:51.317666] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-22T19:21:51.510973] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T19:21:51.914201] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T19:21:52.117637] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-22T19:21:52.917753] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-22T19:21:53.243622] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-22T19:21:53.320112] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T19:21:53.717757] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-22T19:21:54.517638] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-22T19:21:54.602115] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T19:21:55.317618] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-22T19:21:55.790188] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-22T19:21:56.117669] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-22T19:21:56.761439] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T19:21:56.917717] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-22T19:21:57.434822] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T19:21:57.439858] [INFO ] [REMOTE ] IHS: Full fetch complete (51648 records). [2025-10-22T19:21:57.439962] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-22T19:21:57.722749] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-22T19:21:57.827158] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-22T19:21:57.827231] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-22T19:21:57.827999] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-22T19:21:57.828059] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-22T19:21:57.829045] [DEBUG] [LOCAL ] IHS: Trimmed 51648 records to 37211 (keeping 200 days of data) [2025-10-22T19:21:58.030692] [DEBUG] [LOCAL ] IHS: Primary data saved (37211 records). [2025-10-22T19:21:58.030819] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-22T19:21:58.030894] [INFO ] [MAIN ] Update Progress: 1103/2367 symbols completed. IHS took 41.7s. Estimated remaining: 2h 42m 36s. Rate: 7.8 symbols/min [2025-10-22T19:21:58.198003] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:58.236039] [DEBUG] [LOCAL ] IMAX: Loaded 43469 existing records from primary storage. [2025-10-22T19:21:58.236325] [INFO ] [MAIN ] IMAX: Loaded 43469 existing records. [2025-10-22T19:21:58.419078] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:58.419398] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-22T19:21:58.419457] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-22T19:21:58.419670] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-22T19:21:58.419742] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-22T19:21:58.518097] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-22T19:21:58.708851] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T19:21:58.799780] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T19:21:58.819039] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:21:59.101270] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-22T19:21:59.102300] [INFO ] [REMOTE ] IIF: Full fetch complete (8848 records). [2025-10-22T19:21:59.102367] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-22T19:21:59.322838] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-22T19:21:59.473997] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-22T19:21:59.474105] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-22T19:21:59.474341] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-22T19:21:59.474381] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-22T19:21:59.474799] [DEBUG] [LOCAL ] IIF: Trimmed 8848 records to 5278 (keeping 200 days of data) [2025-10-22T19:21:59.504551] [DEBUG] [LOCAL ] IIF: Primary data saved (5278 records). [2025-10-22T19:21:59.504628] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-22T19:21:59.504732] [INFO ] [MAIN ] Update Progress: 1104/2367 symbols completed. IIF took 38.9s. Estimated remaining: 2h 42m 21s. Rate: 7.8 symbols/min [2025-10-22T19:21:59.670382] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:21:59.714429] [DEBUG] [LOCAL ] INFA: Loaded 48721 existing records from primary storage. [2025-10-22T19:21:59.714744] [INFO ] [MAIN ] INFA: Loaded 48721 existing records. [2025-10-22T19:21:59.894877] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:21:59.895083] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-22T19:21:59.895151] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-22T19:21:59.895355] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-22T19:21:59.895397] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-22T19:22:00.129445] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-22T19:22:00.258545] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:22:00.725964] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T19:22:00.917687] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-22T19:22:01.141333] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T19:22:01.717780] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-22T19:22:02.302513] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T19:22:02.517712] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-22T19:22:03.074281] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-22T19:22:03.317685] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-22T19:22:03.764896] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T19:22:04.117702] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-22T19:22:04.828980] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T19:22:04.917821] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-22T19:22:05.610119] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T19:22:05.717710] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-22T19:22:06.359906] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T19:22:06.425854] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-22T19:22:06.517619] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-22T19:22:07.317707] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-22T19:22:08.028610] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T19:22:08.117666] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-22T19:22:08.917703] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-22T19:22:09.021543] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T19:22:09.717987] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-22T19:22:09.724680] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-22T19:22:10.290322] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T19:22:10.517700] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-22T19:22:11.101626] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T19:22:11.317949] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-22T19:22:12.117708] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-22T19:22:12.261605] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T19:22:12.266860] [INFO ] [REMOTE ] IIPR: Full fetch complete (43789 records). [2025-10-22T19:22:12.266960] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-22T19:22:12.685736] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-22T19:22:12.685824] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-22T19:22:12.686521] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-22T19:22:12.686563] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-22T19:22:12.687607] [DEBUG] [LOCAL ] IIPR: Trimmed 43789 records to 28846 (keeping 200 days of data) [2025-10-22T19:22:12.877140] [DEBUG] [LOCAL ] IIPR: Primary data saved (28846 records). [2025-10-22T19:22:12.877267] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-22T19:22:12.877345] [INFO ] [MAIN ] Update Progress: 1105/2367 symbols completed. IIPR took 24.0s. Estimated remaining: 2h 42m 20s. Rate: 7.8 symbols/min [2025-10-22T19:22:12.933876] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-22T19:22:13.070810] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:22:13.104789] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T19:22:13.151110] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T19:22:13.175302] [DEBUG] [LOCAL ] INFY: Loaded 53596 existing records from primary storage. [2025-10-22T19:22:13.175626] [INFO ] [MAIN ] INFY: Loaded 53596 existing records. [2025-10-22T19:22:13.385199] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:22:13.385419] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-22T19:22:13.385467] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-22T19:22:13.385737] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-22T19:22:13.385795] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-22T19:22:13.722737] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-22T19:22:13.761856] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:22:14.292799] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T19:22:14.517634] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-22T19:22:14.820268] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T19:22:14.823261] [INFO ] [REMOTE ] IIM: Full fetch complete (24952 records). [2025-10-22T19:22:14.823333] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-22T19:22:15.190493] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-22T19:22:15.190605] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-22T19:22:15.191265] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-22T19:22:15.191329] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-22T19:22:15.192225] [DEBUG] [LOCAL ] IIM: Trimmed 24952 records to 15480 (keeping 200 days of data) [2025-10-22T19:22:15.290329] [DEBUG] [LOCAL ] IIM: Primary data saved (15480 records). [2025-10-22T19:22:15.290467] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-22T19:22:15.290548] [INFO ] [MAIN ] Update Progress: 1106/2367 symbols completed. IIM took 33.4s. Estimated remaining: 2h 42m 6s. Rate: 7.8 symbols/min [2025-10-22T19:22:15.322815] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-22T19:22:15.462517] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:22:15.462719] [DEBUG] [LOCAL ] ING: No existing data file found in primary storage. [2025-10-22T19:22:15.462768] [WARN ] [MAIN ] ING: No existing data found, performing full refresh instead. [2025-10-22T19:22:15.462879] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-22T19:22:15.462920] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-22T19:22:15.462961] [DEBUG] [LOCAL ] ING: No primary data file found to delete. [2025-10-22T19:22:15.462993] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-22T19:22:15.818826] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:22:16.117622] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-22T19:22:16.162401] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T19:22:16.917684] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-22T19:22:17.199856] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T19:22:17.622304] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T19:22:17.717674] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-22T19:22:18.302474] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T19:22:18.517772] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-22T19:22:19.039157] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T19:22:19.317686] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-22T19:22:20.117694] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-22T19:22:20.166286] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T19:22:20.822192] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T19:22:20.917631] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-22T19:22:21.619970] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T19:22:21.717688] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-22T19:22:22.523588] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-22T19:22:22.545083] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T19:22:23.317846] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-22T19:22:23.444857] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T19:22:24.117691] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-22T19:22:24.189538] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T19:22:24.922021] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-22T19:22:24.927298] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T19:22:24.935408] [INFO ] [REMOTE ] IMAX: Full fetch complete (61116 records). [2025-10-22T19:22:24.935576] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-22T19:22:25.352146] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-22T19:22:25.352254] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-22T19:22:25.353187] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-22T19:22:25.353253] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-22T19:22:25.354497] [DEBUG] [LOCAL ] IMAX: Trimmed 61116 records to 43444 (keeping 200 days of data) [2025-10-22T19:22:25.607066] [DEBUG] [LOCAL ] IMAX: Primary data saved (43444 records). [2025-10-22T19:22:25.607257] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-22T19:22:25.607958] [INFO ] [MAIN ] Update Progress: 1107/2367 symbols completed. IMAX took 27.6s. Estimated remaining: 2h 42m 1s. Rate: 7.8 symbols/min [2025-10-22T19:22:25.719611] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-22T19:22:25.818320] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:22:25.820997] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T19:22:25.860298] [DEBUG] [LOCAL ] INGM: Loaded 28216 existing records from primary storage. [2025-10-22T19:22:25.860563] [INFO ] [MAIN ] INGM: Loaded 28216 existing records. [2025-10-22T19:22:26.066997] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:22:26.067226] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-22T19:22:26.067273] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-22T19:22:26.067603] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-22T19:22:26.067687] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-22T19:22:26.421536] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:22:26.517613] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-22T19:22:26.714634] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T19:22:27.317694] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-22T19:22:27.401661] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T19:22:27.941582] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T19:22:28.117618] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-22T19:22:28.514886] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T19:22:28.917688] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-22T19:22:29.717689] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-22T19:22:29.855696] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T19:22:30.517718] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-22T19:22:30.787237] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T19:22:30.814289] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T19:22:31.317678] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-22T19:22:32.117624] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-22T19:22:32.245390] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T19:22:32.743796] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T19:22:32.917626] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-22T19:22:33.644558] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T19:22:33.651460] [INFO ] [REMOTE ] INFA: Full fetch complete (70746 records). [2025-10-22T19:22:33.651582] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-22T19:22:33.722815] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-22T19:22:34.064489] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-22T19:22:34.064572] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-22T19:22:34.065569] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-22T19:22:34.065635] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-22T19:22:34.067495] [DEBUG] [LOCAL ] INFA: Trimmed 70746 records to 48602 (keeping 200 days of data) [2025-10-22T19:22:34.353689] [DEBUG] [LOCAL ] INFA: Primary data saved (48602 records). [2025-10-22T19:22:34.353849] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-22T19:22:34.353952] [INFO ] [MAIN ] Update Progress: 1108/2367 symbols completed. INFA took 34.8s. Estimated remaining: 2h 41m 55s. Rate: 7.8 symbols/min [2025-10-22T19:22:34.519327] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-22T19:22:34.544913] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:22:34.579902] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T19:22:34.619396] [DEBUG] [LOCAL ] INGR: Loaded 33761 existing records from primary storage. [2025-10-22T19:22:34.619711] [INFO ] [MAIN ] INGR: Loaded 33761 existing records. [2025-10-22T19:22:34.805405] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:22:34.805624] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-22T19:22:34.805703] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-22T19:22:34.805888] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-22T19:22:34.805926] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-22T19:22:35.185751] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:22:35.205776] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T19:22:35.317621] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-22T19:22:36.000183] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T19:22:36.117618] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-22T19:22:36.632015] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T19:22:36.917630] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-22T19:22:37.717716] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-22T19:22:37.844395] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T19:22:38.304058] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T19:22:38.517716] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-22T19:22:39.173334] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-22T19:22:39.317676] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-22T19:22:39.705123] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T19:22:40.117688] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-22T19:22:40.917717] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-22T19:22:41.071501] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T19:22:41.717761] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-22T19:22:41.843180] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T19:22:42.215947] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T19:22:42.517770] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-22T19:22:43.317684] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-22T19:22:43.490305] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T19:22:44.117676] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-22T19:22:44.202455] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T19:22:44.211111] [INFO ] [REMOTE ] ING: Full fetch complete (73825 records). [2025-10-22T19:22:44.211254] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-22T19:22:44.353099] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T19:22:44.621225] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-22T19:22:44.621316] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-22T19:22:44.622228] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-22T19:22:44.622292] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-22T19:22:44.623723] [DEBUG] [LOCAL ] ING: Trimmed 73825 records to 50701 (keeping 200 days of data) [2025-10-22T19:22:44.917717] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-22T19:22:44.930633] [DEBUG] [LOCAL ] ING: Primary data saved (50701 records). [2025-10-22T19:22:44.930811] [INFO ] [MAIN ] ING: Full history saved. [2025-10-22T19:22:44.930889] [INFO ] [MAIN ] Update Progress: 1109/2367 symbols completed. ING took 29.6s. Estimated remaining: 2h 41m 50s. Rate: 7.8 symbols/min [2025-10-22T19:22:45.103961] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:22:45.140164] [DEBUG] [LOCAL ] INN: Loaded 41558 existing records from primary storage. [2025-10-22T19:22:45.140458] [INFO ] [MAIN ] INN: Loaded 41558 existing records. [2025-10-22T19:22:45.316366] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:22:45.317233] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-22T19:22:45.317287] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-22T19:22:45.317519] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-22T19:22:45.317558] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-22T19:22:45.683195] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:22:45.717633] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-22T19:22:45.883785] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T19:22:46.091828] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T19:22:46.517709] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-22T19:22:47.197968] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T19:22:47.317633] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-22T19:22:47.628582] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-22T19:22:48.117718] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-22T19:22:48.917688] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-22T19:22:49.042076] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T19:22:49.485930] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T19:22:49.719053] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-22T19:22:49.722928] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-22T19:22:50.517763] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-22T19:22:51.018046] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-22T19:22:51.023040] [INFO ] [REMOTE ] INGM: Full fetch complete (41820 records). [2025-10-22T19:22:51.023162] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-22T19:22:51.322928] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-22T19:22:51.398026] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-22T19:22:51.398105] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-22T19:22:51.398791] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-22T19:22:51.398853] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-22T19:22:51.399723] [DEBUG] [LOCAL ] INGM: Trimmed 41820 records to 28088 (keeping 200 days of data) [2025-10-22T19:22:51.569889] [DEBUG] [LOCAL ] INGM: Primary data saved (28088 records). [2025-10-22T19:22:51.570026] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-22T19:22:51.570125] [INFO ] [MAIN ] Update Progress: 1110/2367 symbols completed. INGM took 26.0s. Estimated remaining: 2h 41m 41s. Rate: 7.8 symbols/min [2025-10-22T19:22:51.738042] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:22:51.738241] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-22T19:22:51.738284] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-22T19:22:51.738399] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-22T19:22:51.738440] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-22T19:22:51.738482] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-22T19:22:51.738514] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-22T19:22:52.113557] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:22:52.117617] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-10-22T19:22:52.248710] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T19:22:52.261603] [INFO ] [REMOTE ] INFY: Full fetch complete (77747 records). [2025-10-22T19:22:52.261857] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-22T19:22:52.706341] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-22T19:22:52.706477] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-22T19:22:52.707558] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-22T19:22:52.707812] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-22T19:22:52.709411] [DEBUG] [LOCAL ] INFY: Trimmed 77747 records to 53596 (keeping 200 days of data) [2025-10-22T19:22:52.801785] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-22T19:22:52.845552] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T19:22:52.919060] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-22T19:22:53.074182] [DEBUG] [LOCAL ] INFY: Primary data saved (53596 records). [2025-10-22T19:22:53.074316] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-22T19:22:53.074396] [INFO ] [MAIN ] Update Progress: 1111/2367 symbols completed. INFY took 40.2s. Estimated remaining: 2h 41m 27s. Rate: 7.8 symbols/min [2025-10-22T19:22:53.241209] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:22:53.276576] [DEBUG] [LOCAL ] INSP: Loaded 38568 existing records from primary storage. [2025-10-22T19:22:53.276871] [INFO ] [MAIN ] INSP: Loaded 38568 existing records. [2025-10-22T19:22:53.479051] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:22:53.479231] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-22T19:22:53.479285] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-22T19:22:53.479464] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-22T19:22:53.479522] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-22T19:22:53.722734] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-22T19:22:53.850024] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:22:54.285734] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-22T19:22:54.517769] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-10-22T19:22:55.189026] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T19:22:55.317697] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-22T19:22:55.861073] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T19:22:56.117719] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-22T19:22:56.613957] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T19:22:56.917674] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-22T19:22:57.466299] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T19:22:57.717716] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-22T19:22:58.360939] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T19:22:58.517619] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-22T19:22:59.085434] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T19:22:59.317691] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-10-22T19:22:59.958581] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-22T19:23:00.117710] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-22T19:23:00.917626] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-22T19:23:01.717754] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-22T19:23:04.748517] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (4.63 seconds). [2025-10-22T19:23:04.755442] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-22T19:23:05.599055] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (6.28 seconds). [2025-10-22T19:23:05.607024] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-10-22T19:23:05.678872] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (4.76 seconds). [2025-10-22T19:23:05.686066] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-22T19:23:06.011611] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (4.29 seconds). [2025-10-22T19:23:06.021408] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-22T19:23:06.087785] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-22T19:23:06.094757] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-22T19:23:06.695722] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-22T19:23:06.701382] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-10-22T19:23:06.990105] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-22T19:23:07.317634] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-22T19:23:07.375018] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-22T19:23:07.490865] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T19:23:07.518583] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T19:23:08.117677] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-10-22T19:23:08.759634] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T19:23:08.917640] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-22T19:23:09.241449] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T19:23:09.717639] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-10-22T19:23:10.135633] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T19:23:10.517697] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-22T19:23:11.013462] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-22T19:23:11.317700] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-22T19:23:12.041891] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T19:23:12.117619] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-22T19:23:12.789561] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-22T19:23:12.917610] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-22T19:23:13.717764] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-10-22T19:23:13.811204] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T19:23:14.360157] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T19:23:14.517625] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-22T19:23:14.933536] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-22T19:23:15.317703] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-10-22T19:23:16.054403] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T19:23:16.061026] [INFO ] [REMOTE ] INN: Full fetch complete (57660 records). [2025-10-22T19:23:16.061129] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-22T19:23:16.126359] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-22T19:23:16.376975] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T19:23:16.497269] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-22T19:23:16.497339] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-22T19:23:16.498174] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-22T19:23:16.498237] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-22T19:23:16.499536] [DEBUG] [LOCAL ] INN: Trimmed 57660 records to 41470 (keeping 200 days of data) [2025-10-22T19:23:16.727339] [DEBUG] [LOCAL ] INN: Primary data saved (41470 records). [2025-10-22T19:23:16.727466] [INFO ] [MAIN ] INN: Full history saved. [2025-10-22T19:23:16.727541] [INFO ] [MAIN ] Update Progress: 1112/2367 symbols completed. INN took 31.8s. Estimated remaining: 2h 41m 37s. Rate: 7.8 symbols/min [2025-10-22T19:23:16.896251] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:23:16.917639] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-22T19:23:16.931822] [DEBUG] [LOCAL ] INSW: Loaded 39351 existing records from primary storage. [2025-10-22T19:23:16.932076] [INFO ] [MAIN ] INSW: Loaded 39351 existing records. [2025-10-22T19:23:17.105251] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:23:17.105473] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-22T19:23:17.105519] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-22T19:23:17.105740] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-22T19:23:17.105795] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-22T19:23:17.469378] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:23:17.717698] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-22T19:23:17.824263] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T19:23:18.523159] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-22T19:23:18.535533] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-22T19:23:18.542358] [INFO ] [REMOTE ] INGR: Full fetch complete (50794 records). [2025-10-22T19:23:18.542459] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-22T19:23:18.972748] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-22T19:23:18.972872] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-22T19:23:18.974137] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-22T19:23:18.974225] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-22T19:23:18.975801] [DEBUG] [LOCAL ] INGR: Trimmed 50794 records to 33764 (keeping 200 days of data) [2025-10-22T19:23:19.101100] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T19:23:19.241851] [DEBUG] [LOCAL ] INGR: Primary data saved (33764 records). [2025-10-22T19:23:19.242130] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-22T19:23:19.242245] [INFO ] [MAIN ] Update Progress: 1113/2367 symbols completed. INGR took 44.9s. Estimated remaining: 2h 41m 23s. Rate: 7.8 symbols/min [2025-10-22T19:23:19.322808] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-22T19:23:19.423866] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:23:19.482575] [DEBUG] [LOCAL ] INVH: Loaded 53194 existing records from primary storage. [2025-10-22T19:23:19.483102] [INFO ] [MAIN ] INVH: Loaded 53194 existing records. [2025-10-22T19:23:19.674922] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:23:19.675428] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-22T19:23:19.675479] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-22T19:23:19.675957] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-22T19:23:19.676016] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-22T19:23:20.074867] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:23:20.117623] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-22T19:23:20.179241] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T19:23:20.186921] [INFO ] [REMOTE ] INSP: Full fetch complete (53886 records). [2025-10-22T19:23:20.187100] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-22T19:23:20.635261] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-22T19:23:20.635396] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-22T19:23:20.636563] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-22T19:23:20.636782] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-22T19:23:20.638988] [DEBUG] [LOCAL ] INSP: Trimmed 53886 records to 38560 (keeping 200 days of data) [2025-10-22T19:23:20.730509] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-22T19:23:20.918141] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-22T19:23:20.918327] [DEBUG] [LOCAL ] INSP: Primary data saved (38560 records). [2025-10-22T19:23:20.920021] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-22T19:23:20.920148] [INFO ] [MAIN ] Update Progress: 1114/2367 symbols completed. INSP took 27.8s. Estimated remaining: 2h 41m 9s. Rate: 7.8 symbols/min [2025-10-22T19:23:21.087059] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:23:21.120508] [DEBUG] [LOCAL ] INVX: Loaded 29141 existing records from primary storage. [2025-10-22T19:23:21.120910] [INFO ] [MAIN ] INVX: Loaded 29141 existing records. [2025-10-22T19:23:21.303164] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:23:21.303749] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-22T19:23:21.303863] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-22T19:23:21.304276] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-22T19:23:21.304365] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-22T19:23:21.677798] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:23:21.721796] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-10. [2025-10-22T19:23:21.733147] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T19:23:22.517718] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-22T19:23:22.591529] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T19:23:23.169752] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T19:23:23.175264] [INFO ] [REMOTE ] INR: Full fetch complete (37245 records). [2025-10-22T19:23:23.175461] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-10-22T19:23:23.327016] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-22T19:23:23.383677] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-22T19:23:23.384340] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:23:23.384422] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:23:23.384504] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-22T19:23:23.384593] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-22T19:23:23.384636] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-22T19:23:23.384729] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-22T19:23:23.384825] [INFO ] [MAIN ] Update Progress: 1115/2367 symbols completed. INR took 31.8s. Estimated remaining: 2h 40m 55s. Rate: 7.8 symbols/min [2025-10-22T19:23:23.571536] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:23:23.629319] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-22T19:23:23.629818] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-22T19:23:23.826915] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:23:23.827498] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-22T19:23:23.827579] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-22T19:23:23.828094] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-22T19:23:23.828162] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-22T19:23:23.934446] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T19:23:24.127775] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-22T19:23:24.268538] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:23:24.879703] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T19:23:24.917628] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-22T19:23:25.431282] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-22T19:23:25.717687] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-22T19:23:26.470839] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T19:23:26.517605] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-22T19:23:27.317752] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-22T19:23:27.910868] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T19:23:28.117616] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-22T19:23:28.327584] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-22T19:23:28.490035] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T19:23:28.917768] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-22T19:23:29.701981] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T19:23:29.717610] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-22T19:23:30.045094] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T19:23:30.517703] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-22T19:23:31.317670] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-22T19:23:31.511199] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T19:23:32.117723] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-22T19:23:32.703491] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T19:23:32.917716] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-22T19:23:33.234148] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-10-22T19:23:33.717617] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-22T19:23:33.916465] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T19:23:34.152592] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T19:23:34.517694] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-22T19:23:35.317750] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-22T19:23:35.803097] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-22T19:23:36.117623] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-22T19:23:36.499419] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-10-22T19:23:36.864815] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T19:23:36.917692] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-22T19:23:37.380602] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T19:23:37.717702] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-22T19:23:38.517663] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-22T19:23:38.843674] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T19:23:39.317627] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-22T19:23:39.591293] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-10-22T19:23:40.068362] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T19:23:40.119025] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-22T19:23:40.123758] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T19:23:40.917761] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-22T19:23:41.717619] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-22T19:23:41.916687] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T19:23:42.340747] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T19:23:42.517705] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-22T19:23:42.995306] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T19:23:42.999849] [INFO ] [REMOTE ] INVX: Full fetch complete (42835 records). [2025-10-22T19:23:42.999972] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-22T19:23:43.322848] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-22T19:23:43.378323] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-22T19:23:43.378401] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-22T19:23:43.379211] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-22T19:23:43.379331] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-22T19:23:43.380400] [DEBUG] [LOCAL ] INVX: Trimmed 42835 records to 29045 (keeping 200 days of data) [2025-10-22T19:23:43.544755] [DEBUG] [LOCAL ] INVX: Primary data saved (29045 records). [2025-10-22T19:23:43.544888] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-22T19:23:43.544967] [INFO ] [MAIN ] Update Progress: 1116/2367 symbols completed. INVX took 22.6s. Estimated remaining: 2h 41m 2s. Rate: 7.8 symbols/min [2025-10-22T19:23:43.718307] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:23:43.766215] [DEBUG] [LOCAL ] IOT: Loaded 53478 existing records from primary storage. [2025-10-22T19:23:43.766514] [INFO ] [MAIN ] IOT: Loaded 53478 existing records. [2025-10-22T19:23:43.949512] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:23:43.949858] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-22T19:23:43.949942] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-22T19:23:43.950283] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-22T19:23:43.950342] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-22T19:23:44.146089] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-22T19:23:44.192942] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T19:23:44.276274] [INFO ] [REMOTE ] INSW: Full fetch complete (59507 records). [2025-10-22T19:23:44.286820] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-22T19:23:44.415846] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:23:44.746120] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-22T19:23:44.746229] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-22T19:23:44.747230] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-22T19:23:44.747314] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-22T19:23:44.748939] [DEBUG] [LOCAL ] INSW: Trimmed 59507 records to 39208 (keeping 200 days of data) [2025-10-22T19:23:44.919681] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-22T19:23:44.987620] [DEBUG] [LOCAL ] INSW: Primary data saved (39208 records). [2025-10-22T19:23:44.988094] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-22T19:23:44.988208] [INFO ] [MAIN ] Update Progress: 1117/2367 symbols completed. INSW took 28.3s. Estimated remaining: 2h 40m 47s. Rate: 7.8 symbols/min [2025-10-22T19:23:45.160148] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T19:23:45.717687] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-22T19:23:46.709848] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T19:23:46.722144] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-22T19:23:46.915909] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-22T19:23:47.317704] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-22T19:23:47.462121] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T19:23:48.117627] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-22T19:23:48.580469] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T19:23:48.917685] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-22T19:23:49.685050] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-22T19:23:49.717764] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-22T19:23:49.792353] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T19:23:50.517717] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-22T19:23:50.966084] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T19:23:51.317770] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-22T19:23:52.383541] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T19:23:52.392231] [INFO ] [REMOTE ] INVH: Full fetch complete (76993 records). [2025-10-22T19:23:52.392364] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-22T19:23:52.840912] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (3.12 seconds). [2025-10-22T19:23:52.841227] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-22T19:23:52.853397] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-22T19:23:52.855711] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-22T19:23:52.856086] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-22T19:23:52.856983] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-22T19:23:52.860398] [DEBUG] [LOCAL ] INVH: Trimmed 76993 records to 53194 (keeping 200 days of data) [2025-10-22T19:23:53.134838] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T19:23:53.203808] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-22T19:23:53.226635] [DEBUG] [LOCAL ] INVH: Primary data saved (53194 records). [2025-10-22T19:23:53.226750] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-22T19:23:53.226823] [INFO ] [MAIN ] Update Progress: 1118/2367 symbols completed. INVH took 34.0s. Estimated remaining: 2h 40m 40s. Rate: 7.8 symbols/min [2025-10-22T19:23:54.973042] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T19:23:54.984209] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-22T19:23:55.672011] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-10-22T19:23:55.684916] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-22T19:23:56.903180] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-22T19:23:56.914322] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-22T19:23:58.349244] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-22T19:23:58.361714] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-22T19:23:58.780816] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T19:23:58.792840] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-22T19:24:00.744978] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-22T19:24:00.756318] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-22T19:24:01.641072] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (3.28 seconds). [2025-10-22T19:24:01.650609] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-22T19:24:01.650817] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-22T19:24:02.055338] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-22T19:24:02.055452] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-22T19:24:02.056438] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-22T19:24:02.056501] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-22T19:24:02.057972] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-22T19:24:02.372770] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-22T19:24:02.372905] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-22T19:24:02.373437] [INFO ] [MAIN ] Update Progress: 1119/2367 symbols completed. IONQ took 39.0s. Estimated remaining: 2h 40m 34s. Rate: 7.8 symbols/min [2025-10-22T19:24:02.735277] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T19:24:02.746851] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-22T19:24:04.801054] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-22T19:24:04.809590] [INFO ] [REMOTE ] IOT: Full fetch complete (77551 records). [2025-10-22T19:24:04.809733] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-22T19:24:05.195234] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-22T19:24:05.195308] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-22T19:24:05.196363] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-22T19:24:05.196427] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-22T19:24:05.197936] [DEBUG] [LOCAL ] IOT: Trimmed 77551 records to 53475 (keeping 200 days of data) [2025-10-22T19:24:05.501100] [DEBUG] [LOCAL ] IOT: Primary data saved (53475 records). [2025-10-22T19:24:05.501255] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-22T19:24:05.501350] [INFO ] [MAIN ] Update Progress: 1120/2367 symbols completed. IOT took 22.0s. Estimated remaining: 2h 40m 21s. Rate: 7.8 symbols/min [2025-10-22T19:24:06.081212] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:06.135865] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:06.189175] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:06.187673] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:06.213852] [DEBUG] [LOCAL ] IPI: Loaded 21499 existing records from primary storage. [2025-10-22T19:24:06.214205] [INFO ] [MAIN ] IPI: Loaded 21499 existing records. [2025-10-22T19:24:06.256282] [DEBUG] [LOCAL ] IQI: Loaded 17852 existing records from primary storage. [2025-10-22T19:24:06.286116] [INFO ] [MAIN ] IQI: Loaded 17852 existing records. [2025-10-22T19:24:06.549171] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-22T19:24:06.584881] [INFO ] [MAIN ] IPG: Loaded 53330 existing records. [2025-10-22T19:24:06.676907] [DEBUG] [LOCAL ] IP: Loaded 53304 existing records from primary storage. [2025-10-22T19:24:06.683302] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:06.713569] [INFO ] [MAIN ] IP: Loaded 53304 existing records. [2025-10-22T19:24:06.713451] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-22T19:24:06.728176] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-22T19:24:06.783497] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:06.783617] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-22T19:24:06.834004] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-22T19:24:06.848466] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-22T19:24:06.950265] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-22T19:24:07.065793] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-22T19:24:07.084581] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-22T19:24:07.079363] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:07.106636] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-22T19:24:07.115379] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-22T19:24:07.126254] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-22T19:24:07.224569] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-22T19:24:07.402071] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:07.484232] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-22T19:24:07.534830] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-22T19:24:07.599926] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-22T19:24:07.608975] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-22T19:24:07.966955] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:08.005058] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-22T19:24:08.409306] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:08.467829] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-22T19:24:08.568174] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:08.592074] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-22T19:24:08.678236] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:08.678588] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-22T19:24:09.026109] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-22T19:24:09.030187] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-22T19:24:09.583270] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T19:24:09.588330] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-22T19:24:10.142766] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T19:24:10.147326] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-22T19:24:10.354695] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T19:24:10.365743] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-22T19:24:10.408573] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T19:24:10.420525] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-22T19:24:10.435877] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-22T19:24:10.441467] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-22T19:24:11.291745] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T19:24:11.298245] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-22T19:24:11.382555] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T19:24:11.386373] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-22T19:24:11.913438] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T19:24:11.924913] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-22T19:24:12.008326] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T19:24:12.018794] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-22T19:24:12.104859] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-22T19:24:12.111152] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-22T19:24:12.128034] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-22T19:24:12.133949] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-22T19:24:13.011387] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-22T19:24:13.015478] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-22T19:24:13.101442] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-22T19:24:13.107524] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-22T19:24:13.771398] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T19:24:13.784113] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-22T19:24:13.812957] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T19:24:13.844120] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T19:24:14.015661] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T19:24:14.517716] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-22T19:24:15.317762] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-22T19:24:15.799958] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T19:24:16.117636] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-22T19:24:16.315447] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T19:24:16.317470] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T19:24:16.917775] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-22T19:24:17.717670] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-22T19:24:17.921906] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T19:24:17.980269] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T19:24:18.517687] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-22T19:24:18.802487] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-22T19:24:19.317634] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-22T19:24:20.127064] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-22T19:24:20.133678] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T19:24:20.295780] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-22T19:24:20.917683] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-22T19:24:21.201984] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-22T19:24:21.717687] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-22T19:24:21.860916] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T19:24:21.863841] [INFO ] [REMOTE ] IQI: Full fetch complete (26407 records). [2025-10-22T19:24:21.863924] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-22T19:24:22.238159] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-22T19:24:22.238257] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-22T19:24:22.238841] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-22T19:24:22.238909] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-22T19:24:22.239792] [DEBUG] [LOCAL ] IQI: Trimmed 26407 records to 17764 (keeping 200 days of data) [2025-10-22T19:24:22.342670] [DEBUG] [LOCAL ] IQI: Primary data saved (17764 records). [2025-10-22T19:24:22.342809] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-22T19:24:22.342893] [INFO ] [MAIN ] Update Progress: 1121/2367 symbols completed. IQI took 16.8s. Estimated remaining: 2h 40m 23s. Rate: 7.8 symbols/min [2025-10-22T19:24:22.509727] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:22.517722] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-22T19:24:22.554722] [DEBUG] [LOCAL ] IQV: Loaded 50013 existing records from primary storage. [2025-10-22T19:24:22.555015] [INFO ] [MAIN ] IQV: Loaded 50013 existing records. [2025-10-22T19:24:22.727412] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:22.727590] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-22T19:24:22.727637] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-22T19:24:22.727893] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-22T19:24:22.727949] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-22T19:24:23.072848] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:23.317704] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-22T19:24:23.538339] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T19:24:23.635520] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-22T19:24:24.117693] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-22T19:24:24.917635] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-22T19:24:24.978206] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T19:24:25.717691] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-22T19:24:26.065056] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T19:24:26.517718] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-22T19:24:26.679858] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T19:24:27.038546] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T19:24:27.045963] [INFO ] [REMOTE ] IPI: Full fetch complete (30308 records). [2025-10-22T19:24:27.046208] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-22T19:24:27.324070] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-22T19:24:27.454719] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-22T19:24:27.454826] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-22T19:24:27.455780] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-22T19:24:27.455848] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-22T19:24:27.457029] [DEBUG] [LOCAL ] IPI: Trimmed 30308 records to 21414 (keeping 200 days of data) [2025-10-22T19:24:27.593170] [DEBUG] [LOCAL ] IPI: Primary data saved (21414 records). [2025-10-22T19:24:27.593392] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-22T19:24:27.593534] [INFO ] [MAIN ] Update Progress: 1122/2367 symbols completed. IPI took 22.1s. Estimated remaining: 2h 40m 13s. Rate: 7.8 symbols/min [2025-10-22T19:24:27.777186] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:27.832498] [DEBUG] [LOCAL ] IR: Loaded 52756 existing records from primary storage. [2025-10-22T19:24:27.833134] [INFO ] [MAIN ] IR: Loaded 52756 existing records. [2025-10-22T19:24:28.029858] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:28.030288] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-22T19:24:28.030374] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-22T19:24:28.031060] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-22T19:24:28.031127] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-22T19:24:28.122284] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-22T19:24:28.173147] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T19:24:28.455621] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:28.917769] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-22T19:24:29.114600] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T19:24:29.717759] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-22T19:24:30.089744] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-22T19:24:30.397018] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T19:24:30.517698] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-22T19:24:31.224172] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T19:24:31.317701] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-22T19:24:32.117701] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-22T19:24:32.323836] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T19:24:32.917710] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-22T19:24:32.982240] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T19:24:33.717696] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-22T19:24:33.834088] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-22T19:24:34.517717] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-22T19:24:35.317676] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-22T19:24:35.429139] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T19:24:35.696782] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (2.78 seconds). [2025-10-22T19:24:35.705711] [INFO ] [REMOTE ] IP: Full fetch complete (77414 records). [2025-10-22T19:24:35.705843] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-22T19:24:36.117156] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-22T19:24:36.117256] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-22T19:24:36.118236] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-22T19:24:36.118406] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-22T19:24:36.118523] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-22T19:24:36.120903] [DEBUG] [LOCAL ] IP: Trimmed 77414 records to 53300 (keeping 200 days of data) [2025-10-22T19:24:36.358550] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T19:24:36.480837] [DEBUG] [LOCAL ] IP: Primary data saved (53300 records). [2025-10-22T19:24:36.481030] [INFO ] [MAIN ] IP: Full history saved. [2025-10-22T19:24:36.481121] [INFO ] [MAIN ] Update Progress: 1123/2367 symbols completed. IP took 31.0s. Estimated remaining: 2h 40m 6s. Rate: 7.8 symbols/min [2025-10-22T19:24:36.652756] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:36.694109] [DEBUG] [LOCAL ] IRM: Loaded 48973 existing records from primary storage. [2025-10-22T19:24:36.694407] [INFO ] [MAIN ] IRM: Loaded 48973 existing records. [2025-10-22T19:24:36.878824] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:36.879052] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-22T19:24:36.879100] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-22T19:24:36.879438] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-22T19:24:36.879495] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-22T19:24:36.925582] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-22T19:24:37.258341] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:37.288063] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-22T19:24:37.717619] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-22T19:24:37.953849] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-22T19:24:38.517692] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-22T19:24:38.731683] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T19:24:39.149259] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T19:24:39.317720] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-22T19:24:40.117695] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-22T19:24:40.359686] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T19:24:40.368513] [INFO ] [REMOTE ] IPG: Full fetch complete (77441 records). [2025-10-22T19:24:40.368699] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-22T19:24:40.767706] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-22T19:24:40.767875] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-22T19:24:40.769083] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-22T19:24:40.769211] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-22T19:24:40.770757] [DEBUG] [LOCAL ] IPG: Trimmed 77441 records to 53330 (keeping 200 days of data) [2025-10-22T19:24:40.918895] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-22T19:24:40.973302] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T19:24:41.149484] [DEBUG] [LOCAL ] IPG: Primary data saved (53330 records). [2025-10-22T19:24:41.149638] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-22T19:24:41.149765] [INFO ] [MAIN ] Update Progress: 1124/2367 symbols completed. IPG took 35.6s. Estimated remaining: 2h 39m 55s. Rate: 7.8 symbols/min [2025-10-22T19:24:41.330863] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:41.354880] [DEBUG] [LOCAL ] IRS: Loaded 23350 existing records from primary storage. [2025-10-22T19:24:41.355197] [INFO ] [MAIN ] IRS: Loaded 23350 existing records. [2025-10-22T19:24:41.548933] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:41.549150] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-22T19:24:41.549198] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-22T19:24:41.549448] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-22T19:24:41.549522] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-22T19:24:41.723539] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-22T19:24:41.946471] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:42.091731] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T19:24:42.517637] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-22T19:24:42.781105] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T19:24:43.317685] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-22T19:24:43.544871] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T19:24:44.117685] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-22T19:24:44.317258] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T19:24:44.482446] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T19:24:44.917762] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-22T19:24:45.604619] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T19:24:45.717615] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-22T19:24:45.925681] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T19:24:46.517685] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-22T19:24:47.317754] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-22T19:24:47.465433] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T19:24:48.070487] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T19:24:48.117660] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-22T19:24:48.298855] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-22T19:24:48.917762] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-22T19:24:49.717676] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-22T19:24:49.907323] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T19:24:49.960691] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-22T19:24:50.517690] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-22T19:24:51.317676] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-22T19:24:51.364090] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T19:24:52.117675] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-22T19:24:52.266192] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T19:24:52.917678] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-22T19:24:53.057768] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T19:24:53.079963] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-22T19:24:53.717687] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-22T19:24:54.517685] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-22T19:24:54.561188] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T19:24:54.749333] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T19:24:55.031986] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-22T19:24:55.040211] [INFO ] [REMOTE ] IQV: Full fetch complete (72555 records). [2025-10-22T19:24:55.040338] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-22T19:24:55.322753] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-22T19:24:55.427256] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-22T19:24:55.427336] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-22T19:24:55.428258] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-22T19:24:55.428321] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-22T19:24:55.429744] [DEBUG] [LOCAL ] IQV: Trimmed 72555 records to 49962 (keeping 200 days of data) [2025-10-22T19:24:55.721610] [DEBUG] [LOCAL ] IQV: Primary data saved (49962 records). [2025-10-22T19:24:55.721764] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-22T19:24:55.721846] [INFO ] [MAIN ] Update Progress: 1125/2367 symbols completed. IQV took 33.4s. Estimated remaining: 2h 39m 55s. Rate: 7.8 symbols/min [2025-10-22T19:24:55.903204] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:24:55.951362] [DEBUG] [LOCAL ] IRT: Loaded 50486 existing records from primary storage. [2025-10-22T19:24:55.951695] [INFO ] [MAIN ] IRT: Loaded 50486 existing records. [2025-10-22T19:24:56.124601] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-22T19:24:56.129898] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:24:56.131051] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-22T19:24:56.131104] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-22T19:24:56.131294] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-22T19:24:56.131334] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-22T19:24:56.480639] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:24:56.914952] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T19:24:56.924175] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-22T19:24:57.371727] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T19:24:57.717687] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-22T19:24:58.517767] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-22T19:24:58.603553] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T19:24:59.317714] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-22T19:24:59.436454] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T19:25:00.018056] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T19:25:00.117667] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-22T19:25:00.377048] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-22T19:25:00.917699] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-22T19:25:01.563096] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T19:25:01.717686] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-22T19:25:02.517760] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-22T19:25:02.852267] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T19:25:02.860927] [INFO ] [REMOTE ] IR: Full fetch complete (76487 records). [2025-10-22T19:25:02.861053] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-22T19:25:03.260690] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-22T19:25:03.260815] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-22T19:25:03.261939] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-22T19:25:03.262021] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-22T19:25:03.263673] [DEBUG] [LOCAL ] IR: Trimmed 76487 records to 52749 (keeping 200 days of data) [2025-10-22T19:25:03.318083] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-22T19:25:03.391536] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T19:25:03.613524] [DEBUG] [LOCAL ] IR: Primary data saved (52749 records). [2025-10-22T19:25:03.613692] [INFO ] [MAIN ] IR: Full history saved. [2025-10-22T19:25:03.614176] [INFO ] [MAIN ] Update Progress: 1126/2367 symbols completed. IR took 36.0s. Estimated remaining: 2h 39m 47s. Rate: 7.8 symbols/min [2025-10-22T19:25:03.781453] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:25:03.799906] [DEBUG] [LOCAL ] ISD: Loaded 15750 existing records from primary storage. [2025-10-22T19:25:03.800163] [INFO ] [MAIN ] ISD: Loaded 15750 existing records. [2025-10-22T19:25:03.976958] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:25:03.977153] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-22T19:25:03.977199] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-22T19:25:03.977381] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-22T19:25:03.977435] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-22T19:25:04.128117] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-22T19:25:04.339903] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:25:04.367352] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T19:25:04.917665] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-22T19:25:05.164255] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T19:25:05.213242] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T19:25:05.218208] [INFO ] [REMOTE ] IRS: Full fetch complete (32660 records). [2025-10-22T19:25:05.218287] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-22T19:25:05.607094] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-22T19:25:05.607181] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-22T19:25:05.607981] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-22T19:25:05.608044] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-22T19:25:05.608900] [DEBUG] [LOCAL ] IRS: Trimmed 32660 records to 23290 (keeping 200 days of data) [2025-10-22T19:25:05.724793] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-22T19:25:05.744811] [DEBUG] [LOCAL ] IRS: Primary data saved (23290 records). [2025-10-22T19:25:05.745005] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-22T19:25:05.745100] [INFO ] [MAIN ] Update Progress: 1127/2367 symbols completed. IRS took 24.6s. Estimated remaining: 2h 39m 34s. Rate: 7.8 symbols/min [2025-10-22T19:25:05.910180] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:25:05.949344] [DEBUG] [LOCAL ] IT: Loaded 42230 existing records from primary storage. [2025-10-22T19:25:05.949634] [INFO ] [MAIN ] IT: Loaded 42230 existing records. [2025-10-22T19:25:06.120957] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T19:25:06.148032] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:25:06.148245] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-22T19:25:06.148292] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-22T19:25:06.148476] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-22T19:25:06.148517] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-22T19:25:06.525064] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:25:06.521712] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-22T19:25:07.317775] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-22T19:25:07.613146] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T19:25:07.621139] [INFO ] [REMOTE ] IRM: Full fetch complete (72131 records). [2025-10-22T19:25:07.621291] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-22T19:25:08.012339] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-22T19:25:08.012436] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-22T19:25:08.013482] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-22T19:25:08.013560] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-22T19:25:08.014907] [DEBUG] [LOCAL ] IRM: Trimmed 72131 records to 48910 (keeping 200 days of data) [2025-10-22T19:25:08.131307] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-22T19:25:08.165064] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T19:25:08.356805] [DEBUG] [LOCAL ] IRM: Primary data saved (48910 records). [2025-10-22T19:25:08.357026] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-22T19:25:08.357122] [INFO ] [MAIN ] Update Progress: 1128/2367 symbols completed. IRM took 31.9s. Estimated remaining: 2h 39m 20s. Rate: 7.8 symbols/min [2025-10-22T19:25:08.530538] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:25:08.559618] [DEBUG] [LOCAL ] ITGR: Loaded 31006 existing records from primary storage. [2025-10-22T19:25:08.559890] [INFO ] [MAIN ] ITGR: Loaded 31006 existing records. [2025-10-22T19:25:08.737373] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:25:08.737769] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-22T19:25:08.737835] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-22T19:25:08.738104] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-22T19:25:08.738159] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-22T19:25:08.920001] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-22T19:25:09.000459] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T19:25:09.122519] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:25:09.164540] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-22T19:25:09.717775] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-22T19:25:10.517705] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-22T19:25:10.635731] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T19:25:10.840637] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T19:25:11.147838] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T19:25:11.317683] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-22T19:25:12.117665] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-22T19:25:12.359302] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-22T19:25:12.917701] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-22T19:25:13.419868] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-22T19:25:13.717772] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-22T19:25:14.497328] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T19:25:14.517615] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-22T19:25:14.633725] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-22T19:25:15.317707] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-22T19:25:16.111289] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T19:25:16.121966] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-22T19:25:16.841092] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T19:25:16.917638] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-22T19:25:17.121512] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T19:25:17.717691] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-22T19:25:18.517696] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-22T19:25:18.595084] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T19:25:18.618429] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-22T19:25:19.317710] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-22T19:25:20.117639] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-22T19:25:20.156062] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T19:25:20.437295] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T19:25:20.917678] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-22T19:25:21.717638] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-22T19:25:21.757291] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T19:25:22.395502] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T19:25:22.517680] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-22T19:25:23.221267] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T19:25:23.317676] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-22T19:25:24.117636] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-22T19:25:24.204795] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T19:25:24.259107] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T19:25:24.267694] [INFO ] [REMOTE ] IRT: Full fetch complete (72928 records). [2025-10-22T19:25:24.267882] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-22T19:25:24.664935] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-22T19:25:24.665045] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-22T19:25:24.666123] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-22T19:25:24.666190] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-22T19:25:24.667528] [DEBUG] [LOCAL ] IRT: Trimmed 72928 records to 50443 (keeping 200 days of data) [2025-10-22T19:25:24.941699] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-22T19:25:24.979226] [DEBUG] [LOCAL ] IRT: Primary data saved (50443 records). [2025-10-22T19:25:24.979330] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-22T19:25:24.979406] [INFO ] [MAIN ] Update Progress: 1129/2367 symbols completed. IRT took 29.3s. Estimated remaining: 2h 39m 22s. Rate: 7.8 symbols/min [2025-10-22T19:25:25.145721] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:25:25.175444] [DEBUG] [LOCAL ] ITT: Loaded 32438 existing records from primary storage. [2025-10-22T19:25:25.175771] [INFO ] [MAIN ] ITT: Loaded 32438 existing records. [2025-10-22T19:25:25.351824] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:25:25.352101] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-22T19:25:25.352177] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-22T19:25:25.352445] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-22T19:25:25.352554] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-22T19:25:25.686194] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T19:25:25.727483] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-22T19:25:25.752220] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T19:25:25.766463] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:25:26.517685] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-22T19:25:27.279480] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T19:25:27.317612] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-22T19:25:27.798050] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T19:25:28.117680] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-22T19:25:28.917711] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-22T19:25:28.965158] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T19:25:29.451992] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T19:25:29.717672] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-22T19:25:30.321947] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T19:25:30.517631] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-22T19:25:30.829611] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T19:25:31.317760] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-22T19:25:32.117723] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-22T19:25:32.449672] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-22T19:25:32.917717] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-22T19:25:32.969907] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T19:25:33.051245] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T19:25:33.717673] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-22T19:25:34.041381] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T19:25:34.044820] [INFO ] [REMOTE ] ISD: Full fetch complete (24166 records). [2025-10-22T19:25:34.044902] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-22T19:25:34.405116] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-22T19:25:34.405188] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-22T19:25:34.405691] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-22T19:25:34.405751] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-22T19:25:34.406325] [DEBUG] [LOCAL ] ISD: Trimmed 24166 records to 15648 (keeping 200 days of data) [2025-10-22T19:25:34.501538] [DEBUG] [LOCAL ] ISD: Primary data saved (15648 records). [2025-10-22T19:25:34.501692] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-22T19:25:34.501782] [INFO ] [MAIN ] Update Progress: 1130/2367 symbols completed. ISD took 30.9s. Estimated remaining: 2h 39m 17s. Rate: 7.8 symbols/min [2025-10-22T19:25:34.522802] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-22T19:25:34.672334] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:25:34.719531] [DEBUG] [LOCAL ] ITUB: Loaded 53322 existing records from primary storage. [2025-10-22T19:25:34.719857] [INFO ] [MAIN ] ITUB: Loaded 53322 existing records. [2025-10-22T19:25:34.892151] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:25:34.892374] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-22T19:25:34.892441] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-22T19:25:34.892720] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-22T19:25:34.892777] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-22T19:25:35.252467] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:25:35.317618] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-22T19:25:35.403274] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T19:25:36.117632] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-22T19:25:36.379431] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T19:25:36.723553] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T19:25:36.917679] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-22T19:25:37.295159] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T19:25:37.717692] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-22T19:25:38.517632] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-22T19:25:38.676834] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-22T19:25:38.684178] [INFO ] [REMOTE ] IT: Full fetch complete (57943 records). [2025-10-22T19:25:38.684293] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-22T19:25:39.059460] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-22T19:25:39.059539] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-22T19:25:39.060350] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-22T19:25:39.060412] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-22T19:25:39.061543] [DEBUG] [LOCAL ] IT: Trimmed 57943 records to 42205 (keeping 200 days of data) [2025-10-22T19:25:39.311588] [DEBUG] [LOCAL ] IT: Primary data saved (42205 records). [2025-10-22T19:25:39.311766] [INFO ] [MAIN ] IT: Full history saved. [2025-10-22T19:25:39.311856] [INFO ] [MAIN ] Update Progress: 1131/2367 symbols completed. IT took 33.6s. Estimated remaining: 2h 39m 6s. Rate: 7.8 symbols/min [2025-10-22T19:25:39.323102] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-22T19:25:39.484976] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:25:39.513849] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T19:25:39.559855] [DEBUG] [LOCAL ] ITW: Loaded 45596 existing records from primary storage. [2025-10-22T19:25:39.560143] [INFO ] [MAIN ] ITW: Loaded 45596 existing records. [2025-10-22T19:25:39.737685] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:25:39.738408] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-22T19:25:39.738516] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-22T19:25:39.738852] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-22T19:25:39.738947] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-22T19:25:39.909815] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T19:25:40.116892] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:25:40.117608] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-22T19:25:40.548437] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T19:25:40.917698] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-22T19:25:41.670832] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T19:25:41.717630] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-22T19:25:42.096859] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T19:25:42.517684] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-22T19:25:43.317627] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-22T19:25:43.484551] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T19:25:44.117787] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-22T19:25:44.174346] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T19:25:44.261701] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T19:25:44.266877] [INFO ] [REMOTE ] ITGR: Full fetch complete (43260 records). [2025-10-22T19:25:44.267004] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-22T19:25:44.636030] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-22T19:25:44.636117] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-22T19:25:44.636924] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-22T19:25:44.636989] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-22T19:25:44.638016] [DEBUG] [LOCAL ] ITGR: Trimmed 43260 records to 30945 (keeping 200 days of data) [2025-10-22T19:25:44.818112] [DEBUG] [LOCAL ] ITGR: Primary data saved (30945 records). [2025-10-22T19:25:44.818241] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-22T19:25:44.818317] [INFO ] [MAIN ] Update Progress: 1132/2367 symbols completed. ITGR took 36.5s. Estimated remaining: 2h 38m 55s. Rate: 7.8 symbols/min [2025-10-22T19:25:44.917927] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-22T19:25:44.989045] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:25:45.030236] [DEBUG] [LOCAL ] IVR: Loaded 47886 existing records from primary storage. [2025-10-22T19:25:45.030537] [INFO ] [MAIN ] IVR: Loaded 47886 existing records. [2025-10-22T19:25:45.207304] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:25:45.207685] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-22T19:25:45.207908] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-22T19:25:45.208090] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-22T19:25:45.208130] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-22T19:25:45.602287] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T19:25:45.614939] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:25:45.717683] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-22T19:25:46.517818] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-22T19:25:46.781694] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T19:25:47.317779] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-22T19:25:47.393130] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T19:25:48.117755] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-22T19:25:48.216702] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T19:25:48.866791] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T19:25:48.917621] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-22T19:25:49.294277] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T19:25:49.717763] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-22T19:25:50.517677] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-22T19:25:50.624237] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T19:25:51.317692] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-22T19:25:51.382063] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T19:25:51.902630] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T19:25:52.117685] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-22T19:25:52.559708] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T19:25:52.917691] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-22T19:25:53.717721] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-22T19:25:53.846180] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T19:25:53.966800] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T19:25:53.972226] [INFO ] [REMOTE ] ITT: Full fetch complete (47614 records). [2025-10-22T19:25:53.972338] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-22T19:25:54.359753] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-22T19:25:54.359879] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-22T19:25:54.360747] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-22T19:25:54.360811] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-22T19:25:54.361842] [DEBUG] [LOCAL ] ITT: Trimmed 47614 records to 32352 (keeping 200 days of data) [2025-10-22T19:25:54.520049] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-22T19:25:54.566112] [DEBUG] [LOCAL ] ITT: Primary data saved (32352 records). [2025-10-22T19:25:54.566221] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-22T19:25:54.566294] [INFO ] [MAIN ] Update Progress: 1133/2367 symbols completed. ITT took 29.6s. Estimated remaining: 2h 38m 50s. Rate: 7.8 symbols/min [2025-10-22T19:25:54.740826] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:25:54.770002] [DEBUG] [LOCAL ] IVT: Loaded 31476 existing records from primary storage. [2025-10-22T19:25:54.770290] [INFO ] [MAIN ] IVT: Loaded 31476 existing records. [2025-10-22T19:25:54.952078] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:25:54.952284] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-22T19:25:54.952332] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-22T19:25:54.952497] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-22T19:25:54.952537] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-22T19:25:55.323789] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-22T19:25:55.323732] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:25:55.602798] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T19:25:56.117803] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-22T19:25:56.378745] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T19:25:56.917773] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-22T19:25:56.981325] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T19:25:57.717668] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-22T19:25:57.765804] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T19:25:58.517637] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-22T19:25:58.606968] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T19:25:58.856629] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T19:25:59.317620] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-22T19:25:59.344817] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T19:26:00.117676] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-22T19:26:00.917630] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-22T19:26:01.266534] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T19:26:01.717665] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-22T19:26:01.845017] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T19:26:02.517683] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-22T19:26:02.762555] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T19:26:02.980028] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-22T19:26:03.317703] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-22T19:26:04.117761] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-22T19:26:04.252546] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T19:26:04.530566] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-22T19:26:04.917724] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-22T19:26:05.717695] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-22T19:26:05.798429] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T19:26:06.517766] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-22T19:26:06.655566] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T19:26:07.317634] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-22T19:26:07.568349] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T19:26:07.577315] [INFO ] [REMOTE ] ITUB: Full fetch complete (77317 records). [2025-10-22T19:26:07.577500] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-22T19:26:08.025446] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-22T19:26:08.025306] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T19:26:08.032568] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-22T19:26:08.033892] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-22T19:26:08.034371] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-22T19:26:08.036005] [DEBUG] [LOCAL ] ITUB: Trimmed 77317 records to 53318 (keeping 200 days of data) [2025-10-22T19:26:08.121074] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-22T19:26:08.346277] [DEBUG] [LOCAL ] ITUB: Primary data saved (53318 records). [2025-10-22T19:26:08.346412] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-22T19:26:08.347059] [INFO ] [MAIN ] Update Progress: 1134/2367 symbols completed. ITUB took 33.8s. Estimated remaining: 2h 38m 49s. Rate: 7.8 symbols/min [2025-10-22T19:26:08.512709] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:08.562749] [DEBUG] [LOCAL ] IVZ: Loaded 53133 existing records from primary storage. [2025-10-22T19:26:08.563078] [INFO ] [MAIN ] IVZ: Loaded 53133 existing records. [2025-10-22T19:26:08.738000] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:26:08.738209] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-22T19:26:08.738257] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-22T19:26:08.738442] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-22T19:26:08.738481] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-22T19:26:08.930171] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-22T19:26:09.121195] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:26:09.352014] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-22T19:26:09.717705] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-22T19:26:09.944679] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T19:26:09.996830] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T19:26:10.517706] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-22T19:26:11.317672] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-22T19:26:11.509821] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T19:26:12.002738] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T19:26:12.010771] [INFO ] [REMOTE ] IVR: Full fetch complete (69079 records). [2025-10-22T19:26:12.010892] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-22T19:26:12.122859] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-22T19:26:12.410203] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-22T19:26:12.410332] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-22T19:26:12.411482] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-22T19:26:12.411675] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-22T19:26:12.413203] [DEBUG] [LOCAL ] IVR: Trimmed 69079 records to 47827 (keeping 200 days of data) [2025-10-22T19:26:12.695032] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T19:26:12.714125] [DEBUG] [LOCAL ] IVR: Primary data saved (47827 records). [2025-10-22T19:26:12.714878] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-22T19:26:12.715347] [INFO ] [MAIN ] Update Progress: 1135/2367 symbols completed. IVR took 27.9s. Estimated remaining: 2h 38m 37s. Rate: 7.8 symbols/min [2025-10-22T19:26:12.881703] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:12.902795] [DEBUG] [LOCAL ] IX: Loaded 22198 existing records from primary storage. [2025-10-22T19:26:12.903051] [INFO ] [MAIN ] IX: Loaded 22198 existing records. [2025-10-22T19:26:12.923340] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-22T19:26:13.080557] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:26:13.080812] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-22T19:26:13.080861] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-22T19:26:13.081022] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-22T19:26:13.081060] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-22T19:26:13.434437] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:26:13.717712] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-22T19:26:13.822745] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T19:26:14.515841] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T19:26:14.517944] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-22T19:26:14.633808] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T19:26:14.641203] [INFO ] [REMOTE ] ITW: Full fetch complete (66790 records). [2025-10-22T19:26:14.641353] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-22T19:26:15.023132] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-22T19:26:15.023224] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-22T19:26:15.024129] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-22T19:26:15.024192] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-22T19:26:15.025538] [DEBUG] [LOCAL ] ITW: Trimmed 66790 records to 45583 (keeping 200 days of data) [2025-10-22T19:26:15.308227] [DEBUG] [LOCAL ] ITW: Primary data saved (45583 records). [2025-10-22T19:26:15.308367] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-22T19:26:15.308449] [INFO ] [MAIN ] Update Progress: 1136/2367 symbols completed. ITW took 36.0s. Estimated remaining: 2h 38m 24s. Rate: 7.8 symbols/min [2025-10-22T19:26:15.322728] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-22T19:26:15.381160] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T19:26:15.510931] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:15.550623] [DEBUG] [LOCAL ] J: Loaded 40509 existing records from primary storage. [2025-10-22T19:26:15.550962] [INFO ] [MAIN ] J: Loaded 40509 existing records. [2025-10-22T19:26:15.724022] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:26:15.724269] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-22T19:26:15.724316] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-22T19:26:15.724499] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-22T19:26:15.724537] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-22T19:26:16.124969] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-22T19:26:16.124868] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:26:16.721540] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T19:26:16.917773] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-22T19:26:17.209382] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T19:26:17.717752] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-22T19:26:18.336776] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T19:26:18.517754] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-22T19:26:19.247327] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T19:26:19.317619] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-22T19:26:20.117688] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-22T19:26:20.335367] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T19:26:20.853126] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T19:26:20.917669] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-22T19:26:21.486462] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T19:26:21.717828] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-22T19:26:22.472405] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T19:26:22.517624] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-22T19:26:22.910825] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T19:26:23.317668] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-22T19:26:24.117754] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-22T19:26:24.149062] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T19:26:24.917664] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-22T19:26:25.273869] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T19:26:25.377064] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-22T19:26:25.717622] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-22T19:26:26.036953] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T19:26:26.517675] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-22T19:26:27.292802] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T19:26:27.317609] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-22T19:26:27.611438] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T19:26:28.117715] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-22T19:26:28.917677] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-22T19:26:28.975695] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T19:26:29.598437] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-22T19:26:29.604549] [INFO ] [REMOTE ] IVT: Full fetch complete (45792 records). [2025-10-22T19:26:29.604674] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-22T19:26:29.719781] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-22T19:26:29.954459] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T19:26:30.040180] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-22T19:26:30.040310] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-22T19:26:30.041198] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-22T19:26:30.041296] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-22T19:26:30.042424] [DEBUG] [LOCAL ] IVT: Trimmed 45792 records to 31418 (keeping 200 days of data) [2025-10-22T19:26:30.244849] [DEBUG] [LOCAL ] IVT: Primary data saved (31418 records). [2025-10-22T19:26:30.245121] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-22T19:26:30.245230] [INFO ] [MAIN ] Update Progress: 1137/2367 symbols completed. IVT took 35.7s. Estimated remaining: 2h 38m 24s. Rate: 7.8 symbols/min [2025-10-22T19:26:30.413183] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:30.449043] [DEBUG] [LOCAL ] JBGS: Loaded 41810 existing records from primary storage. [2025-10-22T19:26:30.449371] [INFO ] [MAIN ] JBGS: Loaded 41810 existing records. [2025-10-22T19:26:30.522890] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-22T19:26:30.626640] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:26:30.626867] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-22T19:26:30.626913] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-22T19:26:30.627154] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-22T19:26:30.627210] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-22T19:26:30.987633] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:26:31.317639] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-22T19:26:31.699455] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-22T19:26:32.117699] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-22T19:26:32.152182] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T19:26:32.327992] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T19:26:32.917724] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-22T19:26:33.224684] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T19:26:33.717710] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-22T19:26:34.353088] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T19:26:34.517706] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-22T19:26:35.317616] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-22T19:26:35.594203] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T19:26:35.628307] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T19:26:35.632059] [INFO ] [REMOTE ] IX: Full fetch complete (28666 records). [2025-10-22T19:26:35.632130] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-22T19:26:35.999133] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-22T19:26:35.999217] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-22T19:26:35.999951] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-22T19:26:36.000014] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-22T19:26:36.000898] [DEBUG] [LOCAL ] IX: Trimmed 28666 records to 22121 (keeping 200 days of data) [2025-10-22T19:26:36.119184] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-22T19:26:36.126017] [DEBUG] [LOCAL ] IX: Primary data saved (22121 records). [2025-10-22T19:26:36.127460] [INFO ] [MAIN ] IX: Full history saved. [2025-10-22T19:26:36.127558] [INFO ] [MAIN ] Update Progress: 1138/2367 symbols completed. IX took 23.4s. Estimated remaining: 2h 38m 15s. Rate: 7.8 symbols/min [2025-10-22T19:26:36.311508] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:36.350135] [DEBUG] [LOCAL ] JBI: Loaded 42692 existing records from primary storage. [2025-10-22T19:26:36.350459] [INFO ] [MAIN ] JBI: Loaded 42692 existing records. [2025-10-22T19:26:36.532068] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:26:36.532432] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-22T19:26:36.532724] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-22T19:26:36.539880] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-22T19:26:36.551751] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-22T19:26:36.632591] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T19:26:36.928632] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-22T19:26:36.951423] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:26:37.717636] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-22T19:26:37.842307] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T19:26:38.517720] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-22T19:26:38.562733] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T19:26:38.733088] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-22T19:26:39.317719] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-22T19:26:40.117703] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-22T19:26:40.333719] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T19:26:40.343857] [INFO ] [REMOTE ] IVZ: Full fetch complete (77043 records). [2025-10-22T19:26:40.344138] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-22T19:26:40.740471] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-22T19:26:40.740680] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-22T19:26:40.741839] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-22T19:26:40.741927] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-22T19:26:40.753275] [DEBUG] [LOCAL ] IVZ: Trimmed 77043 records to 53130 (keeping 200 days of data) [2025-10-22T19:26:40.770187] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T19:26:40.953917] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-22T19:26:41.108197] [DEBUG] [LOCAL ] IVZ: Primary data saved (53130 records). [2025-10-22T19:26:41.108452] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-22T19:26:41.108703] [INFO ] [MAIN ] Update Progress: 1139/2367 symbols completed. IVZ took 32.8s. Estimated remaining: 2h 38m 4s. Rate: 7.8 symbols/min [2025-10-22T19:26:41.307156] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:41.309668] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T19:26:41.359187] [DEBUG] [LOCAL ] JBL: Loaded 48345 existing records from primary storage. [2025-10-22T19:26:41.359479] [INFO ] [MAIN ] JBL: Loaded 48345 existing records. [2025-10-22T19:26:41.542012] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:26:41.542186] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-22T19:26:41.542235] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-22T19:26:41.542403] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-22T19:26:41.542442] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-22T19:26:41.722868] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-22T19:26:41.917830] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:26:42.517670] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-22T19:26:42.571819] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T19:26:43.148089] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T19:26:43.317750] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-22T19:26:43.640717] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T19:26:44.117708] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-22T19:26:44.821992] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T19:26:44.917619] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-22T19:26:45.532269] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T19:26:45.717715] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-22T19:26:46.500148] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T19:26:46.517622] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-22T19:26:47.132890] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-22T19:26:47.140435] [INFO ] [REMOTE ] J: Full fetch complete (59870 records). [2025-10-22T19:26:47.140568] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-22T19:26:47.328325] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-22T19:26:47.527286] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-22T19:26:47.527354] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-22T19:26:47.528229] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-22T19:26:47.528295] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-22T19:26:47.529544] [DEBUG] [LOCAL ] J: Trimmed 59870 records to 40527 (keeping 200 days of data) [2025-10-22T19:26:47.775011] [DEBUG] [LOCAL ] J: Primary data saved (40527 records). [2025-10-22T19:26:47.775128] [INFO ] [MAIN ] J: Full history saved. [2025-10-22T19:26:47.775201] [INFO ] [MAIN ] Update Progress: 1140/2367 symbols completed. J took 32.5s. Estimated remaining: 2h 37m 55s. Rate: 7.8 symbols/min [2025-10-22T19:26:47.939086] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:47.964244] [DEBUG] [LOCAL ] JBND: Loaded 27324 existing records from primary storage. [2025-10-22T19:26:47.964507] [INFO ] [MAIN ] JBND: Loaded 27324 existing records. [2025-10-22T19:26:48.134454] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-22T19:26:48.140158] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:26:48.140738] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-22T19:26:48.140790] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-22T19:26:48.141005] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-22T19:26:48.141042] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-22T19:26:48.498017] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:26:48.524947] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T19:26:48.924983] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-22T19:26:48.929905] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-22T19:26:49.505724] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T19:26:49.717769] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-22T19:26:49.899954] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T19:26:50.517719] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-22T19:26:51.265240] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T19:26:51.317634] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-22T19:26:52.097438] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T19:26:52.117618] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-22T19:26:52.917702] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-22T19:26:53.046668] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T19:26:53.562863] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T19:26:53.717710] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-22T19:26:54.517683] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-22T19:26:54.625317] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T19:26:54.747926] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-22T19:26:55.317715] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-22T19:26:56.117767] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-22T19:26:56.385497] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T19:26:56.510436] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T19:26:56.917750] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-22T19:26:57.303980] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T19:26:57.310719] [INFO ] [REMOTE ] JBGS: Full fetch complete (59200 records). [2025-10-22T19:26:57.310864] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-22T19:26:57.715925] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-22T19:26:57.716012] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-22T19:26:57.716975] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-22T19:26:57.717040] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-22T19:26:57.717811] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-22T19:26:57.719748] [DEBUG] [LOCAL ] JBGS: Trimmed 59200 records to 41708 (keeping 200 days of data) [2025-10-22T19:26:57.966558] [DEBUG] [LOCAL ] JBGS: Primary data saved (41708 records). [2025-10-22T19:26:57.966720] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-22T19:26:57.966809] [INFO ] [MAIN ] Update Progress: 1141/2367 symbols completed. JBGS took 27.7s. Estimated remaining: 2h 37m 50s. Rate: 7.8 symbols/min [2025-10-22T19:26:58.159109] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:58.161155] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-22T19:26:58.161003] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-22T19:26:58.161256] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-22T19:26:58.166943] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-22T19:26:58.167243] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-22T19:26:58.167816] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-22T19:26:58.168288] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-22T19:26:58.519754] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-22T19:26:58.543823] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:26:59.266841] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T19:26:59.317688] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-10-22T19:26:59.510270] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:26:59.510492] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-10-22T19:26:59.510591] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:26:59.510663] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-22T19:26:59.510721] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:26:59.510788] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-22T19:26:59.510850] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-22T19:26:59.510884] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-22T19:26:59.510921] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-22T19:26:59.510965] [INFO ] [MAIN ] Update Progress: 1142/2367 symbols completed. JBS took 1.5s. Estimated remaining: 2h 37m 36s. Rate: 7.8 symbols/min [2025-10-22T19:26:59.676406] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:26:59.708829] [DEBUG] [LOCAL ] JBTM: Loaded 33651 existing records from primary storage. [2025-10-22T19:26:59.709083] [INFO ] [MAIN ] JBTM: Loaded 33651 existing records. [2025-10-22T19:26:59.883879] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:26:59.884091] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-22T19:26:59.884138] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-22T19:26:59.884408] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-10-22T19:26:59.884462] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-22T19:27:00.119824] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-22T19:27:00.239629] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:27:00.394663] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T19:27:00.917681] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-22T19:27:01.258031] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-22T19:27:01.717689] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-22T19:27:02.517692] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-10-22T19:27:03.317701] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-22T19:27:03.365012] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T19:27:03.665375] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-22T19:27:04.029188] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T19:27:04.117633] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-10-22T19:27:04.917675] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-22T19:27:05.404097] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-22T19:27:05.717677] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-22T19:27:05.780563] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T19:27:06.517630] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-10-22T19:27:06.699007] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T19:27:06.955588] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-22T19:27:07.317700] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-22T19:27:07.860587] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T19:27:08.117684] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-10-22T19:27:08.917671] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-22T19:27:09.308525] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-22T19:27:09.647439] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T19:27:09.717718] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-22T19:27:10.442587] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T19:27:10.449442] [INFO ] [REMOTE ] JBI: Full fetch complete (63610 records). [2025-10-22T19:27:10.449581] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-22T19:27:10.522909] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-22T19:27:10.842993] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-22T19:27:10.843084] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-22T19:27:10.843993] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-22T19:27:10.844055] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-22T19:27:10.845211] [DEBUG] [LOCAL ] JBI: Trimmed 63610 records to 42579 (keeping 200 days of data) [2025-10-22T19:27:11.080231] [DEBUG] [LOCAL ] JBI: Primary data saved (42579 records). [2025-10-22T19:27:11.080349] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-22T19:27:11.080433] [INFO ] [MAIN ] Update Progress: 1143/2367 symbols completed. JBI took 35.0s. Estimated remaining: 2h 37m 32s. Rate: 7.8 symbols/min [2025-10-22T19:27:11.259520] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:27:11.290026] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T19:27:11.304017] [DEBUG] [LOCAL ] JCE: Loaded 7278 existing records from primary storage. [2025-10-22T19:27:11.304567] [INFO ] [MAIN ] JCE: Loaded 7278 existing records. [2025-10-22T19:27:11.326116] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-22T19:27:11.490045] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:27:11.490262] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-22T19:27:11.490334] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-22T19:27:11.490562] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-22T19:27:11.490620] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-22T19:27:11.817442] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-22T19:27:11.890027] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:27:12.117613] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-22T19:27:12.825788] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-22T19:27:12.917611] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-22T19:27:13.338971] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-22T19:27:13.717698] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-10-22T19:27:14.403747] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T19:27:14.517708] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-22T19:27:15.180386] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T19:27:15.317720] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-22T19:27:15.993621] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T19:27:16.117684] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-22T19:27:16.917802] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-10-22T19:27:17.235935] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-22T19:27:17.244084] [INFO ] [REMOTE ] JBL: Full fetch complete (70627 records). [2025-10-22T19:27:17.244223] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-22T19:27:17.674741] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T19:27:17.675218] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-22T19:27:17.681264] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-22T19:27:17.682882] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-22T19:27:17.683012] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-22T19:27:17.683378] [INFO ] [REMOTE ] JBND: Full fetch complete (36186 records). [2025-10-22T19:27:17.683558] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-22T19:27:17.720098] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-22T19:27:17.774609] [DEBUG] [LOCAL ] JBL: Trimmed 70627 records to 48330 (keeping 200 days of data) [2025-10-22T19:27:18.158972] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T19:27:18.240869] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-22T19:27:18.241109] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-22T19:27:18.242776] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-22T19:27:18.293900] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-22T19:27:18.340199] [DEBUG] [LOCAL ] JBND: Trimmed 36186 records to 27369 (keeping 200 days of data) [2025-10-22T19:27:18.375717] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T19:27:18.523558] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-22T19:27:18.556442] [DEBUG] [LOCAL ] JBL: Primary data saved (48330 records). [2025-10-22T19:27:18.557889] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-22T19:27:18.558520] [INFO ] [MAIN ] Update Progress: 1144/2367 symbols completed. JBL took 37.4s. Estimated remaining: 2h 37m 24s. Rate: 7.8 symbols/min [2025-10-22T19:27:18.790779] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:27:18.806302] [DEBUG] [LOCAL ] JBND: Primary data saved (27369 records). [2025-10-22T19:27:18.806700] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-22T19:27:18.806837] [INFO ] [MAIN ] Update Progress: 1145/2367 symbols completed. JBND took 31.0s. Estimated remaining: 2h 37m 8s. Rate: 7.8 symbols/min [2025-10-22T19:27:18.998480] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:27:19.042746] [DEBUG] [LOCAL ] JCI: Loaded 53519 existing records from primary storage. [2025-10-22T19:27:19.043242] [INFO ] [MAIN ] JCI: Loaded 53519 existing records. [2025-10-22T19:27:19.212241] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-22T19:27:19.215027] [DEBUG] [LOCAL ] JEF: Loaded 50196 existing records from primary storage. [2025-10-22T19:27:19.238872] [INFO ] [MAIN ] JEF: Loaded 50196 existing records. [2025-10-22T19:27:19.319314] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-22T19:27:19.358739] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:27:19.395262] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-22T19:27:19.400536] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-22T19:27:19.425102] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-22T19:27:19.440918] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-22T19:27:19.615157] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:27:19.641893] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-22T19:27:19.662961] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-22T19:27:19.716384] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-22T19:27:19.727579] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-22T19:27:20.043160] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:27:20.122859] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-22T19:27:20.173588] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T19:27:20.287581] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:27:20.917639] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-10-22T19:27:21.717675] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-22T19:27:21.969137] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T19:27:22.299579] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T19:27:22.355799] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T19:27:22.517760] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-22T19:27:23.187612] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-22T19:27:23.317696] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-22T19:27:24.117699] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-22T19:27:24.905945] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T19:27:24.917610] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-22T19:27:25.075343] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T19:27:25.554030] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-22T19:27:25.717669] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-22T19:27:26.517700] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-22T19:27:27.275446] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-22T19:27:27.317628] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-22T19:27:27.394369] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T19:27:28.117632] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-10-22T19:27:28.245922] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T19:27:28.248191] [INFO ] [REMOTE ] JCE: Full fetch complete (9652 records). [2025-10-22T19:27:28.248263] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-22T19:27:28.627278] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-22T19:27:28.627352] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-22T19:27:28.627581] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-22T19:27:28.627620] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-22T19:27:28.628108] [DEBUG] [LOCAL ] JCE: Trimmed 9652 records to 7251 (keeping 200 days of data) [2025-10-22T19:27:28.670187] [DEBUG] [LOCAL ] JCE: Primary data saved (7251 records). [2025-10-22T19:27:28.670276] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-22T19:27:28.670352] [INFO ] [MAIN ] Update Progress: 1146/2367 symbols completed. JCE took 17.6s. Estimated remaining: 2h 37m 3s. Rate: 7.8 symbols/min [2025-10-22T19:27:28.837532] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:27:28.876188] [DEBUG] [LOCAL ] JELD: Loaded 45921 existing records from primary storage. [2025-10-22T19:27:28.876491] [INFO ] [MAIN ] JELD: Loaded 45921 existing records. [2025-10-22T19:27:28.929479] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-22T19:27:29.053460] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:27:29.053689] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-22T19:27:29.053747] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-22T19:27:29.053980] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-22T19:27:29.054017] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-22T19:27:29.405578] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:27:29.456139] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T19:27:29.717694] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-22T19:27:30.518791] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-10-22T19:27:30.521444] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T19:27:31.143441] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T19:27:31.317754] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-22T19:27:31.827694] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T19:27:32.117688] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-22T19:27:32.917632] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-22T19:27:33.186576] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T19:27:33.563990] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T19:27:33.717632] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-22T19:27:34.517632] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-22T19:27:34.784418] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T19:27:35.216148] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T19:27:35.317722] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-22T19:27:36.117709] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-10. [2025-10-22T19:27:36.295223] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T19:27:36.917708] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-22T19:27:36.958134] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T19:27:37.545075] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-22T19:27:37.551848] [INFO ] [REMOTE ] JBTM: Full fetch complete (47148 records). [2025-10-22T19:27:37.551981] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-10-22T19:27:37.729490] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-22T19:27:37.938043] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-10-22T19:27:37.938130] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-10-22T19:27:37.938935] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-10-22T19:27:37.938999] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-10-22T19:27:37.940099] [DEBUG] [LOCAL ] JBTM: Trimmed 47148 records to 33593 (keeping 200 days of data) [2025-10-22T19:27:38.145126] [DEBUG] [LOCAL ] JBTM: Primary data saved (33593 records). [2025-10-22T19:27:38.145280] [INFO ] [MAIN ] JBTM: Full history saved. [2025-10-22T19:27:38.145367] [INFO ] [MAIN ] Update Progress: 1147/2367 symbols completed. JBTM took 38.6s. Estimated remaining: 2h 36m 57s. Rate: 7.8 symbols/min [2025-10-22T19:27:38.316953] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:27:38.347297] [DEBUG] [LOCAL ] JFR: Loaded 31046 existing records from primary storage. [2025-10-22T19:27:38.347552] [INFO ] [MAIN ] JFR: Loaded 31046 existing records. [2025-10-22T19:27:38.519907] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-22T19:27:38.555627] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:27:38.556160] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-22T19:27:38.556270] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-22T19:27:38.556638] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-22T19:27:38.556739] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-22T19:27:38.927744] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T19:27:39.021081] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:27:39.317632] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-22T19:27:39.509695] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T19:27:39.814402] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T19:27:40.117726] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-22T19:27:40.846073] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T19:27:40.917612] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-22T19:27:41.729973] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-22T19:27:41.750511] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T19:27:42.402032] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T19:27:42.517689] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-22T19:27:43.113958] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T19:27:43.317672] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-22T19:27:44.117778] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-22T19:27:44.218432] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T19:27:44.922751] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-22T19:27:44.939007] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T19:27:45.520827] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T19:27:45.717696] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-22T19:27:46.517631] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-22T19:27:46.812843] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T19:27:46.891410] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T19:27:47.290617] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-22T19:27:47.317611] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-22T19:27:48.117674] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-22T19:27:48.917754] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-22T19:27:48.974113] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T19:27:49.717778] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-22T19:27:49.861161] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T19:27:50.433132] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T19:27:50.517703] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-22T19:27:51.262142] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T19:27:51.317673] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-22T19:27:52.069123] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-22T19:27:52.076373] [INFO ] [REMOTE ] JELD: Full fetch complete (64607 records). [2025-10-22T19:27:52.076479] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-22T19:27:52.122817] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-22T19:27:52.455606] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-22T19:27:52.455708] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-22T19:27:52.456533] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-22T19:27:52.456575] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-22T19:27:52.457869] [DEBUG] [LOCAL ] JELD: Trimmed 64607 records to 45878 (keeping 200 days of data) [2025-10-22T19:27:52.707045] [DEBUG] [LOCAL ] JELD: Primary data saved (45878 records). [2025-10-22T19:27:52.707158] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-22T19:27:52.707235] [INFO ] [MAIN ] Update Progress: 1148/2367 symbols completed. JELD took 24.0s. Estimated remaining: 2h 36m 57s. Rate: 7.8 symbols/min [2025-10-22T19:27:52.881700] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:27:52.905084] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T19:27:52.916904] [INFO ] [REMOTE ] JEF: Full fetch complete (73348 records). [2025-10-22T19:27:52.917064] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-22T19:27:52.917619] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-22T19:27:52.958473] [DEBUG] [LOCAL ] JGH: Loaded 12652 existing records from primary storage. [2025-10-22T19:27:52.959421] [INFO ] [MAIN ] JGH: Loaded 12652 existing records. [2025-10-22T19:27:53.353591] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:27:53.385954] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-22T19:27:53.391172] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-22T19:27:53.411537] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-22T19:27:53.411694] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-22T19:27:53.676694] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-22T19:27:53.676884] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-22T19:27:53.683009] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-22T19:27:53.688214] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-22T19:27:53.772235] [DEBUG] [LOCAL ] JEF: Trimmed 73348 records to 50191 (keeping 200 days of data) [2025-10-22T19:27:54.062327] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:27:54.064603] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-22T19:27:54.108244] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-22T19:27:54.228945] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T19:27:54.324600] [DEBUG] [LOCAL ] JEF: Primary data saved (50191 records). [2025-10-22T19:27:54.324763] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-22T19:27:54.325730] [INFO ] [MAIN ] Update Progress: 1149/2367 symbols completed. JEF took 35.5s. Estimated remaining: 2h 36m 42s. Rate: 7.8 symbols/min [2025-10-22T19:27:54.494354] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:27:54.518704] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-22T19:27:54.537771] [DEBUG] [LOCAL ] JHG: Loaded 47511 existing records from primary storage. [2025-10-22T19:27:54.538058] [INFO ] [MAIN ] JHG: Loaded 47511 existing records. [2025-10-22T19:27:54.716278] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:27:54.716533] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-22T19:27:54.716590] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-22T19:27:54.716791] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-22T19:27:54.716847] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-22T19:27:54.823590] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T19:27:55.078099] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:27:55.317703] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-22T19:27:56.117710] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-22T19:27:56.431592] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T19:27:56.841582] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T19:27:56.918380] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-22T19:27:56.920792] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T19:27:57.717726] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-22T19:27:58.517668] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-22T19:27:58.789465] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-22T19:27:58.987319] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T19:27:59.317776] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-22T19:28:00.119565] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-22T19:28:00.122554] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-22T19:28:00.156530] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T19:28:00.917705] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-22T19:28:01.717775] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-22T19:28:02.517799] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-22T19:28:03.290372] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T19:28:03.317613] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-22T19:28:03.375314] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (3.26 seconds). [2025-10-22T19:28:03.384110] [INFO ] [REMOTE ] JCI: Full fetch complete (77655 records). [2025-10-22T19:28:03.384225] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-22T19:28:03.529416] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-22T19:28:03.566695] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-22T19:28:03.821255] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-22T19:28:03.821341] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-22T19:28:03.822351] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-22T19:28:03.822438] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-22T19:28:03.823895] [DEBUG] [LOCAL ] JCI: Trimmed 77655 records to 53518 (keeping 200 days of data) [2025-10-22T19:28:04.127561] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-22T19:28:04.152217] [DEBUG] [LOCAL ] JCI: Primary data saved (53518 records). [2025-10-22T19:28:04.152737] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-22T19:28:04.152869] [INFO ] [MAIN ] Update Progress: 1150/2367 symbols completed. JCI took 45.6s. Estimated remaining: 2h 36m 37s. Rate: 7.8 symbols/min [2025-10-22T19:28:04.318529] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:28:04.324043] [DEBUG] [LOCAL ] JHI: Loaded 4184 existing records from primary storage. [2025-10-22T19:28:04.324212] [INFO ] [MAIN ] JHI: Loaded 4184 existing records. [2025-10-22T19:28:04.496940] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:28:04.497145] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-22T19:28:04.497191] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-22T19:28:04.497331] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-22T19:28:04.497368] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-22T19:28:04.849315] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:28:04.917614] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-22T19:28:05.080846] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T19:28:05.328366] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-22T19:28:05.355186] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-22T19:28:05.717690] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-22T19:28:06.517694] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-22T19:28:07.317629] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-22T19:28:07.398974] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T19:28:07.442766] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T19:28:07.760080] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T19:28:08.117709] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-22T19:28:08.698795] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-22T19:28:08.917686] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-22T19:28:09.717676] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-22T19:28:10.486497] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-22T19:28:10.486254] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T19:28:10.517614] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-22T19:28:11.317634] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-22T19:28:11.380952] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T19:28:11.971976] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-22T19:28:12.117632] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-22T19:28:12.917686] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-22T19:28:13.718020] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-22T19:28:13.776981] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T19:28:14.209387] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-22T19:28:14.212969] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T19:28:14.517674] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-22T19:28:15.080623] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-22T19:28:15.317689] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-22T19:28:16.117709] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-22T19:28:16.730447] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T19:28:16.736663] [INFO ] [REMOTE ] JFR: Full fetch complete (48499 records). [2025-10-22T19:28:16.736779] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-22T19:28:16.923796] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-22T19:28:17.064050] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-22T19:28:17.129580] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-22T19:28:17.129682] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-22T19:28:17.130413] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-22T19:28:17.130464] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-22T19:28:17.131469] [DEBUG] [LOCAL ] JFR: Trimmed 48499 records to 30994 (keeping 200 days of data) [2025-10-22T19:28:17.313712] [DEBUG] [LOCAL ] JFR: Primary data saved (30994 records). [2025-10-22T19:28:17.313855] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-22T19:28:17.313944] [INFO ] [MAIN ] Update Progress: 1151/2367 symbols completed. JFR took 39.2s. Estimated remaining: 2h 36m 35s. Rate: 7.8 symbols/min [2025-10-22T19:28:17.487612] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T19:28:17.490822] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:28:17.496316] [DEBUG] [LOCAL ] JHS: Loaded 2986 existing records from primary storage. [2025-10-22T19:28:17.496455] [INFO ] [MAIN ] JHS: Loaded 2986 existing records. [2025-10-22T19:28:17.676733] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:28:17.676944] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-22T19:28:17.676996] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-22T19:28:17.677136] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-22T19:28:17.677175] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-22T19:28:17.722734] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-22T19:28:18.031174] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:28:18.166621] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-22T19:28:18.517759] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-22T19:28:19.097879] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-22T19:28:19.317687] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-22T19:28:20.117681] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-22T19:28:20.730381] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T19:28:20.917626] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-22T19:28:20.996470] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T19:28:21.564051] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-22T19:28:21.717722] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-22T19:28:21.824409] [DEBUG] [REMOTE ] JHG: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-22T19:28:21.824632] [WARN ] [REMOTE ] JHG: No data returned for month 2025-09 [2025-10-22T19:28:21.824781] [FATAL] [REMOTE ] JHG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:28:21.824871] [FATAL] [MAIN ] JHG: Failed to fetch primary data. [2025-10-22T19:28:21.824932] [WARN ] [MAIN ] JHG: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:28:21.824999] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-22T19:28:21.825056] [DEBUG] [LOCAL ] JHG: No primary data file found to delete. [2025-10-22T19:28:21.825091] [INFO ] [LOCAL ] JHG: Starting deletion of derivative data. [2025-10-22T19:28:21.825238] [DEBUG] [LOCAL ] JHG: Deleted derivative data file. [2025-10-22T19:28:21.825316] [INFO ] [MAIN ] Update Progress: 1152/2367 symbols completed. JHG took 27.5s. Estimated remaining: 2h 36m 24s. Rate: 7.8 symbols/min [2025-10-22T19:28:21.993523] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:28:22.044175] [DEBUG] [LOCAL ] JHX: Loaded 53200 existing records from primary storage. [2025-10-22T19:28:22.044585] [INFO ] [MAIN ] JHX: Loaded 53200 existing records. [2025-10-22T19:28:22.216507] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:28:22.216713] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-22T19:28:22.216767] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-22T19:28:22.216959] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-22T19:28:22.217014] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-22T19:28:22.523066] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-22T19:28:22.561843] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:28:23.317760] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-22T19:28:23.339197] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-22T19:28:23.341401] [INFO ] [REMOTE ] JHI: Full fetch complete (5813 records). [2025-10-22T19:28:23.341493] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-22T19:28:23.813392] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-22T19:28:23.903869] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-22T19:28:23.903987] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-22T19:28:23.904351] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-22T19:28:23.904420] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-22T19:28:23.905210] [DEBUG] [LOCAL ] JHI: Trimmed 5813 records to 4142 (keeping 200 days of data) [2025-10-22T19:28:23.937086] [DEBUG] [LOCAL ] JHI: Primary data saved (4142 records). [2025-10-22T19:28:23.937247] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-22T19:28:23.937334] [INFO ] [MAIN ] Update Progress: 1153/2367 symbols completed. JHI took 19.8s. Estimated remaining: 2h 36m 10s. Rate: 7.8 symbols/min [2025-10-22T19:28:24.125326] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-22T19:28:24.162698] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:28:24.180940] [DEBUG] [LOCAL ] JILL: Loaded 15442 existing records from primary storage. [2025-10-22T19:28:24.181233] [INFO ] [MAIN ] JILL: Loaded 15442 existing records. [2025-10-22T19:28:24.396967] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:28:24.397227] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-22T19:28:24.397313] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-22T19:28:24.397535] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-22T19:28:24.397593] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-22T19:28:24.774779] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:28:24.917695] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-22T19:28:25.017165] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T19:28:25.717683] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-22T19:28:25.897473] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T19:28:26.493830] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T19:28:26.517613] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-22T19:28:26.992604] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-22T19:28:27.317619] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-22T19:28:27.777800] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-22T19:28:28.117674] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-22T19:28:28.758319] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T19:28:28.917710] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-22T19:28:29.476496] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T19:28:29.717759] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-22T19:28:30.208417] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-22T19:28:30.517714] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-22T19:28:31.148818] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-22T19:28:31.317688] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-22T19:28:32.083853] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-22T19:28:32.117755] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-22T19:28:32.917678] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-22T19:28:33.235487] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T19:28:33.240120] [INFO ] [REMOTE ] JGH: Full fetch complete (16431 records). [2025-10-22T19:28:33.240222] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-22T19:28:33.614339] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-22T19:28:33.614425] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-22T19:28:33.614870] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-22T19:28:33.614944] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-22T19:28:33.615522] [DEBUG] [LOCAL ] JGH: Trimmed 16431 records to 12537 (keeping 200 days of data) [2025-10-22T19:28:33.693535] [DEBUG] [LOCAL ] JGH: Primary data saved (12537 records). [2025-10-22T19:28:33.693709] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-22T19:28:33.693801] [INFO ] [MAIN ] Update Progress: 1154/2367 symbols completed. JGH took 41.0s. Estimated remaining: 2h 36m 5s. Rate: 7.8 symbols/min [2025-10-22T19:28:33.725220] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-22T19:28:33.823731] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-22T19:28:33.884241] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:28:33.919774] [DEBUG] [LOCAL ] JKS: Loaded 39289 existing records from primary storage. [2025-10-22T19:28:33.920094] [INFO ] [MAIN ] JKS: Loaded 39289 existing records. [2025-10-22T19:28:34.092532] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:28:34.092782] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-22T19:28:34.092830] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-22T19:28:34.093007] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-22T19:28:34.093045] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-22T19:28:34.453790] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:28:34.517613] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-22T19:28:34.840287] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T19:28:35.317683] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-22T19:28:35.679438] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T19:28:36.117685] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-22T19:28:36.297056] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T19:28:36.729449] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-22T19:28:36.730510] [INFO ] [REMOTE ] JHS: Full fetch complete (4557 records). [2025-10-22T19:28:36.730581] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-22T19:28:36.922797] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-22T19:28:37.085555] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-22T19:28:37.085627] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-22T19:28:37.085794] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-22T19:28:37.085843] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-22T19:28:37.086225] [DEBUG] [LOCAL ] JHS: Trimmed 4557 records to 2984 (keeping 200 days of data) [2025-10-22T19:28:37.103676] [DEBUG] [LOCAL ] JHS: Primary data saved (2984 records). [2025-10-22T19:28:37.103739] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-22T19:28:37.103805] [INFO ] [MAIN ] Update Progress: 1155/2367 symbols completed. JHS took 19.8s. Estimated remaining: 2h 35m 52s. Rate: 7.8 symbols/min [2025-10-22T19:28:37.267335] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:28:37.295449] [DEBUG] [LOCAL ] JLL: Loaded 31598 existing records from primary storage. [2025-10-22T19:28:37.295731] [INFO ] [MAIN ] JLL: Loaded 31598 existing records. [2025-10-22T19:28:37.466258] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:28:37.466440] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-22T19:28:37.466487] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-22T19:28:37.466849] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-22T19:28:37.466905] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-22T19:28:37.724280] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-22T19:28:37.812952] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:28:38.219525] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T19:28:38.517688] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-22T19:28:38.724035] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-22T19:28:39.317698] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-22T19:28:40.081322] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T19:28:40.117609] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-22T19:28:40.355042] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T19:28:40.917722] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-22T19:28:41.717671] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-22T19:28:41.753388] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T19:28:41.808037] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-22T19:28:42.517797] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-22T19:28:43.030827] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T19:28:43.317719] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-22T19:28:43.821255] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-22T19:28:44.117701] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-22T19:28:44.917700] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-22T19:28:45.069520] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T19:28:45.543421] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T19:28:45.717770] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-22T19:28:45.827454] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-22T19:28:46.517723] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-22T19:28:47.317716] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-22T19:28:47.454257] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T19:28:47.491303] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T19:28:48.117713] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-22T19:28:48.696689] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T19:28:48.917706] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-22T19:28:49.683210] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T19:28:49.717618] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-22T19:28:49.859970] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-22T19:28:50.517681] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-22T19:28:51.317676] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-22T19:28:51.550365] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T19:28:51.562183] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T19:28:51.565012] [INFO ] [REMOTE ] JILL: Full fetch complete (22358 records). [2025-10-22T19:28:51.565102] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-22T19:28:51.932938] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-22T19:28:51.933028] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-22T19:28:51.933518] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-22T19:28:51.933559] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-22T19:28:51.934349] [DEBUG] [LOCAL ] JILL: Trimmed 22358 records to 15268 (keeping 200 days of data) [2025-10-22T19:28:52.025247] [DEBUG] [LOCAL ] JILL: Primary data saved (15268 records). [2025-10-22T19:28:52.025382] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-22T19:28:52.025461] [INFO ] [MAIN ] Update Progress: 1156/2367 symbols completed. JILL took 28.1s. Estimated remaining: 2h 35m 52s. Rate: 7.8 symbols/min [2025-10-22T19:28:52.123302] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-22T19:28:52.191493] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:28:52.197915] [DEBUG] [LOCAL ] JLS: Loaded 4074 existing records from primary storage. [2025-10-22T19:28:52.198125] [INFO ] [MAIN ] JLS: Loaded 4074 existing records. [2025-10-22T19:28:52.374242] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:28:52.374449] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-22T19:28:52.374516] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-22T19:28:52.374733] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-22T19:28:52.374790] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-22T19:28:52.729635] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:28:52.809408] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T19:28:52.917624] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-22T19:28:53.717634] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-22T19:28:53.999561] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T19:28:54.374273] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-22T19:28:54.426254] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T19:28:54.517665] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-22T19:28:55.317675] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-22T19:28:55.945009] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-22T19:28:56.023028] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T19:28:56.117621] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-22T19:28:56.917684] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-22T19:28:57.619203] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-22T19:28:57.626357] [INFO ] [REMOTE ] JKS: Full fetch complete (58772 records). [2025-10-22T19:28:57.626468] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-22T19:28:57.723895] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-22T19:28:58.017832] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-22T19:28:58.017918] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-22T19:28:58.018719] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-22T19:28:58.018781] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-22T19:28:58.019943] [DEBUG] [LOCAL ] JKS: Trimmed 58772 records to 39215 (keeping 200 days of data) [2025-10-22T19:28:58.250010] [DEBUG] [LOCAL ] JKS: Primary data saved (39215 records). [2025-10-22T19:28:58.250158] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-22T19:28:58.250235] [INFO ] [MAIN ] Update Progress: 1157/2367 symbols completed. JKS took 24.6s. Estimated remaining: 2h 35m 43s. Rate: 7.8 symbols/min [2025-10-22T19:28:58.517632] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-22T19:28:58.921676] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-22T19:28:59.063205] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T19:28:59.118125] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T19:28:59.317690] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-22T19:29:00.117682] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-22T19:29:00.814388] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-22T19:29:00.814230] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T19:29:00.917716] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-22T19:29:01.644917] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T19:29:01.717620] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-22T19:29:02.517760] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-22T19:29:03.068446] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-22T19:29:03.128079] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T19:29:03.317631] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-22T19:29:03.977968] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-22T19:29:04.117709] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-22T19:29:04.917713] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-22T19:29:05.483732] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-22T19:29:05.717721] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-22T19:29:05.849307] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T19:29:05.857965] [INFO ] [REMOTE ] JHX: Full fetch complete (62610 records). [2025-10-22T19:29:05.858068] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-22T19:29:06.263792] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-22T19:29:06.263868] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-22T19:29:06.264704] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-22T19:29:06.264766] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-22T19:29:06.265947] [DEBUG] [LOCAL ] JHX: Trimmed 62610 records to 53199 (keeping 200 days of data) [2025-10-22T19:29:06.326199] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-22T19:29:06.534558] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-22T19:29:06.582278] [DEBUG] [LOCAL ] JHX: Primary data saved (53199 records). [2025-10-22T19:29:06.582412] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-22T19:29:06.582531] [INFO ] [MAIN ] Update Progress: 1158/2367 symbols completed. JHX took 44.8s. Estimated remaining: 2h 35m 36s. Rate: 7.8 symbols/min [2025-10-22T19:29:07.317760] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-22T19:29:07.961372] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T19:29:07.962608] [INFO ] [REMOTE ] JLS: Full fetch complete (5832 records). [2025-10-22T19:29:07.962711] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-22T19:29:08.163025] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T19:29:08.222276] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-22T19:29:08.415475] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-22T19:29:08.415551] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-22T19:29:08.415747] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-22T19:29:08.415807] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-22T19:29:08.416173] [DEBUG] [LOCAL ] JLS: Trimmed 5832 records to 4013 (keeping 200 days of data) [2025-10-22T19:29:08.440408] [DEBUG] [LOCAL ] JLS: Primary data saved (4013 records). [2025-10-22T19:29:08.440534] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-22T19:29:08.440613] [INFO ] [MAIN ] Update Progress: 1159/2367 symbols completed. JLS took 16.4s. Estimated remaining: 2h 35m 22s. Rate: 7.8 symbols/min [2025-10-22T19:29:09.669488] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T19:29:09.676606] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-22T19:29:11.375574] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T19:29:11.383286] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-22T19:29:12.780758] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T19:29:12.787589] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-22T19:29:14.076514] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-22T19:29:14.081067] [INFO ] [REMOTE ] JLL: Full fetch complete (45113 records). [2025-10-22T19:29:14.081152] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-22T19:29:14.449768] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-22T19:29:14.449847] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-22T19:29:14.450553] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-22T19:29:14.450594] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-22T19:29:14.451510] [DEBUG] [LOCAL ] JLL: Trimmed 45113 records to 31450 (keeping 200 days of data) [2025-10-22T19:29:14.632592] [DEBUG] [LOCAL ] JLL: Primary data saved (31450 records). [2025-10-22T19:29:14.632774] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-22T19:29:14.632865] [INFO ] [MAIN ] Update Progress: 1160/2367 symbols completed. JLL took 37.5s. Estimated remaining: 2h 35m 13s. Rate: 7.8 symbols/min [2025-10-22T19:29:15.240922] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:15.239795] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:15.385188] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:15.385557] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-22T19:29:15.382373] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:15.385702] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-22T19:29:15.386238] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-22T19:29:15.386297] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-22T19:29:15.386342] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-22T19:29:15.386406] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-22T19:29:15.704131] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-22T19:29:15.744673] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-22T19:29:15.745791] [DEBUG] [LOCAL ] JOBY: Loaded 53809 existing records from primary storage. [2025-10-22T19:29:15.791580] [INFO ] [MAIN ] JOBY: Loaded 53809 existing records. [2025-10-22T19:29:15.875792] [DEBUG] [LOCAL ] JMIA: Loaded 51203 existing records from primary storage. [2025-10-22T19:29:15.976299] [INFO ] [MAIN ] JMIA: Loaded 51203 existing records. [2025-10-22T19:29:16.088082] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:16.137764] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-22T19:29:16.376129] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:29:16.363104] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:29:16.389056] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-22T19:29:16.389179] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-22T19:29:16.389615] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-22T19:29:16.389669] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-22T19:29:16.410556] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-22T19:29:16.456797] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-22T19:29:16.469986] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-22T19:29:16.469689] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:29:16.470282] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-22T19:29:16.469882] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-22T19:29:16.470389] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-22T19:29:16.487364] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-22T19:29:16.493928] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-22T19:29:16.707197] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-22T19:29:16.774044] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-22T19:29:17.351771] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-22T19:29:17.362481] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-22T19:29:17.548592] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:17.596699] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:17.600573] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:17.601096] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-22T19:29:17.601502] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-22T19:29:17.601948] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-22T19:29:17.764418] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-22T19:29:17.765368] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-22T19:29:18.196463] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-22T19:29:18.197584] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-22T19:29:18.697848] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-22T19:29:18.699128] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-22T19:29:19.139292] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-22T19:29:19.141045] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-22T19:29:19.352094] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T19:29:19.364124] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-22T19:29:19.440756] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T19:29:19.620952] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-22T19:29:20.022993] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-22T19:29:20.117615] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-22T19:29:20.917698] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-22T19:29:21.170667] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T19:29:21.321853] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-22T19:29:21.717678] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-22T19:29:22.501359] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-22T19:29:22.517600] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-22T19:29:23.317624] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-22T19:29:23.445964] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T19:29:23.758804] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T19:29:24.117690] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-22T19:29:24.576241] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-22T19:29:24.917699] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-22T19:29:25.436321] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T19:29:25.717640] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-22T19:29:26.517674] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-22T19:29:27.317612] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-22T19:29:27.803852] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-22T19:29:27.844906] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-10-22T19:29:27.917578] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T19:29:27.918325] [INFO ] [REMOTE ] JMM: Full fetch complete (2288 records). [2025-10-22T19:29:27.918391] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-22T19:29:28.090405] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-22T19:29:28.090620] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:29:28.090718] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:29:28.090790] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-22T19:29:28.090852] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-22T19:29:28.090888] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-22T19:29:28.090926] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-22T19:29:28.090979] [INFO ] [MAIN ] Update Progress: 1161/2367 symbols completed. JMM took 13.5s. Estimated remaining: 2h 35m 11s. Rate: 7.8 symbols/min [2025-10-22T19:29:28.122747] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-22T19:29:28.262276] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:28.284830] [DEBUG] [LOCAL ] JOE: Loaded 23783 existing records from primary storage. [2025-10-22T19:29:28.285105] [INFO ] [MAIN ] JOE: Loaded 23783 existing records. [2025-10-22T19:29:28.457685] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:29:28.457919] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-22T19:29:28.457965] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-22T19:29:28.458139] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-22T19:29:28.458177] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-22T19:29:28.804866] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:28.917818] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-22T19:29:29.107674] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-22T19:29:29.717774] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-22T19:29:30.517757] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-22T19:29:30.828443] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T19:29:31.157343] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (3.03 seconds). [2025-10-22T19:29:31.317782] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-22T19:29:31.647015] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T19:29:31.911864] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T19:29:32.117704] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-22T19:29:32.917719] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-22T19:29:33.717622] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-22T19:29:33.820032] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-22T19:29:34.327809] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-22T19:29:34.517632] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-22T19:29:34.613200] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T19:29:34.863348] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T19:29:35.317710] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-22T19:29:36.117718] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-22T19:29:36.917637] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-22T19:29:37.253634] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-22T19:29:37.326426] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-22T19:29:37.717665] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-22T19:29:37.975413] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T19:29:38.072193] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T19:29:38.517728] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-22T19:29:39.317696] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-22T19:29:40.117716] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-22T19:29:40.420568] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-22T19:29:40.461368] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-10-22T19:29:40.638412] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T19:29:40.917685] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-22T19:29:41.717723] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-22T19:29:42.201782] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-22T19:29:42.517679] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-22T19:29:42.908002] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T19:29:43.317672] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-22T19:29:44.117756] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-22T19:29:44.430716] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-10-22T19:29:44.732612] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-22T19:29:44.917612] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-22T19:29:45.244053] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T19:29:45.409074] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-22T19:29:45.417982] [INFO ] [REMOTE ] JMIA: Full fetch complete (73496 records). [2025-10-22T19:29:45.418134] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-22T19:29:45.722710] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-22T19:29:45.812440] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-22T19:29:45.812517] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-22T19:29:45.813442] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-22T19:29:45.813505] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-22T19:29:45.814870] [DEBUG] [LOCAL ] JMIA: Trimmed 73496 records to 51205 (keeping 200 days of data) [2025-10-22T19:29:46.103491] [DEBUG] [LOCAL ] JMIA: Primary data saved (51205 records). [2025-10-22T19:29:46.103679] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-22T19:29:46.103777] [INFO ] [MAIN ] Update Progress: 1162/2367 symbols completed. JMIA took 31.5s. Estimated remaining: 2h 35m 14s. Rate: 7.8 symbols/min [2025-10-22T19:29:46.269773] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:46.278238] [DEBUG] [LOCAL ] JOF: Loaded 6932 existing records from primary storage. [2025-10-22T19:29:46.278451] [INFO ] [MAIN ] JOF: Loaded 6932 existing records. [2025-10-22T19:29:46.451866] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:29:46.452066] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-22T19:29:46.452111] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-22T19:29:46.452247] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-22T19:29:46.452283] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-22T19:29:46.525033] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-22T19:29:46.805777] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:47.317724] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-22T19:29:47.662801] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T19:29:47.900593] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-22T19:29:47.919976] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-22T19:29:47.990485] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (3.07 seconds). [2025-10-22T19:29:47.999121] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-22T19:29:47.999252] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-22T19:29:48.122809] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-22T19:29:48.396539] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-22T19:29:48.396614] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-22T19:29:48.397550] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-22T19:29:48.397607] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-22T19:29:48.398999] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 53809 (keeping 200 days of data) [2025-10-22T19:29:48.709873] [DEBUG] [LOCAL ] JOBY: Primary data saved (53809 records). [2025-10-22T19:29:48.710006] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-22T19:29:48.710108] [INFO ] [MAIN ] Update Progress: 1163/2367 symbols completed. JOBY took 34.1s. Estimated remaining: 2h 35m 1s. Rate: 7.8 symbols/min [2025-10-22T19:29:48.799788] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-22T19:29:48.898247] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:48.917634] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-22T19:29:48.929867] [DEBUG] [LOCAL ] JPC: Loaded 37060 existing records from primary storage. [2025-10-22T19:29:48.930105] [INFO ] [MAIN ] JPC: Loaded 37060 existing records. [2025-10-22T19:29:49.103252] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:29:49.103482] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-22T19:29:49.103538] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-22T19:29:49.103829] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-22T19:29:49.103884] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-22T19:29:49.444994] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:49.717691] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-22T19:29:49.825136] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T19:29:50.517686] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-22T19:29:50.534140] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T19:29:51.317690] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-22T19:29:52.011477] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T19:29:52.077521] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-22T19:29:52.117616] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-22T19:29:52.917764] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-22T19:29:53.238982] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-22T19:29:53.717755] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-22T19:29:54.517778] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-22T19:29:54.704533] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T19:29:54.708505] [INFO ] [REMOTE ] JOE: Full fetch complete (35577 records). [2025-10-22T19:29:54.708626] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-22T19:29:55.048228] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-22T19:29:55.113741] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-22T19:29:55.113959] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-22T19:29:55.114723] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-22T19:29:55.114785] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-22T19:29:55.115540] [DEBUG] [LOCAL ] JOE: Trimmed 35577 records to 23683 (keeping 200 days of data) [2025-10-22T19:29:55.226420] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-22T19:29:55.248718] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-22T19:29:55.250231] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-22T19:29:55.320589] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-22T19:29:55.568528] [DEBUG] [LOCAL ] JOE: Primary data saved (23683 records). [2025-10-22T19:29:55.589051] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-22T19:29:55.589205] [INFO ] [MAIN ] Update Progress: 1164/2367 symbols completed. JOE took 27.5s. Estimated remaining: 2h 34m 52s. Rate: 7.8 symbols/min [2025-10-22T19:29:55.835367] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-22T19:29:55.842668] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-22T19:29:55.858599] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-22T19:29:55.858707] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-22T19:29:55.861687] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:55.863267] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 53753 (keeping 200 days of data) [2025-10-22T19:29:56.021442] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-22T19:29:56.021865] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-22T19:29:56.128317] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-22T19:29:56.184488] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T19:29:56.324834] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:29:56.326853] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-22T19:29:56.330260] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-22T19:29:56.336238] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-22T19:29:56.336826] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-22T19:29:56.728104] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-22T19:29:56.738468] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-22T19:29:56.744581] [INFO ] [MAIN ] Update Progress: 1165/2367 symbols completed. JNJ took 42.1s. Estimated remaining: 2h 34m 38s. Rate: 7.8 symbols/min [2025-10-22T19:29:56.896670] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:56.922805] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-22T19:29:56.965798] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:29:56.996227] [DEBUG] [LOCAL ] JQC: Loaded 33940 existing records from primary storage. [2025-10-22T19:29:56.996507] [INFO ] [MAIN ] JQC: Loaded 33940 existing records. [2025-10-22T19:29:57.169082] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:29:57.169276] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-22T19:29:57.169323] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-22T19:29:57.169572] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-22T19:29:57.169609] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-22T19:29:57.546086] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:29:57.587298] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-22T19:29:57.641848] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T19:29:57.717671] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-22T19:29:58.517758] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-22T19:29:59.036591] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T19:29:59.228741] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T19:29:59.317608] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-22T19:30:00.089973] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-22T19:30:00.117619] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-22T19:30:00.905312] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T19:30:00.917608] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-22T19:30:01.717890] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-22T19:30:01.800054] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-22T19:30:01.802679] [INFO ] [REMOTE ] JOF: Full fetch complete (9510 records). [2025-10-22T19:30:01.802831] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-22T19:30:02.191573] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-22T19:30:02.191687] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-22T19:30:02.191983] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-22T19:30:02.192025] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-22T19:30:02.192462] [DEBUG] [LOCAL ] JOF: Trimmed 9510 records to 6920 (keeping 200 days of data) [2025-10-22T19:30:02.235823] [DEBUG] [LOCAL ] JOF: Primary data saved (6920 records). [2025-10-22T19:30:02.235962] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-22T19:30:02.236040] [INFO ] [MAIN ] Update Progress: 1166/2367 symbols completed. JOF took 16.1s. Estimated remaining: 2h 34m 28s. Rate: 7.8 symbols/min [2025-10-22T19:30:02.407100] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:30:02.423939] [DEBUG] [LOCAL ] JRI: Loaded 15402 existing records from primary storage. [2025-10-22T19:30:02.424241] [INFO ] [MAIN ] JRI: Loaded 15402 existing records. [2025-10-22T19:30:02.523451] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-22T19:30:02.605922] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:30:02.606170] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-22T19:30:02.606238] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-22T19:30:02.606420] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-22T19:30:02.606467] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-22T19:30:02.970263] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:30:03.310896] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T19:30:03.318992] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-22T19:30:04.117707] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-22T19:30:04.789519] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T19:30:04.906857] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-22T19:30:04.917809] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-22T19:30:05.336889] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-22T19:30:05.717688] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-22T19:30:06.517712] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-22T19:30:06.799384] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T19:30:07.257574] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-22T19:30:07.317627] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-22T19:30:07.915489] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T19:30:08.117635] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-22T19:30:08.311914] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-22T19:30:08.917685] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-22T19:30:09.447753] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T19:30:09.717637] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-22T19:30:10.069493] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T19:30:10.517709] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-22T19:30:11.106836] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T19:30:11.317678] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-22T19:30:11.967193] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T19:30:12.117711] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-22T19:30:12.917673] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-22T19:30:13.688462] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-22T19:30:13.717629] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-22T19:30:13.751299] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T19:30:13.886567] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-22T19:30:14.517687] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-22T19:30:15.195895] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T19:30:15.211460] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-22T19:30:15.317617] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-22T19:30:16.117637] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-22T19:30:16.917725] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-22T19:30:17.130120] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T19:30:17.717679] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-22T19:30:17.878580] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-22T19:30:18.281099] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T19:30:18.517682] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-22T19:30:19.097343] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T19:30:19.317708] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-22T19:30:20.117689] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-22T19:30:20.455408] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-22T19:30:20.611780] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-22T19:30:20.917698] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-22T19:30:21.106302] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T19:30:21.717691] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-22T19:30:22.517806] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-22T19:30:22.605702] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T19:30:23.243988] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-22T19:30:23.317771] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-22T19:30:23.972502] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T19:30:24.117699] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-22T19:30:24.315532] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T19:30:24.917703] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-22T19:30:25.717701] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-22T19:30:26.200345] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-22T19:30:26.517637] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-22T19:30:26.684449] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-22T19:30:26.767554] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T19:30:26.770716] [INFO ] [REMOTE ] JRI: Full fetch complete (22990 records). [2025-10-22T19:30:26.770789] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-22T19:30:27.139605] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-22T19:30:27.139727] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-22T19:30:27.140300] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-22T19:30:27.140343] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-22T19:30:27.141232] [DEBUG] [LOCAL ] JRI: Trimmed 22990 records to 15306 (keeping 200 days of data) [2025-10-22T19:30:27.231963] [DEBUG] [LOCAL ] JRI: Primary data saved (15306 records). [2025-10-22T19:30:27.232101] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-22T19:30:27.232196] [INFO ] [MAIN ] Update Progress: 1167/2367 symbols completed. JRI took 25.0s. Estimated remaining: 2h 34m 38s. Rate: 7.8 symbols/min [2025-10-22T19:30:27.330846] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-22T19:30:27.402411] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:30:27.414321] [DEBUG] [LOCAL ] JRS: Loaded 11594 existing records from primary storage. [2025-10-22T19:30:27.414495] [INFO ] [MAIN ] JRS: Loaded 11594 existing records. [2025-10-22T19:30:27.586585] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:30:27.586821] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-22T19:30:27.586868] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-22T19:30:27.587027] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-22T19:30:27.587083] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-22T19:30:27.932540] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:30:28.038692] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T19:30:28.047585] [INFO ] [REMOTE ] JPC: Full fetch complete (55022 records). [2025-10-22T19:30:28.047786] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-22T19:30:28.122781] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-22T19:30:28.431380] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-22T19:30:28.431466] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-22T19:30:28.432382] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-22T19:30:28.432448] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-22T19:30:28.433678] [DEBUG] [LOCAL ] JPC: Trimmed 55022 records to 36948 (keeping 200 days of data) [2025-10-22T19:30:28.647591] [DEBUG] [LOCAL ] JPC: Primary data saved (36948 records). [2025-10-22T19:30:28.647894] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-22T19:30:28.648112] [INFO ] [MAIN ] Update Progress: 1168/2367 symbols completed. JPC took 39.9s. Estimated remaining: 2h 34m 24s. Rate: 7.8 symbols/min [2025-10-22T19:30:28.846717] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:30:28.844504] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T19:30:28.892151] [DEBUG] [LOCAL ] JXN: Loaded 44418 existing records from primary storage. [2025-10-22T19:30:28.892453] [INFO ] [MAIN ] JXN: Loaded 44418 existing records. [2025-10-22T19:30:28.922927] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-22T19:30:29.067503] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:30:29.067714] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-22T19:30:29.067789] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-22T19:30:29.067973] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-22T19:30:29.068014] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-22T19:30:29.417869] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:30:29.580990] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-22T19:30:29.717717] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-22T19:30:30.419871] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-22T19:30:30.517720] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-22T19:30:31.307564] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T19:30:31.316028] [INFO ] [REMOTE ] JQC: Full fetch complete (50044 records). [2025-10-22T19:30:31.316194] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-22T19:30:31.328073] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-22T19:30:31.735030] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-22T19:30:31.735127] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-22T19:30:31.735879] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-22T19:30:31.735942] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-22T19:30:31.737020] [DEBUG] [LOCAL ] JQC: Trimmed 50044 records to 33868 (keeping 200 days of data) [2025-10-22T19:30:31.935048] [DEBUG] [LOCAL ] JQC: Primary data saved (33868 records). [2025-10-22T19:30:31.935175] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-22T19:30:31.935251] [INFO ] [MAIN ] Update Progress: 1169/2367 symbols completed. JQC took 35.2s. Estimated remaining: 2h 34m 11s. Rate: 7.8 symbols/min [2025-10-22T19:30:32.104943] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:30:32.127142] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-22T19:30:32.147376] [DEBUG] [LOCAL ] K: Loaded 50401 existing records from primary storage. [2025-10-22T19:30:32.147704] [INFO ] [MAIN ] K: Loaded 50401 existing records. [2025-10-22T19:30:32.316963] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:30:32.317117] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-22T19:30:32.317163] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-22T19:30:32.317438] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-22T19:30:32.317476] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-22T19:30:32.663481] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:30:32.861977] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-22T19:30:32.917625] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-22T19:30:32.950569] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T19:30:32.954942] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T19:30:33.717757] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-22T19:30:34.517723] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-22T19:30:35.235829] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T19:30:35.317682] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-22T19:30:35.596311] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.68 seconds). [2025-10-22T19:30:35.605005] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-22T19:30:35.605129] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-22T19:30:35.997157] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-22T19:30:35.997321] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-22T19:30:35.998359] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-22T19:30:35.998439] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-22T19:30:35.999985] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 53794 (keeping 200 days of data) [2025-10-22T19:30:36.126913] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-22T19:30:36.141312] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T19:30:36.365785] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-22T19:30:36.365911] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-22T19:30:36.366094] [INFO ] [MAIN ] Update Progress: 1170/2367 symbols completed. JPM took 40.8s. Estimated remaining: 2h 34m 0s. Rate: 7.8 symbols/min [2025-10-22T19:30:36.532438] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:30:36.547289] [DEBUG] [LOCAL ] KAI: Loaded 13490 existing records from primary storage. [2025-10-22T19:30:36.547511] [INFO ] [MAIN ] KAI: Loaded 13490 existing records. [2025-10-22T19:30:36.727537] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:30:36.727912] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-22T19:30:36.728004] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-22T19:30:36.728213] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-22T19:30:36.728274] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-22T19:30:36.923508] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T19:30:36.922301] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-22T19:30:37.080877] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T19:30:37.163630] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:30:37.717728] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-22T19:30:38.424893] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-22T19:30:38.517792] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-22T19:30:38.810378] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T19:30:39.305793] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T19:30:39.317638] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-22T19:30:40.117708] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-22T19:30:40.329954] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T19:30:40.917718] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-22T19:30:41.718799] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-22T19:30:41.719849] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T19:30:41.894877] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T19:30:42.517637] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-22T19:30:42.665878] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T19:30:43.295737] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T19:30:43.317630] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-22T19:30:44.117708] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-22T19:30:44.770697] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T19:30:44.917716] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-22T19:30:45.717760] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-22T19:30:45.764630] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T19:30:46.517668] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-22T19:30:46.547791] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T19:30:46.728156] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T19:30:47.317753] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-22T19:30:48.117699] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-22T19:30:48.214961] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T19:30:48.427022] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T19:30:48.917635] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-22T19:30:48.993089] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T19:30:49.717697] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-22T19:30:50.492714] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T19:30:50.517615] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-22T19:30:50.674263] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-22T19:30:51.317756] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-22T19:30:52.122776] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-22T19:30:52.137183] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T19:30:52.871402] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T19:30:52.917616] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-22T19:30:53.086185] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T19:30:53.717679] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-22T19:30:54.394047] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T19:30:54.517688] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-22T19:30:55.038407] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T19:30:55.317635] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-22T19:30:56.117623] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-22T19:30:56.227394] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T19:30:56.917669] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-22T19:30:56.996977] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T19:30:56.995707] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-22T19:30:57.717668] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-22T19:30:58.360185] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T19:30:58.367545] [INFO ] [REMOTE ] JXN: Full fetch complete (65506 records). [2025-10-22T19:30:58.367704] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-22T19:30:58.518826] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-22T19:30:58.682572] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T19:30:58.700634] [INFO ] [REMOTE ] JRS: Full fetch complete (16207 records). [2025-10-22T19:30:58.700758] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-22T19:30:58.865341] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-22T19:30:58.865724] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-22T19:30:58.872094] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-22T19:30:58.877290] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-22T19:30:58.940759] [DEBUG] [LOCAL ] JXN: Trimmed 65506 records to 44322 (keeping 200 days of data) [2025-10-22T19:30:59.243716] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-22T19:30:59.245262] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-22T19:30:59.245872] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-22T19:30:59.245950] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-22T19:30:59.252377] [DEBUG] [LOCAL ] JRS: Trimmed 16207 records to 11529 (keeping 200 days of data) [2025-10-22T19:30:59.337870] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-22T19:30:59.418484] [DEBUG] [LOCAL ] JRS: Primary data saved (11529 records). [2025-10-22T19:30:59.422257] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-22T19:30:59.426240] [INFO ] [MAIN ] Update Progress: 1171/2367 symbols completed. JRS took 32.2s. Estimated remaining: 2h 34m 8s. Rate: 7.8 symbols/min [2025-10-22T19:30:59.589574] [DEBUG] [LOCAL ] JXN: Primary data saved (44322 records). [2025-10-22T19:30:59.600126] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-22T19:30:59.610346] [INFO ] [MAIN ] Update Progress: 1172/2367 symbols completed. JXN took 31.0s. Estimated remaining: 2h 33m 53s. Rate: 7.8 symbols/min [2025-10-22T19:30:59.883809] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:30:59.887131] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:30:59.918244] [DEBUG] [LOCAL ] KB: Loaded 23189 existing records from primary storage. [2025-10-22T19:30:59.918555] [INFO ] [MAIN ] KB: Loaded 23189 existing records. [2025-10-22T19:31:00.035019] [DEBUG] [LOCAL ] KAR: Loaded 39768 existing records from primary storage. [2025-10-22T19:31:00.050884] [INFO ] [MAIN ] KAR: Loaded 39768 existing records. [2025-10-22T19:31:00.158502] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:31:00.194706] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-22T19:31:00.210712] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-22T19:31:00.229312] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-22T19:31:00.239909] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-22T19:31:00.377971] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:31:00.404429] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-22T19:31:00.411246] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-22T19:31:00.423147] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-22T19:31:00.423494] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-22T19:31:00.424686] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T19:31:00.489153] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-22T19:31:00.869519] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-22T19:31:01.024409] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:31:01.035342] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-22T19:31:01.127981] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:31:01.569930] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-22T19:31:01.717766] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-22T19:31:02.517627] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-22T19:31:02.761247] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-22T19:31:02.912802] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T19:31:02.921296] [INFO ] [REMOTE ] K: Full fetch complete (72311 records). [2025-10-22T19:31:02.921474] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-22T19:31:03.296315] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T19:31:03.333955] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-22T19:31:03.338199] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-22T19:31:03.339230] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-22T19:31:03.340294] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-22T19:31:03.340485] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-22T19:31:03.341946] [DEBUG] [LOCAL ] K: Trimmed 72311 records to 50378 (keeping 200 days of data) [2025-10-22T19:31:03.644107] [DEBUG] [LOCAL ] K: Primary data saved (50378 records). [2025-10-22T19:31:03.644235] [INFO ] [MAIN ] K: Full history saved. [2025-10-22T19:31:03.644841] [INFO ] [MAIN ] Update Progress: 1173/2367 symbols completed. K took 31.7s. Estimated remaining: 2h 33m 41s. Rate: 7.8 symbols/min [2025-10-22T19:31:03.814121] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:31:03.836899] [DEBUG] [LOCAL ] KBDC: Loaded 22747 existing records from primary storage. [2025-10-22T19:31:03.837136] [INFO ] [MAIN ] KBDC: Loaded 22747 existing records. [2025-10-22T19:31:04.010661] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:31:04.010879] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-22T19:31:04.010936] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-22T19:31:04.011096] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-22T19:31:04.011134] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-22T19:31:04.122817] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-22T19:31:04.364264] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:31:04.478321] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-22T19:31:04.917759] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-22T19:31:05.332495] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T19:31:05.717688] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-22T19:31:06.332325] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T19:31:06.517701] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-22T19:31:07.153439] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T19:31:07.317628] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-22T19:31:07.715743] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-22T19:31:08.117675] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-22T19:31:08.323852] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T19:31:08.917695] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-22T19:31:09.597601] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T19:31:09.717692] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-22T19:31:09.929990] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T19:31:09.933109] [INFO ] [REMOTE ] KAI: Full fetch complete (19274 records). [2025-10-22T19:31:09.933205] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-22T19:31:10.290778] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-22T19:31:10.290875] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-22T19:31:10.291285] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-22T19:31:10.291323] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-22T19:31:10.291871] [DEBUG] [LOCAL ] KAI: Trimmed 19274 records to 13405 (keeping 200 days of data) [2025-10-22T19:31:10.374911] [DEBUG] [LOCAL ] KAI: Primary data saved (13405 records). [2025-10-22T19:31:10.375033] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-22T19:31:10.375110] [INFO ] [MAIN ] Update Progress: 1174/2367 symbols completed. KAI took 34.0s. Estimated remaining: 2h 33m 32s. Rate: 7.8 symbols/min [2025-10-22T19:31:10.522792] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-22T19:31:10.568201] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:31:10.610234] [DEBUG] [LOCAL ] KBH: Loaded 48751 existing records from primary storage. [2025-10-22T19:31:10.610530] [INFO ] [MAIN ] KBH: Loaded 48751 existing records. [2025-10-22T19:31:10.786559] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:31:10.786792] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-22T19:31:10.786840] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-22T19:31:10.787022] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-22T19:31:10.787060] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-22T19:31:11.137025] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:31:11.223489] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T19:31:11.317633] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-22T19:31:11.572377] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T19:31:12.117695] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-22T19:31:12.717318] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T19:31:12.917707] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-22T19:31:13.717694] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-22T19:31:13.867849] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T19:31:13.962738] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T19:31:14.517671] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-22T19:31:14.698392] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-22T19:31:15.317729] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-22T19:31:15.822445] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-22T19:31:16.117784] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-22T19:31:16.917764] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-22T19:31:17.118806] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T19:31:17.281550] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-22T19:31:17.717670] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-22T19:31:17.938221] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-22T19:31:18.517709] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-22T19:31:19.317719] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-22T19:31:19.379011] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T19:31:19.684955] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T19:31:20.117627] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-22T19:31:20.583529] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-22T19:31:20.917693] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-22T19:31:21.717633] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-22T19:31:21.932193] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T19:31:22.013471] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T19:31:22.517689] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-22T19:31:23.202862] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T19:31:23.317618] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-22T19:31:23.404817] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T19:31:24.117683] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-22T19:31:24.753847] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T19:31:24.917667] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-22T19:31:25.162000] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T19:31:25.165280] [INFO ] [REMOTE ] KB: Full fetch complete (33535 records). [2025-10-22T19:31:25.165352] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-22T19:31:25.546122] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-22T19:31:25.546189] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-22T19:31:25.546925] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-22T19:31:25.546993] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-22T19:31:25.548000] [DEBUG] [LOCAL ] KB: Trimmed 33535 records to 23045 (keeping 200 days of data) [2025-10-22T19:31:25.688874] [DEBUG] [LOCAL ] KB: Primary data saved (23045 records). [2025-10-22T19:31:25.689068] [INFO ] [MAIN ] KB: Full history saved. [2025-10-22T19:31:25.689153] [INFO ] [MAIN ] Update Progress: 1175/2367 symbols completed. KB took 26.1s. Estimated remaining: 2h 33m 32s. Rate: 7.8 symbols/min [2025-10-22T19:31:25.722765] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-22T19:31:25.868370] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:31:25.908782] [DEBUG] [LOCAL ] KBR: Loaded 47999 existing records from primary storage. [2025-10-22T19:31:25.909083] [INFO ] [MAIN ] KBR: Loaded 47999 existing records. [2025-10-22T19:31:26.019621] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-22T19:31:26.098104] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:31:26.098312] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-22T19:31:26.098358] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-22T19:31:26.098800] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-22T19:31:26.098856] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-22T19:31:26.443808] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:31:26.517892] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-22T19:31:26.935412] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T19:31:27.317634] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-22T19:31:27.543209] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T19:31:28.117703] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-22T19:31:28.917690] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-22T19:31:29.729584] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-22T19:31:29.736141] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-22T19:31:29.864331] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T19:31:29.871340] [INFO ] [REMOTE ] KAR: Full fetch complete (56919 records). [2025-10-22T19:31:29.871460] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-22T19:31:30.260211] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-22T19:31:30.260363] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-22T19:31:30.261687] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-22T19:31:30.261956] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-22T19:31:30.263402] [DEBUG] [LOCAL ] KAR: Trimmed 56919 records to 39707 (keeping 200 days of data) [2025-10-22T19:31:30.491470] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T19:31:30.522842] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-22T19:31:30.532241] [DEBUG] [LOCAL ] KAR: Primary data saved (39707 records). [2025-10-22T19:31:30.532513] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-22T19:31:30.532617] [INFO ] [MAIN ] Update Progress: 1176/2367 symbols completed. KAR took 31.1s. Estimated remaining: 2h 33m 22s. Rate: 7.8 symbols/min [2025-10-22T19:31:30.702041] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:31:30.749625] [DEBUG] [LOCAL ] KD: Loaded 52344 existing records from primary storage. [2025-10-22T19:31:30.750011] [INFO ] [MAIN ] KD: Loaded 52344 existing records. [2025-10-22T19:31:30.936533] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:31:30.938879] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-22T19:31:30.938716] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T19:31:30.939052] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-22T19:31:30.944102] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-22T19:31:30.944167] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-22T19:31:31.289463] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:31:31.317614] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-22T19:31:32.117717] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-22T19:31:32.170818] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T19:31:32.917771] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-22T19:31:33.250677] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T19:31:33.544474] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T19:31:33.717708] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-22T19:31:34.348603] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T19:31:34.517744] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-22T19:31:35.317688] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-22T19:31:35.477005] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T19:31:36.117685] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-22T19:31:36.147515] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T19:31:36.253764] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-22T19:31:36.917688] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-22T19:31:37.530435] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T19:31:37.717671] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-22T19:31:38.349571] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T19:31:38.517620] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-22T19:31:39.163294] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T19:31:39.317767] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-22T19:31:40.117721] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-22T19:31:40.308295] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T19:31:40.709202] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T19:31:40.714681] [INFO ] [REMOTE ] KBDC: Full fetch complete (30922 records). [2025-10-22T19:31:40.714761] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-22T19:31:40.927314] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-22T19:31:41.121810] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-22T19:31:41.121925] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-22T19:31:41.123011] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-22T19:31:41.123078] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-22T19:31:41.124126] [DEBUG] [LOCAL ] KBDC: Trimmed 30922 records to 22661 (keeping 200 days of data) [2025-10-22T19:31:41.279019] [DEBUG] [LOCAL ] KBDC: Primary data saved (22661 records). [2025-10-22T19:31:41.279247] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-22T19:31:41.279377] [INFO ] [MAIN ] Update Progress: 1177/2367 symbols completed. KBDC took 37.6s. Estimated remaining: 2h 33m 17s. Rate: 7.8 symbols/min [2025-10-22T19:31:41.468865] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:31:41.475865] [DEBUG] [LOCAL ] KEN: Loaded 4665 existing records from primary storage. [2025-10-22T19:31:41.476102] [INFO ] [MAIN ] KEN: Loaded 4665 existing records. [2025-10-22T19:31:41.692338] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:31:41.692920] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-22T19:31:41.692991] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-22T19:31:41.693326] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-22T19:31:41.693388] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-22T19:31:41.724074] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-22T19:31:42.075679] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T19:31:42.110252] [INFO ] [REMOTE ] KBH: Full fetch complete (71077 records). [2025-10-22T19:31:42.131849] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-22T19:31:42.238712] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:31:42.522911] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-22T19:31:42.591560] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-22T19:31:42.592548] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-22T19:31:42.593573] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-22T19:31:42.593769] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-22T19:31:42.595213] [DEBUG] [LOCAL ] KBH: Trimmed 71077 records to 48710 (keeping 200 days of data) [2025-10-22T19:31:42.881210] [DEBUG] [LOCAL ] KBH: Primary data saved (48710 records). [2025-10-22T19:31:42.881407] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-22T19:31:42.881513] [INFO ] [MAIN ] Update Progress: 1178/2367 symbols completed. KBH took 32.5s. Estimated remaining: 2h 33m 3s. Rate: 7.8 symbols/min [2025-10-22T19:31:43.007290] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-22T19:31:43.088737] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:31:43.118034] [DEBUG] [LOCAL ] KEP: Loaded 32502 existing records from primary storage. [2025-10-22T19:31:43.118332] [INFO ] [MAIN ] KEP: Loaded 32502 existing records. [2025-10-22T19:31:43.221076] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T19:31:43.306144] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:31:43.306513] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-22T19:31:43.306661] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-22T19:31:43.307073] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-22T19:31:43.307128] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-22T19:31:43.322898] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-22T19:31:43.721712] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:31:43.736089] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T19:31:44.117670] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-22T19:31:44.917764] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-22T19:31:45.450884] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-22T19:31:45.467974] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T19:31:45.543513] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-22T19:31:45.717675] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-22T19:31:46.339780] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T19:31:46.517668] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-22T19:31:47.317686] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-22T19:31:47.620365] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T19:31:48.072507] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-22T19:31:48.117687] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-22T19:31:48.917690] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-22T19:31:49.360178] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-22T19:31:49.525720] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-22T19:31:49.717671] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-22T19:31:50.517702] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-22T19:31:50.978520] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T19:31:51.317717] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-22T19:31:52.117727] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-22T19:31:52.512360] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-22T19:31:52.694889] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T19:31:52.820672] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T19:31:52.917682] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-22T19:31:53.717694] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-22T19:31:54.517707] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-22T19:31:54.595117] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T19:31:55.141722] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T19:31:55.317726] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-22T19:31:56.108536] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T19:31:56.117603] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-22T19:31:56.917687] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-22T19:31:57.203333] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T19:31:57.629983] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T19:31:57.717617] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-22T19:31:58.328959] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T19:31:58.517684] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-22T19:31:59.137040] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T19:31:59.167171] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T19:31:59.317632] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-22T19:31:59.884828] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-22T19:32:00.117711] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-22T19:32:00.917706] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-22T19:32:01.717730] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-22T19:32:02.155370] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-22T19:32:02.367297] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T19:32:02.517690] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-22T19:32:03.317720] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-22T19:32:03.472582] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T19:32:03.951411] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-22T19:32:04.027012] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T19:32:04.032761] [INFO ] [REMOTE ] KEP: Full fetch complete (42435 records). [2025-10-22T19:32:04.032861] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-22T19:32:04.122774] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-22T19:32:04.399366] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-22T19:32:04.399441] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-22T19:32:04.400117] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-22T19:32:04.400179] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-22T19:32:04.401036] [DEBUG] [LOCAL ] KEP: Trimmed 42435 records to 32572 (keeping 200 days of data) [2025-10-22T19:32:04.581804] [DEBUG] [LOCAL ] KEP: Primary data saved (32572 records). [2025-10-22T19:32:04.581932] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-22T19:32:04.582009] [INFO ] [MAIN ] Update Progress: 1179/2367 symbols completed. KEP took 21.7s. Estimated remaining: 2h 33m 10s. Rate: 7.8 symbols/min [2025-10-22T19:32:04.752947] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:32:04.788113] [DEBUG] [LOCAL ] KEX: Loaded 38788 existing records from primary storage. [2025-10-22T19:32:04.788393] [INFO ] [MAIN ] KEX: Loaded 38788 existing records. [2025-10-22T19:32:04.859832] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T19:32:04.884139] [INFO ] [REMOTE ] KEN: Full fetch complete (5877 records). [2025-10-22T19:32:04.892124] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-22T19:32:04.923554] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-22T19:32:05.132812] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:32:05.160695] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-22T19:32:05.169419] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-22T19:32:05.223699] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-22T19:32:05.238676] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-22T19:32:05.507330] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-22T19:32:05.508595] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-22T19:32:05.523819] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-22T19:32:05.525162] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-22T19:32:05.603437] [DEBUG] [LOCAL ] KEN: Trimmed 5877 records to 4612 (keeping 200 days of data) [2025-10-22T19:32:05.734918] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-22T19:32:05.741267] [DEBUG] [LOCAL ] KEN: Primary data saved (4612 records). [2025-10-22T19:32:05.744953] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-22T19:32:05.745092] [INFO ] [MAIN ] Update Progress: 1180/2367 symbols completed. KEN took 24.5s. Estimated remaining: 2h 32m 55s. Rate: 7.8 symbols/min [2025-10-22T19:32:05.744558] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:32:05.917678] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:32:05.917887] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-22T19:32:05.917931] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-22T19:32:05.918049] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-22T19:32:05.918091] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-22T19:32:05.918133] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-22T19:32:05.918167] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-22T19:32:06.277044] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:32:06.517638] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-22T19:32:06.876818] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-22T19:32:07.317672] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-22T19:32:07.562774] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T19:32:07.570582] [INFO ] [REMOTE ] KBR: Full fetch complete (69937 records). [2025-10-22T19:32:07.570762] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-22T19:32:07.964250] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-22T19:32:07.964364] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-22T19:32:07.965360] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-22T19:32:07.965442] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-22T19:32:07.966916] [DEBUG] [LOCAL ] KBR: Trimmed 69937 records to 47970 (keeping 200 days of data) [2025-10-22T19:32:08.146893] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-22T19:32:08.273940] [DEBUG] [LOCAL ] KBR: Primary data saved (47970 records). [2025-10-22T19:32:08.274077] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-22T19:32:08.274180] [INFO ] [MAIN ] Update Progress: 1181/2367 symbols completed. KBR took 42.6s. Estimated remaining: 2h 32m 42s. Rate: 7.8 symbols/min [2025-10-22T19:32:08.491570] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:32:08.532475] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T19:32:08.586378] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-22T19:32:08.645805] [DEBUG] [LOCAL ] KEYS: Loaded 43207 existing records from primary storage. [2025-10-22T19:32:08.646272] [INFO ] [MAIN ] KEYS: Loaded 43207 existing records. [2025-10-22T19:32:08.926341] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-22T19:32:08.935371] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:32:08.937182] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-22T19:32:08.937256] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-22T19:32:08.937540] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-22T19:32:08.937610] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-22T19:32:09.445762] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:32:09.717673] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-22T19:32:10.131135] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T19:32:10.139830] [INFO ] [REMOTE ] KD: Full fetch complete (76108 records). [2025-10-22T19:32:10.139953] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-22T19:32:10.534288] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-22T19:32:10.534722] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-22T19:32:10.534815] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-22T19:32:10.536603] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-22T19:32:10.536798] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-22T19:32:10.538369] [DEBUG] [LOCAL ] KD: Trimmed 76108 records to 52332 (keeping 200 days of data) [2025-10-22T19:32:10.661156] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T19:32:10.877513] [DEBUG] [LOCAL ] KD: Primary data saved (52332 records). [2025-10-22T19:32:10.877673] [INFO ] [MAIN ] KD: Full history saved. [2025-10-22T19:32:10.877790] [INFO ] [MAIN ] Update Progress: 1182/2367 symbols completed. KD took 40.3s. Estimated remaining: 2h 32m 29s. Rate: 7.8 symbols/min [2025-10-22T19:32:11.046339] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:32:11.050559] [DEBUG] [LOCAL ] KF: Loaded 2359 existing records from primary storage. [2025-10-22T19:32:11.050762] [INFO ] [MAIN ] KF: Loaded 2359 existing records. [2025-10-22T19:32:11.236171] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:32:11.248574] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T19:32:11.247968] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-22T19:32:11.255055] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-22T19:32:11.255883] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-22T19:32:11.255942] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-22T19:32:11.322740] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-22T19:32:11.605407] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:32:12.117691] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-22T19:32:12.156315] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T19:32:12.615312] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-22T19:32:12.911873] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T19:32:12.921548] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-22T19:32:13.389292] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-22T19:32:13.717689] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-22T19:32:14.517713] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-22T19:32:15.123750] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T19:32:15.147168] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T19:32:15.317688] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-22T19:32:16.117692] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-22T19:32:16.873388] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T19:32:16.917709] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-22T19:32:17.317711] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T19:32:17.451265] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-22T19:32:17.717690] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-22T19:32:18.517714] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-22T19:32:19.317701] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-22T19:32:19.581070] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T19:32:19.867985] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-22T19:32:20.117630] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-22T19:32:20.241638] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T19:32:20.712810] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-22T19:32:20.917672] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-22T19:32:21.717729] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-22T19:32:22.517680] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-22T19:32:22.648382] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T19:32:22.813568] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-22T19:32:23.317626] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-22T19:32:23.744293] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-22T19:32:24.117764] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-22T19:32:24.666488] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-22T19:32:24.917677] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-22T19:32:25.717627] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-22T19:32:25.909531] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T19:32:26.154726] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-22T19:32:26.517655] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-22T19:32:26.586497] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T19:32:27.317721] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-22T19:32:28.117676] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-22T19:32:28.172659] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T19:32:28.924141] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-22T19:32:28.942218] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T19:32:29.375745] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-22T19:32:29.485916] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T19:32:29.717779] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-22T19:32:30.517706] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-22T19:32:31.317631] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-22T19:32:31.660921] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T19:32:32.117724] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-22T19:32:32.190588] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T19:32:32.737151] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T19:32:32.790833] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-22T19:32:32.791811] [INFO ] [REMOTE ] KF: Full fetch complete (3505 records). [2025-10-22T19:32:32.791879] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-22T19:32:32.929319] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-22T19:32:33.145056] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-22T19:32:33.145134] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-22T19:32:33.145250] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-22T19:32:33.145288] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-22T19:32:33.145622] [DEBUG] [LOCAL ] KF: Trimmed 3505 records to 2360 (keeping 200 days of data) [2025-10-22T19:32:33.159540] [DEBUG] [LOCAL ] KF: Primary data saved (2360 records). [2025-10-22T19:32:33.159658] [INFO ] [MAIN ] KF: Full history saved. [2025-10-22T19:32:33.159757] [INFO ] [MAIN ] Update Progress: 1183/2367 symbols completed. KF took 22.3s. Estimated remaining: 2h 32m 36s. Rate: 7.8 symbols/min [2025-10-22T19:32:33.328112] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:32:33.346562] [DEBUG] [LOCAL ] KFRC: Loaded 20800 existing records from primary storage. [2025-10-22T19:32:33.346819] [INFO ] [MAIN ] KFRC: Loaded 20800 existing records. [2025-10-22T19:32:33.519619] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:32:33.519859] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-22T19:32:33.519908] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-22T19:32:33.520143] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-22T19:32:33.520180] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-22T19:32:33.723766] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-22T19:32:33.870129] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:32:34.517676] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-22T19:32:34.607862] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T19:32:35.313378] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T19:32:35.321814] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-22T19:32:35.973471] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-22T19:32:36.117685] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-22T19:32:36.389713] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T19:32:36.917689] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-22T19:32:37.029369] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-22T19:32:37.717723] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-22T19:32:38.517637] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-22T19:32:38.600201] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T19:32:38.607828] [INFO ] [REMOTE ] KEYS: Full fetch complete (63118 records). [2025-10-22T19:32:38.607950] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-22T19:32:38.992191] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-22T19:32:38.992265] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-22T19:32:38.993183] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-22T19:32:38.993244] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-22T19:32:38.994413] [DEBUG] [LOCAL ] KEYS: Trimmed 63118 records to 43120 (keeping 200 days of data) [2025-10-22T19:32:39.254935] [DEBUG] [LOCAL ] KEYS: Primary data saved (43120 records). [2025-10-22T19:32:39.255104] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-22T19:32:39.255216] [INFO ] [MAIN ] Update Progress: 1184/2367 symbols completed. KEYS took 31.0s. Estimated remaining: 2h 32m 27s. Rate: 7.8 symbols/min [2025-10-22T19:32:39.322857] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-22T19:32:39.426040] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:32:39.457984] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T19:32:39.472325] [DEBUG] [LOCAL ] KFS: Loaded 8691 existing records from primary storage. [2025-10-22T19:32:39.472532] [INFO ] [MAIN ] KFS: Loaded 8691 existing records. [2025-10-22T19:32:39.645270] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:32:39.645453] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-22T19:32:39.645504] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-22T19:32:39.645676] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-22T19:32:39.645732] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-22T19:32:40.002765] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:32:40.056051] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T19:32:40.117617] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-22T19:32:40.409951] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T19:32:40.917726] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-22T19:32:41.717666] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-22T19:32:41.821709] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T19:32:41.828718] [INFO ] [REMOTE ] KEX: Full fetch complete (56106 records). [2025-10-22T19:32:41.828809] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-22T19:32:42.206742] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-22T19:32:42.206820] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-22T19:32:42.207577] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-22T19:32:42.207617] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-22T19:32:42.208742] [DEBUG] [LOCAL ] KEX: Trimmed 56106 records to 38734 (keeping 200 days of data) [2025-10-22T19:32:42.416435] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T19:32:42.437599] [DEBUG] [LOCAL ] KEX: Primary data saved (38734 records). [2025-10-22T19:32:42.437712] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-22T19:32:42.437821] [INFO ] [MAIN ] Update Progress: 1185/2367 symbols completed. KEX took 37.9s. Estimated remaining: 2h 32m 15s. Rate: 7.8 symbols/min [2025-10-22T19:32:42.526214] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-22T19:32:42.606085] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:32:42.633781] [DEBUG] [LOCAL ] KFY: Loaded 29615 existing records from primary storage. [2025-10-22T19:32:42.634032] [INFO ] [MAIN ] KFY: Loaded 29615 existing records. [2025-10-22T19:32:42.805883] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:32:42.806125] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-22T19:32:42.806202] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-22T19:32:42.806410] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-22T19:32:42.806468] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-22T19:32:43.174933] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:32:43.197332] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-22T19:32:43.206261] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-22T19:32:43.206390] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-22T19:32:43.321121] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-22T19:32:43.315931] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T19:32:43.407762] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T19:32:43.408639] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:32:43.408739] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:32:43.408830] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-22T19:32:43.408929] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-22T19:32:43.408993] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-22T19:32:43.409040] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-22T19:32:43.409099] [INFO ] [MAIN ] Update Progress: 1186/2367 symbols completed. KEY took 37.7s. Estimated remaining: 2h 32m 0s. Rate: 7.8 symbols/min [2025-10-22T19:32:43.575054] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:32:43.623878] [DEBUG] [LOCAL ] KGC: Loaded 53700 existing records from primary storage. [2025-10-22T19:32:43.624218] [INFO ] [MAIN ] KGC: Loaded 53700 existing records. [2025-10-22T19:32:43.797437] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:32:43.797671] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-22T19:32:43.797767] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-22T19:32:43.798146] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-22T19:32:43.798204] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-22T19:32:44.123852] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-22T19:32:44.166859] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:32:44.469947] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T19:32:44.778804] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-22T19:32:44.917628] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-22T19:32:45.717622] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-22T19:32:46.121080] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T19:32:46.490288] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-22T19:32:46.517619] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-22T19:32:47.243150] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T19:32:47.317672] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-22T19:32:48.100020] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T19:32:48.117622] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-22T19:32:48.917722] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-22T19:32:48.972892] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T19:32:49.717781] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-22T19:32:49.989354] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T19:32:50.517682] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-22T19:32:51.317696] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-22T19:32:51.450453] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T19:32:51.656727] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T19:32:52.117701] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-22T19:32:52.486625] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T19:32:52.917707] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-22T19:32:53.690530] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-22T19:32:53.717626] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-22T19:32:54.030628] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T19:32:54.517699] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-22T19:32:54.747599] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T19:32:55.317763] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-22T19:32:55.873713] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T19:32:56.117622] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-22T19:32:56.569425] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-22T19:32:56.917716] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-22T19:32:57.498532] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T19:32:57.717685] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-22T19:32:58.517667] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-22T19:32:58.919148] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-22T19:32:58.962113] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-22T19:32:59.268355] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-22T19:32:59.317638] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-22T19:33:00.117691] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-22T19:33:00.213908] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-22T19:33:00.217146] [INFO ] [REMOTE ] KFS: Full fetch complete (11224 records). [2025-10-22T19:33:00.217285] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-22T19:33:00.590577] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-22T19:33:00.590683] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-22T19:33:00.590982] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-22T19:33:00.591025] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-22T19:33:00.591470] [DEBUG] [LOCAL ] KFS: Trimmed 11224 records to 8701 (keeping 200 days of data) [2025-10-22T19:33:00.641908] [DEBUG] [LOCAL ] KFS: Primary data saved (8701 records). [2025-10-22T19:33:00.642048] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-22T19:33:00.642130] [INFO ] [MAIN ] Update Progress: 1187/2367 symbols completed. KFS took 21.4s. Estimated remaining: 2h 32m 2s. Rate: 7.8 symbols/min [2025-10-22T19:33:00.810082] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:00.848581] [DEBUG] [LOCAL ] KGS: Loaded 46136 existing records from primary storage. [2025-10-22T19:33:00.848921] [INFO ] [MAIN ] KGS: Loaded 46136 existing records. [2025-10-22T19:33:00.922827] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-22T19:33:01.035624] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:33:01.035876] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-22T19:33:01.035934] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-22T19:33:01.036213] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-22T19:33:01.036268] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-22T19:33:01.406162] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:01.717705] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-22T19:33:01.772845] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T19:33:02.517718] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-22T19:33:03.317723] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-22T19:33:04.075033] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-22T19:33:04.117612] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-22T19:33:04.191454] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (3.27 seconds). [2025-10-22T19:33:04.283713] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T19:33:04.756752] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T19:33:04.761101] [INFO ] [REMOTE ] KFRC: Full fetch complete (27064 records). [2025-10-22T19:33:04.761182] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-22T19:33:04.930977] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-22T19:33:05.127387] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-22T19:33:05.127462] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-22T19:33:05.128121] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-22T19:33:05.128201] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-22T19:33:05.129345] [DEBUG] [LOCAL ] KFRC: Trimmed 27064 records to 20843 (keeping 200 days of data) [2025-10-22T19:33:05.265263] [DEBUG] [LOCAL ] KFRC: Primary data saved (20843 records). [2025-10-22T19:33:05.265414] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-22T19:33:05.265492] [INFO ] [MAIN ] Update Progress: 1188/2367 symbols completed. KFRC took 32.1s. Estimated remaining: 2h 31m 51s. Rate: 7.8 symbols/min [2025-10-22T19:33:05.432230] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:05.477875] [DEBUG] [LOCAL ] KIM: Loaded 53000 existing records from primary storage. [2025-10-22T19:33:05.478183] [INFO ] [MAIN ] KIM: Loaded 53000 existing records. [2025-10-22T19:33:05.653378] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:33:05.653612] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-22T19:33:05.653697] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-22T19:33:05.654303] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-22T19:33:05.654342] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-22T19:33:05.726963] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-22T19:33:06.013944] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:06.134488] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-22T19:33:06.284634] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T19:33:06.517682] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-22T19:33:07.317692] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-22T19:33:07.902073] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-22T19:33:08.117713] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-22T19:33:08.315045] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T19:33:08.917692] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-22T19:33:09.045709] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T19:33:09.717689] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-22T19:33:10.038374] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-22T19:33:10.067453] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T19:33:10.517716] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-22T19:33:11.317628] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-22T19:33:11.369263] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-22T19:33:12.117725] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-22T19:33:12.162214] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T19:33:12.775161] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T19:33:12.917700] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-22T19:33:13.644776] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:33:13.717701] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-22T19:33:14.517684] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-22T19:33:14.990005] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-22T19:33:15.309613] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T19:33:15.317978] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-22T19:33:16.073867] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T19:33:16.081015] [INFO ] [REMOTE ] KFY: Full fetch complete (43343 records). [2025-10-22T19:33:16.081199] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-22T19:33:16.122888] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-22T19:33:16.632549] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-22T19:33:16.632724] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-22T19:33:16.634260] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-22T19:33:16.634338] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-22T19:33:16.636082] [DEBUG] [LOCAL ] KFY: Trimmed 43343 records to 29511 (keeping 200 days of data) [2025-10-22T19:33:16.856026] [DEBUG] [LOCAL ] KFY: Primary data saved (29511 records). [2025-10-22T19:33:16.856250] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-22T19:33:16.856411] [INFO ] [MAIN ] Update Progress: 1189/2367 symbols completed. KFY took 34.4s. Estimated remaining: 2h 31m 47s. Rate: 7.8 symbols/min [2025-10-22T19:33:16.922918] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-22T19:33:17.068308] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:17.094397] [DEBUG] [LOCAL ] KIO: Loaded 21750 existing records from primary storage. [2025-10-22T19:33:17.094926] [INFO ] [MAIN ] KIO: Loaded 21750 existing records. [2025-10-22T19:33:17.304239] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:33:17.304888] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-22T19:33:17.305078] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-22T19:33:17.305408] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-22T19:33:17.305512] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-22T19:33:17.442419] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-22T19:33:17.720253] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-22T19:33:17.720148] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:17.762870] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T19:33:18.410863] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T19:33:18.517677] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-22T19:33:19.317686] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-22T19:33:19.811234] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-22T19:33:20.117780] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-22T19:33:20.277904] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T19:33:20.757317] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-22T19:33:20.917620] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-22T19:33:21.029707] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T19:33:21.717702] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-22T19:33:22.001181] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T19:33:22.517667] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-22T19:33:23.317665] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-22T19:33:23.370615] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T19:33:23.495458] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-22T19:33:24.117724] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-22T19:33:24.221522] [DEBUG] [REMOTE ] KIM: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-22T19:33:24.222020] [WARN ] [REMOTE ] KIM: No data returned for month 2025-05 [2025-10-22T19:33:24.222124] [FATAL] [REMOTE ] KIM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:33:24.222258] [FATAL] [MAIN ] KIM: Failed to fetch primary data. [2025-10-22T19:33:24.222339] [WARN ] [MAIN ] KIM: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:33:24.222451] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-22T19:33:24.222545] [DEBUG] [LOCAL ] KIM: No primary data file found to delete. [2025-10-22T19:33:24.222602] [INFO ] [LOCAL ] KIM: Starting deletion of derivative data. [2025-10-22T19:33:24.222978] [DEBUG] [LOCAL ] KIM: Deleted derivative data file. [2025-10-22T19:33:24.223265] [INFO ] [MAIN ] Update Progress: 1190/2367 symbols completed. KIM took 19.0s. Estimated remaining: 2h 31m 39s. Rate: 7.8 symbols/min [2025-10-22T19:33:24.389875] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:24.439186] [DEBUG] [LOCAL ] KKR: Loaded 53500 existing records from primary storage. [2025-10-22T19:33:24.439488] [INFO ] [MAIN ] KKR: Loaded 53500 existing records. [2025-10-22T19:33:24.611100] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:33:24.611307] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-22T19:33:24.611353] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-22T19:33:24.611541] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-22T19:33:24.611578] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-22T19:33:24.922780] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-22T19:33:24.961440] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:25.721757] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-22T19:33:25.724592] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-22T19:33:25.734144] [INFO ] [REMOTE ] KGC: Full fetch complete (77874 records). [2025-10-22T19:33:25.734294] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-22T19:33:26.119714] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-22T19:33:26.119813] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-22T19:33:26.120790] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-22T19:33:26.120853] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-22T19:33:26.122293] [DEBUG] [LOCAL ] KGC: Trimmed 77874 records to 53700 (keeping 200 days of data) [2025-10-22T19:33:26.447550] [DEBUG] [LOCAL ] KGC: Primary data saved (53700 records). [2025-10-22T19:33:26.447728] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-22T19:33:26.448746] [INFO ] [MAIN ] Update Progress: 1191/2367 symbols completed. KGC took 43.0s. Estimated remaining: 2h 31m 26s. Rate: 7.8 symbols/min [2025-10-22T19:33:26.520049] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-22T19:33:26.628699] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:26.637417] [DEBUG] [LOCAL ] KKRS: Loaded 5573 existing records from primary storage. [2025-10-22T19:33:26.637636] [INFO ] [MAIN ] KKRS: Loaded 5573 existing records. [2025-10-22T19:33:26.829611] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:33:26.830228] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-22T19:33:26.830841] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-22T19:33:26.843269] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-22T19:33:26.856179] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-22T19:33:26.868005] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T19:33:26.867089] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T19:33:26.965517] [INFO ] [REMOTE ] KGS: Full fetch complete (66556 records). [2025-10-22T19:33:26.984207] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-22T19:33:27.333147] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-22T19:33:27.534533] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:27.661240] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-22T19:33:27.661334] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-22T19:33:27.662252] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-22T19:33:27.662318] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-22T19:33:27.663695] [DEBUG] [LOCAL ] KGS: Trimmed 66556 records to 46063 (keeping 200 days of data) [2025-10-22T19:33:27.933529] [DEBUG] [LOCAL ] KGS: Primary data saved (46063 records). [2025-10-22T19:33:27.933745] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-22T19:33:27.933845] [INFO ] [MAIN ] Update Progress: 1192/2367 symbols completed. KGS took 27.3s. Estimated remaining: 2h 31m 12s. Rate: 7.8 symbols/min [2025-10-22T19:33:28.102514] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:28.103153] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-22T19:33:28.103340] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-22T19:33:28.103624] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-22T19:33:28.108880] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-22T19:33:28.115479] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-22T19:33:28.116101] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-22T19:33:28.127251] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-22T19:33:28.128022] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T19:33:28.563478] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-22T19:33:28.561729] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:28.757728] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-22T19:33:28.917689] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-10-22T19:33:29.115634] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:33:29.115988] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-10-22T19:33:29.116073] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:33:29.116120] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-22T19:33:29.116155] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:33:29.116220] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-22T19:33:29.116287] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-22T19:33:29.116323] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-22T19:33:29.116364] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-22T19:33:29.116411] [INFO ] [MAIN ] Update Progress: 1193/2367 symbols completed. KKRT took 1.2s. Estimated remaining: 2h 30m 58s. Rate: 7.8 symbols/min [2025-10-22T19:33:29.298894] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:29.299056] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-22T19:33:29.299092] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-22T19:33:29.299219] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-22T19:33:29.299259] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-22T19:33:29.299353] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-22T19:33:29.299400] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-22T19:33:29.718909] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-22T19:33:29.722484] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:30.517855] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-22T19:33:31.180351] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-22T19:33:31.317723] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-22T19:33:31.444411] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T19:33:31.888593] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-22T19:33:32.117680] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-10-22T19:33:32.332089] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:33:32.332386] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-10-22T19:33:32.332477] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:33:32.332522] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-22T19:33:32.332582] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:33:32.332677] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-22T19:33:32.332756] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-22T19:33:32.332792] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-22T19:33:32.332830] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-22T19:33:32.332875] [INFO ] [MAIN ] Update Progress: 1194/2367 symbols completed. KLAR took 3.2s. Estimated remaining: 2h 30m 46s. Rate: 7.8 symbols/min [2025-10-22T19:33:32.501548] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:32.532367] [DEBUG] [LOCAL ] KLC: Loaded 36207 existing records from primary storage. [2025-10-22T19:33:32.532663] [INFO ] [MAIN ] KLC: Loaded 36207 existing records. [2025-10-22T19:33:32.703079] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:33:32.703326] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-22T19:33:32.703392] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-22T19:33:32.704095] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-22T19:33:32.704152] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-22T19:33:32.925741] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-22T19:33:33.049393] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:33.717691] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-22T19:33:34.291797] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-22T19:33:34.517699] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-22T19:33:34.934918] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-22T19:33:35.317810] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-22T19:33:35.722976] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T19:33:36.117725] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-22T19:33:36.874750] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-22T19:33:36.917692] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-22T19:33:37.360994] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-22T19:33:37.717678] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-22T19:33:38.118636] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T19:33:38.517676] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-22T19:33:38.594049] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T19:33:39.317707] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-22T19:33:40.117699] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-22T19:33:40.369870] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T19:33:40.564780] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-22T19:33:40.715739] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-22T19:33:40.917753] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-22T19:33:41.501622] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-22T19:33:41.717762] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-22T19:33:42.517724] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-22T19:33:43.167878] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-22T19:33:43.317727] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-22T19:33:43.504774] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T19:33:44.117692] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-22T19:33:44.422258] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T19:33:44.917695] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-22T19:33:45.583886] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T19:33:45.598577] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T19:33:45.717702] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-22T19:33:46.517714] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-22T19:33:47.317789] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-22T19:33:47.322783] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T19:33:47.323974] [INFO ] [REMOTE ] KKRS: Full fetch complete (7549 records). [2025-10-22T19:33:47.324045] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-22T19:33:47.694203] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-22T19:33:47.694321] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-22T19:33:47.694586] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-22T19:33:47.694631] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-22T19:33:47.695059] [DEBUG] [LOCAL ] KKRS: Trimmed 7549 records to 5547 (keeping 200 days of data) [2025-10-22T19:33:47.729402] [DEBUG] [LOCAL ] KKRS: Primary data saved (5547 records). [2025-10-22T19:33:47.729781] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-22T19:33:47.729913] [INFO ] [MAIN ] Update Progress: 1195/2367 symbols completed. KKRS took 21.3s. Estimated remaining: 2h 30m 46s. Rate: 7.8 symbols/min [2025-10-22T19:33:47.900764] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:47.944808] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-22T19:33:47.999721] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-22T19:33:48.000093] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-22T19:33:48.122830] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-22T19:33:48.178233] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:33:48.178507] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-22T19:33:48.178560] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-22T19:33:48.178778] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-22T19:33:48.178835] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-22T19:33:48.536472] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:48.834612] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T19:33:48.917709] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-22T19:33:49.069575] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T19:33:49.717788] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-22T19:33:50.517723] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-22T19:33:51.136985] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-22T19:33:51.151103] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T19:33:51.317692] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-22T19:33:51.689588] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T19:33:51.695023] [INFO ] [REMOTE ] KIO: Full fetch complete (32326 records). [2025-10-22T19:33:51.695305] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-22T19:33:52.082561] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-22T19:33:52.082700] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-22T19:33:52.083716] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-22T19:33:52.083782] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-22T19:33:52.084890] [DEBUG] [LOCAL ] KIO: Trimmed 32326 records to 21683 (keeping 200 days of data) [2025-10-22T19:33:52.137115] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-22T19:33:52.227026] [DEBUG] [LOCAL ] KIO: Primary data saved (21683 records). [2025-10-22T19:33:52.227202] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-22T19:33:52.227301] [INFO ] [MAIN ] Update Progress: 1196/2367 symbols completed. KIO took 35.4s. Estimated remaining: 2h 30m 35s. Rate: 7.8 symbols/min [2025-10-22T19:33:52.412371] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:33:52.419685] [DEBUG] [LOCAL ] KMPB: Loaded 3533 existing records from primary storage. [2025-10-22T19:33:52.419940] [INFO ] [MAIN ] KMPB: Loaded 3533 existing records. [2025-10-22T19:33:52.601320] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:33:52.601608] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-22T19:33:52.601690] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-22T19:33:52.601883] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-22T19:33:52.601925] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-22T19:33:52.922805] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-22T19:33:52.962716] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:33:53.286314] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-22T19:33:53.571072] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T19:33:53.717689] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-22T19:33:54.086178] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-22T19:33:54.408907] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T19:33:54.517678] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-22T19:33:55.317773] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-22T19:33:56.117706] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-22T19:33:56.471344] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-22T19:33:56.551673] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-22T19:33:56.669861] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T19:33:56.917691] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-22T19:33:57.717714] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-22T19:33:58.347902] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T19:33:58.517711] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-22T19:33:59.317692] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-22T19:33:59.681207] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T19:33:59.895787] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-22T19:34:00.117766] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-22T19:34:00.666373] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-22T19:34:00.675174] [INFO ] [REMOTE ] KKR: Full fetch complete (77660 records). [2025-10-22T19:34:00.675297] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-22T19:34:00.930415] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-22T19:34:01.062185] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-22T19:34:01.062267] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-22T19:34:01.063267] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-22T19:34:01.063332] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-22T19:34:01.064840] [DEBUG] [LOCAL ] KKR: Trimmed 77660 records to 53500 (keeping 200 days of data) [2025-10-22T19:34:01.386631] [DEBUG] [LOCAL ] KKR: Primary data saved (53500 records). [2025-10-22T19:34:01.386784] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-22T19:34:01.386861] [INFO ] [MAIN ] Update Progress: 1197/2367 symbols completed. KKR took 37.2s. Estimated remaining: 2h 30m 28s. Rate: 7.8 symbols/min [2025-10-22T19:34:01.717716] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-22T19:34:01.883943] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T19:34:02.517774] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-22T19:34:03.424185] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T19:34:03.425548] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-22T19:34:03.903978] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-22T19:34:03.946719] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (3.02 seconds). [2025-10-22T19:34:04.117681] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-22T19:34:04.557783] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T19:34:04.564200] [INFO ] [REMOTE ] KLC: Full fetch complete (50613 records). [2025-10-22T19:34:04.564309] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-22T19:34:04.925464] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-22T19:34:04.943903] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-22T19:34:04.943991] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-22T19:34:04.944774] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-22T19:34:04.944940] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-22T19:34:04.945955] [DEBUG] [LOCAL ] KLC: Trimmed 50613 records to 36128 (keeping 200 days of data) [2025-10-22T19:34:05.144519] [DEBUG] [LOCAL ] KLC: Primary data saved (36128 records). [2025-10-22T19:34:05.144668] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-22T19:34:05.144763] [INFO ] [MAIN ] Update Progress: 1198/2367 symbols completed. KLC took 32.8s. Estimated remaining: 2h 30m 17s. Rate: 7.8 symbols/min [2025-10-22T19:34:05.582347] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-22T19:34:05.717813] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-22T19:34:06.019701] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T19:34:06.208436] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-22T19:34:06.517756] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-22T19:34:07.317790] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-22T19:34:07.898894] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T19:34:08.117763] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-22T19:34:08.409511] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-22T19:34:08.664796] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-22T19:34:08.917769] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-22T19:34:09.698598] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-22T19:34:09.699859] [INFO ] [REMOTE ] KMPB: Full fetch complete (4947 records). [2025-10-22T19:34:09.699935] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-22T19:34:09.733340] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-22T19:34:10.076262] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-22T19:34:10.076372] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-22T19:34:10.076567] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-22T19:34:10.076609] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-22T19:34:10.077039] [DEBUG] [LOCAL ] KMPB: Trimmed 4947 records to 3484 (keeping 200 days of data) [2025-10-22T19:34:10.099454] [DEBUG] [LOCAL ] KMPB: Primary data saved (3484 records). [2025-10-22T19:34:10.099609] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-22T19:34:10.099743] [INFO ] [MAIN ] Update Progress: 1199/2367 symbols completed. KMPB took 17.9s. Estimated remaining: 2h 30m 6s. Rate: 7.8 symbols/min [2025-10-22T19:34:11.826128] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-22T19:34:11.840380] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-22T19:34:13.781911] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T19:34:13.794759] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-22T19:34:15.973676] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-22T19:34:15.987308] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-22T19:34:17.572896] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T19:34:17.582970] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-22T19:34:17.583165] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-22T19:34:18.009436] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-22T19:34:18.009562] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-22T19:34:18.011034] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-22T19:34:18.011105] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-22T19:34:18.013229] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-22T19:34:18.355746] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-22T19:34:18.355943] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-22T19:34:18.356952] [INFO ] [MAIN ] Update Progress: 1200/2367 symbols completed. KMI took 30.6s. Estimated remaining: 2h 29m 59s. Rate: 7.8 symbols/min [2025-10-22T19:34:19.065454] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:34:19.117451] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:34:19.149225] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:34:19.151203] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:34:19.231237] [DEBUG] [LOCAL ] KMT: Loaded 42860 existing records from primary storage. [2025-10-22T19:34:19.231878] [INFO ] [MAIN ] KMT: Loaded 42860 existing records. [2025-10-22T19:34:19.306479] [DEBUG] [LOCAL ] KMX: Loaded 53285 existing records from primary storage. [2025-10-22T19:34:19.321789] [INFO ] [MAIN ] KMX: Loaded 53285 existing records. [2025-10-22T19:34:19.322887] [DEBUG] [LOCAL ] KMPR: Loaded 40497 existing records from primary storage. [2025-10-22T19:34:19.378302] [INFO ] [MAIN ] KMPR: Loaded 40497 existing records. [2025-10-22T19:34:19.446120] [DEBUG] [LOCAL ] KN: Loaded 38436 existing records from primary storage. [2025-10-22T19:34:19.515584] [INFO ] [MAIN ] KN: Loaded 38436 existing records. [2025-10-22T19:34:19.803552] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:34:19.932499] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-22T19:34:19.985692] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:34:20.097819] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-22T19:34:20.097676] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:34:20.101440] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:34:20.101931] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-22T19:34:20.098149] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-22T19:34:20.101559] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-22T19:34:20.102298] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-22T19:34:20.102453] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-22T19:34:20.102704] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-22T19:34:20.102855] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-22T19:34:20.102902] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-22T19:34:20.103348] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-22T19:34:20.103258] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-22T19:34:20.103812] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-22T19:34:20.103622] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-22T19:34:20.103028] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-22T19:34:20.159086] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-22T19:34:21.562308] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:34:21.592346] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:34:21.595598] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-22T19:34:21.588860] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-22T19:34:21.634836] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:34:21.683024] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-22T19:34:21.718350] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:34:21.718869] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-22T19:34:23.179062] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-22T19:34:23.184712] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-22T19:34:23.326203] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T19:34:23.333932] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-22T19:34:23.358970] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T19:34:23.367238] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-22T19:34:23.483083] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T19:34:23.493229] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-22T19:34:24.435421] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T19:34:24.444387] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-22T19:34:24.846750] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T19:34:24.896778] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-22T19:34:24.901463] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T19:34:24.910380] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-22T19:34:25.161295] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T19:34:25.170997] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-22T19:34:25.344068] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-22T19:34:25.350895] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-22T19:34:26.123627] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-22T19:34:26.132512] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-22T19:34:26.364894] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T19:34:26.373601] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-22T19:34:26.735700] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T19:34:26.743352] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-22T19:34:26.951148] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T19:34:26.962388] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-22T19:34:27.509441] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T19:34:27.520843] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-22T19:34:28.042668] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T19:34:28.054137] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-22T19:34:28.131176] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T19:34:28.139274] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-22T19:34:28.498587] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T19:34:28.917802] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-22T19:34:29.111070] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T19:34:29.169049] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T19:34:29.306450] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T19:34:29.717684] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-22T19:34:30.444802] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:34:30.517686] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-22T19:34:31.220065] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T19:34:31.317671] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-22T19:34:32.026428] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T19:34:32.117680] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-22T19:34:32.806173] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T19:34:32.917726] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-22T19:34:33.717631] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-22T19:34:34.057221] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T19:34:34.475606] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T19:34:34.517672] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-22T19:34:35.201998] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T19:34:35.317674] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-22T19:34:36.117669] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-22T19:34:36.403504] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T19:34:36.783842] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T19:34:36.917671] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-22T19:34:37.717614] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-22T19:34:37.819774] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T19:34:38.330505] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T19:34:38.517679] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-22T19:34:39.317627] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-22T19:34:39.670365] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-22T19:34:40.117635] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-22T19:34:40.164327] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T19:34:40.868778] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T19:34:40.917705] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-22T19:34:41.717691] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-22T19:34:42.434730] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-22T19:34:42.443972] [INFO ] [REMOTE ] KMX: Full fetch complete (76400 records). [2025-10-22T19:34:42.444163] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-22T19:34:42.522726] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-22T19:34:42.844525] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-22T19:34:42.850507] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-22T19:34:42.856757] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-22T19:34:42.861720] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-22T19:34:42.863363] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T19:34:42.870406] [INFO ] [REMOTE ] KMT: Full fetch complete (61940 records). [2025-10-22T19:34:42.870562] [DEBUG] [LOCAL ] KMX: Trimmed 76400 records to 53286 (keeping 200 days of data) [2025-10-22T19:34:42.870701] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-22T19:34:43.389609] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T19:34:43.418837] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-22T19:34:43.582223] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-22T19:34:43.583675] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-22T19:34:43.586310] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-22T19:34:43.588395] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-22T19:34:43.605216] [DEBUG] [LOCAL ] KMT: Trimmed 61940 records to 42861 (keeping 200 days of data) [2025-10-22T19:34:43.608395] [DEBUG] [LOCAL ] KMX: Primary data saved (53286 records). [2025-10-22T19:34:43.608803] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-22T19:34:43.609081] [INFO ] [MAIN ] Update Progress: 1201/2367 symbols completed. KMX took 25.2s. Estimated remaining: 2h 30m 9s. Rate: 7.8 symbols/min [2025-10-22T19:34:43.953729] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:34:44.040409] [DEBUG] [LOCAL ] KMT: Primary data saved (42861 records). [2025-10-22T19:34:44.040557] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-22T19:34:44.040672] [INFO ] [MAIN ] Update Progress: 1202/2367 symbols completed. KMT took 25.7s. Estimated remaining: 2h 29m 54s. Rate: 7.8 symbols/min [2025-10-22T19:34:44.229933] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:34:44.230941] [DEBUG] [LOCAL ] KNF: Loaded 36664 existing records from primary storage. [2025-10-22T19:34:44.231861] [INFO ] [MAIN ] KNF: Loaded 36664 existing records. [2025-10-22T19:34:44.339434] [DEBUG] [LOCAL ] KNOP: Loaded 10137 existing records from primary storage. [2025-10-22T19:34:44.339843] [INFO ] [MAIN ] KNOP: Loaded 10137 existing records. [2025-10-22T19:34:44.503382] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:34:44.472736] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T19:34:44.533388] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-22T19:34:44.539018] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-22T19:34:44.547914] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-22T19:34:44.548184] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-22T19:34:44.572272] [INFO ] [REMOTE ] KMPR: Full fetch complete (53554 records). [2025-10-22T19:34:44.605521] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-22T19:34:44.837929] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:34:44.857945] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-22T19:34:44.863437] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-22T19:34:44.933326] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-22T19:34:44.994981] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-22T19:34:45.274674] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T19:34:45.443476] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-22T19:34:45.687443] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:34:45.721964] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-22T19:34:45.730553] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-22T19:34:45.748415] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-22T19:34:45.756619] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-22T19:34:45.756780] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-22T19:34:45.821569] [DEBUG] [LOCAL ] KMPR: Trimmed 53554 records to 40496 (keeping 200 days of data) [2025-10-22T19:34:45.841236] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:34:45.841891] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-22T19:34:46.082665] [DEBUG] [LOCAL ] KMPR: Primary data saved (40496 records). [2025-10-22T19:34:46.082821] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-22T19:34:46.082907] [INFO ] [MAIN ] Update Progress: 1203/2367 symbols completed. KMPR took 27.7s. Estimated remaining: 2h 29m 41s. Rate: 7.8 symbols/min [2025-10-22T19:34:46.247233] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:34:46.265854] [DEBUG] [LOCAL ] KNSL: Loaded 18446 existing records from primary storage. [2025-10-22T19:34:46.266085] [INFO ] [MAIN ] KNSL: Loaded 18446 existing records. [2025-10-22T19:34:46.437920] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:34:46.438183] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-22T19:34:46.438229] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-22T19:34:46.438413] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-22T19:34:46.438467] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-22T19:34:46.788446] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:34:46.788846] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-22T19:34:46.854160] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T19:34:47.175040] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T19:34:47.236732] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T19:34:47.243254] [INFO ] [REMOTE ] KN: Full fetch complete (56686 records). [2025-10-22T19:34:47.243365] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-22T19:34:47.322788] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-22T19:34:47.619925] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-22T19:34:47.620002] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-22T19:34:47.620842] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-22T19:34:47.620904] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-22T19:34:47.621957] [DEBUG] [LOCAL ] KN: Trimmed 56686 records to 38389 (keeping 200 days of data) [2025-10-22T19:34:47.826120] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-22T19:34:47.859391] [DEBUG] [LOCAL ] KN: Primary data saved (38389 records). [2025-10-22T19:34:47.859539] [INFO ] [MAIN ] KN: Full history saved. [2025-10-22T19:34:47.859631] [INFO ] [MAIN ] Update Progress: 1204/2367 symbols completed. KN took 29.5s. Estimated remaining: 2h 29m 27s. Rate: 7.8 symbols/min [2025-10-22T19:34:48.026437] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:34:48.067322] [DEBUG] [LOCAL ] KNTK: Loaded 47232 existing records from primary storage. [2025-10-22T19:34:48.067610] [INFO ] [MAIN ] KNTK: Loaded 47232 existing records. [2025-10-22T19:34:48.129134] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-22T19:34:48.245159] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:34:48.245359] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-22T19:34:48.245405] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-22T19:34:48.245590] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-22T19:34:48.245628] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-22T19:34:48.628425] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:34:48.645950] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T19:34:48.906549] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T19:34:48.917610] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-22T19:34:49.706826] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-22T19:34:49.717602] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-22T19:34:50.517675] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-22T19:34:50.692951] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T19:34:51.317682] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-22T19:34:52.089271] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T19:34:52.104820] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T19:34:52.117608] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-22T19:34:52.917685] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-22T19:34:53.620726] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T19:34:53.717685] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-22T19:34:53.958844] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-22T19:34:54.517682] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-22T19:34:55.194009] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-22T19:34:55.225725] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T19:34:55.317691] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-22T19:34:56.111432] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T19:34:56.117616] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-22T19:34:56.885511] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-22T19:34:56.917635] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-22T19:34:57.717700] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-22T19:34:57.810634] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T19:34:58.517671] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-22T19:34:58.821314] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T19:34:59.317699] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-22T19:35:00.031383] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T19:35:00.117717] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-22T19:35:00.917912] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-22T19:35:01.009881] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T19:35:01.717692] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-22T19:35:02.276821] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T19:35:02.445022] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-22T19:35:02.517698] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-22T19:35:03.266541] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T19:35:03.317618] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-22T19:35:03.697551] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T19:35:03.700163] [INFO ] [REMOTE ] KNOP: Full fetch complete (14669 records). [2025-10-22T19:35:03.700232] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-22T19:35:04.055083] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-22T19:35:04.055176] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-22T19:35:04.055521] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-22T19:35:04.055587] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-22T19:35:04.056115] [DEBUG] [LOCAL ] KNOP: Trimmed 14669 records to 10075 (keeping 200 days of data) [2025-10-22T19:35:04.113465] [DEBUG] [LOCAL ] KNOP: Primary data saved (10075 records). [2025-10-22T19:35:04.113589] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-22T19:35:04.113689] [INFO ] [MAIN ] Update Progress: 1205/2367 symbols completed. KNOP took 20.1s. Estimated remaining: 2h 29m 28s. Rate: 7.8 symbols/min [2025-10-22T19:35:04.124809] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-22T19:35:04.280468] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:35:04.327865] [DEBUG] [LOCAL ] KNX: Loaded 52645 existing records from primary storage. [2025-10-22T19:35:04.328189] [INFO ] [MAIN ] KNX: Loaded 52645 existing records. [2025-10-22T19:35:04.501781] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:35:04.501986] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-22T19:35:04.502032] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-22T19:35:04.502209] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-22T19:35:04.502245] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-22T19:35:04.869876] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:35:04.902420] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T19:35:04.917633] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-22T19:35:05.187131] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T19:35:05.717763] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-22T19:35:06.097513] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T19:35:06.517707] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-22T19:35:06.798482] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T19:35:07.317762] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-22T19:35:08.126418] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-22T19:35:08.132082] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T19:35:08.731979] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T19:35:08.917725] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-22T19:35:08.988325] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T19:35:09.717694] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-22T19:35:10.517675] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-22T19:35:11.024008] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-22T19:35:11.241346] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T19:35:11.263395] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-22T19:35:11.317620] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-22T19:35:12.117629] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-22T19:35:12.764991] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T19:35:12.917636] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-22T19:35:13.693463] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T19:35:13.717612] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-22T19:35:14.004466] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T19:35:14.517689] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-22T19:35:15.309506] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T19:35:15.319229] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-22T19:35:15.936271] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T19:35:16.117707] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-22T19:35:16.917696] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-22T19:35:17.047039] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T19:35:17.717670] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-22T19:35:17.862750] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T19:35:17.870261] [INFO ] [REMOTE ] KNF: Full fetch complete (51474 records). [2025-10-22T19:35:17.870417] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-22T19:35:18.089822] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T19:35:18.184864] [INFO ] [REMOTE ] KNSL: Full fetch complete (27112 records). [2025-10-22T19:35:18.214941] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-22T19:35:18.443332] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-22T19:35:18.448542] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-22T19:35:18.471635] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-22T19:35:18.474143] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-22T19:35:18.527540] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-22T19:35:18.543176] [DEBUG] [LOCAL ] KNF: Trimmed 51474 records to 36630 (keeping 200 days of data) [2025-10-22T19:35:18.814847] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-22T19:35:18.814986] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-22T19:35:18.815698] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-22T19:35:18.855120] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-22T19:35:18.897760] [DEBUG] [LOCAL ] KNSL: Trimmed 27112 records to 18288 (keeping 200 days of data) [2025-10-22T19:35:18.915181] [DEBUG] [LOCAL ] KNF: Primary data saved (36630 records). [2025-10-22T19:35:18.915606] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-22T19:35:18.915736] [INFO ] [MAIN ] Update Progress: 1206/2367 symbols completed. KNF took 35.3s. Estimated remaining: 2h 29m 27s. Rate: 7.8 symbols/min [2025-10-22T19:35:19.221821] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:35:19.227425] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-22T19:35:19.228274] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-22T19:35:19.229954] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-22T19:35:19.233422] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-22T19:35:19.235042] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-22T19:35:19.235199] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-22T19:35:19.279576] [DEBUG] [LOCAL ] KNSL: Primary data saved (18288 records). [2025-10-22T19:35:19.300708] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-22T19:35:19.310231] [INFO ] [MAIN ] Update Progress: 1207/2367 symbols completed. KNSL took 33.2s. Estimated remaining: 2h 29m 12s. Rate: 7.8 symbols/min [2025-10-22T19:35:19.711228] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T19:35:19.692226] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:35:19.774433] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-22T19:35:19.862267] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:35:19.900514] [DEBUG] [LOCAL ] KODK: Loaded 43762 existing records from primary storage. [2025-10-22T19:35:19.900837] [INFO ] [MAIN ] KODK: Loaded 43762 existing records. [2025-10-22T19:35:20.085793] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:35:20.086043] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-22T19:35:20.086095] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-22T19:35:20.086281] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-22T19:35:20.086321] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-22T19:35:20.118907] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-22T19:35:20.443843] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:35:20.475016] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T19:35:20.483835] [INFO ] [REMOTE ] KNTK: Full fetch complete (65760 records). [2025-10-22T19:35:20.484069] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-22T19:35:20.867452] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-22T19:35:20.867548] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-22T19:35:20.868526] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-22T19:35:20.868592] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-22T19:35:20.870094] [DEBUG] [LOCAL ] KNTK: Trimmed 65760 records to 47207 (keeping 200 days of data) [2025-10-22T19:35:20.931312] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-22T19:35:21.155083] [DEBUG] [LOCAL ] KNTK: Primary data saved (47207 records). [2025-10-22T19:35:21.155245] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-22T19:35:21.156268] [INFO ] [MAIN ] Update Progress: 1208/2367 symbols completed. KNTK took 33.3s. Estimated remaining: 2h 28m 59s. Rate: 7.8 symbols/min [2025-10-22T19:35:21.326493] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:35:21.353959] [DEBUG] [LOCAL ] KOF: Loaded 26600 existing records from primary storage. [2025-10-22T19:35:21.354325] [INFO ] [MAIN ] KOF: Loaded 26600 existing records. [2025-10-22T19:35:21.533356] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:35:21.533661] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-22T19:35:21.533818] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-22T19:35:21.534094] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-22T19:35:21.534154] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-22T19:35:21.904950] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-22T19:35:21.942100] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:35:21.943023] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-22T19:35:22.517682] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-22T19:35:22.684635] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T19:35:22.991931] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-10-22T19:35:23.317706] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-22T19:35:23.372197] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T19:35:24.117681] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-22T19:35:24.260441] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T19:35:24.839148] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T19:35:24.917688] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-22T19:35:25.717700] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-22T19:35:26.151198] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T19:35:26.390695] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-22T19:35:26.517800] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-22T19:35:27.317684] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-22T19:35:27.428112] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T19:35:27.712936] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-22T19:35:28.117683] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-22T19:35:28.917697] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-22T19:35:29.717784] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-22T19:35:29.870305] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T19:35:29.917900] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-22T19:35:29.997485] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T19:35:30.517697] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-22T19:35:31.319094] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-22T19:35:31.322955] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-22T19:35:32.117788] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-22T19:35:32.389627] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T19:35:32.657841] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-22T19:35:32.917701] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-22T19:35:33.717774] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-22T19:35:34.517765] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-22T19:35:34.655509] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T19:35:34.767873] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-22T19:35:34.966596] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T19:35:35.317704] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-22T19:35:35.987858] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T19:35:36.117697] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-22T19:35:36.917758] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-22T19:35:37.356901] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T19:35:37.717666] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-22T19:35:37.838852] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-22T19:35:38.376290] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T19:35:38.517703] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-22T19:35:39.317688] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-22T19:35:39.549637] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T19:35:39.558571] [INFO ] [REMOTE ] KNX: Full fetch complete (76309 records). [2025-10-22T19:35:39.558746] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-22T19:35:39.961156] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-22T19:35:39.961252] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-22T19:35:39.962321] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-22T19:35:39.962393] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-22T19:35:39.963968] [DEBUG] [LOCAL ] KNX: Trimmed 76309 records to 52645 (keeping 200 days of data) [2025-10-22T19:35:40.143165] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-22T19:35:40.291244] [DEBUG] [LOCAL ] KNX: Primary data saved (52645 records). [2025-10-22T19:35:40.291406] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-22T19:35:40.291498] [INFO ] [MAIN ] Update Progress: 1209/2367 symbols completed. KNX took 36.2s. Estimated remaining: 2h 29m 2s. Rate: 7.8 symbols/min [2025-10-22T19:35:40.459138] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:35:40.477818] [DEBUG] [LOCAL ] KOP: Loaded 17428 existing records from primary storage. [2025-10-22T19:35:40.478051] [INFO ] [MAIN ] KOP: Loaded 17428 existing records. [2025-10-22T19:35:40.655734] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:35:40.655935] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-22T19:35:40.655983] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-22T19:35:40.656159] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-22T19:35:40.656216] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-22T19:35:41.011843] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:35:41.012420] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-22T19:35:41.039752] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T19:35:41.080156] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-22T19:35:41.231406] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T19:35:41.717730] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-22T19:35:42.369608] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-22T19:35:42.517637] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-22T19:35:43.081484] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T19:35:43.317721] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-22T19:35:44.117707] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-22T19:35:44.373156] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T19:35:44.917693] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-22T19:35:45.358031] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-10-22T19:35:45.401688] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-22T19:35:45.717707] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-22T19:35:45.745659] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T19:35:46.517763] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-22T19:35:47.317781] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-22T19:35:47.606562] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T19:35:48.117627] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-22T19:35:48.325121] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-10-22T19:35:48.854282] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-22T19:35:48.917753] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-22T19:35:48.961083] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T19:35:49.717699] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-22T19:35:49.945069] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T19:35:50.517728] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-22T19:35:51.317676] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-22T19:35:52.079027] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T19:35:52.083885] [INFO ] [REMOTE ] KOF: Full fetch complete (38037 records). [2025-10-22T19:35:52.083966] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-22T19:35:52.126669] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-22T19:35:52.471847] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-22T19:35:52.471969] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-22T19:35:52.472859] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-22T19:35:52.472971] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-22T19:35:52.500407] [DEBUG] [LOCAL ] KOF: Trimmed 38037 records to 26529 (keeping 200 days of data) [2025-10-22T19:35:52.502210] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-10-22T19:35:52.682038] [DEBUG] [LOCAL ] KOF: Primary data saved (26529 records). [2025-10-22T19:35:52.682244] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-22T19:35:52.682370] [INFO ] [MAIN ] Update Progress: 1210/2367 symbols completed. KOF took 31.5s. Estimated remaining: 2h 28m 59s. Rate: 7.8 symbols/min [2025-10-22T19:35:52.807028] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T19:35:52.859458] [INFO ] [REMOTE ] KODK: Full fetch complete (63348 records). [2025-10-22T19:35:52.867966] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-22T19:35:52.886867] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:35:52.919280] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-22T19:35:52.970598] [DEBUG] [LOCAL ] KORE: Loaded 2184 existing records from primary storage. [2025-10-22T19:35:52.971770] [INFO ] [MAIN ] KORE: Loaded 2184 existing records. [2025-10-22T19:35:53.294983] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-22T19:35:53.412728] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:35:53.435169] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-22T19:35:53.441676] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-22T19:35:53.445668] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-22T19:35:53.465672] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-22T19:35:53.550825] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-22T19:35:53.572485] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-22T19:35:53.584430] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-22T19:35:53.584984] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-22T19:35:53.663356] [DEBUG] [LOCAL ] KODK: Trimmed 63348 records to 43711 (keeping 200 days of data) [2025-10-22T19:35:53.721069] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-22T19:35:54.147707] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:35:54.350664] [DEBUG] [LOCAL ] KODK: Primary data saved (43711 records). [2025-10-22T19:35:54.350837] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-22T19:35:54.350930] [INFO ] [MAIN ] Update Progress: 1211/2367 symbols completed. KODK took 35.0s. Estimated remaining: 2h 28m 45s. Rate: 7.8 symbols/min [2025-10-22T19:35:54.522905] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-22T19:35:54.583132] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:35:54.636243] [DEBUG] [LOCAL ] KOS: Loaded 53093 existing records from primary storage. [2025-10-22T19:35:54.636568] [INFO ] [MAIN ] KOS: Loaded 53093 existing records. [2025-10-22T19:35:54.821055] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:35:54.821327] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-22T19:35:54.821377] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-22T19:35:54.821584] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-22T19:35:54.821639] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-22T19:35:54.956601] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T19:35:55.211298] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:35:55.317619] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-22T19:35:55.470504] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-22T19:35:55.807591] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.89 seconds). [2025-10-22T19:35:55.822572] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-22T19:35:55.822892] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-22T19:35:56.042679] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-22T19:35:56.043542] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:35:56.043630] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:35:56.043746] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-22T19:35:56.043864] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-22T19:35:56.043909] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-22T19:35:56.043950] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-22T19:35:56.044027] [INFO ] [MAIN ] Update Progress: 1212/2367 symbols completed. KO took 37.1s. Estimated remaining: 2h 28m 32s. Rate: 7.8 symbols/min [2025-10-22T19:35:56.127588] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-22T19:35:56.222378] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:35:56.271209] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-22T19:35:56.271560] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-22T19:35:56.449576] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:35:56.449870] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-22T19:35:56.449925] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-22T19:35:56.450134] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-22T19:35:56.450190] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-22T19:35:56.736942] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T19:35:56.816209] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:35:56.917682] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-22T19:35:57.372103] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-22T19:35:57.717729] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-22T19:35:58.517710] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-22T19:35:58.707121] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T19:35:59.317618] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-22T19:35:59.359579] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T19:35:59.649878] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T19:36:00.117671] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-22T19:36:00.649227] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-22T19:36:00.917706] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-22T19:36:01.584576] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-22T19:36:01.585954] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-22T19:36:01.717702] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-22T19:36:02.517684] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-22T19:36:03.317683] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-22T19:36:03.602351] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T19:36:03.638562] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T19:36:04.117695] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-22T19:36:04.917630] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-22T19:36:05.034905] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T19:36:05.203602] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T19:36:05.206835] [INFO ] [REMOTE ] KOP: Full fetch complete (25439 records). [2025-10-22T19:36:05.207021] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-22T19:36:05.310030] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-22T19:36:05.567189] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-22T19:36:05.567264] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-22T19:36:05.567836] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-22T19:36:05.567900] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-22T19:36:05.568494] [DEBUG] [LOCAL ] KOP: Trimmed 25439 records to 17332 (keeping 200 days of data) [2025-10-22T19:36:05.670039] [DEBUG] [LOCAL ] KOP: Primary data saved (17332 records). [2025-10-22T19:36:05.670173] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-22T19:36:05.670248] [INFO ] [MAIN ] Update Progress: 1213/2367 symbols completed. KOP took 25.4s. Estimated remaining: 2h 28m 26s. Rate: 7.8 symbols/min [2025-10-22T19:36:05.722863] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-22T19:36:05.835871] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:36:05.875895] [DEBUG] [LOCAL ] KRC: Loaded 48149 existing records from primary storage. [2025-10-22T19:36:05.876184] [INFO ] [MAIN ] KRC: Loaded 48149 existing records. [2025-10-22T19:36:06.047460] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:36:06.047688] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-22T19:36:06.051187] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-22T19:36:06.051509] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-22T19:36:06.051565] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-22T19:36:06.395948] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:36:06.517633] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-22T19:36:06.882495] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-22T19:36:07.317617] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-22T19:36:07.831129] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-22T19:36:07.873934] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-22T19:36:08.117675] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-22T19:36:08.568978] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-22T19:36:08.917697] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-22T19:36:09.717701] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-22T19:36:10.408553] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-22T19:36:10.517632] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-22T19:36:10.879899] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T19:36:11.317685] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-22T19:36:11.979330] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-22T19:36:11.980786] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T19:36:11.985275] [INFO ] [REMOTE ] KORE: Full fetch complete (4009 records). [2025-10-22T19:36:11.990955] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-22T19:36:12.128322] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-22T19:36:12.354918] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-22T19:36:12.355022] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-22T19:36:12.355174] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-22T19:36:12.355234] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-22T19:36:12.355624] [DEBUG] [LOCAL ] KORE: Trimmed 4009 records to 2179 (keeping 200 days of data) [2025-10-22T19:36:12.367540] [DEBUG] [LOCAL ] KORE: Primary data saved (2179 records). [2025-10-22T19:36:12.367596] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-22T19:36:12.367690] [INFO ] [MAIN ] Update Progress: 1214/2367 symbols completed. KORE took 19.7s. Estimated remaining: 2h 28m 17s. Rate: 7.8 symbols/min [2025-10-22T19:36:12.538931] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:36:12.571479] [DEBUG] [LOCAL ] KREF: Loaded 38066 existing records from primary storage. [2025-10-22T19:36:12.571775] [INFO ] [MAIN ] KREF: Loaded 38066 existing records. [2025-10-22T19:36:12.742615] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:36:12.742866] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-22T19:36:12.742913] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-22T19:36:12.743123] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-22T19:36:12.743160] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-22T19:36:12.924917] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-22T19:36:13.092742] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:36:13.722763] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-22T19:36:13.740596] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T19:36:14.517692] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-22T19:36:14.919023] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T19:36:15.052235] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-22T19:36:15.317639] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-22T19:36:16.122822] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-22T19:36:16.139953] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T19:36:16.917723] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-22T19:36:17.017878] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T19:36:17.717634] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-22T19:36:18.062119] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T19:36:18.517669] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-22T19:36:18.693290] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T19:36:19.023469] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T19:36:19.317667] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-22T19:36:19.962511] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T19:36:20.117607] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-22T19:36:20.669467] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T19:36:20.917765] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-22T19:36:21.717671] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-22T19:36:21.973783] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T19:36:22.400589] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T19:36:22.517676] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-22T19:36:23.150099] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T19:36:23.317700] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-22T19:36:23.910751] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-22T19:36:24.117682] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-22T19:36:24.761756] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-22T19:36:24.917718] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-22T19:36:25.725706] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-22T19:36:25.734944] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T19:36:26.517630] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-22T19:36:26.665480] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T19:36:27.204546] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T19:36:27.317674] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-22T19:36:27.825772] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T19:36:28.117716] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-22T19:36:28.307536] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T19:36:28.917679] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-22T19:36:29.717730] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-22T19:36:30.150330] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-22T19:36:30.300729] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T19:36:30.517720] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-22T19:36:31.317635] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-22T19:36:31.558514] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T19:36:31.568289] [INFO ] [REMOTE ] KOS: Full fetch complete (77024 records). [2025-10-22T19:36:31.568452] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-22T19:36:31.890955] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T19:36:31.990313] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-22T19:36:31.990396] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-22T19:36:31.991350] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-22T19:36:31.991412] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-22T19:36:31.992795] [DEBUG] [LOCAL ] KOS: Trimmed 77024 records to 53093 (keeping 200 days of data) [2025-10-22T19:36:32.145144] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-22T19:36:32.297761] [DEBUG] [LOCAL ] KOS: Primary data saved (53093 records). [2025-10-22T19:36:32.297901] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-22T19:36:32.298034] [INFO ] [MAIN ] Update Progress: 1215/2367 symbols completed. KOS took 37.9s. Estimated remaining: 2h 28m 21s. Rate: 7.8 symbols/min [2025-10-22T19:36:32.475337] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:36:32.517837] [DEBUG] [LOCAL ] KRG: Loaded 49291 existing records from primary storage. [2025-10-22T19:36:32.518145] [INFO ] [MAIN ] KRG: Loaded 49291 existing records. [2025-10-22T19:36:32.739330] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:36:32.739714] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-22T19:36:32.739774] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-22T19:36:32.739958] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-22T19:36:32.739996] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-22T19:36:32.937185] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-22T19:36:33.110263] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T19:36:33.141314] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:36:33.639185] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T19:36:33.717673] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-22T19:36:34.517726] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-22T19:36:35.038091] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-22T19:36:35.047353] [INFO ] [REMOTE ] KR: Full fetch complete (77843 records). [2025-10-22T19:36:35.047547] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-22T19:36:35.338860] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-22T19:36:35.357299] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T19:36:35.492741] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-22T19:36:35.492837] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-22T19:36:35.493886] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-22T19:36:35.493950] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-22T19:36:35.495457] [DEBUG] [LOCAL ] KR: Trimmed 77843 records to 53681 (keeping 200 days of data) [2025-10-22T19:36:35.831877] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-10-22T19:36:35.832078] [INFO ] [MAIN ] KR: Full history saved. [2025-10-22T19:36:35.832186] [INFO ] [MAIN ] Update Progress: 1216/2367 symbols completed. KR took 39.8s. Estimated remaining: 2h 28m 9s. Rate: 7.8 symbols/min [2025-10-22T19:36:36.013609] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:36:36.013845] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-22T19:36:36.013922] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-22T19:36:36.014087] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-22T19:36:36.014130] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-22T19:36:36.014173] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-22T19:36:36.014206] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-22T19:36:36.121760] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-22T19:36:36.375224] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:36:36.401616] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T19:36:36.917619] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-22T19:36:36.998998] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T19:36:37.005808] [INFO ] [REMOTE ] KREF: Full fetch complete (52979 records). [2025-10-22T19:36:37.005910] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-22T19:36:37.386715] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-22T19:36:37.386796] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-22T19:36:37.387596] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-22T19:36:37.387664] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-22T19:36:37.388765] [DEBUG] [LOCAL ] KREF: Trimmed 52979 records to 38061 (keeping 200 days of data) [2025-10-22T19:36:37.610560] [DEBUG] [LOCAL ] KREF: Primary data saved (38061 records). [2025-10-22T19:36:37.610711] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-22T19:36:37.611401] [INFO ] [MAIN ] Update Progress: 1217/2367 symbols completed. KREF took 25.2s. Estimated remaining: 2h 27m 56s. Rate: 7.8 symbols/min [2025-10-22T19:36:37.720855] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-10-22T19:36:37.811178] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:36:37.812959] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T19:36:37.847611] [DEBUG] [LOCAL ] KRO: Loaded 26642 existing records from primary storage. [2025-10-22T19:36:37.847913] [INFO ] [MAIN ] KRO: Loaded 26642 existing records. [2025-10-22T19:36:37.991150] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:36:38.027596] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:36:38.021531] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-10-22T19:36:38.028039] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:36:38.028181] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-22T19:36:38.028136] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-22T19:36:38.028306] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-22T19:36:38.028359] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:36:38.028535] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-22T19:36:38.028596] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-22T19:36:38.028635] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-22T19:36:38.028691] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-22T19:36:38.028857] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-22T19:36:38.028918] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-22T19:36:38.029051] [INFO ] [MAIN ] Update Progress: 1218/2367 symbols completed. KRMN took 2.2s. Estimated remaining: 2h 27m 41s. Rate: 7.8 symbols/min [2025-10-22T19:36:38.369318] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:36:38.526697] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-22T19:36:38.604015] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:36:38.648667] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T19:36:38.649460] [DEBUG] [LOCAL ] KRP: Loaded 36048 existing records from primary storage. [2025-10-22T19:36:38.661772] [INFO ] [MAIN ] KRP: Loaded 36048 existing records. [2025-10-22T19:36:38.879413] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:36:38.879772] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-22T19:36:38.879833] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-22T19:36:38.880132] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-22T19:36:38.880203] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-22T19:36:39.240029] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:36:39.317730] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-22T19:36:40.117632] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-22T19:36:40.289690] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T19:36:40.917636] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-22T19:36:40.978395] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T19:36:41.131404] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T19:36:41.717726] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-22T19:36:42.499125] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T19:36:42.517609] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-22T19:36:42.901041] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T19:36:42.909004] [INFO ] [REMOTE ] KRC: Full fetch complete (70056 records). [2025-10-22T19:36:42.909145] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-22T19:36:43.291865] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-22T19:36:43.291968] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-22T19:36:43.292876] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-22T19:36:43.292950] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-22T19:36:43.294279] [DEBUG] [LOCAL ] KRC: Trimmed 70056 records to 48094 (keeping 200 days of data) [2025-10-22T19:36:43.345723] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-22T19:36:43.579398] [DEBUG] [LOCAL ] KRC: Primary data saved (48094 records). [2025-10-22T19:36:43.579524] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-22T19:36:43.579601] [INFO ] [MAIN ] Update Progress: 1219/2367 symbols completed. KRC took 37.9s. Estimated remaining: 2h 27m 32s. Rate: 7.8 symbols/min [2025-10-22T19:36:43.747811] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:36:43.796672] [DEBUG] [LOCAL ] KSS: Loaded 53589 existing records from primary storage. [2025-10-22T19:36:43.796988] [INFO ] [MAIN ] KSS: Loaded 53589 existing records. [2025-10-22T19:36:43.985333] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:36:43.985789] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-22T19:36:43.985856] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-22T19:36:43.986177] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-22T19:36:43.986216] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-22T19:36:44.117893] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-22T19:36:44.324596] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T19:36:44.386157] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-22T19:36:44.427144] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:36:44.917682] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-22T19:36:45.485819] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T19:36:45.717625] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-22T19:36:45.989277] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T19:36:46.517774] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-22T19:36:47.317761] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-22T19:36:47.363956] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T19:36:48.117706] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-22T19:36:48.508304] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-22T19:36:48.657407] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-22T19:36:48.917732] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-22T19:36:49.607442] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T19:36:49.717612] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-22T19:36:50.522846] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-22T19:36:50.539264] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T19:36:51.123205] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T19:36:51.317688] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-22T19:36:52.117631] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-22T19:36:52.474850] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-22T19:36:52.917672] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-22T19:36:53.031232] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T19:36:53.540907] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T19:36:53.717705] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-22T19:36:54.017924] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T19:36:54.517718] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-22T19:36:55.078284] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T19:36:55.317638] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-22T19:36:56.105602] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T19:36:56.117613] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-22T19:36:56.453597] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T19:36:56.917703] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-22T19:36:57.717666] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-22T19:36:57.809475] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T19:36:58.261018] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T19:36:58.517633] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-22T19:36:58.914384] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T19:36:59.317708] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-22T19:37:00.117666] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-22T19:37:00.621015] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-22T19:37:00.768056] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T19:37:00.917670] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-22T19:37:01.530969] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T19:37:01.717768] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-22T19:37:02.517781] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-22T19:37:02.790470] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T19:37:02.803737] [INFO ] [REMOTE ] KRG: Full fetch complete (71413 records). [2025-10-22T19:37:02.803945] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-22T19:37:03.054230] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-22T19:37:03.338193] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-22T19:37:03.427861] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-22T19:37:03.427983] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-22T19:37:03.429587] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-22T19:37:03.429749] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-22T19:37:03.431778] [DEBUG] [LOCAL ] KRG: Trimmed 71413 records to 49271 (keeping 200 days of data) [2025-10-22T19:37:03.761072] [DEBUG] [LOCAL ] KRG: Primary data saved (49271 records). [2025-10-22T19:37:03.761210] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-22T19:37:03.761291] [INFO ] [MAIN ] Update Progress: 1220/2367 symbols completed. KRG took 31.5s. Estimated remaining: 2h 27m 36s. Rate: 7.8 symbols/min [2025-10-22T19:37:03.942088] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:03.981823] [DEBUG] [LOCAL ] KT: Loaded 45470 existing records from primary storage. [2025-10-22T19:37:03.982224] [INFO ] [MAIN ] KT: Loaded 45470 existing records. [2025-10-22T19:37:04.129051] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-22T19:37:04.156060] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T19:37:04.175799] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:04.181812] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-22T19:37:04.181869] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-22T19:37:04.181999] [INFO ] [REMOTE ] KRP: Full fetch complete (55024 records). [2025-10-22T19:37:04.182131] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-22T19:37:04.182276] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-22T19:37:04.182360] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-22T19:37:04.851613] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:37:04.926598] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-22T19:37:04.930605] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-22T19:37:04.930737] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-22T19:37:04.931566] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-22T19:37:04.931744] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-22T19:37:04.932972] [DEBUG] [LOCAL ] KRP: Trimmed 55024 records to 35928 (keeping 200 days of data) [2025-10-22T19:37:05.149341] [DEBUG] [LOCAL ] KRP: Primary data saved (35928 records). [2025-10-22T19:37:05.149476] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-22T19:37:05.149558] [INFO ] [MAIN ] Update Progress: 1221/2367 symbols completed. KRP took 27.1s. Estimated remaining: 2h 27m 22s. Rate: 7.8 symbols/min [2025-10-22T19:37:05.327638] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:05.365133] [DEBUG] [LOCAL ] KTB: Loaded 40377 existing records from primary storage. [2025-10-22T19:37:05.365462] [INFO ] [MAIN ] KTB: Loaded 40377 existing records. [2025-10-22T19:37:05.548322] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:05.548624] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-22T19:37:05.548812] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-22T19:37:05.549043] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-22T19:37:05.549111] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-22T19:37:05.922277] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-22T19:37:05.960908] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:37:05.961676] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-22T19:37:06.200130] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T19:37:06.205383] [INFO ] [REMOTE ] KRO: Full fetch complete (35322 records). [2025-10-22T19:37:06.205497] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-22T19:37:06.522964] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-22T19:37:06.600909] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-22T19:37:06.600994] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-22T19:37:06.601671] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-22T19:37:06.601734] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-22T19:37:06.602534] [DEBUG] [LOCAL ] KRO: Trimmed 35322 records to 26553 (keeping 200 days of data) [2025-10-22T19:37:06.753881] [DEBUG] [LOCAL ] KRO: Primary data saved (26553 records). [2025-10-22T19:37:06.754021] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-22T19:37:06.754104] [INFO ] [MAIN ] Update Progress: 1222/2367 symbols completed. KRO took 29.1s. Estimated remaining: 2h 27m 8s. Rate: 7.8 symbols/min [2025-10-22T19:37:06.924565] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:06.936802] [DEBUG] [LOCAL ] KTF: Loaded 11685 existing records from primary storage. [2025-10-22T19:37:06.937045] [INFO ] [MAIN ] KTF: Loaded 11685 existing records. [2025-10-22T19:37:07.120021] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:07.120490] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-22T19:37:07.120593] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-22T19:37:07.121027] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-22T19:37:07.121102] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-22T19:37:07.260174] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-22T19:37:07.322794] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-22T19:37:07.536897] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:37:07.904773] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T19:37:08.043777] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-22T19:37:08.117610] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-22T19:37:08.917724] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-22T19:37:09.023314] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T19:37:09.717667] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-22T19:37:10.041070] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T19:37:10.048173] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-22T19:37:10.517691] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-22T19:37:11.322737] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-22T19:37:11.336818] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T19:37:12.117690] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-22T19:37:12.181898] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T19:37:12.699411] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-22T19:37:12.917635] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-22T19:37:13.296431] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T19:37:13.717681] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-22T19:37:14.517723] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-22T19:37:15.130859] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-22T19:37:15.256235] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T19:37:15.317620] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-22T19:37:16.102546] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T19:37:16.117617] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-22T19:37:16.877838] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T19:37:16.917611] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-22T19:37:17.714096] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-22T19:37:17.723148] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-22T19:37:18.421439] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T19:37:18.517681] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-22T19:37:18.704147] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-22T19:37:19.317679] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-22T19:37:20.030811] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T19:37:20.117683] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-22T19:37:20.917963] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-22T19:37:20.920967] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T19:37:21.239463] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T19:37:21.717697] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-22T19:37:21.917268] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-22T19:37:22.517689] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-22T19:37:23.317678] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-22T19:37:23.706216] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T19:37:24.074501] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T19:37:24.096515] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-22T19:37:24.117681] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-22T19:37:24.917728] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-22T19:37:25.717635] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-22T19:37:25.773558] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T19:37:26.086266] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T19:37:26.517667] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-22T19:37:27.317618] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-22T19:37:27.800553] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-22T19:37:27.809438] [INFO ] [REMOTE ] KSS: Full fetch complete (77752 records). [2025-10-22T19:37:27.809555] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-22T19:37:28.126245] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-22T19:37:28.244008] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-22T19:37:28.243715] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T19:37:28.265562] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-22T19:37:28.270590] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T19:37:28.269751] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-22T19:37:28.278316] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-22T19:37:28.280418] [DEBUG] [LOCAL ] KSS: Trimmed 77752 records to 53589 (keeping 200 days of data) [2025-10-22T19:37:28.594594] [DEBUG] [LOCAL ] KSS: Primary data saved (53589 records). [2025-10-22T19:37:28.594821] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-22T19:37:28.594915] [INFO ] [MAIN ] Update Progress: 1223/2367 symbols completed. KSS took 45.0s. Estimated remaining: 2h 27m 14s. Rate: 7.8 symbols/min [2025-10-22T19:37:28.760455] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:28.807956] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-22T19:37:28.808273] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-22T19:37:28.922819] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-22T19:37:28.983666] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:28.983858] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-22T19:37:28.983904] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-22T19:37:28.984106] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-22T19:37:28.984160] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-22T19:37:29.331916] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:37:29.717780] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-22T19:37:29.781208] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T19:37:30.517625] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-22T19:37:30.649008] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T19:37:30.655060] [INFO ] [REMOTE ] KTB: Full fetch complete (58362 records). [2025-10-22T19:37:30.655163] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-22T19:37:31.046143] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-22T19:37:31.046220] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-22T19:37:31.047188] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-22T19:37:31.047257] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-22T19:37:31.048571] [DEBUG] [LOCAL ] KTB: Trimmed 58362 records to 40299 (keeping 200 days of data) [2025-10-22T19:37:31.317622] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-22T19:37:31.325803] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T19:37:31.324859] [DEBUG] [LOCAL ] KTB: Primary data saved (40299 records). [2025-10-22T19:37:31.336177] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-22T19:37:31.336933] [INFO ] [MAIN ] Update Progress: 1224/2367 symbols completed. KTB took 26.2s. Estimated remaining: 2h 27m 2s. Rate: 7.8 symbols/min [2025-10-22T19:37:31.503122] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:31.547052] [DEBUG] [LOCAL ] KVYO: Loaded 50885 existing records from primary storage. [2025-10-22T19:37:31.547361] [INFO ] [MAIN ] KVYO: Loaded 50885 existing records. [2025-10-22T19:37:31.734603] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:31.734836] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-22T19:37:31.734885] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-22T19:37:31.735270] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-22T19:37:31.735328] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-22T19:37:32.111348] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:37:32.117636] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-22T19:37:32.208482] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T19:37:32.216181] [INFO ] [REMOTE ] KT: Full fetch complete (66756 records). [2025-10-22T19:37:32.216322] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-22T19:37:32.348099] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T19:37:32.614590] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-22T19:37:32.614914] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-22T19:37:32.615810] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-22T19:37:32.615871] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-22T19:37:32.617185] [DEBUG] [LOCAL ] KT: Trimmed 66756 records to 45383 (keeping 200 days of data) [2025-10-22T19:37:32.879595] [DEBUG] [LOCAL ] KT: Primary data saved (45383 records). [2025-10-22T19:37:32.879759] [INFO ] [MAIN ] KT: Full history saved. [2025-10-22T19:37:32.879858] [INFO ] [MAIN ] Update Progress: 1225/2367 symbols completed. KT took 29.1s. Estimated remaining: 2h 26m 48s. Rate: 7.8 symbols/min [2025-10-22T19:37:32.923304] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-22T19:37:33.051171] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:33.085356] [DEBUG] [LOCAL ] KW: Loaded 40418 existing records from primary storage. [2025-10-22T19:37:33.085665] [INFO ] [MAIN ] KW: Loaded 40418 existing records. [2025-10-22T19:37:33.262679] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:33.262936] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-22T19:37:33.262983] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-22T19:37:33.263349] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-22T19:37:33.263404] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-22T19:37:33.609075] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:37:33.717697] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-22T19:37:33.966209] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T19:37:34.265564] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T19:37:34.517685] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-22T19:37:35.192621] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T19:37:35.317688] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-22T19:37:35.828633] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T19:37:36.117668] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-22T19:37:36.617730] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-22T19:37:36.917700] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-22T19:37:37.552777] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-22T19:37:37.717691] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-22T19:37:37.777789] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T19:37:38.462357] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T19:37:38.517715] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-22T19:37:39.317637] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-22T19:37:39.919310] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T19:37:40.117626] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-22T19:37:40.917710] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-22T19:37:41.021131] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T19:37:41.660103] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T19:37:41.662117] [INFO ] [REMOTE ] KTF: Full fetch complete (17303 records). [2025-10-22T19:37:41.662228] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-22T19:37:41.723340] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-22T19:37:41.788469] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T19:37:42.050715] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-22T19:37:42.050798] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-22T19:37:42.051107] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-22T19:37:42.051169] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-22T19:37:42.051692] [DEBUG] [LOCAL ] KTF: Trimmed 17303 records to 11658 (keeping 200 days of data) [2025-10-22T19:37:42.118257] [DEBUG] [LOCAL ] KTF: Primary data saved (11658 records). [2025-10-22T19:37:42.118372] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-22T19:37:42.118446] [INFO ] [MAIN ] Update Progress: 1226/2367 symbols completed. KTF took 35.4s. Estimated remaining: 2h 26m 42s. Rate: 7.8 symbols/min [2025-10-22T19:37:42.286685] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:42.304245] [DEBUG] [LOCAL ] KWR: Loaded 15865 existing records from primary storage. [2025-10-22T19:37:42.304476] [INFO ] [MAIN ] KWR: Loaded 15865 existing records. [2025-10-22T19:37:42.478880] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:42.479105] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-22T19:37:42.479152] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-22T19:37:42.479314] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-22T19:37:42.479352] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-22T19:37:42.522926] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-22T19:37:42.829882] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:37:43.317725] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-22T19:37:43.503942] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T19:37:44.117721] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-22T19:37:44.162014] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T19:37:44.602991] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-22T19:37:44.917726] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-22T19:37:45.642979] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T19:37:45.717705] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-22T19:37:46.517767] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-22T19:37:46.641725] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T19:37:47.136952] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T19:37:47.317730] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-22T19:37:48.021027] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T19:37:48.117610] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-22T19:37:48.917722] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-22T19:37:49.109094] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T19:37:49.594526] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T19:37:49.717634] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-22T19:37:50.517764] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-22T19:37:50.579406] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T19:37:51.317773] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-22T19:37:51.653241] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T19:37:51.698835] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-22T19:37:52.117728] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-22T19:37:52.886971] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T19:37:52.917618] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-22T19:37:53.507561] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-22T19:37:53.717768] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-22T19:37:54.517684] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-22T19:37:54.791864] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T19:37:54.858973] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-22T19:37:54.868639] [INFO ] [REMOTE ] KW: Full fetch complete (57306 records). [2025-10-22T19:37:54.868885] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-22T19:37:55.296478] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-22T19:37:55.296594] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-22T19:37:55.297505] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-22T19:37:55.297573] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-22T19:37:55.298950] [DEBUG] [LOCAL ] KW: Trimmed 57306 records to 40330 (keeping 200 days of data) [2025-10-22T19:37:55.352608] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-22T19:37:55.642989] [DEBUG] [LOCAL ] KW: Primary data saved (40330 records). [2025-10-22T19:37:55.643122] [INFO ] [MAIN ] KW: Full history saved. [2025-10-22T19:37:55.643203] [INFO ] [MAIN ] Update Progress: 1227/2367 symbols completed. KW took 22.8s. Estimated remaining: 2h 26m 39s. Rate: 7.8 symbols/min [2025-10-22T19:37:55.830627] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:55.863881] [DEBUG] [LOCAL ] KYN: Loaded 30292 existing records from primary storage. [2025-10-22T19:37:55.864181] [INFO ] [MAIN ] KYN: Loaded 30292 existing records. [2025-10-22T19:37:56.062240] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:56.062489] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-22T19:37:56.062547] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-22T19:37:56.062960] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-22T19:37:56.063016] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-22T19:37:56.120245] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-22T19:37:56.454035] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:37:56.487431] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T19:37:56.917639] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-22T19:37:57.191992] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-22T19:37:57.379611] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-22T19:37:57.717705] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-22T19:37:58.517674] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-22T19:37:58.561289] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T19:37:58.591639] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T19:37:58.600632] [INFO ] [REMOTE ] KVUE: Full fetch complete (77845 records). [2025-10-22T19:37:58.600799] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-22T19:37:58.988117] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-22T19:37:58.988204] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-22T19:37:58.989275] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-22T19:37:58.989341] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-22T19:37:58.990798] [DEBUG] [LOCAL ] KVUE: Trimmed 77845 records to 53667 (keeping 200 days of data) [2025-10-22T19:37:59.319541] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-22T19:37:59.319827] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-22T19:37:59.319933] [INFO ] [MAIN ] Update Progress: 1228/2367 symbols completed. KVUE took 30.7s. Estimated remaining: 2h 26m 28s. Rate: 7.8 symbols/min [2025-10-22T19:37:59.319359] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-22T19:37:59.491536] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:37:59.526268] [DEBUG] [LOCAL ] L: Loaded 41211 existing records from primary storage. [2025-10-22T19:37:59.526555] [INFO ] [MAIN ] L: Loaded 41211 existing records. [2025-10-22T19:37:59.700828] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:37:59.701582] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-22T19:37:59.701629] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-22T19:37:59.702108] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-22T19:37:59.702164] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-22T19:38:00.057970] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:00.117617] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-22T19:38:00.205898] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T19:38:00.711171] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T19:38:00.917730] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-22T19:38:01.426574] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T19:38:01.717731] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-22T19:38:02.517731] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-22T19:38:02.810218] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T19:38:02.819002] [INFO ] [REMOTE ] KVYO: Full fetch complete (72248 records). [2025-10-22T19:38:02.819123] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-22T19:38:03.202218] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-22T19:38:03.202315] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-22T19:38:03.203235] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-22T19:38:03.203375] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-22T19:38:03.223671] [DEBUG] [LOCAL ] KVYO: Trimmed 72248 records to 50891 (keeping 200 days of data) [2025-10-22T19:38:03.224919] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T19:38:03.318345] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-22T19:38:03.530266] [DEBUG] [LOCAL ] KVYO: Primary data saved (50891 records). [2025-10-22T19:38:03.541875] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-22T19:38:03.542743] [INFO ] [MAIN ] Update Progress: 1229/2367 symbols completed. KVYO took 32.2s. Estimated remaining: 2h 26m 17s. Rate: 7.8 symbols/min [2025-10-22T19:38:03.542528] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T19:38:03.723843] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:38:03.771806] [DEBUG] [LOCAL ] LAC: Loaded 52565 existing records from primary storage. [2025-10-22T19:38:03.772123] [INFO ] [MAIN ] LAC: Loaded 52565 existing records. [2025-10-22T19:38:03.948579] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:38:03.948820] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-22T19:38:03.948870] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-22T19:38:03.949070] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-22T19:38:03.949127] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-22T19:38:04.122921] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-22T19:38:04.306973] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:04.376165] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-22T19:38:04.917678] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-22T19:38:05.710346] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T19:38:05.718413] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-22T19:38:06.148137] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-22T19:38:06.517698] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-22T19:38:07.317626] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-22T19:38:07.766541] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-22T19:38:07.819597] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-22T19:38:08.043889] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T19:38:08.117672] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-22T19:38:08.917727] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-22T19:38:09.656276] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T19:38:09.717624] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-22T19:38:10.393362] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T19:38:10.517683] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-22T19:38:11.277709] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T19:38:11.317706] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-22T19:38:11.537507] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T19:38:12.117698] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-22T19:38:12.856636] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T19:38:12.917679] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-22T19:38:13.472253] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-22T19:38:13.717708] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-22T19:38:14.517635] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-22T19:38:14.568020] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T19:38:14.820967] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T19:38:15.317692] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-22T19:38:16.109236] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T19:38:16.117793] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-22T19:38:16.917682] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-22T19:38:17.367183] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T19:38:17.421777] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T19:38:17.717624] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-22T19:38:17.878921] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-22T19:38:18.517704] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-22T19:38:19.036302] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T19:38:19.317676] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-22T19:38:19.818011] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T19:38:20.117683] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-22T19:38:20.164066] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-22T19:38:20.917682] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-22T19:38:21.717677] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-22T19:38:21.882037] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T19:38:21.884315] [INFO ] [REMOTE ] KWR: Full fetch complete (23222 records). [2025-10-22T19:38:21.884389] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-22T19:38:22.245183] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-22T19:38:22.288685] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-22T19:38:22.288859] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-22T19:38:22.289404] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-22T19:38:22.289487] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-22T19:38:22.289727] [INFO ] [REMOTE ] L: Full fetch complete (59427 records). [2025-10-22T19:38:22.290048] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-22T19:38:22.290465] [DEBUG] [LOCAL ] KWR: Trimmed 23222 records to 15690 (keeping 200 days of data) [2025-10-22T19:38:22.525634] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-22T19:38:22.627288] [DEBUG] [LOCAL ] KWR: Primary data saved (15690 records). [2025-10-22T19:38:22.662768] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-22T19:38:22.682119] [INFO ] [MAIN ] Update Progress: 1230/2367 symbols completed. KWR took 40.6s. Estimated remaining: 2h 26m 20s. Rate: 7.8 symbols/min [2025-10-22T19:38:22.899015] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-22T19:38:22.899212] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-22T19:38:22.905805] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-22T19:38:22.926538] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-22T19:38:22.968993] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:38:22.988802] [DEBUG] [LOCAL ] L: Trimmed 59427 records to 41146 (keeping 200 days of data) [2025-10-22T19:38:22.990229] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T19:38:23.113322] [DEBUG] [LOCAL ] LAD: Loaded 23222 existing records from primary storage. [2025-10-22T19:38:23.125110] [INFO ] [MAIN ] LAD: Loaded 23222 existing records. [2025-10-22T19:38:23.322099] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-22T19:38:23.422177] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:38:23.425281] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-22T19:38:23.426364] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-22T19:38:23.434807] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-22T19:38:23.435572] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-22T19:38:23.553181] [DEBUG] [LOCAL ] L: Primary data saved (41146 records). [2025-10-22T19:38:23.555938] [INFO ] [MAIN ] L: Full history saved. [2025-10-22T19:38:23.556046] [INFO ] [MAIN ] Update Progress: 1231/2367 symbols completed. L took 24.2s. Estimated remaining: 2h 26m 6s. Rate: 7.8 symbols/min [2025-10-22T19:38:23.907347] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:38:23.991865] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:24.020519] [DEBUG] [LOCAL ] LADR: Loaded 39406 existing records from primary storage. [2025-10-22T19:38:24.020869] [INFO ] [MAIN ] LADR: Loaded 39406 existing records. [2025-10-22T19:38:24.119233] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-22T19:38:24.209389] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:38:24.210950] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-22T19:38:24.211027] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-22T19:38:24.211206] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-22T19:38:24.211246] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-22T19:38:24.587455] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:24.603550] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T19:38:24.638748] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-22T19:38:24.917638] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-22T19:38:25.717779] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-22T19:38:25.897972] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T19:38:26.517699] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-22T19:38:26.583136] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-22T19:38:27.137894] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T19:38:27.317631] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-22T19:38:27.774374] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T19:38:27.779895] [INFO ] [REMOTE ] KYN: Full fetch complete (44293 records). [2025-10-22T19:38:27.779997] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-22T19:38:28.121844] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-22T19:38:28.156513] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-22T19:38:28.156602] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-22T19:38:28.157908] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-22T19:38:28.158000] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-22T19:38:28.159138] [DEBUG] [LOCAL ] KYN: Trimmed 44293 records to 30129 (keeping 200 days of data) [2025-10-22T19:38:28.336384] [DEBUG] [LOCAL ] KYN: Primary data saved (30129 records). [2025-10-22T19:38:28.336528] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-22T19:38:28.336615] [INFO ] [MAIN ] Update Progress: 1232/2367 symbols completed. KYN took 32.7s. Estimated remaining: 2h 25m 55s. Rate: 7.8 symbols/min [2025-10-22T19:38:28.532370] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:38:28.537342] [DEBUG] [LOCAL ] LANV: Loaded 2794 existing records from primary storage. [2025-10-22T19:38:28.537498] [INFO ] [MAIN ] LANV: Loaded 2794 existing records. [2025-10-22T19:38:28.728172] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:38:28.728401] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-22T19:38:28.728487] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-22T19:38:28.728615] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-22T19:38:28.728686] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-22T19:38:28.923251] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-22T19:38:29.107862] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:29.302678] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-22T19:38:29.602051] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T19:38:29.717686] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-22T19:38:30.241960] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T19:38:30.292607] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-22T19:38:30.517689] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-22T19:38:31.317728] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-22T19:38:31.807794] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-22T19:38:32.117713] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-22T19:38:32.917770] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-22T19:38:33.301678] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-22T19:38:33.470900] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T19:38:33.717692] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-22T19:38:34.183932] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-22T19:38:34.353827] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T19:38:34.517687] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-22T19:38:35.317713] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-22T19:38:36.117678] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-22T19:38:36.513532] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-22T19:38:36.612813] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-22T19:38:36.917727] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-22T19:38:37.429610] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T19:38:37.717639] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-22T19:38:38.257421] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-22T19:38:38.517714] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-22T19:38:38.917343] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-22T19:38:39.317675] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-22T19:38:39.576975] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T19:38:39.746916] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-22T19:38:40.117691] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-22T19:38:40.917696] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-22T19:38:41.582813] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T19:38:41.717619] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-22T19:38:41.910673] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T19:38:42.517679] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-22T19:38:43.242477] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T19:38:43.317623] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-22T19:38:43.762436] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T19:38:44.117707] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-22T19:38:44.917693] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-22T19:38:45.228063] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T19:38:45.344958] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-22T19:38:45.717694] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-22T19:38:46.160084] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.84 seconds). [2025-10-22T19:38:46.168929] [INFO ] [REMOTE ] LAC: Full fetch complete (76143 records). [2025-10-22T19:38:46.169050] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-22T19:38:46.522360] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-22T19:38:46.561767] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-22T19:38:46.561845] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-22T19:38:46.562797] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-22T19:38:46.562861] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-22T19:38:46.564218] [DEBUG] [LOCAL ] LAC: Trimmed 76143 records to 52571 (keeping 200 days of data) [2025-10-22T19:38:46.856767] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T19:38:46.883452] [DEBUG] [LOCAL ] LAC: Primary data saved (52571 records). [2025-10-22T19:38:46.883593] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-22T19:38:46.883694] [INFO ] [MAIN ] Update Progress: 1233/2367 symbols completed. LAC took 43.3s. Estimated remaining: 2h 25m 58s. Rate: 7.8 symbols/min [2025-10-22T19:38:46.993433] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-22T19:38:47.056912] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:38:47.057073] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-22T19:38:47.057113] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-22T19:38:47.057225] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-22T19:38:47.057266] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-22T19:38:47.057307] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-22T19:38:47.057340] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-22T19:38:47.324997] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-22T19:38:47.409593] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:47.829885] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-22T19:38:48.117768] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-22T19:38:48.917776] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-22T19:38:49.461025] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-22T19:38:49.684838] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T19:38:49.717606] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-22T19:38:50.517690] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-22T19:38:50.843098] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T19:38:50.960007] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T19:38:51.317684] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-22T19:38:52.117708] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-22T19:38:52.570678] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T19:38:52.575032] [INFO ] [REMOTE ] LAD: Full fetch complete (35560 records). [2025-10-22T19:38:52.575116] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-22T19:38:52.935538] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-10-22T19:38:52.951470] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-22T19:38:52.951543] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-22T19:38:52.952281] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-22T19:38:52.952470] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-22T19:38:52.953406] [DEBUG] [LOCAL ] LAD: Trimmed 35560 records to 23290 (keeping 200 days of data) [2025-10-22T19:38:53.092778] [DEBUG] [LOCAL ] LAD: Primary data saved (23290 records). [2025-10-22T19:38:53.092904] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-22T19:38:53.092980] [INFO ] [MAIN ] Update Progress: 1234/2367 symbols completed. LAD took 30.4s. Estimated remaining: 2h 25m 49s. Rate: 7.8 symbols/min [2025-10-22T19:38:53.268164] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:38:53.282034] [DEBUG] [LOCAL ] LAW: Loaded 14777 existing records from primary storage. [2025-10-22T19:38:53.282254] [INFO ] [MAIN ] LAW: Loaded 14777 existing records. [2025-10-22T19:38:53.465240] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:38:53.465563] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-22T19:38:53.465739] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-22T19:38:53.466002] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-22T19:38:53.466059] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-22T19:38:53.725452] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-22T19:38:53.755011] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T19:38:53.762952] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T19:38:53.791127] [INFO ] [REMOTE ] LADR: Full fetch complete (55637 records). [2025-10-22T19:38:53.791370] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-22T19:38:53.982306] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:54.259573] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-22T19:38:54.259681] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-22T19:38:54.260564] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-22T19:38:54.260607] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-22T19:38:54.261796] [DEBUG] [LOCAL ] LADR: Trimmed 55637 records to 39334 (keeping 200 days of data) [2025-10-22T19:38:54.364291] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T19:38:54.366161] [INFO ] [REMOTE ] LANV: Full fetch complete (4237 records). [2025-10-22T19:38:54.367528] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-22T19:38:54.542414] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-22T19:38:54.869898] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-22T19:38:54.869693] [DEBUG] [LOCAL ] LADR: Primary data saved (39334 records). [2025-10-22T19:38:54.870105] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-22T19:38:54.870308] [INFO ] [MAIN ] Update Progress: 1235/2367 symbols completed. LADR took 31.3s. Estimated remaining: 2h 25m 35s. Rate: 7.8 symbols/min [2025-10-22T19:38:54.870197] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-22T19:38:54.882035] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-22T19:38:54.882234] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-22T19:38:54.940088] [DEBUG] [LOCAL ] LANV: Trimmed 4237 records to 2784 (keeping 200 days of data) [2025-10-22T19:38:54.987564] [DEBUG] [LOCAL ] LANV: Primary data saved (2784 records). [2025-10-22T19:38:54.987672] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-22T19:38:54.998390] [INFO ] [MAIN ] Update Progress: 1236/2367 symbols completed. LANV took 26.7s. Estimated remaining: 2h 25m 21s. Rate: 7.8 symbols/min [2025-10-22T19:38:55.157592] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:38:55.227965] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:38:55.268744] [DEBUG] [LOCAL ] LAZ: Loaded 44474 existing records from primary storage. [2025-10-22T19:38:55.269105] [INFO ] [MAIN ] LAZ: Loaded 44474 existing records. [2025-10-22T19:38:55.324738] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-10-22T19:38:55.382496] [DEBUG] [LOCAL ] LB: Loaded 37118 existing records from primary storage. [2025-10-22T19:38:55.383673] [INFO ] [MAIN ] LB: Loaded 37118 existing records. [2025-10-22T19:38:55.555537] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:38:55.575988] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-22T19:38:55.576588] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-22T19:38:55.582281] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-22T19:38:55.582337] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-22T19:38:55.764579] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:38:55.760258] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-22T19:38:55.767969] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-22T19:38:55.771476] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-22T19:38:55.777134] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-22T19:38:55.777216] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-22T19:38:56.118281] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-22T19:38:56.321884] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:56.400922] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:38:56.917665] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-22T19:38:56.976000] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T19:38:57.094840] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T19:38:57.717774] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-10-22T19:38:58.517775] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-22T19:38:58.729198] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T19:38:59.317669] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-22T19:38:59.368122] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T19:39:00.125848] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-22T19:39:00.129078] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T19:39:00.917783] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-22T19:39:00.974320] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-22T19:39:01.717786] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-22T19:39:02.524509] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-10-22T19:39:02.525561] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T19:39:03.317686] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-22T19:39:03.646171] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (4.33 seconds). [2025-10-22T19:39:04.125150] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-22T19:39:04.152302] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T19:39:04.296758] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T19:39:04.917716] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-22T19:39:05.336841] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (4.42 seconds). [2025-10-22T19:39:05.717628] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-22T19:39:05.819270] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-22T19:39:06.517775] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-22T19:39:06.963514] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-10-22T19:39:07.317675] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-22T19:39:07.357128] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T19:39:07.453522] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-22T19:39:08.117730] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-22T19:39:08.917690] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-10-22T19:39:08.980243] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T19:39:09.114128] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T19:39:09.717675] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-22T19:39:10.297268] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T19:39:10.517684] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-22T19:39:10.878385] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T19:39:11.317709] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-22T19:39:11.444188] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T19:39:12.117714] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-10-22T19:39:12.825495] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T19:39:12.917639] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-22T19:39:13.690266] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T19:39:13.717611] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-10-22T19:39:14.517675] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-22T19:39:15.317723] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-22T19:39:15.387980] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-22T19:39:15.513133] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T19:39:15.622908] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T19:39:15.626828] [INFO ] [REMOTE ] LAW: Full fetch complete (21158 records). [2025-10-22T19:39:15.626904] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-22T19:39:15.987090] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-22T19:39:15.987164] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-22T19:39:15.987588] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-22T19:39:15.987628] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-22T19:39:15.988243] [DEBUG] [LOCAL ] LAW: Trimmed 21158 records to 14897 (keeping 200 days of data) [2025-10-22T19:39:16.069285] [DEBUG] [LOCAL ] LAW: Primary data saved (14897 records). [2025-10-22T19:39:16.069417] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-22T19:39:16.069505] [INFO ] [MAIN ] Update Progress: 1237/2367 symbols completed. LAW took 23.0s. Estimated remaining: 2h 25m 25s. Rate: 7.8 symbols/min [2025-10-22T19:39:16.117703] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-10-22T19:39:16.599978] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T19:39:16.917711] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-22T19:39:17.717636] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-22T19:39:17.863424] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T19:39:18.417544] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T19:39:18.517670] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-22T19:39:19.197764] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-22T19:39:19.317674] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-10-22T19:39:19.993189] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T19:39:20.117722] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-22T19:39:20.917669] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-22T19:39:20.966982] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T19:39:21.189470] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-22T19:39:21.717706] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-22T19:39:22.517700] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-10. [2025-10-22T19:39:22.621793] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T19:39:22.628584] [INFO ] [REMOTE ] LAZ: Full fetch complete (65412 records). [2025-10-22T19:39:22.628745] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-22T19:39:23.014723] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-22T19:39:23.014826] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-22T19:39:23.015807] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-22T19:39:23.015916] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-22T19:39:23.017571] [DEBUG] [LOCAL ] LAZ: Trimmed 65412 records to 44442 (keeping 200 days of data) [2025-10-22T19:39:23.130802] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T19:39:23.311025] [DEBUG] [LOCAL ] LAZ: Primary data saved (44442 records). [2025-10-22T19:39:23.311151] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-22T19:39:23.311226] [INFO ] [MAIN ] Update Progress: 1238/2367 symbols completed. LAZ took 28.4s. Estimated remaining: 2h 25m 17s. Rate: 7.8 symbols/min [2025-10-22T19:39:23.317618] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-22T19:39:24.743738] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-22T19:39:24.752421] [INFO ] [REMOTE ] LAR: Full fetch complete (62465 records). [2025-10-22T19:39:24.752547] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-10-22T19:39:24.935903] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T19:39:24.976909] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-22T19:39:24.977992] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:39:24.978352] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-22T19:39:24.978432] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:39:24.979265] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-22T19:39:24.979329] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-22T19:39:24.979366] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-22T19:39:24.979405] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-22T19:39:24.979463] [INFO ] [MAIN ] Update Progress: 1239/2367 symbols completed. LAR took 38.1s. Estimated remaining: 2h 25m 4s. Rate: 7.8 symbols/min [2025-10-22T19:39:26.479371] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T19:39:26.486875] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-22T19:39:28.042811] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T19:39:28.049070] [INFO ] [REMOTE ] LB: Full fetch complete (55825 records). [2025-10-22T19:39:28.049182] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-22T19:39:28.433269] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-22T19:39:28.433601] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-22T19:39:28.434428] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-22T19:39:28.434484] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-22T19:39:28.435660] [DEBUG] [LOCAL ] LB: Trimmed 55825 records to 36982 (keeping 200 days of data) [2025-10-22T19:39:28.661563] [DEBUG] [LOCAL ] LB: Primary data saved (36982 records). [2025-10-22T19:39:28.661731] [INFO ] [MAIN ] LB: Full history saved. [2025-10-22T19:39:28.661816] [INFO ] [MAIN ] Update Progress: 1240/2367 symbols completed. LB took 33.7s. Estimated remaining: 2h 24m 52s. Rate: 7.8 symbols/min [2025-10-22T19:39:29.233893] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:39:29.271538] [DEBUG] [LOCAL ] LCII: No existing data file found in primary storage. [2025-10-22T19:39:29.305923] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:39:29.330775] [WARN ] [MAIN ] LCII: No existing data found, performing full refresh instead. [2025-10-22T19:39:29.396265] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:39:29.401994] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-22T19:39:29.405428] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-22T19:39:29.405140] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:39:29.405676] [DEBUG] [LOCAL ] LCII: No primary data file found to delete. [2025-10-22T19:39:29.405804] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-22T19:39:29.750566] [DEBUG] [LOCAL ] LDI: Loaded 45083 existing records from primary storage. [2025-10-22T19:39:29.761704] [DEBUG] [LOCAL ] LBRT: Loaded 53003 existing records from primary storage. [2025-10-22T19:39:29.774858] [INFO ] [MAIN ] LDI: Loaded 45083 existing records. [2025-10-22T19:39:29.774710] [INFO ] [MAIN ] LBRT: Loaded 53003 existing records. [2025-10-22T19:39:29.980227] [DEBUG] [LOCAL ] LC: Loaded 48247 existing records from primary storage. [2025-10-22T19:39:29.979541] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:39:30.021871] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-22T19:39:30.021556] [INFO ] [MAIN ] LC: Loaded 48247 existing records. [2025-10-22T19:39:30.300492] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:39:30.346843] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-22T19:39:30.346607] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:39:30.347003] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-22T19:39:30.347339] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-22T19:39:30.347435] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-22T19:39:30.347896] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-22T19:39:30.348085] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-22T19:39:30.353571] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-22T19:39:30.365056] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-22T19:39:30.576535] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:39:30.606633] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-22T19:39:30.623899] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-22T19:39:30.652217] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-22T19:39:30.665977] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-22T19:39:31.406420] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:39:31.442795] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:39:31.477788] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-22T19:39:31.474228] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-22T19:39:31.569684] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T19:39:31.578114] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-22T19:39:31.573173] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:39:31.579228] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-22T19:39:32.733452] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T19:39:32.738808] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-22T19:39:32.882306] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T19:39:32.888958] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-22T19:39:33.231810] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T19:39:33.242586] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-22T19:39:33.283485] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T19:39:33.293450] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-22T19:39:33.689154] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T19:39:33.697367] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-22T19:39:34.253707] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T19:39:34.260952] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-22T19:39:34.571465] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T19:39:34.586937] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-22T19:39:34.655534] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T19:39:34.699549] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-22T19:39:35.317717] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-22T19:39:35.601159] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T19:39:36.117624] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-22T19:39:36.280917] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T19:39:36.732190] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T19:39:36.917705] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-22T19:39:37.661471] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T19:39:37.717691] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-22T19:39:38.170090] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T19:39:38.517673] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-22T19:39:39.096727] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T19:39:39.317623] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-22T19:39:39.779096] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T19:39:40.117762] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-22T19:39:40.736623] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T19:39:40.917633] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-22T19:39:41.292369] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T19:39:41.717697] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-22T19:39:42.517730] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-22T19:39:42.603018] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T19:39:43.200576] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T19:39:43.317700] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-22T19:39:44.117765] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-22T19:39:44.286696] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T19:39:44.402283] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T19:39:44.917696] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-22T19:39:45.523052] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T19:39:45.717677] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-22T19:39:45.773377] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-22T19:39:45.777300] [INFO ] [REMOTE ] LCII: Full fetch complete (39024 records). [2025-10-22T19:39:45.777409] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-22T19:39:46.140042] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-22T19:39:46.140120] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-22T19:39:46.140805] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-22T19:39:46.140866] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-22T19:39:46.141639] [DEBUG] [LOCAL ] LCII: Trimmed 39024 records to 26860 (keeping 200 days of data) [2025-10-22T19:39:46.302090] [DEBUG] [LOCAL ] LCII: Primary data saved (26860 records). [2025-10-22T19:39:46.302218] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-22T19:39:46.302286] [INFO ] [MAIN ] Update Progress: 1241/2367 symbols completed. LCII took 17.6s. Estimated remaining: 2h 24m 54s. Rate: 7.8 symbols/min [2025-10-22T19:39:46.470058] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:39:46.509693] [DEBUG] [LOCAL ] LDOS: Loaded 44723 existing records from primary storage. [2025-10-22T19:39:46.509987] [INFO ] [MAIN ] LDOS: Loaded 44723 existing records. [2025-10-22T19:39:46.522974] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-22T19:39:46.684582] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:39:46.684846] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-22T19:39:46.684893] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-22T19:39:46.685317] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-22T19:39:46.685372] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-22T19:39:47.034486] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:39:47.211301] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T19:39:47.317699] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-22T19:39:48.117696] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-22T19:39:48.529597] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T19:39:48.917674] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-22T19:39:49.142438] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T19:39:49.717631] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-22T19:39:49.829261] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T19:39:50.509813] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T19:39:50.518526] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-22T19:39:51.317734] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-22T19:39:51.531462] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T19:39:52.117719] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-22T19:39:52.218357] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T19:39:52.917730] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-22T19:39:53.489282] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-22T19:39:53.717780] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-22T19:39:53.885322] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-22T19:39:54.487391] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T19:39:54.517637] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-22T19:39:55.317760] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-22T19:39:55.903776] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-22T19:39:55.913272] [INFO ] [REMOTE ] LDI: Full fetch complete (62225 records). [2025-10-22T19:39:55.913445] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-22T19:39:56.124595] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-22T19:39:56.356880] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-22T19:39:56.357028] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-22T19:39:56.358291] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-22T19:39:56.358383] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-22T19:39:56.389966] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T19:39:56.400510] [DEBUG] [LOCAL ] LDI: Trimmed 62225 records to 45123 (keeping 200 days of data) [2025-10-22T19:39:56.657009] [DEBUG] [LOCAL ] LDI: Primary data saved (45123 records). [2025-10-22T19:39:56.657170] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-22T19:39:56.657276] [INFO ] [MAIN ] Update Progress: 1242/2367 symbols completed. LDI took 28.0s. Estimated remaining: 2h 24m 48s. Rate: 7.8 symbols/min [2025-10-22T19:39:56.861807] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:39:56.894424] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-22T19:39:56.904156] [INFO ] [REMOTE ] LC: Full fetch complete (70705 records). [2025-10-22T19:39:56.909385] [DEBUG] [LOCAL ] LDP: Loaded 12691 existing records from primary storage. [2025-10-22T19:39:56.909741] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-22T19:39:56.910146] [INFO ] [MAIN ] LDP: Loaded 12691 existing records. [2025-10-22T19:39:56.923345] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-22T19:39:57.258413] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:39:57.291335] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-22T19:39:57.291482] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-22T19:39:57.295669] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-22T19:39:57.315087] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-22T19:39:57.741622] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-22T19:39:57.760911] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-22T19:39:57.784219] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-22T19:39:57.791458] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-22T19:39:57.838459] [DEBUG] [LOCAL ] LC: Trimmed 70705 records to 48255 (keeping 200 days of data) [2025-10-22T19:39:58.033105] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:39:58.034057] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-22T19:39:58.040150] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-22T19:39:58.255279] [DEBUG] [LOCAL ] LC: Primary data saved (48255 records). [2025-10-22T19:39:58.255498] [INFO ] [MAIN ] LC: Full history saved. [2025-10-22T19:39:58.255612] [INFO ] [MAIN ] Update Progress: 1243/2367 symbols completed. LC took 29.6s. Estimated remaining: 2h 24m 35s. Rate: 7.8 symbols/min [2025-10-22T19:39:58.436828] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:39:58.474212] [DEBUG] [LOCAL ] LEA: Loaded 41237 existing records from primary storage. [2025-10-22T19:39:58.474488] [INFO ] [MAIN ] LEA: Loaded 41237 existing records. [2025-10-22T19:39:58.539576] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-22T19:39:58.660977] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:39:58.661289] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-22T19:39:58.661390] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-22T19:39:58.661613] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-22T19:39:58.661753] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-22T19:39:58.972516] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-22T19:39:58.970330] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T19:39:59.093707] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:39:59.317682] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-22T19:40:00.117719] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-22T19:40:00.232428] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T19:40:00.917682] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-22T19:40:00.984546] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-22T19:40:01.010473] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T19:40:01.717729] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-22T19:40:02.517719] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-22T19:40:02.662891] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T19:40:02.790853] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T19:40:03.317683] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-22T19:40:04.117671] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-22T19:40:04.305606] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T19:40:04.340961] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T19:40:04.917663] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-22T19:40:05.533105] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T19:40:05.717633] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-22T19:40:05.844240] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-22T19:40:06.517723] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-22T19:40:07.317731] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-22T19:40:07.373355] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T19:40:08.117636] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-22T19:40:08.523266] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-22T19:40:08.917685] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-22T19:40:08.976995] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T19:40:09.031725] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T19:40:09.717674] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-22T19:40:10.517892] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-22T19:40:10.518832] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T19:40:10.538332] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-22T19:40:11.317696] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-22T19:40:12.097289] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T19:40:12.117624] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-22T19:40:12.205625] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T19:40:12.917729] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-22T19:40:13.715162] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T19:40:13.718361] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-22T19:40:13.761115] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T19:40:14.517679] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-22T19:40:15.317636] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-22T19:40:15.451203] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T19:40:15.453392] [INFO ] [REMOTE ] LDP: Full fetch complete (18722 records). [2025-10-22T19:40:15.453464] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-22T19:40:15.824544] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-22T19:40:15.824624] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-22T19:40:15.825118] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-22T19:40:15.825181] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-22T19:40:15.825730] [DEBUG] [LOCAL ] LDP: Trimmed 18722 records to 12503 (keeping 200 days of data) [2025-10-22T19:40:15.901073] [DEBUG] [LOCAL ] LDP: Primary data saved (12503 records). [2025-10-22T19:40:15.901210] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-22T19:40:15.901289] [INFO ] [MAIN ] Update Progress: 1244/2367 symbols completed. LDP took 19.2s. Estimated remaining: 2h 24m 36s. Rate: 7.8 symbols/min [2025-10-22T19:40:16.066381] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:40:16.107098] [DEBUG] [LOCAL ] LEG: Loaded 50008 existing records from primary storage. [2025-10-22T19:40:16.107428] [INFO ] [MAIN ] LEG: Loaded 50008 existing records. [2025-10-22T19:40:16.138308] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-22T19:40:16.290367] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:40:16.290586] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-22T19:40:16.290666] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-22T19:40:16.291032] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-22T19:40:16.291085] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-22T19:40:16.644156] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:40:16.903991] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T19:40:16.917597] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-22T19:40:17.634934] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (3.92 seconds). [2025-10-22T19:40:17.643552] [INFO ] [REMOTE ] LBRT: Full fetch complete (76523 records). [2025-10-22T19:40:17.643763] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-22T19:40:17.644492] [FATAL] [VALIDATOR ] LBRT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T19:40:17.644598] [FATAL] [MAIN ] LBRT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:40:17.644671] [WARN ] [MAIN ] LBRT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:40:17.644735] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-22T19:40:17.644797] [DEBUG] [LOCAL ] LBRT: No primary data file found to delete. [2025-10-22T19:40:17.644855] [INFO ] [LOCAL ] LBRT: Starting deletion of derivative data. [2025-10-22T19:40:17.645025] [DEBUG] [LOCAL ] LBRT: Deleted derivative data file. [2025-10-22T19:40:17.645120] [INFO ] [MAIN ] Update Progress: 1245/2367 symbols completed. LBRT took 49.0s. Estimated remaining: 2h 24m 23s. Rate: 7.8 symbols/min [2025-10-22T19:40:17.722796] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-22T19:40:17.825408] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:40:17.860049] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T19:40:17.907596] [DEBUG] [LOCAL ] LEN: Loaded 53200 existing records from primary storage. [2025-10-22T19:40:17.908069] [INFO ] [MAIN ] LEN: Loaded 53200 existing records. [2025-10-22T19:40:18.086321] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:40:18.086583] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-22T19:40:18.086662] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-22T19:40:18.086960] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-22T19:40:18.087015] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-22T19:40:18.446348] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:40:18.517672] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-22T19:40:18.656675] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T19:40:19.317636] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-22T19:40:19.480053] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T19:40:20.117625] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-22T19:40:20.275419] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T19:40:20.577161] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T19:40:20.917884] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-22T19:40:21.576383] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T19:40:21.583165] [INFO ] [REMOTE ] LDOS: Full fetch complete (66952 records). [2025-10-22T19:40:21.583298] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-22T19:40:21.722872] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-22T19:40:21.985595] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-22T19:40:21.985740] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-22T19:40:21.986735] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-22T19:40:21.986800] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-22T19:40:21.988189] [DEBUG] [LOCAL ] LDOS: Trimmed 66952 records to 44631 (keeping 200 days of data) [2025-10-22T19:40:22.273314] [DEBUG] [LOCAL ] LDOS: Primary data saved (44631 records). [2025-10-22T19:40:22.273583] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-22T19:40:22.273736] [INFO ] [MAIN ] Update Progress: 1246/2367 symbols completed. LDOS took 36.0s. Estimated remaining: 2h 24m 13s. Rate: 7.8 symbols/min [2025-10-22T19:40:22.442302] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:40:22.481121] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T19:40:22.503818] [DEBUG] [LOCAL ] LEO: Loaded 16799 existing records from primary storage. [2025-10-22T19:40:22.504107] [INFO ] [MAIN ] LEO: Loaded 16799 existing records. [2025-10-22T19:40:22.528468] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-22T19:40:22.730143] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:40:22.730508] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-22T19:40:22.730564] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-22T19:40:22.730910] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-22T19:40:22.730972] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-22T19:40:23.107698] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:40:23.317631] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-22T19:40:23.554313] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-22T19:40:24.117682] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-22T19:40:24.288852] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T19:40:24.897685] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T19:40:24.917622] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-22T19:40:24.970550] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T19:40:25.717696] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-22T19:40:26.049921] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T19:40:26.517678] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-22T19:40:27.317720] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-22T19:40:27.374092] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T19:40:27.380713] [INFO ] [REMOTE ] LEA: Full fetch complete (60513 records). [2025-10-22T19:40:27.380812] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-22T19:40:27.753773] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-22T19:40:27.753853] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-22T19:40:27.754691] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-22T19:40:27.754753] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-22T19:40:27.755932] [DEBUG] [LOCAL ] LEA: Trimmed 60513 records to 41127 (keeping 200 days of data) [2025-10-22T19:40:28.003070] [DEBUG] [LOCAL ] LEA: Primary data saved (41127 records). [2025-10-22T19:40:28.003189] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-22T19:40:28.003263] [INFO ] [MAIN ] Update Progress: 1247/2367 symbols completed. LEA took 29.7s. Estimated remaining: 2h 24m 3s. Rate: 7.8 symbols/min [2025-10-22T19:40:28.127885] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-22T19:40:28.178268] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:40:28.225941] [DEBUG] [LOCAL ] LEVI: Loaded 51823 existing records from primary storage. [2025-10-22T19:40:28.226236] [INFO ] [MAIN ] LEVI: Loaded 51823 existing records. [2025-10-22T19:40:28.404107] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:40:28.404565] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-22T19:40:28.404636] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-22T19:40:28.404943] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-22T19:40:28.405057] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-22T19:40:28.733272] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-22T19:40:28.826602] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:40:28.917673] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-22T19:40:29.223884] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T19:40:29.255954] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T19:40:29.717795] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-22T19:40:30.517675] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-22T19:40:30.790685] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T19:40:30.818204] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-22T19:40:31.317678] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-22T19:40:32.117719] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-22T19:40:32.357777] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T19:40:32.763896] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T19:40:32.917691] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-22T19:40:33.004631] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T19:40:33.717707] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-22T19:40:34.517701] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-22T19:40:34.562219] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T19:40:34.683238] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-22T19:40:35.317670] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-22T19:40:36.117720] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-22T19:40:36.381285] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-22T19:40:36.917727] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-22T19:40:36.947506] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T19:40:37.717677] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-22T19:40:37.751972] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T19:40:37.912309] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T19:40:38.517686] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-22T19:40:39.317768] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-22T19:40:39.746621] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-22T19:40:40.118866] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-22T19:40:40.124774] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T19:40:40.917712] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-22T19:40:41.027464] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T19:40:41.047322] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-22T19:40:41.717634] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-22T19:40:42.523681] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-22T19:40:42.529302] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T19:40:42.719561] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T19:40:43.317705] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-22T19:40:44.117693] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-22T19:40:44.395799] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T19:40:44.917692] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-22T19:40:45.307045] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T19:40:45.377860] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T19:40:45.569298] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-22T19:40:45.572347] [INFO ] [REMOTE ] LEO: Full fetch complete (26506 records). [2025-10-22T19:40:45.572432] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-22T19:40:45.726422] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-22T19:40:45.948022] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-22T19:40:45.948102] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-22T19:40:45.948666] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-22T19:40:45.948730] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-22T19:40:45.949417] [DEBUG] [LOCAL ] LEO: Trimmed 26506 records to 16855 (keeping 200 days of data) [2025-10-22T19:40:46.042328] [DEBUG] [LOCAL ] LEO: Primary data saved (16855 records). [2025-10-22T19:40:46.042451] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-22T19:40:46.042527] [INFO ] [MAIN ] Update Progress: 1248/2367 symbols completed. LEO took 23.8s. Estimated remaining: 2h 24m 5s. Rate: 7.8 symbols/min [2025-10-22T19:40:46.210675] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:40:46.228386] [DEBUG] [LOCAL ] LFT: Loaded 18162 existing records from primary storage. [2025-10-22T19:40:46.228613] [INFO ] [MAIN ] LFT: Loaded 18162 existing records. [2025-10-22T19:40:46.402605] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:40:46.402820] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-22T19:40:46.402867] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-22T19:40:46.403026] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-22T19:40:46.403064] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-22T19:40:46.522836] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-22T19:40:46.760254] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:40:47.317761] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-22T19:40:47.615079] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T19:40:48.117776] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-22T19:40:48.278052] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T19:40:48.917732] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-22T19:40:49.099281] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T19:40:49.702097] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-22T19:40:49.711139] [INFO ] [REMOTE ] LEN: Full fetch complete (77216 records). [2025-10-22T19:40:49.711306] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-22T19:40:49.723362] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-22T19:40:50.104203] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-22T19:40:50.104386] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-22T19:40:50.105726] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-22T19:40:50.105797] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-22T19:40:50.107476] [DEBUG] [LOCAL ] LEN: Trimmed 77216 records to 53196 (keeping 200 days of data) [2025-10-22T19:40:50.475769] [DEBUG] [LOCAL ] LEN: Primary data saved (53196 records). [2025-10-22T19:40:50.475979] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-22T19:40:50.476630] [INFO ] [MAIN ] Update Progress: 1249/2367 symbols completed. LEN took 32.8s. Estimated remaining: 2h 23m 54s. Rate: 7.8 symbols/min [2025-10-22T19:40:50.510738] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T19:40:50.531853] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-22T19:40:50.662534] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:40:50.670775] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-22T19:40:50.682294] [DEBUG] [LOCAL ] LGI: Loaded 10022 existing records from primary storage. [2025-10-22T19:40:50.682520] [INFO ] [MAIN ] LGI: Loaded 10022 existing records. [2025-10-22T19:40:50.855435] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:40:50.855632] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-22T19:40:50.855722] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-22T19:40:50.855937] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-22T19:40:50.855977] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-22T19:40:51.205884] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:40:51.317630] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-22T19:40:52.117674] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-22T19:40:52.247332] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T19:40:52.342293] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-22T19:40:52.917698] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-22T19:40:53.717635] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-22T19:40:53.812882] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T19:40:54.444125] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T19:40:54.517681] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-22T19:40:54.691272] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T19:40:54.699347] [INFO ] [REMOTE ] LEG: Full fetch complete (72814 records). [2025-10-22T19:40:54.699448] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-22T19:40:55.072684] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-22T19:40:55.072772] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-22T19:40:55.073593] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-22T19:40:55.073634] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-22T19:40:55.074966] [DEBUG] [LOCAL ] LEG: Trimmed 72814 records to 49950 (keeping 200 days of data) [2025-10-22T19:40:55.334420] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-22T19:40:55.370457] [DEBUG] [LOCAL ] LEG: Primary data saved (49950 records). [2025-10-22T19:40:55.371053] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-22T19:40:55.371176] [INFO ] [MAIN ] Update Progress: 1250/2367 symbols completed. LEG took 39.5s. Estimated remaining: 2h 23m 44s. Rate: 7.8 symbols/min [2025-10-22T19:40:55.533868] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T19:40:55.551149] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:40:55.590156] [DEBUG] [LOCAL ] LH: Loaded 37192 existing records from primary storage. [2025-10-22T19:40:55.590458] [INFO ] [MAIN ] LH: Loaded 37192 existing records. [2025-10-22T19:40:55.769168] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:40:55.769384] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-22T19:40:55.769432] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-22T19:40:55.769620] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-22T19:40:55.769712] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-22T19:40:56.119159] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:40:56.119244] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-22T19:40:56.157375] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T19:40:56.917726] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-22T19:40:57.717732] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-22T19:40:57.767532] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T19:40:58.413206] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T19:40:58.517610] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-22T19:40:58.776601] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T19:40:59.317699] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-22T19:41:00.021475] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T19:41:00.120791] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-22T19:41:00.124399] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T19:41:00.917696] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-22T19:41:01.717720] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-22T19:41:01.817678] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T19:41:02.087248] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T19:41:02.517657] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-22T19:41:02.665862] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-22T19:41:03.317683] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-22T19:41:04.117714] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-22T19:41:04.173613] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T19:41:04.895669] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T19:41:04.917612] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-22T19:41:05.087302] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T19:41:05.097462] [INFO ] [REMOTE ] LEVI: Full fetch complete (74996 records). [2025-10-22T19:41:05.097793] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-22T19:41:05.498879] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-22T19:41:05.498992] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-22T19:41:05.500045] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-22T19:41:05.500114] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-22T19:41:05.501631] [DEBUG] [LOCAL ] LEVI: Trimmed 74996 records to 51827 (keeping 200 days of data) [2025-10-22T19:41:05.720724] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-22T19:41:05.721261] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-22T19:41:05.840674] [DEBUG] [LOCAL ] LEVI: Primary data saved (51827 records). [2025-10-22T19:41:05.840838] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-22T19:41:05.840924] [INFO ] [MAIN ] Update Progress: 1251/2367 symbols completed. LEVI took 37.8s. Estimated remaining: 2h 23m 39s. Rate: 7.8 symbols/min [2025-10-22T19:41:06.011616] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:41:06.054931] [DEBUG] [LOCAL ] LHX: Loaded 48528 existing records from primary storage. [2025-10-22T19:41:06.055262] [INFO ] [MAIN ] LHX: Loaded 48528 existing records. [2025-10-22T19:41:06.226088] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:41:06.226339] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-22T19:41:06.226398] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-22T19:41:06.226860] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-22T19:41:06.226917] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-22T19:41:06.519561] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-22T19:41:06.580172] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:41:06.904639] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T19:41:07.317698] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-22T19:41:08.120690] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-22T19:41:08.126087] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-22T19:41:08.917735] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-22T19:41:09.020819] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T19:41:09.208956] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T19:41:09.717675] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-22T19:41:10.447800] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:41:10.517684] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-22T19:41:10.814449] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T19:41:11.317717] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-22T19:41:12.117682] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-22T19:41:12.539585] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-22T19:41:12.557390] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-22T19:41:12.917677] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-22T19:41:13.634388] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-22T19:41:13.717715] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-22T19:41:13.788472] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T19:41:14.517702] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-22T19:41:15.317704] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-22T19:41:15.383442] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T19:41:16.117701] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-22T19:41:16.186535] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T19:41:16.329276] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T19:41:16.331675] [INFO ] [REMOTE ] LGI: Full fetch complete (14448 records). [2025-10-22T19:41:16.331757] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-22T19:41:16.693307] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-22T19:41:16.693412] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-22T19:41:16.693784] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-22T19:41:16.693843] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-22T19:41:16.694341] [DEBUG] [LOCAL ] LGI: Trimmed 14448 records to 9951 (keeping 200 days of data) [2025-10-22T19:41:16.756267] [DEBUG] [LOCAL ] LGI: Primary data saved (9951 records). [2025-10-22T19:41:16.756403] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-22T19:41:16.756482] [INFO ] [MAIN ] Update Progress: 1252/2367 symbols completed. LGI took 26.3s. Estimated remaining: 2h 23m 34s. Rate: 7.8 symbols/min [2025-10-22T19:41:16.923263] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:41:16.922280] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-22T19:41:16.950055] [DEBUG] [LOCAL ] LII: Loaded 27758 existing records from primary storage. [2025-10-22T19:41:16.950453] [INFO ] [MAIN ] LII: Loaded 27758 existing records. [2025-10-22T19:41:17.126909] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:41:17.136348] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-22T19:41:17.136771] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T19:41:17.140486] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-22T19:41:17.141145] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-22T19:41:17.141202] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-22T19:41:17.506175] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:41:17.717681] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-22T19:41:18.337069] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T19:41:18.517679] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-22T19:41:18.714605] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-22T19:41:19.317668] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-22T19:41:19.978392] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-22T19:41:20.009711] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-22T19:41:20.012480] [INFO ] [REMOTE ] LFT: Full fetch complete (23785 records). [2025-10-22T19:41:20.012553] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-22T19:41:20.122722] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-22T19:41:20.370066] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-22T19:41:20.370145] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-22T19:41:20.370613] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-22T19:41:20.370679] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-22T19:41:20.371305] [DEBUG] [LOCAL ] LFT: Trimmed 23785 records to 18119 (keeping 200 days of data) [2025-10-22T19:41:20.473287] [DEBUG] [LOCAL ] LFT: Primary data saved (18119 records). [2025-10-22T19:41:20.473419] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-22T19:41:20.473498] [INFO ] [MAIN ] Update Progress: 1253/2367 symbols completed. LFT took 34.4s. Estimated remaining: 2h 23m 22s. Rate: 7.8 symbols/min [2025-10-22T19:41:20.639290] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:41:20.678176] [DEBUG] [LOCAL ] LION: Loaded 46849 existing records from primary storage. [2025-10-22T19:41:20.678460] [INFO ] [MAIN ] LION: Loaded 46849 existing records. [2025-10-22T19:41:20.877013] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:41:20.877240] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-22T19:41:20.877286] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-22T19:41:20.877560] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-22T19:41:20.877617] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-22T19:41:20.922735] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-22T19:41:21.221737] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:41:21.515911] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-22T19:41:21.717630] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-22T19:41:22.101181] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T19:41:22.517729] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-22T19:41:23.317697] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-22T19:41:23.592381] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T19:41:23.630244] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T19:41:24.117693] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-22T19:41:24.689370] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-22T19:41:24.917673] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-22T19:41:25.717763] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-22T19:41:25.825874] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T19:41:25.831804] [INFO ] [REMOTE ] LH: Full fetch complete (54871 records). [2025-10-22T19:41:25.831977] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-22T19:41:26.218240] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-22T19:41:26.218443] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-22T19:41:26.219503] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-22T19:41:26.219710] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-22T19:41:26.220999] [DEBUG] [LOCAL ] LH: Trimmed 54871 records to 37024 (keeping 200 days of data) [2025-10-22T19:41:26.472724] [DEBUG] [LOCAL ] LH: Primary data saved (37024 records). [2025-10-22T19:41:26.496441] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T19:41:26.496634] [INFO ] [MAIN ] LH: Full history saved. [2025-10-22T19:41:26.503859] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T19:41:26.503962] [INFO ] [MAIN ] Update Progress: 1254/2367 symbols completed. LH took 31.1s. Estimated remaining: 2h 23m 13s. Rate: 7.8 symbols/min [2025-10-22T19:41:26.522147] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-22T19:41:26.679762] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:41:26.685748] [DEBUG] [LOCAL ] LITB: Loaded 3861 existing records from primary storage. [2025-10-22T19:41:26.685925] [INFO ] [MAIN ] LITB: Loaded 3861 existing records. [2025-10-22T19:41:26.857955] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:41:26.858126] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-22T19:41:26.858172] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-22T19:41:26.858286] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-22T19:41:26.858323] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-22T19:41:27.199957] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:41:27.317611] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-22T19:41:27.663140] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T19:41:28.079580] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T19:41:28.117779] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-22T19:41:28.580476] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T19:41:28.917724] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-22T19:41:29.717634] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-22T19:41:30.233400] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T19:41:30.517731] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-22T19:41:30.628541] [DEBUG] [REMOTE ] LITB: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-22T19:41:30.628907] [WARN ] [REMOTE ] LITB: No data returned for month 2025-03 [2025-10-22T19:41:30.628996] [FATAL] [REMOTE ] LITB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:41:30.629068] [FATAL] [MAIN ] LITB: Failed to fetch primary data. [2025-10-22T19:41:30.629130] [WARN ] [MAIN ] LITB: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:41:30.629201] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-22T19:41:30.629266] [DEBUG] [LOCAL ] LITB: No primary data file found to delete. [2025-10-22T19:41:30.629300] [INFO ] [LOCAL ] LITB: Starting deletion of derivative data. [2025-10-22T19:41:30.629430] [DEBUG] [LOCAL ] LITB: Deleted derivative data file. [2025-10-22T19:41:30.629511] [INFO ] [MAIN ] Update Progress: 1255/2367 symbols completed. LITB took 4.1s. Estimated remaining: 2h 23m 2s. Rate: 7.8 symbols/min [2025-10-22T19:41:30.799265] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:41:30.846991] [DEBUG] [LOCAL ] LLY: Loaded 53192 existing records from primary storage. [2025-10-22T19:41:30.847286] [INFO ] [MAIN ] LLY: Loaded 53192 existing records. [2025-10-22T19:41:31.024452] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:41:31.024810] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-22T19:41:31.024878] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-22T19:41:31.025157] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-22T19:41:31.025241] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-22T19:41:31.140740] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T19:41:31.318187] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-22T19:41:31.395713] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:41:32.117698] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-22T19:41:32.917637] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-22T19:41:33.044444] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T19:41:33.339072] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T19:41:33.717669] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-22T19:41:34.517776] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-22T19:41:35.288945] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-22T19:41:35.317605] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-22T19:41:35.655937] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T19:41:35.882415] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T19:41:36.117729] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-22T19:41:36.917637] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-22T19:41:37.311389] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T19:41:37.470237] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-22T19:41:37.717717] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-22T19:41:38.517709] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-22T19:41:38.568955] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T19:41:38.980708] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-22T19:41:39.317683] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-22T19:41:40.117812] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-22T19:41:40.868901] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-22T19:41:40.917693] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-22T19:41:41.015993] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T19:41:41.717637] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-22T19:41:41.961564] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T19:41:42.312487] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T19:41:42.317601] [INFO ] [REMOTE ] LII: Full fetch complete (41902 records). [2025-10-22T19:41:42.317721] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-22T19:41:42.523710] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-22T19:41:42.689179] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-22T19:41:42.689258] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-22T19:41:42.689963] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-22T19:41:42.690024] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-22T19:41:42.690834] [DEBUG] [LOCAL ] LII: Trimmed 41902 records to 27810 (keeping 200 days of data) [2025-10-22T19:41:42.861279] [DEBUG] [LOCAL ] LII: Primary data saved (27810 records). [2025-10-22T19:41:42.861402] [INFO ] [MAIN ] LII: Full history saved. [2025-10-22T19:41:42.861478] [INFO ] [MAIN ] Update Progress: 1256/2367 symbols completed. LII took 26.1s. Estimated remaining: 2h 22m 59s. Rate: 7.8 symbols/min [2025-10-22T19:41:43.027620] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:41:43.075575] [DEBUG] [LOCAL ] LMND: Loaded 52124 existing records from primary storage. [2025-10-22T19:41:43.075929] [INFO ] [MAIN ] LMND: Loaded 52124 existing records. [2025-10-22T19:41:43.253832] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:41:43.254057] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-22T19:41:43.254141] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-22T19:41:43.254516] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-22T19:41:43.254555] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-22T19:41:43.322111] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-22T19:41:43.634353] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:41:43.636539] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T19:41:44.117681] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-22T19:41:44.413706] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T19:41:44.917693] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-22T19:41:45.717699] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-22T19:41:45.867223] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-22T19:41:46.097165] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-22T19:41:46.517698] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-22T19:41:46.633535] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T19:41:47.048233] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T19:41:47.317703] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-22T19:41:48.076321] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T19:41:48.117674] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-22T19:41:48.917632] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-22T19:41:49.144719] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T19:41:49.152335] [INFO ] [REMOTE ] LHX: Full fetch complete (70811 records). [2025-10-22T19:41:49.152450] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-22T19:41:49.535406] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-22T19:41:49.535485] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-22T19:41:49.536414] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-22T19:41:49.536477] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-22T19:41:49.537954] [DEBUG] [LOCAL ] LHX: Trimmed 70811 records to 48471 (keeping 200 days of data) [2025-10-22T19:41:49.722951] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-22T19:41:49.838237] [DEBUG] [LOCAL ] LHX: Primary data saved (48471 records). [2025-10-22T19:41:49.838417] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-22T19:41:49.838543] [INFO ] [MAIN ] Update Progress: 1257/2367 symbols completed. LHX took 44.0s. Estimated remaining: 2h 22m 50s. Rate: 7.8 symbols/min [2025-10-22T19:41:50.016780] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:41:50.059716] [DEBUG] [LOCAL ] LMT: Loaded 49628 existing records from primary storage. [2025-10-22T19:41:50.060033] [INFO ] [MAIN ] LMT: Loaded 49628 existing records. [2025-10-22T19:41:50.236170] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:41:50.236449] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-22T19:41:50.236531] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-22T19:41:50.236769] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-22T19:41:50.236936] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-22T19:41:50.472905] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T19:41:50.551983] [INFO ] [REMOTE ] LION: Full fetch complete (57992 records). [2025-10-22T19:41:50.573202] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-22T19:41:50.632196] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:41:50.632762] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-22T19:41:51.046814] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-22T19:41:51.046918] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-22T19:41:51.047896] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-22T19:41:51.047998] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-22T19:41:51.076919] [DEBUG] [LOCAL ] LION: Trimmed 57992 records to 46933 (keeping 200 days of data) [2025-10-22T19:41:51.078669] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.96 seconds). [2025-10-22T19:41:51.325402] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-22T19:41:51.350795] [DEBUG] [LOCAL ] LION: Primary data saved (46933 records). [2025-10-22T19:41:51.350916] [INFO ] [MAIN ] LION: Full history saved. [2025-10-22T19:41:51.351022] [INFO ] [MAIN ] Update Progress: 1258/2367 symbols completed. LION took 30.9s. Estimated remaining: 2h 22m 37s. Rate: 7.8 symbols/min [2025-10-22T19:41:51.528463] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:41:51.601065] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T19:41:51.612846] [DEBUG] [LOCAL ] LNC: Loaded 51488 existing records from primary storage. [2025-10-22T19:41:51.614093] [INFO ] [MAIN ] LNC: Loaded 51488 existing records. [2025-10-22T19:41:51.789891] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:41:51.790090] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-22T19:41:51.790136] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-22T19:41:51.790344] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-22T19:41:51.790398] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-22T19:41:52.122835] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-22T19:41:52.158859] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:41:52.670435] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-22T19:41:52.917681] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-22T19:41:53.717681] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-22T19:41:53.942570] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-10-22T19:41:54.052805] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T19:41:54.517721] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-22T19:41:54.596395] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T19:41:55.317788] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-22T19:41:55.735986] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-22T19:41:56.117719] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-22T19:41:56.917708] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-22T19:41:56.983252] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T19:41:57.128704] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-22T19:41:57.717705] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-22T19:41:58.279314] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-22T19:41:58.522960] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-22T19:41:58.535461] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T19:41:59.317623] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-22T19:41:59.498287] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T19:42:00.117637] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-22T19:42:00.917770] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-22T19:42:01.447155] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.92 seconds). [2025-10-22T19:42:01.707940] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-22T19:42:01.718432] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-22T19:42:02.248707] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T19:42:02.517633] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-22T19:42:02.844545] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T19:42:03.317688] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-22T19:42:04.117638] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-22T19:42:04.411686] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-22T19:42:04.731518] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-22T19:42:04.917617] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-22T19:42:05.189930] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-22T19:42:05.717685] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-22T19:42:06.270819] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T19:42:06.517725] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-22T19:42:06.671663] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T19:42:07.317667] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-22T19:42:07.411868] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-22T19:42:07.437575] [INFO ] [REMOTE ] LLY: Full fetch complete (77209 records). [2025-10-22T19:42:07.447966] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-22T19:42:07.450375] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T19:42:07.899551] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-22T19:42:07.899720] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-22T19:42:07.900942] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-22T19:42:07.901008] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-22T19:42:07.902754] [DEBUG] [LOCAL ] LLY: Trimmed 77209 records to 53191 (keeping 200 days of data) [2025-10-22T19:42:08.119819] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-22T19:42:08.242492] [DEBUG] [LOCAL ] LLY: Primary data saved (53191 records). [2025-10-22T19:42:08.242633] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-22T19:42:08.242753] [INFO ] [MAIN ] Update Progress: 1259/2367 symbols completed. LLY took 37.6s. Estimated remaining: 2h 22m 37s. Rate: 7.8 symbols/min [2025-10-22T19:42:08.411014] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:08.416776] [DEBUG] [LOCAL ] LND: Loaded 4930 existing records from primary storage. [2025-10-22T19:42:08.416943] [INFO ] [MAIN ] LND: Loaded 4930 existing records. [2025-10-22T19:42:08.591243] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:08.591522] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-22T19:42:08.591571] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-22T19:42:08.591754] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-22T19:42:08.591814] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-22T19:42:08.925511] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-22T19:42:08.959023] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:42:09.461090] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-22T19:42:09.717711] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-22T19:42:10.418533] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-22T19:42:10.517734] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-22T19:42:10.643270] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-22T19:42:10.896737] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-22T19:42:11.317765] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-22T19:42:12.117675] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-22T19:42:12.923704] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-22T19:42:12.940555] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-22T19:42:13.612508] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-22T19:42:13.621765] [INFO ] [REMOTE ] LMND: Full fetch complete (75467 records). [2025-10-22T19:42:13.622014] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-22T19:42:13.702279] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T19:42:13.728861] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-22T19:42:13.944026] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T19:42:14.055632] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-22T19:42:14.055736] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-22T19:42:14.056677] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-22T19:42:14.056740] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-22T19:42:14.058153] [DEBUG] [LOCAL ] LMND: Trimmed 75467 records to 52122 (keeping 200 days of data) [2025-10-22T19:42:14.364824] [DEBUG] [LOCAL ] LMND: Primary data saved (52122 records). [2025-10-22T19:42:14.364971] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-22T19:42:14.365578] [INFO ] [MAIN ] Update Progress: 1260/2367 symbols completed. LMND took 31.5s. Estimated remaining: 2h 22m 28s. Rate: 7.8 symbols/min [2025-10-22T19:42:14.531529] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-22T19:42:14.534062] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:14.582002] [DEBUG] [LOCAL ] LNG: Loaded 51114 existing records from primary storage. [2025-10-22T19:42:14.582381] [INFO ] [MAIN ] LNG: Loaded 51114 existing records. [2025-10-22T19:42:14.754303] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:14.754476] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-22T19:42:14.754521] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-22T19:42:14.754813] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-22T19:42:14.754875] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-22T19:42:15.105523] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:42:15.149777] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T19:42:15.317609] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-22T19:42:15.733998] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-22T19:42:16.117688] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-22T19:42:16.917768] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-22T19:42:16.927096] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T19:42:17.717714] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-22T19:42:17.799972] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-22T19:42:18.498356] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-22T19:42:18.517621] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-22T19:42:18.867675] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-22T19:42:18.885105] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-22T19:42:19.317637] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-22T19:42:20.117722] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-22T19:42:20.917670] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-22T19:42:21.199748] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T19:42:21.717724] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-22T19:42:22.140328] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-22T19:42:22.389839] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-22T19:42:22.517708] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-22T19:42:22.941770] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-22T19:42:22.950356] [INFO ] [REMOTE ] LNC: Full fetch complete (74585 records). [2025-10-22T19:42:22.950513] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-22T19:42:23.335395] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-22T19:42:23.361134] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-22T19:42:23.361225] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-22T19:42:23.362235] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-22T19:42:23.362306] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-22T19:42:23.363955] [DEBUG] [LOCAL ] LNC: Trimmed 74585 records to 51466 (keeping 200 days of data) [2025-10-22T19:42:23.685552] [DEBUG] [LOCAL ] LNC: Primary data saved (51466 records). [2025-10-22T19:42:23.685704] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-22T19:42:23.685794] [INFO ] [MAIN ] Update Progress: 1261/2367 symbols completed. LNC took 32.3s. Estimated remaining: 2h 22m 22s. Rate: 7.8 symbols/min [2025-10-22T19:42:23.874776] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:23.888429] [DEBUG] [LOCAL ] LNN: Loaded 11431 existing records from primary storage. [2025-10-22T19:42:23.888639] [INFO ] [MAIN ] LNN: Loaded 11431 existing records. [2025-10-22T19:42:24.078417] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T19:42:24.078145] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:24.080439] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-22T19:42:24.080835] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-22T19:42:24.081028] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-22T19:42:24.081069] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-22T19:42:24.122867] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-22T19:42:24.433608] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:42:24.762344] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-22T19:42:24.917638] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-22T19:42:24.963339] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-22T19:42:24.971524] [INFO ] [REMOTE ] LMT: Full fetch complete (72581 records). [2025-10-22T19:42:24.971693] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-22T19:42:25.379555] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-22T19:42:25.379633] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-22T19:42:25.380563] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-22T19:42:25.380612] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-22T19:42:25.381880] [DEBUG] [LOCAL ] LMT: Trimmed 72581 records to 49623 (keeping 200 days of data) [2025-10-22T19:42:25.678222] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-22T19:42:25.682548] [INFO ] [REMOTE ] LND: Full fetch complete (7819 records). [2025-10-22T19:42:25.684454] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-22T19:42:25.722526] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-22T19:42:25.783601] [DEBUG] [LOCAL ] LMT: Primary data saved (49623 records). [2025-10-22T19:42:25.802840] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-22T19:42:25.813954] [INFO ] [MAIN ] Update Progress: 1262/2367 symbols completed. LMT took 36.0s. Estimated remaining: 2h 22m 9s. Rate: 7.8 symbols/min [2025-10-22T19:42:26.176693] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:26.259041] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-22T19:42:26.259125] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-22T19:42:26.259308] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-22T19:42:26.259347] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-22T19:42:26.259839] [DEBUG] [LOCAL ] LND: Trimmed 7819 records to 4960 (keeping 200 days of data) [2025-10-22T19:42:26.297218] [DEBUG] [LOCAL ] LND: Primary data saved (4960 records). [2025-10-22T19:42:26.297402] [INFO ] [MAIN ] LND: Full history saved. [2025-10-22T19:42:26.297495] [INFO ] [MAIN ] Update Progress: 1263/2367 symbols completed. LND took 18.1s. Estimated remaining: 2h 21m 55s. Rate: 7.8 symbols/min [2025-10-22T19:42:26.420419] [DEBUG] [LOCAL ] LOAR: Loaded 42020 existing records from primary storage. [2025-10-22T19:42:26.436106] [INFO ] [MAIN ] LOAR: Loaded 42020 existing records. [2025-10-22T19:42:26.558440] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-22T19:42:26.560149] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:26.683160] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:26.683419] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-22T19:42:26.683469] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-22T19:42:26.683723] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-22T19:42:26.683790] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-22T19:42:26.800633] [DEBUG] [LOCAL ] LOB: Loaded 26778 existing records from primary storage. [2025-10-22T19:42:26.811625] [INFO ] [MAIN ] LOB: Loaded 26778 existing records. [2025-10-22T19:42:27.006585] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T19:42:27.193259] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:27.203730] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-22T19:42:27.208876] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-22T19:42:27.237861] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-22T19:42:27.246416] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-22T19:42:27.300416] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:42:27.325693] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-22T19:42:27.625128] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:42:28.117699] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-22T19:42:28.488372] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T19:42:28.635213] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T19:42:28.790736] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-22T19:42:28.917734] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-22T19:42:29.717718] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-22T19:42:29.987187] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T19:42:30.517685] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-22T19:42:30.587913] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T19:42:31.317722] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-22T19:42:32.117728] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-22T19:42:32.463267] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T19:42:32.479554] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T19:42:32.917721] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-22T19:42:33.071762] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-22T19:42:33.717685] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-22T19:42:34.175605] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T19:42:34.517662] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-22T19:42:34.954099] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-22T19:42:35.317685] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-22T19:42:36.117677] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-22T19:42:36.336282] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T19:42:36.747384] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T19:42:36.917629] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-22T19:42:37.511425] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-22T19:42:37.717620] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-22T19:42:38.004481] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T19:42:38.517722] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-22T19:42:39.326837] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-22T19:42:39.333042] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T19:42:39.378154] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T19:42:40.117695] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-22T19:42:40.918332] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-22T19:42:40.919872] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T19:42:41.116145] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T19:42:41.717623] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-22T19:42:42.138308] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T19:42:42.517697] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-22T19:42:42.974752] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-22T19:42:43.317690] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-22T19:42:43.927815] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-22T19:42:44.117674] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-22T19:42:44.546718] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-22T19:42:44.917720] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-22T19:42:45.609878] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T19:42:45.717727] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-22T19:42:46.517686] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-22T19:42:46.808269] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T19:42:47.317675] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-22T19:42:47.423094] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-22T19:42:47.592049] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-22T19:42:48.117634] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-22T19:42:48.346152] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T19:42:48.917683] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-22T19:42:49.640169] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T19:42:49.640476] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-22T19:42:49.717695] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-22T19:42:50.517713] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-22T19:42:50.608639] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T19:42:51.317692] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-22T19:42:52.117735] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-22T19:42:52.358088] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T19:42:52.517917] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T19:42:52.917699] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-22T19:42:53.253592] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T19:42:53.717719] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-22T19:42:54.517718] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-22T19:42:54.804882] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T19:42:54.814448] [INFO ] [REMOTE ] LNG: Full fetch complete (74682 records). [2025-10-22T19:42:54.814747] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-22T19:42:54.957717] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T19:42:54.985168] [INFO ] [REMOTE ] LNN: Full fetch complete (16156 records). [2025-10-22T19:42:55.014254] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-22T19:42:55.321734] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-22T19:42:55.519812] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-22T19:42:55.532562] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-22T19:42:55.534307] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-22T19:42:55.540406] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-22T19:42:55.584352] [DEBUG] [LOCAL ] LNG: Trimmed 74682 records to 51063 (keeping 200 days of data) [2025-10-22T19:42:55.724498] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-22T19:42:55.750663] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-22T19:42:55.753060] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-22T19:42:55.753139] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-22T19:42:55.760808] [DEBUG] [LOCAL ] LNN: Trimmed 16156 records to 11504 (keeping 200 days of data) [2025-10-22T19:42:55.956489] [DEBUG] [LOCAL ] LNN: Primary data saved (11504 records). [2025-10-22T19:42:55.960975] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-22T19:42:55.961144] [INFO ] [MAIN ] Update Progress: 1264/2367 symbols completed. LNN took 32.3s. Estimated remaining: 2h 22m 7s. Rate: 7.8 symbols/min [2025-10-22T19:42:56.184314] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T19:42:56.223120] [INFO ] [REMOTE ] LOAR: Full fetch complete (56001 records). [2025-10-22T19:42:56.253083] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-22T19:42:56.258823] [DEBUG] [LOCAL ] LNG: Primary data saved (51063 records). [2025-10-22T19:42:56.256609] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:56.259203] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-22T19:42:56.260138] [INFO ] [MAIN ] Update Progress: 1265/2367 symbols completed. LNG took 41.9s. Estimated remaining: 2h 21m 53s. Rate: 7.8 symbols/min [2025-10-22T19:42:56.470904] [DEBUG] [LOCAL ] LOCL: Loaded 3714 existing records from primary storage. [2025-10-22T19:42:56.532812] [INFO ] [MAIN ] LOCL: Loaded 3714 existing records. [2025-10-22T19:42:56.706264] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:57.038094] [DEBUG] [LOCAL ] LOMA: Loaded 32809 existing records from primary storage. [2025-10-22T19:42:56.988692] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:57.055638] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-22T19:42:57.061219] [INFO ] [MAIN ] LOMA: Loaded 32809 existing records. [2025-10-22T19:42:57.055822] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-22T19:42:57.074689] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T19:42:57.089219] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-22T19:42:57.099007] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-22T19:42:57.117944] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-22T19:42:57.129118] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-22T19:42:57.147049] [INFO ] [REMOTE ] LOB: Full fetch complete (38625 records). [2025-10-22T19:42:57.153487] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-22T19:42:57.169219] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-22T19:42:57.181285] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-22T19:42:57.381873] [DEBUG] [LOCAL ] LOAR: Trimmed 56001 records to 42026 (keeping 200 days of data) [2025-10-22T19:42:57.545921] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:57.592576] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-22T19:42:57.693620] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-22T19:42:57.757701] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-22T19:42:57.813473] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-22T19:42:58.260383] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:42:58.278305] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-22T19:42:58.637545] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-22T19:42:58.666869] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-22T19:42:58.679924] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-22T19:42:58.682507] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-22T19:42:58.728896] [DEBUG] [LOCAL ] LOB: Trimmed 38625 records to 26644 (keeping 200 days of data) [2025-10-22T19:42:58.772307] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:42:58.773141] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-22T19:42:58.928809] [DEBUG] [LOCAL ] LOAR: Primary data saved (42026 records). [2025-10-22T19:42:58.937483] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-22T19:42:58.943048] [INFO ] [MAIN ] Update Progress: 1266/2367 symbols completed. LOAR took 33.1s. Estimated remaining: 2h 21m 40s. Rate: 7.8 symbols/min [2025-10-22T19:42:59.087458] [DEBUG] [LOCAL ] LOB: Primary data saved (26644 records). [2025-10-22T19:42:59.099733] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-22T19:42:59.110365] [INFO ] [MAIN ] Update Progress: 1267/2367 symbols completed. LOB took 32.8s. Estimated remaining: 2h 21m 26s. Rate: 7.8 symbols/min [2025-10-22T19:42:59.223966] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:59.249788] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T19:42:59.272245] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-22T19:42:59.369468] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:42:59.409356] [DEBUG] [LOCAL ] LOW: Loaded 52978 existing records from primary storage. [2025-10-22T19:42:59.423512] [INFO ] [MAIN ] LOW: Loaded 52978 existing records. [2025-10-22T19:42:59.562938] [DEBUG] [LOCAL ] LPG: Loaded 39396 existing records from primary storage. [2025-10-22T19:42:59.585397] [INFO ] [MAIN ] LPG: Loaded 39396 existing records. [2025-10-22T19:42:59.649818] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:59.684721] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-22T19:42:59.696359] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-22T19:42:59.723025] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-22T19:42:59.748255] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-22T19:42:59.753877] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-22T19:42:59.813298] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-22T19:42:59.860951] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:42:59.912063] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-22T19:42:59.924025] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-22T19:42:59.924868] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-22T19:42:59.945739] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-22T19:43:00.251038] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-22T19:43:00.302790] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-22T19:43:00.573684] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:43:00.583503] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T19:43:00.589415] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-22T19:43:00.675866] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:43:00.917721] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-22T19:43:01.310297] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-22T19:43:01.717722] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-22T19:43:02.162782] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-22T19:43:02.513336] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T19:43:02.521954] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-22T19:43:02.578178] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-22T19:43:03.024173] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-22T19:43:03.317770] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-22T19:43:04.117779] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-22T19:43:04.677341] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T19:43:04.917724] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-22T19:43:05.717628] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-22T19:43:05.978785] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T19:43:06.482677] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T19:43:06.517633] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-22T19:43:06.975321] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T19:43:07.317679] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-22T19:43:08.071786] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T19:43:08.117615] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-22T19:43:08.589703] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-22T19:43:08.917682] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-22T19:43:09.722835] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-22T19:43:09.742473] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T19:43:09.868600] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-22T19:43:10.073530] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-22T19:43:10.517680] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-22T19:43:11.317685] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-22T19:43:12.117639] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-22T19:43:12.469128] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T19:43:12.843886] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T19:43:12.917734] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-22T19:43:13.314929] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T19:43:13.717676] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-22T19:43:14.402929] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T19:43:14.517620] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-22T19:43:14.952678] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T19:43:15.004352] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-22T19:43:15.317685] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-22T19:43:16.117688] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-22T19:43:16.917716] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-22T19:43:17.295530] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T19:43:17.466402] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T19:43:17.717694] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-22T19:43:18.105810] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-22T19:43:18.517679] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-22T19:43:19.099584] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-22T19:43:19.317630] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-22T19:43:19.437855] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T19:43:20.117693] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-22T19:43:20.697807] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-22T19:43:20.698933] [INFO ] [REMOTE ] LOCL: Full fetch complete (4547 records). [2025-10-22T19:43:20.699004] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-22T19:43:20.928028] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-22T19:43:21.090470] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-22T19:43:21.090606] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-22T19:43:21.091040] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-22T19:43:21.092579] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T19:43:21.091518] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-22T19:43:21.102724] [DEBUG] [LOCAL ] LOCL: Trimmed 4547 records to 3504 (keeping 200 days of data) [2025-10-22T19:43:21.121877] [DEBUG] [LOCAL ] LOCL: Primary data saved (3504 records). [2025-10-22T19:43:21.121943] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-22T19:43:21.122017] [INFO ] [MAIN ] Update Progress: 1268/2367 symbols completed. LOCL took 25.2s. Estimated remaining: 2h 21m 31s. Rate: 7.8 symbols/min [2025-10-22T19:43:21.286872] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:43:21.312544] [DEBUG] [LOCAL ] LPL: Loaded 28918 existing records from primary storage. [2025-10-22T19:43:21.312834] [INFO ] [MAIN ] LPL: Loaded 28918 existing records. [2025-10-22T19:43:21.483694] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:43:21.483899] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-22T19:43:21.483946] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-22T19:43:21.484197] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-22T19:43:21.484239] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-22T19:43:21.722778] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-22T19:43:21.833090] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:43:22.484513] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T19:43:22.517621] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-22T19:43:23.317676] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-22T19:43:23.565013] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-22T19:43:23.908595] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-22T19:43:24.117727] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-22T19:43:24.428007] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T19:43:24.437819] [INFO ] [REMOTE ] LOMA: Full fetch complete (47770 records). [2025-10-22T19:43:24.438036] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-22T19:43:24.922882] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-22T19:43:25.008255] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-22T19:43:25.008374] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-22T19:43:25.009601] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-22T19:43:25.009713] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-22T19:43:25.011183] [DEBUG] [LOCAL ] LOMA: Trimmed 47770 records to 32716 (keeping 200 days of data) [2025-10-22T19:43:25.235314] [DEBUG] [LOCAL ] LOMA: Primary data saved (32716 records). [2025-10-22T19:43:25.235443] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-22T19:43:25.235521] [INFO ] [MAIN ] Update Progress: 1269/2367 symbols completed. LOMA took 29.0s. Estimated remaining: 2h 21m 20s. Rate: 7.8 symbols/min [2025-10-22T19:43:25.400239] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:43:25.437028] [DEBUG] [LOCAL ] LPX: Loaded 40110 existing records from primary storage. [2025-10-22T19:43:25.437303] [INFO ] [MAIN ] LPX: Loaded 40110 existing records. [2025-10-22T19:43:25.613413] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:43:25.613731] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-22T19:43:25.613861] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-22T19:43:25.619188] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-22T19:43:25.628345] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-22T19:43:25.660707] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T19:43:25.724449] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-22T19:43:25.714305] [INFO ] [REMOTE ] LPG: Full fetch complete (58856 records). [2025-10-22T19:43:25.731839] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-22T19:43:26.373941] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:43:26.419049] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-22T19:43:26.419150] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-22T19:43:26.420067] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-22T19:43:26.420132] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-22T19:43:26.421389] [DEBUG] [LOCAL ] LPG: Trimmed 58856 records to 39248 (keeping 200 days of data) [2025-10-22T19:43:26.517678] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-22T19:43:26.663894] [DEBUG] [LOCAL ] LPG: Primary data saved (39248 records). [2025-10-22T19:43:26.664070] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-22T19:43:26.665096] [INFO ] [MAIN ] Update Progress: 1270/2367 symbols completed. LPG took 27.5s. Estimated remaining: 2h 21m 7s. Rate: 7.8 symbols/min [2025-10-22T19:43:26.837064] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:43:26.874938] [DEBUG] [LOCAL ] LRN: Loaded 39446 existing records from primary storage. [2025-10-22T19:43:26.875216] [INFO ] [MAIN ] LRN: Loaded 39446 existing records. [2025-10-22T19:43:26.987135] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T19:43:27.085716] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:43:27.086145] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-22T19:43:27.086427] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-22T19:43:27.097423] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-22T19:43:27.112718] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-22T19:43:27.180043] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-22T19:43:27.330838] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-22T19:43:27.512964] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:43:28.029298] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T19:43:28.117766] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-22T19:43:28.917800] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-22T19:43:29.466145] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-22T19:43:29.639094] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T19:43:29.717732] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-22T19:43:30.524543] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-22T19:43:30.541436] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T19:43:31.317814] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-22T19:43:31.541098] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T19:43:32.105315] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T19:43:32.117599] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-22T19:43:32.158735] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-22T19:43:32.917705] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-22T19:43:33.602271] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T19:43:33.717673] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-22T19:43:33.992028] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T19:43:34.517788] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-22T19:43:35.317678] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-22T19:43:35.696732] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T19:43:35.706138] [INFO ] [REMOTE ] LOW: Full fetch complete (76721 records). [2025-10-22T19:43:35.706318] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-22T19:43:36.123348] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-22T19:43:36.127204] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-22T19:43:36.128703] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-22T19:43:36.129935] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-22T19:43:36.130075] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-22T19:43:36.155409] [DEBUG] [LOCAL ] LOW: Trimmed 76721 records to 52970 (keeping 200 days of data) [2025-10-22T19:43:36.157016] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T19:43:36.505579] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-22T19:43:36.528242] [DEBUG] [LOCAL ] LOW: Primary data saved (52970 records). [2025-10-22T19:43:36.528397] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-22T19:43:36.528481] [INFO ] [MAIN ] Update Progress: 1271/2367 symbols completed. LOW took 37.6s. Estimated remaining: 2h 21m 1s. Rate: 7.8 symbols/min [2025-10-22T19:43:36.702771] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:43:36.742871] [DEBUG] [LOCAL ] LSPD: Loaded 42387 existing records from primary storage. [2025-10-22T19:43:36.743203] [INFO ] [MAIN ] LSPD: Loaded 42387 existing records. [2025-10-22T19:43:36.918714] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-22T19:43:36.922221] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:43:36.922622] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-22T19:43:36.922730] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-22T19:43:36.923876] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-22T19:43:36.923942] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-22T19:43:37.272783] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:43:37.410195] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-22T19:43:37.717697] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-22T19:43:38.444174] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T19:43:38.517735] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-22T19:43:38.702782] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T19:43:39.317719] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-22T19:43:39.657409] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T19:43:40.117678] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-22T19:43:40.727060] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T19:43:40.917706] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-22T19:43:41.629408] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T19:43:41.717716] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-22T19:43:42.462528] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T19:43:42.517614] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-22T19:43:43.255559] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T19:43:43.317669] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-22T19:43:43.859899] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T19:43:44.117726] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-22T19:43:44.849053] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-22T19:43:44.917669] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-22T19:43:45.224980] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T19:43:45.717687] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-22T19:43:46.517673] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-22T19:43:46.625909] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T19:43:46.632898] [INFO ] [REMOTE ] LPX: Full fetch complete (58761 records). [2025-10-22T19:43:46.633035] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-22T19:43:47.015927] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-22T19:43:47.016107] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-22T19:43:47.017068] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-22T19:43:47.017168] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-22T19:43:47.018881] [DEBUG] [LOCAL ] LPX: Trimmed 58761 records to 40055 (keeping 200 days of data) [2025-10-22T19:43:47.147007] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T19:43:47.294844] [DEBUG] [LOCAL ] LPX: Primary data saved (40055 records). [2025-10-22T19:43:47.294953] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-22T19:43:47.295471] [INFO ] [MAIN ] Update Progress: 1272/2367 symbols completed. LPX took 22.1s. Estimated remaining: 2h 20m 56s. Rate: 7.8 symbols/min [2025-10-22T19:43:47.327360] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-22T19:43:47.464889] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:43:47.495436] [DEBUG] [LOCAL ] LTC: Loaded 30677 existing records from primary storage. [2025-10-22T19:43:47.495712] [INFO ] [MAIN ] LTC: Loaded 30677 existing records. [2025-10-22T19:43:47.672317] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:43:47.672498] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-22T19:43:47.672545] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-22T19:43:47.672755] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-22T19:43:47.672815] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-22T19:43:48.018259] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:43:48.114556] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T19:43:48.118252] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-22T19:43:48.180748] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-22T19:43:48.917675] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-22T19:43:49.717630] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-22T19:43:49.815200] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T19:43:50.425830] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T19:43:50.517637] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-22T19:43:51.052634] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T19:43:51.317692] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-22T19:43:51.975358] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T19:43:52.117678] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-22T19:43:52.817944] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T19:43:52.917689] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-22T19:43:52.971610] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-22T19:43:53.717677] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-22T19:43:54.393028] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T19:43:54.517720] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-22T19:43:54.814039] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T19:43:55.317719] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-22T19:43:55.863310] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T19:43:56.117726] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-22T19:43:56.787867] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T19:43:56.917780] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-22T19:43:57.528595] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T19:43:57.717667] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-22T19:43:58.303853] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T19:43:58.517691] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-22T19:43:59.159450] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T19:43:59.317620] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-22T19:43:59.758804] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-22T19:44:00.117668] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-22T19:44:00.917664] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-22T19:44:01.033048] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T19:44:01.040323] [INFO ] [REMOTE ] LSPD: Full fetch complete (62344 records). [2025-10-22T19:44:01.040440] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-22T19:44:01.420516] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-22T19:44:01.420620] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-22T19:44:01.421702] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-22T19:44:01.421778] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-22T19:44:01.423224] [DEBUG] [LOCAL ] LSPD: Trimmed 62344 records to 42329 (keeping 200 days of data) [2025-10-22T19:44:01.669915] [DEBUG] [LOCAL ] LSPD: Primary data saved (42329 records). [2025-10-22T19:44:01.670084] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-22T19:44:01.670186] [INFO ] [MAIN ] Update Progress: 1273/2367 symbols completed. LSPD took 25.1s. Estimated remaining: 2h 20m 54s. Rate: 7.8 symbols/min [2025-10-22T19:44:01.719686] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-22T19:44:01.870928] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T19:44:01.873267] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:01.929579] [DEBUG] [LOCAL ] LTH: Loaded 51653 existing records from primary storage. [2025-10-22T19:44:01.929913] [INFO ] [MAIN ] LTH: Loaded 51653 existing records. [2025-10-22T19:44:02.111141] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:44:02.111436] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-22T19:44:02.111491] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-22T19:44:02.111768] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-22T19:44:02.111916] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-22T19:44:02.237026] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-22T19:44:02.485031] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:02.517611] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-22T19:44:03.037373] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T19:44:03.317720] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-22T19:44:04.117710] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-22T19:44:04.329155] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T19:44:04.815839] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-22T19:44:04.917681] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-22T19:44:05.717733] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-22T19:44:05.861733] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T19:44:05.868680] [INFO ] [REMOTE ] LPL: Full fetch complete (37613 records). [2025-10-22T19:44:05.868782] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-22T19:44:06.256276] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-22T19:44:06.256352] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-22T19:44:06.257039] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-22T19:44:06.257102] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-22T19:44:06.257933] [DEBUG] [LOCAL ] LPL: Trimmed 37613 records to 28986 (keeping 200 days of data) [2025-10-22T19:44:06.416177] [DEBUG] [LOCAL ] LPL: Primary data saved (28986 records). [2025-10-22T19:44:06.416320] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-22T19:44:06.416406] [INFO ] [MAIN ] Update Progress: 1274/2367 symbols completed. LPL took 45.3s. Estimated remaining: 2h 20m 44s. Rate: 7.8 symbols/min [2025-10-22T19:44:06.525980] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-22T19:44:06.600938] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:06.629341] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T19:44:06.656523] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T19:44:06.690714] [DEBUG] [LOCAL ] LTM: Loaded 39164 existing records from primary storage. [2025-10-22T19:44:06.691046] [INFO ] [MAIN ] LTM: Loaded 39164 existing records. [2025-10-22T19:44:06.866670] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:44:06.866877] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-22T19:44:06.866925] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-22T19:44:06.867103] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-22T19:44:06.867143] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-22T19:44:07.214503] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:07.317734] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-22T19:44:08.117715] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-22T19:44:08.141371] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T19:44:08.408965] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-22T19:44:08.917775] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-22T19:44:09.717682] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-22T19:44:09.972621] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T19:44:10.242182] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-22T19:44:10.517774] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-22T19:44:11.054110] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T19:44:11.059887] [INFO ] [REMOTE ] LRN: Full fetch complete (58279 records). [2025-10-22T19:44:11.060003] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-22T19:44:11.322897] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-22T19:44:11.440848] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-22T19:44:11.440924] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-22T19:44:11.441742] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-22T19:44:11.441804] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-22T19:44:11.442970] [DEBUG] [LOCAL ] LRN: Trimmed 58279 records to 39335 (keeping 200 days of data) [2025-10-22T19:44:11.680357] [DEBUG] [LOCAL ] LRN: Primary data saved (39335 records). [2025-10-22T19:44:11.680517] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-22T19:44:11.680598] [INFO ] [MAIN ] Update Progress: 1275/2367 symbols completed. LRN took 45.0s. Estimated remaining: 2h 20m 34s. Rate: 7.8 symbols/min [2025-10-22T19:44:11.853571] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:11.895030] [DEBUG] [LOCAL ] LU: Loaded 49218 existing records from primary storage. [2025-10-22T19:44:11.895329] [INFO ] [MAIN ] LU: Loaded 49218 existing records. [2025-10-22T19:44:12.069325] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:44:12.069716] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-22T19:44:12.069772] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-22T19:44:12.069972] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-22T19:44:12.070032] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-22T19:44:12.124358] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-22T19:44:12.439266] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:12.468127] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T19:44:12.547015] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T19:44:12.917769] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-22T19:44:13.641422] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T19:44:13.646966] [INFO ] [REMOTE ] LTC: Full fetch complete (43903 records). [2025-10-22T19:44:13.647062] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-22T19:44:13.724064] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-22T19:44:14.030148] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-22T19:44:14.030289] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-22T19:44:14.031212] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-22T19:44:14.031339] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-22T19:44:14.032378] [DEBUG] [LOCAL ] LTC: Trimmed 43903 records to 30631 (keeping 200 days of data) [2025-10-22T19:44:14.227269] [DEBUG] [LOCAL ] LTC: Primary data saved (30631 records). [2025-10-22T19:44:14.227482] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-22T19:44:14.227572] [INFO ] [MAIN ] Update Progress: 1276/2367 symbols completed. LTC took 26.9s. Estimated remaining: 2h 20m 22s. Rate: 7.8 symbols/min [2025-10-22T19:44:14.351831] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T19:44:14.428125] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:14.448845] [DEBUG] [LOCAL ] LUCK: Loaded 23955 existing records from primary storage. [2025-10-22T19:44:14.449105] [INFO ] [MAIN ] LUCK: Loaded 23955 existing records. [2025-10-22T19:44:14.523727] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-22T19:44:14.631874] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:44:14.632068] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-22T19:44:14.632122] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-22T19:44:14.632292] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-22T19:44:14.632329] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-22T19:44:14.986287] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:15.317693] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-22T19:44:15.491174] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T19:44:15.879613] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T19:44:16.117674] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-22T19:44:16.917636] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-22T19:44:17.182185] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T19:44:17.717674] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-22T19:44:17.812305] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T19:44:18.517628] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-22T19:44:18.597901] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T19:44:19.317682] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-22T19:44:19.410565] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T19:44:19.847396] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T19:44:20.117707] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-22T19:44:20.866478] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T19:44:20.917711] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-22T19:44:21.366418] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-22T19:44:21.717730] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-22T19:44:22.373379] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T19:44:22.517781] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-22T19:44:23.052617] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T19:44:23.317709] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-22T19:44:23.834611] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T19:44:24.117728] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-22T19:44:24.696420] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T19:44:24.917691] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-22T19:44:25.476450] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T19:44:25.717707] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-22T19:44:26.396546] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T19:44:26.518207] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-22T19:44:26.555589] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-22T19:44:27.317679] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-22T19:44:28.117635] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-22T19:44:28.330095] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T19:44:28.338380] [INFO ] [REMOTE ] LTH: Full fetch complete (74776 records). [2025-10-22T19:44:28.338514] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-22T19:44:28.732974] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-22T19:44:28.733116] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-22T19:44:28.734232] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-22T19:44:28.734377] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-22T19:44:28.735942] [DEBUG] [LOCAL ] LTH: Trimmed 74776 records to 51635 (keeping 200 days of data) [2025-10-22T19:44:28.919274] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-22T19:44:28.981461] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T19:44:29.089017] [DEBUG] [LOCAL ] LTH: Primary data saved (51635 records). [2025-10-22T19:44:29.089162] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-22T19:44:29.089243] [INFO ] [MAIN ] Update Progress: 1277/2367 symbols completed. LTH took 27.4s. Estimated remaining: 2h 20m 20s. Rate: 7.8 symbols/min [2025-10-22T19:44:29.535934] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T19:44:29.717696] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-22T19:44:30.144288] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T19:44:30.517723] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-22T19:44:31.317768] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-22T19:44:31.371720] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-22T19:44:32.117740] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-22T19:44:32.270670] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T19:44:32.561421] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T19:44:32.917687] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-22T19:44:33.540245] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T19:44:33.717679] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-22T19:44:33.855113] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T19:44:34.517790] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-22T19:44:35.317709] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-22T19:44:35.359416] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T19:44:35.417097] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-22T19:44:36.117847] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-22T19:44:36.917681] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-22T19:44:37.123444] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T19:44:37.131919] [INFO ] [REMOTE ] LTM: Full fetch complete (51331 records). [2025-10-22T19:44:37.132042] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-22T19:44:37.543886] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-22T19:44:37.544128] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-22T19:44:37.545009] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-22T19:44:37.545092] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-22T19:44:37.603036] [DEBUG] [LOCAL ] LTM: Trimmed 51331 records to 39222 (keeping 200 days of data) [2025-10-22T19:44:37.604197] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T19:44:37.717779] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-22T19:44:37.842523] [DEBUG] [LOCAL ] LTM: Primary data saved (39222 records). [2025-10-22T19:44:37.842692] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-22T19:44:37.842789] [INFO ] [MAIN ] Update Progress: 1278/2367 symbols completed. LTM took 31.4s. Estimated remaining: 2h 20m 13s. Rate: 7.8 symbols/min [2025-10-22T19:44:38.176557] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T19:44:38.180218] [INFO ] [REMOTE ] LUCK: Full fetch complete (39381 records). [2025-10-22T19:44:38.180317] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-22T19:44:38.547571] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-22T19:44:38.547686] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-22T19:44:38.548481] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-22T19:44:38.548541] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-22T19:44:38.549489] [DEBUG] [LOCAL ] LUCK: Trimmed 39381 records to 23877 (keeping 200 days of data) [2025-10-22T19:44:38.689087] [DEBUG] [LOCAL ] LUCK: Primary data saved (23877 records). [2025-10-22T19:44:38.689224] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-22T19:44:38.689304] [INFO ] [MAIN ] Update Progress: 1279/2367 symbols completed. LUCK took 24.5s. Estimated remaining: 2h 19m 60s. Rate: 7.8 symbols/min [2025-10-22T19:44:39.389862] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T19:44:39.399724] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-22T19:44:41.034470] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T19:44:41.045059] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-22T19:44:42.942084] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T19:44:42.950589] [INFO ] [REMOTE ] LU: Full fetch complete (70982 records). [2025-10-22T19:44:42.950810] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-22T19:44:43.336091] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-22T19:44:43.336188] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-22T19:44:43.337143] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-22T19:44:43.337204] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-22T19:44:43.338620] [DEBUG] [LOCAL ] LU: Trimmed 70982 records to 49220 (keeping 200 days of data) [2025-10-22T19:44:43.606301] [DEBUG] [LOCAL ] LU: Primary data saved (49220 records). [2025-10-22T19:44:43.606450] [INFO ] [MAIN ] LU: Full history saved. [2025-10-22T19:44:43.606535] [INFO ] [MAIN ] Update Progress: 1280/2367 symbols completed. LU took 31.9s. Estimated remaining: 2h 19m 49s. Rate: 7.8 symbols/min [2025-10-22T19:44:44.316745] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:44.366498] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:44.388405] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:44.384798] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:44.388569] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-22T19:44:44.389835] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-22T19:44:44.390341] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-22T19:44:44.390506] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-22T19:44:44.390698] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-22T19:44:44.390752] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-22T19:44:44.791731] [DEBUG] [LOCAL ] LUMN: Loaded 53645 existing records from primary storage. [2025-10-22T19:44:44.794325] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-22T19:44:44.800683] [INFO ] [MAIN ] LUMN: Loaded 53645 existing records. [2025-10-22T19:44:44.793392] [DEBUG] [LOCAL ] LVS: Loaded 53570 existing records from primary storage. [2025-10-22T19:44:44.833853] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-10-22T19:44:44.833619] [INFO ] [MAIN ] LVS: Loaded 53570 existing records. [2025-10-22T19:44:45.038075] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:45.094971] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-10-22T19:44:45.442763] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:44:45.446546] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:44:45.492448] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-22T19:44:45.492047] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-10-22T19:44:45.496405] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-22T19:44:45.500020] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:44:45.491818] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:44:45.499874] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:44:45.500663] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-22T19:44:45.500486] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-22T19:44:45.501099] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-22T19:44:45.500926] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-22T19:44:45.500859] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-22T19:44:45.500792] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-22T19:44:45.501607] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:44:45.501502] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-22T19:44:45.507103] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-22T19:44:45.526857] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-22T19:44:45.544030] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-22T19:44:45.554728] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-22T19:44:45.544130] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-22T19:44:45.567509] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-22T19:44:45.549415] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-22T19:44:45.581765] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-22T19:44:45.644950] [INFO ] [MAIN ] Update Progress: 1281/2367 symbols completed. LUXE took 2.0s. Estimated remaining: 2h 19m 37s. Rate: 7.8 symbols/min [2025-10-22T19:44:46.472874] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:44:46.764699] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:46.879846] [DEBUG] [LOCAL ] LVWR: Loaded 18596 existing records from primary storage. [2025-10-22T19:44:46.852606] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-22T19:44:46.890608] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:46.886986] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:46.883052] [INFO ] [MAIN ] LVWR: Loaded 18596 existing records. [2025-10-22T19:44:46.891205] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-22T19:44:46.903012] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-22T19:44:47.080684] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:44:47.080930] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-22T19:44:47.080997] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-22T19:44:47.081178] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-22T19:44:47.081237] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-22T19:44:47.451107] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:44:47.451492] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-22T19:44:48.182438] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T19:44:48.184212] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-22T19:44:48.522943] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T19:44:48.533971] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-22T19:44:48.571016] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-22T19:44:48.573041] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-22T19:44:48.613546] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T19:44:48.625834] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-22T19:44:48.859398] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-22T19:44:48.870037] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-22T19:44:48.971502] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-22T19:44:48.973176] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-22T19:44:49.562077] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-22T19:44:49.564625] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-22T19:44:50.333278] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T19:44:50.343601] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-22T19:44:50.514839] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T19:44:50.525384] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-22T19:44:50.655951] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T19:44:50.720478] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-22T19:44:51.317731] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-22T19:44:52.104906] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T19:44:52.117600] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-22T19:44:52.392674] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T19:44:52.917715] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-22T19:44:52.977549] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T19:44:53.680713] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T19:44:53.717618] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-22T19:44:54.517727] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-22T19:44:54.905029] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T19:44:55.241554] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-22T19:44:55.317615] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-22T19:44:55.503093] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T19:44:56.117685] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-22T19:44:56.917718] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-22T19:44:57.195544] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T19:44:57.717688] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-22T19:44:57.743963] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T19:44:57.888455] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T19:44:58.517728] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-22T19:44:59.317770] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-22T19:44:59.821048] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-22T19:45:00.122950] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T19:45:00.122829] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-22T19:45:00.328751] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T19:45:00.917705] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-22T19:45:01.717720] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-22T19:45:02.293211] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-22T19:45:02.517635] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-22T19:45:02.935532] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-22T19:45:03.317734] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-22T19:45:03.827860] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-22T19:45:04.117777] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-22T19:45:04.213130] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T19:45:04.929848] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-22T19:45:04.936044] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T19:45:05.717713] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-22T19:45:05.993498] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T19:45:05.996026] [INFO ] [REMOTE ] LVWR: Full fetch complete (20797 records). [2025-10-22T19:45:05.996103] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-22T19:45:06.335461] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-22T19:45:06.420119] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-22T19:45:06.420207] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-22T19:45:06.420725] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-22T19:45:06.420790] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-22T19:45:06.421497] [DEBUG] [LOCAL ] LVWR: Trimmed 20797 records to 18636 (keeping 200 days of data) [2025-10-22T19:45:06.517996] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-22T19:45:06.536204] [DEBUG] [LOCAL ] LVWR: Primary data saved (18636 records). [2025-10-22T19:45:06.536396] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-22T19:45:06.536494] [INFO ] [MAIN ] Update Progress: 1282/2367 symbols completed. LVWR took 20.8s. Estimated remaining: 2h 19m 40s. Rate: 7.8 symbols/min [2025-10-22T19:45:06.721296] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:45:06.768230] [DEBUG] [LOCAL ] LW: Loaded 51180 existing records from primary storage. [2025-10-22T19:45:06.768530] [INFO ] [MAIN ] LW: Loaded 51180 existing records. [2025-10-22T19:45:06.950811] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:45:06.951027] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-22T19:45:06.951074] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-22T19:45:06.951325] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-22T19:45:06.951382] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-22T19:45:07.308459] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:45:07.317614] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-22T19:45:07.697679] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T19:45:08.117708] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-22T19:45:08.620154] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-22T19:45:08.917694] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-22T19:45:09.082348] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T19:45:09.717692] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-22T19:45:09.931133] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T19:45:10.517727] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-22T19:45:10.797248] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T19:45:11.317686] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-22T19:45:11.426546] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T19:45:12.117702] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-22T19:45:12.547344] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-22T19:45:12.917682] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-22T19:45:13.434883] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T19:45:13.443767] [INFO ] [REMOTE ] LVS: Full fetch complete (77724 records). [2025-10-22T19:45:13.443888] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-22T19:45:13.721553] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-22T19:45:13.848895] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-22T19:45:13.849049] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-22T19:45:13.850344] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-22T19:45:13.850535] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-22T19:45:13.852299] [DEBUG] [LOCAL ] LVS: Trimmed 77724 records to 53569 (keeping 200 days of data) [2025-10-22T19:45:13.995423] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T19:45:14.220977] [DEBUG] [LOCAL ] LVS: Primary data saved (53569 records). [2025-10-22T19:45:14.221124] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-22T19:45:14.221239] [INFO ] [MAIN ] Update Progress: 1283/2367 symbols completed. LVS took 30.6s. Estimated remaining: 2h 19m 33s. Rate: 7.8 symbols/min [2025-10-22T19:45:14.393077] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:45:14.409761] [DEBUG] [LOCAL ] LXFR: Loaded 16437 existing records from primary storage. [2025-10-22T19:45:14.409991] [INFO ] [MAIN ] LXFR: Loaded 16437 existing records. [2025-10-22T19:45:14.522707] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-22T19:45:14.585097] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:45:14.585274] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-22T19:45:14.585321] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-22T19:45:14.585494] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-22T19:45:14.585548] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-22T19:45:14.936944] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:45:15.286270] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-22T19:45:15.295107] [INFO ] [REMOTE ] LUMN: Full fetch complete (77778 records). [2025-10-22T19:45:15.295235] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-22T19:45:15.328284] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-22T19:45:15.695331] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-22T19:45:15.695436] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-22T19:45:15.696470] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-22T19:45:15.696553] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-22T19:45:15.698166] [DEBUG] [LOCAL ] LUMN: Trimmed 77778 records to 53645 (keeping 200 days of data) [2025-10-22T19:45:15.967526] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-22T19:45:16.061195] [DEBUG] [LOCAL ] LUMN: Primary data saved (53645 records). [2025-10-22T19:45:16.061334] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-22T19:45:16.061415] [INFO ] [MAIN ] Update Progress: 1284/2367 symbols completed. LUMN took 32.5s. Estimated remaining: 2h 19m 20s. Rate: 7.8 symbols/min [2025-10-22T19:45:16.124594] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-22T19:45:16.235503] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:45:16.280249] [DEBUG] [LOCAL ] LXP: Loaded 50786 existing records from primary storage. [2025-10-22T19:45:16.280535] [INFO ] [MAIN ] LXP: Loaded 50786 existing records. [2025-10-22T19:45:16.458000] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:45:16.458484] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-22T19:45:16.458600] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-22T19:45:16.458929] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-22T19:45:16.459067] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-22T19:45:16.572681] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T19:45:16.844624] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-22T19:45:16.873706] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:45:16.917605] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-22T19:45:17.717670] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-22T19:45:18.284616] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-22T19:45:18.293872] [INFO ] [REMOTE ] LUV: Full fetch complete (77865 records). [2025-10-22T19:45:18.294004] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-22T19:45:18.526677] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-22T19:45:18.707961] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-22T19:45:18.708150] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-22T19:45:18.709286] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-22T19:45:18.709448] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-22T19:45:18.711206] [DEBUG] [LOCAL ] LUV: Trimmed 77865 records to 53689 (keeping 200 days of data) [2025-10-22T19:45:18.834996] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-22T19:45:19.116756] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T19:45:19.139631] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-10-22T19:45:19.140446] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-22T19:45:19.140541] [INFO ] [MAIN ] Update Progress: 1285/2367 symbols completed. LUV took 35.5s. Estimated remaining: 2h 19m 8s. Rate: 7.8 symbols/min [2025-10-22T19:45:19.331592] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-22T19:45:19.335038] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:45:19.368191] [DEBUG] [LOCAL ] LXU: Loaded 31582 existing records from primary storage. [2025-10-22T19:45:19.368465] [INFO ] [MAIN ] LXU: Loaded 31582 existing records. [2025-10-22T19:45:19.566686] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:45:19.566899] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-22T19:45:19.566946] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-22T19:45:19.567208] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-22T19:45:19.567246] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-22T19:45:19.698154] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T19:45:19.972971] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:45:20.117674] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-22T19:45:20.917697] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-22T19:45:20.982623] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T19:45:21.123813] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-22T19:45:21.717690] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-22T19:45:22.421417] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T19:45:22.517631] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-22T19:45:23.317687] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-22T19:45:23.368016] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T19:45:24.122457] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-22T19:45:24.144525] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T19:45:24.835280] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T19:45:24.917628] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-22T19:45:25.185397] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T19:45:25.717722] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-22T19:45:26.517640] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-22T19:45:26.637581] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T19:45:26.886756] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T19:45:27.317685] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-22T19:45:27.944961] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T19:45:28.117686] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-22T19:45:28.646221] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T19:45:28.917693] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-22T19:45:29.224063] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T19:45:29.717728] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-22T19:45:30.242845] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-22T19:45:30.517678] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-22T19:45:30.653784] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T19:45:31.317728] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-22T19:45:31.797185] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-22T19:45:32.117687] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-22T19:45:32.917765] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-22T19:45:33.007360] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T19:45:33.235500] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T19:45:33.717634] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-22T19:45:34.191148] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T19:45:34.517625] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-22T19:45:34.682727] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T19:45:35.317673] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-22T19:45:35.978093] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T19:45:36.117671] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-22T19:45:36.917725] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-22T19:45:37.010512] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T19:45:37.339252] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-22T19:45:37.717682] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-22T19:45:38.517674] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-22T19:45:38.616175] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T19:45:38.626241] [INFO ] [REMOTE ] LW: Full fetch complete (74787 records). [2025-10-22T19:45:38.626487] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-22T19:45:39.014631] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-22T19:45:39.014753] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-22T19:45:39.015780] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-22T19:45:39.015848] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-22T19:45:39.017310] [DEBUG] [LOCAL ] LW: Trimmed 74787 records to 51164 (keeping 200 days of data) [2025-10-22T19:45:39.318628] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-22T19:45:39.318508] [DEBUG] [LOCAL ] LW: Primary data saved (51164 records). [2025-10-22T19:45:39.320502] [INFO ] [MAIN ] LW: Full history saved. [2025-10-22T19:45:39.321359] [INFO ] [MAIN ] Update Progress: 1286/2367 symbols completed. LW took 32.8s. Estimated remaining: 2h 19m 11s. Rate: 7.8 symbols/min [2025-10-22T19:45:39.493697] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:45:39.530695] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-22T19:45:39.541968] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T19:45:39.593231] [DEBUG] [LOCAL ] LYB: Loaded 53621 existing records from primary storage. [2025-10-22T19:45:39.593583] [INFO ] [MAIN ] LYB: Loaded 53621 existing records. [2025-10-22T19:45:39.765800] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:45:39.766069] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-22T19:45:39.766129] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-22T19:45:39.766320] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-22T19:45:39.766410] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-22T19:45:40.121024] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-22T19:45:40.164131] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:45:40.181491] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T19:45:40.917784] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-22T19:45:41.717769] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-22T19:45:41.887713] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T19:45:42.517771] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-22T19:45:42.698932] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T19:45:42.727857] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T19:45:42.731091] [INFO ] [REMOTE ] LXFR: Full fetch complete (24664 records). [2025-10-22T19:45:42.731326] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-22T19:45:43.101075] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-22T19:45:43.101153] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-22T19:45:43.101604] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-22T19:45:43.101671] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-22T19:45:43.102440] [DEBUG] [LOCAL ] LXFR: Trimmed 24664 records to 16413 (keeping 200 days of data) [2025-10-22T19:45:43.200800] [DEBUG] [LOCAL ] LXFR: Primary data saved (16413 records). [2025-10-22T19:45:43.200930] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-22T19:45:43.201011] [INFO ] [MAIN ] Update Progress: 1287/2367 symbols completed. LXFR took 29.0s. Estimated remaining: 2h 19m 0s. Rate: 7.8 symbols/min [2025-10-22T19:45:43.322836] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-22T19:45:43.376757] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:45:43.423455] [DEBUG] [LOCAL ] LYG: Loaded 52661 existing records from primary storage. [2025-10-22T19:45:43.423816] [INFO ] [MAIN ] LYG: Loaded 52661 existing records. [2025-10-22T19:45:43.599234] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:45:43.599413] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-22T19:45:43.599470] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-22T19:45:43.599662] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-22T19:45:43.599720] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-22T19:45:43.967309] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:45:44.117721] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-22T19:45:44.277610] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T19:45:44.658107] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T19:45:44.663223] [INFO ] [REMOTE ] LXU: Full fetch complete (45284 records). [2025-10-22T19:45:44.663368] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-22T19:45:44.924074] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-22T19:45:45.057211] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-22T19:45:45.057299] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-22T19:45:45.058225] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-22T19:45:45.058293] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-22T19:45:45.059449] [DEBUG] [LOCAL ] LXU: Trimmed 45284 records to 31461 (keeping 200 days of data) [2025-10-22T19:45:45.246034] [DEBUG] [LOCAL ] LXU: Primary data saved (31461 records). [2025-10-22T19:45:45.246182] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-22T19:45:45.246267] [INFO ] [MAIN ] Update Progress: 1288/2367 symbols completed. LXU took 26.1s. Estimated remaining: 2h 18m 48s. Rate: 7.8 symbols/min [2025-10-22T19:45:45.425562] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:45:45.475086] [DEBUG] [LOCAL ] LYV: Loaded 51013 existing records from primary storage. [2025-10-22T19:45:45.475417] [INFO ] [MAIN ] LYV: Loaded 51013 existing records. [2025-10-22T19:45:45.658703] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:45:45.659066] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-22T19:45:45.659320] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-22T19:45:45.659604] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-22T19:45:45.659689] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-22T19:45:45.723209] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-22T19:45:46.068138] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:45:46.071016] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T19:45:46.517789] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-22T19:45:46.566479] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T19:45:47.118154] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T19:45:47.317805] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-22T19:45:48.117698] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-22T19:45:48.247504] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T19:45:48.917688] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-22T19:45:49.200035] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T19:45:49.717682] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-22T19:45:49.794037] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T19:45:50.517708] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-22T19:45:50.749815] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T19:45:51.317629] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-22T19:45:51.583608] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T19:45:52.120764] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-22T19:45:52.123859] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T19:45:52.814528] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T19:45:52.917704] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-22T19:45:53.717759] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-22T19:45:53.958331] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T19:45:54.517694] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-22T19:45:54.674635] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T19:45:55.317636] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-22T19:45:55.523885] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T19:45:55.532300] [INFO ] [REMOTE ] LXP: Full fetch complete (72854 records). [2025-10-22T19:45:55.532441] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-22T19:45:55.916237] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-22T19:45:55.916348] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-22T19:45:55.917320] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-22T19:45:55.917384] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-22T19:45:55.918833] [DEBUG] [LOCAL ] LXP: Trimmed 72854 records to 50756 (keeping 200 days of data) [2025-10-22T19:45:56.119396] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-22T19:45:56.217500] [DEBUG] [LOCAL ] LXP: Primary data saved (50756 records). [2025-10-22T19:45:56.217637] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-22T19:45:56.217784] [INFO ] [MAIN ] Update Progress: 1289/2367 symbols completed. LXP took 40.2s. Estimated remaining: 2h 18m 43s. Rate: 7.8 symbols/min [2025-10-22T19:45:56.388147] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:45:56.420174] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T19:45:56.459112] [DEBUG] [LOCAL ] LZB: Loaded 35070 existing records from primary storage. [2025-10-22T19:45:56.459396] [INFO ] [MAIN ] LZB: Loaded 35070 existing records. [2025-10-22T19:45:56.632198] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:45:56.632393] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-22T19:45:56.632440] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-22T19:45:56.632671] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-22T19:45:56.632729] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-22T19:45:56.918191] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-22T19:45:56.990063] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:45:57.028120] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T19:45:57.717629] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-22T19:45:57.883291] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T19:45:58.517689] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-22T19:45:58.707326] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T19:45:59.073890] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-22T19:45:59.317673] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-22T19:46:00.117675] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-22T19:46:00.415253] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T19:46:00.750705] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T19:46:00.917616] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-22T19:46:01.717673] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-22T19:46:02.035838] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-22T19:46:02.517725] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-22T19:46:02.867290] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-22T19:46:03.203836] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T19:46:03.317631] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-22T19:46:04.117675] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-22T19:46:04.308549] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T19:46:04.917672] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-22T19:46:05.058611] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T19:46:05.717689] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-22T19:46:06.157681] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T19:46:06.393637] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T19:46:06.517612] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-22T19:46:07.229785] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T19:46:07.317615] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-22T19:46:07.856667] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-22T19:46:08.117688] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-22T19:46:08.917690] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-22T19:46:09.199272] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T19:46:09.208062] [INFO ] [REMOTE ] LYG: Full fetch complete (76225 records). [2025-10-22T19:46:09.208209] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-22T19:46:09.594753] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-22T19:46:09.594832] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-22T19:46:09.595925] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-22T19:46:09.595989] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-22T19:46:09.597487] [DEBUG] [LOCAL ] LYG: Trimmed 76225 records to 52652 (keeping 200 days of data) [2025-10-22T19:46:09.762124] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-22T19:46:09.903885] [DEBUG] [LOCAL ] LYG: Primary data saved (52652 records). [2025-10-22T19:46:09.904062] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-22T19:46:09.904147] [INFO ] [MAIN ] Update Progress: 1290/2367 symbols completed. LYG took 26.7s. Estimated remaining: 2h 18m 40s. Rate: 7.8 symbols/min [2025-10-22T19:46:10.085862] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:46:10.101725] [DEBUG] [LOCAL ] LZM: Loaded 14736 existing records from primary storage. [2025-10-22T19:46:10.101947] [INFO ] [MAIN ] LZM: Loaded 14736 existing records. [2025-10-22T19:46:10.291903] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:46:10.292487] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-22T19:46:10.292633] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-22T19:46:10.293303] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-22T19:46:10.313371] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-22T19:46:10.374463] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-22T19:46:10.454638] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-22T19:46:10.454858] [INFO ] [REMOTE ] LYB: Full fetch complete (77635 records). [2025-10-22T19:46:10.465789] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-22T19:46:10.527677] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-22T19:46:10.946549] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:46:11.169408] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-22T19:46:11.169673] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-22T19:46:11.170983] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-22T19:46:11.171106] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-22T19:46:11.195629] [DEBUG] [LOCAL ] LYB: Trimmed 77635 records to 53621 (keeping 200 days of data) [2025-10-22T19:46:11.196694] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T19:46:11.317638] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-22T19:46:11.550223] [DEBUG] [LOCAL ] LYB: Primary data saved (53621 records). [2025-10-22T19:46:11.550364] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-22T19:46:11.551190] [INFO ] [MAIN ] Update Progress: 1291/2367 symbols completed. LYB took 32.2s. Estimated remaining: 2h 18m 27s. Rate: 7.8 symbols/min [2025-10-22T19:46:11.740402] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:46:11.795968] [DEBUG] [LOCAL ] M: Loaded 53544 existing records from primary storage. [2025-10-22T19:46:11.796378] [INFO ] [MAIN ] M: Loaded 53544 existing records. [2025-10-22T19:46:11.998367] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:46:11.998745] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-22T19:46:11.998899] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-22T19:46:11.999100] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-22T19:46:11.999141] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-22T19:46:12.122099] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T19:46:12.121122] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-22T19:46:12.408968] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:46:12.472352] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T19:46:12.917667] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-22T19:46:13.244185] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T19:46:13.644224] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T19:46:13.717618] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-22T19:46:14.517721] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-22T19:46:14.652163] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-22T19:46:15.317734] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-22T19:46:16.117719] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-22T19:46:16.401148] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T19:46:16.457025] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T19:46:16.917727] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-22T19:46:17.639242] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T19:46:17.717683] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-22T19:46:17.754251] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-22T19:46:18.517709] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-22T19:46:19.082357] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T19:46:19.317763] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-22T19:46:20.117688] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-22T19:46:20.332142] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T19:46:20.917627] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-22T19:46:21.000268] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T19:46:21.569536] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T19:46:21.575541] [INFO ] [REMOTE ] LZB: Full fetch complete (51116 records). [2025-10-22T19:46:21.575767] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-22T19:46:21.725613] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-22T19:46:21.967182] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-22T19:46:21.967278] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-22T19:46:21.968175] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-22T19:46:21.968241] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-22T19:46:21.969328] [DEBUG] [LOCAL ] LZB: Trimmed 51116 records to 35036 (keeping 200 days of data) [2025-10-22T19:46:22.178115] [DEBUG] [LOCAL ] LZB: Primary data saved (35036 records). [2025-10-22T19:46:22.178256] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-22T19:46:22.178335] [INFO ] [MAIN ] Update Progress: 1292/2367 symbols completed. LZB took 26.0s. Estimated remaining: 2h 18m 22s. Rate: 7.8 symbols/min [2025-10-22T19:46:22.343874] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:46:22.391085] [DEBUG] [LOCAL ] MA: Loaded 52465 existing records from primary storage. [2025-10-22T19:46:22.391396] [INFO ] [MAIN ] MA: Loaded 52465 existing records. [2025-10-22T19:46:22.522155] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-22T19:46:22.590506] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:46:22.590800] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-22T19:46:22.590947] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-22T19:46:22.591245] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-22T19:46:22.591369] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-22T19:46:22.941138] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-22T19:46:23.015788] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:46:23.317674] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-22T19:46:23.364548] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T19:46:23.672063] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-22T19:46:24.117682] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-22T19:46:24.917698] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-22T19:46:25.383374] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-22T19:46:25.717627] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-22T19:46:25.726130] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T19:46:26.007843] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T19:46:26.517697] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-22T19:46:27.290101] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T19:46:27.317926] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-22T19:46:27.320209] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-22T19:46:28.117700] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-22T19:46:28.917630] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-22T19:46:29.252433] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-22T19:46:29.484048] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T19:46:29.717683] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-22T19:46:30.517704] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-22T19:46:30.829362] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-22T19:46:30.837921] [INFO ] [REMOTE ] LYV: Full fetch complete (74152 records). [2025-10-22T19:46:30.838067] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-22T19:46:31.223337] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-22T19:46:31.223428] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-22T19:46:31.224398] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-22T19:46:31.224466] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-22T19:46:31.225942] [DEBUG] [LOCAL ] LYV: Trimmed 74152 records to 51001 (keeping 200 days of data) [2025-10-22T19:46:31.320115] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-22T19:46:31.540845] [DEBUG] [LOCAL ] LYV: Primary data saved (51001 records). [2025-10-22T19:46:31.540992] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-22T19:46:31.541073] [INFO ] [MAIN ] Update Progress: 1293/2367 symbols completed. LYV took 46.3s. Estimated remaining: 2h 18m 15s. Rate: 7.8 symbols/min [2025-10-22T19:46:31.715498] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:46:31.760184] [DEBUG] [LOCAL ] MAA: Loaded 42974 existing records from primary storage. [2025-10-22T19:46:31.760602] [INFO ] [MAIN ] MAA: Loaded 42974 existing records. [2025-10-22T19:46:31.977613] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:46:31.991097] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-22T19:46:31.991198] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-22T19:46:31.994435] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-22T19:46:31.994769] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-22T19:46:31.996163] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-22T19:46:32.144757] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-22T19:46:32.442617] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:46:32.455508] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T19:46:32.502740] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-22T19:46:32.917684] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-22T19:46:33.717672] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-22T19:46:34.070949] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T19:46:34.075090] [INFO ] [REMOTE ] LZM: Full fetch complete (19900 records). [2025-10-22T19:46:34.075173] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-22T19:46:34.451761] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-22T19:46:34.451953] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-22T19:46:34.452476] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-22T19:46:34.452577] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-22T19:46:34.453433] [DEBUG] [LOCAL ] LZM: Trimmed 19900 records to 14818 (keeping 200 days of data) [2025-10-22T19:46:34.521145] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-22T19:46:34.552057] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-22T19:46:34.577590] [DEBUG] [LOCAL ] LZM: Primary data saved (14818 records). [2025-10-22T19:46:34.577726] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-22T19:46:34.577851] [INFO ] [MAIN ] Update Progress: 1294/2367 symbols completed. LZM took 24.7s. Estimated remaining: 2h 18m 4s. Rate: 7.8 symbols/min [2025-10-22T19:46:34.743532] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:46:34.787161] [DEBUG] [LOCAL ] MAC: Loaded 49653 existing records from primary storage. [2025-10-22T19:46:34.787513] [INFO ] [MAIN ] MAC: Loaded 49653 existing records. [2025-10-22T19:46:34.974379] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:46:34.974620] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-22T19:46:34.974701] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-22T19:46:34.975149] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-22T19:46:34.975204] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-22T19:46:35.322718] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-22T19:46:35.326466] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:46:36.117707] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-22T19:46:36.174002] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-22T19:46:36.340452] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T19:46:36.917680] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-22T19:46:37.471579] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T19:46:37.562094] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T19:46:37.717684] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-22T19:46:38.183019] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-22T19:46:38.517695] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-22T19:46:39.317629] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-22T19:46:39.601604] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T19:46:40.117670] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-22T19:46:40.172217] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T19:46:40.887385] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T19:46:40.917636] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-22T19:46:41.717731] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-22T19:46:42.191962] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T19:46:42.200847] [INFO ] [REMOTE ] M: Full fetch complete (77658 records). [2025-10-22T19:46:42.201007] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-22T19:46:42.520131] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-22T19:46:42.600131] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-22T19:46:42.600327] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-22T19:46:42.601357] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-22T19:46:42.601432] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-22T19:46:42.603315] [DEBUG] [LOCAL ] M: Trimmed 77658 records to 53544 (keeping 200 days of data) [2025-10-22T19:46:42.864877] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T19:46:42.985765] [DEBUG] [LOCAL ] M: Primary data saved (53544 records). [2025-10-22T19:46:42.986064] [INFO ] [MAIN ] M: Full history saved. [2025-10-22T19:46:42.986995] [INFO ] [MAIN ] Update Progress: 1295/2367 symbols completed. M took 31.4s. Estimated remaining: 2h 17m 57s. Rate: 7.8 symbols/min [2025-10-22T19:46:43.167183] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:46:43.197426] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T19:46:43.240473] [DEBUG] [LOCAL ] MAGN: Loaded 36252 existing records from primary storage. [2025-10-22T19:46:43.240791] [INFO ] [MAIN ] MAGN: Loaded 36252 existing records. [2025-10-22T19:46:43.322785] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-22T19:46:43.437581] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:46:43.437919] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-22T19:46:43.437993] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-22T19:46:43.438675] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-22T19:46:43.438742] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-22T19:46:43.828104] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:46:44.117626] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-22T19:46:44.584319] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-22T19:46:44.668939] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-22T19:46:44.917693] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-22T19:46:45.717721] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-22T19:46:45.794719] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T19:46:46.338825] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T19:46:46.517715] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-22T19:46:47.105320] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T19:46:47.317684] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-22T19:46:48.117727] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-22T19:46:48.251442] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T19:46:48.398815] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T19:46:48.917719] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-22T19:46:49.717715] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-22T19:46:50.289207] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-22T19:46:50.525048] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-22T19:46:50.549568] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T19:46:51.056309] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T19:46:51.317685] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-22T19:46:52.117671] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-22T19:46:52.523022] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-22T19:46:52.922795] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-22T19:46:52.939272] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T19:46:53.717668] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-22T19:46:53.867405] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T19:46:54.430737] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T19:46:54.517662] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-22T19:46:55.317729] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-22T19:46:55.491739] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T19:46:56.123458] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-22T19:46:56.138395] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T19:46:56.551170] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T19:46:56.917731] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-22T19:46:57.717731] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-22T19:46:58.508344] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-22T19:46:58.516973] [INFO ] [REMOTE ] MA: Full fetch complete (76405 records). [2025-10-22T19:46:58.517110] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-22T19:46:58.548808] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-22T19:46:58.949844] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-22T19:46:58.950214] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-22T19:46:58.951365] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-22T19:46:58.951959] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-22T19:46:58.953669] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T19:46:58.965882] [DEBUG] [LOCAL ] MA: Trimmed 76405 records to 52451 (keeping 200 days of data) [2025-10-22T19:46:59.312484] [DEBUG] [LOCAL ] MA: Primary data saved (52451 records). [2025-10-22T19:46:59.312632] [INFO ] [MAIN ] MA: Full history saved. [2025-10-22T19:46:59.312750] [INFO ] [MAIN ] Update Progress: 1296/2367 symbols completed. MA took 37.1s. Estimated remaining: 2h 17m 56s. Rate: 7.8 symbols/min [2025-10-22T19:46:59.343779] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-22T19:46:59.523754] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:46:59.526101] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T19:46:59.575016] [DEBUG] [LOCAL ] MAIN: Loaded 41978 existing records from primary storage. [2025-10-22T19:46:59.575296] [INFO ] [MAIN ] MAIN: Loaded 41978 existing records. [2025-10-22T19:46:59.760841] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:46:59.761320] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-22T19:46:59.761390] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-22T19:46:59.761793] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-22T19:46:59.761895] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-22T19:46:59.942840] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T19:47:00.131725] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-22T19:47:00.177540] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:47:00.917723] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-22T19:47:01.354668] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-22T19:47:01.362784] [INFO ] [REMOTE ] MAC: Full fetch complete (71565 records). [2025-10-22T19:47:01.362926] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-22T19:47:01.728422] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-22T19:47:01.805347] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-22T19:47:01.805715] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-22T19:47:01.808174] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-22T19:47:01.806980] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T19:47:01.808358] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-22T19:47:01.818996] [DEBUG] [LOCAL ] MAC: Trimmed 71565 records to 49610 (keeping 200 days of data) [2025-10-22T19:47:02.123745] [DEBUG] [LOCAL ] MAC: Primary data saved (49610 records). [2025-10-22T19:47:02.123884] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-22T19:47:02.123960] [INFO ] [MAIN ] Update Progress: 1297/2367 symbols completed. MAC took 27.5s. Estimated remaining: 2h 17m 44s. Rate: 7.8 symbols/min [2025-10-22T19:47:02.295604] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:47:02.335045] [DEBUG] [LOCAL ] MAN: Loaded 44311 existing records from primary storage. [2025-10-22T19:47:02.335334] [INFO ] [MAIN ] MAN: Loaded 44311 existing records. [2025-10-22T19:47:02.516138] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:47:02.516564] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-22T19:47:02.516632] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-22T19:47:02.517005] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-22T19:47:02.517115] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-22T19:47:02.528346] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-22T19:47:02.607734] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T19:47:02.649104] [INFO ] [REMOTE ] MAA: Full fetch complete (61877 records). [2025-10-22T19:47:02.655039] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-22T19:47:03.192957] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:47:03.316899] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-22T19:47:03.317058] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-22T19:47:03.318126] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-22T19:47:03.318268] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-22T19:47:03.318194] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-22T19:47:03.320246] [DEBUG] [LOCAL ] MAA: Trimmed 61877 records to 43002 (keeping 200 days of data) [2025-10-22T19:47:03.573509] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T19:47:03.624322] [DEBUG] [LOCAL ] MAA: Primary data saved (43002 records). [2025-10-22T19:47:03.624452] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-22T19:47:03.624533] [INFO ] [MAIN ] Update Progress: 1298/2367 symbols completed. MAA took 32.1s. Estimated remaining: 2h 17m 31s. Rate: 7.8 symbols/min [2025-10-22T19:47:03.792008] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:47:03.819416] [DEBUG] [LOCAL ] MANU: Loaded 27249 existing records from primary storage. [2025-10-22T19:47:03.819692] [INFO ] [MAIN ] MANU: Loaded 27249 existing records. [2025-10-22T19:47:03.995533] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:47:03.995752] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-22T19:47:03.995803] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-22T19:47:03.996002] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-22T19:47:03.996057] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-22T19:47:04.144399] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-22T19:47:04.307378] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T19:47:04.397722] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:47:04.917728] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-22T19:47:04.948488] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T19:47:05.717672] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-22T19:47:05.865517] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T19:47:06.318437] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-22T19:47:06.517632] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-22T19:47:06.728212] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T19:47:07.317675] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-22T19:47:07.855595] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-22T19:47:08.117673] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-22T19:47:08.908239] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T19:47:08.921790] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-22T19:47:09.717631] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-22T19:47:09.839055] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T19:47:09.846179] [INFO ] [REMOTE ] MAGN: Full fetch complete (51867 records). [2025-10-22T19:47:09.846284] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-22T19:47:10.169116] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T19:47:10.245492] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-22T19:47:10.245580] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-22T19:47:10.246383] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-22T19:47:10.246444] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-22T19:47:10.247464] [DEBUG] [LOCAL ] MAGN: Trimmed 51867 records to 36149 (keeping 200 days of data) [2025-10-22T19:47:10.457912] [DEBUG] [LOCAL ] MAGN: Primary data saved (36149 records). [2025-10-22T19:47:10.458075] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-22T19:47:10.458173] [INFO ] [MAIN ] Update Progress: 1299/2367 symbols completed. MAGN took 27.5s. Estimated remaining: 2h 17m 23s. Rate: 7.8 symbols/min [2025-10-22T19:47:10.522784] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-22T19:47:10.628692] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:47:10.682197] [DEBUG] [LOCAL ] MAS: Loaded 52251 existing records from primary storage. [2025-10-22T19:47:10.682503] [INFO ] [MAIN ] MAS: Loaded 52251 existing records. [2025-10-22T19:47:10.858096] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:47:10.858326] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-22T19:47:10.858381] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-22T19:47:10.858591] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-22T19:47:10.858698] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-22T19:47:11.222067] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:47:11.317618] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-22T19:47:11.413044] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T19:47:11.476545] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-22T19:47:12.117673] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-22T19:47:12.917628] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-22T19:47:13.038254] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T19:47:13.429402] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T19:47:13.717697] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-22T19:47:14.517673] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-22T19:47:14.565329] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T19:47:15.317627] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-22T19:47:15.575918] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T19:47:15.713436] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-22T19:47:16.117692] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-22T19:47:16.583766] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T19:47:16.917637] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-22T19:47:17.181736] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T19:47:17.717682] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-22T19:47:18.341705] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T19:47:18.517632] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-22T19:47:19.259442] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T19:47:19.317608] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-22T19:47:19.983617] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T19:47:20.117693] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-22T19:47:20.917627] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-22T19:47:20.998959] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T19:47:21.717713] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-22T19:47:21.820016] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T19:47:22.517737] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-22T19:47:22.573816] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T19:47:22.931094] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T19:47:23.317623] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-22T19:47:24.117713] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-22T19:47:24.230940] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T19:47:24.619172] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-22T19:47:24.917715] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-22T19:47:25.689017] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T19:47:25.717637] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-22T19:47:26.517709] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-22T19:47:26.595981] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T19:47:27.232444] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T19:47:27.254303] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T19:47:27.317670] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-22T19:47:28.117779] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-22T19:47:28.723413] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T19:47:28.917720] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-22T19:47:29.717725] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-22T19:47:29.997513] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T19:47:30.517636] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-22T19:47:30.627780] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T19:47:31.317678] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-22T19:47:31.464292] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T19:47:31.475199] [INFO ] [REMOTE ] MAN: Full fetch complete (62855 records). [2025-10-22T19:47:31.475351] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-22T19:47:31.949207] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-22T19:47:31.949296] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-22T19:47:31.950335] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-22T19:47:31.950402] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-22T19:47:31.951739] [DEBUG] [LOCAL ] MAN: Trimmed 62855 records to 44306 (keeping 200 days of data) [2025-10-22T19:47:32.125992] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-22T19:47:32.228911] [DEBUG] [LOCAL ] MAN: Primary data saved (44306 records). [2025-10-22T19:47:32.229180] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-22T19:47:32.229327] [INFO ] [MAIN ] Update Progress: 1300/2367 symbols completed. MAN took 30.1s. Estimated remaining: 2h 17m 27s. Rate: 7.8 symbols/min [2025-10-22T19:47:32.441932] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:47:32.443466] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T19:47:32.484539] [DEBUG] [LOCAL ] MATV: Loaded 35183 existing records from primary storage. [2025-10-22T19:47:32.484925] [INFO ] [MAIN ] MATV: Loaded 35183 existing records. [2025-10-22T19:47:32.663216] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:47:32.663428] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-22T19:47:32.663492] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-22T19:47:32.663883] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-22T19:47:32.663939] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-22T19:47:32.918206] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-22T19:47:33.035259] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:47:33.064831] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T19:47:33.612195] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T19:47:33.617765] [INFO ] [REMOTE ] MANU: Full fetch complete (39418 records). [2025-10-22T19:47:33.617869] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-22T19:47:33.726260] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-22T19:47:34.024021] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-22T19:47:34.024106] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-22T19:47:34.024853] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-22T19:47:34.024916] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-22T19:47:34.025819] [DEBUG] [LOCAL ] MANU: Trimmed 39418 records to 27190 (keeping 200 days of data) [2025-10-22T19:47:34.174493] [DEBUG] [LOCAL ] MANU: Primary data saved (27190 records). [2025-10-22T19:47:34.174627] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-22T19:47:34.174738] [INFO ] [MAIN ] Update Progress: 1301/2367 symbols completed. MANU took 30.6s. Estimated remaining: 2h 17m 14s. Rate: 7.8 symbols/min [2025-10-22T19:47:34.361196] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:47:34.391167] [DEBUG] [LOCAL ] MATX: Loaded 31987 existing records from primary storage. [2025-10-22T19:47:34.391496] [INFO ] [MAIN ] MATX: Loaded 31987 existing records. [2025-10-22T19:47:34.527968] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-22T19:47:34.569898] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:47:34.570063] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-22T19:47:34.570110] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-22T19:47:34.570347] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-22T19:47:34.570384] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-22T19:47:34.906925] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-22T19:47:34.970001] [INFO ] [REMOTE ] MAIN: Full fetch complete (60414 records). [2025-10-22T19:47:34.976767] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:47:34.977439] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-22T19:47:35.248979] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T19:47:35.318607] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-22T19:47:35.413539] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-22T19:47:35.413616] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-22T19:47:35.414616] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-22T19:47:35.414702] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-22T19:47:35.415903] [DEBUG] [LOCAL ] MAIN: Trimmed 60414 records to 41940 (keeping 200 days of data) [2025-10-22T19:47:35.668294] [DEBUG] [LOCAL ] MAIN: Primary data saved (41940 records). [2025-10-22T19:47:35.668422] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-22T19:47:35.668501] [INFO ] [MAIN ] Update Progress: 1302/2367 symbols completed. MAIN took 36.4s. Estimated remaining: 2h 17m 1s. Rate: 7.8 symbols/min [2025-10-22T19:47:35.839150] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:47:35.867379] [DEBUG] [LOCAL ] MAX: Loaded 30845 existing records from primary storage. [2025-10-22T19:47:35.867660] [INFO ] [MAIN ] MAX: Loaded 30845 existing records. [2025-10-22T19:47:36.048147] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:47:36.048425] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-22T19:47:36.048475] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-22T19:47:36.048708] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-22T19:47:36.048763] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-22T19:47:36.118742] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-22T19:47:36.434411] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:47:36.469912] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T19:47:36.497191] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T19:47:36.917687] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-22T19:47:37.538728] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T19:47:37.717624] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-22T19:47:38.194346] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T19:47:38.517668] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-22T19:47:39.303626] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T19:47:39.317603] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-22T19:47:39.771434] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T19:47:40.117684] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-22T19:47:40.876304] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T19:47:40.917680] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-22T19:47:41.717693] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-22T19:47:41.801699] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T19:47:42.366283] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T19:47:42.517705] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-22T19:47:43.122483] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T19:47:43.317778] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-22T19:47:43.990639] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T19:47:44.117770] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-22T19:47:44.646502] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T19:47:44.917756] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-22T19:47:45.717701] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-22T19:47:45.911420] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T19:47:45.920750] [INFO ] [REMOTE ] MAS: Full fetch complete (75407 records). [2025-10-22T19:47:45.920927] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-22T19:47:46.359845] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-22T19:47:46.359959] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-22T19:47:46.361177] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-22T19:47:46.361608] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-22T19:47:46.386460] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T19:47:46.386670] [DEBUG] [LOCAL ] MAS: Trimmed 75407 records to 52226 (keeping 200 days of data) [2025-10-22T19:47:46.517806] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-22T19:47:46.739064] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T19:47:46.754063] [DEBUG] [LOCAL ] MAS: Primary data saved (52226 records). [2025-10-22T19:47:46.754164] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-22T19:47:46.754691] [INFO ] [MAIN ] Update Progress: 1303/2367 symbols completed. MAS took 36.3s. Estimated remaining: 2h 16m 57s. Rate: 7.8 symbols/min [2025-10-22T19:47:46.920272] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:47:46.960894] [DEBUG] [LOCAL ] MBC: Loaded 43908 existing records from primary storage. [2025-10-22T19:47:46.961196] [INFO ] [MAIN ] MBC: Loaded 43908 existing records. [2025-10-22T19:47:47.132109] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:47:47.132321] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-22T19:47:47.132388] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-22T19:47:47.132624] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-22T19:47:47.132706] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-22T19:47:47.322787] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-22T19:47:47.478883] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:47:47.766820] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T19:47:48.117711] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-22T19:47:48.835089] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T19:47:48.890112] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-22T19:47:48.917674] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-22T19:47:49.717696] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-22T19:47:50.041255] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T19:47:50.517622] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-22T19:47:51.091243] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T19:47:51.317669] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-22T19:47:52.002165] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T19:47:52.117684] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-22T19:47:52.520182] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T19:47:52.917688] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-22T19:47:53.509543] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T19:47:53.717764] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-22T19:47:54.424604] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T19:47:54.517708] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-22T19:47:54.885636] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-22T19:47:55.317700] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-22T19:47:56.117637] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-22T19:47:56.874003] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T19:47:56.917638] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-22T19:47:57.278246] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-22T19:47:57.559808] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (3.04 seconds). [2025-10-22T19:47:57.717684] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-22T19:47:58.243310] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T19:47:58.517721] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-22T19:47:58.904333] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T19:47:59.317735] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-22T19:47:59.468314] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T19:48:00.117719] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-22T19:48:00.788385] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T19:48:00.917679] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-22T19:48:01.524745] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T19:48:01.529901] [INFO ] [REMOTE ] MATV: Full fetch complete (52146 records). [2025-10-22T19:48:01.530033] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-22T19:48:01.722829] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-22T19:48:01.913118] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-22T19:48:01.913207] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-22T19:48:01.914053] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-22T19:48:01.914119] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-22T19:48:01.915311] [DEBUG] [LOCAL ] MATV: Trimmed 52146 records to 35045 (keeping 200 days of data) [2025-10-22T19:48:02.124751] [DEBUG] [LOCAL ] MATV: Primary data saved (35045 records). [2025-10-22T19:48:02.124924] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-22T19:48:02.125062] [INFO ] [MAIN ] Update Progress: 1304/2367 symbols completed. MATV took 29.9s. Estimated remaining: 2h 16m 55s. Rate: 7.8 symbols/min [2025-10-22T19:48:02.299778] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:48:02.321897] [DEBUG] [LOCAL ] MBI: Loaded 24151 existing records from primary storage. [2025-10-22T19:48:02.322163] [INFO ] [MAIN ] MBI: Loaded 24151 existing records. [2025-10-22T19:48:02.507510] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:48:02.507928] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-22T19:48:02.508018] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-22T19:48:02.508216] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-22T19:48:02.508313] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-22T19:48:02.522814] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-22T19:48:02.638290] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T19:48:02.936005] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:48:03.317726] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-22T19:48:03.979559] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T19:48:04.117683] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-22T19:48:04.399584] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-10-22T19:48:04.546413] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T19:48:04.917691] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-22T19:48:05.468433] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T19:48:05.717674] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-22T19:48:06.492163] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T19:48:06.517620] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-22T19:48:06.833278] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T19:48:07.317673] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-22T19:48:08.117728] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-22T19:48:08.620740] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T19:48:08.917623] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-22T19:48:09.348882] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-22T19:48:09.376681] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T19:48:09.717691] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-22T19:48:10.391001] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-22T19:48:10.396326] [INFO ] [REMOTE ] MATX: Full fetch complete (43870 records). [2025-10-22T19:48:10.396418] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-22T19:48:10.532112] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-22T19:48:10.766562] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-22T19:48:10.766637] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-22T19:48:10.767415] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-22T19:48:10.767459] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-22T19:48:10.768331] [DEBUG] [LOCAL ] MATX: Trimmed 43870 records to 31898 (keeping 200 days of data) [2025-10-22T19:48:10.959211] [DEBUG] [LOCAL ] MATX: Primary data saved (31898 records). [2025-10-22T19:48:10.959339] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-22T19:48:10.959416] [INFO ] [MAIN ] Update Progress: 1305/2367 symbols completed. MATX took 36.8s. Estimated remaining: 2h 16m 48s. Rate: 7.8 symbols/min [2025-10-22T19:48:11.126245] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:48:11.164454] [DEBUG] [LOCAL ] MC: Loaded 43725 existing records from primary storage. [2025-10-22T19:48:11.164766] [INFO ] [MAIN ] MC: Loaded 43725 existing records. [2025-10-22T19:48:11.348901] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:48:11.348966] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-22T19:48:11.350105] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-22T19:48:11.350159] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-22T19:48:11.350417] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-22T19:48:11.350473] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-22T19:48:11.656016] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T19:48:11.742161] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:48:11.742255] [INFO ] [REMOTE ] MBC: Full fetch complete (63145 records). [2025-10-22T19:48:11.742427] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-22T19:48:11.949232] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T19:48:12.130853] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-22T19:48:12.187197] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-22T19:48:12.187288] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-22T19:48:12.188327] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-22T19:48:12.188394] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-22T19:48:12.189817] [DEBUG] [LOCAL ] MBC: Trimmed 63145 records to 43879 (keeping 200 days of data) [2025-10-22T19:48:12.439786] [DEBUG] [LOCAL ] MBC: Primary data saved (43879 records). [2025-10-22T19:48:12.439922] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-22T19:48:12.440431] [INFO ] [MAIN ] Update Progress: 1306/2367 symbols completed. MBC took 25.7s. Estimated remaining: 2h 16m 35s. Rate: 7.8 symbols/min [2025-10-22T19:48:12.608936] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:48:12.622501] [DEBUG] [LOCAL ] MCB: Loaded 11340 existing records from primary storage. [2025-10-22T19:48:12.622789] [INFO ] [MAIN ] MCB: Loaded 11340 existing records. [2025-10-22T19:48:12.801515] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:48:12.801750] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-22T19:48:12.801822] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-22T19:48:12.801995] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-22T19:48:12.802051] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-22T19:48:12.923201] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-22T19:48:13.072948] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T19:48:13.105799] [INFO ] [REMOTE ] MAX: Full fetch complete (45195 records). [2025-10-22T19:48:13.119999] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T19:48:13.119524] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-22T19:48:13.303238] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:48:13.567623] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-22T19:48:13.567727] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-22T19:48:13.568482] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-22T19:48:13.568529] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-22T19:48:13.569420] [DEBUG] [LOCAL ] MAX: Trimmed 45195 records to 30725 (keeping 200 days of data) [2025-10-22T19:48:13.722573] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-22T19:48:13.741427] [DEBUG] [LOCAL ] MAX: Primary data saved (30725 records). [2025-10-22T19:48:13.741506] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-22T19:48:13.741620] [INFO ] [MAIN ] Update Progress: 1307/2367 symbols completed. MAX took 38.1s. Estimated remaining: 2h 16m 22s. Rate: 7.8 symbols/min [2025-10-22T19:48:13.905142] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:48:13.905313] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-22T19:48:13.905350] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-22T19:48:13.905455] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-22T19:48:13.905495] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-22T19:48:13.905535] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-22T19:48:13.905567] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-22T19:48:14.252377] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:48:14.434179] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T19:48:14.517608] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-22T19:48:14.602286] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T19:48:15.317695] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-22T19:48:16.014575] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-22T19:48:16.117729] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-22T19:48:16.832838] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-22T19:48:16.917625] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-22T19:48:17.717716] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-22T19:48:18.105906] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-22T19:48:18.517719] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-22T19:48:18.600630] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T19:48:18.642462] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-22T19:48:19.216276] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T19:48:19.317702] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-22T19:48:20.117629] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-22T19:48:20.426505] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T19:48:20.917689] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-22T19:48:21.717690] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-22T19:48:22.059937] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-22T19:48:22.517631] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-22T19:48:22.609906] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T19:48:22.829381] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T19:48:23.317731] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-22T19:48:23.797804] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-22T19:48:24.117672] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-22T19:48:24.917672] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-22T19:48:25.623472] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-22T19:48:25.704338] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T19:48:25.717601] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-22T19:48:25.990731] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-22T19:48:26.517690] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-22T19:48:26.533258] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-22T19:48:27.317678] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-22T19:48:27.778016] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T19:48:27.782130] [INFO ] [REMOTE ] MBI: Full fetch complete (35927 records). [2025-10-22T19:48:27.782213] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-22T19:48:28.126784] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-22T19:48:28.167127] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-22T19:48:28.167204] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-22T19:48:28.167979] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-22T19:48:28.168042] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-22T19:48:28.168902] [DEBUG] [LOCAL ] MBI: Trimmed 35927 records to 23968 (keeping 200 days of data) [2025-10-22T19:48:28.296724] [DEBUG] [LOCAL ] MBI: Primary data saved (23968 records). [2025-10-22T19:48:28.296837] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-22T19:48:28.296911] [INFO ] [MAIN ] Update Progress: 1308/2367 symbols completed. MBI took 26.2s. Estimated remaining: 2h 16m 20s. Rate: 7.8 symbols/min [2025-10-22T19:48:28.469187] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:48:28.477082] [DEBUG] [LOCAL ] MCI: Loaded 6222 existing records from primary storage. [2025-10-22T19:48:28.477254] [INFO ] [MAIN ] MCI: Loaded 6222 existing records. [2025-10-22T19:48:28.666875] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:48:28.667955] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-22T19:48:28.668049] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-22T19:48:28.669989] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-22T19:48:28.670064] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-22T19:48:28.917917] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-22T19:48:28.990151] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T19:48:29.078111] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:48:29.121347] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T19:48:29.717634] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-22T19:48:30.517774] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-22T19:48:30.545620] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T19:48:31.151259] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-22T19:48:31.317672] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-22T19:48:31.530407] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T19:48:32.117686] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-22T19:48:32.132073] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T19:48:32.917689] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-22T19:48:33.087532] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T19:48:33.717674] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-22T19:48:33.871014] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-22T19:48:33.873882] [INFO ] [REMOTE ] MCB: Full fetch complete (16680 records). [2025-10-22T19:48:33.874013] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-22T19:48:34.236991] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-22T19:48:34.237084] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-22T19:48:34.237431] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-22T19:48:34.237470] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-22T19:48:34.238008] [DEBUG] [LOCAL ] MCB: Trimmed 16680 records to 11254 (keeping 200 days of data) [2025-10-22T19:48:34.308249] [DEBUG] [LOCAL ] MCB: Primary data saved (11254 records). [2025-10-22T19:48:34.308376] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-22T19:48:34.308452] [INFO ] [MAIN ] Update Progress: 1309/2367 symbols completed. MCB took 21.9s. Estimated remaining: 2h 16m 11s. Rate: 7.8 symbols/min [2025-10-22T19:48:34.480792] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:48:34.507419] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-22T19:48:34.522037] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-22T19:48:34.523975] [DEBUG] [LOCAL ] MCK: Loaded 38187 existing records from primary storage. [2025-10-22T19:48:34.524280] [INFO ] [MAIN ] MCK: Loaded 38187 existing records. [2025-10-22T19:48:34.700275] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:48:34.700489] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-22T19:48:34.700543] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-22T19:48:34.700772] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-22T19:48:34.700833] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-22T19:48:35.056828] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:48:35.317669] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-22T19:48:36.117695] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-22T19:48:36.189057] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T19:48:36.713218] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-22T19:48:36.917694] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-22T19:48:36.976839] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T19:48:37.717701] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-22T19:48:38.517674] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-22T19:48:39.165243] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-22T19:48:39.317636] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-22T19:48:39.342860] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T19:48:40.114776] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T19:48:40.123265] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-22T19:48:40.884307] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T19:48:40.917718] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-22T19:48:41.345249] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-22T19:48:41.717679] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-22T19:48:42.406528] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-22T19:48:42.517693] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-22T19:48:43.062844] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T19:48:43.317694] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-22T19:48:44.117671] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-22T19:48:44.315600] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T19:48:44.323460] [INFO ] [REMOTE ] MC: Full fetch complete (63158 records). [2025-10-22T19:48:44.323604] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-22T19:48:44.726334] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-22T19:48:44.726469] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-22T19:48:44.727429] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-22T19:48:44.727530] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-22T19:48:44.728870] [DEBUG] [LOCAL ] MC: Trimmed 63158 records to 43670 (keeping 200 days of data) [2025-10-22T19:48:44.932600] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-22T19:48:44.988907] [DEBUG] [LOCAL ] MC: Primary data saved (43670 records). [2025-10-22T19:48:44.989032] [INFO ] [MAIN ] MC: Full history saved. [2025-10-22T19:48:44.989110] [INFO ] [MAIN ] Update Progress: 1310/2367 symbols completed. MC took 34.0s. Estimated remaining: 2h 16m 6s. Rate: 7.8 symbols/min [2025-10-22T19:48:45.162960] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:48:45.163258] [DEBUG] [LOCAL ] MCN: No existing data file found in primary storage. [2025-10-22T19:48:45.163357] [WARN ] [MAIN ] MCN: No existing data found, performing full refresh instead. [2025-10-22T19:48:45.163609] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-22T19:48:45.163710] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-22T19:48:45.163773] [DEBUG] [LOCAL ] MCN: No primary data file found to delete. [2025-10-22T19:48:45.163809] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-22T19:48:45.304982] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T19:48:45.552007] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:48:45.664910] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-22T19:48:45.717616] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-22T19:48:46.324165] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T19:48:46.414563] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-22T19:48:46.517709] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-22T19:48:47.317682] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-22T19:48:48.117678] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-22T19:48:48.731706] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-22T19:48:48.825830] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-22T19:48:48.870888] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T19:48:48.917617] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-22T19:48:49.717713] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-22T19:48:50.322201] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T19:48:50.450699] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T19:48:50.517625] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-22T19:48:51.317690] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-22T19:48:52.020938] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T19:48:52.050503] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T19:48:52.117675] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-22T19:48:52.917691] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-22T19:48:53.665613] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T19:48:53.667125] [INFO ] [REMOTE ] MCI: Full fetch complete (9780 records). [2025-10-22T19:48:53.667193] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-22T19:48:53.731513] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-22T19:48:54.029127] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T19:48:54.105455] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-22T19:48:54.105542] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-22T19:48:54.105873] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-22T19:48:54.105940] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-22T19:48:54.106462] [DEBUG] [LOCAL ] MCI: Trimmed 9780 records to 6182 (keeping 200 days of data) [2025-10-22T19:48:54.152601] [DEBUG] [LOCAL ] MCI: Primary data saved (6182 records). [2025-10-22T19:48:54.152849] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-22T19:48:54.152947] [INFO ] [MAIN ] Update Progress: 1311/2367 symbols completed. MCI took 25.9s. Estimated remaining: 2h 15m 59s. Rate: 7.8 symbols/min [2025-10-22T19:48:54.320458] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:48:54.353835] [DEBUG] [LOCAL ] MCO: Loaded 39453 existing records from primary storage. [2025-10-22T19:48:54.354130] [INFO ] [MAIN ] MCO: Loaded 39453 existing records. [2025-10-22T19:48:54.525484] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-22T19:48:54.530306] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:48:54.531758] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-22T19:48:54.531809] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-22T19:48:54.532207] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-22T19:48:54.532247] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-22T19:48:54.883985] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:48:55.317678] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-22T19:48:55.327022] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-22T19:48:55.848679] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-22T19:48:56.117690] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-22T19:48:56.792509] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T19:48:56.842287] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-22T19:48:56.917630] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-22T19:48:57.717723] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-22T19:48:57.750430] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-22T19:48:58.517693] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-22T19:48:59.212854] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T19:48:59.317628] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-22T19:49:00.122814] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-22T19:49:00.138198] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T19:49:00.893094] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-22T19:49:00.899632] [INFO ] [REMOTE ] MCK: Full fetch complete (56604 records). [2025-10-22T19:49:00.899903] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-22T19:49:00.926095] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-22T19:49:01.323338] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-22T19:49:01.323472] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-22T19:49:01.324855] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-22T19:49:01.324955] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-22T19:49:01.326921] [DEBUG] [LOCAL ] MCK: Trimmed 56604 records to 38009 (keeping 200 days of data) [2025-10-22T19:49:01.586934] [DEBUG] [LOCAL ] MCK: Primary data saved (38009 records). [2025-10-22T19:49:01.587143] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-22T19:49:01.587977] [INFO ] [MAIN ] Update Progress: 1312/2367 symbols completed. MCK took 27.3s. Estimated remaining: 2h 15m 51s. Rate: 7.8 symbols/min [2025-10-22T19:49:01.721691] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-22T19:49:01.790320] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:01.806001] [DEBUG] [LOCAL ] MCR: Loaded 8854 existing records from primary storage. [2025-10-22T19:49:01.806485] [INFO ] [MAIN ] MCR: Loaded 8854 existing records. [2025-10-22T19:49:02.018735] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:02.019213] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-22T19:49:02.019267] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-22T19:49:02.019500] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-22T19:49:02.019559] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-22T19:49:02.400129] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:02.411078] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-22T19:49:02.449894] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-22T19:49:02.517679] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-22T19:49:02.683789] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T19:49:03.317684] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-22T19:49:03.353102] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T19:49:04.117695] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-22T19:49:04.917628] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-22T19:49:05.052048] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T19:49:05.062052] [INFO ] [REMOTE ] MCD: Full fetch complete (77131 records). [2025-10-22T19:49:05.062239] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-22T19:49:05.275961] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T19:49:05.276909] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:49:05.277049] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:49:05.277253] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-22T19:49:05.277319] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-22T19:49:05.286895] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-22T19:49:05.286977] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-22T19:49:05.287048] [INFO ] [MAIN ] Update Progress: 1313/2367 symbols completed. MCD took 51.5s. Estimated remaining: 2h 15m 40s. Rate: 7.8 symbols/min [2025-10-22T19:49:05.380580] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T19:49:05.484238] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:05.502807] [DEBUG] [LOCAL ] MCS: Loaded 21229 existing records from primary storage. [2025-10-22T19:49:05.503036] [INFO ] [MAIN ] MCS: Loaded 21229 existing records. [2025-10-22T19:49:05.680532] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:05.680869] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-22T19:49:05.680922] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-22T19:49:05.681122] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-22T19:49:05.681162] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-22T19:49:05.723061] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-22T19:49:05.793901] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T19:49:06.049968] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:06.517686] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-22T19:49:07.317632] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-22T19:49:07.514027] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T19:49:07.640559] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T19:49:08.111861] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T19:49:08.117714] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-22T19:49:08.917692] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-22T19:49:09.616236] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T19:49:09.650868] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-22T19:49:09.717684] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-22T19:49:10.517687] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-22T19:49:10.531517] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T19:49:11.246350] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-22T19:49:11.317629] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-22T19:49:12.117628] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-22T19:49:12.191404] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-22T19:49:12.917672] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-22T19:49:13.560802] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-22T19:49:13.630111] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T19:49:13.717629] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-22T19:49:14.395129] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T19:49:14.517676] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-22T19:49:15.317668] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-22T19:49:15.334382] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T19:49:16.117723] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-22T19:49:16.918756] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T19:49:16.917718] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-22T19:49:17.299886] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-22T19:49:17.717679] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-22T19:49:18.517724] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-22T19:49:18.552799] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T19:49:18.554364] [INFO ] [REMOTE ] MCN: Full fetch complete (11557 records). [2025-10-22T19:49:18.554430] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-22T19:49:18.912297] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-22T19:49:18.912412] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-22T19:49:18.912727] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-22T19:49:18.912814] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-22T19:49:18.913434] [DEBUG] [LOCAL ] MCN: Trimmed 11557 records to 7984 (keeping 200 days of data) [2025-10-22T19:49:18.959502] [DEBUG] [LOCAL ] MCN: Primary data saved (7984 records). [2025-10-22T19:49:18.959793] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-22T19:49:18.959901] [INFO ] [MAIN ] Update Progress: 1314/2367 symbols completed. MCN took 34.0s. Estimated remaining: 2h 15m 37s. Rate: 7.8 symbols/min [2025-10-22T19:49:19.152114] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T19:49:19.155169] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:19.184566] [DEBUG] [LOCAL ] MCY: Loaded 23711 existing records from primary storage. [2025-10-22T19:49:19.184850] [INFO ] [MAIN ] MCY: Loaded 23711 existing records. [2025-10-22T19:49:19.322846] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-22T19:49:19.359334] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:19.359815] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-22T19:49:19.359885] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-22T19:49:19.360079] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-22T19:49:19.360136] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-22T19:49:19.692622] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T19:49:19.738256] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:20.117700] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-22T19:49:20.202903] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T19:49:20.917680] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-22T19:49:21.621597] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T19:49:21.710479] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T19:49:21.717608] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-22T19:49:22.517710] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-22T19:49:23.317772] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-22T19:49:23.571506] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T19:49:23.579079] [INFO ] [REMOTE ] MCO: Full fetch complete (58332 records). [2025-10-22T19:49:23.579178] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-22T19:49:23.959512] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-22T19:49:23.959758] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-22T19:49:23.960688] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-22T19:49:23.960848] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-22T19:49:23.982314] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T19:49:23.990455] [DEBUG] [LOCAL ] MCO: Trimmed 58332 records to 39425 (keeping 200 days of data) [2025-10-22T19:49:24.118355] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-22T19:49:24.187048] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T19:49:24.249693] [DEBUG] [LOCAL ] MCO: Primary data saved (39425 records). [2025-10-22T19:49:24.249839] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-22T19:49:24.249923] [INFO ] [MAIN ] Update Progress: 1315/2367 symbols completed. MCO took 30.1s. Estimated remaining: 2h 15m 28s. Rate: 7.8 symbols/min [2025-10-22T19:49:24.412356] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:24.446808] [DEBUG] [LOCAL ] MD: Loaded 38586 existing records from primary storage. [2025-10-22T19:49:24.447075] [INFO ] [MAIN ] MD: Loaded 38586 existing records. [2025-10-22T19:49:24.617373] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:24.617530] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-22T19:49:24.617577] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-22T19:49:24.617849] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-22T19:49:24.617904] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-22T19:49:24.922934] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-22T19:49:24.961801] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:25.595605] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-22T19:49:25.717765] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-22T19:49:26.030521] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T19:49:26.517737] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-22T19:49:26.984632] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-22T19:49:27.317762] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-22T19:49:27.882019] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-22T19:49:28.057245] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T19:49:28.117622] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-22T19:49:28.917708] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-22T19:49:29.142831] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T19:49:29.717687] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-22T19:49:30.250689] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T19:49:30.517698] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-22T19:49:30.844185] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T19:49:31.317733] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-22T19:49:31.725160] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T19:49:32.010070] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-22T19:49:32.117701] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-22T19:49:32.917802] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-22T19:49:33.323967] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T19:49:33.717724] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-22T19:49:34.424101] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T19:49:34.446324] [INFO ] [REMOTE ] MCR: Full fetch complete (13517 records). [2025-10-22T19:49:34.447836] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T19:49:34.447916] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-22T19:49:34.522887] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-22T19:49:34.820726] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-22T19:49:34.820805] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-22T19:49:34.821109] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-22T19:49:34.821148] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-22T19:49:34.821585] [DEBUG] [LOCAL ] MCR: Trimmed 13517 records to 8866 (keeping 200 days of data) [2025-10-22T19:49:34.871369] [DEBUG] [LOCAL ] MCR: Primary data saved (8866 records). [2025-10-22T19:49:34.871476] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-22T19:49:34.871551] [INFO ] [MAIN ] Update Progress: 1316/2367 symbols completed. MCR took 33.3s. Estimated remaining: 2h 15m 22s. Rate: 7.8 symbols/min [2025-10-22T19:49:35.037397] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:35.044441] [DEBUG] [LOCAL ] MDST: Loaded 6139 existing records from primary storage. [2025-10-22T19:49:35.044627] [INFO ] [MAIN ] MDST: Loaded 6139 existing records. [2025-10-22T19:49:35.218458] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:35.218731] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-22T19:49:35.218788] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-22T19:49:35.218950] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-22T19:49:35.219006] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-22T19:49:35.322924] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-22T19:49:35.577448] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:35.675408] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T19:49:36.117712] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-22T19:49:36.855369] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T19:49:36.917683] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-22T19:49:37.211775] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T19:49:37.717673] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-22T19:49:38.220087] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-22T19:49:38.517719] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-22T19:49:38.825621] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T19:49:39.258865] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-22T19:49:39.317617] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-22T19:49:39.769729] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T19:49:40.117734] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-22T19:49:40.917713] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-22T19:49:41.490478] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T19:49:41.518976] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T19:49:41.717659] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-22T19:49:42.153918] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-22T19:49:42.517692] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-22T19:49:43.317711] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-22T19:49:43.590101] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T19:49:44.117685] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-22T19:49:44.501427] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T19:49:44.917615] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-22T19:49:45.318990] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T19:49:45.323495] [INFO ] [REMOTE ] MCY: Full fetch complete (40808 records). [2025-10-22T19:49:45.323751] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-22T19:49:45.698380] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-22T19:49:45.698469] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-22T19:49:45.699288] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-22T19:49:45.699353] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-22T19:49:45.700337] [DEBUG] [LOCAL ] MCY: Trimmed 40808 records to 23567 (keeping 200 days of data) [2025-10-22T19:49:45.754325] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-22T19:49:45.851460] [DEBUG] [LOCAL ] MCY: Primary data saved (23567 records). [2025-10-22T19:49:45.851603] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-22T19:49:45.851716] [INFO ] [MAIN ] Update Progress: 1317/2367 symbols completed. MCY took 26.9s. Estimated remaining: 2h 15m 17s. Rate: 7.8 symbols/min [2025-10-22T19:49:46.469108] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T19:49:46.517612] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-22T19:49:47.095006] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T19:49:47.099254] [INFO ] [REMOTE ] MCS: Full fetch complete (30664 records). [2025-10-22T19:49:47.099327] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-22T19:49:47.342077] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-22T19:49:47.462431] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-22T19:49:47.462508] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-22T19:49:47.463223] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-22T19:49:47.463285] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-22T19:49:47.464116] [DEBUG] [LOCAL ] MCS: Trimmed 30664 records to 21186 (keeping 200 days of data) [2025-10-22T19:49:47.588194] [DEBUG] [LOCAL ] MCS: Primary data saved (21186 records). [2025-10-22T19:49:47.588312] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-22T19:49:47.588384] [INFO ] [MAIN ] Update Progress: 1318/2367 symbols completed. MCS took 42.3s. Estimated remaining: 2h 15m 5s. Rate: 7.8 symbols/min [2025-10-22T19:49:47.934026] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T19:49:48.024557] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-22T19:49:48.117702] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-22T19:49:48.917736] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-22T19:49:49.491374] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-22T19:49:49.548954] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-22T19:49:49.555694] [INFO ] [REMOTE ] MD: Full fetch complete (55277 records). [2025-10-22T19:49:49.555826] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-22T19:49:49.722767] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-22T19:49:49.963004] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-22T19:49:49.963086] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-22T19:49:49.963897] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-22T19:49:49.963959] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-22T19:49:49.965097] [DEBUG] [LOCAL ] MD: Trimmed 55277 records to 38572 (keeping 200 days of data) [2025-10-22T19:49:50.185873] [DEBUG] [LOCAL ] MD: Primary data saved (38572 records). [2025-10-22T19:49:50.186013] [INFO ] [MAIN ] MD: Full history saved. [2025-10-22T19:49:50.186090] [INFO ] [MAIN ] Update Progress: 1319/2367 symbols completed. MD took 25.9s. Estimated remaining: 2h 14m 53s. Rate: 7.8 symbols/min [2025-10-22T19:49:50.453834] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-22T19:49:50.517716] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-22T19:49:51.247665] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-22T19:49:51.317632] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-22T19:49:52.147122] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T19:49:52.149788] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-22T19:49:53.088378] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T19:49:53.090268] [INFO ] [REMOTE ] MDST: Full fetch complete (8841 records). [2025-10-22T19:49:53.090335] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-22T19:49:53.445016] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-22T19:49:53.445095] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-22T19:49:53.445311] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-22T19:49:53.445349] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-22T19:49:53.445817] [DEBUG] [LOCAL ] MDST: Trimmed 8841 records to 6110 (keeping 200 days of data) [2025-10-22T19:49:53.482059] [DEBUG] [LOCAL ] MDST: Primary data saved (6110 records). [2025-10-22T19:49:53.482187] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-22T19:49:53.482311] [INFO ] [MAIN ] Update Progress: 1320/2367 symbols completed. MDST took 18.6s. Estimated remaining: 2h 14m 42s. Rate: 7.8 symbols/min [2025-10-22T19:49:54.130923] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:54.194809] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:54.193108] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:54.189097] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:49:54.206791] [DEBUG] [LOCAL ] MDV: Loaded 8346 existing records from primary storage. [2025-10-22T19:49:54.207297] [INFO ] [MAIN ] MDV: Loaded 8346 existing records. [2025-10-22T19:49:54.292868] [DEBUG] [LOCAL ] MEC: Loaded 16796 existing records from primary storage. [2025-10-22T19:49:54.293120] [INFO ] [MAIN ] MEC: Loaded 16796 existing records. [2025-10-22T19:49:54.527766] [DEBUG] [LOCAL ] MDU: Loaded 48021 existing records from primary storage. [2025-10-22T19:49:54.553459] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:54.564945] [INFO ] [MAIN ] MDU: Loaded 48021 existing records. [2025-10-22T19:49:54.575943] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-22T19:49:54.698267] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:54.694862] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-22T19:49:54.727886] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-22T19:49:54.734267] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-22T19:49:54.744764] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-22T19:49:54.728744] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-22T19:49:54.760843] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-22T19:49:54.784056] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-22T19:49:54.766593] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-10-22T19:49:54.794357] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-22T19:49:55.043602] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:55.206247] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-22T19:49:55.355088] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-22T19:49:55.507547] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:49:55.527628] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-22T19:49:55.551833] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-22T19:49:55.562468] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-22T19:49:55.557226] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-22T19:49:55.669550] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-22T19:49:55.703854] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-22T19:49:55.943588] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:56.022044] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-22T19:49:56.043609] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:56.076486] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-22T19:49:56.500466] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:56.532146] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-22T19:49:56.563612] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:49:56.563989] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-22T19:49:56.690067] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-22T19:49:56.691920] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-22T19:49:57.184779] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T19:49:57.188127] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-22T19:49:57.327182] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T19:49:57.717692] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-22T19:49:57.736639] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-22T19:49:58.300337] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T19:49:58.331253] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T19:49:58.336022] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T19:49:58.517689] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-22T19:49:59.317727] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-22T19:50:00.127570] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-22T19:50:00.136288] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T19:50:00.175701] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-22T19:50:00.917724] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-22T19:50:01.717694] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-22T19:50:01.725875] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T19:50:01.833850] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T19:50:02.517673] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-22T19:50:03.317676] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-22T19:50:03.462212] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T19:50:03.510231] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T19:50:04.117685] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-22T19:50:04.917769] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-22T19:50:05.335036] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-22T19:50:05.717626] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-22T19:50:05.757891] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T19:50:05.884547] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-22T19:50:06.517689] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-22T19:50:07.317708] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-22T19:50:07.376485] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T19:50:07.627522] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T19:50:08.117674] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-22T19:50:08.917636] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-22T19:50:09.074509] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-22T19:50:09.717626] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-22T19:50:09.919947] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-22T19:50:10.164874] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-22T19:50:10.517735] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-22T19:50:11.116589] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T19:50:11.317637] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-22T19:50:12.117623] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-22T19:50:12.370588] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T19:50:12.766061] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T19:50:12.800951] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T19:50:12.917689] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-22T19:50:13.717669] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-22T19:50:13.895866] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-22T19:50:14.517684] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-22T19:50:15.259817] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T19:50:15.317668] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-22T19:50:16.117622] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-22T19:50:16.240061] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T19:50:16.917637] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-22T19:50:16.981031] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T19:50:17.085744] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T19:50:17.717682] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-22T19:50:17.814474] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-22T19:50:18.321727] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T19:50:18.517636] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-22T19:50:19.317706] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-22T19:50:19.485165] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T19:50:20.117731] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-22T19:50:20.917626] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-22T19:50:21.047924] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T19:50:21.236619] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T19:50:21.717722] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-22T19:50:22.517625] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-22T19:50:22.847792] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T19:50:22.856399] [INFO ] [REMOTE ] MDU: Full fetch complete (70688 records). [2025-10-22T19:50:22.856544] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-22T19:50:23.027319] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T19:50:23.058050] [INFO ] [REMOTE ] MEC: Full fetch complete (23146 records). [2025-10-22T19:50:23.120865] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-22T19:50:23.323817] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-22T19:50:23.422548] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-22T19:50:23.427823] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-22T19:50:23.447052] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-22T19:50:23.467346] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-22T19:50:23.594294] [DEBUG] [LOCAL ] MDU: Trimmed 70688 records to 48009 (keeping 200 days of data) [2025-10-22T19:50:23.773360] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-22T19:50:23.773985] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-22T19:50:23.777130] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-22T19:50:23.777208] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-22T19:50:23.789715] [DEBUG] [LOCAL ] MEC: Trimmed 23146 records to 16914 (keeping 200 days of data) [2025-10-22T19:50:24.059920] [DEBUG] [LOCAL ] MEC: Primary data saved (16914 records). [2025-10-22T19:50:24.070804] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-22T19:50:24.084912] [INFO ] [MAIN ] Update Progress: 1321/2367 symbols completed. MEC took 30.6s. Estimated remaining: 2h 14m 52s. Rate: 7.8 symbols/min [2025-10-22T19:50:24.084740] [DEBUG] [LOCAL ] MDU: Primary data saved (48009 records). [2025-10-22T19:50:24.085104] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-22T19:50:24.085499] [INFO ] [MAIN ] Update Progress: 1322/2367 symbols completed. MDU took 30.6s. Estimated remaining: 2h 14m 38s. Rate: 7.8 symbols/min [2025-10-22T19:50:24.377017] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T19:50:24.399589] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:50:24.449795] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:50:24.450398] [INFO ] [REMOTE ] MDV: Full fetch complete (11697 records). [2025-10-22T19:50:24.451119] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-22T19:50:24.627025] [DEBUG] [LOCAL ] MED: Loaded 21011 existing records from primary storage. [2025-10-22T19:50:24.674067] [INFO ] [MAIN ] MED: Loaded 21011 existing records. [2025-10-22T19:50:24.693819] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-22T19:50:24.786524] [DEBUG] [LOCAL ] MEG: Loaded 31613 existing records from primary storage. [2025-10-22T19:50:24.882919] [INFO ] [MAIN ] MEG: Loaded 31613 existing records. [2025-10-22T19:50:24.872317] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-22T19:50:25.234884] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:50:25.252040] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-22T19:50:25.252185] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-22T19:50:25.263483] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-22T19:50:25.268990] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-22T19:50:25.269257] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-22T19:50:25.269404] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-22T19:50:25.292037] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-22T19:50:25.297780] [DEBUG] [LOCAL ] MDV: Trimmed 11697 records to 8298 (keeping 200 days of data) [2025-10-22T19:50:25.297889] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-22T19:50:25.410018] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:50:25.470008] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-22T19:50:25.500374] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-22T19:50:25.509762] [DEBUG] [LOCAL ] MDV: Primary data saved (8298 records). [2025-10-22T19:50:25.510048] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-22T19:50:25.510298] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-22T19:50:25.510251] [INFO ] [MAIN ] Update Progress: 1323/2367 symbols completed. MDV took 32.0s. Estimated remaining: 2h 14m 25s. Rate: 7.8 symbols/min [2025-10-22T19:50:25.515735] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-22T19:50:26.067198] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:50:26.296012] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:50:26.301957] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-22T19:50:26.392570] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:50:26.393004] [DEBUG] [LOCAL ] MEGI: Loaded 19774 existing records from primary storage. [2025-10-22T19:50:26.393255] [INFO ] [MAIN ] MEGI: Loaded 19774 existing records. [2025-10-22T19:50:26.393482] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-22T19:50:26.576565] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:50:26.576852] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-22T19:50:26.576902] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-22T19:50:26.577130] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-22T19:50:26.577188] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-22T19:50:26.934493] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:50:26.934856] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-22T19:50:27.044320] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-22T19:50:27.053325] [INFO ] [REMOTE ] MDT: Full fetch complete (77857 records). [2025-10-22T19:50:27.053581] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-22T19:50:27.452305] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-22T19:50:27.452441] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-22T19:50:27.453611] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-22T19:50:27.453716] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-22T19:50:27.469308] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T19:50:27.474871] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-22T19:50:27.476021] [DEBUG] [LOCAL ] MDT: Trimmed 77857 records to 53678 (keeping 200 days of data) [2025-10-22T19:50:27.833339] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-10-22T19:50:27.833530] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-22T19:50:27.833805] [INFO ] [MAIN ] Update Progress: 1324/2367 symbols completed. MDT took 34.4s. Estimated remaining: 2h 14m 13s. Rate: 7.8 symbols/min [2025-10-22T19:50:28.016219] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:50:28.045595] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T19:50:28.072152] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T19:50:28.100170] [DEBUG] [LOCAL ] MEI: Loaded 31387 existing records from primary storage. [2025-10-22T19:50:28.100469] [INFO ] [MAIN ] MEI: Loaded 31387 existing records. [2025-10-22T19:50:28.122901] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-22T19:50:28.284773] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:50:28.284982] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-22T19:50:28.285049] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-22T19:50:28.285394] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-22T19:50:28.285449] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-22T19:50:28.638863] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:50:28.701974] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T19:50:28.874883] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-22T19:50:28.917635] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-22T19:50:29.717682] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-22T19:50:30.165561] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T19:50:30.517710] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-22T19:50:30.952311] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T19:50:31.317627] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-22T19:50:31.710795] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-22T19:50:32.117697] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-22T19:50:32.442551] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T19:50:32.917688] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-22T19:50:33.537394] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T19:50:33.717709] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-22T19:50:33.901927] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T19:50:34.517636] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-22T19:50:34.842876] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T19:50:35.317670] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-22T19:50:35.885130] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T19:50:36.117709] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-22T19:50:36.782770] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T19:50:36.917675] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-22T19:50:37.250792] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T19:50:37.717734] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-22T19:50:37.900787] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T19:50:38.517703] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-22T19:50:38.662875] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-22T19:50:39.317690] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-22T19:50:39.968925] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-22T19:50:40.117663] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-22T19:50:40.307813] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T19:50:40.919089] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-22T19:50:40.922691] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T19:50:41.717709] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-22T19:50:42.348684] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-22T19:50:42.517634] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-22T19:50:42.902082] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T19:50:43.317731] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-22T19:50:43.967210] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T19:50:44.117683] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-22T19:50:44.804261] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T19:50:44.922496] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-22T19:50:44.927190] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T19:50:45.717636] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-22T19:50:46.517677] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-22T19:50:46.703080] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T19:50:46.806246] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T19:50:47.317685] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-22T19:50:47.580327] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-22T19:50:48.117680] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-22T19:50:48.352434] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T19:50:48.917693] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-22T19:50:49.179444] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T19:50:49.717717] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-22T19:50:49.919697] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T19:50:50.517693] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-22T19:50:51.135546] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T19:50:51.317633] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-22T19:50:51.592073] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T19:50:51.595362] [INFO ] [REMOTE ] MEGI: Full fetch complete (28976 records). [2025-10-22T19:50:51.595444] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-22T19:50:52.023921] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-22T19:50:52.024261] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-22T19:50:52.024975] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-22T19:50:52.025058] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-22T19:50:52.026107] [DEBUG] [LOCAL ] MEGI: Trimmed 28976 records to 19699 (keeping 200 days of data) [2025-10-22T19:50:52.118436] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-22T19:50:52.157568] [DEBUG] [LOCAL ] MEGI: Primary data saved (19699 records). [2025-10-22T19:50:52.157765] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-22T19:50:52.157877] [INFO ] [MAIN ] Update Progress: 1325/2367 symbols completed. MEGI took 26.6s. Estimated remaining: 2h 14m 19s. Rate: 7.8 symbols/min [2025-10-22T19:50:52.350708] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:50:52.399753] [DEBUG] [LOCAL ] MET: Loaded 53305 existing records from primary storage. [2025-10-22T19:50:52.400109] [INFO ] [MAIN ] MET: Loaded 53305 existing records. [2025-10-22T19:50:52.528166] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-22T19:50:52.574179] [INFO ] [REMOTE ] MED: Full fetch complete (31822 records). [2025-10-22T19:50:52.574947] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-22T19:50:52.627119] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:50:52.686349] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-22T19:50:52.696742] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-22T19:50:52.702476] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-22T19:50:52.723140] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-22T19:50:52.959364] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-22T19:50:53.338737] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-22T19:50:53.347359] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-22T19:50:53.350115] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-22T19:50:53.350473] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-22T19:50:53.371571] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:50:53.372701] [DEBUG] [LOCAL ] MED: Trimmed 31822 records to 20919 (keeping 200 days of data) [2025-10-22T19:50:53.508469] [DEBUG] [LOCAL ] MED: Primary data saved (20919 records). [2025-10-22T19:50:53.508672] [INFO ] [MAIN ] MED: Full history saved. [2025-10-22T19:50:53.508794] [INFO ] [MAIN ] Update Progress: 1326/2367 symbols completed. MED took 29.4s. Estimated remaining: 2h 14m 6s. Rate: 7.8 symbols/min [2025-10-22T19:50:53.737406] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-22T19:50:53.753202] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:50:53.809016] [DEBUG] [LOCAL ] MFA: Loaded 45661 existing records from primary storage. [2025-10-22T19:50:53.809588] [INFO ] [MAIN ] MFA: Loaded 45661 existing records. [2025-10-22T19:50:54.112704] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:50:54.113105] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-22T19:50:54.113181] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-22T19:50:54.113578] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-22T19:50:54.113690] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-22T19:50:54.688536] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:50:54.689240] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-22T19:50:54.853334] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T19:50:55.055817] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T19:50:55.317736] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-22T19:50:55.932134] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T19:50:56.117725] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-22T19:50:56.811305] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T19:50:56.817382] [INFO ] [REMOTE ] MEG: Full fetch complete (47472 records). [2025-10-22T19:50:56.817575] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-22T19:50:56.921483] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-22T19:50:57.232050] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-22T19:50:57.232194] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-22T19:50:57.233148] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-22T19:50:57.233273] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-22T19:50:57.257635] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (5.14 seconds). [2025-10-22T19:50:57.256753] [DEBUG] [LOCAL ] MEG: Trimmed 47472 records to 31527 (keeping 200 days of data) [2025-10-22T19:50:57.448578] [DEBUG] [LOCAL ] MEG: Primary data saved (31527 records). [2025-10-22T19:50:57.448751] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-22T19:50:57.448846] [INFO ] [MAIN ] Update Progress: 1327/2367 symbols completed. MEG took 33.4s. Estimated remaining: 2h 13m 55s. Rate: 7.8 symbols/min [2025-10-22T19:50:57.615325] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:50:57.622253] [DEBUG] [LOCAL ] MFAN: Loaded 4348 existing records from primary storage. [2025-10-22T19:50:57.622453] [INFO ] [MAIN ] MFAN: Loaded 4348 existing records. [2025-10-22T19:50:57.723979] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-22T19:50:57.804460] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:50:57.804717] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-22T19:50:57.804772] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-22T19:50:57.804927] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-22T19:50:57.804982] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-22T19:50:58.176188] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:50:58.244280] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-22T19:50:58.525325] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-22T19:50:58.540334] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T19:50:58.864465] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-22T19:50:59.096070] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T19:50:59.317679] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-22T19:50:59.756778] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T19:51:00.117687] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-22T19:51:00.917688] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-22T19:51:01.503638] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T19:51:01.717778] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-22T19:51:02.221358] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-22T19:51:02.353368] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-22T19:51:02.517704] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-22T19:51:03.317721] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-22T19:51:04.117693] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-22T19:51:04.445128] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T19:51:04.771182] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T19:51:04.917721] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-22T19:51:05.515052] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T19:51:05.722808] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-22T19:51:05.746407] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T19:51:06.517695] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-22T19:51:07.089292] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-22T19:51:07.159383] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T19:51:07.164588] [INFO ] [REMOTE ] MEI: Full fetch complete (45360 records). [2025-10-22T19:51:07.164781] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-22T19:51:07.322581] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-22T19:51:07.568478] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-22T19:51:07.568562] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-22T19:51:07.569470] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-22T19:51:07.569566] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-22T19:51:07.570736] [DEBUG] [LOCAL ] MEI: Trimmed 45360 records to 31216 (keeping 200 days of data) [2025-10-22T19:51:07.751415] [DEBUG] [LOCAL ] MEI: Primary data saved (31216 records). [2025-10-22T19:51:07.751545] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-22T19:51:07.751630] [INFO ] [MAIN ] Update Progress: 1328/2367 symbols completed. MEI took 39.9s. Estimated remaining: 2h 13m 50s. Rate: 7.8 symbols/min [2025-10-22T19:51:07.931116] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:51:07.937551] [DEBUG] [LOCAL ] MFAO: Loaded 3968 existing records from primary storage. [2025-10-22T19:51:07.937851] [INFO ] [MAIN ] MFAO: Loaded 3968 existing records. [2025-10-22T19:51:08.120553] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:51:08.120732] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-22T19:51:08.121234] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-22T19:51:08.122551] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-22T19:51:08.122763] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-22T19:51:08.122821] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-22T19:51:08.498064] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:51:08.917685] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-22T19:51:09.125715] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T19:51:09.460440] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-22T19:51:09.717679] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-22T19:51:09.839712] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T19:51:10.201064] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-22T19:51:10.517690] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-22T19:51:11.317692] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-22T19:51:11.923292] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T19:51:12.117715] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-22T19:51:12.395705] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T19:51:12.675425] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T19:51:12.917625] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-22T19:51:13.323146] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-22T19:51:13.717674] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-22T19:51:14.471890] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T19:51:14.473250] [INFO ] [REMOTE ] MFAN: Full fetch complete (5978 records). [2025-10-22T19:51:14.473318] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-22T19:51:14.528159] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-22T19:51:14.831809] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-22T19:51:14.831930] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-22T19:51:14.832109] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-22T19:51:14.832151] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-22T19:51:14.832523] [DEBUG] [LOCAL ] MFAN: Trimmed 5978 records to 4309 (keeping 200 days of data) [2025-10-22T19:51:14.857446] [DEBUG] [LOCAL ] MFAN: Primary data saved (4309 records). [2025-10-22T19:51:14.857536] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-22T19:51:14.857610] [INFO ] [MAIN ] Update Progress: 1329/2367 symbols completed. MFAN took 17.4s. Estimated remaining: 2h 13m 41s. Rate: 7.8 symbols/min [2025-10-22T19:51:15.041011] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:51:15.089930] [DEBUG] [LOCAL ] MFC: Loaded 51013 existing records from primary storage. [2025-10-22T19:51:15.090295] [INFO ] [MAIN ] MFC: Loaded 51013 existing records. [2025-10-22T19:51:15.273034] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:51:15.273244] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-22T19:51:15.273295] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-22T19:51:15.273474] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-22T19:51:15.273512] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-22T19:51:15.322838] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-22T19:51:15.631743] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:51:15.849371] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-22T19:51:16.117691] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-22T19:51:16.282897] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T19:51:16.917710] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-22T19:51:17.717677] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-22T19:51:18.070085] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T19:51:18.525980] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-22T19:51:18.559237] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T19:51:18.942530] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T19:51:19.162444] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-22T19:51:19.317697] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-22T19:51:20.117667] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-22T19:51:20.798124] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-22T19:51:20.917629] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-22T19:51:21.050976] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T19:51:21.387141] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-22T19:51:21.717682] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-22T19:51:22.517667] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-22T19:51:23.317689] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-22T19:51:23.443834] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T19:51:24.117631] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-22T19:51:24.210887] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T19:51:24.917707] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-22T19:51:25.041011] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T19:51:25.717699] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-22T19:51:25.951787] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T19:51:26.517639] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-22T19:51:26.596172] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T19:51:27.317702] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-22T19:51:27.599215] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T19:51:27.889472] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-22T19:51:28.090797] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T19:51:28.117611] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-22T19:51:28.917733] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-22T19:51:29.717691] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-22T19:51:29.956766] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T19:51:30.264851] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-22T19:51:30.517669] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-22T19:51:30.905842] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-22T19:51:30.915185] [INFO ] [REMOTE ] MET: Full fetch complete (77372 records). [2025-10-22T19:51:30.915345] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-22T19:51:31.311244] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-22T19:51:31.311320] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-22T19:51:31.312316] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-22T19:51:31.312379] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-22T19:51:31.313934] [DEBUG] [LOCAL ] MET: Trimmed 77372 records to 53300 (keeping 200 days of data) [2025-10-22T19:51:31.366674] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-22T19:51:31.637120] [DEBUG] [LOCAL ] MET: Primary data saved (53300 records). [2025-10-22T19:51:31.637280] [INFO ] [MAIN ] MET: Full history saved. [2025-10-22T19:51:31.637369] [INFO ] [MAIN ] Update Progress: 1330/2367 symbols completed. MET took 39.5s. Estimated remaining: 2h 13m 41s. Rate: 7.8 symbols/min [2025-10-22T19:51:31.803725] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:51:31.845667] [DEBUG] [LOCAL ] MFG: Loaded 49585 existing records from primary storage. [2025-10-22T19:51:31.845973] [INFO ] [MAIN ] MFG: Loaded 49585 existing records. [2025-10-22T19:51:32.018856] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:51:32.019053] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-22T19:51:32.019101] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-22T19:51:32.019335] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-22T19:51:32.019374] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-22T19:51:32.122751] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-22T19:51:32.392306] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:51:32.419903] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T19:51:32.427733] [INFO ] [REMOTE ] MFA: Full fetch complete (65262 records). [2025-10-22T19:51:32.427952] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-22T19:51:32.536203] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-22T19:51:32.823318] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-22T19:51:32.823414] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-22T19:51:32.824346] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-22T19:51:32.824411] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-22T19:51:32.825805] [DEBUG] [LOCAL ] MFA: Trimmed 65262 records to 45582 (keeping 200 days of data) [2025-10-22T19:51:32.917923] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-22T19:51:33.096301] [DEBUG] [LOCAL ] MFA: Primary data saved (45582 records). [2025-10-22T19:51:33.096519] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-22T19:51:33.097335] [INFO ] [MAIN ] Update Progress: 1331/2367 symbols completed. MFA took 39.6s. Estimated remaining: 2h 13m 28s. Rate: 7.8 symbols/min [2025-10-22T19:51:33.291908] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:51:33.289687] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-22T19:51:33.315095] [DEBUG] [LOCAL ] MFM: Loaded 14170 existing records from primary storage. [2025-10-22T19:51:33.315313] [INFO ] [MAIN ] MFM: Loaded 14170 existing records. [2025-10-22T19:51:33.486427] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:51:33.486662] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-22T19:51:33.486727] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-22T19:51:33.486908] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-22T19:51:33.486945] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-22T19:51:33.722958] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-22T19:51:33.834223] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:51:34.314274] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-22T19:51:34.315492] [INFO ] [REMOTE ] MFAO: Full fetch complete (5471 records). [2025-10-22T19:51:34.315561] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-22T19:51:34.523423] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-22T19:51:34.697084] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T19:51:34.769200] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-22T19:51:34.769282] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-22T19:51:34.769454] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-22T19:51:34.769533] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-22T19:51:34.769938] [DEBUG] [LOCAL ] MFAO: Trimmed 5471 records to 3896 (keeping 200 days of data) [2025-10-22T19:51:34.793202] [DEBUG] [LOCAL ] MFAO: Primary data saved (3896 records). [2025-10-22T19:51:34.793302] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-22T19:51:34.793379] [INFO ] [MAIN ] Update Progress: 1332/2367 symbols completed. MFAO took 27.0s. Estimated remaining: 2h 13m 16s. Rate: 7.8 symbols/min [2025-10-22T19:51:34.972120] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:51:34.972321] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-22T19:51:34.972359] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-22T19:51:34.972474] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-22T19:51:34.972515] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-22T19:51:34.972555] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-22T19:51:34.972605] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-22T19:51:35.318549] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:51:35.318784] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-22T19:51:36.023126] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T19:51:36.117669] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-22T19:51:36.408913] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T19:51:36.907595] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T19:51:36.917614] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-22T19:51:37.717732] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-22T19:51:37.757584] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-22T19:51:38.035803] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-22T19:51:38.517697] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-22T19:51:39.317737] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-22T19:51:39.516020] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-22T19:51:39.591224] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-22T19:51:40.117679] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-22T19:51:40.428949] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-22T19:51:40.917701] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-22T19:51:41.717720] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-22T19:51:42.517723] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-22T19:51:42.700031] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T19:51:43.216137] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T19:51:43.317673] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-22T19:51:43.399635] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T19:51:44.117699] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-22T19:51:44.426885] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-22T19:51:44.917630] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-22T19:51:44.949538] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T19:51:45.717718] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-22T19:51:45.962012] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-22T19:51:46.517719] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-22T19:51:46.652497] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T19:51:46.859173] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-22T19:51:47.317691] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-22T19:51:47.665560] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-22T19:51:48.117690] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-22T19:51:48.917683] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-22T19:51:49.717700] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-22T19:51:49.801005] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T19:51:49.912320] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T19:51:49.920599] [INFO ] [REMOTE ] MFC: Full fetch complete (74387 records). [2025-10-22T19:51:49.920782] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-22T19:51:50.276781] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T19:51:50.314432] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-22T19:51:50.314503] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-22T19:51:50.315480] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-22T19:51:50.315553] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-22T19:51:50.316876] [DEBUG] [LOCAL ] MFC: Trimmed 74387 records to 50997 (keeping 200 days of data) [2025-10-22T19:51:50.519567] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-22T19:51:50.612313] [DEBUG] [LOCAL ] MFC: Primary data saved (50997 records). [2025-10-22T19:51:50.612438] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-22T19:51:50.612511] [INFO ] [MAIN ] Update Progress: 1333/2367 symbols completed. MFC took 35.8s. Estimated remaining: 2h 13m 14s. Rate: 7.8 symbols/min [2025-10-22T19:51:50.826698] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:51:50.833101] [DEBUG] [LOCAL ] MFSG: Loaded 5924 existing records from primary storage. [2025-10-22T19:51:50.833289] [INFO ] [MAIN ] MFSG: Loaded 5924 existing records. [2025-10-22T19:51:51.013914] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:51:51.014160] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-22T19:51:51.014215] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-22T19:51:51.014395] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-22T19:51:51.014450] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-22T19:51:51.325890] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-22T19:51:51.366439] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:51:51.474512] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T19:51:51.881944] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-22T19:51:52.117676] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-22T19:51:52.770025] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-22T19:51:52.771414] [INFO ] [REMOTE ] MFSB: Full fetch complete (2056 records). [2025-10-22T19:51:52.771483] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-22T19:51:52.920515] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-22T19:51:52.958112] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-22T19:51:52.958437] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:51:52.958505] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:51:52.958575] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-22T19:51:52.958635] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-22T19:51:52.958719] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-22T19:51:52.958769] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-22T19:51:52.958825] [INFO ] [MAIN ] Update Progress: 1334/2367 symbols completed. MFSB took 18.2s. Estimated remaining: 2h 13m 2s. Rate: 7.8 symbols/min [2025-10-22T19:51:53.131854] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:51:53.144940] [DEBUG] [LOCAL ] MFSI: Loaded 12557 existing records from primary storage. [2025-10-22T19:51:53.145174] [INFO ] [MAIN ] MFSI: Loaded 12557 existing records. [2025-10-22T19:51:53.329804] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:51:53.330130] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-22T19:51:53.330198] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-22T19:51:53.330459] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-22T19:51:53.330517] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-22T19:51:53.686914] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:51:53.717691] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-22T19:51:54.420682] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T19:51:54.517713] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-22T19:51:54.764202] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T19:51:55.317664] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-22T19:51:55.482630] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-22T19:51:56.117711] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-22T19:51:56.534900] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-22T19:51:56.917671] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-22T19:51:57.105856] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T19:51:57.336496] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-22T19:51:57.717679] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-22T19:51:58.177565] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-22T19:51:58.517636] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-22T19:51:59.111839] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-22T19:51:59.317667] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-22T19:51:59.902112] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-22T19:52:00.117694] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-22T19:52:00.759120] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T19:52:00.917681] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-22T19:52:01.717788] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-22T19:52:02.327400] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-22T19:52:02.517709] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-22T19:52:02.616362] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T19:52:03.110013] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-22T19:52:03.317682] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-22T19:52:04.117684] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-22T19:52:04.206325] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T19:52:04.917681] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-22T19:52:05.681829] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-22T19:52:05.717627] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-22T19:52:05.892281] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T19:52:06.449582] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-22T19:52:06.517630] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-22T19:52:07.310852] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T19:52:07.317608] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-22T19:52:08.093923] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-22T19:52:08.096031] [INFO ] [REMOTE ] MFSG: Full fetch complete (6815 records). [2025-10-22T19:52:08.096107] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-22T19:52:08.122839] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-22T19:52:08.489399] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-22T19:52:08.489489] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-22T19:52:08.489760] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-22T19:52:08.489825] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-22T19:52:08.490348] [DEBUG] [LOCAL ] MFSG: Trimmed 6815 records to 5956 (keeping 200 days of data) [2025-10-22T19:52:08.526915] [DEBUG] [LOCAL ] MFSG: Primary data saved (5956 records). [2025-10-22T19:52:08.527054] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-22T19:52:08.527137] [INFO ] [MAIN ] Update Progress: 1335/2367 symbols completed. MFSG took 17.9s. Estimated remaining: 2h 13m 1s. Rate: 7.8 symbols/min [2025-10-22T19:52:08.702863] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:52:08.708369] [DEBUG] [LOCAL ] MFSV: Loaded 2921 existing records from primary storage. [2025-10-22T19:52:08.708594] [INFO ] [MAIN ] MFSV: Loaded 2921 existing records. [2025-10-22T19:52:08.892144] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:52:08.892386] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-22T19:52:08.892442] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-22T19:52:08.892599] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-22T19:52:08.892688] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-22T19:52:08.922778] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-22T19:52:09.015751] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T19:52:09.271178] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:52:09.717683] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-22T19:52:10.086165] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-22T19:52:10.517696] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-22T19:52:10.658955] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T19:52:10.887211] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-22T19:52:11.317720] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-22T19:52:12.117690] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-22T19:52:12.366751] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T19:52:12.369324] [INFO ] [REMOTE ] MFM: Full fetch complete (19420 records). [2025-10-22T19:52:12.369393] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-22T19:52:12.727227] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-22T19:52:12.727303] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-22T19:52:12.727738] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-22T19:52:12.727816] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-22T19:52:12.728355] [DEBUG] [LOCAL ] MFM: Trimmed 19420 records to 14090 (keeping 200 days of data) [2025-10-22T19:52:12.809538] [DEBUG] [LOCAL ] MFM: Primary data saved (14090 records). [2025-10-22T19:52:12.809710] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-22T19:52:12.809806] [INFO ] [MAIN ] Update Progress: 1336/2367 symbols completed. MFM took 39.7s. Estimated remaining: 2h 12m 50s. Rate: 7.8 symbols/min [2025-10-22T19:52:12.934505] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T19:52:12.922849] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-22T19:52:12.994345] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:52:13.010511] [DEBUG] [LOCAL ] MG: Loaded 15529 existing records from primary storage. [2025-10-22T19:52:13.010762] [INFO ] [MAIN ] MG: Loaded 15529 existing records. [2025-10-22T19:52:13.195114] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:52:13.195337] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-22T19:52:13.195386] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-22T19:52:13.195552] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-22T19:52:13.195606] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-22T19:52:13.565246] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:52:13.717686] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-22T19:52:14.517630] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-22T19:52:14.625584] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T19:52:14.753767] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-22T19:52:15.269491] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-22T19:52:15.317692] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-22T19:52:16.117729] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-22T19:52:16.917678] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-22T19:52:17.139800] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T19:52:17.148288] [INFO ] [REMOTE ] MFG: Full fetch complete (69808 records). [2025-10-22T19:52:17.148442] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-22T19:52:17.271813] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T19:52:17.441684] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-22T19:52:17.582285] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-22T19:52:17.582386] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-22T19:52:17.583479] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-22T19:52:17.583543] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-22T19:52:17.585107] [DEBUG] [LOCAL ] MFG: Trimmed 69808 records to 49552 (keeping 200 days of data) [2025-10-22T19:52:17.743036] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-22T19:52:17.863384] [DEBUG] [LOCAL ] MFG: Primary data saved (49552 records). [2025-10-22T19:52:17.863506] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-22T19:52:17.863582] [INFO ] [MAIN ] Update Progress: 1337/2367 symbols completed. MFG took 46.2s. Estimated remaining: 2h 12m 41s. Rate: 7.8 symbols/min [2025-10-22T19:52:18.046123] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:52:18.090069] [DEBUG] [LOCAL ] MGA: Loaded 50432 existing records from primary storage. [2025-10-22T19:52:18.090455] [INFO ] [MAIN ] MGA: Loaded 50432 existing records. [2025-10-22T19:52:18.290848] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:52:18.291087] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-22T19:52:18.291135] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-22T19:52:18.291331] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-22T19:52:18.291387] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-22T19:52:18.522785] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-22T19:52:18.679457] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:52:18.675882] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-22T19:52:19.048264] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-22T19:52:19.317698] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-22T19:52:20.117682] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-22T19:52:20.925669] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-22T19:52:20.944883] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T19:52:21.251902] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T19:52:21.357961] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-22T19:52:21.717720] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-22T19:52:22.071768] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-22T19:52:22.517666] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-22T19:52:22.950345] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-22T19:52:23.317702] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-22T19:52:24.117630] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-22T19:52:24.344775] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-22T19:52:24.676994] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T19:52:24.917691] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-22T19:52:25.499187] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T19:52:25.717686] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-22T19:52:26.517694] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-22T19:52:26.796203] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T19:52:27.317721] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-22T19:52:28.117681] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-22T19:52:28.286863] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T19:52:28.500971] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-22T19:52:28.728604] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-22T19:52:28.917677] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-22T19:52:29.717632] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-22T19:52:29.909692] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T19:52:30.517684] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-22T19:52:31.305608] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-22T19:52:31.307149] [INFO ] [REMOTE ] MFSV: Full fetch complete (3662 records). [2025-10-22T19:52:31.307242] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-22T19:52:31.336154] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-22T19:52:31.667254] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-22T19:52:31.677094] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-22T19:52:31.690998] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-22T19:52:31.693806] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-22T19:52:31.694416] [DEBUG] [LOCAL ] MFSV: Trimmed 3662 records to 2944 (keeping 200 days of data) [2025-10-22T19:52:31.696360] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-22T19:52:31.724986] [DEBUG] [LOCAL ] MFSV: Primary data saved (2944 records). [2025-10-22T19:52:31.725099] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-22T19:52:31.725176] [INFO ] [MAIN ] Update Progress: 1338/2367 symbols completed. MFSV took 23.2s. Estimated remaining: 2h 12m 38s. Rate: 7.8 symbols/min [2025-10-22T19:52:31.889315] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:52:31.895840] [DEBUG] [LOCAL ] MGF: Loaded 4170 existing records from primary storage. [2025-10-22T19:52:31.896039] [INFO ] [MAIN ] MGF: Loaded 4170 existing records. [2025-10-22T19:52:32.073529] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:52:32.073794] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-22T19:52:32.073854] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-22T19:52:32.073977] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-22T19:52:32.074034] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-22T19:52:32.125924] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-22T19:52:32.426488] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:52:32.437495] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T19:52:32.440879] [INFO ] [REMOTE ] MFSI: Full fetch complete (14961 records). [2025-10-22T19:52:32.440954] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-22T19:52:32.847396] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-22T19:52:32.847483] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-22T19:52:32.847888] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-22T19:52:32.847970] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-22T19:52:32.848586] [DEBUG] [LOCAL ] MFSI: Trimmed 14961 records to 12648 (keeping 200 days of data) [2025-10-22T19:52:32.921102] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-22T19:52:32.940205] [DEBUG] [LOCAL ] MFSI: Primary data saved (12648 records). [2025-10-22T19:52:32.940637] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-22T19:52:32.940762] [INFO ] [MAIN ] Update Progress: 1339/2367 symbols completed. MFSI took 40.0s. Estimated remaining: 2h 12m 25s. Rate: 7.8 symbols/min [2025-10-22T19:52:33.124691] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:52:33.173188] [DEBUG] [LOCAL ] MGM: Loaded 53605 existing records from primary storage. [2025-10-22T19:52:33.173530] [INFO ] [MAIN ] MGM: Loaded 53605 existing records. [2025-10-22T19:52:33.343953] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:52:33.344137] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-22T19:52:33.344185] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-22T19:52:33.344380] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-22T19:52:33.344446] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-22T19:52:33.704639] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:52:33.717612] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-22T19:52:33.977626] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T19:52:34.007594] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T19:52:34.517630] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-22T19:52:35.200552] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T19:52:35.317633] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-22T19:52:35.410331] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T19:52:36.117769] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-22T19:52:36.680917] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-22T19:52:36.917699] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-22T19:52:37.107693] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T19:52:37.717685] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-22T19:52:38.270948] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-22T19:52:38.517717] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-22T19:52:38.661256] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T19:52:39.058789] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-22T19:52:39.317695] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-22T19:52:40.117738] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-22T19:52:40.681799] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-22T19:52:40.917706] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-22T19:52:41.133781] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T19:52:41.423306] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-22T19:52:41.717696] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-22T19:52:42.517667] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-22T19:52:43.317689] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-22T19:52:43.599745] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T19:52:43.618907] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T19:52:43.621566] [INFO ] [REMOTE ] MG: Full fetch complete (23289 records). [2025-10-22T19:52:43.621662] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-22T19:52:43.988025] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-22T19:52:43.988127] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-22T19:52:43.988752] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-22T19:52:43.993696] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-22T19:52:43.993844] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-22T19:52:43.996429] [DEBUG] [LOCAL ] MG: Trimmed 23289 records to 15383 (keeping 200 days of data) [2025-10-22T19:52:44.086455] [DEBUG] [LOCAL ] MG: Primary data saved (15383 records). [2025-10-22T19:52:44.086623] [INFO ] [MAIN ] MG: Full history saved. [2025-10-22T19:52:44.086758] [INFO ] [MAIN ] Update Progress: 1340/2367 symbols completed. MG took 31.3s. Estimated remaining: 2h 12m 20s. Rate: 7.8 symbols/min [2025-10-22T19:52:44.120247] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-22T19:52:44.265574] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:52:44.272324] [DEBUG] [LOCAL ] MGR: Loaded 5572 existing records from primary storage. [2025-10-22T19:52:44.272518] [INFO ] [MAIN ] MGR: Loaded 5572 existing records. [2025-10-22T19:52:44.452065] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:52:44.452312] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-22T19:52:44.452364] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-22T19:52:44.452539] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-22T19:52:44.452598] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-22T19:52:44.797882] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:52:44.917667] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-22T19:52:45.541011] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-22T19:52:45.717675] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-22T19:52:46.034773] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T19:52:46.517703] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-22T19:52:47.060248] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-22T19:52:47.317632] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-22T19:52:47.472748] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T19:52:47.959050] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-22T19:52:48.117711] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-22T19:52:48.917698] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-22T19:52:49.717618] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-22T19:52:49.878824] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T19:52:50.317026] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-22T19:52:50.517634] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-22T19:52:50.647452] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T19:52:51.093118] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-22T19:52:51.317685] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-22T19:52:51.901131] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-22T19:52:52.117670] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-22T19:52:52.917676] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-22T19:52:53.654566] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-22T19:52:53.717683] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-22T19:52:53.814293] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T19:52:54.517725] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-22T19:52:55.317730] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-22T19:52:55.653751] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T19:52:55.937952] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-22T19:52:56.117633] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-22T19:52:56.233253] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T19:52:56.917691] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-22T19:52:57.717709] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-22T19:52:57.809320] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T19:52:58.371494] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T19:52:58.517630] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-22T19:52:58.674489] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-22T19:52:58.684940] [INFO ] [REMOTE ] MGA: Full fetch complete (73707 records). [2025-10-22T19:52:58.685082] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-22T19:52:59.088099] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-22T19:52:59.088194] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-22T19:52:59.089422] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-22T19:52:59.089489] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-22T19:52:59.091071] [DEBUG] [LOCAL ] MGA: Trimmed 73707 records to 50391 (keeping 200 days of data) [2025-10-22T19:52:59.214991] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-22T19:52:59.318011] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-22T19:52:59.402423] [DEBUG] [LOCAL ] MGA: Primary data saved (50391 records). [2025-10-22T19:52:59.402546] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-22T19:52:59.402622] [INFO ] [MAIN ] Update Progress: 1341/2367 symbols completed. MGA took 41.5s. Estimated remaining: 2h 12m 18s. Rate: 7.8 symbols/min [2025-10-22T19:52:59.593381] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:52:59.598854] [DEBUG] [LOCAL ] MGRB: Loaded 3996 existing records from primary storage. [2025-10-22T19:52:59.599016] [INFO ] [MAIN ] MGRB: Loaded 3996 existing records. [2025-10-22T19:52:59.775287] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:52:59.775489] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-22T19:52:59.775534] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-22T19:52:59.775707] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-10-22T19:52:59.775763] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-22T19:52:59.907057] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-22T19:53:00.127297] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-22T19:53:00.134043] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:53:00.846517] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-22T19:53:00.847730] [INFO ] [REMOTE ] MGF: Full fetch complete (5755 records). [2025-10-22T19:53:00.847821] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-22T19:53:00.923065] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-22T19:53:01.229840] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-22T19:53:01.229917] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-22T19:53:01.230091] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-22T19:53:01.230129] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-22T19:53:01.230541] [DEBUG] [LOCAL ] MGF: Trimmed 5755 records to 4133 (keeping 200 days of data) [2025-10-22T19:53:01.254876] [DEBUG] [LOCAL ] MGF: Primary data saved (4133 records). [2025-10-22T19:53:01.255010] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-22T19:53:01.255089] [INFO ] [MAIN ] Update Progress: 1342/2367 symbols completed. MGF took 29.5s. Estimated remaining: 2h 12m 6s. Rate: 7.8 symbols/min [2025-10-22T19:53:01.424346] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:53:01.429217] [DEBUG] [LOCAL ] MGRD: Loaded 2207 existing records from primary storage. [2025-10-22T19:53:01.429431] [INFO ] [MAIN ] MGRD: Loaded 2207 existing records. [2025-10-22T19:53:01.611549] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:53:01.611795] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-22T19:53:01.611850] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-22T19:53:01.611975] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-22T19:53:01.612014] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-22T19:53:01.727348] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-22T19:53:01.950990] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-22T19:53:02.030005] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:53:02.517710] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-22T19:53:02.885075] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T19:53:02.959591] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-22T19:53:03.317721] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-22T19:53:03.805032] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-22T19:53:04.117696] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-22T19:53:04.724753] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-22T19:53:04.917698] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-22T19:53:05.451507] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-22T19:53:05.717706] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-22T19:53:06.310003] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-22T19:53:06.517635] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-22T19:53:07.030229] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-22T19:53:07.317689] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-22T19:53:07.772503] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T19:53:08.117658] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-22T19:53:08.559526] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-22T19:53:08.917703] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-22T19:53:09.603217] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-22T19:53:09.604615] [INFO ] [REMOTE ] MGR: Full fetch complete (7836 records). [2025-10-22T19:53:09.604707] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-22T19:53:09.722773] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-22T19:53:09.960353] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-22T19:53:09.960425] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-22T19:53:09.960614] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-22T19:53:09.960680] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-22T19:53:09.961080] [DEBUG] [LOCAL ] MGR: Trimmed 7836 records to 5536 (keeping 200 days of data) [2025-10-22T19:53:09.993170] [DEBUG] [LOCAL ] MGR: Primary data saved (5536 records). [2025-10-22T19:53:09.993241] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-22T19:53:09.993317] [INFO ] [MAIN ] Update Progress: 1343/2367 symbols completed. MGR took 25.9s. Estimated remaining: 2h 11m 59s. Rate: 7.8 symbols/min [2025-10-22T19:53:10.158221] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:53:10.166746] [DEBUG] [LOCAL ] MGRE: Loaded 6470 existing records from primary storage. [2025-10-22T19:53:10.166938] [INFO ] [MAIN ] MGRE: Loaded 6470 existing records. [2025-10-22T19:53:10.341225] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:53:10.341407] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-22T19:53:10.341474] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-22T19:53:10.341707] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-22T19:53:10.341783] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-22T19:53:10.445439] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-22T19:53:10.519343] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-22T19:53:10.707535] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:53:11.142170] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-22T19:53:11.317632] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-22T19:53:12.117623] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-22T19:53:12.205219] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T19:53:12.630002] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-22T19:53:12.917698] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-22T19:53:13.717726] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-22T19:53:14.278736] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T19:53:14.517769] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-22T19:53:14.889662] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-22T19:53:15.317728] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-22T19:53:15.323564] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-22T19:53:16.117695] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-22T19:53:16.567700] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-22T19:53:16.917728] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-22T19:53:17.383519] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-22T19:53:17.438084] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T19:53:17.451539] [INFO ] [REMOTE ] MGM: Full fetch complete (77761 records). [2025-10-22T19:53:17.451778] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-22T19:53:17.724180] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-22T19:53:17.857122] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-22T19:53:17.857202] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-22T19:53:17.858250] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-22T19:53:17.858314] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-22T19:53:17.859752] [DEBUG] [LOCAL ] MGM: Trimmed 77761 records to 53605 (keeping 200 days of data) [2025-10-22T19:53:18.170251] [DEBUG] [LOCAL ] MGM: Primary data saved (53605 records). [2025-10-22T19:53:18.170377] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-22T19:53:18.170465] [INFO ] [MAIN ] Update Progress: 1344/2367 symbols completed. MGM took 45.2s. Estimated remaining: 2h 11m 51s. Rate: 7.8 symbols/min [2025-10-22T19:53:18.339554] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:53:18.339759] [DEBUG] [LOCAL ] MGY: No existing data file found in primary storage. [2025-10-22T19:53:18.339812] [WARN ] [MAIN ] MGY: No existing data found, performing full refresh instead. [2025-10-22T19:53:18.339923] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-22T19:53:18.339965] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-22T19:53:18.340006] [DEBUG] [LOCAL ] MGY: No primary data file found to delete. [2025-10-22T19:53:18.340040] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-22T19:53:18.446040] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T19:53:18.523091] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-22T19:53:18.704412] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:53:19.195843] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-22T19:53:19.317733] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-22T19:53:20.117782] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-22T19:53:20.917772] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-22T19:53:20.974706] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-22T19:53:20.981482] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T19:53:21.348435] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-22T19:53:21.717778] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-22T19:53:22.315894] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T19:53:22.517734] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-22T19:53:22.990151] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-22T19:53:23.317736] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-22T19:53:24.117713] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-22T19:53:24.917626] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-22T19:53:25.061097] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T19:53:25.098248] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T19:53:25.717740] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-22T19:53:25.943606] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T19:53:25.944850] [INFO ] [REMOTE ] MGRB: Full fetch complete (5524 records). [2025-10-22T19:53:25.944924] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-22T19:53:26.329714] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-22T19:53:26.329884] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-22T19:53:26.330061] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-22T19:53:26.330102] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-22T19:53:26.330517] [DEBUG] [LOCAL ] MGRB: Trimmed 5524 records to 3994 (keeping 200 days of data) [2025-10-22T19:53:26.355772] [DEBUG] [LOCAL ] MGRB: Primary data saved (3994 records). [2025-10-22T19:53:26.355908] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-22T19:53:26.355992] [INFO ] [MAIN ] Update Progress: 1345/2367 symbols completed. MGRB took 27.0s. Estimated remaining: 2h 11m 44s. Rate: 7.8 symbols/min [2025-10-22T19:53:26.531193] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-22T19:53:26.539497] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-22T19:53:26.538603] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:53:26.543771] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-22T19:53:26.543820] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-22T19:53:26.543931] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-22T19:53:26.543972] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-22T19:53:26.544012] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-22T19:53:26.544045] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-22T19:53:26.882405] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-22T19:53:26.902530] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:53:27.317774] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-01. [2025-10-22T19:53:27.520024] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:53:27.520386] [WARN ] [REMOTE ] MH: No data returned for month 2025-01 [2025-10-22T19:53:27.520482] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:53:27.520560] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-22T19:53:27.520626] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:53:27.520725] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-22T19:53:27.520791] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-22T19:53:27.520829] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-22T19:53:27.520870] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-22T19:53:27.520918] [INFO ] [MAIN ] Update Progress: 1346/2367 symbols completed. MH took 1.2s. Estimated remaining: 2h 11m 31s. Rate: 7.8 symbols/min [2025-10-22T19:53:27.704945] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:53:27.716934] [DEBUG] [LOCAL ] MHD: Loaded 12010 existing records from primary storage. [2025-10-22T19:53:27.717164] [INFO ] [MAIN ] MHD: Loaded 12010 existing records. [2025-10-22T19:53:27.889978] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:53:27.890187] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-22T19:53:27.890234] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-22T19:53:27.890481] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-22T19:53:27.890536] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-22T19:53:28.126071] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-22T19:53:28.241553] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:53:28.752755] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-22T19:53:28.753663] [INFO ] [REMOTE ] MGRD: Full fetch complete (3299 records). [2025-10-22T19:53:28.753735] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-22T19:53:28.923471] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-22T19:53:29.105414] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-22T19:53:29.105489] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-22T19:53:29.105594] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-22T19:53:29.105678] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-22T19:53:29.106035] [DEBUG] [LOCAL ] MGRD: Trimmed 3299 records to 2206 (keeping 200 days of data) [2025-10-22T19:53:29.119295] [DEBUG] [LOCAL ] MGRD: Primary data saved (2206 records). [2025-10-22T19:53:29.119380] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-22T19:53:29.119451] [INFO ] [MAIN ] Update Progress: 1347/2367 symbols completed. MGRD took 27.9s. Estimated remaining: 2h 11m 19s. Rate: 7.8 symbols/min [2025-10-22T19:53:29.284714] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:53:29.294057] [DEBUG] [LOCAL ] MHF: Loaded 9061 existing records from primary storage. [2025-10-22T19:53:29.294258] [INFO ] [MAIN ] MHF: Loaded 9061 existing records. [2025-10-22T19:53:29.480829] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:53:29.481063] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-22T19:53:29.481122] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-22T19:53:29.481318] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-22T19:53:29.481373] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-22T19:53:29.726896] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-22T19:53:29.848904] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:53:30.517701] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-22T19:53:30.694197] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T19:53:30.765505] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T19:53:30.980693] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-22T19:53:31.317732] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-22T19:53:32.110546] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T19:53:32.117603] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-22T19:53:32.917727] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-22T19:53:32.930269] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T19:53:33.621618] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T19:53:33.717629] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-22T19:53:34.394365] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-22T19:53:34.395727] [INFO ] [REMOTE ] MGRE: Full fetch complete (9185 records). [2025-10-22T19:53:34.395800] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-22T19:53:34.522785] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-22T19:53:34.768373] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-22T19:53:34.768471] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-22T19:53:34.768768] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-22T19:53:34.768831] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-22T19:53:34.769347] [DEBUG] [LOCAL ] MGRE: Trimmed 9185 records to 6420 (keeping 200 days of data) [2025-10-22T19:53:34.807273] [DEBUG] [LOCAL ] MGRE: Primary data saved (6420 records). [2025-10-22T19:53:34.807387] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-22T19:53:34.807462] [INFO ] [MAIN ] Update Progress: 1348/2367 symbols completed. MGRE took 24.8s. Estimated remaining: 2h 11m 9s. Rate: 7.8 symbols/min [2025-10-22T19:53:34.975140] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:53:35.016112] [DEBUG] [LOCAL ] MHK: Loaded 42005 existing records from primary storage. [2025-10-22T19:53:35.016410] [INFO ] [MAIN ] MHK: Loaded 42005 existing records. [2025-10-22T19:53:35.190579] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:53:35.190834] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-22T19:53:35.190882] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-22T19:53:35.191108] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-22T19:53:35.191164] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-22T19:53:35.329325] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-22T19:53:35.550147] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:53:36.117729] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-22T19:53:36.401738] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T19:53:36.398115] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-22T19:53:36.917725] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-22T19:53:37.667224] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-22T19:53:37.694595] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-22T19:53:37.717636] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-22T19:53:38.517725] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-22T19:53:38.563766] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T19:53:39.317772] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-22T19:53:40.124342] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-22T19:53:40.148052] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T19:53:40.370209] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T19:53:40.917672] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-10-22T19:53:40.981399] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T19:53:41.717735] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-22T19:53:42.105766] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T19:53:42.520337] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-10-22T19:53:42.522869] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T19:53:43.317725] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-22T19:53:43.963493] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T19:53:44.117637] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-22T19:53:44.243326] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T19:53:44.917785] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-22T19:53:45.621043] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-22T19:53:45.709862] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T19:53:45.718474] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-22T19:53:46.404191] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-22T19:53:46.517738] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-22T19:53:47.318122] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-10-22T19:53:47.319242] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-22T19:53:48.117685] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-22T19:53:48.730104] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-22T19:53:48.917619] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-22T19:53:49.010308] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T19:53:49.643407] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-22T19:53:49.717629] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-22T19:53:50.517627] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-22T19:53:50.721309] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T19:53:51.317691] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-10-22T19:53:52.117783] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-22T19:53:52.243475] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T19:53:52.926307] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-22T19:53:52.929135] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T19:53:52.992446] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T19:53:52.994706] [INFO ] [REMOTE ] MHD: Full fetch complete (18115 records). [2025-10-22T19:53:52.994774] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-22T19:53:53.348321] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-22T19:53:53.348392] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-22T19:53:53.348761] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-22T19:53:53.348821] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-22T19:53:53.349310] [DEBUG] [LOCAL ] MHD: Trimmed 18115 records to 11922 (keeping 200 days of data) [2025-10-22T19:53:53.420612] [DEBUG] [LOCAL ] MHD: Primary data saved (11922 records). [2025-10-22T19:53:53.420777] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-22T19:53:53.420864] [INFO ] [MAIN ] Update Progress: 1349/2367 symbols completed. MHD took 25.9s. Estimated remaining: 2h 11m 10s. Rate: 7.8 symbols/min [2025-10-22T19:53:53.546004] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T19:53:53.600874] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:53:53.601064] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-22T19:53:53.601117] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-22T19:53:53.601228] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-22T19:53:53.601268] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-22T19:53:53.601309] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-22T19:53:53.601341] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-22T19:53:53.722799] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-10. [2025-10-22T19:53:53.948011] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:53:54.517667] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-22T19:53:54.874421] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-22T19:53:55.317629] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-22T19:53:55.647113] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-22T19:53:55.792098] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T19:53:55.800926] [INFO ] [REMOTE ] MGY: Full fetch complete (75961 records). [2025-10-22T19:53:55.801066] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-10-22T19:53:56.122856] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-22T19:53:56.213451] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-10-22T19:53:56.213526] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-10-22T19:53:56.214559] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-10-22T19:53:56.214619] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-10-22T19:53:56.216018] [DEBUG] [LOCAL ] MGY: Trimmed 75961 records to 52424 (keeping 200 days of data) [2025-10-22T19:53:56.525357] [DEBUG] [LOCAL ] MGY: Primary data saved (52424 records). [2025-10-22T19:53:56.525485] [INFO ] [MAIN ] MGY: Full history saved. [2025-10-22T19:53:56.525554] [INFO ] [MAIN ] Update Progress: 1350/2367 symbols completed. MGY took 38.4s. Estimated remaining: 2h 10m 59s. Rate: 7.8 symbols/min [2025-10-22T19:53:56.691853] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:53:56.700960] [DEBUG] [LOCAL ] MHN: Loaded 7437 existing records from primary storage. [2025-10-22T19:53:56.701152] [INFO ] [MAIN ] MHN: Loaded 7437 existing records. [2025-10-22T19:53:56.877425] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:53:56.877618] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-22T19:53:56.877695] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-22T19:53:56.877870] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-22T19:53:56.877923] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-22T19:53:56.920626] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-22T19:53:57.003831] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T19:53:57.260903] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:53:57.309851] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-22T19:53:57.717694] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-22T19:53:58.478080] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-22T19:53:58.517611] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-22T19:53:59.317626] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-22T19:53:59.447872] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T19:53:59.449890] [INFO ] [REMOTE ] MHF: Full fetch complete (12793 records). [2025-10-22T19:53:59.449958] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-22T19:53:59.819882] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-22T19:53:59.830389] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-22T19:53:59.830456] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-22T19:53:59.830816] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-22T19:53:59.830878] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-22T19:53:59.831358] [DEBUG] [LOCAL ] MHF: Trimmed 12793 records to 9054 (keeping 200 days of data) [2025-10-22T19:53:59.882701] [DEBUG] [LOCAL ] MHF: Primary data saved (9054 records). [2025-10-22T19:53:59.882817] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-22T19:53:59.882893] [INFO ] [MAIN ] Update Progress: 1351/2367 symbols completed. MHF took 30.8s. Estimated remaining: 2h 10m 48s. Rate: 7.8 symbols/min [2025-10-22T19:54:00.054041] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:54:00.075222] [DEBUG] [LOCAL ] MHO: Loaded 23733 existing records from primary storage. [2025-10-22T19:54:00.075683] [INFO ] [MAIN ] MHO: Loaded 23733 existing records. [2025-10-22T19:54:00.128026] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-22T19:54:00.256876] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:54:00.257074] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-22T19:54:00.257122] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-22T19:54:00.257302] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-22T19:54:00.257340] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-22T19:54:00.612726] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:54:00.917634] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-22T19:54:01.717708] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-22T19:54:01.790704] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T19:54:01.820972] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-22T19:54:02.517718] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-22T19:54:03.096897] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T19:54:03.131781] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-22T19:54:03.317669] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-22T19:54:04.117691] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-22T19:54:04.457405] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-22T19:54:04.781571] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T19:54:04.917669] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-22T19:54:05.717709] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-22T19:54:06.351887] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T19:54:06.465157] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-22T19:54:06.517677] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-22T19:54:07.231963] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-22T19:54:07.317661] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-22T19:54:07.552823] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-22T19:54:08.117740] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-22T19:54:08.903448] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T19:54:08.917634] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-22T19:54:09.625902] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-22T19:54:09.717730] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-22T19:54:10.329767] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-22T19:54:10.517671] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-22T19:54:11.317678] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-22T19:54:12.123358] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-22T19:54:12.137410] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T19:54:12.589376] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-22T19:54:12.917673] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-22T19:54:12.972844] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-22T19:54:13.717667] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-22T19:54:14.174551] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T19:54:14.517714] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-22T19:54:14.838974] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-22T19:54:15.123371] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T19:54:15.317679] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-22T19:54:16.117684] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-22T19:54:16.484660] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-22T19:54:16.794995] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T19:54:16.917706] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-22T19:54:17.717701] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-22T19:54:18.058302] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-22T19:54:18.085893] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-22T19:54:18.086460] [INFO ] [REMOTE ] MHLA: Full fetch complete (1489 records). [2025-10-22T19:54:18.086554] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-22T19:54:18.263045] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-10-22T19:54:18.263220] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:54:18.263286] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:54:18.263357] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-22T19:54:18.263418] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-22T19:54:18.263453] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-22T19:54:18.263492] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-22T19:54:18.263546] [INFO ] [MAIN ] Update Progress: 1352/2367 symbols completed. MHLA took 24.8s. Estimated remaining: 2h 10m 48s. Rate: 7.8 symbols/min [2025-10-22T19:54:18.427878] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:54:18.428043] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-22T19:54:18.428079] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-22T19:54:18.428185] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-22T19:54:18.428224] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-22T19:54:18.428264] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-22T19:54:18.428299] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-22T19:54:18.523894] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-22T19:54:18.780458] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:54:19.268028] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T19:54:19.317714] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-22T19:54:20.010503] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-22T19:54:20.117684] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-22T19:54:20.917709] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-01. [2025-10-22T19:54:21.116031] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:54:21.116380] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-01 [2025-10-22T19:54:21.116497] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:54:21.116570] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-22T19:54:21.116635] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:54:21.116734] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-22T19:54:21.116801] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-22T19:54:21.116836] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-22T19:54:21.116874] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-22T19:54:21.116919] [INFO ] [MAIN ] Update Progress: 1353/2367 symbols completed. MIAX took 2.9s. Estimated remaining: 2h 10m 37s. Rate: 7.8 symbols/min [2025-10-22T19:54:21.306315] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:54:21.323233] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T19:54:21.345516] [DEBUG] [LOCAL ] MIN: Loaded 13992 existing records from primary storage. [2025-10-22T19:54:21.345875] [INFO ] [MAIN ] MIN: Loaded 13992 existing records. [2025-10-22T19:54:21.536113] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:54:21.536338] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-22T19:54:21.536428] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-22T19:54:21.536622] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-22T19:54:21.536720] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-22T19:54:21.722849] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-22T19:54:21.915229] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:54:22.517671] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-22T19:54:23.317621] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-22T19:54:23.426134] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T19:54:23.430041] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T19:54:23.430620] [INFO ] [REMOTE ] MHN: Full fetch complete (11410 records). [2025-10-22T19:54:23.437985] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-22T19:54:23.481678] [INFO ] [REMOTE ] MHK: Full fetch complete (61324 records). [2025-10-22T19:54:23.514080] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-22T19:54:24.122856] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-22T19:54:24.191403] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-22T19:54:24.207107] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-22T19:54:24.265864] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-22T19:54:24.269862] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-22T19:54:24.292071] [DEBUG] [LOCAL ] MHN: Trimmed 11410 records to 7382 (keeping 200 days of data) [2025-10-22T19:54:24.368260] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-22T19:54:24.368381] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-22T19:54:24.387562] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-22T19:54:24.402978] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-22T19:54:24.413758] [DEBUG] [LOCAL ] MHK: Trimmed 61324 records to 41973 (keeping 200 days of data) [2025-10-22T19:54:24.418604] [DEBUG] [LOCAL ] MHN: Primary data saved (7382 records). [2025-10-22T19:54:24.419040] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-22T19:54:24.419264] [INFO ] [MAIN ] Update Progress: 1354/2367 symbols completed. MHN took 27.9s. Estimated remaining: 2h 10m 26s. Rate: 7.8 symbols/min [2025-10-22T19:54:24.527258] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T19:54:24.742938] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:54:24.878834] [DEBUG] [LOCAL ] MHK: Primary data saved (41973 records). [2025-10-22T19:54:24.893627] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-22T19:54:24.894537] [INFO ] [MAIN ] Update Progress: 1355/2367 symbols completed. MHK took 50.1s. Estimated remaining: 2h 10m 12s. Rate: 7.8 symbols/min [2025-10-22T19:54:24.925831] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-22T19:54:25.004345] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T19:54:25.026389] [DEBUG] [LOCAL ] MIR: Loaded 51399 existing records from primary storage. [2025-10-22T19:54:25.042445] [INFO ] [MAIN ] MIR: Loaded 51399 existing records. [2025-10-22T19:54:25.196421] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:54:25.196625] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-22T19:54:25.202441] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-22T19:54:25.223060] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-22T19:54:25.235579] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-22T19:54:25.252193] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-22T19:54:25.254814] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-22T19:54:25.339294] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:54:25.350687] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-22T19:54:25.355895] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-22T19:54:25.374376] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-10-22T19:54:25.376678] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-22T19:54:25.739238] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-22T19:54:25.930465] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:54:26.013369] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:54:26.246858] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T19:54:26.517686] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-22T19:54:26.524088] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T19:54:26.904984] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-22T19:54:27.317800] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-22T19:54:28.117694] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-22T19:54:28.541532] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-22T19:54:28.917629] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-22T19:54:29.003254] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T19:54:29.466029] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-22T19:54:29.717689] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-22T19:54:30.517704] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-22T19:54:30.919773] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T19:54:31.141917] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-22T19:54:31.317705] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-22T19:54:32.078835] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-22T19:54:32.117684] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-22T19:54:32.917687] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-22T19:54:33.349034] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T19:54:33.355245] [INFO ] [REMOTE ] MHO: Full fetch complete (36571 records). [2025-10-22T19:54:33.355355] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-22T19:54:33.356321] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-22T19:54:33.715607] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-22T19:54:33.715704] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-22T19:54:33.716409] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-22T19:54:33.716450] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-22T19:54:33.717202] [DEBUG] [LOCAL ] MHO: Trimmed 36571 records to 23675 (keeping 200 days of data) [2025-10-22T19:54:33.717797] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-22T19:54:33.860053] [DEBUG] [LOCAL ] MHO: Primary data saved (23675 records). [2025-10-22T19:54:33.860446] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-22T19:54:33.860531] [INFO ] [MAIN ] Update Progress: 1356/2367 symbols completed. MHO took 34.0s. Estimated remaining: 2h 10m 6s. Rate: 7.8 symbols/min [2025-10-22T19:54:34.025061] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:54:34.029754] [DEBUG] [LOCAL ] MITP: Loaded 2255 existing records from primary storage. [2025-10-22T19:54:34.029919] [INFO ] [MAIN ] MITP: Loaded 2255 existing records. [2025-10-22T19:54:34.201686] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:54:34.201876] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-22T19:54:34.201924] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-22T19:54:34.202292] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-10-22T19:54:34.202348] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-22T19:54:34.524817] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-22T19:54:34.548113] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:54:35.324059] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-22T19:54:35.340623] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T19:54:35.384459] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-22T19:54:35.688216] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-22T19:54:36.117662] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-22T19:54:36.921311] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-22T19:54:37.347077] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-22T19:54:37.717630] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-22T19:54:37.898501] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T19:54:38.144041] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-22T19:54:38.517780] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-22T19:54:39.314931] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T19:54:39.317933] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-22T19:54:39.422775] [DEBUG] [REMOTE ] MITP: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-22T19:54:39.423155] [WARN ] [REMOTE ] MITP: No data returned for month 2025-04 [2025-10-22T19:54:39.423282] [FATAL] [REMOTE ] MITP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:54:39.423385] [FATAL] [MAIN ] MITP: Failed to fetch primary data. [2025-10-22T19:54:39.423469] [WARN ] [MAIN ] MITP: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:54:39.423562] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-22T19:54:39.423678] [DEBUG] [LOCAL ] MITP: No primary data file found to delete. [2025-10-22T19:54:39.423754] [INFO ] [LOCAL ] MITP: Starting deletion of derivative data. [2025-10-22T19:54:39.423975] [DEBUG] [LOCAL ] MITP: Deleted derivative data file. [2025-10-22T19:54:39.424079] [INFO ] [MAIN ] Update Progress: 1357/2367 symbols completed. MITP took 5.6s. Estimated remaining: 2h 9m 56s. Rate: 7.8 symbols/min [2025-10-22T19:54:40.117677] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-22T19:54:40.447632] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-22T19:54:40.917668] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-22T19:54:41.717733] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-22T19:54:42.517716] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-22T19:54:42.540809] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-22T19:54:42.578725] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T19:54:42.890147] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-22T19:54:43.317674] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-22T19:54:44.117684] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-22T19:54:44.451526] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T19:54:44.917719] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-22T19:54:45.345663] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-22T19:54:45.717684] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-22T19:54:45.767285] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T19:54:46.065368] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-22T19:54:46.517678] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-22T19:54:47.317676] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-22T19:54:48.117792] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-22T19:54:48.237318] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-22T19:54:48.269820] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T19:54:48.616476] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-22T19:54:48.617294] [INFO ] [REMOTE ] MITN: Full fetch complete (2342 records). [2025-10-22T19:54:48.617374] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-22T19:54:48.617736] [FATAL] [VALIDATOR ] MITN: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T19:54:48.617842] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:54:48.617883] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:54:48.617918] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-22T19:54:48.617970] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-22T19:54:48.618022] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-22T19:54:48.618062] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-22T19:54:48.618113] [INFO ] [MAIN ] Update Progress: 1358/2367 symbols completed. MITN took 23.7s. Estimated remaining: 2h 9m 50s. Rate: 7.8 symbols/min [2025-10-22T19:54:48.917727] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-22T19:54:49.717737] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-22T19:54:50.466697] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-22T19:54:50.517623] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-22T19:54:50.686557] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T19:54:51.317684] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-22T19:54:51.528263] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T19:54:51.531348] [INFO ] [REMOTE ] MIN: Full fetch complete (17677 records). [2025-10-22T19:54:51.531458] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-22T19:54:51.885598] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-22T19:54:51.885691] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-22T19:54:51.886030] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-22T19:54:51.886071] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-22T19:54:51.886568] [DEBUG] [LOCAL ] MIN: Trimmed 17677 records to 13938 (keeping 200 days of data) [2025-10-22T19:54:51.963688] [DEBUG] [LOCAL ] MIN: Primary data saved (13938 records). [2025-10-22T19:54:51.963814] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-22T19:54:51.963890] [INFO ] [MAIN ] Update Progress: 1359/2367 symbols completed. MIN took 30.8s. Estimated remaining: 2h 9m 39s. Rate: 7.8 symbols/min [2025-10-22T19:54:53.056162] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T19:54:53.067692] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-22T19:54:54.870886] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T19:54:54.882178] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-22T19:54:56.865767] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T19:54:56.874691] [INFO ] [REMOTE ] MIR: Full fetch complete (73973 records). [2025-10-22T19:54:56.874831] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-22T19:54:57.265047] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-22T19:54:57.265129] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-22T19:54:57.266096] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-22T19:54:57.266156] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-22T19:54:57.267454] [DEBUG] [LOCAL ] MIR: Trimmed 73973 records to 51402 (keeping 200 days of data) [2025-10-22T19:54:57.557039] [DEBUG] [LOCAL ] MIR: Primary data saved (51402 records). [2025-10-22T19:54:57.557155] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-22T19:54:57.557230] [INFO ] [MAIN ] Update Progress: 1360/2367 symbols completed. MIR took 33.1s. Estimated remaining: 2h 9m 29s. Rate: 7.8 symbols/min [2025-10-22T19:54:58.100637] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:54:58.199415] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:54:58.191143] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:54:58.258104] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:54:58.265810] [DEBUG] [LOCAL ] MIY: Loaded 6214 existing records from primary storage. [2025-10-22T19:54:58.266287] [INFO ] [MAIN ] MIY: Loaded 6214 existing records. [2025-10-22T19:54:58.376937] [DEBUG] [LOCAL ] MITT: Loaded 22416 existing records from primary storage. [2025-10-22T19:54:58.411738] [INFO ] [MAIN ] MITT: Loaded 22416 existing records. [2025-10-22T19:54:58.565053] [DEBUG] [LOCAL ] MKL: Loaded 33977 existing records from primary storage. [2025-10-22T19:54:58.586914] [INFO ] [MAIN ] MKL: Loaded 33977 existing records. [2025-10-22T19:54:58.647149] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:54:58.726699] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-22T19:54:58.749518] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-22T19:54:58.801542] [DEBUG] [LOCAL ] MKC: Loaded 52527 existing records from primary storage. [2025-10-22T19:54:58.784865] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-22T19:54:58.822953] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-22T19:54:58.824234] [INFO ] [MAIN ] MKC: Loaded 52527 existing records. [2025-10-22T19:54:58.870352] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:54:58.944900] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-22T19:54:59.012872] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-22T19:54:59.049890] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-22T19:54:59.096244] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-22T19:54:59.142848] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:54:59.192955] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-22T19:54:59.208724] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-22T19:54:59.264971] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-22T19:54:59.345915] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-22T19:54:59.456241] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:54:59.479039] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-22T19:54:59.570888] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-22T19:54:59.614828] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-22T19:54:59.754404] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-22T19:54:59.843472] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:54:59.937891] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-22T19:55:00.430330] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:55:00.478037] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-22T19:55:00.554941] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:55:00.558485] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-22T19:55:00.637403] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:55:00.637830] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-22T19:55:00.875725] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T19:55:00.877477] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-22T19:55:01.529566] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T19:55:01.531265] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-22T19:55:01.781598] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T19:55:01.790225] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-22T19:55:02.190519] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-22T19:55:02.192407] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-22T19:55:02.225427] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T19:55:02.232732] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-22T19:55:02.336412] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T19:55:02.346973] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-22T19:55:02.913879] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-22T19:55:02.916692] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-22T19:55:02.943911] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T19:55:02.952424] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-22T19:55:03.430475] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T19:55:03.438737] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-22T19:55:03.555472] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T19:55:04.117674] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-22T19:55:04.165254] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-22T19:55:04.292875] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T19:55:04.697382] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-22T19:55:04.917628] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-22T19:55:04.972724] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T19:55:05.430793] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-22T19:55:05.717680] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-22T19:55:06.517703] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-22T19:55:07.317707] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-22T19:55:07.615884] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-22T19:55:07.923273] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T19:55:07.931270] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T19:55:08.117685] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-22T19:55:08.753628] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-22T19:55:08.917715] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-22T19:55:09.717634] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-22T19:55:09.817157] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-22T19:55:09.819135] [INFO ] [REMOTE ] MIY: Full fetch complete (8707 records). [2025-10-22T19:55:09.819216] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-22T19:55:10.178209] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-22T19:55:10.178296] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-22T19:55:10.178523] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-22T19:55:10.178564] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-22T19:55:10.179003] [DEBUG] [LOCAL ] MIY: Trimmed 8707 records to 6216 (keeping 200 days of data) [2025-10-22T19:55:10.215605] [DEBUG] [LOCAL ] MIY: Primary data saved (6216 records). [2025-10-22T19:55:10.215769] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-22T19:55:10.215855] [INFO ] [MAIN ] Update Progress: 1361/2367 symbols completed. MIY took 12.7s. Estimated remaining: 2h 9m 25s. Rate: 7.8 symbols/min [2025-10-22T19:55:10.384895] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:55:10.423118] [DEBUG] [LOCAL ] MLI: Loaded 43432 existing records from primary storage. [2025-10-22T19:55:10.423422] [INFO ] [MAIN ] MLI: Loaded 43432 existing records. [2025-10-22T19:55:10.522914] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-22T19:55:10.609510] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:55:10.609747] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-22T19:55:10.609836] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-22T19:55:10.610091] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-22T19:55:10.610162] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-22T19:55:10.977101] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:55:11.092927] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T19:55:11.317672] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-22T19:55:12.117772] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-22T19:55:12.331824] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T19:55:12.872677] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T19:55:12.917628] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-22T19:55:13.229324] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T19:55:13.717726] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-22T19:55:14.517671] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-22T19:55:14.588343] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T19:55:15.317731] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-22T19:55:15.440207] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T19:55:15.828598] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-22T19:55:16.108544] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T19:55:16.117616] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-22T19:55:16.917688] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-22T19:55:17.294638] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T19:55:17.717633] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-22T19:55:18.255153] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-22T19:55:18.517680] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-22T19:55:19.317772] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-22T19:55:19.624732] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-22T19:55:19.842971] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T19:55:20.117666] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-22T19:55:20.917682] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-22T19:55:21.021151] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T19:55:21.528811] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T19:55:21.717673] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-22T19:55:21.961949] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T19:55:22.517711] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-22T19:55:23.324276] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-22T19:55:23.345526] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T19:55:23.398527] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T19:55:24.117718] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-22T19:55:24.574516] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T19:55:24.580219] [INFO ] [REMOTE ] MKL: Full fetch complete (49912 records). [2025-10-22T19:55:24.580363] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-22T19:55:24.925828] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-22T19:55:24.970536] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-22T19:55:24.970623] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-22T19:55:24.971576] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-22T19:55:24.971628] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-22T19:55:24.973029] [DEBUG] [LOCAL ] MKL: Trimmed 49912 records to 33801 (keeping 200 days of data) [2025-10-22T19:55:25.198254] [DEBUG] [LOCAL ] MKL: Primary data saved (33801 records). [2025-10-22T19:55:25.199616] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T19:55:25.199126] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-22T19:55:25.204802] [INFO ] [MAIN ] Update Progress: 1362/2367 symbols completed. MKL took 27.6s. Estimated remaining: 2h 9m 23s. Rate: 7.8 symbols/min [2025-10-22T19:55:25.401278] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:55:25.427119] [DEBUG] [LOCAL ] MLM: Loaded 28871 existing records from primary storage. [2025-10-22T19:55:25.427382] [INFO ] [MAIN ] MLM: Loaded 28871 existing records. [2025-10-22T19:55:25.603550] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:55:25.603841] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-22T19:55:25.603904] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-22T19:55:25.604265] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-22T19:55:25.604333] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-22T19:55:25.718735] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-22T19:55:25.968678] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:55:26.495370] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T19:55:26.517635] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-22T19:55:27.317734] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-22T19:55:27.608544] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T19:55:28.103718] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T19:55:28.117688] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-22T19:55:28.165760] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-22T19:55:28.169503] [INFO ] [REMOTE ] MITT: Full fetch complete (33441 records). [2025-10-22T19:55:28.169598] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-22T19:55:28.536084] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-22T19:55:28.536171] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-22T19:55:28.536845] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-22T19:55:28.536916] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-22T19:55:28.537771] [DEBUG] [LOCAL ] MITT: Trimmed 33441 records to 22283 (keeping 200 days of data) [2025-10-22T19:55:28.664385] [DEBUG] [LOCAL ] MITT: Primary data saved (22283 records). [2025-10-22T19:55:28.664510] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-22T19:55:28.664588] [INFO ] [MAIN ] Update Progress: 1363/2367 symbols completed. MITT took 31.1s. Estimated remaining: 2h 9m 12s. Rate: 7.8 symbols/min [2025-10-22T19:55:28.840826] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:55:28.867583] [DEBUG] [LOCAL ] MLNK: Loaded 27266 existing records from primary storage. [2025-10-22T19:55:28.867897] [INFO ] [MAIN ] MLNK: Loaded 27266 existing records. [2025-10-22T19:55:28.927484] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-22T19:55:29.068175] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:55:29.068434] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-10-22T19:55:29.068494] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-10-22T19:55:29.068830] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-10-22T19:55:29.068888] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-10-22T19:55:29.461323] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:55:29.705879] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T19:55:29.717629] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-22T19:55:30.517670] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-22T19:55:30.612098] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T19:55:31.230796] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T19:55:31.317673] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-22T19:55:32.117635] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-10-22T19:55:32.333924] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T19:55:32.917186] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T19:55:32.920176] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-22T19:55:33.236867] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T19:55:33.717678] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-22T19:55:34.517735] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-22T19:55:34.594045] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T19:55:35.317808] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-22T19:55:35.466513] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T19:55:35.948563] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T19:55:36.117700] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-22T19:55:36.485899] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T19:55:36.917780] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-22T19:55:37.347014] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T19:55:37.494421] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-22T19:55:37.503247] [INFO ] [REMOTE ] MKC: Full fetch complete (75997 records). [2025-10-22T19:55:37.503402] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-22T19:55:37.727370] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-22T19:55:37.904225] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-22T19:55:37.904322] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-22T19:55:37.905499] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-22T19:55:37.905570] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-22T19:55:37.907084] [DEBUG] [LOCAL ] MKC: Trimmed 75997 records to 52525 (keeping 200 days of data) [2025-10-22T19:55:38.234126] [DEBUG] [LOCAL ] MKC: Primary data saved (52525 records). [2025-10-22T19:55:38.234248] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-22T19:55:38.234327] [INFO ] [MAIN ] Update Progress: 1364/2367 symbols completed. MKC took 40.7s. Estimated remaining: 2h 9m 6s. Rate: 7.8 symbols/min [2025-10-22T19:55:38.405734] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:55:38.410860] [DEBUG] [LOCAL ] MLP: Loaded 3066 existing records from primary storage. [2025-10-22T19:55:38.411007] [INFO ] [MAIN ] MLP: Loaded 3066 existing records. [2025-10-22T19:55:38.522732] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-10-22T19:55:38.596849] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:55:38.597150] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-22T19:55:38.597208] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-22T19:55:38.597350] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-22T19:55:38.597405] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-22T19:55:38.983611] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:55:39.071519] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-22T19:55:39.317626] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-22T19:55:39.650686] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T19:55:39.887920] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-22T19:55:40.117674] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-22T19:55:40.917723] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-22T19:55:41.717687] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-10-22T19:55:41.739056] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T19:55:41.781408] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T19:55:42.517712] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-22T19:55:42.893758] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-22T19:55:42.997157] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-22T19:55:43.317719] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-10-22T19:55:44.117773] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-22T19:55:44.400096] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T19:55:44.917639] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-22T19:55:45.459224] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T19:55:45.717780] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-22T19:55:46.517702] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-22T19:55:46.727854] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T19:55:46.735248] [INFO ] [REMOTE ] MLI: Full fetch complete (63254 records). [2025-10-22T19:55:46.735402] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-22T19:55:47.121330] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-22T19:55:47.187053] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-22T19:55:47.187216] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-22T19:55:47.189483] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-22T19:55:47.191406] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T19:55:47.191594] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-22T19:55:47.202557] [DEBUG] [LOCAL ] MLI: Trimmed 63254 records to 43388 (keeping 200 days of data) [2025-10-22T19:55:47.326858] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-10-22T19:55:47.616047] [DEBUG] [LOCAL ] MLI: Primary data saved (43388 records). [2025-10-22T19:55:47.616236] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-22T19:55:47.616358] [INFO ] [MAIN ] Update Progress: 1365/2367 symbols completed. MLI took 37.4s. Estimated remaining: 2h 8m 59s. Rate: 7.8 symbols/min [2025-10-22T19:55:47.882030] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:55:47.882263] [DEBUG] [LOCAL ] MLR: No existing data file found in primary storage. [2025-10-22T19:55:47.882307] [WARN ] [MAIN ] MLR: No existing data found, performing full refresh instead. [2025-10-22T19:55:47.882428] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-22T19:55:47.882469] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-22T19:55:47.882510] [DEBUG] [LOCAL ] MLR: No primary data file found to delete. [2025-10-22T19:55:47.882543] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-22T19:55:48.122223] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-22T19:55:48.297313] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:55:48.335085] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T19:55:48.917702] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-22T19:55:49.476613] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T19:55:49.481071] [INFO ] [REMOTE ] MLM: Full fetch complete (45118 records). [2025-10-22T19:55:49.481194] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-22T19:55:49.722906] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-22T19:55:49.797119] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T19:55:49.886743] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-22T19:55:49.886820] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-22T19:55:49.887567] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-22T19:55:49.887607] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-22T19:55:49.888538] [DEBUG] [LOCAL ] MLM: Trimmed 45118 records to 28634 (keeping 200 days of data) [2025-10-22T19:55:50.064435] [DEBUG] [LOCAL ] MLM: Primary data saved (28634 records). [2025-10-22T19:55:50.064567] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-22T19:55:50.064816] [INFO ] [MAIN ] Update Progress: 1366/2367 symbols completed. MLM took 24.9s. Estimated remaining: 2h 8m 48s. Rate: 7.8 symbols/min [2025-10-22T19:55:50.233164] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:55:50.278673] [DEBUG] [LOCAL ] MMC: Loaded 51948 existing records from primary storage. [2025-10-22T19:55:50.278982] [INFO ] [MAIN ] MMC: Loaded 51948 existing records. [2025-10-22T19:55:50.396713] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-22T19:55:50.464392] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:55:50.464633] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-22T19:55:50.464728] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-22T19:55:50.465172] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-10-22T19:55:50.465230] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-22T19:55:50.525871] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-10-22T19:55:50.816836] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:55:51.317683] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-22T19:55:51.739567] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T19:55:51.809782] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-22T19:55:52.117637] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-10-22T19:55:52.917720] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-22T19:55:53.170097] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-22T19:55:53.717725] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-22T19:55:54.208194] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-22T19:55:54.517670] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-22T19:55:54.622527] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T19:55:55.049878] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-22T19:55:55.317680] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-22T19:55:55.882631] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-22T19:55:56.117706] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-22T19:55:56.698379] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-22T19:55:56.699765] [INFO ] [REMOTE ] MLP: Full fetch complete (4382 records). [2025-10-22T19:55:56.699849] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-22T19:55:56.922752] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-10-22T19:55:57.069322] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-22T19:55:57.069390] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-22T19:55:57.069522] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-22T19:55:57.069560] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-22T19:55:57.069931] [DEBUG] [LOCAL ] MLP: Trimmed 4382 records to 3004 (keeping 200 days of data) [2025-10-22T19:55:57.086509] [DEBUG] [LOCAL ] MLP: Primary data saved (3004 records). [2025-10-22T19:55:57.086568] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-22T19:55:57.086629] [INFO ] [MAIN ] Update Progress: 1367/2367 symbols completed. MLP took 18.9s. Estimated remaining: 2h 8m 39s. Rate: 7.8 symbols/min [2025-10-22T19:55:57.250704] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:55:57.264411] [DEBUG] [LOCAL ] MMD: Loaded 10750 existing records from primary storage. [2025-10-22T19:55:57.264617] [INFO ] [MAIN ] MMD: Loaded 10750 existing records. [2025-10-22T19:55:57.436708] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:55:57.436931] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-22T19:55:57.436978] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-22T19:55:57.437127] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-22T19:55:57.437163] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-22T19:55:57.722833] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-22T19:55:57.783491] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:55:58.180944] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-22T19:55:58.517715] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-10-22T19:55:59.317632] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-22T19:55:59.441122] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T19:55:59.508173] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T19:56:00.117626] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-10. [2025-10-22T19:56:00.206556] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T19:56:00.917673] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-22T19:56:01.374924] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T19:56:01.381149] [INFO ] [REMOTE ] MLNK: Full fetch complete (37820 records). [2025-10-22T19:56:01.381228] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-10-22T19:56:01.721875] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-22T19:56:01.751463] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-10-22T19:56:01.752288] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-10-22T19:56:01.753107] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-10-22T19:56:01.753216] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-10-22T19:56:01.754350] [DEBUG] [LOCAL ] MLNK: Trimmed 37820 records to 27397 (keeping 200 days of data) [2025-10-22T19:56:01.868554] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-22T19:56:01.954308] [DEBUG] [LOCAL ] MLNK: Primary data saved (27397 records). [2025-10-22T19:56:01.954481] [INFO ] [MAIN ] MLNK: Full history saved. [2025-10-22T19:56:01.954583] [INFO ] [MAIN ] Update Progress: 1368/2367 symbols completed. MLNK took 33.3s. Estimated remaining: 2h 8m 30s. Rate: 7.8 symbols/min [2025-10-22T19:56:02.120296] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:56:02.134201] [DEBUG] [LOCAL ] MMI: Loaded 15428 existing records from primary storage. [2025-10-22T19:56:02.134405] [INFO ] [MAIN ] MMI: Loaded 15428 existing records. [2025-10-22T19:56:02.305380] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:56:02.305584] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-22T19:56:02.305630] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-22T19:56:02.305859] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-22T19:56:02.305904] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-22T19:56:02.522824] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-22T19:56:02.654010] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:56:03.317713] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-22T19:56:03.369030] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-22T19:56:03.465444] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T19:56:04.117698] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-22T19:56:04.297395] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T19:56:04.917630] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-22T19:56:05.044233] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-22T19:56:05.717701] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-22T19:56:05.966755] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T19:56:06.475674] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T19:56:06.517618] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-22T19:56:07.249844] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-22T19:56:07.317727] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-22T19:56:08.071293] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-22T19:56:08.117618] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-22T19:56:08.922824] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-22T19:56:08.925166] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-22T19:56:09.717698] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-22T19:56:10.516231] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T19:56:10.519279] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-22T19:56:10.890495] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T19:56:11.317701] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-22T19:56:11.455509] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-22T19:56:12.117661] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-22T19:56:12.332299] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-22T19:56:12.608587] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-22T19:56:12.917708] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-22T19:56:13.717726] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-22T19:56:13.967399] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T19:56:14.517694] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-22T19:56:14.599609] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-22T19:56:14.601863] [INFO ] [REMOTE ] MMD: Full fetch complete (17032 records). [2025-10-22T19:56:14.601937] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-22T19:56:14.972975] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-22T19:56:14.973052] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-22T19:56:14.973405] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-22T19:56:14.973444] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-22T19:56:14.973966] [DEBUG] [LOCAL ] MMD: Trimmed 17032 records to 10733 (keeping 200 days of data) [2025-10-22T19:56:15.041110] [DEBUG] [LOCAL ] MMD: Primary data saved (10733 records). [2025-10-22T19:56:15.041225] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-22T19:56:15.041305] [INFO ] [MAIN ] Update Progress: 1369/2367 symbols completed. MMD took 18.0s. Estimated remaining: 2h 8m 26s. Rate: 7.8 symbols/min [2025-10-22T19:56:15.219811] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:56:15.219991] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-22T19:56:15.220047] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-22T19:56:15.220188] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-22T19:56:15.220243] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-22T19:56:15.220298] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-22T19:56:15.220342] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-22T19:56:15.322565] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-22T19:56:15.580516] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:56:15.619327] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-22T19:56:16.117665] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-22T19:56:16.134064] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-22T19:56:16.917696] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-22T19:56:17.166705] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T19:56:17.397204] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-22T19:56:17.717721] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-22T19:56:18.517692] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-22T19:56:19.317733] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-01. [2025-10-22T19:56:19.436314] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T19:56:19.510242] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:56:19.510586] [WARN ] [REMOTE ] MMID: No data returned for month 2025-01 [2025-10-22T19:56:19.510701] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:56:19.510752] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-22T19:56:19.510786] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:56:19.510829] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-22T19:56:19.510884] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-22T19:56:19.510918] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-22T19:56:19.510956] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-22T19:56:19.511003] [INFO ] [MAIN ] Update Progress: 1370/2367 symbols completed. MMID took 4.5s. Estimated remaining: 2h 8m 16s. Rate: 7.8 symbols/min [2025-10-22T19:56:19.679029] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-22T19:56:19.737404] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:56:19.737582] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-22T19:56:19.737620] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-22T19:56:19.737796] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-22T19:56:19.737852] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-22T19:56:19.737893] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-22T19:56:19.737925] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-22T19:56:20.118048] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:56:20.118114] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-22T19:56:20.917679] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-22T19:56:21.054856] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-22T19:56:21.717700] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-22T19:56:22.517716] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-22T19:56:22.621074] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T19:56:22.730492] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-22T19:56:22.988203] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-22T19:56:23.317662] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-22T19:56:24.117632] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-22T19:56:24.550677] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-22T19:56:24.917711] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-22T19:56:25.307238] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-22T19:56:25.717695] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-22T19:56:25.728545] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T19:56:26.211074] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-22T19:56:26.517680] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-22T19:56:27.317675] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-22T19:56:28.056243] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T19:56:28.117703] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-22T19:56:28.270456] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T19:56:28.917692] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-22T19:56:29.322501] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T19:56:29.325909] [INFO ] [REMOTE ] MMI: Full fetch complete (21839 records). [2025-10-22T19:56:29.325997] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-22T19:56:29.438736] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-22T19:56:29.702509] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-22T19:56:29.702589] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-22T19:56:29.703130] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-22T19:56:29.703190] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-22T19:56:29.703791] [DEBUG] [LOCAL ] MMI: Trimmed 21839 records to 15372 (keeping 200 days of data) [2025-10-22T19:56:29.742695] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-22T19:56:29.799348] [DEBUG] [LOCAL ] MMI: Primary data saved (15372 records). [2025-10-22T19:56:29.799464] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-22T19:56:29.799542] [INFO ] [MAIN ] Update Progress: 1371/2367 symbols completed. MMI took 27.8s. Estimated remaining: 2h 8m 10s. Rate: 7.8 symbols/min [2025-10-22T19:56:29.967261] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:56:30.020517] [DEBUG] [LOCAL ] MMM: Loaded 53112 existing records from primary storage. [2025-10-22T19:56:30.020988] [INFO ] [MAIN ] MMM: Loaded 53112 existing records. [2025-10-22T19:56:30.205300] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:56:30.205544] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-22T19:56:30.205600] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-22T19:56:30.206139] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-22T19:56:30.206195] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-22T19:56:30.517997] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-22T19:56:30.557547] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:56:30.748155] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T19:56:30.971790] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-22T19:56:31.317702] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-10. [2025-10-22T19:56:32.117724] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-22T19:56:32.244514] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T19:56:32.247259] [INFO ] [REMOTE ] MLR: Full fetch complete (18923 records). [2025-10-22T19:56:32.247341] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-10-22T19:56:32.619456] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-10-22T19:56:32.619536] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-10-22T19:56:32.620049] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-10-22T19:56:32.620115] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-10-22T19:56:32.620669] [DEBUG] [LOCAL ] MLR: Trimmed 18923 records to 12116 (keeping 200 days of data) [2025-10-22T19:56:32.712579] [DEBUG] [LOCAL ] MLR: Primary data saved (12116 records). [2025-10-22T19:56:32.712775] [INFO ] [MAIN ] MLR: Full history saved. [2025-10-22T19:56:32.712883] [INFO ] [MAIN ] Update Progress: 1372/2367 symbols completed. MLR took 45.1s. Estimated remaining: 2h 7m 59s. Rate: 7.8 symbols/min [2025-10-22T19:56:32.904006] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:56:32.922959] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-22T19:56:32.938930] [DEBUG] [LOCAL ] MMS: Loaded 33484 existing records from primary storage. [2025-10-22T19:56:32.939235] [INFO ] [MAIN ] MMS: Loaded 33484 existing records. [2025-10-22T19:56:33.128612] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:56:33.128929] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-22T19:56:33.129001] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-22T19:56:33.129432] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-10-22T19:56:33.129489] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-22T19:56:33.504282] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:56:33.717731] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-22T19:56:33.978848] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T19:56:34.517778] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-22T19:56:34.959459] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-22T19:56:35.212639] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T19:56:35.317614] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-22T19:56:36.010130] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T19:56:36.018856] [INFO ] [REMOTE ] MMC: Full fetch complete (75219 records). [2025-10-22T19:56:36.018989] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-22T19:56:36.120751] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-22T19:56:36.410513] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-22T19:56:36.410596] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-22T19:56:36.411578] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-22T19:56:36.411757] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-22T19:56:36.413181] [DEBUG] [LOCAL ] MMC: Trimmed 75219 records to 51936 (keeping 200 days of data) [2025-10-22T19:56:36.730036] [DEBUG] [LOCAL ] MMC: Primary data saved (51936 records). [2025-10-22T19:56:36.730163] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-22T19:56:36.730255] [INFO ] [MAIN ] Update Progress: 1373/2367 symbols completed. MMC took 46.7s. Estimated remaining: 2h 7m 48s. Rate: 7.8 symbols/min [2025-10-22T19:56:36.901972] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:56:36.914010] [DEBUG] [LOCAL ] MMT: Loaded 10203 existing records from primary storage. [2025-10-22T19:56:36.914327] [INFO ] [MAIN ] MMT: Loaded 10203 existing records. [2025-10-22T19:56:36.925534] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-22T19:56:37.095912] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:56:37.096257] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-22T19:56:37.096357] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-22T19:56:37.096727] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-22T19:56:37.096800] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-22T19:56:37.300330] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-22T19:56:37.468702] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-22T19:56:37.502372] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:56:37.648823] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T19:56:37.717626] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-22T19:56:38.067167] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-22T19:56:38.517634] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-22T19:56:39.317726] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-22T19:56:39.654681] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-22T19:56:40.117839] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-22T19:56:40.493484] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-22T19:56:40.891786] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T19:56:40.917663] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-22T19:56:41.719036] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-22T19:56:41.718048] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-22T19:56:42.517669] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-22T19:56:42.957264] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-22T19:56:43.292264] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T19:56:43.317622] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-22T19:56:44.117682] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-22T19:56:44.719689] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T19:56:44.917685] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-22T19:56:45.717694] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-22T19:56:45.981945] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T19:56:46.292089] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-22T19:56:46.311530] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T19:56:46.517664] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-22T19:56:47.317795] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-22T19:56:47.785490] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T19:56:48.117708] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-22T19:56:48.881094] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-22T19:56:48.917711] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-22T19:56:49.281881] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-22T19:56:49.717690] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-22T19:56:50.063634] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-22T19:56:50.276747] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T19:56:50.517697] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-22T19:56:51.252559] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T19:56:51.317631] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-22T19:56:52.117691] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-22T19:56:52.664039] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-22T19:56:52.664980] [INFO ] [REMOTE ] MMKT: Full fetch complete (2135 records). [2025-10-22T19:56:52.665054] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-22T19:56:52.845785] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-22T19:56:52.845976] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:56:52.846073] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:56:52.846134] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-22T19:56:52.846204] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-22T19:56:52.846252] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-22T19:56:52.846313] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-22T19:56:52.846384] [INFO ] [MAIN ] Update Progress: 1374/2367 symbols completed. MMKT took 33.3s. Estimated remaining: 2h 7m 47s. Rate: 7.8 symbols/min [2025-10-22T19:56:52.921614] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-22T19:56:53.025282] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:56:53.042327] [DEBUG] [LOCAL ] MMU: Loaded 16751 existing records from primary storage. [2025-10-22T19:56:53.042668] [INFO ] [MAIN ] MMU: Loaded 16751 existing records. [2025-10-22T19:56:53.228279] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:56:53.228585] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-22T19:56:53.228730] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-22T19:56:53.229007] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-22T19:56:53.229136] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-22T19:56:53.351798] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-22T19:56:53.632104] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:56:53.717873] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-22T19:56:53.721058] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T19:56:54.517768] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-22T19:56:54.606242] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T19:56:55.317692] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-22T19:56:55.555955] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T19:56:56.117715] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-22T19:56:56.917633] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-22T19:56:57.444859] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-22T19:56:57.520897] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T19:56:57.544552] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T19:56:57.717684] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-22T19:56:58.517724] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-22T19:56:59.156748] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T19:56:59.240754] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-22T19:56:59.317620] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-22T19:57:00.117721] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-22T19:57:00.854157] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T19:57:00.860503] [INFO ] [REMOTE ] MMS: Full fetch complete (51148 records). [2025-10-22T19:57:00.860619] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-22T19:57:00.920933] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-22T19:57:01.155917] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T19:57:01.189442] [INFO ] [REMOTE ] MMT: Full fetch complete (15929 records). [2025-10-22T19:57:01.192531] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-22T19:57:01.408237] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-22T19:57:01.434447] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-22T19:57:01.457333] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-22T19:57:01.472349] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-22T19:57:01.603289] [DEBUG] [LOCAL ] MMS: Trimmed 51148 records to 33396 (keeping 200 days of data) [2025-10-22T19:57:01.717917] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-22T19:57:01.801483] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-22T19:57:01.817724] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-22T19:57:01.821244] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-22T19:57:01.828546] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-22T19:57:01.844918] [DEBUG] [LOCAL ] MMT: Trimmed 15929 records to 10142 (keeping 200 days of data) [2025-10-22T19:57:01.978783] [DEBUG] [LOCAL ] MMT: Primary data saved (10142 records). [2025-10-22T19:57:01.988763] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-22T19:57:01.990263] [INFO ] [MAIN ] Update Progress: 1375/2367 symbols completed. MMT took 25.3s. Estimated remaining: 2h 7m 40s. Rate: 7.8 symbols/min [2025-10-22T19:57:02.005765] [DEBUG] [LOCAL ] MMS: Primary data saved (33396 records). [2025-10-22T19:57:02.061534] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-22T19:57:02.094200] [INFO ] [MAIN ] Update Progress: 1376/2367 symbols completed. MMS took 29.4s. Estimated remaining: 2h 7m 27s. Rate: 7.8 symbols/min [2025-10-22T19:57:02.320672] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:57:02.344713] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T19:57:02.417540] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:57:02.439734] [DEBUG] [LOCAL ] MNR: Loaded 25091 existing records from primary storage. [2025-10-22T19:57:02.440202] [INFO ] [MAIN ] MNR: Loaded 25091 existing records. [2025-10-22T19:57:02.518529] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-22T19:57:02.647445] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:57:02.648461] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-22T19:57:02.648692] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-22T19:57:02.660198] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-22T19:57:02.661572] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-22T19:57:02.728709] [DEBUG] [LOCAL ] MNSO: Loaded 44129 existing records from primary storage. [2025-10-22T19:57:02.769390] [INFO ] [MAIN ] MNSO: Loaded 44129 existing records. [2025-10-22T19:57:03.134299] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:57:03.145161] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-22T19:57:03.145226] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-22T19:57:03.156314] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-22T19:57:03.161538] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-22T19:57:03.300436] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:57:03.323696] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-22T19:57:03.602512] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:57:03.619837] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T19:57:03.654880] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T19:57:04.105794] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T19:57:04.117608] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-22T19:57:04.917718] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-22T19:57:05.158690] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-22T19:57:05.717693] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-22T19:57:06.517616] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-22T19:57:06.576569] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T19:57:06.576229] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T19:57:07.317730] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-22T19:57:07.951028] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T19:57:08.117693] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-22T19:57:08.246873] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T19:57:08.917718] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-22T19:57:09.717692] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-22T19:57:09.774131] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T19:57:10.517737] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-22T19:57:10.711790] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T19:57:10.815722] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-22T19:57:11.233349] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-22T19:57:11.317628] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-22T19:57:12.117623] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-22T19:57:12.430559] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T19:57:12.917723] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-22T19:57:13.717633] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-22T19:57:13.887802] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T19:57:13.973406] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-22T19:57:14.517616] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-22T19:57:14.977224] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-22T19:57:15.317739] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-22T19:57:16.117678] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-22T19:57:16.290918] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T19:57:16.819474] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-22T19:57:16.828142] [INFO ] [REMOTE ] MMM: Full fetch complete (77221 records). [2025-10-22T19:57:16.828270] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-22T19:57:16.920036] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-22T19:57:17.233681] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-22T19:57:17.233811] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-22T19:57:17.235198] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-22T19:57:17.235320] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-22T19:57:17.237013] [DEBUG] [LOCAL ] MMM: Trimmed 77221 records to 53112 (keeping 200 days of data) [2025-10-22T19:57:17.345801] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T19:57:17.584566] [DEBUG] [LOCAL ] MMM: Primary data saved (53112 records). [2025-10-22T19:57:17.584717] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-22T19:57:17.584805] [INFO ] [MAIN ] Update Progress: 1377/2367 symbols completed. MMM took 47.8s. Estimated remaining: 2h 7m 25s. Rate: 7.8 symbols/min [2025-10-22T19:57:17.727416] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-22T19:57:17.754506] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:57:17.754694] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-22T19:57:17.754749] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-22T19:57:17.754857] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-22T19:57:17.754899] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-22T19:57:17.754941] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-22T19:57:17.754972] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-22T19:57:18.054856] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-22T19:57:18.073638] [INFO ] [REMOTE ] MMU: Full fetch complete (25080 records). [2025-10-22T19:57:18.107589] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-22T19:57:18.129270] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:57:18.488104] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-22T19:57:18.488193] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-22T19:57:18.488740] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-22T19:57:18.488826] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-22T19:57:18.489600] [DEBUG] [LOCAL ] MMU: Trimmed 25080 records to 16784 (keeping 200 days of data) [2025-10-22T19:57:18.530254] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-01. [2025-10-22T19:57:18.589611] [DEBUG] [LOCAL ] MMU: Primary data saved (16784 records). [2025-10-22T19:57:18.589797] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-22T19:57:18.589882] [INFO ] [MAIN ] Update Progress: 1378/2367 symbols completed. MMU took 25.7s. Estimated remaining: 2h 7m 12s. Rate: 7.8 symbols/min [2025-10-22T19:57:18.753776] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:57:18.753959] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-22T19:57:18.753996] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-22T19:57:18.754101] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-22T19:57:18.754140] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-22T19:57:18.754180] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-22T19:57:18.754211] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-22T19:57:18.797312] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:57:18.835059] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-01 [2025-10-22T19:57:18.846464] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:57:18.857021] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-22T19:57:18.857129] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:57:18.857207] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-22T19:57:18.857616] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-22T19:57:18.868566] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-22T19:57:18.873764] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-22T19:57:18.873856] [INFO ] [MAIN ] Update Progress: 1379/2367 symbols completed. MNTN took 1.3s. Estimated remaining: 2h 6m 59s. Rate: 7.8 symbols/min [2025-10-22T19:57:19.218564] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:57:19.302680] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:57:19.317667] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-22T19:57:19.337128] [DEBUG] [LOCAL ] MOD: Loaded 44532 existing records from primary storage. [2025-10-22T19:57:19.337421] [INFO ] [MAIN ] MOD: Loaded 44532 existing records. [2025-10-22T19:57:19.520404] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:57:19.520734] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-22T19:57:19.520803] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-22T19:57:19.521118] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-22T19:57:19.521204] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-22T19:57:19.656357] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T19:57:19.910938] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:57:20.117691] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-22T19:57:20.529126] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T19:57:20.917718] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-22T19:57:21.717832] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-22T19:57:21.914222] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T19:57:22.517686] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-22T19:57:22.576322] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T19:57:23.317740] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-22T19:57:23.632363] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T19:57:23.976593] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-22T19:57:24.117689] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-22T19:57:24.528686] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T19:57:24.917709] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-22T19:57:25.717715] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-22T19:57:26.343171] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-22T19:57:26.517790] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-22T19:57:26.642142] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T19:57:27.239833] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T19:57:27.317693] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-22T19:57:27.345692] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T19:57:28.117638] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-22T19:57:28.917686] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-22T19:57:29.030611] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T19:57:29.353412] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T19:57:29.358035] [INFO ] [REMOTE ] MNR: Full fetch complete (36903 records). [2025-10-22T19:57:29.358132] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-22T19:57:29.729680] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-22T19:57:29.760028] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-22T19:57:29.760160] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-22T19:57:29.760973] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-22T19:57:29.761050] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-22T19:57:29.762094] [DEBUG] [LOCAL ] MNR: Trimmed 36903 records to 24999 (keeping 200 days of data) [2025-10-22T19:57:29.914044] [DEBUG] [LOCAL ] MNR: Primary data saved (24999 records). [2025-10-22T19:57:29.914170] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-22T19:57:29.914247] [INFO ] [MAIN ] Update Progress: 1380/2367 symbols completed. MNR took 27.9s. Estimated remaining: 2h 6m 54s. Rate: 7.8 symbols/min [2025-10-22T19:57:30.086826] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:57:30.131457] [DEBUG] [LOCAL ] MODG: Loaded 51537 existing records from primary storage. [2025-10-22T19:57:30.131806] [INFO ] [MAIN ] MODG: Loaded 51537 existing records. [2025-10-22T19:57:30.315318] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:57:30.315522] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-22T19:57:30.315580] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-22T19:57:30.315939] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-22T19:57:30.315995] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-22T19:57:30.525336] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-22T19:57:30.720241] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T19:57:30.718931] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:57:31.317732] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-22T19:57:32.117728] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-22T19:57:32.197268] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-22T19:57:32.244068] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T19:57:32.917639] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-22T19:57:33.032379] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T19:57:33.717694] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-22T19:57:33.818464] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T19:57:34.280283] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T19:57:34.517678] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-22T19:57:35.317699] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-22T19:57:35.372298] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-22T19:57:36.079503] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T19:57:36.117609] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-22T19:57:36.917703] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-22T19:57:37.100376] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T19:57:37.717628] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-22T19:57:37.822890] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T19:57:38.517684] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-22T19:57:39.267157] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-22T19:57:39.317712] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-22T19:57:39.471881] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T19:57:40.117635] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-22T19:57:40.238494] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T19:57:40.246043] [INFO ] [REMOTE ] MNSO: Full fetch complete (64702 records). [2025-10-22T19:57:40.246145] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-22T19:57:40.634876] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-22T19:57:40.634971] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-22T19:57:40.635904] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-22T19:57:40.635978] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-22T19:57:40.637410] [DEBUG] [LOCAL ] MNSO: Trimmed 64702 records to 44038 (keeping 200 days of data) [2025-10-22T19:57:40.747249] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T19:57:40.919104] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-22T19:57:40.951481] [DEBUG] [LOCAL ] MNSO: Primary data saved (44038 records). [2025-10-22T19:57:40.951618] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-22T19:57:40.951760] [INFO ] [MAIN ] Update Progress: 1381/2367 symbols completed. MNSO took 38.8s. Estimated remaining: 2h 6m 48s. Rate: 7.8 symbols/min [2025-10-22T19:57:41.129986] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:57:41.167536] [DEBUG] [LOCAL ] MOH: Loaded 43015 existing records from primary storage. [2025-10-22T19:57:41.167923] [INFO ] [MAIN ] MOH: Loaded 43015 existing records. [2025-10-22T19:57:41.346601] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:57:41.346826] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-22T19:57:41.346873] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-22T19:57:41.347175] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-10-22T19:57:41.347215] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-22T19:57:41.705870] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:57:41.717672] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-22T19:57:41.830941] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T19:57:41.989246] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T19:57:42.517709] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-22T19:57:42.787723] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T19:57:43.317688] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-22T19:57:44.117682] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-22T19:57:44.232826] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T19:57:44.240208] [INFO ] [REMOTE ] MOD: Full fetch complete (66477 records). [2025-10-22T19:57:44.240378] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-22T19:57:44.646596] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-22T19:57:44.646763] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-22T19:57:44.647705] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-22T19:57:44.647802] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-22T19:57:44.649173] [DEBUG] [LOCAL ] MOD: Trimmed 66477 records to 44505 (keeping 200 days of data) [2025-10-22T19:57:44.909825] [DEBUG] [LOCAL ] MOD: Primary data saved (44505 records). [2025-10-22T19:57:44.909949] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-22T19:57:44.910023] [INFO ] [MAIN ] Update Progress: 1382/2367 symbols completed. MOD took 26.0s. Estimated remaining: 2h 6m 38s. Rate: 7.8 symbols/min [2025-10-22T19:57:44.927247] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-22T19:57:45.089764] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:57:45.138275] [DEBUG] [LOCAL ] MOS: Loaded 53511 existing records from primary storage. [2025-10-22T19:57:45.138598] [INFO ] [MAIN ] MOS: Loaded 53511 existing records. [2025-10-22T19:57:45.321927] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:57:45.322156] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-22T19:57:45.322273] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-22T19:57:45.332149] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-10-22T19:57:45.346927] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-22T19:57:45.425791] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-22T19:57:45.719333] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-22T19:57:45.741481] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:57:45.905123] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T19:57:46.477005] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T19:57:46.517612] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-22T19:57:47.317788] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-22T19:57:47.445108] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T19:57:48.063936] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T19:57:48.117613] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-22T19:57:48.917688] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-22T19:57:49.117889] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T19:57:49.642347] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T19:57:49.717691] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-22T19:57:50.517716] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-22T19:57:50.557608] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T19:57:51.053211] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-22T19:57:51.317669] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-22T19:57:52.117722] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-22T19:57:52.917719] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-22T19:57:53.094906] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T19:57:53.320737] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-22T19:57:53.717718] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-22T19:57:53.909085] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T19:57:54.517720] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-22T19:57:54.749410] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T19:57:55.102387] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T19:57:55.317625] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-22T19:57:56.117635] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-22T19:57:56.229259] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T19:57:56.917711] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-22T19:57:57.419524] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-22T19:57:57.717665] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-22T19:57:57.852333] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T19:57:58.517721] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-22T19:57:58.874896] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T19:57:59.317738] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-22T19:57:59.832818] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T19:57:59.841873] [INFO ] [REMOTE ] MO: Full fetch complete (77541 records). [2025-10-22T19:57:59.842030] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-22T19:58:00.038606] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T19:58:00.040735] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-22T19:58:00.040847] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-22T19:58:00.040934] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-22T19:58:00.041032] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-22T19:58:00.041208] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-22T19:58:00.041341] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-22T19:58:00.041526] [INFO ] [MAIN ] Update Progress: 1383/2367 symbols completed. MO took 41.5s. Estimated remaining: 2h 6m 36s. Rate: 7.8 symbols/min [2025-10-22T19:58:00.123985] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-22T19:58:00.219729] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:58:00.252710] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T19:58:00.280051] [DEBUG] [LOCAL ] MOV: Loaded 21325 existing records from primary storage. [2025-10-22T19:58:00.280291] [INFO ] [MAIN ] MOV: Loaded 21325 existing records. [2025-10-22T19:58:00.458941] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:58:00.459192] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-22T19:58:00.459240] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-22T19:58:00.459431] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-10-22T19:58:00.459487] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-22T19:58:00.809812] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:58:00.917670] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-22T19:58:01.006942] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T19:58:01.717721] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-22T19:58:01.901726] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T19:58:02.084009] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-22T19:58:02.517697] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-22T19:58:03.317637] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-10-22T19:58:03.560148] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T19:58:03.568712] [INFO ] [REMOTE ] MODG: Full fetch complete (74816 records). [2025-10-22T19:58:03.568856] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-22T19:58:03.684972] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T19:58:03.989219] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-22T19:58:03.989303] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-22T19:58:03.990281] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-22T19:58:03.990346] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-22T19:58:03.991773] [DEBUG] [LOCAL ] MODG: Trimmed 74816 records to 51534 (keeping 200 days of data) [2025-10-22T19:58:04.148872] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-22T19:58:04.282931] [DEBUG] [LOCAL ] MODG: Primary data saved (51534 records). [2025-10-22T19:58:04.283071] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-22T19:58:04.283146] [INFO ] [MAIN ] Update Progress: 1384/2367 symbols completed. MODG took 34.4s. Estimated remaining: 2h 6m 25s. Rate: 7.8 symbols/min [2025-10-22T19:58:04.455246] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:58:04.503785] [DEBUG] [LOCAL ] MP: Loaded 53744 existing records from primary storage. [2025-10-22T19:58:04.504151] [INFO ] [MAIN ] MP: Loaded 53744 existing records. [2025-10-22T19:58:04.678862] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:58:04.679097] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-22T19:58:04.679158] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-22T19:58:04.679726] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-10-22T19:58:04.679787] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-22T19:58:04.927174] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-22T19:58:05.042802] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:58:05.117590] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T19:58:05.601537] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T19:58:05.717681] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-10. [2025-10-22T19:58:06.367679] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T19:58:06.517774] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-22T19:58:07.317683] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-22T19:58:07.492843] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T19:58:07.500734] [INFO ] [REMOTE ] MOH: Full fetch complete (59843 records). [2025-10-22T19:58:07.500896] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-10-22T19:58:07.908163] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-10-22T19:58:07.908352] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-10-22T19:58:07.909351] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-10-22T19:58:07.909436] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-10-22T19:58:07.929041] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T19:58:07.929212] [DEBUG] [LOCAL ] MOH: Trimmed 59843 records to 43041 (keeping 200 days of data) [2025-10-22T19:58:08.139494] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-22T19:58:08.194878] [DEBUG] [LOCAL ] MOH: Primary data saved (43041 records). [2025-10-22T19:58:08.195018] [INFO ] [MAIN ] MOH: Full history saved. [2025-10-22T19:58:08.195096] [INFO ] [MAIN ] Update Progress: 1385/2367 symbols completed. MOH took 27.2s. Estimated remaining: 2h 6m 15s. Rate: 7.8 symbols/min [2025-10-22T19:58:08.364912] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:58:08.372511] [DEBUG] [LOCAL ] MPA: Loaded 5218 existing records from primary storage. [2025-10-22T19:58:08.372752] [INFO ] [MAIN ] MPA: Loaded 5218 existing records. [2025-10-22T19:58:08.551941] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:58:08.552150] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-22T19:58:08.552196] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-22T19:58:08.552345] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-10-22T19:58:08.552400] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-22T19:58:08.909012] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:58:08.917635] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-22T19:58:09.200929] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T19:58:09.246297] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-22T19:58:09.264349] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T19:58:09.717686] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-22T19:58:10.333577] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-22T19:58:10.517717] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-22T19:58:11.317689] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-22T19:58:12.117672] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-22T19:58:12.331198] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T19:58:12.616237] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T19:58:12.690466] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-22T19:58:12.917673] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-22T19:58:13.717700] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-22T19:58:14.433325] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-22T19:58:14.517692] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-22T19:58:14.667717] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T19:58:15.282352] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-22T19:58:15.317668] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-22T19:58:16.117721] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-22T19:58:16.390708] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-22T19:58:16.917672] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-22T19:58:17.717725] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-22T19:58:17.825882] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T19:58:18.331013] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-22T19:58:18.480835] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T19:58:18.517726] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-22T19:58:19.317720] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-22T19:58:20.117726] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-22T19:58:20.849736] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-22T19:58:20.917708] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-22T19:58:21.152752] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T19:58:21.164777] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T19:58:21.168493] [INFO ] [REMOTE ] MOV: Full fetch complete (30533 records). [2025-10-22T19:58:21.168940] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-10-22T19:58:21.424524] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-22T19:58:21.544451] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-10-22T19:58:21.544514] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-10-22T19:58:21.545123] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-10-22T19:58:21.545188] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-10-22T19:58:21.545966] [DEBUG] [LOCAL ] MOV: Trimmed 30533 records to 21161 (keeping 200 days of data) [2025-10-22T19:58:21.669234] [DEBUG] [LOCAL ] MOV: Primary data saved (21161 records). [2025-10-22T19:58:21.669356] [INFO ] [MAIN ] MOV: Full history saved. [2025-10-22T19:58:21.669432] [INFO ] [MAIN ] Update Progress: 1386/2367 symbols completed. MOV took 21.6s. Estimated remaining: 2h 6m 11s. Rate: 7.8 symbols/min [2025-10-22T19:58:21.722946] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-22T19:58:21.840291] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:58:21.888687] [DEBUG] [LOCAL ] MPC: Loaded 51933 existing records from primary storage. [2025-10-22T19:58:21.889032] [INFO ] [MAIN ] MPC: Loaded 51933 existing records. [2025-10-22T19:58:22.084809] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:58:22.085009] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-22T19:58:22.085057] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-22T19:58:22.085486] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-10-22T19:58:22.085523] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-22T19:58:22.439200] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:58:22.517615] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-22T19:58:23.317738] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-22T19:58:23.977728] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-22T19:58:24.117718] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-22T19:58:24.264603] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T19:58:24.832227] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T19:58:24.917633] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-22T19:58:25.208676] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T19:58:25.556329] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-22T19:58:25.717717] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-22T19:58:26.517666] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-22T19:58:27.317677] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-22T19:58:27.813559] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-22T19:58:28.117634] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-22T19:58:28.224882] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T19:58:28.917726] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-22T19:58:29.209664] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T19:58:29.219455] [INFO ] [REMOTE ] MOS: Full fetch complete (77631 records). [2025-10-22T19:58:29.219684] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-22T19:58:29.601265] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-22T19:58:29.601353] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-22T19:58:29.602365] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-22T19:58:29.602430] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-22T19:58:29.604145] [DEBUG] [LOCAL ] MOS: Trimmed 77631 records to 53511 (keeping 200 days of data) [2025-10-22T19:58:29.719716] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-22T19:58:29.929171] [DEBUG] [LOCAL ] MOS: Primary data saved (53511 records). [2025-10-22T19:58:29.929332] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-22T19:58:29.929436] [INFO ] [MAIN ] Update Progress: 1387/2367 symbols completed. MOS took 45.0s. Estimated remaining: 2h 6m 4s. Rate: 7.8 symbols/min [2025-10-22T19:58:30.094010] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:58:30.141024] [DEBUG] [LOCAL ] MPLX: Loaded 50784 existing records from primary storage. [2025-10-22T19:58:30.141406] [INFO ] [MAIN ] MPLX: Loaded 50784 existing records. [2025-10-22T19:58:30.317241] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:58:30.317445] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-22T19:58:30.317510] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-22T19:58:30.317742] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-10-22T19:58:30.317826] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-22T19:58:30.426257] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-22T19:58:30.534991] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-22T19:58:30.687033] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:58:30.855557] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T19:58:30.871694] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-10-22T19:58:31.042998] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-22T19:58:31.044289] [INFO ] [REMOTE ] MPA: Full fetch complete (7071 records). [2025-10-22T19:58:31.044357] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-22T19:58:31.322832] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-22T19:58:31.397101] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-22T19:58:31.397177] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-22T19:58:31.397369] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-22T19:58:31.397408] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-22T19:58:31.397863] [DEBUG] [LOCAL ] MPA: Trimmed 7071 records to 5192 (keeping 200 days of data) [2025-10-22T19:58:31.429002] [DEBUG] [LOCAL ] MPA: Primary data saved (5192 records). [2025-10-22T19:58:31.429083] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-22T19:58:31.429156] [INFO ] [MAIN ] Update Progress: 1388/2367 symbols completed. MPA took 23.2s. Estimated remaining: 2h 5m 52s. Rate: 7.8 symbols/min [2025-10-22T19:58:31.596135] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:58:31.602023] [DEBUG] [LOCAL ] MPV: Loaded 4372 existing records from primary storage. [2025-10-22T19:58:31.602189] [INFO ] [MAIN ] MPV: Loaded 4372 existing records. [2025-10-22T19:58:31.774055] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:58:31.774399] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-22T19:58:31.774456] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-22T19:58:31.775155] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-10-22T19:58:31.775212] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-22T19:58:32.119637] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:58:32.119757] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-22T19:58:32.917729] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-22T19:58:33.717697] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-22T19:58:33.818138] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T19:58:34.034884] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-22T19:58:34.333082] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T19:58:34.350024] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-22T19:58:34.517682] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-22T19:58:35.317725] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-22T19:58:36.099370] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T19:58:36.117623] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-22T19:58:36.932485] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-22T19:58:36.941196] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T19:58:37.644415] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-22T19:58:37.717718] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-22T19:58:38.517723] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-22T19:58:38.628807] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-22T19:58:39.246380] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T19:58:39.317691] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-22T19:58:40.117625] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-22T19:58:40.381950] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T19:58:40.917699] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-22T19:58:41.279893] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T19:58:41.717718] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-22T19:58:42.517724] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-22T19:58:42.711267] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T19:58:43.056441] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-22T19:58:43.085701] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (2.97 seconds). [2025-10-22T19:58:43.094749] [INFO ] [REMOTE ] MP: Full fetch complete (77581 records). [2025-10-22T19:58:43.094934] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-22T19:58:43.324745] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-22T19:58:43.504274] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-10-22T19:58:43.504387] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-10-22T19:58:43.505855] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-10-22T19:58:43.506162] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-10-22T19:58:43.533868] [DEBUG] [LOCAL ] MP: Trimmed 77581 records to 53744 (keeping 200 days of data) [2025-10-22T19:58:43.535161] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T19:58:43.873463] [DEBUG] [LOCAL ] MP: Primary data saved (53744 records). [2025-10-22T19:58:43.873638] [INFO ] [MAIN ] MP: Full history saved. [2025-10-22T19:58:43.873776] [INFO ] [MAIN ] Update Progress: 1389/2367 symbols completed. MP took 39.6s. Estimated remaining: 2h 5m 47s. Rate: 7.8 symbols/min [2025-10-22T19:58:44.038382] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:58:44.083214] [DEBUG] [LOCAL ] MPW: Loaded 53486 existing records from primary storage. [2025-10-22T19:58:44.083514] [INFO ] [MAIN ] MPW: Loaded 53486 existing records. [2025-10-22T19:58:44.124847] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-22T19:58:44.262054] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:58:44.262324] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-22T19:58:44.262395] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-22T19:58:44.262772] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-10-22T19:58:44.262849] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-22T19:58:44.615283] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:58:44.917690] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-22T19:58:45.071363] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T19:58:45.717637] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-22T19:58:45.905088] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T19:58:46.517687] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-22T19:58:46.760138] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T19:58:47.317711] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-22T19:58:47.351469] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-22T19:58:47.379722] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T19:58:48.117664] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-22T19:58:48.919272] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-22T19:58:48.922200] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T19:58:49.717626] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-22T19:58:49.748680] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T19:58:50.517733] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-22T19:58:50.877951] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T19:58:50.886992] [INFO ] [REMOTE ] MPC: Full fetch complete (75712 records). [2025-10-22T19:58:50.887137] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-22T19:58:51.192231] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-22T19:58:51.286638] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-10-22T19:58:51.286756] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-10-22T19:58:51.288003] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-10-22T19:58:51.288194] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-10-22T19:58:51.289705] [DEBUG] [LOCAL ] MPC: Trimmed 75712 records to 51893 (keeping 200 days of data) [2025-10-22T19:58:51.347373] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-22T19:58:51.618495] [DEBUG] [LOCAL ] MPC: Primary data saved (51893 records). [2025-10-22T19:58:51.618713] [INFO ] [MAIN ] MPC: Full history saved. [2025-10-22T19:58:51.618804] [INFO ] [MAIN ] Update Progress: 1390/2367 symbols completed. MPC took 29.9s. Estimated remaining: 2h 5m 40s. Rate: 7.8 symbols/min [2025-10-22T19:58:51.840601] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:58:51.843430] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-22T19:58:51.863841] [DEBUG] [LOCAL ] MPX: Loaded 3999 existing records from primary storage. [2025-10-22T19:58:51.864110] [INFO ] [MAIN ] MPX: Loaded 3999 existing records. [2025-10-22T19:58:52.045924] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:58:52.046144] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-22T19:58:52.046218] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-22T19:58:52.052432] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-10-22T19:58:52.052500] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-22T19:58:52.052829] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-22T19:58:52.124346] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-22T19:58:52.420208] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:58:52.917681] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-22T19:58:53.616085] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T19:58:53.717697] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-22T19:58:53.933955] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T19:58:54.517669] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-22T19:58:55.145278] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-22T19:58:55.317638] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-22T19:58:55.621608] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T19:58:56.117688] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-22T19:58:56.917634] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-22T19:58:57.002544] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T19:58:57.602595] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-22T19:58:57.717684] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-22T19:58:57.932127] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T19:58:58.517685] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-22T19:58:59.317703] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-22T19:58:59.545964] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T19:58:59.555375] [INFO ] [REMOTE ] MPLX: Full fetch complete (74352 records). [2025-10-22T19:58:59.555531] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-10-22T19:58:59.945829] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-10-22T19:58:59.950146] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-10-22T19:58:59.951624] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-10-22T19:58:59.951842] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-22T19:58:59.953477] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-10-22T19:58:59.955414] [DEBUG] [LOCAL ] MPLX: Trimmed 74352 records to 50774 (keeping 200 days of data) [2025-10-22T19:59:00.139782] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-22T19:59:00.272125] [DEBUG] [LOCAL ] MPLX: Primary data saved (50774 records). [2025-10-22T19:59:00.272250] [INFO ] [MAIN ] MPLX: Full history saved. [2025-10-22T19:59:00.272325] [INFO ] [MAIN ] Update Progress: 1391/2367 symbols completed. MPLX took 30.3s. Estimated remaining: 2h 5m 33s. Rate: 7.8 symbols/min [2025-10-22T19:59:00.442810] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:59:00.473686] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-22T19:59:00.487470] [DEBUG] [LOCAL ] MQT: Loaded 8058 existing records from primary storage. [2025-10-22T19:59:00.487960] [INFO ] [MAIN ] MQT: Loaded 8058 existing records. [2025-10-22T19:59:00.600039] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-22T19:59:00.666395] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:59:00.666594] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-22T19:59:00.666660] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-22T19:59:00.666826] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-10-22T19:59:00.666865] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-22T19:59:00.922911] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-22T19:59:01.028804] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:59:01.717737] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-22T19:59:02.503977] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T19:59:02.517602] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-22T19:59:02.570865] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T19:59:03.317710] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-22T19:59:03.352354] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-22T19:59:03.916468] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T19:59:04.117626] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-22T19:59:04.717152] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T19:59:04.917717] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-22T19:59:05.664901] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-22T19:59:05.717622] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-22T19:59:06.517681] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-22T19:59:06.651916] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-22T19:59:07.130932] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-22T19:59:07.132009] [INFO ] [REMOTE ] MPV: Full fetch complete (7580 records). [2025-10-22T19:59:07.132077] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-22T19:59:07.327493] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-22T19:59:07.490662] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-10-22T19:59:07.490759] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-10-22T19:59:07.490976] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-10-22T19:59:07.491018] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-10-22T19:59:07.491382] [DEBUG] [LOCAL ] MPV: Trimmed 7580 records to 4350 (keeping 200 days of data) [2025-10-22T19:59:07.517194] [DEBUG] [LOCAL ] MPV: Primary data saved (4350 records). [2025-10-22T19:59:07.517275] [INFO ] [MAIN ] MPV: Full history saved. [2025-10-22T19:59:07.517345] [INFO ] [MAIN ] Update Progress: 1392/2367 symbols completed. MPV took 36.1s. Estimated remaining: 2h 5m 25s. Rate: 7.8 symbols/min [2025-10-22T19:59:07.682261] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:59:07.699450] [DEBUG] [LOCAL ] MQY: Loaded 16629 existing records from primary storage. [2025-10-22T19:59:07.699703] [INFO ] [MAIN ] MQY: Loaded 16629 existing records. [2025-10-22T19:59:07.873002] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:59:07.873199] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-22T19:59:07.873245] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-22T19:59:07.873439] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-10-22T19:59:07.873495] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-22T19:59:08.122916] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-22T19:59:08.161492] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-22T19:59:08.250357] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:59:08.917689] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-22T19:59:09.652021] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-22T19:59:09.717678] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-22T19:59:10.030298] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T19:59:10.314438] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T19:59:10.517720] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-22T19:59:11.317670] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-22T19:59:11.628537] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T19:59:12.053357] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-22T19:59:12.117634] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-22T19:59:12.917634] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-22T19:59:13.172121] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T19:59:13.319720] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-22T19:59:13.717719] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-22T19:59:14.301388] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-22T19:59:14.517682] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-22T19:59:15.306753] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T19:59:15.317627] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-22T19:59:16.117716] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-22T19:59:16.160551] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-22T19:59:16.162439] [INFO ] [REMOTE ] MQT: Full fetch complete (12995 records). [2025-10-22T19:59:16.162515] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-22T19:59:16.524163] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-10-22T19:59:16.524249] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-10-22T19:59:16.524519] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-10-22T19:59:16.524560] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-10-22T19:59:16.525027] [DEBUG] [LOCAL ] MQT: Trimmed 12995 records to 7975 (keeping 200 days of data) [2025-10-22T19:59:16.571170] [DEBUG] [LOCAL ] MQT: Primary data saved (7975 records). [2025-10-22T19:59:16.571289] [INFO ] [MAIN ] MQT: Full history saved. [2025-10-22T19:59:16.571365] [INFO ] [MAIN ] Update Progress: 1393/2367 symbols completed. MQT took 16.3s. Estimated remaining: 2h 5m 18s. Rate: 7.8 symbols/min [2025-10-22T19:59:16.737990] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:59:16.775043] [DEBUG] [LOCAL ] MRC: Loaded 37214 existing records from primary storage. [2025-10-22T19:59:16.775368] [INFO ] [MAIN ] MRC: Loaded 37214 existing records. [2025-10-22T19:59:16.924289] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-22T19:59:16.955402] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:59:16.955801] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-22T19:59:16.955852] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-22T19:59:16.956030] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-10-22T19:59:16.956068] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-22T19:59:17.075414] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-22T19:59:17.339130] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:59:17.717735] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-22T19:59:18.326251] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T19:59:18.517723] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-22T19:59:18.622197] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T19:59:19.317631] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-22T19:59:19.632258] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T19:59:20.117701] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-22T19:59:20.669396] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-22T19:59:20.692984] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T19:59:20.917699] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-22T19:59:21.571416] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-22T19:59:21.717726] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-22T19:59:22.517634] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-22T19:59:23.317714] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-22T19:59:23.607568] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T19:59:23.616832] [INFO ] [REMOTE ] MPW: Full fetch complete (77575 records). [2025-10-22T19:59:23.616974] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-22T19:59:23.998323] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-22T19:59:24.018332] [INFO ] [REMOTE ] MPX: Full fetch complete (6496 records). [2025-10-22T19:59:24.037122] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-22T19:59:24.044703] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-10-22T19:59:24.054823] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-10-22T19:59:24.081596] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T19:59:24.058731] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-10-22T19:59:24.111943] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-10-22T19:59:24.122725] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-22T19:59:24.176741] [DEBUG] [LOCAL ] MPW: Trimmed 77575 records to 53485 (keeping 200 days of data) [2025-10-22T19:59:24.569206] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-10-22T19:59:24.569362] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-10-22T19:59:24.569568] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-10-22T19:59:24.569639] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-10-22T19:59:24.616781] [DEBUG] [LOCAL ] MPX: Trimmed 6496 records to 3955 (keeping 200 days of data) [2025-10-22T19:59:24.688511] [DEBUG] [LOCAL ] MPX: Primary data saved (3955 records). [2025-10-22T19:59:24.688604] [INFO ] [MAIN ] MPX: Full history saved. [2025-10-22T19:59:24.688722] [INFO ] [MAIN ] Update Progress: 1394/2367 symbols completed. MPX took 33.1s. Estimated remaining: 2h 5m 10s. Rate: 7.8 symbols/min [2025-10-22T19:59:24.880638] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:59:24.918971] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-22T19:59:24.987549] [DEBUG] [LOCAL ] MPW: Primary data saved (53485 records). [2025-10-22T19:59:24.987858] [INFO ] [MAIN ] MPW: Full history saved. [2025-10-22T19:59:24.988265] [INFO ] [MAIN ] Update Progress: 1395/2367 symbols completed. MPW took 41.1s. Estimated remaining: 2h 4m 58s. Rate: 7.8 symbols/min [2025-10-22T19:59:25.072188] [DEBUG] [LOCAL ] MRK: Loaded 53790 existing records from primary storage. [2025-10-22T19:59:25.094378] [INFO ] [MAIN ] MRK: Loaded 53790 existing records. [2025-10-22T19:59:25.176840] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T19:59:25.316457] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:59:25.339285] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-22T19:59:25.346779] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-22T19:59:25.346928] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-22T19:59:25.346990] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-22T19:59:25.347805] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-22T19:59:25.363378] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-22T19:59:25.400402] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:59:25.438523] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-22T19:59:25.449675] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-22T19:59:25.469742] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-10-22T19:59:25.473000] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-22T19:59:25.747408] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-22T19:59:26.058362] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:59:26.124929] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:59:26.168992] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T19:59:26.517672] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-22T19:59:26.801369] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-22T19:59:27.317713] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-22T19:59:28.088724] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T19:59:28.117632] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-22T19:59:28.917674] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-22T19:59:29.427166] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-22T19:59:29.492916] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T19:59:29.717689] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-22T19:59:29.836754] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-22T19:59:30.517722] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-22T19:59:31.049891] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T19:59:31.317691] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-22T19:59:31.485384] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T19:59:32.117710] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-22T19:59:32.909897] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T19:59:32.918541] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-01. [2025-10-22T19:59:32.968000] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-22T19:59:33.108526] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T19:59:33.108875] [WARN ] [REMOTE ] MRP: No data returned for month 2025-01 [2025-10-22T19:59:33.108974] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T19:59:33.109027] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-22T19:59:33.109104] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T19:59:33.109177] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-22T19:59:33.109262] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-22T19:59:33.109318] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-22T19:59:33.109362] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-22T19:59:33.109408] [INFO ] [MAIN ] Update Progress: 1396/2367 symbols completed. MRP took 8.1s. Estimated remaining: 2h 4m 50s. Rate: 7.8 symbols/min [2025-10-22T19:59:33.286215] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:59:33.338181] [DEBUG] [LOCAL ] MS: Loaded 53688 existing records from primary storage. [2025-10-22T19:59:33.338479] [INFO ] [MAIN ] MS: Loaded 53688 existing records. [2025-10-22T19:59:33.513106] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:59:33.513300] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-22T19:59:33.513351] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-22T19:59:33.513528] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-10-22T19:59:33.513565] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-22T19:59:33.722794] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-22T19:59:33.868990] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:59:34.517634] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-22T19:59:35.132189] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T19:59:35.317626] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-22T19:59:35.631200] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T19:59:35.634855] [INFO ] [REMOTE ] MQY: Full fetch complete (26029 records). [2025-10-22T19:59:35.634948] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-22T19:59:36.007733] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-10-22T19:59:36.011421] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-10-22T19:59:36.012036] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-10-22T19:59:36.012098] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-10-22T19:59:36.012957] [DEBUG] [LOCAL ] MQY: Trimmed 26029 records to 16545 (keeping 200 days of data) [2025-10-22T19:59:36.114237] [DEBUG] [LOCAL ] MQY: Primary data saved (16545 records). [2025-10-22T19:59:36.114386] [INFO ] [MAIN ] MQY: Full history saved. [2025-10-22T19:59:36.114489] [INFO ] [MAIN ] Update Progress: 1397/2367 symbols completed. MQY took 28.6s. Estimated remaining: 2h 4m 39s. Rate: 7.8 symbols/min [2025-10-22T19:59:36.117604] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-22T19:59:36.917807] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-22T19:59:37.552939] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-22T19:59:37.620194] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T19:59:37.717622] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-22T19:59:38.517626] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-22T19:59:38.859567] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T19:59:39.317674] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-22T19:59:40.019071] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-22T19:59:40.090534] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T19:59:40.096781] [INFO ] [REMOTE ] MRC: Full fetch complete (55164 records). [2025-10-22T19:59:40.096884] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-22T19:59:40.129707] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-22T19:59:40.480782] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-10-22T19:59:40.480901] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-10-22T19:59:40.481783] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-10-22T19:59:40.481847] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-10-22T19:59:40.483036] [DEBUG] [LOCAL ] MRC: Trimmed 55164 records to 37105 (keeping 200 days of data) [2025-10-22T19:59:40.694332] [DEBUG] [LOCAL ] MRC: Primary data saved (37105 records). [2025-10-22T19:59:40.694465] [INFO ] [MAIN ] MRC: Full history saved. [2025-10-22T19:59:40.694541] [INFO ] [MAIN ] Update Progress: 1398/2367 symbols completed. MRC took 24.1s. Estimated remaining: 2h 4m 29s. Rate: 7.8 symbols/min [2025-10-22T19:59:40.806233] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T19:59:40.917634] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-22T19:59:42.447159] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-22T19:59:42.459021] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-22T19:59:42.989510] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-22T19:59:43.000553] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-22T19:59:44.780414] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-22T19:59:44.791584] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-22T19:59:44.893129] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-22T19:59:44.904341] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-22T19:59:46.767550] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T19:59:46.779134] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-22T19:59:46.830875] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-22T19:59:46.841758] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-22T19:59:48.619165] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-22T19:59:48.630103] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-22T19:59:49.145773] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-22T19:59:49.162109] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-22T19:59:50.691378] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-22T19:59:50.703095] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-22T19:59:51.361784] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-22T19:59:51.373258] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-22T19:59:52.494523] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T19:59:52.506576] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-22T19:59:53.615118] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-22T19:59:53.626762] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-22T19:59:54.576755] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-22T19:59:54.588236] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-22T19:59:56.092486] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-22T19:59:56.101314] [INFO ] [REMOTE ] MRK: Full fetch complete (77968 records). [2025-10-22T19:59:56.101464] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-10-22T19:59:56.485685] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-10-22T19:59:56.485783] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-10-22T19:59:56.486860] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-10-22T19:59:56.486922] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-10-22T19:59:56.488360] [DEBUG] [LOCAL ] MRK: Trimmed 77968 records to 53790 (keeping 200 days of data) [2025-10-22T19:59:56.741977] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-22T19:59:56.752495] [INFO ] [REMOTE ] MS: Full fetch complete (77858 records). [2025-10-22T19:59:56.753368] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-22T19:59:57.249972] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-10-22T19:59:57.251378] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-10-22T19:59:57.253267] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-10-22T19:59:57.253608] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-10-22T19:59:57.259712] [DEBUG] [LOCAL ] MS: Trimmed 77858 records to 53688 (keeping 200 days of data) [2025-10-22T19:59:57.264395] [DEBUG] [LOCAL ] MRK: Primary data saved (53790 records). [2025-10-22T19:59:57.264852] [INFO ] [MAIN ] MRK: Full history saved. [2025-10-22T19:59:57.265174] [INFO ] [MAIN ] Update Progress: 1399/2367 symbols completed. MRK took 32.6s. Estimated remaining: 2h 4m 28s. Rate: 7.8 symbols/min [2025-10-22T19:59:57.600506] [DEBUG] [LOCAL ] MS: Primary data saved (53688 records). [2025-10-22T19:59:57.600665] [INFO ] [MAIN ] MS: Full history saved. [2025-10-22T19:59:57.600762] [INFO ] [MAIN ] Update Progress: 1400/2367 symbols completed. MS took 24.5s. Estimated remaining: 2h 4m 15s. Rate: 7.8 symbols/min [2025-10-22T19:59:58.181518] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:59:58.219850] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-22T19:59:58.219626] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:59:58.267478] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-22T19:59:58.272785] [DEBUG] [LOCAL ] MSA: No existing data file found in primary storage. [2025-10-22T19:59:58.287395] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-22T19:59:58.298707] [WARN ] [MAIN ] MSA: No existing data found, performing full refresh instead. [2025-10-22T19:59:58.317465] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:59:58.318149] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-22T19:59:58.311074] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-22T19:59:58.318899] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-22T19:59:58.339600] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-22T19:59:58.325349] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-22T19:59:58.342999] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-22T19:59:58.343149] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-22T19:59:58.342749] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T19:59:58.513776] [DEBUG] [LOCAL ] MSB: Loaded 7970 existing records from primary storage. [2025-10-22T19:59:58.582631] [INFO ] [MAIN ] MSB: Loaded 7970 existing records. [2025-10-22T19:59:58.735164] [DEBUG] [LOCAL ] MSCI: Loaded 34327 existing records from primary storage. [2025-10-22T19:59:58.847560] [INFO ] [MAIN ] MSCI: Loaded 34327 existing records. [2025-10-22T19:59:59.564816] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:59:59.621439] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-22T19:59:59.656534] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:59:59.648242] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T19:59:59.660977] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T19:59:59.662817] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-22T19:59:59.663025] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-22T19:59:59.664583] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-22T19:59:59.664502] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-22T19:59:59.664918] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-22T19:59:59.665169] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-10-22T19:59:59.665225] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-22T19:59:59.665260] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-10-22T19:59:59.665557] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-22T20:00:00.275867] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-22T20:00:00.361841] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-22T20:00:00.434947] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:00:00.430846] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:00:00.436282] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-22T20:00:00.438225] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-22T20:00:00.490120] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-22T20:00:00.495134] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-22T20:00:01.009859] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T20:00:01.011381] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-22T20:00:01.486584] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-22T20:00:01.487975] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-22T20:00:01.525240] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-22T20:00:01.528994] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-22T20:00:01.724337] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T20:00:01.730270] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-10-22T20:00:01.896268] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T20:00:01.903417] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-22T20:00:02.116266] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-22T20:00:02.119539] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-22T20:00:02.371824] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-22T20:00:02.372789] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-22T20:00:02.837365] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T20:00:02.841587] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-10-22T20:00:03.004476] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-22T20:00:03.047626] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-22T20:00:03.317770] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-22T20:00:03.554812] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T20:00:04.065678] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T20:00:04.117708] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-22T20:00:04.220628] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-22T20:00:04.917718] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-22T20:00:05.714082] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T20:00:05.717608] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-22T20:00:05.923903] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T20:00:06.517631] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-22T20:00:06.593900] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T20:00:07.317692] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-22T20:00:08.117627] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-10-22T20:00:08.190674] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T20:00:08.355867] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T20:00:08.917678] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-22T20:00:09.239365] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T20:00:09.261589] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-22T20:00:09.717687] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-22T20:00:10.226678] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-22T20:00:10.517633] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-22T20:00:11.317786] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-22T20:00:11.757011] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-22T20:00:12.117729] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-10-22T20:00:12.651053] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T20:00:12.917637] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-22T20:00:13.225119] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T20:00:13.708266] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T20:00:13.717598] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-22T20:00:14.517694] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-22T20:00:14.640367] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-22T20:00:14.643257] [INFO ] [REMOTE ] MSB: Full fetch complete (13188 records). [2025-10-22T20:00:14.643360] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-22T20:00:15.008013] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-10-22T20:00:15.008289] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-10-22T20:00:15.008620] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-10-22T20:00:15.008689] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-10-22T20:00:15.009158] [DEBUG] [LOCAL ] MSB: Trimmed 13188 records to 7968 (keeping 200 days of data) [2025-10-22T20:00:15.055667] [DEBUG] [LOCAL ] MSB: Primary data saved (7968 records). [2025-10-22T20:00:15.055795] [INFO ] [MAIN ] MSB: Full history saved. [2025-10-22T20:00:15.055877] [INFO ] [MAIN ] Update Progress: 1401/2367 symbols completed. MSB took 17.4s. Estimated remaining: 2h 4m 14s. Rate: 7.8 symbols/min [2025-10-22T20:00:15.223021] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:00:15.239237] [DEBUG] [LOCAL ] MSD: Loaded 16587 existing records from primary storage. [2025-10-22T20:00:15.239465] [INFO ] [MAIN ] MSD: Loaded 16587 existing records. [2025-10-22T20:00:15.326629] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-10-22T20:00:15.412979] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:00:15.413185] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-22T20:00:15.413231] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-22T20:00:15.413435] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-10-22T20:00:15.413490] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-22T20:00:15.772189] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:00:15.852337] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T20:00:16.117629] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-22T20:00:16.331791] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T20:00:16.917667] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-22T20:00:17.717704] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-22T20:00:17.798343] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T20:00:17.825339] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-22T20:00:18.179406] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-22T20:00:18.517667] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-22T20:00:19.317726] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-10-22T20:00:19.888623] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T20:00:20.117732] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-22T20:00:20.387675] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-22T20:00:20.599172] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-22T20:00:20.917689] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-10-22T20:00:21.717637] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-22T20:00:21.870728] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T20:00:22.517671] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-10. [2025-10-22T20:00:23.147924] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T20:00:23.317710] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-22T20:00:23.607829] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T20:00:23.611794] [INFO ] [REMOTE ] MSA: Full fetch complete (25914 records). [2025-10-22T20:00:23.611914] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-10-22T20:00:24.107140] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-10-22T20:00:24.107238] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-10-22T20:00:24.108118] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-10-22T20:00:24.108189] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-10-22T20:00:24.109306] [DEBUG] [LOCAL ] MSA: Trimmed 25914 records to 18830 (keeping 200 days of data) [2025-10-22T20:00:24.186959] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-22T20:00:24.305798] [DEBUG] [LOCAL ] MSA: Primary data saved (18830 records). [2025-10-22T20:00:24.305960] [INFO ] [MAIN ] MSA: Full history saved. [2025-10-22T20:00:24.306039] [INFO ] [MAIN ] Update Progress: 1402/2367 symbols completed. MSA took 26.7s. Estimated remaining: 2h 4m 7s. Rate: 7.8 symbols/min [2025-10-22T20:00:24.580466] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:00:24.634742] [DEBUG] [LOCAL ] MSDL: Loaded 38655 existing records from primary storage. [2025-10-22T20:00:24.635161] [INFO ] [MAIN ] MSDL: Loaded 38655 existing records. [2025-10-22T20:00:24.761083] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-22T20:00:24.781450] [INFO ] [REMOTE ] MSC: Full fetch complete (2484 records). [2025-10-22T20:00:24.806046] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-22T20:00:24.940158] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-22T20:00:25.017142] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:00:25.057824] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-22T20:00:25.063163] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-22T20:00:25.108503] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-22T20:00:25.104833] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-10-22T20:00:25.108851] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-22T20:00:25.108794] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:00:25.183903] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:00:25.189194] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-22T20:00:25.189398] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-22T20:00:25.207949] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-22T20:00:25.211059] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-22T20:00:25.211213] [INFO ] [MAIN ] Update Progress: 1403/2367 symbols completed. MSC took 27.6s. Estimated remaining: 2h 3m 55s. Rate: 7.8 symbols/min [2025-10-22T20:00:25.562791] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-22T20:00:25.582041] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:00:25.645084] [INFO ] [REMOTE ] MSCI: Full fetch complete (50619 records). [2025-10-22T20:00:25.667779] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-22T20:00:25.667532] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:00:25.735434] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-22T20:00:25.863733] [DEBUG] [LOCAL ] MSGE: Loaded 26990 existing records from primary storage. [2025-10-22T20:00:25.905577] [INFO ] [MAIN ] MSGE: Loaded 26990 existing records. [2025-10-22T20:00:26.285209] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T20:00:26.284637] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:00:26.285361] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-10-22T20:00:26.289053] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-22T20:00:26.289508] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-22T20:00:26.289428] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-10-22T20:00:26.290690] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-10-22T20:00:26.290624] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-10-22T20:00:26.290794] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-10-22T20:00:26.290872] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-22T20:00:26.389827] [DEBUG] [LOCAL ] MSCI: Trimmed 50619 records to 34183 (keeping 200 days of data) [2025-10-22T20:00:26.536854] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-22T20:00:26.764678] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:00:26.878676] [DEBUG] [LOCAL ] MSCI: Primary data saved (34183 records). [2025-10-22T20:00:26.878863] [INFO ] [MAIN ] MSCI: Full history saved. [2025-10-22T20:00:26.878969] [INFO ] [MAIN ] Update Progress: 1404/2367 symbols completed. MSCI took 29.3s. Estimated remaining: 2h 3m 43s. Rate: 7.8 symbols/min [2025-10-22T20:00:27.048671] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:00:27.070096] [DEBUG] [LOCAL ] MSGS: Loaded 17296 existing records from primary storage. [2025-10-22T20:00:27.070376] [INFO ] [MAIN ] MSGS: Loaded 17296 existing records. [2025-10-22T20:00:27.260317] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:00:27.260600] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-22T20:00:27.260693] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-22T20:00:27.260894] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-10-22T20:00:27.260944] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-22T20:00:27.320392] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-22T20:00:27.575468] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T20:00:27.662910] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:00:27.809632] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-22T20:00:28.117725] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-22T20:00:28.459712] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T20:00:28.917689] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-22T20:00:28.966976] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-22T20:00:29.717698] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-22T20:00:30.011683] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T20:00:30.517694] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-22T20:00:31.069828] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T20:00:31.317706] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-22T20:00:31.432719] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-22T20:00:32.117731] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-22T20:00:32.713904] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T20:00:32.917682] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-22T20:00:33.009099] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-22T20:00:33.717690] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-22T20:00:34.485029] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T20:00:34.517705] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-22T20:00:35.050239] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-22T20:00:35.317680] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-22T20:00:35.664676] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T20:00:36.117734] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-22T20:00:36.313854] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-22T20:00:36.917621] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-22T20:00:37.232073] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T20:00:37.717620] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-22T20:00:38.517720] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-22T20:00:38.538255] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T20:00:38.948099] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T20:00:39.317687] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-22T20:00:39.575987] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T20:00:40.117695] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-22T20:00:40.638121] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T20:00:40.917665] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-22T20:00:41.010306] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T20:00:41.717671] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-22T20:00:42.063278] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T20:00:42.517665] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-22T20:00:42.534762] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-22T20:00:43.317638] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-22T20:00:43.697161] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T20:00:44.117623] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-22T20:00:44.449786] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-22T20:00:44.917773] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-22T20:00:45.099111] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-22T20:00:45.717708] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-22T20:00:46.081867] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-22T20:00:46.517712] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-22T20:00:46.762593] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T20:00:47.317741] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-22T20:00:48.059167] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T20:00:48.117622] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-22T20:00:48.453847] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T20:00:48.917776] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-22T20:00:49.344161] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T20:00:49.717691] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-22T20:00:49.922801] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-22T20:00:50.517628] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-22T20:00:50.926039] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T20:00:51.317631] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-22T20:00:51.519036] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T20:00:52.117727] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-22T20:00:52.401283] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T20:00:52.917676] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-22T20:00:53.623552] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T20:00:53.717666] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-22T20:00:53.892605] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-22T20:00:53.898105] [INFO ] [REMOTE ] MSGE: Full fetch complete (40058 records). [2025-10-22T20:00:53.898207] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-22T20:00:54.266427] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-10-22T20:00:54.266533] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-10-22T20:00:54.267287] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-10-22T20:00:54.267350] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-10-22T20:00:54.268308] [DEBUG] [LOCAL ] MSGE: Trimmed 40058 records to 27002 (keeping 200 days of data) [2025-10-22T20:00:54.421130] [DEBUG] [LOCAL ] MSGE: Primary data saved (27002 records). [2025-10-22T20:00:54.421258] [INFO ] [MAIN ] MSGE: Full history saved. [2025-10-22T20:00:54.421335] [INFO ] [MAIN ] Update Progress: 1405/2367 symbols completed. MSGE took 29.2s. Estimated remaining: 2h 3m 49s. Rate: 7.8 symbols/min [2025-10-22T20:00:54.520416] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-22T20:00:54.589095] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:00:54.625087] [DEBUG] [LOCAL ] MSI: Loaded 39735 existing records from primary storage. [2025-10-22T20:00:54.625412] [INFO ] [MAIN ] MSI: Loaded 39735 existing records. [2025-10-22T20:00:54.801820] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:00:54.802052] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-22T20:00:54.802104] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-22T20:00:54.802282] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-10-22T20:00:54.802319] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-22T20:00:55.157943] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:00:55.317685] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-22T20:00:55.466199] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T20:00:55.484926] [INFO ] [REMOTE ] MSDL: Full fetch complete (56372 records). [2025-10-22T20:00:55.485991] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-22T20:00:55.485868] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-22T20:00:55.530564] [INFO ] [REMOTE ] MSGS: Full fetch complete (23737 records). [2025-10-22T20:00:55.541163] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-22T20:00:56.124232] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-22T20:00:56.269171] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-10-22T20:00:56.279525] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-10-22T20:00:56.285526] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-10-22T20:00:56.290727] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-10-22T20:00:56.348996] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-10-22T20:00:56.349146] [DEBUG] [LOCAL ] MSDL: Trimmed 56372 records to 38577 (keeping 200 days of data) [2025-10-22T20:00:56.349226] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-10-22T20:00:56.349542] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-10-22T20:00:56.349617] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-10-22T20:00:56.350845] [DEBUG] [LOCAL ] MSGS: Trimmed 23737 records to 17199 (keeping 200 days of data) [2025-10-22T20:00:56.567711] [DEBUG] [LOCAL ] MSGS: Primary data saved (17199 records). [2025-10-22T20:00:56.568125] [INFO ] [MAIN ] MSGS: Full history saved. [2025-10-22T20:00:56.568219] [INFO ] [MAIN ] Update Progress: 1406/2367 symbols completed. MSGS took 29.7s. Estimated remaining: 2h 3m 37s. Rate: 7.8 symbols/min [2025-10-22T20:00:56.840557] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:00:56.841350] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-22T20:00:56.841404] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-22T20:00:56.841513] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-22T20:00:56.841554] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-22T20:00:56.841595] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-22T20:00:56.841627] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-22T20:00:57.197203] [DEBUG] [LOCAL ] MSDL: Primary data saved (38577 records). [2025-10-22T20:00:57.202747] [INFO ] [MAIN ] MSDL: Full history saved. [2025-10-22T20:00:57.231210] [INFO ] [MAIN ] Update Progress: 1407/2367 symbols completed. MSDL took 32.9s. Estimated remaining: 2h 3m 25s. Rate: 7.8 symbols/min [2025-10-22T20:00:57.279867] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-22T20:00:57.272391] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:00:57.309598] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-01. [2025-10-22T20:00:57.411065] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-22T20:00:57.470162] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:00:57.470315] [INFO ] [REMOTE ] MSD: Full fetch complete (23137 records). [2025-10-22T20:00:57.470883] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-22T20:00:57.724316] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-22T20:00:57.781967] [DEBUG] [LOCAL ] MSM: Loaded 35438 existing records from primary storage. [2025-10-22T20:00:57.789914] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-22T20:00:57.802356] [INFO ] [MAIN ] MSM: Loaded 35438 existing records. [2025-10-22T20:00:57.983187] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-10-22T20:00:57.983602] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-10-22T20:00:57.989756] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-10-22T20:00:57.994977] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-10-22T20:00:58.043544] [DEBUG] [LOCAL ] MSD: Trimmed 23137 records to 16543 (keeping 200 days of data) [2025-10-22T20:00:58.065486] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:00:58.065915] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-22T20:00:58.066141] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-22T20:00:58.066397] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-10-22T20:00:58.066455] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-22T20:00:58.524250] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:00:58.524351] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-10-22T20:00:58.651008] [DEBUG] [LOCAL ] MSD: Primary data saved (16543 records). [2025-10-22T20:00:58.651180] [INFO ] [MAIN ] MSD: Full history saved. [2025-10-22T20:00:58.651270] [INFO ] [MAIN ] Update Progress: 1408/2367 symbols completed. MSD took 43.6s. Estimated remaining: 2h 3m 13s. Rate: 7.8 symbols/min [2025-10-22T20:00:58.821854] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:00:58.867201] [DEBUG] [LOCAL ] MT: Loaded 50424 existing records from primary storage. [2025-10-22T20:00:58.867512] [INFO ] [MAIN ] MT: Loaded 50424 existing records. [2025-10-22T20:00:59.047429] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:00:59.047690] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-22T20:00:59.047772] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-22T20:00:59.048059] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-10-22T20:00:59.048100] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-22T20:00:59.321351] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-22T20:00:59.396212] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-22T20:00:59.426465] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:00:59.449875] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T20:01:00.117656] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-22T20:01:00.917685] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-10-22T20:01:01.084442] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T20:01:01.717691] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-22T20:01:01.976684] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-22T20:01:02.184048] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-22T20:01:02.517696] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-10-22T20:01:03.263841] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-22T20:01:03.267798] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T20:01:03.317667] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-22T20:01:04.117718] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-22T20:01:04.740422] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T20:01:04.917681] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-10-22T20:01:05.572334] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T20:01:05.717700] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-10-22T20:01:05.853409] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T20:01:06.517668] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-22T20:01:06.662669] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T20:01:07.317779] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-22T20:01:08.117634] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-22T20:01:08.292375] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T20:01:08.649091] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T20:01:08.917687] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-10-22T20:01:09.717687] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-22T20:01:09.755144] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-22T20:01:09.782707] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T20:01:10.517715] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-10-22T20:01:11.317638] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-22T20:01:11.629703] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T20:01:11.709028] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T20:01:12.117737] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-22T20:01:12.917634] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-22T20:01:13.132610] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T20:01:13.536291] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T20:01:13.717773] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-10-22T20:01:14.517739] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-22T20:01:14.808866] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-22T20:01:14.827056] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-22T20:01:15.317737] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-10. [2025-10-22T20:01:15.924766] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T20:01:16.117719] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-22T20:01:16.619423] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-22T20:01:16.628753] [INFO ] [REMOTE ] MSIF: Full fetch complete (19296 records). [2025-10-22T20:01:16.629033] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-10-22T20:01:16.920469] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-22T20:01:16.933808] [WARN ] [VALIDATOR ] MSIF: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-10-22T20:01:16.935293] [FATAL] [MAIN ] MSIF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:01:16.935397] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:01:16.935495] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-22T20:01:16.935592] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-22T20:01:16.935669] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-22T20:01:16.935856] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-22T20:01:16.935994] [INFO ] [MAIN ] Update Progress: 1409/2367 symbols completed. MSIF took 20.4s. Estimated remaining: 2h 3m 12s. Rate: 7.8 symbols/min [2025-10-22T20:01:17.163969] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:01:17.208143] [DEBUG] [LOCAL ] MTB: Loaded 46648 existing records from primary storage. [2025-10-22T20:01:17.208478] [INFO ] [MAIN ] MTB: Loaded 46648 existing records. [2025-10-22T20:01:17.394982] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:01:17.395214] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-22T20:01:17.395264] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-22T20:01:17.395768] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-10-22T20:01:17.395827] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-22T20:01:17.733710] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-22T20:01:17.770048] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:01:17.794779] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T20:01:18.517737] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-22T20:01:18.625776] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T20:01:19.317839] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-22T20:01:19.317727] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T20:01:20.059741] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T20:01:20.117632] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-22T20:01:20.917840] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-22T20:01:21.078955] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T20:01:21.724427] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-22T20:01:21.729528] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T20:01:22.517620] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-22T20:01:22.600116] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T20:01:22.994356] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T20:01:23.317668] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-22T20:01:24.123035] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-22T20:01:24.132942] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T20:01:24.910382] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T20:01:24.917953] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-22T20:01:25.717625] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-22T20:01:25.809758] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T20:01:26.517678] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-22T20:01:26.803344] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T20:01:27.049308] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T20:01:27.055626] [INFO ] [REMOTE ] MSM: Full fetch complete (51929 records). [2025-10-22T20:01:27.055741] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-22T20:01:27.322838] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-22T20:01:27.434126] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-10-22T20:01:27.434205] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-10-22T20:01:27.435025] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-10-22T20:01:27.435088] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-10-22T20:01:27.436183] [DEBUG] [LOCAL ] MSM: Trimmed 51929 records to 35407 (keeping 200 days of data) [2025-10-22T20:01:27.652953] [DEBUG] [LOCAL ] MSM: Primary data saved (35407 records). [2025-10-22T20:01:27.653121] [INFO ] [MAIN ] MSM: Full history saved. [2025-10-22T20:01:27.653214] [INFO ] [MAIN ] Update Progress: 1410/2367 symbols completed. MSM took 30.4s. Estimated remaining: 2h 3m 7s. Rate: 7.8 symbols/min [2025-10-22T20:01:27.848665] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:01:27.865017] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T20:01:27.874608] [INFO ] [REMOTE ] MSI: Full fetch complete (58059 records). [2025-10-22T20:01:27.874771] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-22T20:01:27.981316] [DEBUG] [LOCAL ] MTD: Loaded 15275 existing records from primary storage. [2025-10-22T20:01:27.992510] [INFO ] [MAIN ] MTD: Loaded 15275 existing records. [2025-10-22T20:01:28.121601] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-22T20:01:28.398622] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:01:28.409120] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-22T20:01:28.414307] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-22T20:01:28.419624] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-10-22T20:01:28.433699] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-22T20:01:28.548330] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-10-22T20:01:28.556826] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-10-22T20:01:28.567889] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-10-22T20:01:28.578673] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-10-22T20:01:28.623892] [DEBUG] [LOCAL ] MSI: Trimmed 58059 records to 39574 (keeping 200 days of data) [2025-10-22T20:01:29.014078] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:01:29.019159] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-22T20:01:29.188351] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T20:01:29.203482] [DEBUG] [LOCAL ] MSI: Primary data saved (39574 records). [2025-10-22T20:01:29.203609] [INFO ] [MAIN ] MSI: Full history saved. [2025-10-22T20:01:29.203722] [INFO ] [MAIN ] Update Progress: 1411/2367 symbols completed. MSI took 34.8s. Estimated remaining: 2h 2m 55s. Rate: 7.8 symbols/min [2025-10-22T20:01:29.372706] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:01:29.418913] [DEBUG] [LOCAL ] MTDR: Loaded 51762 existing records from primary storage. [2025-10-22T20:01:29.419202] [INFO ] [MAIN ] MTDR: Loaded 51762 existing records. [2025-10-22T20:01:29.603846] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:01:29.604083] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-22T20:01:29.604142] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-22T20:01:29.604343] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-10-22T20:01:29.604398] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-22T20:01:29.721748] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-22T20:01:29.964842] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T20:01:30.025271] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T20:01:30.066709] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:01:30.517728] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-22T20:01:31.317718] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-22T20:01:31.558358] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T20:01:32.117704] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-22T20:01:32.348784] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T20:01:32.875750] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T20:01:32.917733] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-22T20:01:33.717722] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-22T20:01:33.847908] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T20:01:34.526748] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-22T20:01:34.532046] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T20:01:34.575247] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T20:01:35.317677] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-22T20:01:36.107073] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T20:01:36.117606] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-22T20:01:36.917724] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-22T20:01:37.287442] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-22T20:01:37.299434] [INFO ] [REMOTE ] MT: Full fetch complete (73780 records). [2025-10-22T20:01:37.299584] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-22T20:01:37.700164] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-10-22T20:01:37.700353] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-10-22T20:01:37.701491] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-10-22T20:01:37.701604] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-10-22T20:01:37.703328] [DEBUG] [LOCAL ] MT: Trimmed 73780 records to 50419 (keeping 200 days of data) [2025-10-22T20:01:37.752572] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-22T20:01:37.858729] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T20:01:38.045862] [DEBUG] [LOCAL ] MT: Primary data saved (50419 records). [2025-10-22T20:01:38.046040] [INFO ] [MAIN ] MT: Full history saved. [2025-10-22T20:01:38.046127] [INFO ] [MAIN ] Update Progress: 1412/2367 symbols completed. MT took 39.4s. Estimated remaining: 2h 2m 48s. Rate: 7.8 symbols/min [2025-10-22T20:01:38.215748] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:01:38.262594] [DEBUG] [LOCAL ] MTG: Loaded 51078 existing records from primary storage. [2025-10-22T20:01:38.262916] [INFO ] [MAIN ] MTG: Loaded 51078 existing records. [2025-10-22T20:01:38.439076] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:01:38.439268] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-22T20:01:38.439315] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-22T20:01:38.439501] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-10-22T20:01:38.439538] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-22T20:01:38.519451] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-22T20:01:38.807886] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:01:38.817377] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-22T20:01:38.862597] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T20:01:39.317738] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-22T20:01:40.117700] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-22T20:01:40.188867] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T20:01:40.917624] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-22T20:01:41.033861] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T20:01:41.234974] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T20:01:41.717668] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-22T20:01:42.503174] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T20:01:42.517602] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-22T20:01:43.317631] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-22T20:01:43.428584] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T20:01:44.122946] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-22T20:01:44.145446] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T20:01:44.917670] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-22T20:01:45.095568] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T20:01:45.717705] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-22T20:01:46.113111] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-22T20:01:46.121250] [INFO ] [REMOTE ] MTB: Full fetch complete (68343 records). [2025-10-22T20:01:46.121386] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-22T20:01:46.516059] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-10-22T20:01:46.516204] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-10-22T20:01:46.517196] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-10-22T20:01:46.517308] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-10-22T20:01:46.517616] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-22T20:01:46.519429] [DEBUG] [LOCAL ] MTB: Trimmed 68343 records to 46640 (keeping 200 days of data) [2025-10-22T20:01:46.654056] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T20:01:46.849524] [DEBUG] [LOCAL ] MTB: Primary data saved (46640 records). [2025-10-22T20:01:46.849689] [INFO ] [MAIN ] MTB: Full history saved. [2025-10-22T20:01:46.849785] [INFO ] [MAIN ] Update Progress: 1413/2367 symbols completed. MTB took 29.9s. Estimated remaining: 2h 2m 41s. Rate: 7.8 symbols/min [2025-10-22T20:01:47.017792] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:01:47.063837] [DEBUG] [LOCAL ] MTH: Loaded 43836 existing records from primary storage. [2025-10-22T20:01:47.064214] [INFO ] [MAIN ] MTH: Loaded 43836 existing records. [2025-10-22T20:01:47.250222] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:01:47.250430] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-22T20:01:47.250478] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-22T20:01:47.250724] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-10-22T20:01:47.250782] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-22T20:01:47.318440] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-22T20:01:47.637218] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:01:47.641589] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-22T20:01:47.673580] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T20:01:48.117710] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-22T20:01:48.917635] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-22T20:01:49.105374] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T20:01:49.717635] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-22T20:01:50.003693] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T20:01:50.487717] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T20:01:50.517669] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-22T20:01:51.317688] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-22T20:01:51.518155] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T20:01:51.992020] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T20:01:52.117683] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-22T20:01:52.917730] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-22T20:01:53.070154] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T20:01:53.720858] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-22T20:01:53.724521] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T20:01:54.517704] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-22T20:01:54.566323] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T20:01:54.662425] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T20:01:55.317688] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-22T20:01:56.117626] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-22T20:01:56.220240] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T20:01:56.917628] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-22T20:01:57.003347] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T20:01:57.717622] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-22T20:01:57.877941] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T20:01:57.956047] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T20:01:58.517724] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-22T20:01:59.317682] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-22T20:01:59.663465] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T20:01:59.672287] [INFO ] [REMOTE ] MTDR: Full fetch complete (74344 records). [2025-10-22T20:01:59.672439] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-22T20:02:00.076806] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-10-22T20:02:00.076999] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-10-22T20:02:00.078074] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-10-22T20:02:00.078251] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-10-22T20:02:00.111466] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T20:02:00.109707] [DEBUG] [LOCAL ] MTDR: Trimmed 74344 records to 51762 (keeping 200 days of data) [2025-10-22T20:02:00.121771] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-22T20:02:00.244724] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-22T20:02:00.454756] [DEBUG] [LOCAL ] MTDR: Primary data saved (51762 records). [2025-10-22T20:02:00.454907] [INFO ] [MAIN ] MTDR: Full history saved. [2025-10-22T20:02:00.454986] [INFO ] [MAIN ] Update Progress: 1414/2367 symbols completed. MTDR took 31.3s. Estimated remaining: 2h 2m 37s. Rate: 7.8 symbols/min [2025-10-22T20:02:00.628772] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:02:00.667313] [DEBUG] [LOCAL ] MTN: Loaded 39441 existing records from primary storage. [2025-10-22T20:02:00.667621] [INFO ] [MAIN ] MTN: Loaded 39441 existing records. [2025-10-22T20:02:00.846743] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:02:00.846991] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-22T20:02:00.847077] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-22T20:02:00.847453] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-10-22T20:02:00.847741] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-22T20:02:00.925937] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-22T20:02:01.211972] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:02:01.717720] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-22T20:02:01.832167] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T20:02:02.517704] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-22T20:02:02.719721] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T20:02:02.846777] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-22T20:02:03.198825] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T20:02:03.317727] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-22T20:02:04.117731] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-22T20:02:04.598274] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T20:02:04.601233] [INFO ] [REMOTE ] MTD: Full fetch complete (21482 records). [2025-10-22T20:02:04.601309] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-22T20:02:04.922777] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-22T20:02:04.986458] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-10-22T20:02:04.986540] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-10-22T20:02:04.987027] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-10-22T20:02:04.987090] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-10-22T20:02:04.987911] [DEBUG] [LOCAL ] MTD: Trimmed 21482 records to 15156 (keeping 200 days of data) [2025-10-22T20:02:05.099443] [DEBUG] [LOCAL ] MTD: Primary data saved (15156 records). [2025-10-22T20:02:05.099603] [INFO ] [MAIN ] MTD: Full history saved. [2025-10-22T20:02:05.099730] [INFO ] [MAIN ] Update Progress: 1415/2367 symbols completed. MTD took 37.4s. Estimated remaining: 2h 2m 27s. Rate: 7.8 symbols/min [2025-10-22T20:02:05.271007] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:02:05.271198] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-22T20:02:05.271253] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-22T20:02:05.271368] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-22T20:02:05.271409] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-22T20:02:05.271454] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-22T20:02:05.271487] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-22T20:02:05.632334] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:02:05.701721] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T20:02:05.717678] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-22T20:02:06.144921] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T20:02:06.218115] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-22T20:02:06.517727] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-22T20:02:06.870434] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-22T20:02:07.317718] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-22T20:02:08.117937] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-22T20:02:08.511199] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-22T20:02:08.820271] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T20:02:08.917739] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-22T20:02:09.717708] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-22T20:02:10.075154] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-22T20:02:10.517730] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-22T20:02:10.737156] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T20:02:10.746002] [INFO ] [REMOTE ] MTG: Full fetch complete (74271 records). [2025-10-22T20:02:10.746153] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-10-22T20:02:11.144215] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-10-22T20:02:11.144301] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-10-22T20:02:11.145352] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-10-22T20:02:11.145416] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-10-22T20:02:11.146850] [DEBUG] [LOCAL ] MTG: Trimmed 74271 records to 51061 (keeping 200 days of data) [2025-10-22T20:02:11.320140] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-22T20:02:11.469002] [DEBUG] [LOCAL ] MTG: Primary data saved (51061 records). [2025-10-22T20:02:11.469177] [INFO ] [MAIN ] MTG: Full history saved. [2025-10-22T20:02:11.469274] [INFO ] [MAIN ] Update Progress: 1416/2367 symbols completed. MTG took 33.4s. Estimated remaining: 2h 2m 19s. Rate: 7.8 symbols/min [2025-10-22T20:02:11.656131] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:02:11.675131] [DEBUG] [LOCAL ] MTRN: Loaded 18253 existing records from primary storage. [2025-10-22T20:02:11.675373] [INFO ] [MAIN ] MTRN: Loaded 18253 existing records. [2025-10-22T20:02:11.773220] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-22T20:02:11.885881] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:02:11.886092] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-22T20:02:11.886140] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-22T20:02:11.886302] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-10-22T20:02:11.886342] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-22T20:02:12.122694] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-22T20:02:12.262800] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:02:12.291026] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T20:02:12.916414] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-22T20:02:12.918130] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-22T20:02:13.717729] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-22T20:02:14.524413] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-22T20:02:14.531992] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T20:02:14.580455] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-22T20:02:15.007207] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-22T20:02:15.317703] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-22T20:02:16.117683] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-22T20:02:16.184276] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-22T20:02:16.917727] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-22T20:02:17.717699] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-22T20:02:17.822483] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T20:02:17.972876] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-22T20:02:18.517667] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-22T20:02:19.317717] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-22T20:02:19.477713] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T20:02:19.545904] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-22T20:02:19.672416] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-22T20:02:20.117689] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-22T20:02:20.917684] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-22T20:02:21.717631] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-22T20:02:21.801733] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T20:02:21.812856] [INFO ] [REMOTE ] MTH: Full fetch complete (64157 records). [2025-10-22T20:02:21.813001] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-10-22T20:02:22.212914] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-10-22T20:02:22.213009] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-10-22T20:02:22.213949] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-10-22T20:02:22.214019] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-10-22T20:02:22.215369] [DEBUG] [LOCAL ] MTH: Trimmed 64157 records to 43777 (keeping 200 days of data) [2025-10-22T20:02:22.513412] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-22T20:02:22.515320] [DEBUG] [LOCAL ] MTH: Primary data saved (43777 records). [2025-10-22T20:02:22.522730] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-22T20:02:22.524018] [INFO ] [MAIN ] MTH: Full history saved. [2025-10-22T20:02:22.524289] [INFO ] [MAIN ] Update Progress: 1417/2367 symbols completed. MTH took 35.7s. Estimated remaining: 2h 2m 13s. Rate: 7.8 symbols/min [2025-10-22T20:02:22.693385] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:02:22.719337] [DEBUG] [LOCAL ] MTUS: Loaded 27534 existing records from primary storage. [2025-10-22T20:02:22.719579] [INFO ] [MAIN ] MTUS: Loaded 27534 existing records. [2025-10-22T20:02:22.899745] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:02:22.900027] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-22T20:02:22.900100] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-22T20:02:22.900296] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-10-22T20:02:22.900346] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-22T20:02:22.999174] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-22T20:02:22.987891] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-22T20:02:23.268152] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:02:23.317613] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-22T20:02:24.117674] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-22T20:02:24.594608] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T20:02:24.619588] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-22T20:02:24.620242] [INFO ] [REMOTE ] MTR: Full fetch complete (2364 records). [2025-10-22T20:02:24.620308] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-10-22T20:02:24.827626] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T20:02:24.827864] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:02:24.827933] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:02:24.828006] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-22T20:02:24.828066] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-22T20:02:24.828103] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-22T20:02:24.828149] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-22T20:02:24.828203] [INFO ] [MAIN ] Update Progress: 1418/2367 symbols completed. MTR took 19.7s. Estimated remaining: 2h 2m 2s. Rate: 7.8 symbols/min [2025-10-22T20:02:24.923109] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-22T20:02:24.999950] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:02:25.028911] [DEBUG] [LOCAL ] MTW: Loaded 26484 existing records from primary storage. [2025-10-22T20:02:25.029280] [INFO ] [MAIN ] MTW: Loaded 26484 existing records. [2025-10-22T20:02:25.214375] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:02:25.214634] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-22T20:02:25.214716] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-22T20:02:25.215010] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-10-22T20:02:25.215069] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-22T20:02:25.627245] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:02:25.717721] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-22T20:02:25.968935] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-22T20:02:26.517695] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-22T20:02:26.949848] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T20:02:27.317678] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-22T20:02:27.632926] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T20:02:28.117702] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-22T20:02:28.170124] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-22T20:02:28.917616] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-22T20:02:28.980380] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T20:02:29.717723] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-22T20:02:29.963915] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T20:02:30.517672] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-22T20:02:30.906194] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T20:02:31.317692] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-22T20:02:31.823422] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T20:02:32.122359] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-22T20:02:32.126692] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T20:02:32.917696] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-22T20:02:33.417624] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-22T20:02:33.717632] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-22T20:02:33.916627] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T20:02:34.517689] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-22T20:02:34.771046] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T20:02:35.317630] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-22T20:02:35.695908] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T20:02:36.117684] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-22T20:02:36.850036] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T20:02:36.917669] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-22T20:02:37.516864] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T20:02:37.717734] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-22T20:02:38.408078] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T20:02:38.517677] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-22T20:02:39.002250] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T20:02:39.006750] [INFO ] [REMOTE ] MTRN: Full fetch complete (24118 records). [2025-10-22T20:02:39.006981] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-22T20:02:39.317857] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-22T20:02:39.400975] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-10-22T20:02:39.401114] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-10-22T20:02:39.401789] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-10-22T20:02:39.401959] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-10-22T20:02:39.402749] [DEBUG] [LOCAL ] MTRN: Trimmed 24118 records to 18137 (keeping 200 days of data) [2025-10-22T20:02:39.516107] [DEBUG] [LOCAL ] MTRN: Primary data saved (18137 records). [2025-10-22T20:02:39.516256] [INFO ] [MAIN ] MTRN: Full history saved. [2025-10-22T20:02:39.516334] [INFO ] [MAIN ] Update Progress: 1419/2367 symbols completed. MTRN took 28.0s. Estimated remaining: 2h 1m 59s. Rate: 7.8 symbols/min [2025-10-22T20:02:39.710929] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:02:39.731559] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T20:02:39.758815] [DEBUG] [LOCAL ] MTX: Loaded 22671 existing records from primary storage. [2025-10-22T20:02:39.759073] [INFO ] [MAIN ] MTX: Loaded 22671 existing records. [2025-10-22T20:02:39.936543] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:02:39.936836] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-22T20:02:39.936886] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-22T20:02:39.937220] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-10-22T20:02:39.937278] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-22T20:02:40.123990] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-22T20:02:40.291970] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:02:40.500028] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T20:02:40.917681] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-22T20:02:41.233965] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T20:02:41.717795] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-22T20:02:41.898702] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T20:02:42.517698] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-22T20:02:42.764627] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T20:02:43.317695] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-22T20:02:44.075374] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T20:02:44.117693] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-22T20:02:44.470704] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T20:02:44.917679] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-22T20:02:45.720498] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-22T20:02:45.726439] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T20:02:45.734244] [INFO ] [REMOTE ] MTN: Full fetch complete (56812 records). [2025-10-22T20:02:45.734385] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-22T20:02:46.115980] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-10-22T20:02:46.116076] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-10-22T20:02:46.116944] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-10-22T20:02:46.117022] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-10-22T20:02:46.131826] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T20:02:46.137517] [DEBUG] [LOCAL ] MTN: Trimmed 56812 records to 39380 (keeping 200 days of data) [2025-10-22T20:02:46.379634] [DEBUG] [LOCAL ] MTN: Primary data saved (39380 records). [2025-10-22T20:02:46.379800] [INFO ] [MAIN ] MTN: Full history saved. [2025-10-22T20:02:46.379884] [INFO ] [MAIN ] Update Progress: 1420/2367 symbols completed. MTN took 45.9s. Estimated remaining: 2h 1m 50s. Rate: 7.8 symbols/min [2025-10-22T20:02:46.523921] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-22T20:02:46.549705] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:02:46.590243] [DEBUG] [LOCAL ] MTZ: Loaded 42780 existing records from primary storage. [2025-10-22T20:02:46.590549] [INFO ] [MAIN ] MTZ: Loaded 42780 existing records. [2025-10-22T20:02:46.768437] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:02:46.768683] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-22T20:02:46.768763] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-22T20:02:46.769038] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-10-22T20:02:46.769092] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-22T20:02:46.938307] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-22T20:02:47.138191] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:02:47.317637] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-22T20:02:47.770520] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T20:02:47.774808] [INFO ] [REMOTE ] MTUS: Full fetch complete (41133 records). [2025-10-22T20:02:47.774894] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-10-22T20:02:48.135480] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-22T20:02:48.151811] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-10-22T20:02:48.152502] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-10-22T20:02:48.153421] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-10-22T20:02:48.153591] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-10-22T20:02:48.154634] [DEBUG] [LOCAL ] MTUS: Trimmed 41133 records to 27451 (keeping 200 days of data) [2025-10-22T20:02:48.312363] [DEBUG] [LOCAL ] MTUS: Primary data saved (27451 records). [2025-10-22T20:02:48.312509] [INFO ] [MAIN ] MTUS: Full history saved. [2025-10-22T20:02:48.312589] [INFO ] [MAIN ] Update Progress: 1421/2367 symbols completed. MTUS took 25.8s. Estimated remaining: 2h 1m 39s. Rate: 7.8 symbols/min [2025-10-22T20:02:48.481437] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:02:48.493986] [DEBUG] [LOCAL ] MUA: Loaded 11519 existing records from primary storage. [2025-10-22T20:02:48.494199] [INFO ] [MAIN ] MUA: Loaded 11519 existing records. [2025-10-22T20:02:48.682234] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:02:48.682559] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-22T20:02:48.682677] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-22T20:02:48.682937] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-10-22T20:02:48.682986] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-22T20:02:48.925214] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-22T20:02:49.043607] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:02:49.068170] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T20:02:49.329000] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-22T20:02:49.717740] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-22T20:02:50.233732] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T20:02:50.517940] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-22T20:02:51.191559] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T20:02:51.317698] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-22T20:02:51.435316] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T20:02:52.117698] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-22T20:02:52.917665] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-22T20:02:53.007602] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T20:02:53.298273] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T20:02:53.717674] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-22T20:02:53.818696] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T20:02:54.517681] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-22T20:02:54.831841] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-22T20:02:55.317766] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-22T20:02:55.687901] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T20:02:56.117689] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-22T20:02:56.917633] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-22T20:02:56.980630] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T20:02:57.138430] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T20:02:57.717691] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-22T20:02:58.176220] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T20:02:58.180918] [INFO ] [REMOTE ] MTW: Full fetch complete (38211 records). [2025-10-22T20:02:58.181072] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-10-22T20:02:58.524279] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-22T20:02:58.574567] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-10-22T20:02:58.574700] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-10-22T20:02:58.575429] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-10-22T20:02:58.575473] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-10-22T20:02:58.576485] [DEBUG] [LOCAL ] MTW: Trimmed 38211 records to 26422 (keeping 200 days of data) [2025-10-22T20:02:58.726189] [DEBUG] [LOCAL ] MTW: Primary data saved (26422 records). [2025-10-22T20:02:58.726403] [INFO ] [MAIN ] MTW: Full history saved. [2025-10-22T20:02:58.726547] [INFO ] [MAIN ] Update Progress: 1422/2367 symbols completed. MTW took 33.9s. Estimated remaining: 2h 1m 33s. Rate: 7.8 symbols/min [2025-10-22T20:02:58.930796] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:02:58.950189] [DEBUG] [LOCAL ] MUC: Loaded 20743 existing records from primary storage. [2025-10-22T20:02:58.965763] [INFO ] [MAIN ] MUC: Loaded 20743 existing records. [2025-10-22T20:02:59.000150] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-22T20:02:59.157934] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:02:59.158190] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-22T20:02:59.158254] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-22T20:02:59.158456] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-10-22T20:02:59.158507] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-22T20:02:59.328503] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-22T20:02:59.508439] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:03:00.117631] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-22T20:03:00.227806] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T20:03:00.579880] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-22T20:03:00.917691] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-22T20:03:01.285169] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T20:03:01.561441] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-22T20:03:01.717778] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-22T20:03:02.517729] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-22T20:03:03.278354] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T20:03:03.317626] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-22T20:03:03.474825] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-22T20:03:04.117696] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-22T20:03:04.843327] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T20:03:04.917610] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-22T20:03:05.186697] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T20:03:05.717638] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-22T20:03:06.517632] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-22T20:03:06.650572] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T20:03:06.702749] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T20:03:07.317672] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-22T20:03:07.447451] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-22T20:03:08.117672] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-22T20:03:08.457060] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T20:03:08.917663] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-22T20:03:08.928884] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T20:03:08.932596] [INFO ] [REMOTE ] MTX: Full fetch complete (31410 records). [2025-10-22T20:03:08.932738] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-22T20:03:09.310409] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-10-22T20:03:09.310505] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-10-22T20:03:09.311226] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-10-22T20:03:09.311289] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-10-22T20:03:09.312059] [DEBUG] [LOCAL ] MTX: Trimmed 31410 records to 22589 (keeping 200 days of data) [2025-10-22T20:03:09.446284] [DEBUG] [LOCAL ] MTX: Primary data saved (22589 records). [2025-10-22T20:03:09.446411] [INFO ] [MAIN ] MTX: Full history saved. [2025-10-22T20:03:09.446491] [INFO ] [MAIN ] Update Progress: 1423/2367 symbols completed. MTX took 29.9s. Estimated remaining: 2h 1m 27s. Rate: 7.8 symbols/min [2025-10-22T20:03:09.615995] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:03:09.627492] [DEBUG] [LOCAL ] MUE: Loaded 12251 existing records from primary storage. [2025-10-22T20:03:09.627736] [INFO ] [MAIN ] MUE: Loaded 12251 existing records. [2025-10-22T20:03:09.726621] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-22T20:03:09.812055] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:03:09.812311] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-22T20:03:09.812367] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-22T20:03:09.812539] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-10-22T20:03:09.812577] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-22T20:03:10.183878] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:03:10.517714] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-22T20:03:10.601868] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T20:03:10.814227] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T20:03:11.273287] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T20:03:11.317616] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-22T20:03:12.117624] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-22T20:03:12.247228] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T20:03:12.723418] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-22T20:03:12.917711] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-22T20:03:13.707545] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T20:03:13.717606] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-22T20:03:14.517787] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-22T20:03:14.628803] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-22T20:03:15.323143] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-22T20:03:15.330620] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T20:03:15.995704] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-22T20:03:16.117733] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-22T20:03:16.827412] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T20:03:16.831230] [INFO ] [REMOTE ] MUA: Full fetch complete (18360 records). [2025-10-22T20:03:16.831386] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-10-22T20:03:16.922833] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-22T20:03:17.273747] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-10-22T20:03:17.273829] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-10-22T20:03:17.274259] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-10-22T20:03:17.274301] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-10-22T20:03:17.274842] [DEBUG] [LOCAL ] MUA: Trimmed 18360 records to 11533 (keeping 200 days of data) [2025-10-22T20:03:17.343049] [DEBUG] [LOCAL ] MUA: Primary data saved (11533 records). [2025-10-22T20:03:17.343185] [INFO ] [MAIN ] MUA: Full history saved. [2025-10-22T20:03:17.343264] [INFO ] [MAIN ] Update Progress: 1424/2367 symbols completed. MUA took 29.0s. Estimated remaining: 2h 1m 20s. Rate: 7.8 symbols/min [2025-10-22T20:03:17.514809] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:03:17.563690] [DEBUG] [LOCAL ] MUFG: Loaded 52435 existing records from primary storage. [2025-10-22T20:03:17.564020] [INFO ] [MAIN ] MUFG: Loaded 52435 existing records. [2025-10-22T20:03:17.719808] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-22T20:03:17.741666] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:03:17.741896] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-22T20:03:17.741956] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-22T20:03:17.742141] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-10-22T20:03:17.742199] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-22T20:03:18.141827] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T20:03:18.140909] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:03:18.517694] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-22T20:03:19.317628] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-22T20:03:19.494694] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T20:03:19.502199] [INFO ] [REMOTE ] MTZ: Full fetch complete (63743 records). [2025-10-22T20:03:19.502307] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-22T20:03:19.885724] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-10-22T20:03:19.885957] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-10-22T20:03:19.886913] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-10-22T20:03:19.886990] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-10-22T20:03:19.888710] [DEBUG] [LOCAL ] MTZ: Trimmed 63743 records to 42746 (keeping 200 days of data) [2025-10-22T20:03:19.915669] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T20:03:20.124132] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-22T20:03:20.188303] [DEBUG] [LOCAL ] MTZ: Primary data saved (42746 records). [2025-10-22T20:03:20.188438] [INFO ] [MAIN ] MTZ: Full history saved. [2025-10-22T20:03:20.188521] [INFO ] [MAIN ] Update Progress: 1425/2367 symbols completed. MTZ took 33.8s. Estimated remaining: 2h 1m 9s. Rate: 7.8 symbols/min [2025-10-22T20:03:20.362249] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:03:20.376935] [DEBUG] [LOCAL ] MUJ: Loaded 13883 existing records from primary storage. [2025-10-22T20:03:20.377199] [INFO ] [MAIN ] MUJ: Loaded 13883 existing records. [2025-10-22T20:03:20.508278] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T20:03:20.575839] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:03:20.576049] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-22T20:03:20.576097] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-22T20:03:20.576346] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-10-22T20:03:20.576385] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-22T20:03:20.880687] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T20:03:20.922780] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-22T20:03:20.962072] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:03:21.717692] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-22T20:03:22.453051] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T20:03:22.517712] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-22T20:03:22.701621] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T20:03:23.308785] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-22T20:03:23.317610] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-22T20:03:24.111099] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T20:03:24.117609] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-22T20:03:24.917727] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-22T20:03:25.717700] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-22T20:03:25.925016] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T20:03:26.474815] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-22T20:03:26.517680] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-22T20:03:26.776428] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T20:03:27.318521] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-22T20:03:27.317678] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-22T20:03:28.117738] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-22T20:03:28.923324] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-22T20:03:28.924880] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T20:03:29.165090] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T20:03:29.717670] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-22T20:03:29.910598] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T20:03:30.517729] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-22T20:03:31.317726] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-22T20:03:31.349671] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-22T20:03:31.457384] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T20:03:32.117696] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-22T20:03:32.470078] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T20:03:32.475496] [INFO ] [REMOTE ] MUC: Full fetch complete (29552 records). [2025-10-22T20:03:32.475587] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-22T20:03:32.773181] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-22T20:03:32.851238] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-10-22T20:03:32.851310] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-10-22T20:03:32.851905] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-10-22T20:03:32.851965] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-10-22T20:03:32.852640] [DEBUG] [LOCAL ] MUC: Trimmed 29552 records to 20640 (keeping 200 days of data) [2025-10-22T20:03:32.937144] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-22T20:03:32.977252] [DEBUG] [LOCAL ] MUC: Primary data saved (20640 records). [2025-10-22T20:03:32.977365] [INFO ] [MAIN ] MUC: Full history saved. [2025-10-22T20:03:32.977443] [INFO ] [MAIN ] Update Progress: 1426/2367 symbols completed. MUC took 34.3s. Estimated remaining: 2h 1m 4s. Rate: 7.8 symbols/min [2025-10-22T20:03:33.141490] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:03:33.187003] [DEBUG] [LOCAL ] MUR: Loaded 52868 existing records from primary storage. [2025-10-22T20:03:33.187322] [INFO ] [MAIN ] MUR: Loaded 52868 existing records. [2025-10-22T20:03:33.366909] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:03:33.367163] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-22T20:03:33.367223] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-22T20:03:33.367510] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-10-22T20:03:33.367570] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-22T20:03:33.721384] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:03:33.721626] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-22T20:03:33.829122] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T20:03:34.517695] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-22T20:03:35.317670] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-22T20:03:35.440337] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-22T20:03:35.486590] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T20:03:36.117673] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-22T20:03:36.917667] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-22T20:03:37.050377] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T20:03:37.113550] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T20:03:37.717678] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-22T20:03:37.906230] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T20:03:38.517687] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-22T20:03:38.614682] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-22T20:03:39.317684] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-22T20:03:40.117710] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-22T20:03:40.432174] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-22T20:03:40.917729] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-22T20:03:40.937107] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T20:03:41.208853] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T20:03:41.570787] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-22T20:03:41.717702] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-22T20:03:42.517704] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-22T20:03:43.317690] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-22T20:03:43.514957] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T20:03:44.117680] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-22T20:03:44.238556] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-22T20:03:44.241174] [INFO ] [REMOTE ] MUE: Full fetch complete (15947 records). [2025-10-22T20:03:44.241247] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-22T20:03:44.380839] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T20:03:44.680246] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-10-22T20:03:44.680339] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-10-22T20:03:44.680740] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-10-22T20:03:44.680841] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-10-22T20:03:44.681748] [DEBUG] [LOCAL ] MUE: Trimmed 15947 records to 12225 (keeping 200 days of data) [2025-10-22T20:03:44.761416] [DEBUG] [LOCAL ] MUE: Primary data saved (12225 records). [2025-10-22T20:03:44.761567] [INFO ] [MAIN ] MUE: Full history saved. [2025-10-22T20:03:44.761691] [INFO ] [MAIN ] Update Progress: 1427/2367 symbols completed. MUE took 35.3s. Estimated remaining: 2h 0m 59s. Rate: 7.8 symbols/min [2025-10-22T20:03:44.876956] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-22T20:03:44.911937] [INFO ] [REMOTE ] MUJ: Full fetch complete (19614 records). [2025-10-22T20:03:44.927796] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-22T20:03:44.942038] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-22T20:03:44.976412] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:03:45.277109] [DEBUG] [LOCAL ] MUSA: Loaded 24642 existing records from primary storage. [2025-10-22T20:03:45.305799] [INFO ] [MAIN ] MUSA: Loaded 24642 existing records. [2025-10-22T20:03:45.520296] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-10-22T20:03:45.533699] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-10-22T20:03:45.545391] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-10-22T20:03:45.545511] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-10-22T20:03:45.577776] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:03:45.578408] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-22T20:03:45.578490] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-22T20:03:45.578253] [DEBUG] [LOCAL ] MUJ: Trimmed 19614 records to 13888 (keeping 200 days of data) [2025-10-22T20:03:45.579050] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-10-22T20:03:45.579124] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-22T20:03:45.725783] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-22T20:03:45.768854] [DEBUG] [LOCAL ] MUJ: Primary data saved (13888 records). [2025-10-22T20:03:45.781240] [INFO ] [MAIN ] MUJ: Full history saved. [2025-10-22T20:03:45.786525] [INFO ] [MAIN ] Update Progress: 1428/2367 symbols completed. MUJ took 25.6s. Estimated remaining: 2h 0m 47s. Rate: 7.8 symbols/min [2025-10-22T20:03:46.205967] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:03:46.210792] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:03:46.210991] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-22T20:03:46.211090] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-22T20:03:46.211276] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-22T20:03:46.211608] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-22T20:03:46.211717] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-22T20:03:46.211766] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-22T20:03:46.522785] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-22T20:03:46.563986] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:03:46.914371] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T20:03:47.289244] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T20:03:47.317606] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-22T20:03:47.729524] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-22T20:03:48.117622] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-22T20:03:48.179911] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T20:03:48.917679] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-22T20:03:49.147465] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T20:03:49.147841] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-22T20:03:49.147934] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T20:03:49.148004] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-22T20:03:49.148073] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T20:03:49.148147] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-22T20:03:49.148213] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-22T20:03:49.148250] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-22T20:03:49.148324] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-22T20:03:49.148403] [INFO ] [MAIN ] Update Progress: 1429/2367 symbols completed. MUSE took 3.4s. Estimated remaining: 2h 0m 37s. Rate: 7.8 symbols/min [2025-10-22T20:03:49.325098] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:03:49.364349] [DEBUG] [LOCAL ] MUX: Loaded 43793 existing records from primary storage. [2025-10-22T20:03:49.364705] [INFO ] [MAIN ] MUX: Loaded 43793 existing records. [2025-10-22T20:03:49.543606] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:03:49.543838] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-22T20:03:49.543887] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-22T20:03:49.544280] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-10-22T20:03:49.544353] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-22T20:03:49.721217] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-22T20:03:49.912897] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:03:49.942929] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T20:03:50.517709] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-22T20:03:51.317679] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-22T20:03:51.724079] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-22T20:03:51.752449] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-22T20:03:51.761047] [INFO ] [REMOTE ] MUFG: Full fetch complete (75873 records). [2025-10-22T20:03:51.761172] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-22T20:03:52.127833] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-22T20:03:52.151754] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-10-22T20:03:52.151861] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-10-22T20:03:52.153045] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-10-22T20:03:52.153112] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-10-22T20:03:52.154883] [DEBUG] [LOCAL ] MUFG: Trimmed 75873 records to 52428 (keeping 200 days of data) [2025-10-22T20:03:52.466848] [DEBUG] [LOCAL ] MUFG: Primary data saved (52428 records). [2025-10-22T20:03:52.466989] [INFO ] [MAIN ] MUFG: Full history saved. [2025-10-22T20:03:52.467068] [INFO ] [MAIN ] Update Progress: 1430/2367 symbols completed. MUFG took 35.1s. Estimated remaining: 2h 0m 26s. Rate: 7.8 symbols/min [2025-10-22T20:03:52.637916] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:03:52.654376] [DEBUG] [LOCAL ] MVF: Loaded 12684 existing records from primary storage. [2025-10-22T20:03:52.654603] [INFO ] [MAIN ] MVF: Loaded 12684 existing records. [2025-10-22T20:03:52.778429] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T20:03:52.855169] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:03:52.855392] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-22T20:03:52.855470] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-22T20:03:52.855769] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-10-22T20:03:52.855844] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-22T20:03:52.922761] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-22T20:03:53.208150] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:03:53.291303] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-22T20:03:53.717668] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-22T20:03:54.517677] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-22T20:03:54.723288] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T20:03:55.216411] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T20:03:55.317670] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-22T20:03:55.791598] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T20:03:56.117727] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-22T20:03:56.917687] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-22T20:03:56.942706] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-22T20:03:57.019930] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T20:03:57.717683] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-22T20:03:58.208437] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-22T20:03:58.517667] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-22T20:03:58.580722] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T20:03:59.317719] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-22T20:04:00.117697] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-22T20:04:00.577475] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-22T20:04:00.920535] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-22T20:04:01.011306] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T20:04:01.105363] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-22T20:04:01.717625] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-22T20:04:02.123429] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T20:04:02.517728] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-22T20:04:03.300429] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T20:04:03.317623] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-22T20:04:03.506875] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T20:04:04.117716] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-22T20:04:04.828367] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T20:04:04.917623] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-22T20:04:05.717630] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-22T20:04:05.897198] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T20:04:06.299064] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T20:04:06.517708] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-22T20:04:06.928410] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T20:04:07.317717] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-22T20:04:08.031866] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-22T20:04:08.117731] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-22T20:04:08.321315] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T20:04:08.917673] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-22T20:04:09.014007] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-22T20:04:09.717681] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-22T20:04:09.774087] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T20:04:10.517681] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-22T20:04:10.994011] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T20:04:10.998129] [INFO ] [REMOTE ] MUSA: Full fetch complete (35649 records). [2025-10-22T20:04:10.998242] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-22T20:04:11.331997] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-22T20:04:11.380880] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-10-22T20:04:11.380962] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-10-22T20:04:11.381786] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-10-22T20:04:11.381873] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-10-22T20:04:11.382823] [DEBUG] [LOCAL ] MUSA: Trimmed 35649 records to 24600 (keeping 200 days of data) [2025-10-22T20:04:11.533885] [DEBUG] [LOCAL ] MUSA: Primary data saved (24600 records). [2025-10-22T20:04:11.534023] [INFO ] [MAIN ] MUSA: Full history saved. [2025-10-22T20:04:11.534103] [INFO ] [MAIN ] Update Progress: 1431/2367 symbols completed. MUSA took 26.8s. Estimated remaining: 2h 0m 26s. Rate: 7.8 symbols/min [2025-10-22T20:04:11.709679] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:04:11.720598] [DEBUG] [LOCAL ] MVO: Loaded 8969 existing records from primary storage. [2025-10-22T20:04:11.720869] [INFO ] [MAIN ] MVO: Loaded 8969 existing records. [2025-10-22T20:04:11.900990] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:04:11.901265] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-22T20:04:11.901339] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-22T20:04:11.901498] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-10-22T20:04:11.901537] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-22T20:04:12.120354] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-22T20:04:12.280293] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:04:12.412034] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T20:04:12.421069] [INFO ] [REMOTE ] MUR: Full fetch complete (76814 records). [2025-10-22T20:04:12.421238] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-22T20:04:12.834265] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-10-22T20:04:12.834377] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-10-22T20:04:12.835534] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-10-22T20:04:12.836039] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-10-22T20:04:12.837793] [DEBUG] [LOCAL ] MUR: Trimmed 76814 records to 52861 (keeping 200 days of data) [2025-10-22T20:04:12.925695] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-22T20:04:12.984232] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T20:04:13.011295] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-22T20:04:13.218102] [DEBUG] [LOCAL ] MUR: Primary data saved (52861 records). [2025-10-22T20:04:13.218275] [INFO ] [MAIN ] MUR: Full history saved. [2025-10-22T20:04:13.218920] [INFO ] [MAIN ] Update Progress: 1432/2367 symbols completed. MUR took 40.2s. Estimated remaining: 2h 0m 14s. Rate: 7.8 symbols/min [2025-10-22T20:04:13.386933] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:04:13.399661] [DEBUG] [LOCAL ] MVT: Loaded 9911 existing records from primary storage. [2025-10-22T20:04:13.399895] [INFO ] [MAIN ] MVT: Loaded 9911 existing records. [2025-10-22T20:04:13.575880] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:04:13.576116] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-22T20:04:13.576173] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-22T20:04:13.576328] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-10-22T20:04:13.576368] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-22T20:04:13.736721] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-22T20:04:13.883000] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-22T20:04:13.955937] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:04:14.517631] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-22T20:04:15.317694] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-22T20:04:15.379013] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T20:04:15.535419] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T20:04:16.117842] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-22T20:04:16.126359] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T20:04:16.917687] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-22T20:04:17.217509] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T20:04:17.717732] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-22T20:04:17.748216] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T20:04:18.506257] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-22T20:04:18.509346] [INFO ] [REMOTE ] MVF: Full fetch complete (18522 records). [2025-10-22T20:04:18.509456] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-10-22T20:04:18.522786] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-10-22T20:04:18.876995] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-10-22T20:04:18.877075] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-10-22T20:04:18.877481] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-10-22T20:04:18.877542] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-10-22T20:04:18.878233] [DEBUG] [LOCAL ] MVF: Trimmed 18522 records to 12686 (keeping 200 days of data) [2025-10-22T20:04:18.951326] [DEBUG] [LOCAL ] MVF: Primary data saved (12686 records). [2025-10-22T20:04:18.951468] [INFO ] [MAIN ] MVF: Full history saved. [2025-10-22T20:04:18.951546] [INFO ] [MAIN ] Update Progress: 1433/2367 symbols completed. MVF took 26.5s. Estimated remaining: 2h 0m 5s. Rate: 7.8 symbols/min [2025-10-22T20:04:19.119074] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:04:19.160013] [DEBUG] [LOCAL ] MWA: Loaded 45796 existing records from primary storage. [2025-10-22T20:04:19.160317] [INFO ] [MAIN ] MWA: Loaded 45796 existing records. [2025-10-22T20:04:19.321993] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-22T20:04:19.346021] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:04:19.346310] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-22T20:04:19.346362] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-22T20:04:19.346717] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-10-22T20:04:19.346773] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-22T20:04:19.469211] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-22T20:04:19.717219] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:04:20.117624] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-10-22T20:04:20.147182] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T20:04:20.760693] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T20:04:20.917686] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-10-22T20:04:21.674823] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-22T20:04:21.717610] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-10-22T20:04:22.517617] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-22T20:04:22.561317] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-22T20:04:23.234672] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T20:04:23.317623] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-22T20:04:24.061816] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-22T20:04:24.117702] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-22T20:04:24.917713] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-10-22T20:04:25.595914] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-22T20:04:25.717727] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-10-22T20:04:26.200892] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-22T20:04:26.209570] [INFO ] [REMOTE ] MUX: Full fetch complete (61535 records). [2025-10-22T20:04:26.209764] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-22T20:04:26.519596] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-22T20:04:26.536731] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T20:04:26.620795] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-10-22T20:04:26.620881] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-10-22T20:04:26.621784] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-10-22T20:04:26.621850] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-10-22T20:04:26.623214] [DEBUG] [LOCAL ] MUX: Trimmed 61535 records to 43833 (keeping 200 days of data) [2025-10-22T20:04:26.871704] [DEBUG] [LOCAL ] MUX: Primary data saved (43833 records). [2025-10-22T20:04:26.871831] [INFO ] [MAIN ] MUX: Full history saved. [2025-10-22T20:04:26.871909] [INFO ] [MAIN ] Update Progress: 1434/2367 symbols completed. MUX took 37.7s. Estimated remaining: 1h 59m 57s. Rate: 7.8 symbols/min [2025-10-22T20:04:27.041893] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:04:27.061773] [DEBUG] [LOCAL ] MX: Loaded 22280 existing records from primary storage. [2025-10-22T20:04:27.062031] [INFO ] [MAIN ] MX: Loaded 22280 existing records. [2025-10-22T20:04:27.241822] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:04:27.242083] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-22T20:04:27.242134] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-22T20:04:27.242380] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-10-22T20:04:27.242436] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-22T20:04:27.323420] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-22T20:04:27.539958] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-22T20:04:27.615437] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:04:28.117683] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-22T20:04:28.917690] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-22T20:04:28.999194] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T20:04:29.008977] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T20:04:29.370341] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-22T20:04:29.717702] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-10. [2025-10-22T20:04:30.517635] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-22T20:04:30.657778] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T20:04:30.660022] [INFO ] [REMOTE ] MVO: Full fetch complete (14611 records). [2025-10-22T20:04:30.660092] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-10-22T20:04:31.057115] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-10-22T20:04:31.057194] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-10-22T20:04:31.057544] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-10-22T20:04:31.057585] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-10-22T20:04:31.058161] [DEBUG] [LOCAL ] MVO: Trimmed 14611 records to 8969 (keeping 200 days of data) [2025-10-22T20:04:31.112895] [DEBUG] [LOCAL ] MVO: Primary data saved (8969 records). [2025-10-22T20:04:31.113060] [INFO ] [MAIN ] MVO: Full history saved. [2025-10-22T20:04:31.113162] [INFO ] [MAIN ] Update Progress: 1435/2367 symbols completed. MVO took 19.6s. Estimated remaining: 1h 59m 47s. Rate: 7.8 symbols/min [2025-10-22T20:04:31.291568] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:04:31.291742] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-22T20:04:31.291788] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-22T20:04:31.291894] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-22T20:04:31.291935] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-22T20:04:31.291975] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-22T20:04:31.292007] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-22T20:04:31.322849] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-22T20:04:31.467460] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T20:04:31.664640] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:04:32.117673] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-22T20:04:32.903683] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T20:04:32.917605] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-22T20:04:33.200138] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T20:04:33.717670] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-22T20:04:34.517624] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-22T20:04:34.607677] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T20:04:34.665390] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T20:04:35.278218] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-22T20:04:35.317690] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-22T20:04:36.117684] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-22T20:04:36.917681] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-22T20:04:37.118394] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T20:04:37.172674] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T20:04:37.362024] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-22T20:04:37.717680] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-22T20:04:38.496753] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T20:04:38.517613] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-22T20:04:39.296249] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-22T20:04:39.297995] [INFO ] [REMOTE ] MVT: Full fetch complete (13729 records). [2025-10-22T20:04:39.298067] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-22T20:04:39.326851] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-22T20:04:39.651186] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-10-22T20:04:39.651260] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-10-22T20:04:39.651558] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-10-22T20:04:39.651598] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-10-22T20:04:39.652084] [DEBUG] [LOCAL ] MVT: Trimmed 13729 records to 9790 (keeping 200 days of data) [2025-10-22T20:04:39.712744] [DEBUG] [LOCAL ] MVT: Primary data saved (9790 records). [2025-10-22T20:04:39.712846] [INFO ] [MAIN ] MVT: Full history saved. [2025-10-22T20:04:39.712921] [INFO ] [MAIN ] Update Progress: 1436/2367 symbols completed. MVT took 26.5s. Estimated remaining: 1h 59m 40s. Rate: 7.8 symbols/min [2025-10-22T20:04:39.882846] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:04:39.890379] [DEBUG] [LOCAL ] MXF: Loaded 5492 existing records from primary storage. [2025-10-22T20:04:39.890565] [INFO ] [MAIN ] MXF: Loaded 5492 existing records. [2025-10-22T20:04:39.984164] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-22T20:04:40.084165] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:04:40.084392] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-22T20:04:40.084447] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-22T20:04:40.084637] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-10-22T20:04:40.084729] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-22T20:04:40.122864] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-22T20:04:40.468362] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:04:40.917675] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-22T20:04:41.356433] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T20:04:41.442669] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-22T20:04:41.717695] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-22T20:04:42.071523] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-22T20:04:42.517690] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-22T20:04:43.317672] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-22T20:04:43.394729] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T20:04:44.117695] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-22T20:04:44.917704] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-22T20:04:44.957973] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T20:04:45.096107] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-22T20:04:45.376366] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-22T20:04:45.717728] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-22T20:04:46.517737] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-22T20:04:46.811428] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T20:04:47.317733] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-22T20:04:47.924514] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T20:04:47.992088] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T20:04:48.117674] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-22T20:04:48.921011] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-22T20:04:49.480232] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T20:04:49.717636] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-22T20:04:49.880464] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-22T20:04:50.517710] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-22T20:04:51.268427] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-22T20:04:51.308853] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T20:04:51.318109] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-22T20:04:52.117628] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-22T20:04:52.438084] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-22T20:04:52.917784] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-22T20:04:53.695998] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T20:04:53.717618] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-22T20:04:54.163477] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T20:04:54.167061] [INFO ] [REMOTE ] MX: Full fetch complete (31534 records). [2025-10-22T20:04:54.167147] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-22T20:04:54.517671] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-22T20:04:54.551842] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-10-22T20:04:54.551916] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-10-22T20:04:54.552549] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-10-22T20:04:54.552603] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-10-22T20:04:54.553380] [DEBUG] [LOCAL ] MX: Trimmed 31534 records to 22229 (keeping 200 days of data) [2025-10-22T20:04:54.671924] [DEBUG] [LOCAL ] MX: Primary data saved (22229 records). [2025-10-22T20:04:54.672042] [INFO ] [MAIN ] MX: Full history saved. [2025-10-22T20:04:54.672116] [INFO ] [MAIN ] Update Progress: 1437/2367 symbols completed. MX took 27.8s. Estimated remaining: 1h 59m 37s. Rate: 7.8 symbols/min [2025-10-22T20:04:55.188828] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T20:04:55.317672] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-22T20:04:55.371197] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T20:04:56.117671] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-22T20:04:56.705485] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T20:04:56.794087] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-22T20:04:56.801878] [INFO ] [REMOTE ] MWA: Full fetch complete (68226 records). [2025-10-22T20:04:56.802009] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-22T20:04:56.922740] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-22T20:04:57.191917] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-10-22T20:04:57.192012] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-10-22T20:04:57.193282] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-10-22T20:04:57.193381] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-10-22T20:04:57.194847] [DEBUG] [LOCAL ] MWA: Trimmed 68226 records to 45767 (keeping 200 days of data) [2025-10-22T20:04:57.377049] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-22T20:04:57.471622] [DEBUG] [LOCAL ] MWA: Primary data saved (45767 records). [2025-10-22T20:04:57.471820] [INFO ] [MAIN ] MWA: Full history saved. [2025-10-22T20:04:57.471949] [INFO ] [MAIN ] Update Progress: 1438/2367 symbols completed. MWA took 38.5s. Estimated remaining: 1h 59m 26s. Rate: 7.8 symbols/min [2025-10-22T20:04:57.717636] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-22T20:04:58.123864] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-22T20:04:58.517675] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-22T20:04:59.116900] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-22T20:04:59.317697] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-22T20:04:59.864752] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T20:05:00.117726] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-22T20:05:00.611408] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-22T20:05:00.917732] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-22T20:05:01.331806] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-22T20:05:01.717727] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-22T20:05:02.195233] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-22T20:05:02.517714] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-22T20:05:03.144809] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-22T20:05:03.145665] [INFO ] [REMOTE ] MXE: Full fetch complete (2548 records). [2025-10-22T20:05:03.145740] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-22T20:05:03.146081] [FATAL] [VALIDATOR ] MXE: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T20:05:03.146161] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:05:03.146203] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:05:03.146267] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-22T20:05:03.146329] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-22T20:05:03.146364] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-22T20:05:03.146404] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-22T20:05:03.146454] [INFO ] [MAIN ] Update Progress: 1439/2367 symbols completed. MXE took 32.0s. Estimated remaining: 1h 59m 17s. Rate: 7.8 symbols/min [2025-10-22T20:05:03.317684] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-22T20:05:04.011808] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-22T20:05:04.117723] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-22T20:05:04.882927] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-22T20:05:04.884457] [INFO ] [REMOTE ] MXF: Full fetch complete (9777 records). [2025-10-22T20:05:04.884532] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-10-22T20:05:05.285487] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-10-22T20:05:05.285610] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-10-22T20:05:05.285879] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-10-22T20:05:05.285934] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-10-22T20:05:05.286374] [DEBUG] [LOCAL ] MXF: Trimmed 9777 records to 5491 (keeping 200 days of data) [2025-10-22T20:05:05.319294] [DEBUG] [LOCAL ] MXF: Primary data saved (5491 records). [2025-10-22T20:05:05.319404] [INFO ] [MAIN ] MXF: Full history saved. [2025-10-22T20:05:05.319482] [INFO ] [MAIN ] Update Progress: 1440/2367 symbols completed. MXF took 25.6s. Estimated remaining: 1h 59m 6s. Rate: 7.8 symbols/min [2025-10-22T20:05:05.895730] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:05:06.056994] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:05:06.077492] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:05:06.037321] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:05:06.092934] [DEBUG] [LOCAL ] MYI: Loaded 19113 existing records from primary storage. [2025-10-22T20:05:06.096512] [INFO ] [MAIN ] MYI: Loaded 19113 existing records. [2025-10-22T20:05:06.173991] [DEBUG] [LOCAL ] MYN: Loaded 9986 existing records from primary storage. [2025-10-22T20:05:06.203469] [INFO ] [MAIN ] MYN: Loaded 9986 existing records. [2025-10-22T20:05:06.228024] [DEBUG] [LOCAL ] MYE: Loaded 24090 existing records from primary storage. [2025-10-22T20:05:06.220568] [DEBUG] [LOCAL ] MYD: Loaded 13209 existing records from primary storage. [2025-10-22T20:05:06.233674] [INFO ] [MAIN ] MYD: Loaded 13209 existing records. [2025-10-22T20:05:06.267674] [INFO ] [MAIN ] MYE: Loaded 24090 existing records. [2025-10-22T20:05:06.755828] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:05:06.859755] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-22T20:05:06.888701] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-22T20:05:06.859412] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:05:06.894490] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-22T20:05:06.898190] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:05:06.898371] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-22T20:05:06.926493] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:05:06.926740] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-10-22T20:05:06.926918] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-22T20:05:06.927372] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-10-22T20:05:06.927461] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-22T20:05:06.927736] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-22T20:05:06.927070] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-22T20:05:06.927279] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-22T20:05:06.958138] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-22T20:05:06.949236] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-10-22T20:05:07.019128] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-22T20:05:07.019278] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-10-22T20:05:07.035728] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-22T20:05:08.253716] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:05:08.241349] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:05:08.262727] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-22T20:05:08.268165] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-22T20:05:08.379896] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:05:08.393173] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-22T20:05:08.422542] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:05:08.422927] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-22T20:05:09.213074] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T20:05:09.216789] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-22T20:05:09.274558] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-22T20:05:09.277635] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-22T20:05:09.451223] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-22T20:05:09.557241] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T20:05:09.717725] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-22T20:05:09.830247] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T20:05:09.925709] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T20:05:10.517710] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-22T20:05:10.809630] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T20:05:11.317663] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-22T20:05:11.345106] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T20:05:12.117701] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-22T20:05:12.411519] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T20:05:12.917660] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-22T20:05:13.183551] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T20:05:13.717631] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-22T20:05:14.048926] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T20:05:14.517668] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-22T20:05:14.756157] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-22T20:05:15.317729] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-22T20:05:15.534087] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-22T20:05:16.117721] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-22T20:05:16.681978] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T20:05:16.917672] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-22T20:05:17.063145] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-22T20:05:17.717630] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-22T20:05:17.833549] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-22T20:05:18.517668] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-22T20:05:18.785745] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-22T20:05:19.254243] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-22T20:05:19.317626] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-22T20:05:20.038783] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T20:05:20.117668] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-22T20:05:20.917637] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-22T20:05:20.979035] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T20:05:21.717670] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-22T20:05:21.947282] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T20:05:22.517668] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-22T20:05:22.611026] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-22T20:05:23.133763] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T20:05:23.317722] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-22T20:05:24.117684] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-22T20:05:24.196760] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-22T20:05:24.910471] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-22T20:05:24.917617] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-22T20:05:25.717696] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-22T20:05:25.799734] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-22T20:05:26.517693] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-22T20:05:26.776479] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-22T20:05:27.311268] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-22T20:05:27.317609] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-22T20:05:28.114901] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T20:05:28.117702] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-22T20:05:28.917630] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-22T20:05:29.218729] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T20:05:29.717693] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-22T20:05:29.768881] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-22T20:05:29.771791] [INFO ] [REMOTE ] MYD: Full fetch complete (20050 records). [2025-10-22T20:05:29.771871] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-22T20:05:30.136808] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-10-22T20:05:30.136900] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-10-22T20:05:30.137345] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-10-22T20:05:30.137405] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-10-22T20:05:30.137997] [DEBUG] [LOCAL ] MYD: Trimmed 20050 records to 13143 (keeping 200 days of data) [2025-10-22T20:05:30.214821] [DEBUG] [LOCAL ] MYD: Primary data saved (13143 records). [2025-10-22T20:05:30.214956] [INFO ] [MAIN ] MYD: Full history saved. [2025-10-22T20:05:30.215032] [INFO ] [MAIN ] Update Progress: 1441/2367 symbols completed. MYD took 24.9s. Estimated remaining: 1h 59m 9s. Rate: 7.8 symbols/min [2025-10-22T20:05:30.379153] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:05:30.413836] [DEBUG] [LOCAL ] NABL: Loaded 39022 existing records from primary storage. [2025-10-22T20:05:30.414119] [INFO ] [MAIN ] NABL: Loaded 39022 existing records. [2025-10-22T20:05:30.522749] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-22T20:05:30.590746] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:05:30.591001] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-22T20:05:30.591049] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-22T20:05:30.591243] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-10-22T20:05:30.591285] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-22T20:05:30.963721] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:05:30.981114] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T20:05:31.317625] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-22T20:05:31.694914] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T20:05:31.698802] [INFO ] [REMOTE ] MYI: Full fetch complete (28726 records). [2025-10-22T20:05:31.698883] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-22T20:05:32.064921] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-10-22T20:05:32.065009] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-10-22T20:05:32.065590] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-10-22T20:05:32.065631] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-10-22T20:05:32.066372] [DEBUG] [LOCAL ] MYI: Trimmed 28726 records to 19068 (keeping 200 days of data) [2025-10-22T20:05:32.122162] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-22T20:05:32.181887] [DEBUG] [LOCAL ] MYI: Primary data saved (19068 records). [2025-10-22T20:05:32.182021] [INFO ] [MAIN ] MYI: Full history saved. [2025-10-22T20:05:32.182098] [INFO ] [MAIN ] Update Progress: 1442/2367 symbols completed. MYI took 26.9s. Estimated remaining: 1h 58m 58s. Rate: 7.8 symbols/min [2025-10-22T20:05:32.353018] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:05:32.376067] [DEBUG] [LOCAL ] NAC: Loaded 24420 existing records from primary storage. [2025-10-22T20:05:32.376326] [INFO ] [MAIN ] NAC: Loaded 24420 existing records. [2025-10-22T20:05:32.555844] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:05:32.556307] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-22T20:05:32.556371] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-22T20:05:32.556535] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-10-22T20:05:32.556574] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-22T20:05:32.754366] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T20:05:32.922728] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-22T20:05:32.952300] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:05:33.005563] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-22T20:05:33.007586] [INFO ] [REMOTE ] MYN: Full fetch complete (14986 records). [2025-10-22T20:05:33.007678] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-22T20:05:33.376572] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-10-22T20:05:33.376667] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-10-22T20:05:33.377062] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-10-22T20:05:33.377120] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-10-22T20:05:33.377586] [DEBUG] [LOCAL ] MYN: Trimmed 14986 records to 9951 (keeping 200 days of data) [2025-10-22T20:05:33.435051] [DEBUG] [LOCAL ] MYN: Primary data saved (9951 records). [2025-10-22T20:05:33.435174] [INFO ] [MAIN ] MYN: Full history saved. [2025-10-22T20:05:33.435248] [INFO ] [MAIN ] Update Progress: 1443/2367 symbols completed. MYN took 28.1s. Estimated remaining: 1h 58m 46s. Rate: 7.8 symbols/min [2025-10-22T20:05:33.599417] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:05:33.635855] [DEBUG] [LOCAL ] NAD: Loaded 33724 existing records from primary storage. [2025-10-22T20:05:33.636118] [INFO ] [MAIN ] NAD: Loaded 33724 existing records. [2025-10-22T20:05:33.727485] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-22T20:05:33.818972] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:05:33.819194] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-22T20:05:33.819242] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-22T20:05:33.819418] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-10-22T20:05:33.819457] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-22T20:05:34.185743] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:05:34.318587] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T20:05:34.517716] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-22T20:05:34.911725] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T20:05:35.317684] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-22T20:05:35.936123] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T20:05:36.117635] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-22T20:05:36.416378] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T20:05:36.917723] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-22T20:05:37.166597] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T20:05:37.717685] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-22T20:05:38.249294] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T20:05:38.517678] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-22T20:05:39.292132] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T20:05:39.317611] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-22T20:05:39.652739] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T20:05:40.117631] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-22T20:05:40.877196] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T20:05:40.917675] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-22T20:05:41.426778] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T20:05:41.717721] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-22T20:05:42.517725] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-22T20:05:42.577431] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T20:05:43.045446] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T20:05:43.317706] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-22T20:05:43.737219] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T20:05:44.117793] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-22T20:05:44.713088] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T20:05:44.917667] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-22T20:05:45.247538] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T20:05:45.717739] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-22T20:05:46.006282] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T20:05:46.517730] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-22T20:05:46.798119] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T20:05:47.317687] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-22T20:05:47.932199] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T20:05:48.118065] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-22T20:05:48.521245] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T20:05:48.917634] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-22T20:05:49.142183] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T20:05:49.717707] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-22T20:05:50.065508] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T20:05:50.517700] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-22T20:05:51.111944] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-22T20:05:51.317628] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-22T20:05:51.631737] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T20:05:52.117774] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-22T20:05:52.641981] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T20:05:52.917729] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-22T20:05:53.089311] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T20:05:53.717708] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-22T20:05:54.010123] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T20:05:54.517841] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-22T20:05:54.930359] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T20:05:55.317724] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-22T20:05:56.033932] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T20:05:56.117687] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-22T20:05:56.675057] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T20:05:56.917693] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-22T20:05:57.316566] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T20:05:57.320713] [INFO ] [REMOTE ] NAC: Full fetch complete (35432 records). [2025-10-22T20:05:57.320846] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-22T20:05:57.691078] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-10-22T20:05:57.691159] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-10-22T20:05:57.691847] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-10-22T20:05:57.691912] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-10-22T20:05:57.692691] [DEBUG] [LOCAL ] NAC: Trimmed 35432 records to 24487 (keeping 200 days of data) [2025-10-22T20:05:57.742609] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-22T20:05:57.840114] [DEBUG] [LOCAL ] NAC: Primary data saved (24487 records). [2025-10-22T20:05:57.840261] [INFO ] [MAIN ] NAC: Full history saved. [2025-10-22T20:05:57.840364] [INFO ] [MAIN ] Update Progress: 1444/2367 symbols completed. NAC took 25.7s. Estimated remaining: 1h 58m 49s. Rate: 7.8 symbols/min [2025-10-22T20:05:58.038522] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:05:58.047249] [DEBUG] [LOCAL ] NAN: Loaded 8463 existing records from primary storage. [2025-10-22T20:05:58.047438] [INFO ] [MAIN ] NAN: Loaded 8463 existing records. [2025-10-22T20:05:58.245836] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:05:58.255786] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-22T20:05:58.256019] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-22T20:05:58.257262] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-22T20:05:58.256633] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-10-22T20:05:58.257419] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-22T20:05:58.293354] [INFO ] [REMOTE ] MYE: Full fetch complete (35974 records). [2025-10-22T20:05:58.328214] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-22T20:05:58.520018] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-22T20:05:58.950326] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:05:59.030485] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-10-22T20:05:59.030764] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-10-22T20:05:59.031563] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-10-22T20:05:59.031788] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-10-22T20:05:59.032571] [DEBUG] [LOCAL ] MYE: Trimmed 35974 records to 24003 (keeping 200 days of data) [2025-10-22T20:05:59.192335] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T20:05:59.215798] [DEBUG] [LOCAL ] MYE: Primary data saved (24003 records). [2025-10-22T20:05:59.216006] [INFO ] [MAIN ] MYE: Full history saved. [2025-10-22T20:05:59.216122] [INFO ] [MAIN ] Update Progress: 1445/2367 symbols completed. MYE took 53.9s. Estimated remaining: 1h 58m 37s. Rate: 7.8 symbols/min [2025-10-22T20:05:59.324107] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-22T20:05:59.397689] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:05:59.446296] [DEBUG] [LOCAL ] NAT: Loaded 49231 existing records from primary storage. [2025-10-22T20:05:59.446788] [INFO ] [MAIN ] NAT: Loaded 49231 existing records. [2025-10-22T20:05:59.635638] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:05:59.635955] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-22T20:05:59.636007] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-22T20:05:59.636258] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-10-22T20:05:59.636318] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-22T20:05:59.995868] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:06:00.081314] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T20:06:00.086725] [INFO ] [REMOTE ] NAD: Full fetch complete (48531 records). [2025-10-22T20:06:00.086818] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-22T20:06:00.122754] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-22T20:06:00.200065] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T20:06:00.484064] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-10-22T20:06:00.484149] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-10-22T20:06:00.485456] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-10-22T20:06:00.485525] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-10-22T20:06:00.486711] [DEBUG] [LOCAL ] NAD: Trimmed 48531 records to 33581 (keeping 200 days of data) [2025-10-22T20:06:00.694597] [DEBUG] [LOCAL ] NAD: Primary data saved (33581 records). [2025-10-22T20:06:00.694764] [INFO ] [MAIN ] NAD: Full history saved. [2025-10-22T20:06:00.694848] [INFO ] [MAIN ] Update Progress: 1446/2367 symbols completed. NAD took 27.3s. Estimated remaining: 1h 58m 26s. Rate: 7.8 symbols/min [2025-10-22T20:06:00.865958] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:06:00.897209] [DEBUG] [LOCAL ] NATL: Loaded 32251 existing records from primary storage. [2025-10-22T20:06:00.897491] [INFO ] [MAIN ] NATL: Loaded 32251 existing records. [2025-10-22T20:06:00.928026] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-22T20:06:01.082155] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:06:01.082373] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-22T20:06:01.082420] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-22T20:06:01.082599] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-10-22T20:06:01.082636] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-22T20:06:01.423360] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:06:01.717781] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-22T20:06:01.837194] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-22T20:06:02.118196] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T20:06:02.517699] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-22T20:06:03.180840] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T20:06:03.317687] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-22T20:06:04.117669] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-22T20:06:04.219567] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T20:06:04.669125] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T20:06:04.675852] [INFO ] [REMOTE ] NABL: Full fetch complete (56968 records). [2025-10-22T20:06:04.675980] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-22T20:06:04.926119] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-22T20:06:05.005365] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-22T20:06:05.131948] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-10-22T20:06:05.132082] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-10-22T20:06:05.133161] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-10-22T20:06:05.133239] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-10-22T20:06:05.134558] [DEBUG] [LOCAL ] NABL: Trimmed 56968 records to 38946 (keeping 200 days of data) [2025-10-22T20:06:05.361560] [DEBUG] [LOCAL ] NABL: Primary data saved (38946 records). [2025-10-22T20:06:05.361718] [INFO ] [MAIN ] NABL: Full history saved. [2025-10-22T20:06:05.361810] [INFO ] [MAIN ] Update Progress: 1447/2367 symbols completed. NABL took 35.1s. Estimated remaining: 1h 58m 16s. Rate: 7.8 symbols/min [2025-10-22T20:06:05.542559] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:06:05.547878] [DEBUG] [LOCAL ] NAZ: Loaded 2684 existing records from primary storage. [2025-10-22T20:06:05.548039] [INFO ] [MAIN ] NAZ: Loaded 2684 existing records. [2025-10-22T20:06:05.719167] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-22T20:06:05.747802] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:06:05.748812] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-22T20:06:05.748868] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-22T20:06:05.749026] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-10-22T20:06:05.749084] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-22T20:06:06.114399] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:06:06.517719] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-22T20:06:06.602450] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-22T20:06:06.870294] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T20:06:06.891382] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-22T20:06:07.317672] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-22T20:06:08.117720] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-22T20:06:08.151954] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-22T20:06:08.917739] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-22T20:06:09.425018] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T20:06:09.550562] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-22T20:06:09.717714] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-22T20:06:10.270838] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-22T20:06:10.517678] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-22T20:06:11.112391] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T20:06:11.317724] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-22T20:06:12.089577] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-22T20:06:12.117736] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-22T20:06:12.663855] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-22T20:06:12.917676] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-22T20:06:13.388147] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-22T20:06:13.717714] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-22T20:06:14.517633] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-22T20:06:14.527618] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-22T20:06:15.317702] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-22T20:06:15.602086] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T20:06:16.117721] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-22T20:06:16.645711] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-22T20:06:16.917672] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-22T20:06:17.156213] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T20:06:17.508842] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-22T20:06:17.717696] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-22T20:06:18.517711] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-22T20:06:19.089261] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-22T20:06:19.237444] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-22T20:06:19.317705] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-22T20:06:20.117684] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-22T20:06:20.131281] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T20:06:20.133117] [INFO ] [REMOTE ] NAN: Full fetch complete (13504 records). [2025-10-22T20:06:20.133188] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-22T20:06:20.496945] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-10-22T20:06:20.497033] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-10-22T20:06:20.497357] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-10-22T20:06:20.497397] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-10-22T20:06:20.497936] [DEBUG] [LOCAL ] NAN: Trimmed 13504 records to 8427 (keeping 200 days of data) [2025-10-22T20:06:20.547052] [DEBUG] [LOCAL ] NAN: Primary data saved (8427 records). [2025-10-22T20:06:20.547150] [INFO ] [MAIN ] NAN: Full history saved. [2025-10-22T20:06:20.547225] [INFO ] [MAIN ] Update Progress: 1448/2367 symbols completed. NAN took 22.7s. Estimated remaining: 1h 58m 13s. Rate: 7.8 symbols/min [2025-10-22T20:06:20.711159] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:06:20.721553] [DEBUG] [LOCAL ] NBB: Loaded 9040 existing records from primary storage. [2025-10-22T20:06:20.721754] [INFO ] [MAIN ] NBB: Loaded 9040 existing records. [2025-10-22T20:06:20.892169] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:06:20.892389] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-22T20:06:20.892447] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-22T20:06:20.892602] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-10-22T20:06:20.892638] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-22T20:06:20.922901] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-22T20:06:21.247976] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:06:21.524188] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T20:06:21.717667] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-22T20:06:21.844710] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T20:06:22.517628] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-22T20:06:22.526872] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-22T20:06:23.218142] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T20:06:23.317690] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-22T20:06:24.030315] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-22T20:06:24.117680] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-22T20:06:24.730630] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-22T20:06:24.731608] [INFO ] [REMOTE ] NAZ: Full fetch complete (4080 records). [2025-10-22T20:06:24.731712] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-22T20:06:24.927411] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-22T20:06:25.087613] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-10-22T20:06:25.087736] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-10-22T20:06:25.087987] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-10-22T20:06:25.088035] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-10-22T20:06:25.088400] [DEBUG] [LOCAL ] NAZ: Trimmed 4080 records to 2670 (keeping 200 days of data) [2025-10-22T20:06:25.111382] [DEBUG] [LOCAL ] NAZ: Primary data saved (2670 records). [2025-10-22T20:06:25.111479] [INFO ] [MAIN ] NAZ: Full history saved. [2025-10-22T20:06:25.111569] [INFO ] [MAIN ] Update Progress: 1449/2367 symbols completed. NAZ took 19.7s. Estimated remaining: 1h 58m 3s. Rate: 7.8 symbols/min [2025-10-22T20:06:25.281164] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:06:25.304391] [DEBUG] [LOCAL ] NBHC: Loaded 23749 existing records from primary storage. [2025-10-22T20:06:25.304669] [INFO ] [MAIN ] NBHC: Loaded 23749 existing records. [2025-10-22T20:06:25.480450] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:06:25.480668] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-22T20:06:25.480739] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-22T20:06:25.480959] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-10-22T20:06:25.481024] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-22T20:06:25.727235] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-22T20:06:25.832490] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:06:26.470608] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T20:06:26.517705] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-22T20:06:27.317680] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-22T20:06:27.567528] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-22T20:06:27.626100] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T20:06:28.122761] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-22T20:06:28.136302] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T20:06:28.917631] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-22T20:06:29.167211] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-22T20:06:29.717725] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-22T20:06:30.517697] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-22T20:06:30.586705] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T20:06:30.612829] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-22T20:06:31.310880] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-22T20:06:31.317603] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-22T20:06:32.117695] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-22T20:06:32.218510] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-22T20:06:32.853244] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-22T20:06:32.917618] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-22T20:06:33.717688] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-22T20:06:33.930712] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T20:06:34.275873] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-22T20:06:34.517667] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-22T20:06:35.317742] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-22T20:06:35.905308] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-22T20:06:36.117692] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-22T20:06:36.341535] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T20:06:36.917681] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-22T20:06:37.702459] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T20:06:37.717600] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-22T20:06:38.104680] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-22T20:06:38.517713] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-22T20:06:39.317707] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-22T20:06:39.454396] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T20:06:39.623275] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T20:06:40.117630] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-22T20:06:40.459114] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T20:06:40.917671] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-22T20:06:40.951883] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T20:06:41.717708] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-22T20:06:42.306044] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-22T20:06:42.517721] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-22T20:06:42.945053] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T20:06:42.950432] [INFO ] [REMOTE ] NBHC: Full fetch complete (33294 records). [2025-10-22T20:06:42.950554] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-22T20:06:43.319783] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-22T20:06:43.320154] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-10-22T20:06:43.321196] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-10-22T20:06:43.321919] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-10-22T20:06:43.322013] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-10-22T20:06:43.322780] [DEBUG] [LOCAL ] NBHC: Trimmed 33294 records to 23669 (keeping 200 days of data) [2025-10-22T20:06:43.462675] [DEBUG] [LOCAL ] NBHC: Primary data saved (23669 records). [2025-10-22T20:06:43.462804] [INFO ] [MAIN ] NBHC: Full history saved. [2025-10-22T20:06:43.462882] [INFO ] [MAIN ] Update Progress: 1450/2367 symbols completed. NBHC took 18.4s. Estimated remaining: 1h 58m 2s. Rate: 7.8 symbols/min [2025-10-22T20:06:43.629281] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:06:43.658913] [DEBUG] [LOCAL ] NBR: Loaded 34506 existing records from primary storage. [2025-10-22T20:06:43.659197] [INFO ] [MAIN ] NBR: Loaded 34506 existing records. [2025-10-22T20:06:43.835819] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:06:43.841390] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-22T20:06:43.847918] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-22T20:06:43.848479] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-10-22T20:06:43.848930] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T20:06:43.848996] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-22T20:06:43.899248] [INFO ] [REMOTE ] NATL: Full fetch complete (44986 records). [2025-10-22T20:06:43.931941] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-10-22T20:06:44.137792] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-22T20:06:44.619660] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:06:44.650680] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-10-22T20:06:44.650759] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-10-22T20:06:44.651525] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-10-22T20:06:44.651565] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-10-22T20:06:44.652495] [DEBUG] [LOCAL ] NATL: Trimmed 44986 records to 32096 (keeping 200 days of data) [2025-10-22T20:06:44.835752] [DEBUG] [LOCAL ] NATL: Primary data saved (32096 records). [2025-10-22T20:06:44.835877] [INFO ] [MAIN ] NATL: Full history saved. [2025-10-22T20:06:44.835952] [INFO ] [MAIN ] Update Progress: 1451/2367 symbols completed. NATL took 44.1s. Estimated remaining: 1h 57m 51s. Rate: 7.8 symbols/min [2025-10-22T20:06:44.919754] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-22T20:06:45.005958] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:06:45.025876] [DEBUG] [LOCAL ] NBXG: Loaded 21795 existing records from primary storage. [2025-10-22T20:06:45.026117] [INFO ] [MAIN ] NBXG: Loaded 21795 existing records. [2025-10-22T20:06:45.132843] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-22T20:06:45.223442] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:06:45.224056] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-22T20:06:45.224231] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-22T20:06:45.224864] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-10-22T20:06:45.233735] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-22T20:06:45.320771] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T20:06:45.370751] [INFO ] [REMOTE ] NAT: Full fetch complete (72211 records). [2025-10-22T20:06:45.381845] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-22T20:06:45.718621] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-22T20:06:45.880528] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:06:46.057079] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-10-22T20:06:46.057242] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-10-22T20:06:46.058415] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-10-22T20:06:46.058500] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-10-22T20:06:46.077561] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T20:06:46.083963] [DEBUG] [LOCAL ] NAT: Trimmed 72211 records to 49207 (keeping 200 days of data) [2025-10-22T20:06:46.359443] [DEBUG] [LOCAL ] NAT: Primary data saved (49207 records). [2025-10-22T20:06:46.359584] [INFO ] [MAIN ] NAT: Full history saved. [2025-10-22T20:06:46.359680] [INFO ] [MAIN ] Update Progress: 1452/2367 symbols completed. NAT took 47.1s. Estimated remaining: 1h 57m 39s. Rate: 7.8 symbols/min [2025-10-22T20:06:46.527121] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:06:46.524587] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-22T20:06:46.533073] [DEBUG] [LOCAL ] NC: Loaded 2007 existing records from primary storage. [2025-10-22T20:06:46.533470] [INFO ] [MAIN ] NC: Loaded 2007 existing records. [2025-10-22T20:06:46.621094] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-22T20:06:46.738024] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:06:46.738309] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-22T20:06:46.738383] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-22T20:06:46.738515] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-10-22T20:06:46.738555] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-22T20:06:47.112727] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:06:47.317709] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-22T20:06:47.618097] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-22T20:06:48.102744] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T20:06:48.117612] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-22T20:06:48.884903] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-22T20:06:48.917676] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-22T20:06:49.717721] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-22T20:06:50.326386] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-22T20:06:50.350164] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T20:06:50.517695] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-22T20:06:51.317696] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-22T20:06:51.618729] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T20:06:51.936763] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-22T20:06:52.117681] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-22T20:06:52.431632] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-22T20:06:52.917722] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-22T20:06:53.601511] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-22T20:06:53.717682] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-22T20:06:54.192338] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-22T20:06:54.517682] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-22T20:06:55.317665] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-22T20:06:55.761128] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-22T20:06:56.117721] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-22T20:06:56.562268] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-22T20:06:56.715118] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T20:06:56.917720] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-22T20:06:57.380053] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-22T20:06:57.717699] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-22T20:06:58.517798] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-22T20:06:58.876865] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-22T20:06:59.317743] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-22T20:06:59.954095] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T20:07:00.055700] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T20:07:00.117704] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-22T20:07:00.917632] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-22T20:07:01.218681] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T20:07:01.220736] [INFO ] [REMOTE ] NBB: Full fetch complete (13158 records). [2025-10-22T20:07:01.220853] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-22T20:07:01.343633] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-22T20:07:01.707138] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-10-22T20:07:01.707248] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-10-22T20:07:01.711563] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-10-22T20:07:01.711753] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-10-22T20:07:01.712712] [DEBUG] [LOCAL ] NBB: Trimmed 13158 records to 9022 (keeping 200 days of data) [2025-10-22T20:07:01.746772] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-22T20:07:01.797862] [DEBUG] [LOCAL ] NBB: Primary data saved (9022 records). [2025-10-22T20:07:01.798032] [INFO ] [MAIN ] NBB: Full history saved. [2025-10-22T20:07:01.798138] [INFO ] [MAIN ] Update Progress: 1453/2367 symbols completed. NBB took 41.3s. Estimated remaining: 1h 57m 36s. Rate: 7.8 symbols/min [2025-10-22T20:07:02.005357] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:07:02.017327] [DEBUG] [LOCAL ] NCA: Loaded 9809 existing records from primary storage. [2025-10-22T20:07:02.017590] [INFO ] [MAIN ] NCA: Loaded 9809 existing records. [2025-10-22T20:07:02.199052] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:07:02.199283] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-22T20:07:02.199332] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-22T20:07:02.199630] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-10-22T20:07:02.199739] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-22T20:07:02.524667] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-22T20:07:02.612222] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:07:03.089716] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-22T20:07:03.235766] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T20:07:03.317622] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-22T20:07:04.117721] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-22T20:07:04.803243] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T20:07:04.862041] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-22T20:07:04.917612] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-22T20:07:05.675849] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T20:07:05.717700] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-22T20:07:06.335683] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-22T20:07:06.336917] [INFO ] [REMOTE ] NC: Full fetch complete (2778 records). [2025-10-22T20:07:06.336996] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-22T20:07:06.524184] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-22T20:07:06.710547] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-10-22T20:07:06.710688] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-10-22T20:07:06.710814] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-10-22T20:07:06.710854] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-10-22T20:07:06.711197] [DEBUG] [LOCAL ] NC: Trimmed 2778 records to 1998 (keeping 200 days of data) [2025-10-22T20:07:06.723512] [DEBUG] [LOCAL ] NC: Primary data saved (1998 records). [2025-10-22T20:07:06.723613] [INFO ] [MAIN ] NC: Full history saved. [2025-10-22T20:07:06.723723] [INFO ] [MAIN ] Update Progress: 1454/2367 symbols completed. NC took 20.4s. Estimated remaining: 1h 57m 27s. Rate: 7.8 symbols/min [2025-10-22T20:07:06.890791] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:07:06.911292] [DEBUG] [LOCAL ] NCDL: Loaded 21701 existing records from primary storage. [2025-10-22T20:07:06.911548] [INFO ] [MAIN ] NCDL: Loaded 21701 existing records. [2025-10-22T20:07:07.091098] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:07:07.091438] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-22T20:07:07.091487] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-22T20:07:07.091743] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-10-22T20:07:07.091799] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-22T20:07:07.327324] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-22T20:07:07.438689] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-22T20:07:07.458133] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:07:08.117631] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-22T20:07:08.508949] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T20:07:08.917639] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-22T20:07:08.983441] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-22T20:07:09.717632] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-22T20:07:09.927869] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-22T20:07:10.517688] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-10-22T20:07:10.576230] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T20:07:11.317679] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-22T20:07:11.744154] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-22T20:07:12.117635] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-22T20:07:12.401935] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T20:07:12.917679] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-22T20:07:13.670799] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T20:07:13.717619] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-22T20:07:13.958321] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-22T20:07:14.517775] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-22T20:07:14.937188] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-22T20:07:15.317721] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-10-22T20:07:15.720844] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-22T20:07:16.117771] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-22T20:07:16.359308] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T20:07:16.614622] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-22T20:07:16.917735] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-22T20:07:17.691981] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-22T20:07:17.717610] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-22T20:07:18.446914] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-22T20:07:18.517724] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-22T20:07:19.317837] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-10-22T20:07:19.823539] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T20:07:20.117721] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-22T20:07:20.312290] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T20:07:20.917669] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-10. [2025-10-22T20:07:21.284877] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T20:07:21.720092] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-22T20:07:21.723558] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T20:07:21.727786] [INFO ] [REMOTE ] NBXG: Full fetch complete (32532 records). [2025-10-22T20:07:21.727879] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-10-22T20:07:22.138237] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-10-22T20:07:22.138327] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-10-22T20:07:22.139131] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-10-22T20:07:22.139192] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-10-22T20:07:22.140011] [DEBUG] [LOCAL ] NBXG: Trimmed 32532 records to 21680 (keeping 200 days of data) [2025-10-22T20:07:22.278497] [DEBUG] [LOCAL ] NBXG: Primary data saved (21680 records). [2025-10-22T20:07:22.278623] [INFO ] [MAIN ] NBXG: Full history saved. [2025-10-22T20:07:22.278734] [INFO ] [MAIN ] Update Progress: 1455/2367 symbols completed. NBXG took 37.4s. Estimated remaining: 1h 57m 24s. Rate: 7.8 symbols/min [2025-10-22T20:07:22.450714] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:07:22.502117] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-10-22T20:07:22.502430] [INFO ] [MAIN ] NCLH: Loaded 53753 existing records. [2025-10-22T20:07:22.522769] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-22T20:07:22.690513] [WARN ] [MAIN ] NCLH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:07:22.690808] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-22T20:07:22.690886] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-22T20:07:22.691131] [DEBUG] [LOCAL ] NCLH: Deleted primary data file. [2025-10-22T20:07:22.691206] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-22T20:07:23.031089] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-22T20:07:23.112594] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:07:23.167820] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-22T20:07:23.317700] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-22T20:07:24.117723] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-22T20:07:24.917678] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-22T20:07:25.121031] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T20:07:25.336557] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-22T20:07:25.717721] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-22T20:07:26.522930] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-22T20:07:26.542218] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T20:07:27.301782] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-22T20:07:27.303874] [INFO ] [REMOTE ] NCA: Full fetch complete (14287 records). [2025-10-22T20:07:27.303952] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-22T20:07:27.326914] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-22T20:07:27.721595] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-10-22T20:07:27.721809] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-10-22T20:07:27.722562] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-10-22T20:07:27.722721] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-10-22T20:07:27.724012] [DEBUG] [LOCAL ] NCA: Trimmed 14287 records to 9773 (keeping 200 days of data) [2025-10-22T20:07:27.809232] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-22T20:07:27.829235] [DEBUG] [LOCAL ] NCA: Primary data saved (9773 records). [2025-10-22T20:07:27.829442] [INFO ] [MAIN ] NCA: Full history saved. [2025-10-22T20:07:27.829553] [INFO ] [MAIN ] Update Progress: 1456/2367 symbols completed. NCA took 26.0s. Estimated remaining: 1h 57m 15s. Rate: 7.8 symbols/min [2025-10-22T20:07:28.010167] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:07:28.026686] [DEBUG] [LOCAL ] NCV: Loaded 13917 existing records from primary storage. [2025-10-22T20:07:28.027012] [INFO ] [MAIN ] NCV: Loaded 13917 existing records. [2025-10-22T20:07:28.121725] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-22T20:07:28.215578] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:07:28.215901] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-22T20:07:28.215957] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-22T20:07:28.216202] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-10-22T20:07:28.216243] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-22T20:07:28.541841] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T20:07:28.629757] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:07:28.917687] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-22T20:07:29.631174] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T20:07:29.636614] [INFO ] [REMOTE ] NBR: Full fetch complete (49057 records). [2025-10-22T20:07:29.636804] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-22T20:07:29.724966] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-22T20:07:30.025858] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-10-22T20:07:30.025960] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-10-22T20:07:30.026914] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-10-22T20:07:30.026978] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-10-22T20:07:30.028080] [DEBUG] [LOCAL ] NBR: Trimmed 49057 records to 34369 (keeping 200 days of data) [2025-10-22T20:07:30.223568] [DEBUG] [LOCAL ] NBR: Primary data saved (34369 records). [2025-10-22T20:07:30.223726] [INFO ] [MAIN ] NBR: Full history saved. [2025-10-22T20:07:30.223813] [INFO ] [MAIN ] Update Progress: 1457/2367 symbols completed. NBR took 46.8s. Estimated remaining: 1h 57m 4s. Rate: 7.8 symbols/min [2025-10-22T20:07:30.404864] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:07:30.419480] [DEBUG] [LOCAL ] NCZ: Loaded 12305 existing records from primary storage. [2025-10-22T20:07:30.419788] [INFO ] [MAIN ] NCZ: Loaded 12305 existing records. [2025-10-22T20:07:30.525935] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-22T20:07:30.607195] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:07:30.607427] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-22T20:07:30.607486] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-22T20:07:30.607674] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-10-22T20:07:30.607730] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-22T20:07:30.917032] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-22T20:07:30.994038] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:07:31.037218] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-22T20:07:31.317631] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-22T20:07:31.632291] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T20:07:32.117736] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-22T20:07:32.655161] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T20:07:32.917719] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-22T20:07:33.174245] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T20:07:33.717681] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-22T20:07:34.168816] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T20:07:34.173439] [INFO ] [REMOTE ] NCDL: Full fetch complete (32929 records). [2025-10-22T20:07:34.173510] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-22T20:07:34.520114] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-22T20:07:34.564078] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-10-22T20:07:34.564147] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-10-22T20:07:34.564816] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-10-22T20:07:34.564878] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-10-22T20:07:34.565681] [DEBUG] [LOCAL ] NCDL: Trimmed 32929 records to 21597 (keeping 200 days of data) [2025-10-22T20:07:34.696937] [DEBUG] [LOCAL ] NCDL: Primary data saved (21597 records). [2025-10-22T20:07:34.697064] [INFO ] [MAIN ] NCDL: Full history saved. [2025-10-22T20:07:34.697150] [INFO ] [MAIN ] Update Progress: 1458/2367 symbols completed. NCDL took 28.0s. Estimated remaining: 1h 56m 54s. Rate: 7.8 symbols/min [2025-10-22T20:07:34.869367] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:07:34.880511] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T20:07:34.901084] [DEBUG] [LOCAL ] NDMO: Loaded 16942 existing records from primary storage. [2025-10-22T20:07:34.901335] [INFO ] [MAIN ] NDMO: Loaded 16942 existing records. [2025-10-22T20:07:35.084831] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:07:35.085050] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-22T20:07:35.085098] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-22T20:07:35.085257] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-10-22T20:07:35.085296] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-22T20:07:35.330592] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-22T20:07:35.448124] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:07:35.558019] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T20:07:36.117680] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-22T20:07:36.234123] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-22T20:07:36.917683] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-22T20:07:37.489706] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T20:07:37.717636] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-22T20:07:37.953158] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-22T20:07:38.517675] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-22T20:07:39.317706] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-22T20:07:39.353960] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-22T20:07:39.772504] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-22T20:07:40.117631] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-22T20:07:40.272717] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-22T20:07:40.917716] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-22T20:07:40.934756] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-22T20:07:41.717709] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-22T20:07:41.850636] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-22T20:07:42.517684] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-22T20:07:43.317741] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-22T20:07:43.546605] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T20:07:43.731183] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-22T20:07:44.117703] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-22T20:07:44.176475] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T20:07:44.917690] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-22T20:07:45.705893] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-22T20:07:45.717722] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-22T20:07:46.187706] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-22T20:07:46.517667] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-22T20:07:46.531424] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-22T20:07:47.159171] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-22T20:07:47.317702] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-22T20:07:48.117697] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-22T20:07:48.917737] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-22T20:07:49.040524] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-22T20:07:49.390518] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-22T20:07:49.717682] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-22T20:07:49.947044] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-22T20:07:50.517637] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-22T20:07:50.544255] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T20:07:51.317701] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-22T20:07:51.430274] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-22T20:07:52.117778] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-22T20:07:52.917677] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-22T20:07:52.956147] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T20:07:53.216220] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-22T20:07:53.717682] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-22T20:07:53.811184] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T20:07:54.517732] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-22T20:07:54.700081] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-22T20:07:55.317786] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-22T20:07:55.585384] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T20:07:55.589074] [INFO ] [REMOTE ] NCZ: Full fetch complete (21043 records). [2025-10-22T20:07:55.589202] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-22T20:07:55.997906] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-10-22T20:07:55.998050] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-10-22T20:07:55.998777] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-10-22T20:07:55.998843] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-10-22T20:07:55.999713] [DEBUG] [LOCAL ] NCZ: Trimmed 21043 records to 12268 (keeping 200 days of data) [2025-10-22T20:07:56.083720] [DEBUG] [LOCAL ] NCZ: Primary data saved (12268 records). [2025-10-22T20:07:56.083983] [INFO ] [MAIN ] NCZ: Full history saved. [2025-10-22T20:07:56.084130] [INFO ] [MAIN ] Update Progress: 1459/2367 symbols completed. NCZ took 25.9s. Estimated remaining: 1h 56m 55s. Rate: 7.8 symbols/min [2025-10-22T20:07:56.122912] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-22T20:07:56.266317] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:07:56.319223] [DEBUG] [LOCAL ] NE: Loaded 52323 existing records from primary storage. [2025-10-22T20:07:56.319709] [INFO ] [MAIN ] NE: Loaded 52323 existing records. [2025-10-22T20:07:56.500317] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:07:56.500624] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-22T20:07:56.500722] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-22T20:07:56.500976] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-10-22T20:07:56.501024] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-22T20:07:56.882213] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:07:56.917681] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-22T20:07:57.252163] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T20:07:57.462159] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-22T20:07:57.717708] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-22T20:07:58.376594] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T20:07:58.517792] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-22T20:07:58.786308] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T20:07:59.317699] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-22T20:08:00.117726] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-22T20:08:00.439107] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-22T20:08:00.730914] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-22T20:08:00.917716] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-22T20:08:01.717676] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-22T20:08:02.517791] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-22T20:08:02.684286] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-22T20:08:02.687490] [INFO ] [REMOTE ] NDMO: Full fetch complete (23336 records). [2025-10-22T20:08:02.687579] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-22T20:08:02.980709] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-22T20:08:03.008616] [INFO ] [REMOTE ] NCV: Full fetch complete (22428 records). [2025-10-22T20:08:03.009522] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-10-22T20:08:03.180337] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-10-22T20:08:03.208764] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-10-22T20:08:03.210128] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-10-22T20:08:03.241753] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-10-22T20:08:03.318743] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-10 (3.20 seconds). [2025-10-22T20:08:03.393139] [DEBUG] [LOCAL ] NDMO: Trimmed 23336 records to 16956 (keeping 200 days of data) [2025-10-22T20:08:03.435375] [INFO ] [REMOTE ] NCLH: Full fetch complete (77933 records). [2025-10-22T20:08:03.456915] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-10-22T20:08:03.688586] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-10-22T20:08:03.703418] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-10-22T20:08:03.704480] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-10-22T20:08:03.732099] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-10-22T20:08:03.789129] [DEBUG] [LOCAL ] NCV: Trimmed 22428 records to 13884 (keeping 200 days of data) [2025-10-22T20:08:03.826801] [DEBUG] [LOCAL ] NDMO: Primary data saved (16956 records). [2025-10-22T20:08:03.843870] [INFO ] [MAIN ] NDMO: Full history saved. [2025-10-22T20:08:03.906096] [INFO ] [MAIN ] Update Progress: 1460/2367 symbols completed. NDMO took 29.2s. Estimated remaining: 1h 56m 47s. Rate: 7.8 symbols/min [2025-10-22T20:08:04.327526] [DEBUG] [LOCAL ] NCV: Primary data saved (13884 records). [2025-10-22T20:08:04.369221] [INFO ] [MAIN ] NCV: Full history saved. [2025-10-22T20:08:04.369569] [INFO ] [MAIN ] Update Progress: 1461/2367 symbols completed. NCV took 36.5s. Estimated remaining: 1h 56m 35s. Rate: 7.8 symbols/min [2025-10-22T20:08:04.369431] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present. [2025-10-22T20:08:04.389934] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed. [2025-10-22T20:08:04.398588] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-10-22T20:08:04.466590] [DEBUG] [LOCAL ] NCLH: Saving primary data. [2025-10-22T20:08:04.466421] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:08:04.531137] [DEBUG] [LOCAL ] NCLH: Trimmed 77933 records to 53753 (keeping 200 days of data) [2025-10-22T20:08:04.702534] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:08:04.753321] [DEBUG] [LOCAL ] NEA: Loaded 35149 existing records from primary storage. [2025-10-22T20:08:04.762054] [INFO ] [MAIN ] NEA: Loaded 35149 existing records. [2025-10-22T20:08:05.135631] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:08:05.136556] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-22T20:08:05.136969] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-22T20:08:05.138302] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-10-22T20:08:05.147366] [INFO ] [MAIN ] NEE: Loaded 53707 existing records. [2025-10-22T20:08:05.147055] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-10-22T20:08:05.264412] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-22T20:08:05.389947] [DEBUG] [LOCAL ] NCLH: Primary data saved (53753 records). [2025-10-22T20:08:05.411051] [INFO ] [MAIN ] NCLH: Full history saved. [2025-10-22T20:08:05.441215] [INFO ] [MAIN ] Update Progress: 1462/2367 symbols completed. NCLH took 43.2s. Estimated remaining: 1h 56m 23s. Rate: 7.8 symbols/min [2025-10-22T20:08:05.561383] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (3.04 seconds). [2025-10-22T20:08:05.688478] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:08:05.709942] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-22T20:08:05.715460] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-22T20:08:05.753176] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-22T20:08:05.792196] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-10-22T20:08:05.792423] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-22T20:08:06.054537] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:08:06.284873] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:08:06.315913] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-22T20:08:06.530555] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:08:06.532333] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-22T20:08:06.534296] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-10-22T20:08:06.534746] [INFO ] [MAIN ] NEM: Loaded 53708 existing records. [2025-10-22T20:08:06.710120] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:08:06.710358] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-22T20:08:06.710408] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-22T20:08:06.710619] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-10-22T20:08:06.710702] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-22T20:08:07.081039] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:08:07.081333] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-22T20:08:07.632354] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T20:08:07.643557] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-22T20:08:07.827506] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T20:08:07.835774] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-22T20:08:08.386625] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T20:08:08.399008] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-22T20:08:09.172709] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-22T20:08:09.183843] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-22T20:08:09.258943] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T20:08:09.424083] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T20:08:09.717733] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-22T20:08:10.446336] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-22T20:08:10.517703] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-22T20:08:11.107243] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-22T20:08:11.228499] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-22T20:08:11.317626] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-22T20:08:12.117740] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-22T20:08:12.522688] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T20:08:12.917726] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-22T20:08:12.948937] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T20:08:13.717811] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-22T20:08:14.284628] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-22T20:08:14.326695] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T20:08:14.517696] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-22T20:08:14.951858] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T20:08:15.317706] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-22T20:08:16.117734] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-22T20:08:16.730795] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-22T20:08:16.900263] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T20:08:16.917606] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-22T20:08:17.717701] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-22T20:08:17.827824] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T20:08:18.329018] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T20:08:18.517715] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-22T20:08:19.317729] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-22T20:08:19.568044] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-22T20:08:20.117824] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-22T20:08:20.884929] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-22T20:08:20.917609] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-22T20:08:20.959357] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T20:08:21.717713] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-22T20:08:21.912987] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T20:08:22.517681] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-22T20:08:23.052514] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T20:08:23.286020] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T20:08:23.317621] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-22T20:08:24.117706] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-22T20:08:24.591491] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T20:08:24.600399] [INFO ] [REMOTE ] NE: Full fetch complete (75755 records). [2025-10-22T20:08:24.600572] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-22T20:08:24.919305] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-22T20:08:25.029167] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-10-22T20:08:25.030076] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-10-22T20:08:25.032364] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-10-22T20:08:25.032444] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-10-22T20:08:25.031214] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T20:08:25.039269] [INFO ] [REMOTE ] NEA: Full fetch complete (50949 records). [2025-10-22T20:08:25.039513] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-22T20:08:25.040220] [DEBUG] [LOCAL ] NE: Trimmed 75755 records to 52301 (keeping 200 days of data) [2025-10-22T20:08:25.687003] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-10-22T20:08:25.687169] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-10-22T20:08:25.688295] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-10-22T20:08:25.717873] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-10-22T20:08:25.751599] [DEBUG] [LOCAL ] NEA: Trimmed 50949 records to 35122 (keeping 200 days of data) [2025-10-22T20:08:25.851615] [DEBUG] [LOCAL ] NE: Primary data saved (52301 records). [2025-10-22T20:08:25.865783] [INFO ] [MAIN ] NE: Full history saved. [2025-10-22T20:08:25.866282] [INFO ] [MAIN ] Update Progress: 1463/2367 symbols completed. NE took 29.8s. Estimated remaining: 1h 56m 23s. Rate: 7.8 symbols/min [2025-10-22T20:08:26.153137] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:08:26.159831] [DEBUG] [LOCAL ] NEA: Primary data saved (35122 records). [2025-10-22T20:08:26.160019] [INFO ] [MAIN ] NEA: Full history saved. [2025-10-22T20:08:26.160196] [INFO ] [MAIN ] Update Progress: 1464/2367 symbols completed. NEA took 22.2s. Estimated remaining: 1h 56m 11s. Rate: 7.8 symbols/min [2025-10-22T20:08:26.354821] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:08:26.405051] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-22T20:08:26.421761] [DEBUG] [LOCAL ] NEU: Loaded 8639 existing records from primary storage. [2025-10-22T20:08:26.422521] [INFO ] [MAIN ] NEU: Loaded 8639 existing records. [2025-10-22T20:08:26.422291] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-22T20:08:26.541280] [DEBUG] [LOCAL ] NET: Loaded 52821 existing records from primary storage. [2025-10-22T20:08:26.544225] [INFO ] [MAIN ] NET: Loaded 52821 existing records. [2025-10-22T20:08:26.726021] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:08:26.747555] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-22T20:08:26.764766] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-22T20:08:26.799232] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-10-22T20:08:26.804384] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-22T20:08:26.804266] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:08:26.848763] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-22T20:08:26.875414] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-22T20:08:26.897351] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-10-22T20:08:26.908377] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-22T20:08:27.487227] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:08:27.526209] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-22T20:08:27.558286] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:08:27.558797] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-22T20:08:27.592622] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-10-22T20:08:28.117616] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-22T20:08:28.275239] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-22T20:08:28.520394] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-22T20:08:28.917633] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-22T20:08:29.578824] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-22T20:08:29.608858] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-22T20:08:29.717728] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-22T20:08:30.233458] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-22T20:08:30.442192] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-22T20:08:30.517623] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-22T20:08:31.317719] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-22T20:08:32.117728] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-22T20:08:32.577272] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-22T20:08:32.917694] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-22T20:08:33.447489] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T20:08:33.717713] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-22T20:08:34.352532] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-22T20:08:34.517637] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-22T20:08:35.135887] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-22T20:08:35.187467] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-22T20:08:35.317633] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-22T20:08:35.942970] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-22T20:08:36.017067] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-22T20:08:36.117634] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-22T20:08:36.917730] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-22T20:08:37.218472] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-22T20:08:37.717724] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-22T20:08:38.517708] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-22T20:08:39.147115] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-22T20:08:39.317693] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-22T20:08:40.109241] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T20:08:40.125306] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-22T20:08:40.148971] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-22T20:08:40.162471] [INFO ] [REMOTE ] NEE: Full fetch complete (77887 records). [2025-10-22T20:08:40.162627] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-22T20:08:40.557816] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-10-22T20:08:40.568157] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-10-22T20:08:40.583886] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-10-22T20:08:40.586962] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-10-22T20:08:40.589613] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-22T20:08:40.601725] [DEBUG] [LOCAL ] NEE: Trimmed 77887 records to 53707 (keeping 200 days of data) [2025-10-22T20:08:40.920386] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-22T20:08:40.939911] [DEBUG] [LOCAL ] NEE: Primary data saved (53707 records). [2025-10-22T20:08:40.940016] [INFO ] [MAIN ] NEE: Full history saved. [2025-10-22T20:08:40.940089] [INFO ] [MAIN ] Update Progress: 1465/2367 symbols completed. NEE took 36.6s. Estimated remaining: 1h 56m 7s. Rate: 7.8 symbols/min [2025-10-22T20:08:41.054207] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-22T20:08:41.158445] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:08:41.164678] [DEBUG] [LOCAL ] NEXA: Loaded 5576 existing records from primary storage. [2025-10-22T20:08:41.164879] [INFO ] [MAIN ] NEXA: Loaded 5576 existing records. [2025-10-22T20:08:41.345734] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:08:41.345962] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-22T20:08:41.346031] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-22T20:08:41.346195] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-10-22T20:08:41.346250] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-22T20:08:41.699170] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:08:41.717680] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-22T20:08:42.494143] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T20:08:42.517623] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-22T20:08:42.815713] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T20:08:42.886113] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-22T20:08:43.317701] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-22T20:08:43.861245] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-22T20:08:44.117675] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-22T20:08:44.903895] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T20:08:44.917613] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-22T20:08:45.717668] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-22T20:08:45.823334] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T20:08:45.825320] [INFO ] [REMOTE ] NEU: Full fetch complete (10825 records). [2025-10-22T20:08:45.825480] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-22T20:08:46.256245] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-10-22T20:08:46.256364] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-10-22T20:08:46.256784] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-10-22T20:08:46.256867] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-10-22T20:08:46.257786] [DEBUG] [LOCAL ] NEU: Trimmed 10825 records to 8614 (keeping 200 days of data) [2025-10-22T20:08:46.313407] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-22T20:08:46.354923] [DEBUG] [LOCAL ] NEU: Primary data saved (8614 records). [2025-10-22T20:08:46.355187] [INFO ] [MAIN ] NEU: Full history saved. [2025-10-22T20:08:46.355371] [INFO ] [MAIN ] Update Progress: 1466/2367 symbols completed. NEU took 20.2s. Estimated remaining: 1h 55m 58s. Rate: 7.8 symbols/min [2025-10-22T20:08:46.522996] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-22T20:08:46.625741] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:08:46.669997] [DEBUG] [LOCAL ] NFG: Loaded 38359 existing records from primary storage. [2025-10-22T20:08:46.670315] [INFO ] [MAIN ] NFG: Loaded 38359 existing records. [2025-10-22T20:08:46.915993] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:08:46.916212] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-22T20:08:46.916262] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-22T20:08:46.916713] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-10-22T20:08:46.916770] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-22T20:08:47.322772] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-22T20:08:47.327473] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:08:48.117780] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-22T20:08:48.698107] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-22T20:08:48.727087] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-22T20:08:48.917737] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-22T20:08:49.300512] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-22T20:08:49.717724] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-22T20:08:49.778048] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-22T20:08:50.517717] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-22T20:08:51.154123] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-22T20:08:51.318007] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-22T20:08:51.321151] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T20:08:52.117682] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-22T20:08:52.558838] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-22T20:08:52.917705] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-22T20:08:53.717707] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-22T20:08:53.971861] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (2.65 seconds). [2025-10-22T20:08:53.980935] [INFO ] [REMOTE ] NEM: Full fetch complete (77887 records). [2025-10-22T20:08:53.981080] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-22T20:08:54.390674] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-10-22T20:08:54.390806] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-10-22T20:08:54.391859] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-10-22T20:08:54.391963] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-10-22T20:08:54.393521] [DEBUG] [LOCAL ] NEM: Trimmed 77887 records to 53708 (keeping 200 days of data) [2025-10-22T20:08:54.517797] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T20:08:54.518903] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-22T20:08:54.759211] [DEBUG] [LOCAL ] NEM: Primary data saved (53708 records). [2025-10-22T20:08:54.759404] [INFO ] [MAIN ] NEM: Full history saved. [2025-10-22T20:08:54.759503] [INFO ] [MAIN ] Update Progress: 1467/2367 symbols completed. NEM took 49.3s. Estimated remaining: 1h 55m 51s. Rate: 7.8 symbols/min [2025-10-22T20:08:54.945974] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:08:54.964470] [DEBUG] [LOCAL ] NFJ: Loaded 19899 existing records from primary storage. [2025-10-22T20:08:54.964765] [INFO ] [MAIN ] NFJ: Loaded 19899 existing records. [2025-10-22T20:08:55.137583] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:08:55.137978] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-22T20:08:55.138038] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-22T20:08:55.138241] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-10-22T20:08:55.138297] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-22T20:08:55.248314] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-22T20:08:55.322800] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-22T20:08:55.513010] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:08:55.655490] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T20:08:56.117699] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-22T20:08:56.917729] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-22T20:08:57.130934] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T20:08:57.717709] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-22T20:08:57.889921] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T20:08:58.113519] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T20:08:58.116518] [INFO ] [REMOTE ] NEXA: Full fetch complete (8023 records). [2025-10-22T20:08:58.116592] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-10-22T20:08:58.472821] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-10-22T20:08:58.473259] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-10-22T20:08:58.473480] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-10-22T20:08:58.473523] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-10-22T20:08:58.473934] [DEBUG] [LOCAL ] NEXA: Trimmed 8023 records to 5704 (keeping 200 days of data) [2025-10-22T20:08:58.505156] [DEBUG] [LOCAL ] NEXA: Primary data saved (5704 records). [2025-10-22T20:08:58.505267] [INFO ] [MAIN ] NEXA: Full history saved. [2025-10-22T20:08:58.505342] [INFO ] [MAIN ] Update Progress: 1468/2367 symbols completed. NEXA took 17.6s. Estimated remaining: 1h 55m 41s. Rate: 7.8 symbols/min [2025-10-22T20:08:58.525726] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-22T20:08:58.674480] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:08:58.712309] [DEBUG] [LOCAL ] NGG: Loaded 46801 existing records from primary storage. [2025-10-22T20:08:58.712598] [INFO ] [MAIN ] NGG: Loaded 46801 existing records. [2025-10-22T20:08:58.885970] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:08:58.886195] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-22T20:08:58.886242] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-22T20:08:58.886677] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-10-22T20:08:58.886734] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-22T20:08:59.246302] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:08:59.271758] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T20:08:59.317615] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-22T20:08:59.694058] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T20:09:00.117681] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-22T20:09:00.917712] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-22T20:09:01.717744] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-22T20:09:02.088548] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (2.77 seconds). [2025-10-22T20:09:02.272470] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T20:09:02.517726] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-22T20:09:03.230202] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T20:09:03.317698] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-22T20:09:04.117667] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-22T20:09:04.448850] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-22T20:09:04.930309] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-22T20:09:04.933036] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (4.02 seconds). [2025-10-22T20:09:05.064457] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T20:09:05.717684] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-22T20:09:06.522809] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-22T20:09:06.537733] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-22T20:09:06.605144] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T20:09:07.317673] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-22T20:09:07.699717] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T20:09:08.029412] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-22T20:09:08.038256] [INFO ] [REMOTE ] NET: Full fetch complete (76868 records). [2025-10-22T20:09:08.038384] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-10-22T20:09:08.127775] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-22T20:09:08.429740] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-10-22T20:09:08.429822] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-10-22T20:09:08.430913] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-10-22T20:09:08.431737] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-10-22T20:09:08.433296] [DEBUG] [LOCAL ] NET: Trimmed 76868 records to 52801 (keeping 200 days of data) [2025-10-22T20:09:08.751433] [DEBUG] [LOCAL ] NET: Primary data saved (52801 records). [2025-10-22T20:09:08.751697] [INFO ] [MAIN ] NET: Full history saved. [2025-10-22T20:09:08.751974] [INFO ] [MAIN ] Update Progress: 1469/2367 symbols completed. NET took 42.9s. Estimated remaining: 1h 55m 35s. Rate: 7.8 symbols/min [2025-10-22T20:09:08.866163] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T20:09:08.921464] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-22T20:09:08.970726] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:09:08.984791] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T20:09:09.015344] [DEBUG] [LOCAL ] NGL: Loaded 30056 existing records from primary storage. [2025-10-22T20:09:09.015610] [INFO ] [MAIN ] NGL: Loaded 30056 existing records. [2025-10-22T20:09:09.185388] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:09:09.185556] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-22T20:09:09.185602] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-22T20:09:09.185968] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-10-22T20:09:09.186022] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-22T20:09:09.529990] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:09:09.717740] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-22T20:09:10.475179] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T20:09:10.517613] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-22T20:09:11.303623] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T20:09:11.317604] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-22T20:09:11.925490] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T20:09:12.117673] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-22T20:09:12.917741] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-22T20:09:12.974259] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T20:09:13.713366] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T20:09:13.717936] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-22T20:09:13.775889] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T20:09:13.783020] [INFO ] [REMOTE ] NFG: Full fetch complete (57302 records). [2025-10-22T20:09:13.783156] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-22T20:09:14.162161] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-10-22T20:09:14.162245] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-10-22T20:09:14.163135] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-10-22T20:09:14.163198] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-10-22T20:09:14.164370] [DEBUG] [LOCAL ] NFG: Trimmed 57302 records to 38254 (keeping 200 days of data) [2025-10-22T20:09:14.402745] [DEBUG] [LOCAL ] NFG: Primary data saved (38254 records). [2025-10-22T20:09:14.402873] [INFO ] [MAIN ] NFG: Full history saved. [2025-10-22T20:09:14.402946] [INFO ] [MAIN ] Update Progress: 1470/2367 symbols completed. NFG took 28.0s. Estimated remaining: 1h 55m 26s. Rate: 7.8 symbols/min [2025-10-22T20:09:14.522772] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-22T20:09:14.578232] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:09:14.590633] [DEBUG] [LOCAL ] NGS: Loaded 11017 existing records from primary storage. [2025-10-22T20:09:14.590874] [INFO ] [MAIN ] NGS: Loaded 11017 existing records. [2025-10-22T20:09:14.767721] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:09:14.767927] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-22T20:09:14.767973] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-22T20:09:14.768149] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-10-22T20:09:14.768203] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-22T20:09:15.117572] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:09:15.318769] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-22T20:09:15.321772] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T20:09:15.790012] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-22T20:09:16.117709] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-22T20:09:16.419839] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T20:09:16.917635] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-22T20:09:17.199857] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T20:09:17.717693] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-22T20:09:18.517691] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-22T20:09:18.675131] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T20:09:18.797715] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T20:09:19.317667] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-22T20:09:19.553914] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-22T20:09:20.117726] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-22T20:09:20.410939] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T20:09:20.917709] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-22T20:09:21.694422] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T20:09:21.717611] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-22T20:09:22.015667] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T20:09:22.517692] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-22T20:09:23.250157] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-22T20:09:23.317710] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-22T20:09:23.386914] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T20:09:24.117607] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-22T20:09:24.597034] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T20:09:24.917728] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-22T20:09:25.162743] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T20:09:25.717713] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-22T20:09:26.026326] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-22T20:09:26.517715] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-22T20:09:26.578343] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T20:09:27.317733] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-22T20:09:28.117668] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-22T20:09:28.349264] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T20:09:28.370374] [INFO ] [REMOTE ] NGG: Full fetch complete (66704 records). [2025-10-22T20:09:28.370561] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-22T20:09:28.372106] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T20:09:28.769395] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-10-22T20:09:28.769480] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-10-22T20:09:28.770561] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-10-22T20:09:28.770627] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-10-22T20:09:28.771937] [DEBUG] [LOCAL ] NGG: Trimmed 66704 records to 46767 (keeping 200 days of data) [2025-10-22T20:09:28.945768] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-22T20:09:29.065155] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T20:09:29.078450] [DEBUG] [LOCAL ] NGG: Primary data saved (46767 records). [2025-10-22T20:09:29.078608] [INFO ] [MAIN ] NGG: Full history saved. [2025-10-22T20:09:29.078769] [INFO ] [MAIN ] Update Progress: 1471/2367 symbols completed. NGG took 30.6s. Estimated remaining: 1h 55m 22s. Rate: 7.8 symbols/min [2025-10-22T20:09:29.246229] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:09:29.267492] [DEBUG] [LOCAL ] NGVC: Loaded 22809 existing records from primary storage. [2025-10-22T20:09:29.267832] [INFO ] [MAIN ] NGVC: Loaded 22809 existing records. [2025-10-22T20:09:29.441261] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:09:29.441467] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-22T20:09:29.441515] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-22T20:09:29.441719] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-10-22T20:09:29.441776] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-22T20:09:29.722754] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-22T20:09:29.797951] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:09:30.124164] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T20:09:30.130087] [INFO ] [REMOTE ] NFJ: Full fetch complete (29548 records). [2025-10-22T20:09:30.130249] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-22T20:09:30.514914] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-10-22T20:09:30.515015] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-10-22T20:09:30.515992] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-10-22T20:09:30.516076] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-10-22T20:09:30.517051] [DEBUG] [LOCAL ] NFJ: Trimmed 29548 records to 19717 (keeping 200 days of data) [2025-10-22T20:09:30.517784] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-22T20:09:30.645881] [DEBUG] [LOCAL ] NFJ: Primary data saved (19717 records). [2025-10-22T20:09:30.646078] [INFO ] [MAIN ] NFJ: Full history saved. [2025-10-22T20:09:30.646179] [INFO ] [MAIN ] Update Progress: 1472/2367 symbols completed. NFJ took 35.9s. Estimated remaining: 1h 55m 11s. Rate: 7.8 symbols/min [2025-10-22T20:09:30.822864] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:09:30.848489] [DEBUG] [LOCAL ] NGVT: Loaded 23894 existing records from primary storage. [2025-10-22T20:09:30.848871] [INFO ] [MAIN ] NGVT: Loaded 23894 existing records. [2025-10-22T20:09:31.037095] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:09:31.037569] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-22T20:09:31.037624] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-22T20:09:31.037908] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-10-22T20:09:31.037968] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-22T20:09:31.324788] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-22T20:09:31.457955] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:09:31.464233] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T20:09:31.591114] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T20:09:32.117841] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-22T20:09:32.501972] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T20:09:32.917733] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-22T20:09:33.604625] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T20:09:33.717699] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-22T20:09:33.746246] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T20:09:34.517691] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-22T20:09:34.757880] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T20:09:35.317710] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-22T20:09:35.361934] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T20:09:36.117820] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-22T20:09:36.632084] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T20:09:36.917686] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-22T20:09:37.215634] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T20:09:37.717676] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-22T20:09:37.796331] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-22T20:09:37.798811] [INFO ] [REMOTE ] NGS: Full fetch complete (16685 records). [2025-10-22T20:09:37.798962] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-22T20:09:38.204666] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-10-22T20:09:38.204787] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-10-22T20:09:38.205466] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-10-22T20:09:38.205511] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-10-22T20:09:38.206302] [DEBUG] [LOCAL ] NGS: Trimmed 16685 records to 10875 (keeping 200 days of data) [2025-10-22T20:09:38.281097] [DEBUG] [LOCAL ] NGS: Primary data saved (10875 records). [2025-10-22T20:09:38.281318] [INFO ] [MAIN ] NGS: Full history saved. [2025-10-22T20:09:38.281438] [INFO ] [MAIN ] Update Progress: 1473/2367 symbols completed. NGS took 23.9s. Estimated remaining: 1h 55m 3s. Rate: 7.8 symbols/min [2025-10-22T20:09:38.476895] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:09:38.499188] [DEBUG] [LOCAL ] NHI: Loaded 21970 existing records from primary storage. [2025-10-22T20:09:38.499511] [INFO ] [MAIN ] NHI: Loaded 21970 existing records. [2025-10-22T20:09:38.522803] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-22T20:09:38.777894] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:09:38.778522] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-22T20:09:38.778791] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-22T20:09:38.779079] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-10-22T20:09:38.779156] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-22T20:09:39.043614] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-22T20:09:39.321474] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-22T20:09:39.364150] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:09:39.645593] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-22T20:09:40.117703] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-22T20:09:40.404566] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T20:09:40.917670] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-22T20:09:41.081051] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-22T20:09:41.717697] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-22T20:09:42.033903] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T20:09:42.517679] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-22T20:09:42.939768] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T20:09:43.317733] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-22T20:09:43.378142] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T20:09:44.117704] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-22T20:09:44.563022] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-22T20:09:44.917707] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-22T20:09:45.176781] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T20:09:45.717677] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-22T20:09:46.057607] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T20:09:46.517671] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-22T20:09:47.017783] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-22T20:09:47.021965] [INFO ] [REMOTE ] NGL: Full fetch complete (41624 records). [2025-10-22T20:09:47.022047] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-22T20:09:47.322737] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-22T20:09:47.387128] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-10-22T20:09:47.387205] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-10-22T20:09:47.387978] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-10-22T20:09:47.388041] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-10-22T20:09:47.389025] [DEBUG] [LOCAL ] NGL: Trimmed 41624 records to 29896 (keeping 200 days of data) [2025-10-22T20:09:47.554131] [DEBUG] [LOCAL ] NGL: Primary data saved (29896 records). [2025-10-22T20:09:47.554260] [INFO ] [MAIN ] NGL: Full history saved. [2025-10-22T20:09:47.554344] [INFO ] [MAIN ] Update Progress: 1474/2367 symbols completed. NGL took 38.8s. Estimated remaining: 1h 54m 56s. Rate: 7.8 symbols/min [2025-10-22T20:09:47.723831] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:09:47.771552] [DEBUG] [LOCAL ] NI: Loaded 53409 existing records from primary storage. [2025-10-22T20:09:47.771916] [INFO ] [MAIN ] NI: Loaded 53409 existing records. [2025-10-22T20:09:47.949163] [WARN ] [MAIN ] NI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:09:47.949444] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-22T20:09:47.954708] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-22T20:09:47.957399] [DEBUG] [LOCAL ] NI: Deleted primary data file. [2025-10-22T20:09:47.962339] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-22T20:09:48.005995] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T20:09:48.122919] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-22T20:09:48.327741] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:09:48.340135] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T20:09:48.917636] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-22T20:09:48.971872] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T20:09:49.717712] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-22T20:09:50.517666] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-22T20:09:50.727489] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T20:09:50.759294] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-22T20:09:51.317629] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-22T20:09:51.549679] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T20:09:52.117709] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-22T20:09:52.917726] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-22T20:09:52.996935] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T20:09:53.164466] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T20:09:53.717629] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-22T20:09:54.028603] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T20:09:54.517683] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-22T20:09:55.317734] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-22T20:09:55.484080] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T20:09:55.614122] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T20:09:56.117694] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-22T20:09:56.418391] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T20:09:56.884071] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T20:09:56.917619] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-22T20:09:57.717682] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-22T20:09:58.188851] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T20:09:58.192733] [INFO ] [REMOTE ] NGVT: Full fetch complete (34360 records). [2025-10-22T20:09:58.192818] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-22T20:09:58.522811] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-22T20:09:58.591948] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-10-22T20:09:58.592025] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-10-22T20:09:58.592735] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-10-22T20:09:58.592799] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-10-22T20:09:58.593586] [DEBUG] [LOCAL ] NGVT: Trimmed 34360 records to 23771 (keeping 200 days of data) [2025-10-22T20:09:58.729131] [DEBUG] [LOCAL ] NGVT: Primary data saved (23771 records). [2025-10-22T20:09:58.729337] [INFO ] [MAIN ] NGVT: Full history saved. [2025-10-22T20:09:58.729440] [INFO ] [MAIN ] Update Progress: 1475/2367 symbols completed. NGVT took 28.1s. Estimated remaining: 1h 54m 51s. Rate: 7.8 symbols/min [2025-10-22T20:09:58.895426] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:09:58.906704] [DEBUG] [LOCAL ] NIC: Loaded 8865 existing records from primary storage. [2025-10-22T20:09:58.906915] [INFO ] [MAIN ] NIC: Loaded 8865 existing records. [2025-10-22T20:09:59.081229] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:09:59.081440] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-22T20:09:59.081487] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-22T20:09:59.081713] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-10-22T20:09:59.081774] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-22T20:09:59.322094] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-22T20:09:59.396919] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T20:09:59.458264] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:10:00.117672] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-22T20:10:00.218264] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-22T20:10:00.416841] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-22T20:10:00.917711] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-22T20:10:00.987288] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-22T20:10:01.717678] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-22T20:10:02.117385] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T20:10:02.517715] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-22T20:10:03.317701] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-22T20:10:03.463069] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-22T20:10:04.122865] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-22T20:10:04.141166] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-22T20:10:04.431911] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T20:10:04.435596] [INFO ] [REMOTE ] NGVC: Full fetch complete (31120 records). [2025-10-22T20:10:04.435701] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-22T20:10:04.792393] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-10-22T20:10:04.792472] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-10-22T20:10:04.793288] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-10-22T20:10:04.793350] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-10-22T20:10:04.794066] [DEBUG] [LOCAL ] NGVC: Trimmed 31120 records to 22759 (keeping 200 days of data) [2025-10-22T20:10:04.921751] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-22T20:10:04.929896] [DEBUG] [LOCAL ] NGVC: Primary data saved (22759 records). [2025-10-22T20:10:04.930963] [INFO ] [MAIN ] NGVC: Full history saved. [2025-10-22T20:10:04.931050] [INFO ] [MAIN ] Update Progress: 1476/2367 symbols completed. NGVC took 35.9s. Estimated remaining: 1h 54m 42s. Rate: 7.8 symbols/min [2025-10-22T20:10:05.107185] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:10:05.119266] [DEBUG] [LOCAL ] NIE: Loaded 11830 existing records from primary storage. [2025-10-22T20:10:05.119460] [INFO ] [MAIN ] NIE: Loaded 11830 existing records. [2025-10-22T20:10:05.293418] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:10:05.293608] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-22T20:10:05.293684] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-22T20:10:05.293850] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-10-22T20:10:05.293888] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-22T20:10:05.579505] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-22T20:10:05.664282] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:10:05.717617] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-22T20:10:06.517718] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-22T20:10:06.777598] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-22T20:10:07.262882] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-22T20:10:07.317728] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-22T20:10:07.640686] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-22T20:10:08.039920] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T20:10:08.117678] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-22T20:10:08.917677] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-22T20:10:09.012085] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-22T20:10:09.717695] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-22T20:10:10.082481] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-22T20:10:10.087632] [INFO ] [REMOTE ] NHI: Full fetch complete (31189 records). [2025-10-22T20:10:10.087866] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-10-22T20:10:10.491957] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-10-22T20:10:10.492081] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-10-22T20:10:10.492937] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-10-22T20:10:10.493009] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-10-22T20:10:10.494167] [DEBUG] [LOCAL ] NHI: Trimmed 31189 records to 21900 (keeping 200 days of data) [2025-10-22T20:10:10.548881] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-22T20:10:10.609193] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-22T20:10:10.649108] [DEBUG] [LOCAL ] NHI: Primary data saved (21900 records). [2025-10-22T20:10:10.649283] [INFO ] [MAIN ] NHI: Full history saved. [2025-10-22T20:10:10.649420] [INFO ] [MAIN ] Update Progress: 1477/2367 symbols completed. NHI took 32.4s. Estimated remaining: 1h 54m 33s. Rate: 7.8 symbols/min [2025-10-22T20:10:11.317681] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-22T20:10:11.494342] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-22T20:10:12.117707] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-22T20:10:12.125745] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T20:10:12.922031] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-22T20:10:12.923185] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-22T20:10:13.652157] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T20:10:13.717729] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-22T20:10:14.517698] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-22T20:10:14.530308] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T20:10:15.317714] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-22T20:10:15.353779] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T20:10:16.117699] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-22T20:10:16.245858] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T20:10:16.917794] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-22T20:10:17.717685] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-22T20:10:17.758561] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-22T20:10:18.073101] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T20:10:18.517728] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-22T20:10:18.577584] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T20:10:19.030729] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-22T20:10:19.317689] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-22T20:10:20.117700] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-22T20:10:20.124910] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-22T20:10:20.900530] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-22T20:10:20.903269] [INFO ] [REMOTE ] NIE: Full fetch complete (16848 records). [2025-10-22T20:10:20.903339] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-22T20:10:20.923982] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-22T20:10:21.303148] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-10-22T20:10:21.303246] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-10-22T20:10:21.303820] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-10-22T20:10:21.303893] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-10-22T20:10:21.304513] [DEBUG] [LOCAL ] NIE: Trimmed 16848 records to 11724 (keeping 200 days of data) [2025-10-22T20:10:21.385281] [DEBUG] [LOCAL ] NIE: Primary data saved (11724 records). [2025-10-22T20:10:21.385443] [INFO ] [MAIN ] NIE: Full history saved. [2025-10-22T20:10:21.385536] [INFO ] [MAIN ] Update Progress: 1478/2367 symbols completed. NIE took 16.5s. Estimated remaining: 1h 54m 27s. Rate: 7.8 symbols/min [2025-10-22T20:10:21.717735] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-22T20:10:22.523426] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T20:10:22.525849] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-22T20:10:22.765258] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T20:10:23.317793] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-22T20:10:23.415862] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-22T20:10:23.417900] [INFO ] [REMOTE ] NIC: Full fetch complete (12554 records). [2025-10-22T20:10:23.417973] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-22T20:10:23.793312] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-10-22T20:10:23.793386] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-10-22T20:10:23.793764] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-10-22T20:10:23.793835] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-10-22T20:10:23.794365] [DEBUG] [LOCAL ] NIC: Trimmed 12554 records to 8868 (keeping 200 days of data) [2025-10-22T20:10:23.862103] [DEBUG] [LOCAL ] NIC: Primary data saved (8868 records). [2025-10-22T20:10:23.862233] [INFO ] [MAIN ] NIC: Full history saved. [2025-10-22T20:10:23.862348] [INFO ] [MAIN ] Update Progress: 1479/2367 symbols completed. NIC took 25.1s. Estimated remaining: 1h 54m 16s. Rate: 7.8 symbols/min [2025-10-22T20:10:25.155848] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T20:10:25.167425] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-22T20:10:27.143402] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T20:10:27.155349] [INFO ] [REMOTE ] NI: Full fetch complete (77512 records). [2025-10-22T20:10:27.155859] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-22T20:10:27.544034] [DEBUG] [VALIDATOR ] NI: All expected trading days are present. [2025-10-22T20:10:27.544133] [DEBUG] [VALIDATOR ] NI: Primary data validation passed. [2025-10-22T20:10:27.545217] [INFO ] [MAIN ] NI: Fetched primary data is valid. [2025-10-22T20:10:27.545286] [DEBUG] [LOCAL ] NI: Saving primary data. [2025-10-22T20:10:27.546939] [DEBUG] [LOCAL ] NI: Trimmed 77512 records to 53408 (keeping 200 days of data) [2025-10-22T20:10:27.867323] [DEBUG] [LOCAL ] NI: Primary data saved (53408 records). [2025-10-22T20:10:27.867477] [INFO ] [MAIN ] NI: Full history saved. [2025-10-22T20:10:27.867557] [INFO ] [MAIN ] Update Progress: 1480/2367 symbols completed. NI took 40.3s. Estimated remaining: 1h 54m 6s. Rate: 7.8 symbols/min [2025-10-22T20:10:28.571975] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:10:28.582007] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:10:28.625177] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-22T20:10:28.626260] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-22T20:10:28.672381] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:10:28.676385] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:10:28.678146] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-22T20:10:28.678478] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-22T20:10:28.678612] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-22T20:10:28.678690] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-22T20:10:28.739767] [DEBUG] [LOCAL ] NIM: Loaded 3540 existing records from primary storage. [2025-10-22T20:10:28.770387] [INFO ] [MAIN ] NIM: Loaded 3540 existing records. [2025-10-22T20:10:29.048280] [DEBUG] [LOCAL ] NINE: Loaded 28646 existing records from primary storage. [2025-10-22T20:10:29.145902] [INFO ] [MAIN ] NINE: Loaded 28646 existing records. [2025-10-22T20:10:29.176569] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-22T20:10:29.218315] [INFO ] [MAIN ] NIO: Loaded 53802 existing records. [2025-10-22T20:10:29.217918] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:10:29.278939] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-22T20:10:29.355445] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-22T20:10:29.509386] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-10-22T20:10:29.559338] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-22T20:10:29.566052] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:10:29.634523] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-01. [2025-10-22T20:10:29.781833] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:10:29.782079] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-22T20:10:29.821022] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:10:29.834021] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-22T20:10:29.821125] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-22T20:10:29.857014] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-22T20:10:29.857176] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-10-22T20:10:29.857741] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-22T20:10:29.862979] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-10-22T20:10:29.874925] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-22T20:10:30.036610] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T20:10:30.090312] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-01 [2025-10-22T20:10:30.157784] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T20:10:30.165963] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-22T20:10:30.166147] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T20:10:30.166430] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-22T20:10:30.177406] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-22T20:10:30.239821] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-22T20:10:30.362216] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-22T20:10:30.433876] [INFO ] [MAIN ] Update Progress: 1481/2367 symbols completed. NIQ took 2.5s. Estimated remaining: 1h 53m 55s. Rate: 7.8 symbols/min [2025-10-22T20:10:30.752382] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:10:30.787247] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-22T20:10:31.058865] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:10:31.056981] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:10:31.062989] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:10:31.064144] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-22T20:10:31.063853] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-22T20:10:31.098343] [DEBUG] [LOCAL ] NJR: Loaded 37972 existing records from primary storage. [2025-10-22T20:10:31.098634] [INFO ] [MAIN ] NJR: Loaded 37972 existing records. [2025-10-22T20:10:31.271990] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:10:31.272195] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-22T20:10:31.272247] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-22T20:10:31.272500] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-10-22T20:10:31.272555] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-22T20:10:31.547729] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T20:10:31.549773] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-22T20:10:31.629275] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:10:31.629608] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-22T20:10:32.043559] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-22T20:10:32.045506] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-22T20:10:32.739813] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-22T20:10:32.742174] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-22T20:10:32.876576] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T20:10:32.884985] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-22T20:10:33.006722] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T20:10:33.014619] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-22T20:10:33.439129] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-22T20:10:33.450079] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-22T20:10:33.473105] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-22T20:10:33.717621] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-22T20:10:34.111690] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T20:10:34.126639] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-22T20:10:34.401763] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T20:10:34.517618] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-22T20:10:35.154873] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T20:10:35.317676] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-22T20:10:35.422317] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-22T20:10:36.117680] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-22T20:10:36.608834] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-22T20:10:36.917675] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-22T20:10:37.535538] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T20:10:37.717718] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-22T20:10:37.792576] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-22T20:10:38.517787] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-22T20:10:39.317687] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-22T20:10:39.401597] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T20:10:39.716985] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-22T20:10:40.117701] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-22T20:10:40.318348] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-22T20:10:40.917701] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-22T20:10:41.653839] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-22T20:10:41.717686] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-22T20:10:42.400351] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T20:10:42.517683] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-22T20:10:43.092871] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T20:10:43.317702] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-22T20:10:44.034186] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T20:10:44.117721] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-22T20:10:44.917685] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-22T20:10:45.383359] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T20:10:45.717722] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-10-22T20:10:45.875678] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-22T20:10:46.047721] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-22T20:10:46.165831] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-22T20:10:46.517707] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-10-22T20:10:46.998569] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-22T20:10:47.317678] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-22T20:10:48.117686] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-22T20:10:48.917713] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-22T20:10:49.536689] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T20:10:49.716147] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-22T20:10:49.720453] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-22T20:10:49.767191] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-22T20:10:50.517742] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-22T20:10:51.323499] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-22T20:10:51.344068] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T20:10:52.117737] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-22T20:10:52.670499] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T20:10:52.675509] [INFO ] [REMOTE ] NINE: Full fetch complete (43237 records). [2025-10-22T20:10:52.675604] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-22T20:10:52.931455] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-10. [2025-10-22T20:10:53.062231] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-22T20:10:53.142148] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-10-22T20:10:53.142229] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-10-22T20:10:53.143105] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-10-22T20:10:53.143168] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-10-22T20:10:53.144111] [DEBUG] [LOCAL ] NINE: Trimmed 43237 records to 28666 (keeping 200 days of data) [2025-10-22T20:10:53.311729] [DEBUG] [LOCAL ] NINE: Primary data saved (28666 records). [2025-10-22T20:10:53.311869] [INFO ] [MAIN ] NINE: Full history saved. [2025-10-22T20:10:53.311971] [INFO ] [MAIN ] Update Progress: 1482/2367 symbols completed. NINE took 25.4s. Estimated remaining: 1h 53m 57s. Rate: 7.8 symbols/min [2025-10-22T20:10:53.486465] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:10:53.486621] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-22T20:10:53.486695] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-22T20:10:53.486854] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-22T20:10:53.486924] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-22T20:10:53.487042] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-22T20:10:53.487105] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-22T20:10:53.592193] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-22T20:10:53.619259] [INFO ] [REMOTE ] NIM: Full fetch complete (6158 records). [2025-10-22T20:10:53.668406] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-10-22T20:10:53.735227] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-22T20:10:53.882521] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T20:10:54.001900] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:10:54.250317] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-10-22T20:10:54.250395] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-10-22T20:10:54.250566] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-10-22T20:10:54.250604] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-10-22T20:10:54.250986] [DEBUG] [LOCAL ] NIM: Trimmed 6158 records to 3526 (keeping 200 days of data) [2025-10-22T20:10:54.271412] [DEBUG] [LOCAL ] NIM: Primary data saved (3526 records). [2025-10-22T20:10:54.271493] [INFO ] [MAIN ] NIM: Full history saved. [2025-10-22T20:10:54.271565] [INFO ] [MAIN ] Update Progress: 1483/2367 symbols completed. NIM took 26.4s. Estimated remaining: 1h 53m 45s. Rate: 7.8 symbols/min [2025-10-22T20:10:54.435085] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:10:54.435260] [DEBUG] [LOCAL ] NKX: No existing data file found in primary storage. [2025-10-22T20:10:54.435298] [WARN ] [MAIN ] NKX: No existing data found, performing full refresh instead. [2025-10-22T20:10:54.435406] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-22T20:10:54.435446] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-22T20:10:54.435486] [DEBUG] [LOCAL ] NKX: No primary data file found to delete. [2025-10-22T20:10:54.435517] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-22T20:10:54.524868] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-22T20:10:54.807434] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:10:55.317745] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-22T20:10:56.117629] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-22T20:10:56.142076] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-22T20:10:56.403015] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-22T20:10:56.917697] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-22T20:10:57.049342] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-22T20:10:57.277591] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-22T20:10:57.284075] [INFO ] [REMOTE ] NJR: Full fetch complete (54854 records). [2025-10-22T20:10:57.284197] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-22T20:10:57.414379] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-22T20:10:57.676784] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-10-22T20:10:57.676861] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-10-22T20:10:57.677809] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-10-22T20:10:57.677875] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-10-22T20:10:57.679010] [DEBUG] [LOCAL ] NJR: Trimmed 54854 records to 37856 (keeping 200 days of data) [2025-10-22T20:10:57.730581] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-22T20:10:57.911587] [DEBUG] [LOCAL ] NJR: Primary data saved (37856 records). [2025-10-22T20:10:57.911746] [INFO ] [MAIN ] NJR: Full history saved. [2025-10-22T20:10:57.911829] [INFO ] [MAIN ] Update Progress: 1484/2367 symbols completed. NJR took 27.4s. Estimated remaining: 1h 53m 35s. Rate: 7.8 symbols/min [2025-10-22T20:10:58.075706] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:10:58.075889] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-22T20:10:58.075929] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-22T20:10:58.076038] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-22T20:10:58.076080] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-22T20:10:58.076121] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-22T20:10:58.076153] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-22T20:10:58.442182] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:10:58.517700] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-22T20:10:59.033230] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-22T20:10:59.317672] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-22T20:11:00.117735] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-22T20:11:00.226748] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-22T20:11:00.753433] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T20:11:00.917668] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-22T20:11:01.717691] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-22T20:11:01.984875] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-10-22T20:11:02.517780] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-22T20:11:02.534626] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T20:11:03.112096] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T20:11:03.192773] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-22T20:11:03.317720] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-22T20:11:04.117715] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-22T20:11:04.917744] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-22T20:11:05.008534] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T20:11:05.560916] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-22T20:11:05.717670] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-22T20:11:05.936695] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-22T20:11:06.183584] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-22T20:11:06.517731] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-22T20:11:07.128371] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-22T20:11:07.317705] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-22T20:11:08.117675] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-22T20:11:08.835970] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-22T20:11:08.917710] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-22T20:11:09.717628] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-22T20:11:10.074205] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-10 (2.76 seconds). [2025-10-22T20:11:10.084214] [INFO ] [REMOTE ] NIO: Full fetch complete (77982 records). [2025-10-22T20:11:10.084364] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-22T20:11:10.518989] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-22T20:11:10.518739] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-22T20:11:10.521523] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-10-22T20:11:10.522506] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-10-22T20:11:10.523716] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-10-22T20:11:10.523781] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-10-22T20:11:10.525347] [DEBUG] [LOCAL ] NIO: Trimmed 77982 records to 53802 (keeping 200 days of data) [2025-10-22T20:11:10.828903] [DEBUG] [LOCAL ] NIO: Primary data saved (53802 records). [2025-10-22T20:11:10.829037] [INFO ] [MAIN ] NIO: Full history saved. [2025-10-22T20:11:10.829113] [INFO ] [MAIN ] Update Progress: 1485/2367 symbols completed. NIO took 43.0s. Estimated remaining: 1h 53m 30s. Rate: 7.8 symbols/min [2025-10-22T20:11:11.000106] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:11:11.012747] [DEBUG] [LOCAL ] NLOP: Loaded 11626 existing records from primary storage. [2025-10-22T20:11:11.012977] [INFO ] [MAIN ] NLOP: Loaded 11626 existing records. [2025-10-22T20:11:11.188903] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:11:11.189515] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-22T20:11:11.189574] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-22T20:11:11.189870] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-10-22T20:11:11.189927] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-22T20:11:11.327306] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-22T20:11:11.568883] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:11:11.582280] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-22T20:11:11.685890] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-22T20:11:11.988897] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-22T20:11:12.117636] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-22T20:11:12.719864] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T20:11:12.917676] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-22T20:11:13.717677] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-10-22T20:11:14.517707] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-22T20:11:14.730027] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T20:11:15.317633] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-10-22T20:11:15.537199] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-22T20:11:15.598974] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-22T20:11:15.880914] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T20:11:16.117665] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-22T20:11:16.917685] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-22T20:11:16.944153] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-22T20:11:17.466837] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-22T20:11:17.468145] [INFO ] [REMOTE ] NL: Full fetch complete (6896 records). [2025-10-22T20:11:17.468212] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-22T20:11:17.645269] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T20:11:17.645499] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:11:17.645569] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:11:17.645658] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-22T20:11:17.645740] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-22T20:11:17.645779] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-22T20:11:17.645819] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-22T20:11:17.645874] [INFO ] [MAIN ] Update Progress: 1486/2367 symbols completed. NL took 19.7s. Estimated remaining: 1h 53m 22s. Rate: 7.8 symbols/min [2025-10-22T20:11:17.722881] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-22T20:11:17.820309] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:11:17.869054] [DEBUG] [LOCAL ] NLY: Loaded 53564 existing records from primary storage. [2025-10-22T20:11:17.869402] [INFO ] [MAIN ] NLY: Loaded 53564 existing records. [2025-10-22T20:11:18.050548] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:11:18.050826] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-22T20:11:18.050889] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-22T20:11:18.051069] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-10-22T20:11:18.051108] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-22T20:11:18.401775] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:11:18.517627] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-10-22T20:11:18.606131] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-22T20:11:19.317668] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-22T20:11:19.455638] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-22T20:11:20.117723] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-10. [2025-10-22T20:11:20.917730] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-22T20:11:21.237776] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-22T20:11:21.254443] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-22T20:11:21.256701] [INFO ] [REMOTE ] NKX: Full fetch complete (19134 records). [2025-10-22T20:11:21.256769] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-10-22T20:11:21.635566] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-10-22T20:11:21.635683] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-10-22T20:11:21.636101] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-10-22T20:11:21.636141] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-10-22T20:11:21.636734] [DEBUG] [LOCAL ] NKX: Trimmed 19134 records to 13670 (keeping 200 days of data) [2025-10-22T20:11:21.718827] [DEBUG] [LOCAL ] NKX: Primary data saved (13670 records). [2025-10-22T20:11:21.719001] [INFO ] [MAIN ] NKX: Full history saved. [2025-10-22T20:11:21.719141] [INFO ] [MAIN ] Update Progress: 1487/2367 symbols completed. NKX took 27.4s. Estimated remaining: 1h 53m 12s. Rate: 7.8 symbols/min [2025-10-22T20:11:21.718710] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-22T20:11:21.925081] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:11:21.938946] [DEBUG] [LOCAL ] NMAI: Loaded 12611 existing records from primary storage. [2025-10-22T20:11:21.939244] [INFO ] [MAIN ] NMAI: Loaded 12611 existing records. [2025-10-22T20:11:22.072090] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T20:11:22.135115] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:11:22.135308] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-22T20:11:22.135354] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-22T20:11:22.135524] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-10-22T20:11:22.135578] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-22T20:11:22.486199] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:11:22.517610] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-22T20:11:23.317719] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-22T20:11:23.484163] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T20:11:23.596470] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T20:11:24.117671] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-22T20:11:24.909925] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T20:11:24.917604] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-22T20:11:25.717619] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-22T20:11:25.911614] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-10-22T20:11:25.955189] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T20:11:26.199547] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-22T20:11:26.517710] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-22T20:11:27.317664] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-22T20:11:27.388369] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-22T20:11:28.117684] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-22T20:11:28.917632] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-22T20:11:28.929109] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-22T20:11:29.487298] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-22T20:11:29.717676] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-22T20:11:30.517732] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-22T20:11:31.317637] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-22T20:11:31.383303] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-22T20:11:31.482882] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-22T20:11:31.907336] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-22T20:11:32.117698] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-22T20:11:32.263672] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T20:11:32.917723] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-22T20:11:33.689992] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-22T20:11:33.717677] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-22T20:11:33.960208] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T20:11:34.517732] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-22T20:11:35.317688] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-22T20:11:35.426441] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T20:11:35.754843] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-22T20:11:36.117638] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-22T20:11:36.273221] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-22T20:11:36.917671] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-22T20:11:37.049902] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-22T20:11:37.717639] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-22T20:11:37.890241] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T20:11:38.517941] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-22T20:11:39.317688] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-22T20:11:39.425840] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T20:11:39.428961] [INFO ] [REMOTE ] NLOP: Full fetch complete (17696 records). [2025-10-22T20:11:39.429228] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-22T20:11:39.801871] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-22T20:11:39.885803] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-10-22T20:11:39.886876] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-10-22T20:11:39.887461] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-10-22T20:11:39.887510] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-10-22T20:11:39.888347] [DEBUG] [LOCAL ] NLOP: Trimmed 17696 records to 11491 (keeping 200 days of data) [2025-10-22T20:11:39.964969] [DEBUG] [LOCAL ] NLOP: Primary data saved (11491 records). [2025-10-22T20:11:39.965123] [INFO ] [MAIN ] NLOP: Full history saved. [2025-10-22T20:11:39.965209] [INFO ] [MAIN ] Update Progress: 1488/2367 symbols completed. NLOP took 29.1s. Estimated remaining: 1h 53m 11s. Rate: 7.8 symbols/min [2025-10-22T20:11:40.127017] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-22T20:11:40.145899] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:11:40.146962] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-22T20:11:40.147052] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-22T20:11:40.147177] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-22T20:11:40.147222] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-22T20:11:40.147266] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-22T20:11:40.147301] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-22T20:11:40.503872] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:11:40.917719] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-01. [2025-10-22T20:11:41.114890] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T20:11:41.143730] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T20:11:41.144017] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-01 [2025-10-22T20:11:41.144121] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T20:11:41.144215] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-22T20:11:41.144298] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T20:11:41.144390] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-22T20:11:41.144473] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-22T20:11:41.144511] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-22T20:11:41.144549] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-22T20:11:41.144592] [INFO ] [MAIN ] Update Progress: 1489/2367 symbols completed. NMAX took 1.2s. Estimated remaining: 1h 52m 59s. Rate: 7.8 symbols/min [2025-10-22T20:11:41.315074] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:11:41.333513] [DEBUG] [LOCAL ] NMCO: Loaded 16621 existing records from primary storage. [2025-10-22T20:11:41.333813] [INFO ] [MAIN ] NMCO: Loaded 16621 existing records. [2025-10-22T20:11:41.524240] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:11:41.524582] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-22T20:11:41.524663] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-22T20:11:41.524851] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-10-22T20:11:41.524896] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-22T20:11:41.731617] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-22T20:11:41.912638] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:11:41.933250] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-22T20:11:42.517685] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-22T20:11:42.756050] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T20:11:42.758786] [INFO ] [REMOTE ] NMAI: Full fetch complete (19499 records). [2025-10-22T20:11:42.758879] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-22T20:11:43.137636] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-10-22T20:11:43.137775] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-10-22T20:11:43.138430] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-10-22T20:11:43.138496] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-10-22T20:11:43.139358] [DEBUG] [LOCAL ] NMAI: Trimmed 19499 records to 12567 (keeping 200 days of data) [2025-10-22T20:11:43.220565] [DEBUG] [LOCAL ] NMAI: Primary data saved (12567 records). [2025-10-22T20:11:43.220734] [INFO ] [MAIN ] NMAI: Full history saved. [2025-10-22T20:11:43.220822] [INFO ] [MAIN ] Update Progress: 1490/2367 symbols completed. NMAI took 21.5s. Estimated remaining: 1h 52m 48s. Rate: 7.8 symbols/min [2025-10-22T20:11:43.321409] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-22T20:11:43.398341] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:11:43.409096] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T20:11:43.423185] [DEBUG] [LOCAL ] NMG: Loaded 11780 existing records from primary storage. [2025-10-22T20:11:43.423419] [INFO ] [MAIN ] NMG: Loaded 11780 existing records. [2025-10-22T20:11:43.603236] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:11:43.603481] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-22T20:11:43.603539] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-22T20:11:43.603790] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-10-22T20:11:43.603846] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-22T20:11:43.949520] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:11:44.117625] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-22T20:11:44.905232] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T20:11:44.917606] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-22T20:11:45.088840] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T20:11:45.687911] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-22T20:11:45.717619] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-22T20:11:46.517701] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-22T20:11:46.619575] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T20:11:47.107183] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T20:11:47.317618] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-22T20:11:48.117693] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-22T20:11:48.171362] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-22T20:11:48.180533] [INFO ] [REMOTE ] NKE: Full fetch complete (77217 records). [2025-10-22T20:11:48.180741] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-22T20:11:48.379015] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-22T20:11:48.379861] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:11:48.379935] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:11:48.380009] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-22T20:11:48.380083] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-22T20:11:48.380123] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-22T20:11:48.380164] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-22T20:11:48.380228] [INFO ] [MAIN ] Update Progress: 1491/2367 symbols completed. NKE took 55.1s. Estimated remaining: 1h 52m 39s. Rate: 7.8 symbols/min [2025-10-22T20:11:48.555481] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:11:48.560987] [DEBUG] [LOCAL ] NMI: Loaded 4051 existing records from primary storage. [2025-10-22T20:11:48.561185] [INFO ] [MAIN ] NMI: Loaded 4051 existing records. [2025-10-22T20:11:48.747541] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:11:48.747895] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-22T20:11:48.747949] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-22T20:11:48.748118] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-10-22T20:11:48.748173] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-22T20:11:48.934142] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-22T20:11:48.949781] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T20:11:49.122512] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:11:49.717723] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-22T20:11:50.465837] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-22T20:11:50.517723] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-22T20:11:50.805681] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T20:11:51.120233] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T20:11:51.317715] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-22T20:11:51.939229] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-22T20:11:52.117723] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-22T20:11:52.917635] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-22T20:11:53.219007] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-22T20:11:53.501218] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-22T20:11:53.717704] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-22T20:11:54.517666] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-22T20:11:54.636056] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-22T20:11:55.317727] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-22T20:11:55.398671] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-22T20:11:56.117664] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-22T20:11:56.254878] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T20:11:56.842366] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-22T20:11:56.917718] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-22T20:11:57.509353] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-22T20:11:57.717733] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-22T20:11:58.181374] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-22T20:11:58.517673] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-22T20:11:59.066373] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-22T20:11:59.317686] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-22T20:11:59.942635] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T20:12:00.117701] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-22T20:12:00.917709] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-22T20:12:00.970534] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-22T20:12:01.717628] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-22T20:12:01.957682] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T20:12:02.517723] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-22T20:12:03.317677] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-22T20:12:03.451052] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T20:12:03.457464] [INFO ] [REMOTE ] NMG: Full fetch complete (16127 records). [2025-10-22T20:12:03.457553] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-22T20:12:03.818025] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-10-22T20:12:03.818112] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-10-22T20:12:03.818463] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-10-22T20:12:03.818502] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-10-22T20:12:03.819013] [DEBUG] [LOCAL ] NMG: Trimmed 16127 records to 12064 (keeping 200 days of data) [2025-10-22T20:12:03.884318] [DEBUG] [LOCAL ] NMG: Primary data saved (12064 records). [2025-10-22T20:12:03.884443] [INFO ] [MAIN ] NMG: Full history saved. [2025-10-22T20:12:03.884530] [INFO ] [MAIN ] Update Progress: 1492/2367 symbols completed. NMG took 20.7s. Estimated remaining: 1h 52m 36s. Rate: 7.8 symbols/min [2025-10-22T20:12:03.989006] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-22T20:12:04.057422] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:12:04.073441] [DEBUG] [LOCAL ] NMM: Loaded 14252 existing records from primary storage. [2025-10-22T20:12:04.073721] [INFO ] [MAIN ] NMM: Loaded 14252 existing records. [2025-10-22T20:12:04.127888] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-22T20:12:04.256095] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:12:04.256417] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-22T20:12:04.256548] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-22T20:12:04.256768] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-10-22T20:12:04.256826] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-22T20:12:04.610130] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:12:04.644325] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-22T20:12:04.917631] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-22T20:12:05.146346] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T20:12:05.522719] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T20:12:05.717720] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-22T20:12:06.517627] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-22T20:12:06.665078] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T20:12:07.188769] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-22T20:12:07.317682] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-22T20:12:08.117637] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-22T20:12:08.332936] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-22T20:12:08.774320] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-22T20:12:08.917679] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-22T20:12:09.717741] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-22T20:12:10.517682] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-22T20:12:10.658493] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T20:12:10.661119] [INFO ] [REMOTE ] NMCO: Full fetch complete (22858 records). [2025-10-22T20:12:10.661192] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-22T20:12:11.051573] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-10-22T20:12:11.051771] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-10-22T20:12:11.052351] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-10-22T20:12:11.052442] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-10-22T20:12:11.053344] [DEBUG] [LOCAL ] NMCO: Trimmed 22858 records to 16631 (keeping 200 days of data) [2025-10-22T20:12:11.076898] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-22T20:12:11.155452] [INFO ] [REMOTE ] NLY: Full fetch complete (77697 records). [2025-10-22T20:12:11.171481] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-10-22T20:12:11.186084] [DEBUG] [LOCAL ] NMCO: Primary data saved (16631 records). [2025-10-22T20:12:11.248631] [INFO ] [MAIN ] NMCO: Full history saved. [2025-10-22T20:12:11.260304] [INFO ] [MAIN ] Update Progress: 1493/2367 symbols completed. NMCO took 30.1s. Estimated remaining: 1h 52m 28s. Rate: 7.8 symbols/min [2025-10-22T20:12:11.325539] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-22T20:12:11.541790] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:12:11.683775] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T20:12:11.804941] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-10-22T20:12:11.805081] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-10-22T20:12:11.806207] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-10-22T20:12:11.807176] [DEBUG] [LOCAL ] NMR: Loaded 35555 existing records from primary storage. [2025-10-22T20:12:11.806333] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-10-22T20:12:11.807617] [INFO ] [MAIN ] NMR: Loaded 35555 existing records. [2025-10-22T20:12:11.912925] [DEBUG] [LOCAL ] NLY: Trimmed 77697 records to 53564 (keeping 200 days of data) [2025-10-22T20:12:12.095697] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:12:12.096913] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-22T20:12:12.098284] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-22T20:12:12.099418] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-10-22T20:12:12.100513] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-22T20:12:12.122755] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-22T20:12:12.194326] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T20:12:12.232707] [INFO ] [REMOTE ] NMI: Full fetch complete (5655 records). [2025-10-22T20:12:12.248821] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-22T20:12:12.963410] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:12:12.990834] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-22T20:12:13.027957] [DEBUG] [LOCAL ] NLY: Primary data saved (53564 records). [2025-10-22T20:12:13.028600] [INFO ] [MAIN ] NLY: Full history saved. [2025-10-22T20:12:13.034485] [INFO ] [MAIN ] Update Progress: 1494/2367 symbols completed. NLY took 55.4s. Estimated remaining: 1h 52m 16s. Rate: 7.8 symbols/min [2025-10-22T20:12:13.184521] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-10-22T20:12:13.191558] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-10-22T20:12:13.211604] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-10-22T20:12:13.237838] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-10-22T20:12:13.250439] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T20:12:13.269740] [DEBUG] [LOCAL ] NMI: Trimmed 5655 records to 4049 (keeping 200 days of data) [2025-10-22T20:12:13.321054] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:12:13.349234] [DEBUG] [LOCAL ] NMI: Primary data saved (4049 records). [2025-10-22T20:12:13.352103] [INFO ] [MAIN ] NMI: Full history saved. [2025-10-22T20:12:13.352266] [INFO ] [MAIN ] Update Progress: 1495/2367 symbols completed. NMI took 25.0s. Estimated remaining: 1h 52m 4s. Rate: 7.8 symbols/min [2025-10-22T20:12:13.351981] [DEBUG] [LOCAL ] NMS: Loaded 2903 existing records from primary storage. [2025-10-22T20:12:13.364931] [INFO ] [MAIN ] NMS: Loaded 2903 existing records. [2025-10-22T20:12:13.727617] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-22T20:12:13.748346] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:12:13.756162] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:12:13.757107] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-22T20:12:13.757364] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-22T20:12:13.757555] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-10-22T20:12:13.757615] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-22T20:12:13.854055] [DEBUG] [LOCAL ] NMT: Loaded 2817 existing records from primary storage. [2025-10-22T20:12:13.879188] [INFO ] [MAIN ] NMT: Loaded 2817 existing records. [2025-10-22T20:12:14.262364] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:12:14.281740] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-22T20:12:14.303356] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-22T20:12:14.367717] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:12:14.367930] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-10-22T20:12:14.368542] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-22T20:12:14.493447] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T20:12:14.522736] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-22T20:12:14.762475] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:12:14.955615] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-22T20:12:15.317699] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-22T20:12:15.815274] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-22T20:12:15.989288] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T20:12:16.117705] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-22T20:12:16.568359] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-22T20:12:16.917725] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-22T20:12:17.365159] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-22T20:12:17.717714] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-22T20:12:18.517636] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-22T20:12:19.064293] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-22T20:12:19.126174] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T20:12:19.317727] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-22T20:12:19.882626] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-22T20:12:20.117713] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-22T20:12:20.917816] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-22T20:12:21.366306] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-22T20:12:21.717802] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-22T20:12:21.816949] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T20:12:22.313960] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-22T20:12:22.517727] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-22T20:12:23.012001] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-22T20:12:23.317691] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-22T20:12:23.865307] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-22T20:12:24.117709] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-22T20:12:24.917706] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-22T20:12:25.471070] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-22T20:12:25.481717] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-22T20:12:25.717696] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-22T20:12:26.192088] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-22T20:12:26.517699] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-22T20:12:27.074985] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T20:12:27.317705] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-22T20:12:27.804021] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-22T20:12:28.117668] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-22T20:12:28.704402] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-22T20:12:28.917637] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-10-22T20:12:29.717685] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-22T20:12:30.228757] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-22T20:12:30.258211] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-22T20:12:30.517739] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-22T20:12:31.007866] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-22T20:12:31.317730] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-22T20:12:31.890932] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-22T20:12:31.891933] [INFO ] [REMOTE ] NMT: Full fetch complete (3885 records). [2025-10-22T20:12:31.892021] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-22T20:12:32.122767] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-22T20:12:32.257566] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-10-22T20:12:32.257640] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-10-22T20:12:32.257822] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-10-22T20:12:32.257881] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-10-22T20:12:32.258214] [DEBUG] [LOCAL ] NMT: Trimmed 3885 records to 2811 (keeping 200 days of data) [2025-10-22T20:12:32.275207] [DEBUG] [LOCAL ] NMT: Primary data saved (2811 records). [2025-10-22T20:12:32.275279] [INFO ] [MAIN ] NMT: Full history saved. [2025-10-22T20:12:32.275347] [INFO ] [MAIN ] Update Progress: 1496/2367 symbols completed. NMT took 18.9s. Estimated remaining: 1h 52m 3s. Rate: 7.8 symbols/min [2025-10-22T20:12:32.439756] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:12:32.460365] [DEBUG] [LOCAL ] NMZ: Loaded 21449 existing records from primary storage. [2025-10-22T20:12:32.460599] [INFO ] [MAIN ] NMZ: Loaded 21449 existing records. [2025-10-22T20:12:32.638990] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:12:32.639194] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-22T20:12:32.639241] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-22T20:12:32.639407] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-10-22T20:12:32.639444] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-22T20:12:32.922753] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-22T20:12:32.986166] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:12:33.070261] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-22T20:12:33.446032] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-22T20:12:33.717684] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-22T20:12:34.517702] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-22T20:12:34.626168] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T20:12:34.980851] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-22T20:12:35.317670] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-10-22T20:12:36.117687] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-22T20:12:36.596072] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-22T20:12:36.597144] [INFO ] [REMOTE ] NMS: Full fetch complete (4065 records). [2025-10-22T20:12:36.597212] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-22T20:12:36.919875] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-22T20:12:36.937236] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T20:12:37.000167] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-10-22T20:12:37.000244] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-10-22T20:12:37.000363] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-10-22T20:12:37.000421] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-10-22T20:12:37.000850] [DEBUG] [LOCAL ] NMS: Trimmed 4065 records to 2889 (keeping 200 days of data) [2025-10-22T20:12:37.018996] [DEBUG] [LOCAL ] NMS: Primary data saved (2889 records). [2025-10-22T20:12:37.019107] [INFO ] [MAIN ] NMS: Full history saved. [2025-10-22T20:12:37.019183] [INFO ] [MAIN ] Update Progress: 1497/2367 symbols completed. NMS took 24.0s. Estimated remaining: 1h 51m 54s. Rate: 7.8 symbols/min [2025-10-22T20:12:37.225935] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:12:37.236474] [DEBUG] [LOCAL ] NNI: Loaded 10538 existing records from primary storage. [2025-10-22T20:12:37.236691] [INFO ] [MAIN ] NNI: Loaded 10538 existing records. [2025-10-22T20:12:37.412568] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:12:37.412776] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-22T20:12:37.412827] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-22T20:12:37.412977] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-10-22T20:12:37.413014] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-22T20:12:37.729967] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-22T20:12:37.772904] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:12:37.854830] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T20:12:38.517690] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-10-22T20:12:38.849430] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T20:12:39.317698] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-22T20:12:39.815080] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-22T20:12:39.968073] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T20:12:40.117675] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-22T20:12:40.833170] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-22T20:12:40.917680] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-22T20:12:41.569316] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T20:12:41.717700] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-22T20:12:42.258705] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-22T20:12:42.517687] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-22T20:12:43.208285] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-22T20:12:43.317633] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-22T20:12:44.117635] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-22T20:12:44.533118] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T20:12:44.895518] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-22T20:12:44.917680] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-10-22T20:12:45.717667] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-22T20:12:46.357235] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T20:12:46.372194] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T20:12:46.517683] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-22T20:12:47.317732] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-10. [2025-10-22T20:12:47.583921] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T20:12:48.117711] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-22T20:12:48.855965] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T20:12:48.862818] [INFO ] [REMOTE ] NMR: Full fetch complete (51289 records). [2025-10-22T20:12:48.862954] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-10-22T20:12:48.922844] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-22T20:12:48.996527] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T20:12:49.260214] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-10-22T20:12:49.260291] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-10-22T20:12:49.261168] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-10-22T20:12:49.261232] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-10-22T20:12:49.262369] [DEBUG] [LOCAL ] NMR: Trimmed 51289 records to 35454 (keeping 200 days of data) [2025-10-22T20:12:49.457507] [DEBUG] [LOCAL ] NMR: Primary data saved (35454 records). [2025-10-22T20:12:49.457663] [INFO ] [MAIN ] NMR: Full history saved. [2025-10-22T20:12:49.457783] [INFO ] [MAIN ] Update Progress: 1498/2367 symbols completed. NMR took 38.2s. Estimated remaining: 1h 51m 49s. Rate: 7.8 symbols/min [2025-10-22T20:12:49.623767] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:12:49.663664] [DEBUG] [LOCAL ] NNN: Loaded 48194 existing records from primary storage. [2025-10-22T20:12:49.663969] [INFO ] [MAIN ] NNN: Loaded 48194 existing records. [2025-10-22T20:12:49.725343] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-22T20:12:49.842056] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:12:49.842255] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-22T20:12:49.842310] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-22T20:12:49.842588] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-10-22T20:12:49.842673] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-22T20:12:50.126577] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-22T20:12:50.204698] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:12:50.517630] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-22T20:12:50.813418] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T20:12:51.317688] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-22T20:12:52.117672] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-22T20:12:52.127586] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T20:12:52.183405] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T20:12:52.917634] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-22T20:12:53.179970] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T20:12:53.388846] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-22T20:12:53.717694] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-22T20:12:54.517684] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-22T20:12:55.276341] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T20:12:55.317617] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-22T20:12:55.494593] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-22T20:12:56.117733] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-22T20:12:56.917685] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-22T20:12:56.982451] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T20:12:57.023426] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T20:12:57.026392] [INFO ] [REMOTE ] NMM: Full fetch complete (21599 records). [2025-10-22T20:12:57.026501] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-22T20:12:57.405971] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-10-22T20:12:57.406048] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-10-22T20:12:57.406523] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-10-22T20:12:57.406564] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-10-22T20:12:57.407182] [DEBUG] [LOCAL ] NMM: Trimmed 21599 records to 14137 (keeping 200 days of data) [2025-10-22T20:12:57.492919] [DEBUG] [LOCAL ] NMM: Primary data saved (14137 records). [2025-10-22T20:12:57.493052] [INFO ] [MAIN ] NMM: Full history saved. [2025-10-22T20:12:57.493129] [INFO ] [MAIN ] Update Progress: 1499/2367 symbols completed. NMM took 53.6s. Estimated remaining: 1h 51m 41s. Rate: 7.8 symbols/min [2025-10-22T20:12:57.662896] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:12:57.670754] [DEBUG] [LOCAL ] NNY: Loaded 5694 existing records from primary storage. [2025-10-22T20:12:57.670994] [INFO ] [MAIN ] NNY: Loaded 5694 existing records. [2025-10-22T20:12:57.727731] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-22T20:12:57.870395] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:12:57.871405] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T20:12:57.871502] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-22T20:12:57.874447] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-22T20:12:57.875469] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-10-22T20:12:57.875529] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-22T20:12:58.235736] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:12:58.517685] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-22T20:12:59.317697] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-22T20:12:59.558872] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T20:12:59.593135] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T20:12:59.595126] [INFO ] [REMOTE ] NNI: Full fetch complete (13150 records). [2025-10-22T20:12:59.595194] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-22T20:12:59.974206] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-22T20:12:59.974558] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-10-22T20:12:59.976149] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-10-22T20:12:59.977101] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-10-22T20:12:59.977153] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-10-22T20:12:59.977789] [DEBUG] [LOCAL ] NNI: Trimmed 13150 records to 10508 (keeping 200 days of data) [2025-10-22T20:13:00.041328] [DEBUG] [LOCAL ] NNI: Primary data saved (10508 records). [2025-10-22T20:13:00.041454] [INFO ] [MAIN ] NNI: Full history saved. [2025-10-22T20:13:00.041530] [INFO ] [MAIN ] Update Progress: 1500/2367 symbols completed. NNI took 23.0s. Estimated remaining: 1h 51m 31s. Rate: 7.8 symbols/min [2025-10-22T20:13:00.122911] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-22T20:13:00.214011] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:13:00.231424] [DEBUG] [LOCAL ] NOA: Loaded 15834 existing records from primary storage. [2025-10-22T20:13:00.231674] [INFO ] [MAIN ] NOA: Loaded 15834 existing records. [2025-10-22T20:13:00.409045] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:13:00.409292] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-22T20:13:00.409340] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-22T20:13:00.409708] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-10-22T20:13:00.409768] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-22T20:13:00.763666] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:13:00.917666] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-22T20:13:01.632274] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-22T20:13:01.717632] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-22T20:13:01.827869] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T20:13:02.517693] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-22T20:13:02.770870] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T20:13:03.317629] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-22T20:13:03.333345] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-22T20:13:04.117687] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-22T20:13:04.816375] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T20:13:04.917620] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-22T20:13:04.954825] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-22T20:13:05.717680] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-22T20:13:06.517690] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-22T20:13:06.633550] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T20:13:06.736384] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T20:13:07.141786] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T20:13:07.317630] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-22T20:13:08.117692] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-22T20:13:08.917693] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-22T20:13:08.973792] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T20:13:09.261695] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T20:13:09.717702] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-22T20:13:10.025045] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-22T20:13:10.517704] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-22T20:13:10.690047] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-22T20:13:11.317679] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-22T20:13:11.676446] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-22T20:13:11.680529] [INFO ] [REMOTE ] NMZ: Full fetch complete (31060 records). [2025-10-22T20:13:11.680632] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-22T20:13:12.072801] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-10-22T20:13:12.072987] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-10-22T20:13:12.073684] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-10-22T20:13:12.073750] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-10-22T20:13:12.074635] [DEBUG] [LOCAL ] NMZ: Trimmed 31060 records to 21383 (keeping 200 days of data) [2025-10-22T20:13:12.127914] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-22T20:13:12.177084] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T20:13:12.222784] [DEBUG] [LOCAL ] NMZ: Primary data saved (21383 records). [2025-10-22T20:13:12.222905] [INFO ] [MAIN ] NMZ: Full history saved. [2025-10-22T20:13:12.222980] [INFO ] [MAIN ] Update Progress: 1501/2367 symbols completed. NMZ took 39.9s. Estimated remaining: 1h 51m 25s. Rate: 7.8 symbols/min [2025-10-22T20:13:12.398953] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:13:12.418503] [DEBUG] [LOCAL ] NOAH: Loaded 20006 existing records from primary storage. [2025-10-22T20:13:12.418772] [INFO ] [MAIN ] NOAH: Loaded 20006 existing records. [2025-10-22T20:13:12.599590] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:13:12.599843] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-22T20:13:12.599929] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-22T20:13:12.600092] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-10-22T20:13:12.600155] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-22T20:13:12.923634] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-22T20:13:12.953759] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:13:13.717676] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-22T20:13:13.861252] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T20:13:13.893286] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-22T20:13:14.517732] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-22T20:13:14.606922] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-22T20:13:15.044733] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-22T20:13:15.317678] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-22T20:13:16.117692] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-22T20:13:16.163178] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-22T20:13:16.917630] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-22T20:13:17.305903] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T20:13:17.507237] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T20:13:17.717713] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-22T20:13:18.218545] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-22T20:13:18.517722] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-22T20:13:19.114845] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T20:13:19.317711] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-22T20:13:20.117724] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-22T20:13:20.294583] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-22T20:13:20.733793] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-22T20:13:20.917782] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-22T20:13:21.662110] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T20:13:21.663833] [INFO ] [REMOTE ] NNY: Full fetch complete (8346 records). [2025-10-22T20:13:21.663907] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-22T20:13:21.725720] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-22T20:13:22.045294] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-10-22T20:13:22.045397] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-10-22T20:13:22.045703] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-10-22T20:13:22.045766] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-10-22T20:13:22.046255] [DEBUG] [LOCAL ] NNY: Trimmed 8346 records to 5674 (keeping 200 days of data) [2025-10-22T20:13:22.084477] [DEBUG] [LOCAL ] NNY: Primary data saved (5674 records). [2025-10-22T20:13:22.084689] [INFO ] [MAIN ] NNY: Full history saved. [2025-10-22T20:13:22.084802] [INFO ] [MAIN ] Update Progress: 1502/2367 symbols completed. NNY took 24.6s. Estimated remaining: 1h 51m 19s. Rate: 7.8 symbols/min [2025-10-22T20:13:22.282840] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:13:22.321434] [DEBUG] [LOCAL ] NOC: Loaded 41646 existing records from primary storage. [2025-10-22T20:13:22.321798] [INFO ] [MAIN ] NOC: Loaded 41646 existing records. [2025-10-22T20:13:22.531285] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-22T20:13:22.587973] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:13:22.588330] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-22T20:13:22.588414] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-22T20:13:22.588870] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-10-22T20:13:22.588929] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-22T20:13:22.854863] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-22T20:13:22.876840] [INFO ] [REMOTE ] NOA: Full fetch complete (22579 records). [2025-10-22T20:13:22.877128] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-22T20:13:23.351591] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-22T20:13:23.514493] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:13:23.659269] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-10-22T20:13:23.659361] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-10-22T20:13:23.659889] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-10-22T20:13:23.659955] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-10-22T20:13:23.660726] [DEBUG] [LOCAL ] NOA: Trimmed 22579 records to 15736 (keeping 200 days of data) [2025-10-22T20:13:23.737018] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T20:13:23.774380] [DEBUG] [LOCAL ] NOA: Primary data saved (15736 records). [2025-10-22T20:13:23.774678] [INFO ] [MAIN ] NOA: Full history saved. [2025-10-22T20:13:23.774794] [INFO ] [MAIN ] Update Progress: 1503/2367 symbols completed. NOA took 23.7s. Estimated remaining: 1h 51m 8s. Rate: 7.8 symbols/min [2025-10-22T20:13:23.996521] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:13:24.051364] [DEBUG] [LOCAL ] NOG: Loaded 51364 existing records from primary storage. [2025-10-22T20:13:24.051732] [INFO ] [MAIN ] NOG: Loaded 51364 existing records. [2025-10-22T20:13:24.122890] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-22T20:13:24.262767] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:13:24.262997] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-22T20:13:24.263070] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-22T20:13:24.263488] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-10-22T20:13:24.263528] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-22T20:13:24.615083] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:13:24.917694] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-22T20:13:25.196194] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T20:13:25.223084] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T20:13:25.231459] [INFO ] [REMOTE ] NNN: Full fetch complete (70325 records). [2025-10-22T20:13:25.231626] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-22T20:13:25.644982] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-10-22T20:13:25.645136] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-10-22T20:13:25.646941] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-10-22T20:13:25.647015] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-10-22T20:13:25.648968] [DEBUG] [LOCAL ] NNN: Trimmed 70325 records to 48165 (keeping 200 days of data) [2025-10-22T20:13:25.743669] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-22T20:13:25.970501] [DEBUG] [LOCAL ] NNN: Primary data saved (48165 records). [2025-10-22T20:13:25.970757] [INFO ] [MAIN ] NNN: Full history saved. [2025-10-22T20:13:25.970887] [INFO ] [MAIN ] Update Progress: 1504/2367 symbols completed. NNN took 36.5s. Estimated remaining: 1h 50m 57s. Rate: 7.8 symbols/min [2025-10-22T20:13:26.146408] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:13:26.200237] [DEBUG] [LOCAL ] NOK: Loaded 53622 existing records from primary storage. [2025-10-22T20:13:26.200746] [INFO ] [MAIN ] NOK: Loaded 53622 existing records. [2025-10-22T20:13:26.391414] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:13:26.391953] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-22T20:13:26.392101] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-22T20:13:26.392368] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-10-22T20:13:26.392426] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-22T20:13:26.522801] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-22T20:13:26.793951] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:13:26.828610] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T20:13:27.317698] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-22T20:13:27.445211] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T20:13:27.897403] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T20:13:28.117688] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-22T20:13:28.917689] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-22T20:13:28.998543] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T20:13:29.691983] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-22T20:13:29.717611] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-22T20:13:29.835377] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T20:13:30.517688] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-22T20:13:31.317708] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-22T20:13:31.502155] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T20:13:32.117721] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-22T20:13:32.326385] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T20:13:32.917719] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-22T20:13:33.103496] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T20:13:33.276363] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T20:13:33.717681] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-22T20:13:34.517704] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-22T20:13:34.846487] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T20:13:35.317720] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-22T20:13:35.454042] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T20:13:35.623085] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T20:13:36.117783] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-22T20:13:36.917718] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-22T20:13:37.247087] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-22T20:13:37.578501] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-22T20:13:37.717632] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-22T20:13:37.975171] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T20:13:38.517720] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-22T20:13:39.317718] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-22T20:13:39.609726] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T20:13:40.100850] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-22T20:13:40.104123] [INFO ] [REMOTE ] NOAH: Full fetch complete (27280 records). [2025-10-22T20:13:40.104210] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-22T20:13:40.125210] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-22T20:13:40.483219] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-10-22T20:13:40.483322] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-10-22T20:13:40.483921] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-10-22T20:13:40.483983] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-10-22T20:13:40.484760] [DEBUG] [LOCAL ] NOAH: Trimmed 27280 records to 19844 (keeping 200 days of data) [2025-10-22T20:13:40.602916] [DEBUG] [LOCAL ] NOAH: Primary data saved (19844 records). [2025-10-22T20:13:40.603146] [INFO ] [MAIN ] NOAH: Full history saved. [2025-10-22T20:13:40.603325] [INFO ] [MAIN ] Update Progress: 1505/2367 symbols completed. NOAH took 28.4s. Estimated remaining: 1h 50m 53s. Rate: 7.8 symbols/min [2025-10-22T20:13:40.780865] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:13:40.781063] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-22T20:13:40.781126] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-22T20:13:40.781253] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-22T20:13:40.781310] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-22T20:13:40.781551] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-22T20:13:40.781624] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-22T20:13:40.917241] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-22T20:13:40.917630] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-22T20:13:41.195110] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:13:41.717714] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-22T20:13:41.873493] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T20:13:42.067685] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-22T20:13:42.517694] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-22T20:13:42.798191] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T20:13:43.317681] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-22T20:13:43.682283] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-22T20:13:44.117724] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-22T20:13:44.827512] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-22T20:13:44.917627] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-22T20:13:45.717673] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-22T20:13:45.979751] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T20:13:46.528474] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-22T20:13:46.531115] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T20:13:47.317710] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-22T20:13:47.463806] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T20:13:47.910810] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T20:13:48.117667] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-22T20:13:48.417796] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T20:13:48.473365] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-22T20:13:48.917634] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-22T20:13:49.717712] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-22T20:13:50.517699] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-22T20:13:50.660560] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T20:13:51.317718] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-22T20:13:51.562733] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T20:13:51.657689] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-22T20:13:52.088917] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T20:13:52.117671] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-22T20:13:52.917680] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-22T20:13:53.248077] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-22T20:13:53.717675] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-22T20:13:54.316738] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-22T20:13:54.517725] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-22T20:13:55.317688] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-22T20:13:55.616242] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T20:13:55.623395] [INFO ] [REMOTE ] NOC: Full fetch complete (61980 records). [2025-10-22T20:13:55.623589] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-22T20:13:56.082673] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-10-22T20:13:56.082853] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-10-22T20:13:56.083932] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-10-22T20:13:56.084011] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-10-22T20:13:56.085294] [DEBUG] [LOCAL ] NOC: Trimmed 61980 records to 41598 (keeping 200 days of data) [2025-10-22T20:13:56.145207] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-22T20:13:56.353184] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T20:13:56.408296] [DEBUG] [LOCAL ] NOC: Primary data saved (41598 records). [2025-10-22T20:13:56.408437] [INFO ] [MAIN ] NOC: Full history saved. [2025-10-22T20:13:56.408519] [INFO ] [MAIN ] Update Progress: 1506/2367 symbols completed. NOC took 34.3s. Estimated remaining: 1h 50m 50s. Rate: 7.8 symbols/min [2025-10-22T20:13:56.577413] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:13:56.615460] [DEBUG] [LOCAL ] NOMD: Loaded 43178 existing records from primary storage. [2025-10-22T20:13:56.615758] [INFO ] [MAIN ] NOMD: Loaded 43178 existing records. [2025-10-22T20:13:56.654958] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-22T20:13:56.798722] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:13:56.799134] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-22T20:13:56.799282] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-22T20:13:56.799731] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-10-22T20:13:56.799787] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-22T20:13:56.922864] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-22T20:13:57.152685] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:13:57.181712] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T20:13:57.717686] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-22T20:13:58.517712] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-22T20:13:59.124351] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-22T20:13:59.221070] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T20:13:59.317622] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-22T20:14:00.117731] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-22T20:14:00.389916] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-22T20:14:00.699210] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T20:14:00.917690] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-22T20:14:01.717737] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-22T20:14:02.180684] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-22T20:14:02.322883] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-22T20:14:02.331673] [INFO ] [REMOTE ] NOK: Full fetch complete (77774 records). [2025-10-22T20:14:02.331807] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-22T20:14:02.527716] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-22T20:14:02.737304] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-10-22T20:14:02.737383] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-10-22T20:14:02.738578] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-10-22T20:14:02.738666] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-10-22T20:14:02.740173] [DEBUG] [LOCAL ] NOK: Trimmed 77774 records to 53622 (keeping 200 days of data) [2025-10-22T20:14:03.045811] [DEBUG] [LOCAL ] NOK: Primary data saved (53622 records). [2025-10-22T20:14:03.045964] [INFO ] [MAIN ] NOK: Full history saved. [2025-10-22T20:14:03.046101] [INFO ] [MAIN ] Update Progress: 1507/2367 symbols completed. NOK took 37.1s. Estimated remaining: 1h 50m 42s. Rate: 7.8 symbols/min [2025-10-22T20:14:03.202762] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-22T20:14:03.239289] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:14:03.275401] [DEBUG] [LOCAL ] NOTE: Loaded 39700 existing records from primary storage. [2025-10-22T20:14:03.275786] [INFO ] [MAIN ] NOTE: Loaded 39700 existing records. [2025-10-22T20:14:03.329138] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-22T20:14:03.450255] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:14:03.450461] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-22T20:14:03.450508] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-22T20:14:03.450849] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-10-22T20:14:03.450904] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-22T20:14:03.792927] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:14:03.977426] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-22T20:14:03.978256] [INFO ] [REMOTE ] NOM: Full fetch complete (1524 records). [2025-10-22T20:14:03.978332] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-22T20:14:04.127736] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-22T20:14:04.161511] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-22T20:14:04.161744] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:14:04.161819] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:14:04.161892] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-22T20:14:04.161951] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-22T20:14:04.161987] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-22T20:14:04.162025] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-22T20:14:04.162080] [INFO ] [MAIN ] Update Progress: 1508/2367 symbols completed. NOM took 23.6s. Estimated remaining: 1h 50m 30s. Rate: 7.8 symbols/min [2025-10-22T20:14:04.343169] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:14:04.393124] [DEBUG] [LOCAL ] NOV: Loaded 53168 existing records from primary storage. [2025-10-22T20:14:04.393482] [INFO ] [MAIN ] NOV: Loaded 53168 existing records. [2025-10-22T20:14:04.579141] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:14:04.579542] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-22T20:14:04.579687] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-22T20:14:04.580160] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-10-22T20:14:04.580271] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-22T20:14:04.714992] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-22T20:14:04.751006] [INFO ] [REMOTE ] NOG: Full fetch complete (74303 records). [2025-10-22T20:14:04.784535] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-22T20:14:04.932520] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-22T20:14:05.161051] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:14:05.396163] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-10-22T20:14:05.396276] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-10-22T20:14:05.397287] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-10-22T20:14:05.397349] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-10-22T20:14:05.398734] [DEBUG] [LOCAL ] NOG: Trimmed 74303 records to 51348 (keeping 200 days of data) [2025-10-22T20:14:05.705268] [DEBUG] [LOCAL ] NOG: Primary data saved (51348 records). [2025-10-22T20:14:05.705404] [INFO ] [MAIN ] NOG: Full history saved. [2025-10-22T20:14:05.705485] [INFO ] [MAIN ] Update Progress: 1509/2367 symbols completed. NOG took 41.9s. Estimated remaining: 1h 50m 19s. Rate: 7.8 symbols/min [2025-10-22T20:14:05.736699] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-22T20:14:05.875083] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:14:05.918030] [DEBUG] [LOCAL ] NOW: Loaded 47904 existing records from primary storage. [2025-10-22T20:14:05.918372] [INFO ] [MAIN ] NOW: Loaded 47904 existing records. [2025-10-22T20:14:06.097109] [WARN ] [MAIN ] NOW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:14:06.097337] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-22T20:14:06.097400] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-22T20:14:06.097715] [DEBUG] [LOCAL ] NOW: Deleted primary data file. [2025-10-22T20:14:06.097811] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-22T20:14:06.194540] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-22T20:14:06.497826] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:14:06.517610] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-22T20:14:06.542758] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T20:14:07.317708] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-22T20:14:07.561117] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T20:14:08.117731] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-22T20:14:08.626395] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-22T20:14:08.740862] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T20:14:08.917720] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-22T20:14:09.717718] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-22T20:14:09.859459] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T20:14:10.517721] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-22T20:14:10.777722] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T20:14:11.317712] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-22T20:14:11.615752] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-22T20:14:11.966216] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-22T20:14:12.117698] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-22T20:14:12.917701] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-22T20:14:13.569203] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-22T20:14:13.675201] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T20:14:13.717672] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-22T20:14:14.517731] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-22T20:14:14.711678] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T20:14:15.317792] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-22T20:14:16.117714] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-22T20:14:16.442839] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-22T20:14:16.493941] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-22T20:14:16.917731] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-22T20:14:17.537194] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-22T20:14:17.717675] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-22T20:14:17.911097] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T20:14:18.369925] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T20:14:18.517704] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-22T20:14:19.317634] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-22T20:14:19.828865] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-22T20:14:19.830203] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T20:14:20.117684] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-22T20:14:20.917737] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-22T20:14:21.057166] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T20:14:21.717712] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-22T20:14:21.865902] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T20:14:22.213337] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T20:14:22.517717] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-22T20:14:23.317686] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-22T20:14:23.824099] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-22T20:14:24.117721] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-22T20:14:24.384505] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T20:14:24.392715] [INFO ] [REMOTE ] NOMD: Full fetch complete (60832 records). [2025-10-22T20:14:24.392832] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-22T20:14:24.778673] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-10-22T20:14:24.778773] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-10-22T20:14:24.779689] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-10-22T20:14:24.779752] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-10-22T20:14:24.781137] [DEBUG] [LOCAL ] NOMD: Trimmed 60832 records to 43199 (keeping 200 days of data) [2025-10-22T20:14:24.952366] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-22T20:14:25.040987] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T20:14:25.079913] [DEBUG] [LOCAL ] NOMD: Primary data saved (43199 records). [2025-10-22T20:14:25.080029] [INFO ] [MAIN ] NOMD: Full history saved. [2025-10-22T20:14:25.080099] [INFO ] [MAIN ] Update Progress: 1510/2367 symbols completed. NOMD took 28.7s. Estimated remaining: 1h 50m 18s. Rate: 7.8 symbols/min [2025-10-22T20:14:25.250469] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:14:25.250674] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-22T20:14:25.250728] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-22T20:14:25.250862] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-22T20:14:25.250931] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-22T20:14:25.250985] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-22T20:14:25.251020] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-22T20:14:25.614460] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:14:25.717618] [INFO ] [REMOTE ] NP: Fetching primary data for 2025-01. [2025-10-22T20:14:25.918738] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T20:14:25.919065] [WARN ] [REMOTE ] NP: No data returned for month 2025-01 [2025-10-22T20:14:25.919155] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T20:14:25.919200] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-22T20:14:25.919259] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T20:14:25.919329] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-22T20:14:25.919392] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-22T20:14:25.919428] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-22T20:14:25.919468] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-22T20:14:25.919514] [INFO ] [MAIN ] Update Progress: 1511/2367 symbols completed. NP took 0.8s. Estimated remaining: 1h 50m 6s. Rate: 7.8 symbols/min [2025-10-22T20:14:26.090966] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:14:26.091142] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-22T20:14:26.091180] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-22T20:14:26.091289] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-22T20:14:26.091328] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-22T20:14:26.091368] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-22T20:14:26.091399] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-22T20:14:26.492401] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:14:26.519968] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-01. [2025-10-22T20:14:26.523772] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-22T20:14:26.564638] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T20:14:26.762557] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T20:14:26.762934] [WARN ] [REMOTE ] NPB: No data returned for month 2025-01 [2025-10-22T20:14:26.763023] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T20:14:26.763067] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-22T20:14:26.763102] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T20:14:26.763157] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-22T20:14:26.763213] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-22T20:14:26.763247] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-22T20:14:26.763286] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-22T20:14:26.763330] [INFO ] [MAIN ] Update Progress: 1512/2367 symbols completed. NPB took 0.8s. Estimated remaining: 1h 49m 55s. Rate: 7.8 symbols/min [2025-10-22T20:14:26.939908] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:14:26.957167] [DEBUG] [LOCAL ] NPCT: Loaded 16499 existing records from primary storage. [2025-10-22T20:14:26.957388] [INFO ] [MAIN ] NPCT: Loaded 16499 existing records. [2025-10-22T20:14:27.131860] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:14:27.132069] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-22T20:14:27.132123] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-22T20:14:27.132293] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-10-22T20:14:27.132349] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-22T20:14:27.327971] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-22T20:14:27.489896] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:14:28.117682] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-22T20:14:28.917675] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-22T20:14:29.208950] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-22T20:14:29.395509] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-22T20:14:29.717666] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-22T20:14:30.488962] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T20:14:30.517623] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-22T20:14:31.317743] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-22T20:14:31.648393] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-22T20:14:31.924201] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T20:14:32.117737] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-22T20:14:32.308725] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-22T20:14:32.917699] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-22T20:14:33.717696] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-22T20:14:33.944339] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T20:14:34.226835] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T20:14:34.517664] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-22T20:14:35.317716] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-22T20:14:35.340247] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-22T20:14:35.348614] [INFO ] [REMOTE ] NOW: Full fetch complete (70757 records). [2025-10-22T20:14:35.348769] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-22T20:14:35.749803] [DEBUG] [VALIDATOR ] NOW: All expected trading days are present. [2025-10-22T20:14:35.749919] [DEBUG] [VALIDATOR ] NOW: Primary data validation passed. [2025-10-22T20:14:35.750962] [INFO ] [MAIN ] NOW: Fetched primary data is valid. [2025-10-22T20:14:35.751176] [DEBUG] [LOCAL ] NOW: Saving primary data. [2025-10-22T20:14:35.781499] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-22T20:14:35.780061] [DEBUG] [LOCAL ] NOW: Trimmed 70757 records to 47850 (keeping 200 days of data) [2025-10-22T20:14:36.081039] [DEBUG] [LOCAL ] NOW: Primary data saved (47850 records). [2025-10-22T20:14:36.081174] [INFO ] [MAIN ] NOW: Full history saved. [2025-10-22T20:14:36.081248] [INFO ] [MAIN ] Update Progress: 1513/2367 symbols completed. NOW took 30.4s. Estimated remaining: 1h 49m 48s. Rate: 7.8 symbols/min [2025-10-22T20:14:36.124476] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-22T20:14:36.251475] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:14:36.261662] [DEBUG] [LOCAL ] NPFD: Loaded 10016 existing records from primary storage. [2025-10-22T20:14:36.261859] [INFO ] [MAIN ] NPFD: Loaded 10016 existing records. [2025-10-22T20:14:36.443087] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:14:36.443504] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-22T20:14:36.443563] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-22T20:14:36.443882] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-10-22T20:14:36.443938] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-22T20:14:36.802698] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:14:36.823241] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T20:14:36.827534] [INFO ] [REMOTE ] NOTE: Full fetch complete (61035 records). [2025-10-22T20:14:36.827626] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-22T20:14:36.921550] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-22T20:14:37.216661] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-10-22T20:14:37.216805] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-10-22T20:14:37.217785] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-10-22T20:14:37.217886] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-10-22T20:14:37.228347] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T20:14:37.232399] [DEBUG] [LOCAL ] NOTE: Trimmed 61035 records to 39580 (keeping 200 days of data) [2025-10-22T20:14:37.453459] [DEBUG] [LOCAL ] NOTE: Primary data saved (39580 records). [2025-10-22T20:14:37.453575] [INFO ] [MAIN ] NOTE: Full history saved. [2025-10-22T20:14:37.453670] [INFO ] [MAIN ] Update Progress: 1514/2367 symbols completed. NOTE took 34.4s. Estimated remaining: 1h 49m 37s. Rate: 7.8 symbols/min [2025-10-22T20:14:37.621709] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:14:37.632209] [DEBUG] [LOCAL ] NPK: Loaded 8461 existing records from primary storage. [2025-10-22T20:14:37.632404] [INFO ] [MAIN ] NPK: Loaded 8461 existing records. [2025-10-22T20:14:37.722823] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-22T20:14:37.814926] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:14:37.815203] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-22T20:14:37.820961] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-22T20:14:37.821624] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-22T20:14:37.822434] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-10-22T20:14:37.823883] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-22T20:14:38.181478] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:14:38.517625] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-22T20:14:38.759182] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-22T20:14:39.184467] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-22T20:14:39.317709] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-22T20:14:39.942667] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-22T20:14:40.117662] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-22T20:14:40.871064] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-22T20:14:40.917691] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-22T20:14:41.717674] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-22T20:14:41.948260] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T20:14:42.517683] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-22T20:14:43.284469] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-22T20:14:43.317617] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-22T20:14:43.554116] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T20:14:44.067208] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-22T20:14:44.117629] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-22T20:14:44.917695] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-22T20:14:45.193446] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T20:14:45.691526] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-22T20:14:45.717680] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-22T20:14:46.447304] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-22T20:14:46.517708] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-22T20:14:47.317697] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-22T20:14:47.526769] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T20:14:48.117712] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-22T20:14:48.917623] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-22T20:14:49.083964] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T20:14:49.293399] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T20:14:49.302106] [INFO ] [REMOTE ] NOV: Full fetch complete (77176 records). [2025-10-22T20:14:49.302218] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-22T20:14:49.704235] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-10-22T20:14:49.704433] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T20:14:49.706214] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-10-22T20:14:49.707907] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-10-22T20:14:49.707973] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-10-22T20:14:49.709261] [DEBUG] [LOCAL ] NOV: Trimmed 77176 records to 53163 (keeping 200 days of data) [2025-10-22T20:14:49.761600] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-22T20:14:50.036101] [DEBUG] [LOCAL ] NOV: Primary data saved (53163 records). [2025-10-22T20:14:50.036210] [INFO ] [MAIN ] NOV: Full history saved. [2025-10-22T20:14:50.036284] [INFO ] [MAIN ] Update Progress: 1515/2367 symbols completed. NOV took 45.9s. Estimated remaining: 1h 49m 32s. Rate: 7.8 symbols/min [2025-10-22T20:14:50.200078] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:14:50.235313] [DEBUG] [LOCAL ] NPKI: Loaded 40462 existing records from primary storage. [2025-10-22T20:14:50.235605] [INFO ] [MAIN ] NPKI: Loaded 40462 existing records. [2025-10-22T20:14:50.412729] [WARN ] [MAIN ] NPKI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:14:50.414112] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-22T20:14:50.414173] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-22T20:14:50.414941] [DEBUG] [LOCAL ] NPKI: Deleted primary data file. [2025-10-22T20:14:50.415000] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-22T20:14:50.525496] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T20:14:50.518089] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-22T20:14:50.786871] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:14:51.317701] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-22T20:14:51.353744] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T20:14:52.117685] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-22T20:14:52.317616] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-22T20:14:52.917704] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-22T20:14:53.406171] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-22T20:14:53.711443] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T20:14:53.717611] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-22T20:14:54.198895] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-22T20:14:54.517685] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-22T20:14:55.284190] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-22T20:14:55.317626] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-22T20:14:56.117623] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-22T20:14:56.291286] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-22T20:14:56.917734] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-22T20:14:57.402076] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T20:14:57.717634] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-22T20:14:57.906468] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T20:14:57.908967] [INFO ] [REMOTE ] NPCT: Full fetch complete (24355 records). [2025-10-22T20:14:57.909063] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-22T20:14:58.290551] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-10-22T20:14:58.290638] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-10-22T20:14:58.291252] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-10-22T20:14:58.291295] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-10-22T20:14:58.291966] [DEBUG] [LOCAL ] NPCT: Trimmed 24355 records to 16365 (keeping 200 days of data) [2025-10-22T20:14:58.389594] [DEBUG] [LOCAL ] NPCT: Primary data saved (16365 records). [2025-10-22T20:14:58.389753] [INFO ] [MAIN ] NPCT: Full history saved. [2025-10-22T20:14:58.389844] [INFO ] [MAIN ] Update Progress: 1516/2367 symbols completed. NPCT took 31.6s. Estimated remaining: 1h 49m 24s. Rate: 7.8 symbols/min [2025-10-22T20:14:58.527825] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-22T20:14:58.569952] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:14:58.571897] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-22T20:14:58.588539] [DEBUG] [LOCAL ] NPO: Loaded 13573 existing records from primary storage. [2025-10-22T20:14:58.588815] [INFO ] [MAIN ] NPO: Loaded 13573 existing records. [2025-10-22T20:14:58.771086] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:14:58.771322] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-22T20:14:58.771382] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-22T20:14:58.771554] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-10-22T20:14:58.771608] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-22T20:14:59.122441] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:14:59.291397] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-22T20:14:59.317623] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-22T20:15:00.117691] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-22T20:15:00.181021] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-22T20:15:00.917776] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-22T20:15:01.047784] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T20:15:01.050335] [INFO ] [REMOTE ] NPFD: Full fetch complete (14660 records). [2025-10-22T20:15:01.050412] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-22T20:15:01.434971] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-10-22T20:15:01.435099] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-10-22T20:15:01.435428] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-10-22T20:15:01.435469] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-10-22T20:15:01.436216] [DEBUG] [LOCAL ] NPFD: Trimmed 14660 records to 9999 (keeping 200 days of data) [2025-10-22T20:15:01.499599] [DEBUG] [LOCAL ] NPFD: Primary data saved (9999 records). [2025-10-22T20:15:01.499769] [INFO ] [MAIN ] NPFD: Full history saved. [2025-10-22T20:15:01.499853] [INFO ] [MAIN ] Update Progress: 1517/2367 symbols completed. NPFD took 25.4s. Estimated remaining: 1h 49m 14s. Rate: 7.8 symbols/min [2025-10-22T20:15:01.678720] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-22T20:15:01.717738] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-22T20:15:02.517952] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-22T20:15:03.286885] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T20:15:03.317605] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-22T20:15:03.450042] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T20:15:03.452511] [INFO ] [REMOTE ] NPK: Full fetch complete (11127 records). [2025-10-22T20:15:03.452594] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-22T20:15:03.889678] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-10-22T20:15:03.889844] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-10-22T20:15:03.890307] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-10-22T20:15:03.890387] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-10-22T20:15:03.891327] [DEBUG] [LOCAL ] NPK: Trimmed 11127 records to 8371 (keeping 200 days of data) [2025-10-22T20:15:03.941348] [DEBUG] [LOCAL ] NPK: Primary data saved (8371 records). [2025-10-22T20:15:03.941498] [INFO ] [MAIN ] NPK: Full history saved. [2025-10-22T20:15:03.941594] [INFO ] [MAIN ] Update Progress: 1518/2367 symbols completed. NPK took 26.5s. Estimated remaining: 1h 49m 3s. Rate: 7.8 symbols/min [2025-10-22T20:15:04.117792] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-22T20:15:05.012040] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T20:15:05.024297] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-22T20:15:05.050100] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-22T20:15:05.717710] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-22T20:15:06.678313] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T20:15:06.687521] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-22T20:15:06.802276] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T20:15:07.317712] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-22T20:15:08.179162] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T20:15:08.187509] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-22T20:15:08.322991] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-22T20:15:08.917682] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-22T20:15:09.808384] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T20:15:09.818107] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-22T20:15:09.872910] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-22T20:15:10.517719] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-22T20:15:11.303893] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T20:15:11.317605] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-22T20:15:11.392140] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-22T20:15:12.117745] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-22T20:15:12.735624] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-22T20:15:12.917719] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-22T20:15:13.120674] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T20:15:13.717624] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-22T20:15:14.427801] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-22T20:15:14.506070] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T20:15:14.512817] [INFO ] [REMOTE ] NPKI: Full fetch complete (56417 records). [2025-10-22T20:15:14.512912] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-22T20:15:14.544968] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-22T20:15:14.887036] [DEBUG] [VALIDATOR ] NPKI: All expected trading days are present. [2025-10-22T20:15:14.887112] [DEBUG] [VALIDATOR ] NPKI: Primary data validation passed. [2025-10-22T20:15:14.888004] [INFO ] [MAIN ] NPKI: Fetched primary data is valid. [2025-10-22T20:15:14.888068] [DEBUG] [LOCAL ] NPKI: Saving primary data. [2025-10-22T20:15:14.889204] [DEBUG] [LOCAL ] NPKI: Trimmed 56417 records to 40429 (keeping 200 days of data) [2025-10-22T20:15:15.114823] [DEBUG] [LOCAL ] NPKI: Primary data saved (40429 records). [2025-10-22T20:15:15.114978] [INFO ] [MAIN ] NPKI: Full history saved. [2025-10-22T20:15:15.115090] [INFO ] [MAIN ] Update Progress: 1519/2367 symbols completed. NPKI took 25.1s. Estimated remaining: 1h 48m 58s. Rate: 7.8 symbols/min [2025-10-22T20:15:15.478884] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T20:15:15.482004] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-22T20:15:16.628332] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T20:15:16.631724] [INFO ] [REMOTE ] NPO: Full fetch complete (18885 records). [2025-10-22T20:15:16.631799] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-22T20:15:16.995983] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-10-22T20:15:16.996086] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-10-22T20:15:16.996624] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-10-22T20:15:16.996720] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-10-22T20:15:16.997311] [DEBUG] [LOCAL ] NPO: Trimmed 18885 records to 13496 (keeping 200 days of data) [2025-10-22T20:15:17.078960] [DEBUG] [LOCAL ] NPO: Primary data saved (13496 records). [2025-10-22T20:15:17.079099] [INFO ] [MAIN ] NPO: Full history saved. [2025-10-22T20:15:17.079174] [INFO ] [MAIN ] Update Progress: 1520/2367 symbols completed. NPO took 18.7s. Estimated remaining: 1h 48m 47s. Rate: 7.8 symbols/min [2025-10-22T20:15:17.741484] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:15:17.672779] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:15:17.806485] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:15:17.831506] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:15:17.842605] [DEBUG] [LOCAL ] NPV: Loaded 5390 existing records from primary storage. [2025-10-22T20:15:17.843120] [INFO ] [MAIN ] NPV: Loaded 5390 existing records. [2025-10-22T20:15:17.907704] [DEBUG] [LOCAL ] NQP: Loaded 9224 existing records from primary storage. [2025-10-22T20:15:17.933301] [INFO ] [MAIN ] NQP: Loaded 9224 existing records. [2025-10-22T20:15:18.089994] [DEBUG] [LOCAL ] NRDY: Loaded 32274 existing records from primary storage. [2025-10-22T20:15:18.158188] [DEBUG] [LOCAL ] NPWR: Loaded 43381 existing records from primary storage. [2025-10-22T20:15:18.169302] [INFO ] [MAIN ] NRDY: Loaded 32274 existing records. [2025-10-22T20:15:18.175670] [INFO ] [MAIN ] NPWR: Loaded 43381 existing records. [2025-10-22T20:15:18.203746] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:15:18.307120] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-22T20:15:18.355678] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-22T20:15:18.493232] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-10-22T20:15:18.594753] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:15:18.605922] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-22T20:15:18.627190] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:15:18.581964] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-22T20:15:18.627379] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-22T20:15:18.636876] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-22T20:15:18.683627] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:15:18.699484] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-10-22T20:15:18.708905] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-22T20:15:18.717625] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-22T20:15:18.728133] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-22T20:15:18.788962] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-22T20:15:18.802609] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-10-22T20:15:18.826455] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-10-22T20:15:18.826612] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-22T20:15:18.837004] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-22T20:15:19.850987] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:15:19.922610] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-22T20:15:20.115967] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:15:20.132674] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-22T20:15:20.193836] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:15:20.211626] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-22T20:15:20.218528] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:15:20.218917] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-22T20:15:20.653410] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T20:15:20.655004] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-22T20:15:20.942069] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-22T20:15:20.944133] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-22T20:15:21.045362] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-22T20:15:21.046753] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-22T20:15:21.479708] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T20:15:21.682169] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-22T20:15:21.717696] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-22T20:15:21.726339] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-22T20:15:21.755636] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T20:15:22.517745] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-22T20:15:22.549400] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T20:15:23.317694] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-22T20:15:23.696740] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T20:15:24.117690] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-22T20:15:24.807094] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T20:15:24.917738] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-22T20:15:25.697132] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T20:15:25.717615] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-22T20:15:25.966957] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T20:15:26.517701] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-22T20:15:27.232185] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-22T20:15:27.323690] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-22T20:15:27.340304] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T20:15:28.068021] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-22T20:15:28.117710] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-22T20:15:28.917692] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-22T20:15:29.536748] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T20:15:29.717694] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-22T20:15:30.400972] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-22T20:15:30.460168] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T20:15:30.517671] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-22T20:15:31.176306] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-22T20:15:31.317680] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-22T20:15:31.892756] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-22T20:15:32.117678] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-22T20:15:32.794768] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-22T20:15:32.917678] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-22T20:15:33.717789] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-22T20:15:34.289601] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-22T20:15:34.489781] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-22T20:15:34.517686] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-22T20:15:35.083398] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-22T20:15:35.317629] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-22T20:15:36.060089] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T20:15:36.117678] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-22T20:15:36.718234] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-22T20:15:36.917671] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-10-22T20:15:37.679585] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-22T20:15:37.717666] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-10. [2025-10-22T20:15:38.466133] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T20:15:38.467889] [INFO ] [REMOTE ] NQP: Full fetch complete (12731 records). [2025-10-22T20:15:38.467984] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-10-22T20:15:38.522782] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-22T20:15:38.834756] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-10-22T20:15:38.834840] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-10-22T20:15:38.835135] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-10-22T20:15:38.835175] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-10-22T20:15:38.835624] [DEBUG] [LOCAL ] NQP: Trimmed 12731 records to 9070 (keeping 200 days of data) [2025-10-22T20:15:38.891129] [DEBUG] [LOCAL ] NQP: Primary data saved (9070 records). [2025-10-22T20:15:38.891252] [INFO ] [MAIN ] NQP: Full history saved. [2025-10-22T20:15:38.891329] [INFO ] [MAIN ] Update Progress: 1521/2367 symbols completed. NQP took 21.8s. Estimated remaining: 1h 48m 47s. Rate: 7.8 symbols/min [2025-10-22T20:15:39.066285] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:15:39.074876] [DEBUG] [LOCAL ] NREF: Loaded 7839 existing records from primary storage. [2025-10-22T20:15:39.075042] [INFO ] [MAIN ] NREF: Loaded 7839 existing records. [2025-10-22T20:15:39.255018] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:15:39.255238] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-22T20:15:39.255286] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-22T20:15:39.255469] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-10-22T20:15:39.255525] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-22T20:15:39.322868] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-22T20:15:39.641554] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:15:40.117723] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-22T20:15:40.259870] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T20:15:40.557076] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-22T20:15:40.841603] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T20:15:40.917666] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-22T20:15:41.398487] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-22T20:15:41.717723] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-22T20:15:42.517684] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-22T20:15:42.539828] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T20:15:43.317698] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-22T20:15:44.117631] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-22T20:15:44.143246] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T20:15:44.250854] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T20:15:44.622532] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-22T20:15:44.624297] [INFO ] [REMOTE ] NPV: Full fetch complete (7196 records). [2025-10-22T20:15:44.624481] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-22T20:15:44.922770] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-22T20:15:45.043294] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-10-22T20:15:45.043370] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-10-22T20:15:45.043594] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-10-22T20:15:45.043680] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-10-22T20:15:45.044094] [DEBUG] [LOCAL ] NPV: Trimmed 7196 records to 5380 (keeping 200 days of data) [2025-10-22T20:15:45.076685] [DEBUG] [LOCAL ] NPV: Primary data saved (5380 records). [2025-10-22T20:15:45.076815] [INFO ] [MAIN ] NPV: Full history saved. [2025-10-22T20:15:45.076900] [INFO ] [MAIN ] Update Progress: 1522/2367 symbols completed. NPV took 28.0s. Estimated remaining: 1h 48m 38s. Rate: 7.8 symbols/min [2025-10-22T20:15:45.245549] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:15:45.292611] [DEBUG] [LOCAL ] NRG: Loaded 52818 existing records from primary storage. [2025-10-22T20:15:45.292954] [INFO ] [MAIN ] NRG: Loaded 52818 existing records. [2025-10-22T20:15:45.464607] [WARN ] [MAIN ] NRG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:15:45.464823] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-22T20:15:45.464869] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-22T20:15:45.465197] [DEBUG] [LOCAL ] NRG: Deleted primary data file. [2025-10-22T20:15:45.465253] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-22T20:15:45.723699] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-22T20:15:45.814531] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:15:46.061766] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-22T20:15:46.517710] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-22T20:15:46.543016] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T20:15:47.317691] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-22T20:15:48.025751] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-22T20:15:48.027805] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T20:15:48.117693] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-22T20:15:48.917672] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-22T20:15:49.559248] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T20:15:49.717688] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-22T20:15:50.425284] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T20:15:50.517620] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-22T20:15:51.317627] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-22T20:15:51.333122] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-22T20:15:51.518407] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T20:15:52.117681] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-22T20:15:52.683343] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T20:15:52.917688] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-22T20:15:53.717715] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-22T20:15:53.992161] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-22T20:15:54.435582] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T20:15:54.441288] [INFO ] [REMOTE ] NRDY: Full fetch complete (49977 records). [2025-10-22T20:15:54.441424] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-22T20:15:54.522761] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-22T20:15:54.831660] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-10-22T20:15:54.831756] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-10-22T20:15:54.832569] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-10-22T20:15:54.832610] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-10-22T20:15:54.833745] [DEBUG] [LOCAL ] NRDY: Trimmed 49977 records to 32164 (keeping 200 days of data) [2025-10-22T20:15:55.017157] [DEBUG] [LOCAL ] NRDY: Primary data saved (32164 records). [2025-10-22T20:15:55.017298] [INFO ] [MAIN ] NRDY: Full history saved. [2025-10-22T20:15:55.017380] [INFO ] [MAIN ] Update Progress: 1523/2367 symbols completed. NRDY took 37.9s. Estimated remaining: 1h 48m 32s. Rate: 7.8 symbols/min [2025-10-22T20:15:55.193237] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:15:55.231935] [DEBUG] [LOCAL ] NRGV: Loaded 43875 existing records from primary storage. [2025-10-22T20:15:55.232221] [INFO ] [MAIN ] NRGV: Loaded 43875 existing records. [2025-10-22T20:15:55.322735] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-22T20:15:55.414511] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:15:55.414838] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-22T20:15:55.414909] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-22T20:15:55.415101] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-10-22T20:15:55.415159] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-22T20:15:55.779322] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-22T20:15:55.815629] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:15:55.815760] [INFO ] [REMOTE ] NPWR: Full fetch complete (60715 records). [2025-10-22T20:15:55.815896] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-22T20:15:56.122880] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-22T20:15:56.216220] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-10-22T20:15:56.216425] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-10-22T20:15:56.221876] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-10-22T20:15:56.223754] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-10-22T20:15:56.223996] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-22T20:15:56.227472] [DEBUG] [LOCAL ] NPWR: Trimmed 60715 records to 43444 (keeping 200 days of data) [2025-10-22T20:15:56.501669] [DEBUG] [LOCAL ] NPWR: Primary data saved (43444 records). [2025-10-22T20:15:56.501813] [INFO ] [MAIN ] NPWR: Full history saved. [2025-10-22T20:15:56.501900] [INFO ] [MAIN ] Update Progress: 1524/2367 symbols completed. NPWR took 39.4s. Estimated remaining: 1h 48m 21s. Rate: 7.8 symbols/min [2025-10-22T20:15:56.567428] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-22T20:15:56.681109] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:15:56.700095] [DEBUG] [LOCAL ] NRK: Loaded 20410 existing records from primary storage. [2025-10-22T20:15:56.700324] [INFO ] [MAIN ] NRK: Loaded 20410 existing records. [2025-10-22T20:15:56.874206] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:15:56.874511] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-22T20:15:56.874588] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-22T20:15:56.874924] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-10-22T20:15:56.874996] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-22T20:15:56.922840] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-22T20:15:57.233043] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:15:57.580502] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T20:15:57.717636] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-22T20:15:58.517680] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-22T20:15:58.893300] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T20:15:58.946098] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T20:15:58.990765] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-22T20:15:59.317746] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-22T20:16:00.117633] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-22T20:16:00.363838] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T20:16:00.917689] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-22T20:16:01.717717] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-22T20:16:02.241997] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-22T20:16:02.517633] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-22T20:16:03.317729] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-22T20:16:03.360532] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-10-22T20:16:04.117631] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-22T20:16:04.226694] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-22T20:16:04.283304] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-22T20:16:04.466039] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T20:16:04.917685] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-22T20:16:05.081362] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-22T20:16:05.717628] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-22T20:16:05.783685] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T20:16:05.785544] [INFO ] [REMOTE ] NREF: Full fetch complete (10882 records). [2025-10-22T20:16:05.785620] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-22T20:16:06.177073] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-10-22T20:16:06.177155] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-10-22T20:16:06.177432] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-10-22T20:16:06.177476] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-10-22T20:16:06.178123] [DEBUG] [LOCAL ] NREF: Trimmed 10882 records to 7815 (keeping 200 days of data) [2025-10-22T20:16:06.225389] [DEBUG] [LOCAL ] NREF: Primary data saved (7815 records). [2025-10-22T20:16:06.225523] [INFO ] [MAIN ] NREF: Full history saved. [2025-10-22T20:16:06.225599] [INFO ] [MAIN ] Update Progress: 1525/2367 symbols completed. NREF took 27.3s. Estimated remaining: 1h 48m 14s. Rate: 7.8 symbols/min [2025-10-22T20:16:06.401993] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:16:06.408898] [DEBUG] [LOCAL ] NRP: Loaded 4194 existing records from primary storage. [2025-10-22T20:16:06.409108] [INFO ] [MAIN ] NRP: Loaded 4194 existing records. [2025-10-22T20:16:06.522784] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-22T20:16:06.600850] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:16:06.601203] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-22T20:16:06.601253] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-22T20:16:06.601388] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-10-22T20:16:06.601428] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-22T20:16:06.994086] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:16:06.995853] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T20:16:07.317689] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-22T20:16:08.094312] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T20:16:08.117621] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-22T20:16:08.752415] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-22T20:16:08.889921] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-22T20:16:08.917667] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-22T20:16:09.713474] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-22T20:16:09.717619] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-22T20:16:10.366064] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-22T20:16:10.517679] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-22T20:16:11.292985] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-22T20:16:11.317634] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-22T20:16:12.100068] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T20:16:12.117622] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-22T20:16:12.917712] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-22T20:16:12.923595] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T20:16:13.717683] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-22T20:16:14.358576] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-22T20:16:14.517704] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-22T20:16:15.164332] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-22T20:16:15.300282] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T20:16:15.317631] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-22T20:16:16.117736] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-22T20:16:16.580954] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-22T20:16:16.917699] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-22T20:16:17.717702] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-22T20:16:18.248246] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-22T20:16:18.517693] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-22T20:16:18.636674] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T20:16:18.870576] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-22T20:16:19.317713] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-22T20:16:19.357043] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-22T20:16:19.358443] [INFO ] [REMOTE ] NRP: Full fetch complete (6302 records). [2025-10-22T20:16:19.358527] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-22T20:16:19.716946] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-10-22T20:16:19.717027] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-10-22T20:16:19.717191] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-10-22T20:16:19.717231] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-10-22T20:16:19.717715] [DEBUG] [LOCAL ] NRP: Trimmed 6302 records to 4126 (keeping 200 days of data) [2025-10-22T20:16:19.743189] [DEBUG] [LOCAL ] NRP: Primary data saved (4126 records). [2025-10-22T20:16:19.743314] [INFO ] [MAIN ] NRP: Full history saved. [2025-10-22T20:16:19.743391] [INFO ] [MAIN ] Update Progress: 1526/2367 symbols completed. NRP took 13.5s. Estimated remaining: 1h 48m 9s. Rate: 7.8 symbols/min [2025-10-22T20:16:19.919223] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:16:19.926412] [DEBUG] [LOCAL ] NRT: Loaded 4885 existing records from primary storage. [2025-10-22T20:16:19.926679] [INFO ] [MAIN ] NRT: Loaded 4885 existing records. [2025-10-22T20:16:20.117322] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:16:20.117540] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-22T20:16:20.117636] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-22T20:16:20.117944] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-22T20:16:20.119274] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-10-22T20:16:20.119339] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-22T20:16:20.491222] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:16:20.685274] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T20:16:20.917714] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-22T20:16:21.636705] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T20:16:21.717627] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-22T20:16:22.223564] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T20:16:22.517726] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-22T20:16:23.317687] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-22T20:16:23.857484] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-22T20:16:24.117626] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-22T20:16:24.278564] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T20:16:24.447256] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T20:16:24.917742] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-22T20:16:25.717619] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-22T20:16:25.861339] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T20:16:26.204902] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-22T20:16:26.213838] [INFO ] [REMOTE ] NRG: Full fetch complete (76820 records). [2025-10-22T20:16:26.213995] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-22T20:16:26.522898] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-22T20:16:26.601110] [DEBUG] [VALIDATOR ] NRG: All expected trading days are present. [2025-10-22T20:16:26.601188] [DEBUG] [VALIDATOR ] NRG: Primary data validation passed. [2025-10-22T20:16:26.602236] [INFO ] [MAIN ] NRG: Fetched primary data is valid. [2025-10-22T20:16:26.602299] [DEBUG] [LOCAL ] NRG: Saving primary data. [2025-10-22T20:16:26.603693] [DEBUG] [LOCAL ] NRG: Trimmed 76820 records to 52825 (keeping 200 days of data) [2025-10-22T20:16:26.926267] [DEBUG] [LOCAL ] NRG: Primary data saved (52825 records). [2025-10-22T20:16:26.926402] [INFO ] [MAIN ] NRG: Full history saved. [2025-10-22T20:16:26.926479] [INFO ] [MAIN ] Update Progress: 1527/2367 symbols completed. NRG took 41.8s. Estimated remaining: 1h 48m 1s. Rate: 7.8 symbols/min [2025-10-22T20:16:27.099686] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:16:27.111784] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T20:16:27.118495] [DEBUG] [LOCAL ] NRUC: Loaded 3108 existing records from primary storage. [2025-10-22T20:16:27.118627] [INFO ] [REMOTE ] NRK: Full fetch complete (27608 records). [2025-10-22T20:16:27.119000] [INFO ] [MAIN ] NRUC: Loaded 3108 existing records. [2025-10-22T20:16:27.119148] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-22T20:16:27.319192] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-22T20:16:27.506376] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:16:27.541524] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-22T20:16:27.554553] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-22T20:16:27.578304] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-10-22T20:16:27.584636] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-22T20:16:27.871948] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-10-22T20:16:27.873470] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-10-22T20:16:27.874529] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-10-22T20:16:27.874606] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-10-22T20:16:27.934451] [DEBUG] [LOCAL ] NRK: Trimmed 27608 records to 20423 (keeping 200 days of data) [2025-10-22T20:16:28.178847] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:16:28.182884] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-22T20:16:28.186462] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-22T20:16:28.216086] [DEBUG] [LOCAL ] NRK: Primary data saved (20423 records). [2025-10-22T20:16:28.216203] [INFO ] [MAIN ] NRK: Full history saved. [2025-10-22T20:16:28.216278] [INFO ] [MAIN ] Update Progress: 1528/2367 symbols completed. NRK took 31.7s. Estimated remaining: 1h 47m 50s. Rate: 7.8 symbols/min [2025-10-22T20:16:28.389211] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:16:28.419590] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-22T20:16:28.457286] [DEBUG] [LOCAL ] NSA: Loaded 45119 existing records from primary storage. [2025-10-22T20:16:28.457568] [INFO ] [MAIN ] NSA: Loaded 45119 existing records. [2025-10-22T20:16:28.631826] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:16:28.631995] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-22T20:16:28.632040] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-22T20:16:28.632212] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-10-22T20:16:28.632249] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-22T20:16:28.910057] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T20:16:28.922800] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-22T20:16:28.994465] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:16:29.704231] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-22T20:16:29.717623] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-22T20:16:30.517713] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-22T20:16:31.317734] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-22T20:16:31.759338] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T20:16:31.832275] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T20:16:32.056867] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-22T20:16:32.117682] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-22T20:16:32.897181] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-22T20:16:32.917620] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-22T20:16:33.715714] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T20:16:33.717614] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-22T20:16:34.517734] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-22T20:16:35.231599] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-22T20:16:35.317680] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-22T20:16:35.346132] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T20:16:36.047192] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-22T20:16:36.117678] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-22T20:16:36.917747] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-22T20:16:37.597868] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-22T20:16:37.717638] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-10-22T20:16:37.807905] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T20:16:38.427105] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-22T20:16:38.517626] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-10-22T20:16:39.144035] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-22T20:16:39.317665] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-22T20:16:40.117603] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-22T20:16:40.917721] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-22T20:16:41.088939] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T20:16:41.490421] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-22T20:16:41.717625] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-10-22T20:16:41.790316] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T20:16:41.798961] [INFO ] [REMOTE ] NRGV: Full fetch complete (62535 records). [2025-10-22T20:16:41.799061] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-22T20:16:42.184833] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-10-22T20:16:42.184943] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-10-22T20:16:42.185899] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-10-22T20:16:42.185961] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-10-22T20:16:42.187212] [DEBUG] [LOCAL ] NRGV: Trimmed 62535 records to 43940 (keeping 200 days of data) [2025-10-22T20:16:42.381756] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-22T20:16:42.435593] [DEBUG] [LOCAL ] NRGV: Primary data saved (43940 records). [2025-10-22T20:16:42.435740] [INFO ] [MAIN ] NRGV: Full history saved. [2025-10-22T20:16:42.435825] [INFO ] [MAIN ] Update Progress: 1529/2367 symbols completed. NRGV took 47.4s. Estimated remaining: 1h 47m 46s. Rate: 7.8 symbols/min [2025-10-22T20:16:42.522769] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-10-22T20:16:42.607409] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:16:42.650112] [DEBUG] [LOCAL ] NSC: Loaded 48688 existing records from primary storage. [2025-10-22T20:16:42.650404] [INFO ] [MAIN ] NSC: Loaded 48688 existing records. [2025-10-22T20:16:42.824259] [WARN ] [MAIN ] NSC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:16:42.824525] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-22T20:16:42.824607] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-22T20:16:42.824908] [DEBUG] [LOCAL ] NSC: Deleted primary data file. [2025-10-22T20:16:42.824984] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-22T20:16:43.173577] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:16:43.210751] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-22T20:16:43.317636] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-22T20:16:44.117698] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-22T20:16:44.917629] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-22T20:16:45.031037] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-22T20:16:45.139738] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T20:16:45.717689] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-22T20:16:46.406093] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-22T20:16:46.517714] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-10-22T20:16:46.633848] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T20:16:47.230139] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-22T20:16:47.317662] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-22T20:16:48.087043] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-22T20:16:48.088414] [INFO ] [REMOTE ] NRT: Full fetch complete (7677 records). [2025-10-22T20:16:48.088487] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-22T20:16:48.122765] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-22T20:16:48.442478] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-10-22T20:16:48.442553] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-10-22T20:16:48.442784] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-10-22T20:16:48.442843] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-10-22T20:16:48.443233] [DEBUG] [LOCAL ] NRT: Trimmed 7677 records to 4872 (keeping 200 days of data) [2025-10-22T20:16:48.470539] [DEBUG] [LOCAL ] NRT: Primary data saved (4872 records). [2025-10-22T20:16:48.470668] [INFO ] [MAIN ] NRT: Full history saved. [2025-10-22T20:16:48.470759] [INFO ] [MAIN ] Update Progress: 1530/2367 symbols completed. NRT took 28.7s. Estimated remaining: 1h 47m 37s. Rate: 7.8 symbols/min [2025-10-22T20:16:48.636432] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:16:48.669124] [DEBUG] [LOCAL ] NSP: Loaded 35740 existing records from primary storage. [2025-10-22T20:16:48.669418] [INFO ] [MAIN ] NSP: Loaded 35740 existing records. [2025-10-22T20:16:48.848523] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:16:48.848862] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-22T20:16:48.848921] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-22T20:16:48.849122] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-10-22T20:16:48.849176] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-22T20:16:48.925947] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-22T20:16:49.201972] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:16:49.717627] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-10. [2025-10-22T20:16:49.941137] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-22T20:16:50.442165] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-22T20:16:50.443358] [INFO ] [REMOTE ] NRUC: Full fetch complete (5012 records). [2025-10-22T20:16:50.443426] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-10-22T20:16:50.518294] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-22T20:16:50.818572] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-10-22T20:16:50.818716] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-10-22T20:16:50.818906] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-10-22T20:16:50.819038] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-10-22T20:16:50.819569] [DEBUG] [LOCAL ] NRUC: Trimmed 5012 records to 3098 (keeping 200 days of data) [2025-10-22T20:16:50.863124] [DEBUG] [LOCAL ] NRUC: Primary data saved (3098 records). [2025-10-22T20:16:50.863244] [INFO ] [MAIN ] NRUC: Full history saved. [2025-10-22T20:16:50.863329] [INFO ] [MAIN ] Update Progress: 1531/2367 symbols completed. NRUC took 23.9s. Estimated remaining: 1h 47m 27s. Rate: 7.8 symbols/min [2025-10-22T20:16:50.896702] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-22T20:16:51.047957] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:16:51.068385] [DEBUG] [LOCAL ] NTB: Loaded 20289 existing records from primary storage. [2025-10-22T20:16:51.068662] [INFO ] [MAIN ] NTB: Loaded 20289 existing records. [2025-10-22T20:16:51.244031] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:16:51.244240] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-22T20:16:51.244299] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-22T20:16:51.244489] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-10-22T20:16:51.244544] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-22T20:16:51.322751] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-22T20:16:51.598524] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:16:52.117709] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-22T20:16:52.302841] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T20:16:52.917629] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-22T20:16:53.003886] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T20:16:53.717677] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-22T20:16:54.140772] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-22T20:16:54.517703] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-22T20:16:54.911508] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T20:16:55.036152] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-22T20:16:55.317711] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-22T20:16:56.117701] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-22T20:16:56.593553] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-22T20:16:56.669413] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-22T20:16:56.917677] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-22T20:16:57.717733] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-22T20:16:57.868751] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T20:16:58.518100] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-22T20:16:58.518291] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-22T20:16:58.527107] [INFO ] [REMOTE ] NSA: Full fetch complete (62780 records). [2025-10-22T20:16:58.527239] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-22T20:16:58.911663] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-10-22T20:16:58.911820] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-10-22T20:16:58.912793] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-10-22T20:16:58.913390] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-10-22T20:16:58.914706] [DEBUG] [LOCAL ] NSA: Trimmed 62780 records to 45071 (keeping 200 days of data) [2025-10-22T20:16:59.037274] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T20:16:59.208081] [DEBUG] [LOCAL ] NSA: Primary data saved (45071 records). [2025-10-22T20:16:59.208207] [INFO ] [MAIN ] NSA: Full history saved. [2025-10-22T20:16:59.208297] [INFO ] [MAIN ] Update Progress: 1532/2367 symbols completed. NSA took 31.0s. Estimated remaining: 1h 47m 19s. Rate: 7.8 symbols/min [2025-10-22T20:16:59.322834] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-22T20:16:59.378983] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:16:59.379100] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-22T20:16:59.379137] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-22T20:16:59.379243] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-22T20:16:59.379284] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-22T20:16:59.379326] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-22T20:16:59.379358] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-22T20:16:59.736211] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:17:00.117666] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-22T20:17:00.778378] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-22T20:17:00.917703] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-22T20:17:01.046176] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-22T20:17:01.717665] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-22T20:17:01.811582] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-22T20:17:02.397622] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-22T20:17:02.517689] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-22T20:17:02.679543] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T20:17:03.317710] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-22T20:17:04.117632] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-22T20:17:04.254974] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T20:17:04.789686] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-22T20:17:04.917668] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-22T20:17:05.430825] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-22T20:17:05.717668] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-22T20:17:06.335523] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-22T20:17:06.336262] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T20:17:06.517716] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-10-22T20:17:07.317706] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-22T20:17:07.326190] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-22T20:17:08.117702] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-22T20:17:08.917743] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-22T20:17:09.417419] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-22T20:17:09.668977] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T20:17:09.717618] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-22T20:17:10.220941] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T20:17:10.517704] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-22T20:17:11.317705] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-10-22T20:17:11.432321] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T20:17:11.957957] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-22T20:17:12.117631] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-10-22T20:17:12.553211] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T20:17:12.866963] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-22T20:17:12.917665] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-10-22T20:17:13.702189] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-22T20:17:13.717607] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-10-22T20:17:14.430398] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-22T20:17:14.517639] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-10. [2025-10-22T20:17:15.317704] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-22T20:17:15.345751] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-22T20:17:15.346397] [INFO ] [REMOTE ] NTEST: Full fetch complete (1960 records). [2025-10-22T20:17:15.346463] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-10-22T20:17:15.523139] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-10-22T20:17:15.523333] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:17:15.523401] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:17:15.523449] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-22T20:17:15.523506] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-22T20:17:15.523541] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-22T20:17:15.523579] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-22T20:17:15.523634] [INFO ] [MAIN ] Update Progress: 1533/2367 symbols completed. NTEST took 16.3s. Estimated remaining: 1h 47m 16s. Rate: 7.8 symbols/min [2025-10-22T20:17:15.689964] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:17:15.738179] [DEBUG] [LOCAL ] NTR: Loaded 52637 existing records from primary storage. [2025-10-22T20:17:15.738504] [INFO ] [MAIN ] NTR: Loaded 52637 existing records. [2025-10-22T20:17:15.912403] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:17:15.912636] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-22T20:17:15.912718] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-22T20:17:15.912967] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-10-22T20:17:15.913022] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-22T20:17:16.122852] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-22T20:17:16.267235] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:17:16.917634] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-22T20:17:17.310560] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-22T20:17:17.318349] [INFO ] [REMOTE ] NSC: Full fetch complete (70915 records). [2025-10-22T20:17:17.318471] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-22T20:17:17.701456] [DEBUG] [VALIDATOR ] NSC: All expected trading days are present. [2025-10-22T20:17:17.701715] [DEBUG] [VALIDATOR ] NSC: Primary data validation passed. [2025-10-22T20:17:17.702668] [INFO ] [MAIN ] NSC: Fetched primary data is valid. [2025-10-22T20:17:17.702743] [DEBUG] [LOCAL ] NSC: Saving primary data. [2025-10-22T20:17:17.704156] [DEBUG] [LOCAL ] NSC: Trimmed 70915 records to 48653 (keeping 200 days of data) [2025-10-22T20:17:17.757898] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-22T20:17:17.830999] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T20:17:18.017829] [DEBUG] [LOCAL ] NSC: Primary data saved (48653 records). [2025-10-22T20:17:18.017953] [INFO ] [MAIN ] NSC: Full history saved. [2025-10-22T20:17:18.018029] [INFO ] [MAIN ] Update Progress: 1534/2367 symbols completed. NSC took 35.6s. Estimated remaining: 1h 47m 6s. Rate: 7.8 symbols/min [2025-10-22T20:17:18.182292] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:17:18.222062] [DEBUG] [LOCAL ] NTST: Loaded 44086 existing records from primary storage. [2025-10-22T20:17:18.222337] [INFO ] [MAIN ] NTST: Loaded 44086 existing records. [2025-10-22T20:17:18.394821] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:17:18.394988] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-22T20:17:18.395033] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-22T20:17:18.395227] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-10-22T20:17:18.395282] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-22T20:17:18.534227] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-22T20:17:18.747973] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:17:18.858303] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T20:17:19.317631] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-22T20:17:19.587005] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T20:17:19.640447] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T20:17:20.117779] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-22T20:17:20.917704] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-22T20:17:21.209152] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T20:17:21.695431] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T20:17:21.722800] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-22T20:17:21.735959] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T20:17:22.517671] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-22T20:17:23.317686] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-22T20:17:23.748785] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-22T20:17:23.798053] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-22T20:17:24.117695] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-22T20:17:24.917729] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-22T20:17:24.958834] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T20:17:24.968587] [INFO ] [REMOTE ] NSP: Full fetch complete (50285 records). [2025-10-22T20:17:24.968770] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-22T20:17:25.371103] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-10-22T20:17:25.371224] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-10-22T20:17:25.372708] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-10-22T20:17:25.373314] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-10-22T20:17:25.373184] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-22T20:17:25.379522] [DEBUG] [LOCAL ] NSP: Trimmed 50285 records to 35753 (keeping 200 days of data) [2025-10-22T20:17:25.592316] [DEBUG] [LOCAL ] NSP: Primary data saved (35753 records). [2025-10-22T20:17:25.592473] [INFO ] [MAIN ] NSP: Full history saved. [2025-10-22T20:17:25.592554] [INFO ] [MAIN ] Update Progress: 1535/2367 symbols completed. NSP took 37.1s. Estimated remaining: 1h 46m 58s. Rate: 7.8 symbols/min [2025-10-22T20:17:25.722861] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-22T20:17:25.772232] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:17:25.822810] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-10-22T20:17:25.823162] [INFO ] [MAIN ] NU: Loaded 53746 existing records. [2025-10-22T20:17:26.007487] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:17:26.007768] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-22T20:17:26.007831] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-22T20:17:26.008055] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-10-22T20:17:26.008111] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-22T20:17:26.405599] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:17:26.517639] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-22T20:17:26.728445] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T20:17:26.923903] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T20:17:27.317714] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-22T20:17:28.117711] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-22T20:17:28.196086] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T20:17:28.917611] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-22T20:17:29.195359] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T20:17:29.199086] [INFO ] [REMOTE ] NTB: Full fetch complete (30772 records). [2025-10-22T20:17:29.199157] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-22T20:17:29.573917] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-10-22T20:17:29.574040] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-10-22T20:17:29.574687] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-10-22T20:17:29.574748] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-10-22T20:17:29.575491] [DEBUG] [LOCAL ] NTB: Trimmed 30772 records to 20182 (keeping 200 days of data) [2025-10-22T20:17:29.693804] [DEBUG] [LOCAL ] NTB: Primary data saved (20182 records). [2025-10-22T20:17:29.693915] [INFO ] [MAIN ] NTB: Full history saved. [2025-10-22T20:17:29.693985] [INFO ] [MAIN ] Update Progress: 1536/2367 symbols completed. NTB took 38.8s. Estimated remaining: 1h 46m 48s. Rate: 7.8 symbols/min [2025-10-22T20:17:29.724500] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-22T20:17:29.892989] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:17:29.895687] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-22T20:17:29.896229] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-22T20:17:29.897265] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-22T20:17:29.901078] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-22T20:17:29.907373] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-22T20:17:29.907941] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-22T20:17:29.907991] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-22T20:17:30.261380] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:17:30.410376] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T20:17:30.517608] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-22T20:17:31.317629] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-22T20:17:31.608024] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T20:17:32.117624] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-22T20:17:32.602970] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-22T20:17:32.917706] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-22T20:17:32.975932] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T20:17:33.673201] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T20:17:33.717607] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-22T20:17:34.517635] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-22T20:17:35.249871] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-22T20:17:35.317687] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-22T20:17:35.746268] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-22T20:17:36.117725] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-22T20:17:36.917628] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-22T20:17:37.115556] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-22T20:17:37.468386] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-22T20:17:37.717624] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-22T20:17:38.222070] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-22T20:17:38.335841] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T20:17:38.517668] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-22T20:17:39.317677] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-22T20:17:40.117722] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-22T20:17:40.181484] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T20:17:40.253237] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-22T20:17:40.917671] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-22T20:17:41.278550] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-22T20:17:41.717637] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-22T20:17:42.528498] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-22T20:17:42.531420] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-22T20:17:43.325548] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-22T20:17:43.345871] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-22T20:17:43.561247] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T20:17:43.569903] [INFO ] [REMOTE ] NTR: Full fetch complete (76510 records). [2025-10-22T20:17:43.570032] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-22T20:17:43.954575] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-10-22T20:17:43.954673] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-10-22T20:17:43.955710] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-10-22T20:17:43.955771] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-10-22T20:17:43.957190] [DEBUG] [LOCAL ] NTR: Trimmed 76510 records to 52631 (keeping 200 days of data) [2025-10-22T20:17:44.135222] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-22T20:17:44.214629] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T20:17:44.312227] [DEBUG] [LOCAL ] NTR: Primary data saved (52631 records). [2025-10-22T20:17:44.312369] [INFO ] [MAIN ] NTR: Full history saved. [2025-10-22T20:17:44.313131] [INFO ] [MAIN ] Update Progress: 1537/2367 symbols completed. NTR took 28.8s. Estimated remaining: 1h 46m 44s. Rate: 7.8 symbols/min [2025-10-22T20:17:44.480357] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:17:44.517104] [DEBUG] [LOCAL ] NUS: Loaded 36101 existing records from primary storage. [2025-10-22T20:17:44.517371] [INFO ] [MAIN ] NUS: Loaded 36101 existing records. [2025-10-22T20:17:44.693840] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:17:44.693988] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-22T20:17:44.694033] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-22T20:17:44.694227] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-10-22T20:17:44.694281] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-22T20:17:44.933729] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-22T20:17:45.051049] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:17:45.706104] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-22T20:17:45.717616] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-22T20:17:46.517724] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-22T20:17:46.602823] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-22T20:17:46.824223] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T20:17:47.004469] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-22T20:17:47.317685] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-22T20:17:48.117715] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-22T20:17:48.643931] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T20:17:48.917730] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-22T20:17:49.722963] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-22T20:17:49.737383] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-22T20:17:49.902537] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T20:17:50.517728] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-22T20:17:51.107344] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-22T20:17:51.140955] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T20:17:51.317639] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-22T20:17:52.117684] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-22T20:17:52.927393] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-22T20:17:52.931012] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-22T20:17:53.411253] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-22T20:17:53.564520] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-22T20:17:53.717637] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-22T20:17:54.517686] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-22T20:17:54.820134] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T20:17:55.317707] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-22T20:17:55.918377] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-22T20:17:56.117713] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-22T20:17:56.166271] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-22T20:17:56.917741] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-22T20:17:57.019096] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T20:17:57.026757] [INFO ] [REMOTE ] NTST: Full fetch complete (61881 records). [2025-10-22T20:17:57.026914] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-22T20:17:57.421538] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-10-22T20:17:57.421626] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-10-22T20:17:57.422601] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-10-22T20:17:57.422678] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-10-22T20:17:57.423994] [DEBUG] [LOCAL ] NTST: Trimmed 61881 records to 44049 (keeping 200 days of data) [2025-10-22T20:17:57.687192] [DEBUG] [LOCAL ] NTST: Primary data saved (44049 records). [2025-10-22T20:17:57.687356] [INFO ] [MAIN ] NTST: Full history saved. [2025-10-22T20:17:57.687446] [INFO ] [MAIN ] Update Progress: 1538/2367 symbols completed. NTST took 39.7s. Estimated remaining: 1h 46m 40s. Rate: 7.8 symbols/min [2025-10-22T20:17:57.722805] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-22T20:17:57.865439] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:17:57.887431] [DEBUG] [LOCAL ] NUV: Loaded 23448 existing records from primary storage. [2025-10-22T20:17:57.887711] [INFO ] [MAIN ] NUV: Loaded 23448 existing records. [2025-10-22T20:17:58.069902] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:17:58.070265] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-22T20:17:58.070432] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-22T20:17:58.070626] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-10-22T20:17:58.070728] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-22T20:17:58.448955] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:17:58.481614] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-22T20:17:58.493147] [INFO ] [REMOTE ] NUE: Full fetch complete (74793 records). [2025-10-22T20:17:58.493301] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-22T20:17:58.517783] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-22T20:17:58.669328] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T20:17:58.730332] [WARN ] [VALIDATOR ] NUE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T20:17:58.731068] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:17:58.731139] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:17:58.731213] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-22T20:17:58.731278] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-22T20:17:58.731314] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-22T20:17:58.731352] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-22T20:17:58.731409] [INFO ] [MAIN ] Update Progress: 1539/2367 symbols completed. NUE took 29.0s. Estimated remaining: 1h 46m 28s. Rate: 7.8 symbols/min [2025-10-22T20:17:58.894959] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:17:58.941189] [DEBUG] [LOCAL ] NUVB: Loaded 51709 existing records from primary storage. [2025-10-22T20:17:58.941486] [INFO ] [MAIN ] NUVB: Loaded 51709 existing records. [2025-10-22T20:17:59.112095] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:17:59.112297] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-22T20:17:59.112344] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-22T20:17:59.112554] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-10-22T20:17:59.112608] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-22T20:17:59.337099] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-22T20:17:59.501338] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:17:59.773198] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T20:18:00.118137] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-22T20:18:00.346771] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-22T20:18:00.917678] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-22T20:18:01.118992] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T20:18:01.717724] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-22T20:18:02.040421] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-22T20:18:02.517689] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-22T20:18:03.090085] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-22T20:18:03.139854] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T20:18:03.317670] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-22T20:18:04.117669] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-22T20:18:04.185681] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T20:18:04.917715] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-22T20:18:05.051310] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T20:18:05.717739] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-22T20:18:06.180635] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T20:18:06.269125] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-22T20:18:06.278017] [INFO ] [REMOTE ] NU: Full fetch complete (77925 records). [2025-10-22T20:18:06.278162] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-22T20:18:06.522935] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-22T20:18:06.673592] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-10-22T20:18:06.673695] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-10-22T20:18:06.674735] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-10-22T20:18:06.674797] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-10-22T20:18:06.676165] [DEBUG] [LOCAL ] NU: Trimmed 77925 records to 53746 (keeping 200 days of data) [2025-10-22T20:18:06.996377] [DEBUG] [LOCAL ] NU: Primary data saved (53746 records). [2025-10-22T20:18:06.996624] [INFO ] [MAIN ] NU: Full history saved. [2025-10-22T20:18:06.996766] [INFO ] [MAIN ] Update Progress: 1540/2367 symbols completed. NU took 41.4s. Estimated remaining: 1h 46m 21s. Rate: 7.8 symbols/min [2025-10-22T20:18:07.193743] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:18:07.196227] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T20:18:07.211217] [DEBUG] [LOCAL ] NUW: Loaded 6674 existing records from primary storage. [2025-10-22T20:18:07.211409] [INFO ] [MAIN ] NUW: Loaded 6674 existing records. [2025-10-22T20:18:07.322848] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-22T20:18:07.409952] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:18:07.410182] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-22T20:18:07.410229] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-22T20:18:07.410382] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-10-22T20:18:07.410421] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-22T20:18:07.800001] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:18:08.117630] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-22T20:18:08.441467] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T20:18:08.677520] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T20:18:08.917724] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-22T20:18:09.396237] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T20:18:09.654626] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-22T20:18:09.717682] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-22T20:18:10.517785] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-22T20:18:11.285273] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T20:18:11.291083] [INFO ] [REMOTE ] NUS: Full fetch complete (53268 records). [2025-10-22T20:18:11.291216] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-22T20:18:11.322821] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-22T20:18:11.697811] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-10-22T20:18:11.697974] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-10-22T20:18:11.699001] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-10-22T20:18:11.699110] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-10-22T20:18:11.700560] [DEBUG] [LOCAL ] NUS: Trimmed 53268 records to 36083 (keeping 200 days of data) [2025-10-22T20:18:11.808099] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T20:18:11.936270] [DEBUG] [LOCAL ] NUS: Primary data saved (36083 records). [2025-10-22T20:18:11.936414] [INFO ] [MAIN ] NUS: Full history saved. [2025-10-22T20:18:11.937001] [INFO ] [MAIN ] Update Progress: 1541/2367 symbols completed. NUS took 27.6s. Estimated remaining: 1h 46m 12s. Rate: 7.8 symbols/min [2025-10-22T20:18:12.117160] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:18:12.117686] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-22T20:18:12.148414] [DEBUG] [LOCAL ] NVG: Loaded 27482 existing records from primary storage. [2025-10-22T20:18:12.148729] [INFO ] [MAIN ] NVG: Loaded 27482 existing records. [2025-10-22T20:18:12.324592] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:18:12.324811] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-22T20:18:12.324857] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-22T20:18:12.325025] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-10-22T20:18:12.325062] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-22T20:18:12.677324] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:18:12.917675] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-22T20:18:12.992957] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-22T20:18:13.266974] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-22T20:18:13.717808] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-22T20:18:14.522765] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-10-22T20:18:14.536044] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T20:18:14.940036] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T20:18:15.317634] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-22T20:18:15.590889] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T20:18:16.117807] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-22T20:18:16.917778] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-22T20:18:17.230715] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T20:18:17.498877] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T20:18:17.717719] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-22T20:18:17.855451] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-22T20:18:18.517683] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-22T20:18:18.852468] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T20:18:19.317742] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-22T20:18:20.117706] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-10-22T20:18:20.661560] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-22T20:18:20.686712] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T20:18:20.917684] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-22T20:18:21.070130] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-22T20:18:21.717697] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-22T20:18:22.198613] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T20:18:22.203345] [INFO ] [REMOTE ] NUV: Full fetch complete (33832 records). [2025-10-22T20:18:22.203464] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-22T20:18:22.522782] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-22T20:18:22.593417] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-10-22T20:18:22.593507] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-10-22T20:18:22.594318] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-10-22T20:18:22.594382] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-10-22T20:18:22.595355] [DEBUG] [LOCAL ] NUV: Trimmed 33832 records to 23286 (keeping 200 days of data) [2025-10-22T20:18:22.731949] [DEBUG] [LOCAL ] NUV: Primary data saved (23286 records). [2025-10-22T20:18:22.732079] [INFO ] [MAIN ] NUV: Full history saved. [2025-10-22T20:18:22.732159] [INFO ] [MAIN ] Update Progress: 1542/2367 symbols completed. NUV took 25.0s. Estimated remaining: 1h 46m 6s. Rate: 7.8 symbols/min [2025-10-22T20:18:22.908475] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:18:22.939244] [DEBUG] [LOCAL ] NVGS: Loaded 30102 existing records from primary storage. [2025-10-22T20:18:22.939519] [INFO ] [MAIN ] NVGS: Loaded 30102 existing records. [2025-10-22T20:18:23.125880] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T20:18:23.148450] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:18:23.154989] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-22T20:18:23.155076] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-22T20:18:23.155265] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-10-22T20:18:23.155307] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-22T20:18:23.331134] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-10-22T20:18:23.522859] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:18:24.117629] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-22T20:18:24.342511] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T20:18:24.788979] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-22T20:18:24.917730] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-10-22T20:18:25.318968] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T20:18:25.717708] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-22T20:18:25.782698] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T20:18:26.517683] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-10-22T20:18:27.243595] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T20:18:27.317682] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-22T20:18:28.117685] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-22T20:18:28.718966] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-22T20:18:28.744341] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T20:18:28.917624] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-10-22T20:18:29.373367] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-22T20:18:29.717738] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-22T20:18:30.517734] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-10-22T20:18:31.022571] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-22T20:18:31.060593] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-22T20:18:31.080235] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T20:18:31.317623] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-10. [2025-10-22T20:18:32.117686] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-22T20:18:32.917731] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-10-22T20:18:33.223246] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T20:18:33.522760] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-22T20:18:33.531435] [INFO ] [REMOTE ] NUVB: Full fetch complete (73490 records). [2025-10-22T20:18:33.531544] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-10-22T20:18:33.717883] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-22T20:18:33.815727] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-22T20:18:33.942888] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-10-22T20:18:33.942965] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-10-22T20:18:33.944056] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-10-22T20:18:33.944116] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-10-22T20:18:33.945581] [DEBUG] [LOCAL ] NUVB: Trimmed 73490 records to 51712 (keeping 200 days of data) [2025-10-22T20:18:34.246824] [DEBUG] [LOCAL ] NUVB: Primary data saved (51712 records). [2025-10-22T20:18:34.246967] [INFO ] [MAIN ] NUVB: Full history saved. [2025-10-22T20:18:34.247049] [INFO ] [MAIN ] Update Progress: 1543/2367 symbols completed. NUVB took 35.5s. Estimated remaining: 1h 46m 0s. Rate: 7.8 symbols/min [2025-10-22T20:18:34.413150] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:18:34.460097] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-10-22T20:18:34.460421] [INFO ] [MAIN ] NVO: Loaded 53784 existing records. [2025-10-22T20:18:34.522963] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-10-22T20:18:34.640724] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:18:34.640950] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-22T20:18:34.641015] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-22T20:18:34.641231] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-10-22T20:18:34.641286] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-22T20:18:34.995603] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:18:35.288481] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T20:18:35.317616] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-22T20:18:35.352931] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T20:18:36.117738] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-22T20:18:36.891383] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T20:18:36.917631] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-22T20:18:37.717687] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-22T20:18:38.411283] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T20:18:38.517706] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-22T20:18:38.731080] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-22T20:18:39.242152] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T20:18:39.317697] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-22T20:18:39.988335] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-22T20:18:40.117704] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-10. [2025-10-22T20:18:40.797383] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T20:18:40.797599] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-22T20:18:40.807997] [INFO ] [REMOTE ] NUW: Full fetch complete (10697 records). [2025-10-22T20:18:40.808582] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-10-22T20:18:40.922786] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-22T20:18:41.169503] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-10-22T20:18:41.169577] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-10-22T20:18:41.169845] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-10-22T20:18:41.169906] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-10-22T20:18:41.170318] [DEBUG] [LOCAL ] NUW: Trimmed 10697 records to 6639 (keeping 200 days of data) [2025-10-22T20:18:41.209857] [DEBUG] [LOCAL ] NUW: Primary data saved (6639 records). [2025-10-22T20:18:41.209969] [INFO ] [MAIN ] NUW: Full history saved. [2025-10-22T20:18:41.210047] [INFO ] [MAIN ] Update Progress: 1544/2367 symbols completed. NUW took 34.2s. Estimated remaining: 1h 45m 52s. Rate: 7.8 symbols/min [2025-10-22T20:18:41.376823] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:18:41.396546] [DEBUG] [LOCAL ] NVR: Loaded 18543 existing records from primary storage. [2025-10-22T20:18:41.396923] [INFO ] [MAIN ] NVR: Loaded 18543 existing records. [2025-10-22T20:18:41.580263] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:18:41.580772] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-22T20:18:41.580831] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-22T20:18:41.581284] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-10-22T20:18:41.581341] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-22T20:18:41.725868] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-22T20:18:41.947881] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:18:42.517694] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-22T20:18:43.317549] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T20:18:43.317705] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-22T20:18:43.557475] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-10-22T20:18:43.844534] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T20:18:44.117711] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-22T20:18:44.770588] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T20:18:44.917668] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-22T20:18:45.419977] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-22T20:18:45.424516] [INFO ] [REMOTE ] NVG: Full fetch complete (39499 records). [2025-10-22T20:18:45.424624] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-22T20:18:45.722753] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-22T20:18:45.797471] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-10-22T20:18:45.797571] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-10-22T20:18:45.798371] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-10-22T20:18:45.798433] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-10-22T20:18:45.799274] [DEBUG] [LOCAL ] NVG: Trimmed 39499 records to 27394 (keeping 200 days of data) [2025-10-22T20:18:45.963608] [DEBUG] [LOCAL ] NVG: Primary data saved (27394 records). [2025-10-22T20:18:45.963752] [INFO ] [MAIN ] NVG: Full history saved. [2025-10-22T20:18:45.963858] [INFO ] [MAIN ] Update Progress: 1545/2367 symbols completed. NVG took 34.0s. Estimated remaining: 1h 45m 43s. Rate: 7.8 symbols/min [2025-10-22T20:18:46.128179] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:18:46.160950] [DEBUG] [LOCAL ] NVRI: Loaded 39040 existing records from primary storage. [2025-10-22T20:18:46.161219] [INFO ] [MAIN ] NVRI: Loaded 39040 existing records. [2025-10-22T20:18:46.333374] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:18:46.333587] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-22T20:18:46.333633] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-22T20:18:46.333936] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-10-22T20:18:46.333991] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-22T20:18:46.530997] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-22T20:18:46.686848] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:18:46.985778] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-22T20:18:47.317693] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-22T20:18:47.693887] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-10-22T20:18:47.797464] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-22T20:18:48.117694] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-22T20:18:48.346150] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-22T20:18:48.917721] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-22T20:18:49.644987] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T20:18:49.717667] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-22T20:18:50.334986] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T20:18:50.517691] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-22T20:18:51.317695] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-22T20:18:51.421898] [DEBUG] [REMOTE ] NVR: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-22T20:18:51.422198] [WARN ] [REMOTE ] NVR: No data returned for month 2025-05 [2025-10-22T20:18:51.422289] [FATAL] [REMOTE ] NVR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T20:18:51.422363] [FATAL] [MAIN ] NVR: Failed to fetch primary data. [2025-10-22T20:18:51.422429] [WARN ] [MAIN ] NVR: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T20:18:51.422497] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-22T20:18:51.422562] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-10-22T20:18:51.422598] [INFO ] [LOCAL ] NVR: Starting deletion of derivative data. [2025-10-22T20:18:51.422899] [DEBUG] [LOCAL ] NVR: Deleted derivative data file. [2025-10-22T20:18:51.422983] [INFO ] [MAIN ] Update Progress: 1546/2367 symbols completed. NVR took 10.2s. Estimated remaining: 1h 45m 34s. Rate: 7.8 symbols/min [2025-10-22T20:18:51.593387] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:18:51.642167] [DEBUG] [LOCAL ] NVS: Loaded 51339 existing records from primary storage. [2025-10-22T20:18:51.642465] [INFO ] [MAIN ] NVS: Loaded 51339 existing records. [2025-10-22T20:18:51.852932] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:18:51.853223] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-22T20:18:51.853415] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-22T20:18:51.853622] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-10-22T20:18:51.853703] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-22T20:18:52.106684] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T20:18:52.123194] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-22T20:18:52.254891] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:18:52.375927] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-22T20:18:52.917722] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-22T20:18:53.131949] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-22T20:18:53.136277] [INFO ] [REMOTE ] NVGS: Full fetch complete (41877 records). [2025-10-22T20:18:53.136362] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-22T20:18:53.500623] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-10-22T20:18:53.500726] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-10-22T20:18:53.501469] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-10-22T20:18:53.501508] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-10-22T20:18:53.502357] [DEBUG] [LOCAL ] NVGS: Trimmed 41877 records to 29948 (keeping 200 days of data) [2025-10-22T20:18:53.682811] [DEBUG] [LOCAL ] NVGS: Primary data saved (29948 records). [2025-10-22T20:18:53.682931] [INFO ] [MAIN ] NVGS: Full history saved. [2025-10-22T20:18:53.683018] [INFO ] [MAIN ] Update Progress: 1547/2367 symbols completed. NVGS took 31.0s. Estimated remaining: 1h 45m 23s. Rate: 7.8 symbols/min [2025-10-22T20:18:53.725352] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-22T20:18:53.850802] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:18:53.897572] [DEBUG] [LOCAL ] NVST: Loaded 51463 existing records from primary storage. [2025-10-22T20:18:53.897907] [INFO ] [MAIN ] NVST: Loaded 51463 existing records. [2025-10-22T20:18:54.071721] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:18:54.071909] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-22T20:18:54.071990] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-22T20:18:54.072174] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-10-22T20:18:54.072213] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-22T20:18:54.425169] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:18:54.517704] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-22T20:18:54.889714] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-22T20:18:55.317674] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-22T20:18:55.379570] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T20:18:56.117673] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-22T20:18:56.202123] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T20:18:56.917709] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-22T20:18:57.317605] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-22T20:18:57.691411] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T20:18:57.717667] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-22T20:18:58.517702] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-22T20:18:58.614247] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T20:18:59.321353] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-22T20:18:59.324367] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T20:19:00.117747] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-22T20:19:00.917732] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-22T20:19:02.085797] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-22T20:19:02.094204] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-22T20:19:02.224199] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.90 seconds). [2025-10-22T20:19:02.371816] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (3.85 seconds). [2025-10-22T20:19:02.517744] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-22T20:19:03.317732] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-22T20:19:03.545974] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-10-22T20:19:03.839259] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T20:19:04.117722] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-22T20:19:04.624706] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-22T20:19:04.917679] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-22T20:19:05.717634] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-22T20:19:06.016983] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-10-22T20:19:06.059571] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-22T20:19:06.517673] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-22T20:19:06.710553] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T20:19:07.317736] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-22T20:19:07.563716] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-22T20:19:08.044685] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T20:19:08.117779] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-22T20:19:08.917728] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-22T20:19:09.717706] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-22T20:19:10.069316] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T20:19:10.240400] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-22T20:19:10.517697] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-22T20:19:10.574954] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T20:19:11.317743] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-22T20:19:11.716608] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-22T20:19:12.117718] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-22T20:19:12.917795] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-22T20:19:13.321118] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-22T20:19:13.419848] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-22T20:19:13.427124] [INFO ] [REMOTE ] NVRI: Full fetch complete (56072 records). [2025-10-22T20:19:13.427282] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-22T20:19:13.724579] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-22T20:19:13.852802] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (3.34 seconds). [2025-10-22T20:19:13.853027] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-10-22T20:19:13.863771] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-10-22T20:19:13.864829] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-10-22T20:19:13.865146] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-10-22T20:19:13.866693] [DEBUG] [LOCAL ] NVRI: Trimmed 56072 records to 38962 (keeping 200 days of data) [2025-10-22T20:19:14.079713] [DEBUG] [LOCAL ] NVRI: Primary data saved (38962 records). [2025-10-22T20:19:14.079836] [INFO ] [MAIN ] NVRI: Full history saved. [2025-10-22T20:19:14.080432] [INFO ] [MAIN ] Update Progress: 1548/2367 symbols completed. NVRI took 28.1s. Estimated remaining: 1h 45m 22s. Rate: 7.8 symbols/min [2025-10-22T20:19:14.251334] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:19:14.299435] [DEBUG] [LOCAL ] NVT: Loaded 51413 existing records from primary storage. [2025-10-22T20:19:14.299763] [INFO ] [MAIN ] NVT: Loaded 51413 existing records. [2025-10-22T20:19:14.473752] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:19:14.473976] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-22T20:19:14.474022] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-22T20:19:14.474354] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-10-22T20:19:14.474410] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-22T20:19:14.527745] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-22T20:19:14.833464] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:19:14.862368] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T20:19:15.317676] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-22T20:19:15.994730] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-22T20:19:16.117675] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-22T20:19:16.917722] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-22T20:19:17.302444] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-10-22T20:19:17.397710] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-22T20:19:17.717629] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-22T20:19:18.256823] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-22T20:19:18.486367] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T20:19:18.517683] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-22T20:19:19.317714] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-22T20:19:20.117733] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-22T20:19:20.333034] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-22T20:19:20.426733] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-10 (2.71 seconds). [2025-10-22T20:19:20.435840] [INFO ] [REMOTE ] NVO: Full fetch complete (77964 records). [2025-10-22T20:19:20.436003] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-22T20:19:20.818303] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-10-22T20:19:20.818379] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-10-22T20:19:20.819394] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-10-22T20:19:20.819455] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-10-22T20:19:20.820895] [DEBUG] [LOCAL ] NVO: Trimmed 77964 records to 53784 (keeping 200 days of data) [2025-10-22T20:19:20.917734] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-22T20:19:21.147250] [DEBUG] [LOCAL ] NVO: Primary data saved (53784 records). [2025-10-22T20:19:21.147388] [INFO ] [MAIN ] NVO: Full history saved. [2025-10-22T20:19:21.147465] [INFO ] [MAIN ] Update Progress: 1549/2367 symbols completed. NVO took 46.9s. Estimated remaining: 1h 45m 14s. Rate: 7.8 symbols/min [2025-10-22T20:19:21.317729] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:19:21.342031] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-22T20:19:21.350938] [INFO ] [REMOTE ] NVS: Full fetch complete (74973 records). [2025-10-22T20:19:21.351120] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-22T20:19:21.661245] [DEBUG] [LOCAL ] NWG: Loaded 51412 existing records from primary storage. [2025-10-22T20:19:21.674278] [INFO ] [MAIN ] NWG: Loaded 51412 existing records. [2025-10-22T20:19:21.992283] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-10-22T20:19:22.022408] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-10-22T20:19:22.022220] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:19:22.023781] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-10-22T20:19:22.024042] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-22T20:19:22.024260] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-22T20:19:22.024332] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-10-22T20:19:22.024776] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-10-22T20:19:22.024958] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-22T20:19:22.130781] [DEBUG] [LOCAL ] NVS: Trimmed 74973 records to 51301 (keeping 200 days of data) [2025-10-22T20:19:22.298619] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-22T20:19:22.461988] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-22T20:19:22.693792] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:19:22.703125] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-22T20:19:22.806052] [DEBUG] [LOCAL ] NVS: Primary data saved (51301 records). [2025-10-22T20:19:22.806197] [INFO ] [MAIN ] NVS: Full history saved. [2025-10-22T20:19:22.806282] [INFO ] [MAIN ] Update Progress: 1550/2367 symbols completed. NVS took 31.4s. Estimated remaining: 1h 45m 3s. Rate: 7.8 symbols/min [2025-10-22T20:19:22.976116] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:19:23.001632] [DEBUG] [LOCAL ] NWN: Loaded 26539 existing records from primary storage. [2025-10-22T20:19:23.001910] [INFO ] [MAIN ] NWN: Loaded 26539 existing records. [2025-10-22T20:19:23.184854] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:19:23.185225] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-22T20:19:23.185287] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-22T20:19:23.185488] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-10-22T20:19:23.185543] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-22T20:19:23.336317] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-22T20:19:23.368456] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-22T20:19:23.620491] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:19:24.117735] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-22T20:19:24.405637] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T20:19:24.415494] [INFO ] [REMOTE ] NVST: Full fetch complete (74398 records). [2025-10-22T20:19:24.415627] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-22T20:19:24.782200] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T20:19:24.836832] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-10-22T20:19:24.836903] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-10-22T20:19:24.837897] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-10-22T20:19:24.837959] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-10-22T20:19:24.839259] [DEBUG] [LOCAL ] NVST: Trimmed 74398 records to 51406 (keeping 200 days of data) [2025-10-22T20:19:24.923703] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-22T20:19:25.174261] [DEBUG] [LOCAL ] NVST: Primary data saved (51406 records). [2025-10-22T20:19:25.175854] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T20:19:25.175955] [INFO ] [MAIN ] NVST: Full history saved. [2025-10-22T20:19:25.186940] [INFO ] [MAIN ] Update Progress: 1551/2367 symbols completed. NVST took 31.5s. Estimated remaining: 1h 44m 53s. Rate: 7.8 symbols/min [2025-10-22T20:19:25.356228] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:19:25.386626] [DEBUG] [LOCAL ] NX: Loaded 33386 existing records from primary storage. [2025-10-22T20:19:25.386937] [INFO ] [MAIN ] NX: Loaded 33386 existing records. [2025-10-22T20:19:25.568547] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:19:25.568861] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-22T20:19:25.569037] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-22T20:19:25.575567] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-10-22T20:19:25.583085] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-22T20:19:25.667692] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T20:19:25.722765] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-22T20:19:25.949441] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:19:26.517679] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-22T20:19:26.734198] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T20:19:27.317684] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-22T20:19:27.777056] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-22T20:19:27.809949] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-22T20:19:28.117686] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-22T20:19:28.917702] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-22T20:19:29.162153] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T20:19:29.717731] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-22T20:19:29.760483] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T20:19:30.473273] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T20:19:30.517668] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-22T20:19:31.317722] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-22T20:19:31.836756] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-22T20:19:32.117636] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-22T20:19:32.557798] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-22T20:19:32.917686] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-22T20:19:32.934847] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T20:19:33.717638] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-22T20:19:33.888607] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T20:19:34.517670] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-10-22T20:19:34.848045] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-22T20:19:35.153993] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T20:19:35.317723] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-22T20:19:36.117691] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-22T20:19:36.363682] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T20:19:36.917634] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-22T20:19:37.249203] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T20:19:37.717721] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-22T20:19:37.780130] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T20:19:38.489314] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T20:19:38.517675] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-22T20:19:39.284989] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T20:19:39.293598] [INFO ] [REMOTE ] NVT: Full fetch complete (74905 records). [2025-10-22T20:19:39.293788] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-22T20:19:39.326013] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-10-22T20:19:39.711055] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-10-22T20:19:39.711214] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-10-22T20:19:39.712394] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-10-22T20:19:39.712458] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-10-22T20:19:39.714018] [DEBUG] [LOCAL ] NVT: Trimmed 74905 records to 51415 (keeping 200 days of data) [2025-10-22T20:19:40.030494] [DEBUG] [LOCAL ] NVT: Primary data saved (51415 records). [2025-10-22T20:19:40.030692] [INFO ] [MAIN ] NVT: Full history saved. [2025-10-22T20:19:40.031593] [INFO ] [MAIN ] Update Progress: 1552/2367 symbols completed. NVT took 26.0s. Estimated remaining: 1h 44m 49s. Rate: 7.8 symbols/min [2025-10-22T20:19:40.131828] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-22T20:19:40.159939] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T20:19:40.241254] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:19:40.248886] [DEBUG] [LOCAL ] NXC: Loaded 4031 existing records from primary storage. [2025-10-22T20:19:40.249120] [INFO ] [MAIN ] NXC: Loaded 4031 existing records. [2025-10-22T20:19:40.429173] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:19:40.429384] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-22T20:19:40.429434] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-22T20:19:40.429568] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-10-22T20:19:40.429606] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-22T20:19:40.793588] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:19:40.917713] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-22T20:19:41.094791] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-22T20:19:41.432363] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-22T20:19:41.539705] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-22T20:19:41.717687] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-22T20:19:42.517632] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-10-22T20:19:43.086726] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-22T20:19:43.317722] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-22T20:19:43.990861] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-22T20:19:44.117619] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-22T20:19:44.466368] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-22T20:19:44.843497] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-22T20:19:44.917634] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-22T20:19:45.706192] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T20:19:45.717707] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-22T20:19:46.323964] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-22T20:19:46.517665] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-22T20:19:47.317774] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-10-22T20:19:48.015009] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T20:19:48.117683] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-22T20:19:48.910885] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T20:19:48.924200] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-22T20:19:49.474800] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T20:19:49.683430] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-22T20:19:49.717611] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-22T20:19:50.449746] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-22T20:19:50.517616] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-22T20:19:51.139300] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-22T20:19:51.317670] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-22T20:19:52.117623] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-10. [2025-10-22T20:19:52.866968] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T20:19:52.917618] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-22T20:19:53.633217] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T20:19:53.641413] [INFO ] [REMOTE ] NWG: Full fetch complete (74054 records). [2025-10-22T20:19:53.641536] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-10-22T20:19:53.722742] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-22T20:19:54.024947] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-10-22T20:19:54.025070] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-10-22T20:19:54.026113] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-10-22T20:19:54.026256] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-10-22T20:19:54.027616] [DEBUG] [LOCAL ] NWG: Trimmed 74054 records to 51400 (keeping 200 days of data) [2025-10-22T20:19:54.257605] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T20:19:54.354770] [DEBUG] [LOCAL ] NWG: Primary data saved (51400 records). [2025-10-22T20:19:54.354870] [INFO ] [MAIN ] NWG: Full history saved. [2025-10-22T20:19:54.354944] [INFO ] [MAIN ] Update Progress: 1553/2367 symbols completed. NWG took 33.2s. Estimated remaining: 1h 44m 44s. Rate: 7.8 symbols/min [2025-10-22T20:19:54.523901] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-22T20:19:54.523839] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:19:54.524853] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-22T20:19:54.524906] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-22T20:19:54.525036] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-22T20:19:54.525102] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-22T20:19:54.525184] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-22T20:19:54.525243] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-22T20:19:54.642347] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T20:19:54.889698] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:19:55.317694] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-22T20:19:55.921825] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T20:19:56.117697] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-22T20:19:56.780176] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-22T20:19:56.917669] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-22T20:19:57.380509] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T20:19:57.384467] [INFO ] [REMOTE ] NWN: Full fetch complete (37382 records). [2025-10-22T20:19:57.384548] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-22T20:19:57.737773] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-22T20:19:57.752604] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-10-22T20:19:57.752726] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-10-22T20:19:57.753483] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-10-22T20:19:57.753671] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-10-22T20:19:57.754515] [DEBUG] [LOCAL ] NWN: Trimmed 37382 records to 26434 (keeping 200 days of data) [2025-10-22T20:19:57.907254] [DEBUG] [LOCAL ] NWN: Primary data saved (26434 records). [2025-10-22T20:19:57.907379] [INFO ] [MAIN ] NWN: Full history saved. [2025-10-22T20:19:57.907455] [INFO ] [MAIN ] Update Progress: 1554/2367 symbols completed. NWN took 35.1s. Estimated remaining: 1h 44m 34s. Rate: 7.8 symbols/min [2025-10-22T20:19:58.074980] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:19:58.089101] [DEBUG] [LOCAL ] NXDT: Loaded 14863 existing records from primary storage. [2025-10-22T20:19:58.089349] [INFO ] [MAIN ] NXDT: Loaded 14863 existing records. [2025-10-22T20:19:58.268146] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:19:58.268420] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-22T20:19:58.268469] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-22T20:19:58.268690] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-10-22T20:19:58.268747] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-22T20:19:58.519339] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-01. [2025-10-22T20:19:58.507819] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-22T20:19:58.555196] [INFO ] [REMOTE ] NXC: Full fetch complete (5626 records). [2025-10-22T20:19:58.555385] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-22T20:19:58.778722] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:19:58.878039] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T20:19:58.915743] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-01 [2025-10-22T20:19:58.937397] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T20:19:58.948115] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-22T20:19:58.948201] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T20:19:58.948604] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-22T20:19:58.964389] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-22T20:19:58.969609] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-22T20:19:58.997804] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-22T20:19:59.021741] [INFO ] [MAIN ] Update Progress: 1555/2367 symbols completed. NXDR took 4.7s. Estimated remaining: 1h 44m 23s. Rate: 7.8 symbols/min [2025-10-22T20:19:59.105694] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-10-22T20:19:59.128975] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-10-22T20:19:59.132256] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-10-22T20:19:59.137961] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-10-22T20:19:59.153848] [DEBUG] [LOCAL ] NXC: Trimmed 5626 records to 4057 (keeping 200 days of data) [2025-10-22T20:19:59.218528] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:19:59.231775] [DEBUG] [LOCAL ] NXC: Primary data saved (4057 records). [2025-10-22T20:19:59.231970] [INFO ] [MAIN ] NXC: Full history saved. [2025-10-22T20:19:59.232058] [INFO ] [MAIN ] Update Progress: 1556/2367 symbols completed. NXC took 19.2s. Estimated remaining: 1h 44m 12s. Rate: 7.8 symbols/min [2025-10-22T20:19:59.329803] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-22T20:19:59.408574] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:19:59.433623] [DEBUG] [LOCAL ] NXG: Loaded 10499 existing records from primary storage. [2025-10-22T20:19:59.433996] [INFO ] [MAIN ] NXG: Loaded 10499 existing records. [2025-10-22T20:19:59.566627] [DEBUG] [LOCAL ] NXE: Loaded 53062 existing records from primary storage. [2025-10-22T20:19:59.568986] [INFO ] [MAIN ] NXE: Loaded 53062 existing records. [2025-10-22T20:19:59.568748] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-22T20:19:59.710523] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:19:59.719728] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-22T20:19:59.720117] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-22T20:19:59.737447] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-10-22T20:19:59.747870] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-22T20:19:59.995006] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:20:00.026703] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-22T20:20:00.057604] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-22T20:20:00.106983] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-10-22T20:20:00.117596] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-22T20:20:00.117823] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-22T20:20:00.286713] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:20:00.330693] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-22T20:20:00.571205] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:20:00.917723] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-22T20:20:01.718009] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-22T20:20:02.517735] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-22T20:20:03.249204] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T20:20:03.317714] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-22T20:20:03.572197] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T20:20:03.654808] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (3.54 seconds). [2025-10-22T20:20:03.989018] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (3.07 seconds). [2025-10-22T20:20:04.117699] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-22T20:20:04.372980] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T20:20:04.917684] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-22T20:20:05.488176] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-22T20:20:05.717677] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-22T20:20:06.483121] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T20:20:06.489807] [INFO ] [REMOTE ] NX: Full fetch complete (48340 records). [2025-10-22T20:20:06.489971] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-22T20:20:06.526207] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-22T20:20:06.882821] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-10-22T20:20:06.882938] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-10-22T20:20:06.884266] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-10-22T20:20:06.884335] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-10-22T20:20:06.885622] [DEBUG] [LOCAL ] NX: Trimmed 48340 records to 33325 (keeping 200 days of data) [2025-10-22T20:20:07.097088] [DEBUG] [LOCAL ] NX: Primary data saved (33325 records). [2025-10-22T20:20:07.097237] [INFO ] [MAIN ] NX: Full history saved. [2025-10-22T20:20:07.097329] [INFO ] [MAIN ] Update Progress: 1557/2367 symbols completed. NX took 41.9s. Estimated remaining: 1h 44m 4s. Rate: 7.8 symbols/min [2025-10-22T20:20:07.317699] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-22T20:20:07.613601] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T20:20:07.730440] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-22T20:20:08.117726] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-22T20:20:08.637157] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T20:20:08.917678] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-22T20:20:09.717626] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-22T20:20:10.146997] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T20:20:10.218343] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-22T20:20:10.517734] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-22T20:20:10.743225] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-22T20:20:11.317723] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-22T20:20:12.117799] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-10-22T20:20:12.303045] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T20:20:12.582236] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T20:20:12.917619] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-22T20:20:13.157773] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-22T20:20:13.717711] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-22T20:20:14.517719] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-10-22T20:20:14.900868] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T20:20:15.096278] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-22T20:20:15.317685] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-22T20:20:15.427569] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T20:20:16.117707] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-22T20:20:16.917705] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-10-22T20:20:17.306001] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T20:20:17.389750] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-22T20:20:17.717790] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-22T20:20:17.964804] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-22T20:20:18.517701] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-10-22T20:20:19.317626] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-22T20:20:19.466533] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-22T20:20:19.779552] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-22T20:20:20.117637] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-22T20:20:20.294886] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-22T20:20:20.917675] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-22T20:20:21.717632] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-10-22T20:20:21.864124] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-22T20:20:21.866867] [INFO ] [REMOTE ] NXDT: Full fetch complete (24028 records). [2025-10-22T20:20:21.866944] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-22T20:20:22.242768] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-10-22T20:20:22.242925] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-10-22T20:20:22.243485] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-10-22T20:20:22.243557] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-10-22T20:20:22.270969] [DEBUG] [LOCAL ] NXDT: Trimmed 24028 records to 14784 (keeping 200 days of data) [2025-10-22T20:20:22.272833] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-22T20:20:22.368185] [DEBUG] [LOCAL ] NXDT: Primary data saved (14784 records). [2025-10-22T20:20:22.368318] [INFO ] [MAIN ] NXDT: Full history saved. [2025-10-22T20:20:22.368430] [INFO ] [MAIN ] Update Progress: 1558/2367 symbols completed. NXDT took 24.5s. Estimated remaining: 1h 44m 0s. Rate: 7.8 symbols/min [2025-10-22T20:20:22.375968] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-22T20:20:22.517676] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-10. [2025-10-22T20:20:23.317725] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-22T20:20:23.463659] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-22T20:20:23.465966] [INFO ] [REMOTE ] NXG: Full fetch complete (14737 records). [2025-10-22T20:20:23.466036] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-10-22T20:20:23.825839] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-10-22T20:20:23.825938] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-10-22T20:20:23.826320] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-10-22T20:20:23.826396] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-10-22T20:20:23.827031] [DEBUG] [LOCAL ] NXG: Trimmed 14737 records to 10466 (keeping 200 days of data) [2025-10-22T20:20:23.889994] [DEBUG] [LOCAL ] NXG: Primary data saved (10466 records). [2025-10-22T20:20:23.890130] [INFO ] [MAIN ] NXG: Full history saved. [2025-10-22T20:20:23.890217] [INFO ] [MAIN ] Update Progress: 1559/2367 symbols completed. NXG took 24.7s. Estimated remaining: 1h 43m 49s. Rate: 7.8 symbols/min [2025-10-22T20:20:25.452550] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-22T20:20:25.463907] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-22T20:20:27.735537] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-22T20:20:27.744510] [INFO ] [REMOTE ] NXE: Full fetch complete (76944 records). [2025-10-22T20:20:27.744702] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-22T20:20:28.168362] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-10-22T20:20:28.168456] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-10-22T20:20:28.169513] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-10-22T20:20:28.169580] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-10-22T20:20:28.171025] [DEBUG] [LOCAL ] NXE: Trimmed 76944 records to 53067 (keeping 200 days of data) [2025-10-22T20:20:28.463581] [DEBUG] [LOCAL ] NXE: Primary data saved (53067 records). [2025-10-22T20:20:28.463733] [INFO ] [MAIN ] NXE: Full history saved. [2025-10-22T20:20:28.463818] [INFO ] [MAIN ] Update Progress: 1560/2367 symbols completed. NXE took 29.4s. Estimated remaining: 1h 43m 40s. Rate: 7.8 symbols/min [2025-10-22T20:20:29.152707] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:20:29.135023] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:20:29.156199] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:20:29.132521] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:20:29.165483] [DEBUG] [LOCAL ] NXN: Loaded 2287 existing records from primary storage. [2025-10-22T20:20:29.165861] [INFO ] [MAIN ] NXN: Loaded 2287 existing records. [2025-10-22T20:20:29.277789] [DEBUG] [LOCAL ] NXP: Loaded 12283 existing records from primary storage. [2025-10-22T20:20:29.281526] [INFO ] [MAIN ] NXP: Loaded 12283 existing records. [2025-10-22T20:20:29.315962] [DEBUG] [LOCAL ] NXRT: Loaded 18938 existing records from primary storage. [2025-10-22T20:20:29.316234] [DEBUG] [LOCAL ] NXJ: Loaded 14817 existing records from primary storage. [2025-10-22T20:20:29.430553] [INFO ] [MAIN ] NXRT: Loaded 18938 existing records. [2025-10-22T20:20:29.342802] [INFO ] [MAIN ] NXJ: Loaded 14817 existing records. [2025-10-22T20:20:29.473578] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:20:29.513745] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-22T20:20:29.544460] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-22T20:20:29.652183] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-10-22T20:20:29.718566] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:20:29.692859] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-22T20:20:29.749612] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-22T20:20:29.783683] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-22T20:20:29.823857] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-10-22T20:20:29.969803] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:20:29.905122] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-22T20:20:30.031145] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:20:30.050778] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-22T20:20:30.050947] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-22T20:20:30.067285] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-22T20:20:30.128104] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-10-22T20:20:30.106064] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-22T20:20:30.169033] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-22T20:20:30.175759] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-10-22T20:20:30.296944] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-22T20:20:31.032018] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:20:31.089472] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-22T20:20:31.251543] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:20:31.330353] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-22T20:20:31.512671] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:20:31.508775] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:20:31.512999] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-22T20:20:31.513261] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-22T20:20:31.965890] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T20:20:31.967059] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-22T20:20:32.341828] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T20:20:32.344772] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-22T20:20:32.428904] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T20:20:32.432066] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-22T20:20:32.590898] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-22T20:20:32.592138] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-22T20:20:32.640432] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-22T20:20:32.643883] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-22T20:20:33.182406] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-22T20:20:33.183680] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-22T20:20:33.236125] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-22T20:20:33.239228] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-22T20:20:33.320194] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-22T20:20:33.611717] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T20:20:33.661466] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-22T20:20:33.717676] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-22T20:20:33.904967] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-22T20:20:34.517710] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-22T20:20:34.582741] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T20:20:35.317686] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-22T20:20:35.696083] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-22T20:20:36.117678] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-22T20:20:36.525588] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-22T20:20:36.677148] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-22T20:20:36.917619] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-22T20:20:37.661756] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-22T20:20:37.717674] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-22T20:20:38.301033] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-22T20:20:38.517696] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-22T20:20:39.317675] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-22T20:20:39.490601] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-22T20:20:40.117695] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-22T20:20:40.410894] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-22T20:20:40.917625] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-22T20:20:41.064289] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T20:20:41.717717] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-22T20:20:42.242192] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T20:20:42.517680] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-22T20:20:43.048698] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-22T20:20:43.048353] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-22T20:20:43.317685] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-22T20:20:44.117741] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-22T20:20:44.390795] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T20:20:44.917800] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-22T20:20:44.983777] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T20:20:45.380322] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-22T20:20:45.717704] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-22T20:20:46.341668] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-22T20:20:46.342807] [INFO ] [REMOTE ] NXN: Full fetch complete (3437 records). [2025-10-22T20:20:46.342908] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-22T20:20:46.522736] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-22T20:20:46.714115] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-10-22T20:20:46.714224] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-10-22T20:20:46.714375] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-10-22T20:20:46.714415] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-10-22T20:20:46.714787] [DEBUG] [LOCAL ] NXN: Trimmed 3437 records to 2296 (keeping 200 days of data) [2025-10-22T20:20:46.728879] [DEBUG] [LOCAL ] NXN: Primary data saved (2296 records). [2025-10-22T20:20:46.728940] [INFO ] [MAIN ] NXN: Full history saved. [2025-10-22T20:20:46.729007] [INFO ] [MAIN ] Update Progress: 1561/2367 symbols completed. NXN took 18.3s. Estimated remaining: 1h 43m 38s. Rate: 7.8 symbols/min [2025-10-22T20:20:46.895097] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:20:46.895329] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-22T20:20:46.895371] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-22T20:20:46.895442] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-22T20:20:46.895478] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-22T20:20:46.895518] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-22T20:20:46.895549] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-22T20:20:47.239435] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:20:47.317623] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-22T20:20:47.855333] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T20:20:47.939457] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-22T20:20:48.117680] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-22T20:20:48.917631] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-22T20:20:49.227267] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T20:20:49.529604] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T20:20:49.717702] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-22T20:20:50.275201] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-22T20:20:50.517697] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-22T20:20:51.317711] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-22T20:20:51.739909] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-22T20:20:51.741067] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T20:20:52.117684] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-22T20:20:52.577107] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-22T20:20:52.917735] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-22T20:20:53.717735] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-22T20:20:54.171577] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T20:20:54.168357] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-22T20:20:54.517799] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-22T20:20:55.235016] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-22T20:20:55.317684] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-22T20:20:55.768366] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-22T20:20:56.117682] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-22T20:20:56.813911] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T20:20:56.917712] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-22T20:20:57.717706] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-22T20:20:57.866974] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-22T20:20:57.869410] [INFO ] [REMOTE ] NXJ: Full fetch complete (20241 records). [2025-10-22T20:20:57.869481] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-22T20:20:58.241939] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-22T20:20:58.253462] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-10-22T20:20:58.253565] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-10-22T20:20:58.254196] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-10-22T20:20:58.254265] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-10-22T20:20:58.255055] [DEBUG] [LOCAL ] NXJ: Trimmed 20241 records to 14830 (keeping 200 days of data) [2025-10-22T20:20:58.345377] [DEBUG] [LOCAL ] NXJ: Primary data saved (14830 records). [2025-10-22T20:20:58.345523] [INFO ] [MAIN ] NXJ: Full history saved. [2025-10-22T20:20:58.345604] [INFO ] [MAIN ] Update Progress: 1562/2367 symbols completed. NXJ took 29.9s. Estimated remaining: 1h 43m 32s. Rate: 7.8 symbols/min [2025-10-22T20:20:58.511596] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:20:58.517730] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-22T20:20:58.556274] [DEBUG] [LOCAL ] NYT: Loaded 49485 existing records from primary storage. [2025-10-22T20:20:58.556577] [INFO ] [MAIN ] NYT: Loaded 49485 existing records. [2025-10-22T20:20:58.741705] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:20:58.741941] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-22T20:20:58.741999] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-22T20:20:58.742200] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-10-22T20:20:58.742257] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-22T20:20:59.095565] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:20:59.203604] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-22T20:20:59.317631] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-22T20:20:59.785968] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-22T20:20:59.786729] [INFO ] [REMOTE ] NYC: Full fetch complete (1852 records). [2025-10-22T20:20:59.786797] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-22T20:20:59.964173] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-22T20:20:59.964359] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:20:59.964428] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:20:59.964498] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-22T20:20:59.964561] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-22T20:20:59.964599] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-22T20:20:59.964662] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-22T20:20:59.964742] [INFO ] [MAIN ] Update Progress: 1563/2367 symbols completed. NYC took 13.2s. Estimated remaining: 1h 43m 21s. Rate: 7.8 symbols/min [2025-10-22T20:21:00.120885] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-22T20:21:00.169692] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:21:00.199496] [DEBUG] [LOCAL ] NZF: Loaded 28757 existing records from primary storage. [2025-10-22T20:21:00.199801] [INFO ] [MAIN ] NZF: Loaded 28757 existing records. [2025-10-22T20:21:00.394588] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:21:00.394813] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-22T20:21:00.394862] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-22T20:21:00.395077] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-10-22T20:21:00.395132] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-22T20:21:00.741198] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:21:00.917728] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-22T20:21:01.327074] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T20:21:01.717735] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-22T20:21:02.133436] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-22T20:21:02.517668] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-22T20:21:03.252078] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T20:21:03.317698] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-22T20:21:03.645684] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T20:21:04.117711] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-22T20:21:04.650025] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T20:21:04.917696] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-22T20:21:05.127840] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T20:21:05.717723] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-22T20:21:06.352789] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T20:21:06.517673] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-22T20:21:06.642224] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-22T20:21:06.644737] [INFO ] [REMOTE ] NXP: Full fetch complete (16973 records). [2025-10-22T20:21:06.644811] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-22T20:21:07.010035] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-10-22T20:21:07.010122] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-10-22T20:21:07.010496] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-10-22T20:21:07.010539] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-10-22T20:21:07.011158] [DEBUG] [LOCAL ] NXP: Trimmed 16973 records to 12233 (keeping 200 days of data) [2025-10-22T20:21:07.084892] [DEBUG] [LOCAL ] NXP: Primary data saved (12233 records). [2025-10-22T20:21:07.085018] [INFO ] [MAIN ] NXP: Full history saved. [2025-10-22T20:21:07.085092] [INFO ] [MAIN ] Update Progress: 1564/2367 symbols completed. NXP took 38.6s. Estimated remaining: 1h 43m 13s. Rate: 7.8 symbols/min [2025-10-22T20:21:07.250540] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:21:07.250712] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-22T20:21:07.250762] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-22T20:21:07.250904] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-22T20:21:07.250945] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-22T20:21:07.250987] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-22T20:21:07.251018] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-22T20:21:07.326619] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-22T20:21:07.612788] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:21:08.117704] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-22T20:21:08.276882] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-22T20:21:08.280586] [INFO ] [REMOTE ] NXRT: Full fetch complete (26118 records). [2025-10-22T20:21:08.280708] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-22T20:21:08.673138] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-10-22T20:21:08.673263] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-10-22T20:21:08.673847] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-10-22T20:21:08.673919] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-10-22T20:21:08.685490] [DEBUG] [LOCAL ] NXRT: Trimmed 26118 records to 18929 (keeping 200 days of data) [2025-10-22T20:21:08.706603] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-22T20:21:08.828692] [DEBUG] [LOCAL ] NXRT: Primary data saved (18929 records). [2025-10-22T20:21:08.828837] [INFO ] [MAIN ] NXRT: Full history saved. [2025-10-22T20:21:08.828929] [INFO ] [MAIN ] Update Progress: 1565/2367 symbols completed. NXRT took 40.4s. Estimated remaining: 1h 43m 2s. Rate: 7.8 symbols/min [2025-10-22T20:21:08.925847] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-22T20:21:09.000967] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:21:09.050026] [DEBUG] [LOCAL ] OBDC: Loaded 51730 existing records from primary storage. [2025-10-22T20:21:09.050342] [INFO ] [MAIN ] OBDC: Loaded 51730 existing records. [2025-10-22T20:21:09.230258] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:21:09.230502] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-22T20:21:09.230549] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-22T20:21:09.231135] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-10-22T20:21:09.231198] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-22T20:21:09.579599] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:21:09.717695] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-22T20:21:10.517794] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-22T20:21:10.683309] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T20:21:11.048941] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.93 seconds). [2025-10-22T20:21:11.305899] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T20:21:11.317613] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-22T20:21:12.117716] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-22T20:21:12.433555] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-22T20:21:12.917720] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-22T20:21:13.717627] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-22T20:21:14.006817] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-10-22T20:21:14.099778] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-22T20:21:14.188291] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T20:21:14.517710] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-22T20:21:15.317639] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-22T20:21:15.587733] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T20:21:16.117744] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-22T20:21:16.470054] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T20:21:16.917629] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-22T20:21:17.063372] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T20:21:17.717712] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-22T20:21:18.517637] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-22T20:21:18.755919] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T20:21:18.836631] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-22T20:21:19.317630] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-22T20:21:19.748917] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-22T20:21:19.969552] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T20:21:20.117721] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-22T20:21:20.917690] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-22T20:21:21.717692] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-22T20:21:22.075212] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-10-22T20:21:22.105102] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T20:21:22.154536] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-22T20:21:22.517971] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-22T20:21:23.317708] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-22T20:21:23.806163] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-22T20:21:24.117637] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-22T20:21:24.386568] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-22T20:21:24.917681] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-22T20:21:25.565523] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T20:21:25.717679] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-22T20:21:26.152719] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-10-22T20:21:26.517730] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-22T20:21:26.795495] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T20:21:27.000718] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T20:21:27.007486] [INFO ] [REMOTE ] NZF: Full fetch complete (42166 records). [2025-10-22T20:21:27.007704] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-22T20:21:27.322739] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-22T20:21:27.414331] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-10-22T20:21:27.414404] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-10-22T20:21:27.415175] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-10-22T20:21:27.415235] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-10-22T20:21:27.416083] [DEBUG] [LOCAL ] NZF: Trimmed 42166 records to 28713 (keeping 200 days of data) [2025-10-22T20:21:27.583142] [DEBUG] [LOCAL ] NZF: Primary data saved (28713 records). [2025-10-22T20:21:27.583267] [INFO ] [MAIN ] NZF: Full history saved. [2025-10-22T20:21:27.583342] [INFO ] [MAIN ] Update Progress: 1566/2367 symbols completed. NZF took 27.6s. Estimated remaining: 1h 43m 0s. Rate: 7.8 symbols/min [2025-10-22T20:21:27.755215] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:21:27.771555] [DEBUG] [LOCAL ] OBK: Loaded 16436 existing records from primary storage. [2025-10-22T20:21:27.771808] [INFO ] [MAIN ] OBK: Loaded 16436 existing records. [2025-10-22T20:21:27.946404] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:21:27.946798] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-22T20:21:27.946913] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-22T20:21:27.947125] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-10-22T20:21:27.947180] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-22T20:21:28.118760] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-22T20:21:28.306553] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:21:28.340022] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-22T20:21:28.917688] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-22T20:21:29.717727] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-22T20:21:29.926035] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-22T20:21:30.251239] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-22T20:21:30.517697] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-22T20:21:30.808253] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T20:21:30.887525] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T20:21:31.317727] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-22T20:21:32.117743] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-22T20:21:32.436388] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T20:21:32.917689] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-22T20:21:33.310579] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-10-22T20:21:33.717711] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-22T20:21:34.318462] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-22T20:21:34.517681] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-22T20:21:34.721508] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T20:21:34.756347] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T20:21:35.317707] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-22T20:21:36.117722] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-22T20:21:36.917689] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-22T20:21:37.254936] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-22T20:21:37.352971] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-10-22T20:21:37.379816] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T20:21:37.717736] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-22T20:21:38.517733] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-22T20:21:38.912864] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T20:21:38.922011] [INFO ] [REMOTE ] OBDC: Full fetch complete (75403 records). [2025-10-22T20:21:38.922183] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-22T20:21:39.326766] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-10-22T20:21:39.325943] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-22T20:21:39.326987] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-10-22T20:21:39.329108] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-10-22T20:21:39.329316] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-10-22T20:21:39.330823] [DEBUG] [LOCAL ] OBDC: Trimmed 75403 records to 51730 (keeping 200 days of data) [2025-10-22T20:21:39.649516] [DEBUG] [LOCAL ] OBDC: Primary data saved (51730 records). [2025-10-22T20:21:39.649691] [INFO ] [MAIN ] OBDC: Full history saved. [2025-10-22T20:21:39.649787] [INFO ] [MAIN ] Update Progress: 1567/2367 symbols completed. OBDC took 30.8s. Estimated remaining: 1h 42m 55s. Rate: 7.8 symbols/min [2025-10-22T20:21:39.826211] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:21:39.867868] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-22T20:21:39.914982] [DEBUG] [LOCAL ] OC: Loaded 44951 existing records from primary storage. [2025-10-22T20:21:39.915476] [INFO ] [MAIN ] OC: Loaded 44951 existing records. [2025-10-22T20:21:40.095400] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:21:40.095794] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-22T20:21:40.095887] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-22T20:21:40.096231] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-10-22T20:21:40.096287] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-22T20:21:40.126283] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-22T20:21:40.408249] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T20:21:40.473277] [INFO ] [REMOTE ] NYT: Full fetch complete (72199 records). [2025-10-22T20:21:40.504890] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:21:40.499131] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-22T20:21:40.583378] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-22T20:21:40.896134] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-10-22T20:21:40.896215] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-10-22T20:21:40.897217] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-10-22T20:21:40.897281] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-10-22T20:21:40.898672] [DEBUG] [LOCAL ] NYT: Trimmed 72199 records to 49445 (keeping 200 days of data) [2025-10-22T20:21:40.950688] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-22T20:21:41.200709] [DEBUG] [LOCAL ] NYT: Primary data saved (49445 records). [2025-10-22T20:21:41.200876] [INFO ] [MAIN ] NYT: Full history saved. [2025-10-22T20:21:41.200963] [INFO ] [MAIN ] Update Progress: 1568/2367 symbols completed. NYT took 42.9s. Estimated remaining: 1h 42m 44s. Rate: 7.8 symbols/min [2025-10-22T20:21:41.366237] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:21:41.378453] [DEBUG] [LOCAL ] OCFT: Loaded 7172 existing records from primary storage. [2025-10-22T20:21:41.378682] [INFO ] [MAIN ] OCFT: Loaded 7172 existing records. [2025-10-22T20:21:41.549901] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:21:41.550127] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-22T20:21:41.550175] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-22T20:21:41.550327] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-10-22T20:21:41.550380] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-22T20:21:41.719157] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-22T20:21:41.904909] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:21:42.517635] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-22T20:21:42.802345] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T20:21:42.940636] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-10 (2.81 seconds). [2025-10-22T20:21:42.952570] [INFO ] [REMOTE ] O: Full fetch complete (77572 records). [2025-10-22T20:21:42.952771] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-22T20:21:43.065904] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T20:21:43.165441] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T20:21:43.166377] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:21:43.166467] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:21:43.166559] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-22T20:21:43.166686] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-22T20:21:43.166747] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-22T20:21:43.166794] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-22T20:21:43.166857] [INFO ] [MAIN ] Update Progress: 1569/2367 symbols completed. O took 36.1s. Estimated remaining: 1h 42m 33s. Rate: 7.8 symbols/min [2025-10-22T20:21:43.339728] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:21:43.336113] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-22T20:21:43.345124] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T20:21:43.356352] [DEBUG] [LOCAL ] ODC: Loaded 8680 existing records from primary storage. [2025-10-22T20:21:43.356564] [INFO ] [MAIN ] ODC: Loaded 8680 existing records. [2025-10-22T20:21:43.538675] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:21:43.538902] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-22T20:21:43.538949] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-22T20:21:43.539132] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-10-22T20:21:43.539171] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-22T20:21:43.884969] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:21:44.117780] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-22T20:21:44.917684] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-22T20:21:45.073387] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T20:21:45.268988] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T20:21:45.717661] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-22T20:21:45.745813] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T20:21:46.517632] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-22T20:21:47.304717] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T20:21:47.317601] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-22T20:21:47.519340] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T20:21:48.117705] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-22T20:21:48.289821] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-22T20:21:48.917692] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-10-22T20:21:48.999252] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-22T20:21:49.717723] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-22T20:21:50.517699] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-22T20:21:50.983614] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-22T20:21:51.134863] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-22T20:21:51.317691] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-10-22T20:21:51.411318] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T20:21:52.117715] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-22T20:21:52.871459] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-22T20:21:52.917622] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-22T20:21:53.255400] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-22T20:21:53.717666] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-22T20:21:53.782546] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T20:21:54.517673] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-22T20:21:54.660888] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-22T20:21:55.317724] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-22T20:21:55.355933] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T20:21:56.117630] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-22T20:21:56.413581] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-22T20:21:56.917687] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-22T20:21:57.076466] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-22T20:21:57.717686] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-22T20:21:57.879821] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-22T20:21:58.517705] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-10-22T20:21:58.559526] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-22T20:21:59.317699] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-22T20:22:00.117860] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-22T20:22:00.301850] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T20:22:00.318554] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T20:22:00.917736] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-22T20:22:01.023687] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-22T20:22:01.717671] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-22T20:22:02.013908] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T20:22:02.517776] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-22T20:22:02.757876] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T20:22:03.099869] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-22T20:22:03.101356] [INFO ] [REMOTE ] OCFT: Full fetch complete (11661 records). [2025-10-22T20:22:03.101472] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-22T20:22:03.325141] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-22T20:22:03.512519] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-10-22T20:22:03.512838] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-10-22T20:22:03.513382] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-10-22T20:22:03.513463] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-10-22T20:22:03.514046] [DEBUG] [LOCAL ] OCFT: Trimmed 11661 records to 7090 (keeping 200 days of data) [2025-10-22T20:22:03.555736] [DEBUG] [LOCAL ] OCFT: Primary data saved (7090 records). [2025-10-22T20:22:03.555874] [INFO ] [MAIN ] OCFT: Full history saved. [2025-10-22T20:22:03.555958] [INFO ] [MAIN ] Update Progress: 1570/2367 symbols completed. OCFT took 22.4s. Estimated remaining: 1h 42m 32s. Rate: 7.8 symbols/min [2025-10-22T20:22:03.727848] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:22:03.755579] [DEBUG] [LOCAL ] ODV: Loaded 29925 existing records from primary storage. [2025-10-22T20:22:03.755887] [INFO ] [MAIN ] ODV: Loaded 29925 existing records. [2025-10-22T20:22:03.937965] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:22:03.938210] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-22T20:22:03.938258] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-22T20:22:03.938502] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-10-22T20:22:03.938594] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-22T20:22:04.117884] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-10-22T20:22:04.350859] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:22:04.358974] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T20:22:04.917733] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-22T20:22:05.717786] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-22T20:22:05.972431] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T20:22:05.975629] [INFO ] [REMOTE ] OBK: Full fetch complete (23886 records). [2025-10-22T20:22:05.975749] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-10-22T20:22:06.315639] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-22T20:22:06.417820] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-10-22T20:22:06.417901] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-10-22T20:22:06.418445] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-10-22T20:22:06.418487] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-10-22T20:22:06.419157] [DEBUG] [LOCAL ] OBK: Trimmed 23886 records to 16363 (keeping 200 days of data) [2025-10-22T20:22:06.519025] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-22T20:22:06.518943] [DEBUG] [LOCAL ] OBK: Primary data saved (16363 records). [2025-10-22T20:22:06.519973] [INFO ] [MAIN ] OBK: Full history saved. [2025-10-22T20:22:06.520147] [INFO ] [MAIN ] Update Progress: 1571/2367 symbols completed. OBK took 38.9s. Estimated remaining: 1h 42m 22s. Rate: 7.8 symbols/min [2025-10-22T20:22:06.695926] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:22:06.704041] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-22T20:22:06.739886] [DEBUG] [LOCAL ] OEC: Loaded 37212 existing records from primary storage. [2025-10-22T20:22:06.740164] [INFO ] [MAIN ] OEC: Loaded 37212 existing records. [2025-10-22T20:22:06.917093] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:22:06.917296] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-22T20:22:06.917344] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-22T20:22:06.917516] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-10-22T20:22:06.917592] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-22T20:22:07.318069] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-10-22T20:22:07.322030] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:22:07.512156] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T20:22:07.514278] [INFO ] [REMOTE ] ODC: Full fetch complete (11491 records). [2025-10-22T20:22:07.514350] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-22T20:22:07.873734] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-10-22T20:22:07.873835] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-10-22T20:22:07.874116] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-10-22T20:22:07.874158] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-10-22T20:22:07.874637] [DEBUG] [LOCAL ] ODC: Trimmed 11491 records to 8681 (keeping 200 days of data) [2025-10-22T20:22:07.926349] [DEBUG] [LOCAL ] ODC: Primary data saved (8681 records). [2025-10-22T20:22:07.926478] [INFO ] [MAIN ] ODC: Full history saved. [2025-10-22T20:22:07.926558] [INFO ] [MAIN ] Update Progress: 1572/2367 symbols completed. ODC took 24.8s. Estimated remaining: 1h 42m 11s. Rate: 7.8 symbols/min [2025-10-22T20:22:08.093100] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:22:08.112673] [DEBUG] [LOCAL ] OFG: Loaded 20625 existing records from primary storage. [2025-10-22T20:22:08.112903] [INFO ] [MAIN ] OFG: Loaded 20625 existing records. [2025-10-22T20:22:08.124219] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-22T20:22:08.317244] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:22:08.317467] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-22T20:22:08.317516] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-22T20:22:08.317826] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-10-22T20:22:08.317886] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-22T20:22:08.667825] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:22:08.917778] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-22T20:22:09.130398] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T20:22:09.186875] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T20:22:09.717711] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-22T20:22:10.398295] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T20:22:10.517628] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-22T20:22:10.916936] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-22T20:22:11.317705] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-22T20:22:12.117955] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-22T20:22:12.118554] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T20:22:12.572955] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T20:22:12.917780] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-22T20:22:13.112956] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T20:22:13.717740] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-22T20:22:14.026979] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T20:22:14.517684] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-22T20:22:14.963752] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T20:22:15.317690] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-22T20:22:16.073541] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T20:22:16.117662] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-22T20:22:16.540100] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T20:22:16.917733] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-10-22T20:22:17.494782] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T20:22:17.717721] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-22T20:22:18.517702] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-22T20:22:18.727270] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T20:22:18.929836] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-22T20:22:19.317698] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-10. [2025-10-22T20:22:19.648740] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T20:22:20.117698] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-22T20:22:20.917674] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-22T20:22:21.222998] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-22T20:22:21.231350] [INFO ] [REMOTE ] OC: Full fetch complete (64894 records). [2025-10-22T20:22:21.231495] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-10-22T20:22:21.396130] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-22T20:22:21.653018] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-10-22T20:22:21.653129] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-10-22T20:22:21.654135] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-10-22T20:22:21.654202] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-10-22T20:22:21.655548] [DEBUG] [LOCAL ] OC: Trimmed 64894 records to 44899 (keeping 200 days of data) [2025-10-22T20:22:21.722005] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-22T20:22:21.945151] [DEBUG] [LOCAL ] OC: Primary data saved (44899 records). [2025-10-22T20:22:21.945281] [INFO ] [MAIN ] OC: Full history saved. [2025-10-22T20:22:21.945357] [INFO ] [MAIN ] Update Progress: 1573/2367 symbols completed. OC took 42.3s. Estimated remaining: 1h 42m 7s. Rate: 7.8 symbols/min [2025-10-22T20:22:22.114190] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:22:22.151662] [DEBUG] [LOCAL ] OGE: Loaded 45791 existing records from primary storage. [2025-10-22T20:22:22.151964] [INFO ] [MAIN ] OGE: Loaded 45791 existing records. [2025-10-22T20:22:22.331350] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:22:22.331594] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-22T20:22:22.331670] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-22T20:22:22.331988] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-10-22T20:22:22.332041] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-22T20:22:22.523688] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-22T20:22:22.638190] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T20:22:22.729669] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:22:23.317630] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-22T20:22:23.377908] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T20:22:23.934967] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T20:22:24.117678] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-22T20:22:24.917687] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-22T20:22:25.047783] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T20:22:25.219468] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T20:22:25.717626] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-22T20:22:26.517684] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-22T20:22:26.617551] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T20:22:27.317690] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-22T20:22:27.379799] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T20:22:27.504800] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T20:22:28.117706] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-10. [2025-10-22T20:22:28.895929] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T20:22:28.917696] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-22T20:22:29.717732] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-22T20:22:29.892750] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T20:22:29.900337] [INFO ] [REMOTE ] ODV: Full fetch complete (36158 records). [2025-10-22T20:22:29.900415] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-10-22T20:22:30.264345] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-10-22T20:22:30.264420] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-10-22T20:22:30.265146] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-10-22T20:22:30.265205] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-10-22T20:22:30.266020] [DEBUG] [LOCAL ] ODV: Trimmed 36158 records to 30003 (keeping 200 days of data) [2025-10-22T20:22:30.430869] [DEBUG] [LOCAL ] ODV: Primary data saved (30003 records). [2025-10-22T20:22:30.430993] [INFO ] [MAIN ] ODV: Full history saved. [2025-10-22T20:22:30.431067] [INFO ] [MAIN ] Update Progress: 1574/2367 symbols completed. ODV took 26.9s. Estimated remaining: 1h 41m 59s. Rate: 7.8 symbols/min [2025-10-22T20:22:30.526229] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-10-22T20:22:30.607865] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:22:30.657938] [DEBUG] [LOCAL ] OGN: Loaded 53103 existing records from primary storage. [2025-10-22T20:22:30.658298] [INFO ] [MAIN ] OGN: Loaded 53103 existing records. [2025-10-22T20:22:30.841176] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:22:30.841751] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-22T20:22:30.841941] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-22T20:22:30.842166] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-10-22T20:22:30.842217] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-22T20:22:31.029835] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T20:22:31.242022] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-22T20:22:31.246728] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:22:31.317619] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-22T20:22:32.117732] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-22T20:22:32.230925] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T20:22:32.917628] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-10-22T20:22:32.981315] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T20:22:33.213497] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T20:22:33.217428] [INFO ] [REMOTE ] OFG: Full fetch complete (33745 records). [2025-10-22T20:22:33.217589] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-22T20:22:33.592541] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-10-22T20:22:33.592615] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-10-22T20:22:33.593416] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-10-22T20:22:33.593479] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-10-22T20:22:33.594278] [DEBUG] [LOCAL ] OFG: Trimmed 33745 records to 20595 (keeping 200 days of data) [2025-10-22T20:22:33.718342] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-22T20:22:33.719283] [DEBUG] [LOCAL ] OFG: Primary data saved (20595 records). [2025-10-22T20:22:33.719422] [INFO ] [MAIN ] OFG: Full history saved. [2025-10-22T20:22:33.720290] [INFO ] [MAIN ] Update Progress: 1575/2367 symbols completed. OFG took 25.8s. Estimated remaining: 1h 41m 49s. Rate: 7.8 symbols/min [2025-10-22T20:22:33.889780] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:22:33.925926] [DEBUG] [LOCAL ] OGS: Loaded 34004 existing records from primary storage. [2025-10-22T20:22:33.926281] [INFO ] [MAIN ] OGS: Loaded 34004 existing records. [2025-10-22T20:22:34.120086] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:22:34.120310] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-22T20:22:34.120358] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-22T20:22:34.120533] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-10-22T20:22:34.120571] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-22T20:22:34.472373] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:22:34.517626] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-22T20:22:34.557987] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T20:22:35.317624] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-22T20:22:35.733055] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-22T20:22:36.117636] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-10-22T20:22:36.295545] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T20:22:36.420417] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T20:22:36.917665] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-22T20:22:37.691118] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T20:22:37.717616] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-10. [2025-10-22T20:22:38.247444] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T20:22:38.517737] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-22T20:22:39.304963] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T20:22:39.311464] [INFO ] [REMOTE ] OEC: Full fetch complete (53555 records). [2025-10-22T20:22:39.311616] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-10-22T20:22:39.323432] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-22T20:22:39.698985] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-10-22T20:22:39.699077] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-10-22T20:22:39.700077] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-10-22T20:22:39.700144] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-10-22T20:22:39.701371] [DEBUG] [LOCAL ] OEC: Trimmed 53555 records to 37142 (keeping 200 days of data) [2025-10-22T20:22:39.920905] [DEBUG] [LOCAL ] OEC: Primary data saved (37142 records). [2025-10-22T20:22:39.921140] [INFO ] [MAIN ] OEC: Full history saved. [2025-10-22T20:22:39.921240] [INFO ] [MAIN ] Update Progress: 1576/2367 symbols completed. OEC took 33.4s. Estimated remaining: 1h 41m 41s. Rate: 7.8 symbols/min [2025-10-22T20:22:40.095163] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:22:40.122039] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-22T20:22:40.145901] [DEBUG] [LOCAL ] OHI: Loaded 51895 existing records from primary storage. [2025-10-22T20:22:40.146263] [INFO ] [MAIN ] OHI: Loaded 51895 existing records. [2025-10-22T20:22:40.330320] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:22:40.330598] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-22T20:22:40.330717] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-22T20:22:40.331135] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-10-22T20:22:40.331228] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-22T20:22:40.651470] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-22T20:22:40.727893] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:22:40.836527] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T20:22:40.917614] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-22T20:22:41.717636] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-22T20:22:42.124783] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-22T20:22:42.517701] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-22T20:22:42.549807] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T20:22:43.317720] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-22T20:22:43.532280] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T20:22:44.117711] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-22T20:22:44.545468] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-22T20:22:44.795058] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T20:22:44.917702] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-22T20:22:45.717634] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-22T20:22:45.848303] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T20:22:46.517706] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-22T20:22:46.922260] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T20:22:47.317773] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-22T20:22:47.365903] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T20:22:47.885611] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T20:22:48.117688] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-22T20:22:48.917725] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-22T20:22:49.188465] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-22T20:22:49.252529] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T20:22:49.717661] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-22T20:22:50.517625] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-22T20:22:50.795540] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T20:22:51.317732] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-22T20:22:51.709682] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-22T20:22:52.078839] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T20:22:52.117637] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-22T20:22:52.917635] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-22T20:22:53.296716] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-22T20:22:53.372119] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T20:22:53.717673] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-22T20:22:53.821796] [DEBUG] [REMOTE ] OGS: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-22T20:22:53.822068] [WARN ] [REMOTE ] OGS: No data returned for month 2025-10 [2025-10-22T20:22:53.822157] [FATAL] [REMOTE ] OGS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T20:22:53.822232] [FATAL] [MAIN ] OGS: Failed to fetch primary data. [2025-10-22T20:22:53.822295] [WARN ] [MAIN ] OGS: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T20:22:53.822364] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-22T20:22:53.822426] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-22T20:22:53.822462] [INFO ] [LOCAL ] OGS: Starting deletion of derivative data. [2025-10-22T20:22:53.822595] [DEBUG] [LOCAL ] OGS: Deleted derivative data file. [2025-10-22T20:22:53.822705] [INFO ] [MAIN ] Update Progress: 1577/2367 symbols completed. OGS took 20.1s. Estimated remaining: 1h 41m 36s. Rate: 7.8 symbols/min [2025-10-22T20:22:53.991295] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:22:54.037602] [DEBUG] [LOCAL ] OI: Loaded 47059 existing records from primary storage. [2025-10-22T20:22:54.037985] [INFO ] [MAIN ] OI: Loaded 47059 existing records. [2025-10-22T20:22:54.214982] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:22:54.215187] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-22T20:22:54.215234] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-22T20:22:54.215423] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-10-22T20:22:54.215462] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-22T20:22:54.520548] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-22T20:22:54.574951] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:22:55.083757] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-22T20:22:55.317704] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-22T20:22:56.122354] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-22T20:22:56.231857] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T20:22:56.917695] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-22T20:22:57.330557] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T20:22:57.717723] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-22T20:22:58.130145] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-22T20:22:58.382560] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T20:22:58.517763] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-22T20:22:59.317639] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-22T20:22:59.668728] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T20:23:00.117729] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-22T20:23:00.917735] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-22T20:23:06.176960] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (7.66 seconds). [2025-10-22T20:23:06.189310] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-22T20:23:06.229566] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (6.11 seconds). [2025-10-22T20:23:06.238969] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-22T20:23:06.775461] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (5.86 seconds). [2025-10-22T20:23:06.786255] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-22T20:23:07.209528] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-10 (7.89 seconds). [2025-10-22T20:23:07.217479] [INFO ] [REMOTE ] OGE: Full fetch complete (66820 records). [2025-10-22T20:23:07.217708] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-22T20:23:07.612324] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-10-22T20:23:07.612450] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-10-22T20:23:07.613805] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-10-22T20:23:07.613876] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-10-22T20:23:07.615777] [DEBUG] [LOCAL ] OGE: Trimmed 66820 records to 45782 (keeping 200 days of data) [2025-10-22T20:23:07.916772] [DEBUG] [LOCAL ] OGE: Primary data saved (45782 records). [2025-10-22T20:23:07.916972] [INFO ] [MAIN ] OGE: Full history saved. [2025-10-22T20:23:07.917073] [INFO ] [MAIN ] Update Progress: 1578/2367 symbols completed. OGE took 46.0s. Estimated remaining: 1h 41m 32s. Rate: 7.8 symbols/min [2025-10-22T20:23:08.102296] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:23:08.128543] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T20:23:08.142014] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-22T20:23:08.148443] [DEBUG] [LOCAL ] OIA: Loaded 13046 existing records from primary storage. [2025-10-22T20:23:08.148674] [INFO ] [MAIN ] OIA: Loaded 13046 existing records. [2025-10-22T20:23:08.366525] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:23:08.367940] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-22T20:23:08.371850] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-22T20:23:08.371662] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-22T20:23:08.380581] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-10-22T20:23:08.381031] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-22T20:23:08.425024] [INFO ] [REMOTE ] OGN: Full fetch complete (76948 records). [2025-10-22T20:23:08.451747] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-22T20:23:09.069387] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:23:09.087901] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-22T20:23:09.205051] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-10-22T20:23:09.205160] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-10-22T20:23:09.206275] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-10-22T20:23:09.206358] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-10-22T20:23:09.207905] [DEBUG] [LOCAL ] OGN: Trimmed 76948 records to 53117 (keeping 200 days of data) [2025-10-22T20:23:09.368993] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-22T20:23:09.466062] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-22T20:23:09.601006] [DEBUG] [LOCAL ] OGN: Primary data saved (53117 records). [2025-10-22T20:23:09.601148] [INFO ] [MAIN ] OGN: Full history saved. [2025-10-22T20:23:09.601226] [INFO ] [MAIN ] Update Progress: 1579/2367 symbols completed. OGN took 39.2s. Estimated remaining: 1h 41m 21s. Rate: 7.8 symbols/min [2025-10-22T20:23:09.768097] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:23:09.803832] [DEBUG] [LOCAL ] OII: Loaded 41827 existing records from primary storage. [2025-10-22T20:23:09.804116] [INFO ] [MAIN ] OII: Loaded 41827 existing records. [2025-10-22T20:23:09.984025] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:23:09.984775] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-22T20:23:09.994621] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-22T20:23:09.995097] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-22T20:23:09.999110] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-22T20:23:09.998473] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-10-22T20:23:10.000056] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-22T20:23:10.390436] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:23:10.393031] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-22T20:23:10.392628] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-22T20:23:10.404721] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-22T20:23:11.295388] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-22T20:23:11.299620] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-22T20:23:11.435206] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T20:23:11.446135] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-22T20:23:11.715144] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T20:23:11.723403] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-22T20:23:12.256635] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T20:23:12.267311] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-22T20:23:12.347703] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T20:23:12.351379] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-22T20:23:13.487732] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T20:23:13.498486] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-22T20:23:13.516404] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T20:23:13.542624] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-22T20:23:13.717665] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-22T20:23:14.065076] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T20:23:14.517769] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-22T20:23:15.283584] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-22T20:23:15.307205] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T20:23:15.315600] [INFO ] [REMOTE ] OHI: Full fetch complete (75292 records). [2025-10-22T20:23:15.315775] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-22T20:23:15.327708] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-22T20:23:15.743758] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-10-22T20:23:15.743901] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-10-22T20:23:15.744988] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-10-22T20:23:15.745068] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-10-22T20:23:15.771463] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T20:23:15.781232] [DEBUG] [LOCAL ] OHI: Trimmed 75292 records to 51841 (keeping 200 days of data) [2025-10-22T20:23:16.088870] [DEBUG] [LOCAL ] OHI: Primary data saved (51841 records). [2025-10-22T20:23:16.089006] [INFO ] [MAIN ] OHI: Full history saved. [2025-10-22T20:23:16.089109] [INFO ] [MAIN ] Update Progress: 1580/2367 symbols completed. OHI took 36.2s. Estimated remaining: 1h 41m 13s. Rate: 7.8 symbols/min [2025-10-22T20:23:16.122766] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-22T20:23:16.261394] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:23:16.294906] [DEBUG] [LOCAL ] OIS: Loaded 39895 existing records from primary storage. [2025-10-22T20:23:16.295176] [INFO ] [MAIN ] OIS: Loaded 39895 existing records. [2025-10-22T20:23:16.470929] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:23:16.471126] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-22T20:23:16.471202] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-22T20:23:16.471515] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-10-22T20:23:16.471588] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-22T20:23:16.824724] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:23:16.917629] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-22T20:23:17.116496] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T20:23:17.278863] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T20:23:17.717686] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-22T20:23:18.416837] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T20:23:18.517619] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-22T20:23:19.317633] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-10-22T20:23:19.651230] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-22T20:23:20.029691] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T20:23:20.117667] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-22T20:23:20.162304] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-22T20:23:20.917707] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-22T20:23:21.717933] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-22T20:23:22.069673] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T20:23:22.517702] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-10-22T20:23:22.620211] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T20:23:23.274742] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T20:23:23.317607] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-10-22T20:23:23.767914] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-22T20:23:24.117692] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-22T20:23:24.917735] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-22T20:23:25.143584] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T20:23:25.717719] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-10. [2025-10-22T20:23:25.820270] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T20:23:26.517629] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-22T20:23:26.711407] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T20:23:27.137001] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-22T20:23:27.145039] [INFO ] [REMOTE ] OI: Full fetch complete (68256 records). [2025-10-22T20:23:27.145153] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-10-22T20:23:27.324277] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-10-22T20:23:27.537884] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-10-22T20:23:27.537968] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-10-22T20:23:27.539025] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-10-22T20:23:27.539088] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-10-22T20:23:27.540429] [DEBUG] [LOCAL ] OI: Trimmed 68256 records to 47048 (keeping 200 days of data) [2025-10-22T20:23:27.820029] [DEBUG] [LOCAL ] OI: Primary data saved (47048 records). [2025-10-22T20:23:27.820252] [INFO ] [MAIN ] OI: Full history saved. [2025-10-22T20:23:27.821033] [INFO ] [MAIN ] Update Progress: 1581/2367 symbols completed. OI took 34.0s. Estimated remaining: 1h 41m 7s. Rate: 7.8 symbols/min [2025-10-22T20:23:27.992317] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T20:23:28.050615] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:23:28.100177] [DEBUG] [LOCAL ] OKE: Loaded 53576 existing records from primary storage. [2025-10-22T20:23:28.100476] [INFO ] [MAIN ] OKE: Loaded 53576 existing records. [2025-10-22T20:23:28.122775] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-22T20:23:28.278055] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:23:28.278247] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-22T20:23:28.278294] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-22T20:23:28.278495] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-10-22T20:23:28.278579] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-22T20:23:28.628399] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:23:28.640756] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-22T20:23:28.917730] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-22T20:23:29.717631] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-22T20:23:29.955908] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T20:23:30.517709] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-22T20:23:30.896214] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-22T20:23:31.108217] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T20:23:31.317683] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-22T20:23:32.117689] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-22T20:23:32.326475] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T20:23:32.773050] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T20:23:32.917720] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-22T20:23:33.717665] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-22T20:23:34.180867] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-22T20:23:34.517699] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-10. [2025-10-22T20:23:34.714846] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T20:23:35.317630] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-22T20:23:35.356331] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-22T20:23:35.359471] [INFO ] [REMOTE ] OIA: Full fetch complete (20126 records). [2025-10-22T20:23:35.384004] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-10-22T20:23:35.386146] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T20:23:35.782486] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-10-22T20:23:35.782594] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-10-22T20:23:35.783310] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-10-22T20:23:35.783374] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-10-22T20:23:35.784101] [DEBUG] [LOCAL ] OIA: Trimmed 20126 records to 13047 (keeping 200 days of data) [2025-10-22T20:23:35.865977] [DEBUG] [LOCAL ] OIA: Primary data saved (13047 records). [2025-10-22T20:23:35.866169] [INFO ] [MAIN ] OIA: Full history saved. [2025-10-22T20:23:35.866268] [INFO ] [MAIN ] Update Progress: 1582/2367 symbols completed. OIA took 27.9s. Estimated remaining: 1h 40m 59s. Rate: 7.8 symbols/min [2025-10-22T20:23:36.057439] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:23:36.057789] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-10-22T20:23:36.057845] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-10-22T20:23:36.057996] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-22T20:23:36.058050] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-22T20:23:36.058096] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-22T20:23:36.058131] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-22T20:23:36.124174] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-22T20:23:36.474489] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:23:36.917625] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-22T20:23:37.390898] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-22T20:23:37.717669] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-22T20:23:37.888604] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T20:23:38.373185] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T20:23:38.379773] [INFO ] [REMOTE ] OII: Full fetch complete (61680 records). [2025-10-22T20:23:38.379861] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-22T20:23:38.522978] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-22T20:23:38.808946] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-10-22T20:23:38.809030] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-10-22T20:23:38.810196] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-10-22T20:23:38.810259] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-10-22T20:23:38.811438] [DEBUG] [LOCAL ] OII: Trimmed 61680 records to 41819 (keeping 200 days of data) [2025-10-22T20:23:39.050660] [DEBUG] [LOCAL ] OII: Primary data saved (41819 records). [2025-10-22T20:23:39.050797] [INFO ] [MAIN ] OII: Full history saved. [2025-10-22T20:23:39.050879] [INFO ] [MAIN ] Update Progress: 1583/2367 symbols completed. OII took 29.4s. Estimated remaining: 1h 40m 49s. Rate: 7.8 symbols/min [2025-10-22T20:23:39.223461] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:23:39.279274] [DEBUG] [LOCAL ] OLN: Loaded 52011 existing records from primary storage. [2025-10-22T20:23:39.279613] [INFO ] [MAIN ] OLN: Loaded 52011 existing records. [2025-10-22T20:23:39.343409] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-22T20:23:39.461747] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:23:39.461976] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-22T20:23:39.462024] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-22T20:23:39.462240] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-10-22T20:23:39.462296] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-22T20:23:39.841796] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:23:39.887817] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-22T20:23:40.117694] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-22T20:23:40.794272] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T20:23:40.917623] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-22T20:23:41.403460] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.88 seconds). [2025-10-22T20:23:41.717762] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-22T20:23:42.086388] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-22T20:23:42.431031] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T20:23:42.437882] [INFO ] [REMOTE ] OIS: Full fetch complete (57326 records). [2025-10-22T20:23:42.438038] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-22T20:23:42.523014] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-22T20:23:42.838395] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-10-22T20:23:42.838477] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-10-22T20:23:42.839587] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-10-22T20:23:42.839673] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-10-22T20:23:42.840855] [DEBUG] [LOCAL ] OIS: Trimmed 57326 records to 39794 (keeping 200 days of data) [2025-10-22T20:23:43.069341] [DEBUG] [LOCAL ] OIS: Primary data saved (39794 records). [2025-10-22T20:23:43.069472] [INFO ] [MAIN ] OIS: Full history saved. [2025-10-22T20:23:43.069547] [INFO ] [MAIN ] Update Progress: 1584/2367 symbols completed. OIS took 27.0s. Estimated remaining: 1h 40m 40s. Rate: 7.8 symbols/min [2025-10-22T20:23:43.238793] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:23:43.248438] [DEBUG] [LOCAL ] OLP: Loaded 10120 existing records from primary storage. [2025-10-22T20:23:43.248602] [INFO ] [MAIN ] OLP: Loaded 10120 existing records. [2025-10-22T20:23:43.322918] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-22T20:23:43.425092] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:23:43.425288] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-22T20:23:43.425335] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-22T20:23:43.425547] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-10-22T20:23:43.425603] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-22T20:23:43.779542] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:23:43.848738] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-22T20:23:44.117685] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-22T20:23:44.271196] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-22T20:23:44.917711] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-22T20:23:45.717672] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-22T20:23:46.035635] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-10-22T20:23:46.192385] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-22T20:23:46.330289] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T20:23:46.517700] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-22T20:23:46.607601] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T20:23:47.317712] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-22T20:23:48.117687] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-22T20:23:48.215884] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-22T20:23:48.917780] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-22T20:23:49.295572] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.78 seconds). [2025-10-22T20:23:49.717690] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-22T20:23:49.950537] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-22T20:23:50.446397] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-22T20:23:50.517684] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-22T20:23:51.317727] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-22T20:23:52.117728] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-22T20:23:52.428318] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T20:23:52.514382] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.80 seconds). [2025-10-22T20:23:52.917701] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-22T20:23:53.099090] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T20:23:53.389157] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-22T20:23:53.717673] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-22T20:23:54.517728] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-22T20:23:54.760501] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T20:23:55.317634] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-22T20:23:55.417901] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-22T20:23:55.657889] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-10-22T20:23:56.117680] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-22T20:23:56.917663] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-22T20:23:57.328972] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-22T20:23:57.338088] [INFO ] [REMOTE ] OKE: Full fetch complete (77678 records). [2025-10-22T20:23:57.338240] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-22T20:23:57.733081] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-10-22T20:23:57.729142] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-22T20:23:57.733251] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-10-22T20:23:57.735405] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-10-22T20:23:57.735573] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-10-22T20:23:57.737077] [DEBUG] [LOCAL ] OKE: Trimmed 77678 records to 53576 (keeping 200 days of data) [2025-10-22T20:23:58.053165] [DEBUG] [LOCAL ] OKE: Primary data saved (53576 records). [2025-10-22T20:23:58.053295] [INFO ] [MAIN ] OKE: Full history saved. [2025-10-22T20:23:58.053370] [INFO ] [MAIN ] Update Progress: 1585/2367 symbols completed. OKE took 30.2s. Estimated remaining: 1h 40m 36s. Rate: 7.8 symbols/min [2025-10-22T20:23:58.219276] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:23:58.266579] [DEBUG] [LOCAL ] OMC: Loaded 53292 existing records from primary storage. [2025-10-22T20:23:58.266925] [INFO ] [MAIN ] OMC: Loaded 53292 existing records. [2025-10-22T20:23:58.446230] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:23:58.446570] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-22T20:23:58.446635] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-22T20:23:58.446951] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-10-22T20:23:58.447067] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-22T20:23:58.733183] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T20:23:58.745246] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-22T20:23:58.857302] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:23:58.861857] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-22T20:23:58.957707] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.84 seconds). [2025-10-22T20:23:59.317780] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-22T20:23:59.739706] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T20:24:00.117686] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-22T20:24:00.917790] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-22T20:24:01.458585] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-22T20:24:01.717794] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-10-22T20:24:02.517624] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-22T20:24:02.685518] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T20:24:02.747501] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-22T20:24:02.949625] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-10-22T20:24:03.317674] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-22T20:24:04.117619] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-10-22T20:24:04.279455] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T20:24:04.917710] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-22T20:24:05.249738] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T20:24:05.717671] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-10. [2025-10-22T20:24:06.294988] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.98 seconds). [2025-10-22T20:24:06.438610] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T20:24:06.517610] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-22T20:24:06.818700] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T20:24:06.821204] [INFO ] [REMOTE ] OLP: Full fetch complete (14286 records). [2025-10-22T20:24:06.821281] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-10-22T20:24:07.189934] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-10-22T20:24:07.190032] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-10-22T20:24:07.190354] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-10-22T20:24:07.190394] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-10-22T20:24:07.190873] [DEBUG] [LOCAL ] OLP: Trimmed 14286 records to 10043 (keeping 200 days of data) [2025-10-22T20:24:07.251391] [DEBUG] [LOCAL ] OLP: Primary data saved (10043 records). [2025-10-22T20:24:07.251510] [INFO ] [MAIN ] OLP: Full history saved. [2025-10-22T20:24:07.251588] [INFO ] [MAIN ] Update Progress: 1586/2367 symbols completed. OLP took 24.2s. Estimated remaining: 1h 40m 29s. Rate: 7.8 symbols/min [2025-10-22T20:24:07.325762] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-22T20:24:07.422206] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:24:07.462674] [DEBUG] [LOCAL ] OMF: Loaded 46466 existing records from primary storage. [2025-10-22T20:24:07.463018] [INFO ] [MAIN ] OMF: Loaded 46466 existing records. [2025-10-22T20:24:07.636815] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:24:07.637037] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-22T20:24:07.637093] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-22T20:24:07.637291] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-10-22T20:24:07.637350] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-22T20:24:07.988955] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:24:08.117626] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-22T20:24:08.917712] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-22T20:24:09.467201] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-22T20:24:09.516590] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (3.00 seconds). [2025-10-22T20:24:09.717716] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-22T20:24:10.047124] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T20:24:10.517679] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-22T20:24:10.784610] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T20:24:11.317714] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-22T20:24:11.449942] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T20:24:11.458254] [INFO ] [REMOTE ] OKLO: Full fetch complete (77609 records). [2025-10-22T20:24:11.458380] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-22T20:24:11.459074] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T20:24:11.459159] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:24:11.459202] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:24:11.459267] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-22T20:24:11.459331] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-22T20:24:11.459368] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-10-22T20:24:11.459411] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-10-22T20:24:11.459466] [INFO ] [MAIN ] Update Progress: 1587/2367 symbols completed. OKLO took 35.6s. Estimated remaining: 1h 40m 19s. Rate: 7.8 symbols/min [2025-10-22T20:24:11.642629] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:24:11.683458] [DEBUG] [LOCAL ] OMI: Loaded 46212 existing records from primary storage. [2025-10-22T20:24:11.683886] [INFO ] [MAIN ] OMI: Loaded 46212 existing records. [2025-10-22T20:24:11.897216] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:24:11.899225] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-22T20:24:11.899394] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-22T20:24:11.909781] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-22T20:24:11.910319] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-10-22T20:24:11.910383] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-22T20:24:12.122894] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-22T20:24:12.265171] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:24:12.917620] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-22T20:24:13.089119] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-22T20:24:13.717686] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-22T20:24:14.239897] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-22T20:24:14.517706] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-22T20:24:15.160182] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-22T20:24:15.317673] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-22T20:24:15.369862] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T20:24:16.117671] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-22T20:24:16.306589] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T20:24:16.917671] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-22T20:24:17.335348] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-22T20:24:17.344025] [INFO ] [REMOTE ] OLN: Full fetch complete (74766 records). [2025-10-22T20:24:17.344146] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-22T20:24:17.731622] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-22T20:24:17.731546] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-10-22T20:24:17.732123] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-10-22T20:24:17.733351] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-10-22T20:24:17.733429] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-10-22T20:24:17.735515] [DEBUG] [LOCAL ] OLN: Trimmed 74766 records to 52000 (keeping 200 days of data) [2025-10-22T20:24:17.763263] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T20:24:18.091155] [DEBUG] [LOCAL ] OLN: Primary data saved (52000 records). [2025-10-22T20:24:18.091289] [INFO ] [MAIN ] OLN: Full history saved. [2025-10-22T20:24:18.091367] [INFO ] [MAIN ] Update Progress: 1588/2367 symbols completed. OLN took 39.0s. Estimated remaining: 1h 40m 11s. Rate: 7.8 symbols/min [2025-10-22T20:24:18.256975] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:24:18.265264] [DEBUG] [LOCAL ] ONIT: Loaded 7582 existing records from primary storage. [2025-10-22T20:24:18.265463] [INFO ] [MAIN ] ONIT: Loaded 7582 existing records. [2025-10-22T20:24:18.460194] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:24:18.460447] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-22T20:24:18.460496] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-22T20:24:18.460723] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-10-22T20:24:18.460778] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-22T20:24:18.528030] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-22T20:24:18.815529] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:24:18.880831] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T20:24:19.317687] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-22T20:24:19.642536] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-22T20:24:20.100526] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T20:24:20.117622] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-22T20:24:20.697813] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T20:24:20.917707] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-22T20:24:21.717712] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-10-22T20:24:21.942344] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T20:24:22.518677] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-22T20:24:22.532509] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T20:24:22.533082] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-22T20:24:23.317692] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-22T20:24:24.117669] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-22T20:24:24.357991] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T20:24:24.917714] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-10-22T20:24:25.174180] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T20:24:25.717617] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-22T20:24:26.128894] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T20:24:26.494786] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T20:24:26.517610] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-10-22T20:24:27.317632] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-22T20:24:27.717531] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-22T20:24:28.096338] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T20:24:28.117666] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-10-22T20:24:28.917707] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-10-22T20:24:29.515820] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-22T20:24:29.717633] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-22T20:24:29.855460] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-22T20:24:29.888039] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T20:24:30.517733] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-10-22T20:24:31.317687] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-10-22T20:24:31.369833] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T20:24:31.453266] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T20:24:32.117684] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-10-22T20:24:32.917639] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-22T20:24:33.261703] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-22T20:24:33.299912] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T20:24:33.717673] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-10-22T20:24:34.468609] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-22T20:24:34.517617] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-10. [2025-10-22T20:24:34.595312] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T20:24:34.607268] [INFO ] [REMOTE ] OMF: Full fetch complete (67812 records). [2025-10-22T20:24:34.607416] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-22T20:24:34.987703] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-10-22T20:24:34.987808] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-10-22T20:24:34.988960] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-10-22T20:24:34.989020] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-10-22T20:24:34.990441] [DEBUG] [LOCAL ] OMF: Trimmed 67812 records to 46434 (keeping 200 days of data) [2025-10-22T20:24:35.262018] [DEBUG] [LOCAL ] OMF: Primary data saved (46434 records). [2025-10-22T20:24:35.262141] [INFO ] [MAIN ] OMF: Full history saved. [2025-10-22T20:24:35.262216] [INFO ] [MAIN ] Update Progress: 1589/2367 symbols completed. OMF took 28.0s. Estimated remaining: 1h 40m 8s. Rate: 7.8 symbols/min [2025-10-22T20:24:35.324127] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-22T20:24:35.438505] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:24:35.466156] [DEBUG] [LOCAL ] ONL: Loaded 29123 existing records from primary storage. [2025-10-22T20:24:35.466411] [INFO ] [MAIN ] ONL: Loaded 29123 existing records. [2025-10-22T20:24:35.640064] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:24:35.640265] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-22T20:24:35.640312] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-22T20:24:35.640499] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-10-22T20:24:35.640553] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-22T20:24:35.996712] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:24:36.117626] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-10-22T20:24:36.310985] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T20:24:36.319235] [INFO ] [REMOTE ] OMI: Full fetch complete (65766 records). [2025-10-22T20:24:36.319373] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-10-22T20:24:36.746708] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-10-22T20:24:36.746791] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-10-22T20:24:36.747754] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-10-22T20:24:36.747815] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-10-22T20:24:36.749136] [DEBUG] [LOCAL ] OMI: Trimmed 65766 records to 46218 (keeping 200 days of data) [2025-10-22T20:24:36.937482] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-22T20:24:37.007357] [DEBUG] [LOCAL ] OMI: Primary data saved (46218 records). [2025-10-22T20:24:37.007479] [INFO ] [MAIN ] OMI: Full history saved. [2025-10-22T20:24:37.007555] [INFO ] [MAIN ] Update Progress: 1590/2367 symbols completed. OMI took 25.5s. Estimated remaining: 1h 39m 57s. Rate: 7.8 symbols/min [2025-10-22T20:24:37.068666] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T20:24:37.203992] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T20:24:37.242506] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:24:37.291837] [DEBUG] [LOCAL ] ONON: Loaded 53614 existing records from primary storage. [2025-10-22T20:24:37.292180] [INFO ] [MAIN ] ONON: Loaded 53614 existing records. [2025-10-22T20:24:37.479805] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:24:37.480035] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-22T20:24:37.480090] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-22T20:24:37.480288] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-10-22T20:24:37.480325] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-22T20:24:37.722773] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-22T20:24:37.823879] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:24:38.358322] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T20:24:38.517683] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-22T20:24:39.317722] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-22T20:24:39.840074] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-22T20:24:39.849114] [INFO ] [REMOTE ] OMC: Full fetch complete (77285 records). [2025-10-22T20:24:39.849260] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-22T20:24:40.124120] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-10-22T20:24:40.266527] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-10-22T20:24:40.266608] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-10-22T20:24:40.267900] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-10-22T20:24:40.267979] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-10-22T20:24:40.269503] [DEBUG] [LOCAL ] OMC: Trimmed 77285 records to 53292 (keeping 200 days of data) [2025-10-22T20:24:40.504510] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T20:24:40.617840] [DEBUG] [LOCAL ] OMC: Primary data saved (53292 records). [2025-10-22T20:24:40.617982] [INFO ] [MAIN ] OMC: Full history saved. [2025-10-22T20:24:40.618685] [INFO ] [MAIN ] Update Progress: 1591/2367 symbols completed. OMC took 42.6s. Estimated remaining: 1h 39m 48s. Rate: 7.8 symbols/min [2025-10-22T20:24:40.788148] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:24:40.817728] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-22T20:24:40.842480] [DEBUG] [LOCAL ] ONTF: Loaded 22574 existing records from primary storage. [2025-10-22T20:24:40.842747] [INFO ] [MAIN ] ONTF: Loaded 22574 existing records. [2025-10-22T20:24:40.928021] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-22T20:24:41.027225] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:24:41.027607] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-22T20:24:41.027686] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-22T20:24:41.027994] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-10-22T20:24:41.028049] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-22T20:24:41.138922] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T20:24:41.453622] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:24:41.717734] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-22T20:24:42.477617] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T20:24:42.517630] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-22T20:24:42.868929] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T20:24:43.317689] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-22T20:24:44.101127] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T20:24:44.117686] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-22T20:24:44.379298] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T20:24:44.917783] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-10-22T20:24:45.589330] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T20:24:45.717714] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-22T20:24:45.809903] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T20:24:46.517732] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-10-22T20:24:47.274606] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T20:24:47.317623] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-22T20:24:47.378877] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T20:24:48.117705] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-22T20:24:48.736283] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T20:24:48.917622] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-22T20:24:49.311047] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-22T20:24:49.717768] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-22T20:24:50.228515] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T20:24:50.489757] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-22T20:24:50.517637] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-22T20:24:51.317630] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-22T20:24:51.699992] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T20:24:52.117684] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-22T20:24:52.618635] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T20:24:52.917696] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-22T20:24:53.717700] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-10. [2025-10-22T20:24:54.103260] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-22T20:24:54.198626] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-22T20:24:54.502636] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-22T20:24:54.504149] [INFO ] [REMOTE ] ONIT: Full fetch complete (11018 records). [2025-10-22T20:24:54.504217] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-10-22T20:24:54.524577] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-22T20:24:54.862333] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-10-22T20:24:54.862406] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-10-22T20:24:54.862677] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-10-22T20:24:54.862736] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-10-22T20:24:54.863147] [DEBUG] [LOCAL ] ONIT: Trimmed 11018 records to 7526 (keeping 200 days of data) [2025-10-22T20:24:54.907130] [DEBUG] [LOCAL ] ONIT: Primary data saved (7526 records). [2025-10-22T20:24:54.907257] [INFO ] [MAIN ] ONIT: Full history saved. [2025-10-22T20:24:54.907348] [INFO ] [MAIN ] Update Progress: 1592/2367 symbols completed. ONIT took 36.8s. Estimated remaining: 1h 39m 43s. Rate: 7.8 symbols/min [2025-10-22T20:24:55.089192] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:24:55.130407] [DEBUG] [LOCAL ] ONTO: Loaded 47225 existing records from primary storage. [2025-10-22T20:24:55.130744] [INFO ] [MAIN ] ONTO: Loaded 47225 existing records. [2025-10-22T20:24:55.306756] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:24:55.306960] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-22T20:24:55.307008] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-22T20:24:55.307376] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-10-22T20:24:55.307433] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-22T20:24:55.330872] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-22T20:24:55.672736] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:24:55.777063] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T20:24:55.781161] [INFO ] [REMOTE ] ONL: Full fetch complete (42592 records). [2025-10-22T20:24:55.781236] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-22T20:24:56.122815] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-22T20:24:56.161293] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-10-22T20:24:56.161433] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-10-22T20:24:56.162320] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-10-22T20:24:56.162384] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-10-22T20:24:56.163356] [DEBUG] [LOCAL ] ONL: Trimmed 42592 records to 28911 (keeping 200 days of data) [2025-10-22T20:24:56.327450] [DEBUG] [LOCAL ] ONL: Primary data saved (28911 records). [2025-10-22T20:24:56.327566] [INFO ] [MAIN ] ONL: Full history saved. [2025-10-22T20:24:56.327665] [INFO ] [MAIN ] Update Progress: 1593/2367 symbols completed. ONL took 21.1s. Estimated remaining: 1h 39m 32s. Rate: 7.8 symbols/min [2025-10-22T20:24:56.498079] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:24:56.514636] [DEBUG] [LOCAL ] OOMA: Loaded 18367 existing records from primary storage. [2025-10-22T20:24:56.514874] [INFO ] [MAIN ] OOMA: Loaded 18367 existing records. [2025-10-22T20:24:56.689953] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:24:56.690135] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-22T20:24:56.690189] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-22T20:24:56.690390] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-10-22T20:24:56.690444] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-22T20:24:56.931169] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-22T20:24:57.043347] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:24:57.472505] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T20:24:57.602972] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-22T20:24:57.717614] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-22T20:24:58.517699] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-22T20:24:58.826616] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-22T20:24:59.317708] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-22T20:24:59.398073] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T20:24:59.842503] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-22T20:25:00.117673] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-22T20:25:00.399611] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T20:25:00.917719] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-22T20:25:01.717685] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-22T20:25:02.222407] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T20:25:02.517724] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-22T20:25:02.572922] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-22T20:25:02.757682] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-22T20:25:03.317721] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-22T20:25:04.117668] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-22T20:25:04.175447] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T20:25:04.917715] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-22T20:25:04.959511] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-22T20:25:04.965318] [INFO ] [REMOTE ] ONTF: Full fetch complete (31569 records). [2025-10-22T20:25:04.965521] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-22T20:25:05.372244] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-10-22T20:25:05.372350] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-10-22T20:25:05.373120] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-10-22T20:25:05.373201] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-10-22T20:25:05.374181] [DEBUG] [LOCAL ] ONTF: Trimmed 31569 records to 22531 (keeping 200 days of data) [2025-10-22T20:25:05.487618] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-22T20:25:05.541251] [DEBUG] [LOCAL ] ONTF: Primary data saved (22531 records). [2025-10-22T20:25:05.541376] [INFO ] [MAIN ] ONTF: Full history saved. [2025-10-22T20:25:05.541452] [INFO ] [MAIN ] Update Progress: 1594/2367 symbols completed. ONTF took 24.9s. Estimated remaining: 1h 39m 25s. Rate: 7.8 symbols/min [2025-10-22T20:25:05.708110] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:25:05.722482] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-22T20:25:05.735026] [DEBUG] [LOCAL ] OPAD: Loaded 26134 existing records from primary storage. [2025-10-22T20:25:05.735289] [INFO ] [MAIN ] OPAD: Loaded 26134 existing records. [2025-10-22T20:25:05.915291] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:25:05.915518] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-22T20:25:05.915571] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-22T20:25:05.915807] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-10-22T20:25:05.915883] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-22T20:25:06.276235] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:25:06.517671] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-22T20:25:06.546567] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T20:25:07.317697] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-22T20:25:07.834012] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T20:25:08.123581] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-22T20:25:08.144034] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-22T20:25:08.893243] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T20:25:08.917634] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-22T20:25:09.154554] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T20:25:09.717693] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-22T20:25:10.517628] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-22T20:25:10.901462] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T20:25:11.300862] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-22T20:25:11.317629] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-22T20:25:12.117760] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-22T20:25:12.738623] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-22T20:25:12.874545] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T20:25:12.917609] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-22T20:25:13.614112] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-22T20:25:13.707466] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-22T20:25:13.717609] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-22T20:25:14.517680] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-22T20:25:14.685338] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-22T20:25:15.317697] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-22T20:25:15.773427] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-22T20:25:16.117681] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-22T20:25:16.917629] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-22T20:25:17.200274] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T20:25:17.359182] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T20:25:17.717688] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-22T20:25:18.462356] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T20:25:18.517612] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-22T20:25:18.820709] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T20:25:18.830978] [INFO ] [REMOTE ] ONON: Full fetch complete (77770 records). [2025-10-22T20:25:18.831202] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-22T20:25:19.263251] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-10-22T20:25:19.263378] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-10-22T20:25:19.264970] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-10-22T20:25:19.265064] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-10-22T20:25:19.267237] [DEBUG] [LOCAL ] ONON: Trimmed 77770 records to 53613 (keeping 200 days of data) [2025-10-22T20:25:19.329006] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-22T20:25:19.376128] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-22T20:25:19.635326] [DEBUG] [LOCAL ] ONON: Primary data saved (53613 records). [2025-10-22T20:25:19.635542] [INFO ] [MAIN ] ONON: Full history saved. [2025-10-22T20:25:19.635683] [INFO ] [MAIN ] Update Progress: 1595/2367 symbols completed. ONON took 42.6s. Estimated remaining: 1h 39m 21s. Rate: 7.8 symbols/min [2025-10-22T20:25:19.861149] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:25:19.908750] [DEBUG] [LOCAL ] OPFI: Loaded 46049 existing records from primary storage. [2025-10-22T20:25:19.909208] [INFO ] [MAIN ] OPFI: Loaded 46049 existing records. [2025-10-22T20:25:20.097170] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:25:20.097478] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-22T20:25:20.097534] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-22T20:25:20.097932] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-10-22T20:25:20.097993] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-22T20:25:20.122817] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-22T20:25:20.483560] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:25:20.671359] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-22T20:25:20.917685] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-10-22T20:25:21.458403] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-22T20:25:21.717686] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-22T20:25:22.108363] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T20:25:22.517687] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-22T20:25:23.317766] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-10-22T20:25:23.919154] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-22T20:25:24.117632] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-22T20:25:24.576852] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-22T20:25:24.606548] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-22T20:25:24.917701] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-22T20:25:25.717715] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-10. [2025-10-22T20:25:26.272075] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-22T20:25:26.517660] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-22T20:25:26.793502] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T20:25:26.796744] [INFO ] [REMOTE ] OOMA: Full fetch complete (25853 records). [2025-10-22T20:25:26.796860] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-10-22T20:25:27.173567] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-10-22T20:25:27.173685] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-10-22T20:25:27.174274] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-10-22T20:25:27.174379] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-10-22T20:25:27.175085] [DEBUG] [LOCAL ] OOMA: Trimmed 25853 records to 18269 (keeping 200 days of data) [2025-10-22T20:25:27.279881] [DEBUG] [LOCAL ] OOMA: Primary data saved (18269 records). [2025-10-22T20:25:27.280078] [INFO ] [MAIN ] OOMA: Full history saved. [2025-10-22T20:25:27.280176] [INFO ] [MAIN ] Update Progress: 1596/2367 symbols completed. OOMA took 31.0s. Estimated remaining: 1h 39m 13s. Rate: 7.8 symbols/min [2025-10-22T20:25:27.322696] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-22T20:25:27.466996] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:25:27.480982] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-22T20:25:27.502102] [DEBUG] [LOCAL ] OPP: Loaded 12372 existing records from primary storage. [2025-10-22T20:25:27.502300] [INFO ] [MAIN ] OPP: Loaded 12372 existing records. [2025-10-22T20:25:27.677148] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:25:27.677353] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-22T20:25:27.677400] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-22T20:25:27.677581] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-10-22T20:25:27.677639] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-22T20:25:28.029535] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:25:28.117725] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-22T20:25:28.507074] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T20:25:28.917666] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-22T20:25:29.099036] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T20:25:29.336414] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T20:25:29.717703] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-22T20:25:30.517636] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-22T20:25:30.917805] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T20:25:30.925587] [INFO ] [REMOTE ] OPAD: Full fetch complete (28966 records). [2025-10-22T20:25:30.925700] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-22T20:25:31.300041] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-10-22T20:25:31.300219] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-10-22T20:25:31.301332] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-10-22T20:25:31.301450] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-10-22T20:25:31.302599] [DEBUG] [LOCAL ] OPAD: Trimmed 28966 records to 26424 (keeping 200 days of data) [2025-10-22T20:25:31.347687] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-22T20:25:31.454891] [DEBUG] [LOCAL ] OPAD: Primary data saved (26424 records). [2025-10-22T20:25:31.455130] [INFO ] [MAIN ] OPAD: Full history saved. [2025-10-22T20:25:31.455334] [INFO ] [MAIN ] Update Progress: 1597/2367 symbols completed. OPAD took 25.9s. Estimated remaining: 1h 39m 3s. Rate: 7.8 symbols/min [2025-10-22T20:25:31.484915] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T20:25:32.081626] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T20:25:32.117676] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-22T20:25:32.385203] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-22T20:25:32.917837] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-22T20:25:33.717626] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-22T20:25:33.851149] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-22T20:25:34.107519] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-22T20:25:34.517672] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-22T20:25:35.317667] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-22T20:25:35.551401] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T20:25:35.592261] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-22T20:25:36.117712] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-22T20:25:36.917623] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-22T20:25:37.144405] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T20:25:37.177022] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-22T20:25:37.717676] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-22T20:25:38.517698] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-22T20:25:38.652479] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T20:25:38.698134] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T20:25:38.706612] [INFO ] [REMOTE ] ONTO: Full fetch complete (67384 records). [2025-10-22T20:25:38.706839] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-22T20:25:39.138490] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-10-22T20:25:39.138583] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-10-22T20:25:39.139591] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-10-22T20:25:39.139683] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-10-22T20:25:39.141034] [DEBUG] [LOCAL ] ONTO: Trimmed 67384 records to 47210 (keeping 200 days of data) [2025-10-22T20:25:39.319055] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-22T20:25:39.427858] [DEBUG] [LOCAL ] ONTO: Primary data saved (47210 records). [2025-10-22T20:25:39.428006] [INFO ] [MAIN ] ONTO: Full history saved. [2025-10-22T20:25:39.428092] [INFO ] [MAIN ] Update Progress: 1598/2367 symbols completed. ONTO took 44.5s. Estimated remaining: 1h 38m 56s. Rate: 7.8 symbols/min [2025-10-22T20:25:40.388885] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-22T20:25:40.393204] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-22T20:25:40.462370] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T20:25:40.917687] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-22T20:25:41.369877] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-22T20:25:41.717679] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-22T20:25:42.751626] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T20:25:42.762260] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-22T20:25:42.792317] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T20:25:43.317773] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-22T20:25:44.391937] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T20:25:44.395202] [INFO ] [REMOTE ] OPP: Full fetch complete (17393 records). [2025-10-22T20:25:44.395278] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-22T20:25:44.782977] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-10-22T20:25:44.783186] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-10-22T20:25:44.783680] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-10-22T20:25:44.783762] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-10-22T20:25:44.784798] [DEBUG] [LOCAL ] OPP: Trimmed 17393 records to 12339 (keeping 200 days of data) [2025-10-22T20:25:44.853152] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-22T20:25:44.883154] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-22T20:25:44.910578] [DEBUG] [LOCAL ] OPP: Primary data saved (12339 records). [2025-10-22T20:25:44.910771] [INFO ] [MAIN ] OPP: Full history saved. [2025-10-22T20:25:44.910868] [INFO ] [MAIN ] Update Progress: 1599/2367 symbols completed. OPP took 17.6s. Estimated remaining: 1h 38m 47s. Rate: 7.8 symbols/min [2025-10-22T20:25:46.741564] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T20:25:46.749030] [INFO ] [REMOTE ] OPFI: Full fetch complete (68669 records). [2025-10-22T20:25:46.749166] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-22T20:25:47.136388] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-10-22T20:25:47.136468] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-10-22T20:25:47.137440] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-10-22T20:25:47.137503] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-10-22T20:25:47.139097] [DEBUG] [LOCAL ] OPFI: Trimmed 68669 records to 46022 (keeping 200 days of data) [2025-10-22T20:25:47.413665] [DEBUG] [LOCAL ] OPFI: Primary data saved (46022 records). [2025-10-22T20:25:47.413842] [INFO ] [MAIN ] OPFI: Full history saved. [2025-10-22T20:25:47.413938] [INFO ] [MAIN ] Update Progress: 1600/2367 symbols completed. OPFI took 27.8s. Estimated remaining: 1h 38m 37s. Rate: 7.8 symbols/min [2025-10-22T20:25:47.969199] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:25:48.031779] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:25:48.100009] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:25:48.132305] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:25:48.132637] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-22T20:25:48.132860] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-22T20:25:48.133054] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-22T20:25:48.133099] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-22T20:25:48.133142] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-22T20:25:48.133173] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-22T20:25:48.390983] [DEBUG] [LOCAL ] ORA: Loaded 33184 existing records from primary storage. [2025-10-22T20:25:48.447070] [DEBUG] [LOCAL ] ORC: Loaded 52485 existing records from primary storage. [2025-10-22T20:25:48.477282] [DEBUG] [LOCAL ] OR: Loaded 46840 existing records from primary storage. [2025-10-22T20:25:48.455936] [INFO ] [MAIN ] ORA: Loaded 33184 existing records. [2025-10-22T20:25:48.518473] [INFO ] [MAIN ] ORC: Loaded 52485 existing records. [2025-10-22T20:25:48.527963] [INFO ] [MAIN ] OR: Loaded 46840 existing records. [2025-10-22T20:25:48.910462] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:25:48.920216] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-22T20:25:49.098009] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:25:49.165083] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:25:49.136881] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:25:49.165398] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-22T20:25:49.165215] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-22T20:25:49.165669] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-22T20:25:49.165596] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-22T20:25:49.165803] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-22T20:25:49.165900] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-22T20:25:49.166134] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-10-22T20:25:49.166181] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-10-22T20:25:49.166107] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-10-22T20:25:49.166473] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-22T20:25:49.166516] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-22T20:25:49.166409] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-22T20:25:50.298624] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T20:25:50.370432] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-22T20:25:50.536804] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:25:50.568321] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:25:50.596916] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-22T20:25:50.597135] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-22T20:25:50.626444] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:25:50.626919] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-22T20:25:51.324895] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-22T20:25:51.326511] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-22T20:25:52.137636] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T20:25:52.139382] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-22T20:25:52.356102] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T20:25:52.367084] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-22T20:25:52.444290] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T20:25:52.452107] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-22T20:25:52.847891] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-22T20:25:52.857955] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-22T20:25:53.092363] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-22T20:25:53.094615] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-22T20:25:53.996251] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-22T20:25:53.998924] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-22T20:25:54.027085] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T20:25:54.126757] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T20:25:54.382976] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T20:25:54.517621] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-22T20:25:54.631095] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-22T20:25:55.317684] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-22T20:25:56.117707] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-22T20:25:56.268444] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T20:25:56.631353] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-22T20:25:56.917715] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-22T20:25:57.718618] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-22T20:25:57.721396] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-22T20:25:57.801867] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T20:25:58.517676] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-22T20:25:59.317676] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-22T20:25:59.485563] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T20:25:59.737767] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T20:26:00.117724] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-22T20:26:00.554164] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-22T20:26:00.917700] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-22T20:26:00.924573] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T20:26:00.926299] [INFO ] [REMOTE ] OPY: Full fetch complete (10227 records). [2025-10-22T20:26:00.926370] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-22T20:26:01.103768] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T20:26:01.104007] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:26:01.104075] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:26:01.104143] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-22T20:26:01.104216] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-22T20:26:01.104270] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-22T20:26:01.104313] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-22T20:26:01.104367] [INFO ] [MAIN ] Update Progress: 1601/2367 symbols completed. OPY took 13.7s. Estimated remaining: 1h 38m 32s. Rate: 7.8 symbols/min [2025-10-22T20:26:01.275063] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:26:01.275238] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-22T20:26:01.275277] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-22T20:26:01.275403] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-22T20:26:01.275443] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-22T20:26:01.275483] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-22T20:26:01.275514] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-22T20:26:01.639408] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:26:01.717706] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-22T20:26:02.517730] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-22T20:26:02.819415] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-22T20:26:03.317708] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-22T20:26:04.034160] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-22T20:26:04.117634] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-22T20:26:04.293195] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-22T20:26:04.917690] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-22T20:26:05.188085] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T20:26:05.518228] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T20:26:05.717674] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-22T20:26:06.517705] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-22T20:26:07.317631] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-22T20:26:07.347581] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T20:26:07.496680] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-22T20:26:08.117788] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-22T20:26:08.906813] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-22T20:26:08.918226] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-22T20:26:09.025139] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T20:26:09.717703] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-22T20:26:09.761469] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T20:26:10.517728] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-22T20:26:11.317708] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-22T20:26:11.541503] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-22T20:26:11.780021] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-22T20:26:12.117665] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-22T20:26:12.184302] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T20:26:12.917677] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-22T20:26:13.037921] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T20:26:13.717698] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-22T20:26:14.517681] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-22T20:26:14.830139] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-10-22T20:26:15.254163] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-22T20:26:15.317771] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-22T20:26:15.584934] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T20:26:16.117715] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-22T20:26:16.175612] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T20:26:16.181976] [INFO ] [REMOTE ] ORA: Full fetch complete (49016 records). [2025-10-22T20:26:16.182066] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-22T20:26:16.562811] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-10-22T20:26:16.562922] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-10-22T20:26:16.563839] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-10-22T20:26:16.563903] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-10-22T20:26:16.564932] [DEBUG] [LOCAL ] ORA: Trimmed 49016 records to 33147 (keeping 200 days of data) [2025-10-22T20:26:16.764413] [DEBUG] [LOCAL ] ORA: Primary data saved (33147 records). [2025-10-22T20:26:16.764542] [INFO ] [MAIN ] ORA: Full history saved. [2025-10-22T20:26:16.764619] [INFO ] [MAIN ] Update Progress: 1602/2367 symbols completed. ORA took 29.3s. Estimated remaining: 1h 38m 28s. Rate: 7.8 symbols/min [2025-10-22T20:26:16.931348] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:26:16.928141] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-22T20:26:16.931538] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-22T20:26:16.932317] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-22T20:26:16.932437] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-22T20:26:16.932479] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-22T20:26:16.932522] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-22T20:26:16.932555] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-22T20:26:17.319227] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:26:17.717721] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-22T20:26:18.110895] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-10-22T20:26:18.332448] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-22T20:26:18.517667] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-22T20:26:18.837285] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T20:26:19.111200] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T20:26:19.317692] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-22T20:26:20.117765] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-22T20:26:20.917672] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-22T20:26:21.033837] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T20:26:21.285309] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.77 seconds). [2025-10-22T20:26:21.717702] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-22T20:26:22.235556] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T20:26:22.339283] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-22T20:26:22.517639] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-22T20:26:23.317774] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-10. [2025-10-22T20:26:24.117633] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-22T20:26:24.485945] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T20:26:24.921204] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-22T20:26:24.927302] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (3.21 seconds). [2025-10-22T20:26:25.327689] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-22T20:26:25.336385] [INFO ] [REMOTE ] ORC: Full fetch complete (75590 records). [2025-10-22T20:26:25.336534] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-10-22T20:26:25.732229] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-22T20:26:25.732498] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-10-22T20:26:25.733427] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-10-22T20:26:25.734491] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-10-22T20:26:25.734595] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-10-22T20:26:25.743917] [DEBUG] [LOCAL ] ORC: Trimmed 75590 records to 52479 (keeping 200 days of data) [2025-10-22T20:26:25.758509] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T20:26:25.824576] [INFO ] [REMOTE ] OR: Full fetch complete (66908 records). [2025-10-22T20:26:25.851399] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-22T20:26:26.433324] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-10-22T20:26:26.439276] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-10-22T20:26:26.440540] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-10-22T20:26:26.456433] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-10-22T20:26:26.471295] [DEBUG] [LOCAL ] OR: Trimmed 66908 records to 46846 (keeping 200 days of data) [2025-10-22T20:26:26.534298] [DEBUG] [LOCAL ] ORC: Primary data saved (52479 records). [2025-10-22T20:26:26.542300] [INFO ] [MAIN ] ORC: Full history saved. [2025-10-22T20:26:26.542805] [INFO ] [MAIN ] Update Progress: 1603/2367 symbols completed. ORC took 39.1s. Estimated remaining: 1h 38m 21s. Rate: 7.8 symbols/min [2025-10-22T20:26:26.760528] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:26:26.902804] [DEBUG] [LOCAL ] ORN: Loaded 30771 existing records from primary storage. [2025-10-22T20:26:26.908000] [INFO ] [MAIN ] ORN: Loaded 30771 existing records. [2025-10-22T20:26:27.047543] [DEBUG] [LOCAL ] OR: Primary data saved (46846 records). [2025-10-22T20:26:27.084372] [INFO ] [MAIN ] OR: Full history saved. [2025-10-22T20:26:27.090274] [INFO ] [MAIN ] Update Progress: 1604/2367 symbols completed. OR took 39.7s. Estimated remaining: 1h 38m 10s. Rate: 7.8 symbols/min [2025-10-22T20:26:27.107452] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-22T20:26:27.252371] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-22T20:26:27.326536] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:26:27.332192] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-22T20:26:27.353202] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-22T20:26:27.379244] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-10-22T20:26:27.399854] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:26:27.399969] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-22T20:26:27.789588] [DEBUG] [LOCAL ] OSCR: Loaded 53769 existing records from primary storage. [2025-10-22T20:26:27.809134] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:26:27.809450] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-22T20:26:27.809560] [INFO ] [MAIN ] OSCR: Loaded 53769 existing records. [2025-10-22T20:26:27.985608] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:26:27.985827] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-22T20:26:27.985918] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-22T20:26:27.986116] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-10-22T20:26:27.986156] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-22T20:26:28.337012] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:26:28.337338] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-22T20:26:28.527963] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-22T20:26:28.917710] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-22T20:26:29.182841] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-22T20:26:29.344633] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T20:26:29.717729] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-22T20:26:30.490232] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-22T20:26:30.517611] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-22T20:26:31.317723] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-22T20:26:31.625111] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-22T20:26:31.902035] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.98 seconds). [2025-10-22T20:26:32.117673] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-22T20:26:32.660764] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T20:26:32.770923] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-22T20:26:32.817494] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-22T20:26:32.826321] [INFO ] [REMOTE ] ORCL: Full fetch complete (77213 records). [2025-10-22T20:26:32.826486] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-22T20:26:32.827424] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T20:26:32.827520] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:26:32.827563] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:26:32.827668] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-22T20:26:32.827821] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-22T20:26:32.827884] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-22T20:26:32.827930] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-22T20:26:32.827989] [INFO ] [MAIN ] Update Progress: 1605/2367 symbols completed. ORCL took 31.7s. Estimated remaining: 1h 38m 2s. Rate: 7.8 symbols/min [2025-10-22T20:26:32.922876] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-22T20:26:33.006801] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:26:33.006984] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-22T20:26:33.007021] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-22T20:26:33.007139] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-22T20:26:33.007180] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-22T20:26:33.007222] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-22T20:26:33.007257] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-22T20:26:33.371959] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:26:33.717688] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-22T20:26:34.517673] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-22T20:26:35.036390] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-22T20:26:35.317703] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-22T20:26:35.639689] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T20:26:36.073613] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T20:26:36.117624] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-22T20:26:36.726309] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-22T20:26:36.917676] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-22T20:26:37.717662] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-22T20:26:38.119495] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T20:26:38.517630] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-22T20:26:38.756702] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T20:26:38.912947] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-22T20:26:39.317687] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-22T20:26:40.117714] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-22T20:26:40.316265] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T20:26:40.917775] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-22T20:26:41.192581] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T20:26:41.201346] [INFO ] [REMOTE ] ORI: Full fetch complete (70498 records). [2025-10-22T20:26:41.201466] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-22T20:26:41.416816] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T20:26:41.418251] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:26:41.418343] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:26:41.418433] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-22T20:26:41.418513] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-22T20:26:41.418576] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-22T20:26:41.418633] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-22T20:26:41.418745] [INFO ] [MAIN ] Update Progress: 1606/2367 symbols completed. ORI took 24.7s. Estimated remaining: 1h 37m 54s. Rate: 7.8 symbols/min [2025-10-22T20:26:41.630719] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:26:41.630931] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-22T20:26:41.630973] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-22T20:26:41.631115] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-22T20:26:41.631189] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-22T20:26:41.631252] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-22T20:26:41.631287] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-22T20:26:41.722897] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-22T20:26:42.163110] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:26:42.517682] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-01. [2025-10-22T20:26:43.023510] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T20:26:43.023791] [WARN ] [REMOTE ] OTF: No data returned for month 2025-01 [2025-10-22T20:26:43.023880] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T20:26:43.023946] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-22T20:26:43.024015] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T20:26:43.024084] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-22T20:26:43.024168] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-22T20:26:43.024223] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-22T20:26:43.024266] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-22T20:26:43.024313] [INFO ] [MAIN ] Update Progress: 1607/2367 symbols completed. OTF took 1.6s. Estimated remaining: 1h 37m 44s. Rate: 7.8 symbols/min [2025-10-22T20:26:43.221043] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-22T20:26:43.223916] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:26:43.274138] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (3.16 seconds). [2025-10-22T20:26:43.322302] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-22T20:26:43.341333] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T20:26:43.370889] [DEBUG] [LOCAL ] OTIS: Loaded 52718 existing records from primary storage. [2025-10-22T20:26:43.371251] [INFO ] [MAIN ] OTIS: Loaded 52718 existing records. [2025-10-22T20:26:43.545766] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:26:43.545996] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-22T20:26:43.546043] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-22T20:26:43.546228] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-10-22T20:26:43.546274] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-22T20:26:43.894132] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:26:44.117715] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-22T20:26:44.917703] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-22T20:26:45.717670] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-22T20:26:45.938603] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T20:26:46.043703] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-10-22T20:26:46.258562] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-22T20:26:46.517685] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-22T20:26:47.317669] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-22T20:26:47.582459] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T20:26:48.117703] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-22T20:26:48.332029] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T20:26:48.917639] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-22T20:26:49.717624] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-22T20:26:49.978046] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T20:26:50.189274] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T20:26:50.269917] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-10-22T20:26:50.517667] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-22T20:26:51.245149] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T20:26:51.317664] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-22T20:26:52.117627] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-22T20:26:52.537147] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-22T20:26:52.891637] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T20:26:52.917617] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-22T20:26:53.717705] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-22T20:26:54.434220] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T20:26:54.517625] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-22T20:26:54.873486] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-10-22T20:26:55.317676] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-22T20:26:55.536439] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T20:26:55.541258] [INFO ] [REMOTE ] ORN: Full fetch complete (45611 records). [2025-10-22T20:26:55.541347] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-22T20:26:55.918395] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-10-22T20:26:55.918532] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-10-22T20:26:55.919399] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-10-22T20:26:55.919548] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-10-22T20:26:55.951031] [DEBUG] [LOCAL ] ORN: Trimmed 45611 records to 30727 (keeping 200 days of data) [2025-10-22T20:26:55.952701] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-22T20:26:56.120724] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-22T20:26:56.132537] [DEBUG] [LOCAL ] ORN: Primary data saved (30727 records). [2025-10-22T20:26:56.132767] [INFO ] [MAIN ] ORN: Full history saved. [2025-10-22T20:26:56.132849] [INFO ] [MAIN ] Update Progress: 1608/2367 symbols completed. ORN took 29.6s. Estimated remaining: 1h 37m 38s. Rate: 7.8 symbols/min [2025-10-22T20:26:56.300211] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:26:56.342109] [DEBUG] [LOCAL ] OUT: Loaded 47722 existing records from primary storage. [2025-10-22T20:26:56.342458] [INFO ] [MAIN ] OUT: Loaded 47722 existing records. [2025-10-22T20:26:56.522159] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:26:56.522429] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-22T20:26:56.522526] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-22T20:26:56.523200] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-10-22T20:26:56.523257] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-22T20:26:56.912101] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:26:56.906907] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T20:26:56.920357] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-22T20:26:57.717664] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-22T20:26:58.064696] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-22T20:26:58.445088] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T20:26:58.517623] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-22T20:26:59.317673] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-22T20:26:59.441024] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T20:27:00.117616] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-22T20:27:00.297284] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T20:27:00.836249] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T20:27:00.917676] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-10-22T20:27:01.717719] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-22T20:27:02.517627] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-22T20:27:02.738900] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-22T20:27:02.872557] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T20:27:02.920293] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-22T20:27:03.317700] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-22T20:27:04.117677] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-10-22T20:27:04.413535] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T20:27:04.917705] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-22T20:27:05.099764] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T20:27:05.717668] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-22T20:27:06.068812] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T20:27:06.517766] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-22T20:27:07.317625] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-10-22T20:27:07.733740] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-10 (2.82 seconds). [2025-10-22T20:27:07.742940] [INFO ] [REMOTE ] OSCR: Full fetch complete (77758 records). [2025-10-22T20:27:07.743116] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-22T20:27:08.203459] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-10-22T20:27:08.199692] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-22T20:27:08.203840] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-10-22T20:27:08.215722] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-10-22T20:27:08.215930] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-10-22T20:27:08.217831] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-10-22T20:27:08.246690] [DEBUG] [LOCAL ] OSCR: Trimmed 77758 records to 53769 (keeping 200 days of data) [2025-10-22T20:27:08.247714] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T20:27:08.316836] [INFO ] [REMOTE ] OSK: Full fetch complete (61303 records). [2025-10-22T20:27:08.343715] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-22T20:27:08.686784] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T20:27:08.699027] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:27:08.732342] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:27:08.739357] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-22T20:27:08.739778] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-22T20:27:08.757917] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-22T20:27:08.762076] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-22T20:27:08.763062] [INFO ] [MAIN ] Update Progress: 1609/2367 symbols completed. OSK took 35.9s. Estimated remaining: 1h 37m 33s. Rate: 7.8 symbols/min [2025-10-22T20:27:08.903927] [DEBUG] [LOCAL ] OSCR: Primary data saved (53769 records). [2025-10-22T20:27:08.909302] [INFO ] [MAIN ] OSCR: Full history saved. [2025-10-22T20:27:08.939908] [INFO ] [MAIN ] Update Progress: 1610/2367 symbols completed. OSCR took 41.8s. Estimated remaining: 1h 37m 22s. Rate: 7.8 symbols/min [2025-10-22T20:27:08.965341] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:27:09.137793] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:27:09.166368] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T20:27:09.191034] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-10-22T20:27:09.212273] [DEBUG] [LOCAL ] OVV: Loaded 53467 existing records from primary storage. [2025-10-22T20:27:09.212705] [INFO ] [MAIN ] OVV: Loaded 53467 existing records. [2025-10-22T20:27:09.421943] [DEBUG] [LOCAL ] OWL: Loaded 53557 existing records from primary storage. [2025-10-22T20:27:09.420713] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:27:09.422137] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-22T20:27:09.422287] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-22T20:27:09.422397] [INFO ] [MAIN ] OWL: Loaded 53557 existing records. [2025-10-22T20:27:09.488267] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-10-22T20:27:09.504525] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-22T20:27:09.714323] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:27:09.729931] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-22T20:27:09.748183] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-22T20:27:09.765066] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-10-22T20:27:09.785250] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-22T20:27:10.130537] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:27:10.148034] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-22T20:27:10.355826] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:27:10.387710] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-22T20:27:10.517632] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-22T20:27:10.986767] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T20:27:11.317756] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-10. [2025-10-22T20:27:12.119018] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-22T20:27:12.117876] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-10-22T20:27:12.513372] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T20:27:12.917705] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-22T20:27:13.122386] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T20:27:13.131066] [INFO ] [REMOTE ] OTIS: Full fetch complete (76390 records). [2025-10-22T20:27:13.131222] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-10-22T20:27:13.520190] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-10-22T20:27:13.520271] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-10-22T20:27:13.521404] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-10-22T20:27:13.521467] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-10-22T20:27:13.522914] [DEBUG] [LOCAL ] OTIS: Trimmed 76390 records to 52700 (keeping 200 days of data) [2025-10-22T20:27:13.734791] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-22T20:27:13.843553] [DEBUG] [LOCAL ] OTIS: Primary data saved (52700 records). [2025-10-22T20:27:13.843703] [INFO ] [MAIN ] OTIS: Full history saved. [2025-10-22T20:27:13.843792] [INFO ] [MAIN ] Update Progress: 1611/2367 symbols completed. OTIS took 30.8s. Estimated remaining: 1h 37m 13s. Rate: 7.8 symbols/min [2025-10-22T20:27:14.036080] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:27:14.069434] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T20:27:14.084246] [DEBUG] [LOCAL ] OWLT: Loaded 9535 existing records from primary storage. [2025-10-22T20:27:14.084447] [INFO ] [MAIN ] OWLT: Loaded 9535 existing records. [2025-10-22T20:27:14.256116] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:27:14.256322] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-22T20:27:14.256368] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-22T20:27:14.256726] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-10-22T20:27:14.256784] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-22T20:27:14.526402] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-10-22T20:27:14.610127] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:27:14.719121] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T20:27:15.317680] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-22T20:27:15.882859] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-22T20:27:16.117694] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-22T20:27:16.734790] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-22T20:27:16.917683] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-10-22T20:27:17.607592] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-22T20:27:17.717633] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-22T20:27:18.163521] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T20:27:18.517721] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-22T20:27:18.703014] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T20:27:19.273545] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T20:27:19.317585] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T20:27:19.317629] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-22T20:27:20.117690] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-10. [2025-10-22T20:27:20.917764] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-22T20:27:21.530160] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-22T20:27:21.718975] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-22T20:27:21.721674] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-22T20:27:21.729965] [INFO ] [REMOTE ] OUT: Full fetch complete (69162 records). [2025-10-22T20:27:21.730088] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-10-22T20:27:22.126850] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-10-22T20:27:22.126926] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-10-22T20:27:22.127927] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-10-22T20:27:22.127993] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-10-22T20:27:22.129265] [DEBUG] [LOCAL ] OUT: Trimmed 69162 records to 47687 (keeping 200 days of data) [2025-10-22T20:27:22.414902] [DEBUG] [LOCAL ] OUT: Primary data saved (47687 records). [2025-10-22T20:27:22.415094] [INFO ] [MAIN ] OUT: Full history saved. [2025-10-22T20:27:22.415192] [INFO ] [MAIN ] Update Progress: 1612/2367 symbols completed. OUT took 26.3s. Estimated remaining: 1h 37m 5s. Rate: 7.8 symbols/min [2025-10-22T20:27:22.522748] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-22T20:27:22.586089] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:27:22.618604] [DEBUG] [LOCAL ] OXM: Loaded 33200 existing records from primary storage. [2025-10-22T20:27:22.618935] [INFO ] [MAIN ] OXM: Loaded 33200 existing records. [2025-10-22T20:27:22.797864] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:27:22.798240] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-22T20:27:22.798304] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-22T20:27:22.798533] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-10-22T20:27:22.798692] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-22T20:27:23.196029] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-22T20:27:23.199783] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:27:23.317628] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-22T20:27:23.465510] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-22T20:27:23.692986] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-22T20:27:24.117686] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-22T20:27:24.705810] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T20:27:24.917634] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-22T20:27:25.717716] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-22T20:27:25.783802] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T20:27:26.174523] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-22T20:27:26.517676] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-22T20:27:27.267469] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-22T20:27:27.317614] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-22T20:27:27.731570] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T20:27:28.117750] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-22T20:27:28.226552] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-22T20:27:28.917716] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-22T20:27:29.717677] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-22T20:27:30.157157] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-22T20:27:30.349879] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T20:27:30.517666] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-22T20:27:30.750363] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T20:27:31.317724] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-22T20:27:32.117674] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-22T20:27:32.200424] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T20:27:32.917689] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-22T20:27:33.088050] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-22T20:27:33.234596] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-22T20:27:33.717768] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-22T20:27:34.424240] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T20:27:34.517694] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-22T20:27:35.317710] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-22T20:27:35.915581] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-22T20:27:36.062380] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T20:27:36.117622] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-22T20:27:36.917682] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-22T20:27:37.401052] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-22T20:27:37.717676] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-22T20:27:37.922215] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T20:27:38.517683] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-22T20:27:38.814494] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-22T20:27:38.815054] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T20:27:39.317680] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-22T20:27:40.117719] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-22T20:27:40.414040] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T20:27:40.423241] [INFO ] [REMOTE ] OVV: Full fetch complete (77512 records). [2025-10-22T20:27:40.423395] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-22T20:27:40.862049] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-10-22T20:27:40.864070] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T20:27:40.862923] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-10-22T20:27:40.873441] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-10-22T20:27:40.873935] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-10-22T20:27:40.875311] [DEBUG] [LOCAL ] OVV: Trimmed 77512 records to 53493 (keeping 200 days of data) [2025-10-22T20:27:40.930823] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-22T20:27:41.111380] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T20:27:41.230695] [DEBUG] [LOCAL ] OVV: Primary data saved (53493 records). [2025-10-22T20:27:41.230835] [INFO ] [MAIN ] OVV: Full history saved. [2025-10-22T20:27:41.231474] [INFO ] [MAIN ] Update Progress: 1613/2367 symbols completed. OVV took 32.5s. Estimated remaining: 1h 37m 3s. Rate: 7.8 symbols/min [2025-10-22T20:27:41.400430] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:27:41.400596] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-22T20:27:41.400634] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-22T20:27:41.400779] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-22T20:27:41.400820] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-22T20:27:41.400881] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-22T20:27:41.400915] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-22T20:27:41.724138] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-22T20:27:41.764264] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:27:42.517714] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-22T20:27:42.748528] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T20:27:42.753484] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T20:27:42.754159] [INFO ] [REMOTE ] OWLT: Full fetch complete (12469 records). [2025-10-22T20:27:42.765133] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-22T20:27:43.123936] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-10-22T20:27:43.124007] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-10-22T20:27:43.124280] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-10-22T20:27:43.124319] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-10-22T20:27:43.124784] [DEBUG] [LOCAL ] OWLT: Trimmed 12469 records to 9777 (keeping 200 days of data) [2025-10-22T20:27:43.178736] [DEBUG] [LOCAL ] OWLT: Primary data saved (9777 records). [2025-10-22T20:27:43.178873] [INFO ] [MAIN ] OWLT: Full history saved. [2025-10-22T20:27:43.178952] [INFO ] [MAIN ] Update Progress: 1614/2367 symbols completed. OWLT took 29.3s. Estimated remaining: 1h 36m 52s. Rate: 7.8 symbols/min [2025-10-22T20:27:43.326611] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-22T20:27:43.346023] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:27:43.392676] [DEBUG] [LOCAL ] PAAS: Loaded 53625 existing records from primary storage. [2025-10-22T20:27:43.392986] [INFO ] [MAIN ] PAAS: Loaded 53625 existing records. [2025-10-22T20:27:43.564846] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:27:43.565065] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-22T20:27:43.565111] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-22T20:27:43.565391] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-10-22T20:27:43.565428] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-22T20:27:43.910427] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:27:44.117717] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-22T20:27:44.917714] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-22T20:27:45.207625] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.69 seconds). [2025-10-22T20:27:45.282162] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T20:27:45.291034] [INFO ] [REMOTE ] OWL: Full fetch complete (77712 records). [2025-10-22T20:27:45.291164] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-22T20:27:45.682389] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-10-22T20:27:45.682515] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-10-22T20:27:45.683702] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-10-22T20:27:45.683788] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-10-22T20:27:45.700917] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T20:27:45.707017] [DEBUG] [LOCAL ] OWL: Trimmed 77712 records to 53560 (keeping 200 days of data) [2025-10-22T20:27:45.763179] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-22T20:27:46.035733] [DEBUG] [LOCAL ] OWL: Primary data saved (53560 records). [2025-10-22T20:27:46.035847] [INFO ] [MAIN ] OWL: Full history saved. [2025-10-22T20:27:46.035923] [INFO ] [MAIN ] Update Progress: 1615/2367 symbols completed. OWL took 37.1s. Estimated remaining: 1h 36m 42s. Rate: 7.8 symbols/min [2025-10-22T20:27:46.201547] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:27:46.214278] [DEBUG] [LOCAL ] PAC: Loaded 11632 existing records from primary storage. [2025-10-22T20:27:46.214481] [INFO ] [MAIN ] PAC: Loaded 11632 existing records. [2025-10-22T20:27:46.387186] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:27:46.387374] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-22T20:27:46.387419] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-22T20:27:46.387575] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-10-22T20:27:46.387611] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-22T20:27:46.529715] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-22T20:27:46.748115] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:27:46.791866] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-22T20:27:47.317782] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-22T20:27:47.397300] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T20:27:48.117680] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-22T20:27:48.324196] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T20:27:48.917797] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-10-22T20:27:49.142455] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-22T20:27:49.622991] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T20:27:49.628701] [INFO ] [REMOTE ] OXM: Full fetch complete (46467 records). [2025-10-22T20:27:49.628808] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-22T20:27:49.722759] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-22T20:27:50.012667] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-10-22T20:27:50.012764] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-10-22T20:27:50.013592] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-10-22T20:27:50.013689] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-10-22T20:27:50.015096] [DEBUG] [LOCAL ] OXM: Trimmed 46467 records to 33140 (keeping 200 days of data) [2025-10-22T20:27:50.226736] [DEBUG] [LOCAL ] OXM: Primary data saved (33140 records). [2025-10-22T20:27:50.226886] [INFO ] [MAIN ] OXM: Full history saved. [2025-10-22T20:27:50.226977] [INFO ] [MAIN ] Update Progress: 1616/2367 symbols completed. OXM took 27.8s. Estimated remaining: 1h 36m 33s. Rate: 7.8 symbols/min [2025-10-22T20:27:50.398152] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:27:50.427913] [DEBUG] [LOCAL ] PACK: Loaded 31920 existing records from primary storage. [2025-10-22T20:27:50.428211] [INFO ] [MAIN ] PACK: Loaded 31920 existing records. [2025-10-22T20:27:50.520841] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-22T20:27:50.614307] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:27:50.614547] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-22T20:27:50.614750] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-22T20:27:50.615066] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-10-22T20:27:50.615137] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-22T20:27:50.877993] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T20:27:50.946562] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-22T20:27:51.019903] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:27:51.317725] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-22T20:27:52.117666] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-22T20:27:52.323746] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-22T20:27:52.917697] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-10-22T20:27:53.355900] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T20:27:53.576577] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (3.06 seconds). [2025-10-22T20:27:53.717630] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-22T20:27:53.764603] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T20:27:54.517769] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-22T20:27:55.317747] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-10-22T20:27:55.876877] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T20:27:56.117626] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-22T20:27:56.525955] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-10-22T20:27:56.917688] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-22T20:27:57.128851] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T20:27:57.675817] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T20:27:57.717616] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-22T20:27:58.517687] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-10-22T20:27:59.193828] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T20:27:59.317617] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-22T20:27:59.672867] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-10-22T20:28:00.117620] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-22T20:28:00.396503] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T20:28:00.918285] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-10-22T20:28:00.922549] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-22T20:28:01.717689] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-10-22T20:28:01.992475] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T20:28:02.394988] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-22T20:28:02.517699] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-22T20:28:03.317628] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-10-22T20:28:03.826684] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-22T20:28:04.117706] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-22T20:28:04.334933] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T20:28:04.917719] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-10-22T20:28:05.195549] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-22T20:28:05.474732] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T20:28:05.717672] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-22T20:28:06.517689] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-22T20:28:07.171552] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-22T20:28:07.198820] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T20:28:07.317668] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-22T20:28:08.117713] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-10-22T20:28:08.917637] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-10-22T20:28:08.920820] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T20:28:08.938749] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-22T20:28:09.457951] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.94 seconds). [2025-10-22T20:28:09.717710] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-22T20:28:10.517761] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-10-22T20:28:11.191974] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-22T20:28:11.317689] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-22T20:28:11.496097] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-22T20:28:11.544469] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T20:28:12.117680] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-22T20:28:12.917775] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-10-22T20:28:13.550110] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-22T20:28:13.596900] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-22T20:28:13.602741] [INFO ] [REMOTE ] PACK: Full fetch complete (45407 records). [2025-10-22T20:28:13.602842] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-22T20:28:13.722713] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-10-22T20:28:14.016484] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-10-22T20:28:14.016592] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-10-22T20:28:14.017508] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-10-22T20:28:14.017573] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-10-22T20:28:14.018705] [DEBUG] [LOCAL ] PACK: Trimmed 45407 records to 31862 (keeping 200 days of data) [2025-10-22T20:28:14.200410] [DEBUG] [LOCAL ] PACK: Primary data saved (31862 records). [2025-10-22T20:28:14.200568] [INFO ] [MAIN ] PACK: Full history saved. [2025-10-22T20:28:14.200683] [INFO ] [MAIN ] Update Progress: 1617/2367 symbols completed. PACK took 24.0s. Estimated remaining: 1h 36m 33s. Rate: 7.8 symbols/min [2025-10-22T20:28:14.385100] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:28:14.422411] [DEBUG] [LOCAL ] PACS: Loaded 34755 existing records from primary storage. [2025-10-22T20:28:14.422841] [INFO ] [MAIN ] PACS: Loaded 34755 existing records. [2025-10-22T20:28:14.526994] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-22T20:28:14.615534] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:28:14.615740] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-22T20:28:14.615791] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-22T20:28:14.615959] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-10-22T20:28:14.615995] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-22T20:28:14.902471] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-22T20:28:14.983286] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:28:15.014094] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-22T20:28:15.317635] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-10-22T20:28:16.117688] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-10. [2025-10-22T20:28:16.877918] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-22T20:28:16.880227] [INFO ] [REMOTE ] PAC: Full fetch complete (16817 records). [2025-10-22T20:28:16.880297] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-10-22T20:28:16.925256] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-22T20:28:17.271969] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-10-22T20:28:17.272400] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-10-22T20:28:17.273153] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-10-22T20:28:17.273689] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-10-22T20:28:17.275715] [DEBUG] [LOCAL ] PAC: Trimmed 16817 records to 11566 (keeping 200 days of data) [2025-10-22T20:28:17.363546] [DEBUG] [LOCAL ] PAC: Primary data saved (11566 records). [2025-10-22T20:28:17.363895] [INFO ] [MAIN ] PAC: Full history saved. [2025-10-22T20:28:17.364021] [INFO ] [MAIN ] Update Progress: 1618/2367 symbols completed. PAC took 31.3s. Estimated remaining: 1h 36m 23s. Rate: 7.8 symbols/min [2025-10-22T20:28:17.466450] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-10 (2.94 seconds). [2025-10-22T20:28:17.527608] [INFO ] [REMOTE ] OXY: Full fetch complete (77585 records). [2025-10-22T20:28:17.567780] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-22T20:28:17.685506] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-22T20:28:17.709370] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:28:17.752135] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-10. [2025-10-22T20:28:17.854013] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T20:28:17.855310] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:28:17.855574] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:28:17.855788] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-22T20:28:17.855879] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-22T20:28:17.855922] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-22T20:28:17.855964] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-22T20:28:17.862825] [INFO ] [MAIN ] Update Progress: 1619/2367 symbols completed. OXY took 36.6s. Estimated remaining: 1h 36m 12s. Rate: 7.8 symbols/min [2025-10-22T20:28:17.914770] [DEBUG] [LOCAL ] PAG: Loaded 21325 existing records from primary storage. [2025-10-22T20:28:17.953163] [INFO ] [MAIN ] PAG: Loaded 21325 existing records. [2025-10-22T20:28:18.192915] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:28:18.259125] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:28:18.259631] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-22T20:28:18.259839] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-22T20:28:18.260187] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-10-22T20:28:18.260279] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-22T20:28:18.634022] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T20:28:18.639545] [DEBUG] [LOCAL ] PAGS: Loaded 52807 existing records from primary storage. [2025-10-22T20:28:18.649282] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-22T20:28:18.662272] [INFO ] [MAIN ] PAGS: Loaded 52807 existing records. [2025-10-22T20:28:18.855380] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:28:18.931967] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:28:18.932210] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-22T20:28:18.932259] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-22T20:28:18.932452] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-10-22T20:28:18.932489] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-22T20:28:19.278999] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:28:19.317631] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-22T20:28:20.117702] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-22T20:28:20.151051] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T20:28:20.195841] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-10 (2.44 seconds). [2025-10-22T20:28:20.204626] [INFO ] [REMOTE ] PAAS: Full fetch complete (77659 records). [2025-10-22T20:28:20.204807] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-10-22T20:28:20.641500] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-10-22T20:28:20.641620] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-10-22T20:28:20.643490] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-10-22T20:28:20.643604] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-10-22T20:28:20.645767] [DEBUG] [LOCAL ] PAAS: Trimmed 77659 records to 53625 (keeping 200 days of data) [2025-10-22T20:28:20.935544] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-22T20:28:20.987487] [DEBUG] [LOCAL ] PAAS: Primary data saved (53625 records). [2025-10-22T20:28:20.987796] [INFO ] [MAIN ] PAAS: Full history saved. [2025-10-22T20:28:20.987891] [INFO ] [MAIN ] Update Progress: 1620/2367 symbols completed. PAAS took 37.8s. Estimated remaining: 1h 36m 2s. Rate: 7.8 symbols/min [2025-10-22T20:28:21.182113] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:28:21.212512] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T20:28:21.215157] [DEBUG] [LOCAL ] PAI: Loaded 2836 existing records from primary storage. [2025-10-22T20:28:21.226055] [INFO ] [MAIN ] PAI: Loaded 2836 existing records. [2025-10-22T20:28:21.397617] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T20:28:21.417725] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:28:21.421879] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-22T20:28:21.421932] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-22T20:28:21.422087] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-10-22T20:28:21.422143] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-22T20:28:21.733078] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-22T20:28:21.773992] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:28:22.493396] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T20:28:22.517697] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-22T20:28:23.251821] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T20:28:23.317621] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-22T20:28:23.642872] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T20:28:24.009094] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-22T20:28:24.117711] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-22T20:28:24.790999] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-22T20:28:24.917666] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-22T20:28:25.717687] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-22T20:28:26.196582] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T20:28:26.517842] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-22T20:28:27.085975] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-22T20:28:27.324269] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-22T20:28:27.330670] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-22T20:28:27.978698] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T20:28:28.117766] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-22T20:28:28.917724] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-22T20:28:29.717634] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-22T20:28:30.154954] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-22T20:28:30.325427] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T20:28:30.505243] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-22T20:28:30.517606] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-22T20:28:31.053843] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-22T20:28:31.317673] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-22T20:28:32.054440] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-22T20:28:32.117635] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-22T20:28:32.917671] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-10-22T20:28:33.461588] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T20:28:33.610270] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-22T20:28:33.717704] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-22T20:28:34.517762] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-22T20:28:35.259161] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-22T20:28:35.317622] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-22T20:28:36.117725] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-22T20:28:36.312219] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T20:28:36.917707] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-10. [2025-10-22T20:28:37.294108] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T20:28:37.566979] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-22T20:28:37.568142] [INFO ] [REMOTE ] PAI: Full fetch complete (4116 records). [2025-10-22T20:28:37.568227] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-22T20:28:37.726162] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-22T20:28:37.743762] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T20:28:37.954442] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-10-22T20:28:37.954511] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-10-22T20:28:37.954663] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-10-22T20:28:37.954725] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-10-22T20:28:37.955066] [DEBUG] [LOCAL ] PAI: Trimmed 4116 records to 2830 (keeping 200 days of data) [2025-10-22T20:28:37.971736] [DEBUG] [LOCAL ] PAI: Primary data saved (2830 records). [2025-10-22T20:28:37.971795] [INFO ] [MAIN ] PAI: Full history saved. [2025-10-22T20:28:37.971859] [INFO ] [MAIN ] Update Progress: 1621/2367 symbols completed. PAI took 17.0s. Estimated remaining: 1h 35m 59s. Rate: 7.8 symbols/min [2025-10-22T20:28:38.134799] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:28:38.134934] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-22T20:28:38.134972] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-22T20:28:38.135077] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-22T20:28:38.135117] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-22T20:28:38.135156] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-22T20:28:38.135188] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-22T20:28:38.477532] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:28:38.517612] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-01. [2025-10-22T20:28:38.814949] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T20:28:38.815250] [WARN ] [REMOTE ] PAII: No data returned for month 2025-01 [2025-10-22T20:28:38.815359] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T20:28:38.815454] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-22T20:28:38.815540] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T20:28:38.815634] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-22T20:28:38.815759] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-22T20:28:38.815819] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-22T20:28:38.815877] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-22T20:28:38.815926] [INFO ] [MAIN ] Update Progress: 1622/2367 symbols completed. PAII took 0.8s. Estimated remaining: 1h 35m 48s. Rate: 7.8 symbols/min [2025-10-22T20:28:38.980392] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:28:39.005506] [DEBUG] [LOCAL ] PAM: Loaded 29042 existing records from primary storage. [2025-10-22T20:28:39.005769] [INFO ] [MAIN ] PAM: Loaded 29042 existing records. [2025-10-22T20:28:39.177568] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:28:39.177802] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-22T20:28:39.177864] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-22T20:28:39.178080] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-10-22T20:28:39.178135] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-22T20:28:39.320078] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-22T20:28:39.536467] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:28:39.780730] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-22T20:28:40.117784] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-22T20:28:40.777897] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T20:28:40.917636] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-22T20:28:41.527760] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T20:28:41.717702] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-22T20:28:41.787194] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-22T20:28:42.517787] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-22T20:28:43.306759] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T20:28:43.317602] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-22T20:28:43.973983] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-22T20:28:44.117617] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-22T20:28:44.669595] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T20:28:44.917688] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-22T20:28:45.717671] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-22T20:28:45.893557] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T20:28:46.517712] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-22T20:28:46.848418] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-22T20:28:46.941968] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T20:28:47.317674] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-22T20:28:47.818807] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-22T20:28:48.120788] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-22T20:28:48.917692] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-22T20:28:49.647582] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T20:28:49.717688] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-22T20:28:49.763976] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-22T20:28:50.238723] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T20:28:50.517750] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-22T20:28:50.929894] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T20:28:51.317752] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-22T20:28:52.109114] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T20:28:52.115171] [INFO ] [REMOTE ] PACS: Full fetch complete (50463 records). [2025-10-22T20:28:52.115263] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-22T20:28:52.127669] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-22T20:28:52.499892] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-10-22T20:28:52.499971] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-10-22T20:28:52.500821] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-10-22T20:28:52.500896] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-10-22T20:28:52.501927] [DEBUG] [LOCAL ] PACS: Trimmed 50463 records to 34769 (keeping 200 days of data) [2025-10-22T20:28:52.697935] [DEBUG] [LOCAL ] PACS: Primary data saved (34769 records). [2025-10-22T20:28:52.698062] [INFO ] [MAIN ] PACS: Full history saved. [2025-10-22T20:28:52.698135] [INFO ] [MAIN ] Update Progress: 1623/2367 symbols completed. PACS took 38.5s. Estimated remaining: 1h 35m 43s. Rate: 7.8 symbols/min [2025-10-22T20:28:52.865484] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:28:52.896440] [DEBUG] [LOCAL ] PAR: Loaded 34301 existing records from primary storage. [2025-10-22T20:28:52.896738] [INFO ] [MAIN ] PAR: Loaded 34301 existing records. [2025-10-22T20:28:52.927877] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-22T20:28:53.077053] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:28:53.077356] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-22T20:28:53.077410] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-22T20:28:53.077618] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-10-22T20:28:53.077703] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-22T20:28:53.478190] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:28:53.484176] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-22T20:28:53.657862] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T20:28:53.717690] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-22T20:28:53.768710] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T20:28:54.517692] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-22T20:28:55.317716] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-22T20:28:55.616984] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-22T20:28:55.639513] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T20:28:55.643590] [INFO ] [REMOTE ] PAG: Full fetch complete (30865 records). [2025-10-22T20:28:55.643725] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-22T20:28:56.016196] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-10-22T20:28:56.016276] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-10-22T20:28:56.016990] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-10-22T20:28:56.017053] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-10-22T20:28:56.017823] [DEBUG] [LOCAL ] PAG: Trimmed 30865 records to 21200 (keeping 200 days of data) [2025-10-22T20:28:56.127708] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-22T20:28:56.152399] [DEBUG] [LOCAL ] PAG: Primary data saved (21200 records). [2025-10-22T20:28:56.152773] [INFO ] [MAIN ] PAG: Full history saved. [2025-10-22T20:28:56.152872] [INFO ] [MAIN ] Update Progress: 1624/2367 symbols completed. PAG took 38.8s. Estimated remaining: 1h 35m 33s. Rate: 7.8 symbols/min [2025-10-22T20:28:56.328439] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:28:56.370903] [DEBUG] [LOCAL ] PARR: Loaded 47969 existing records from primary storage. [2025-10-22T20:28:56.371201] [INFO ] [MAIN ] PARR: Loaded 47969 existing records. [2025-10-22T20:28:56.549941] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:28:56.550171] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-22T20:28:56.550228] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-22T20:28:56.550415] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-10-22T20:28:56.550469] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-22T20:28:56.846758] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T20:28:56.926622] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-22T20:28:56.932470] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:28:57.717624] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-22T20:28:58.164497] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T20:28:58.173235] [INFO ] [REMOTE ] PAGS: Full fetch complete (76506 records). [2025-10-22T20:28:58.173372] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-22T20:28:58.519302] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-22T20:28:58.569302] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-10-22T20:28:58.569754] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-10-22T20:28:58.570857] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-10-22T20:28:58.570937] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-10-22T20:28:58.572467] [DEBUG] [LOCAL ] PAGS: Trimmed 76506 records to 52806 (keeping 200 days of data) [2025-10-22T20:28:58.720440] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T20:28:58.928116] [DEBUG] [LOCAL ] PAGS: Primary data saved (52806 records). [2025-10-22T20:28:58.928252] [INFO ] [MAIN ] PAGS: Full history saved. [2025-10-22T20:28:58.928329] [INFO ] [MAIN ] Update Progress: 1625/2367 symbols completed. PAGS took 41.1s. Estimated remaining: 1h 35m 23s. Rate: 7.8 symbols/min [2025-10-22T20:28:59.107617] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:28:59.159406] [DEBUG] [LOCAL ] PATH: Loaded 53680 existing records from primary storage. [2025-10-22T20:28:59.159911] [INFO ] [MAIN ] PATH: Loaded 53680 existing records. [2025-10-22T20:28:59.322960] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-22T20:28:59.323669] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T20:28:59.370882] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:28:59.371119] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-22T20:28:59.371168] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-22T20:28:59.371363] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-10-22T20:28:59.371403] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-22T20:28:59.724842] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:29:00.117630] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-22T20:29:00.287017] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T20:29:00.847821] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T20:29:00.853602] [INFO ] [REMOTE ] PAM: Full fetch complete (42439 records). [2025-10-22T20:29:00.853709] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-22T20:29:00.927087] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-22T20:29:01.224052] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-10-22T20:29:01.224127] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-10-22T20:29:01.224896] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-10-22T20:29:01.224957] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-10-22T20:29:01.225785] [DEBUG] [LOCAL ] PAM: Trimmed 42439 records to 29064 (keeping 200 days of data) [2025-10-22T20:29:01.396567] [DEBUG] [LOCAL ] PAM: Primary data saved (29064 records). [2025-10-22T20:29:01.396813] [INFO ] [MAIN ] PAM: Full history saved. [2025-10-22T20:29:01.396903] [INFO ] [MAIN ] Update Progress: 1626/2367 symbols completed. PAM took 22.6s. Estimated remaining: 1h 35m 13s. Rate: 7.8 symbols/min [2025-10-22T20:29:01.566237] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:29:01.586225] [DEBUG] [LOCAL ] PAXS: Loaded 21037 existing records from primary storage. [2025-10-22T20:29:01.586443] [INFO ] [MAIN ] PAXS: Loaded 21037 existing records. [2025-10-22T20:29:01.721437] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-22T20:29:01.759724] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T20:29:01.831145] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:29:01.831357] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-22T20:29:01.831406] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-22T20:29:01.831621] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-10-22T20:29:01.831707] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-22T20:29:02.187215] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:29:02.517680] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-22T20:29:03.067882] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T20:29:03.317696] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-22T20:29:03.541629] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-22T20:29:03.616924] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T20:29:04.117678] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-22T20:29:04.618396] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T20:29:04.917766] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-22T20:29:05.345844] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T20:29:05.717768] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-22T20:29:06.517775] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-22T20:29:07.182989] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T20:29:07.317682] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-22T20:29:07.436809] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-10-22T20:29:07.688920] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-22T20:29:08.117723] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-22T20:29:08.715582] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T20:29:08.917752] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-22T20:29:09.428443] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T20:29:09.717681] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-22T20:29:10.517696] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-22T20:29:11.181588] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-22T20:29:11.317634] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-22T20:29:11.501214] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T20:29:12.117685] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-22T20:29:12.917693] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-22T20:29:13.109583] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T20:29:13.166667] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-10-22T20:29:13.289027] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-22T20:29:13.717669] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-22T20:29:14.394574] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T20:29:14.517620] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-22T20:29:15.317637] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-22T20:29:15.408876] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T20:29:15.630912] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T20:29:16.117693] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-22T20:29:16.917669] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-22T20:29:17.447975] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T20:29:17.717756] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-22T20:29:17.790784] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-22T20:29:18.517686] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-22T20:29:18.719695] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T20:29:18.931539] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T20:29:19.317695] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-22T20:29:20.117671] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-22T20:29:20.516163] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T20:29:20.917770] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-22T20:29:21.394519] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-10-22T20:29:21.717720] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-22T20:29:21.821370] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T20:29:22.517669] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-22T20:29:22.822329] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T20:29:22.844966] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-22T20:29:22.848860] [INFO ] [REMOTE ] PAXS: Full fetch complete (29508 records). [2025-10-22T20:29:22.848964] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-22T20:29:23.218671] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-10-22T20:29:23.218763] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-10-22T20:29:23.219449] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-10-22T20:29:23.219490] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-10-22T20:29:23.220190] [DEBUG] [LOCAL ] PAXS: Trimmed 29508 records to 20921 (keeping 200 days of data) [2025-10-22T20:29:23.326564] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-22T20:29:23.347504] [DEBUG] [LOCAL ] PAXS: Primary data saved (20921 records). [2025-10-22T20:29:23.347629] [INFO ] [MAIN ] PAXS: Full history saved. [2025-10-22T20:29:23.347771] [INFO ] [MAIN ] Update Progress: 1627/2367 symbols completed. PAXS took 22.0s. Estimated remaining: 1h 35m 12s. Rate: 7.8 symbols/min [2025-10-22T20:29:23.539890] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:29:23.575520] [DEBUG] [LOCAL ] PAY: Loaded 38642 existing records from primary storage. [2025-10-22T20:29:23.575860] [INFO ] [MAIN ] PAY: Loaded 38642 existing records. [2025-10-22T20:29:23.769935] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:29:23.770153] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-22T20:29:23.770202] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-22T20:29:23.770423] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-10-22T20:29:23.770479] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-22T20:29:24.120965] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-22T20:29:24.124146] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:29:24.282005] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T20:29:24.917723] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-22T20:29:25.118597] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T20:29:25.717702] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-22T20:29:26.517856] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-22T20:29:26.569205] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-22T20:29:26.599394] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T20:29:27.317690] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-22T20:29:27.538533] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T20:29:28.117630] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-22T20:29:28.231105] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T20:29:28.238206] [INFO ] [REMOTE ] PAR: Full fetch complete (49278 records). [2025-10-22T20:29:28.238296] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-10-22T20:29:28.620609] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-10-22T20:29:28.620727] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-10-22T20:29:28.621603] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-10-22T20:29:28.621674] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-10-22T20:29:28.622710] [DEBUG] [LOCAL ] PAR: Trimmed 49278 records to 34300 (keeping 200 days of data) [2025-10-22T20:29:28.819114] [DEBUG] [LOCAL ] PAR: Primary data saved (34300 records). [2025-10-22T20:29:28.819253] [INFO ] [MAIN ] PAR: Full history saved. [2025-10-22T20:29:28.819333] [INFO ] [MAIN ] Update Progress: 1628/2367 symbols completed. PAR took 36.1s. Estimated remaining: 1h 35m 3s. Rate: 7.8 symbols/min [2025-10-22T20:29:28.920084] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-22T20:29:28.992778] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:29:29.025290] [DEBUG] [LOCAL ] PAYC: Loaded 36168 existing records from primary storage. [2025-10-22T20:29:29.025584] [INFO ] [MAIN ] PAYC: Loaded 36168 existing records. [2025-10-22T20:29:29.197960] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:29:29.198192] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-22T20:29:29.198240] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-22T20:29:29.198533] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-10-22T20:29:29.198589] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-22T20:29:29.560600] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:29:29.708824] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-22T20:29:29.719945] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-22T20:29:29.812385] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T20:29:29.821818] [INFO ] [REMOTE ] PARR: Full fetch complete (69074 records). [2025-10-22T20:29:29.822067] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-22T20:29:30.225515] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-10-22T20:29:30.225639] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-10-22T20:29:30.226707] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-10-22T20:29:30.226770] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-10-22T20:29:30.228205] [DEBUG] [LOCAL ] PARR: Trimmed 69074 records to 47952 (keeping 200 days of data) [2025-10-22T20:29:30.477000] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T20:29:30.524854] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-22T20:29:30.539835] [DEBUG] [LOCAL ] PARR: Primary data saved (47952 records). [2025-10-22T20:29:30.539950] [INFO ] [MAIN ] PARR: Full history saved. [2025-10-22T20:29:30.540045] [INFO ] [MAIN ] Update Progress: 1629/2367 symbols completed. PARR took 34.4s. Estimated remaining: 1h 34m 53s. Rate: 7.8 symbols/min [2025-10-22T20:29:30.706927] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:29:30.742932] [DEBUG] [LOCAL ] PB: Loaded 42332 existing records from primary storage. [2025-10-22T20:29:30.743396] [INFO ] [MAIN ] PB: Loaded 42332 existing records. [2025-10-22T20:29:30.921094] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:29:30.921387] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-22T20:29:30.921464] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-22T20:29:30.921942] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-10-22T20:29:30.922009] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-22T20:29:31.080516] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-22T20:29:31.307203] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:29:31.317618] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-22T20:29:32.121028] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-22T20:29:32.127454] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-22T20:29:32.917667] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-22T20:29:33.093618] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T20:29:33.717693] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-22T20:29:33.820781] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T20:29:34.374983] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-22T20:29:34.517785] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-22T20:29:35.317697] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-22T20:29:36.117720] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-22T20:29:36.183832] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-22T20:29:36.249261] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T20:29:36.744367] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T20:29:36.917685] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-22T20:29:37.669629] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T20:29:37.717688] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-22T20:29:38.517741] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-22T20:29:39.317686] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-22T20:29:39.341605] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T20:29:39.447343] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-22T20:29:40.116864] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T20:29:40.119932] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-22T20:29:40.917674] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-22T20:29:41.040266] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T20:29:41.717716] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-22T20:29:41.761614] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T20:29:42.342991] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T20:29:42.517762] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-10-22T20:29:43.317784] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-22T20:29:44.117618] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-22T20:29:44.308723] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T20:29:44.608946] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-10 (2.89 seconds). [2025-10-22T20:29:44.617995] [INFO ] [REMOTE ] PATH: Full fetch complete (77852 records). [2025-10-22T20:29:44.618149] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-22T20:29:44.922638] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-10-22T20:29:45.035848] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-10-22T20:29:45.035967] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-10-22T20:29:45.037168] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-10-22T20:29:45.037370] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-10-22T20:29:45.038975] [DEBUG] [LOCAL ] PATH: Trimmed 77852 records to 53680 (keeping 200 days of data) [2025-10-22T20:29:45.144891] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T20:29:45.390899] [DEBUG] [LOCAL ] PATH: Primary data saved (53680 records). [2025-10-22T20:29:45.391031] [INFO ] [MAIN ] PATH: Full history saved. [2025-10-22T20:29:45.391558] [INFO ] [MAIN ] Update Progress: 1630/2367 symbols completed. PATH took 46.5s. Estimated remaining: 1h 34m 48s. Rate: 7.8 symbols/min [2025-10-22T20:29:45.561433] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:29:45.607095] [DEBUG] [LOCAL ] PBA: Loaded 49217 existing records from primary storage. [2025-10-22T20:29:45.607401] [INFO ] [MAIN ] PBA: Loaded 49217 existing records. [2025-10-22T20:29:45.744903] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-22T20:29:45.785960] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:29:45.786293] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-22T20:29:45.786385] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-22T20:29:45.786630] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-10-22T20:29:45.786734] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-22T20:29:45.911192] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T20:29:46.190842] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:29:46.286508] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T20:29:46.517709] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-10-22T20:29:47.317696] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-22T20:29:47.464321] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T20:29:48.117716] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-22T20:29:48.170380] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T20:29:48.917637] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-10-22T20:29:49.133375] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T20:29:49.657253] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T20:29:49.717637] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-22T20:29:50.522918] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-22T20:29:50.534637] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T20:29:51.324593] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-22T20:29:51.340060] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T20:29:52.117697] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-10-22T20:29:52.203997] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T20:29:52.917675] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-22T20:29:53.126684] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T20:29:53.717721] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-22T20:29:53.965837] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T20:29:54.522757] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-22T20:29:54.534845] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-22T20:29:54.541604] [INFO ] [REMOTE ] PAY: Full fetch complete (54167 records). [2025-10-22T20:29:54.541723] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-22T20:29:54.928062] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-10-22T20:29:54.928156] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-10-22T20:29:54.929034] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-10-22T20:29:54.929097] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-10-22T20:29:54.930182] [DEBUG] [LOCAL ] PAY: Trimmed 54167 records to 38615 (keeping 200 days of data) [2025-10-22T20:29:55.155865] [DEBUG] [LOCAL ] PAY: Primary data saved (38615 records). [2025-10-22T20:29:55.156007] [INFO ] [MAIN ] PAY: Full history saved. [2025-10-22T20:29:55.156089] [INFO ] [MAIN ] Update Progress: 1631/2367 symbols completed. PAY took 31.8s. Estimated remaining: 1h 34m 42s. Rate: 7.8 symbols/min [2025-10-22T20:29:55.325518] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-10. [2025-10-22T20:29:55.330129] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:29:55.378778] [DEBUG] [LOCAL ] PBF: Loaded 53110 existing records from primary storage. [2025-10-22T20:29:55.379097] [INFO ] [MAIN ] PBF: Loaded 53110 existing records. [2025-10-22T20:29:55.561986] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:29:55.562426] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-22T20:29:55.562514] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-22T20:29:55.562815] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-10-22T20:29:55.562885] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-22T20:29:55.710857] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T20:29:55.991530] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:29:56.117624] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-22T20:29:56.285845] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T20:29:56.917635] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-22T20:29:57.141204] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T20:29:57.148711] [INFO ] [REMOTE ] PB: Full fetch complete (59810 records). [2025-10-22T20:29:57.148829] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-10-22T20:29:57.522884] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-10-22T20:29:57.522966] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-10-22T20:29:57.523882] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-10-22T20:29:57.523945] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-10-22T20:29:57.525100] [DEBUG] [LOCAL ] PB: Trimmed 59810 records to 42332 (keeping 200 days of data) [2025-10-22T20:29:57.741162] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-22T20:29:57.792323] [DEBUG] [LOCAL ] PB: Primary data saved (42332 records). [2025-10-22T20:29:57.792538] [INFO ] [MAIN ] PB: Full history saved. [2025-10-22T20:29:57.792696] [INFO ] [MAIN ] Update Progress: 1632/2367 symbols completed. PB took 27.3s. Estimated remaining: 1h 34m 32s. Rate: 7.8 symbols/min [2025-10-22T20:29:57.963943] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:29:57.993326] [DEBUG] [LOCAL ] PBH: Loaded 32532 existing records from primary storage. [2025-10-22T20:29:57.993601] [INFO ] [MAIN ] PBH: Loaded 32532 existing records. [2025-10-22T20:29:58.171923] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:29:58.172366] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-22T20:29:58.172432] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-22T20:29:58.172729] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-10-22T20:29:58.172834] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-22T20:29:58.310753] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-22T20:29:58.517714] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-22T20:29:58.549258] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-22T20:29:58.602989] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:29:58.603274] [INFO ] [REMOTE ] PAYC: Full fetch complete (53235 records). [2025-10-22T20:29:58.603803] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-22T20:29:58.974331] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-10-22T20:29:58.974411] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-10-22T20:29:58.975267] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-10-22T20:29:58.975331] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-10-22T20:29:58.976371] [DEBUG] [LOCAL ] PAYC: Trimmed 53235 records to 36051 (keeping 200 days of data) [2025-10-22T20:29:59.198397] [DEBUG] [LOCAL ] PAYC: Primary data saved (36051 records). [2025-10-22T20:29:59.198546] [INFO ] [MAIN ] PAYC: Full history saved. [2025-10-22T20:29:59.198628] [INFO ] [MAIN ] Update Progress: 1633/2367 symbols completed. PAYC took 30.4s. Estimated remaining: 1h 34m 21s. Rate: 7.8 symbols/min [2025-10-22T20:29:59.322967] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-22T20:29:59.367345] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:29:59.367579] [DEBUG] [LOCAL ] PBI: No existing data file found in primary storage. [2025-10-22T20:29:59.367694] [WARN ] [MAIN ] PBI: No existing data found, performing full refresh instead. [2025-10-22T20:29:59.367809] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-22T20:29:59.367854] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-22T20:29:59.367894] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-22T20:29:59.367925] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-22T20:29:59.727072] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:29:59.768830] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-22T20:30:00.117697] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-22T20:30:00.268374] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T20:30:00.671083] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T20:30:00.917696] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-22T20:30:01.717771] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-22T20:30:02.030598] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T20:30:02.517788] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-22T20:30:02.823389] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T20:30:03.323584] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-22T20:30:03.337343] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T20:30:03.984098] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T20:30:04.117691] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-22T20:30:04.917707] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-22T20:30:05.421495] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-22T20:30:05.517664] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T20:30:05.717771] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-22T20:30:06.019228] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T20:30:06.517711] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-22T20:30:07.317631] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-22T20:30:07.606558] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T20:30:08.117684] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-22T20:30:08.452242] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-22T20:30:08.871098] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T20:30:08.917623] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-22T20:30:09.717665] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-22T20:30:10.305622] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-22T20:30:10.453933] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T20:30:10.517616] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-22T20:30:11.266044] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T20:30:11.317634] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-22T20:30:11.840208] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T20:30:12.117682] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-22T20:30:12.917775] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-22T20:30:13.025417] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T20:30:13.635434] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T20:30:13.717716] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-22T20:30:14.464079] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-22T20:30:14.473491] [INFO ] [REMOTE ] PBA: Full fetch complete (71683 records). [2025-10-22T20:30:14.473786] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-22T20:30:14.522807] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-22T20:30:14.905286] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-10-22T20:30:14.905477] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-10-22T20:30:14.906871] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-10-22T20:30:14.906952] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-10-22T20:30:14.908963] [DEBUG] [LOCAL ] PBA: Trimmed 71683 records to 49189 (keeping 200 days of data) [2025-10-22T20:30:15.236809] [DEBUG] [LOCAL ] PBA: Primary data saved (49189 records). [2025-10-22T20:30:15.237011] [INFO ] [MAIN ] PBA: Full history saved. [2025-10-22T20:30:15.237789] [INFO ] [MAIN ] Update Progress: 1634/2367 symbols completed. PBA took 29.8s. Estimated remaining: 1h 34m 17s. Rate: 7.8 symbols/min [2025-10-22T20:30:15.327092] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-22T20:30:15.422249] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:30:15.486559] [DEBUG] [LOCAL ] PBR: Loaded 53713 existing records from primary storage. [2025-10-22T20:30:15.487061] [INFO ] [MAIN ] PBR: Loaded 53713 existing records. [2025-10-22T20:30:15.674759] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:30:15.700620] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-22T20:30:15.700886] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-22T20:30:15.704620] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-10-22T20:30:15.705901] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-22T20:30:15.705821] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T20:30:16.068931] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:30:16.117618] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-22T20:30:16.290621] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T20:30:16.917691] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-22T20:30:17.358113] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-22T20:30:17.717672] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-22T20:30:18.218877] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-22T20:30:18.517758] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-22T20:30:18.603034] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T20:30:19.317687] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-22T20:30:19.802298] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-22T20:30:20.117675] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-22T20:30:20.384167] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T20:30:20.771916] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T20:30:20.778395] [INFO ] [REMOTE ] PBH: Full fetch complete (44775 records). [2025-10-22T20:30:20.778665] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-22T20:30:20.922931] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-22T20:30:21.173633] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-10-22T20:30:21.173761] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-10-22T20:30:21.174582] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-10-22T20:30:21.174627] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-10-22T20:30:21.175769] [DEBUG] [LOCAL ] PBH: Trimmed 44775 records to 32424 (keeping 200 days of data) [2025-10-22T20:30:21.362628] [DEBUG] [LOCAL ] PBH: Primary data saved (32424 records). [2025-10-22T20:30:21.362785] [INFO ] [MAIN ] PBH: Full history saved. [2025-10-22T20:30:21.362863] [INFO ] [MAIN ] Update Progress: 1635/2367 symbols completed. PBH took 23.6s. Estimated remaining: 1h 34m 9s. Rate: 7.8 symbols/min [2025-10-22T20:30:21.527521] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:30:21.545013] [DEBUG] [LOCAL ] PBT: Loaded 17447 existing records from primary storage. [2025-10-22T20:30:21.545263] [INFO ] [MAIN ] PBT: Loaded 17447 existing records. [2025-10-22T20:30:21.717873] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-22T20:30:21.724107] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:30:21.724979] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-22T20:30:21.725033] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-22T20:30:21.725207] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-10-22T20:30:21.725246] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-22T20:30:22.090135] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:30:22.190957] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-22T20:30:22.517629] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-22T20:30:22.930270] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-22T20:30:23.317622] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-22T20:30:23.992534] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-22T20:30:24.117676] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-22T20:30:24.535108] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-22T20:30:24.685147] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T20:30:24.917699] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-22T20:30:25.717712] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-22T20:30:25.818605] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-22T20:30:26.249349] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-22T20:30:26.517756] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-22T20:30:27.317685] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-22T20:30:27.529434] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T20:30:28.003783] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-22T20:30:28.117752] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-22T20:30:28.917631] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-22T20:30:29.203044] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T20:30:29.212121] [INFO ] [REMOTE ] PBF: Full fetch complete (76739 records). [2025-10-22T20:30:29.212243] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-22T20:30:29.266822] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T20:30:29.629072] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-10-22T20:30:29.629152] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-10-22T20:30:29.630291] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-10-22T20:30:29.630355] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-10-22T20:30:29.631765] [DEBUG] [LOCAL ] PBF: Trimmed 76739 records to 53104 (keeping 200 days of data) [2025-10-22T20:30:29.719359] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-22T20:30:29.952797] [DEBUG] [LOCAL ] PBF: Primary data saved (53104 records). [2025-10-22T20:30:29.952982] [INFO ] [MAIN ] PBF: Full history saved. [2025-10-22T20:30:29.953065] [INFO ] [MAIN ] Update Progress: 1636/2367 symbols completed. PBF took 34.8s. Estimated remaining: 1h 34m 1s. Rate: 7.8 symbols/min [2025-10-22T20:30:30.122130] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:30:30.132061] [DEBUG] [LOCAL ] PCF: Loaded 9109 existing records from primary storage. [2025-10-22T20:30:30.132253] [INFO ] [MAIN ] PCF: Loaded 9109 existing records. [2025-10-22T20:30:30.308711] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:30:30.308916] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-22T20:30:30.308964] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-22T20:30:30.309109] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-10-22T20:30:30.309147] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-22T20:30:30.546482] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-22T20:30:30.695402] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:30:30.813983] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-22T20:30:31.019255] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-22T20:30:31.317664] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-22T20:30:32.117702] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-22T20:30:32.261286] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T20:30:32.917698] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-10-22T20:30:33.383256] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T20:30:33.717696] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-22T20:30:33.843175] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-22T20:30:34.482625] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T20:30:34.517671] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-22T20:30:35.046444] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-22T20:30:35.317745] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-10. [2025-10-22T20:30:35.734829] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T20:30:36.117712] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-22T20:30:36.917772] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-22T20:30:37.189373] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T20:30:37.197625] [INFO ] [REMOTE ] PBI: Full fetch complete (72472 records). [2025-10-22T20:30:37.197819] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-10-22T20:30:37.411829] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-22T20:30:37.606214] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-10-22T20:30:37.606301] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-10-22T20:30:37.607344] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-10-22T20:30:37.607409] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-10-22T20:30:37.608869] [DEBUG] [LOCAL ] PBI: Trimmed 72472 records to 49986 (keeping 200 days of data) [2025-10-22T20:30:37.720709] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-22T20:30:37.908500] [DEBUG] [LOCAL ] PBI: Primary data saved (49986 records). [2025-10-22T20:30:37.908675] [INFO ] [MAIN ] PBI: Full history saved. [2025-10-22T20:30:37.908780] [INFO ] [MAIN ] Update Progress: 1637/2367 symbols completed. PBI took 38.7s. Estimated remaining: 1h 33m 54s. Rate: 7.8 symbols/min [2025-10-22T20:30:37.916030] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-22T20:30:38.517676] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-22T20:30:39.082932] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T20:30:39.317720] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-22T20:30:40.117769] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-22T20:30:40.478840] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T20:30:40.745203] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-22T20:30:40.917626] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-22T20:30:41.059010] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T20:30:41.717630] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-22T20:30:42.162132] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T20:30:42.165140] [INFO ] [REMOTE ] PBT: Full fetch complete (24487 records). [2025-10-22T20:30:42.165213] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-22T20:30:42.519297] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-22T20:30:42.529842] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-10-22T20:30:42.529900] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-10-22T20:30:42.530389] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-10-22T20:30:42.530427] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-10-22T20:30:42.531251] [DEBUG] [LOCAL ] PBT: Trimmed 24487 records to 17314 (keeping 200 days of data) [2025-10-22T20:30:42.634523] [DEBUG] [LOCAL ] PBT: Primary data saved (17314 records). [2025-10-22T20:30:42.634808] [INFO ] [MAIN ] PBT: Full history saved. [2025-10-22T20:30:42.634918] [INFO ] [MAIN ] Update Progress: 1638/2367 symbols completed. PBT took 21.3s. Estimated remaining: 1h 33m 45s. Rate: 7.8 symbols/min [2025-10-22T20:30:42.641393] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-22T20:30:43.317675] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-22T20:30:44.264768] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-22T20:30:44.266981] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-22T20:30:44.979494] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-22T20:30:44.991909] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-22T20:30:45.179762] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T20:30:45.717742] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-22T20:30:46.501017] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-22T20:30:46.517609] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-22T20:30:47.259883] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-22T20:30:47.294494] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-22T20:30:47.317608] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-22T20:30:48.117693] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-22T20:30:48.470302] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-22T20:30:48.917769] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-22T20:30:49.780464] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-22T20:30:49.782485] [INFO ] [REMOTE ] PCF: Full fetch complete (13405 records). [2025-10-22T20:30:49.782567] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-22T20:30:50.144236] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-10-22T20:30:50.144313] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-10-22T20:30:50.144638] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-10-22T20:30:50.144719] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-10-22T20:30:50.145177] [DEBUG] [LOCAL ] PCF: Trimmed 13405 records to 9086 (keeping 200 days of data) [2025-10-22T20:30:50.197934] [DEBUG] [LOCAL ] PCF: Primary data saved (9086 records). [2025-10-22T20:30:50.198078] [INFO ] [MAIN ] PCF: Full history saved. [2025-10-22T20:30:50.198169] [INFO ] [MAIN ] Update Progress: 1639/2367 symbols completed. PCF took 20.2s. Estimated remaining: 1h 33m 37s. Rate: 7.8 symbols/min [2025-10-22T20:30:50.531696] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-22T20:30:50.543554] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-22T20:30:52.838882] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-22T20:30:52.847637] [INFO ] [REMOTE ] PBR: Full fetch complete (77882 records). [2025-10-22T20:30:52.847828] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-22T20:30:53.235595] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-10-22T20:30:53.235695] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-10-22T20:30:53.236745] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-10-22T20:30:53.236807] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-10-22T20:30:53.238298] [DEBUG] [LOCAL ] PBR: Trimmed 77882 records to 53713 (keeping 200 days of data) [2025-10-22T20:30:53.565487] [DEBUG] [LOCAL ] PBR: Primary data saved (53713 records). [2025-10-22T20:30:53.565589] [INFO ] [MAIN ] PBR: Full history saved. [2025-10-22T20:30:53.566199] [INFO ] [MAIN ] Update Progress: 1640/2367 symbols completed. PBR took 38.3s. Estimated remaining: 1h 33m 27s. Rate: 7.8 symbols/min [2025-10-22T20:30:54.223478] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:30:54.236551] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:30:54.298488] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:30:54.331475] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:30:54.340075] [DEBUG] [LOCAL ] PCM: Loaded 6878 existing records from primary storage. [2025-10-22T20:30:54.340629] [INFO ] [MAIN ] PCM: Loaded 6878 existing records. [2025-10-22T20:30:54.568304] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:30:54.568746] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-22T20:30:54.568809] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-22T20:30:54.568994] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-10-22T20:30:54.569032] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-22T20:30:54.550020] [DEBUG] [LOCAL ] PCN: Loaded 25456 existing records from primary storage. [2025-10-22T20:30:54.589580] [INFO ] [MAIN ] PCN: Loaded 25456 existing records. [2025-10-22T20:30:54.819099] [DEBUG] [LOCAL ] PCOR: Loaded 47534 existing records from primary storage. [2025-10-22T20:30:54.819996] [DEBUG] [LOCAL ] PCG: Loaded 53719 existing records from primary storage. [2025-10-22T20:30:54.820864] [INFO ] [MAIN ] PCOR: Loaded 47534 existing records. [2025-10-22T20:30:54.849483] [INFO ] [MAIN ] PCG: Loaded 53719 existing records. [2025-10-22T20:30:55.115701] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:30:55.148085] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-22T20:30:55.172141] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-22T20:30:55.248458] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-10-22T20:30:55.248690] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-22T20:30:55.580279] [WARN ] [MAIN ] PCG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:30:55.599542] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:30:55.605009] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-22T20:30:55.633988] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-22T20:30:55.644282] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-22T20:30:55.648191] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-22T20:30:55.692139] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:30:55.697411] [DEBUG] [LOCAL ] PCG: Deleted primary data file. [2025-10-22T20:30:55.697528] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-22T20:30:55.697907] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-22T20:30:55.728214] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-10-22T20:30:55.738601] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-22T20:30:56.358443] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:30:56.437613] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-22T20:30:56.720987] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:30:56.732275] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:30:56.732705] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-22T20:30:56.734930] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-22T20:30:56.734554] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-22T20:30:56.738806] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-22T20:30:57.667781] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-22T20:30:57.670202] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-22T20:30:57.831171] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T20:30:57.835818] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-22T20:30:58.477867] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T20:30:58.479559] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T20:30:58.490977] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-22T20:30:58.492476] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-22T20:30:58.744891] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-22T20:30:58.749558] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-22T20:30:58.859403] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-22T20:30:58.870111] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-22T20:30:59.366382] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-22T20:30:59.368533] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-22T20:30:59.921394] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-22T20:31:00.069077] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T20:31:00.083765] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T20:31:00.117614] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-22T20:31:00.917783] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-22T20:31:01.046628] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-22T20:31:01.717623] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-22T20:31:01.845107] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T20:31:02.327506] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-22T20:31:02.517679] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-22T20:31:03.263133] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-22T20:31:03.317702] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-22T20:31:03.608667] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T20:31:04.117669] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-22T20:31:04.780286] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-22T20:31:04.917713] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-22T20:31:05.691743] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T20:31:05.717613] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-22T20:31:06.318389] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T20:31:06.517683] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-22T20:31:07.317759] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-22T20:31:07.557375] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T20:31:07.555483] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T20:31:08.117680] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-22T20:31:08.634525] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T20:31:08.917686] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-22T20:31:09.717671] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-22T20:31:10.227762] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-22T20:31:10.266047] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T20:31:10.517681] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-22T20:31:10.684233] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T20:31:11.317686] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-22T20:31:11.835510] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T20:31:12.117628] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-22T20:31:12.256472] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T20:31:12.258314] [INFO ] [REMOTE ] PCM: Full fetch complete (10311 records). [2025-10-22T20:31:12.258386] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-22T20:31:12.607180] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-10-22T20:31:12.607256] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-10-22T20:31:12.607495] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-10-22T20:31:12.607532] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-10-22T20:31:12.608127] [DEBUG] [LOCAL ] PCM: Trimmed 10311 records to 6875 (keeping 200 days of data) [2025-10-22T20:31:12.646599] [DEBUG] [LOCAL ] PCM: Primary data saved (6875 records). [2025-10-22T20:31:12.646728] [INFO ] [MAIN ] PCM: Full history saved. [2025-10-22T20:31:12.646810] [INFO ] [MAIN ] Update Progress: 1641/2367 symbols completed. PCM took 19.1s. Estimated remaining: 1h 33m 24s. Rate: 7.8 symbols/min [2025-10-22T20:31:12.813896] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:31:12.825391] [DEBUG] [LOCAL ] PCQ: Loaded 12158 existing records from primary storage. [2025-10-22T20:31:12.825602] [INFO ] [MAIN ] PCQ: Loaded 12158 existing records. [2025-10-22T20:31:12.923811] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-22T20:31:13.005277] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:31:13.005576] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-22T20:31:13.005623] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-22T20:31:13.005872] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-10-22T20:31:13.005929] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-22T20:31:13.356997] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:31:13.717631] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-22T20:31:13.971844] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-22T20:31:14.517756] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-22T20:31:15.134535] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T20:31:15.225877] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-22T20:31:15.242923] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T20:31:15.317712] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-22T20:31:16.117698] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-22T20:31:16.917683] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-22T20:31:17.444011] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T20:31:17.717627] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-22T20:31:18.044287] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-22T20:31:18.080793] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T20:31:18.517680] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-22T20:31:19.163116] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T20:31:19.317783] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-22T20:31:19.968044] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T20:31:20.117679] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-22T20:31:20.286799] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-22T20:31:20.917676] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-22T20:31:21.717683] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-22T20:31:21.838186] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T20:31:21.849854] [INFO ] [REMOTE ] PCOR: Full fetch complete (69310 records). [2025-10-22T20:31:21.850074] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-22T20:31:22.261322] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-10-22T20:31:22.261418] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-10-22T20:31:22.262518] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-10-22T20:31:22.262586] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-10-22T20:31:22.264077] [DEBUG] [LOCAL ] PCOR: Trimmed 69310 records to 47461 (keeping 200 days of data) [2025-10-22T20:31:22.370188] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T20:31:22.378304] [INFO ] [REMOTE ] PCN: Full fetch complete (34912 records). [2025-10-22T20:31:22.379776] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-22T20:31:22.523337] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-22T20:31:22.890351] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-10-22T20:31:22.890758] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-10-22T20:31:22.891461] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-10-22T20:31:22.892055] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-10-22T20:31:22.916773] [DEBUG] [LOCAL ] PCN: Trimmed 34912 records to 25332 (keeping 200 days of data) [2025-10-22T20:31:23.067502] [DEBUG] [LOCAL ] PCOR: Primary data saved (47461 records). [2025-10-22T20:31:23.079754] [INFO ] [MAIN ] PCOR: Full history saved. [2025-10-22T20:31:23.083078] [INFO ] [MAIN ] Update Progress: 1642/2367 symbols completed. PCOR took 29.5s. Estimated remaining: 1h 33m 18s. Rate: 7.8 symbols/min [2025-10-22T20:31:23.284931] [DEBUG] [LOCAL ] PCN: Primary data saved (25332 records). [2025-10-22T20:31:23.303015] [INFO ] [MAIN ] PCN: Full history saved. [2025-10-22T20:31:23.302923] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:31:23.303451] [INFO ] [MAIN ] Update Progress: 1643/2367 symbols completed. PCN took 29.7s. Estimated remaining: 1h 33m 7s. Rate: 7.8 symbols/min [2025-10-22T20:31:23.499683] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:31:23.499866] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-22T20:31:23.499911] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-22T20:31:23.500120] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-22T20:31:23.500180] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-22T20:31:23.500232] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-22T20:31:23.500271] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-22T20:31:23.629730] [DEBUG] [LOCAL ] PD: Loaded 48330 existing records from primary storage. [2025-10-22T20:31:23.668531] [INFO ] [MAIN ] PD: Loaded 48330 existing records. [2025-10-22T20:31:23.893590] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T20:31:23.996082] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-22T20:31:24.081478] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:31:24.105225] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-22T20:31:24.115158] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-22T20:31:24.119228] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:31:24.119808] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-22T20:31:24.119909] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-10-22T20:31:24.120815] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-22T20:31:24.283807] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-22T20:31:24.540943] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:31:24.739507] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-22T20:31:24.917761] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-22T20:31:25.039103] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-22T20:31:25.435218] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-22T20:31:25.717697] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-22T20:31:26.336443] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T20:31:26.517671] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-22T20:31:27.172842] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-22T20:31:27.317682] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-22T20:31:28.117687] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-22T20:31:28.266029] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T20:31:28.917670] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-22T20:31:29.717673] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-22T20:31:29.843405] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T20:31:30.138564] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-22T20:31:30.223587] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-22T20:31:30.517697] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-22T20:31:31.317693] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-22T20:31:31.771130] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-22T20:31:32.117707] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-22T20:31:32.653724] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-22T20:31:32.917713] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-22T20:31:33.066743] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T20:31:33.717710] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-22T20:31:34.517704] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-22T20:31:35.033877] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-22T20:31:35.126592] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T20:31:35.317673] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-22T20:31:35.353317] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T20:31:36.117662] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-22T20:31:36.437479] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-22T20:31:36.917705] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-22T20:31:37.398929] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-22T20:31:37.717692] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-22T20:31:38.218030] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-22T20:31:38.226934] [INFO ] [REMOTE ] PCG: Full fetch complete (77898 records). [2025-10-22T20:31:38.227094] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-22T20:31:38.522752] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-22T20:31:38.608516] [DEBUG] [VALIDATOR ] PCG: All expected trading days are present. [2025-10-22T20:31:38.608599] [DEBUG] [VALIDATOR ] PCG: Primary data validation passed. [2025-10-22T20:31:38.609668] [INFO ] [MAIN ] PCG: Fetched primary data is valid. [2025-10-22T20:31:38.609733] [DEBUG] [LOCAL ] PCG: Saving primary data. [2025-10-22T20:31:38.611174] [DEBUG] [LOCAL ] PCG: Trimmed 77898 records to 53719 (keeping 200 days of data) [2025-10-22T20:31:38.947623] [DEBUG] [LOCAL ] PCG: Primary data saved (53719 records). [2025-10-22T20:31:38.947814] [INFO ] [MAIN ] PCG: Full history saved. [2025-10-22T20:31:38.947909] [INFO ] [MAIN ] Update Progress: 1644/2367 symbols completed. PCG took 45.3s. Estimated remaining: 1h 33m 3s. Rate: 7.8 symbols/min [2025-10-22T20:31:39.127676] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:31:39.172222] [DEBUG] [LOCAL ] PDI: Loaded 50192 existing records from primary storage. [2025-10-22T20:31:39.172546] [INFO ] [MAIN ] PDI: Loaded 50192 existing records. [2025-10-22T20:31:39.328590] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-22T20:31:39.362086] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:31:39.362635] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-22T20:31:39.362730] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-22T20:31:39.363182] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-10-22T20:31:39.363316] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-22T20:31:39.556924] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T20:31:39.640365] [INFO ] [REMOTE ] PCQ: Full fetch complete (16896 records). [2025-10-22T20:31:39.646043] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-22T20:31:39.657930] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T20:31:39.847441] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-22T20:31:39.955315] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:31:40.122911] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-22T20:31:40.225557] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-10-22T20:31:40.225673] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-10-22T20:31:40.226048] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-10-22T20:31:40.226088] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-10-22T20:31:40.226588] [DEBUG] [LOCAL ] PCQ: Trimmed 16896 records to 12114 (keeping 200 days of data) [2025-10-22T20:31:40.299328] [DEBUG] [LOCAL ] PCQ: Primary data saved (12114 records). [2025-10-22T20:31:40.299468] [INFO ] [MAIN ] PCQ: Full history saved. [2025-10-22T20:31:40.299547] [INFO ] [MAIN ] Update Progress: 1645/2367 symbols completed. PCQ took 27.7s. Estimated remaining: 1h 32m 52s. Rate: 7.8 symbols/min [2025-10-22T20:31:40.467287] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:31:40.502724] [DEBUG] [LOCAL ] PDM: Loaded 39841 existing records from primary storage. [2025-10-22T20:31:40.503006] [INFO ] [MAIN ] PDM: Loaded 39841 existing records. [2025-10-22T20:31:40.677583] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:31:40.677847] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-22T20:31:40.677897] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-22T20:31:40.678088] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-10-22T20:31:40.678125] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-22T20:31:40.926615] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-22T20:31:41.046009] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:31:41.717695] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-22T20:31:42.126627] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-22T20:31:42.127335] [INFO ] [REMOTE ] PDCC: Full fetch complete (1385 records). [2025-10-22T20:31:42.127402] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-22T20:31:42.324405] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-22T20:31:42.324859] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:31:42.325008] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:31:42.325216] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-22T20:31:42.325298] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-22T20:31:42.340844] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-22T20:31:42.350986] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-22T20:31:42.351081] [INFO ] [MAIN ] Update Progress: 1646/2367 symbols completed. PDCC took 19.0s. Estimated remaining: 1h 32m 42s. Rate: 7.8 symbols/min [2025-10-22T20:31:42.386202] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-22T20:31:42.521493] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-22T20:31:42.540489] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:31:42.572195] [DEBUG] [LOCAL ] PDO: Loaded 31531 existing records from primary storage. [2025-10-22T20:31:42.572495] [INFO ] [MAIN ] PDO: Loaded 31531 existing records. [2025-10-22T20:31:42.748136] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:31:42.748578] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-22T20:31:42.748733] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-22T20:31:42.748940] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-10-22T20:31:42.748993] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-22T20:31:42.930710] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T20:31:43.138805] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:31:43.317633] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-22T20:31:44.117705] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-22T20:31:44.455440] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-22T20:31:44.530460] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T20:31:44.917685] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-22T20:31:45.717749] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-22T20:31:45.922993] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T20:31:45.995151] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T20:31:46.517679] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-22T20:31:47.317634] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-22T20:31:47.349722] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T20:31:48.063856] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T20:31:48.117704] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-22T20:31:48.917717] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-22T20:31:49.049458] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T20:31:49.717685] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-22T20:31:50.152588] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-22T20:31:50.437834] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T20:31:50.517715] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-22T20:31:51.317637] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-22T20:31:51.394162] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T20:31:51.885684] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-22T20:31:52.117676] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-22T20:31:52.917637] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-22T20:31:53.506574] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-22T20:31:53.717734] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-22T20:31:53.749473] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T20:31:54.336207] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T20:31:54.517768] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-22T20:31:55.317635] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-22T20:31:55.480850] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T20:31:56.117696] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-22T20:31:56.246280] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T20:31:56.917748] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-22T20:31:57.328077] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-22T20:31:57.717779] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-10-22T20:31:58.216634] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-22T20:31:58.517703] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-22T20:31:58.555389] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T20:31:59.317623] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-22T20:31:59.586410] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-22T20:32:00.117789] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-10-22T20:32:00.533805] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-22T20:32:00.917762] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-22T20:32:01.348716] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-22T20:32:01.717699] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-22T20:32:01.991361] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T20:32:02.365191] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T20:32:02.517689] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-10-22T20:32:02.946234] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T20:32:03.317695] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-22T20:32:04.117638] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-22T20:32:04.150882] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T20:32:04.917671] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-22T20:32:04.974535] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T20:32:05.717743] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-10-22T20:32:05.784911] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T20:32:05.793263] [INFO ] [REMOTE ] PD: Full fetch complete (68322 records). [2025-10-22T20:32:05.793419] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-22T20:32:06.196469] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-10-22T20:32:06.196608] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-10-22T20:32:06.197835] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-10-22T20:32:06.197908] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-10-22T20:32:06.199331] [DEBUG] [LOCAL ] PD: Trimmed 68322 records to 48330 (keeping 200 days of data) [2025-10-22T20:32:06.482333] [DEBUG] [LOCAL ] PD: Primary data saved (48330 records). [2025-10-22T20:32:06.482472] [INFO ] [MAIN ] PD: Full history saved. [2025-10-22T20:32:06.483274] [INFO ] [MAIN ] Update Progress: 1647/2367 symbols completed. PD took 43.4s. Estimated remaining: 1h 32m 41s. Rate: 7.8 symbols/min [2025-10-22T20:32:06.527705] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-22T20:32:06.654092] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T20:32:06.692422] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:32:06.710737] [DEBUG] [LOCAL ] PDS: Loaded 16771 existing records from primary storage. [2025-10-22T20:32:06.710999] [INFO ] [MAIN ] PDS: Loaded 16771 existing records. [2025-10-22T20:32:06.894298] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:32:06.894551] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-22T20:32:06.894599] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-22T20:32:06.894802] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-10-22T20:32:06.894857] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-22T20:32:07.247156] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:32:07.317624] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-22T20:32:07.829430] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-22T20:32:07.875127] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T20:32:07.881693] [INFO ] [REMOTE ] PDM: Full fetch complete (57387 records). [2025-10-22T20:32:07.881809] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-22T20:32:08.128636] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-22T20:32:08.262228] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-10-22T20:32:08.262362] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-10-22T20:32:08.263277] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-10-22T20:32:08.263338] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-10-22T20:32:08.264447] [DEBUG] [LOCAL ] PDM: Trimmed 57387 records to 39741 (keeping 200 days of data) [2025-10-22T20:32:08.474081] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T20:32:08.509231] [DEBUG] [LOCAL ] PDM: Primary data saved (39741 records). [2025-10-22T20:32:08.509407] [INFO ] [MAIN ] PDM: Full history saved. [2025-10-22T20:32:08.509544] [INFO ] [MAIN ] Update Progress: 1648/2367 symbols completed. PDM took 28.2s. Estimated remaining: 1h 32m 31s. Rate: 7.8 symbols/min [2025-10-22T20:32:08.732268] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:32:08.750154] [DEBUG] [LOCAL ] PDT: Loaded 17479 existing records from primary storage. [2025-10-22T20:32:08.750387] [INFO ] [MAIN ] PDT: Loaded 17479 existing records. [2025-10-22T20:32:08.925960] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:32:08.926041] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-10. [2025-10-22T20:32:08.926209] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-22T20:32:08.927032] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-22T20:32:08.927203] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-10-22T20:32:08.927241] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-22T20:32:09.284601] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:32:09.717627] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-22T20:32:09.777126] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T20:32:10.517703] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-22T20:32:10.791515] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-22T20:32:11.111381] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-22T20:32:11.124784] [INFO ] [REMOTE ] PDI: Full fetch complete (73139 records). [2025-10-22T20:32:11.124991] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-10-22T20:32:11.326736] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-22T20:32:11.732609] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-10-22T20:32:11.732849] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-10-22T20:32:11.734791] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-10-22T20:32:11.734888] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-10-22T20:32:11.736849] [DEBUG] [LOCAL ] PDI: Trimmed 73139 records to 50186 (keeping 200 days of data) [2025-10-22T20:32:12.035111] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T20:32:12.118288] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-10. [2025-10-22T20:32:12.152761] [DEBUG] [LOCAL ] PDI: Primary data saved (50186 records). [2025-10-22T20:32:12.152904] [INFO ] [MAIN ] PDI: Full history saved. [2025-10-22T20:32:12.153014] [INFO ] [MAIN ] Update Progress: 1649/2367 symbols completed. PDI took 33.2s. Estimated remaining: 1h 32m 22s. Rate: 7.8 symbols/min [2025-10-22T20:32:12.334015] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:32:12.349716] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T20:32:12.366769] [DEBUG] [LOCAL ] PDX: Loaded 14225 existing records from primary storage. [2025-10-22T20:32:12.367031] [INFO ] [MAIN ] PDX: Loaded 14225 existing records. [2025-10-22T20:32:12.538712] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:32:12.538879] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-22T20:32:12.538924] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-22T20:32:12.539111] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-10-22T20:32:12.539166] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-22T20:32:12.880245] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:32:12.917614] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-22T20:32:13.426842] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T20:32:13.433540] [INFO ] [REMOTE ] PDO: Full fetch complete (46934 records). [2025-10-22T20:32:13.433821] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-10-22T20:32:13.723000] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-22T20:32:13.815262] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-10-22T20:32:13.815358] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-10-22T20:32:13.816220] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-10-22T20:32:13.816286] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-10-22T20:32:13.817378] [DEBUG] [LOCAL ] PDO: Trimmed 46934 records to 31375 (keeping 200 days of data) [2025-10-22T20:32:14.016418] [DEBUG] [LOCAL ] PDO: Primary data saved (31375 records). [2025-10-22T20:32:14.016757] [INFO ] [MAIN ] PDO: Full history saved. [2025-10-22T20:32:14.016916] [INFO ] [MAIN ] Update Progress: 1650/2367 symbols completed. PDO took 31.7s. Estimated remaining: 1h 32m 11s. Rate: 7.8 symbols/min [2025-10-22T20:32:14.187524] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:32:14.235019] [DEBUG] [LOCAL ] PEB: Loaded 50735 existing records from primary storage. [2025-10-22T20:32:14.235413] [INFO ] [MAIN ] PEB: Loaded 50735 existing records. [2025-10-22T20:32:14.412579] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:32:14.412983] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-22T20:32:14.413054] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-22T20:32:14.419174] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-10-22T20:32:14.428807] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-22T20:32:14.429786] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T20:32:14.526836] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-22T20:32:14.788726] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:32:14.882199] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T20:32:15.317681] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-22T20:32:15.787192] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-22T20:32:16.117714] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-22T20:32:16.636373] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T20:32:16.917763] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-22T20:32:17.703106] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T20:32:17.717611] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-22T20:32:18.372843] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-22T20:32:18.517676] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-22T20:32:19.317685] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-22T20:32:19.460823] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T20:32:19.481941] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-22T20:32:20.117697] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-22T20:32:20.344056] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T20:32:20.917632] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-22T20:32:21.233334] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T20:32:21.717856] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-22T20:32:22.517774] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-22T20:32:22.859308] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T20:32:22.885799] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-22T20:32:23.317690] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-22T20:32:23.782167] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T20:32:24.117680] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-22T20:32:24.444854] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T20:32:24.917712] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-22T20:32:25.258924] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T20:32:25.717670] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-22T20:32:26.517623] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-22T20:32:26.831545] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T20:32:26.897369] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T20:32:27.317674] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-22T20:32:27.644680] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-22T20:32:28.117631] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-22T20:32:28.492537] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T20:32:28.917624] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-22T20:32:29.245726] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T20:32:29.717696] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-22T20:32:29.849928] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T20:32:30.517696] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-22T20:32:30.823316] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T20:32:31.317683] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-22T20:32:31.632184] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T20:32:32.117676] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-22T20:32:32.917691] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-22T20:32:33.087578] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T20:32:33.195589] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T20:32:33.717700] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-22T20:32:34.004015] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T20:32:34.517683] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-22T20:32:35.317636] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-22T20:32:35.627347] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-22T20:32:35.647437] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T20:32:35.984922] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-22T20:32:36.117687] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-22T20:32:36.917626] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-22T20:32:37.093420] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T20:32:37.096091] [INFO ] [REMOTE ] PDX: Full fetch complete (23675 records). [2025-10-22T20:32:37.096164] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-22T20:32:37.455009] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-10-22T20:32:37.455094] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-10-22T20:32:37.455596] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-10-22T20:32:37.455636] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-10-22T20:32:37.456402] [DEBUG] [LOCAL ] PDX: Trimmed 23675 records to 14138 (keeping 200 days of data) [2025-10-22T20:32:37.539209] [DEBUG] [LOCAL ] PDX: Primary data saved (14138 records). [2025-10-22T20:32:37.539338] [INFO ] [MAIN ] PDX: Full history saved. [2025-10-22T20:32:37.539410] [INFO ] [MAIN ] Update Progress: 1651/2367 symbols completed. PDX took 25.4s. Estimated remaining: 1h 32m 11s. Rate: 7.8 symbols/min [2025-10-22T20:32:37.705858] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:32:37.717702] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-22T20:32:37.755597] [DEBUG] [LOCAL ] PEG: Loaded 53139 existing records from primary storage. [2025-10-22T20:32:37.755961] [INFO ] [MAIN ] PEG: Loaded 53139 existing records. [2025-10-22T20:32:37.931141] [WARN ] [MAIN ] PEG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:32:37.931340] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-22T20:32:37.931395] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-22T20:32:37.931595] [DEBUG] [LOCAL ] PEG: Deleted primary data file. [2025-10-22T20:32:37.931683] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-22T20:32:38.210391] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-22T20:32:38.297907] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:32:38.517660] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-22T20:32:39.317682] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-22T20:32:39.691093] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-22T20:32:40.117674] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-22T20:32:40.480727] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-22T20:32:40.521386] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T20:32:40.525109] [INFO ] [REMOTE ] PDS: Full fetch complete (25662 records). [2025-10-22T20:32:40.525185] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-22T20:32:40.901782] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-10-22T20:32:40.901861] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-10-22T20:32:40.902369] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-10-22T20:32:40.902427] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-10-22T20:32:40.903079] [DEBUG] [LOCAL ] PDS: Trimmed 25662 records to 16604 (keeping 200 days of data) [2025-10-22T20:32:40.942866] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-22T20:32:41.001080] [DEBUG] [LOCAL ] PDS: Primary data saved (16604 records). [2025-10-22T20:32:41.001188] [INFO ] [MAIN ] PDS: Full history saved. [2025-10-22T20:32:41.001262] [INFO ] [MAIN ] Update Progress: 1652/2367 symbols completed. PDS took 34.5s. Estimated remaining: 1h 32m 1s. Rate: 7.8 symbols/min [2025-10-22T20:32:41.181617] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:32:41.214379] [DEBUG] [LOCAL ] PEN: Loaded 29689 existing records from primary storage. [2025-10-22T20:32:41.214707] [INFO ] [MAIN ] PEN: Loaded 29689 existing records. [2025-10-22T20:32:41.337093] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-22T20:32:41.356832] [INFO ] [REMOTE ] PDT: Full fetch complete (25110 records). [2025-10-22T20:32:41.367192] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-22T20:32:41.525715] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:32:41.526011] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-22T20:32:41.526364] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-22T20:32:41.542313] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-10-22T20:32:41.557834] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-22T20:32:41.720766] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-22T20:32:42.102794] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-10-22T20:32:42.103205] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-10-22T20:32:42.119549] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-10-22T20:32:42.124811] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-10-22T20:32:42.185460] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:32:42.181985] [DEBUG] [LOCAL ] PDT: Trimmed 25110 records to 17437 (keeping 200 days of data) [2025-10-22T20:32:42.294548] [DEBUG] [LOCAL ] PDT: Primary data saved (17437 records). [2025-10-22T20:32:42.294692] [INFO ] [MAIN ] PDT: Full history saved. [2025-10-22T20:32:42.294780] [INFO ] [MAIN ] Update Progress: 1653/2367 symbols completed. PDT took 33.8s. Estimated remaining: 1h 31m 51s. Rate: 7.8 symbols/min [2025-10-22T20:32:42.468339] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:32:42.480820] [DEBUG] [LOCAL ] PEO: Loaded 11168 existing records from primary storage. [2025-10-22T20:32:42.481033] [INFO ] [MAIN ] PEO: Loaded 11168 existing records. [2025-10-22T20:32:42.524756] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-22T20:32:42.666989] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:32:42.667349] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-22T20:32:42.667518] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-22T20:32:42.667826] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-10-22T20:32:42.668005] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-22T20:32:43.005896] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-22T20:32:43.072966] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:32:43.317670] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-22T20:32:43.717950] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-22T20:32:44.117631] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-22T20:32:44.164725] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T20:32:44.917672] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-22T20:32:45.187787] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-22T20:32:45.717620] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-22T20:32:45.970468] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T20:32:46.082793] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T20:32:46.517689] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-22T20:32:46.882507] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T20:32:47.317755] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-22T20:32:48.117760] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-22T20:32:48.227860] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-22T20:32:48.412082] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T20:32:48.420236] [INFO ] [REMOTE ] PEB: Full fetch complete (73248 records). [2025-10-22T20:32:48.420355] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-22T20:32:48.814467] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-10-22T20:32:48.814545] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-10-22T20:32:48.815566] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-10-22T20:32:48.815627] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-10-22T20:32:48.817023] [DEBUG] [LOCAL ] PEB: Trimmed 73248 records to 50732 (keeping 200 days of data) [2025-10-22T20:32:48.925379] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-22T20:32:49.117032] [DEBUG] [LOCAL ] PEB: Primary data saved (50732 records). [2025-10-22T20:32:49.117161] [INFO ] [MAIN ] PEB: Full history saved. [2025-10-22T20:32:49.117237] [INFO ] [MAIN ] Update Progress: 1654/2367 symbols completed. PEB took 35.1s. Estimated remaining: 1h 31m 42s. Rate: 7.8 symbols/min [2025-10-22T20:32:49.285364] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:32:49.305218] [DEBUG] [LOCAL ] PERF: Loaded 14530 existing records from primary storage. [2025-10-22T20:32:49.305541] [INFO ] [MAIN ] PERF: Loaded 14530 existing records. [2025-10-22T20:32:49.505634] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:32:49.505997] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-22T20:32:49.506077] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-22T20:32:49.506409] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-10-22T20:32:49.506467] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-22T20:32:49.745320] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-10-22T20:32:49.806297] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T20:32:49.888622] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:32:50.517698] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-22T20:32:50.719670] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-22T20:32:50.991581] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-22T20:32:51.317668] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-22T20:32:52.064826] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T20:32:52.117620] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-10-22T20:32:52.607826] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-22T20:32:52.917637] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-22T20:32:53.177527] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T20:32:53.717675] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-10-22T20:32:54.192988] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T20:32:54.517673] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-22T20:32:54.583044] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-22T20:32:55.317633] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-10-22T20:32:55.476964] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-22T20:32:56.117638] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-10-22T20:32:56.319718] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T20:32:56.917666] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-10-22T20:32:57.717670] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-22T20:32:57.751732] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T20:32:58.035734] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T20:32:58.517679] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-22T20:32:58.696197] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T20:32:59.317744] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-22T20:33:00.117664] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-10-22T20:33:00.201706] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T20:33:00.551679] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-22T20:33:00.917677] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-22T20:33:01.024101] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-22T20:33:01.717711] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-10-22T20:33:02.517671] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-22T20:33:02.661514] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-22T20:33:02.953521] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-22T20:33:03.317631] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-22T20:33:03.421110] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-22T20:33:04.117763] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-22T20:33:04.917709] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-10-22T20:33:05.413222] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-22T20:33:05.437482] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T20:33:05.717762] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-10. [2025-10-22T20:33:06.291262] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T20:33:06.517750] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-22T20:33:06.715914] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T20:33:06.718331] [INFO ] [REMOTE ] PEO: Full fetch complete (16290 records). [2025-10-22T20:33:06.718432] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-10-22T20:33:07.076922] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-10-22T20:33:07.076999] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-10-22T20:33:07.077350] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-10-22T20:33:07.077388] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-10-22T20:33:07.077935] [DEBUG] [LOCAL ] PEO: Trimmed 16290 records to 11042 (keeping 200 days of data) [2025-10-22T20:33:07.143668] [DEBUG] [LOCAL ] PEO: Primary data saved (11042 records). [2025-10-22T20:33:07.143802] [INFO ] [MAIN ] PEO: Full history saved. [2025-10-22T20:33:07.143880] [INFO ] [MAIN ] Update Progress: 1655/2367 symbols completed. PEO took 24.8s. Estimated remaining: 1h 31m 39s. Rate: 7.8 symbols/min [2025-10-22T20:33:07.306456] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:33:07.306673] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-22T20:33:07.306727] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-22T20:33:07.306840] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-22T20:33:07.306880] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-22T20:33:07.306920] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-22T20:33:07.306952] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-22T20:33:07.327027] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-10-22T20:33:07.654888] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:33:08.117671] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-01. [2025-10-22T20:33:08.494493] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T20:33:08.515282] [WARN ] [REMOTE ] PEW: No data returned for month 2025-01 [2025-10-22T20:33:08.517295] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-22T20:33:08.528860] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T20:33:08.529431] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-22T20:33:08.530087] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T20:33:08.530265] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-22T20:33:08.530497] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-22T20:33:08.530575] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-22T20:33:08.530719] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-22T20:33:08.530885] [INFO ] [MAIN ] Update Progress: 1656/2367 symbols completed. PEW took 1.4s. Estimated remaining: 1h 31m 29s. Rate: 7.8 symbols/min [2025-10-22T20:33:08.718805] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-22T20:33:08.720999] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:33:08.734864] [DEBUG] [LOCAL ] PFD: Loaded 5399 existing records from primary storage. [2025-10-22T20:33:08.735072] [INFO ] [MAIN ] PFD: Loaded 5399 existing records. [2025-10-22T20:33:08.909206] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:33:08.909485] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-22T20:33:08.909535] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-22T20:33:08.909887] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-10-22T20:33:08.909943] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-22T20:33:08.922955] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-10-22T20:33:09.262400] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:33:09.717621] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-22T20:33:10.435353] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T20:33:10.517673] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-10-22T20:33:10.533964] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-22T20:33:11.317680] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-22T20:33:12.001841] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T20:33:12.117634] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-10. [2025-10-22T20:33:12.280809] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-22T20:33:12.917712] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-22T20:33:13.474785] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T20:33:13.479486] [INFO ] [REMOTE ] PEN: Full fetch complete (44284 records). [2025-10-22T20:33:13.479593] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-10-22T20:33:13.726615] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-22T20:33:13.855943] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-10-22T20:33:13.856028] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-10-22T20:33:13.857048] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-10-22T20:33:13.857162] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-10-22T20:33:13.858289] [DEBUG] [LOCAL ] PEN: Trimmed 44284 records to 29554 (keeping 200 days of data) [2025-10-22T20:33:14.032546] [DEBUG] [LOCAL ] PEN: Primary data saved (29554 records). [2025-10-22T20:33:14.032708] [INFO ] [MAIN ] PEN: Full history saved. [2025-10-22T20:33:14.032797] [INFO ] [MAIN ] Update Progress: 1657/2367 symbols completed. PEN took 33.0s. Estimated remaining: 1h 31m 20s. Rate: 7.8 symbols/min [2025-10-22T20:33:14.202051] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:33:14.254435] [DEBUG] [LOCAL ] PFE: Loaded 53813 existing records from primary storage. [2025-10-22T20:33:14.254777] [INFO ] [MAIN ] PFE: Loaded 53813 existing records. [2025-10-22T20:33:14.428448] [WARN ] [MAIN ] PFE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:33:14.428882] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-22T20:33:14.428938] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-22T20:33:14.429174] [DEBUG] [LOCAL ] PFE: Deleted primary data file. [2025-10-22T20:33:14.429237] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-22T20:33:14.523857] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-22T20:33:14.535574] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T20:33:14.802357] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:33:15.007303] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-22T20:33:15.317674] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-22T20:33:15.409357] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T20:33:16.093738] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-22T20:33:16.117702] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-10-22T20:33:16.888544] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-22T20:33:16.917751] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-22T20:33:17.717753] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-10-22T20:33:17.929918] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T20:33:18.472764] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-22T20:33:18.517682] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-10-22T20:33:19.224937] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T20:33:19.317626] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-10-22T20:33:20.117672] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-22T20:33:20.145796] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T20:33:20.917791] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-10-22T20:33:21.149118] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T20:33:21.152265] [INFO ] [REMOTE ] PERF: Full fetch complete (21542 records). [2025-10-22T20:33:21.152345] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-22T20:33:21.514917] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-10-22T20:33:21.515023] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-10-22T20:33:21.515479] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-10-22T20:33:21.515519] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-10-22T20:33:21.516100] [DEBUG] [LOCAL ] PERF: Trimmed 21542 records to 14512 (keeping 200 days of data) [2025-10-22T20:33:21.596500] [DEBUG] [LOCAL ] PERF: Primary data saved (14512 records). [2025-10-22T20:33:21.596628] [INFO ] [MAIN ] PERF: Full history saved. [2025-10-22T20:33:21.596740] [INFO ] [MAIN ] Update Progress: 1658/2367 symbols completed. PERF took 32.5s. Estimated remaining: 1h 31m 12s. Rate: 7.8 symbols/min [2025-10-22T20:33:21.722976] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-22T20:33:21.768858] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:33:21.775613] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T20:33:21.816029] [DEBUG] [LOCAL ] PFGC: Loaded 46930 existing records from primary storage. [2025-10-22T20:33:21.816320] [INFO ] [MAIN ] PFGC: Loaded 46930 existing records. [2025-10-22T20:33:21.990342] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:33:21.990543] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-22T20:33:21.990589] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-22T20:33:21.990852] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-10-22T20:33:21.990906] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-22T20:33:22.347618] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:33:22.517686] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-22T20:33:23.317706] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-10. [2025-10-22T20:33:24.117766] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-22T20:33:24.128296] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T20:33:24.130427] [INFO ] [REMOTE ] PFD: Full fetch complete (7464 records). [2025-10-22T20:33:24.130680] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-10-22T20:33:24.575837] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-10-22T20:33:24.577553] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-22T20:33:24.587631] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-10-22T20:33:24.589357] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-10-22T20:33:24.589465] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-10-22T20:33:24.590136] [DEBUG] [LOCAL ] PFD: Trimmed 7464 records to 5349 (keeping 200 days of data) [2025-10-22T20:33:24.621118] [DEBUG] [LOCAL ] PFD: Primary data saved (5349 records). [2025-10-22T20:33:24.621219] [INFO ] [MAIN ] PFD: Full history saved. [2025-10-22T20:33:24.621308] [INFO ] [MAIN ] Update Progress: 1659/2367 symbols completed. PFD took 16.1s. Estimated remaining: 1h 31m 3s. Rate: 7.8 symbols/min [2025-10-22T20:33:24.793530] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:33:24.828022] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (3.11 seconds). [2025-10-22T20:33:24.842447] [DEBUG] [LOCAL ] PFH: Loaded 6451 existing records from primary storage. [2025-10-22T20:33:24.842684] [INFO ] [MAIN ] PFH: Loaded 6451 existing records. [2025-10-22T20:33:24.922803] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-22T20:33:25.026861] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:33:25.027070] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-22T20:33:25.027127] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-22T20:33:25.027271] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-10-22T20:33:25.027310] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-22T20:33:25.379498] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:33:25.717619] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-22T20:33:26.127219] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-22T20:33:26.139474] [INFO ] [REMOTE ] PEG: Full fetch complete (76978 records). [2025-10-22T20:33:26.139786] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-22T20:33:26.518686] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-22T20:33:26.537160] [DEBUG] [VALIDATOR ] PEG: All expected trading days are present. [2025-10-22T20:33:26.538777] [DEBUG] [VALIDATOR ] PEG: Primary data validation passed. [2025-10-22T20:33:26.540213] [INFO ] [MAIN ] PEG: Fetched primary data is valid. [2025-10-22T20:33:26.540425] [DEBUG] [LOCAL ] PEG: Saving primary data. [2025-10-22T20:33:26.566714] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T20:33:26.565717] [DEBUG] [LOCAL ] PEG: Trimmed 76978 records to 53124 (keeping 200 days of data) [2025-10-22T20:33:26.894848] [DEBUG] [LOCAL ] PEG: Primary data saved (53124 records). [2025-10-22T20:33:26.894993] [INFO ] [MAIN ] PEG: Full history saved. [2025-10-22T20:33:26.895072] [INFO ] [MAIN ] Update Progress: 1660/2367 symbols completed. PEG took 49.4s. Estimated remaining: 1h 30m 53s. Rate: 7.8 symbols/min [2025-10-22T20:33:27.080558] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:33:27.095137] [DEBUG] [LOCAL ] PFL: Loaded 14565 existing records from primary storage. [2025-10-22T20:33:27.095387] [INFO ] [MAIN ] PFL: Loaded 14565 existing records. [2025-10-22T20:33:27.235090] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-22T20:33:27.325684] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-22T20:33:27.325587] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:33:27.326897] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-22T20:33:27.326952] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-22T20:33:27.327114] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-10-22T20:33:27.327151] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-22T20:33:27.691609] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:33:28.062549] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-22T20:33:28.117611] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-22T20:33:28.198037] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-22T20:33:28.917703] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-22T20:33:29.717636] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-22T20:33:29.884835] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T20:33:30.517621] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-22T20:33:30.582356] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-22T20:33:30.971508] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-10-22T20:33:31.317749] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-22T20:33:32.117671] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-22T20:33:32.501166] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-22T20:33:32.917674] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-22T20:33:33.187526] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-22T20:33:33.717686] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-22T20:33:34.235551] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.92 seconds). [2025-10-22T20:33:34.517676] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-22T20:33:34.670201] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T20:33:34.687942] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-22T20:33:35.317709] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-22T20:33:35.477398] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-22T20:33:36.117744] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-10-22T20:33:36.917630] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-22T20:33:36.963983] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T20:33:37.717626] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-22T20:33:38.172991] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-10-22T20:33:38.517669] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-22T20:33:38.735924] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T20:33:38.848914] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-22T20:33:39.317685] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-22T20:33:40.117758] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-22T20:33:40.917685] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-10-22T20:33:41.121024] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T20:33:41.300784] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-10-22T20:33:41.323095] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T20:33:41.717735] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-22T20:33:41.731030] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T20:33:42.517681] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-22T20:33:43.317681] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-10-22T20:33:43.542736] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T20:33:44.117637] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-22T20:33:44.164335] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-22T20:33:44.917671] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-22T20:33:45.717631] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-10-22T20:33:45.857890] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (3.34 seconds). [2025-10-22T20:33:46.162239] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-22T20:33:46.228119] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-22T20:33:46.502558] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-22T20:33:46.517601] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-10-22T20:33:47.298667] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T20:33:47.317614] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-10. [2025-10-22T20:33:48.117688] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-22T20:33:48.153476] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-22T20:33:48.154744] [INFO ] [REMOTE ] PFH: Full fetch complete (9622 records). [2025-10-22T20:33:48.154847] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-10-22T20:33:48.526100] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-10-22T20:33:48.526180] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-10-22T20:33:48.526480] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-10-22T20:33:48.526521] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-10-22T20:33:48.526973] [DEBUG] [LOCAL ] PFH: Trimmed 9622 records to 6414 (keeping 200 days of data) [2025-10-22T20:33:48.565857] [DEBUG] [LOCAL ] PFH: Primary data saved (6414 records). [2025-10-22T20:33:48.565995] [INFO ] [MAIN ] PFH: Full history saved. [2025-10-22T20:33:48.566074] [INFO ] [MAIN ] Update Progress: 1661/2367 symbols completed. PFH took 23.9s. Estimated remaining: 1h 30m 51s. Rate: 7.8 symbols/min [2025-10-22T20:33:48.739351] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:33:48.783377] [DEBUG] [LOCAL ] PFLT: Loaded 44325 existing records from primary storage. [2025-10-22T20:33:48.783729] [INFO ] [MAIN ] PFLT: Loaded 44325 existing records. [2025-10-22T20:33:48.922972] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-22T20:33:48.964736] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:33:48.964954] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-22T20:33:48.965006] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-22T20:33:48.965193] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-10-22T20:33:48.965233] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-22T20:33:49.322854] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:33:49.717698] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-22T20:33:50.517797] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-22T20:33:50.799892] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T20:33:51.113048] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (3.00 seconds). [2025-10-22T20:33:51.271372] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-22T20:33:51.317679] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-22T20:33:51.904735] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-22T20:33:52.103403] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-22T20:33:52.117601] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-22T20:33:52.917750] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-22T20:33:53.317804] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T20:33:53.717690] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-22T20:33:54.517711] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-22T20:33:55.317763] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-22T20:33:55.366202] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-22T20:33:55.374100] [INFO ] [REMOTE ] PFGC: Full fetch complete (67740 records). [2025-10-22T20:33:55.374258] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-22T20:33:55.780276] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-10-22T20:33:55.780433] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-10-22T20:33:55.782338] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-10-22T20:33:55.782426] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-10-22T20:33:55.784996] [DEBUG] [LOCAL ] PFGC: Trimmed 67740 records to 46794 (keeping 200 days of data) [2025-10-22T20:33:55.958525] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (3.04 seconds). [2025-10-22T20:33:56.119834] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-22T20:33:56.179617] [DEBUG] [LOCAL ] PFGC: Primary data saved (46794 records). [2025-10-22T20:33:56.179843] [INFO ] [MAIN ] PFGC: Full history saved. [2025-10-22T20:33:56.179952] [INFO ] [MAIN ] Update Progress: 1662/2367 symbols completed. PFGC took 34.6s. Estimated remaining: 1h 30m 43s. Rate: 7.8 symbols/min [2025-10-22T20:33:56.358308] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:33:56.384842] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-22T20:33:56.413318] [DEBUG] [LOCAL ] PFN: Loaded 22317 existing records from primary storage. [2025-10-22T20:33:56.413681] [INFO ] [MAIN ] PFN: Loaded 22317 existing records. [2025-10-22T20:33:56.560550] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T20:33:56.629006] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:33:56.629243] [INFO ] [REMOTE ] PFL: Full fetch complete (20774 records). [2025-10-22T20:33:56.629629] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-22T20:33:56.675848] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-22T20:33:56.709159] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-22T20:33:56.736128] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-10-22T20:33:56.736243] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-22T20:33:56.932748] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-22T20:33:57.414087] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-10-22T20:33:57.436828] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-10-22T20:33:57.436739] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:33:57.437989] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-10-22T20:33:57.438332] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-10-22T20:33:57.439122] [DEBUG] [LOCAL ] PFL: Trimmed 20774 records to 14446 (keeping 200 days of data) [2025-10-22T20:33:57.538314] [DEBUG] [LOCAL ] PFL: Primary data saved (14446 records). [2025-10-22T20:33:57.538518] [INFO ] [MAIN ] PFL: Full history saved. [2025-10-22T20:33:57.538620] [INFO ] [MAIN ] Update Progress: 1663/2367 symbols completed. PFL took 30.6s. Estimated remaining: 1h 30m 33s. Rate: 7.8 symbols/min [2025-10-22T20:33:57.713868] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:33:57.719486] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-22T20:33:57.725135] [DEBUG] [LOCAL ] PFO: Loaded 6109 existing records from primary storage. [2025-10-22T20:33:57.725359] [INFO ] [MAIN ] PFO: Loaded 6109 existing records. [2025-10-22T20:33:57.921128] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:33:57.921420] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-22T20:33:57.921470] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-22T20:33:57.921697] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-10-22T20:33:57.921774] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-22T20:33:58.293143] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:33:58.517754] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-22T20:33:59.006043] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-22T20:33:59.057011] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-10 (2.94 seconds). [2025-10-22T20:33:59.066494] [INFO ] [REMOTE ] PFE: Full fetch complete (77993 records). [2025-10-22T20:33:59.066696] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-22T20:33:59.322105] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-22T20:33:59.389638] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-22T20:33:59.427302] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T20:33:59.533288] [DEBUG] [VALIDATOR ] PFE: All expected trading days are present. [2025-10-22T20:33:59.533388] [DEBUG] [VALIDATOR ] PFE: Primary data validation passed. [2025-10-22T20:33:59.534626] [INFO ] [MAIN ] PFE: Fetched primary data is valid. [2025-10-22T20:33:59.534716] [DEBUG] [LOCAL ] PFE: Saving primary data. [2025-10-22T20:33:59.536368] [DEBUG] [LOCAL ] PFE: Trimmed 77993 records to 53813 (keeping 200 days of data) [2025-10-22T20:33:59.866068] [DEBUG] [LOCAL ] PFE: Primary data saved (53813 records). [2025-10-22T20:33:59.866216] [INFO ] [MAIN ] PFE: Full history saved. [2025-10-22T20:33:59.866922] [INFO ] [MAIN ] Update Progress: 1664/2367 symbols completed. PFE took 45.8s. Estimated remaining: 1h 30m 23s. Rate: 7.8 symbols/min [2025-10-22T20:34:00.041737] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:34:00.079006] [DEBUG] [LOCAL ] PFS: Loaded 35763 existing records from primary storage. [2025-10-22T20:34:00.079279] [INFO ] [MAIN ] PFS: Loaded 35763 existing records. [2025-10-22T20:34:00.123458] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-22T20:34:00.266109] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:34:00.266300] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-22T20:34:00.266349] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-22T20:34:00.266549] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-10-22T20:34:00.266589] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-22T20:34:00.633080] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:34:00.917671] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-22T20:34:01.249345] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T20:34:01.413608] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-22T20:34:01.717701] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-22T20:34:02.517747] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-22T20:34:02.612111] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T20:34:02.920382] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-22T20:34:02.992558] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-22T20:34:03.317750] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-22T20:34:04.117731] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-22T20:34:04.857075] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T20:34:04.917735] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-22T20:34:05.501951] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T20:34:05.666589] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-22T20:34:05.717698] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-22T20:34:06.517707] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-22T20:34:07.288289] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-22T20:34:07.317664] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-22T20:34:07.547431] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T20:34:08.117741] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-22T20:34:08.132879] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T20:34:08.917777] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-22T20:34:09.348717] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T20:34:09.717687] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-22T20:34:10.343799] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T20:34:10.517625] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-22T20:34:10.903484] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T20:34:11.317747] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-22T20:34:12.086022] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-22T20:34:12.117627] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-22T20:34:12.362539] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T20:34:12.917855] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-22T20:34:12.941843] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-22T20:34:13.717707] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-22T20:34:14.517631] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-22T20:34:14.681006] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-22T20:34:14.704977] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T20:34:15.317765] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-22T20:34:16.117758] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-22T20:34:16.271055] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T20:34:16.386500] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T20:34:16.917695] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-22T20:34:17.536846] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T20:34:17.717689] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-22T20:34:17.800788] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-22T20:34:17.802698] [INFO ] [REMOTE ] PFO: Full fetch complete (7881 records). [2025-10-22T20:34:17.802807] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-22T20:34:18.198081] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-10-22T20:34:18.198217] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-10-22T20:34:18.198448] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-10-22T20:34:18.198489] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-10-22T20:34:18.198968] [DEBUG] [LOCAL ] PFO: Trimmed 7881 records to 6073 (keeping 200 days of data) [2025-10-22T20:34:18.233602] [DEBUG] [LOCAL ] PFO: Primary data saved (6073 records). [2025-10-22T20:34:18.233704] [INFO ] [MAIN ] PFO: Full history saved. [2025-10-22T20:34:18.233784] [INFO ] [MAIN ] Update Progress: 1665/2367 symbols completed. PFO took 20.7s. Estimated remaining: 1h 30m 19s. Rate: 7.8 symbols/min [2025-10-22T20:34:18.396994] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:34:18.429389] [DEBUG] [LOCAL ] PFSI: Loaded 29123 existing records from primary storage. [2025-10-22T20:34:18.429788] [INFO ] [MAIN ] PFSI: Loaded 29123 existing records. [2025-10-22T20:34:18.525581] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-22T20:34:18.607266] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:34:18.607475] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-22T20:34:18.607523] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-22T20:34:18.607775] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-10-22T20:34:18.607835] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-22T20:34:18.953805] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:34:18.967408] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-22T20:34:19.317696] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-22T20:34:20.117682] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-22T20:34:20.282228] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T20:34:20.333983] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T20:34:20.917682] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-22T20:34:21.574759] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T20:34:21.717749] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-22T20:34:22.517746] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-22T20:34:22.563565] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T20:34:23.317632] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-22T20:34:23.698587] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T20:34:23.707911] [INFO ] [REMOTE ] PFLT: Full fetch complete (64384 records). [2025-10-22T20:34:23.708085] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-22T20:34:23.867923] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T20:34:23.919007] [INFO ] [REMOTE ] PFN: Full fetch complete (31380 records). [2025-10-22T20:34:23.949413] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-22T20:34:24.150759] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-22T20:34:24.455337] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-10-22T20:34:24.460553] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-10-22T20:34:24.484420] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-10-22T20:34:24.484599] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-10-22T20:34:24.585964] [DEBUG] [LOCAL ] PFLT: Trimmed 64384 records to 44240 (keeping 200 days of data) [2025-10-22T20:34:24.605343] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-10-22T20:34:24.605455] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-10-22T20:34:24.606283] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-10-22T20:34:24.606367] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-10-22T20:34:24.691314] [DEBUG] [LOCAL ] PFN: Trimmed 31380 records to 22150 (keeping 200 days of data) [2025-10-22T20:34:24.989050] [DEBUG] [LOCAL ] PFLT: Primary data saved (44240 records). [2025-10-22T20:34:24.989225] [INFO ] [MAIN ] PFLT: Full history saved. [2025-10-22T20:34:25.001775] [DEBUG] [LOCAL ] PFN: Primary data saved (22150 records). [2025-10-22T20:34:24.998682] [INFO ] [MAIN ] Update Progress: 1666/2367 symbols completed. PFLT took 36.4s. Estimated remaining: 1h 30m 11s. Rate: 7.8 symbols/min [2025-10-22T20:34:25.042098] [INFO ] [MAIN ] PFN: Full history saved. [2025-10-22T20:34:25.066073] [INFO ] [MAIN ] Update Progress: 1667/2367 symbols completed. PFN took 28.9s. Estimated remaining: 1h 30m 0s. Rate: 7.8 symbols/min [2025-10-22T20:34:25.105364] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T20:34:25.249271] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-22T20:34:25.310374] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:34:25.381386] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:34:25.388628] [DEBUG] [LOCAL ] PGP: Loaded 5696 existing records from primary storage. [2025-10-22T20:34:25.388901] [INFO ] [MAIN ] PGP: Loaded 5696 existing records. [2025-10-22T20:34:25.589123] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:34:25.604366] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-22T20:34:25.605394] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-22T20:34:25.605293] [DEBUG] [LOCAL ] PG: Loaded 53753 existing records from primary storage. [2025-10-22T20:34:25.605816] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-10-22T20:34:25.606028] [INFO ] [MAIN ] PG: Loaded 53753 existing records. [2025-10-22T20:34:25.611403] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-22T20:34:25.748378] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T20:34:25.836745] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-22T20:34:26.003312] [WARN ] [MAIN ] PG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:34:26.062171] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-22T20:34:26.067703] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-22T20:34:26.088549] [DEBUG] [LOCAL ] PG: Deleted primary data file. [2025-10-22T20:34:26.098620] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-22T20:34:26.293199] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:34:26.520142] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-22T20:34:26.559130] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:34:26.807739] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T20:34:27.292085] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T20:34:27.317702] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-22T20:34:28.023316] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T20:34:28.117693] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-22T20:34:28.903605] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T20:34:28.917708] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-22T20:34:29.686930] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-22T20:34:29.732092] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-22T20:34:29.745463] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-22T20:34:30.450806] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-22T20:34:30.517706] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-22T20:34:31.317776] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-22T20:34:31.394906] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T20:34:32.117792] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-22T20:34:32.923353] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-22T20:34:32.935304] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T20:34:32.971377] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-22T20:34:33.717792] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-22T20:34:34.517746] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-22T20:34:34.560974] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T20:34:35.002276] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-22T20:34:35.317763] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-10-22T20:34:36.117750] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-22T20:34:36.693362] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-22T20:34:36.826399] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T20:34:36.917684] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-10-22T20:34:37.339015] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T20:34:37.717702] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-22T20:34:38.435734] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T20:34:38.456981] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-22T20:34:38.517621] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-10. [2025-10-22T20:34:39.317681] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-22T20:34:40.119366] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-22T20:34:40.128699] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T20:34:40.129701] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-22T20:34:40.140335] [INFO ] [REMOTE ] PFS: Full fetch complete (52262 records). [2025-10-22T20:34:40.140479] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-10-22T20:34:40.510245] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-10-22T20:34:40.510326] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-10-22T20:34:40.511239] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-10-22T20:34:40.511300] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-10-22T20:34:40.512332] [DEBUG] [LOCAL ] PFS: Trimmed 52262 records to 35666 (keeping 200 days of data) [2025-10-22T20:34:40.731373] [DEBUG] [LOCAL ] PFS: Primary data saved (35666 records). [2025-10-22T20:34:40.731540] [INFO ] [MAIN ] PFS: Full history saved. [2025-10-22T20:34:40.731669] [INFO ] [MAIN ] Update Progress: 1668/2367 symbols completed. PFS took 40.9s. Estimated remaining: 1h 29m 56s. Rate: 7.8 symbols/min [2025-10-22T20:34:40.897005] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:34:40.926169] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-22T20:34:40.949849] [DEBUG] [LOCAL ] PGR: Loaded 52868 existing records from primary storage. [2025-10-22T20:34:40.950174] [INFO ] [MAIN ] PGR: Loaded 52868 existing records. [2025-10-22T20:34:41.124400] [WARN ] [MAIN ] PGR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:34:41.124608] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-22T20:34:41.124687] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-22T20:34:41.124919] [DEBUG] [LOCAL ] PGR: Deleted primary data file. [2025-10-22T20:34:41.124963] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-22T20:34:41.480301] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:34:41.717741] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-22T20:34:42.268440] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-22T20:34:42.459790] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T20:34:42.517676] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-22T20:34:42.562970] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-22T20:34:43.317701] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-22T20:34:44.117636] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-22T20:34:44.274770] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-22T20:34:44.917639] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-22T20:34:45.069053] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-22T20:34:45.559049] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T20:34:45.719587] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-22T20:34:45.721703] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-22T20:34:45.724423] [INFO ] [REMOTE ] PGP: Full fetch complete (7943 records). [2025-10-22T20:34:45.724496] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-22T20:34:46.079803] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-10-22T20:34:46.079885] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-10-22T20:34:46.080110] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-10-22T20:34:46.080171] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-10-22T20:34:46.080555] [DEBUG] [LOCAL ] PGP: Trimmed 7943 records to 5642 (keeping 200 days of data) [2025-10-22T20:34:46.119710] [DEBUG] [LOCAL ] PGP: Primary data saved (5642 records). [2025-10-22T20:34:46.119853] [INFO ] [MAIN ] PGP: Full history saved. [2025-10-22T20:34:46.119951] [INFO ] [MAIN ] Update Progress: 1669/2367 symbols completed. PGP took 21.0s. Estimated remaining: 1h 29m 47s. Rate: 7.8 symbols/min [2025-10-22T20:34:46.283239] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:34:46.323505] [DEBUG] [LOCAL ] PGRE: Loaded 46973 existing records from primary storage. [2025-10-22T20:34:46.323830] [INFO ] [MAIN ] PGRE: Loaded 46973 existing records. [2025-10-22T20:34:46.493711] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:34:46.493919] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-22T20:34:46.493965] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-22T20:34:46.494189] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-10-22T20:34:46.494232] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-22T20:34:46.523778] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-22T20:34:46.841570] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:34:47.317780] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-22T20:34:47.561953] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-22T20:34:48.117697] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-22T20:34:48.336533] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-22T20:34:48.917704] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-22T20:34:49.106380] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-22T20:34:49.151055] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T20:34:49.717682] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-22T20:34:50.517636] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-22T20:34:50.653876] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-22T20:34:51.281797] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-22T20:34:51.317624] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-22T20:34:52.008875] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T20:34:52.117682] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-22T20:34:52.917673] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-22T20:34:53.716563] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T20:34:53.723147] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-22T20:34:53.827627] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-22T20:34:54.517709] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-22T20:34:54.553334] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T20:34:54.695855] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-22T20:34:55.317771] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-22T20:34:56.117737] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-22T20:34:56.202293] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T20:34:56.802741] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-22T20:34:56.917633] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-22T20:34:57.560474] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T20:34:57.566353] [INFO ] [REMOTE ] PFSI: Full fetch complete (41772 records). [2025-10-22T20:34:57.566463] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-22T20:34:57.733028] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-22T20:34:57.972149] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-10-22T20:34:57.972230] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-10-22T20:34:57.973047] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-10-22T20:34:57.973109] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-10-22T20:34:57.974034] [DEBUG] [LOCAL ] PFSI: Trimmed 41772 records to 29100 (keeping 200 days of data) [2025-10-22T20:34:58.151096] [DEBUG] [LOCAL ] PFSI: Primary data saved (29100 records). [2025-10-22T20:34:58.151251] [INFO ] [MAIN ] PFSI: Full history saved. [2025-10-22T20:34:58.151339] [INFO ] [MAIN ] Update Progress: 1670/2367 symbols completed. PFSI took 39.9s. Estimated remaining: 1h 29m 41s. Rate: 7.8 symbols/min [2025-10-22T20:34:58.322612] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:34:58.331142] [DEBUG] [LOCAL ] PGZ: Loaded 5560 existing records from primary storage. [2025-10-22T20:34:58.331359] [INFO ] [MAIN ] PGZ: Loaded 5560 existing records. [2025-10-22T20:34:58.530890] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-22T20:34:58.537078] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:34:58.537672] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-22T20:34:58.537839] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-22T20:34:58.538126] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-10-22T20:34:58.538283] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-22T20:34:58.770368] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T20:34:58.957421] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:34:58.995865] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T20:34:59.317693] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-22T20:35:00.117695] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-22T20:35:00.853766] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-22T20:35:00.896366] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T20:35:00.917626] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-22T20:35:00.996012] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T20:35:01.717682] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-22T20:35:02.517743] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-22T20:35:03.317702] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-22T20:35:03.419924] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-22T20:35:03.429027] [INFO ] [REMOTE ] PG: Full fetch complete (77928 records). [2025-10-22T20:35:03.429163] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-22T20:35:03.698750] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-22T20:35:03.859893] [DEBUG] [VALIDATOR ] PG: All expected trading days are present. [2025-10-22T20:35:03.859990] [DEBUG] [VALIDATOR ] PG: Primary data validation passed. [2025-10-22T20:35:03.861080] [INFO ] [MAIN ] PG: Fetched primary data is valid. [2025-10-22T20:35:03.861162] [DEBUG] [LOCAL ] PG: Saving primary data. [2025-10-22T20:35:03.890021] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T20:35:03.888876] [DEBUG] [LOCAL ] PG: Trimmed 77928 records to 53753 (keeping 200 days of data) [2025-10-22T20:35:04.117786] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-22T20:35:04.226083] [DEBUG] [LOCAL ] PG: Primary data saved (53753 records). [2025-10-22T20:35:04.226182] [INFO ] [MAIN ] PG: Full history saved. [2025-10-22T20:35:04.226257] [INFO ] [MAIN ] Update Progress: 1671/2367 symbols completed. PG took 39.2s. Estimated remaining: 1h 29m 33s. Rate: 7.8 symbols/min [2025-10-22T20:35:04.394583] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:35:04.430093] [DEBUG] [LOCAL ] PH: Loaded 36700 existing records from primary storage. [2025-10-22T20:35:04.430550] [INFO ] [MAIN ] PH: Loaded 36700 existing records. [2025-10-22T20:35:04.563085] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T20:35:04.649177] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:35:04.649402] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-22T20:35:04.649447] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-22T20:35:04.649682] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-10-22T20:35:04.649739] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-22T20:35:04.923152] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-22T20:35:05.129399] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:35:05.647225] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T20:35:05.717758] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-22T20:35:06.142861] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-22T20:35:06.517764] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-22T20:35:07.317742] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-22T20:35:07.471810] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T20:35:08.117772] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-22T20:35:08.850854] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-22T20:35:08.917693] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-22T20:35:09.033310] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T20:35:09.219123] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-22T20:35:09.227612] [INFO ] [REMOTE ] PGR: Full fetch complete (76783 records). [2025-10-22T20:35:09.227801] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-22T20:35:09.611484] [DEBUG] [VALIDATOR ] PGR: All expected trading days are present. [2025-10-22T20:35:09.612681] [DEBUG] [VALIDATOR ] PGR: Primary data validation passed. [2025-10-22T20:35:09.613904] [INFO ] [MAIN ] PGR: Fetched primary data is valid. [2025-10-22T20:35:09.613971] [DEBUG] [LOCAL ] PGR: Saving primary data. [2025-10-22T20:35:09.615423] [DEBUG] [LOCAL ] PGR: Trimmed 76783 records to 52867 (keeping 200 days of data) [2025-10-22T20:35:09.717880] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-22T20:35:09.949583] [DEBUG] [LOCAL ] PGR: Primary data saved (52867 records). [2025-10-22T20:35:09.949781] [INFO ] [MAIN ] PGR: Full history saved. [2025-10-22T20:35:09.950453] [INFO ] [MAIN ] Update Progress: 1672/2367 symbols completed. PGR took 29.2s. Estimated remaining: 1h 29m 24s. Rate: 7.8 symbols/min [2025-10-22T20:35:10.117149] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:35:10.161524] [DEBUG] [LOCAL ] PHG: Loaded 45554 existing records from primary storage. [2025-10-22T20:35:10.161878] [INFO ] [MAIN ] PHG: Loaded 45554 existing records. [2025-10-22T20:35:10.343833] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:35:10.344091] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-22T20:35:10.344140] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-22T20:35:10.344368] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-10-22T20:35:10.344427] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-22T20:35:10.519142] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-22T20:35:10.717855] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:35:10.742602] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-22T20:35:11.317637] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-10-22T20:35:11.618033] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-22T20:35:11.645368] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T20:35:12.117677] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-22T20:35:12.917785] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-22T20:35:13.435450] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-22T20:35:13.494604] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T20:35:13.501951] [INFO ] [REMOTE ] PGRE: Full fetch complete (64504 records). [2025-10-22T20:35:13.502061] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-22T20:35:13.727814] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-10-22T20:35:13.891852] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-10-22T20:35:13.891927] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-10-22T20:35:13.892980] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-10-22T20:35:13.893042] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-10-22T20:35:13.894277] [DEBUG] [LOCAL ] PGRE: Trimmed 64504 records to 46946 (keeping 200 days of data) [2025-10-22T20:35:14.147862] [DEBUG] [LOCAL ] PGRE: Primary data saved (46946 records). [2025-10-22T20:35:14.148050] [INFO ] [MAIN ] PGRE: Full history saved. [2025-10-22T20:35:14.148153] [INFO ] [MAIN ] Update Progress: 1673/2367 symbols completed. PGRE took 28.0s. Estimated remaining: 1h 29m 15s. Rate: 7.8 symbols/min [2025-10-22T20:35:14.319808] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:35:14.335132] [DEBUG] [LOCAL ] PHI: Loaded 15197 existing records from primary storage. [2025-10-22T20:35:14.335337] [INFO ] [MAIN ] PHI: Loaded 15197 existing records. [2025-10-22T20:35:14.519081] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:35:14.519159] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-22T20:35:14.519363] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-22T20:35:14.520163] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-22T20:35:14.520340] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-10-22T20:35:14.520395] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-22T20:35:14.919720] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T20:35:14.925943] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:35:15.317705] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-22T20:35:15.367138] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T20:35:15.799151] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-22T20:35:16.117704] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-10-22T20:35:16.851972] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T20:35:16.917702] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-22T20:35:17.717702] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-22T20:35:17.890924] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T20:35:17.938602] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-22T20:35:18.473414] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-22T20:35:18.517673] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-22T20:35:19.317640] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-22T20:35:19.430210] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T20:35:20.117772] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-22T20:35:20.448499] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T20:35:20.917681] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-22T20:35:21.579998] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T20:35:21.642106] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-22T20:35:21.717635] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-22T20:35:22.517684] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-22T20:35:23.317761] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-10-22T20:35:23.342665] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T20:35:23.613469] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-22T20:35:24.117752] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-22T20:35:24.917766] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-10-22T20:35:24.976886] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-22T20:35:24.979090] [INFO ] [REMOTE ] PGZ: Full fetch complete (8191 records). [2025-10-22T20:35:24.979191] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-22T20:35:25.246577] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-22T20:35:25.423742] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-10-22T20:35:25.423830] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-10-22T20:35:25.424107] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-10-22T20:35:25.424173] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-10-22T20:35:25.424579] [DEBUG] [LOCAL ] PGZ: Trimmed 8191 records to 5498 (keeping 200 days of data) [2025-10-22T20:35:25.458919] [DEBUG] [LOCAL ] PGZ: Primary data saved (5498 records). [2025-10-22T20:35:25.459063] [INFO ] [MAIN ] PGZ: Full history saved. [2025-10-22T20:35:25.459151] [INFO ] [MAIN ] Update Progress: 1674/2367 symbols completed. PGZ took 27.3s. Estimated remaining: 1h 29m 9s. Rate: 7.8 symbols/min [2025-10-22T20:35:25.642586] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:35:25.675812] [DEBUG] [LOCAL ] PHIN: Loaded 31536 existing records from primary storage. [2025-10-22T20:35:25.676098] [INFO ] [MAIN ] PHIN: Loaded 31536 existing records. [2025-10-22T20:35:25.722821] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-22T20:35:25.867378] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:35:25.867623] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-22T20:35:25.867789] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-22T20:35:25.868313] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-10-22T20:35:25.868368] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-22T20:35:26.235440] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:35:26.517621] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-22T20:35:26.873530] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T20:35:27.039916] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-22T20:35:27.317689] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-22T20:35:28.117631] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-10-22T20:35:28.148270] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T20:35:28.426907] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T20:35:28.917755] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-22T20:35:29.717738] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-10-22T20:35:29.912581] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T20:35:30.447342] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T20:35:30.517607] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-22T20:35:31.027137] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T20:35:31.317755] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-10-22T20:35:32.117745] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-22T20:35:32.284039] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T20:35:32.917631] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-22T20:35:33.062727] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T20:35:33.103224] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T20:35:33.717638] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-22T20:35:34.517633] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-10-22T20:35:34.586219] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T20:35:34.742753] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T20:35:35.317682] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-10-22T20:35:35.681941] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T20:35:36.117788] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-10-22T20:35:36.547467] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T20:35:36.917691] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-22T20:35:37.717636] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-10. [2025-10-22T20:35:37.878114] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T20:35:38.368293] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T20:35:38.517696] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-22T20:35:38.949820] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T20:35:38.955124] [INFO ] [REMOTE ] PH: Full fetch complete (55812 records). [2025-10-22T20:35:38.955249] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-10-22T20:35:39.324052] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-10-22T20:35:39.343323] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-10-22T20:35:39.343425] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-10-22T20:35:39.344480] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-10-22T20:35:39.344678] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-10-22T20:35:39.345969] [DEBUG] [LOCAL ] PH: Trimmed 55812 records to 36514 (keeping 200 days of data) [2025-10-22T20:35:39.574599] [DEBUG] [LOCAL ] PH: Primary data saved (36514 records). [2025-10-22T20:35:39.574767] [INFO ] [MAIN ] PH: Full history saved. [2025-10-22T20:35:39.574854] [INFO ] [MAIN ] Update Progress: 1675/2367 symbols completed. PH took 35.3s. Estimated remaining: 1h 29m 4s. Rate: 7.8 symbols/min [2025-10-22T20:35:39.744727] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:35:39.770442] [DEBUG] [LOCAL ] PHK: Loaded 26917 existing records from primary storage. [2025-10-22T20:35:39.770802] [INFO ] [MAIN ] PHK: Loaded 26917 existing records. [2025-10-22T20:35:39.961923] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:35:39.962374] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-22T20:35:39.962440] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-22T20:35:39.962662] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-10-22T20:35:39.962723] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-22T20:35:40.125181] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-10-22T20:35:40.270256] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T20:35:40.368883] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:35:40.917701] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-22T20:35:41.370838] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-22T20:35:41.487580] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T20:35:41.717687] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-10-22T20:35:42.500595] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T20:35:42.517607] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-22T20:35:43.317634] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-22T20:35:43.488161] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T20:35:44.053040] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T20:35:44.117618] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-22T20:35:44.917678] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-10-22T20:35:45.140639] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T20:35:45.492600] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T20:35:45.717666] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-22T20:35:46.379199] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T20:35:46.517627] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-22T20:35:46.803081] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T20:35:47.317683] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-22T20:35:47.877270] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T20:35:47.882104] [INFO ] [REMOTE ] PHIN: Full fetch complete (47371 records). [2025-10-22T20:35:47.882216] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-22T20:35:48.127490] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-10. [2025-10-22T20:35:48.251196] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-10-22T20:35:48.251271] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-10-22T20:35:48.252093] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-10-22T20:35:48.252154] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-10-22T20:35:48.253074] [DEBUG] [LOCAL ] PHIN: Trimmed 47371 records to 31408 (keeping 200 days of data) [2025-10-22T20:35:48.439255] [DEBUG] [LOCAL ] PHIN: Primary data saved (31408 records). [2025-10-22T20:35:48.439389] [INFO ] [MAIN ] PHIN: Full history saved. [2025-10-22T20:35:48.439482] [INFO ] [MAIN ] Update Progress: 1676/2367 symbols completed. PHIN took 23.0s. Estimated remaining: 1h 28m 57s. Rate: 7.8 symbols/min [2025-10-22T20:35:48.605908] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:35:48.654495] [DEBUG] [LOCAL ] PHM: Loaded 51692 existing records from primary storage. [2025-10-22T20:35:48.654826] [INFO ] [MAIN ] PHM: Loaded 51692 existing records. [2025-10-22T20:35:48.845740] [WARN ] [MAIN ] PHM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:35:48.846051] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-22T20:35:48.846116] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-22T20:35:48.847491] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T20:35:48.847536] [DEBUG] [LOCAL ] PHM: Deleted primary data file. [2025-10-22T20:35:48.847754] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-22T20:35:48.917798] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-22T20:35:49.043121] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-22T20:35:49.124479] [INFO ] [REMOTE ] PHI: Full fetch complete (21363 records). [2025-10-22T20:35:49.135809] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-10-22T20:35:49.348519] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:35:49.616432] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-10-22T20:35:49.616511] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-10-22T20:35:49.617071] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-10-22T20:35:49.617133] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-10-22T20:35:49.617701] [DEBUG] [LOCAL ] PHI: Trimmed 21363 records to 15189 (keeping 200 days of data) [2025-10-22T20:35:49.706501] [DEBUG] [LOCAL ] PHI: Primary data saved (15189 records). [2025-10-22T20:35:49.706637] [INFO ] [MAIN ] PHI: Full history saved. [2025-10-22T20:35:49.706756] [INFO ] [MAIN ] Update Progress: 1677/2367 symbols completed. PHI took 35.6s. Estimated remaining: 1h 28m 46s. Rate: 7.8 symbols/min [2025-10-22T20:35:49.717744] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-22T20:35:50.502982] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T20:35:50.517609] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-10-22T20:35:51.317626] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-10. [2025-10-22T20:35:51.816858] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-22T20:35:51.889346] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-22T20:35:52.117737] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-22T20:35:52.917679] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-10-22T20:35:53.054694] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T20:35:53.061474] [INFO ] [REMOTE ] PHG: Full fetch complete (65742 records). [2025-10-22T20:35:53.061594] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-10-22T20:35:53.437969] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-10-22T20:35:53.438064] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-10-22T20:35:53.439057] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-10-22T20:35:53.439119] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-10-22T20:35:53.440564] [DEBUG] [LOCAL ] PHG: Trimmed 65742 records to 45475 (keeping 200 days of data) [2025-10-22T20:35:53.697966] [DEBUG] [LOCAL ] PHG: Primary data saved (45475 records). [2025-10-22T20:35:53.698090] [INFO ] [MAIN ] PHG: Full history saved. [2025-10-22T20:35:53.698660] [INFO ] [MAIN ] Update Progress: 1678/2367 symbols completed. PHG took 43.7s. Estimated remaining: 1h 28m 37s. Rate: 7.8 symbols/min [2025-10-22T20:35:54.011683] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T20:35:54.021392] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-22T20:35:54.231768] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-22T20:35:54.517749] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-10-22T20:35:56.008242] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T20:35:56.013886] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-10-22T20:35:56.073054] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T20:35:56.117614] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-22T20:35:57.175807] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T20:35:57.187917] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-10-22T20:35:58.184591] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-22T20:35:58.195408] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-22T20:35:58.341094] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-22T20:35:58.517756] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-10. [2025-10-22T20:35:59.836621] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T20:35:59.846164] [INFO ] [REMOTE ] PHK: Full fetch complete (39465 records). [2025-10-22T20:35:59.846456] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-10-22T20:36:00.288356] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-10-22T20:36:00.288590] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-10-22T20:36:00.290241] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-10-22T20:36:00.290332] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-10-22T20:36:00.319066] [DEBUG] [LOCAL ] PHK: Trimmed 39465 records to 26760 (keeping 200 days of data) [2025-10-22T20:36:00.320882] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-22T20:36:00.333007] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-22T20:36:00.504194] [DEBUG] [LOCAL ] PHK: Primary data saved (26760 records). [2025-10-22T20:36:00.504393] [INFO ] [MAIN ] PHK: Full history saved. [2025-10-22T20:36:00.504498] [INFO ] [MAIN ] Update Progress: 1679/2367 symbols completed. PHK took 20.9s. Estimated remaining: 1h 28m 29s. Rate: 7.8 symbols/min [2025-10-22T20:36:02.465980] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T20:36:02.476257] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-22T20:36:04.303234] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T20:36:04.315628] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-22T20:36:06.229056] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T20:36:06.240916] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-22T20:36:08.258580] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-22T20:36:08.270253] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-22T20:36:10.291550] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-22T20:36:10.300165] [INFO ] [REMOTE ] PHM: Full fetch complete (75241 records). [2025-10-22T20:36:10.300298] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-22T20:36:10.724591] [DEBUG] [VALIDATOR ] PHM: All expected trading days are present. [2025-10-22T20:36:10.724716] [DEBUG] [VALIDATOR ] PHM: Primary data validation passed. [2025-10-22T20:36:10.725882] [INFO ] [MAIN ] PHM: Fetched primary data is valid. [2025-10-22T20:36:10.725949] [DEBUG] [LOCAL ] PHM: Saving primary data. [2025-10-22T20:36:10.727437] [DEBUG] [LOCAL ] PHM: Trimmed 75241 records to 51691 (keeping 200 days of data) [2025-10-22T20:36:11.050250] [DEBUG] [LOCAL ] PHM: Primary data saved (51691 records). [2025-10-22T20:36:11.050388] [INFO ] [MAIN ] PHM: Full history saved. [2025-10-22T20:36:11.050464] [INFO ] [MAIN ] Update Progress: 1680/2367 symbols completed. PHM took 22.6s. Estimated remaining: 1h 28m 22s. Rate: 7.8 symbols/min [2025-10-22T20:36:11.685248] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:36:11.745629] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:36:11.765333] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:36:11.764397] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:36:11.773903] [DEBUG] [LOCAL ] PIM: Loaded 4874 existing records from primary storage. [2025-10-22T20:36:11.774345] [INFO ] [MAIN ] PIM: Loaded 4874 existing records. [2025-10-22T20:36:11.891627] [DEBUG] [LOCAL ] PINE: Loaded 14364 existing records from primary storage. [2025-10-22T20:36:11.896150] [INFO ] [MAIN ] PINE: Loaded 14364 existing records. [2025-10-22T20:36:12.064440] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:36:12.102763] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-22T20:36:12.091233] [DEBUG] [LOCAL ] PHR: Loaded 37942 existing records from primary storage. [2025-10-22T20:36:12.115021] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-22T20:36:12.119328] [INFO ] [MAIN ] PHR: Loaded 37942 existing records. [2025-10-22T20:36:12.130783] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-10-22T20:36:12.150725] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-22T20:36:12.371278] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:36:12.380000] [DEBUG] [LOCAL ] PII: Loaded 48742 existing records from primary storage. [2025-10-22T20:36:12.399907] [INFO ] [MAIN ] PII: Loaded 48742 existing records. [2025-10-22T20:36:12.394613] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-22T20:36:12.400419] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-22T20:36:12.510180] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-10-22T20:36:12.629164] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-22T20:36:12.672173] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:36:12.700842] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-22T20:36:12.757991] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-22T20:36:12.858215] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-10-22T20:36:12.921741] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:36:12.913382] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-22T20:36:12.942567] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-22T20:36:12.985490] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-22T20:36:13.127735] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-10-22T20:36:13.222208] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-22T20:36:13.227309] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:36:13.261046] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-22T20:36:13.848286] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:36:13.879361] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-22T20:36:14.017044] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:36:14.027909] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-22T20:36:14.097104] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:36:14.097426] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-22T20:36:14.597620] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T20:36:14.598979] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-22T20:36:15.135058] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-22T20:36:15.136593] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-22T20:36:15.296460] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T20:36:15.300265] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-22T20:36:15.740614] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T20:36:15.748087] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-22T20:36:15.792471] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T20:36:15.802164] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-22T20:36:15.838557] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-22T20:36:15.840079] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-22T20:36:16.223365] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-22T20:36:16.226873] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-22T20:36:16.382889] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-22T20:36:16.384461] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-22T20:36:17.087986] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T20:36:17.094295] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-22T20:36:17.319381] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T20:36:17.322832] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-22T20:36:17.329563] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-22T20:36:17.331357] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-22T20:36:17.561176] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T20:36:17.570619] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-22T20:36:17.865713] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-22T20:36:17.867280] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-22T20:36:18.489782] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T20:36:18.494366] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-22T20:36:18.657365] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T20:36:18.659056] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-22T20:36:18.750912] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T20:36:18.758874] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-22T20:36:19.149821] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-22T20:36:19.317569] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T20:36:19.317802] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-22T20:36:19.341970] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T20:36:20.117684] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-22T20:36:20.248468] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T20:36:20.357279] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T20:36:20.917637] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-22T20:36:21.717944] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-22T20:36:22.133727] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T20:36:22.359373] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-22T20:36:22.383264] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-22T20:36:22.517671] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-22T20:36:23.317691] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-22T20:36:23.692919] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T20:36:24.117682] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-22T20:36:24.917671] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-22T20:36:24.990069] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T20:36:25.114334] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T20:36:25.717678] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-22T20:36:26.517702] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-22T20:36:26.700183] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-22T20:36:26.888186] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T20:36:27.252102] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-22T20:36:27.253579] [INFO ] [REMOTE ] PIM: Full fetch complete (6451 records). [2025-10-22T20:36:27.253700] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-22T20:36:27.326789] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-22T20:36:27.681796] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-10-22T20:36:27.681899] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-10-22T20:36:27.682105] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-10-22T20:36:27.682203] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-10-22T20:36:27.682606] [DEBUG] [LOCAL ] PIM: Trimmed 6451 records to 4846 (keeping 200 days of data) [2025-10-22T20:36:27.710602] [DEBUG] [LOCAL ] PIM: Primary data saved (4846 records). [2025-10-22T20:36:27.710738] [INFO ] [MAIN ] PIM: Full history saved. [2025-10-22T20:36:27.710822] [INFO ] [MAIN ] Update Progress: 1681/2367 symbols completed. PIM took 16.7s. Estimated remaining: 1h 28m 18s. Rate: 7.8 symbols/min [2025-10-22T20:36:27.874971] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:36:27.923396] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-10-22T20:36:27.923796] [INFO ] [MAIN ] PINS: Loaded 53693 existing records. [2025-10-22T20:36:28.096220] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:36:28.096429] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-22T20:36:28.096475] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-22T20:36:28.096702] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-10-22T20:36:28.096759] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-22T20:36:28.126468] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-22T20:36:28.439781] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:36:28.917669] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-10-22T20:36:29.144360] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-22T20:36:29.234794] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T20:36:29.237903] [INFO ] [REMOTE ] PINE: Full fetch complete (21022 records). [2025-10-22T20:36:29.237974] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-22T20:36:29.599510] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-10-22T20:36:29.599584] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-10-22T20:36:29.600033] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-10-22T20:36:29.600093] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-10-22T20:36:29.600624] [DEBUG] [LOCAL ] PINE: Trimmed 21022 records to 14383 (keeping 200 days of data) [2025-10-22T20:36:29.685438] [DEBUG] [LOCAL ] PINE: Primary data saved (14383 records). [2025-10-22T20:36:29.685576] [INFO ] [MAIN ] PINE: Full history saved. [2025-10-22T20:36:29.685675] [INFO ] [MAIN ] Update Progress: 1682/2367 symbols completed. PINE took 18.6s. Estimated remaining: 1h 28m 8s. Rate: 7.8 symbols/min [2025-10-22T20:36:29.722885] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-22T20:36:29.854161] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:36:29.868432] [DEBUG] [LOCAL ] PIPR: Loaded 15094 existing records from primary storage. [2025-10-22T20:36:29.868689] [INFO ] [MAIN ] PIPR: Loaded 15094 existing records. [2025-10-22T20:36:30.042083] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:36:30.042330] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-22T20:36:30.042377] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-22T20:36:30.042543] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-10-22T20:36:30.042580] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-22T20:36:30.396252] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:36:30.517637] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-22T20:36:30.567900] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T20:36:31.317750] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-10-22T20:36:31.847681] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-22T20:36:31.868073] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T20:36:32.117693] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-22T20:36:32.917735] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-22T20:36:32.935950] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T20:36:33.041826] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T20:36:33.717683] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-22T20:36:34.517737] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-22T20:36:34.684753] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T20:36:34.961279] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-22T20:36:35.317684] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-22T20:36:36.117684] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-22T20:36:36.585015] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-22T20:36:36.639389] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T20:36:36.917667] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-10-22T20:36:37.717630] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-22T20:36:37.952199] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T20:36:38.517634] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-22T20:36:38.744697] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T20:36:38.795719] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T20:36:39.317679] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-10. [2025-10-22T20:36:40.117633] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-22T20:36:40.314669] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T20:36:40.322443] [INFO ] [REMOTE ] PII: Full fetch complete (71290 records). [2025-10-22T20:36:40.322568] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-22T20:36:40.708330] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-10-22T20:36:40.708609] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-10-22T20:36:40.709880] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-10-22T20:36:40.710023] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-10-22T20:36:40.734623] [DEBUG] [LOCAL ] PII: Trimmed 71290 records to 48713 (keeping 200 days of data) [2025-10-22T20:36:40.734439] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-22T20:36:40.803871] [INFO ] [REMOTE ] PHR: Full fetch complete (53530 records). [2025-10-22T20:36:40.831889] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-10-22T20:36:40.920549] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-22T20:36:41.378607] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-10-22T20:36:41.384056] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T20:36:41.382600] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-10-22T20:36:41.392822] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-10-22T20:36:41.393411] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-10-22T20:36:41.404081] [DEBUG] [LOCAL ] PHR: Trimmed 53530 records to 37953 (keeping 200 days of data) [2025-10-22T20:36:41.554273] [DEBUG] [LOCAL ] PII: Primary data saved (48713 records). [2025-10-22T20:36:41.560443] [INFO ] [MAIN ] PII: Full history saved. [2025-10-22T20:36:41.564160] [INFO ] [MAIN ] Update Progress: 1683/2367 symbols completed. PII took 30.5s. Estimated remaining: 1h 28m 2s. Rate: 7.8 symbols/min [2025-10-22T20:36:41.727189] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-22T20:36:41.802451] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:36:41.872795] [DEBUG] [LOCAL ] PHR: Primary data saved (37953 records). [2025-10-22T20:36:41.879002] [INFO ] [MAIN ] PHR: Full history saved. [2025-10-22T20:36:41.879957] [INFO ] [MAIN ] Update Progress: 1684/2367 symbols completed. PHR took 30.8s. Estimated remaining: 1h 27m 51s. Rate: 7.8 symbols/min [2025-10-22T20:36:41.910814] [DEBUG] [LOCAL ] PJT: Loaded 21350 existing records from primary storage. [2025-10-22T20:36:41.954777] [INFO ] [MAIN ] PJT: Loaded 21350 existing records. [2025-10-22T20:36:42.194612] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:36:42.236490] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:36:42.236776] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-22T20:36:42.236912] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-22T20:36:42.237111] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-10-22T20:36:42.237168] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-22T20:36:42.610803] [DEBUG] [LOCAL ] PK: Loaded 52756 existing records from primary storage. [2025-10-22T20:36:42.668226] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:36:42.668534] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-22T20:36:42.664553] [INFO ] [MAIN ] PK: Loaded 52756 existing records. [2025-10-22T20:36:42.852823] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:36:42.853451] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-22T20:36:42.853594] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-22T20:36:42.853856] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-10-22T20:36:42.853906] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-22T20:36:43.139991] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T20:36:43.235117] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:36:43.253339] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-22T20:36:43.317622] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-22T20:36:44.100044] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T20:36:44.117616] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-22T20:36:44.917673] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-22T20:36:45.118428] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T20:36:45.449115] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-22T20:36:45.717638] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-22T20:36:46.320346] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T20:36:46.517633] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-22T20:36:46.776711] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T20:36:47.317667] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-22T20:36:48.117635] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-22T20:36:48.276137] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T20:36:48.279149] [INFO ] [REMOTE ] PIPR: Full fetch complete (21094 records). [2025-10-22T20:36:48.279221] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-22T20:36:48.662844] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-10-22T20:36:48.662973] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-10-22T20:36:48.663515] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-10-22T20:36:48.663590] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-10-22T20:36:48.664328] [DEBUG] [LOCAL ] PIPR: Trimmed 21094 records to 14992 (keeping 200 days of data) [2025-10-22T20:36:48.758498] [DEBUG] [LOCAL ] PIPR: Primary data saved (14992 records). [2025-10-22T20:36:48.758676] [INFO ] [MAIN ] PIPR: Full history saved. [2025-10-22T20:36:48.758905] [INFO ] [MAIN ] Update Progress: 1685/2367 symbols completed. PIPR took 19.1s. Estimated remaining: 1h 27m 43s. Rate: 7.8 symbols/min [2025-10-22T20:36:48.889860] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-22T20:36:48.921450] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-22T20:36:48.972028] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:36:48.988891] [DEBUG] [LOCAL ] PKE: Loaded 14243 existing records from primary storage. [2025-10-22T20:36:48.989117] [INFO ] [MAIN ] PKE: Loaded 14243 existing records. [2025-10-22T20:36:49.160977] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:36:49.161207] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-22T20:36:49.161255] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-22T20:36:49.161415] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-10-22T20:36:49.161453] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-22T20:36:49.509087] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:36:49.717638] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-22T20:36:49.755240] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T20:36:50.426734] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T20:36:50.517677] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-10-22T20:36:50.966849] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T20:36:51.317676] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-22T20:36:52.086927] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T20:36:52.117631] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-10-22T20:36:52.289118] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T20:36:52.917628] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-22T20:36:53.378456] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-22T20:36:53.717838] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-22T20:36:54.517744] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-10-22T20:36:55.331294] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-22T20:36:55.333757] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-22T20:36:55.359528] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T20:36:55.469750] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-22T20:36:56.117639] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-10-22T20:36:56.245475] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-22T20:36:56.917696] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-22T20:36:57.340432] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T20:36:57.717787] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-22T20:36:57.886434] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-22T20:36:58.517761] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-10-22T20:36:59.317638] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-22T20:36:59.897871] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T20:36:59.933130] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-22T20:37:00.117666] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-22T20:37:00.917670] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-10-22T20:37:01.459939] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-22T20:37:01.708875] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T20:37:01.717609] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-10. [2025-10-22T20:37:02.076434] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T20:37:02.517699] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-22T20:37:02.821815] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T20:37:02.825599] [INFO ] [REMOTE ] PJT: Full fetch complete (32145 records). [2025-10-22T20:37:02.825761] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-10-22T20:37:03.192488] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-10-22T20:37:03.192561] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-10-22T20:37:03.193346] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-10-22T20:37:03.193407] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-10-22T20:37:03.194138] [DEBUG] [LOCAL ] PJT: Trimmed 32145 records to 21211 (keeping 200 days of data) [2025-10-22T20:37:03.318341] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-22T20:37:03.331295] [DEBUG] [LOCAL ] PJT: Primary data saved (21211 records). [2025-10-22T20:37:03.331463] [INFO ] [MAIN ] PJT: Full history saved. [2025-10-22T20:37:03.331565] [INFO ] [MAIN ] Update Progress: 1686/2367 symbols completed. PJT took 21.8s. Estimated remaining: 1h 27m 38s. Rate: 7.8 symbols/min [2025-10-22T20:37:03.509905] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T20:37:03.513123] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:37:03.554554] [DEBUG] [LOCAL ] PKG: Loaded 38576 existing records from primary storage. [2025-10-22T20:37:03.554885] [INFO ] [MAIN ] PKG: Loaded 38576 existing records. [2025-10-22T20:37:03.756476] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:37:03.756791] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-22T20:37:03.756852] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-22T20:37:03.757269] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-10-22T20:37:03.757327] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-22T20:37:04.119617] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-22T20:37:04.119536] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:37:04.917754] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-22T20:37:05.148559] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T20:37:05.722756] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-22T20:37:05.744864] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-22T20:37:06.517685] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-22T20:37:07.037863] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-22T20:37:07.317722] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-10-22T20:37:07.746800] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T20:37:07.774599] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T20:37:08.117666] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-22T20:37:08.917634] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-22T20:37:09.136360] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-22T20:37:09.717623] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-22T20:37:09.807633] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T20:37:10.502011] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-22T20:37:10.517611] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-22T20:37:11.284801] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T20:37:11.317620] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-22T20:37:12.117699] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-22T20:37:12.686389] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-22T20:37:12.698798] [INFO ] [REMOTE ] PINS: Full fetch complete (77871 records). [2025-10-22T20:37:12.699087] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-22T20:37:12.925766] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-10-22T20:37:13.135890] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-10-22T20:37:13.136032] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-10-22T20:37:13.137504] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-10-22T20:37:13.137621] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-10-22T20:37:13.174269] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-22T20:37:13.185905] [DEBUG] [LOCAL ] PINS: Trimmed 77871 records to 53693 (keeping 200 days of data) [2025-10-22T20:37:13.324321] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T20:37:13.568629] [DEBUG] [LOCAL ] PINS: Primary data saved (53693 records). [2025-10-22T20:37:13.568930] [INFO ] [MAIN ] PINS: Full history saved. [2025-10-22T20:37:13.569043] [INFO ] [MAIN ] Update Progress: 1687/2367 symbols completed. PINS took 45.9s. Estimated remaining: 1h 27m 32s. Rate: 7.8 symbols/min [2025-10-22T20:37:13.722843] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-22T20:37:13.750193] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:37:13.788954] [DEBUG] [LOCAL ] PKST: Loaded 18231 existing records from primary storage. [2025-10-22T20:37:13.789315] [INFO ] [MAIN ] PKST: Loaded 18231 existing records. [2025-10-22T20:37:13.968000] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:37:13.968288] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-22T20:37:13.968373] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-22T20:37:13.968629] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-10-22T20:37:13.968729] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-22T20:37:14.359772] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:37:14.517739] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-22T20:37:14.752329] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T20:37:14.797844] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T20:37:14.801436] [INFO ] [REMOTE ] PKE: Full fetch complete (18437 records). [2025-10-22T20:37:14.801506] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-22T20:37:15.159892] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-10-22T20:37:15.159990] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-10-22T20:37:15.160436] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-10-22T20:37:15.160507] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-10-22T20:37:15.161259] [DEBUG] [LOCAL ] PKE: Trimmed 18437 records to 14290 (keeping 200 days of data) [2025-10-22T20:37:15.250334] [DEBUG] [LOCAL ] PKE: Primary data saved (14290 records). [2025-10-22T20:37:15.250489] [INFO ] [MAIN ] PKE: Full history saved. [2025-10-22T20:37:15.250581] [INFO ] [MAIN ] Update Progress: 1688/2367 symbols completed. PKE took 26.5s. Estimated remaining: 1h 27m 22s. Rate: 7.8 symbols/min [2025-10-22T20:37:15.324289] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-22T20:37:15.421598] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:37:15.442428] [DEBUG] [LOCAL ] PKX: Loaded 22782 existing records from primary storage. [2025-10-22T20:37:15.442736] [INFO ] [MAIN ] PKX: Loaded 22782 existing records. [2025-10-22T20:37:15.584185] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T20:37:15.642260] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:37:15.642535] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-22T20:37:15.642586] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-22T20:37:15.642896] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-10-22T20:37:15.642954] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-22T20:37:15.991237] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:37:16.117627] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-22T20:37:16.917635] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-22T20:37:17.597445] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-22T20:37:17.652275] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T20:37:17.717618] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-22T20:37:18.089718] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T20:37:18.517753] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-10-22T20:37:19.138302] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T20:37:19.317738] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-22T20:37:20.059126] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T20:37:20.117692] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-22T20:37:20.631882] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T20:37:20.917734] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-10-22T20:37:21.441771] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T20:37:21.717767] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-22T20:37:22.517624] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-22T20:37:22.616787] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T20:37:22.667013] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-22T20:37:23.317741] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-22T20:37:24.117737] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-10-22T20:37:24.195726] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T20:37:24.408857] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-22T20:37:24.917742] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-22T20:37:25.717738] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-22T20:37:25.861809] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T20:37:26.223986] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T20:37:26.517634] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-22T20:37:27.317694] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-10-22T20:37:27.460587] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T20:37:27.756460] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T20:37:28.117717] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-22T20:37:28.917667] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-22T20:37:29.002993] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T20:37:29.340118] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T20:37:29.717766] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-22T20:37:30.212635] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-22T20:37:30.517751] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-22T20:37:31.317637] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-22T20:37:31.430572] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T20:37:31.588458] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-22T20:37:32.117760] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-22T20:37:32.248609] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-22T20:37:32.917669] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-22T20:37:33.235020] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-22T20:37:33.717741] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-22T20:37:34.517639] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-10-22T20:37:34.787374] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T20:37:34.796052] [INFO ] [REMOTE ] PK: Full fetch complete (76538 records). [2025-10-22T20:37:34.796230] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-22T20:37:35.129094] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T20:37:35.217739] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-10-22T20:37:35.217833] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-10-22T20:37:35.219067] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-10-22T20:37:35.219147] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-10-22T20:37:35.220685] [DEBUG] [LOCAL ] PK: Trimmed 76538 records to 52755 (keeping 200 days of data) [2025-10-22T20:37:35.317909] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-22T20:37:35.542709] [DEBUG] [LOCAL ] PK: Primary data saved (52755 records). [2025-10-22T20:37:35.542815] [INFO ] [MAIN ] PK: Full history saved. [2025-10-22T20:37:35.542890] [INFO ] [MAIN ] Update Progress: 1689/2367 symbols completed. PK took 53.7s. Estimated remaining: 1h 27m 19s. Rate: 7.8 symbols/min [2025-10-22T20:37:35.714223] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:37:35.764492] [DEBUG] [LOCAL ] PL: Loaded 53209 existing records from primary storage. [2025-10-22T20:37:35.764860] [INFO ] [MAIN ] PL: Loaded 53209 existing records. [2025-10-22T20:37:35.947265] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:37:35.947499] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-22T20:37:35.947554] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-22T20:37:35.947805] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-10-22T20:37:35.947862] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-22T20:37:36.130410] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-22T20:37:36.318051] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:37:36.342444] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T20:37:36.420128] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T20:37:36.917733] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-10-22T20:37:37.439922] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T20:37:37.443521] [INFO ] [REMOTE ] PKX: Full fetch complete (35931 records). [2025-10-22T20:37:37.443597] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-22T20:37:37.723074] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-22T20:37:37.826255] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-10-22T20:37:37.826357] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-10-22T20:37:37.827278] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-10-22T20:37:37.827344] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-10-22T20:37:37.828139] [DEBUG] [LOCAL ] PKX: Trimmed 35931 records to 22626 (keeping 200 days of data) [2025-10-22T20:37:37.964543] [DEBUG] [LOCAL ] PKX: Primary data saved (22626 records). [2025-10-22T20:37:37.964702] [INFO ] [MAIN ] PKX: Full history saved. [2025-10-22T20:37:37.964794] [INFO ] [MAIN ] Update Progress: 1690/2367 symbols completed. PKX took 22.7s. Estimated remaining: 1h 27m 9s. Rate: 7.8 symbols/min [2025-10-22T20:37:38.139354] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:37:38.189751] [DEBUG] [LOCAL ] PLD: Loaded 53418 existing records from primary storage. [2025-10-22T20:37:38.190063] [INFO ] [MAIN ] PLD: Loaded 53418 existing records. [2025-10-22T20:37:38.373935] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:37:38.374213] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-22T20:37:38.374298] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-22T20:37:38.375017] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-10-22T20:37:38.375082] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-22T20:37:38.527287] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-10. [2025-10-22T20:37:38.759992] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T20:37:38.780604] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:37:39.317698] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-22T20:37:39.848527] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T20:37:39.852199] [INFO ] [REMOTE ] PKST: Full fetch complete (28935 records). [2025-10-22T20:37:39.852275] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-10-22T20:37:40.120393] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-10. [2025-10-22T20:37:40.265536] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-10-22T20:37:40.265675] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-10-22T20:37:40.266813] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-10-22T20:37:40.266945] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-10-22T20:37:40.268051] [DEBUG] [LOCAL ] PKST: Trimmed 28935 records to 18133 (keeping 200 days of data) [2025-10-22T20:37:40.407281] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-22T20:37:40.411803] [DEBUG] [LOCAL ] PKST: Primary data saved (18133 records). [2025-10-22T20:37:40.417065] [INFO ] [MAIN ] PKST: Full history saved. [2025-10-22T20:37:40.423830] [INFO ] [MAIN ] Update Progress: 1691/2367 symbols completed. PKST took 26.9s. Estimated remaining: 1h 26m 59s. Rate: 7.8 symbols/min [2025-10-22T20:37:40.594010] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:37:40.624928] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T20:37:40.672751] [DEBUG] [LOCAL ] PLNT: Loaded 48051 existing records from primary storage. [2025-10-22T20:37:40.673070] [INFO ] [MAIN ] PLNT: Loaded 48051 existing records. [2025-10-22T20:37:40.849251] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:37:40.849479] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-22T20:37:40.849567] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-22T20:37:40.849807] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-10-22T20:37:40.849865] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-22T20:37:40.926613] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-22T20:37:41.211384] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:37:41.664613] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T20:37:41.671292] [INFO ] [REMOTE ] PKG: Full fetch complete (57676 records). [2025-10-22T20:37:41.671434] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-10-22T20:37:41.721140] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-22T20:37:42.056863] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-10-22T20:37:42.057040] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-10-22T20:37:42.058087] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-10-22T20:37:42.058150] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-10-22T20:37:42.059450] [DEBUG] [LOCAL ] PKG: Trimmed 57676 records to 38565 (keeping 200 days of data) [2025-10-22T20:37:42.175717] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T20:37:42.337011] [DEBUG] [LOCAL ] PKG: Primary data saved (38565 records). [2025-10-22T20:37:42.337163] [INFO ] [MAIN ] PKG: Full history saved. [2025-10-22T20:37:42.337243] [INFO ] [MAIN ] Update Progress: 1692/2367 symbols completed. PKG took 39.0s. Estimated remaining: 1h 26m 49s. Rate: 7.8 symbols/min [2025-10-22T20:37:42.500224] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:37:42.519116] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-22T20:37:42.519728] [DEBUG] [LOCAL ] PLOW: Loaded 19800 existing records from primary storage. [2025-10-22T20:37:42.520868] [INFO ] [MAIN ] PLOW: Loaded 19800 existing records. [2025-10-22T20:37:42.697422] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:37:42.697687] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-22T20:37:42.697763] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-22T20:37:42.697944] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-10-22T20:37:42.697982] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-22T20:37:43.038243] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:37:43.317675] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-22T20:37:43.649993] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T20:37:44.117780] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-22T20:37:44.414107] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T20:37:44.584182] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-22T20:37:44.917685] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-22T20:37:45.044024] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-22T20:37:45.717755] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-22T20:37:46.043954] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T20:37:46.517747] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-22T20:37:46.808439] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-22T20:37:47.317689] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-22T20:37:48.117753] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-22T20:37:48.315397] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-22T20:37:48.636891] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-22T20:37:48.917743] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-22T20:37:49.325509] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-22T20:37:49.717764] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-10-22T20:37:50.517694] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-22T20:37:50.996948] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-22T20:37:51.112865] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T20:37:51.317730] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-22T20:37:52.117688] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-22T20:37:52.428872] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T20:37:52.917694] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-22T20:37:53.120126] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T20:37:53.532826] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-22T20:37:53.717685] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-22T20:37:54.517779] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-10-22T20:37:54.645462] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T20:37:55.317762] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-22T20:37:55.850511] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T20:37:56.068079] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-22T20:37:56.117661] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-22T20:37:56.917793] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-10-22T20:37:57.125895] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T20:37:57.717810] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-22T20:37:58.131432] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T20:37:58.517697] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-22T20:37:58.740910] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-22T20:37:59.317761] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-22T20:37:59.643600] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T20:37:59.679924] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-22T20:38:00.117750] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-22T20:38:00.917751] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-10-22T20:38:01.023255] [DEBUG] [REMOTE ] PLOW: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-22T20:38:01.023687] [WARN ] [REMOTE ] PLOW: No data returned for month 2025-07 [2025-10-22T20:38:01.023784] [FATAL] [REMOTE ] PLOW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T20:38:01.023878] [FATAL] [MAIN ] PLOW: Failed to fetch primary data. [2025-10-22T20:38:01.023942] [WARN ] [MAIN ] PLOW: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T20:38:01.024017] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-22T20:38:01.024093] [DEBUG] [LOCAL ] PLOW: No primary data file found to delete. [2025-10-22T20:38:01.024173] [INFO ] [LOCAL ] PLOW: Starting deletion of derivative data. [2025-10-22T20:38:01.024347] [DEBUG] [LOCAL ] PLOW: Deleted derivative data file. [2025-10-22T20:38:01.024439] [INFO ] [MAIN ] Update Progress: 1693/2367 symbols completed. PLOW took 18.7s. Estimated remaining: 1h 26m 46s. Rate: 7.8 symbols/min [2025-10-22T20:38:01.203248] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:38:01.240134] [DEBUG] [LOCAL ] PLYM: Loaded 34464 existing records from primary storage. [2025-10-22T20:38:01.240411] [INFO ] [MAIN ] PLYM: Loaded 34464 existing records. [2025-10-22T20:38:01.413185] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:38:01.413415] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-22T20:38:01.413463] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-22T20:38:01.413692] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-10-22T20:38:01.413749] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-22T20:38:01.721789] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-22T20:38:01.814352] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:38:01.860912] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-22T20:38:01.978545] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-22T20:38:02.517730] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-22T20:38:02.875949] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T20:38:03.317738] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-22T20:38:04.117687] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-22T20:38:04.395368] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T20:38:04.726870] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T20:38:04.917788] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-22T20:38:05.717779] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-22T20:38:06.517776] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-22T20:38:06.773249] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T20:38:06.898431] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-10-22T20:38:07.052482] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T20:38:07.317738] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-22T20:38:07.468797] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T20:38:08.117771] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-22T20:38:08.856552] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T20:38:08.917634] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-22T20:38:09.717763] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-22T20:38:10.203504] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-22T20:38:10.213946] [INFO ] [REMOTE ] PLD: Full fetch complete (77512 records). [2025-10-22T20:38:10.214217] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-22T20:38:10.520824] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-22T20:38:10.676810] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-10-22T20:38:10.677165] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-10-22T20:38:10.679216] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-10-22T20:38:10.681594] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-10-22T20:38:10.681454] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T20:38:10.694453] [DEBUG] [LOCAL ] PLD: Trimmed 77512 records to 53416 (keeping 200 days of data) [2025-10-22T20:38:11.070522] [DEBUG] [LOCAL ] PLD: Primary data saved (53416 records). [2025-10-22T20:38:11.070740] [INFO ] [MAIN ] PLD: Full history saved. [2025-10-22T20:38:11.070851] [INFO ] [MAIN ] Update Progress: 1694/2367 symbols completed. PLD took 33.1s. Estimated remaining: 1h 26m 39s. Rate: 7.8 symbols/min [2025-10-22T20:38:11.276677] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:38:11.317791] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-22T20:38:11.341957] [DEBUG] [LOCAL ] PM: Loaded 53674 existing records from primary storage. [2025-10-22T20:38:11.342629] [INFO ] [MAIN ] PM: Loaded 53674 existing records. [2025-10-22T20:38:11.567761] [WARN ] [MAIN ] PM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:38:11.568046] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-22T20:38:11.568112] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-22T20:38:11.568351] [DEBUG] [LOCAL ] PM: Deleted primary data file. [2025-10-22T20:38:11.568393] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-22T20:38:11.988087] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:38:12.117740] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-22T20:38:12.310470] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T20:38:12.525713] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-10 (2.81 seconds). [2025-10-22T20:38:12.534515] [INFO ] [REMOTE ] PL: Full fetch complete (77124 records). [2025-10-22T20:38:12.534702] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-22T20:38:12.821476] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T20:38:12.931320] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-22T20:38:12.956059] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-10-22T20:38:12.956126] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-10-22T20:38:12.957377] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-10-22T20:38:12.957444] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-10-22T20:38:12.959222] [DEBUG] [LOCAL ] PL: Trimmed 77124 records to 53212 (keeping 200 days of data) [2025-10-22T20:38:13.260467] [DEBUG] [LOCAL ] PL: Primary data saved (53212 records). [2025-10-22T20:38:13.260623] [INFO ] [MAIN ] PL: Full history saved. [2025-10-22T20:38:13.260753] [INFO ] [MAIN ] Update Progress: 1695/2367 symbols completed. PL took 37.7s. Estimated remaining: 1h 26m 29s. Rate: 7.8 symbols/min [2025-10-22T20:38:13.424631] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:38:13.444545] [DEBUG] [LOCAL ] PML: Loaded 21933 existing records from primary storage. [2025-10-22T20:38:13.444809] [INFO ] [MAIN ] PML: Loaded 21933 existing records. [2025-10-22T20:38:13.615260] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:38:13.615483] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-22T20:38:13.615529] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-22T20:38:13.615735] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-10-22T20:38:13.615820] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-22T20:38:13.722859] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-22T20:38:13.969910] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:38:14.224263] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-22T20:38:14.448406] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T20:38:14.524336] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-22T20:38:14.545176] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-22T20:38:14.556841] [INFO ] [REMOTE ] PLNT: Full fetch complete (70635 records). [2025-10-22T20:38:14.557017] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-22T20:38:14.936802] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-10-22T20:38:14.936938] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-10-22T20:38:14.938076] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-10-22T20:38:14.938140] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-10-22T20:38:14.939409] [DEBUG] [LOCAL ] PLNT: Trimmed 70635 records to 48026 (keeping 200 days of data) [2025-10-22T20:38:15.219362] [DEBUG] [LOCAL ] PLNT: Primary data saved (48026 records). [2025-10-22T20:38:15.219515] [INFO ] [MAIN ] PLNT: Full history saved. [2025-10-22T20:38:15.219599] [INFO ] [MAIN ] Update Progress: 1696/2367 symbols completed. PLNT took 34.8s. Estimated remaining: 1h 26m 19s. Rate: 7.8 symbols/min [2025-10-22T20:38:15.322771] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-22T20:38:15.386761] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:38:15.397669] [DEBUG] [LOCAL ] PMM: Loaded 10018 existing records from primary storage. [2025-10-22T20:38:15.397914] [INFO ] [MAIN ] PMM: Loaded 10018 existing records. [2025-10-22T20:38:15.569795] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:38:15.569981] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-22T20:38:15.570026] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-22T20:38:15.570191] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-10-22T20:38:15.570247] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-22T20:38:15.913227] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:38:16.118254] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-22T20:38:16.119947] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T20:38:16.917723] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-22T20:38:17.004090] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T20:38:17.717637] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-22T20:38:18.006490] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T20:38:18.033447] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T20:38:18.517682] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-22T20:38:19.317758] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-22T20:38:19.393315] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T20:38:19.845100] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T20:38:20.050325] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-22T20:38:20.117625] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-22T20:38:20.917629] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-22T20:38:21.303006] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-22T20:38:21.717696] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-22T20:38:22.517688] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-22T20:38:22.709314] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T20:38:23.154805] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T20:38:23.317607] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-22T20:38:24.058217] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-22T20:38:24.117613] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-22T20:38:24.193794] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T20:38:24.917743] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-22T20:38:25.331361] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T20:38:25.717751] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-22T20:38:26.211451] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-22T20:38:26.517634] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-22T20:38:27.317739] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-22T20:38:27.898031] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-22T20:38:27.950729] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T20:38:28.117625] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-10-22T20:38:28.431076] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T20:38:28.917724] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-22T20:38:29.717730] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-22T20:38:30.502465] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-22T20:38:30.514728] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-22T20:38:30.522077] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-22T20:38:30.523979] [INFO ] [REMOTE ] PLYM: Full fetch complete (48043 records). [2025-10-22T20:38:30.524232] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-22T20:38:30.843088] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-22T20:38:30.922341] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-10-22T20:38:30.922423] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-10-22T20:38:30.923366] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-10-22T20:38:30.923428] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-10-22T20:38:30.924393] [DEBUG] [LOCAL ] PLYM: Trimmed 48043 records to 34435 (keeping 200 days of data) [2025-10-22T20:38:31.135730] [DEBUG] [LOCAL ] PLYM: Primary data saved (34435 records). [2025-10-22T20:38:31.135881] [INFO ] [MAIN ] PLYM: Full history saved. [2025-10-22T20:38:31.135981] [INFO ] [MAIN ] Update Progress: 1697/2367 symbols completed. PLYM took 30.1s. Estimated remaining: 1h 26m 15s. Rate: 7.8 symbols/min [2025-10-22T20:38:31.324037] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:38:31.324282] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-22T20:38:31.335499] [DEBUG] [LOCAL ] PMO: Loaded 9593 existing records from primary storage. [2025-10-22T20:38:31.335759] [INFO ] [MAIN ] PMO: Loaded 9593 existing records. [2025-10-22T20:38:31.509527] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:38:31.509757] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-22T20:38:31.509881] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-22T20:38:31.510220] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-10-22T20:38:31.510273] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-22T20:38:31.871177] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:38:31.888118] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T20:38:32.117733] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-22T20:38:32.317365] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T20:38:32.917693] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-10-22T20:38:33.299936] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T20:38:33.304308] [INFO ] [REMOTE ] PML: Full fetch complete (29848 records). [2025-10-22T20:38:33.304400] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-22T20:38:33.671756] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-10-22T20:38:33.671837] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-10-22T20:38:33.672539] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-10-22T20:38:33.672601] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-10-22T20:38:33.673326] [DEBUG] [LOCAL ] PML: Trimmed 29848 records to 21888 (keeping 200 days of data) [2025-10-22T20:38:33.724039] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-22T20:38:33.806105] [DEBUG] [LOCAL ] PML: Primary data saved (21888 records). [2025-10-22T20:38:33.806233] [INFO ] [MAIN ] PML: Full history saved. [2025-10-22T20:38:33.806358] [INFO ] [MAIN ] Update Progress: 1698/2367 symbols completed. PML took 20.5s. Estimated remaining: 1h 26m 5s. Rate: 7.8 symbols/min [2025-10-22T20:38:33.976971] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:38:34.020161] [DEBUG] [LOCAL ] PMT: Loaded 40721 existing records from primary storage. [2025-10-22T20:38:34.020506] [INFO ] [MAIN ] PMT: Loaded 40721 existing records. [2025-10-22T20:38:34.197245] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:38:34.197424] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-22T20:38:34.197472] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-22T20:38:34.197683] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-10-22T20:38:34.197759] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-22T20:38:34.523954] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-22T20:38:34.552354] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:38:34.554319] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-22T20:38:34.704572] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T20:38:35.317745] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-10-22T20:38:35.715976] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-22T20:38:36.117688] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-22T20:38:36.917696] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-22T20:38:37.129777] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T20:38:37.596195] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-22T20:38:37.717614] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-10-22T20:38:38.517754] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-22T20:38:38.830296] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T20:38:39.317779] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-22T20:38:39.354885] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-22T20:38:39.637415] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T20:38:40.117695] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-10-22T20:38:40.334464] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T20:38:40.917804] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-22T20:38:41.717675] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-22T20:38:41.842871] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-22T20:38:42.293089] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-22T20:38:42.517760] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-22T20:38:43.317729] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-10. [2025-10-22T20:38:43.393598] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T20:38:43.394394] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-22T20:38:44.117697] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-22T20:38:44.917626] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-22T20:38:45.070374] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-22T20:38:45.072882] [INFO ] [REMOTE ] PMM: Full fetch complete (17666 records). [2025-10-22T20:38:45.072976] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-22T20:38:45.448882] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-10-22T20:38:45.449029] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-10-22T20:38:45.449779] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-10-22T20:38:45.449863] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-10-22T20:38:45.450983] [DEBUG] [LOCAL ] PMM: Trimmed 17666 records to 10032 (keeping 200 days of data) [2025-10-22T20:38:45.516948] [DEBUG] [LOCAL ] PMM: Primary data saved (10032 records). [2025-10-22T20:38:45.517304] [INFO ] [MAIN ] PMM: Full history saved. [2025-10-22T20:38:45.527330] [INFO ] [MAIN ] Update Progress: 1699/2367 symbols completed. PMM took 30.3s. Estimated remaining: 1h 25m 59s. Rate: 7.8 symbols/min [2025-10-22T20:38:45.608755] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-22T20:38:45.656148] [INFO ] [REMOTE ] PM: Full fetch complete (77834 records). [2025-10-22T20:38:45.659090] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-10-22T20:38:45.718534] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-22T20:38:45.838484] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:38:45.854628] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-22T20:38:45.859873] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-22T20:38:45.897517] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-22T20:38:45.917745] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-22T20:38:45.938521] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-22T20:38:45.978062] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-22T20:38:46.306704] [DEBUG] [VALIDATOR ] PM: All expected trading days are present. [2025-10-22T20:38:46.317975] [DEBUG] [VALIDATOR ] PM: Primary data validation passed. [2025-10-22T20:38:46.320787] [INFO ] [MAIN ] PM: Fetched primary data is valid. [2025-10-22T20:38:46.337861] [DEBUG] [LOCAL ] PM: Saving primary data. [2025-10-22T20:38:46.428323] [DEBUG] [LOCAL ] PM: Trimmed 77834 records to 53674 (keeping 200 days of data) [2025-10-22T20:38:46.677013] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:38:46.684590] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-22T20:38:46.813711] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-22T20:38:46.933195] [DEBUG] [LOCAL ] PM: Primary data saved (53674 records). [2025-10-22T20:38:46.933325] [INFO ] [MAIN ] PM: Full history saved. [2025-10-22T20:38:46.933404] [INFO ] [MAIN ] Update Progress: 1700/2367 symbols completed. PM took 35.9s. Estimated remaining: 1h 25m 49s. Rate: 7.8 symbols/min [2025-10-22T20:38:47.065933] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T20:38:47.124909] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:38:47.125037] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-22T20:38:47.125074] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-22T20:38:47.125183] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-22T20:38:47.125224] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-22T20:38:47.125266] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-22T20:38:47.125314] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-22T20:38:47.326749] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-22T20:38:47.379132] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-22T20:38:47.489151] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:38:48.117677] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-22T20:38:48.917697] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-01. [2025-10-22T20:38:49.031883] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-22T20:38:49.240267] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T20:38:49.240591] [WARN ] [REMOTE ] PMTV: No data returned for month 2025-01 [2025-10-22T20:38:49.240740] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T20:38:49.240789] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-22T20:38:49.240854] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T20:38:49.240927] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-22T20:38:49.240992] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-22T20:38:49.241028] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-22T20:38:49.241066] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-22T20:38:49.241109] [INFO ] [MAIN ] Update Progress: 1701/2367 symbols completed. PMTV took 2.3s. Estimated remaining: 1h 25m 39s. Rate: 7.8 symbols/min [2025-10-22T20:38:49.472221] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:38:49.502074] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-22T20:38:49.502270] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-22T20:38:49.506463] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-22T20:38:49.503280] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-22T20:38:49.521771] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-22T20:38:49.522694] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-22T20:38:49.523193] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-22T20:38:49.723251] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-22T20:38:50.000946] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:38:50.517678] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-01. [2025-10-22T20:38:50.704148] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T20:38:50.963079] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T20:38:50.963393] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-01 [2025-10-22T20:38:50.963478] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T20:38:50.963546] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-22T20:38:50.963613] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T20:38:50.963709] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-22T20:38:50.963777] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-22T20:38:50.963830] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-22T20:38:50.963874] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-22T20:38:50.963920] [INFO ] [MAIN ] Update Progress: 1702/2367 symbols completed. PMTW took 1.7s. Estimated remaining: 1h 25m 29s. Rate: 7.8 symbols/min [2025-10-22T20:38:51.158454] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:38:51.211365] [DEBUG] [LOCAL ] PNC: Loaded 52077 existing records from primary storage. [2025-10-22T20:38:51.211710] [INFO ] [MAIN ] PNC: Loaded 52077 existing records. [2025-10-22T20:38:51.324682] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-22T20:38:51.416048] [WARN ] [MAIN ] PNC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:38:51.416289] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-22T20:38:51.416365] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-22T20:38:51.416677] [DEBUG] [LOCAL ] PNC: Deleted primary data file. [2025-10-22T20:38:51.416735] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-22T20:38:51.804099] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:38:51.860983] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-22T20:38:52.117693] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-22T20:38:52.740159] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-22T20:38:52.917697] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-22T20:38:53.717679] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-22T20:38:54.524952] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-22T20:38:54.527465] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T20:38:54.660441] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T20:38:54.974107] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-22T20:38:55.317692] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-22T20:38:56.117737] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-22T20:38:56.917637] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-22T20:38:56.965560] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T20:38:57.717749] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-22T20:38:57.810026] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-22T20:38:58.074441] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-22T20:38:58.517757] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-22T20:38:59.013892] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-22T20:38:59.317621] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-22T20:38:59.500167] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T20:39:00.117718] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-22T20:39:00.195560] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T20:39:00.626625] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-22T20:39:00.917728] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-22T20:39:01.717760] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-22T20:39:02.517637] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-22T20:39:02.597230] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-22T20:39:02.930492] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-22T20:39:03.317669] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-22T20:39:04.117627] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-22T20:39:04.154506] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-22T20:39:04.156163] [INFO ] [REMOTE ] PMO: Full fetch complete (16115 records). [2025-10-22T20:39:04.156234] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-22T20:39:04.352695] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T20:39:04.530294] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-22T20:39:04.567577] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-10-22T20:39:04.567677] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-10-22T20:39:04.568083] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-10-22T20:39:04.568134] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-10-22T20:39:04.568607] [DEBUG] [LOCAL ] PMO: Trimmed 16115 records to 9459 (keeping 200 days of data) [2025-10-22T20:39:04.630891] [DEBUG] [LOCAL ] PMO: Primary data saved (9459 records). [2025-10-22T20:39:04.631333] [INFO ] [MAIN ] PMO: Full history saved. [2025-10-22T20:39:04.631440] [INFO ] [MAIN ] Update Progress: 1703/2367 symbols completed. PMO took 33.5s. Estimated remaining: 1h 25m 23s. Rate: 7.8 symbols/min [2025-10-22T20:39:04.798369] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:39:04.807765] [DEBUG] [LOCAL ] PNI: Loaded 6905 existing records from primary storage. [2025-10-22T20:39:04.807977] [INFO ] [MAIN ] PNI: Loaded 6905 existing records. [2025-10-22T20:39:04.922920] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-22T20:39:04.985529] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:39:04.985804] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-22T20:39:04.985851] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-22T20:39:04.986317] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-10-22T20:39:04.986379] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-22T20:39:05.334884] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:39:05.717679] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-22T20:39:06.517631] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-22T20:39:06.710026] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T20:39:06.749503] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-22T20:39:06.994210] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-22T20:39:07.317687] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-22T20:39:07.823241] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-22T20:39:07.823963] [INFO ] [REMOTE ] PMTU: Full fetch complete (1186 records). [2025-10-22T20:39:07.824030] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-22T20:39:07.996768] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-22T20:39:07.996926] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:39:07.996971] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:39:07.997011] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-22T20:39:07.997081] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-22T20:39:07.997121] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-22T20:39:07.997160] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-22T20:39:07.997212] [INFO ] [MAIN ] Update Progress: 1704/2367 symbols completed. PMTU took 22.5s. Estimated remaining: 1h 25m 14s. Rate: 7.8 symbols/min [2025-10-22T20:39:08.122912] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-22T20:39:08.168623] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:39:08.199324] [DEBUG] [LOCAL ] PNNT: Loaded 33432 existing records from primary storage. [2025-10-22T20:39:08.199585] [INFO ] [MAIN ] PNNT: Loaded 33432 existing records. [2025-10-22T20:39:08.371910] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:39:08.372110] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-22T20:39:08.372155] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-22T20:39:08.372359] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-10-22T20:39:08.372418] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-22T20:39:08.746507] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:39:08.917629] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-22T20:39:09.717732] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-22T20:39:10.290936] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-22T20:39:10.321629] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T20:39:10.329000] [INFO ] [REMOTE ] PMT: Full fetch complete (58700 records). [2025-10-22T20:39:10.329106] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-22T20:39:10.526790] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-22T20:39:10.712498] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-10-22T20:39:10.712593] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-10-22T20:39:10.713617] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-10-22T20:39:10.713699] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-10-22T20:39:10.714807] [DEBUG] [LOCAL ] PMT: Trimmed 58700 records to 40705 (keeping 200 days of data) [2025-10-22T20:39:10.971582] [DEBUG] [LOCAL ] PMT: Primary data saved (40705 records). [2025-10-22T20:39:10.971728] [INFO ] [MAIN ] PMT: Full history saved. [2025-10-22T20:39:10.971812] [INFO ] [MAIN ] Update Progress: 1705/2367 symbols completed. PMT took 37.2s. Estimated remaining: 1h 25m 4s. Rate: 7.8 symbols/min [2025-10-22T20:39:11.137508] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:39:11.181451] [DEBUG] [LOCAL ] PNR: Loaded 47493 existing records from primary storage. [2025-10-22T20:39:11.181814] [INFO ] [MAIN ] PNR: Loaded 47493 existing records. [2025-10-22T20:39:11.329631] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-22T20:39:11.359051] [WARN ] [MAIN ] PNR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:39:11.360242] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-22T20:39:11.360424] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-22T20:39:11.360773] [DEBUG] [LOCAL ] PNR: Deleted primary data file. [2025-10-22T20:39:11.360856] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-22T20:39:11.679331] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-22T20:39:11.743675] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:39:12.117748] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-22T20:39:12.262971] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-22T20:39:12.514125] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T20:39:12.917734] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-10-22T20:39:13.566387] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T20:39:13.638225] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-22T20:39:13.717683] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-22T20:39:14.517667] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-22T20:39:15.317696] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-10-22T20:39:15.820138] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-22T20:39:16.117773] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-22T20:39:16.442859] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-22T20:39:16.777606] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-22T20:39:16.917613] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-22T20:39:17.414715] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T20:39:17.717756] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-10-22T20:39:18.494458] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-22T20:39:18.517669] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-10-22T20:39:18.729315] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T20:39:19.253517] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-22T20:39:19.317675] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-10-22T20:39:20.109030] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-22T20:39:20.117608] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-10-22T20:39:20.917622] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-22T20:39:20.985971] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T20:39:21.717668] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-10-22T20:39:22.517723] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-22T20:39:22.557869] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T20:39:22.792099] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T20:39:23.317690] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-22T20:39:24.117741] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-10. [2025-10-22T20:39:24.184852] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T20:39:24.901231] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-22T20:39:24.902638] [INFO ] [REMOTE ] PNI: Full fetch complete (9688 records). [2025-10-22T20:39:24.902733] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-10-22T20:39:24.923289] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-22T20:39:25.271632] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-10-22T20:39:25.271781] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-10-22T20:39:25.272127] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-10-22T20:39:25.272246] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-10-22T20:39:25.273158] [DEBUG] [LOCAL ] PNI: Trimmed 9688 records to 6901 (keeping 200 days of data) [2025-10-22T20:39:25.341685] [DEBUG] [LOCAL ] PNI: Primary data saved (6901 records). [2025-10-22T20:39:25.342019] [INFO ] [MAIN ] PNI: Full history saved. [2025-10-22T20:39:25.342170] [INFO ] [MAIN ] Update Progress: 1706/2367 symbols completed. PNI took 20.7s. Estimated remaining: 1h 24m 59s. Rate: 7.8 symbols/min [2025-10-22T20:39:25.376661] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-22T20:39:25.527267] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:39:25.573022] [DEBUG] [LOCAL ] PNW: Loaded 45576 existing records from primary storage. [2025-10-22T20:39:25.573332] [INFO ] [MAIN ] PNW: Loaded 45576 existing records. [2025-10-22T20:39:25.722802] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-22T20:39:25.752320] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:39:25.752686] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-22T20:39:25.752745] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-22T20:39:25.752941] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-10-22T20:39:25.752979] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-22T20:39:26.112919] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:39:26.517729] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-10-22T20:39:26.578799] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T20:39:27.317630] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-22T20:39:27.757628] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-22T20:39:28.117747] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-22T20:39:28.756026] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-22T20:39:28.792441] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T20:39:28.917679] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-22T20:39:29.717746] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-22T20:39:29.943983] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T20:39:30.324123] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-22T20:39:30.517756] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-22T20:39:30.799217] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T20:39:31.317751] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-22T20:39:32.117758] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-10-22T20:39:32.256146] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T20:39:32.922742] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-22T20:39:32.941381] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T20:39:33.717724] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-22T20:39:34.225920] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-22T20:39:34.527554] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-22T20:39:34.533580] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T20:39:35.156995] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T20:39:35.317771] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-10-22T20:39:36.117694] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-22T20:39:36.366400] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T20:39:36.917774] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-22T20:39:37.261391] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-22T20:39:37.717638] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-22T20:39:37.894282] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T20:39:38.517668] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-10. [2025-10-22T20:39:38.640976] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T20:39:38.813415] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T20:39:39.317766] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-22T20:39:40.117635] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-22T20:39:40.521077] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T20:39:40.529615] [INFO ] [REMOTE ] PNC: Full fetch complete (75788 records). [2025-10-22T20:39:40.529824] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-10-22T20:39:40.923691] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-22T20:39:40.925621] [DEBUG] [VALIDATOR ] PNC: All expected trading days are present. [2025-10-22T20:39:40.925810] [DEBUG] [VALIDATOR ] PNC: Primary data validation passed. [2025-10-22T20:39:40.926993] [INFO ] [MAIN ] PNC: Fetched primary data is valid. [2025-10-22T20:39:40.927173] [DEBUG] [LOCAL ] PNC: Saving primary data. [2025-10-22T20:39:40.928635] [DEBUG] [LOCAL ] PNC: Trimmed 75788 records to 52065 (keeping 200 days of data) [2025-10-22T20:39:41.179000] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T20:39:41.295536] [DEBUG] [LOCAL ] PNC: Primary data saved (52065 records). [2025-10-22T20:39:41.295714] [INFO ] [MAIN ] PNC: Full history saved. [2025-10-22T20:39:41.295808] [INFO ] [MAIN ] Update Progress: 1707/2367 symbols completed. PNC took 50.3s. Estimated remaining: 1h 24m 55s. Rate: 7.8 symbols/min [2025-10-22T20:39:41.470018] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:39:41.509528] [DEBUG] [LOCAL ] POR: Loaded 46776 existing records from primary storage. [2025-10-22T20:39:41.509850] [INFO ] [MAIN ] POR: Loaded 46776 existing records. [2025-10-22T20:39:41.700265] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:39:41.712124] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-22T20:39:41.712026] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T20:39:41.718069] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-22T20:39:41.718592] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-22T20:39:41.719930] [INFO ] [REMOTE ] PNNT: Full fetch complete (47838 records). [2025-10-22T20:39:41.720007] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-22T20:39:41.720143] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-10-22T20:39:41.720249] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-22T20:39:42.649425] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:39:42.655817] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-22T20:39:42.770069] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-10-22T20:39:42.771000] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-10-22T20:39:42.772156] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-10-22T20:39:42.772288] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-10-22T20:39:42.773703] [DEBUG] [LOCAL ] PNNT: Trimmed 47838 records to 33331 (keeping 200 days of data) [2025-10-22T20:39:42.928884] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-22T20:39:43.060713] [DEBUG] [LOCAL ] PNNT: Primary data saved (33331 records). [2025-10-22T20:39:43.060873] [INFO ] [MAIN ] PNNT: Full history saved. [2025-10-22T20:39:43.060959] [INFO ] [MAIN ] Update Progress: 1708/2367 symbols completed. PNNT took 35.1s. Estimated remaining: 1h 24m 45s. Rate: 7.8 symbols/min [2025-10-22T20:39:43.234034] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:39:43.271175] [DEBUG] [LOCAL ] POST: Loaded 38568 existing records from primary storage. [2025-10-22T20:39:43.271460] [INFO ] [MAIN ] POST: Loaded 38568 existing records. [2025-10-22T20:39:43.333632] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-22T20:39:43.463330] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:39:43.463798] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-22T20:39:43.463902] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-22T20:39:43.464258] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-10-22T20:39:43.464368] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-22T20:39:43.747312] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-22T20:39:43.866830] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:39:44.117728] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-22T20:39:44.842072] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-22T20:39:44.917627] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-22T20:39:45.282564] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T20:39:45.290575] [INFO ] [REMOTE ] PNR: Full fetch complete (69742 records). [2025-10-22T20:39:45.290778] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-22T20:39:45.685311] [DEBUG] [VALIDATOR ] PNR: All expected trading days are present. [2025-10-22T20:39:45.685403] [DEBUG] [VALIDATOR ] PNR: Primary data validation passed. [2025-10-22T20:39:45.686564] [INFO ] [MAIN ] PNR: Fetched primary data is valid. [2025-10-22T20:39:45.686630] [DEBUG] [LOCAL ] PNR: Saving primary data. [2025-10-22T20:39:45.687992] [DEBUG] [LOCAL ] PNR: Trimmed 69742 records to 47486 (keeping 200 days of data) [2025-10-22T20:39:45.742101] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-22T20:39:45.989722] [DEBUG] [LOCAL ] PNR: Primary data saved (47486 records). [2025-10-22T20:39:45.989914] [INFO ] [MAIN ] PNR: Full history saved. [2025-10-22T20:39:45.990044] [INFO ] [MAIN ] Update Progress: 1709/2367 symbols completed. PNR took 35.0s. Estimated remaining: 1h 24m 35s. Rate: 7.8 symbols/min [2025-10-22T20:39:46.131454] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T20:39:46.210188] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:39:46.259173] [DEBUG] [LOCAL ] PPG: Loaded 50524 existing records from primary storage. [2025-10-22T20:39:46.259486] [INFO ] [MAIN ] PPG: Loaded 50524 existing records. [2025-10-22T20:39:46.432925] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:39:46.433125] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-22T20:39:46.433194] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-22T20:39:46.433372] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-10-22T20:39:46.433408] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-22T20:39:46.521759] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-22T20:39:46.820207] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:39:46.848581] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-22T20:39:47.044540] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T20:39:47.317677] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-22T20:39:48.117737] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-22T20:39:48.378849] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T20:39:48.917679] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-22T20:39:49.263608] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T20:39:49.717773] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-22T20:39:49.930324] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T20:39:50.517637] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-22T20:39:50.666068] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T20:39:51.317684] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-22T20:39:51.764144] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-22T20:39:52.122868] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-10-22T20:39:52.137962] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T20:39:52.917730] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-22T20:39:53.088385] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T20:39:53.096425] [INFO ] [REMOTE ] PNW: Full fetch complete (66059 records). [2025-10-22T20:39:53.096615] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-22T20:39:53.480279] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-10-22T20:39:53.480358] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-10-22T20:39:53.481565] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-10-22T20:39:53.481629] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-10-22T20:39:53.482939] [DEBUG] [LOCAL ] PNW: Trimmed 66059 records to 45501 (keeping 200 days of data) [2025-10-22T20:39:53.717749] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-22T20:39:53.755989] [DEBUG] [LOCAL ] PNW: Primary data saved (45501 records). [2025-10-22T20:39:53.756186] [INFO ] [MAIN ] PNW: Full history saved. [2025-10-22T20:39:53.756273] [INFO ] [MAIN ] Update Progress: 1710/2367 symbols completed. PNW took 28.4s. Estimated remaining: 1h 24m 27s. Rate: 7.8 symbols/min [2025-10-22T20:39:53.924174] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:39:53.974954] [DEBUG] [LOCAL ] PPL: Loaded 53506 existing records from primary storage. [2025-10-22T20:39:53.975269] [INFO ] [MAIN ] PPL: Loaded 53506 existing records. [2025-10-22T20:39:54.157384] [WARN ] [MAIN ] PPL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:39:54.157740] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-22T20:39:54.157877] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-22T20:39:54.158343] [DEBUG] [LOCAL ] PPL: Deleted primary data file. [2025-10-22T20:39:54.158462] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-22T20:39:54.291224] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-22T20:39:54.522951] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-10-22T20:39:54.570858] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:39:54.619371] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T20:39:55.317632] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-22T20:39:55.686930] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T20:39:56.117686] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-22T20:39:56.571064] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-22T20:39:56.917696] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-22T20:39:57.126103] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T20:39:57.629120] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T20:39:57.717749] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-10-22T20:39:58.517770] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-22T20:39:58.649248] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T20:39:59.317682] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-22T20:39:59.661735] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-22T20:39:59.791229] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T20:40:00.117749] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-10-22T20:40:00.917665] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-22T20:40:00.949254] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T20:40:01.717694] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-22T20:40:01.970519] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T20:40:02.436376] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T20:40:02.517784] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-10-22T20:40:03.317775] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-22T20:40:03.654742] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T20:40:04.117733] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-22T20:40:04.726772] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-22T20:40:04.917737] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-22T20:40:05.074435] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T20:40:05.717623] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-22T20:40:05.812307] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T20:40:06.517637] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-22T20:40:06.799900] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T20:40:07.317666] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-10-22T20:40:07.356725] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T20:40:08.117732] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-22T20:40:08.465315] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T20:40:08.917758] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-22T20:40:09.333225] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-22T20:40:09.717629] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-10-22T20:40:09.916073] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T20:40:10.517775] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-22T20:40:10.634267] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T20:40:11.317631] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-22T20:40:11.712320] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T20:40:12.117691] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-10. [2025-10-22T20:40:12.239765] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T20:40:12.247373] [INFO ] [REMOTE ] POR: Full fetch complete (68318 records). [2025-10-22T20:40:12.247478] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-22T20:40:12.639437] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-10-22T20:40:12.639529] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-10-22T20:40:12.640637] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-10-22T20:40:12.640723] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-10-22T20:40:12.642071] [DEBUG] [LOCAL ] POR: Trimmed 68318 records to 46735 (keeping 200 days of data) [2025-10-22T20:40:12.919998] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-22T20:40:12.932805] [DEBUG] [LOCAL ] POR: Primary data saved (46735 records). [2025-10-22T20:40:12.932897] [INFO ] [MAIN ] POR: Full history saved. [2025-10-22T20:40:12.932972] [INFO ] [MAIN ] Update Progress: 1711/2367 symbols completed. POR took 31.6s. Estimated remaining: 1h 24m 24s. Rate: 7.8 symbols/min [2025-10-22T20:40:13.127083] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:40:13.128022] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T20:40:13.134291] [INFO ] [REMOTE ] POST: Full fetch complete (55572 records). [2025-10-22T20:40:13.134394] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-22T20:40:13.303886] [DEBUG] [LOCAL ] PPT: Loaded 19747 existing records from primary storage. [2025-10-22T20:40:13.325227] [INFO ] [MAIN ] PPT: Loaded 19747 existing records. [2025-10-22T20:40:13.689340] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:40:13.706532] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-22T20:40:13.706676] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-22T20:40:13.706615] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-10-22T20:40:13.706800] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-10-22T20:40:13.707827] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-10-22T20:40:13.707785] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-10-22T20:40:13.707932] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-22T20:40:13.708002] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-10-22T20:40:13.813202] [DEBUG] [LOCAL ] POST: Trimmed 55572 records to 38443 (keeping 200 days of data) [2025-10-22T20:40:14.186736] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:40:14.191048] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-22T20:40:14.304362] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-22T20:40:14.318631] [INFO ] [REMOTE ] PPG: Full fetch complete (73957 records). [2025-10-22T20:40:14.322830] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-10-22T20:40:14.461365] [DEBUG] [LOCAL ] POST: Primary data saved (38443 records). [2025-10-22T20:40:14.467230] [INFO ] [MAIN ] POST: Full history saved. [2025-10-22T20:40:14.472477] [INFO ] [MAIN ] Update Progress: 1712/2367 symbols completed. POST took 31.4s. Estimated remaining: 1h 24m 14s. Rate: 7.8 symbols/min [2025-10-22T20:40:14.844823] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:40:14.948382] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-10-22T20:40:14.948563] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-10-22T20:40:14.949843] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-10-22T20:40:14.949980] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-10-22T20:40:14.951674] [DEBUG] [LOCAL ] PPG: Trimmed 73957 records to 50502 (keeping 200 days of data) [2025-10-22T20:40:15.124588] [DEBUG] [LOCAL ] PR: Loaded 53611 existing records from primary storage. [2025-10-22T20:40:15.186040] [INFO ] [MAIN ] PR: Loaded 53611 existing records. [2025-10-22T20:40:15.460882] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:40:15.468176] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-22T20:40:15.468488] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-22T20:40:15.481935] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-22T20:40:15.485813] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-10-22T20:40:15.487055] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-22T20:40:15.487447] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-22T20:40:15.806727] [DEBUG] [LOCAL ] PPG: Primary data saved (50502 records). [2025-10-22T20:40:15.823379] [INFO ] [MAIN ] PPG: Full history saved. [2025-10-22T20:40:15.829074] [INFO ] [MAIN ] Update Progress: 1713/2367 symbols completed. PPG took 29.8s. Estimated remaining: 1h 24m 4s. Rate: 7.8 symbols/min [2025-10-22T20:40:16.054586] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:40:16.070829] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-22T20:40:16.117166] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T20:40:16.150681] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-22T20:40:16.149750] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:40:16.186364] [DEBUG] [LOCAL ] PRA: Loaded 34582 existing records from primary storage. [2025-10-22T20:40:16.186709] [INFO ] [MAIN ] PRA: Loaded 34582 existing records. [2025-10-22T20:40:16.361616] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:40:16.361886] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-22T20:40:16.361934] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-22T20:40:16.362123] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-10-22T20:40:16.362162] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-22T20:40:16.759074] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:40:16.917725] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-22T20:40:17.479806] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T20:40:17.594585] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-22T20:40:17.684277] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T20:40:17.717677] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-22T20:40:18.311075] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T20:40:18.517750] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-22T20:40:18.938277] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-22T20:40:19.317743] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-22T20:40:20.117799] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-22T20:40:20.489623] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-22T20:40:20.491570] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T20:40:20.917687] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-22T20:40:21.717639] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-22T20:40:21.982390] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T20:40:22.517764] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-22T20:40:22.631003] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-22T20:40:22.957807] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-22T20:40:23.317744] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-22T20:40:23.728134] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T20:40:24.117743] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-22T20:40:24.917729] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-22T20:40:25.326521] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-22T20:40:25.386459] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T20:40:25.717682] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-22T20:40:26.517678] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-22T20:40:26.936717] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T20:40:27.317630] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-22T20:40:27.358399] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-22T20:40:27.553891] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T20:40:28.117734] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-22T20:40:28.781764] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T20:40:28.917717] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-22T20:40:29.717664] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-22T20:40:30.261508] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-22T20:40:30.517750] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-22T20:40:30.645877] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T20:40:31.317676] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-22T20:40:31.686275] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-22T20:40:31.694211] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T20:40:31.703857] [INFO ] [REMOTE ] PPL: Full fetch complete (77629 records). [2025-10-22T20:40:31.703971] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-22T20:40:32.087113] [DEBUG] [VALIDATOR ] PPL: All expected trading days are present. [2025-10-22T20:40:32.087186] [DEBUG] [VALIDATOR ] PPL: Primary data validation passed. [2025-10-22T20:40:32.088383] [INFO ] [MAIN ] PPL: Fetched primary data is valid. [2025-10-22T20:40:32.088450] [DEBUG] [LOCAL ] PPL: Saving primary data. [2025-10-22T20:40:32.089905] [DEBUG] [LOCAL ] PPL: Trimmed 77629 records to 53505 (keeping 200 days of data) [2025-10-22T20:40:32.141844] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-22T20:40:32.446422] [DEBUG] [LOCAL ] PPL: Primary data saved (53505 records). [2025-10-22T20:40:32.446581] [INFO ] [MAIN ] PPL: Full history saved. [2025-10-22T20:40:32.447364] [INFO ] [MAIN ] Update Progress: 1714/2367 symbols completed. PPL took 38.7s. Estimated remaining: 1h 23m 60s. Rate: 7.8 symbols/min [2025-10-22T20:40:32.651974] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:40:32.657312] [DEBUG] [LOCAL ] PRCS: Loaded 2800 existing records from primary storage. [2025-10-22T20:40:32.657474] [INFO ] [MAIN ] PRCS: Loaded 2800 existing records. [2025-10-22T20:40:32.859113] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:40:32.859558] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-22T20:40:32.859668] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-22T20:40:32.884425] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-10-22T20:40:32.886080] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T20:40:32.886210] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-22T20:40:32.918124] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-22T20:40:33.233051] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T20:40:33.306083] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:40:33.717787] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-22T20:40:34.448296] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T20:40:34.472732] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T20:40:34.517737] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-22T20:40:35.317783] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-22T20:40:35.635387] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T20:40:35.638233] [INFO ] [REMOTE ] PPT: Full fetch complete (28474 records). [2025-10-22T20:40:35.638465] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-22T20:40:36.026121] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-10-22T20:40:36.026199] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-10-22T20:40:36.026820] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-10-22T20:40:36.026881] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-10-22T20:40:36.027546] [DEBUG] [LOCAL ] PPT: Trimmed 28474 records to 19701 (keeping 200 days of data) [2025-10-22T20:40:36.128701] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-22T20:40:36.140273] [DEBUG] [LOCAL ] PPT: Primary data saved (19701 records). [2025-10-22T20:40:36.140419] [INFO ] [MAIN ] PPT: Full history saved. [2025-10-22T20:40:36.140504] [INFO ] [MAIN ] Update Progress: 1715/2367 symbols completed. PPT took 23.2s. Estimated remaining: 1h 23m 50s. Rate: 7.8 symbols/min [2025-10-22T20:40:36.337321] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:40:36.365713] [DEBUG] [LOCAL ] PRG: Loaded 29630 existing records from primary storage. [2025-10-22T20:40:36.365990] [INFO ] [MAIN ] PRG: Loaded 29630 existing records. [2025-10-22T20:40:36.546353] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:40:36.546626] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-22T20:40:36.546728] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-22T20:40:36.546911] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-10-22T20:40:36.546951] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-22T20:40:36.831916] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-22T20:40:36.893797] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T20:40:36.921855] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-22T20:40:36.964938] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:40:37.635279] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-22T20:40:37.717635] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-22T20:40:38.517945] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-22T20:40:39.203309] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-22T20:40:39.317635] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-22T20:40:39.717454] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T20:40:39.771696] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-22T20:40:40.117687] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-22T20:40:40.917684] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-22T20:40:41.717670] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-22T20:40:41.831791] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T20:40:42.510191] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T20:40:42.520412] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-22T20:40:42.757158] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T20:40:43.317689] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-22T20:40:43.796810] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T20:40:43.912052] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T20:40:44.117679] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-22T20:40:44.917675] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-22T20:40:45.544073] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T20:40:45.717729] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-22T20:40:46.517634] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-22T20:40:46.718533] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T20:40:47.031039] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T20:40:47.036892] [INFO ] [REMOTE ] PRA: Full fetch complete (45204 records). [2025-10-22T20:40:47.037005] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-22T20:40:47.136307] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T20:40:47.322812] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-22T20:40:47.435148] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-10-22T20:40:47.435229] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-10-22T20:40:47.436120] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-10-22T20:40:47.436183] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-10-22T20:40:47.437141] [DEBUG] [LOCAL ] PRA: Trimmed 45204 records to 34389 (keeping 200 days of data) [2025-10-22T20:40:47.637623] [DEBUG] [LOCAL ] PRA: Primary data saved (34389 records). [2025-10-22T20:40:47.637828] [INFO ] [MAIN ] PRA: Full history saved. [2025-10-22T20:40:47.637919] [INFO ] [MAIN ] Update Progress: 1716/2367 symbols completed. PRA took 31.8s. Estimated remaining: 1h 23m 44s. Rate: 7.8 symbols/min [2025-10-22T20:40:47.829572] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:40:47.872834] [DEBUG] [LOCAL ] PRGO: Loaded 47142 existing records from primary storage. [2025-10-22T20:40:47.873160] [INFO ] [MAIN ] PRGO: Loaded 47142 existing records. [2025-10-22T20:40:48.065334] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:40:48.065570] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-22T20:40:48.065622] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-22T20:40:48.065963] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-10-22T20:40:48.066021] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-22T20:40:48.130395] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-22T20:40:48.432078] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:40:48.806526] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-22T20:40:48.917669] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-22T20:40:49.034023] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T20:40:49.717903] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-22T20:40:50.517692] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-22T20:40:50.970416] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-22T20:40:51.118969] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T20:40:51.277259] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T20:40:51.317638] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-22T20:40:51.913187] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T20:40:51.914233] [INFO ] [REMOTE ] PRCS: Full fetch complete (3907 records). [2025-10-22T20:40:51.914302] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-22T20:40:52.125350] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-22T20:40:52.278838] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-10-22T20:40:52.278919] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-10-22T20:40:52.279061] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-10-22T20:40:52.279100] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-10-22T20:40:52.279429] [DEBUG] [LOCAL ] PRCS: Trimmed 3907 records to 2782 (keeping 200 days of data) [2025-10-22T20:40:52.295159] [DEBUG] [LOCAL ] PRCS: Primary data saved (2782 records). [2025-10-22T20:40:52.295223] [INFO ] [MAIN ] PRCS: Full history saved. [2025-10-22T20:40:52.295290] [INFO ] [MAIN ] Update Progress: 1717/2367 symbols completed. PRCS took 19.8s. Estimated remaining: 1h 23m 35s. Rate: 7.8 symbols/min [2025-10-22T20:40:52.917772] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-22T20:40:53.717759] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-22T20:40:54.350686] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-22T20:40:54.381918] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T20:40:54.517635] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-22T20:40:55.317629] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-22T20:40:55.583763] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-22T20:40:56.117714] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-22T20:40:56.495982] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T20:40:56.698217] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T20:40:56.917680] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-22T20:40:57.717749] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-22T20:40:58.015993] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-22T20:40:58.399427] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T20:40:58.517614] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-22T20:40:59.317682] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-22T20:40:59.789841] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T20:40:59.800751] [INFO ] [REMOTE ] PR: Full fetch complete (77763 records). [2025-10-22T20:40:59.800916] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-22T20:41:00.144975] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T20:41:00.189688] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-22T20:41:00.233631] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-10-22T20:41:00.233755] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-10-22T20:41:00.234996] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-10-22T20:41:00.235072] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-10-22T20:41:00.236688] [DEBUG] [LOCAL ] PR: Trimmed 77763 records to 53611 (keeping 200 days of data) [2025-10-22T20:41:00.568156] [DEBUG] [LOCAL ] PR: Primary data saved (53611 records). [2025-10-22T20:41:00.568251] [INFO ] [MAIN ] PR: Full history saved. [2025-10-22T20:41:00.568324] [INFO ] [MAIN ] Update Progress: 1718/2367 symbols completed. PR took 46.1s. Estimated remaining: 1h 23m 28s. Rate: 7.8 symbols/min [2025-10-22T20:41:01.099999] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T20:41:01.110098] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-22T20:41:01.702296] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T20:41:01.717611] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-22T20:41:02.961396] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T20:41:02.972336] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-22T20:41:03.135098] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-22T20:41:03.140744] [INFO ] [REMOTE ] PRG: Full fetch complete (44510 records). [2025-10-22T20:41:03.140907] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-22T20:41:03.516468] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-10-22T20:41:03.516555] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-10-22T20:41:03.517425] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-10-22T20:41:03.517486] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-10-22T20:41:03.518402] [DEBUG] [LOCAL ] PRG: Trimmed 44510 records to 29701 (keeping 200 days of data) [2025-10-22T20:41:03.700020] [DEBUG] [LOCAL ] PRG: Primary data saved (29701 records). [2025-10-22T20:41:03.700161] [INFO ] [MAIN ] PRG: Full history saved. [2025-10-22T20:41:03.700241] [INFO ] [MAIN ] Update Progress: 1719/2367 symbols completed. PRG took 27.6s. Estimated remaining: 1h 23m 18s. Rate: 7.8 symbols/min [2025-10-22T20:41:04.716282] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T20:41:04.725396] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-22T20:41:06.392330] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T20:41:06.402263] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-22T20:41:09.121279] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-10-22T20:41:09.131687] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-22T20:41:11.090155] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-22T20:41:11.102240] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-10. [2025-10-22T20:41:13.061489] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-22T20:41:13.069819] [INFO ] [REMOTE ] PRGO: Full fetch complete (68935 records). [2025-10-22T20:41:13.069958] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-10-22T20:41:13.459696] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-10-22T20:41:13.459789] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-10-22T20:41:13.460970] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-10-22T20:41:13.461039] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-10-22T20:41:13.462483] [DEBUG] [LOCAL ] PRGO: Trimmed 68935 records to 47131 (keeping 200 days of data) [2025-10-22T20:41:13.747147] [DEBUG] [LOCAL ] PRGO: Primary data saved (47131 records). [2025-10-22T20:41:13.747279] [INFO ] [MAIN ] PRGO: Full history saved. [2025-10-22T20:41:13.747359] [INFO ] [MAIN ] Update Progress: 1720/2367 symbols completed. PRGO took 26.1s. Estimated remaining: 1h 23m 11s. Rate: 7.8 symbols/min [2025-10-22T20:41:14.330509] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:41:14.383419] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:41:14.425386] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:41:14.461096] [DEBUG] [LOCAL ] PRH: Loaded 4716 existing records from primary storage. [2025-10-22T20:41:14.463086] [INFO ] [MAIN ] PRH: Loaded 4716 existing records. [2025-10-22T20:41:14.462712] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:41:14.674029] [DEBUG] [LOCAL ] PRI: Loaded 17836 existing records from primary storage. [2025-10-22T20:41:14.688910] [INFO ] [MAIN ] PRI: Loaded 17836 existing records. [2025-10-22T20:41:14.698990] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:41:14.689629] [DEBUG] [LOCAL ] PRKS: Loaded 42343 existing records from primary storage. [2025-10-22T20:41:14.741084] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-22T20:41:14.746540] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-22T20:41:14.764182] [DEBUG] [LOCAL ] PRIM: Loaded 44099 existing records from primary storage. [2025-10-22T20:41:14.746428] [INFO ] [MAIN ] PRKS: Loaded 42343 existing records. [2025-10-22T20:41:14.801311] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-10-22T20:41:14.841464] [INFO ] [MAIN ] PRIM: Loaded 44099 existing records. [2025-10-22T20:41:14.816282] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-22T20:41:15.161103] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:41:15.201414] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-22T20:41:15.232611] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-22T20:41:15.379789] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:41:15.385096] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-10-22T20:41:15.390340] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-22T20:41:15.371449] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:41:15.390783] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-22T20:41:15.443966] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-22T20:41:15.444139] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-22T20:41:15.434486] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-22T20:41:15.504317] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-10-22T20:41:15.504468] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-22T20:41:15.518399] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-10-22T20:41:15.669031] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-22T20:41:16.136754] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:41:16.161433] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-22T20:41:16.577369] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:41:16.599187] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-22T20:41:16.714675] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:41:16.734212] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:41:16.734447] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-22T20:41:16.730864] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-22T20:41:17.355019] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-22T20:41:17.356771] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-22T20:41:18.078433] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T20:41:18.082378] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-22T20:41:18.167339] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T20:41:18.169671] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-10-22T20:41:18.432420] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-22T20:41:18.440907] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-22T20:41:18.644054] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T20:41:18.652622] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-22T20:41:18.936534] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-22T20:41:18.938323] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-10-22T20:41:19.102489] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-22T20:41:19.106326] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-22T20:41:19.754148] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T20:41:19.756306] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-10-22T20:41:20.036722] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T20:41:20.045261] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-22T20:41:20.240111] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T20:41:20.245130] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-22T20:41:20.292353] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-22T20:41:20.294600] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-10-22T20:41:20.337735] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T20:41:20.346090] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-22T20:41:21.024009] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-22T20:41:21.025594] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-10-22T20:41:21.555629] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-22T20:41:21.557112] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-10-22T20:41:21.654483] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T20:41:21.659578] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-22T20:41:21.715827] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T20:41:21.725601] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-22T20:41:22.059553] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T20:41:22.317990] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-22T20:41:22.517715] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-22T20:41:22.767388] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T20:41:23.317738] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-22T20:41:23.521392] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T20:41:23.904090] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T20:41:24.117675] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-10-22T20:41:24.522626] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T20:41:24.734844] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-22T20:41:24.917682] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-22T20:41:25.717692] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-22T20:41:26.484017] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T20:41:26.517691] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-22T20:41:27.317636] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-22T20:41:27.520388] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T20:41:27.670885] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T20:41:28.117722] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-10. [2025-10-22T20:41:28.892298] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-22T20:41:28.893543] [INFO ] [REMOTE ] PRH: Full fetch complete (7452 records). [2025-10-22T20:41:28.893617] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-10-22T20:41:28.928952] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-22T20:41:29.309121] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-10-22T20:41:29.309257] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-10-22T20:41:29.309528] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-10-22T20:41:29.309818] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-10-22T20:41:29.311206] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-22T20:41:29.311859] [DEBUG] [LOCAL ] PRH: Trimmed 7452 records to 4687 (keeping 200 days of data) [2025-10-22T20:41:29.351265] [DEBUG] [LOCAL ] PRH: Primary data saved (4687 records). [2025-10-22T20:41:29.351415] [INFO ] [MAIN ] PRH: Full history saved. [2025-10-22T20:41:29.351510] [INFO ] [MAIN ] Update Progress: 1721/2367 symbols completed. PRH took 15.6s. Estimated remaining: 1h 23m 7s. Rate: 7.8 symbols/min [2025-10-22T20:41:29.553712] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:41:29.575533] [DEBUG] [LOCAL ] PRLB: Loaded 20323 existing records from primary storage. [2025-10-22T20:41:29.575887] [INFO ] [MAIN ] PRLB: Loaded 20323 existing records. [2025-10-22T20:41:29.723033] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-22T20:41:29.802587] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:41:29.802832] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-22T20:41:29.802900] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-22T20:41:29.803125] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-10-22T20:41:29.803182] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-22T20:41:30.165926] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:41:30.225380] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T20:41:30.517746] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-22T20:41:31.317672] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-22T20:41:31.376318] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T20:41:31.490572] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T20:41:32.117750] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-22T20:41:32.917740] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-22T20:41:33.014502] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T20:41:33.165346] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T20:41:33.168498] [INFO ] [REMOTE ] PRI: Full fetch complete (25614 records). [2025-10-22T20:41:33.168571] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-22T20:41:33.530576] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-10-22T20:41:33.530674] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-10-22T20:41:33.531311] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-10-22T20:41:33.531354] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-10-22T20:41:33.532024] [DEBUG] [LOCAL ] PRI: Trimmed 25614 records to 17709 (keeping 200 days of data) [2025-10-22T20:41:33.638855] [DEBUG] [LOCAL ] PRI: Primary data saved (17709 records). [2025-10-22T20:41:33.638986] [INFO ] [MAIN ] PRI: Full history saved. [2025-10-22T20:41:33.639062] [INFO ] [MAIN ] Update Progress: 1722/2367 symbols completed. PRI took 19.9s. Estimated remaining: 1h 22m 58s. Rate: 7.8 symbols/min [2025-10-22T20:41:33.722972] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-22T20:41:33.810233] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:41:33.848528] [DEBUG] [LOCAL ] PRM: Loaded 44377 existing records from primary storage. [2025-10-22T20:41:33.848840] [INFO ] [MAIN ] PRM: Loaded 44377 existing records. [2025-10-22T20:41:34.026462] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:41:34.026682] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-22T20:41:34.026740] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-22T20:41:34.026975] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-10-22T20:41:34.027015] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-22T20:41:34.292148] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T20:41:34.422322] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:41:34.517742] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-22T20:41:35.317766] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-22T20:41:35.517009] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T20:41:36.117752] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-22T20:41:36.224698] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T20:41:36.917670] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-22T20:41:37.113043] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T20:41:37.717756] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-22T20:41:37.745464] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T20:41:38.164428] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T20:41:38.517734] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-22T20:41:39.317685] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-22T20:41:39.448315] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T20:41:39.972494] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T20:41:40.117716] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-22T20:41:40.630105] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T20:41:40.917672] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-22T20:41:41.717740] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-22T20:41:41.936577] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T20:41:41.983626] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T20:41:42.517753] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-22T20:41:43.317741] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-22T20:41:43.580522] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T20:41:44.117639] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-22T20:41:44.240687] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T20:41:44.247815] [INFO ] [REMOTE ] PRIM: Full fetch complete (63843 records). [2025-10-22T20:41:44.247930] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-22T20:41:44.640132] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-10-22T20:41:44.640301] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-10-22T20:41:44.641619] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-10-22T20:41:44.641771] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-10-22T20:41:44.643875] [DEBUG] [LOCAL ] PRIM: Trimmed 63843 records to 44097 (keeping 200 days of data) [2025-10-22T20:41:44.777078] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T20:41:44.918035] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-22T20:41:44.961714] [DEBUG] [LOCAL ] PRIM: Primary data saved (44097 records). [2025-10-22T20:41:44.961849] [INFO ] [MAIN ] PRIM: Full history saved. [2025-10-22T20:41:44.961964] [INFO ] [MAIN ] Update Progress: 1723/2367 symbols completed. PRIM took 31.2s. Estimated remaining: 1h 22m 51s. Rate: 7.8 symbols/min [2025-10-22T20:41:45.136983] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:41:45.186303] [DEBUG] [LOCAL ] PRMB: Loaded 53109 existing records from primary storage. [2025-10-22T20:41:45.186630] [INFO ] [MAIN ] PRMB: Loaded 53109 existing records. [2025-10-22T20:41:45.368739] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:41:45.380465] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T20:41:45.380123] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-22T20:41:45.380577] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-22T20:41:45.385404] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-10-22T20:41:45.385463] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-22T20:41:45.728168] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-22T20:41:45.732858] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:41:46.517741] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-22T20:41:46.644801] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T20:41:46.652715] [INFO ] [REMOTE ] PRKS: Full fetch complete (61610 records). [2025-10-22T20:41:46.652990] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-22T20:41:46.816568] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T20:41:47.065147] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-10-22T20:41:47.065237] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-10-22T20:41:47.066353] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-10-22T20:41:47.066419] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-10-22T20:41:47.067587] [DEBUG] [LOCAL ] PRKS: Trimmed 61610 records to 42224 (keeping 200 days of data) [2025-10-22T20:41:47.307151] [DEBUG] [LOCAL ] PRKS: Primary data saved (42224 records). [2025-10-22T20:41:47.307282] [INFO ] [MAIN ] PRKS: Full history saved. [2025-10-22T20:41:47.307363] [INFO ] [MAIN ] Update Progress: 1724/2367 symbols completed. PRKS took 33.6s. Estimated remaining: 1h 22m 41s. Rate: 7.8 symbols/min [2025-10-22T20:41:47.322740] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-22T20:41:47.479045] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:41:47.515829] [DEBUG] [LOCAL ] PRO: Loaded 40193 existing records from primary storage. [2025-10-22T20:41:47.516138] [INFO ] [MAIN ] PRO: Loaded 40193 existing records. [2025-10-22T20:41:47.689293] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:41:47.689493] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-22T20:41:47.689540] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-22T20:41:47.689739] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-10-22T20:41:47.689797] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-22T20:41:48.037683] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:41:48.117681] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-22T20:41:48.229989] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T20:41:48.917638] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-22T20:41:49.068323] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T20:41:49.486177] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T20:41:49.717684] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-22T20:41:50.517630] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-22T20:41:50.683713] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T20:41:51.119595] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T20:41:51.317734] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-22T20:41:52.117721] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-22T20:41:52.285353] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-22T20:41:52.324444] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-22T20:41:52.917722] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-22T20:41:53.717671] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-22T20:41:53.790152] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T20:41:54.337631] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T20:41:54.517690] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-22T20:41:55.317679] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-22T20:41:55.754610] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-22T20:41:56.117756] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-22T20:41:56.254749] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T20:41:56.856281] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T20:41:56.917616] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-22T20:41:57.717638] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-22T20:41:57.793474] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T20:41:58.485633] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T20:41:58.517713] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-22T20:41:58.578467] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T20:41:59.317688] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-22T20:42:00.117773] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-22T20:42:00.339326] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T20:42:00.342613] [INFO ] [REMOTE ] PRLB: Full fetch complete (30389 records). [2025-10-22T20:42:00.342778] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-22T20:42:00.737067] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-22T20:42:00.775606] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-10-22T20:42:00.775732] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-10-22T20:42:00.776882] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-10-22T20:42:00.776948] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-10-22T20:42:00.777749] [DEBUG] [LOCAL ] PRLB: Trimmed 30389 records to 20243 (keeping 200 days of data) [2025-10-22T20:42:00.898723] [DEBUG] [LOCAL ] PRLB: Primary data saved (20243 records). [2025-10-22T20:42:00.898849] [INFO ] [MAIN ] PRLB: Full history saved. [2025-10-22T20:42:00.898927] [INFO ] [MAIN ] Update Progress: 1725/2367 symbols completed. PRLB took 31.5s. Estimated remaining: 1h 22m 36s. Rate: 7.8 symbols/min [2025-10-22T20:42:00.925791] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-22T20:42:01.100282] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:42:01.125730] [DEBUG] [LOCAL ] PRSU: Loaded 23232 existing records from primary storage. [2025-10-22T20:42:01.126004] [INFO ] [MAIN ] PRSU: Loaded 23232 existing records. [2025-10-22T20:42:01.302762] [WARN ] [MAIN ] PRSU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:42:01.302977] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-22T20:42:01.303023] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-22T20:42:01.303288] [DEBUG] [LOCAL ] PRSU: Deleted primary data file. [2025-10-22T20:42:01.303326] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-22T20:42:01.660463] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:42:01.717631] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-22T20:42:01.843132] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T20:42:02.517747] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-22T20:42:03.146051] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-22T20:42:03.317723] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-22T20:42:03.468013] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T20:42:04.122915] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-01. [2025-10-22T20:42:04.139997] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T20:42:04.917725] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-22T20:42:05.244635] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-22T20:42:05.717752] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-22T20:42:05.758347] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T20:42:06.517638] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-10-22T20:42:06.753006] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T20:42:06.760607] [INFO ] [REMOTE ] PRM: Full fetch complete (64915 records). [2025-10-22T20:42:06.760759] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-22T20:42:07.150464] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-10-22T20:42:07.150591] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-10-22T20:42:07.151634] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-10-22T20:42:07.151718] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-10-22T20:42:07.153043] [DEBUG] [LOCAL ] PRM: Trimmed 64915 records to 44368 (keeping 200 days of data) [2025-10-22T20:42:07.324839] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-22T20:42:07.391042] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T20:42:07.456535] [DEBUG] [LOCAL ] PRM: Primary data saved (44368 records). [2025-10-22T20:42:07.456697] [INFO ] [MAIN ] PRM: Full history saved. [2025-10-22T20:42:07.456790] [INFO ] [MAIN ] Update Progress: 1726/2367 symbols completed. PRM took 33.8s. Estimated remaining: 1h 22m 28s. Rate: 7.8 symbols/min [2025-10-22T20:42:07.644131] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:42:07.651515] [DEBUG] [LOCAL ] PRT: Loaded 5138 existing records from primary storage. [2025-10-22T20:42:07.651762] [INFO ] [MAIN ] PRT: Loaded 5138 existing records. [2025-10-22T20:42:07.835458] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:42:07.835769] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-22T20:42:07.835825] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-22T20:42:07.836161] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-10-22T20:42:07.836297] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-22T20:42:07.918017] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T20:42:08.125758] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-22T20:42:08.205548] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:42:08.917742] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-22T20:42:09.402067] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-22T20:42:09.717665] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-22T20:42:09.803591] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T20:42:09.865392] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-22T20:42:10.517773] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-22T20:42:11.317676] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-22T20:42:11.402705] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-22T20:42:11.570744] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T20:42:12.117731] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-22T20:42:12.917753] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-10-22T20:42:13.078094] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T20:42:13.717774] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-22T20:42:14.040042] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-22T20:42:14.048811] [INFO ] [REMOTE ] PRMB: Full fetch complete (76324 records). [2025-10-22T20:42:14.048941] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-22T20:42:14.450201] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-22T20:42:14.450375] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-10-22T20:42:14.452974] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-10-22T20:42:14.454121] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-10-22T20:42:14.462451] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-10-22T20:42:14.477415] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T20:42:14.486861] [DEBUG] [LOCAL ] PRMB: Trimmed 76324 records to 53101 (keeping 200 days of data) [2025-10-22T20:42:14.538508] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-22T20:42:14.802215] [DEBUG] [LOCAL ] PRMB: Primary data saved (53101 records). [2025-10-22T20:42:14.802341] [INFO ] [MAIN ] PRMB: Full history saved. [2025-10-22T20:42:14.802416] [INFO ] [MAIN ] Update Progress: 1727/2367 symbols completed. PRMB took 29.8s. Estimated remaining: 1h 22m 20s. Rate: 7.8 symbols/min [2025-10-22T20:42:14.965435] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:42:15.013244] [DEBUG] [LOCAL ] PRU: Loaded 51187 existing records from primary storage. [2025-10-22T20:42:15.013537] [INFO ] [MAIN ] PRU: Loaded 51187 existing records. [2025-10-22T20:42:15.184834] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:42:15.185074] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-22T20:42:15.185128] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-22T20:42:15.185304] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-10-22T20:42:15.185340] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-22T20:42:15.322844] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-22T20:42:15.532151] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:42:16.117668] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-10-22T20:42:16.147300] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T20:42:16.301744] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-22T20:42:16.309454] [INFO ] [REMOTE ] PRO: Full fetch complete (53962 records). [2025-10-22T20:42:16.309578] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-22T20:42:16.708846] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-10-22T20:42:16.708926] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-10-22T20:42:16.709873] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-10-22T20:42:16.709935] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-10-22T20:42:16.711075] [DEBUG] [LOCAL ] PRO: Trimmed 53962 records to 40143 (keeping 200 days of data) [2025-10-22T20:42:16.924810] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-22T20:42:16.942233] [DEBUG] [LOCAL ] PRO: Primary data saved (40143 records). [2025-10-22T20:42:16.942346] [INFO ] [MAIN ] PRO: Full history saved. [2025-10-22T20:42:16.942418] [INFO ] [MAIN ] Update Progress: 1728/2367 symbols completed. PRO took 29.6s. Estimated remaining: 1h 22m 10s. Rate: 7.8 symbols/min [2025-10-22T20:42:17.109178] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:42:17.109323] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-22T20:42:17.109360] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-22T20:42:17.109465] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-22T20:42:17.109505] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-22T20:42:17.109549] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-22T20:42:17.109583] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-22T20:42:17.461822] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:42:17.501131] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T20:42:17.717671] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-10-22T20:42:18.517717] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-22T20:42:18.852576] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T20:42:18.897755] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-22T20:42:19.221194] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T20:42:19.317638] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-22T20:42:20.016693] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-22T20:42:20.117623] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-22T20:42:20.626414] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-22T20:42:20.917721] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-22T20:42:21.717684] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-22T20:42:22.228244] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-22T20:42:22.517639] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-22T20:42:22.860185] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-22T20:42:23.228927] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-22T20:42:23.317761] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-22T20:42:24.095160] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-22T20:42:24.117608] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-22T20:42:24.917744] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-22T20:42:24.955232] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-22T20:42:25.717723] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-10-22T20:42:26.517740] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-22T20:42:26.528333] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T20:42:26.998907] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-22T20:42:27.033122] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-22T20:42:27.317739] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-10. [2025-10-22T20:42:28.088206] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-22T20:42:28.089774] [INFO ] [REMOTE ] PRT: Full fetch complete (8552 records). [2025-10-22T20:42:28.089880] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-10-22T20:42:28.122722] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-10-22T20:42:28.445583] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-10-22T20:42:28.445685] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-10-22T20:42:28.445925] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-10-22T20:42:28.445966] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-10-22T20:42:28.446352] [DEBUG] [LOCAL ] PRT: Trimmed 8552 records to 5061 (keeping 200 days of data) [2025-10-22T20:42:28.475048] [DEBUG] [LOCAL ] PRT: Primary data saved (5061 records). [2025-10-22T20:42:28.475166] [INFO ] [MAIN ] PRT: Full history saved. [2025-10-22T20:42:28.475241] [INFO ] [MAIN ] Update Progress: 1729/2367 symbols completed. PRT took 21.0s. Estimated remaining: 1h 22m 4s. Rate: 7.8 symbols/min [2025-10-22T20:42:28.640084] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:42:28.680675] [DEBUG] [LOCAL ] PSA: Loaded 42179 existing records from primary storage. [2025-10-22T20:42:28.681014] [INFO ] [MAIN ] PSA: Loaded 42179 existing records. [2025-10-22T20:42:28.860668] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:42:28.860960] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-22T20:42:28.861725] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-22T20:42:28.862217] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-10-22T20:42:28.862275] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-22T20:42:28.923539] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-22T20:42:29.209958] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:42:29.443718] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-22T20:42:29.560304] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T20:42:29.717668] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-22T20:42:30.180808] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-22T20:42:30.517781] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-10-22T20:42:31.317679] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-22T20:42:31.858726] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-22T20:42:32.117713] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-22T20:42:32.917718] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-22T20:42:32.976194] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T20:42:33.472221] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T20:42:33.717686] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-10-22T20:42:34.337515] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-22T20:42:34.517747] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-22T20:42:34.935958] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-22T20:42:35.150302] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T20:42:35.317763] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-22T20:42:36.117688] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-22T20:42:36.622690] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-22T20:42:36.917747] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-22T20:42:37.031060] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T20:42:37.323639] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-22T20:42:37.324398] [INFO ] [REMOTE ] PRVS: Full fetch complete (1236 records). [2025-10-22T20:42:37.324464] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-22T20:42:37.504367] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-22T20:42:37.504545] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:42:37.504626] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:42:37.504804] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-22T20:42:37.504869] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-22T20:42:37.504906] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-22T20:42:37.504946] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-22T20:42:37.505001] [INFO ] [MAIN ] Update Progress: 1730/2367 symbols completed. PRVS took 20.6s. Estimated remaining: 1h 21m 57s. Rate: 7.8 symbols/min [2025-10-22T20:42:37.675977] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:42:37.685411] [DEBUG] [LOCAL ] PSBD: Loaded 8213 existing records from primary storage. [2025-10-22T20:42:37.685572] [INFO ] [MAIN ] PSBD: Loaded 8213 existing records. [2025-10-22T20:42:37.723266] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-22T20:42:37.865567] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:42:37.865796] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-22T20:42:37.865843] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-22T20:42:37.865996] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-10-22T20:42:37.866073] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-22T20:42:38.211897] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:42:38.517779] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-22T20:42:39.317740] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-22T20:42:39.504745] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-22T20:42:39.836352] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-22T20:42:40.117771] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-22T20:42:40.712350] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-22T20:42:40.917682] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-22T20:42:41.717673] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-22T20:42:42.069634] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T20:42:42.480847] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T20:42:42.517687] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-22T20:42:42.892553] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T20:42:43.317632] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-10-22T20:42:43.468167] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T20:42:44.117707] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-22T20:42:44.616310] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T20:42:44.917766] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-22T20:42:45.717637] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-22T20:42:46.270374] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-22T20:42:46.517622] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-22T20:42:46.774189] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T20:42:47.323543] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-22T20:42:47.333632] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-10-22T20:42:48.117750] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-10. [2025-10-22T20:42:48.200581] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T20:42:48.874547] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-22T20:42:48.917724] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-22T20:42:48.987158] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T20:42:48.992871] [INFO ] [REMOTE ] PRSU: Full fetch complete (34334 records). [2025-10-22T20:42:48.993012] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-10-22T20:42:49.368154] [DEBUG] [VALIDATOR ] PRSU: All expected trading days are present. [2025-10-22T20:42:49.368232] [DEBUG] [VALIDATOR ] PRSU: Primary data validation passed. [2025-10-22T20:42:49.368908] [INFO ] [MAIN ] PRSU: Fetched primary data is valid. [2025-10-22T20:42:49.368969] [DEBUG] [LOCAL ] PRSU: Saving primary data. [2025-10-22T20:42:49.369746] [DEBUG] [LOCAL ] PRSU: Trimmed 34334 records to 23124 (keeping 200 days of data) [2025-10-22T20:42:49.499208] [DEBUG] [LOCAL ] PRSU: Primary data saved (23124 records). [2025-10-22T20:42:49.499332] [INFO ] [MAIN ] PRSU: Full history saved. [2025-10-22T20:42:49.499408] [INFO ] [MAIN ] Update Progress: 1731/2367 symbols completed. PRSU took 48.6s. Estimated remaining: 1h 21m 50s. Rate: 7.8 symbols/min [2025-10-22T20:42:49.666589] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:42:49.675483] [DEBUG] [LOCAL ] PSF: Loaded 6992 existing records from primary storage. [2025-10-22T20:42:49.675705] [INFO ] [MAIN ] PSF: Loaded 6992 existing records. [2025-10-22T20:42:49.722957] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-22T20:42:49.863523] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:42:49.863805] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-22T20:42:49.863885] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-22T20:42:49.864058] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-10-22T20:42:49.864114] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-22T20:42:50.213555] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:42:50.517753] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-22T20:42:50.852358] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T20:42:51.317637] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-22T20:42:51.449903] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T20:42:51.632543] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-22T20:42:52.117752] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-22T20:42:52.917679] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-22T20:42:52.948322] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-22T20:42:53.167068] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T20:42:53.175601] [INFO ] [REMOTE ] PRU: Full fetch complete (74591 records). [2025-10-22T20:42:53.175815] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-22T20:42:53.567528] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-10-22T20:42:53.567607] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-10-22T20:42:53.568780] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-10-22T20:42:53.568870] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-10-22T20:42:53.570218] [DEBUG] [LOCAL ] PRU: Trimmed 74591 records to 51171 (keeping 200 days of data) [2025-10-22T20:42:53.752950] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-22T20:42:53.907451] [DEBUG] [LOCAL ] PRU: Primary data saved (51171 records). [2025-10-22T20:42:53.907591] [INFO ] [MAIN ] PRU: Full history saved. [2025-10-22T20:42:53.907709] [INFO ] [MAIN ] Update Progress: 1732/2367 symbols completed. PRU took 39.1s. Estimated remaining: 1h 21m 42s. Rate: 7.8 symbols/min [2025-10-22T20:42:54.073236] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:42:54.101618] [DEBUG] [LOCAL ] PSFE: Loaded 29751 existing records from primary storage. [2025-10-22T20:42:54.101929] [INFO ] [MAIN ] PSFE: Loaded 29751 existing records. [2025-10-22T20:42:54.278095] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:42:54.278318] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-22T20:42:54.278367] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-22T20:42:54.278578] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-10-22T20:42:54.278702] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-22T20:42:54.527296] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-22T20:42:54.647271] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:42:54.689476] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T20:42:54.749974] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T20:42:55.317740] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-22T20:42:55.642088] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T20:42:55.972554] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-22T20:42:56.117732] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-22T20:42:56.917710] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-22T20:42:57.685345] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-22T20:42:57.710194] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T20:42:57.718390] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-22T20:42:58.517714] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-22T20:42:58.574435] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-22T20:42:59.317736] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-10-22T20:42:59.562321] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T20:42:59.565556] [INFO ] [REMOTE ] PSBD: Full fetch complete (10938 records). [2025-10-22T20:42:59.565632] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-22T20:42:59.931326] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-10-22T20:42:59.931401] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-10-22T20:42:59.931685] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-10-22T20:42:59.931747] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-10-22T20:42:59.932184] [DEBUG] [LOCAL ] PSBD: Trimmed 10938 records to 8246 (keeping 200 days of data) [2025-10-22T20:42:59.983784] [DEBUG] [LOCAL ] PSBD: Primary data saved (8246 records). [2025-10-22T20:42:59.983923] [INFO ] [MAIN ] PSBD: Full history saved. [2025-10-22T20:42:59.984009] [INFO ] [MAIN ] Update Progress: 1733/2367 symbols completed. PSBD took 22.5s. Estimated remaining: 1h 21m 33s. Rate: 7.8 symbols/min [2025-10-22T20:43:00.121356] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-22T20:43:00.152012] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:43:00.189263] [DEBUG] [LOCAL ] PSN: Loaded 45263 existing records from primary storage. [2025-10-22T20:43:00.189550] [INFO ] [MAIN ] PSN: Loaded 45263 existing records. [2025-10-22T20:43:00.360082] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:43:00.360283] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-22T20:43:00.360329] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-22T20:43:00.360599] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-10-22T20:43:00.360689] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-22T20:43:00.707057] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:43:00.798751] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T20:43:00.917763] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-22T20:43:01.717670] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-22T20:43:01.815410] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-22T20:43:01.935684] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T20:43:02.517705] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-10-22T20:43:03.317687] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-22T20:43:03.683268] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-22T20:43:03.747919] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T20:43:04.117670] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-10-22T20:43:04.917752] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-22T20:43:05.053445] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T20:43:05.061037] [INFO ] [REMOTE ] PSA: Full fetch complete (59704 records). [2025-10-22T20:43:05.061202] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-22T20:43:05.478659] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-10-22T20:43:05.478759] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-10-22T20:43:05.479765] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-10-22T20:43:05.479828] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-10-22T20:43:05.481202] [DEBUG] [LOCAL ] PSA: Trimmed 59704 records to 42093 (keeping 200 days of data) [2025-10-22T20:43:05.720378] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-22T20:43:05.765250] [DEBUG] [LOCAL ] PSA: Primary data saved (42093 records). [2025-10-22T20:43:05.766440] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T20:43:05.766715] [INFO ] [MAIN ] PSA: Full history saved. [2025-10-22T20:43:05.773700] [INFO ] [MAIN ] Update Progress: 1734/2367 symbols completed. PSA took 37.3s. Estimated remaining: 1h 21m 25s. Rate: 7.8 symbols/min [2025-10-22T20:43:05.940484] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:43:05.976360] [DEBUG] [LOCAL ] PSO: Loaded 36731 existing records from primary storage. [2025-10-22T20:43:05.976740] [INFO ] [MAIN ] PSO: Loaded 36731 existing records. [2025-10-22T20:43:06.159041] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:43:06.159290] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-22T20:43:06.159340] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-22T20:43:06.159591] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-10-22T20:43:06.159683] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-22T20:43:06.520010] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-10-22T20:43:06.560019] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:43:06.763933] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-22T20:43:06.785757] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T20:43:07.317729] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-22T20:43:07.597573] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T20:43:08.117738] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-22T20:43:08.867402] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-22T20:43:08.917678] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-10-22T20:43:09.209964] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T20:43:09.717750] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-22T20:43:10.517630] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-22T20:43:10.633077] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T20:43:11.317670] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-22T20:43:11.455290] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-22T20:43:11.539877] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T20:43:12.117687] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-22T20:43:12.785177] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T20:43:12.917637] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-10-22T20:43:13.008855] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T20:43:13.717746] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-22T20:43:14.426941] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T20:43:14.517630] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-10-22T20:43:14.556075] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T20:43:15.317676] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-22T20:43:16.069152] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T20:43:16.095535] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-22T20:43:16.097028] [INFO ] [REMOTE ] PSF: Full fetch complete (9691 records). [2025-10-22T20:43:16.097100] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-22T20:43:16.125983] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-22T20:43:16.468275] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-10-22T20:43:16.468346] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-10-22T20:43:16.468630] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-10-22T20:43:16.468708] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-10-22T20:43:16.469372] [DEBUG] [LOCAL ] PSF: Trimmed 9691 records to 6947 (keeping 200 days of data) [2025-10-22T20:43:16.511442] [DEBUG] [LOCAL ] PSF: Primary data saved (6947 records). [2025-10-22T20:43:16.511563] [INFO ] [MAIN ] PSF: Full history saved. [2025-10-22T20:43:16.511664] [INFO ] [MAIN ] Update Progress: 1735/2367 symbols completed. PSF took 27.0s. Estimated remaining: 1h 21m 18s. Rate: 7.8 symbols/min [2025-10-22T20:43:16.687876] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:43:16.722798] [DEBUG] [LOCAL ] PSQH: Loaded 35346 existing records from primary storage. [2025-10-22T20:43:16.723070] [INFO ] [MAIN ] PSQH: Loaded 35346 existing records. [2025-10-22T20:43:16.903691] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:43:16.903896] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-22T20:43:16.903947] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-22T20:43:16.904142] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-10-22T20:43:16.904198] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-22T20:43:16.924672] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-22T20:43:17.266806] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:43:17.563585] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T20:43:17.717679] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-22T20:43:18.517667] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-10-22T20:43:18.582100] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T20:43:19.317679] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-22T20:43:19.512532] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T20:43:19.958228] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T20:43:20.117638] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-10-22T20:43:20.835833] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T20:43:20.917620] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-22T20:43:21.717617] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-10-22T20:43:22.019318] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T20:43:22.517633] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-10-22T20:43:22.856855] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T20:43:22.984432] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-22T20:43:23.317752] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-22T20:43:24.117751] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-22T20:43:24.196156] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T20:43:24.917763] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-10. [2025-10-22T20:43:25.035768] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T20:43:25.717747] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-22T20:43:25.905357] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T20:43:26.215587] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-22T20:43:26.221289] [INFO ] [REMOTE ] PSFE: Full fetch complete (43058 records). [2025-10-22T20:43:26.221454] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-10-22T20:43:26.522986] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-22T20:43:26.597205] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-10-22T20:43:26.597284] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-10-22T20:43:26.598128] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-10-22T20:43:26.598190] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-10-22T20:43:26.599087] [DEBUG] [LOCAL ] PSFE: Trimmed 43058 records to 29574 (keeping 200 days of data) [2025-10-22T20:43:26.765625] [DEBUG] [LOCAL ] PSFE: Primary data saved (29574 records). [2025-10-22T20:43:26.765775] [INFO ] [MAIN ] PSFE: Full history saved. [2025-10-22T20:43:26.765854] [INFO ] [MAIN ] Update Progress: 1736/2367 symbols completed. PSFE took 32.9s. Estimated remaining: 1h 21m 11s. Rate: 7.8 symbols/min [2025-10-22T20:43:26.946116] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:43:27.006522] [DEBUG] [LOCAL ] PSTG: Loaded 52836 existing records from primary storage. [2025-10-22T20:43:27.006968] [INFO ] [MAIN ] PSTG: Loaded 52836 existing records. [2025-10-22T20:43:27.208356] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:43:27.208808] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-22T20:43:27.208949] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-22T20:43:27.209337] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-10-22T20:43:27.209412] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-22T20:43:27.326684] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-10-22T20:43:27.587372] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T20:43:27.759232] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:43:28.117772] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-22T20:43:28.357911] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T20:43:28.576472] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T20:43:28.917742] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-22T20:43:29.698516] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T20:43:29.717656] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-22T20:43:30.517744] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-22T20:43:30.743444] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T20:43:31.317760] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-10-22T20:43:31.473863] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-22T20:43:32.117619] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-22T20:43:32.429548] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T20:43:32.665371] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T20:43:32.917666] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-22T20:43:33.416493] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T20:43:33.717676] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-22T20:43:34.517710] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-22T20:43:34.817387] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-22T20:43:35.199143] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T20:43:35.317672] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-22T20:43:36.117759] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-22T20:43:36.307533] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T20:43:36.314537] [INFO ] [REMOTE ] PSN: Full fetch complete (66870 records). [2025-10-22T20:43:36.314699] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-22T20:43:36.722105] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-10-22T20:43:36.722187] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-10-22T20:43:36.723157] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-10-22T20:43:36.723220] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-10-22T20:43:36.724517] [DEBUG] [LOCAL ] PSN: Trimmed 66870 records to 45180 (keeping 200 days of data) [2025-10-22T20:43:36.926784] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-10-22T20:43:36.987575] [DEBUG] [LOCAL ] PSN: Primary data saved (45180 records). [2025-10-22T20:43:36.987757] [INFO ] [MAIN ] PSN: Full history saved. [2025-10-22T20:43:36.987852] [INFO ] [MAIN ] Update Progress: 1737/2367 symbols completed. PSN took 37.0s. Estimated remaining: 1h 21m 5s. Rate: 7.8 symbols/min [2025-10-22T20:43:37.159771] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:43:37.179729] [DEBUG] [LOCAL ] PSTL: Loaded 19964 existing records from primary storage. [2025-10-22T20:43:37.179973] [INFO ] [MAIN ] PSTL: Loaded 19964 existing records. [2025-10-22T20:43:37.363629] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:43:37.364066] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-22T20:43:37.364203] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-22T20:43:37.364494] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-10-22T20:43:37.364558] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-22T20:43:37.503814] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-22T20:43:37.720803] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-22T20:43:37.790879] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:43:37.811373] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T20:43:38.517685] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-22T20:43:38.719448] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T20:43:39.317818] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-10-22T20:43:39.678110] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T20:43:39.852019] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-22T20:43:40.117749] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-22T20:43:40.511077] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-22T20:43:40.917732] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-22T20:43:41.717740] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-22T20:43:41.847025] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T20:43:42.517620] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-22T20:43:42.602902] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-22T20:43:42.780748] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T20:43:43.317757] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-22T20:43:44.117616] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-22T20:43:44.547485] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-22T20:43:44.597992] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T20:43:44.917759] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-22T20:43:45.717679] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-22T20:43:46.026092] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-22T20:43:46.034601] [INFO ] [REMOTE ] PSQH: Full fetch complete (53315 records). [2025-10-22T20:43:46.034943] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-22T20:43:46.451155] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-10-22T20:43:46.451341] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-10-22T20:43:46.453023] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-10-22T20:43:46.453103] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-10-22T20:43:46.454408] [DEBUG] [LOCAL ] PSQH: Trimmed 53315 records to 35401 (keeping 200 days of data) [2025-10-22T20:43:46.535095] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-10. [2025-10-22T20:43:46.660638] [DEBUG] [LOCAL ] PSQH: Primary data saved (35401 records). [2025-10-22T20:43:46.660887] [INFO ] [MAIN ] PSQH: Full history saved. [2025-10-22T20:43:46.661004] [INFO ] [MAIN ] Update Progress: 1738/2367 symbols completed. PSQH took 30.1s. Estimated remaining: 1h 20m 58s. Rate: 7.8 symbols/min [2025-10-22T20:43:46.842121] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:43:46.895757] [DEBUG] [LOCAL ] PSX: Loaded 53132 existing records from primary storage. [2025-10-22T20:43:46.896142] [INFO ] [MAIN ] PSX: Loaded 53132 existing records. [2025-10-22T20:43:47.089268] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:43:47.089927] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-22T20:43:47.090134] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-22T20:43:47.103320] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-10-22T20:43:47.105283] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-22T20:43:47.153033] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T20:43:47.247749] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-22T20:43:47.323163] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-22T20:43:47.559773] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:43:48.117711] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-22T20:43:48.220765] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T20:43:48.227974] [INFO ] [REMOTE ] PSO: Full fetch complete (52914 records). [2025-10-22T20:43:48.228136] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-10-22T20:43:48.633872] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-10-22T20:43:48.633952] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-10-22T20:43:48.634835] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-10-22T20:43:48.634898] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-10-22T20:43:48.635915] [DEBUG] [LOCAL ] PSO: Trimmed 52914 records to 36655 (keeping 200 days of data) [2025-10-22T20:43:48.847905] [DEBUG] [LOCAL ] PSO: Primary data saved (36655 records). [2025-10-22T20:43:48.848035] [INFO ] [MAIN ] PSO: Full history saved. [2025-10-22T20:43:48.848110] [INFO ] [MAIN ] Update Progress: 1739/2367 symbols completed. PSO took 43.1s. Estimated remaining: 1h 20m 48s. Rate: 7.8 symbols/min [2025-10-22T20:43:48.922036] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-10-22T20:43:49.018183] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:43:49.033548] [DEBUG] [LOCAL ] PTA: Loaded 15492 existing records from primary storage. [2025-10-22T20:43:49.033801] [INFO ] [MAIN ] PTA: Loaded 15492 existing records. [2025-10-22T20:43:49.208439] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:43:49.208602] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-22T20:43:49.208672] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-22T20:43:49.208942] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-10-22T20:43:49.208982] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-22T20:43:49.521236] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T20:43:49.623221] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:43:49.636837] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-22T20:43:49.717615] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-22T20:43:50.517726] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-22T20:43:50.727310] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T20:43:51.317730] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-22T20:43:51.763024] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T20:43:51.875889] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-22T20:43:52.117639] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-22T20:43:52.487852] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T20:43:52.917712] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-10-22T20:43:53.365316] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T20:43:53.717753] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-22T20:43:54.517723] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-22T20:43:54.811249] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T20:43:55.317684] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-22T20:43:55.366451] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-22T20:43:55.375295] [INFO ] [REMOTE ] PSTG: Full fetch complete (76698 records). [2025-10-22T20:43:55.375424] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-22T20:43:55.585632] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-22T20:43:55.777377] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-10-22T20:43:55.777462] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-10-22T20:43:55.778602] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-10-22T20:43:55.778697] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-10-22T20:43:55.780211] [DEBUG] [LOCAL ] PSTG: Trimmed 76698 records to 52833 (keeping 200 days of data) [2025-10-22T20:43:56.083479] [DEBUG] [LOCAL ] PSTG: Primary data saved (52833 records). [2025-10-22T20:43:56.083628] [INFO ] [MAIN ] PSTG: Full history saved. [2025-10-22T20:43:56.083750] [INFO ] [MAIN ] Update Progress: 1740/2367 symbols completed. PSTG took 29.3s. Estimated remaining: 1h 20m 40s. Rate: 7.8 symbols/min [2025-10-22T20:43:56.125902] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-22T20:43:56.277995] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:43:56.315443] [DEBUG] [LOCAL ] PTY: Loaded 37954 existing records from primary storage. [2025-10-22T20:43:56.315802] [INFO ] [MAIN ] PTY: Loaded 37954 existing records. [2025-10-22T20:43:56.522882] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:43:56.523218] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-22T20:43:56.523778] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-22T20:43:56.524328] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-22T20:43:56.529351] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-10-22T20:43:56.529416] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-22T20:43:56.875093] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:43:56.917616] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-22T20:43:57.306842] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-22T20:43:57.717733] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-22T20:43:57.787553] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-22T20:43:58.517789] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-10-22T20:43:58.798750] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-22T20:43:59.317679] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-22T20:44:00.117677] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-22T20:44:00.480171] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T20:44:00.917760] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-10-22T20:44:01.084974] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-22T20:44:01.488731] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-22T20:44:01.717712] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-22T20:44:02.517754] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-22T20:44:03.012982] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-22T20:44:03.096923] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-22T20:44:03.317720] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-10-22T20:44:03.682004] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-22T20:44:04.117741] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-22T20:44:04.917619] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-22T20:44:05.272373] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T20:44:05.275985] [INFO ] [REMOTE ] PSTL: Full fetch complete (29455 records). [2025-10-22T20:44:05.276057] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-22T20:44:05.652865] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-22T20:44:05.701131] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-10-22T20:44:05.701209] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-10-22T20:44:05.701886] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-10-22T20:44:05.702221] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-10-22T20:44:05.702967] [DEBUG] [LOCAL ] PSTL: Trimmed 29455 records to 19894 (keeping 200 days of data) [2025-10-22T20:44:05.752699] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-10-22T20:44:05.823408] [DEBUG] [LOCAL ] PSTL: Primary data saved (19894 records). [2025-10-22T20:44:05.823526] [INFO ] [MAIN ] PSTL: Full history saved. [2025-10-22T20:44:05.823599] [INFO ] [MAIN ] Update Progress: 1741/2367 symbols completed. PSTL took 28.8s. Estimated remaining: 1h 20m 33s. Rate: 7.8 symbols/min [2025-10-22T20:44:05.993798] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:44:06.032170] [DEBUG] [LOCAL ] PUK: Loaded 44388 existing records from primary storage. [2025-10-22T20:44:06.032453] [INFO ] [MAIN ] PUK: Loaded 44388 existing records. [2025-10-22T20:44:06.212603] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:44:06.212923] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-22T20:44:06.213031] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-22T20:44:06.213543] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-10-22T20:44:06.213603] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-22T20:44:06.519124] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-10-22T20:44:06.567373] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T20:44:06.607023] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:44:06.884265] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T20:44:07.317677] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-22T20:44:08.117638] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-10-22T20:44:08.390169] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-22T20:44:08.917626] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-22T20:44:09.232737] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-22T20:44:09.299234] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-22T20:44:09.717755] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-22T20:44:10.431447] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T20:44:10.517616] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-22T20:44:11.317618] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-10-22T20:44:11.403987] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T20:44:11.904861] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T20:44:12.117608] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-22T20:44:12.283568] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T20:44:12.917757] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-22T20:44:13.717767] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-10. [2025-10-22T20:44:14.004743] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T20:44:14.522795] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-22T20:44:14.536220] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T20:44:14.820975] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T20:44:14.825437] [INFO ] [REMOTE ] PTA: Full fetch complete (22733 records). [2025-10-22T20:44:14.825546] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-10-22T20:44:15.210629] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-10-22T20:44:15.210746] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-10-22T20:44:15.211206] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-10-22T20:44:15.211245] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-10-22T20:44:15.211918] [DEBUG] [LOCAL ] PTA: Trimmed 22733 records to 15444 (keeping 200 days of data) [2025-10-22T20:44:15.306744] [DEBUG] [LOCAL ] PTA: Primary data saved (15444 records). [2025-10-22T20:44:15.306883] [INFO ] [MAIN ] PTA: Full history saved. [2025-10-22T20:44:15.307004] [INFO ] [MAIN ] Update Progress: 1742/2367 symbols completed. PTA took 26.5s. Estimated remaining: 1h 20m 26s. Rate: 7.8 symbols/min [2025-10-22T20:44:15.328294] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-10-22T20:44:15.485922] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:44:15.528213] [DEBUG] [LOCAL ] PUMP: Loaded 49434 existing records from primary storage. [2025-10-22T20:44:15.528573] [INFO ] [MAIN ] PUMP: Loaded 49434 existing records. [2025-10-22T20:44:15.705274] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:44:15.705480] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-22T20:44:15.705527] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-22T20:44:15.705768] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-10-22T20:44:15.705827] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-22T20:44:16.062546] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:44:16.117620] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-22T20:44:16.399696] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T20:44:16.917638] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-22T20:44:17.459109] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-22T20:44:17.717709] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-10-22T20:44:17.863932] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T20:44:18.295117] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T20:44:18.517745] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-22T20:44:19.318629] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-22T20:44:19.321255] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T20:44:20.117627] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-10-22T20:44:20.302036] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T20:44:20.721163] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T20:44:20.917720] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-22T20:44:21.717743] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-22T20:44:22.308665] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-22T20:44:22.386995] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T20:44:22.517615] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-22T20:44:23.317767] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-22T20:44:23.542984] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-22T20:44:24.011324] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T20:44:24.117618] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-22T20:44:24.917673] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-10. [2025-10-22T20:44:25.141630] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T20:44:25.717635] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-22T20:44:25.775765] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T20:44:26.517624] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-22T20:44:26.966562] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-22T20:44:26.975249] [INFO ] [REMOTE ] PSX: Full fetch complete (77136 records). [2025-10-22T20:44:26.975365] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-10-22T20:44:27.323796] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-22T20:44:27.363612] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-10-22T20:44:27.363876] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-10-22T20:44:27.365039] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-10-22T20:44:27.365120] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-10-22T20:44:27.366584] [DEBUG] [LOCAL ] PSX: Trimmed 77136 records to 53124 (keeping 200 days of data) [2025-10-22T20:44:27.605632] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T20:44:27.721103] [DEBUG] [LOCAL ] PSX: Primary data saved (53124 records). [2025-10-22T20:44:27.721237] [INFO ] [MAIN ] PSX: Full history saved. [2025-10-22T20:44:27.721854] [INFO ] [MAIN ] Update Progress: 1743/2367 symbols completed. PSX took 41.1s. Estimated remaining: 1h 20m 20s. Rate: 7.8 symbols/min [2025-10-22T20:44:27.891126] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:44:27.940581] [DEBUG] [LOCAL ] PVH: Loaded 49613 existing records from primary storage. [2025-10-22T20:44:27.940941] [INFO ] [MAIN ] PVH: Loaded 49613 existing records. [2025-10-22T20:44:28.118955] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-22T20:44:28.122586] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:44:28.123760] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-22T20:44:28.123814] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-22T20:44:28.124006] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-10-22T20:44:28.124045] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-22T20:44:28.529441] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:44:28.538125] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T20:44:28.759358] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T20:44:28.766708] [INFO ] [REMOTE ] PTY: Full fetch complete (54562 records). [2025-10-22T20:44:28.766817] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-22T20:44:28.926590] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-10-22T20:44:29.182738] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-10-22T20:44:29.182824] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-10-22T20:44:29.183738] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-10-22T20:44:29.183800] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-10-22T20:44:29.184820] [DEBUG] [LOCAL ] PTY: Trimmed 54562 records to 37908 (keeping 200 days of data) [2025-10-22T20:44:29.410437] [DEBUG] [LOCAL ] PTY: Primary data saved (37908 records). [2025-10-22T20:44:29.410574] [INFO ] [MAIN ] PTY: Full history saved. [2025-10-22T20:44:29.410675] [INFO ] [MAIN ] Update Progress: 1744/2367 symbols completed. PTY took 33.3s. Estimated remaining: 1h 20m 10s. Rate: 7.8 symbols/min [2025-10-22T20:44:29.581748] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:44:29.589116] [DEBUG] [LOCAL ] PVL: Loaded 4717 existing records from primary storage. [2025-10-22T20:44:29.589336] [INFO ] [MAIN ] PVL: Loaded 4717 existing records. [2025-10-22T20:44:29.725152] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-10-22T20:44:29.768704] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:44:29.769504] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-22T20:44:29.769619] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-22T20:44:29.769862] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-10-22T20:44:29.769929] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-22T20:44:30.116343] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-22T20:44:30.203984] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:44:30.517621] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-22T20:44:30.690158] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-22T20:44:31.174292] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T20:44:31.317627] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-10-22T20:44:31.324515] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-22T20:44:32.117770] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-22T20:44:32.706059] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-22T20:44:32.917718] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-22T20:44:33.039796] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T20:44:33.717744] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-10-22T20:44:34.413004] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-22T20:44:34.421570] [INFO ] [REMOTE ] PUK: Full fetch complete (65319 records). [2025-10-22T20:44:34.421773] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-22T20:44:34.523081] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-22T20:44:34.820678] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-10-22T20:44:34.820786] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-10-22T20:44:34.822211] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-10-22T20:44:34.822353] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-10-22T20:44:34.824259] [DEBUG] [LOCAL ] PUK: Trimmed 65319 records to 44333 (keeping 200 days of data) [2025-10-22T20:44:35.150123] [DEBUG] [LOCAL ] PUK: Primary data saved (44333 records). [2025-10-22T20:44:35.150309] [INFO ] [MAIN ] PUK: Full history saved. [2025-10-22T20:44:35.150427] [INFO ] [MAIN ] Update Progress: 1745/2367 symbols completed. PUK took 29.3s. Estimated remaining: 1h 20m 2s. Rate: 7.8 symbols/min [2025-10-22T20:44:35.318274] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-10-22T20:44:35.326076] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-22T20:44:35.440177] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:44:35.496515] [DEBUG] [LOCAL ] PWR: Loaded 46503 existing records from primary storage. [2025-10-22T20:44:35.496994] [INFO ] [MAIN ] PWR: Loaded 46503 existing records. [2025-10-22T20:44:35.668732] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T20:44:35.767338] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:44:35.767588] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-22T20:44:35.767638] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-22T20:44:35.767919] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-10-22T20:44:35.767966] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-22T20:44:36.126151] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-22T20:44:36.130847] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:44:36.716928] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-22T20:44:36.917611] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-10-22T20:44:37.351701] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-22T20:44:37.717759] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-10-22T20:44:38.517636] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-22T20:44:38.793945] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T20:44:39.312463] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T20:44:39.317621] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-22T20:44:39.707469] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T20:44:40.099965] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T20:44:40.117612] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-22T20:44:40.839462] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-22T20:44:40.917782] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-22T20:44:41.625772] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-22T20:44:41.717727] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-10-22T20:44:42.517748] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-10-22T20:44:43.317634] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-22T20:44:43.596278] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T20:44:44.117637] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-22T20:44:44.127031] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T20:44:44.313039] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T20:44:44.917722] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-10-22T20:44:45.717738] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-10-22T20:44:46.077573] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-22T20:44:46.517670] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-22T20:44:46.726956] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T20:44:47.317630] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-10. [2025-10-22T20:44:47.571549] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T20:44:48.117670] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-22T20:44:48.308099] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T20:44:48.759416] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T20:44:48.760743] [INFO ] [REMOTE ] PVL: Full fetch complete (7089 records). [2025-10-22T20:44:48.760811] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-22T20:44:48.922492] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-22T20:44:49.161715] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-10-22T20:44:49.167003] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-10-22T20:44:49.179316] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-10-22T20:44:49.179409] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-10-22T20:44:49.180875] [DEBUG] [LOCAL ] PVL: Trimmed 7089 records to 4737 (keeping 200 days of data) [2025-10-22T20:44:49.182047] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T20:44:49.204017] [INFO ] [REMOTE ] PUMP: Full fetch complete (71735 records). [2025-10-22T20:44:49.213581] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-10-22T20:44:49.221400] [DEBUG] [LOCAL ] PVL: Primary data saved (4737 records). [2025-10-22T20:44:49.221585] [INFO ] [MAIN ] PVL: Full history saved. [2025-10-22T20:44:49.221954] [INFO ] [MAIN ] Update Progress: 1746/2367 symbols completed. PVL took 19.8s. Estimated remaining: 1h 19m 56s. Rate: 7.8 symbols/min [2025-10-22T20:44:49.596806] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:44:49.719752] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-10-22T20:44:49.831286] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-10-22T20:44:49.831383] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-10-22T20:44:49.832637] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-10-22T20:44:49.832861] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-10-22T20:44:49.834355] [DEBUG] [LOCAL ] PUMP: Trimmed 71735 records to 49434 (keeping 200 days of data) [2025-10-22T20:44:49.929858] [DEBUG] [LOCAL ] PX: Loaded 34132 existing records from primary storage. [2025-10-22T20:44:49.940439] [INFO ] [MAIN ] PX: Loaded 34132 existing records. [2025-10-22T20:44:50.254367] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:44:50.270104] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-22T20:44:50.270233] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-22T20:44:50.270500] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-10-22T20:44:50.270556] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-22T20:44:50.430804] [DEBUG] [LOCAL ] PUMP: Primary data saved (49434 records). [2025-10-22T20:44:50.441862] [INFO ] [MAIN ] PUMP: Full history saved. [2025-10-22T20:44:50.447123] [INFO ] [MAIN ] Update Progress: 1747/2367 symbols completed. PUMP took 35.1s. Estimated remaining: 1h 19m 46s. Rate: 7.8 symbols/min [2025-10-22T20:44:50.816488] [INFO ] [MAIN ] PXED: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:44:50.820625] [DEBUG] [LOCAL ] PXED: No existing data file found in primary storage. [2025-10-22T20:44:50.836907] [WARN ] [MAIN ] PXED: No existing data found, performing full refresh instead. [2025-10-22T20:44:50.872906] [INFO ] [MAIN ] PXED: Wiping existing primary data before full refresh. [2025-10-22T20:44:50.903044] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-22T20:44:50.907031] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:44:50.907187] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-22T20:44:50.907601] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-22T20:44:50.907734] [INFO ] [MAIN ] PXED: Starting full primary refresh. [2025-10-22T20:44:51.278350] [INFO ] [REMOTE ] PXED: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:44:51.297598] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-22T20:44:51.317633] [INFO ] [REMOTE ] PXED: Fetching primary data for 2025-01. [2025-10-22T20:44:51.384698] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T20:44:51.687787] [DEBUG] [REMOTE ] PXED: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T20:44:51.688266] [WARN ] [REMOTE ] PXED: No data returned for month 2025-01 [2025-10-22T20:44:51.688374] [FATAL] [REMOTE ] PXED: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T20:44:51.688426] [FATAL] [MAIN ] PXED: Failed to fetch primary data. [2025-10-22T20:44:51.688464] [WARN ] [MAIN ] PXED: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T20:44:51.688533] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-22T20:44:51.688606] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-22T20:44:51.688669] [INFO ] [LOCAL ] PXED: Starting deletion of derivative data. [2025-10-22T20:44:51.688738] [DEBUG] [LOCAL ] PXED: No derivative data file found to delete. [2025-10-22T20:44:51.688792] [INFO ] [MAIN ] Update Progress: 1748/2367 symbols completed. PXED took 1.2s. Estimated remaining: 1h 19m 36s. Rate: 7.8 symbols/min [2025-10-22T20:44:51.865086] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:44:51.865254] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-22T20:44:51.865290] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-22T20:44:51.865402] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-22T20:44:51.865442] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-22T20:44:51.865481] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-22T20:44:51.865511] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-22T20:44:52.126344] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-22T20:44:52.271663] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:44:52.363691] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T20:44:52.917777] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-22T20:44:53.717676] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-10-22T20:44:54.202039] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-22T20:44:54.421123] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T20:44:54.517676] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-22T20:44:55.317771] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-22T20:44:55.678765] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-22T20:44:56.048864] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-22T20:44:56.117667] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-22T20:44:56.917751] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-10-22T20:44:57.717635] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-22T20:44:57.772459] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-22T20:44:58.112109] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-10-22T20:44:58.517723] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-22T20:44:58.827250] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-22T20:44:59.317732] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-22T20:44:59.647133] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-22T20:45:00.117705] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-10. [2025-10-22T20:45:00.926871] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-22T20:45:00.929039] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T20:45:01.398534] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.88 seconds). [2025-10-22T20:45:01.606184] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T20:45:01.615277] [INFO ] [REMOTE ] PVH: Full fetch complete (70905 records). [2025-10-22T20:45:01.615488] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-10-22T20:45:01.725559] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-22T20:45:02.042506] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-10-22T20:45:02.042607] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-10-22T20:45:02.043718] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-10-22T20:45:02.043790] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-10-22T20:45:02.045438] [DEBUG] [LOCAL ] PVH: Trimmed 70905 records to 49508 (keeping 200 days of data) [2025-10-22T20:45:02.352604] [DEBUG] [LOCAL ] PVH: Primary data saved (49508 records). [2025-10-22T20:45:02.352777] [INFO ] [MAIN ] PVH: Full history saved. [2025-10-22T20:45:02.353499] [INFO ] [MAIN ] Update Progress: 1749/2367 symbols completed. PVH took 34.6s. Estimated remaining: 1h 19m 29s. Rate: 7.8 symbols/min [2025-10-22T20:45:02.522780] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:45:02.522852] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-22T20:45:02.553233] [DEBUG] [LOCAL ] QD: Loaded 27677 existing records from primary storage. [2025-10-22T20:45:02.553501] [INFO ] [MAIN ] QD: Loaded 27677 existing records. [2025-10-22T20:45:02.739840] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:45:02.740104] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-22T20:45:02.740174] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-22T20:45:02.740456] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-10-22T20:45:02.740678] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-22T20:45:03.141131] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:45:03.136003] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-22T20:45:03.317614] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-22T20:45:03.498145] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T20:45:04.117722] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-22T20:45:04.917770] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-22T20:45:05.547809] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T20:45:05.602882] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (3.08 seconds). [2025-10-22T20:45:05.660510] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-22T20:45:05.717700] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-22T20:45:06.398101] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T20:45:06.517736] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-22T20:45:07.317721] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-22T20:45:07.689931] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T20:45:07.988042] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-22T20:45:08.117733] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-22T20:45:08.917750] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-22T20:45:09.344124] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T20:45:09.717783] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-22T20:45:10.213125] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.90 seconds). [2025-10-22T20:45:10.517716] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-22T20:45:10.899770] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T20:45:11.268907] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T20:45:11.317630] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-10. [2025-10-22T20:45:12.036209] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T20:45:12.117673] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-22T20:45:12.552903] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T20:45:12.557712] [INFO ] [REMOTE ] PX: Full fetch complete (49836 records). [2025-10-22T20:45:12.557802] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-10-22T20:45:12.919099] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-22T20:45:12.935977] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-10-22T20:45:12.936043] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-10-22T20:45:12.937085] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-10-22T20:45:12.937261] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-10-22T20:45:12.938470] [DEBUG] [LOCAL ] PX: Trimmed 49836 records to 33950 (keeping 200 days of data) [2025-10-22T20:45:13.140264] [DEBUG] [LOCAL ] PX: Primary data saved (33950 records). [2025-10-22T20:45:13.140403] [INFO ] [MAIN ] PX: Full history saved. [2025-10-22T20:45:13.140481] [INFO ] [MAIN ] Update Progress: 1750/2367 symbols completed. PX took 23.9s. Estimated remaining: 1h 19m 23s. Rate: 7.8 symbols/min [2025-10-22T20:45:13.310427] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:45:13.352923] [DEBUG] [LOCAL ] QGEN: Loaded 49069 existing records from primary storage. [2025-10-22T20:45:13.353238] [INFO ] [MAIN ] QGEN: Loaded 49069 existing records. [2025-10-22T20:45:13.531011] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:45:13.531210] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-22T20:45:13.531260] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-22T20:45:13.531703] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-10-22T20:45:13.531758] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-22T20:45:13.746083] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-22T20:45:13.811081] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T20:45:13.928633] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:45:14.517727] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-22T20:45:15.317709] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-22T20:45:15.816678] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T20:45:15.824202] [INFO ] [REMOTE ] PWR: Full fetch complete (69143 records). [2025-10-22T20:45:15.824349] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-22T20:45:16.225180] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-10-22T20:45:16.225621] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-10-22T20:45:16.226771] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-10-22T20:45:16.226855] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-10-22T20:45:16.228430] [DEBUG] [LOCAL ] PWR: Trimmed 69143 records to 46492 (keeping 200 days of data) [2025-10-22T20:45:16.359580] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (3.44 seconds). [2025-10-22T20:45:16.394815] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-22T20:45:16.421249] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-22T20:45:16.594138] [DEBUG] [LOCAL ] PWR: Primary data saved (46492 records). [2025-10-22T20:45:16.594267] [INFO ] [MAIN ] PWR: Full history saved. [2025-10-22T20:45:16.594344] [INFO ] [MAIN ] Update Progress: 1751/2367 symbols completed. PWR took 41.4s. Estimated remaining: 1h 19m 13s. Rate: 7.8 symbols/min [2025-10-22T20:45:16.721344] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T20:45:16.790517] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:45:16.839008] [DEBUG] [LOCAL ] QS: Loaded 53760 existing records from primary storage. [2025-10-22T20:45:16.839304] [INFO ] [MAIN ] QS: Loaded 53760 existing records. [2025-10-22T20:45:16.927132] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-22T20:45:17.014245] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:45:17.014450] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-22T20:45:17.014496] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-22T20:45:17.014723] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-10-22T20:45:17.014780] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-22T20:45:17.371867] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:45:17.717698] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-22T20:45:18.196748] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T20:45:18.517673] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-22T20:45:18.918332] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-22T20:45:19.317760] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-22T20:45:19.921192] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T20:45:20.117637] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-22T20:45:20.328463] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-22T20:45:20.917677] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-22T20:45:21.717621] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-22T20:45:21.847920] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T20:45:22.239949] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-22T20:45:22.517774] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-22T20:45:23.261993] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-22T20:45:23.273495] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T20:45:23.317634] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-22T20:45:24.117764] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-22T20:45:24.917638] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-22T20:45:25.455130] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.94 seconds). [2025-10-22T20:45:25.680986] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-22T20:45:25.717619] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-22T20:45:26.006466] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T20:45:26.265305] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-22T20:45:26.517705] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-22T20:45:27.317762] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-22T20:45:27.876389] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-22T20:45:28.117713] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-22T20:45:28.472959] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T20:45:28.582138] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T20:45:28.586741] [INFO ] [REMOTE ] QD: Full fetch complete (40007 records). [2025-10-22T20:45:28.586824] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-22T20:45:28.941581] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-22T20:45:28.957331] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-10-22T20:45:28.957411] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-10-22T20:45:28.958261] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-10-22T20:45:28.958461] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-10-22T20:45:28.959325] [DEBUG] [LOCAL ] QD: Trimmed 40007 records to 27517 (keeping 200 days of data) [2025-10-22T20:45:29.111909] [DEBUG] [LOCAL ] QD: Primary data saved (27517 records). [2025-10-22T20:45:29.112056] [INFO ] [MAIN ] QD: Full history saved. [2025-10-22T20:45:29.112152] [INFO ] [MAIN ] Update Progress: 1752/2367 symbols completed. QD took 26.8s. Estimated remaining: 1h 19m 7s. Rate: 7.8 symbols/min [2025-10-22T20:45:29.278215] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:45:29.326041] [DEBUG] [LOCAL ] QSR: Loaded 52480 existing records from primary storage. [2025-10-22T20:45:29.326338] [INFO ] [MAIN ] QSR: Loaded 52480 existing records. [2025-10-22T20:45:29.538484] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:45:29.538722] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-22T20:45:29.538781] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-22T20:45:29.538971] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-10-22T20:45:29.539009] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-22T20:45:29.745710] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-22T20:45:29.896743] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:45:30.517740] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-22T20:45:30.935747] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-22T20:45:30.976196] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-10-22T20:45:31.317706] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-22T20:45:31.910163] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-22T20:45:32.117758] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-22T20:45:32.518603] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T20:45:32.917753] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-22T20:45:33.190949] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-22T20:45:33.717899] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-22T20:45:34.097185] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-22T20:45:34.522808] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-22T20:45:34.541374] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-22T20:45:34.550016] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-10-22T20:45:34.550170] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-22T20:45:34.551143] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T20:45:34.551244] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:45:34.551289] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:45:34.551371] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-22T20:45:34.551461] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-22T20:45:34.551504] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-10-22T20:45:34.551545] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-10-22T20:45:34.551604] [INFO ] [MAIN ] Update Progress: 1753/2367 symbols completed. QBTS took 42.9s. Estimated remaining: 1h 18m 59s. Rate: 7.8 symbols/min [2025-10-22T20:45:34.734183] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:45:34.770427] [DEBUG] [LOCAL ] QTWO: Loaded 39479 existing records from primary storage. [2025-10-22T20:45:34.770760] [INFO ] [MAIN ] QTWO: Loaded 39479 existing records. [2025-10-22T20:45:34.952222] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:45:34.952529] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-22T20:45:34.952587] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-22T20:45:34.952911] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-10-22T20:45:34.952972] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-22T20:45:35.180309] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-22T20:45:35.327345] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-22T20:45:35.369076] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:45:36.117762] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-22T20:45:36.923282] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-22T20:45:36.941764] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-22T20:45:37.094029] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T20:45:37.717668] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-22T20:45:37.743688] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T20:45:38.517673] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-22T20:45:39.317759] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-22T20:45:39.713339] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T20:45:39.789179] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-10-22T20:45:40.106585] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T20:45:40.117622] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-22T20:45:40.891947] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T20:45:40.917637] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-22T20:45:41.717743] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-22T20:45:42.052536] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-22T20:45:42.517755] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-22T20:45:42.577281] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T20:45:43.317633] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-22T20:45:43.604377] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T20:45:44.117730] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-22T20:45:44.575967] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T20:45:44.917664] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-22T20:45:45.163264] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-22T20:45:45.717759] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-22T20:45:46.091924] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-22T20:45:46.496437] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T20:45:46.517781] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-22T20:45:47.317723] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-22T20:45:47.510551] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T20:45:47.518796] [INFO ] [REMOTE ] QGEN: Full fetch complete (70645 records). [2025-10-22T20:45:47.518945] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-22T20:45:47.919283] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-10-22T20:45:47.919408] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-10-22T20:45:47.920514] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-10-22T20:45:47.920668] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-10-22T20:45:47.922120] [DEBUG] [LOCAL ] QGEN: Trimmed 70645 records to 49044 (keeping 200 days of data) [2025-10-22T20:45:48.125729] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-10-22T20:45:48.156298] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T20:45:48.259606] [DEBUG] [LOCAL ] QGEN: Primary data saved (49044 records). [2025-10-22T20:45:48.259783] [INFO ] [MAIN ] QGEN: Full history saved. [2025-10-22T20:45:48.259869] [INFO ] [MAIN ] Update Progress: 1754/2367 symbols completed. QGEN took 35.1s. Estimated remaining: 1h 18m 53s. Rate: 7.8 symbols/min [2025-10-22T20:45:48.429903] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:45:48.452476] [DEBUG] [LOCAL ] QUAD: Loaded 23058 existing records from primary storage. [2025-10-22T20:45:48.452755] [INFO ] [MAIN ] QUAD: Loaded 23058 existing records. [2025-10-22T20:45:48.631732] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:45:48.631932] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-22T20:45:48.631978] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-22T20:45:48.632140] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-10-22T20:45:48.632177] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-22T20:45:48.919133] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-22T20:45:48.997739] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:45:49.270658] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T20:45:49.717765] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-22T20:45:50.517634] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-22T20:45:50.586387] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T20:45:51.060263] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.93 seconds). [2025-10-22T20:45:51.085951] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-22T20:45:51.317674] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-22T20:45:52.117630] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-22T20:45:52.434602] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T20:45:52.478059] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T20:45:52.917669] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-22T20:45:53.717618] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-22T20:45:53.778066] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T20:45:54.119599] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-22T20:45:54.517742] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-10. [2025-10-22T20:45:55.317636] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-22T20:45:55.589621] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-22T20:45:56.117784] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-22T20:45:56.917750] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-22T20:45:57.200070] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T20:45:57.391034] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-10 (2.87 seconds). [2025-10-22T20:45:57.400755] [INFO ] [REMOTE ] QS: Full fetch complete (77920 records). [2025-10-22T20:45:57.400891] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-10-22T20:45:57.521340] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T20:45:57.722782] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-22T20:45:57.819087] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-10-22T20:45:57.819166] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-10-22T20:45:57.820227] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-10-22T20:45:57.820291] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-10-22T20:45:57.821689] [DEBUG] [LOCAL ] QS: Trimmed 77920 records to 53760 (keeping 200 days of data) [2025-10-22T20:45:58.132593] [DEBUG] [LOCAL ] QS: Primary data saved (53760 records). [2025-10-22T20:45:58.132766] [INFO ] [MAIN ] QS: Full history saved. [2025-10-22T20:45:58.132866] [INFO ] [MAIN ] Update Progress: 1755/2367 symbols completed. QS took 41.5s. Estimated remaining: 1h 18m 46s. Rate: 7.8 symbols/min [2025-10-22T20:45:58.301900] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:45:58.310497] [DEBUG] [LOCAL ] QVCC: Loaded 8725 existing records from primary storage. [2025-10-22T20:45:58.310693] [INFO ] [MAIN ] QVCC: Loaded 8725 existing records. [2025-10-22T20:45:58.484987] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:45:58.485200] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-22T20:45:58.485245] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-22T20:45:58.485414] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-10-22T20:45:58.485468] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-22T20:45:58.527186] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-22T20:45:58.838184] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:45:58.860503] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T20:45:58.869148] [INFO ] [REMOTE ] QSR: Full fetch complete (76081 records). [2025-10-22T20:45:58.869269] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-22T20:45:59.251847] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-10-22T20:45:59.251927] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-10-22T20:45:59.254085] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-10-22T20:45:59.254295] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-10-22T20:45:59.255796] [DEBUG] [LOCAL ] QSR: Trimmed 76081 records to 52450 (keeping 200 days of data) [2025-10-22T20:45:59.346496] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-22T20:45:59.513477] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T20:45:59.525759] [INFO ] [REMOTE ] QTWO: Full fetch complete (58197 records). [2025-10-22T20:45:59.533083] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-22T20:45:59.787630] [DEBUG] [LOCAL ] QSR: Primary data saved (52450 records). [2025-10-22T20:45:59.791567] [INFO ] [MAIN ] QSR: Full history saved. [2025-10-22T20:45:59.792413] [INFO ] [MAIN ] Update Progress: 1756/2367 symbols completed. QSR took 30.7s. Estimated remaining: 1h 18m 37s. Rate: 7.8 symbols/min [2025-10-22T20:46:00.055165] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T20:46:00.146547] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-22T20:46:00.240006] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:46:00.245508] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-10-22T20:46:00.246300] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-10-22T20:46:00.247534] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-10-22T20:46:00.248976] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-10-22T20:46:00.248865] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-22T20:46:00.254861] [DEBUG] [LOCAL ] QTWO: Trimmed 58197 records to 39446 (keeping 200 days of data) [2025-10-22T20:46:00.258070] [DEBUG] [LOCAL ] QVCD: Loaded 4584 existing records from primary storage. [2025-10-22T20:46:00.258553] [INFO ] [MAIN ] QVCD: Loaded 4584 existing records. [2025-10-22T20:46:00.689090] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:46:00.694065] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-22T20:46:00.694152] [DEBUG] [LOCAL ] QTWO: Primary data saved (39446 records). [2025-10-22T20:46:00.694357] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-22T20:46:00.694490] [INFO ] [MAIN ] QTWO: Full history saved. [2025-10-22T20:46:00.694631] [INFO ] [MAIN ] Update Progress: 1757/2367 symbols completed. QTWO took 26.1s. Estimated remaining: 1h 18m 26s. Rate: 7.8 symbols/min [2025-10-22T20:46:00.694922] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-10-22T20:46:00.695004] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-22T20:46:00.927839] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-10-22T20:46:01.080291] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:46:01.505160] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T20:46:01.571017] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T20:46:01.717678] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-22T20:46:02.517672] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-22T20:46:02.925726] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T20:46:03.317637] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-22T20:46:03.330283] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-22T20:46:04.117703] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-22T20:46:04.778595] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-22T20:46:04.790603] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-22T20:46:04.917709] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-10-22T20:46:05.717771] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-10-22T20:46:06.132233] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T20:46:06.517672] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-10. [2025-10-22T20:46:06.707824] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-22T20:46:07.317619] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-10-22T20:46:07.673096] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-22T20:46:07.677136] [INFO ] [REMOTE ] QUAD: Full fetch complete (33950 records). [2025-10-22T20:46:07.677233] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-10-22T20:46:08.052524] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-10-22T20:46:08.052633] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-10-22T20:46:08.053404] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-10-22T20:46:08.053448] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-10-22T20:46:08.054220] [DEBUG] [LOCAL ] QUAD: Trimmed 33950 records to 22988 (keeping 200 days of data) [2025-10-22T20:46:08.135837] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-22T20:46:08.172232] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T20:46:08.197359] [DEBUG] [LOCAL ] QUAD: Primary data saved (22988 records). [2025-10-22T20:46:08.197496] [INFO ] [MAIN ] QUAD: Full history saved. [2025-10-22T20:46:08.197577] [INFO ] [MAIN ] Update Progress: 1758/2367 symbols completed. QUAD took 19.9s. Estimated remaining: 1h 18m 19s. Rate: 7.8 symbols/min [2025-10-22T20:46:08.704713] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-22T20:46:08.917669] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-22T20:46:09.717629] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-10-22T20:46:09.792093] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-22T20:46:10.517751] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-22T20:46:10.654314] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-22T20:46:11.317709] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-10-22T20:46:11.413414] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-22T20:46:12.117778] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-22T20:46:12.361428] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T20:46:12.885478] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-22T20:46:12.917708] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-22T20:46:13.587717] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-22T20:46:13.717745] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-22T20:46:14.517772] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-10-22T20:46:14.556514] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-22T20:46:15.317752] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-22T20:46:15.375674] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T20:46:16.019052] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T20:46:16.117771] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-10-22T20:46:16.917766] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-22T20:46:17.042462] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-22T20:46:17.412204] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-22T20:46:17.413632] [INFO ] [REMOTE ] QVCD: Full fetch complete (6198 records). [2025-10-22T20:46:17.413733] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-22T20:46:17.722750] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-10-22T20:46:17.802467] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-10-22T20:46:17.802554] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-10-22T20:46:17.802777] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-10-22T20:46:17.802840] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-10-22T20:46:17.803321] [DEBUG] [LOCAL ] QVCD: Trimmed 6198 records to 4565 (keeping 200 days of data) [2025-10-22T20:46:17.831582] [DEBUG] [LOCAL ] QVCD: Primary data saved (4565 records). [2025-10-22T20:46:17.831768] [INFO ] [MAIN ] QVCD: Full history saved. [2025-10-22T20:46:17.831872] [INFO ] [MAIN ] Update Progress: 1759/2367 symbols completed. QVCD took 18.0s. Estimated remaining: 1h 18m 12s. Rate: 7.8 symbols/min [2025-10-22T20:46:18.836884] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-22T20:46:18.839399] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-10. [2025-10-22T20:46:19.719638] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-22T20:46:19.722692] [INFO ] [REMOTE ] QVCC: Full fetch complete (11875 records). [2025-10-22T20:46:19.722875] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-10-22T20:46:20.235139] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-10-22T20:46:20.235223] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-10-22T20:46:20.235544] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-10-22T20:46:20.235586] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-10-22T20:46:20.236131] [DEBUG] [LOCAL ] QVCC: Trimmed 11875 records to 8694 (keeping 200 days of data) [2025-10-22T20:46:20.287175] [DEBUG] [LOCAL ] QVCC: Primary data saved (8694 records). [2025-10-22T20:46:20.287323] [INFO ] [MAIN ] QVCC: Full history saved. [2025-10-22T20:46:20.287449] [INFO ] [MAIN ] Update Progress: 1760/2367 symbols completed. QVCC took 22.2s. Estimated remaining: 1h 18m 2s. Rate: 7.8 symbols/min [2025-10-22T20:46:20.854225] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:46:21.005321] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:46:21.012176] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:46:21.031379] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:46:21.068576] [DEBUG] [LOCAL ] RA: Loaded 21936 existing records from primary storage. [2025-10-22T20:46:21.068874] [INFO ] [MAIN ] RA: Loaded 21936 existing records. [2025-10-22T20:46:21.138278] [DEBUG] [LOCAL ] RACE: Loaded 32941 existing records from primary storage. [2025-10-22T20:46:21.150335] [INFO ] [MAIN ] RACE: Loaded 32941 existing records. [2025-10-22T20:46:21.144792] [DEBUG] [LOCAL ] R: Loaded 27949 existing records from primary storage. [2025-10-22T20:46:21.266828] [INFO ] [MAIN ] R: Loaded 27949 existing records. [2025-10-22T20:46:21.405392] [DEBUG] [LOCAL ] QXO: Loaded 53470 existing records from primary storage. [2025-10-22T20:46:21.432041] [INFO ] [MAIN ] QXO: Loaded 53470 existing records. [2025-10-22T20:46:21.590834] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:46:21.696011] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-22T20:46:21.734891] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-22T20:46:21.706608] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:46:21.766212] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-10-22T20:46:21.789671] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-22T20:46:21.773688] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-22T20:46:21.799158] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:46:21.799439] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-22T20:46:21.828195] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-22T20:46:21.838594] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-10-22T20:46:21.858628] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-22T20:46:21.853478] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-22T20:46:21.917256] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-10-22T20:46:21.944220] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:46:21.944369] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-22T20:46:22.047942] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-22T20:46:22.079385] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-22T20:46:22.152636] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-10-22T20:46:22.184080] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-22T20:46:23.038900] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:46:23.110573] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-22T20:46:23.223547] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:46:23.296063] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:46:23.261741] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-22T20:46:23.318022] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-22T20:46:23.371715] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:46:23.372144] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-22T20:46:24.560195] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T20:46:24.564981] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-22T20:46:24.831319] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T20:46:24.838087] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-22T20:46:25.011863] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T20:46:25.018202] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-22T20:46:25.300203] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T20:46:25.309723] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-22T20:46:25.638347] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-22T20:46:25.717626] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-22T20:46:25.854918] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-22T20:46:26.517734] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-22T20:46:26.687399] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T20:46:26.839836] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T20:46:26.983425] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-22T20:46:27.317715] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-22T20:46:27.936832] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-22T20:46:28.117720] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-22T20:46:28.917706] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-22T20:46:29.257666] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T20:46:29.369949] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-22T20:46:29.717750] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-22T20:46:30.517670] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-22T20:46:30.601461] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T20:46:30.888168] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T20:46:31.317725] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-22T20:46:32.117677] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-22T20:46:32.380418] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T20:46:32.730206] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T20:46:32.917632] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-22T20:46:33.717676] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-22T20:46:33.837068] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T20:46:34.517712] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-22T20:46:34.608415] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T20:46:35.082152] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T20:46:35.317739] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-22T20:46:36.117677] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-22T20:46:36.383212] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T20:46:36.508682] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T20:46:36.917758] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-22T20:46:37.717631] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-22T20:46:38.141369] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-22T20:46:38.517711] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-22T20:46:38.545922] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T20:46:39.317716] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-22T20:46:39.403144] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T20:46:40.117746] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-22T20:46:40.649819] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T20:46:40.823609] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-22T20:46:40.917768] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-22T20:46:41.631513] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T20:46:41.717750] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-22T20:46:42.517706] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-22T20:46:42.971553] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T20:46:43.131606] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-22T20:46:43.317671] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-22T20:46:44.117756] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-22T20:46:44.226212] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T20:46:44.917722] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-22T20:46:45.495383] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-22T20:46:45.550921] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T20:46:45.717673] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-22T20:46:46.169891] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T20:46:46.174683] [INFO ] [REMOTE ] R: Full fetch complete (42350 records). [2025-10-22T20:46:46.174824] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-22T20:46:46.523299] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-22T20:46:46.592082] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-10-22T20:46:46.592165] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-10-22T20:46:46.592989] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-10-22T20:46:46.593053] [DEBUG] [LOCAL ] R: Saving primary data. [2025-10-22T20:46:46.594092] [DEBUG] [LOCAL ] R: Trimmed 42350 records to 27881 (keeping 200 days of data) [2025-10-22T20:46:46.764313] [DEBUG] [LOCAL ] R: Primary data saved (27881 records). [2025-10-22T20:46:46.764453] [INFO ] [MAIN ] R: Full history saved. [2025-10-22T20:46:46.764535] [INFO ] [MAIN ] Update Progress: 1761/2367 symbols completed. R took 26.5s. Estimated remaining: 1h 18m 1s. Rate: 7.8 symbols/min [2025-10-22T20:46:46.935673] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:46:46.970697] [DEBUG] [LOCAL ] RAMP: Loaded 37686 existing records from primary storage. [2025-10-22T20:46:46.971021] [INFO ] [MAIN ] RAMP: Loaded 37686 existing records. [2025-10-22T20:46:47.154404] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:46:47.154821] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-22T20:46:47.154937] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-22T20:46:47.155162] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-10-22T20:46:47.155217] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-22T20:46:47.355670] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-22T20:46:47.580107] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:46:47.582482] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T20:46:48.117716] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-22T20:46:48.686313] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T20:46:48.919096] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-22T20:46:48.923664] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-22T20:46:48.933732] [INFO ] [REMOTE ] QXO: Full fetch complete (76273 records). [2025-10-22T20:46:48.933907] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-22T20:46:49.328107] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-10-22T20:46:49.328193] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-10-22T20:46:49.329512] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-10-22T20:46:49.329576] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-10-22T20:46:49.331102] [DEBUG] [LOCAL ] QXO: Trimmed 76273 records to 53475 (keeping 200 days of data) [2025-10-22T20:46:49.647227] [DEBUG] [LOCAL ] QXO: Primary data saved (53475 records). [2025-10-22T20:46:49.647360] [INFO ] [MAIN ] QXO: Full history saved. [2025-10-22T20:46:49.647438] [INFO ] [MAIN ] Update Progress: 1762/2367 symbols completed. QXO took 29.4s. Estimated remaining: 1h 17m 51s. Rate: 7.8 symbols/min [2025-10-22T20:46:49.721591] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-22T20:46:49.819569] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:46:49.838380] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T20:46:49.885637] [DEBUG] [LOCAL ] RBA: Loaded 46100 existing records from primary storage. [2025-10-22T20:46:49.885976] [INFO ] [MAIN ] RBA: Loaded 46100 existing records. [2025-10-22T20:46:50.068312] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:46:50.068753] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-22T20:46:50.068813] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-22T20:46:50.069003] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-10-22T20:46:50.069042] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-22T20:46:50.223115] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T20:46:50.440863] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:46:50.517703] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-22T20:46:51.257296] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T20:46:51.317599] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-22T20:46:51.701508] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T20:46:51.705706] [INFO ] [REMOTE ] RA: Full fetch complete (31908 records). [2025-10-22T20:46:51.705783] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-22T20:46:52.063852] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-10-22T20:46:52.063925] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-10-22T20:46:52.064526] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-10-22T20:46:52.064565] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-10-22T20:46:52.065328] [DEBUG] [LOCAL ] RA: Trimmed 31908 records to 21871 (keeping 200 days of data) [2025-10-22T20:46:52.124382] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-22T20:46:52.195764] [DEBUG] [LOCAL ] RA: Primary data saved (21871 records). [2025-10-22T20:46:52.195883] [INFO ] [MAIN ] RA: Full history saved. [2025-10-22T20:46:52.195955] [INFO ] [MAIN ] Update Progress: 1763/2367 symbols completed. RA took 31.9s. Estimated remaining: 1h 17m 42s. Rate: 7.8 symbols/min [2025-10-22T20:46:52.359204] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:46:52.375159] [DEBUG] [LOCAL ] RBC: Loaded 15293 existing records from primary storage. [2025-10-22T20:46:52.375377] [INFO ] [MAIN ] RBC: Loaded 15293 existing records. [2025-10-22T20:46:52.545789] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:46:52.545974] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-22T20:46:52.546019] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-22T20:46:52.546205] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-10-22T20:46:52.546259] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-22T20:46:52.892229] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:46:52.917607] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-22T20:46:53.050909] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T20:46:53.717628] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-22T20:46:53.956993] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-22T20:46:54.307084] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-22T20:46:54.314279] [INFO ] [REMOTE ] RACE: Full fetch complete (49499 records). [2025-10-22T20:46:54.314381] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-22T20:46:54.522758] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-22T20:46:54.696782] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-10-22T20:46:54.696884] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-10-22T20:46:54.697797] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-10-22T20:46:54.697858] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-10-22T20:46:54.698792] [DEBUG] [LOCAL ] RACE: Trimmed 49499 records to 32943 (keeping 200 days of data) [2025-10-22T20:46:54.892573] [DEBUG] [LOCAL ] RACE: Primary data saved (32943 records). [2025-10-22T20:46:54.892724] [INFO ] [MAIN ] RACE: Full history saved. [2025-10-22T20:46:54.892812] [INFO ] [MAIN ] Update Progress: 1764/2367 symbols completed. RACE took 34.6s. Estimated remaining: 1h 17m 32s. Rate: 7.8 symbols/min [2025-10-22T20:46:55.060153] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:46:55.107614] [DEBUG] [LOCAL ] RBLX: Loaded 53718 existing records from primary storage. [2025-10-22T20:46:55.107976] [INFO ] [MAIN ] RBLX: Loaded 53718 existing records. [2025-10-22T20:46:55.284792] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:46:55.285074] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-22T20:46:55.285206] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-22T20:46:55.285559] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-10-22T20:46:55.285683] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-22T20:46:55.327570] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-22T20:46:55.488793] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T20:46:55.676204] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:46:55.684928] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T20:46:56.117739] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-22T20:46:56.917735] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-22T20:46:57.119336] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T20:46:57.253435] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-22T20:46:57.717704] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-10-22T20:46:58.517731] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-22T20:46:59.283738] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-22T20:46:59.317708] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-22T20:46:59.371748] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T20:46:59.693531] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T20:47:00.117667] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-22T20:47:00.917711] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-10-22T20:47:01.717676] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-22T20:47:01.938192] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-10-22T20:47:01.970521] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T20:47:02.517758] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-22T20:47:02.839830] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T20:47:03.145144] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-22T20:47:03.317620] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-10-22T20:47:04.117673] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-22T20:47:04.779314] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-22T20:47:04.845818] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T20:47:04.917625] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-10-22T20:47:05.690355] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T20:47:05.717620] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-22T20:47:06.517750] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-22T20:47:06.781863] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T20:47:06.996315] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-22T20:47:07.317627] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-22T20:47:07.665981] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T20:47:08.117743] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-22T20:47:08.917619] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-22T20:47:09.024178] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T20:47:09.717614] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-22T20:47:10.108092] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T20:47:10.423534] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-22T20:47:10.517629] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-22T20:47:11.317633] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-10-22T20:47:11.352192] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T20:47:12.117713] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-22T20:47:12.847900] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-22T20:47:12.917675] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-22T20:47:12.975482] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T20:47:13.722846] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-22T20:47:13.735032] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-22T20:47:13.742254] [INFO ] [REMOTE ] RAMP: Full fetch complete (54844 records). [2025-10-22T20:47:13.742343] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-22T20:47:14.135340] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T20:47:14.135589] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-10-22T20:47:14.139068] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-10-22T20:47:14.140133] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-10-22T20:47:14.140215] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-10-22T20:47:14.141535] [DEBUG] [LOCAL ] RAMP: Trimmed 54844 records to 37664 (keeping 200 days of data) [2025-10-22T20:47:14.354174] [DEBUG] [LOCAL ] RAMP: Primary data saved (37664 records). [2025-10-22T20:47:14.354299] [INFO ] [MAIN ] RAMP: Full history saved. [2025-10-22T20:47:14.354375] [INFO ] [MAIN ] Update Progress: 1765/2367 symbols completed. RAMP took 27.6s. Estimated remaining: 1h 17m 29s. Rate: 7.8 symbols/min [2025-10-22T20:47:14.521892] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-10-22T20:47:14.521824] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:47:14.529846] [DEBUG] [LOCAL ] RBOT: Loaded 6199 existing records from primary storage. [2025-10-22T20:47:14.530044] [INFO ] [MAIN ] RBOT: Loaded 6199 existing records. [2025-10-22T20:47:14.705944] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:47:14.706182] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-22T20:47:14.706239] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-22T20:47:14.706445] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-10-22T20:47:14.706500] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-22T20:47:15.055449] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:47:15.317701] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-22T20:47:16.117694] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-22T20:47:16.226516] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-22T20:47:16.265857] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-22T20:47:16.300027] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T20:47:16.917740] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-10-22T20:47:17.062561] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T20:47:17.717718] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-22T20:47:18.517777] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-22T20:47:18.731926] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T20:47:18.765830] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T20:47:19.317701] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-22T20:47:19.653009] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T20:47:20.117793] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-22T20:47:20.128317] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T20:47:20.917767] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-22T20:47:21.404062] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-22T20:47:21.717634] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-22T20:47:22.517719] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-22T20:47:22.671159] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-22T20:47:22.971423] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T20:47:22.974751] [INFO ] [REMOTE ] RBC: Full fetch complete (21872 records). [2025-10-22T20:47:22.974823] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-22T20:47:23.088404] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-22T20:47:23.319539] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-22T20:47:23.348514] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-10-22T20:47:23.348591] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-10-22T20:47:23.349049] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-10-22T20:47:23.349112] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-10-22T20:47:23.349705] [DEBUG] [LOCAL ] RBC: Trimmed 21872 records to 15288 (keeping 200 days of data) [2025-10-22T20:47:23.443724] [DEBUG] [LOCAL ] RBC: Primary data saved (15288 records). [2025-10-22T20:47:23.443886] [INFO ] [MAIN ] RBC: Full history saved. [2025-10-22T20:47:23.444003] [INFO ] [MAIN ] Update Progress: 1766/2367 symbols completed. RBC took 31.2s. Estimated remaining: 1h 17m 22s. Rate: 7.8 symbols/min [2025-10-22T20:47:23.606634] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:47:23.653997] [DEBUG] [LOCAL ] RBRK: Loaded 53163 existing records from primary storage. [2025-10-22T20:47:23.654334] [INFO ] [MAIN ] RBRK: Loaded 53163 existing records. [2025-10-22T20:47:23.825966] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:47:23.826183] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-22T20:47:23.826230] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-22T20:47:23.826698] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-10-22T20:47:23.826776] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-22T20:47:24.102887] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T20:47:24.119143] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-22T20:47:24.214719] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:47:24.917719] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-10-22T20:47:25.717752] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-22T20:47:26.517638] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-22T20:47:26.652842] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-22T20:47:26.717637] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T20:47:26.885100] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-10-22T20:47:27.317700] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-10. [2025-10-22T20:47:28.117757] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-22T20:47:28.422183] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-22T20:47:28.917722] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-22T20:47:29.065945] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T20:47:29.073948] [INFO ] [REMOTE ] RBA: Full fetch complete (66616 records). [2025-10-22T20:47:29.074089] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-10-22T20:47:29.455557] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-10-22T20:47:29.455634] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-10-22T20:47:29.456685] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-10-22T20:47:29.456745] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-10-22T20:47:29.458040] [DEBUG] [LOCAL ] RBA: Trimmed 66616 records to 46060 (keeping 200 days of data) [2025-10-22T20:47:29.723567] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-22T20:47:29.742694] [DEBUG] [LOCAL ] RBA: Primary data saved (46060 records). [2025-10-22T20:47:29.742798] [INFO ] [MAIN ] RBA: Full history saved. [2025-10-22T20:47:29.743237] [INFO ] [MAIN ] Update Progress: 1767/2367 symbols completed. RBA took 40.1s. Estimated remaining: 1h 17m 13s. Rate: 7.8 symbols/min [2025-10-22T20:47:29.906756] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:47:29.946561] [DEBUG] [LOCAL ] RC: Loaded 48888 existing records from primary storage. [2025-10-22T20:47:29.946882] [INFO ] [MAIN ] RC: Loaded 48888 existing records. [2025-10-22T20:47:30.118775] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:47:30.118953] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-22T20:47:30.118998] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-22T20:47:30.119261] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-10-22T20:47:30.119297] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-22T20:47:30.472744] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:47:30.517613] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-22T20:47:30.589993] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T20:47:30.762231] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-22T20:47:30.820920] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-22T20:47:31.317721] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-22T20:47:32.117724] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-22T20:47:32.319034] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T20:47:32.917670] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-22T20:47:32.964361] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-22T20:47:33.414690] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-22T20:47:33.717713] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-22T20:47:34.517750] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-22T20:47:34.662062] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T20:47:35.317704] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-22T20:47:35.551075] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T20:47:35.553804] [INFO ] [REMOTE ] RBOT: Full fetch complete (9275 records). [2025-10-22T20:47:35.553874] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-22T20:47:35.901734] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-10-22T20:47:35.901831] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-10-22T20:47:35.902053] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-10-22T20:47:35.902207] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-10-22T20:47:35.902904] [DEBUG] [LOCAL ] RBOT: Trimmed 9275 records to 6236 (keeping 200 days of data) [2025-10-22T20:47:35.938459] [DEBUG] [LOCAL ] RBOT: Primary data saved (6236 records). [2025-10-22T20:47:35.938590] [INFO ] [MAIN ] RBOT: Full history saved. [2025-10-22T20:47:35.938693] [INFO ] [MAIN ] Update Progress: 1768/2367 symbols completed. RBOT took 21.6s. Estimated remaining: 1h 17m 5s. Rate: 7.8 symbols/min [2025-10-22T20:47:36.118002] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-22T20:47:36.110030] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-22T20:47:36.144063] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:47:36.144411] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-22T20:47:36.144470] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-22T20:47:36.144727] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-22T20:47:36.144637] [INFO ] [REMOTE ] RBLX: Full fetch complete (77887 records). [2025-10-22T20:47:36.144837] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-22T20:47:36.144911] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-22T20:47:36.145000] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-22T20:47:36.145148] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-22T20:47:36.815287] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:47:36.907554] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-10-22T20:47:36.907717] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-10-22T20:47:36.908971] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-10-22T20:47:36.909052] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-10-22T20:47:36.925716] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-22T20:47:36.910717] [DEBUG] [LOCAL ] RBLX: Trimmed 77887 records to 53718 (keeping 200 days of data) [2025-10-22T20:47:36.942180] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T20:47:37.266989] [DEBUG] [LOCAL ] RBLX: Primary data saved (53718 records). [2025-10-22T20:47:37.267122] [INFO ] [MAIN ] RBLX: Full history saved. [2025-10-22T20:47:37.267200] [INFO ] [MAIN ] Update Progress: 1769/2367 symbols completed. RBLX took 42.4s. Estimated remaining: 1h 16m 55s. Rate: 7.8 symbols/min [2025-10-22T20:47:37.430225] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:47:37.440704] [DEBUG] [LOCAL ] RCD: Loaded 3345 existing records from primary storage. [2025-10-22T20:47:37.440867] [INFO ] [MAIN ] RCD: Loaded 3345 existing records. [2025-10-22T20:47:37.595949] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-22T20:47:37.625610] [WARN ] [MAIN ] RCD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:47:37.625804] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-22T20:47:37.625870] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-22T20:47:37.626040] [DEBUG] [LOCAL ] RCD: Deleted primary data file. [2025-10-22T20:47:37.626114] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-22T20:47:37.722926] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-22T20:47:38.019594] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:47:38.051119] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T20:47:38.447928] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T20:47:38.517669] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-22T20:47:39.317638] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-22T20:47:40.037547] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-22T20:47:40.117609] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-22T20:47:40.453191] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-22T20:47:40.797295] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-22T20:47:40.917706] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-22T20:47:41.637075] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T20:47:41.717623] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-22T20:47:42.275717] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-22T20:47:42.517717] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-22T20:47:43.317711] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-10-22T20:47:44.084748] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T20:47:44.117623] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-22T20:47:44.687514] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-22T20:47:44.917610] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-22T20:47:45.688285] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T20:47:45.717614] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-22T20:47:46.517744] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-22T20:47:46.942794] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-22T20:47:47.067268] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-22T20:47:47.317695] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-10-22T20:47:47.451804] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T20:47:47.925886] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T20:47:48.117629] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-22T20:47:48.506840] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-22T20:47:48.917636] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-22T20:47:49.717699] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-22T20:47:50.226022] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-22T20:47:50.517702] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-10-22T20:47:51.321427] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-22T20:47:51.327536] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-22T20:47:51.361876] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-22T20:47:51.787208] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-22T20:47:51.788089] [INFO ] [REMOTE ] RCB: Full fetch complete (3710 records). [2025-10-22T20:47:51.788159] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-22T20:47:51.980829] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-22T20:47:51.981033] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:47:51.981102] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:47:51.981172] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-22T20:47:51.981239] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-22T20:47:51.981276] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-22T20:47:51.981323] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-22T20:47:51.981377] [INFO ] [MAIN ] Update Progress: 1770/2367 symbols completed. RCB took 16.0s. Estimated remaining: 1h 16m 50s. Rate: 7.8 symbols/min [2025-10-22T20:47:52.128821] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-22T20:47:52.165563] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:47:52.210727] [DEBUG] [LOCAL ] RCI: Loaded 48595 existing records from primary storage. [2025-10-22T20:47:52.211040] [INFO ] [MAIN ] RCI: Loaded 48595 existing records. [2025-10-22T20:47:52.396773] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:47:52.396983] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-22T20:47:52.397031] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-22T20:47:52.397613] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-10-22T20:47:52.397711] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-22T20:47:52.747548] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:47:52.917710] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-22T20:47:53.717703] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-22T20:47:54.389447] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-22T20:47:54.517713] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-22T20:47:54.879137] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T20:47:55.317743] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-22T20:47:55.487804] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T20:47:56.117674] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-22T20:47:56.796414] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-22T20:47:56.917635] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-22T20:47:57.079748] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T20:47:57.717706] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-10-22T20:47:57.757078] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T20:47:58.195355] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-22T20:47:58.517697] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-22T20:47:59.051111] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-22T20:47:59.060484] [INFO ] [REMOTE ] RBRK: Full fetch complete (76707 records). [2025-10-22T20:47:59.060683] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-22T20:47:59.325458] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-10-22T20:47:59.482665] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-10-22T20:47:59.482762] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-10-22T20:47:59.483842] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-10-22T20:47:59.483908] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-10-22T20:47:59.485346] [DEBUG] [LOCAL ] RBRK: Trimmed 76707 records to 53165 (keeping 200 days of data) [2025-10-22T20:47:59.803270] [DEBUG] [LOCAL ] RBRK: Primary data saved (53165 records). [2025-10-22T20:47:59.803452] [INFO ] [MAIN ] RBRK: Full history saved. [2025-10-22T20:47:59.804195] [INFO ] [MAIN ] Update Progress: 1771/2367 symbols completed. RBRK took 36.4s. Estimated remaining: 1h 16m 42s. Rate: 7.8 symbols/min [2025-10-22T20:47:59.974499] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:47:59.974676] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-22T20:47:59.974732] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-22T20:47:59.974849] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-22T20:47:59.974890] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-22T20:47:59.974933] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-22T20:47:59.974965] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-22T20:48:00.092830] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-22T20:48:00.118534] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-22T20:48:00.347965] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:48:00.378920] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T20:48:00.917705] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-22T20:48:01.717724] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-10-22T20:48:02.204939] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-22T20:48:02.501729] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T20:48:02.517608] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-10-22T20:48:02.882559] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T20:48:03.317627] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-22T20:48:03.360662] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-22T20:48:04.117740] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-22T20:48:04.917763] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-22T20:48:05.152825] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T20:48:05.717780] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-22T20:48:06.303591] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-22T20:48:06.517626] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-10-22T20:48:06.851048] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T20:48:06.859378] [INFO ] [REMOTE ] RC: Full fetch complete (71095 records). [2025-10-22T20:48:06.859489] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-22T20:48:07.251963] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-22T20:48:07.253624] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-10-22T20:48:07.254540] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-10-22T20:48:07.255598] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-10-22T20:48:07.255803] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-10-22T20:48:07.257296] [DEBUG] [LOCAL ] RC: Trimmed 71095 records to 48871 (keeping 200 days of data) [2025-10-22T20:48:07.328345] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-22T20:48:07.373040] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T20:48:07.574933] [DEBUG] [LOCAL ] RC: Primary data saved (48871 records). [2025-10-22T20:48:07.575057] [INFO ] [MAIN ] RC: Full history saved. [2025-10-22T20:48:07.575133] [INFO ] [MAIN ] Update Progress: 1772/2367 symbols completed. RC took 37.8s. Estimated remaining: 1h 16m 34s. Rate: 7.8 symbols/min [2025-10-22T20:48:07.742237] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:48:07.754042] [DEBUG] [LOCAL ] RCS: Loaded 12511 existing records from primary storage. [2025-10-22T20:48:07.754244] [INFO ] [MAIN ] RCS: Loaded 12511 existing records. [2025-10-22T20:48:07.930477] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:48:07.930710] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-22T20:48:07.930765] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-22T20:48:07.930956] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-10-22T20:48:07.931020] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-22T20:48:08.124470] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-22T20:48:08.285053] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:48:08.917765] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-22T20:48:09.279402] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-22T20:48:09.717628] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-10-22T20:48:10.142520] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T20:48:10.168933] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-22T20:48:10.225959] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T20:48:10.517665] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-22T20:48:11.317612] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-22T20:48:11.581877] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T20:48:12.117732] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-22T20:48:12.917732] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-10. [2025-10-22T20:48:13.035129] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-22T20:48:13.260394] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T20:48:13.447954] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-22T20:48:13.448811] [INFO ] [REMOTE ] RCD: Full fetch complete (5845 records). [2025-10-22T20:48:13.448878] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-10-22T20:48:13.722695] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-22T20:48:13.803553] [DEBUG] [VALIDATOR ] RCD: All expected trading days are present. [2025-10-22T20:48:13.803624] [DEBUG] [VALIDATOR ] RCD: Primary data validation passed. [2025-10-22T20:48:13.803831] [INFO ] [MAIN ] RCD: Fetched primary data is valid. [2025-10-22T20:48:13.803881] [DEBUG] [LOCAL ] RCD: Saving primary data. [2025-10-22T20:48:13.804253] [DEBUG] [LOCAL ] RCD: Trimmed 5845 records to 3332 (keeping 200 days of data) [2025-10-22T20:48:13.823777] [DEBUG] [LOCAL ] RCD: Primary data saved (3332 records). [2025-10-22T20:48:13.823837] [INFO ] [MAIN ] RCD: Full history saved. [2025-10-22T20:48:13.823903] [INFO ] [MAIN ] Update Progress: 1773/2367 symbols completed. RCD took 36.6s. Estimated remaining: 1h 16m 26s. Rate: 7.8 symbols/min [2025-10-22T20:48:13.990286] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:48:14.025257] [DEBUG] [LOCAL ] RCUS: Loaded 42978 existing records from primary storage. [2025-10-22T20:48:14.025527] [INFO ] [MAIN ] RCUS: Loaded 42978 existing records. [2025-10-22T20:48:14.198969] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:48:14.199190] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-22T20:48:14.199240] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-22T20:48:14.199559] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-10-22T20:48:14.199596] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-22T20:48:14.522819] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-22T20:48:14.567347] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:48:15.317671] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-22T20:48:15.550168] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T20:48:16.117626] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-22T20:48:16.475191] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-22T20:48:16.657879] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-22T20:48:16.917630] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-22T20:48:17.645154] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T20:48:17.717632] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-22T20:48:17.934312] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-22T20:48:18.517637] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-22T20:48:19.323196] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-22T20:48:19.337018] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-22T20:48:19.346326] [INFO ] [REMOTE ] RCI: Full fetch complete (70688 records). [2025-10-22T20:48:19.346504] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-22T20:48:19.709464] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T20:48:19.952041] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-10-22T20:48:19.952143] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-10-22T20:48:19.953225] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-10-22T20:48:19.953293] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-10-22T20:48:19.954818] [DEBUG] [LOCAL ] RCI: Trimmed 70688 records to 48578 (keeping 200 days of data) [2025-10-22T20:48:20.156753] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-22T20:48:20.293200] [DEBUG] [LOCAL ] RCI: Primary data saved (48578 records). [2025-10-22T20:48:20.293352] [INFO ] [MAIN ] RCI: Full history saved. [2025-10-22T20:48:20.293436] [INFO ] [MAIN ] Update Progress: 1774/2367 symbols completed. RCI took 28.3s. Estimated remaining: 1h 16m 18s. Rate: 7.8 symbols/min [2025-10-22T20:48:20.475369] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:48:20.523192] [DEBUG] [LOCAL ] RDDT: Loaded 53772 existing records from primary storage. [2025-10-22T20:48:20.523490] [INFO ] [MAIN ] RDDT: Loaded 53772 existing records. [2025-10-22T20:48:20.697624] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:48:20.697915] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-22T20:48:20.697971] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-22T20:48:20.698605] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-10-22T20:48:20.698698] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-22T20:48:20.932221] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-22T20:48:21.048008] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:48:21.539140] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-22T20:48:21.717636] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-22T20:48:21.781294] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T20:48:21.981106] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-22T20:48:22.517742] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-22T20:48:23.317768] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-22T20:48:23.883153] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-22T20:48:24.117729] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-22T20:48:24.279099] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T20:48:24.917746] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-22T20:48:25.091304] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T20:48:25.717704] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-22T20:48:25.830104] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-22T20:48:26.517734] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-10-22T20:48:26.650597] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T20:48:27.318025] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-22T20:48:27.791761] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-22T20:48:28.117619] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-22T20:48:28.889799] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T20:48:28.917632] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-10-22T20:48:29.100382] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-22T20:48:29.717639] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-10-22T20:48:30.215451] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-22T20:48:30.270327] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T20:48:30.517747] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-10-22T20:48:31.317711] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-22T20:48:32.117707] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-22T20:48:32.216385] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T20:48:32.308708] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T20:48:32.344870] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-10-22T20:48:32.917766] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-22T20:48:33.717665] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-10-22T20:48:34.114217] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T20:48:34.117689] [INFO ] [REMOTE ] RCS: Full fetch complete (19041 records). [2025-10-22T20:48:34.117766] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-22T20:48:34.436477] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-22T20:48:34.527506] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-10-22T20:48:34.526903] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-10-22T20:48:34.528382] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-10-22T20:48:34.528824] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-10-22T20:48:34.528884] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-10-22T20:48:34.529589] [DEBUG] [LOCAL ] RCS: Trimmed 19041 records to 12437 (keeping 200 days of data) [2025-10-22T20:48:34.619472] [DEBUG] [LOCAL ] RCS: Primary data saved (12437 records). [2025-10-22T20:48:34.619633] [INFO ] [MAIN ] RCS: Full history saved. [2025-10-22T20:48:34.619783] [INFO ] [MAIN ] Update Progress: 1775/2367 symbols completed. RCS took 27.0s. Estimated remaining: 1h 16m 13s. Rate: 7.8 symbols/min [2025-10-22T20:48:34.796346] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:48:34.833869] [DEBUG] [LOCAL ] RDN: Loaded 44217 existing records from primary storage. [2025-10-22T20:48:34.834176] [INFO ] [MAIN ] RDN: Loaded 44217 existing records. [2025-10-22T20:48:35.011547] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:48:35.011820] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-22T20:48:35.011876] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-22T20:48:35.012181] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-10-22T20:48:35.012237] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-22T20:48:35.322967] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-22T20:48:35.359539] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:48:36.117745] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-22T20:48:36.248550] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T20:48:36.346442] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-22T20:48:36.918267] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-10-22T20:48:37.474968] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-22T20:48:37.717748] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-22T20:48:37.893289] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T20:48:38.148514] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T20:48:38.517734] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-10. [2025-10-22T20:48:38.580279] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-22T20:48:38.590388] [INFO ] [REMOTE ] RCL: Full fetch complete (75049 records). [2025-10-22T20:48:38.590561] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-22T20:48:38.591367] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T20:48:38.591464] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:48:38.591508] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:48:38.591606] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-22T20:48:38.591732] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-22T20:48:38.591799] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-10-22T20:48:38.591878] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-10-22T20:48:38.591982] [INFO ] [MAIN ] Update Progress: 1776/2367 symbols completed. RCL took 38.8s. Estimated remaining: 1h 16m 4s. Rate: 7.8 symbols/min [2025-10-22T20:48:38.785036] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:48:38.833703] [DEBUG] [LOCAL ] RDW: Loaded 52286 existing records from primary storage. [2025-10-22T20:48:38.834006] [INFO ] [MAIN ] RDW: Loaded 52286 existing records. [2025-10-22T20:48:39.015258] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:48:39.015491] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-22T20:48:39.015557] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-22T20:48:39.016065] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-10-22T20:48:39.016123] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-22T20:48:39.323085] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-10-22T20:48:39.364278] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:48:40.117626] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-22T20:48:40.260244] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T20:48:40.267924] [INFO ] [REMOTE ] RCUS: Full fetch complete (61206 records). [2025-10-22T20:48:40.268021] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-10-22T20:48:40.645843] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-10-22T20:48:40.645922] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-10-22T20:48:40.646907] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-10-22T20:48:40.646970] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-10-22T20:48:40.648147] [DEBUG] [LOCAL ] RCUS: Trimmed 61206 records to 42963 (keeping 200 days of data) [2025-10-22T20:48:40.888490] [DEBUG] [LOCAL ] RCUS: Primary data saved (42963 records). [2025-10-22T20:48:40.888614] [INFO ] [MAIN ] RCUS: Full history saved. [2025-10-22T20:48:40.888719] [INFO ] [MAIN ] Update Progress: 1777/2367 symbols completed. RCUS took 27.1s. Estimated remaining: 1h 15m 54s. Rate: 7.8 symbols/min [2025-10-22T20:48:40.931763] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-22T20:48:41.087832] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:48:41.129952] [DEBUG] [LOCAL ] RDY: Loaded 46313 existing records from primary storage. [2025-10-22T20:48:41.130261] [INFO ] [MAIN ] RDY: Loaded 46313 existing records. [2025-10-22T20:48:41.310760] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:48:41.310989] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-22T20:48:41.311036] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-22T20:48:41.311371] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-10-22T20:48:41.311410] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-22T20:48:41.659629] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:48:41.717628] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-22T20:48:42.172252] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-10-22T20:48:42.226383] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-22T20:48:42.351961] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T20:48:42.517720] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-10-22T20:48:43.105217] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T20:48:43.317670] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-22T20:48:44.117759] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-22T20:48:44.917758] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-22T20:48:45.095680] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T20:48:45.134079] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-10-22T20:48:45.717630] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-10-22T20:48:46.492084] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-22T20:48:46.517610] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-22T20:48:46.846458] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-22T20:48:47.317746] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-22T20:48:48.117731] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-22T20:48:48.454959] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-22T20:48:48.667171] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-22T20:48:48.917625] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-10-22T20:48:49.149258] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T20:48:49.717629] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-22T20:48:50.110464] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T20:48:50.517705] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-22T20:48:51.329951] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-22T20:48:51.332946] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-22T20:48:51.498143] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T20:48:52.117627] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-22T20:48:52.545229] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-22T20:48:52.917756] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-10-22T20:48:53.209306] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T20:48:53.717716] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-22T20:48:53.955401] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-22T20:48:54.517709] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-22T20:48:55.317731] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-22T20:48:55.728928] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-10-22T20:48:55.869151] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T20:48:55.955271] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-22T20:48:56.117712] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-22T20:48:56.917711] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-22T20:48:57.243480] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-22T20:48:57.717663] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-22T20:48:58.487051] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-22T20:48:58.517613] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-22T20:48:58.602317] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T20:48:59.233013] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T20:48:59.317612] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-22T20:49:00.117753] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-10. [2025-10-22T20:49:00.917669] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-22T20:49:01.478585] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-10-22T20:49:01.547497] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-22T20:49:01.717738] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-22T20:49:02.517632] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-22T20:49:02.622154] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T20:49:02.952305] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-10 (2.83 seconds). [2025-10-22T20:49:02.961249] [INFO ] [REMOTE ] RDDT: Full fetch complete (77929 records). [2025-10-22T20:49:02.961382] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-10-22T20:49:03.323299] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-22T20:49:03.347724] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-10-22T20:49:03.347819] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-10-22T20:49:03.349141] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-10-22T20:49:03.349228] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-10-22T20:49:03.350810] [DEBUG] [LOCAL ] RDDT: Trimmed 77929 records to 53772 (keeping 200 days of data) [2025-10-22T20:49:03.709878] [DEBUG] [LOCAL ] RDDT: Primary data saved (53772 records). [2025-10-22T20:49:03.710042] [INFO ] [MAIN ] RDDT: Full history saved. [2025-10-22T20:49:03.710138] [INFO ] [MAIN ] Update Progress: 1778/2367 symbols completed. RDDT took 43.4s. Estimated remaining: 1h 15m 51s. Rate: 7.8 symbols/min [2025-10-22T20:49:03.898974] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:49:03.941897] [DEBUG] [LOCAL ] RELX: Loaded 48574 existing records from primary storage. [2025-10-22T20:49:03.942202] [INFO ] [MAIN ] RELX: Loaded 48574 existing records. [2025-10-22T20:49:04.119680] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:49:04.120354] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-22T20:49:04.144407] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-22T20:49:04.146495] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T20:49:04.146539] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-10-22T20:49:04.156081] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-22T20:49:04.198540] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-22T20:49:04.470706] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-10-22T20:49:04.563744] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:49:04.917715] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-22T20:49:04.993303] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T20:49:05.000840] [INFO ] [REMOTE ] RDN: Full fetch complete (65870 records). [2025-10-22T20:49:05.000966] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-22T20:49:05.409766] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-10-22T20:49:05.409854] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-10-22T20:49:05.410850] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-10-22T20:49:05.410914] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-10-22T20:49:05.412184] [DEBUG] [LOCAL ] RDN: Trimmed 65870 records to 44108 (keeping 200 days of data) [2025-10-22T20:49:05.709616] [DEBUG] [LOCAL ] RDN: Primary data saved (44108 records). [2025-10-22T20:49:05.710118] [INFO ] [MAIN ] RDN: Full history saved. [2025-10-22T20:49:05.710242] [INFO ] [MAIN ] Update Progress: 1779/2367 symbols completed. RDN took 31.1s. Estimated remaining: 1h 15m 42s. Rate: 7.8 symbols/min [2025-10-22T20:49:05.722970] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-22T20:49:05.896055] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:49:05.921524] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T20:49:05.967793] [DEBUG] [LOCAL ] RERE: Loaded 41775 existing records from primary storage. [2025-10-22T20:49:05.968232] [INFO ] [MAIN ] RERE: Loaded 41775 existing records. [2025-10-22T20:49:06.160862] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:49:06.161205] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-22T20:49:06.161258] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-22T20:49:06.162000] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-10-22T20:49:06.162062] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-22T20:49:06.527402] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-22T20:49:06.575061] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:49:07.317738] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-22T20:49:07.401033] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-22T20:49:07.747608] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-22T20:49:08.117731] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-22T20:49:08.305322] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T20:49:08.312933] [INFO ] [REMOTE ] RDY: Full fetch complete (68524 records). [2025-10-22T20:49:08.313041] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-22T20:49:08.689985] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-10-22T20:49:08.690057] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-10-22T20:49:08.691064] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-10-22T20:49:08.691125] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-10-22T20:49:08.692401] [DEBUG] [LOCAL ] RDY: Trimmed 68524 records to 46215 (keeping 200 days of data) [2025-10-22T20:49:08.802071] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T20:49:08.921193] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-22T20:49:08.990924] [DEBUG] [LOCAL ] RDY: Primary data saved (46215 records). [2025-10-22T20:49:08.991052] [INFO ] [MAIN ] RDY: Full history saved. [2025-10-22T20:49:08.991129] [INFO ] [MAIN ] Update Progress: 1780/2367 symbols completed. RDY took 28.1s. Estimated remaining: 1h 15m 33s. Rate: 7.8 symbols/min [2025-10-22T20:49:09.157262] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:49:09.195282] [DEBUG] [LOCAL ] RES: Loaded 46955 existing records from primary storage. [2025-10-22T20:49:09.195572] [INFO ] [MAIN ] RES: Loaded 46955 existing records. [2025-10-22T20:49:09.365437] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:49:09.365702] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-22T20:49:09.365758] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-22T20:49:09.366031] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-10-22T20:49:09.366085] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-22T20:49:09.704143] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:49:09.717605] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-22T20:49:10.406835] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T20:49:10.517638] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-22T20:49:11.107853] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-10 (2.99 seconds). [2025-10-22T20:49:11.116706] [INFO ] [REMOTE ] RDW: Full fetch complete (75539 records). [2025-10-22T20:49:11.116843] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-22T20:49:11.325864] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-22T20:49:11.528484] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-10-22T20:49:11.528939] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-10-22T20:49:11.530528] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-10-22T20:49:11.530754] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-10-22T20:49:11.564296] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T20:49:11.562413] [DEBUG] [LOCAL ] RDW: Trimmed 75539 records to 52288 (keeping 200 days of data) [2025-10-22T20:49:11.976806] [DEBUG] [LOCAL ] RDW: Primary data saved (52288 records). [2025-10-22T20:49:11.977000] [INFO ] [MAIN ] RDW: Full history saved. [2025-10-22T20:49:11.977733] [INFO ] [MAIN ] Update Progress: 1781/2367 symbols completed. RDW took 33.4s. Estimated remaining: 1h 15m 23s. Rate: 7.8 symbols/min [2025-10-22T20:49:12.124039] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-22T20:49:12.219945] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:49:12.247343] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T20:49:12.293846] [DEBUG] [LOCAL ] REVG: Loaded 40260 existing records from primary storage. [2025-10-22T20:49:12.294187] [INFO ] [MAIN ] REVG: Loaded 40260 existing records. [2025-10-22T20:49:12.521837] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:49:12.522155] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-22T20:49:12.522209] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-22T20:49:12.522401] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-10-22T20:49:12.522440] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-22T20:49:12.887446] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:49:12.917617] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-22T20:49:13.232910] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T20:49:13.717751] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-22T20:49:13.967576] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T20:49:14.525070] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-22T20:49:14.540329] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T20:49:15.317634] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-22T20:49:15.659683] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T20:49:16.117737] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-22T20:49:16.215298] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T20:49:16.505730] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T20:49:16.917705] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-22T20:49:17.717628] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-10-22T20:49:18.040530] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T20:49:18.517754] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-22T20:49:18.578316] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T20:49:19.284114] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T20:49:19.317639] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-10-22T20:49:19.867737] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T20:49:20.117721] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-22T20:49:20.752111] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T20:49:20.917702] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-22T20:49:21.717771] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-10-22T20:49:21.944856] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T20:49:22.371609] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T20:49:22.517745] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-22T20:49:23.317636] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-22T20:49:23.422234] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T20:49:24.117725] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-10-22T20:49:24.292244] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T20:49:24.869302] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T20:49:24.917711] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-22T20:49:25.717636] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-22T20:49:25.839166] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T20:49:26.517754] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-10-22T20:49:26.637125] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T20:49:27.317633] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-22T20:49:27.390573] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T20:49:28.117742] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-22T20:49:28.169598] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T20:49:28.917744] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-10-22T20:49:29.089141] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T20:49:29.717776] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-22T20:49:30.077273] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-22T20:49:30.290906] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T20:49:30.517747] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-10-22T20:49:31.317712] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-22T20:49:31.759115] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-22T20:49:32.117736] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-22T20:49:32.196507] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T20:49:32.793389] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T20:49:32.917699] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-22T20:49:33.717717] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-22T20:49:33.752978] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T20:49:33.760666] [INFO ] [REMOTE ] RERE: Full fetch complete (57989 records). [2025-10-22T20:49:33.760795] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-22T20:49:34.193364] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-10-22T20:49:34.193483] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-10-22T20:49:34.194664] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-10-22T20:49:34.194732] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-10-22T20:49:34.195985] [DEBUG] [LOCAL ] RERE: Trimmed 57989 records to 41799 (keeping 200 days of data) [2025-10-22T20:49:34.447871] [DEBUG] [LOCAL ] RERE: Primary data saved (41799 records). [2025-10-22T20:49:34.448028] [INFO ] [MAIN ] RERE: Full history saved. [2025-10-22T20:49:34.448139] [INFO ] [MAIN ] Update Progress: 1782/2367 symbols completed. RERE took 28.7s. Estimated remaining: 1h 15m 20s. Rate: 7.8 symbols/min [2025-10-22T20:49:34.526556] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-10-22T20:49:34.642918] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:49:34.683434] [DEBUG] [LOCAL ] REX: Loaded 14379 existing records from primary storage. [2025-10-22T20:49:34.683782] [INFO ] [MAIN ] REX: Loaded 14379 existing records. [2025-10-22T20:49:34.754936] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T20:49:34.871268] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:49:34.871475] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-22T20:49:34.871522] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-22T20:49:34.871719] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-10-22T20:49:34.871774] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-22T20:49:35.215385] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:49:35.317633] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-22T20:49:35.642591] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T20:49:36.117746] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-22T20:49:36.389921] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T20:49:36.917755] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-10. [2025-10-22T20:49:37.121334] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T20:49:37.717625] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-22T20:49:37.939922] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T20:49:38.517635] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-22T20:49:38.537773] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-22T20:49:38.545268] [INFO ] [REMOTE ] REVG: Full fetch complete (57832 records). [2025-10-22T20:49:38.545409] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-10-22T20:49:38.923506] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-10-22T20:49:38.923588] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-10-22T20:49:38.924621] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-10-22T20:49:38.924704] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-10-22T20:49:38.926152] [DEBUG] [LOCAL ] REVG: Trimmed 57832 records to 40157 (keeping 200 days of data) [2025-10-22T20:49:39.171410] [DEBUG] [LOCAL ] REVG: Primary data saved (40157 records). [2025-10-22T20:49:39.171529] [INFO ] [MAIN ] REVG: Full history saved. [2025-10-22T20:49:39.172170] [INFO ] [MAIN ] Update Progress: 1783/2367 symbols completed. REVG took 27.2s. Estimated remaining: 1h 15m 12s. Rate: 7.8 symbols/min [2025-10-22T20:49:39.319681] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-22T20:49:39.355088] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:49:39.376745] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T20:49:39.384525] [INFO ] [REMOTE ] RES: Full fetch complete (68717 records). [2025-10-22T20:49:39.384696] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-22T20:49:39.748711] [DEBUG] [LOCAL ] REXR: Loaded 52204 existing records from primary storage. [2025-10-22T20:49:39.780029] [INFO ] [MAIN ] REXR: Loaded 52204 existing records. [2025-10-22T20:49:39.927988] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-10-22T20:49:39.928176] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-10-22T20:49:39.930398] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-10-22T20:49:39.930490] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-10-22T20:49:40.008378] [DEBUG] [LOCAL ] RES: Trimmed 68717 records to 46858 (keeping 200 days of data) [2025-10-22T20:49:40.012830] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:49:40.013331] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-22T20:49:40.013386] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-22T20:49:40.013607] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-10-22T20:49:40.013695] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-22T20:49:40.666577] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:49:40.667036] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-22T20:49:40.680288] [DEBUG] [LOCAL ] RES: Primary data saved (46858 records). [2025-10-22T20:49:40.697297] [INFO ] [MAIN ] RES: Full history saved. [2025-10-22T20:49:40.704281] [INFO ] [MAIN ] Update Progress: 1784/2367 symbols completed. RES took 31.7s. Estimated remaining: 1h 15m 2s. Rate: 7.8 symbols/min [2025-10-22T20:49:40.708789] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T20:49:40.732486] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-22T20:49:40.824048] [INFO ] [REMOTE ] RELX: Full fetch complete (68498 records). [2025-10-22T20:49:40.824199] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-22T20:49:40.938349] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-22T20:49:40.987087] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:49:41.328902] [DEBUG] [LOCAL ] REZI: Loaded 47128 existing records from primary storage. [2025-10-22T20:49:41.332517] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-10-22T20:49:41.332905] [INFO ] [MAIN ] REZI: Loaded 47128 existing records. [2025-10-22T20:49:41.332780] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-10-22T20:49:41.357847] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-10-22T20:49:41.377206] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-10-22T20:49:41.443044] [DEBUG] [LOCAL ] RELX: Trimmed 68498 records to 48581 (keeping 200 days of data) [2025-10-22T20:49:41.619611] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:49:41.639810] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-22T20:49:41.648333] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-22T20:49:41.656404] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-10-22T20:49:41.656581] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-22T20:49:42.247487] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:49:42.226301] [DEBUG] [LOCAL ] RELX: Primary data saved (48581 records). [2025-10-22T20:49:42.249038] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-22T20:49:42.249147] [INFO ] [MAIN ] RELX: Full history saved. [2025-10-22T20:49:42.248610] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T20:49:42.250316] [INFO ] [MAIN ] Update Progress: 1785/2367 symbols completed. RELX took 38.5s. Estimated remaining: 1h 14m 52s. Rate: 7.8 symbols/min [2025-10-22T20:49:42.435741] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:49:42.484436] [DEBUG] [LOCAL ] RF: Loaded 53633 existing records from primary storage. [2025-10-22T20:49:42.484872] [INFO ] [MAIN ] RF: Loaded 53633 existing records. [2025-10-22T20:49:42.527627] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-22T20:49:42.674618] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:49:42.674976] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-22T20:49:42.675115] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-22T20:49:42.675461] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-10-22T20:49:42.675510] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-22T20:49:42.852295] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-22T20:49:43.074089] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:49:43.317786] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-22T20:49:43.867047] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T20:49:43.884308] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T20:49:44.117736] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-22T20:49:44.917617] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-22T20:49:45.109575] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T20:49:45.717705] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-22T20:49:46.258280] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-22T20:49:46.449810] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-22T20:49:46.517637] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-22T20:49:47.317758] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-22T20:49:47.645738] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T20:49:48.117629] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-22T20:49:48.329263] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T20:49:48.536876] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T20:49:48.917635] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-22T20:49:49.717662] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-22T20:49:50.131125] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T20:49:50.342553] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T20:49:50.517719] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-22T20:49:51.317624] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-22T20:49:51.428173] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T20:49:52.117622] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-22T20:49:52.330883] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T20:49:52.438200] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-22T20:49:52.917704] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-22T20:49:53.717705] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-22T20:49:53.903597] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-22T20:49:53.930926] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T20:49:54.517696] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-22T20:49:55.317735] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-22T20:49:55.461217] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-22T20:49:55.563246] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T20:49:56.117750] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-22T20:49:56.917751] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-22T20:49:57.415103] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-22T20:49:57.717731] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-22T20:49:57.764467] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T20:49:58.517749] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-22T20:49:58.852159] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-22T20:49:58.870456] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T20:49:59.317753] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-22T20:50:00.117628] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-22T20:50:00.228176] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T20:50:00.917710] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-22T20:50:01.635774] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-22T20:50:01.717611] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-22T20:50:02.289684] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-22T20:50:02.517763] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-22T20:50:02.567890] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T20:50:03.317723] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-22T20:50:03.742912] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T20:50:03.874478] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-22T20:50:04.117752] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-22T20:50:04.917744] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-22T20:50:05.280990] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-22T20:50:05.717730] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-22T20:50:05.900278] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T20:50:06.517753] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-22T20:50:06.793074] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-22T20:50:06.801500] [INFO ] [REMOTE ] REXR: Full fetch complete (75348 records). [2025-10-22T20:50:06.801611] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-22T20:50:06.986488] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T20:50:07.080631] [INFO ] [REMOTE ] REX: Full fetch complete (21199 records). [2025-10-22T20:50:07.102179] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-22T20:50:07.334621] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-22T20:50:07.334820] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-10-22T20:50:07.346264] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-10-22T20:50:07.365975] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-10-22T20:50:07.412013] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-10-22T20:50:07.521785] [DEBUG] [LOCAL ] REXR: Trimmed 75348 records to 52193 (keeping 200 days of data) [2025-10-22T20:50:07.820166] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-10-22T20:50:07.846637] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-10-22T20:50:07.847712] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-10-22T20:50:07.851382] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-10-22T20:50:07.873101] [DEBUG] [LOCAL ] REX: Trimmed 21199 records to 14324 (keeping 200 days of data) [2025-10-22T20:50:08.056473] [DEBUG] [LOCAL ] REXR: Primary data saved (52193 records). [2025-10-22T20:50:08.062460] [INFO ] [MAIN ] REXR: Full history saved. [2025-10-22T20:50:08.063458] [INFO ] [MAIN ] Update Progress: 1786/2367 symbols completed. REXR took 28.9s. Estimated remaining: 1h 14m 50s. Rate: 7.8 symbols/min [2025-10-22T20:50:08.062555] [DEBUG] [LOCAL ] REX: Primary data saved (14324 records). [2025-10-22T20:50:08.119594] [INFO ] [MAIN ] REX: Full history saved. [2025-10-22T20:50:08.155750] [INFO ] [MAIN ] Update Progress: 1787/2367 symbols completed. REX took 33.7s. Estimated remaining: 1h 14m 40s. Rate: 7.8 symbols/min [2025-10-22T20:50:08.335165] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:50:08.421353] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:50:08.446316] [DEBUG] [LOCAL ] RFI: Loaded 10308 existing records from primary storage. [2025-10-22T20:50:08.447999] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T20:50:08.448243] [INFO ] [MAIN ] RFI: Loaded 10308 existing records. [2025-10-22T20:50:08.501844] [INFO ] [REMOTE ] REZI: Full fetch complete (66231 records). [2025-10-22T20:50:08.544510] [DEBUG] [LOCAL ] RFL: Loaded 11446 existing records from primary storage. [2025-10-22T20:50:08.550066] [INFO ] [MAIN ] RFL: Loaded 11446 existing records. [2025-10-22T20:50:08.549848] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-22T20:50:08.804257] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:50:08.824668] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-22T20:50:08.824769] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-22T20:50:08.871688] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-10-22T20:50:08.938876] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-22T20:50:08.965161] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:50:09.011621] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-22T20:50:09.028328] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-22T20:50:09.127433] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-10-22T20:50:09.157310] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-22T20:50:09.668176] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-10-22T20:50:09.784303] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-10-22T20:50:09.876524] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-10-22T20:50:09.899328] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-10-22T20:50:09.925884] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:50:09.966982] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-22T20:50:09.966604] [DEBUG] [LOCAL ] REZI: Trimmed 66231 records to 47098 (keeping 200 days of data) [2025-10-22T20:50:10.033854] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:50:10.082309] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (2.75 seconds). [2025-10-22T20:50:10.091030] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-22T20:50:10.147280] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-22T20:50:10.327327] [DEBUG] [LOCAL ] REZI: Primary data saved (47098 records). [2025-10-22T20:50:10.327463] [INFO ] [MAIN ] REZI: Full history saved. [2025-10-22T20:50:10.327546] [INFO ] [MAIN ] Update Progress: 1788/2367 symbols completed. REZI took 29.6s. Estimated remaining: 1h 14m 31s. Rate: 7.8 symbols/min [2025-10-22T20:50:10.494867] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:50:10.501685] [DEBUG] [LOCAL ] RFM: Loaded 4210 existing records from primary storage. [2025-10-22T20:50:10.501882] [INFO ] [MAIN ] RFM: Loaded 4210 existing records. [2025-10-22T20:50:10.680197] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:50:10.680440] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-22T20:50:10.680487] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-22T20:50:10.680636] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-10-22T20:50:10.680723] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-22T20:50:10.957516] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-22T20:50:10.975212] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-22T20:50:11.038562] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:50:11.176375] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T20:50:11.317684] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-22T20:50:11.688366] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-22T20:50:12.117704] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-22T20:50:12.187106] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-22T20:50:12.549317] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-22T20:50:12.900888] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-22T20:50:12.917602] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-22T20:50:13.717732] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-22T20:50:14.002973] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-22T20:50:14.431886] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-22T20:50:14.517633] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-22T20:50:15.267088] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-22T20:50:15.317663] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-22T20:50:16.117717] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-22T20:50:16.555439] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T20:50:16.725754] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-22T20:50:16.917687] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-22T20:50:17.717618] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-22T20:50:18.024889] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T20:50:18.273684] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-22T20:50:18.517735] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-22T20:50:19.233998] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-22T20:50:19.317720] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-22T20:50:19.947699] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-22T20:50:20.117712] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-22T20:50:20.917744] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-22T20:50:21.702688] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-22T20:50:21.717714] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-22T20:50:22.097988] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T20:50:22.473018] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-22T20:50:22.517615] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-22T20:50:23.064674] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-22T20:50:23.317744] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-22T20:50:24.117631] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-22T20:50:24.194723] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T20:50:24.917743] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-22T20:50:25.145285] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-22T20:50:25.717724] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-22T20:50:26.517702] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-22T20:50:26.584741] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T20:50:26.975355] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-22T20:50:27.117956] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T20:50:27.119264] [INFO ] [REMOTE ] RFM: Full fetch complete (5672 records). [2025-10-22T20:50:27.119332] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-10-22T20:50:27.323508] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-22T20:50:27.513624] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-10-22T20:50:27.513725] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-10-22T20:50:27.513890] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-10-22T20:50:27.513930] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-10-22T20:50:27.514289] [DEBUG] [LOCAL ] RFM: Trimmed 5672 records to 4209 (keeping 200 days of data) [2025-10-22T20:50:27.539279] [DEBUG] [LOCAL ] RFM: Primary data saved (4209 records). [2025-10-22T20:50:27.539356] [INFO ] [MAIN ] RFM: Full history saved. [2025-10-22T20:50:27.539426] [INFO ] [MAIN ] Update Progress: 1789/2367 symbols completed. RFM took 17.2s. Estimated remaining: 1h 14m 26s. Rate: 7.8 symbols/min [2025-10-22T20:50:27.702063] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:50:27.712899] [DEBUG] [LOCAL ] RFMZ: Loaded 8978 existing records from primary storage. [2025-10-22T20:50:27.713130] [INFO ] [MAIN ] RFMZ: Loaded 8978 existing records. [2025-10-22T20:50:27.894606] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:50:27.894844] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-22T20:50:27.894892] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-22T20:50:27.895043] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-10-22T20:50:27.895081] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-22T20:50:28.123731] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-22T20:50:28.269779] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:50:28.437621] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T20:50:28.917732] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-22T20:50:29.275818] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-22T20:50:29.717771] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-22T20:50:30.517776] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-22T20:50:30.629575] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T20:50:30.631698] [INFO ] [REMOTE ] RFL: Full fetch complete (13263 records). [2025-10-22T20:50:30.631786] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-22T20:50:31.051920] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-10-22T20:50:31.052024] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-10-22T20:50:31.052500] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-10-22T20:50:31.052799] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-10-22T20:50:31.053548] [DEBUG] [LOCAL ] RFL: Trimmed 13263 records to 11419 (keeping 200 days of data) [2025-10-22T20:50:31.109639] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-22T20:50:31.156543] [DEBUG] [LOCAL ] RFL: Primary data saved (11419 records). [2025-10-22T20:50:31.156850] [INFO ] [MAIN ] RFL: Full history saved. [2025-10-22T20:50:31.156953] [INFO ] [MAIN ] Update Progress: 1790/2367 symbols completed. RFL took 23.0s. Estimated remaining: 1h 14m 17s. Rate: 7.8 symbols/min [2025-10-22T20:50:31.190329] [INFO ] [REMOTE ] RF: Full fetch complete (77798 records). [2025-10-22T20:50:31.202910] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-22T20:50:31.319496] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-22T20:50:31.346764] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-22T20:50:31.472634] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:50:31.723716] [DEBUG] [LOCAL ] RGA: Loaded 29320 existing records from primary storage. [2025-10-22T20:50:31.739727] [INFO ] [MAIN ] RGA: Loaded 29320 existing records. [2025-10-22T20:50:31.935850] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-10-22T20:50:31.941164] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-10-22T20:50:31.952900] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-10-22T20:50:31.970608] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-10-22T20:50:32.011762] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:50:32.012210] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-22T20:50:32.012439] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-22T20:50:32.012861] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-10-22T20:50:32.012996] [DEBUG] [LOCAL ] RF: Trimmed 77798 records to 53633 (keeping 200 days of data) [2025-10-22T20:50:32.013210] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-22T20:50:32.140891] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-22T20:50:32.556031] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T20:50:32.724385] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:50:32.738822] [DEBUG] [LOCAL ] RF: Primary data saved (53633 records). [2025-10-22T20:50:32.738943] [INFO ] [MAIN ] RF: Full history saved. [2025-10-22T20:50:32.739019] [INFO ] [MAIN ] Update Progress: 1791/2367 symbols completed. RF took 50.5s. Estimated remaining: 1h 14m 7s. Rate: 7.8 symbols/min [2025-10-22T20:50:32.909335] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:50:32.921393] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-22T20:50:32.931725] [DEBUG] [LOCAL ] RGR: Loaded 21070 existing records from primary storage. [2025-10-22T20:50:32.931944] [INFO ] [MAIN ] RGR: Loaded 21070 existing records. [2025-10-22T20:50:33.064980] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-22T20:50:33.125228] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:50:33.125467] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-22T20:50:33.125535] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-22T20:50:33.125772] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-10-22T20:50:33.125838] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-22T20:50:33.472048] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:50:33.715715] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T20:50:33.717610] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-22T20:50:34.517747] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-22T20:50:35.308060] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T20:50:35.317615] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-22T20:50:35.811167] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-22T20:50:36.117731] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-22T20:50:36.917628] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-22T20:50:37.019927] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T20:50:37.072312] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T20:50:37.717727] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-22T20:50:37.785131] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T20:50:38.517718] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-22T20:50:38.916978] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T20:50:39.317758] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-22T20:50:39.463758] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-22T20:50:40.117710] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-22T20:50:40.917632] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-22T20:50:41.002352] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-22T20:50:41.017431] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T20:50:41.717691] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-22T20:50:41.889780] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-22T20:50:42.517723] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-22T20:50:43.301475] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T20:50:43.317725] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-22T20:50:43.702590] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-22T20:50:44.117638] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-22T20:50:44.922827] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-22T20:50:44.941315] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T20:50:45.437370] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T20:50:45.717710] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-22T20:50:45.770795] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-22T20:50:45.772685] [INFO ] [REMOTE ] RFI: Full fetch complete (15117 records). [2025-10-22T20:50:45.772851] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-22T20:50:46.132192] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-10-22T20:50:46.132290] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-10-22T20:50:46.133530] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-10-22T20:50:46.133587] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-10-22T20:50:46.134156] [DEBUG] [LOCAL ] RFI: Trimmed 15117 records to 10230 (keeping 200 days of data) [2025-10-22T20:50:46.197148] [DEBUG] [LOCAL ] RFI: Primary data saved (10230 records). [2025-10-22T20:50:46.197284] [INFO ] [MAIN ] RFI: Full history saved. [2025-10-22T20:50:46.197375] [INFO ] [MAIN ] Update Progress: 1792/2367 symbols completed. RFI took 38.1s. Estimated remaining: 1h 14m 1s. Rate: 7.8 symbols/min [2025-10-22T20:50:46.362091] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:50:46.366045] [DEBUG] [LOCAL ] RGT: Loaded 2719 existing records from primary storage. [2025-10-22T20:50:46.366182] [INFO ] [MAIN ] RGT: Loaded 2719 existing records. [2025-10-22T20:50:46.521000] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-22T20:50:46.541499] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:50:46.541795] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-22T20:50:46.541842] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-22T20:50:46.541980] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-10-22T20:50:46.542019] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-22T20:50:46.900683] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:50:47.006420] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-22T20:50:47.317631] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-22T20:50:47.512324] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T20:50:47.960688] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-22T20:50:48.117687] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-22T20:50:48.917687] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-22T20:50:49.447011] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T20:50:49.717755] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-22T20:50:49.849866] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T20:50:50.313107] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-22T20:50:50.517730] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-22T20:50:51.317724] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-10-22T20:50:51.756944] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-22T20:50:52.117704] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-22T20:50:52.818077] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T20:50:52.917637] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-22T20:50:52.955804] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-22T20:50:53.614754] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-22T20:50:53.717693] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-22T20:50:54.517696] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-22T20:50:54.934694] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T20:50:54.949139] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-22T20:50:55.317695] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-22T20:50:55.893794] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-22T20:50:56.117729] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-22T20:50:56.917838] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-22T20:50:57.041253] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-22T20:50:57.653314] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-22T20:50:57.717763] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-10-22T20:50:58.517706] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-22T20:50:59.149957] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T20:50:59.266378] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-22T20:50:59.317683] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-22T20:51:00.117635] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-10. [2025-10-22T20:51:00.272003] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T20:51:00.917761] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-22T20:51:01.482621] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T20:51:01.487434] [INFO ] [REMOTE ] RGA: Full fetch complete (45008 records). [2025-10-22T20:51:01.487525] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-10-22T20:51:01.727691] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-22T20:51:01.867032] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-10-22T20:51:01.867195] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-10-22T20:51:01.868099] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-10-22T20:51:01.868161] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-10-22T20:51:01.869195] [DEBUG] [LOCAL ] RGA: Trimmed 45008 records to 29198 (keeping 200 days of data) [2025-10-22T20:51:01.964076] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T20:51:01.968312] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12375 records). [2025-10-22T20:51:01.969155] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-22T20:51:02.399800] [DEBUG] [LOCAL ] RGA: Primary data saved (29198 records). [2025-10-22T20:51:02.421503] [INFO ] [MAIN ] RGA: Full history saved. [2025-10-22T20:51:02.429208] [INFO ] [MAIN ] Update Progress: 1793/2367 symbols completed. RGA took 31.3s. Estimated remaining: 1h 13m 56s. Rate: 7.8 symbols/min [2025-10-22T20:51:02.429311] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-10-22T20:51:02.429387] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-10-22T20:51:02.429769] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-10-22T20:51:02.441092] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-10-22T20:51:02.498725] [DEBUG] [LOCAL ] RFMZ: Trimmed 12375 records to 9010 (keeping 200 days of data) [2025-10-22T20:51:02.520307] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-22T20:51:02.664596] [DEBUG] [LOCAL ] RFMZ: Primary data saved (9010 records). [2025-10-22T20:51:02.654457] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:51:02.665299] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-10-22T20:51:02.665539] [INFO ] [MAIN ] Update Progress: 1794/2367 symbols completed. RFMZ took 35.1s. Estimated remaining: 1h 13m 46s. Rate: 7.8 symbols/min [2025-10-22T20:51:02.841614] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:51:02.875949] [DEBUG] [LOCAL ] RH: Loaded 47171 existing records from primary storage. [2025-10-22T20:51:02.876378] [INFO ] [MAIN ] RH: Loaded 47171 existing records. [2025-10-22T20:51:03.083701] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:51:03.100332] [DEBUG] [LOCAL ] RHI: Loaded 49676 existing records from primary storage. [2025-10-22T20:51:03.101796] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T20:51:03.101188] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-22T20:51:03.102165] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-22T20:51:03.102361] [INFO ] [MAIN ] RHI: Loaded 49676 existing records. [2025-10-22T20:51:03.111871] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-10-22T20:51:03.118555] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-22T20:51:03.286350] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-22T20:51:03.319059] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-22T20:51:03.394758] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:51:03.411004] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-22T20:51:03.411177] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-22T20:51:03.433631] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-10-22T20:51:03.446057] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-22T20:51:03.916223] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:51:04.024195] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:51:04.117703] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-22T20:51:04.149879] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T20:51:04.917701] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-22T20:51:05.438219] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T20:51:05.463131] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-22T20:51:05.464138] [INFO ] [REMOTE ] RGT: Full fetch complete (3934 records). [2025-10-22T20:51:05.464206] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-22T20:51:05.722842] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-22T20:51:05.815516] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-10-22T20:51:05.815591] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-10-22T20:51:05.815736] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-10-22T20:51:05.815795] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-10-22T20:51:05.816127] [DEBUG] [LOCAL ] RGT: Trimmed 3934 records to 2685 (keeping 200 days of data) [2025-10-22T20:51:05.831787] [DEBUG] [LOCAL ] RGT: Primary data saved (2685 records). [2025-10-22T20:51:05.831848] [INFO ] [MAIN ] RGT: Full history saved. [2025-10-22T20:51:05.831914] [INFO ] [MAIN ] Update Progress: 1795/2367 symbols completed. RGT took 19.6s. Estimated remaining: 1h 13m 37s. Rate: 7.8 symbols/min [2025-10-22T20:51:05.996265] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:51:05.996410] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-22T20:51:05.996445] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-22T20:51:05.996560] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-22T20:51:05.996600] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-22T20:51:05.996660] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-22T20:51:05.996715] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-22T20:51:06.348126] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:51:06.517691] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-22T20:51:07.266022] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T20:51:07.317707] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-01. [2025-10-22T20:51:07.685310] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T20:51:07.685623] [WARN ] [REMOTE ] RHLD: No data returned for month 2025-01 [2025-10-22T20:51:07.685756] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T20:51:07.685847] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-22T20:51:07.685931] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T20:51:07.686023] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-22T20:51:07.686107] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-22T20:51:07.686147] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-22T20:51:07.686185] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-22T20:51:07.686230] [INFO ] [MAIN ] Update Progress: 1796/2367 symbols completed. RHLD took 1.9s. Estimated remaining: 1h 13m 27s. Rate: 7.8 symbols/min [2025-10-22T20:51:07.855006] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:51:07.893162] [DEBUG] [LOCAL ] RHP: Loaded 40408 existing records from primary storage. [2025-10-22T20:51:07.893436] [INFO ] [MAIN ] RHP: Loaded 40408 existing records. [2025-10-22T20:51:08.071921] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:51:08.072137] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-22T20:51:08.072191] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-22T20:51:08.072404] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-10-22T20:51:08.072461] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-22T20:51:08.126213] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-22T20:51:08.483452] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-22T20:51:08.487236] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:51:08.917690] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-22T20:51:09.525977] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T20:51:09.531038] [INFO ] [REMOTE ] RGR: Full fetch complete (28812 records). [2025-10-22T20:51:09.531147] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-22T20:51:09.722869] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-22T20:51:09.912834] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-10-22T20:51:09.912929] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-10-22T20:51:09.913515] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-10-22T20:51:09.913577] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-10-22T20:51:09.914278] [DEBUG] [LOCAL ] RGR: Trimmed 28812 records to 20982 (keeping 200 days of data) [2025-10-22T20:51:10.039307] [DEBUG] [LOCAL ] RGR: Primary data saved (20982 records). [2025-10-22T20:51:10.039425] [INFO ] [MAIN ] RGR: Full history saved. [2025-10-22T20:51:10.039499] [INFO ] [MAIN ] Update Progress: 1797/2367 symbols completed. RGR took 37.3s. Estimated remaining: 1h 13m 18s. Rate: 7.8 symbols/min [2025-10-22T20:51:10.517701] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-10-22T20:51:10.627077] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T20:51:11.317707] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-22T20:51:11.452488] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T20:51:12.117631] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-22T20:51:12.173612] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T20:51:12.731321] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-22T20:51:12.917711] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-22T20:51:13.630288] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T20:51:13.717702] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-22T20:51:14.464593] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T20:51:14.517606] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-22T20:51:15.317708] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-10-22T20:51:15.598581] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T20:51:16.117619] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-22T20:51:16.525464] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T20:51:16.908836] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T20:51:16.919013] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-22T20:51:17.717948] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-10-22T20:51:17.998715] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T20:51:18.517713] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-22T20:51:18.725345] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T20:51:19.317772] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-22T20:51:19.639271] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T20:51:19.942389] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T20:51:20.117722] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-22T20:51:20.917718] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-10-22T20:51:21.095767] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T20:51:21.677996] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T20:51:21.717621] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-22T20:51:22.517700] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-22T20:51:22.554285] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T20:51:23.326936] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-10-22T20:51:23.329450] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T20:51:24.117754] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-22T20:51:24.453308] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T20:51:24.917716] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-22T20:51:25.396072] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-22T20:51:25.717626] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-10-22T20:51:25.806530] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T20:51:26.517704] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-22T20:51:26.601808] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T20:51:27.331156] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-22T20:51:27.333451] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T20:51:28.117630] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-10-22T20:51:28.232273] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T20:51:28.917743] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-22T20:51:29.185937] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T20:51:29.717736] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-22T20:51:29.998569] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T20:51:30.517713] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-10-22T20:51:30.617700] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T20:51:30.624535] [INFO ] [REMOTE ] RHP: Full fetch complete (58272 records). [2025-10-22T20:51:30.624750] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-22T20:51:31.001304] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-10-22T20:51:31.001382] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-10-22T20:51:31.002361] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-10-22T20:51:31.002425] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-10-22T20:51:31.003604] [DEBUG] [LOCAL ] RHP: Trimmed 58272 records to 40303 (keeping 200 days of data) [2025-10-22T20:51:31.254454] [DEBUG] [LOCAL ] RHP: Primary data saved (40303 records). [2025-10-22T20:51:31.254595] [INFO ] [MAIN ] RHP: Full history saved. [2025-10-22T20:51:31.255193] [INFO ] [MAIN ] Update Progress: 1798/2367 symbols completed. RHP took 23.6s. Estimated remaining: 1h 13m 15s. Rate: 7.8 symbols/min [2025-10-22T20:51:31.536624] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T20:51:31.544925] [INFO ] [REMOTE ] RHI: Full fetch complete (70911 records). [2025-10-22T20:51:31.545040] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-22T20:51:31.933589] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-10-22T20:51:31.933690] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-10-22T20:51:31.934767] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-10-22T20:51:31.934829] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-10-22T20:51:31.936171] [DEBUG] [LOCAL ] RHI: Trimmed 70911 records to 49689 (keeping 200 days of data) [2025-10-22T20:51:32.242408] [DEBUG] [LOCAL ] RHI: Primary data saved (49689 records). [2025-10-22T20:51:32.242550] [INFO ] [MAIN ] RHI: Full history saved. [2025-10-22T20:51:32.242637] [INFO ] [MAIN ] Update Progress: 1799/2367 symbols completed. RHI took 29.6s. Estimated remaining: 1h 13m 5s. Rate: 7.8 symbols/min [2025-10-22T20:51:32.600509] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-22T20:51:32.610828] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-10. [2025-10-22T20:51:34.478889] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T20:51:34.486124] [INFO ] [REMOTE ] RH: Full fetch complete (66340 records). [2025-10-22T20:51:34.486234] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-10-22T20:51:34.875964] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-10-22T20:51:34.876040] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-10-22T20:51:34.877071] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-10-22T20:51:34.877135] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-10-22T20:51:34.878395] [DEBUG] [LOCAL ] RH: Trimmed 66340 records to 47133 (keeping 200 days of data) [2025-10-22T20:51:35.162863] [DEBUG] [LOCAL ] RH: Primary data saved (47133 records). [2025-10-22T20:51:35.163001] [INFO ] [MAIN ] RH: Full history saved. [2025-10-22T20:51:35.163101] [INFO ] [MAIN ] Update Progress: 1800/2367 symbols completed. RH took 32.7s. Estimated remaining: 1h 12m 56s. Rate: 7.8 symbols/min [2025-10-22T20:51:35.786562] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:51:35.739863] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:51:35.794889] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:51:35.864424] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:51:35.878022] [DEBUG] [LOCAL ] RIV: Loaded 12687 existing records from primary storage. [2025-10-22T20:51:35.878592] [INFO ] [MAIN ] RIV: Loaded 12687 existing records. [2025-10-22T20:51:36.109791] [DEBUG] [LOCAL ] RIO: Loaded 53402 existing records from primary storage. [2025-10-22T20:51:36.132303] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:51:36.133100] [INFO ] [MAIN ] RIO: Loaded 53402 existing records. [2025-10-22T20:51:36.144697] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-22T20:51:36.201284] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-22T20:51:36.206692] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-10-22T20:51:36.214147] [DEBUG] [LOCAL ] RITM: Loaded 52948 existing records from primary storage. [2025-10-22T20:51:36.230961] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-22T20:51:36.230797] [INFO ] [MAIN ] RITM: Loaded 52948 existing records. [2025-10-22T20:51:36.292766] [DEBUG] [LOCAL ] RIG: Loaded 53675 existing records from primary storage. [2025-10-22T20:51:36.329098] [INFO ] [MAIN ] RIG: Loaded 53675 existing records. [2025-10-22T20:51:36.658021] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:51:36.675664] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-22T20:51:36.686355] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-22T20:51:36.722749] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-10-22T20:51:36.777623] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-22T20:51:36.858515] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:51:36.929328] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-22T20:51:36.980382] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-22T20:51:37.062707] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-10-22T20:51:37.072683] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-22T20:51:37.120700] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:51:37.179549] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-22T20:51:37.199373] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-22T20:51:37.326552] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-10-22T20:51:37.383509] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-22T20:51:37.684718] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:51:37.811058] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-22T20:51:37.970406] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:51:38.056505] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-22T20:51:38.305278] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:51:38.322042] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-22T20:51:38.325829] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:51:38.327108] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-10-22T20:51:39.042072] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T20:51:39.045310] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-22T20:51:40.009895] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-22T20:51:40.012449] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-22T20:51:40.161857] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-22T20:51:40.172635] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-22T20:51:40.262865] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T20:51:40.273347] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-10-22T20:51:40.420445] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-22T20:51:40.431399] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-22T20:51:40.639390] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T20:51:40.642209] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-22T20:51:41.573302] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-22T20:51:41.576388] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-22T20:51:42.258100] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-22T20:51:42.268016] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-10-22T20:51:42.350794] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-22T20:51:42.349502] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-22T20:51:42.363344] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-22T20:51:42.479273] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-22T20:51:42.517623] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-22T20:51:43.312393] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T20:51:43.317609] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-22T20:51:44.045980] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T20:51:44.117703] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-10-22T20:51:44.287956] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-22T20:51:44.525362] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-22T20:51:44.917716] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-22T20:51:45.717787] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-22T20:51:45.992793] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-22T20:51:46.223449] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-22T20:51:46.517744] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-10-22T20:51:47.317755] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-22T20:51:47.969519] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-22T20:51:48.117627] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-22T20:51:48.500068] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-22T20:51:48.917752] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-22T20:51:49.684350] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-22T20:51:49.717639] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-22T20:51:50.109376] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-22T20:51:50.252262] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-22T20:51:50.517689] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-22T20:51:51.317778] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-22T20:51:52.024032] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-22T20:51:52.117703] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-22T20:51:52.221667] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-22T20:51:52.224544] [INFO ] [REMOTE ] RIV: Full fetch complete (17544 records). [2025-10-22T20:51:52.224706] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-22T20:51:52.589729] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-10-22T20:51:52.589905] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-10-22T20:51:52.590344] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-10-22T20:51:52.590434] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-10-22T20:51:52.591222] [DEBUG] [LOCAL ] RIV: Trimmed 17544 records to 12627 (keeping 200 days of data) [2025-10-22T20:51:52.685230] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-22T20:51:52.711543] [DEBUG] [LOCAL ] RIV: Primary data saved (12627 records). [2025-10-22T20:51:52.711706] [INFO ] [MAIN ] RIV: Full history saved. [2025-10-22T20:51:52.711793] [INFO ] [MAIN ] Update Progress: 1801/2367 symbols completed. RIV took 17.5s. Estimated remaining: 1h 12m 51s. Rate: 7.8 symbols/min [2025-10-22T20:51:52.874718] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:51:52.917630] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-10-22T20:51:52.917564] [DEBUG] [LOCAL ] RJF: Loaded 46561 existing records from primary storage. [2025-10-22T20:51:52.918786] [INFO ] [MAIN ] RJF: Loaded 46561 existing records. [2025-10-22T20:51:53.094509] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:51:53.094758] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-22T20:51:53.094808] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-22T20:51:53.095034] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-10-22T20:51:53.095089] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-22T20:51:53.437740] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:51:53.717693] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-22T20:51:54.404322] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-22T20:51:54.517632] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-22T20:51:54.937356] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-22T20:51:55.317687] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-22T20:51:55.521756] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T20:51:56.117633] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-10-22T20:51:56.665542] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-22T20:51:56.917704] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-22T20:51:57.217280] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-22T20:51:57.717698] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-22T20:51:58.282022] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-22T20:51:58.517741] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-22T20:51:59.329011] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-10-22T20:51:59.352684] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-22T20:51:59.572016] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-22T20:52:00.117713] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-22T20:52:00.513014] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-22T20:52:00.917760] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-22T20:52:01.590815] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-22T20:52:01.717743] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-10-22T20:52:02.408213] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-22T20:52:02.517631] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-22T20:52:03.283618] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-22T20:52:03.317628] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-22T20:52:03.720391] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-22T20:52:04.117753] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-22T20:52:04.852449] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-22T20:52:04.917637] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-22T20:52:05.537409] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-22T20:52:05.546982] [INFO ] [REMOTE ] RIG: Full fetch complete (77844 records). [2025-10-22T20:52:05.547168] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-22T20:52:05.722986] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-10. [2025-10-22T20:52:06.166291] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-10-22T20:52:06.166421] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-10-22T20:52:06.168955] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-10-22T20:52:06.169095] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-10-22T20:52:06.171332] [DEBUG] [LOCAL ] RIG: Trimmed 77844 records to 53675 (keeping 200 days of data) [2025-10-22T20:52:06.318078] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-22T20:52:06.524714] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-22T20:52:06.577696] [DEBUG] [LOCAL ] RIG: Primary data saved (53675 records). [2025-10-22T20:52:06.577850] [INFO ] [MAIN ] RIG: Full history saved. [2025-10-22T20:52:06.577944] [INFO ] [MAIN ] Update Progress: 1802/2367 symbols completed. RIG took 31.4s. Estimated remaining: 1h 12m 45s. Rate: 7.8 symbols/min [2025-10-22T20:52:06.766810] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:52:06.815300] [DEBUG] [LOCAL ] RKT: Loaded 53729 existing records from primary storage. [2025-10-22T20:52:06.815613] [INFO ] [MAIN ] RKT: Loaded 53729 existing records. [2025-10-22T20:52:06.991757] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:52:06.992042] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-22T20:52:06.992101] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-22T20:52:06.992370] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-10-22T20:52:06.992424] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-22T20:52:07.366396] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:52:07.366798] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-22T20:52:07.392024] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-22T20:52:07.401298] [INFO ] [REMOTE ] RIO: Full fetch complete (77513 records). [2025-10-22T20:52:07.401449] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-22T20:52:07.795937] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-10-22T20:52:07.796082] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-10-22T20:52:07.797552] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-10-22T20:52:07.797730] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-10-22T20:52:07.799292] [DEBUG] [LOCAL ] RIO: Trimmed 77513 records to 53402 (keeping 200 days of data) [2025-10-22T20:52:08.055606] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-22T20:52:08.088968] [INFO ] [REMOTE ] RITM: Full fetch complete (76747 records). [2025-10-22T20:52:08.097008] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-10-22T20:52:08.384603] [DEBUG] [LOCAL ] RIO: Primary data saved (53402 records). [2025-10-22T20:52:08.384973] [INFO ] [MAIN ] RIO: Full history saved. [2025-10-22T20:52:08.399589] [INFO ] [MAIN ] Update Progress: 1803/2367 symbols completed. RIO took 33.2s. Estimated remaining: 1h 12m 36s. Rate: 7.8 symbols/min [2025-10-22T20:52:08.794987] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:52:08.799441] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-10-22T20:52:08.799949] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-10-22T20:52:08.801256] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-10-22T20:52:08.801433] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-10-22T20:52:08.834427] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-22T20:52:08.833197] [DEBUG] [LOCAL ] RITM: Trimmed 76747 records to 52945 (keeping 200 days of data) [2025-10-22T20:52:08.846115] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-22T20:52:09.000721] [DEBUG] [LOCAL ] RL: Loaded 39575 existing records from primary storage. [2025-10-22T20:52:09.001013] [INFO ] [MAIN ] RL: Loaded 39575 existing records. [2025-10-22T20:52:09.350133] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:52:09.358516] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-22T20:52:09.375450] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-22T20:52:09.386237] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-10-22T20:52:09.396064] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-22T20:52:09.403343] [DEBUG] [LOCAL ] RITM: Primary data saved (52945 records). [2025-10-22T20:52:09.453617] [INFO ] [MAIN ] RITM: Full history saved. [2025-10-22T20:52:09.470231] [INFO ] [MAIN ] Update Progress: 1804/2367 symbols completed. RITM took 34.3s. Estimated remaining: 1h 12m 26s. Rate: 7.8 symbols/min [2025-10-22T20:52:09.839479] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-22T20:52:09.928416] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:52:09.942377] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-22T20:52:10.031430] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:52:10.031855] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-22T20:52:10.056470] [DEBUG] [LOCAL ] RLI: Loaded 34734 existing records from primary storage. [2025-10-22T20:52:10.056817] [INFO ] [MAIN ] RLI: Loaded 34734 existing records. [2025-10-22T20:52:10.233508] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:52:10.233749] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-22T20:52:10.233801] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-22T20:52:10.233997] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-10-22T20:52:10.234035] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-22T20:52:10.592024] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:52:10.592501] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-22T20:52:10.754676] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T20:52:11.317698] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-22T20:52:11.883294] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-22T20:52:12.003285] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-22T20:52:12.068853] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T20:52:12.117722] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-22T20:52:12.917758] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-22T20:52:13.136663] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-22T20:52:13.639422] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T20:52:13.717697] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-22T20:52:14.517731] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-22T20:52:14.756578] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T20:52:15.274075] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T20:52:15.317614] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-22T20:52:16.117622] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-22T20:52:16.325186] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T20:52:16.917698] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-22T20:52:17.050229] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T20:52:17.717746] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-22T20:52:18.162796] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T20:52:18.517731] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-22T20:52:18.749411] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T20:52:19.317795] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-22T20:52:19.658134] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-22T20:52:19.895684] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-22T20:52:20.117765] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-22T20:52:20.917754] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-22T20:52:21.308744] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T20:52:21.717701] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-22T20:52:22.212326] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-22T20:52:22.327636] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T20:52:22.517734] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-22T20:52:23.317693] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-22T20:52:23.577131] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T20:52:24.117732] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-22T20:52:24.461445] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T20:52:24.890058] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T20:52:24.917610] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-22T20:52:25.717679] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-22T20:52:25.950992] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T20:52:26.517713] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-22T20:52:26.617295] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T20:52:27.317701] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-22T20:52:28.081797] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-22T20:52:28.117613] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-22T20:52:28.257874] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T20:52:28.265533] [INFO ] [REMOTE ] RJF: Full fetch complete (68884 records). [2025-10-22T20:52:28.265694] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-22T20:52:28.645053] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-10-22T20:52:28.645150] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-10-22T20:52:28.646201] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-10-22T20:52:28.646324] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-10-22T20:52:28.647605] [DEBUG] [LOCAL ] RJF: Trimmed 68884 records to 46546 (keeping 200 days of data) [2025-10-22T20:52:28.924745] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-22T20:52:28.937569] [DEBUG] [LOCAL ] RJF: Primary data saved (46546 records). [2025-10-22T20:52:28.937715] [INFO ] [MAIN ] RJF: Full history saved. [2025-10-22T20:52:28.937972] [INFO ] [MAIN ] Update Progress: 1805/2367 symbols completed. RJF took 36.2s. Estimated remaining: 1h 12m 22s. Rate: 7.8 symbols/min [2025-10-22T20:52:29.128113] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T20:52:29.130445] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:52:29.179339] [DEBUG] [LOCAL ] RLJ: Loaded 47968 existing records from primary storage. [2025-10-22T20:52:29.179805] [INFO ] [MAIN ] RLJ: Loaded 47968 existing records. [2025-10-22T20:52:29.357038] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:52:29.357302] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-22T20:52:29.357356] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-22T20:52:29.357639] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-10-22T20:52:29.357752] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-22T20:52:29.712037] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:52:29.717632] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-22T20:52:30.519418] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-22T20:52:30.524753] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-22T20:52:30.653753] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T20:52:31.317711] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-22T20:52:31.456460] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T20:52:32.117639] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-22T20:52:32.330671] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T20:52:32.917694] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-22T20:52:33.489874] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-22T20:52:33.717733] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-22T20:52:33.843384] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T20:52:34.526934] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-22T20:52:34.533283] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T20:52:35.265852] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T20:52:35.317632] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-22T20:52:36.117703] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-22T20:52:36.409169] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T20:52:36.781117] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T20:52:36.786671] [INFO ] [REMOTE ] RL: Full fetch complete (59277 records). [2025-10-22T20:52:36.786781] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-22T20:52:36.926961] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-22T20:52:37.164755] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-10-22T20:52:37.164834] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-10-22T20:52:37.165791] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-10-22T20:52:37.165851] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-10-22T20:52:37.166914] [DEBUG] [LOCAL ] RL: Trimmed 59277 records to 39350 (keeping 200 days of data) [2025-10-22T20:52:37.403590] [DEBUG] [LOCAL ] RL: Primary data saved (39350 records). [2025-10-22T20:52:37.403746] [INFO ] [MAIN ] RL: Full history saved. [2025-10-22T20:52:37.403829] [INFO ] [MAIN ] Update Progress: 1806/2367 symbols completed. RL took 29.0s. Estimated remaining: 1h 12m 14s. Rate: 7.8 symbols/min [2025-10-22T20:52:37.567101] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:52:37.578090] [DEBUG] [LOCAL ] RLTY: Loaded 11133 existing records from primary storage. [2025-10-22T20:52:37.578289] [INFO ] [MAIN ] RLTY: Loaded 11133 existing records. [2025-10-22T20:52:37.727398] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-22T20:52:37.756784] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:52:37.758465] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-22T20:52:37.758516] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-22T20:52:37.758729] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-10-22T20:52:37.758784] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-22T20:52:38.104326] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:52:38.319063] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-22T20:52:38.327821] [INFO ] [REMOTE ] RKT: Full fetch complete (77604 records). [2025-10-22T20:52:38.327949] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-22T20:52:38.522793] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-22T20:52:38.720283] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-10-22T20:52:38.720491] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-10-22T20:52:38.721727] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-10-22T20:52:38.721810] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-10-22T20:52:38.723582] [DEBUG] [LOCAL ] RKT: Trimmed 77604 records to 53729 (keeping 200 days of data) [2025-10-22T20:52:38.836409] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T20:52:39.105496] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T20:52:39.116218] [DEBUG] [LOCAL ] RKT: Primary data saved (53729 records). [2025-10-22T20:52:39.116518] [INFO ] [MAIN ] RKT: Full history saved. [2025-10-22T20:52:39.116925] [INFO ] [MAIN ] Update Progress: 1807/2367 symbols completed. RKT took 32.5s. Estimated remaining: 1h 12m 5s. Rate: 7.8 symbols/min [2025-10-22T20:52:39.284563] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:52:39.323070] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-22T20:52:39.326347] [DEBUG] [LOCAL ] RLX: Loaded 48166 existing records from primary storage. [2025-10-22T20:52:39.326735] [INFO ] [MAIN ] RLX: Loaded 48166 existing records. [2025-10-22T20:52:39.504183] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:52:39.504393] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-22T20:52:39.504447] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-22T20:52:39.504886] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-10-22T20:52:39.504941] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-22T20:52:39.788985] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-22T20:52:39.870532] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:52:40.117715] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-22T20:52:40.917738] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-22T20:52:40.987967] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T20:52:40.994804] [INFO ] [REMOTE ] RLI: Full fetch complete (49442 records). [2025-10-22T20:52:40.994934] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-22T20:52:41.363277] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-10-22T20:52:41.363355] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-10-22T20:52:41.364257] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-10-22T20:52:41.364318] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-10-22T20:52:41.365268] [DEBUG] [LOCAL ] RLI: Trimmed 49442 records to 34703 (keeping 200 days of data) [2025-10-22T20:52:41.572343] [DEBUG] [LOCAL ] RLI: Primary data saved (34703 records). [2025-10-22T20:52:41.572455] [INFO ] [MAIN ] RLI: Full history saved. [2025-10-22T20:52:41.572529] [INFO ] [MAIN ] Update Progress: 1808/2367 symbols completed. RLI took 32.1s. Estimated remaining: 1h 11m 55s. Rate: 7.8 symbols/min [2025-10-22T20:52:41.722738] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-22T20:52:41.747817] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:52:41.756566] [DEBUG] [LOCAL ] RM: Loaded 7555 existing records from primary storage. [2025-10-22T20:52:41.756782] [INFO ] [MAIN ] RM: Loaded 7555 existing records. [2025-10-22T20:52:41.937079] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:52:41.937465] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-22T20:52:41.937544] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-22T20:52:41.937752] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-10-22T20:52:41.937816] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-22T20:52:42.062709] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T20:52:42.326719] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:52:42.400514] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-22T20:52:42.517610] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-22T20:52:42.767937] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T20:52:43.317703] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-22T20:52:44.117705] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-22T20:52:44.319699] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T20:52:44.379624] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-22T20:52:44.917624] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-22T20:52:45.717633] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-22T20:52:45.918117] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-22T20:52:45.961523] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T20:52:46.428466] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-22T20:52:46.517708] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-22T20:52:47.317686] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-22T20:52:47.453549] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-22T20:52:48.117724] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-22T20:52:48.917635] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-22T20:52:49.003094] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T20:52:49.190293] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T20:52:49.717693] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-22T20:52:50.517753] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-22T20:52:50.632474] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T20:52:50.654255] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T20:52:51.317767] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-22T20:52:52.117706] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-22T20:52:52.371855] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T20:52:52.917709] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-22T20:52:53.017410] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T20:52:53.072347] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T20:52:53.717739] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-22T20:52:53.818555] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-22T20:52:54.517716] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-22T20:52:54.681200] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-22T20:52:55.317695] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-22T20:52:55.445412] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-22T20:52:56.117719] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-22T20:52:56.917733] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-22T20:52:57.030460] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T20:52:57.717760] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-22T20:52:57.825361] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T20:52:57.923264] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T20:52:58.517733] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-22T20:52:59.320794] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-22T20:52:59.323525] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T20:52:59.332157] [INFO ] [REMOTE ] RLJ: Full fetch complete (69429 records). [2025-10-22T20:52:59.332286] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-22T20:52:59.464216] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-22T20:52:59.765256] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-10-22T20:52:59.765344] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-10-22T20:52:59.766425] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-10-22T20:52:59.766495] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-10-22T20:52:59.767873] [DEBUG] [LOCAL ] RLJ: Trimmed 69429 records to 47956 (keeping 200 days of data) [2025-10-22T20:53:00.039105] [DEBUG] [LOCAL ] RLJ: Primary data saved (47956 records). [2025-10-22T20:53:00.039234] [INFO ] [MAIN ] RLJ: Full history saved. [2025-10-22T20:53:00.039315] [INFO ] [MAIN ] Update Progress: 1809/2367 symbols completed. RLJ took 31.1s. Estimated remaining: 1h 11m 51s. Rate: 7.8 symbols/min [2025-10-22T20:53:00.127865] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-22T20:53:00.207267] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:53:00.227500] [DEBUG] [LOCAL ] RMAX: Loaded 21668 existing records from primary storage. [2025-10-22T20:53:00.227783] [INFO ] [MAIN ] RMAX: Loaded 21668 existing records. [2025-10-22T20:53:00.403697] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:53:00.403973] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-22T20:53:00.404034] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-22T20:53:00.404239] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-10-22T20:53:00.404298] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-22T20:53:00.766386] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:53:00.917719] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-22T20:53:01.205721] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-22T20:53:01.291080] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-22T20:53:01.717711] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-10-22T20:53:01.920280] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-22T20:53:02.517703] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-22T20:53:02.676228] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-22T20:53:03.317705] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-22T20:53:03.433956] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-22T20:53:04.117746] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-22T20:53:04.532811] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T20:53:04.917726] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-10. [2025-10-22T20:53:04.951329] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T20:53:05.717748] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-22T20:53:05.904917] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T20:53:05.907058] [INFO ] [REMOTE ] RLTY: Full fetch complete (17245 records). [2025-10-22T20:53:05.907128] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-10-22T20:53:06.258313] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-10-22T20:53:06.258386] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-10-22T20:53:06.258767] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-10-22T20:53:06.258829] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-10-22T20:53:06.259337] [DEBUG] [LOCAL ] RLTY: Trimmed 17245 records to 10963 (keeping 200 days of data) [2025-10-22T20:53:06.324352] [DEBUG] [LOCAL ] RLTY: Primary data saved (10963 records). [2025-10-22T20:53:06.324469] [INFO ] [MAIN ] RLTY: Full history saved. [2025-10-22T20:53:06.324545] [INFO ] [MAIN ] Update Progress: 1810/2367 symbols completed. RLTY took 28.9s. Estimated remaining: 1h 11m 43s. Rate: 7.8 symbols/min [2025-10-22T20:53:06.491393] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:53:06.525317] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-22T20:53:06.527797] [DEBUG] [LOCAL ] RMD: Loaded 41958 existing records from primary storage. [2025-10-22T20:53:06.528038] [INFO ] [MAIN ] RMD: Loaded 41958 existing records. [2025-10-22T20:53:06.638421] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-22T20:53:06.687791] [INFO ] [REMOTE ] RM: Full fetch complete (11480 records). [2025-10-22T20:53:06.717165] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-22T20:53:06.717098] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:53:06.764681] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-22T20:53:06.797091] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-22T20:53:06.822699] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-10-22T20:53:06.825619] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-22T20:53:07.319480] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-22T20:53:07.378777] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-10-22T20:53:07.394677] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-10-22T20:53:07.400110] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-10-22T20:53:07.428988] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-10-22T20:53:07.438363] [DEBUG] [LOCAL ] RM: Trimmed 11480 records to 7508 (keeping 200 days of data) [2025-10-22T20:53:07.459019] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:53:07.504741] [DEBUG] [LOCAL ] RM: Primary data saved (7508 records). [2025-10-22T20:53:07.504874] [INFO ] [MAIN ] RM: Full history saved. [2025-10-22T20:53:07.504970] [INFO ] [MAIN ] Update Progress: 1811/2367 symbols completed. RM took 25.9s. Estimated remaining: 1h 11m 33s. Rate: 7.8 symbols/min [2025-10-22T20:53:07.673788] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:53:07.680887] [DEBUG] [LOCAL ] RMI: Loaded 4731 existing records from primary storage. [2025-10-22T20:53:07.681084] [INFO ] [MAIN ] RMI: Loaded 4731 existing records. [2025-10-22T20:53:07.858038] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:53:07.858274] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-22T20:53:07.858329] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-22T20:53:07.858536] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-10-22T20:53:07.858610] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-22T20:53:08.122832] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-22T20:53:08.221961] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:53:08.527484] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-22T20:53:08.659332] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T20:53:08.917698] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-22T20:53:09.717788] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-22T20:53:10.084803] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-22T20:53:10.113031] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-22T20:53:10.517692] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-22T20:53:11.317637] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-22T20:53:11.703785] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T20:53:11.761300] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-22T20:53:11.971864] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-22T20:53:12.117678] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-22T20:53:12.917719] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-22T20:53:13.360438] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T20:53:13.717718] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-22T20:53:14.347877] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-22T20:53:14.517625] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-22T20:53:14.706035] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T20:53:15.237281] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-22T20:53:15.317727] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-22T20:53:15.832140] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-22T20:53:16.117724] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-22T20:53:16.917706] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-22T20:53:17.717705] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-22T20:53:17.876968] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-22T20:53:17.888141] [INFO ] [REMOTE ] RLX: Full fetch complete (70138 records). [2025-10-22T20:53:17.888305] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-22T20:53:18.266386] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-10-22T20:53:18.266595] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-10-22T20:53:18.271141] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-22T20:53:18.272534] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-10-22T20:53:18.272714] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-10-22T20:53:18.275977] [DEBUG] [LOCAL ] RLX: Trimmed 70138 records to 48165 (keeping 200 days of data) [2025-10-22T20:53:18.504863] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T20:53:18.518802] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-22T20:53:18.593335] [DEBUG] [LOCAL ] RLX: Primary data saved (48165 records). [2025-10-22T20:53:18.593468] [INFO ] [MAIN ] RLX: Full history saved. [2025-10-22T20:53:18.593546] [INFO ] [MAIN ] Update Progress: 1812/2367 symbols completed. RLX took 39.5s. Estimated remaining: 1h 11m 26s. Rate: 7.8 symbols/min [2025-10-22T20:53:18.762478] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:53:18.774686] [DEBUG] [LOCAL ] RMM: Loaded 10888 existing records from primary storage. [2025-10-22T20:53:18.774915] [INFO ] [MAIN ] RMM: Loaded 10888 existing records. [2025-10-22T20:53:18.947590] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:53:18.947841] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-22T20:53:18.947888] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-22T20:53:18.948056] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-10-22T20:53:18.948111] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-22T20:53:19.298711] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:53:19.317616] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-22T20:53:19.827145] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T20:53:20.117736] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-22T20:53:20.253549] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T20:53:20.917749] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-22T20:53:21.464627] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T20:53:21.717630] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-22T20:53:21.729486] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T20:53:22.517715] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-22T20:53:23.317741] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-22T20:53:23.425050] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-22T20:53:23.633632] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T20:53:24.117730] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-22T20:53:24.217194] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-22T20:53:24.643610] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-22T20:53:24.917760] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-22T20:53:25.717639] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-10. [2025-10-22T20:53:25.870976] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-22T20:53:26.517618] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-22T20:53:26.897893] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T20:53:26.901297] [INFO ] [REMOTE ] RMAX: Full fetch complete (29903 records). [2025-10-22T20:53:26.901374] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-10-22T20:53:27.010268] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-22T20:53:27.267538] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-10-22T20:53:27.267612] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-10-22T20:53:27.268192] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-10-22T20:53:27.268237] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-10-22T20:53:27.268943] [DEBUG] [LOCAL ] RMAX: Trimmed 29903 records to 21614 (keeping 200 days of data) [2025-10-22T20:53:27.321597] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-22T20:53:27.388676] [DEBUG] [LOCAL ] RMAX: Primary data saved (21614 records). [2025-10-22T20:53:27.388805] [INFO ] [MAIN ] RMAX: Full history saved. [2025-10-22T20:53:27.388882] [INFO ] [MAIN ] Update Progress: 1813/2367 symbols completed. RMAX took 27.3s. Estimated remaining: 1h 11m 19s. Rate: 7.8 symbols/min [2025-10-22T20:53:27.556352] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:53:27.563401] [DEBUG] [LOCAL ] RMMZ: Loaded 4789 existing records from primary storage. [2025-10-22T20:53:27.563580] [INFO ] [MAIN ] RMMZ: Loaded 4789 existing records. [2025-10-22T20:53:27.734863] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:53:27.735060] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-22T20:53:27.735107] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-22T20:53:27.735244] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-10-22T20:53:27.735294] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-22T20:53:28.080591] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:53:28.117616] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-22T20:53:28.252304] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T20:53:28.857544] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-22T20:53:28.917626] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-22T20:53:29.564675] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T20:53:29.717753] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-22T20:53:30.428510] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-22T20:53:30.517622] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-22T20:53:31.240045] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-22T20:53:31.317725] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-22T20:53:32.117690] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-22T20:53:32.917751] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-22T20:53:33.016282] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-22T20:53:33.292236] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T20:53:33.682423] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-22T20:53:33.717692] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-22T20:53:34.517637] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-22T20:53:34.708546] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T20:53:35.317703] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-22T20:53:36.117694] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-22T20:53:36.155850] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T20:53:36.173407] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T20:53:36.917734] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-22T20:53:37.177393] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T20:53:37.412363] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-22T20:53:37.717744] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-22T20:53:38.517735] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-22T20:53:38.538775] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-22T20:53:38.540912] [INFO ] [REMOTE ] RMM: Full fetch complete (14808 records). [2025-10-22T20:53:38.540980] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-22T20:53:38.895344] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-10-22T20:53:38.895450] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-10-22T20:53:38.895810] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-10-22T20:53:38.895871] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-10-22T20:53:38.896331] [DEBUG] [LOCAL ] RMM: Trimmed 14808 records to 10866 (keeping 200 days of data) [2025-10-22T20:53:38.959993] [DEBUG] [LOCAL ] RMM: Primary data saved (10866 records). [2025-10-22T20:53:38.960126] [INFO ] [MAIN ] RMM: Full history saved. [2025-10-22T20:53:38.960201] [INFO ] [MAIN ] Update Progress: 1814/2367 symbols completed. RMM took 20.4s. Estimated remaining: 1h 11m 12s. Rate: 7.8 symbols/min [2025-10-22T20:53:39.125168] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:53:39.142157] [DEBUG] [LOCAL ] RMT: Loaded 17254 existing records from primary storage. [2025-10-22T20:53:39.142377] [INFO ] [MAIN ] RMT: Loaded 17254 existing records. [2025-10-22T20:53:39.247762] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-22T20:53:39.324473] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:53:39.324584] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-22T20:53:39.325070] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-22T20:53:39.325173] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-22T20:53:39.326247] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-10-22T20:53:39.326307] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-22T20:53:39.736400] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:53:40.117721] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-22T20:53:40.183217] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T20:53:40.917731] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-22T20:53:41.577405] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T20:53:41.651833] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-22T20:53:41.653318] [INFO ] [REMOTE ] RMI: Full fetch complete (6090 records). [2025-10-22T20:53:41.654321] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-22T20:53:41.723482] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-10-22T20:53:42.028984] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-10-22T20:53:42.029085] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-10-22T20:53:42.029292] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-10-22T20:53:42.029338] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-10-22T20:53:42.029804] [DEBUG] [LOCAL ] RMI: Trimmed 6090 records to 4769 (keeping 200 days of data) [2025-10-22T20:53:42.059759] [DEBUG] [LOCAL ] RMI: Primary data saved (4769 records). [2025-10-22T20:53:42.059901] [INFO ] [MAIN ] RMI: Full history saved. [2025-10-22T20:53:42.059981] [INFO ] [MAIN ] Update Progress: 1815/2367 symbols completed. RMI took 34.6s. Estimated remaining: 1h 11m 3s. Rate: 7.8 symbols/min [2025-10-22T20:53:42.234863] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:53:42.278481] [DEBUG] [LOCAL ] RNG: Loaded 48007 existing records from primary storage. [2025-10-22T20:53:42.278846] [INFO ] [MAIN ] RNG: Loaded 48007 existing records. [2025-10-22T20:53:42.470107] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:53:42.470299] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-22T20:53:42.470346] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-22T20:53:42.470530] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-10-22T20:53:42.470569] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-22T20:53:42.528530] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-22T20:53:42.715153] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T20:53:42.875988] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:53:43.317708] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-10-22T20:53:43.603477] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-22T20:53:44.117224] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-22T20:53:44.117628] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-22T20:53:44.917729] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-22T20:53:45.304332] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-22T20:53:45.717704] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-22T20:53:46.517630] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-10-22T20:53:46.830340] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T20:53:46.868233] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T20:53:47.208083] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-22T20:53:47.317702] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-10. [2025-10-22T20:53:48.018071] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-22T20:53:48.019328] [INFO ] [REMOTE ] RMMZ: Full fetch complete (6587 records). [2025-10-22T20:53:48.019419] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-10-22T20:53:48.122732] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-22T20:53:48.390838] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-10-22T20:53:48.390917] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-10-22T20:53:48.391109] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-10-22T20:53:48.391149] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-10-22T20:53:48.391543] [DEBUG] [LOCAL ] RMMZ: Trimmed 6587 records to 4798 (keeping 200 days of data) [2025-10-22T20:53:48.420779] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4798 records). [2025-10-22T20:53:48.420905] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-10-22T20:53:48.420984] [INFO ] [MAIN ] Update Progress: 1816/2367 symbols completed. RMMZ took 21.0s. Estimated remaining: 1h 10m 55s. Rate: 7.8 symbols/min [2025-10-22T20:53:48.591228] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:53:48.613929] [DEBUG] [LOCAL ] RNGR: Loaded 20828 existing records from primary storage. [2025-10-22T20:53:48.614182] [INFO ] [MAIN ] RNGR: Loaded 20828 existing records. [2025-10-22T20:53:48.792030] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:53:48.792234] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-22T20:53:48.792279] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-22T20:53:48.792476] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-10-22T20:53:48.792532] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-22T20:53:48.932934] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-22T20:53:49.149663] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:53:49.373455] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T20:53:49.717744] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-22T20:53:50.517772] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-22T20:53:50.732093] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-22T20:53:50.801836] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T20:53:51.317725] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-22T20:53:51.748203] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T20:53:52.117710] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-22T20:53:52.459496] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-22T20:53:52.917759] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-22T20:53:53.717739] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-22T20:53:53.759864] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T20:53:54.517690] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-22T20:53:54.654470] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-22T20:53:54.813429] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-22T20:53:55.317708] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-22T20:53:55.468568] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-22T20:53:56.117747] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-22T20:53:56.482267] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T20:53:56.917726] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-22T20:53:57.717631] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-22T20:53:57.854999] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T20:53:57.975576] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T20:53:58.517716] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-22T20:53:58.972740] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T20:53:59.317777] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-22T20:53:59.582757] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T20:53:59.586318] [INFO ] [REMOTE ] RMT: Full fetch complete (25521 records). [2025-10-22T20:53:59.586397] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-22T20:53:59.958333] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-10-22T20:53:59.958413] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-10-22T20:53:59.958963] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-10-22T20:53:59.959025] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-10-22T20:53:59.959679] [DEBUG] [LOCAL ] RMT: Trimmed 25521 records to 17151 (keeping 200 days of data) [2025-10-22T20:54:00.075611] [DEBUG] [LOCAL ] RMT: Primary data saved (17151 records). [2025-10-22T20:54:00.075824] [INFO ] [MAIN ] RMT: Full history saved. [2025-10-22T20:54:00.075943] [INFO ] [MAIN ] Update Progress: 1817/2367 symbols completed. RMT took 21.1s. Estimated remaining: 1h 10m 48s. Rate: 7.8 symbols/min [2025-10-22T20:54:00.122880] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-22T20:54:00.249032] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:54:00.264304] [DEBUG] [LOCAL ] RNP: Loaded 16036 existing records from primary storage. [2025-10-22T20:54:00.264537] [INFO ] [MAIN ] RNP: Loaded 16036 existing records. [2025-10-22T20:54:00.436919] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:54:00.437152] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-22T20:54:00.437201] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-22T20:54:00.437410] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-10-22T20:54:00.437449] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-22T20:54:00.784454] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:54:00.917758] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-22T20:54:00.981608] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T20:54:01.596635] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T20:54:01.717728] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-22T20:54:02.059985] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T20:54:02.517683] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-22T20:54:03.317715] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-22T20:54:03.405954] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T20:54:04.117634] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-22T20:54:04.368546] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T20:54:04.434249] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T20:54:04.917883] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-22T20:54:05.565332] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T20:54:05.717691] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-22T20:54:06.067113] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T20:54:06.517632] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-22T20:54:07.114596] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T20:54:07.317694] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-22T20:54:08.117756] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-22T20:54:08.368014] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T20:54:08.917688] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-22T20:54:09.035123] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T20:54:09.042186] [INFO ] [REMOTE ] RMD: Full fetch complete (61673 records). [2025-10-22T20:54:09.042313] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-22T20:54:09.401850] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-22T20:54:09.443553] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-10-22T20:54:09.444052] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-10-22T20:54:09.445134] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-10-22T20:54:09.445200] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-10-22T20:54:09.446463] [DEBUG] [LOCAL ] RMD: Trimmed 61673 records to 41879 (keeping 200 days of data) [2025-10-22T20:54:09.702857] [DEBUG] [LOCAL ] RMD: Primary data saved (41879 records). [2025-10-22T20:54:09.702989] [INFO ] [MAIN ] RMD: Full history saved. [2025-10-22T20:54:09.703724] [INFO ] [MAIN ] Update Progress: 1818/2367 symbols completed. RMD took 1m 3s. Estimated remaining: 1h 10m 41s. Rate: 7.8 symbols/min [2025-10-22T20:54:09.724160] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-22T20:54:09.876670] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:54:09.909501] [DEBUG] [LOCAL ] RNR: Loaded 33624 existing records from primary storage. [2025-10-22T20:54:09.909802] [INFO ] [MAIN ] RNR: Loaded 33624 existing records. [2025-10-22T20:54:10.129634] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:54:10.129878] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-22T20:54:10.129930] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-22T20:54:10.131042] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-10-22T20:54:10.131112] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-22T20:54:10.493206] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:54:10.517615] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-22T20:54:10.648982] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T20:54:10.978272] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T20:54:11.317711] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-22T20:54:12.117720] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-22T20:54:12.313241] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T20:54:12.917746] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-22T20:54:13.245567] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-22T20:54:13.287757] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T20:54:13.291351] [INFO ] [REMOTE ] RNGR: Full fetch complete (28499 records). [2025-10-22T20:54:13.291424] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-22T20:54:13.655200] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-10-22T20:54:13.655286] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-10-22T20:54:13.655883] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-10-22T20:54:13.655944] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-10-22T20:54:13.656767] [DEBUG] [LOCAL ] RNGR: Trimmed 28499 records to 20718 (keeping 200 days of data) [2025-10-22T20:54:13.742123] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-22T20:54:13.785768] [DEBUG] [LOCAL ] RNGR: Primary data saved (20718 records). [2025-10-22T20:54:13.785896] [INFO ] [MAIN ] RNGR: Full history saved. [2025-10-22T20:54:13.785973] [INFO ] [MAIN ] Update Progress: 1819/2367 symbols completed. RNGR took 25.4s. Estimated remaining: 1h 10m 33s. Rate: 7.8 symbols/min [2025-10-22T20:54:13.963297] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:54:13.996203] [DEBUG] [LOCAL ] RNST: Loaded 36011 existing records from primary storage. [2025-10-22T20:54:13.996475] [INFO ] [MAIN ] RNST: Loaded 36011 existing records. [2025-10-22T20:54:14.137106] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T20:54:14.197375] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:54:14.197567] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-22T20:54:14.197615] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-22T20:54:14.197892] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-10-22T20:54:14.197948] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-22T20:54:14.524833] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-22T20:54:14.555495] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:54:15.317778] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-22T20:54:15.554044] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T20:54:16.117753] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-22T20:54:16.405680] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T20:54:16.467131] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T20:54:16.917699] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-22T20:54:17.347994] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T20:54:17.717730] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-22T20:54:18.374464] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T20:54:18.517724] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-22T20:54:19.317797] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-22T20:54:19.612187] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T20:54:19.983019] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T20:54:20.117617] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-22T20:54:20.467338] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-22T20:54:20.917631] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-22T20:54:21.717630] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-22T20:54:21.929913] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T20:54:22.409079] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T20:54:22.517728] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-22T20:54:23.317726] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-22T20:54:23.576084] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T20:54:23.584256] [INFO ] [REMOTE ] RNG: Full fetch complete (69951 records). [2025-10-22T20:54:23.584371] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-22T20:54:23.994638] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-10-22T20:54:23.994772] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-10-22T20:54:23.995954] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-10-22T20:54:23.996040] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-10-22T20:54:23.997473] [DEBUG] [LOCAL ] RNG: Trimmed 69951 records to 47979 (keeping 200 days of data) [2025-10-22T20:54:24.074512] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T20:54:24.120913] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-22T20:54:24.308018] [DEBUG] [LOCAL ] RNG: Primary data saved (47979 records). [2025-10-22T20:54:24.308162] [INFO ] [MAIN ] RNG: Full history saved. [2025-10-22T20:54:24.308244] [INFO ] [MAIN ] Update Progress: 1820/2367 symbols completed. RNG took 42.2s. Estimated remaining: 1h 10m 26s. Rate: 7.8 symbols/min [2025-10-22T20:54:24.474051] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:54:24.492764] [DEBUG] [LOCAL ] ROG: Loaded 21822 existing records from primary storage. [2025-10-22T20:54:24.492990] [INFO ] [MAIN ] ROG: Loaded 21822 existing records. [2025-10-22T20:54:24.674311] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:54:24.674517] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-22T20:54:24.674567] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-22T20:54:24.674774] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-10-22T20:54:24.674831] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-22T20:54:24.919814] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-22T20:54:25.040316] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:54:25.133276] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T20:54:25.221188] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-22T20:54:25.717631] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-22T20:54:26.092133] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T20:54:26.517689] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-22T20:54:27.056361] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-22T20:54:27.317742] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-22T20:54:27.897563] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T20:54:28.117736] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-10-22T20:54:28.149085] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T20:54:28.917695] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-22T20:54:29.430210] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-22T20:54:29.717687] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-10-22T20:54:30.276334] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T20:54:30.517682] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-22T20:54:30.863833] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T20:54:31.317621] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-22T20:54:31.620211] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T20:54:32.117760] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-10-22T20:54:32.401152] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T20:54:32.917686] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-22T20:54:33.717693] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-22T20:54:33.772825] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T20:54:33.790206] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-22T20:54:34.517704] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-10-22T20:54:34.966359] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T20:54:34.972295] [INFO ] [REMOTE ] RNR: Full fetch complete (50996 records). [2025-10-22T20:54:34.972448] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-22T20:54:35.329378] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-22T20:54:35.348044] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-10-22T20:54:35.348103] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-10-22T20:54:35.349063] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-10-22T20:54:35.349227] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-10-22T20:54:35.350311] [DEBUG] [LOCAL ] RNR: Trimmed 50996 records to 33518 (keeping 200 days of data) [2025-10-22T20:54:35.551693] [DEBUG] [LOCAL ] RNR: Primary data saved (33518 records). [2025-10-22T20:54:35.551820] [INFO ] [MAIN ] RNR: Full history saved. [2025-10-22T20:54:35.551901] [INFO ] [MAIN ] Update Progress: 1821/2367 symbols completed. RNR took 25.8s. Estimated remaining: 1h 10m 19s. Rate: 7.8 symbols/min [2025-10-22T20:54:35.730397] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:54:35.751776] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T20:54:35.793976] [DEBUG] [LOCAL ] ROK: Loaded 42879 existing records from primary storage. [2025-10-22T20:54:35.794371] [INFO ] [MAIN ] ROK: Loaded 42879 existing records. [2025-10-22T20:54:35.972723] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:54:35.972962] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-22T20:54:35.973008] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-22T20:54:35.973366] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-10-22T20:54:35.973421] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-22T20:54:36.122875] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-10. [2025-10-22T20:54:36.329634] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:54:36.522366] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T20:54:36.525919] [INFO ] [REMOTE ] RNP: Full fetch complete (23431 records). [2025-10-22T20:54:36.525996] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-22T20:54:36.887967] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-10-22T20:54:36.888034] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-10-22T20:54:36.888499] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-10-22T20:54:36.888537] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-10-22T20:54:36.889234] [DEBUG] [LOCAL ] RNP: Trimmed 23431 records to 15933 (keeping 200 days of data) [2025-10-22T20:54:36.929478] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-22T20:54:36.988142] [DEBUG] [LOCAL ] RNP: Primary data saved (15933 records). [2025-10-22T20:54:36.988252] [INFO ] [MAIN ] RNP: Full history saved. [2025-10-22T20:54:36.988327] [INFO ] [MAIN ] Update Progress: 1822/2367 symbols completed. RNP took 36.9s. Estimated remaining: 1h 10m 9s. Rate: 7.8 symbols/min [2025-10-22T20:54:37.153721] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:54:37.196684] [DEBUG] [LOCAL ] ROL: Loaded 50278 existing records from primary storage. [2025-10-22T20:54:37.196980] [INFO ] [MAIN ] ROL: Loaded 50278 existing records. [2025-10-22T20:54:37.396955] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:54:37.397201] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-22T20:54:37.397260] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-22T20:54:37.397477] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-10-22T20:54:37.397533] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-22T20:54:37.735747] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T20:54:37.735231] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-22T20:54:37.769952] [INFO ] [REMOTE ] RNST: Full fetch complete (52782 records). [2025-10-22T20:54:37.795712] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-10-22T20:54:37.798679] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:54:38.153119] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T20:54:38.191381] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-10-22T20:54:38.191470] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-10-22T20:54:38.192412] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-10-22T20:54:38.192473] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-10-22T20:54:38.193541] [DEBUG] [LOCAL ] RNST: Trimmed 52782 records to 35883 (keeping 200 days of data) [2025-10-22T20:54:38.420075] [DEBUG] [LOCAL ] RNST: Primary data saved (35883 records). [2025-10-22T20:54:38.420239] [INFO ] [MAIN ] RNST: Full history saved. [2025-10-22T20:54:38.420328] [INFO ] [MAIN ] Update Progress: 1823/2367 symbols completed. RNST took 24.6s. Estimated remaining: 1h 9m 60s. Rate: 7.8 symbols/min [2025-10-22T20:54:38.518822] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-22T20:54:38.591379] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:54:38.632451] [DEBUG] [LOCAL ] RPM: Loaded 42107 existing records from primary storage. [2025-10-22T20:54:38.632781] [INFO ] [MAIN ] RPM: Loaded 42107 existing records. [2025-10-22T20:54:38.805114] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:54:38.805312] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-22T20:54:38.805357] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-22T20:54:38.805792] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-10-22T20:54:38.805846] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-22T20:54:39.153920] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:54:39.179348] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T20:54:39.317618] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-22T20:54:39.800962] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T20:54:40.117718] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-22T20:54:40.578927] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T20:54:40.917745] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-22T20:54:41.491569] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T20:54:41.717690] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-22T20:54:42.517761] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-22T20:54:42.862540] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-22T20:54:42.916529] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-22T20:54:43.317757] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-22T20:54:44.117753] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-22T20:54:44.369855] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-22T20:54:44.917691] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-22T20:54:45.063604] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-10-22T20:54:45.717762] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-22T20:54:45.930992] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T20:54:46.517746] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-22T20:54:47.239800] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-22T20:54:47.317625] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-22T20:54:47.788731] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-22T20:54:47.927715] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T20:54:48.117630] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-22T20:54:48.929227] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-22T20:54:48.931745] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T20:54:49.717632] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-22T20:54:50.116837] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T20:54:50.224800] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-22T20:54:50.517764] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-22T20:54:51.317685] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-22T20:54:51.631723] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-22T20:54:52.117702] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-22T20:54:52.241711] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T20:54:52.917623] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-22T20:54:53.268420] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T20:54:53.324920] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T20:54:53.717706] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-22T20:54:54.517639] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-22T20:54:54.867363] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T20:54:55.317691] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-22T20:54:55.508033] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T20:54:55.510885] [INFO ] [REMOTE ] ROG: Full fetch complete (30749 records). [2025-10-22T20:54:55.511064] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-22T20:54:55.828499] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-22T20:54:55.919694] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-10-22T20:54:55.919776] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-10-22T20:54:55.920392] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-10-22T20:54:55.920431] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-10-22T20:54:55.921118] [DEBUG] [LOCAL ] ROG: Trimmed 30749 records to 21642 (keeping 200 days of data) [2025-10-22T20:54:56.043223] [DEBUG] [LOCAL ] ROG: Primary data saved (21642 records). [2025-10-22T20:54:56.043342] [INFO ] [MAIN ] ROG: Full history saved. [2025-10-22T20:54:56.043418] [INFO ] [MAIN ] Update Progress: 1824/2367 symbols completed. ROG took 31.7s. Estimated remaining: 1h 9m 55s. Rate: 7.8 symbols/min [2025-10-22T20:54:56.122813] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-22T20:54:56.215260] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:54:56.233267] [DEBUG] [LOCAL ] RPT: Loaded 19031 existing records from primary storage. [2025-10-22T20:54:56.233513] [INFO ] [MAIN ] RPT: Loaded 19031 existing records. [2025-10-22T20:54:56.409790] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:54:56.409985] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-22T20:54:56.410033] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-22T20:54:56.410199] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-10-22T20:54:56.410238] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-22T20:54:56.758828] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:54:56.917634] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-22T20:54:57.717709] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-22T20:54:57.844397] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T20:54:58.039019] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T20:54:58.070223] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-22T20:54:58.517712] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-22T20:54:59.317631] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-22T20:54:59.638889] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-22T20:55:00.117638] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-10-22T20:55:00.316899] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T20:55:00.538862] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T20:55:00.917630] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-22T20:55:01.717807] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-22T20:55:02.079446] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T20:55:02.517759] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-10-22T20:55:02.980274] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-22T20:55:03.003774] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-22T20:55:03.317701] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-22T20:55:04.117636] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-22T20:55:04.514906] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-22T20:55:04.917700] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-22T20:55:04.984089] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-22T20:55:05.717702] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-22T20:55:06.094577] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T20:55:06.517712] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-10-22T20:55:06.797284] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T20:55:06.882695] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T20:55:07.317692] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-22T20:55:08.117627] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-22T20:55:08.224886] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T20:55:08.917677] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-10. [2025-10-22T20:55:09.515485] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-22T20:55:09.717695] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-22T20:55:10.151688] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-22T20:55:10.304778] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T20:55:10.311456] [INFO ] [REMOTE ] ROK: Full fetch complete (62695 records). [2025-10-22T20:55:10.311594] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-10-22T20:55:10.526762] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-22T20:55:10.710305] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-10-22T20:55:10.710407] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-10-22T20:55:10.711470] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-10-22T20:55:10.711535] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-10-22T20:55:10.712989] [DEBUG] [LOCAL ] ROK: Trimmed 62695 records to 42806 (keeping 200 days of data) [2025-10-22T20:55:10.982026] [DEBUG] [LOCAL ] ROK: Primary data saved (42806 records). [2025-10-22T20:55:10.982152] [INFO ] [MAIN ] ROK: Full history saved. [2025-10-22T20:55:10.982942] [INFO ] [MAIN ] Update Progress: 1825/2367 symbols completed. ROK took 35.4s. Estimated remaining: 1h 9m 49s. Rate: 7.8 symbols/min [2025-10-22T20:55:11.165469] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:55:11.197395] [DEBUG] [LOCAL ] RQI: Loaded 28928 existing records from primary storage. [2025-10-22T20:55:11.197748] [INFO ] [MAIN ] RQI: Loaded 28928 existing records. [2025-10-22T20:55:11.322917] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-22T20:55:11.384817] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:55:11.385064] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-22T20:55:11.385111] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-22T20:55:11.385503] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-10-22T20:55:11.385562] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-22T20:55:11.736940] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:55:11.964432] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-22T20:55:12.117759] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-22T20:55:12.118858] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T20:55:12.917741] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-22T20:55:13.596159] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-22T20:55:13.604702] [INFO ] [REMOTE ] ROL: Full fetch complete (73207 records). [2025-10-22T20:55:13.604824] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-10-22T20:55:13.722871] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-22T20:55:14.000754] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-10-22T20:55:14.000861] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-10-22T20:55:14.002024] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-10-22T20:55:14.002196] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-10-22T20:55:14.023906] [DEBUG] [LOCAL ] ROL: Trimmed 73207 records to 50245 (keeping 200 days of data) [2025-10-22T20:55:14.025201] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-22T20:55:14.033969] [INFO ] [REMOTE ] RPM: Full fetch complete (59879 records). [2025-10-22T20:55:14.034167] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-10-22T20:55:14.672545] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-10-22T20:55:14.699516] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-10-22T20:55:14.703942] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-10-22T20:55:14.704555] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-10-22T20:55:14.705478] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T20:55:14.756197] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-22T20:55:14.761975] [DEBUG] [LOCAL ] RPM: Trimmed 59879 records to 42049 (keeping 200 days of data) [2025-10-22T20:55:14.872572] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T20:55:14.895585] [DEBUG] [LOCAL ] ROL: Primary data saved (50245 records). [2025-10-22T20:55:14.903374] [INFO ] [MAIN ] ROL: Full history saved. [2025-10-22T20:55:14.903994] [INFO ] [MAIN ] Update Progress: 1826/2367 symbols completed. ROL took 37.9s. Estimated remaining: 1h 9m 41s. Rate: 7.8 symbols/min [2025-10-22T20:55:15.093794] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:55:15.267035] [DEBUG] [LOCAL ] RRC: Loaded 52921 existing records from primary storage. [2025-10-22T20:55:15.268351] [INFO ] [MAIN ] RRC: Loaded 52921 existing records. [2025-10-22T20:55:15.269090] [DEBUG] [LOCAL ] RPM: Primary data saved (42049 records). [2025-10-22T20:55:15.300096] [INFO ] [MAIN ] RPM: Full history saved. [2025-10-22T20:55:15.323217] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-22T20:55:15.344167] [INFO ] [MAIN ] Update Progress: 1827/2367 symbols completed. RPM took 36.9s. Estimated remaining: 1h 9m 31s. Rate: 7.8 symbols/min [2025-10-22T20:55:15.567226] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:55:15.590242] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-22T20:55:15.604540] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-22T20:55:15.621488] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-10-22T20:55:15.621589] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-22T20:55:15.621430] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:55:16.001857] [DEBUG] [LOCAL ] RRX: Loaded 40876 existing records from primary storage. [2025-10-22T20:55:16.016491] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:55:16.016927] [INFO ] [MAIN ] RRX: Loaded 40876 existing records. [2025-10-22T20:55:16.119233] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-22T20:55:16.218325] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:55:16.218694] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-22T20:55:16.218941] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-22T20:55:16.224575] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-10-22T20:55:16.234634] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-22T20:55:16.269421] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T20:55:16.617779] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:55:16.673615] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T20:55:16.917702] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-22T20:55:17.717692] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-22T20:55:18.105207] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-22T20:55:18.493592] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-22T20:55:18.517614] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-22T20:55:18.870718] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-22T20:55:19.317711] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-22T20:55:20.117754] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-22T20:55:20.270172] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-22T20:55:20.889327] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T20:55:20.917614] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-22T20:55:21.655467] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T20:55:21.717621] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-22T20:55:22.517728] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-22T20:55:22.972671] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-22T20:55:23.188419] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T20:55:23.317632] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-22T20:55:24.117717] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-22T20:55:24.236288] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T20:55:24.636944] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T20:55:24.917631] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-22T20:55:25.064217] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-22T20:55:25.067357] [INFO ] [REMOTE ] RPT: Full fetch complete (28235 records). [2025-10-22T20:55:25.067426] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-22T20:55:25.427962] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-10-22T20:55:25.428036] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-10-22T20:55:25.428639] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-10-22T20:55:25.428717] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-10-22T20:55:25.429363] [DEBUG] [LOCAL ] RPT: Trimmed 28235 records to 18982 (keeping 200 days of data) [2025-10-22T20:55:25.535842] [DEBUG] [LOCAL ] RPT: Primary data saved (18982 records). [2025-10-22T20:55:25.535975] [INFO ] [MAIN ] RPT: Full history saved. [2025-10-22T20:55:25.536052] [INFO ] [MAIN ] Update Progress: 1828/2367 symbols completed. RPT took 29.5s. Estimated remaining: 1h 9m 24s. Rate: 7.8 symbols/min [2025-10-22T20:55:25.701996] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:55:25.717921] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-10-22T20:55:25.729159] [DEBUG] [LOCAL ] RS: Loaded 24603 existing records from primary storage. [2025-10-22T20:55:25.729392] [INFO ] [MAIN ] RS: Loaded 24603 existing records. [2025-10-22T20:55:25.900173] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:55:25.900380] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-22T20:55:25.900444] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-22T20:55:25.900680] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-10-22T20:55:25.900736] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-22T20:55:26.240749] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:55:26.517734] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-22T20:55:26.687106] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T20:55:27.049687] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T20:55:27.317689] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-10-22T20:55:28.117621] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-22T20:55:28.322888] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T20:55:28.560190] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T20:55:28.917698] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-22T20:55:29.717627] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-22T20:55:29.905238] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T20:55:30.492103] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T20:55:30.517623] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-10-22T20:55:31.223059] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T20:55:31.317722] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-22T20:55:32.117638] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-22T20:55:32.177731] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T20:55:32.862506] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-22T20:55:32.917615] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-22T20:55:33.717701] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-22T20:55:33.973285] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-22T20:55:34.517710] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-22T20:55:34.653701] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T20:55:35.301308] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T20:55:35.317614] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-22T20:55:36.117747] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-22T20:55:36.549586] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-22T20:55:36.917721] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-10-22T20:55:36.961448] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T20:55:37.717690] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-22T20:55:37.881304] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T20:55:38.324558] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T20:55:38.517710] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-22T20:55:39.317728] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-10. [2025-10-22T20:55:39.569673] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-22T20:55:40.117757] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-22T20:55:40.592560] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T20:55:40.597305] [INFO ] [REMOTE ] RQI: Full fetch complete (42737 records). [2025-10-22T20:55:40.597416] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-10-22T20:55:40.905421] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-22T20:55:40.934155] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-22T20:55:41.003614] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-10-22T20:55:41.003721] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-10-22T20:55:41.004575] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-10-22T20:55:41.004616] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-10-22T20:55:41.005532] [DEBUG] [LOCAL ] RQI: Trimmed 42737 records to 28772 (keeping 200 days of data) [2025-10-22T20:55:41.182612] [DEBUG] [LOCAL ] RQI: Primary data saved (28772 records). [2025-10-22T20:55:41.182803] [INFO ] [MAIN ] RQI: Full history saved. [2025-10-22T20:55:41.182904] [INFO ] [MAIN ] Update Progress: 1829/2367 symbols completed. RQI took 30.2s. Estimated remaining: 1h 9m 18s. Rate: 7.8 symbols/min [2025-10-22T20:55:41.346261] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:55:41.352049] [DEBUG] [LOCAL ] RSF: Loaded 4283 existing records from primary storage. [2025-10-22T20:55:41.352239] [INFO ] [MAIN ] RSF: Loaded 4283 existing records. [2025-10-22T20:55:41.532765] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:55:41.532973] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-22T20:55:41.533022] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-22T20:55:41.533184] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-10-22T20:55:41.533243] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-22T20:55:41.725580] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-22T20:55:41.912790] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:55:42.124568] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-22T20:55:42.331469] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T20:55:42.517733] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-22T20:55:43.236590] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-22T20:55:43.243492] [INFO ] [REMOTE ] RRX: Full fetch complete (58810 records). [2025-10-22T20:55:43.243679] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-22T20:55:43.322740] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-22T20:55:43.629170] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-10-22T20:55:43.629251] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-10-22T20:55:43.630214] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-10-22T20:55:43.630275] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-10-22T20:55:43.631403] [DEBUG] [LOCAL ] RRX: Trimmed 58810 records to 40772 (keeping 200 days of data) [2025-10-22T20:55:43.886074] [DEBUG] [LOCAL ] RRX: Primary data saved (40772 records). [2025-10-22T20:55:43.886200] [INFO ] [MAIN ] RRX: Full history saved. [2025-10-22T20:55:43.886276] [INFO ] [MAIN ] Update Progress: 1830/2367 symbols completed. RRX took 28.5s. Estimated remaining: 1h 9m 9s. Rate: 7.8 symbols/min [2025-10-22T20:55:44.057128] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:55:44.060716] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-22T20:55:44.104445] [DEBUG] [LOCAL ] RSG: Loaded 47364 existing records from primary storage. [2025-10-22T20:55:44.104787] [INFO ] [MAIN ] RSG: Loaded 47364 existing records. [2025-10-22T20:55:44.125081] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-22T20:55:44.289949] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:55:44.290300] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-22T20:55:44.290443] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-22T20:55:44.290697] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-10-22T20:55:44.290754] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-22T20:55:44.418180] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T20:55:44.459910] [INFO ] [REMOTE ] RRC: Full fetch complete (76751 records). [2025-10-22T20:55:44.479721] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-22T20:55:44.860273] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:55:44.922801] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-22T20:55:45.089099] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-10-22T20:55:45.089202] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-10-22T20:55:45.090555] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-10-22T20:55:45.090630] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-10-22T20:55:45.092233] [DEBUG] [LOCAL ] RRC: Trimmed 76751 records to 52917 (keeping 200 days of data) [2025-10-22T20:55:45.426307] [DEBUG] [LOCAL ] RRC: Primary data saved (52917 records). [2025-10-22T20:55:45.427525] [INFO ] [MAIN ] RRC: Full history saved. [2025-10-22T20:55:45.427821] [INFO ] [MAIN ] Update Progress: 1831/2367 symbols completed. RRC took 30.5s. Estimated remaining: 1h 8m 60s. Rate: 7.8 symbols/min [2025-10-22T20:55:45.427439] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-22T20:55:45.604482] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:55:45.613167] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-22T20:55:45.649101] [DEBUG] [LOCAL ] RSI: Loaded 46990 existing records from primary storage. [2025-10-22T20:55:45.649398] [INFO ] [MAIN ] RSI: Loaded 46990 existing records. [2025-10-22T20:55:45.722755] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-22T20:55:45.822763] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:55:45.822987] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-22T20:55:45.823035] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-22T20:55:45.823331] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-10-22T20:55:45.823386] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-22T20:55:46.166117] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:55:46.414298] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-22T20:55:46.517740] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-22T20:55:47.317710] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-22T20:55:48.117679] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-22T20:55:48.466380] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-22T20:55:48.615429] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-22T20:55:48.845859] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-22T20:55:48.917627] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-22T20:55:49.623243] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-22T20:55:49.717714] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-22T20:55:50.517754] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-22T20:55:51.317630] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-22T20:55:51.716455] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-22T20:55:52.117750] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-22T20:55:52.296571] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T20:55:52.887023] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T20:55:52.917712] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-22T20:55:53.694465] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T20:55:53.717601] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-22T20:55:54.066959] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T20:55:54.389291] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-22T20:55:54.517703] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-22T20:55:55.317719] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-22T20:55:56.042109] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-22T20:55:56.057875] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T20:55:56.117619] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-22T20:55:56.829121] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-22T20:55:56.917681] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-22T20:55:57.522712] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-22T20:55:57.523856] [INFO ] [REMOTE ] RSF: Full fetch complete (5647 records). [2025-10-22T20:55:57.523941] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-22T20:55:57.725308] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-22T20:55:57.882791] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-10-22T20:55:57.882863] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-10-22T20:55:57.883024] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-10-22T20:55:57.883063] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-10-22T20:55:57.883437] [DEBUG] [LOCAL ] RSF: Trimmed 5647 records to 4258 (keeping 200 days of data) [2025-10-22T20:55:57.908533] [DEBUG] [LOCAL ] RSF: Primary data saved (4258 records). [2025-10-22T20:55:57.908621] [INFO ] [MAIN ] RSF: Full history saved. [2025-10-22T20:55:57.908726] [INFO ] [MAIN ] Update Progress: 1832/2367 symbols completed. RSF took 16.7s. Estimated remaining: 1h 8m 53s. Rate: 7.8 symbols/min [2025-10-22T20:55:58.074091] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:55:58.102958] [DEBUG] [LOCAL ] RSKD: Loaded 33301 existing records from primary storage. [2025-10-22T20:55:58.103220] [INFO ] [MAIN ] RSKD: Loaded 33301 existing records. [2025-10-22T20:55:58.275993] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:55:58.276150] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-22T20:55:58.276197] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-22T20:55:58.276521] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-10-22T20:55:58.276577] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-22T20:55:58.522955] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-22T20:55:58.625156] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:55:58.925185] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T20:55:59.317714] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-22T20:56:00.117695] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-22T20:56:00.469248] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-22T20:56:00.680371] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T20:56:00.685546] [INFO ] [REMOTE ] RS: Full fetch complete (38634 records). [2025-10-22T20:56:00.685717] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-10-22T20:56:00.924976] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-22T20:56:01.080036] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-10-22T20:56:01.080128] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-10-22T20:56:01.080968] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-10-22T20:56:01.081031] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-10-22T20:56:01.081895] [DEBUG] [LOCAL ] RS: Trimmed 38634 records to 24518 (keeping 200 days of data) [2025-10-22T20:56:01.235441] [DEBUG] [LOCAL ] RS: Primary data saved (24518 records). [2025-10-22T20:56:01.235566] [INFO ] [MAIN ] RS: Full history saved. [2025-10-22T20:56:01.235666] [INFO ] [MAIN ] Update Progress: 1833/2367 symbols completed. RS took 35.7s. Estimated remaining: 1h 8m 44s. Rate: 7.8 symbols/min [2025-10-22T20:56:01.401706] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:56:01.438295] [DEBUG] [LOCAL ] RTO: Loaded 39798 existing records from primary storage. [2025-10-22T20:56:01.438569] [INFO ] [MAIN ] RTO: Loaded 39798 existing records. [2025-10-22T20:56:01.616343] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:56:01.616626] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-22T20:56:01.616711] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-22T20:56:01.616977] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-10-22T20:56:01.617058] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-22T20:56:01.722780] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-22T20:56:02.024719] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:56:02.100124] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T20:56:02.464564] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T20:56:02.517691] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-22T20:56:03.317717] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-22T20:56:03.596672] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T20:56:04.095073] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T20:56:04.117695] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-22T20:56:04.917637] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-22T20:56:05.169183] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T20:56:05.717695] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-22T20:56:05.916632] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T20:56:06.427023] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T20:56:06.517735] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-22T20:56:07.235855] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T20:56:07.317634] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-22T20:56:08.117625] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-22T20:56:08.793873] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-22T20:56:08.917733] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-22T20:56:09.476128] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-22T20:56:09.717692] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-22T20:56:09.808199] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T20:56:10.418701] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T20:56:10.517709] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-22T20:56:11.317749] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-22T20:56:11.563338] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-22T20:56:11.997796] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-22T20:56:12.117692] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-22T20:56:12.917711] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-22T20:56:13.252236] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-22T20:56:13.717742] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-22T20:56:13.908887] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T20:56:14.517743] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-22T20:56:14.550809] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T20:56:15.308267] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T20:56:15.318124] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-22T20:56:16.117733] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-22T20:56:16.359416] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T20:56:16.799001] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T20:56:16.917708] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-22T20:56:17.717632] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-22T20:56:18.102699] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T20:56:18.517637] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-22T20:56:18.575544] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T20:56:19.317634] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-22T20:56:19.782454] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-22T20:56:20.117681] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-22T20:56:20.449004] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-22T20:56:20.917735] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-22T20:56:21.029931] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T20:56:21.038254] [INFO ] [REMOTE ] RSI: Full fetch complete (69742 records). [2025-10-22T20:56:21.038366] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-22T20:56:21.437788] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-10-22T20:56:21.437874] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-10-22T20:56:21.439091] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-10-22T20:56:21.439158] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-10-22T20:56:21.440550] [DEBUG] [LOCAL ] RSI: Trimmed 69742 records to 46976 (keeping 200 days of data) [2025-10-22T20:56:21.716673] [DEBUG] [LOCAL ] RSI: Primary data saved (46976 records). [2025-10-22T20:56:21.717105] [INFO ] [MAIN ] RSI: Full history saved. [2025-10-22T20:56:21.735746] [INFO ] [MAIN ] Update Progress: 1834/2367 symbols completed. RSI took 36.3s. Estimated remaining: 1h 8m 40s. Rate: 7.8 symbols/min [2025-10-22T20:56:21.723903] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-22T20:56:21.758120] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T20:56:21.916851] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:56:21.967635] [DEBUG] [LOCAL ] RTX: Loaded 53706 existing records from primary storage. [2025-10-22T20:56:21.967981] [INFO ] [MAIN ] RTX: Loaded 53706 existing records. [2025-10-22T20:56:22.143104] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:56:22.143324] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-22T20:56:22.143436] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-22T20:56:22.143686] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-10-22T20:56:22.143743] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-22T20:56:22.499500] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:56:22.517610] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-22T20:56:22.518637] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T20:56:23.317715] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-22T20:56:23.737088] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-22T20:56:24.117764] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-22T20:56:24.650257] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-22T20:56:24.701110] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T20:56:24.709088] [INFO ] [REMOTE ] RSKD: Full fetch complete (48329 records). [2025-10-22T20:56:24.709218] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-22T20:56:24.922872] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-22T20:56:25.122092] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-10-22T20:56:25.122174] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-10-22T20:56:25.123087] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-10-22T20:56:25.123150] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-10-22T20:56:25.124200] [DEBUG] [LOCAL ] RSKD: Trimmed 48329 records to 33238 (keeping 200 days of data) [2025-10-22T20:56:25.306295] [DEBUG] [LOCAL ] RSKD: Primary data saved (33238 records). [2025-10-22T20:56:25.306426] [INFO ] [MAIN ] RSKD: Full history saved. [2025-10-22T20:56:25.306502] [INFO ] [MAIN ] Update Progress: 1835/2367 symbols completed. RSKD took 27.4s. Estimated remaining: 1h 8m 31s. Rate: 7.8 symbols/min [2025-10-22T20:56:25.474397] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:56:25.515920] [DEBUG] [LOCAL ] RVLV: Loaded 47419 existing records from primary storage. [2025-10-22T20:56:25.516206] [INFO ] [MAIN ] RVLV: Loaded 47419 existing records. [2025-10-22T20:56:25.695371] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:56:25.695729] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-22T20:56:25.695845] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-22T20:56:25.696034] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-10-22T20:56:25.696074] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-22T20:56:25.727301] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-22T20:56:26.094206] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:56:26.120375] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-22T20:56:26.517742] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-22T20:56:27.318208] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-22T20:56:27.576994] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-22T20:56:27.683515] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-10-22T20:56:28.117618] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-22T20:56:28.215605] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T20:56:28.223216] [INFO ] [REMOTE ] RSG: Full fetch complete (68406 records). [2025-10-22T20:56:28.223327] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-10-22T20:56:28.607458] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-10-22T20:56:28.607533] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-10-22T20:56:28.608839] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-10-22T20:56:28.608936] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-10-22T20:56:28.610219] [DEBUG] [LOCAL ] RSG: Trimmed 68406 records to 47300 (keeping 200 days of data) [2025-10-22T20:56:28.904921] [DEBUG] [LOCAL ] RSG: Primary data saved (47300 records). [2025-10-22T20:56:28.905066] [INFO ] [MAIN ] RSG: Full history saved. [2025-10-22T20:56:28.905147] [INFO ] [MAIN ] Update Progress: 1836/2367 symbols completed. RSG took 45.0s. Estimated remaining: 1h 8m 22s. Rate: 7.8 symbols/min [2025-10-22T20:56:28.939333] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-22T20:56:29.087029] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:56:29.117228] [DEBUG] [LOCAL ] RVT: Loaded 26271 existing records from primary storage. [2025-10-22T20:56:29.117872] [INFO ] [MAIN ] RVT: Loaded 26271 existing records. [2025-10-22T20:56:29.321989] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T20:56:29.325680] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:56:29.335507] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-22T20:56:29.335592] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-22T20:56:29.335828] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-10-22T20:56:29.335883] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-22T20:56:29.703176] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:56:29.717751] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-22T20:56:30.497152] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-22T20:56:30.517623] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-22T20:56:30.714503] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T20:56:31.317724] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-22T20:56:31.500312] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T20:56:32.117767] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-22T20:56:32.753223] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-22T20:56:32.917624] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-22T20:56:32.961118] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T20:56:33.717681] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-22T20:56:33.782701] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T20:56:34.517625] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-22T20:56:34.964892] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T20:56:35.318092] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-22T20:56:35.325737] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-22T20:56:35.943346] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T20:56:36.117739] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-22T20:56:36.917713] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-22T20:56:37.562970] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-22T20:56:37.717735] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-22T20:56:37.777575] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T20:56:37.784490] [INFO ] [REMOTE ] RTO: Full fetch complete (58840 records). [2025-10-22T20:56:37.784600] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-22T20:56:38.160727] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-10-22T20:56:38.160810] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-10-22T20:56:38.161767] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-10-22T20:56:38.161828] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-10-22T20:56:38.162915] [DEBUG] [LOCAL ] RTO: Trimmed 58840 records to 39724 (keeping 200 days of data) [2025-10-22T20:56:38.403130] [DEBUG] [LOCAL ] RTO: Primary data saved (39724 records). [2025-10-22T20:56:38.403410] [INFO ] [MAIN ] RTO: Full history saved. [2025-10-22T20:56:38.403499] [INFO ] [MAIN ] Update Progress: 1837/2367 symbols completed. RTO took 37.2s. Estimated remaining: 1h 8m 15s. Rate: 7.8 symbols/min [2025-10-22T20:56:38.523703] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-22T20:56:38.528175] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T20:56:39.317765] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-22T20:56:39.515928] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T20:56:40.117705] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-22T20:56:40.576773] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T20:56:40.688375] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-22T20:56:40.917696] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-22T20:56:41.717749] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-22T20:56:42.038147] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-22T20:56:42.160012] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-22T20:56:42.517749] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-22T20:56:43.317760] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-22T20:56:43.830036] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-22T20:56:44.010719] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-22T20:56:44.117734] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-22T20:56:44.917753] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-22T20:56:45.114382] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T20:56:45.717760] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-22T20:56:46.368935] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T20:56:46.417691] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-22T20:56:46.517690] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-22T20:56:47.317616] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-22T20:56:47.502757] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-22T20:56:47.880009] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T20:56:48.117772] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-22T20:56:48.203500] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T20:56:48.917745] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-22T20:56:49.717629] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-22T20:56:49.935175] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T20:56:50.489716] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T20:56:50.517610] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-22T20:56:51.317713] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-22T20:56:51.823632] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T20:56:51.828178] [INFO ] [REMOTE ] RVT: Full fetch complete (39104 records). [2025-10-22T20:56:51.828258] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-22T20:56:52.187995] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-22T20:56:52.235686] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-10-22T20:56:52.235532] [INFO ] [REMOTE ] RTX: Full fetch complete (77878 records). [2025-10-22T20:56:52.235806] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-22T20:56:52.235875] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-10-22T20:56:52.236793] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-10-22T20:56:52.236914] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-10-22T20:56:52.318627] [DEBUG] [LOCAL ] RVT: Trimmed 39104 records to 26119 (keeping 200 days of data) [2025-10-22T20:56:52.793766] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-10-22T20:56:52.796852] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-10-22T20:56:52.798088] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-10-22T20:56:52.798718] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-10-22T20:56:52.805939] [DEBUG] [LOCAL ] RVT: Primary data saved (26119 records). [2025-10-22T20:56:52.806068] [INFO ] [MAIN ] RVT: Full history saved. [2025-10-22T20:56:52.806193] [INFO ] [MAIN ] Update Progress: 1838/2367 symbols completed. RVT took 23.9s. Estimated remaining: 1h 8m 9s. Rate: 7.8 symbols/min [2025-10-22T20:56:52.806806] [DEBUG] [LOCAL ] RTX: Trimmed 77878 records to 53706 (keeping 200 days of data) [2025-10-22T20:56:53.136289] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T20:56:53.146180] [INFO ] [REMOTE ] RVLV: Full fetch complete (69016 records). [2025-10-22T20:56:53.147343] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-22T20:56:53.321448] [DEBUG] [LOCAL ] RTX: Primary data saved (53706 records). [2025-10-22T20:56:53.340756] [INFO ] [MAIN ] RTX: Full history saved. [2025-10-22T20:56:53.342364] [INFO ] [MAIN ] Update Progress: 1839/2367 symbols completed. RTX took 31.6s. Estimated remaining: 1h 7m 60s. Rate: 7.8 symbols/min [2025-10-22T20:56:53.547612] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-10-22T20:56:53.547732] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-10-22T20:56:53.548823] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-10-22T20:56:53.548884] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-10-22T20:56:53.550151] [DEBUG] [LOCAL ] RVLV: Trimmed 69016 records to 47368 (keeping 200 days of data) [2025-10-22T20:56:53.816734] [DEBUG] [LOCAL ] RVLV: Primary data saved (47368 records). [2025-10-22T20:56:53.816875] [INFO ] [MAIN ] RVLV: Full history saved. [2025-10-22T20:56:53.817620] [INFO ] [MAIN ] Update Progress: 1840/2367 symbols completed. RVLV took 28.5s. Estimated remaining: 1h 7m 50s. Rate: 7.8 symbols/min [2025-10-22T20:56:54.517804] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:56:54.508294] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:56:54.516581] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:56:54.537806] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-22T20:56:54.537598] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:56:54.538151] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-22T20:56:54.538560] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-22T20:56:54.538946] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-22T20:56:54.538668] [DEBUG] [LOCAL ] RVTY: No existing data file found in primary storage. [2025-10-22T20:56:54.539015] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-22T20:56:54.539298] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-22T20:56:54.539463] [WARN ] [MAIN ] RVTY: No existing data found, performing full refresh instead. [2025-10-22T20:56:54.539707] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-22T20:56:54.539590] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-22T20:56:54.539378] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-22T20:56:54.539796] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-22T20:56:54.540010] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-22T20:56:54.540239] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-22T20:56:54.540309] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-22T20:56:54.540371] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-22T20:56:54.540682] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-22T20:56:54.552353] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-22T20:56:55.129006] [DEBUG] [LOCAL ] RWT: Loaded 40481 existing records from primary storage. [2025-10-22T20:56:55.168559] [INFO ] [MAIN ] RWT: Loaded 40481 existing records. [2025-10-22T20:56:55.600854] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:56:55.636565] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-22T20:56:55.822407] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:56:55.854263] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:56:55.858145] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:56:55.858727] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-22T20:56:55.858975] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-22T20:56:55.858526] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-22T20:56:55.859898] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-22T20:56:55.861880] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-10-22T20:56:55.862191] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-22T20:56:56.244537] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:56:56.244953] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-22T20:56:56.435793] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T20:56:56.437433] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-10-22T20:56:56.769818] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-22T20:56:56.771215] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-22T20:56:56.870142] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-22T20:56:56.917634] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-10-22T20:56:57.519099] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T20:56:57.589333] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T20:56:57.621213] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T20:56:57.717623] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-10-22T20:56:57.855849] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T20:56:58.517716] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-22T20:56:58.987270] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-22T20:56:59.317735] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-10-22T20:57:00.115585] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T20:57:00.122374] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-22T20:57:00.767244] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-22T20:57:00.917616] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-22T20:57:01.464457] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-22T20:57:01.582358] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-22T20:57:01.717685] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-10-22T20:57:02.517778] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-10-22T20:57:03.217049] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-22T20:57:03.317721] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-22T20:57:03.726187] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T20:57:04.117632] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-10-22T20:57:04.610290] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-22T20:57:04.707631] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-22T20:57:04.917722] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-22T20:57:05.443873] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-22T20:57:05.717687] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-22T20:57:06.517687] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-10-22T20:57:07.098727] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-22T20:57:07.317636] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-10-22T20:57:07.438935] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T20:57:08.117713] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-10-22T20:57:08.917624] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-22T20:57:08.937860] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-22T20:57:09.412039] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-22T20:57:09.449789] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-22T20:57:09.717703] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-10-22T20:57:10.517715] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-22T20:57:10.978612] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-22T20:57:11.317742] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-22T20:57:11.623185] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-22T20:57:12.117769] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-10-22T20:57:12.917681] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-10-22T20:57:13.025997] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T20:57:13.717628] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-22T20:57:13.775727] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T20:57:14.077294] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T20:57:14.517681] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-10-22T20:57:15.217938] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T20:57:15.317638] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-22T20:57:16.117615] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-10-22T20:57:16.377622] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T20:57:16.858557] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T20:57:16.917623] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-10. [2025-10-22T20:57:17.186037] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T20:57:17.451550] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-22T20:57:17.452557] [INFO ] [REMOTE ] RWTO: Full fetch complete (4827 records). [2025-10-22T20:57:17.452626] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-22T20:57:17.632845] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-22T20:57:17.633052] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:57:17.633104] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:57:17.633145] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-22T20:57:17.633217] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-22T20:57:17.633286] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-22T20:57:17.633359] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-22T20:57:17.633428] [INFO ] [MAIN ] Update Progress: 1841/2367 symbols completed. RWTO took 23.8s. Estimated remaining: 1h 7m 47s. Rate: 7.8 symbols/min [2025-10-22T20:57:17.722911] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-22T20:57:17.806553] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:57:17.806774] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-22T20:57:17.806818] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-22T20:57:17.806929] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-22T20:57:17.806969] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-22T20:57:17.807008] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-22T20:57:17.807038] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-22T20:57:18.153770] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:57:18.517744] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-10-22T20:57:18.536013] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-22T20:57:19.317720] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-22T20:57:19.835790] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-22T20:57:20.117718] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-22T20:57:20.391532] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-22T20:57:20.675179] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-22T20:57:20.676074] [INFO ] [REMOTE ] RWTN: Full fetch complete (3172 records). [2025-10-22T20:57:20.676141] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-22T20:57:20.849018] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-22T20:57:20.849203] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:57:20.849270] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:57:20.849338] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-22T20:57:20.849423] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-22T20:57:20.849460] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-22T20:57:20.849499] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-22T20:57:20.849552] [INFO ] [MAIN ] Update Progress: 1842/2367 symbols completed. RWTN took 27.0s. Estimated remaining: 1h 7m 38s. Rate: 7.8 symbols/min [2025-10-22T20:57:20.922867] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-10. [2025-10-22T20:57:21.014559] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:57:21.057750] [DEBUG] [LOCAL ] RXO: Loaded 48484 existing records from primary storage. [2025-10-22T20:57:21.058045] [INFO ] [MAIN ] RXO: Loaded 48484 existing records. [2025-10-22T20:57:21.232260] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:57:21.232476] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-22T20:57:21.232524] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-22T20:57:21.233076] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-10-22T20:57:21.233143] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-22T20:57:21.586812] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:57:21.717723] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-22T20:57:22.517721] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-22T20:57:23.029334] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-22T20:57:23.037465] [INFO ] [REMOTE ] RVTY: Full fetch complete (68057 records). [2025-10-22T20:57:23.037608] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-10-22T20:57:23.321713] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-01. [2025-10-22T20:57:23.428091] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-10-22T20:57:23.428199] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-10-22T20:57:23.429290] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-10-22T20:57:23.429414] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-10-22T20:57:23.453867] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T20:57:23.463037] [DEBUG] [LOCAL ] RVTY: Trimmed 68057 records to 47785 (keeping 200 days of data) [2025-10-22T20:57:23.763706] [DEBUG] [LOCAL ] RVTY: Primary data saved (47785 records). [2025-10-22T20:57:23.763880] [INFO ] [MAIN ] RVTY: Full history saved. [2025-10-22T20:57:23.763993] [INFO ] [MAIN ] Update Progress: 1843/2367 symbols completed. RVTY took 29.9s. Estimated remaining: 1h 7m 28s. Rate: 7.8 symbols/min [2025-10-22T20:57:23.934392] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:57:23.978068] [DEBUG] [LOCAL ] RY: Loaded 47533 existing records from primary storage. [2025-10-22T20:57:23.978372] [INFO ] [MAIN ] RY: Loaded 47533 existing records. [2025-10-22T20:57:24.084349] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T20:57:24.144406] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-10-22T20:57:24.167434] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:57:24.167884] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-22T20:57:24.168009] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-22T20:57:24.168277] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-10-22T20:57:24.168346] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-22T20:57:24.342297] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T20:57:24.559770] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:57:24.798714] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T20:57:24.917708] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-22T20:57:25.717704] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-22T20:57:26.517631] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-10-22T20:57:27.044388] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-22T20:57:27.102148] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-22T20:57:27.317715] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-22T20:57:27.375183] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T20:57:28.117714] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-22T20:57:28.917623] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-10-22T20:57:29.094619] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T20:57:29.429243] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-22T20:57:29.717737] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-22T20:57:29.904727] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T20:57:30.517723] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-10-22T20:57:30.925249] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-22T20:57:31.317693] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-10-22T20:57:31.441524] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T20:57:31.448087] [INFO ] [REMOTE ] RWT: Full fetch complete (58051 records). [2025-10-22T20:57:31.448215] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-22T20:57:31.838290] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-10-22T20:57:31.838422] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-10-22T20:57:31.839686] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-10-22T20:57:31.839754] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-10-22T20:57:31.841495] [DEBUG] [LOCAL ] RWT: Trimmed 58051 records to 40374 (keeping 200 days of data) [2025-10-22T20:57:31.936639] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-22T20:57:32.098221] [DEBUG] [LOCAL ] RWT: Primary data saved (40374 records). [2025-10-22T20:57:32.098344] [INFO ] [MAIN ] RWT: Full history saved. [2025-10-22T20:57:32.098417] [INFO ] [MAIN ] Update Progress: 1844/2367 symbols completed. RWT took 38.3s. Estimated remaining: 1h 7m 21s. Rate: 7.8 symbols/min [2025-10-22T20:57:32.122939] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-22T20:57:32.276118] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:57:32.311420] [DEBUG] [LOCAL ] RYAM: Loaded 35073 existing records from primary storage. [2025-10-22T20:57:32.311748] [INFO ] [MAIN ] RYAM: Loaded 35073 existing records. [2025-10-22T20:57:32.503980] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:57:32.504216] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-22T20:57:32.504286] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-22T20:57:32.504533] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-10-22T20:57:32.504588] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-22T20:57:32.860943] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:57:32.917620] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-22T20:57:33.717753] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-10-22T20:57:34.225217] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T20:57:34.515534] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-22T20:57:34.517241] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-22T20:57:34.518784] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-10-22T20:57:35.098447] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T20:57:35.317756] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-10-22T20:57:35.975478] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-22T20:57:36.117766] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-22T20:57:36.917738] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-10. [2025-10-22T20:57:37.490720] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-22T20:57:37.491623] [INFO ] [REMOTE ] RWTP: Full fetch complete (4690 records). [2025-10-22T20:57:37.491719] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-10-22T20:57:37.670460] [WARN ] [VALIDATOR ] RWTP: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-10-22T20:57:37.670678] [FATAL] [MAIN ] RWTP: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:57:37.670748] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:57:37.670817] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-22T20:57:37.670878] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-22T20:57:37.670913] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-22T20:57:37.670951] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-22T20:57:37.671007] [INFO ] [MAIN ] Update Progress: 1845/2367 symbols completed. RWTP took 20.0s. Estimated remaining: 1h 7m 13s. Rate: 7.8 symbols/min [2025-10-22T20:57:37.722965] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-22T20:57:37.839065] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:57:37.881604] [DEBUG] [LOCAL ] RYAN: Loaded 45079 existing records from primary storage. [2025-10-22T20:57:37.881919] [INFO ] [MAIN ] RYAN: Loaded 45079 existing records. [2025-10-22T20:57:38.079217] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:57:38.090506] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-22T20:57:38.090805] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-22T20:57:38.092362] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-10-22T20:57:38.092298] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T20:57:38.092557] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-22T20:57:38.445871] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:57:38.517614] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-22T20:57:39.055727] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T20:57:39.317720] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-22T20:57:40.117633] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-22T20:57:40.280394] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T20:57:40.784043] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T20:57:40.917621] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-22T20:57:41.717630] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-22T20:57:41.991949] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T20:57:42.339188] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T20:57:42.517687] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-22T20:57:43.321723] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-22T20:57:43.326410] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T20:57:44.094547] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T20:57:44.117626] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-22T20:57:44.917707] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-22T20:57:45.182629] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T20:57:45.723288] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-22T20:57:45.728630] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T20:57:46.408969] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T20:57:46.517688] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-22T20:57:47.317767] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-22T20:57:47.614214] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-22T20:57:48.063893] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T20:57:48.117609] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-22T20:57:48.917637] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-22T20:57:49.351863] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-22T20:57:49.539872] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T20:57:49.717728] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-22T20:57:50.517711] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-22T20:57:50.917243] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-22T20:57:51.317757] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-22T20:57:51.643752] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T20:57:51.733750] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T20:57:52.117779] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-22T20:57:52.917749] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-22T20:57:53.211621] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T20:57:53.632455] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T20:57:53.717747] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-22T20:57:54.517718] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-22T20:57:54.819133] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T20:57:55.183584] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T20:57:55.317699] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-22T20:57:56.117640] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-22T20:57:56.179669] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T20:57:56.917738] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-22T20:57:57.139731] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T20:57:57.147157] [INFO ] [REMOTE ] RY: Full fetch complete (69243 records). [2025-10-22T20:57:57.147275] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-22T20:57:57.528974] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-10-22T20:57:57.529145] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-10-22T20:57:57.530272] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-10-22T20:57:57.530353] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-10-22T20:57:57.551523] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T20:57:57.559160] [DEBUG] [LOCAL ] RY: Trimmed 69243 records to 47473 (keeping 200 days of data) [2025-10-22T20:57:57.731350] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-22T20:57:57.847016] [DEBUG] [LOCAL ] RY: Primary data saved (47473 records). [2025-10-22T20:57:57.847155] [INFO ] [MAIN ] RY: Full history saved. [2025-10-22T20:57:57.847242] [INFO ] [MAIN ] Update Progress: 1846/2367 symbols completed. RY took 34.1s. Estimated remaining: 1h 7m 8s. Rate: 7.8 symbols/min [2025-10-22T20:57:58.010986] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:57:58.030727] [DEBUG] [LOCAL ] RYI: Loaded 21755 existing records from primary storage. [2025-10-22T20:57:58.030956] [INFO ] [MAIN ] RYI: Loaded 21755 existing records. [2025-10-22T20:57:58.203666] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:57:58.203856] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-22T20:57:58.203904] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-22T20:57:58.204624] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-10-22T20:57:58.204717] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-22T20:57:58.522359] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-22T20:57:58.562784] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:57:58.648401] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T20:57:59.114147] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T20:57:59.120124] [INFO ] [REMOTE ] RYAM: Full fetch complete (49138 records). [2025-10-22T20:57:59.120228] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-22T20:57:59.323476] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-22T20:57:59.488145] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-10-22T20:57:59.488222] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-10-22T20:57:59.489127] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-10-22T20:57:59.489231] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-10-22T20:57:59.490324] [DEBUG] [LOCAL ] RYAM: Trimmed 49138 records to 35018 (keeping 200 days of data) [2025-10-22T20:57:59.680041] [DEBUG] [LOCAL ] RYAM: Primary data saved (35018 records). [2025-10-22T20:57:59.680185] [INFO ] [MAIN ] RYAM: Full history saved. [2025-10-22T20:57:59.680263] [INFO ] [MAIN ] Update Progress: 1847/2367 symbols completed. RYAM took 27.6s. Estimated remaining: 1h 6m 59s. Rate: 7.8 symbols/min [2025-10-22T20:57:59.846045] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:57:59.884743] [DEBUG] [LOCAL ] RYN: Loaded 45758 existing records from primary storage. [2025-10-22T20:57:59.885026] [INFO ] [MAIN ] RYN: Loaded 45758 existing records. [2025-10-22T20:58:00.060081] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:58:00.060314] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-22T20:58:00.060361] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-22T20:58:00.060752] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-10-22T20:58:00.060808] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-22T20:58:00.122851] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-22T20:58:00.426957] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:58:00.456301] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-22T20:58:00.626626] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T20:58:00.917782] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-22T20:58:01.717690] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-22T20:58:01.917722] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T20:58:02.517692] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-22T20:58:02.683127] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T20:58:03.002588] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T20:58:03.317703] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-22T20:58:04.117700] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-22T20:58:04.245506] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T20:58:04.741763] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T20:58:04.917704] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-22T20:58:05.223884] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T20:58:05.717712] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-22T20:58:06.517692] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-22T20:58:06.976985] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-22T20:58:07.258571] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T20:58:07.317627] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-22T20:58:08.117623] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-22T20:58:08.331303] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T20:58:08.458852] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-22T20:58:08.917759] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-22T20:58:09.717634] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-22T20:58:09.790319] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T20:58:10.165187] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T20:58:10.517719] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-22T20:58:11.317706] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-22T20:58:11.406172] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T20:58:12.117637] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-22T20:58:12.377589] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T20:58:12.386188] [INFO ] [REMOTE ] RXO: Full fetch complete (69020 records). [2025-10-22T20:58:12.386341] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-22T20:58:12.773426] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-10-22T20:58:12.773505] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-10-22T20:58:12.774565] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-10-22T20:58:12.774627] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-10-22T20:58:12.775917] [DEBUG] [LOCAL ] RXO: Trimmed 69020 records to 48464 (keeping 200 days of data) [2025-10-22T20:58:12.939149] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-22T20:58:13.057769] [DEBUG] [LOCAL ] RXO: Primary data saved (48464 records). [2025-10-22T20:58:13.057914] [INFO ] [MAIN ] RXO: Full history saved. [2025-10-22T20:58:13.057995] [INFO ] [MAIN ] Update Progress: 1848/2367 symbols completed. RXO took 52.2s. Estimated remaining: 1h 6m 53s. Rate: 7.8 symbols/min [2025-10-22T20:58:13.235600] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:58:13.250873] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T20:58:13.259727] [INFO ] [REMOTE ] RYAN: Full fetch complete (64935 records). [2025-10-22T20:58:13.261616] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-22T20:58:13.308957] [DEBUG] [LOCAL ] RZB: Loaded 5931 existing records from primary storage. [2025-10-22T20:58:13.366400] [INFO ] [MAIN ] RZB: Loaded 5931 existing records. [2025-10-22T20:58:13.772774] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:58:13.784236] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-22T20:58:13.803270] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-22T20:58:13.837600] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-10-22T20:58:13.867991] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-22T20:58:13.867911] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T20:58:13.927932] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-10-22T20:58:13.957194] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-10-22T20:58:13.957035] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-22T20:58:13.963858] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-10-22T20:58:13.977088] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-10-22T20:58:14.062886] [DEBUG] [LOCAL ] RYAN: Trimmed 64935 records to 45003 (keeping 200 days of data) [2025-10-22T20:58:14.390353] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:58:14.518780] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-22T20:58:14.557782] [DEBUG] [LOCAL ] RYAN: Primary data saved (45003 records). [2025-10-22T20:58:14.557931] [INFO ] [MAIN ] RYAN: Full history saved. [2025-10-22T20:58:14.558446] [INFO ] [MAIN ] Update Progress: 1849/2367 symbols completed. RYAN took 36.9s. Estimated remaining: 1h 6m 43s. Rate: 7.8 symbols/min [2025-10-22T20:58:14.725608] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:58:14.734934] [DEBUG] [LOCAL ] RZC: Loaded 6559 existing records from primary storage. [2025-10-22T20:58:14.735152] [INFO ] [MAIN ] RZC: Loaded 6559 existing records. [2025-10-22T20:58:14.918848] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:58:14.919473] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-22T20:58:14.919744] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-22T20:58:14.929288] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-10-22T20:58:14.935127] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-22T20:58:14.992781] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-22T20:58:15.104811] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T20:58:15.320844] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-22T20:58:15.353708] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:58:15.354548] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-22T20:58:16.117715] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-10-22T20:58:16.605943] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-22T20:58:16.695417] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-22T20:58:16.917721] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-10-22T20:58:17.717748] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-22T20:58:17.814973] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-22T20:58:18.354105] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-22T20:58:18.517749] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-22T20:58:19.317741] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-22T20:58:19.818183] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-22T20:58:20.117709] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-22T20:58:20.248095] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T20:58:20.917705] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-22T20:58:21.227765] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T20:58:21.231628] [INFO ] [REMOTE ] RYI: Full fetch complete (31848 records). [2025-10-22T20:58:21.231735] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-22T20:58:21.630798] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-10-22T20:58:21.630877] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-10-22T20:58:21.631609] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-10-22T20:58:21.631702] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-10-22T20:58:21.632772] [DEBUG] [LOCAL ] RYI: Trimmed 31848 records to 21663 (keeping 200 days of data) [2025-10-22T20:58:21.727021] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-10-22T20:58:21.777158] [DEBUG] [LOCAL ] RYI: Primary data saved (21663 records). [2025-10-22T20:58:21.777281] [INFO ] [MAIN ] RYI: Full history saved. [2025-10-22T20:58:21.777362] [INFO ] [MAIN ] Update Progress: 1850/2367 symbols completed. RYI took 23.9s. Estimated remaining: 1h 6m 35s. Rate: 7.8 symbols/min [2025-10-22T20:58:21.878581] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-22T20:58:21.970313] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:58:22.020432] [DEBUG] [LOCAL ] S: Loaded 53538 existing records from primary storage. [2025-10-22T20:58:22.020772] [INFO ] [MAIN ] S: Loaded 53538 existing records. [2025-10-22T20:58:22.192762] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:58:22.193018] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-22T20:58:22.193066] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-22T20:58:22.193284] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-22T20:58:22.193343] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-22T20:58:22.541516] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:58:22.520359] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-22T20:58:22.543148] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T20:58:23.317697] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-22T20:58:23.464950] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-22T20:58:24.117724] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-10-22T20:58:24.903849] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T20:58:24.917602] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-10-22T20:58:25.538305] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-22T20:58:25.717628] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-22T20:58:26.023913] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T20:58:26.517743] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-10-22T20:58:27.136166] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T20:58:27.317630] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-10-22T20:58:27.800555] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-22T20:58:28.117797] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-22T20:58:28.143161] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T20:58:28.917775] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-10-22T20:58:29.697761] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T20:58:29.717679] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-22T20:58:30.395730] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-22T20:58:30.517704] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-22T20:58:31.255285] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T20:58:31.317710] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-22T20:58:31.446709] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T20:58:32.117735] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-10. [2025-10-22T20:58:32.797369] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-22T20:58:32.798509] [INFO ] [REMOTE ] RZB: Full fetch complete (8312 records). [2025-10-22T20:58:32.798616] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-22T20:58:32.922809] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-22T20:58:33.168202] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-10-22T20:58:33.168280] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-10-22T20:58:33.168509] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-10-22T20:58:33.168549] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-10-22T20:58:33.169012] [DEBUG] [LOCAL ] RZB: Trimmed 8312 records to 5891 (keeping 200 days of data) [2025-10-22T20:58:33.204625] [DEBUG] [LOCAL ] RZB: Primary data saved (5891 records). [2025-10-22T20:58:33.204763] [INFO ] [MAIN ] RZB: Full history saved. [2025-10-22T20:58:33.204868] [INFO ] [MAIN ] Update Progress: 1851/2367 symbols completed. RZB took 20.1s. Estimated remaining: 1h 6m 29s. Rate: 7.8 symbols/min [2025-10-22T20:58:33.390555] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:58:33.432852] [DEBUG] [LOCAL ] SA: Loaded 44659 existing records from primary storage. [2025-10-22T20:58:33.433188] [INFO ] [MAIN ] SA: Loaded 44659 existing records. [2025-10-22T20:58:33.604974] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-22T20:58:33.629502] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:58:33.630286] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-22T20:58:33.630629] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-22T20:58:33.630889] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-22T20:58:33.631005] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-22T20:58:33.721142] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-22T20:58:33.774169] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-22T20:58:34.023228] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:58:34.517743] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-22T20:58:35.317628] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-22T20:58:35.638505] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-22T20:58:36.117696] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-22T20:58:36.587452] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-22T20:58:36.660110] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T20:58:36.917744] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-22T20:58:37.717716] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-22T20:58:37.952032] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T20:58:37.960198] [INFO ] [REMOTE ] RYN: Full fetch complete (65734 records). [2025-10-22T20:58:37.960325] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-22T20:58:38.365036] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-10-22T20:58:38.365137] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-10-22T20:58:38.366314] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-10-22T20:58:38.366386] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-10-22T20:58:38.368228] [DEBUG] [LOCAL ] RYN: Trimmed 65734 records to 45740 (keeping 200 days of data) [2025-10-22T20:58:38.543197] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-22T20:58:38.655479] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T20:58:38.681416] [DEBUG] [LOCAL ] RYN: Primary data saved (45740 records). [2025-10-22T20:58:38.681551] [INFO ] [MAIN ] RYN: Full history saved. [2025-10-22T20:58:38.681631] [INFO ] [MAIN ] Update Progress: 1852/2367 symbols completed. RYN took 39.0s. Estimated remaining: 1h 6m 20s. Rate: 7.8 symbols/min [2025-10-22T20:58:38.848707] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:58:38.859385] [DEBUG] [LOCAL ] SABA: Loaded 9231 existing records from primary storage. [2025-10-22T20:58:38.859584] [INFO ] [MAIN ] SABA: Loaded 9231 existing records. [2025-10-22T20:58:39.040524] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:58:39.040789] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-22T20:58:39.040878] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-22T20:58:39.041069] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-22T20:58:39.041129] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-22T20:58:39.325431] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-22T20:58:39.415252] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:58:39.421032] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-22T20:58:39.657730] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-22T20:58:40.117689] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-22T20:58:40.727836] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T20:58:40.917740] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-22T20:58:41.041206] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T20:58:41.717719] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-22T20:58:42.517627] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-22T20:58:42.645353] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T20:58:43.312729] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T20:58:43.317593] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-22T20:58:43.510955] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T20:58:44.117740] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-22T20:58:44.917628] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-22T20:58:45.196079] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T20:58:45.627722] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-22T20:58:45.717683] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-22T20:58:46.522727] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-22T20:58:46.543277] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T20:58:47.317685] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-22T20:58:47.497686] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T20:58:47.999223] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-22T20:58:48.000563] [INFO ] [REMOTE ] RZC: Full fetch complete (9614 records). [2025-10-22T20:58:48.000633] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-22T20:58:48.121820] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-22T20:58:48.387712] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-22T20:58:48.390627] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-22T20:58:48.390909] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-22T20:58:48.391174] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-22T20:58:48.392683] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-10-22T20:58:48.403504] [DEBUG] [LOCAL ] RZC: Trimmed 9614 records to 6485 (keeping 200 days of data) [2025-10-22T20:58:48.441845] [DEBUG] [LOCAL ] RZC: Primary data saved (6485 records). [2025-10-22T20:58:48.441936] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-22T20:58:48.442009] [INFO ] [MAIN ] Update Progress: 1853/2367 symbols completed. RZC took 33.9s. Estimated remaining: 1h 6m 13s. Rate: 7.8 symbols/min [2025-10-22T20:58:48.607413] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:58:48.636846] [DEBUG] [LOCAL ] SAFE: Loaded 30071 existing records from primary storage. [2025-10-22T20:58:48.637099] [INFO ] [MAIN ] SAFE: Loaded 30071 existing records. [2025-10-22T20:58:48.810626] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:58:48.810897] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-22T20:58:48.810950] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-22T20:58:48.811184] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-10-22T20:58:48.811223] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-22T20:58:48.922754] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-22T20:58:49.168592] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:58:49.194268] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T20:58:49.717707] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-22T20:58:50.517729] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-22T20:58:50.686001] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-22T20:58:51.323482] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-22T20:58:51.337679] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-22T20:58:51.821784] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T20:58:52.117708] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-22T20:58:52.917744] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-22T20:58:53.160875] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-22T20:58:53.445052] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T20:58:53.717711] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-22T20:58:54.517703] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-22T20:58:55.157439] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-22T20:58:55.166175] [INFO ] [REMOTE ] S: Full fetch complete (77659 records). [2025-10-22T20:58:55.166317] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-22T20:58:55.336522] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T20:58:55.339043] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-22T20:58:55.595344] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-22T20:58:55.595414] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-22T20:58:55.596685] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-22T20:58:55.596755] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-22T20:58:55.598283] [DEBUG] [LOCAL ] S: Trimmed 77659 records to 53538 (keeping 200 days of data) [2025-10-22T20:58:55.911306] [DEBUG] [LOCAL ] S: Primary data saved (53538 records). [2025-10-22T20:58:55.911456] [INFO ] [MAIN ] S: Full history saved. [2025-10-22T20:58:55.911538] [INFO ] [MAIN ] Update Progress: 1854/2367 symbols completed. S took 34.1s. Estimated remaining: 1h 6m 5s. Rate: 7.8 symbols/min [2025-10-22T20:58:56.080265] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:58:56.100384] [DEBUG] [LOCAL ] SAH: Loaded 20845 existing records from primary storage. [2025-10-22T20:58:56.100605] [INFO ] [MAIN ] SAH: Loaded 20845 existing records. [2025-10-22T20:58:56.122891] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-22T20:58:56.228152] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T20:58:56.319071] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T20:58:56.325860] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:58:56.326691] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-22T20:58:56.327109] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-22T20:58:56.327309] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-10-22T20:58:56.327363] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-22T20:58:56.675053] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:58:56.917613] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-22T20:58:57.717737] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-22T20:58:57.818996] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T20:58:58.155724] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T20:58:58.517733] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-22T20:58:58.723500] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-22T20:58:59.317797] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-22T20:58:59.493479] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T20:59:00.117718] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-22T20:59:00.924848] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-22T20:59:00.941583] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T20:59:01.712518] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T20:59:01.719029] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-22T20:59:01.761879] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-22T20:59:02.517748] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-22T20:59:03.317749] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-22T20:59:03.548140] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T20:59:03.772595] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-22T20:59:04.117617] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-22T20:59:04.319305] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T20:59:04.917638] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-22T20:59:05.717623] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-22T20:59:06.045369] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T20:59:06.054126] [INFO ] [REMOTE ] SA: Full fetch complete (63574 records). [2025-10-22T20:59:06.054270] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-22T20:59:06.250920] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T20:59:06.465397] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-22T20:59:06.465471] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-22T20:59:06.466472] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-22T20:59:06.466534] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-22T20:59:06.467728] [DEBUG] [LOCAL ] SA: Trimmed 63574 records to 44669 (keeping 200 days of data) [2025-10-22T20:59:06.523845] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-22T20:59:06.726055] [DEBUG] [LOCAL ] SA: Primary data saved (44669 records). [2025-10-22T20:59:06.726196] [INFO ] [MAIN ] SA: Full history saved. [2025-10-22T20:59:06.726275] [INFO ] [MAIN ] Update Progress: 1855/2367 symbols completed. SA took 33.5s. Estimated remaining: 1h 5m 59s. Rate: 7.8 symbols/min [2025-10-22T20:59:06.894068] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:59:06.894204] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-22T20:59:06.894241] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-22T20:59:06.894357] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-22T20:59:06.894425] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-22T20:59:06.894477] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-22T20:59:06.894518] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-22T20:59:07.244219] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:59:07.266974] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T20:59:07.317604] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-22T20:59:08.067307] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T20:59:08.117608] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-22T20:59:08.311624] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T20:59:08.917693] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-22T20:59:09.717703] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-22T20:59:09.748026] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T20:59:10.036099] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T20:59:10.517677] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-22T20:59:10.866486] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-22T20:59:11.034270] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-22T20:59:11.317701] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-22T20:59:12.117694] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-22T20:59:12.645540] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T20:59:12.917750] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-22T20:59:12.965919] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-22T20:59:12.967832] [INFO ] [REMOTE ] SABA: Full fetch complete (15044 records). [2025-10-22T20:59:12.967902] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-22T20:59:13.331920] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-22T20:59:13.332218] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-22T20:59:13.332563] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-22T20:59:13.332634] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-22T20:59:13.333136] [DEBUG] [LOCAL ] SABA: Trimmed 15044 records to 9181 (keeping 200 days of data) [2025-10-22T20:59:13.387596] [DEBUG] [LOCAL ] SABA: Primary data saved (9181 records). [2025-10-22T20:59:13.387759] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-22T20:59:13.387846] [INFO ] [MAIN ] Update Progress: 1856/2367 symbols completed. SABA took 34.7s. Estimated remaining: 1h 5m 51s. Rate: 7.8 symbols/min [2025-10-22T20:59:13.456232] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-22T20:59:13.594992] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:59:13.615850] [DEBUG] [LOCAL ] SAM: Loaded 21328 existing records from primary storage. [2025-10-22T20:59:13.616191] [INFO ] [MAIN ] SAM: Loaded 21328 existing records. [2025-10-22T20:59:13.719581] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-22T20:59:13.829040] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:59:13.829277] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-22T20:59:13.829350] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-22T20:59:13.829841] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-10-22T20:59:13.829898] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-22T20:59:14.179897] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:59:14.517757] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-22T20:59:14.962598] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-22T20:59:15.317725] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-22T20:59:16.117635] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-22T20:59:16.138155] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T20:59:16.458591] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T20:59:16.917749] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-22T20:59:17.347854] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-22T20:59:17.451775] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T20:59:17.717701] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-22T20:59:18.517734] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-22T20:59:18.600939] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-22T20:59:18.605287] [INFO ] [REMOTE ] SAFE: Full fetch complete (44008 records). [2025-10-22T20:59:18.605379] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-22T20:59:18.978842] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-22T20:59:18.978958] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-22T20:59:18.979844] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-22T20:59:18.979940] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-22T20:59:18.980962] [DEBUG] [LOCAL ] SAFE: Trimmed 44008 records to 29883 (keeping 200 days of data) [2025-10-22T20:59:19.164695] [DEBUG] [LOCAL ] SAFE: Primary data saved (29883 records). [2025-10-22T20:59:19.164844] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-22T20:59:19.164927] [INFO ] [MAIN ] Update Progress: 1857/2367 symbols completed. SAFE took 30.7s. Estimated remaining: 1h 5m 42s. Rate: 7.8 symbols/min [2025-10-22T20:59:19.318075] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-22T20:59:19.337157] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:59:19.385773] [DEBUG] [LOCAL ] SAN: Loaded 52969 existing records from primary storage. [2025-10-22T20:59:19.386090] [INFO ] [MAIN ] SAN: Loaded 52969 existing records. [2025-10-22T20:59:19.560941] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:59:19.561170] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-22T20:59:19.561218] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-22T20:59:19.561500] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-22T20:59:19.561562] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-22T20:59:19.710286] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T20:59:19.761036] [INFO ] [REMOTE ] SAH: Full fetch complete (30875 records). [2025-10-22T20:59:19.791493] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-22T20:59:20.120128] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:59:20.132124] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-22T20:59:20.320802] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-22T20:59:20.320957] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-22T20:59:20.321724] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-22T20:59:20.321786] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-22T20:59:20.322485] [DEBUG] [LOCAL ] SAH: Trimmed 30875 records to 20685 (keeping 200 days of data) [2025-10-22T20:59:20.450529] [DEBUG] [LOCAL ] SAH: Primary data saved (20685 records). [2025-10-22T20:59:20.450694] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-22T20:59:20.450804] [INFO ] [MAIN ] Update Progress: 1858/2367 symbols completed. SAH took 24.5s. Estimated remaining: 1h 5m 33s. Rate: 7.8 symbols/min [2025-10-22T20:59:20.628306] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:59:20.641897] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T20:59:20.687593] [DEBUG] [LOCAL ] SAP: Loaded 49869 existing records from primary storage. [2025-10-22T20:59:20.687936] [INFO ] [MAIN ] SAP: Loaded 49869 existing records. [2025-10-22T20:59:20.769295] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-22T20:59:20.876536] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:59:20.876799] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-22T20:59:20.876852] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-22T20:59:20.877060] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-22T20:59:20.877116] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-22T20:59:20.922870] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-22T20:59:21.237600] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:59:21.468399] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-22T20:59:21.717755] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-22T20:59:22.100005] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-22T20:59:22.517746] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-22T20:59:22.987328] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-22T20:59:23.317705] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-22T20:59:23.784122] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-22T20:59:24.117711] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-22T20:59:24.917748] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-22T20:59:25.717745] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-22T20:59:26.086103] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-22T20:59:26.122440] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-22T20:59:26.517723] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-22T20:59:27.317714] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-22T20:59:27.623328] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T20:59:27.721692] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-22T20:59:27.739419] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T20:59:28.117694] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-22T20:59:28.917754] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-22T20:59:29.382686] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-22T20:59:29.383392] [INFO ] [REMOTE ] SAJ: Full fetch complete (970 records). [2025-10-22T20:59:29.383473] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-22T20:59:29.561596] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-22T20:59:29.561784] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-22T20:59:29.561856] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-22T20:59:29.561942] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-22T20:59:29.562018] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-22T20:59:29.562054] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-22T20:59:29.562094] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-22T20:59:29.562149] [INFO ] [MAIN ] Update Progress: 1859/2367 symbols completed. SAJ took 22.8s. Estimated remaining: 1h 5m 25s. Rate: 7.8 symbols/min [2025-10-22T20:59:29.728832] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-22T20:59:29.733400] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:59:29.733672] [DEBUG] [LOCAL ] SAR: No existing data file found in primary storage. [2025-10-22T20:59:29.733731] [WARN ] [MAIN ] SAR: No existing data found, performing full refresh instead. [2025-10-22T20:59:29.733853] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-22T20:59:29.733896] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-22T20:59:29.733938] [DEBUG] [LOCAL ] SAR: No primary data file found to delete. [2025-10-22T20:59:29.733970] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-22T20:59:30.093715] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:59:30.119574] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-22T20:59:30.517639] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-22T20:59:30.961785] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T20:59:31.317757] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-22T20:59:31.399437] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-22T20:59:32.117767] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-22T20:59:32.751994] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T20:59:32.917631] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-22T20:59:33.717761] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-22T20:59:34.085158] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-22T20:59:34.241254] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T20:59:34.517738] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-22T20:59:35.317767] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-22T20:59:35.712847] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T20:59:35.818050] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-22T20:59:36.117759] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-22T20:59:36.917787] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-22T20:59:37.154260] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T20:59:37.471348] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-22T20:59:37.717632] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-22T20:59:38.517719] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-22T20:59:39.044530] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-22T20:59:39.317725] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-22T20:59:39.781345] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-22T20:59:39.918056] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-22T20:59:40.117703] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-22T20:59:40.178718] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-22T20:59:40.917691] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-22T20:59:41.717729] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-22T20:59:42.095519] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T20:59:42.099141] [INFO ] [REMOTE ] SAM: Full fetch complete (31180 records). [2025-10-22T20:59:42.099221] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-22T20:59:42.479156] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-22T20:59:42.479250] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-22T20:59:42.479904] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-22T20:59:42.479965] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-22T20:59:42.480710] [DEBUG] [LOCAL ] SAM: Trimmed 31180 records to 21215 (keeping 200 days of data) [2025-10-22T20:59:42.529842] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-22T20:59:42.611361] [DEBUG] [LOCAL ] SAM: Primary data saved (21215 records). [2025-10-22T20:59:42.611506] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-22T20:59:42.611595] [INFO ] [MAIN ] Update Progress: 1860/2367 symbols completed. SAM took 29.2s. Estimated remaining: 1h 5m 19s. Rate: 7.8 symbols/min [2025-10-22T20:59:42.781985] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:59:42.823212] [DEBUG] [LOCAL ] SARO: Loaded 48274 existing records from primary storage. [2025-10-22T20:59:42.823509] [INFO ] [MAIN ] SARO: Loaded 48274 existing records. [2025-10-22T20:59:43.011233] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T20:59:43.025471] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-22T20:59:43.027111] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-22T20:59:43.027013] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T20:59:43.033736] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-10-22T20:59:43.033917] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-22T20:59:43.173480] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (3.06 seconds). [2025-10-22T20:59:43.322880] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-10-22T20:59:43.436094] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:59:44.117703] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-22T20:59:44.534864] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T20:59:44.630165] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-22T20:59:44.917691] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-10-22T20:59:45.717767] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-22T20:59:45.823366] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T20:59:45.842387] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-22T20:59:46.517755] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-10-22T20:59:47.317744] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-22T20:59:47.395741] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T20:59:47.859315] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-22T20:59:48.117729] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-22T20:59:48.917745] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-22T20:59:49.717698] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-10-22T20:59:49.936485] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-10-22T20:59:49.975985] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T20:59:50.517735] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-22T20:59:50.876110] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T20:59:51.045811] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-22T20:59:51.320917] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-22T20:59:52.117742] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-10-22T20:59:52.527610] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-22T20:59:52.917609] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-22T20:59:53.268584] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T20:59:53.309052] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-22T20:59:53.717706] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-10. [2025-10-22T20:59:54.517728] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-22T20:59:55.056395] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-22T20:59:55.077173] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T20:59:55.081840] [INFO ] [REMOTE ] SAR: Full fetch complete (24083 records). [2025-10-22T20:59:55.081929] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-10-22T20:59:55.325329] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-22T20:59:55.447303] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-10-22T20:59:55.447383] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-10-22T20:59:55.447900] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-10-22T20:59:55.447960] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-10-22T20:59:55.448537] [DEBUG] [LOCAL ] SAR: Trimmed 24083 records to 17125 (keeping 200 days of data) [2025-10-22T20:59:55.549485] [DEBUG] [LOCAL ] SAR: Primary data saved (17125 records). [2025-10-22T20:59:55.549617] [INFO ] [MAIN ] SAR: Full history saved. [2025-10-22T20:59:55.549714] [INFO ] [MAIN ] Update Progress: 1861/2367 symbols completed. SAR took 26.0s. Estimated remaining: 1h 5m 13s. Rate: 7.8 symbols/min [2025-10-22T20:59:55.713428] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:59:55.713596] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-22T20:59:55.713636] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-22T20:59:55.713768] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-22T20:59:55.713807] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-22T20:59:55.713847] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-22T20:59:55.713882] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-22T20:59:56.058201] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T20:59:56.117612] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-22T20:59:56.631031] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-22T20:59:56.715287] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-22T20:59:56.917623] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-22T20:59:57.222254] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-22T20:59:57.717749] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-22T20:59:58.173080] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-22T20:59:58.517714] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-10-22T20:59:58.921030] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T20:59:58.929479] [INFO ] [REMOTE ] SAP: Full fetch complete (72331 records). [2025-10-22T20:59:58.929610] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-22T20:59:59.322501] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-22T20:59:59.322731] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-22T20:59:59.323489] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-22T20:59:59.324735] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-22T20:59:59.324900] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-22T20:59:59.326261] [DEBUG] [LOCAL ] SAP: Trimmed 72331 records to 49878 (keeping 200 days of data) [2025-10-22T20:59:59.624466] [DEBUG] [LOCAL ] SAP: Primary data saved (49878 records). [2025-10-22T20:59:59.624592] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-22T20:59:59.624702] [INFO ] [MAIN ] Update Progress: 1862/2367 symbols completed. SAP took 39.2s. Estimated remaining: 1h 5m 4s. Rate: 7.8 symbols/min [2025-10-22T20:59:59.796756] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T20:59:59.796980] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-22T20:59:59.797039] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-22T20:59:59.797156] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-22T20:59:59.797199] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-22T20:59:59.797243] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-22T20:59:59.797277] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-22T20:59:59.976217] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-22T21:00:00.122729] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-22T21:00:00.182326] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:00:00.350264] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T21:00:00.745127] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-22T21:00:00.917726] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-22T21:00:01.717701] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-10-22T21:00:02.035740] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-22T21:00:02.517729] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-22T21:00:03.317704] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-22T21:00:03.784906] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-22T21:00:03.931103] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-22T21:00:04.117764] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-22T21:00:04.735815] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-22T21:00:04.785546] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-22T21:00:04.917706] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-22T21:00:05.493083] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T21:00:05.717705] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-10-22T21:00:06.517690] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-22T21:00:07.248152] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T21:00:07.317631] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-22T21:00:07.882595] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-22T21:00:08.032612] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-22T21:00:08.117729] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-22T21:00:08.654348] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-22T21:00:08.655308] [INFO ] [REMOTE ] SAT: Full fetch complete (1485 records). [2025-10-22T21:00:08.655391] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-22T21:00:08.852130] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-22T21:00:08.852313] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:00:08.852382] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:00:08.852453] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-22T21:00:08.852516] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-22T21:00:08.852554] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-22T21:00:08.852594] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-22T21:00:08.852673] [INFO ] [MAIN ] Update Progress: 1863/2367 symbols completed. SAT took 13.3s. Estimated remaining: 1h 4m 57s. Rate: 7.8 symbols/min [2025-10-22T21:00:08.922874] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-10-22T21:00:09.042167] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:00:09.042306] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-22T21:00:09.042343] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-22T21:00:09.042448] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-22T21:00:09.042488] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-22T21:00:09.042528] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-22T21:00:09.042559] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-22T21:00:09.429534] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:00:09.717725] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-22T21:00:10.422278] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T21:00:10.517754] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-22T21:00:11.046779] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-22T21:00:11.134487] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-22T21:00:11.317832] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-22T21:00:11.847538] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-22T21:00:12.117683] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-22T21:00:12.648571] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-22T21:00:12.917727] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-22T21:00:13.529217] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-22T21:00:13.717736] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-22T21:00:14.517717] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-10-22T21:00:15.317706] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-22T21:00:15.874709] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-22T21:00:15.876031] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-22T21:00:16.117723] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-22T21:00:16.446359] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T21:00:16.917749] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-22T21:00:17.399892] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-22T21:00:17.717758] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-10. [2025-10-22T21:00:18.371212] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-22T21:00:18.379894] [INFO ] [REMOTE ] SAN: Full fetch complete (76587 records). [2025-10-22T21:00:18.380025] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-22T21:00:18.522833] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-10-22T21:00:18.778541] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-22T21:00:18.778624] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-22T21:00:18.779878] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-22T21:00:18.779943] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-22T21:00:18.781389] [DEBUG] [LOCAL ] SAN: Trimmed 76587 records to 52964 (keeping 200 days of data) [2025-10-22T21:00:19.091487] [DEBUG] [LOCAL ] SAN: Primary data saved (52964 records). [2025-10-22T21:00:19.091624] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-22T21:00:19.092244] [INFO ] [MAIN ] Update Progress: 1864/2367 symbols completed. SAN took 59.9s. Estimated remaining: 1h 4m 50s. Rate: 7.8 symbols/min [2025-10-22T21:00:19.223386] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-22T21:00:19.266022] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:00:19.296269] [DEBUG] [LOCAL ] SB: Loaded 32516 existing records from primary storage. [2025-10-22T21:00:19.296532] [INFO ] [MAIN ] SB: Loaded 32516 existing records. [2025-10-22T21:00:19.322782] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-22T21:00:19.485409] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:00:19.485893] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-22T21:00:19.486026] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-22T21:00:19.486261] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-22T21:00:19.486304] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-22T21:00:19.857886] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-22T21:00:19.877621] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T21:00:19.880938] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:00:19.890124] [INFO ] [REMOTE ] SARO: Full fetch complete (69027 records). [2025-10-22T21:00:19.890250] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-22T21:00:20.122768] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-22T21:00:20.286096] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-22T21:00:20.286205] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-22T21:00:20.287329] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-22T21:00:20.287397] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-22T21:00:20.288807] [DEBUG] [LOCAL ] SARO: Trimmed 69027 records to 48231 (keeping 200 days of data) [2025-10-22T21:00:20.573580] [DEBUG] [LOCAL ] SARO: Primary data saved (48231 records). [2025-10-22T21:00:20.573789] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-22T21:00:20.573907] [INFO ] [MAIN ] Update Progress: 1865/2367 symbols completed. SARO took 38.0s. Estimated remaining: 1h 4m 40s. Rate: 7.8 symbols/min [2025-10-22T21:00:20.671945] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-22T21:00:20.773946] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:00:20.774141] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-22T21:00:20.774180] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-22T21:00:20.774303] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-22T21:00:20.774345] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-22T21:00:20.774391] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-22T21:00:20.774473] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-22T21:00:20.930470] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-22T21:00:21.151718] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:00:21.717747] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-10-22T21:00:22.253823] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-22T21:00:22.517632] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-10-22T21:00:22.654122] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-22T21:00:23.114332] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T21:00:23.317640] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-10-22T21:00:23.900480] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-22T21:00:24.117624] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-01. [2025-10-22T21:00:24.448600] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:00:24.449063] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-01 [2025-10-22T21:00:24.449171] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:00:24.449222] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-22T21:00:24.449284] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:00:24.449357] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-22T21:00:24.449455] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-22T21:00:24.449512] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-22T21:00:24.449566] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-22T21:00:24.449672] [INFO ] [MAIN ] Update Progress: 1866/2367 symbols completed. SBDS took 3.9s. Estimated remaining: 1h 4m 32s. Rate: 7.8 symbols/min [2025-10-22T21:00:24.642523] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:00:24.687232] [DEBUG] [LOCAL ] SBH: Loaded 49869 existing records from primary storage. [2025-10-22T21:00:24.687570] [INFO ] [MAIN ] SBH: Loaded 49869 existing records. [2025-10-22T21:00:24.890050] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:00:24.890252] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-22T21:00:24.890299] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-22T21:00:24.890512] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-10-22T21:00:24.890586] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-22T21:00:24.922902] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-22T21:00:25.300425] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:00:25.717718] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-22T21:00:26.517699] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-22T21:00:26.631450] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T21:00:27.016552] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-22T21:00:27.217703] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T21:00:27.317614] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-22T21:00:28.118070] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-22T21:00:28.671286] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-22T21:00:28.672162] [INFO ] [REMOTE ] SAY: Full fetch complete (1378 records). [2025-10-22T21:00:28.672237] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-22T21:00:28.861804] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-22T21:00:28.861994] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:00:28.862041] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:00:28.862081] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-22T21:00:28.862139] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-22T21:00:28.862177] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-22T21:00:28.862219] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-22T21:00:28.862277] [INFO ] [MAIN ] Update Progress: 1867/2367 symbols completed. SAY took 29.2s. Estimated remaining: 1h 4m 23s. Rate: 7.8 symbols/min [2025-10-22T21:00:28.929760] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-10-22T21:00:29.043227] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:00:29.052898] [DEBUG] [LOCAL ] SBI: Loaded 7743 existing records from primary storage. [2025-10-22T21:00:29.053098] [INFO ] [MAIN ] SBI: Loaded 7743 existing records. [2025-10-22T21:00:29.256634] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:00:29.263440] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-22T21:00:29.263564] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-22T21:00:29.263850] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-22T21:00:29.263955] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-22T21:00:29.312582] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-22T21:00:29.546864] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T21:00:29.644392] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:00:29.717732] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-22T21:00:30.515416] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T21:00:30.517880] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-22T21:00:31.300273] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T21:00:31.317710] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-22T21:00:32.117750] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-10-22T21:00:32.687399] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-22T21:00:32.917691] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-10-22T21:00:32.970900] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T21:00:33.430025] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-22T21:00:33.717720] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-22T21:00:34.517733] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-22T21:00:35.317639] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-10. [2025-10-22T21:00:35.382833] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T21:00:35.421461] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-22T21:00:36.004711] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-22T21:00:36.005530] [INFO ] [REMOTE ] SAZ: Full fetch complete (1855 records). [2025-10-22T21:00:36.005599] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-22T21:00:36.122780] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-22T21:00:36.189512] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T21:00:36.189797] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:00:36.189870] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:00:36.189963] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-22T21:00:36.190049] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-22T21:00:36.190125] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-22T21:00:36.190178] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-22T21:00:36.190235] [INFO ] [MAIN ] Update Progress: 1868/2367 symbols completed. SAZ took 27.3s. Estimated remaining: 1h 4m 15s. Rate: 7.8 symbols/min [2025-10-22T21:00:36.358771] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:00:36.377936] [DEBUG] [LOCAL ] SBR: Loaded 7880 existing records from primary storage. [2025-10-22T21:00:36.378151] [INFO ] [MAIN ] SBR: Loaded 7880 existing records. [2025-10-22T21:00:36.551270] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:00:36.551482] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-22T21:00:36.551528] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-22T21:00:36.551694] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-22T21:00:36.551748] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-22T21:00:36.911557] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:00:36.917613] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-22T21:00:37.044612] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-22T21:00:37.705171] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T21:00:37.717622] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-22T21:00:38.517719] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-22T21:00:38.876031] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T21:00:39.317732] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-22T21:00:39.346769] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-22T21:00:40.117714] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-22T21:00:40.917696] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-22T21:00:41.355601] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-22T21:00:41.693450] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T21:00:41.706090] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T21:00:41.717605] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-22T21:00:42.517726] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-22T21:00:42.621853] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-22T21:00:43.317720] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-22T21:00:44.076108] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T21:00:44.117629] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-22T21:00:44.917691] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-22T21:00:45.224463] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T21:00:45.722759] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-22T21:00:45.733589] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T21:00:45.783101] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-22T21:00:46.517707] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-22T21:00:47.317628] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-22T21:00:47.392488] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-22T21:00:47.520445] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T21:00:48.117707] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-22T21:00:48.816710] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T21:00:48.917615] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-22T21:00:48.987067] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-22T21:00:49.717639] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-22T21:00:49.891335] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-22T21:00:50.517700] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-22T21:00:51.180434] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T21:00:51.186609] [INFO ] [REMOTE ] SB: Full fetch complete (49367 records). [2025-10-22T21:00:51.186773] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-22T21:00:51.330386] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-22T21:00:51.447960] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T21:00:51.598101] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-22T21:00:51.598185] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-22T21:00:51.599273] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-22T21:00:51.599344] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-22T21:00:51.600380] [DEBUG] [LOCAL ] SB: Trimmed 49367 records to 32405 (keeping 200 days of data) [2025-10-22T21:00:51.796502] [DEBUG] [LOCAL ] SB: Primary data saved (32405 records). [2025-10-22T21:00:51.796638] [INFO ] [MAIN ] SB: Full history saved. [2025-10-22T21:00:51.796765] [INFO ] [MAIN ] Update Progress: 1869/2367 symbols completed. SB took 32.7s. Estimated remaining: 1h 4m 9s. Rate: 7.8 symbols/min [2025-10-22T21:00:51.980755] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:00:52.025492] [DEBUG] [LOCAL ] SBS: Loaded 49295 existing records from primary storage. [2025-10-22T21:00:52.025815] [INFO ] [MAIN ] SBS: Loaded 49295 existing records. [2025-10-22T21:00:52.124409] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-22T21:00:52.204369] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:00:52.204555] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-22T21:00:52.204607] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-22T21:00:52.204834] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-22T21:00:52.204901] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-22T21:00:52.557254] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:00:52.882462] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-22T21:00:52.917847] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-22T21:00:53.185368] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T21:00:53.607549] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-22T21:00:53.717712] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-22T21:00:54.517746] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-22T21:00:54.612390] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T21:00:55.317733] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-22T21:00:55.592067] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T21:00:56.117746] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-22T21:00:56.917743] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-22T21:00:57.050141] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T21:00:57.096561] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T21:00:57.098732] [INFO ] [REMOTE ] SBR: Full fetch complete (11366 records). [2025-10-22T21:00:57.098800] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-22T21:00:57.465300] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-22T21:00:57.474081] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-22T21:00:57.474222] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-22T21:00:57.475397] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-22T21:00:57.475461] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-22T21:00:57.475999] [DEBUG] [LOCAL ] SBR: Trimmed 11366 records to 7813 (keeping 200 days of data) [2025-10-22T21:00:57.523508] [DEBUG] [LOCAL ] SBR: Primary data saved (7813 records). [2025-10-22T21:00:57.523638] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-22T21:00:57.523761] [INFO ] [MAIN ] Update Progress: 1870/2367 symbols completed. SBR took 21.3s. Estimated remaining: 1h 4m 1s. Rate: 7.8 symbols/min [2025-10-22T21:00:57.693342] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:00:57.709324] [DEBUG] [LOCAL ] SBSI: Loaded 14915 existing records from primary storage. [2025-10-22T21:00:57.709571] [INFO ] [MAIN ] SBSI: Loaded 14915 existing records. [2025-10-22T21:00:57.722882] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-22T21:00:57.892275] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:00:57.892470] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-22T21:00:57.892517] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-22T21:00:57.892719] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-10-22T21:00:57.892775] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-22T21:00:58.246213] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:00:58.517701] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-22T21:00:59.317686] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-22T21:00:59.672373] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T21:00:59.721407] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T21:01:00.117709] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-22T21:01:00.917732] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-22T21:01:01.280970] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-22T21:01:01.701209] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T21:01:01.717613] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-22T21:01:02.055683] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T21:01:02.517618] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-22T21:01:02.885798] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-22T21:01:03.317627] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-22T21:01:03.392490] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T21:01:03.394216] [INFO ] [REMOTE ] SBI: Full fetch complete (10606 records). [2025-10-22T21:01:03.394285] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-22T21:01:03.785401] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-22T21:01:03.785741] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-22T21:01:03.786514] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-22T21:01:03.786593] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-22T21:01:03.787723] [DEBUG] [LOCAL ] SBI: Trimmed 10606 records to 7748 (keeping 200 days of data) [2025-10-22T21:01:03.840621] [DEBUG] [LOCAL ] SBI: Primary data saved (7748 records). [2025-10-22T21:01:03.840847] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-22T21:01:03.840962] [INFO ] [MAIN ] Update Progress: 1871/2367 symbols completed. SBI took 35.0s. Estimated remaining: 1h 3m 53s. Rate: 7.8 symbols/min [2025-10-22T21:01:04.040185] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:01:04.093212] [DEBUG] [LOCAL ] SBSW: Loaded 53185 existing records from primary storage. [2025-10-22T21:01:04.093726] [INFO ] [MAIN ] SBSW: Loaded 53185 existing records. [2025-10-22T21:01:04.126389] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-22T21:01:04.290833] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:01:04.291170] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-22T21:01:04.291224] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-22T21:01:04.291809] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-10-22T21:01:04.291888] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-22T21:01:04.669508] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:01:04.917723] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-22T21:01:05.306619] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T21:01:05.419480] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-22T21:01:05.717632] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-22T21:01:06.517770] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-22T21:01:07.052627] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-22T21:01:07.317693] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-22T21:01:07.399288] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T21:01:07.408026] [INFO ] [REMOTE ] SBH: Full fetch complete (73010 records). [2025-10-22T21:01:07.408181] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-22T21:01:07.809775] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-22T21:01:07.809852] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-22T21:01:07.810953] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-22T21:01:07.811018] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-22T21:01:07.812343] [DEBUG] [LOCAL ] SBH: Trimmed 73010 records to 49854 (keeping 200 days of data) [2025-10-22T21:01:08.114331] [DEBUG] [LOCAL ] SBH: Primary data saved (49854 records). [2025-10-22T21:01:08.114608] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-22T21:01:08.138916] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-22T21:01:08.124512] [INFO ] [MAIN ] Update Progress: 1872/2367 symbols completed. SBH took 43.7s. Estimated remaining: 1h 3m 44s. Rate: 7.8 symbols/min [2025-10-22T21:01:08.216205] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T21:01:08.338323] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:01:08.339068] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-22T21:01:08.339477] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-22T21:01:08.339557] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-22T21:01:08.343016] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-22T21:01:08.343342] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-22T21:01:08.343403] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-22T21:01:08.343438] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-22T21:01:08.687936] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:01:08.917639] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-22T21:01:09.428507] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-22T21:01:09.717733] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-22T21:01:10.215732] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-22T21:01:10.406279] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-22T21:01:10.517684] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-22T21:01:10.900842] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-22T21:01:11.317744] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-22T21:01:12.117720] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-22T21:01:12.917734] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-22T21:01:13.457979] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-22T21:01:13.484147] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T21:01:13.717744] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-22T21:01:14.179073] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-22T21:01:14.517736] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-22T21:01:14.849254] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T21:01:15.317722] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-22T21:01:15.674482] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-22T21:01:16.117762] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-10-22T21:01:16.917708] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-22T21:01:17.212229] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T21:01:17.717759] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-22T21:01:18.015191] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-22T21:01:18.023128] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T21:01:18.096445] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-22T21:01:18.517631] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-22T21:01:19.317713] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-22T21:01:20.117889] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-10-22T21:01:20.315559] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T21:01:20.749079] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-22T21:01:20.917755] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-22T21:01:21.717628] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-22T21:01:21.994228] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T21:01:22.097170] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-22T21:01:22.517717] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-22T21:01:23.259050] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-22T21:01:23.317685] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-22T21:01:23.667860] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T21:01:23.941189] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-22T21:01:24.117702] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-10-22T21:01:24.917766] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-22T21:01:25.717725] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-22T21:01:25.981148] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T21:01:25.984263] [INFO ] [REMOTE ] SBSI: Full fetch complete (21359 records). [2025-10-22T21:01:25.984345] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-22T21:01:26.367684] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-22T21:01:26.367853] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-22T21:01:26.368361] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-22T21:01:26.368433] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-22T21:01:26.394837] [DEBUG] [LOCAL ] SBSI: Trimmed 21359 records to 14802 (keeping 200 days of data) [2025-10-22T21:01:26.396401] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-22T21:01:26.499800] [DEBUG] [LOCAL ] SBSI: Primary data saved (14802 records). [2025-10-22T21:01:26.499935] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-22T21:01:26.500016] [INFO ] [MAIN ] Update Progress: 1873/2367 symbols completed. SBSI took 29.0s. Estimated remaining: 1h 3m 40s. Rate: 7.8 symbols/min [2025-10-22T21:01:26.522734] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-22T21:01:26.669732] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:01:26.711507] [DEBUG] [LOCAL ] SCCO: Loaded 49596 existing records from primary storage. [2025-10-22T21:01:26.711847] [INFO ] [MAIN ] SCCO: Loaded 49596 existing records. [2025-10-22T21:01:26.882908] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:01:26.883114] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-22T21:01:26.883194] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-22T21:01:26.883827] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-22T21:01:26.883889] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-22T21:01:27.154560] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-22T21:01:27.244196] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:01:27.317611] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-22T21:01:27.543798] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T21:01:27.982822] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-22T21:01:28.117613] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-22T21:01:28.615811] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-22T21:01:28.917712] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-22T21:01:29.717734] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-22T21:01:30.163109] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-22T21:01:30.163853] [INFO ] [REMOTE ] SBXD: Full fetch complete (3139 records). [2025-10-22T21:01:30.163920] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-22T21:01:30.352342] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-10-22T21:01:30.352601] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:01:30.352718] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:01:30.352805] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-22T21:01:30.352889] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-22T21:01:30.352941] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-22T21:01:30.353000] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-22T21:01:30.353076] [INFO ] [MAIN ] Update Progress: 1874/2367 symbols completed. SBXD took 22.2s. Estimated remaining: 1h 3m 31s. Rate: 7.8 symbols/min [2025-10-22T21:01:30.517912] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:01:30.517975] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-10-22T21:01:30.532324] [DEBUG] [LOCAL ] SCD: Loaded 13518 existing records from primary storage. [2025-10-22T21:01:30.532554] [INFO ] [MAIN ] SCD: Loaded 13518 existing records. [2025-10-22T21:01:30.718212] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:01:30.718452] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-22T21:01:30.718504] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-22T21:01:30.718724] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-22T21:01:30.718787] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-22T21:01:31.086712] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:01:31.137437] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-22T21:01:31.317617] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-22T21:01:32.117744] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-22T21:01:32.187813] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-22T21:01:32.608576] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-22T21:01:32.917639] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-22T21:01:33.135433] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T21:01:33.717635] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-10-22T21:01:33.801325] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-22T21:01:34.517748] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-22T21:01:35.317751] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-22T21:01:35.904095] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-22T21:01:36.016881] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-22T21:01:36.117625] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-22T21:01:36.293671] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T21:01:36.301694] [INFO ] [REMOTE ] SBS: Full fetch complete (70698 records). [2025-10-22T21:01:36.301819] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-22T21:01:36.725542] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-22T21:01:36.725620] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-22T21:01:36.726754] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-22T21:01:36.726816] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-22T21:01:36.728168] [DEBUG] [LOCAL ] SBS: Trimmed 70698 records to 49293 (keeping 200 days of data) [2025-10-22T21:01:36.924239] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-10-22T21:01:37.012247] [DEBUG] [LOCAL ] SBS: Primary data saved (49293 records). [2025-10-22T21:01:37.012368] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-22T21:01:37.012942] [INFO ] [MAIN ] Update Progress: 1875/2367 symbols completed. SBS took 45.2s. Estimated remaining: 1h 3m 23s. Rate: 7.8 symbols/min [2025-10-22T21:01:37.180744] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:01:37.230806] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-22T21:01:37.231104] [INFO ] [MAIN ] SCHW: Loaded 53685 existing records. [2025-10-22T21:01:37.409316] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:01:37.409704] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-22T21:01:37.419513] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-22T21:01:37.433112] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-10-22T21:01:37.433231] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-22T21:01:37.532973] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T21:01:37.722796] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-22T21:01:37.812735] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:01:38.517733] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-22T21:01:38.644736] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-22T21:01:38.902792] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T21:01:39.317700] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-22T21:01:39.535662] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-22T21:01:40.117735] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-10. [2025-10-22T21:01:40.443735] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-22T21:01:40.917742] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-22T21:01:41.720744] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-22T21:01:41.726032] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T21:01:42.400888] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-22T21:01:42.409739] [INFO ] [REMOTE ] SBSW: Full fetch complete (76749 records). [2025-10-22T21:01:42.409865] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-22T21:01:42.527229] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-22T21:01:42.769295] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T21:01:42.849481] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-22T21:01:42.849572] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-22T21:01:42.850721] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-22T21:01:42.850787] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-22T21:01:42.852225] [DEBUG] [LOCAL ] SBSW: Trimmed 76749 records to 53185 (keeping 200 days of data) [2025-10-22T21:01:43.150739] [DEBUG] [LOCAL ] SBSW: Primary data saved (53185 records). [2025-10-22T21:01:43.150860] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-22T21:01:43.150935] [INFO ] [MAIN ] Update Progress: 1876/2367 symbols completed. SBSW took 39.3s. Estimated remaining: 1h 3m 15s. Rate: 7.8 symbols/min [2025-10-22T21:01:43.319485] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:01:43.319559] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-22T21:01:43.361624] [DEBUG] [LOCAL ] SCI: Loaded 46251 existing records from primary storage. [2025-10-22T21:01:43.361939] [INFO ] [MAIN ] SCI: Loaded 46251 existing records. [2025-10-22T21:01:43.545353] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:01:43.545682] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-22T21:01:43.545819] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-22T21:01:43.546100] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-10-22T21:01:43.546175] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-22T21:01:43.685470] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T21:01:43.937515] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:01:44.117628] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-22T21:01:44.191599] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-22T21:01:44.917769] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-22T21:01:45.717635] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-22T21:01:45.832332] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-22T21:01:45.964066] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T21:01:46.517631] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-22T21:01:46.870098] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-22T21:01:47.317630] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-22T21:01:47.534864] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T21:01:48.117758] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-22T21:01:48.722819] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-22T21:01:48.917759] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-22T21:01:49.479462] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-22T21:01:49.489392] [INFO ] [REMOTE ] SCCO: Full fetch complete (71900 records). [2025-10-22T21:01:49.489606] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-22T21:01:49.725889] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-22T21:01:49.893230] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-22T21:01:49.893334] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-22T21:01:49.894905] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-22T21:01:49.895138] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-22T21:01:49.896836] [DEBUG] [LOCAL ] SCCO: Trimmed 71900 records to 49566 (keeping 200 days of data) [2025-10-22T21:01:50.188877] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T21:01:50.221554] [DEBUG] [LOCAL ] SCCO: Primary data saved (49566 records). [2025-10-22T21:01:50.221734] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-22T21:01:50.221828] [INFO ] [MAIN ] Update Progress: 1877/2367 symbols completed. SCCO took 23.7s. Estimated remaining: 1h 3m 7s. Rate: 7.8 symbols/min [2025-10-22T21:01:50.517720] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-22T21:01:51.317630] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-22T21:01:51.351429] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T21:01:51.592386] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-22T21:01:51.890422] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-22T21:01:52.117715] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-22T21:01:52.917715] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-22T21:01:53.717630] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-22T21:01:53.796147] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T21:01:53.994614] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T21:01:54.471194] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-22T21:01:54.517696] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-22T21:01:55.317723] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-22T21:01:56.117777] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-22T21:01:56.433996] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T21:01:56.489740] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T21:01:56.917622] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-22T21:01:57.083590] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T21:01:57.717748] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-22T21:01:57.856758] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T21:01:58.517732] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-22T21:01:58.747926] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T21:01:58.750539] [INFO ] [REMOTE ] SCD: Full fetch complete (17113 records). [2025-10-22T21:01:58.750610] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-22T21:01:59.108245] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-22T21:01:59.108322] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-22T21:01:59.108738] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-22T21:01:59.108800] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-22T21:01:59.109418] [DEBUG] [LOCAL ] SCD: Trimmed 17113 records to 13496 (keeping 200 days of data) [2025-10-22T21:01:59.191197] [DEBUG] [LOCAL ] SCD: Primary data saved (13496 records). [2025-10-22T21:01:59.191361] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-22T21:01:59.191442] [INFO ] [MAIN ] Update Progress: 1878/2367 symbols completed. SCD took 28.8s. Estimated remaining: 1h 2m 59s. Rate: 7.8 symbols/min [2025-10-22T21:01:59.317631] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-22T21:01:59.554019] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T21:02:00.117698] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-22T21:02:01.447388] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T21:02:01.457070] [INFO ] [REMOTE ] SCHW: Full fetch complete (77865 records). [2025-10-22T21:02:01.457216] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-22T21:02:01.873313] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-22T21:02:01.873409] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-22T21:02:01.874576] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-22T21:02:01.874744] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-22T21:02:01.901721] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-22T21:02:01.911783] [DEBUG] [LOCAL ] SCHW: Trimmed 77865 records to 53685 (keeping 200 days of data) [2025-10-22T21:02:01.912715] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-22T21:02:02.242030] [DEBUG] [LOCAL ] SCHW: Primary data saved (53685 records). [2025-10-22T21:02:02.242216] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-22T21:02:02.242827] [INFO ] [MAIN ] Update Progress: 1879/2367 symbols completed. SCHW took 25.2s. Estimated remaining: 1h 2m 50s. Rate: 7.8 symbols/min [2025-10-22T21:02:03.692151] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T21:02:03.701785] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-22T21:02:05.584244] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T21:02:05.595418] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-22T21:02:07.341967] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T21:02:07.351718] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-22T21:02:09.097165] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T21:02:09.106613] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-22T21:02:10.931095] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T21:02:10.938442] [INFO ] [REMOTE ] SCI: Full fetch complete (67525 records). [2025-10-22T21:02:10.938559] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-22T21:02:11.332228] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-22T21:02:11.332329] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-22T21:02:11.333380] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-22T21:02:11.333442] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-22T21:02:11.334731] [DEBUG] [LOCAL ] SCI: Trimmed 67525 records to 46165 (keeping 200 days of data) [2025-10-22T21:02:11.613436] [DEBUG] [LOCAL ] SCI: Primary data saved (46165 records). [2025-10-22T21:02:11.613614] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-22T21:02:11.613740] [INFO ] [MAIN ] Update Progress: 1880/2367 symbols completed. SCI took 28.5s. Estimated remaining: 1h 2m 43s. Rate: 7.8 symbols/min [2025-10-22T21:02:12.251325] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:02:12.250500] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:02:12.303188] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:02:12.306581] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:02:12.343857] [DEBUG] [LOCAL ] SCM: Loaded 20048 existing records from primary storage. [2025-10-22T21:02:12.343087] [DEBUG] [LOCAL ] SCL: Loaded 15125 existing records from primary storage. [2025-10-22T21:02:12.351541] [INFO ] [MAIN ] SCL: Loaded 15125 existing records. [2025-10-22T21:02:12.352737] [INFO ] [MAIN ] SCM: Loaded 20048 existing records. [2025-10-22T21:02:12.397588] [DEBUG] [LOCAL ] SD: Loaded 28387 existing records from primary storage. [2025-10-22T21:02:12.459736] [INFO ] [MAIN ] SD: Loaded 28387 existing records. [2025-10-22T21:02:12.858471] [DEBUG] [LOCAL ] SCS: Loaded 43289 existing records from primary storage. [2025-10-22T21:02:12.947856] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:02:12.906798] [INFO ] [MAIN ] SCS: Loaded 43289 existing records. [2025-10-22T21:02:13.023286] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:02:12.984483] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-22T21:02:13.038238] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-22T21:02:13.049032] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-22T21:02:13.085094] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-22T21:02:13.090600] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-22T21:02:13.133134] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-10-22T21:02:13.146130] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-22T21:02:13.133011] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-22T21:02:13.307111] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:02:13.344156] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-22T21:02:13.389436] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-22T21:02:13.466590] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-10-22T21:02:13.509389] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-22T21:02:13.789714] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:02:13.852798] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-22T21:02:13.931422] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-22T21:02:13.993478] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-22T21:02:14.034775] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-22T21:02:14.756821] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:02:14.656171] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:02:14.772589] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-22T21:02:14.774524] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-22T21:02:14.769235] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:02:14.792570] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-22T21:02:14.980521] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:02:14.980880] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-22T21:02:16.110073] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T21:02:16.113686] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-22T21:02:16.137035] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-22T21:02:16.141597] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-22T21:02:16.213194] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T21:02:16.220927] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-22T21:02:16.311525] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T21:02:16.316868] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-22T21:02:17.178136] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T21:02:17.181353] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-22T21:02:17.324612] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T21:02:17.328246] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-22T21:02:17.593263] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T21:02:17.598211] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-22T21:02:17.935939] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T21:02:17.943430] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-22T21:02:17.992305] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T21:02:17.996011] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-22T21:02:18.717287] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-22T21:02:18.723012] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-22T21:02:19.190617] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T21:02:19.198576] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-22T21:02:19.212438] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T21:02:19.218250] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-22T21:02:19.553017] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T21:02:19.561947] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-22T21:02:20.102678] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T21:02:20.107923] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-22T21:02:20.264688] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-22T21:02:20.271630] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-22T21:02:20.382322] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T21:02:20.386116] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-22T21:02:21.048789] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-22T21:02:21.053511] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-22T21:02:21.153171] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T21:02:21.284417] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-22T21:02:21.424617] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T21:02:21.717768] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-22T21:02:21.906277] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-22T21:02:22.517734] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-22T21:02:23.173473] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T21:02:23.317755] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-22T21:02:24.117748] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-22T21:02:24.258860] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T21:02:24.878398] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T21:02:24.917620] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-22T21:02:25.186103] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-22T21:02:25.717717] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-22T21:02:26.352795] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T21:02:26.517700] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-22T21:02:27.088036] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T21:02:27.317734] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-22T21:02:28.043542] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T21:02:28.117727] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-22T21:02:28.371899] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T21:02:28.917753] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-22T21:02:29.717634] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-22T21:02:30.086054] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T21:02:30.118429] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-22T21:02:30.517744] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-22T21:02:30.784220] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-22T21:02:31.280058] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-22T21:02:31.283231] [INFO ] [REMOTE ] SCL: Full fetch complete (21611 records). [2025-10-22T21:02:31.283304] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-22T21:02:31.322761] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-22T21:02:31.649468] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-22T21:02:31.649567] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-22T21:02:31.650152] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-22T21:02:31.650215] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-22T21:02:31.650808] [DEBUG] [LOCAL ] SCL: Trimmed 21611 records to 15126 (keeping 200 days of data) [2025-10-22T21:02:31.741282] [DEBUG] [LOCAL ] SCL: Primary data saved (15126 records). [2025-10-22T21:02:31.741407] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-22T21:02:31.741508] [INFO ] [MAIN ] Update Progress: 1881/2367 symbols completed. SCL took 20.1s. Estimated remaining: 1h 2m 39s. Rate: 7.8 symbols/min [2025-10-22T21:02:31.907248] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:02:31.918788] [DEBUG] [LOCAL ] SDHC: Loaded 10367 existing records from primary storage. [2025-10-22T21:02:31.919011] [INFO ] [MAIN ] SDHC: Loaded 10367 existing records. [2025-10-22T21:02:32.094818] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:02:32.095023] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-22T21:02:32.095127] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-22T21:02:32.095336] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-22T21:02:32.095409] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-22T21:02:32.128498] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-22T21:02:32.466541] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:02:32.477464] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T21:02:32.917759] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-22T21:02:33.717772] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-22T21:02:33.918491] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T21:02:34.117903] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T21:02:34.517697] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-22T21:02:34.633448] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T21:02:35.317623] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-22T21:02:35.565911] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T21:02:36.117737] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-22T21:02:36.917621] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-22T21:02:37.069432] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T21:02:37.076716] [INFO ] [REMOTE ] SCS: Full fetch complete (61080 records). [2025-10-22T21:02:37.076833] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-22T21:02:37.378445] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T21:02:37.481673] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-22T21:02:37.481757] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-22T21:02:37.482721] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-22T21:02:37.482782] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-22T21:02:37.483903] [DEBUG] [LOCAL ] SCS: Trimmed 61080 records to 43227 (keeping 200 days of data) [2025-10-22T21:02:37.722926] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-22T21:02:37.744245] [DEBUG] [LOCAL ] SCS: Primary data saved (43227 records). [2025-10-22T21:02:37.744450] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-22T21:02:37.744532] [INFO ] [MAIN ] Update Progress: 1882/2367 symbols completed. SCS took 26.1s. Estimated remaining: 1h 2m 30s. Rate: 7.8 symbols/min [2025-10-22T21:02:37.915231] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:02:37.927382] [DEBUG] [LOCAL ] SDHY: Loaded 11218 existing records from primary storage. [2025-10-22T21:02:37.927602] [INFO ] [MAIN ] SDHY: Loaded 11218 existing records. [2025-10-22T21:02:38.104342] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:02:38.104544] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-22T21:02:38.104591] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-22T21:02:38.104753] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-22T21:02:38.104808] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-22T21:02:38.226671] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T21:02:38.275752] [INFO ] [REMOTE ] SD: Full fetch complete (40723 records). [2025-10-22T21:02:38.328989] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-22T21:02:38.522487] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-22T21:02:38.622064] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:02:38.785364] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T21:02:38.861553] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-22T21:02:38.861622] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-22T21:02:38.862430] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-22T21:02:38.862482] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-22T21:02:38.863310] [DEBUG] [LOCAL ] SD: Trimmed 40723 records to 28248 (keeping 200 days of data) [2025-10-22T21:02:39.031133] [DEBUG] [LOCAL ] SD: Primary data saved (28248 records). [2025-10-22T21:02:39.031256] [INFO ] [MAIN ] SD: Full history saved. [2025-10-22T21:02:39.031337] [INFO ] [MAIN ] Update Progress: 1883/2367 symbols completed. SD took 27.4s. Estimated remaining: 1h 2m 21s. Rate: 7.8 symbols/min [2025-10-22T21:02:39.200719] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:02:39.200865] [DEBUG] [LOCAL ] SDRL: No existing data file found in primary storage. [2025-10-22T21:02:39.200900] [WARN ] [MAIN ] SDRL: No existing data found, performing full refresh instead. [2025-10-22T21:02:39.201005] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-22T21:02:39.201044] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-22T21:02:39.201085] [DEBUG] [LOCAL ] SDRL: No primary data file found to delete. [2025-10-22T21:02:39.201116] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-22T21:02:39.322870] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-22T21:02:39.551461] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:02:39.842855] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-22T21:02:40.059541] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T21:02:40.117684] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-22T21:02:40.917713] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-22T21:02:41.024481] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T21:02:41.717854] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-22T21:02:42.120026] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T21:02:42.517624] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-22T21:02:42.671625] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T21:02:43.317734] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-22T21:02:43.917861] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T21:02:43.922346] [INFO ] [REMOTE ] SCM: Full fetch complete (29255 records). [2025-10-22T21:02:43.922464] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-22T21:02:44.122753] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-22T21:02:44.243921] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-22T21:02:44.315043] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-22T21:02:44.315128] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-22T21:02:44.315876] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-22T21:02:44.315940] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-22T21:02:44.316856] [DEBUG] [LOCAL ] SCM: Trimmed 29255 records to 19989 (keeping 200 days of data) [2025-10-22T21:02:44.439164] [DEBUG] [LOCAL ] SCM: Primary data saved (19989 records). [2025-10-22T21:02:44.439304] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-22T21:02:44.439384] [INFO ] [MAIN ] Update Progress: 1884/2367 symbols completed. SCM took 32.8s. Estimated remaining: 1h 2m 13s. Rate: 7.8 symbols/min [2025-10-22T21:02:44.614807] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:02:44.614998] [DEBUG] [LOCAL ] SE: No existing data file found in primary storage. [2025-10-22T21:02:44.615035] [WARN ] [MAIN ] SE: No existing data found, performing full refresh instead. [2025-10-22T21:02:44.615148] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-22T21:02:44.615190] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-22T21:02:44.615231] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-10-22T21:02:44.615263] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-22T21:02:44.922909] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-22T21:02:44.983638] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:02:45.717758] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-22T21:02:45.877449] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T21:02:45.901889] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-22T21:02:46.517637] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-22T21:02:46.701118] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-22T21:02:47.317635] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-22T21:02:47.546840] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T21:02:48.117711] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-22T21:02:48.917693] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-22T21:02:48.987784] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T21:02:49.072418] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-22T21:02:49.074887] [INFO ] [REMOTE ] SDHC: Full fetch complete (16793 records). [2025-10-22T21:02:49.074955] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-22T21:02:49.425511] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-22T21:02:49.425582] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-22T21:02:49.425949] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-22T21:02:49.426009] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-22T21:02:49.426478] [DEBUG] [LOCAL ] SDHC: Trimmed 16793 records to 10378 (keeping 200 days of data) [2025-10-22T21:02:49.485111] [DEBUG] [LOCAL ] SDHC: Primary data saved (10378 records). [2025-10-22T21:02:49.485216] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-22T21:02:49.485290] [INFO ] [MAIN ] Update Progress: 1885/2367 symbols completed. SDHC took 17.7s. Estimated remaining: 1h 2m 4s. Rate: 7.8 symbols/min [2025-10-22T21:02:49.650276] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:02:49.691918] [DEBUG] [LOCAL ] SEE: Loaded 48111 existing records from primary storage. [2025-10-22T21:02:49.692198] [INFO ] [MAIN ] SEE: Loaded 48111 existing records. [2025-10-22T21:02:49.722751] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-22T21:02:49.876123] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:02:49.876377] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-22T21:02:49.876432] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-22T21:02:49.876918] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-10-22T21:02:49.876973] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-22T21:02:50.056936] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T21:02:50.237861] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:02:50.517688] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-22T21:02:51.317632] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-22T21:02:51.785178] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-22T21:02:52.117620] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-22T21:02:52.204959] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T21:02:52.246145] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-22T21:02:52.917758] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-22T21:02:53.717731] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-22T21:02:54.001957] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T21:02:54.229202] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T21:02:54.517746] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-22T21:02:55.317619] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-10-22T21:02:55.382089] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T21:02:56.117750] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-22T21:02:56.852100] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-22T21:02:56.917678] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-22T21:02:57.077285] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T21:02:57.136872] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T21:02:57.717757] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-22T21:02:58.465556] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-22T21:02:58.517729] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-22T21:02:59.124502] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-22T21:02:59.317724] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-22T21:02:59.439173] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-22T21:03:00.117759] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-22T21:03:00.917727] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-10-22T21:03:01.398082] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T21:03:01.717741] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-22T21:03:02.111925] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-10-22T21:03:02.407432] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-22T21:03:02.410457] [INFO ] [REMOTE ] SDHY: Full fetch complete (15923 records). [2025-10-22T21:03:02.410547] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-22T21:03:02.517781] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-22T21:03:02.724284] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T21:03:02.813152] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-22T21:03:02.813229] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-22T21:03:02.813560] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-22T21:03:02.813599] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-22T21:03:02.814141] [DEBUG] [LOCAL ] SDHY: Trimmed 15923 records to 11210 (keeping 200 days of data) [2025-10-22T21:03:02.885250] [DEBUG] [LOCAL ] SDHY: Primary data saved (11210 records). [2025-10-22T21:03:02.885385] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-22T21:03:02.885498] [INFO ] [MAIN ] Update Progress: 1886/2367 symbols completed. SDHY took 25.1s. Estimated remaining: 1h 1m 58s. Rate: 7.8 symbols/min [2025-10-22T21:03:03.052405] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:03:03.066285] [DEBUG] [LOCAL ] SEG: Loaded 12613 existing records from primary storage. [2025-10-22T21:03:03.066485] [INFO ] [MAIN ] SEG: Loaded 12613 existing records. [2025-10-22T21:03:03.240276] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:03:03.240433] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-22T21:03:03.240476] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-22T21:03:03.240606] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-22T21:03:03.240666] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-22T21:03:03.322747] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-10-22T21:03:03.587558] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:03:04.117718] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-22T21:03:04.511108] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T21:03:04.917726] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-22T21:03:05.080193] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T21:03:05.717706] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-10-22T21:03:05.835524] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T21:03:06.528058] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-22T21:03:06.548402] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-22T21:03:07.317748] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-22T21:03:07.475296] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T21:03:07.635502] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T21:03:08.117693] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-10-22T21:03:08.917719] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-22T21:03:09.508628] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-22T21:03:09.717698] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-22T21:03:09.841612] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T21:03:09.889086] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-22T21:03:10.517760] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-22T21:03:11.317707] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-22T21:03:12.117690] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-10-22T21:03:12.155856] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-22T21:03:12.452197] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-22T21:03:12.454228] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-22T21:03:12.917713] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-22T21:03:13.717637] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-22T21:03:13.903198] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T21:03:14.517683] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-22T21:03:14.717723] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T21:03:14.764414] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T21:03:15.317636] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-10. [2025-10-22T21:03:16.117725] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-22T21:03:16.922763] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-22T21:03:16.943545] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-22T21:03:16.975256] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T21:03:16.981874] [INFO ] [REMOTE ] SDRL: Full fetch complete (61150 records). [2025-10-22T21:03:16.982002] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-10-22T21:03:17.332632] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T21:03:17.384199] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-10-22T21:03:17.384678] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-10-22T21:03:17.385878] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-10-22T21:03:17.385947] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-10-22T21:03:17.387251] [DEBUG] [LOCAL ] SDRL: Trimmed 61150 records to 41106 (keeping 200 days of data) [2025-10-22T21:03:17.639682] [DEBUG] [LOCAL ] SDRL: Primary data saved (41106 records). [2025-10-22T21:03:17.640098] [INFO ] [MAIN ] SDRL: Full history saved. [2025-10-22T21:03:17.640189] [INFO ] [MAIN ] Update Progress: 1887/2367 symbols completed. SDRL took 38.6s. Estimated remaining: 1h 1m 52s. Rate: 7.8 symbols/min [2025-10-22T21:03:17.722940] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-22T21:03:17.816145] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:03:17.857388] [DEBUG] [LOCAL ] SEI: Loaded 50023 existing records from primary storage. [2025-10-22T21:03:17.857831] [INFO ] [MAIN ] SEI: Loaded 50023 existing records. [2025-10-22T21:03:18.028748] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:03:18.028981] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-22T21:03:18.029028] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-22T21:03:18.029959] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-10-22T21:03:18.030017] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-22T21:03:18.377690] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:03:18.517621] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-22T21:03:18.783968] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T21:03:19.317626] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-22T21:03:19.530107] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T21:03:20.113587] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-22T21:03:20.123513] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-22T21:03:20.917767] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-22T21:03:21.174366] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T21:03:21.717693] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-22T21:03:21.748516] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-22T21:03:21.757359] [INFO ] [REMOTE ] SE: Full fetch complete (76894 records). [2025-10-22T21:03:21.757619] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-22T21:03:21.803745] [FATAL] [VALIDATOR ] SE: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T21:03:21.806209] [FATAL] [MAIN ] SE: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:03:21.806327] [WARN ] [MAIN ] SE: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:03:21.806451] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-22T21:03:21.806590] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-10-22T21:03:21.806824] [INFO ] [LOCAL ] SE: Starting deletion of derivative data. [2025-10-22T21:03:21.808297] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T21:03:21.807267] [DEBUG] [LOCAL ] SE: No derivative data file found to delete. [2025-10-22T21:03:21.818374] [INFO ] [MAIN ] Update Progress: 1888/2367 symbols completed. SE took 37.4s. Estimated remaining: 1h 1m 43s. Rate: 7.8 symbols/min [2025-10-22T21:03:21.994540] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:03:22.033070] [DEBUG] [LOCAL ] SEM: Loaded 43198 existing records from primary storage. [2025-10-22T21:03:22.033391] [INFO ] [MAIN ] SEM: Loaded 43198 existing records. [2025-10-22T21:03:22.210922] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:03:22.211143] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-22T21:03:22.211189] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-22T21:03:22.211401] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-10-22T21:03:22.211457] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-22T21:03:22.520001] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-22T21:03:22.553776] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:03:23.317749] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-22T21:03:23.613425] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-22T21:03:24.117620] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-22T21:03:24.382367] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T21:03:24.431903] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T21:03:24.917745] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-22T21:03:25.717619] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-22T21:03:25.890272] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T21:03:25.898390] [INFO ] [REMOTE ] SEE: Full fetch complete (70079 records). [2025-10-22T21:03:25.898537] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-22T21:03:26.024628] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-22T21:03:26.300556] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-22T21:03:26.300706] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-22T21:03:26.301822] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-22T21:03:26.301886] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-22T21:03:26.303312] [DEBUG] [LOCAL ] SEE: Trimmed 70079 records to 48091 (keeping 200 days of data) [2025-10-22T21:03:26.518789] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-22T21:03:26.589159] [DEBUG] [LOCAL ] SEE: Primary data saved (48091 records). [2025-10-22T21:03:26.589283] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-22T21:03:26.589357] [INFO ] [MAIN ] Update Progress: 1889/2367 symbols completed. SEE took 37.1s. Estimated remaining: 1h 1m 35s. Rate: 7.8 symbols/min [2025-10-22T21:03:26.756660] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:03:26.792998] [DEBUG] [LOCAL ] SEMR: Loaded 42075 existing records from primary storage. [2025-10-22T21:03:26.793283] [INFO ] [MAIN ] SEMR: Loaded 42075 existing records. [2025-10-22T21:03:26.963849] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:03:26.964046] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-22T21:03:26.964092] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-22T21:03:26.964455] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-22T21:03:26.964492] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-22T21:03:27.315254] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:03:27.323913] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-22T21:03:27.338548] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T21:03:28.117626] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-22T21:03:28.478291] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T21:03:28.917708] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-22T21:03:28.992130] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T21:03:29.422504] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-22T21:03:29.717687] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-22T21:03:29.857122] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T21:03:29.859267] [INFO ] [REMOTE ] SEG: Full fetch complete (19809 records). [2025-10-22T21:03:29.859336] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-22T21:03:30.219623] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-22T21:03:30.219729] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-22T21:03:30.220158] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-22T21:03:30.220197] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-22T21:03:30.220784] [DEBUG] [LOCAL ] SEG: Trimmed 19809 records to 12503 (keeping 200 days of data) [2025-10-22T21:03:30.291551] [DEBUG] [LOCAL ] SEG: Primary data saved (12503 records). [2025-10-22T21:03:30.291702] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-22T21:03:30.291813] [INFO ] [MAIN ] Update Progress: 1890/2367 symbols completed. SEG took 27.4s. Estimated remaining: 1h 1m 26s. Rate: 7.8 symbols/min [2025-10-22T21:03:30.459881] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:03:30.507989] [DEBUG] [LOCAL ] SES: Loaded 51604 existing records from primary storage. [2025-10-22T21:03:30.508298] [INFO ] [MAIN ] SES: Loaded 51604 existing records. [2025-10-22T21:03:30.522770] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-22T21:03:30.700727] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:03:30.700958] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-22T21:03:30.701007] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-22T21:03:30.701186] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-22T21:03:30.701225] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-22T21:03:31.081014] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:03:31.317634] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-22T21:03:31.388239] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T21:03:32.117700] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-22T21:03:32.612014] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-22T21:03:32.917701] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-22T21:03:33.689501] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T21:03:33.717713] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-22T21:03:34.033867] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-22T21:03:34.517627] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-22T21:03:34.866131] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T21:03:35.317691] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-22T21:03:35.518635] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T21:03:36.117736] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-22T21:03:36.755223] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-22T21:03:36.917683] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-22T21:03:36.954974] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T21:03:37.717701] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-22T21:03:37.879118] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T21:03:38.517760] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-22T21:03:39.317705] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-22T21:03:39.501962] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T21:03:39.625738] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-10-22T21:03:39.780291] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T21:03:40.117684] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-22T21:03:40.917693] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-22T21:03:41.369116] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-22T21:03:41.593043] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T21:03:41.717747] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-22T21:03:42.182242] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-22T21:03:42.517695] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-22T21:03:43.235470] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T21:03:43.317628] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-22T21:03:44.117637] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-22T21:03:44.448386] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-22T21:03:44.542510] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-22T21:03:44.917691] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-22T21:03:45.717701] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-22T21:03:46.517711] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-22T21:03:46.671320] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-22T21:03:46.857239] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-22T21:03:47.292368] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T21:03:47.317614] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-22T21:03:48.089484] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T21:03:48.117614] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-22T21:03:48.917739] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-22T21:03:48.948790] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-22T21:03:48.958855] [INFO ] [REMOTE ] SEM: Full fetch complete (61524 records). [2025-10-22T21:03:48.958975] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-22T21:03:49.341064] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-22T21:03:49.341138] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-22T21:03:49.342121] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-22T21:03:49.342183] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-22T21:03:49.343320] [DEBUG] [LOCAL ] SEM: Trimmed 61524 records to 43168 (keeping 200 days of data) [2025-10-22T21:03:49.594484] [DEBUG] [LOCAL ] SEM: Primary data saved (43168 records). [2025-10-22T21:03:49.594599] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-22T21:03:49.594714] [INFO ] [MAIN ] Update Progress: 1891/2367 symbols completed. SEM took 27.8s. Estimated remaining: 1h 1m 21s. Rate: 7.8 symbols/min [2025-10-22T21:03:49.723054] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-22T21:03:49.765782] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:03:49.791403] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T21:03:49.831947] [DEBUG] [LOCAL ] SF: Loaded 41371 existing records from primary storage. [2025-10-22T21:03:49.832218] [INFO ] [MAIN ] SF: Loaded 41371 existing records. [2025-10-22T21:03:50.003058] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:03:50.003252] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-22T21:03:50.003298] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-22T21:03:50.003588] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-10-22T21:03:50.003671] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-22T21:03:50.344978] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:03:50.517624] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-22T21:03:51.099257] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-22T21:03:51.108088] [INFO ] [REMOTE ] SEI: Full fetch complete (71241 records). [2025-10-22T21:03:51.108204] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-22T21:03:51.329512] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-22T21:03:51.494804] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-22T21:03:51.494899] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-22T21:03:51.495997] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-22T21:03:51.496072] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-22T21:03:51.497363] [DEBUG] [LOCAL ] SEI: Trimmed 71241 records to 50024 (keeping 200 days of data) [2025-10-22T21:03:51.793738] [DEBUG] [LOCAL ] SEI: Primary data saved (50024 records). [2025-10-22T21:03:51.793855] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-22T21:03:51.793932] [INFO ] [MAIN ] Update Progress: 1892/2367 symbols completed. SEI took 34.2s. Estimated remaining: 1h 1m 12s. Rate: 7.8 symbols/min [2025-10-22T21:03:51.964269] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:03:51.970765] [DEBUG] [LOCAL ] SFB: Loaded 3739 existing records from primary storage. [2025-10-22T21:03:51.971049] [INFO ] [MAIN ] SFB: Loaded 3739 existing records. [2025-10-22T21:03:52.152997] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:03:52.153624] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-22T21:03:52.153860] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-22T21:03:52.154099] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-22T21:03:52.154310] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-22T21:03:52.316678] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-22T21:03:52.380687] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-22T21:03:52.485732] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-22T21:03:52.605750] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:03:52.917694] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-22T21:03:53.290327] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-22T21:03:53.525350] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-22T21:03:53.717723] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-22T21:03:54.517689] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-22T21:03:54.874496] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-10-22T21:03:55.156119] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T21:03:55.317730] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-22T21:03:55.434567] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T21:03:56.117722] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-22T21:03:56.917629] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-22T21:03:57.106216] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T21:03:57.674824] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-22T21:03:57.717702] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-22T21:03:58.410832] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-22T21:03:58.517633] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-22T21:03:58.588187] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-22T21:03:59.317760] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-22T21:04:00.117702] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-22T21:04:00.199885] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T21:04:00.207419] [INFO ] [REMOTE ] SEMR: Full fetch complete (60660 records). [2025-10-22T21:04:00.207548] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-22T21:04:00.599545] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-22T21:04:00.599634] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-22T21:04:00.600794] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-22T21:04:00.600884] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-22T21:04:00.602106] [DEBUG] [LOCAL ] SEMR: Trimmed 60660 records to 42068 (keeping 200 days of data) [2025-10-22T21:04:00.842526] [DEBUG] [LOCAL ] SEMR: Primary data saved (42068 records). [2025-10-22T21:04:00.842676] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-22T21:04:00.842777] [INFO ] [MAIN ] Update Progress: 1893/2367 symbols completed. SEMR took 34.3s. Estimated remaining: 1h 1m 5s. Rate: 7.8 symbols/min [2025-10-22T21:04:00.918448] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-22T21:04:00.938427] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-22T21:04:01.024400] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:04:01.043937] [DEBUG] [LOCAL ] SFBS: Loaded 21362 existing records from primary storage. [2025-10-22T21:04:01.044196] [INFO ] [MAIN ] SFBS: Loaded 21362 existing records. [2025-10-22T21:04:01.237744] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:04:01.237991] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-22T21:04:01.238038] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-22T21:04:01.238261] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-10-22T21:04:01.238299] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-22T21:04:01.609857] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:04:01.652625] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-22T21:04:01.717697] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-22T21:04:02.397115] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-22T21:04:02.517689] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-22T21:04:03.057101] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-22T21:04:03.274699] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-22T21:04:03.317692] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-22T21:04:04.117712] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-22T21:04:04.917690] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-22T21:04:05.265798] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T21:04:05.717852] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-22T21:04:06.267253] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T21:04:06.517698] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-22T21:04:06.643731] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-22T21:04:07.137267] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-22T21:04:07.317736] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-22T21:04:07.463457] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T21:04:07.992299] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-22T21:04:08.117701] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-22T21:04:08.715864] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T21:04:08.717020] [INFO ] [REMOTE ] SFB: Full fetch complete (5777 records). [2025-10-22T21:04:08.717091] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-22T21:04:08.922741] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-22T21:04:09.069998] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-22T21:04:09.070076] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-22T21:04:09.070263] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-22T21:04:09.070302] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-22T21:04:09.070684] [DEBUG] [LOCAL ] SFB: Trimmed 5777 records to 3697 (keeping 200 days of data) [2025-10-22T21:04:09.092405] [DEBUG] [LOCAL ] SFB: Primary data saved (3697 records). [2025-10-22T21:04:09.092489] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-22T21:04:09.092561] [INFO ] [MAIN ] Update Progress: 1894/2367 symbols completed. SFB took 17.3s. Estimated remaining: 1h 0m 57s. Rate: 7.8 symbols/min [2025-10-22T21:04:09.256502] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:04:09.294377] [DEBUG] [LOCAL ] SFL: Loaded 45311 existing records from primary storage. [2025-10-22T21:04:09.294680] [INFO ] [MAIN ] SFL: Loaded 45311 existing records. [2025-10-22T21:04:09.473586] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:04:09.473870] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-22T21:04:09.473927] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-22T21:04:09.474393] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-10-22T21:04:09.474448] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-22T21:04:09.722740] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-22T21:04:09.822847] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:04:10.517630] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-22T21:04:10.755910] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-22T21:04:10.894755] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T21:04:11.317626] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-22T21:04:11.576890] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-22T21:04:11.585736] [INFO ] [REMOTE ] SES: Full fetch complete (75647 records). [2025-10-22T21:04:11.585863] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-22T21:04:11.994171] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-22T21:04:11.994269] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-22T21:04:11.995370] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-22T21:04:11.995433] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-22T21:04:11.996824] [DEBUG] [LOCAL ] SES: Trimmed 75647 records to 51614 (keeping 200 days of data) [2025-10-22T21:04:12.154907] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-22T21:04:12.296792] [DEBUG] [LOCAL ] SES: Primary data saved (51614 records). [2025-10-22T21:04:12.297004] [INFO ] [MAIN ] SES: Full history saved. [2025-10-22T21:04:12.297722] [INFO ] [MAIN ] Update Progress: 1895/2367 symbols completed. SES took 42.0s. Estimated remaining: 1h 0m 48s. Rate: 7.8 symbols/min [2025-10-22T21:04:12.471986] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:04:12.526797] [DEBUG] [LOCAL ] SG: Loaded 53504 existing records from primary storage. [2025-10-22T21:04:12.527135] [INFO ] [MAIN ] SG: Loaded 53504 existing records. [2025-10-22T21:04:12.726754] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-22T21:04:12.733216] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:04:12.740267] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-22T21:04:12.740331] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-22T21:04:12.741223] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-10-22T21:04:12.741301] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-22T21:04:12.933692] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-22T21:04:13.185989] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:04:13.717709] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-22T21:04:13.906475] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T21:04:14.482812] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T21:04:14.517614] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-22T21:04:15.317763] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-22T21:04:15.509159] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T21:04:15.715432] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-22T21:04:16.117738] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-22T21:04:16.917639] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-22T21:04:17.097057] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T21:04:17.717711] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-22T21:04:18.127350] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T21:04:18.177434] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T21:04:18.517727] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-22T21:04:19.063513] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T21:04:19.317617] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-10-22T21:04:19.718927] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T21:04:20.117708] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-22T21:04:20.917764] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-22T21:04:21.291639] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T21:04:21.717743] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-22T21:04:21.797639] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T21:04:22.517621] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-22T21:04:22.621448] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T21:04:22.942774] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T21:04:23.317677] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-22T21:04:24.117634] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-22T21:04:24.228013] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T21:04:24.235021] [INFO ] [REMOTE ] SF: Full fetch complete (60421 records). [2025-10-22T21:04:24.235128] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-22T21:04:24.609037] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-22T21:04:24.609156] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-22T21:04:24.610157] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-22T21:04:24.610219] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-22T21:04:24.611375] [DEBUG] [LOCAL ] SF: Trimmed 60421 records to 41355 (keeping 200 days of data) [2025-10-22T21:04:24.871979] [DEBUG] [LOCAL ] SF: Primary data saved (41355 records). [2025-10-22T21:04:24.872089] [INFO ] [MAIN ] SF: Full history saved. [2025-10-22T21:04:24.872162] [INFO ] [MAIN ] Update Progress: 1896/2367 symbols completed. SF took 35.3s. Estimated remaining: 1h 0m 42s. Rate: 7.8 symbols/min [2025-10-22T21:04:24.939498] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-10-22T21:04:25.046439] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:04:25.088230] [DEBUG] [LOCAL ] SGHC: Loaded 47267 existing records from primary storage. [2025-10-22T21:04:25.088510] [INFO ] [MAIN ] SGHC: Loaded 47267 existing records. [2025-10-22T21:04:25.300581] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:04:25.300963] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-22T21:04:25.303910] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-22T21:04:25.304307] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-22T21:04:25.305865] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-22T21:04:25.304739] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-22T21:04:25.585549] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T21:04:25.691714] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:04:25.717617] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-22T21:04:26.517688] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-22T21:04:26.855569] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T21:04:26.943244] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T21:04:26.947497] [INFO ] [REMOTE ] SFBS: Full fetch complete (30550 records). [2025-10-22T21:04:26.947609] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-22T21:04:27.302731] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-22T21:04:27.302812] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-22T21:04:27.303374] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-22T21:04:27.303412] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-22T21:04:27.304084] [DEBUG] [LOCAL ] SFBS: Trimmed 30550 records to 21398 (keeping 200 days of data) [2025-10-22T21:04:27.355737] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-22T21:04:27.434018] [DEBUG] [LOCAL ] SFBS: Primary data saved (21398 records). [2025-10-22T21:04:27.434143] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-22T21:04:27.434219] [INFO ] [MAIN ] Update Progress: 1897/2367 symbols completed. SFBS took 26.6s. Estimated remaining: 1h 0m 33s. Rate: 7.8 symbols/min [2025-10-22T21:04:27.596737] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:04:27.596874] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-22T21:04:27.596911] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-22T21:04:27.597018] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-22T21:04:27.597058] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-22T21:04:27.597114] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-22T21:04:27.597148] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-22T21:04:27.945035] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:04:28.011951] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T21:04:28.117710] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-10-22T21:04:28.917765] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-01. [2025-10-22T21:04:29.300813] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:04:29.301074] [WARN ] [REMOTE ] SGI: No data returned for month 2025-01 [2025-10-22T21:04:29.301177] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:04:29.301271] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-22T21:04:29.301354] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:04:29.301450] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-22T21:04:29.301531] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-22T21:04:29.301570] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-22T21:04:29.301611] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-22T21:04:29.301676] [INFO ] [MAIN ] Update Progress: 1898/2367 symbols completed. SGI took 1.9s. Estimated remaining: 1h 0m 24s. Rate: 7.8 symbols/min [2025-10-22T21:04:29.471167] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:04:29.479594] [DEBUG] [LOCAL ] SGU: Loaded 6532 existing records from primary storage. [2025-10-22T21:04:29.479817] [INFO ] [MAIN ] SGU: Loaded 6532 existing records. [2025-10-22T21:04:29.657608] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:04:29.657945] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-22T21:04:29.657994] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-22T21:04:29.658128] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-22T21:04:29.658164] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-22T21:04:29.726191] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-22T21:04:30.015270] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-22T21:04:30.062196] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:04:30.255700] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-22T21:04:30.517735] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-10-22T21:04:31.317733] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-10-22T21:04:31.785622] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-22T21:04:32.117753] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-22T21:04:32.917699] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-22T21:04:33.144478] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-22T21:04:33.676127] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T21:04:33.717628] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-22T21:04:33.936607] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T21:04:34.250199] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (3.73 seconds). [2025-10-22T21:04:34.473673] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T21:04:34.517621] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-22T21:04:35.317735] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-22T21:04:36.047548] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-22T21:04:36.117616] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-22T21:04:36.356752] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T21:04:36.901800] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-22T21:04:36.917610] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-22T21:04:37.479301] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-22T21:04:37.717683] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-10-22T21:04:38.517770] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-22T21:04:39.317739] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-22T21:04:39.954310] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-22T21:04:40.117623] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-10-22T21:04:40.136912] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-22T21:04:40.336034] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T21:04:40.917690] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-10-22T21:04:41.717737] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-22T21:04:42.304416] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-22T21:04:42.517638] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-10-22T21:04:42.799461] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T21:04:43.317745] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-22T21:04:43.467442] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T21:04:44.117630] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-22T21:04:44.343830] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-22T21:04:44.749344] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-22T21:04:44.917612] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-10-22T21:04:45.717635] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-10-22T21:04:45.999222] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T21:04:46.517744] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-22T21:04:47.073774] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-22T21:04:47.317734] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-22T21:04:47.391541] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-22T21:04:47.524846] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T21:04:48.117690] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-10-22T21:04:48.917768] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-10. [2025-10-22T21:04:49.246468] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-22T21:04:49.717739] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-22T21:04:49.997929] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T21:04:50.517631] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-22T21:04:50.987346] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-22T21:04:50.996286] [INFO ] [REMOTE ] SG: Full fetch complete (77479 records). [2025-10-22T21:04:50.996409] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-22T21:04:51.178682] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-22T21:04:51.318016] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-10. [2025-10-22T21:04:51.414559] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-22T21:04:51.414661] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-22T21:04:51.415796] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-22T21:04:51.415859] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-22T21:04:51.417237] [DEBUG] [LOCAL ] SG: Trimmed 77479 records to 53505 (keeping 200 days of data) [2025-10-22T21:04:51.722774] [DEBUG] [LOCAL ] SG: Primary data saved (53505 records). [2025-10-22T21:04:51.723017] [INFO ] [MAIN ] SG: Full history saved. [2025-10-22T21:04:51.723942] [INFO ] [MAIN ] Update Progress: 1899/2367 symbols completed. SG took 39.4s. Estimated remaining: 1h 0m 20s. Rate: 7.8 symbols/min [2025-10-22T21:04:51.923573] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-22T21:04:51.925801] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:04:51.984077] [DEBUG] [LOCAL ] SHAK: Loaded 48675 existing records from primary storage. [2025-10-22T21:04:51.984421] [INFO ] [MAIN ] SHAK: Loaded 48675 existing records. [2025-10-22T21:04:52.124164] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-22T21:04:52.164395] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:04:52.164555] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-22T21:04:52.164601] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-22T21:04:52.164816] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-10-22T21:04:52.164872] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-22T21:04:52.504637] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:04:52.917637] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-22T21:04:53.229793] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-22T21:04:53.237754] [INFO ] [REMOTE ] SFL: Full fetch complete (65949 records). [2025-10-22T21:04:53.237874] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-10-22T21:04:53.616845] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-10-22T21:04:53.617001] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-10-22T21:04:53.618094] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-10-22T21:04:53.618158] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-10-22T21:04:53.619440] [DEBUG] [LOCAL ] SFL: Trimmed 65949 records to 45244 (keeping 200 days of data) [2025-10-22T21:04:53.720486] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-22T21:04:53.898154] [DEBUG] [LOCAL ] SFL: Primary data saved (45244 records). [2025-10-22T21:04:53.898347] [INFO ] [MAIN ] SFL: Full history saved. [2025-10-22T21:04:53.898488] [INFO ] [MAIN ] Update Progress: 1900/2367 symbols completed. SFL took 44.8s. Estimated remaining: 1h 0m 10s. Rate: 7.8 symbols/min [2025-10-22T21:04:54.123189] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:04:54.124918] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T21:04:54.134150] [INFO ] [REMOTE ] SGHC: Full fetch complete (65696 records). [2025-10-22T21:04:54.134362] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-22T21:04:54.343520] [DEBUG] [LOCAL ] SHCO: Loaded 25262 existing records from primary storage. [2025-10-22T21:04:54.400613] [INFO ] [MAIN ] SHCO: Loaded 25262 existing records. [2025-10-22T21:04:54.565162] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-22T21:04:54.577456] [INFO ] [REMOTE ] SGU: Full fetch complete (8903 records). [2025-10-22T21:04:54.627269] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-22T21:04:54.719359] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:04:54.773619] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-22T21:04:54.800868] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-22T21:04:54.807393] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-22T21:04:54.807517] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-22T21:04:54.813032] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-22T21:04:54.818895] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-22T21:04:54.840639] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-10-22T21:04:54.840979] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-22T21:04:54.875177] [DEBUG] [LOCAL ] SGHC: Trimmed 65696 records to 47310 (keeping 200 days of data) [2025-10-22T21:04:55.264728] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-22T21:04:55.403372] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-22T21:04:55.710027] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-22T21:04:55.723895] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-22T21:04:55.753709] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-22T21:04:55.767378] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-22T21:04:55.833922] [DEBUG] [LOCAL ] SGU: Trimmed 8903 records to 6507 (keeping 200 days of data) [2025-10-22T21:04:55.884173] [DEBUG] [LOCAL ] SGHC: Primary data saved (47310 records). [2025-10-22T21:04:55.939795] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-22T21:04:55.971340] [INFO ] [MAIN ] Update Progress: 1901/2367 symbols completed. SGHC took 31.1s. Estimated remaining: 1h 0m 1s. Rate: 7.8 symbols/min [2025-10-22T21:04:55.976780] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:04:55.992449] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-22T21:04:56.089316] [DEBUG] [LOCAL ] SGU: Primary data saved (6507 records). [2025-10-22T21:04:56.100127] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-22T21:04:56.100238] [INFO ] [MAIN ] Update Progress: 1902/2367 symbols completed. SGU took 26.8s. Estimated remaining: 59m 52s. Rate: 7.8 symbols/min [2025-10-22T21:04:56.291921] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:04:56.346188] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:04:56.371188] [DEBUG] [LOCAL ] SHG: Loaded 26685 existing records from primary storage. [2025-10-22T21:04:56.371448] [INFO ] [MAIN ] SHG: Loaded 26685 existing records. [2025-10-22T21:04:56.579212] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:04:56.579460] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-22T21:04:56.579570] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-22T21:04:56.580766] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-22T21:04:56.580697] [DEBUG] [LOCAL ] SHEL: Loaded 53675 existing records from primary storage. [2025-10-22T21:04:56.580949] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-22T21:04:56.612519] [INFO ] [MAIN ] SHEL: Loaded 53675 existing records. [2025-10-22T21:04:56.992338] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:04:57.022181] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-22T21:04:57.038034] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-22T21:04:57.058417] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-22T21:04:57.060786] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-22T21:04:57.272043] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:04:57.299090] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-22T21:04:57.515368] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:04:57.525345] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-22T21:04:57.527565] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T21:04:57.560733] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-22T21:04:57.717722] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-22T21:04:58.517717] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-22T21:04:58.909069] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T21:04:59.317749] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-22T21:04:59.710456] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T21:04:59.750211] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-22T21:04:59.853711] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-22T21:05:00.117739] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-22T21:05:00.921282] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-22T21:05:00.923391] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T21:05:01.717733] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-22T21:05:01.775342] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T21:05:02.517710] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-22T21:05:03.302554] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-22T21:05:03.317608] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-22T21:05:03.654747] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T21:05:03.765852] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T21:05:04.117628] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-22T21:05:04.917629] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-22T21:05:05.341258] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T21:05:05.681941] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-22T21:05:05.717767] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-22T21:05:06.486591] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T21:05:06.517624] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-22T21:05:07.317758] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-22T21:05:07.470572] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T21:05:08.117629] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-22T21:05:08.768638] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T21:05:08.927232] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-22T21:05:08.948303] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-22T21:05:08.986176] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-22T21:05:09.717754] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-22T21:05:10.517740] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-22T21:05:10.964918] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-22T21:05:11.071314] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T21:05:11.317776] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-22T21:05:12.117727] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-22T21:05:12.917807] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-22T21:05:12.962681] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-22T21:05:13.173722] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-22T21:05:13.717760] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-22T21:05:13.742730] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T21:05:14.278743] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T21:05:14.517724] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-22T21:05:15.317727] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-22T21:05:15.427606] [DEBUG] [REMOTE ] SHCO: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-22T21:05:15.427982] [WARN ] [REMOTE ] SHCO: No data returned for month 2025-08 [2025-10-22T21:05:15.428076] [FATAL] [REMOTE ] SHCO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:05:15.428151] [FATAL] [MAIN ] SHCO: Failed to fetch primary data. [2025-10-22T21:05:15.428215] [WARN ] [MAIN ] SHCO: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:05:15.428290] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-22T21:05:15.428352] [DEBUG] [LOCAL ] SHCO: No primary data file found to delete. [2025-10-22T21:05:15.428388] [INFO ] [LOCAL ] SHCO: Starting deletion of derivative data. [2025-10-22T21:05:15.428548] [DEBUG] [LOCAL ] SHCO: Deleted derivative data file. [2025-10-22T21:05:15.428631] [INFO ] [MAIN ] Update Progress: 1903/2367 symbols completed. SHCO took 21.5s. Estimated remaining: 59m 47s. Rate: 7.8 symbols/min [2025-10-22T21:05:15.599627] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:05:15.642412] [DEBUG] [LOCAL ] SHO: Loaded 49179 existing records from primary storage. [2025-10-22T21:05:15.642924] [INFO ] [MAIN ] SHO: Loaded 49179 existing records. [2025-10-22T21:05:15.824008] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:05:15.824498] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-22T21:05:15.824584] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-22T21:05:15.825722] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-10-22T21:05:15.825784] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-22T21:05:16.098780] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-22T21:05:16.130179] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-22T21:05:16.224581] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:05:16.801202] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-22T21:05:16.917747] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-22T21:05:17.563346] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T21:05:17.717745] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-22T21:05:18.517705] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-22T21:05:18.714115] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T21:05:19.317718] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-22T21:05:19.660336] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T21:05:19.967620] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T21:05:20.117700] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-22T21:05:20.791156] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T21:05:20.917784] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-22T21:05:21.717626] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-22T21:05:21.884312] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T21:05:22.517678] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-22T21:05:22.788323] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T21:05:23.317754] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-22T21:05:24.125177] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-22T21:05:24.128597] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-22T21:05:24.382603] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T21:05:24.390357] [INFO ] [REMOTE ] SHAK: Full fetch complete (71237 records). [2025-10-22T21:05:24.390461] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-22T21:05:24.769988] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-22T21:05:24.770085] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-22T21:05:24.771164] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-22T21:05:24.771270] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-22T21:05:24.772725] [DEBUG] [LOCAL ] SHAK: Trimmed 71237 records to 48652 (keeping 200 days of data) [2025-10-22T21:05:24.939887] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-22T21:05:25.008381] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T21:05:25.101691] [DEBUG] [LOCAL ] SHAK: Primary data saved (48652 records). [2025-10-22T21:05:25.101867] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-22T21:05:25.102636] [INFO ] [MAIN ] Update Progress: 1904/2367 symbols completed. SHAK took 33.4s. Estimated remaining: 59m 40s. Rate: 7.8 symbols/min [2025-10-22T21:05:25.268684] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:05:25.273730] [DEBUG] [LOCAL ] SHOC: Loaded 3084 existing records from primary storage. [2025-10-22T21:05:25.273910] [INFO ] [MAIN ] SHOC: Loaded 3084 existing records. [2025-10-22T21:05:25.453944] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:05:25.454273] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-22T21:05:25.454323] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-22T21:05:25.454492] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-22T21:05:25.454547] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-22T21:05:25.606928] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-22T21:05:25.657972] [INFO ] [REMOTE ] SHG: Full fetch complete (41325 records). [2025-10-22T21:05:25.717043] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-22T21:05:25.722468] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-22T21:05:25.948356] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:05:26.202941] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-22T21:05:26.203009] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-22T21:05:26.203813] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-22T21:05:26.203874] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-22T21:05:26.204743] [DEBUG] [LOCAL ] SHG: Trimmed 41325 records to 26653 (keeping 200 days of data) [2025-10-22T21:05:26.361962] [DEBUG] [LOCAL ] SHG: Primary data saved (26653 records). [2025-10-22T21:05:26.362335] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-22T21:05:26.362438] [INFO ] [MAIN ] Update Progress: 1905/2367 symbols completed. SHG took 30.3s. Estimated remaining: 59m 30s. Rate: 7.8 symbols/min [2025-10-22T21:05:26.522915] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-22T21:05:26.567620] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:05:26.615665] [DEBUG] [LOCAL ] SHW: Loaded 50402 existing records from primary storage. [2025-10-22T21:05:26.615991] [INFO ] [MAIN ] SHW: Loaded 50402 existing records. [2025-10-22T21:05:26.796199] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:05:26.796435] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-22T21:05:26.796483] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-22T21:05:26.797180] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-10-22T21:05:26.797251] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-22T21:05:27.151742] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:05:27.317631] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-22T21:05:27.419412] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-22T21:05:27.528158] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T21:05:27.666467] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-22T21:05:28.117743] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-22T21:05:28.722292] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-22T21:05:28.917696] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-22T21:05:29.266053] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T21:05:29.717702] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-22T21:05:29.934628] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T21:05:30.517742] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-22T21:05:31.317746] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-22T21:05:32.075517] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-22T21:05:32.082410] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-22T21:05:32.117634] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-22T21:05:32.408120] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T21:05:32.619509] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-22T21:05:32.917728] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-22T21:05:33.630567] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-22T21:05:33.717746] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-22T21:05:34.517684] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-22T21:05:35.317715] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-22T21:05:35.323605] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T21:05:35.736395] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-22T21:05:36.117752] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-22T21:05:36.917704] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-22T21:05:37.501700] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-22T21:05:37.510536] [INFO ] [REMOTE ] SHEL: Full fetch complete (77837 records). [2025-10-22T21:05:37.510715] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-22T21:05:37.733185] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-22T21:05:37.902894] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-22T21:05:37.902981] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-22T21:05:37.904158] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-22T21:05:37.904226] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-22T21:05:37.905695] [DEBUG] [LOCAL ] SHEL: Trimmed 77837 records to 53675 (keeping 200 days of data) [2025-10-22T21:05:38.232851] [DEBUG] [LOCAL ] SHEL: Primary data saved (53675 records). [2025-10-22T21:05:38.232988] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-22T21:05:38.233067] [INFO ] [MAIN ] Update Progress: 1906/2367 symbols completed. SHEL took 42.3s. Estimated remaining: 59m 24s. Rate: 7.8 symbols/min [2025-10-22T21:05:38.410687] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-22T21:05:38.439787] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:05:38.447124] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-22T21:05:38.447510] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-22T21:05:38.447694] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-22T21:05:38.447898] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-22T21:05:38.448065] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-22T21:05:38.448149] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-22T21:05:38.522734] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-22T21:05:38.596703] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T21:05:38.638495] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T21:05:38.860788] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:05:39.317703] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-22T21:05:39.910526] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-22T21:05:40.117721] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-22T21:05:40.567064] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-22T21:05:40.759249] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T21:05:40.760365] [INFO ] [REMOTE ] SHOC: Full fetch complete (6789 records). [2025-10-22T21:05:40.760449] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-22T21:05:40.922843] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-01. [2025-10-22T21:05:41.113164] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-22T21:05:41.113237] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-22T21:05:41.113410] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-22T21:05:41.113448] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-22T21:05:41.113840] [DEBUG] [LOCAL ] SHOC: Trimmed 6789 records to 3016 (keeping 200 days of data) [2025-10-22T21:05:41.132629] [DEBUG] [LOCAL ] SHOC: Primary data saved (3016 records). [2025-10-22T21:05:41.132817] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-22T21:05:41.132911] [INFO ] [MAIN ] Update Progress: 1907/2367 symbols completed. SHOC took 16.0s. Estimated remaining: 59m 15s. Rate: 7.8 symbols/min [2025-10-22T21:05:41.306433] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:05:41.329065] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:05:41.329397] [WARN ] [REMOTE ] SI: No data returned for month 2025-01 [2025-10-22T21:05:41.329486] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:05:41.329533] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-22T21:05:41.329592] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:05:41.329689] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-22T21:05:41.329760] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-22T21:05:41.329796] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-22T21:05:41.329834] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-22T21:05:41.329881] [INFO ] [MAIN ] Update Progress: 1908/2367 symbols completed. SI took 3.1s. Estimated remaining: 59m 5s. Rate: 7.8 symbols/min [2025-10-22T21:05:41.476708] [DEBUG] [LOCAL ] SID: Loaded 42896 existing records from primary storage. [2025-10-22T21:05:41.497719] [INFO ] [MAIN ] SID: Loaded 42896 existing records. [2025-10-22T21:05:41.624785] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:05:41.720209] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-22T21:05:41.727304] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:05:41.728547] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-22T21:05:41.728674] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-22T21:05:41.729172] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-22T21:05:41.729281] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-22T21:05:41.921214] [DEBUG] [LOCAL ] SIG: Loaded 45374 existing records from primary storage. [2025-10-22T21:05:41.982093] [INFO ] [MAIN ] SIG: Loaded 45374 existing records. [2025-10-22T21:05:42.251612] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:05:42.315454] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:05:42.315682] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-22T21:05:42.315740] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-22T21:05:42.315945] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-10-22T21:05:42.316001] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-22T21:05:42.522847] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-22T21:05:42.677195] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:05:43.317707] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-22T21:05:43.624510] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T21:05:44.117754] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-22T21:05:44.239199] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-22T21:05:44.917672] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-22T21:05:45.158813] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-22T21:05:45.717742] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-22T21:05:45.852555] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T21:05:46.517675] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-22T21:05:46.727169] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T21:05:47.320812] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-22T21:05:47.349675] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T21:05:48.117701] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-22T21:05:48.392949] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T21:05:48.917696] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-22T21:05:49.077159] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T21:05:49.717634] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-22T21:05:49.905097] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T21:05:50.517678] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-22T21:05:50.805419] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T21:05:51.317696] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-22T21:05:51.427802] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T21:05:52.117690] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-22T21:05:52.196110] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T21:05:52.917624] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-22T21:05:53.000328] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T21:05:53.007829] [INFO ] [REMOTE ] SHO: Full fetch complete (70817 records). [2025-10-22T21:05:53.007956] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-22T21:05:53.390444] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-22T21:05:53.390550] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-22T21:05:53.391621] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-22T21:05:53.391711] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-22T21:05:53.393072] [DEBUG] [LOCAL ] SHO: Trimmed 70817 records to 49127 (keeping 200 days of data) [2025-10-22T21:05:53.680451] [DEBUG] [LOCAL ] SHO: Primary data saved (49127 records). [2025-10-22T21:05:53.680594] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-22T21:05:53.680711] [INFO ] [MAIN ] Update Progress: 1909/2367 symbols completed. SHO took 38.3s. Estimated remaining: 58m 59s. Rate: 7.8 symbols/min [2025-10-22T21:05:53.742420] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-22T21:05:53.858965] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:05:53.881150] [DEBUG] [LOCAL ] SII: Loaded 24218 existing records from primary storage. [2025-10-22T21:05:53.881397] [INFO ] [MAIN ] SII: Loaded 24218 existing records. [2025-10-22T21:05:54.058397] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:05:54.058591] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-22T21:05:54.058877] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-22T21:05:54.059163] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-22T21:05:54.059272] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-22T21:05:54.279669] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-22T21:05:54.454500] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:05:54.517612] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-22T21:05:54.698354] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T21:05:55.317745] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-22T21:05:55.513855] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T21:05:55.560165] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-22T21:05:56.117681] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-22T21:05:56.917750] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-22T21:05:57.063106] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T21:05:57.717629] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-22T21:05:57.760194] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T21:05:58.517807] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-22T21:05:58.792925] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T21:05:58.817144] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T21:05:59.317744] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-22T21:06:00.117707] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-22T21:06:00.231442] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T21:06:00.917716] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-22T21:06:01.401521] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-22T21:06:01.426318] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T21:06:01.717743] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-22T21:06:02.517783] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-22T21:06:02.713060] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T21:06:02.726437] [INFO ] [REMOTE ] SHW: Full fetch complete (73361 records). [2025-10-22T21:06:02.726778] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-22T21:06:03.174085] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-22T21:06:03.174230] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-22T21:06:03.176005] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-22T21:06:03.176077] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-22T21:06:03.178200] [DEBUG] [LOCAL ] SHW: Trimmed 73361 records to 50382 (keeping 200 days of data) [2025-10-22T21:06:03.311241] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-22T21:06:03.320157] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-22T21:06:03.527607] [DEBUG] [LOCAL ] SHW: Primary data saved (50382 records). [2025-10-22T21:06:03.530832] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-22T21:06:03.530946] [INFO ] [MAIN ] Update Progress: 1910/2367 symbols completed. SHW took 37.2s. Estimated remaining: 58m 51s. Rate: 7.8 symbols/min [2025-10-22T21:06:03.696668] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:06:03.724888] [DEBUG] [LOCAL ] SILA: Loaded 30099 existing records from primary storage. [2025-10-22T21:06:03.725142] [INFO ] [MAIN ] SILA: Loaded 30099 existing records. [2025-10-22T21:06:03.898885] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:06:03.899151] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-22T21:06:03.899288] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-22T21:06:03.899608] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-22T21:06:03.899698] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-22T21:06:04.121249] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-22T21:06:04.260037] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:06:04.286437] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T21:06:04.576408] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-22T21:06:04.917705] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-22T21:06:05.717716] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-22T21:06:05.868863] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T21:06:06.517725] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-22T21:06:06.556023] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T21:06:06.975794] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T21:06:07.317734] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-22T21:06:07.791084] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-22T21:06:08.117707] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-22T21:06:08.917701] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-22T21:06:08.994829] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T21:06:09.717633] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-22T21:06:09.749783] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-22T21:06:09.758027] [INFO ] [REMOTE ] SID: Full fetch complete (61153 records). [2025-10-22T21:06:09.758187] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-22T21:06:10.160456] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-22T21:06:10.160541] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-22T21:06:10.161662] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-22T21:06:10.161726] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-22T21:06:10.162948] [DEBUG] [LOCAL ] SID: Trimmed 61153 records to 42913 (keeping 200 days of data) [2025-10-22T21:06:10.402051] [DEBUG] [LOCAL ] SID: Primary data saved (42913 records). [2025-10-22T21:06:10.402167] [INFO ] [MAIN ] SID: Full history saved. [2025-10-22T21:06:10.402724] [INFO ] [MAIN ] Update Progress: 1911/2367 symbols completed. SID took 29.3s. Estimated remaining: 58m 43s. Rate: 7.8 symbols/min [2025-10-22T21:06:10.522822] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-22T21:06:10.582110] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:06:10.623672] [DEBUG] [LOCAL ] SITC: Loaded 41712 existing records from primary storage. [2025-10-22T21:06:10.624179] [INFO ] [MAIN ] SITC: Loaded 41712 existing records. [2025-10-22T21:06:10.816127] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:06:10.816923] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-22T21:06:10.817344] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-22T21:06:10.858426] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-10-22T21:06:10.858705] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-22T21:06:10.891737] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T21:06:10.905416] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T21:06:11.246005] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:06:11.317701] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-22T21:06:11.912209] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-22T21:06:12.117736] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-22T21:06:12.917801] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-22T21:06:13.047495] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T21:06:13.434703] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T21:06:13.717624] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-22T21:06:14.517701] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-22T21:06:14.578626] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T21:06:14.585837] [INFO ] [REMOTE ] SIG: Full fetch complete (67717 records). [2025-10-22T21:06:14.585954] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-22T21:06:14.991606] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-22T21:06:14.991738] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-22T21:06:14.993048] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-22T21:06:14.993127] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-22T21:06:14.994837] [DEBUG] [LOCAL ] SIG: Trimmed 67717 records to 45345 (keeping 200 days of data) [2025-10-22T21:06:15.111979] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-22T21:06:15.284866] [DEBUG] [LOCAL ] SIG: Primary data saved (45345 records). [2025-10-22T21:06:15.285036] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-22T21:06:15.285128] [INFO ] [MAIN ] Update Progress: 1912/2367 symbols completed. SIG took 34.0s. Estimated remaining: 58m 35s. Rate: 7.8 symbols/min [2025-10-22T21:06:15.327581] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-22T21:06:15.453177] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:06:15.485609] [DEBUG] [LOCAL ] SITE: Loaded 35562 existing records from primary storage. [2025-10-22T21:06:15.485899] [INFO ] [MAIN ] SITE: Loaded 35562 existing records. [2025-10-22T21:06:15.660936] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:06:15.661117] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-22T21:06:15.661164] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-22T21:06:15.661410] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-22T21:06:15.661465] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-22T21:06:16.016408] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:06:16.088548] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T21:06:16.117680] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-22T21:06:16.600270] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-22T21:06:16.917698] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-22T21:06:17.178264] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T21:06:17.717727] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-22T21:06:18.206955] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-22T21:06:18.213214] [INFO ] [REMOTE ] SII: Full fetch complete (31601 records). [2025-10-22T21:06:18.213426] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-22T21:06:18.522935] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-22T21:06:18.618119] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-22T21:06:18.618203] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-22T21:06:18.619085] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-22T21:06:18.619154] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-22T21:06:18.620137] [DEBUG] [LOCAL ] SII: Trimmed 31601 records to 24194 (keeping 200 days of data) [2025-10-22T21:06:18.784223] [DEBUG] [LOCAL ] SII: Primary data saved (24194 records). [2025-10-22T21:06:18.784403] [INFO ] [MAIN ] SII: Full history saved. [2025-10-22T21:06:18.784523] [INFO ] [MAIN ] Update Progress: 1913/2367 symbols completed. SII took 25.1s. Estimated remaining: 58m 26s. Rate: 7.8 symbols/min [2025-10-22T21:06:18.967386] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:06:19.015537] [DEBUG] [LOCAL ] SJM: Loaded 50110 existing records from primary storage. [2025-10-22T21:06:19.015893] [INFO ] [MAIN ] SJM: Loaded 50110 existing records. [2025-10-22T21:06:19.211948] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:06:19.212299] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-22T21:06:19.212402] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-22T21:06:19.218528] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-10-22T21:06:19.218620] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-22T21:06:19.235469] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T21:06:19.322872] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-22T21:06:19.596347] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:06:19.789820] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T21:06:20.117790] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-22T21:06:20.917627] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-22T21:06:21.167031] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T21:06:21.717728] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-22T21:06:21.996737] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T21:06:22.436726] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T21:06:22.517617] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-22T21:06:23.244847] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T21:06:23.317626] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-22T21:06:24.117724] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-22T21:06:24.170933] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T21:06:24.802397] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T21:06:24.917712] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-22T21:06:25.576252] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-22T21:06:25.717686] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-22T21:06:26.415837] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T21:06:26.517680] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-22T21:06:27.307169] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T21:06:27.317602] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-22T21:06:28.117688] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-22T21:06:28.189753] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-22T21:06:28.917725] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-22T21:06:29.070431] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T21:06:29.501452] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-22T21:06:29.717711] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-22T21:06:30.315689] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T21:06:30.517730] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-22T21:06:31.317729] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-22T21:06:31.405709] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T21:06:31.898889] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T21:06:32.117715] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-22T21:06:32.692373] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-22T21:06:32.917726] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-22T21:06:33.717711] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-22T21:06:34.064672] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-22T21:06:34.197341] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T21:06:34.202715] [INFO ] [REMOTE ] SILA: Full fetch complete (44370 records). [2025-10-22T21:06:34.202843] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-22T21:06:34.522866] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-22T21:06:34.682082] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-22T21:06:34.682170] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-22T21:06:34.683087] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-22T21:06:34.683172] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-22T21:06:34.684256] [DEBUG] [LOCAL ] SILA: Trimmed 44370 records to 29955 (keeping 200 days of data) [2025-10-22T21:06:34.879495] [DEBUG] [LOCAL ] SILA: Primary data saved (29955 records). [2025-10-22T21:06:34.879600] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-22T21:06:34.879693] [INFO ] [MAIN ] Update Progress: 1914/2367 symbols completed. SILA took 31.3s. Estimated remaining: 58m 21s. Rate: 7.8 symbols/min [2025-10-22T21:06:35.044531] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:06:35.064042] [DEBUG] [LOCAL ] SJT: Loaded 22756 existing records from primary storage. [2025-10-22T21:06:35.064290] [INFO ] [MAIN ] SJT: Loaded 22756 existing records. [2025-10-22T21:06:35.239698] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:06:35.239956] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-22T21:06:35.240030] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-22T21:06:35.240355] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-22T21:06:35.240440] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-22T21:06:35.335149] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-22T21:06:35.370948] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T21:06:35.627827] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:06:36.117692] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-22T21:06:36.141103] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T21:06:36.917720] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-22T21:06:37.242119] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-22T21:06:37.717772] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-22T21:06:37.881134] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T21:06:37.932760] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-22T21:06:38.517694] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-22T21:06:39.317728] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-22T21:06:39.631945] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T21:06:39.879436] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T21:06:40.117715] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-22T21:06:40.922200] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-22T21:06:40.924313] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T21:06:40.933624] [INFO ] [REMOTE ] SITC: Full fetch complete (60692 records). [2025-10-22T21:06:40.933797] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-22T21:06:41.319086] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-22T21:06:41.319170] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-22T21:06:41.320940] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-22T21:06:41.321005] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-22T21:06:41.322338] [DEBUG] [LOCAL ] SITC: Trimmed 60692 records to 41703 (keeping 200 days of data) [2025-10-22T21:06:41.461067] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T21:06:41.592735] [DEBUG] [LOCAL ] SITC: Primary data saved (41703 records). [2025-10-22T21:06:41.592935] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-22T21:06:41.593520] [INFO ] [MAIN ] Update Progress: 1915/2367 symbols completed. SITC took 31.2s. Estimated remaining: 58m 13s. Rate: 7.8 symbols/min [2025-10-22T21:06:41.722754] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-22T21:06:41.771716] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:06:41.815237] [DEBUG] [LOCAL ] SKE: Loaded 37343 existing records from primary storage. [2025-10-22T21:06:41.815635] [INFO ] [MAIN ] SKE: Loaded 37343 existing records. [2025-10-22T21:06:42.005090] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:06:42.005301] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-22T21:06:42.005371] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-22T21:06:42.005550] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-22T21:06:42.005588] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-22T21:06:42.357290] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:06:42.517621] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-22T21:06:42.857823] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-22T21:06:43.130908] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T21:06:43.317690] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-22T21:06:44.005293] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T21:06:44.117695] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-22T21:06:44.917744] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-22T21:06:45.393836] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-22T21:06:45.717757] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-22T21:06:45.873634] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T21:06:46.300985] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-22T21:06:46.517680] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-22T21:06:47.317770] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-22T21:06:47.747084] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-22T21:06:47.776277] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T21:06:48.117742] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-22T21:06:48.785735] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T21:06:48.917768] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-22T21:06:49.495966] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T21:06:49.503322] [INFO ] [REMOTE ] SITE: Full fetch complete (50806 records). [2025-10-22T21:06:49.503478] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-22T21:06:49.722957] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-22T21:06:49.908327] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-22T21:06:49.908455] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-22T21:06:49.909980] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-22T21:06:49.910047] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-22T21:06:49.911556] [DEBUG] [LOCAL ] SITE: Trimmed 50806 records to 35501 (keeping 200 days of data) [2025-10-22T21:06:50.128126] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-22T21:06:50.163951] [DEBUG] [LOCAL ] SITE: Primary data saved (35501 records). [2025-10-22T21:06:50.164159] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-22T21:06:50.164264] [INFO ] [MAIN ] Update Progress: 1916/2367 symbols completed. SITE took 34.9s. Estimated remaining: 58m 5s. Rate: 7.8 symbols/min [2025-10-22T21:06:50.337351] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:06:50.346262] [DEBUG] [LOCAL ] SKIL: Loaded 6877 existing records from primary storage. [2025-10-22T21:06:50.346509] [INFO ] [MAIN ] SKIL: Loaded 6877 existing records. [2025-10-22T21:06:50.519274] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-22T21:06:50.523174] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:06:50.525020] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-22T21:06:50.525087] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-22T21:06:50.525232] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-22T21:06:50.525270] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-22T21:06:50.894150] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:06:51.317690] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-22T21:06:51.751622] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-22T21:06:52.117673] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-22T21:06:52.206118] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T21:06:52.644676] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-22T21:06:52.917700] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-22T21:06:53.717743] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-22T21:06:53.830118] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-22T21:06:54.157240] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-22T21:06:54.517718] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-22T21:06:54.847020] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T21:06:55.317692] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-22T21:06:56.117703] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-22T21:06:56.159791] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T21:06:56.550562] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T21:06:56.554751] [INFO ] [REMOTE ] SJT: Full fetch complete (32004 records). [2025-10-22T21:06:56.554861] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-22T21:06:56.919767] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-22T21:06:56.922851] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-22T21:06:56.922909] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-22T21:06:56.923525] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-22T21:06:56.923666] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-22T21:06:56.924458] [DEBUG] [LOCAL ] SJT: Trimmed 32004 records to 22724 (keeping 200 days of data) [2025-10-22T21:06:57.047745] [DEBUG] [LOCAL ] SJT: Primary data saved (22724 records). [2025-10-22T21:06:57.047872] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-22T21:06:57.047946] [INFO ] [MAIN ] Update Progress: 1917/2367 symbols completed. SJT took 22.2s. Estimated remaining: 57m 57s. Rate: 7.8 symbols/min [2025-10-22T21:06:57.068310] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-22T21:06:57.717739] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-22T21:06:58.446359] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-22T21:06:58.517680] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-22T21:06:58.559556] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T21:06:59.307262] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T21:06:59.317602] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-22T21:06:59.890825] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-22T21:07:00.117694] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-22T21:07:00.917699] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-22T21:07:01.696899] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T21:07:01.717611] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-22T21:07:01.797141] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T21:07:02.517749] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-22T21:07:03.235628] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T21:07:03.317742] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-22T21:07:04.117766] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-22T21:07:04.231533] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T21:07:04.411288] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T21:07:04.419134] [INFO ] [REMOTE ] SJM: Full fetch complete (72332 records). [2025-10-22T21:07:04.419259] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-22T21:07:04.839930] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-22T21:07:04.840053] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-22T21:07:04.841721] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-22T21:07:04.841791] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-22T21:07:04.843748] [DEBUG] [LOCAL ] SJM: Trimmed 72332 records to 50093 (keeping 200 days of data) [2025-10-22T21:07:04.939159] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-22T21:07:05.186631] [DEBUG] [LOCAL ] SJM: Primary data saved (50093 records). [2025-10-22T21:07:05.186871] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-22T21:07:05.186976] [INFO ] [MAIN ] Update Progress: 1918/2367 symbols completed. SJM took 46.4s. Estimated remaining: 57m 49s. Rate: 7.8 symbols/min [2025-10-22T21:07:05.580796] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-22T21:07:05.601905] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T21:07:05.717723] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-22T21:07:06.517747] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-22T21:07:07.449597] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T21:07:07.454133] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-22T21:07:07.457508] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T21:07:08.117718] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-22T21:07:08.452437] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T21:07:08.455049] [INFO ] [REMOTE ] SKIL: Full fetch complete (10459 records). [2025-10-22T21:07:08.455138] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-22T21:07:08.812749] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-22T21:07:08.812828] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-22T21:07:08.813077] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-22T21:07:08.813117] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-22T21:07:08.813529] [DEBUG] [LOCAL ] SKIL: Trimmed 10459 records to 6902 (keeping 200 days of data) [2025-10-22T21:07:08.851698] [DEBUG] [LOCAL ] SKIL: Primary data saved (6902 records). [2025-10-22T21:07:08.851776] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-22T21:07:08.851844] [INFO ] [MAIN ] Update Progress: 1919/2367 symbols completed. SKIL took 18.7s. Estimated remaining: 57m 41s. Rate: 7.8 symbols/min [2025-10-22T21:07:09.935286] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T21:07:09.943261] [INFO ] [REMOTE ] SKE: Full fetch complete (52541 records). [2025-10-22T21:07:09.943362] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-22T21:07:10.341572] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-22T21:07:10.341693] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-22T21:07:10.342776] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-22T21:07:10.342840] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-22T21:07:10.344137] [DEBUG] [LOCAL ] SKE: Trimmed 52541 records to 37318 (keeping 200 days of data) [2025-10-22T21:07:10.564035] [DEBUG] [LOCAL ] SKE: Primary data saved (37318 records). [2025-10-22T21:07:10.564184] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-22T21:07:10.564737] [INFO ] [MAIN ] Update Progress: 1920/2367 symbols completed. SKE took 29.0s. Estimated remaining: 57m 32s. Rate: 7.8 symbols/min [2025-10-22T21:07:11.134150] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:07:11.176818] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:07:11.232340] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:07:11.263794] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:07:11.274421] [DEBUG] [LOCAL ] SKLZ: Loaded 11495 existing records from primary storage. [2025-10-22T21:07:11.274868] [INFO ] [MAIN ] SKLZ: Loaded 11495 existing records. [2025-10-22T21:07:11.433299] [DEBUG] [LOCAL ] SKM: Loaded 35237 existing records from primary storage. [2025-10-22T21:07:11.500363] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:07:11.495496] [INFO ] [MAIN ] SKM: Loaded 35237 existing records. [2025-10-22T21:07:11.501246] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-22T21:07:11.512344] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-22T21:07:11.546716] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-22T21:07:11.546848] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-22T21:07:11.638310] [DEBUG] [LOCAL ] SKT: Loaded 42370 existing records from primary storage. [2025-10-22T21:07:11.690392] [INFO ] [MAIN ] SKT: Loaded 42370 existing records. [2025-10-22T21:07:11.707449] [DEBUG] [LOCAL ] SKY: Loaded 38650 existing records from primary storage. [2025-10-22T21:07:11.732299] [INFO ] [MAIN ] SKY: Loaded 38650 existing records. [2025-10-22T21:07:11.946886] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:07:11.960227] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-22T21:07:12.087599] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-22T21:07:12.190698] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-10-22T21:07:12.207251] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-22T21:07:12.412477] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:07:12.526499] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:07:12.518242] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:07:12.526772] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-22T21:07:12.515174] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-22T21:07:12.537405] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-22T21:07:12.542610] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-22T21:07:12.527000] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-22T21:07:12.557745] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-10-22T21:07:12.557903] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-10-22T21:07:12.558052] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-22T21:07:12.563680] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-22T21:07:13.259378] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:07:13.302906] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-22T21:07:13.512836] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:07:13.520492] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-22T21:07:13.543108] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:07:13.543349] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-22T21:07:13.921318] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T21:07:13.925346] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-22T21:07:14.636305] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T21:07:14.642418] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-22T21:07:14.913886] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-22T21:07:14.917103] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-22T21:07:14.953716] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-22T21:07:14.964494] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-22T21:07:15.095111] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T21:07:15.317731] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-22T21:07:15.890344] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T21:07:16.023364] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T21:07:16.117662] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-22T21:07:16.413337] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T21:07:16.920527] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-22T21:07:16.938911] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T21:07:17.164614] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T21:07:17.717726] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-10-22T21:07:18.517688] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-22T21:07:18.564221] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T21:07:19.238792] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T21:07:19.317614] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-10-22T21:07:19.681486] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T21:07:20.117733] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-22T21:07:20.601452] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T21:07:20.917720] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-22T21:07:21.381689] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-22T21:07:21.717724] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-22T21:07:22.517716] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-22T21:07:22.829185] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T21:07:23.316518] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-22T21:07:23.324157] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-10-22T21:07:23.530975] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-22T21:07:24.117709] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-22T21:07:24.733824] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T21:07:24.917673] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-22T21:07:25.133987] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T21:07:25.717722] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-22T21:07:26.517681] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-10-22T21:07:26.732115] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T21:07:26.800968] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-22T21:07:27.317750] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-22T21:07:28.019382] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T21:07:28.117607] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-10-22T21:07:28.268764] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-22T21:07:28.917705] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-22T21:07:29.543796] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T21:07:29.717720] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-10-22T21:07:29.847168] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T21:07:30.517743] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-10-22T21:07:31.191582] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-22T21:07:31.317672] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-10-22T21:07:31.831673] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-22T21:07:32.117696] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-22T21:07:32.792743] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T21:07:32.917714] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-10-22T21:07:33.543969] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T21:07:33.717755] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-22T21:07:34.481797] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T21:07:34.517617] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-10-22T21:07:35.317676] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-22T21:07:35.384896] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T21:07:35.982424] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-22T21:07:35.984687] [INFO ] [REMOTE ] SKLZ: Full fetch complete (17748 records). [2025-10-22T21:07:35.984759] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-22T21:07:36.118297] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-22T21:07:36.428463] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-22T21:07:36.429050] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-22T21:07:36.429910] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T21:07:36.430405] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-22T21:07:36.438612] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-22T21:07:36.439983] [DEBUG] [LOCAL ] SKLZ: Trimmed 17748 records to 11463 (keeping 200 days of data) [2025-10-22T21:07:36.506421] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11463 records). [2025-10-22T21:07:36.506546] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-22T21:07:36.506623] [INFO ] [MAIN ] Update Progress: 1921/2367 symbols completed. SKLZ took 25.9s. Estimated remaining: 57m 28s. Rate: 7.8 symbols/min [2025-10-22T21:07:36.678676] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:07:36.693660] [DEBUG] [LOCAL ] SKYH: Loaded 15910 existing records from primary storage. [2025-10-22T21:07:36.693884] [INFO ] [MAIN ] SKYH: Loaded 15910 existing records. [2025-10-22T21:07:36.867153] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:07:36.867328] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-22T21:07:36.867376] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-22T21:07:36.867750] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-22T21:07:36.867807] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-22T21:07:36.924459] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-10. [2025-10-22T21:07:37.230598] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:07:37.717723] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-22T21:07:37.941728] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T21:07:38.403443] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-22T21:07:38.409676] [INFO ] [REMOTE ] SKM: Full fetch complete (49280 records). [2025-10-22T21:07:38.409791] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-10-22T21:07:38.518454] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-22T21:07:38.559108] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-22T21:07:38.797031] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-10-22T21:07:38.797108] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-10-22T21:07:38.798098] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-10-22T21:07:38.798164] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-10-22T21:07:38.799212] [DEBUG] [LOCAL ] SKM: Trimmed 49280 records to 35160 (keeping 200 days of data) [2025-10-22T21:07:39.013135] [DEBUG] [LOCAL ] SKM: Primary data saved (35160 records). [2025-10-22T21:07:39.013268] [INFO ] [MAIN ] SKM: Full history saved. [2025-10-22T21:07:39.013346] [INFO ] [MAIN ] Update Progress: 1922/2367 symbols completed. SKM took 28.4s. Estimated remaining: 57m 19s. Rate: 7.8 symbols/min [2025-10-22T21:07:39.193136] [INFO ] [MAIN ] SLAI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:07:39.193354] [DEBUG] [LOCAL ] SLAI: No existing data file found in primary storage. [2025-10-22T21:07:39.193422] [WARN ] [MAIN ] SLAI: No existing data found, performing full refresh instead. [2025-10-22T21:07:39.193560] [INFO ] [MAIN ] SLAI: Wiping existing primary data before full refresh. [2025-10-22T21:07:39.193603] [INFO ] [LOCAL ] SLAI: Starting deletion of primary data. [2025-10-22T21:07:39.193676] [DEBUG] [LOCAL ] SLAI: No primary data file found to delete. [2025-10-22T21:07:39.193732] [INFO ] [MAIN ] SLAI: Starting full primary refresh. [2025-10-22T21:07:39.322781] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-10-22T21:07:39.559841] [INFO ] [REMOTE ] SLAI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:07:40.117687] [INFO ] [REMOTE ] SLAI: Fetching primary data for 2025-01. [2025-10-22T21:07:40.246890] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T21:07:40.415363] [DEBUG] [REMOTE ] SLAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:07:40.415636] [WARN ] [REMOTE ] SLAI: No data returned for month 2025-01 [2025-10-22T21:07:40.415794] [FATAL] [REMOTE ] SLAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:07:40.415890] [FATAL] [MAIN ] SLAI: Failed to fetch primary data. [2025-10-22T21:07:40.415975] [WARN ] [MAIN ] SLAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:07:40.416068] [INFO ] [LOCAL ] SLAI: Starting deletion of primary data. [2025-10-22T21:07:40.416151] [DEBUG] [LOCAL ] SLAI: No primary data file found to delete. [2025-10-22T21:07:40.416188] [INFO ] [LOCAL ] SLAI: Starting deletion of derivative data. [2025-10-22T21:07:40.416228] [DEBUG] [LOCAL ] SLAI: No derivative data file found to delete. [2025-10-22T21:07:40.416274] [INFO ] [MAIN ] Update Progress: 1923/2367 symbols completed. SLAI took 1.4s. Estimated remaining: 57m 10s. Rate: 7.8 symbols/min [2025-10-22T21:07:40.580773] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:07:40.580918] [DEBUG] [LOCAL ] SLB: No existing data file found in primary storage. [2025-10-22T21:07:40.580956] [WARN ] [MAIN ] SLB: No existing data found, performing full refresh instead. [2025-10-22T21:07:40.581086] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-22T21:07:40.581179] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-22T21:07:40.581261] [DEBUG] [LOCAL ] SLB: No primary data file found to delete. [2025-10-22T21:07:40.581314] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-22T21:07:40.926988] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-22T21:07:40.932434] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:07:41.157698] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T21:07:41.717735] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-22T21:07:42.483354] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T21:07:42.490283] [INFO ] [REMOTE ] SKT: Full fetch complete (60746 records). [2025-10-22T21:07:42.490395] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-22T21:07:42.522631] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-22T21:07:42.691438] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T21:07:42.885358] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-22T21:07:42.885439] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-22T21:07:42.886496] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-22T21:07:42.886561] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-22T21:07:42.891032] [DEBUG] [LOCAL ] SKT: Trimmed 60746 records to 42303 (keeping 200 days of data) [2025-10-22T21:07:43.141951] [DEBUG] [LOCAL ] SKT: Primary data saved (42303 records). [2025-10-22T21:07:43.142082] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-22T21:07:43.142186] [INFO ] [MAIN ] Update Progress: 1924/2367 symbols completed. SKT took 32.6s. Estimated remaining: 57m 1s. Rate: 7.8 symbols/min [2025-10-22T21:07:43.307552] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:07:43.325559] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-22T21:07:43.342056] [DEBUG] [LOCAL ] SLF: Loaded 38518 existing records from primary storage. [2025-10-22T21:07:43.342348] [INFO ] [MAIN ] SLF: Loaded 38518 existing records. [2025-10-22T21:07:43.517898] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:07:43.518108] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-22T21:07:43.518154] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-22T21:07:43.518396] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-22T21:07:43.518451] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-22T21:07:43.865271] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:07:44.117737] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-22T21:07:44.512846] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-22T21:07:44.918358] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-10. [2025-10-22T21:07:44.924696] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-22T21:07:45.717717] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-22T21:07:45.887197] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T21:07:46.150403] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T21:07:46.157238] [INFO ] [REMOTE ] SKY: Full fetch complete (54364 records). [2025-10-22T21:07:46.157346] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-22T21:07:46.523282] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-10-22T21:07:46.523401] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-10-22T21:07:46.522870] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-22T21:07:46.525488] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-10-22T21:07:46.525723] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-10-22T21:07:46.526944] [DEBUG] [LOCAL ] SKY: Trimmed 54364 records to 38578 (keeping 200 days of data) [2025-10-22T21:07:46.751297] [DEBUG] [LOCAL ] SKY: Primary data saved (38578 records). [2025-10-22T21:07:46.751448] [INFO ] [MAIN ] SKY: Full history saved. [2025-10-22T21:07:46.751530] [INFO ] [MAIN ] Update Progress: 1925/2367 symbols completed. SKY took 36.2s. Estimated remaining: 56m 52s. Rate: 7.8 symbols/min [2025-10-22T21:07:46.918294] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:07:46.959178] [DEBUG] [LOCAL ] SLG: Loaded 45820 existing records from primary storage. [2025-10-22T21:07:46.959481] [INFO ] [MAIN ] SLG: Loaded 45820 existing records. [2025-10-22T21:07:47.129968] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:07:47.130199] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-22T21:07:47.130245] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-22T21:07:47.130467] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-10-22T21:07:47.130522] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-22T21:07:47.330951] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-22T21:07:47.483718] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:07:47.711688] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-22T21:07:47.841203] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T21:07:48.117696] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-22T21:07:48.917727] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-10-22T21:07:49.103839] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-22T21:07:49.400442] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T21:07:49.717737] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-22T21:07:50.517707] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-22T21:07:51.097682] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-22T21:07:51.159901] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T21:07:51.317692] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-22T21:07:51.745974] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T21:07:52.117738] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-22T21:07:52.917690] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-10-22T21:07:53.061140] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T21:07:53.290512] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-22T21:07:53.717729] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-22T21:07:54.517721] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-22T21:07:55.317703] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-22T21:07:55.412880] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T21:07:55.570724] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-22T21:07:56.117696] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-10-22T21:07:56.303239] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T21:07:56.449006] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T21:07:56.917752] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-22T21:07:57.717711] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-22T21:07:58.095610] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T21:07:58.316418] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-22T21:07:58.517733] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-22T21:07:59.324158] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-10-22T21:07:59.339636] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T21:07:59.533620] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T21:08:00.117697] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-22T21:08:00.917702] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-22T21:08:01.552435] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-22T21:08:01.717745] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-10-22T21:08:01.863081] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T21:08:02.517685] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-22T21:08:02.680924] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-22T21:08:03.245265] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-22T21:08:03.248432] [INFO ] [REMOTE ] SKYH: Full fetch complete (22504 records). [2025-10-22T21:08:03.248503] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-22T21:08:03.322862] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-22T21:08:03.611202] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-22T21:08:03.611281] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-22T21:08:03.611791] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-22T21:08:03.611853] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-22T21:08:03.612415] [DEBUG] [LOCAL ] SKYH: Trimmed 22504 records to 15813 (keeping 200 days of data) [2025-10-22T21:08:03.701340] [DEBUG] [LOCAL ] SKYH: Primary data saved (15813 records). [2025-10-22T21:08:03.701465] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-22T21:08:03.701539] [INFO ] [MAIN ] Update Progress: 1926/2367 symbols completed. SKYH took 27.2s. Estimated remaining: 56m 47s. Rate: 7.8 symbols/min [2025-10-22T21:08:03.872894] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:08:03.908218] [DEBUG] [LOCAL ] SLGN: Loaded 41036 existing records from primary storage. [2025-10-22T21:08:03.908495] [INFO ] [MAIN ] SLGN: Loaded 41036 existing records. [2025-10-22T21:08:04.107615] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:08:04.108013] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-22T21:08:04.108143] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-22T21:08:04.108549] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-10-22T21:08:04.108606] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-22T21:08:04.129072] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-22T21:08:04.300335] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-22T21:08:04.513961] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:08:04.917664] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-22T21:08:05.001957] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T21:08:05.717640] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-22T21:08:05.865535] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T21:08:06.517758] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-10-22T21:08:06.627220] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T21:08:07.317692] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-22T21:08:07.753908] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-22T21:08:08.117675] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-22T21:08:08.665700] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-22T21:08:08.927172] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-22T21:08:08.931578] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T21:08:09.717726] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-10-22T21:08:10.043598] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-22T21:08:10.517680] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-22T21:08:10.629493] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T21:08:11.317733] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-22T21:08:11.938456] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-22T21:08:12.117728] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-10. [2025-10-22T21:08:12.306633] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T21:08:12.914429] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T21:08:12.922723] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-22T21:08:13.717727] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-22T21:08:14.367061] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-22T21:08:14.376057] [INFO ] [REMOTE ] SLB: Full fetch complete (77877 records). [2025-10-22T21:08:14.376194] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-22T21:08:14.522790] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-22T21:08:14.776132] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-10-22T21:08:14.776316] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-10-22T21:08:14.777494] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-10-22T21:08:14.777593] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-10-22T21:08:14.787595] [DEBUG] [LOCAL ] SLB: Trimmed 77877 records to 53697 (keeping 200 days of data) [2025-10-22T21:08:14.804411] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T21:08:15.146334] [DEBUG] [LOCAL ] SLB: Primary data saved (53697 records). [2025-10-22T21:08:15.146541] [INFO ] [MAIN ] SLB: Full history saved. [2025-10-22T21:08:15.146630] [INFO ] [MAIN ] Update Progress: 1927/2367 symbols completed. SLB took 34.7s. Estimated remaining: 56m 40s. Rate: 7.8 symbols/min [2025-10-22T21:08:15.313242] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:08:15.313531] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-22T21:08:15.313576] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-22T21:08:15.313713] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-22T21:08:15.313763] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-22T21:08:15.313806] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-22T21:08:15.313838] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-22T21:08:15.344429] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-22T21:08:15.608084] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T21:08:15.670401] [INFO ] [REMOTE ] SLG: Full fetch complete (65198 records). [2025-10-22T21:08:15.682066] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-22T21:08:15.766789] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:08:16.114036] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-22T21:08:16.114670] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-22T21:08:16.116231] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T21:08:16.118590] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-22T21:08:16.118837] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-22T21:08:16.118735] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-22T21:08:16.129610] [DEBUG] [LOCAL ] SLG: Trimmed 65198 records to 45790 (keeping 200 days of data) [2025-10-22T21:08:16.404092] [DEBUG] [LOCAL ] SLG: Primary data saved (45790 records). [2025-10-22T21:08:16.404243] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-22T21:08:16.405137] [INFO ] [MAIN ] Update Progress: 1928/2367 symbols completed. SLG took 29.7s. Estimated remaining: 56m 31s. Rate: 7.8 symbols/min [2025-10-22T21:08:16.571250] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:08:16.611577] [DEBUG] [LOCAL ] SLQT: Loaded 43445 existing records from primary storage. [2025-10-22T21:08:16.611924] [INFO ] [MAIN ] SLQT: Loaded 43445 existing records. [2025-10-22T21:08:16.785342] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:08:16.785598] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-22T21:08:16.785667] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-22T21:08:16.786008] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-22T21:08:16.786048] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-22T21:08:16.927575] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-22T21:08:17.076192] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-22T21:08:17.158977] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:08:17.182244] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T21:08:17.717721] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-22T21:08:18.517731] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-22T21:08:18.593256] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T21:08:18.599249] [INFO ] [REMOTE ] SLF: Full fetch complete (56389 records). [2025-10-22T21:08:18.599359] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-22T21:08:18.986312] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-22T21:08:18.986431] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-22T21:08:18.987550] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-22T21:08:18.987637] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-22T21:08:18.988810] [DEBUG] [LOCAL ] SLF: Trimmed 56389 records to 38364 (keeping 200 days of data) [2025-10-22T21:08:19.088823] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-22T21:08:19.226714] [DEBUG] [LOCAL ] SLF: Primary data saved (38364 records). [2025-10-22T21:08:19.226930] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-22T21:08:19.227153] [INFO ] [MAIN ] Update Progress: 1929/2367 symbols completed. SLF took 36.1s. Estimated remaining: 56m 22s. Rate: 7.8 symbols/min [2025-10-22T21:08:19.326547] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-22T21:08:19.426095] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T21:08:19.436093] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:08:19.465975] [DEBUG] [LOCAL ] SLVM: Loaded 27696 existing records from primary storage. [2025-10-22T21:08:19.466269] [INFO ] [MAIN ] SLVM: Loaded 27696 existing records. [2025-10-22T21:08:19.639146] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:08:19.639378] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-22T21:08:19.639435] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-22T21:08:19.639677] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-10-22T21:08:19.639733] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-22T21:08:19.982890] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:08:20.117693] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-22T21:08:20.917709] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-22T21:08:21.036691] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T21:08:21.104852] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-22T21:08:21.432539] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-22T21:08:21.717711] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-22T21:08:22.240268] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-22T21:08:22.517708] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-22T21:08:23.317739] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-22T21:08:23.859857] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T21:08:24.117748] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-22T21:08:24.917715] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-22T21:08:25.247568] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-22T21:08:25.325471] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-22T21:08:25.477661] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-22T21:08:25.717694] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-22T21:08:26.517737] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-22T21:08:27.053572] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-22T21:08:27.317724] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-22T21:08:27.687695] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T21:08:28.117748] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-22T21:08:28.369361] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T21:08:28.917698] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-22T21:08:29.676883] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T21:08:29.717882] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-22T21:08:30.517744] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-22T21:08:30.752134] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T21:08:31.033288] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-22T21:08:31.203468] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T21:08:31.317696] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-22T21:08:31.802609] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-22T21:08:32.117691] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-22T21:08:32.917737] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-22T21:08:33.717692] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-22T21:08:33.835982] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T21:08:34.146229] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-22T21:08:34.164962] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T21:08:34.517721] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-22T21:08:35.317721] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-22T21:08:36.117720] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-22T21:08:36.220290] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T21:08:36.612108] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-22T21:08:36.613798] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1051 records). [2025-10-22T21:08:36.616518] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-22T21:08:36.616408] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-22T21:08:36.802444] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-22T21:08:36.802678] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:08:36.802766] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:08:36.802832] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-22T21:08:36.802895] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-22T21:08:36.802931] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-22T21:08:36.802983] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-22T21:08:36.803064] [INFO ] [MAIN ] Update Progress: 1930/2367 symbols completed. SLNZ took 21.7s. Estimated remaining: 56m 16s. Rate: 7.8 symbols/min [2025-10-22T21:08:36.922804] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-22T21:08:36.971854] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:08:37.025510] [DEBUG] [LOCAL ] SM: Loaded 52354 existing records from primary storage. [2025-10-22T21:08:37.025994] [INFO ] [MAIN ] SM: Loaded 52354 existing records. [2025-10-22T21:08:37.228936] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:08:37.229248] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-22T21:08:37.229305] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-22T21:08:37.229532] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-10-22T21:08:37.229587] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-22T21:08:37.581993] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:08:37.717705] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-22T21:08:38.286374] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T21:08:38.517692] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-22T21:08:39.317719] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-22T21:08:39.452300] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T21:08:40.052802] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T21:08:40.117706] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-22T21:08:40.917737] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-22T21:08:41.343575] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-22T21:08:41.717701] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-22T21:08:41.888947] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T21:08:42.517719] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-22T21:08:42.598189] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T21:08:43.317694] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-22T21:08:43.610818] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T21:08:43.663082] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-22T21:08:44.117706] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-22T21:08:44.855302] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-22T21:08:44.863167] [INFO ] [REMOTE ] SLGN: Full fetch complete (59364 records). [2025-10-22T21:08:44.863288] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-22T21:08:44.928972] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-22T21:08:45.250747] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-22T21:08:45.250831] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-22T21:08:45.251951] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-22T21:08:45.252017] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-22T21:08:45.253213] [DEBUG] [LOCAL ] SLGN: Trimmed 59364 records to 41015 (keeping 200 days of data) [2025-10-22T21:08:45.495207] [DEBUG] [LOCAL ] SLGN: Primary data saved (41015 records). [2025-10-22T21:08:45.495332] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-22T21:08:45.495406] [INFO ] [MAIN ] Update Progress: 1931/2367 symbols completed. SLGN took 41.8s. Estimated remaining: 56m 9s. Rate: 7.8 symbols/min [2025-10-22T21:08:45.670102] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:08:45.670336] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-22T21:08:45.670407] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-22T21:08:45.670583] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-22T21:08:45.670708] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-22T21:08:45.670780] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-22T21:08:45.670826] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-22T21:08:45.733284] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-22T21:08:46.038921] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:08:46.069545] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-22T21:08:46.315391] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T21:08:46.320433] [INFO ] [REMOTE ] SLVM: Full fetch complete (40169 records). [2025-10-22T21:08:46.320528] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-22T21:08:46.524526] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-22T21:08:46.693317] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-22T21:08:46.693395] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-22T21:08:46.694177] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-22T21:08:46.694237] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-22T21:08:46.695135] [DEBUG] [LOCAL ] SLVM: Trimmed 40169 records to 27737 (keeping 200 days of data) [2025-10-22T21:08:46.862011] [DEBUG] [LOCAL ] SLVM: Primary data saved (27737 records). [2025-10-22T21:08:46.862141] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-22T21:08:46.862218] [INFO ] [MAIN ] Update Progress: 1932/2367 symbols completed. SLVM took 27.6s. Estimated remaining: 55m 60s. Rate: 7.8 symbols/min [2025-10-22T21:08:47.033808] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:08:47.042939] [DEBUG] [LOCAL ] SMBK: Loaded 8280 existing records from primary storage. [2025-10-22T21:08:47.043139] [INFO ] [MAIN ] SMBK: Loaded 8280 existing records. [2025-10-22T21:08:47.219189] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:08:47.219395] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-22T21:08:47.219441] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-22T21:08:47.219614] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-10-22T21:08:47.219717] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-22T21:08:47.322829] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-01. [2025-10-22T21:08:47.603533] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:08:47.684059] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:08:47.684426] [WARN ] [REMOTE ] SMA: No data returned for month 2025-01 [2025-10-22T21:08:47.684517] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:08:47.684569] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-22T21:08:47.684631] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:08:47.684727] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-22T21:08:47.684790] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-22T21:08:47.684825] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-22T21:08:47.684864] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-22T21:08:47.684910] [INFO ] [MAIN ] Update Progress: 1933/2367 symbols completed. SMA took 2.2s. Estimated remaining: 55m 51s. Rate: 7.8 symbols/min [2025-10-22T21:08:47.868736] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:08:47.905798] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-22T21:08:47.922579] [DEBUG] [LOCAL ] SMC: Loaded 11048 existing records from primary storage. [2025-10-22T21:08:47.922877] [INFO ] [MAIN ] SMC: Loaded 11048 existing records. [2025-10-22T21:08:48.103676] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:08:48.103972] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-22T21:08:48.104028] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-22T21:08:48.104174] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-22T21:08:48.104211] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-22T21:08:48.124113] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-22T21:08:48.422868] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-22T21:08:48.492858] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:08:48.917743] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-22T21:08:49.717735] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-10-22T21:08:49.942381] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-22T21:08:50.196732] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-22T21:08:50.517865] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-22T21:08:50.760516] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-22T21:08:51.317798] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-22T21:08:52.117715] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-10-22T21:08:52.422607] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T21:08:52.557218] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T21:08:52.564380] [INFO ] [REMOTE ] SLQT: Full fetch complete (63803 records). [2025-10-22T21:08:52.564502] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-22T21:08:52.918001] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-22T21:08:52.943906] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-22T21:08:52.965566] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-22T21:08:52.965696] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-22T21:08:52.966917] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-22T21:08:52.967007] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-22T21:08:52.968434] [DEBUG] [LOCAL ] SLQT: Trimmed 63803 records to 43361 (keeping 200 days of data) [2025-10-22T21:08:53.205475] [DEBUG] [LOCAL ] SLQT: Primary data saved (43361 records). [2025-10-22T21:08:53.205614] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-22T21:08:53.206059] [INFO ] [MAIN ] Update Progress: 1934/2367 symbols completed. SLQT took 36.8s. Estimated remaining: 55m 42s. Rate: 7.8 symbols/min [2025-10-22T21:08:53.393078] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:08:53.441272] [DEBUG] [LOCAL ] SMFG: Loaded 48330 existing records from primary storage. [2025-10-22T21:08:53.441591] [INFO ] [MAIN ] SMFG: Loaded 48330 existing records. [2025-10-22T21:08:53.614775] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:08:53.615017] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-22T21:08:53.615065] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-22T21:08:53.615463] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-22T21:08:53.615519] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-22T21:08:53.739305] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-10-22T21:08:54.021920] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:08:54.517711] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-22T21:08:54.786745] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T21:08:54.909148] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-22T21:08:55.317729] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-22T21:08:56.117717] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-10-22T21:08:56.307437] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T21:08:56.917672] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-22T21:08:57.141701] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-22T21:08:57.291251] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-22T21:08:57.717751] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-22T21:08:58.517693] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-10-22T21:08:58.728911] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T21:08:58.738823] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-22T21:08:59.114374] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T21:08:59.317697] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-22T21:09:00.117671] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-10-22T21:09:00.299595] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-22T21:09:00.917683] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-22T21:09:01.127375] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-22T21:09:01.717695] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-10-22T21:09:01.965014] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T21:09:02.517714] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-22T21:09:02.667826] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T21:09:03.174164] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-22T21:09:03.317739] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-22T21:09:04.117720] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-10-22T21:09:04.344013] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T21:09:04.917746] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-22T21:09:05.011928] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T21:09:05.723353] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-22T21:09:05.728411] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T21:09:06.517735] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-22T21:09:07.317684] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-10-22T21:09:07.701680] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T21:09:08.117723] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-22T21:09:08.181681] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T21:09:08.363858] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T21:09:08.917732] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-10. [2025-10-22T21:09:09.717694] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-22T21:09:09.785406] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T21:09:09.787402] [INFO ] [REMOTE ] SMBK: Full fetch complete (11862 records). [2025-10-22T21:09:09.787469] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-22T21:09:10.149585] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-22T21:09:10.149840] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-22T21:09:10.150217] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-22T21:09:10.150298] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-22T21:09:10.151075] [DEBUG] [LOCAL ] SMBK: Trimmed 11862 records to 8269 (keeping 200 days of data) [2025-10-22T21:09:10.234194] [DEBUG] [LOCAL ] SMBK: Primary data saved (8269 records). [2025-10-22T21:09:10.234907] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-22T21:09:10.241520] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-22T21:09:10.252357] [INFO ] [MAIN ] Update Progress: 1935/2367 symbols completed. SMBK took 23.4s. Estimated remaining: 55m 37s. Rate: 7.8 symbols/min [2025-10-22T21:09:10.416161] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:09:10.453687] [DEBUG] [LOCAL ] SMG: Loaded 42875 existing records from primary storage. [2025-10-22T21:09:10.453968] [INFO ] [MAIN ] SMG: Loaded 42875 existing records. [2025-10-22T21:09:10.522118] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-22T21:09:10.632164] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:09:10.632382] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-22T21:09:10.632430] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-22T21:09:10.632609] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-10-22T21:09:10.632678] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-22T21:09:10.801026] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-22T21:09:10.999472] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:09:11.317694] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-22T21:09:12.117676] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-22T21:09:12.581954] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-22T21:09:12.590733] [INFO ] [REMOTE ] SM: Full fetch complete (75942 records). [2025-10-22T21:09:12.590852] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-22T21:09:12.925576] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-22T21:09:12.998064] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-22T21:09:12.998384] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-22T21:09:12.999623] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-22T21:09:12.999719] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-22T21:09:13.008787] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-22T21:09:13.013097] [DEBUG] [LOCAL ] SM: Trimmed 75942 records to 52354 (keeping 200 days of data) [2025-10-22T21:09:13.097236] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T21:09:13.373393] [DEBUG] [LOCAL ] SM: Primary data saved (52354 records). [2025-10-22T21:09:13.373539] [INFO ] [MAIN ] SM: Full history saved. [2025-10-22T21:09:13.373619] [INFO ] [MAIN ] Update Progress: 1936/2367 symbols completed. SM took 36.6s. Estimated remaining: 55m 28s. Rate: 7.8 symbols/min [2025-10-22T21:09:13.554996] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:09:13.568177] [DEBUG] [LOCAL ] SMHI: Loaded 12854 existing records from primary storage. [2025-10-22T21:09:13.568381] [INFO ] [MAIN ] SMHI: Loaded 12854 existing records. [2025-10-22T21:09:13.722891] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-22T21:09:13.761441] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:09:13.761775] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-22T21:09:13.761831] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-22T21:09:13.761983] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-10-22T21:09:13.762021] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-22T21:09:14.108802] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:09:14.517725] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-22T21:09:14.716313] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T21:09:14.718445] [INFO ] [REMOTE ] SMC: Full fetch complete (16517 records). [2025-10-22T21:09:14.718514] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-22T21:09:15.111475] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-22T21:09:15.120463] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-22T21:09:15.130304] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-22T21:09:15.130912] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-22T21:09:15.131075] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-22T21:09:15.131879] [DEBUG] [LOCAL ] SMC: Trimmed 16517 records to 10904 (keeping 200 days of data) [2025-10-22T21:09:15.193472] [DEBUG] [LOCAL ] SMC: Primary data saved (10904 records). [2025-10-22T21:09:15.193599] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-22T21:09:15.193697] [INFO ] [MAIN ] Update Progress: 1937/2367 symbols completed. SMC took 27.5s. Estimated remaining: 55m 19s. Rate: 7.8 symbols/min [2025-10-22T21:09:15.332090] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-22T21:09:15.368436] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:09:15.385807] [DEBUG] [LOCAL ] SMP: Loaded 18732 existing records from primary storage. [2025-10-22T21:09:15.386033] [INFO ] [MAIN ] SMP: Loaded 18732 existing records. [2025-10-22T21:09:15.563914] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:09:15.564093] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-22T21:09:15.564139] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-22T21:09:15.564422] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-10-22T21:09:15.564477] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-22T21:09:15.865475] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T21:09:15.946306] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:09:16.117697] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-10-22T21:09:16.917748] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-22T21:09:17.167164] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T21:09:17.367529] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-22T21:09:17.717722] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-10-22T21:09:18.092921] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T21:09:18.517724] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-22T21:09:18.895376] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T21:09:19.317732] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-22T21:09:20.117700] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-10-22T21:09:20.358716] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T21:09:20.917734] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-22T21:09:21.142922] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-22T21:09:21.244336] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T21:09:21.717716] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-10-22T21:09:22.517671] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-22T21:09:22.601894] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T21:09:23.081821] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T21:09:23.317685] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-22T21:09:24.117672] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-10-22T21:09:24.435769] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-22T21:09:24.917824] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-10-22T21:09:25.245686] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-22T21:09:25.313382] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T21:09:25.717735] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-10-22T21:09:26.212911] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-22T21:09:26.517784] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-10-22T21:09:26.908903] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T21:09:27.317730] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-22T21:09:27.833673] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T21:09:28.117713] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-10-22T21:09:28.917705] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-22T21:09:29.114313] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-22T21:09:29.155616] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T21:09:29.717715] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-10-22T21:09:30.352197] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T21:09:30.517722] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-22T21:09:30.845257] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-22T21:09:31.317774] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-10-22T21:09:32.117705] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-22T21:09:32.284286] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T21:09:32.502584] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T21:09:32.917753] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-10-22T21:09:33.717738] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-22T21:09:33.838930] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-22T21:09:33.987464] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-22T21:09:34.517724] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-10-22T21:09:35.317775] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-22T21:09:35.529877] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-22T21:09:35.529488] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T21:09:36.117724] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-10-22T21:09:36.917709] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-10-22T21:09:37.115111] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T21:09:37.123801] [INFO ] [REMOTE ] SMFG: Full fetch complete (69364 records). [2025-10-22T21:09:37.123921] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-22T21:09:37.523222] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-22T21:09:37.519732] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-22T21:09:37.527908] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-22T21:09:37.529022] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-22T21:09:37.529112] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-22T21:09:37.530423] [DEBUG] [LOCAL ] SMFG: Trimmed 69364 records to 48307 (keeping 200 days of data) [2025-10-22T21:09:37.727373] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-22T21:09:37.815467] [DEBUG] [LOCAL ] SMFG: Primary data saved (48307 records). [2025-10-22T21:09:37.815729] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-22T21:09:37.816467] [INFO ] [MAIN ] Update Progress: 1938/2367 symbols completed. SMFG took 44.6s. Estimated remaining: 55m 14s. Rate: 7.8 symbols/min [2025-10-22T21:09:37.924571] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T21:09:37.994832] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:09:37.994967] [DEBUG] [LOCAL ] SMR: No existing data file found in primary storage. [2025-10-22T21:09:37.995004] [WARN ] [MAIN ] SMR: No existing data found, performing full refresh instead. [2025-10-22T21:09:37.995128] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-22T21:09:37.995169] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-22T21:09:37.995210] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-10-22T21:09:37.995243] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-22T21:09:38.342429] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:09:38.517631] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-22T21:09:39.317701] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-10. [2025-10-22T21:09:39.459744] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T21:09:40.117724] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-22T21:09:40.141824] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-22T21:09:40.143699] [INFO ] [REMOTE ] SMHI: Full fetch complete (21249 records). [2025-10-22T21:09:40.143771] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-22T21:09:40.532532] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-22T21:09:40.532614] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-22T21:09:40.533057] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-22T21:09:40.533112] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-22T21:09:40.533624] [DEBUG] [LOCAL ] SMHI: Trimmed 21249 records to 12664 (keeping 200 days of data) [2025-10-22T21:09:40.600630] [DEBUG] [LOCAL ] SMHI: Primary data saved (12664 records). [2025-10-22T21:09:40.600785] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-22T21:09:40.600862] [INFO ] [MAIN ] Update Progress: 1939/2367 symbols completed. SMHI took 27.2s. Estimated remaining: 55m 6s. Rate: 7.8 symbols/min [2025-10-22T21:09:40.769232] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:09:40.806846] [DEBUG] [LOCAL ] SMRT: Loaded 43792 existing records from primary storage. [2025-10-22T21:09:40.807146] [INFO ] [MAIN ] SMRT: Loaded 43792 existing records. [2025-10-22T21:09:40.922779] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-10-22T21:09:40.991297] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:09:40.992064] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-22T21:09:40.992235] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-22T21:09:40.992508] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-22T21:09:40.992639] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-22T21:09:41.371688] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.85 seconds). [2025-10-22T21:09:41.405160] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:09:41.490544] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T21:09:41.717634] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-22T21:09:41.992952] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T21:09:42.517724] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-22T21:09:43.318077] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-22T21:09:43.368771] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-22T21:09:43.377911] [INFO ] [REMOTE ] SMG: Full fetch complete (62831 records). [2025-10-22T21:09:43.378127] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-22T21:09:43.902151] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-22T21:09:43.902247] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-22T21:09:43.903284] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-22T21:09:43.903348] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-22T21:09:43.904681] [DEBUG] [LOCAL ] SMG: Trimmed 62831 records to 42743 (keeping 200 days of data) [2025-10-22T21:09:44.122036] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-10. [2025-10-22T21:09:44.174500] [DEBUG] [LOCAL ] SMG: Primary data saved (42743 records). [2025-10-22T21:09:44.174627] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-22T21:09:44.174743] [INFO ] [MAIN ] Update Progress: 1940/2367 symbols completed. SMG took 33.9s. Estimated remaining: 54m 57s. Rate: 7.8 symbols/min [2025-10-22T21:09:44.348049] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:09:44.379467] [DEBUG] [LOCAL ] SMWB: Loaded 31817 existing records from primary storage. [2025-10-22T21:09:44.379780] [INFO ] [MAIN ] SMWB: Loaded 31817 existing records. [2025-10-22T21:09:44.570964] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:09:44.571262] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-22T21:09:44.571423] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-22T21:09:44.571776] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-10-22T21:09:44.571843] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-22T21:09:44.638001] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T21:09:44.921253] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-22T21:09:45.011691] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:09:45.043172] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-22T21:09:45.145615] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T21:09:45.149118] [INFO ] [REMOTE ] SMP: Full fetch complete (26536 records). [2025-10-22T21:09:45.149210] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-22T21:09:45.525101] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-10-22T21:09:45.525183] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-10-22T21:09:45.525740] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-10-22T21:09:45.525800] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-10-22T21:09:45.526460] [DEBUG] [LOCAL ] SMP: Trimmed 26536 records to 18640 (keeping 200 days of data) [2025-10-22T21:09:45.636567] [DEBUG] [LOCAL ] SMP: Primary data saved (18640 records). [2025-10-22T21:09:45.636736] [INFO ] [MAIN ] SMP: Full history saved. [2025-10-22T21:09:45.636836] [INFO ] [MAIN ] Update Progress: 1941/2367 symbols completed. SMP took 30.4s. Estimated remaining: 54m 48s. Rate: 7.8 symbols/min [2025-10-22T21:09:45.726303] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-22T21:09:45.806619] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:09:45.850105] [DEBUG] [LOCAL ] SN: Loaded 49991 existing records from primary storage. [2025-10-22T21:09:45.850401] [INFO ] [MAIN ] SN: Loaded 49991 existing records. [2025-10-22T21:09:46.026676] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:09:46.026848] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-22T21:09:46.026894] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-22T21:09:46.027067] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-10-22T21:09:46.027104] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-22T21:09:46.387214] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:09:46.468632] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T21:09:46.517698] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-22T21:09:47.312391] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T21:09:47.320076] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-22T21:09:48.117722] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-22T21:09:48.245429] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T21:09:48.917783] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-22T21:09:49.717736] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-22T21:09:49.852704] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T21:09:50.114059] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-10-22T21:09:50.517681] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-22T21:09:50.696861] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T21:09:51.288246] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T21:09:51.317686] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-22T21:09:52.117755] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-22T21:09:52.292900] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T21:09:52.917706] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-22T21:09:52.986621] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T21:09:53.584054] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T21:09:53.717697] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-22T21:09:54.524993] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-22T21:09:54.530944] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T21:09:55.317709] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-22T21:09:55.660250] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-22T21:09:55.729395] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-22T21:09:56.117713] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-22T21:09:56.917697] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-22T21:09:57.717706] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-22T21:09:57.931567] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-22T21:09:58.077444] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T21:09:58.309233] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-22T21:09:58.517681] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-22T21:09:58.867949] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T21:09:59.317774] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-22T21:10:00.117924] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-22T21:10:00.172946] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T21:10:00.917726] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-22T21:10:01.630368] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-22T21:10:01.717973] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-22T21:10:02.175255] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-10-22T21:10:02.517763] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-22T21:10:02.647010] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T21:10:03.317700] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-22T21:10:03.352150] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T21:10:04.117672] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-22T21:10:04.917726] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-22T21:10:05.060354] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T21:10:05.329460] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-22T21:10:05.340400] [INFO ] [REMOTE ] SMRT: Full fetch complete (62501 records). [2025-10-22T21:10:05.340673] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-22T21:10:05.721849] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-22T21:10:05.743410] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-22T21:10:05.743602] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-22T21:10:05.744760] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-22T21:10:05.744990] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-22T21:10:05.759859] [DEBUG] [LOCAL ] SMRT: Trimmed 62501 records to 43781 (keeping 200 days of data) [2025-10-22T21:10:05.784971] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (3.27 seconds). [2025-10-22T21:10:06.041982] [DEBUG] [LOCAL ] SMRT: Primary data saved (43781 records). [2025-10-22T21:10:06.042107] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-22T21:10:06.042183] [INFO ] [MAIN ] Update Progress: 1942/2367 symbols completed. SMRT took 25.4s. Estimated remaining: 54m 43s. Rate: 7.8 symbols/min [2025-10-22T21:10:06.250873] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:10:06.262983] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-22T21:10:06.292750] [DEBUG] [LOCAL ] SNA: Loaded 25833 existing records from primary storage. [2025-10-22T21:10:06.293007] [INFO ] [MAIN ] SNA: Loaded 25833 existing records. [2025-10-22T21:10:06.476546] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:10:06.476793] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-22T21:10:06.476841] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-22T21:10:06.477024] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-10-22T21:10:06.477084] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-22T21:10:06.522796] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-10-22T21:10:06.842048] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:10:07.317701] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-22T21:10:07.768404] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-22T21:10:08.117690] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-22T21:10:08.164477] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T21:10:08.702291] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T21:10:08.917719] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-22T21:10:09.717717] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-10-22T21:10:10.517710] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-22T21:10:10.618616] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-22T21:10:10.880779] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T21:10:11.317704] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-10. [2025-10-22T21:10:11.502454] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (3.38 seconds). [2025-10-22T21:10:12.117695] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-22T21:10:12.476904] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-22T21:10:12.481386] [INFO ] [REMOTE ] SMWB: Full fetch complete (48671 records). [2025-10-22T21:10:12.481507] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-22T21:10:12.817103] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-22T21:10:12.918413] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-22T21:10:12.919403] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-22T21:10:12.919456] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-22T21:10:12.920371] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-22T21:10:12.920515] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-22T21:10:12.921609] [DEBUG] [LOCAL ] SMWB: Trimmed 48671 records to 31619 (keeping 200 days of data) [2025-10-22T21:10:13.099249] [DEBUG] [LOCAL ] SMWB: Primary data saved (31619 records). [2025-10-22T21:10:13.099391] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-22T21:10:13.099470] [INFO ] [MAIN ] Update Progress: 1943/2367 symbols completed. SMWB took 28.9s. Estimated remaining: 54m 35s. Rate: 7.8 symbols/min [2025-10-22T21:10:13.274056] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:10:13.324841] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-22T21:10:13.325182] [INFO ] [MAIN ] SNAP: Loaded 53796 existing records. [2025-10-22T21:10:13.505980] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:10:13.506182] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-22T21:10:13.506230] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-22T21:10:13.506748] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-10-22T21:10:13.506815] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-22T21:10:13.725445] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-22T21:10:13.905767] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T21:10:13.904711] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:10:14.517669] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-22T21:10:14.585212] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T21:10:15.317713] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-22T21:10:16.117775] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-22T21:10:16.785983] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (3.06 seconds). [2025-10-22T21:10:16.922152] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-22T21:10:16.924444] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T21:10:16.933271] [INFO ] [REMOTE ] SN: Full fetch complete (71841 records). [2025-10-22T21:10:16.933375] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-22T21:10:17.269241] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-22T21:10:17.374517] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-22T21:10:17.374610] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-22T21:10:17.375733] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-22T21:10:17.375795] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-22T21:10:17.377233] [DEBUG] [LOCAL ] SN: Trimmed 71841 records to 49982 (keeping 200 days of data) [2025-10-22T21:10:17.668041] [DEBUG] [LOCAL ] SN: Primary data saved (49982 records). [2025-10-22T21:10:17.668228] [INFO ] [MAIN ] SN: Full history saved. [2025-10-22T21:10:17.668376] [INFO ] [MAIN ] Update Progress: 1944/2367 symbols completed. SN took 32.0s. Estimated remaining: 54m 27s. Rate: 7.8 symbols/min [2025-10-22T21:10:17.723166] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-22T21:10:17.843372] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:10:17.865872] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T21:10:17.877274] [DEBUG] [LOCAL ] SNDA: Loaded 4499 existing records from primary storage. [2025-10-22T21:10:17.877508] [INFO ] [MAIN ] SNDA: Loaded 4499 existing records. [2025-10-22T21:10:18.064343] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:10:18.064549] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-22T21:10:18.064599] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-22T21:10:18.064757] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-22T21:10:18.064809] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-22T21:10:18.419306] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:10:18.517671] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-22T21:10:19.317724] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-22T21:10:19.480814] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-22T21:10:19.958613] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (3.04 seconds). [2025-10-22T21:10:20.117692] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-22T21:10:20.257569] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-22T21:10:20.929413] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-22T21:10:20.933075] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T21:10:21.038974] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-22T21:10:21.717709] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-22T21:10:22.517709] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-22T21:10:23.063023] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T21:10:23.125305] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-22T21:10:23.286457] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-22T21:10:23.317634] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-22T21:10:24.117712] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-22T21:10:24.917722] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-22T21:10:25.553795] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T21:10:25.715022] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-22T21:10:25.722871] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-22T21:10:25.724747] [INFO ] [REMOTE ] SMR: Full fetch complete (77587 records). [2025-10-22T21:10:25.724863] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-22T21:10:25.725574] [FATAL] [VALIDATOR ] SMR: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T21:10:25.725684] [FATAL] [MAIN ] SMR: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:10:25.725752] [WARN ] [MAIN ] SMR: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:10:25.725842] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-22T21:10:25.725907] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-10-22T21:10:25.725943] [INFO ] [LOCAL ] SMR: Starting deletion of derivative data. [2025-10-22T21:10:25.725982] [DEBUG] [LOCAL ] SMR: No derivative data file found to delete. [2025-10-22T21:10:25.726036] [INFO ] [MAIN ] Update Progress: 1945/2367 symbols completed. SMR took 47.9s. Estimated remaining: 54m 19s. Rate: 7.8 symbols/min [2025-10-22T21:10:25.897199] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:10:25.929726] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-22T21:10:25.973591] [DEBUG] [LOCAL ] SNDR: Loaded 41593 existing records from primary storage. [2025-10-22T21:10:25.973887] [INFO ] [MAIN ] SNDR: Loaded 41593 existing records. [2025-10-22T21:10:26.150908] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:10:26.151097] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-22T21:10:26.151145] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-22T21:10:26.151334] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-10-22T21:10:26.151371] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-22T21:10:26.500827] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:10:26.517625] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-22T21:10:26.720206] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-22T21:10:27.317700] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-22T21:10:28.037213] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T21:10:28.090240] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-22T21:10:28.117634] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-22T21:10:28.871358] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-22T21:10:28.917715] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-22T21:10:29.717723] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-22T21:10:30.446810] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-22T21:10:30.517678] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-22T21:10:31.029367] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-22T21:10:31.317674] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-22T21:10:31.548387] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-10-22T21:10:32.117734] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-22T21:10:32.870565] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-22T21:10:32.925715] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-22T21:10:32.928308] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T21:10:33.671047] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T21:10:33.672278] [INFO ] [REMOTE ] SNDA: Full fetch complete (7542 records). [2025-10-22T21:10:33.672352] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-22T21:10:33.722797] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-10-22T21:10:34.062752] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-22T21:10:34.062830] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-22T21:10:34.063081] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-22T21:10:34.063127] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-22T21:10:34.063505] [DEBUG] [LOCAL ] SNDA: Trimmed 7542 records to 4475 (keeping 200 days of data) [2025-10-22T21:10:34.088626] [DEBUG] [LOCAL ] SNDA: Primary data saved (4475 records). [2025-10-22T21:10:34.088729] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-22T21:10:34.088802] [INFO ] [MAIN ] Update Progress: 1946/2367 symbols completed. SNDA took 16.4s. Estimated remaining: 54m 11s. Rate: 7.8 symbols/min [2025-10-22T21:10:34.262583] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:10:34.304546] [DEBUG] [LOCAL ] SNN: Loaded 44384 existing records from primary storage. [2025-10-22T21:10:34.305011] [INFO ] [MAIN ] SNN: Loaded 44384 existing records. [2025-10-22T21:10:34.503001] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:10:34.503226] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-22T21:10:34.503283] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-22T21:10:34.503473] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-22T21:10:34.503525] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-22T21:10:34.523693] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-22T21:10:34.854746] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:10:35.065695] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T21:10:35.317692] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-10-22T21:10:35.928571] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T21:10:36.117692] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-22T21:10:36.601139] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T21:10:36.917702] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-10. [2025-10-22T21:10:37.717717] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-22T21:10:38.076812] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-22T21:10:38.081567] [INFO ] [REMOTE ] SNA: Full fetch complete (39151 records). [2025-10-22T21:10:38.081823] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-22T21:10:38.465344] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-10-22T21:10:38.465519] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-10-22T21:10:38.466417] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-10-22T21:10:38.466501] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-10-22T21:10:38.467521] [DEBUG] [LOCAL ] SNA: Trimmed 39151 records to 25699 (keeping 200 days of data) [2025-10-22T21:10:38.531878] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-22T21:10:38.595093] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-22T21:10:38.673557] [DEBUG] [LOCAL ] SNA: Primary data saved (25699 records). [2025-10-22T21:10:38.673712] [INFO ] [MAIN ] SNA: Full history saved. [2025-10-22T21:10:38.673800] [INFO ] [MAIN ] Update Progress: 1947/2367 symbols completed. SNA took 32.6s. Estimated remaining: 54m 3s. Rate: 7.8 symbols/min [2025-10-22T21:10:38.861274] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:10:38.861530] [DEBUG] [LOCAL ] SNOW: No existing data file found in primary storage. [2025-10-22T21:10:38.861592] [WARN ] [MAIN ] SNOW: No existing data found, performing full refresh instead. [2025-10-22T21:10:38.861944] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-22T21:10:38.862031] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-22T21:10:38.862104] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-10-22T21:10:38.862144] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-22T21:10:39.233382] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:10:39.267036] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-22T21:10:39.317702] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-22T21:10:40.037125] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T21:10:40.117697] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-22T21:10:40.917798] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-22T21:10:41.513336] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T21:10:41.717771] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-22T21:10:41.769165] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-22T21:10:42.517745] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-22T21:10:43.317675] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-22T21:10:43.759118] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-10-22T21:10:43.783559] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-22T21:10:44.117747] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-22T21:10:44.917750] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-22T21:10:45.053716] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T21:10:45.497206] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.98 seconds). [2025-10-22T21:10:45.717717] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-22T21:10:45.933436] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T21:10:46.517717] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-22T21:10:47.317713] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-22T21:10:47.409666] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T21:10:47.528299] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-10-22T21:10:48.117715] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-22T21:10:48.466202] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T21:10:48.917740] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-22T21:10:49.717797] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-22T21:10:49.788635] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T21:10:49.845227] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-22T21:10:50.517731] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-22T21:10:51.317725] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-10-22T21:10:51.568734] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T21:10:51.721246] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-10-22T21:10:52.122914] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-22T21:10:52.165937] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T21:10:52.917721] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-22T21:10:53.604714] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-22T21:10:53.640167] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T21:10:53.717626] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-22T21:10:54.517723] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-22T21:10:54.700515] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T21:10:54.710805] [INFO ] [REMOTE ] SNDR: Full fetch complete (60283 records). [2025-10-22T21:10:54.710921] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-22T21:10:55.098486] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-22T21:10:55.098599] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-22T21:10:55.099748] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-22T21:10:55.099813] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-22T21:10:55.101028] [DEBUG] [LOCAL ] SNDR: Trimmed 60283 records to 41601 (keeping 200 days of data) [2025-10-22T21:10:55.324551] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-10-22T21:10:55.350913] [DEBUG] [LOCAL ] SNDR: Primary data saved (41601 records). [2025-10-22T21:10:55.350994] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-22T21:10:55.351551] [INFO ] [MAIN ] Update Progress: 1948/2367 symbols completed. SNDR took 29.6s. Estimated remaining: 53m 57s. Rate: 7.8 symbols/min [2025-10-22T21:10:55.519999] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:10:55.566214] [DEBUG] [LOCAL ] SNV: Loaded 49068 existing records from primary storage. [2025-10-22T21:10:55.566509] [INFO ] [MAIN ] SNV: Loaded 49068 existing records. [2025-10-22T21:10:55.742069] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:10:55.742390] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-22T21:10:55.742445] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-22T21:10:55.742761] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-10-22T21:10:55.742819] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-22T21:10:55.885823] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-22T21:10:56.129449] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-22T21:10:56.134121] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:10:56.917694] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-22T21:10:57.076631] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-22T21:10:57.086043] [INFO ] [REMOTE ] SNAP: Full fetch complete (77975 records). [2025-10-22T21:10:57.086210] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-22T21:10:57.477808] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-22T21:10:57.477893] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-22T21:10:57.479032] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-22T21:10:57.479108] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-22T21:10:57.480569] [DEBUG] [LOCAL ] SNAP: Trimmed 77975 records to 53796 (keeping 200 days of data) [2025-10-22T21:10:57.787397] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-10-22T21:10:57.787502] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-22T21:10:57.787576] [INFO ] [MAIN ] Update Progress: 1949/2367 symbols completed. SNAP took 44.7s. Estimated remaining: 53m 48s. Rate: 7.8 symbols/min [2025-10-22T21:10:57.956247] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:10:57.992731] [DEBUG] [LOCAL ] SNX: Loaded 38922 existing records from primary storage. [2025-10-22T21:10:57.993018] [INFO ] [MAIN ] SNX: Loaded 38922 existing records. [2025-10-22T21:10:58.179858] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:10:58.180425] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-22T21:10:58.180556] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-22T21:10:58.180891] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-10-22T21:10:58.180973] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-22T21:10:58.521263] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-22T21:10:58.558411] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-22T21:10:58.614502] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:10:58.614981] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-22T21:10:58.871193] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T21:10:59.317689] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-22T21:10:59.417019] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (4.09 seconds). [2025-10-22T21:11:00.117728] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-10-22T21:11:00.286102] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T21:11:00.772715] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-22T21:11:00.917669] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-22T21:11:01.241768] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-22T21:11:01.717708] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-22T21:11:02.365419] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-22T21:11:02.517723] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-10-22T21:11:02.540468] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T21:11:03.317768] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-22T21:11:04.117697] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-22T21:11:04.361447] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-22T21:11:04.920914] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-22T21:11:05.013884] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T21:11:05.021363] [INFO ] [REMOTE ] SNN: Full fetch complete (63092 records). [2025-10-22T21:11:05.021534] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-22T21:11:05.402892] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-22T21:11:05.402981] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-22T21:11:05.404003] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-22T21:11:05.404068] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-22T21:11:05.405362] [DEBUG] [LOCAL ] SNN: Trimmed 63092 records to 44338 (keeping 200 days of data) [2025-10-22T21:11:05.670738] [DEBUG] [LOCAL ] SNN: Primary data saved (44338 records). [2025-10-22T21:11:05.670893] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-22T21:11:05.670976] [INFO ] [MAIN ] Update Progress: 1950/2367 symbols completed. SNN took 31.6s. Estimated remaining: 53m 41s. Rate: 7.8 symbols/min [2025-10-22T21:11:05.853456] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:11:05.907687] [DEBUG] [LOCAL ] SO: Loaded 53615 existing records from primary storage. [2025-10-22T21:11:05.907994] [INFO ] [MAIN ] SO: Loaded 53615 existing records. [2025-10-22T21:11:06.089175] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:11:06.089501] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-22T21:11:06.089679] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-22T21:11:06.090108] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-10-22T21:11:06.090167] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-22T21:11:06.388172] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-22T21:11:06.441230] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-22T21:11:06.515174] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:11:06.517626] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-22T21:11:06.704309] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T21:11:07.317738] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-22T21:11:07.640873] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T21:11:08.117741] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-22T21:11:08.638150] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-22T21:11:08.917731] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-22T21:11:08.959578] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (6.44 seconds). [2025-10-22T21:11:09.212351] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T21:11:09.603425] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T21:11:09.717737] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-10-22T21:11:10.517675] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-22T21:11:10.666253] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T21:11:11.317777] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-22T21:11:12.117685] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-22T21:11:12.327442] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-22T21:11:12.362367] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-22T21:11:12.777997] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T21:11:12.917687] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-22T21:11:13.110987] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-22T21:11:13.717732] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-10-22T21:11:14.517710] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-10-22T21:11:15.074298] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-22T21:11:15.317721] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-22T21:11:16.117768] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-22T21:11:16.217673] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T21:11:16.353914] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-22T21:11:16.925781] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-10-22T21:11:16.959468] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T21:11:17.717714] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-10. [2025-10-22T21:11:18.165172] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-22T21:11:18.408402] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T21:11:18.517682] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-10-22T21:11:19.029701] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T21:11:19.038958] [INFO ] [REMOTE ] SNOW: Full fetch complete (77331 records). [2025-10-22T21:11:19.039137] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-22T21:11:19.040047] [FATAL] [VALIDATOR ] SNOW: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T21:11:19.040161] [FATAL] [MAIN ] SNOW: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:11:19.040243] [WARN ] [MAIN ] SNOW: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:11:19.040330] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-22T21:11:19.040438] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-10-22T21:11:19.040514] [INFO ] [LOCAL ] SNOW: Starting deletion of derivative data. [2025-10-22T21:11:19.040605] [DEBUG] [LOCAL ] SNOW: No derivative data file found to delete. [2025-10-22T21:11:19.040732] [INFO ] [MAIN ] Update Progress: 1951/2367 symbols completed. SNOW took 40.4s. Estimated remaining: 53m 34s. Rate: 7.8 symbols/min [2025-10-22T21:11:19.223874] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:11:19.258438] [DEBUG] [LOCAL ] SOBO: Loaded 39418 existing records from primary storage. [2025-10-22T21:11:19.258734] [INFO ] [MAIN ] SOBO: Loaded 39418 existing records. [2025-10-22T21:11:19.323339] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-22T21:11:19.451606] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:11:19.451842] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-22T21:11:19.451889] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-22T21:11:19.452246] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-22T21:11:19.452284] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-22T21:11:19.822845] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:11:20.117744] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-22T21:11:20.291389] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T21:11:20.322662] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-22T21:11:20.917690] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-10. [2025-10-22T21:11:21.717700] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-22T21:11:22.099283] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T21:11:22.517663] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-10. [2025-10-22T21:11:22.637569] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-22T21:11:22.639029] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T21:11:22.656136] [INFO ] [REMOTE ] SNX: Full fetch complete (57330 records). [2025-10-22T21:11:22.656297] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-22T21:11:23.041806] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-10-22T21:11:23.041933] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-10-22T21:11:23.042941] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-10-22T21:11:23.043005] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-10-22T21:11:23.044250] [DEBUG] [LOCAL ] SNX: Trimmed 57330 records to 38854 (keeping 200 days of data) [2025-10-22T21:11:23.284140] [DEBUG] [LOCAL ] SNX: Primary data saved (38854 records). [2025-10-22T21:11:23.284285] [INFO ] [MAIN ] SNX: Full history saved. [2025-10-22T21:11:23.284362] [INFO ] [MAIN ] Update Progress: 1952/2367 symbols completed. SNX took 25.5s. Estimated remaining: 53m 26s. Rate: 7.8 symbols/min [2025-10-22T21:11:23.327563] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-22T21:11:23.460223] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:11:23.508415] [DEBUG] [LOCAL ] SOC: Loaded 51226 existing records from primary storage. [2025-10-22T21:11:23.508773] [INFO ] [MAIN ] SOC: Loaded 51226 existing records. [2025-10-22T21:11:23.687731] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:11:23.687970] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-22T21:11:23.688018] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-22T21:11:23.688202] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-22T21:11:23.688258] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-22T21:11:24.053057] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:11:24.117729] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-22T21:11:24.373537] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T21:11:24.382401] [INFO ] [REMOTE ] SNV: Full fetch complete (71845 records). [2025-10-22T21:11:24.382525] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-22T21:11:24.751725] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T21:11:24.833987] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-10-22T21:11:24.834486] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-10-22T21:11:24.835626] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-10-22T21:11:24.835709] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-10-22T21:11:24.837065] [DEBUG] [LOCAL ] SNV: Trimmed 71845 records to 49060 (keeping 200 days of data) [2025-10-22T21:11:24.924706] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-22T21:11:25.133130] [DEBUG] [LOCAL ] SNV: Primary data saved (49060 records). [2025-10-22T21:11:25.133257] [INFO ] [MAIN ] SNV: Full history saved. [2025-10-22T21:11:25.133870] [INFO ] [MAIN ] Update Progress: 1953/2367 symbols completed. SNV took 29.8s. Estimated remaining: 53m 17s. Rate: 7.8 symbols/min [2025-10-22T21:11:25.305621] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:11:25.312229] [DEBUG] [LOCAL ] SOJC: Loaded 4657 existing records from primary storage. [2025-10-22T21:11:25.312430] [INFO ] [MAIN ] SOJC: Loaded 4657 existing records. [2025-10-22T21:11:25.486218] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:11:25.486680] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-22T21:11:25.486741] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-22T21:11:25.486922] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-22T21:11:25.486976] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-22T21:11:25.717799] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-22T21:11:25.844598] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:11:25.881984] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T21:11:26.517738] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-22T21:11:26.760706] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T21:11:26.850160] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T21:11:27.317714] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-22T21:11:27.351413] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T21:11:28.117734] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-22T21:11:28.692827] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T21:11:28.917688] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-22T21:11:29.717701] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-22T21:11:29.748119] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T21:11:30.461379] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-22T21:11:30.517680] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-22T21:11:30.610782] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T21:11:30.619552] [INFO ] [REMOTE ] SO: Full fetch complete (77775 records). [2025-10-22T21:11:30.619717] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-22T21:11:31.027962] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-22T21:11:31.028035] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-22T21:11:31.029140] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-22T21:11:31.029201] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-22T21:11:31.030592] [DEBUG] [LOCAL ] SO: Trimmed 77775 records to 53615 (keeping 200 days of data) [2025-10-22T21:11:31.324133] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-22T21:11:31.348372] [DEBUG] [LOCAL ] SO: Primary data saved (53615 records). [2025-10-22T21:11:31.348490] [INFO ] [MAIN ] SO: Full history saved. [2025-10-22T21:11:31.348569] [INFO ] [MAIN ] Update Progress: 1954/2367 symbols completed. SO took 25.7s. Estimated remaining: 53m 9s. Rate: 7.8 symbols/min [2025-10-22T21:11:31.514730] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:11:31.528514] [DEBUG] [LOCAL ] SOJD: Loaded 12668 existing records from primary storage. [2025-10-22T21:11:31.528747] [INFO ] [MAIN ] SOJD: Loaded 12668 existing records. [2025-10-22T21:11:31.705140] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:11:31.705348] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-22T21:11:31.705417] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-22T21:11:31.705600] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-22T21:11:31.705693] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-22T21:11:32.072785] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:11:32.117674] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-22T21:11:32.248229] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-22T21:11:32.275089] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T21:11:32.917691] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-22T21:11:33.175004] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-22T21:11:33.717692] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-22T21:11:33.778280] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-22T21:11:34.517692] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-22T21:11:34.718350] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-22T21:11:35.317713] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-22T21:11:36.117677] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-22T21:11:36.315377] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T21:11:36.383889] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-22T21:11:36.715189] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T21:11:36.917721] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-22T21:11:37.717739] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-22T21:11:37.726793] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T21:11:38.517749] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-22T21:11:39.317722] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-22T21:11:39.451745] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T21:11:40.067782] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-22T21:11:40.117690] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-22T21:11:40.253745] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T21:11:40.917695] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-22T21:11:41.005426] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T21:11:41.717715] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-22T21:11:42.517669] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-22T21:11:42.675076] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-22T21:11:42.701592] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T21:11:43.317709] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-22T21:11:44.117754] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-22T21:11:44.449314] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T21:11:44.919151] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-22T21:11:44.923535] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T21:11:44.967697] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T21:11:45.717689] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-22T21:11:46.517711] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-22T21:11:46.876239] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-22T21:11:46.918076] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-22T21:11:47.317708] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-22T21:11:48.119752] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-22T21:11:48.122154] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-22T21:11:48.369905] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-22T21:11:48.917712] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-22T21:11:49.717709] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-22T21:11:49.988406] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-22T21:11:50.019745] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T21:11:50.387238] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-22T21:11:50.388956] [INFO ] [REMOTE ] SOJC: Full fetch complete (7231 records). [2025-10-22T21:11:50.389212] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-22T21:11:50.522794] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-22T21:11:50.790222] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-22T21:11:50.790328] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-22T21:11:50.790539] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-22T21:11:50.790580] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-22T21:11:50.790990] [DEBUG] [LOCAL ] SOJC: Trimmed 7231 records to 4574 (keeping 200 days of data) [2025-10-22T21:11:50.818113] [DEBUG] [LOCAL ] SOJC: Primary data saved (4574 records). [2025-10-22T21:11:50.818207] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-22T21:11:50.818293] [INFO ] [MAIN ] Update Progress: 1955/2367 symbols completed. SOJC took 25.7s. Estimated remaining: 53m 4s. Rate: 7.8 symbols/min [2025-10-22T21:11:50.981825] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:11:50.992721] [DEBUG] [LOCAL ] SOJE: Loaded 8777 existing records from primary storage. [2025-10-22T21:11:50.992965] [INFO ] [MAIN ] SOJE: Loaded 8777 existing records. [2025-10-22T21:11:51.163998] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:11:51.164205] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-22T21:11:51.164252] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-22T21:11:51.164451] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-22T21:11:51.164507] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-22T21:11:51.324609] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-22T21:11:51.549125] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:11:52.117859] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-22T21:11:52.123460] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T21:11:52.917637] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-22T21:11:53.075665] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-22T21:11:53.376750] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-22T21:11:53.717680] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-22T21:11:54.432853] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T21:11:54.496442] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T21:11:54.517684] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-22T21:11:55.317704] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-22T21:11:55.508212] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T21:11:55.510851] [INFO ] [REMOTE ] SOJD: Full fetch complete (19076 records). [2025-10-22T21:11:55.510943] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-22T21:11:55.884237] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-22T21:11:55.884342] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-22T21:11:55.884813] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-22T21:11:55.884874] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-22T21:11:55.885422] [DEBUG] [LOCAL ] SOJD: Trimmed 19076 records to 12581 (keeping 200 days of data) [2025-10-22T21:11:55.965028] [DEBUG] [LOCAL ] SOJD: Primary data saved (12581 records). [2025-10-22T21:11:55.965183] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-22T21:11:55.965280] [INFO ] [MAIN ] Update Progress: 1956/2367 symbols completed. SOJD took 24.6s. Estimated remaining: 52m 55s. Rate: 7.8 symbols/min [2025-10-22T21:11:56.118050] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-22T21:11:56.142082] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:11:56.142315] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-22T21:11:56.142386] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-22T21:11:56.142499] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-22T21:11:56.142540] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-22T21:11:56.142580] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-22T21:11:56.142612] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-22T21:11:56.260417] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T21:11:56.495847] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:11:56.917720] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-22T21:11:57.717675] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-01. [2025-10-22T21:11:57.856060] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-22T21:11:58.042439] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T21:11:58.517726] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-22T21:11:58.874675] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T21:11:59.317725] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-22T21:12:00.117732] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-02. [2025-10-22T21:12:00.216442] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T21:12:00.231398] [INFO ] [REMOTE ] SOBO: Full fetch complete (58578 records). [2025-10-22T21:12:00.232314] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-22T21:12:00.232441] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-22T21:12:00.613848] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-22T21:12:00.613922] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-22T21:12:00.614901] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-22T21:12:00.614962] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-22T21:12:00.616017] [DEBUG] [LOCAL ] SOBO: Trimmed 58578 records to 39390 (keeping 200 days of data) [2025-10-22T21:12:00.853395] [DEBUG] [LOCAL ] SOBO: Primary data saved (39390 records). [2025-10-22T21:12:00.853540] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-22T21:12:00.853627] [INFO ] [MAIN ] Update Progress: 1957/2367 symbols completed. SOBO took 41.8s. Estimated remaining: 52m 47s. Rate: 7.8 symbols/min [2025-10-22T21:12:00.917720] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-22T21:12:01.056020] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-22T21:12:01.717682] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-03. [2025-10-22T21:12:01.849933] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-22T21:12:02.406380] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-22T21:12:02.517731] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-22T21:12:03.317694] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-04. [2025-10-22T21:12:03.398601] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T21:12:04.117772] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-22T21:12:04.288206] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-22T21:12:04.917786] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-05. [2025-10-22T21:12:05.047310] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T21:12:05.717671] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-22T21:12:05.780969] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T21:12:06.517632] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-22T21:12:06.821582] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T21:12:07.317689] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-06. [2025-10-22T21:12:08.117744] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-22T21:12:08.288956] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-22T21:12:08.677370] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-22T21:12:08.725996] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T21:12:08.917690] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-22T21:12:09.696811] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T21:12:09.717631] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-22T21:12:10.517749] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-07. [2025-10-22T21:12:10.525912] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T21:12:10.528447] [INFO ] [REMOTE ] SOJE: Full fetch complete (13444 records). [2025-10-22T21:12:10.528586] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-22T21:12:10.929413] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-22T21:12:10.929498] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-22T21:12:10.929832] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-22T21:12:10.929893] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-22T21:12:10.930368] [DEBUG] [LOCAL ] SOJE: Trimmed 13444 records to 8697 (keeping 200 days of data) [2025-10-22T21:12:10.985537] [DEBUG] [LOCAL ] SOJE: Primary data saved (8697 records). [2025-10-22T21:12:10.985714] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-22T21:12:10.985807] [INFO ] [MAIN ] Update Progress: 1958/2367 symbols completed. SOJE took 20.2s. Estimated remaining: 52m 40s. Rate: 7.8 symbols/min [2025-10-22T21:12:11.317721] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-22T21:12:11.425782] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T21:12:12.117777] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-08. [2025-10-22T21:12:13.002225] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T21:12:13.004855] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-10-22T21:12:13.559419] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-22T21:12:13.568792] [INFO ] [REMOTE ] SOC: Full fetch complete (72223 records). [2025-10-22T21:12:13.568913] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-22T21:12:13.961992] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-22T21:12:13.985202] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-10. [2025-10-22T21:12:14.003912] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-22T21:12:14.003990] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-22T21:12:14.005230] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-22T21:12:14.005294] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-22T21:12:14.006819] [DEBUG] [LOCAL ] SOC: Trimmed 72223 records to 51227 (keeping 200 days of data) [2025-10-22T21:12:14.306188] [DEBUG] [LOCAL ] SOC: Primary data saved (51227 records). [2025-10-22T21:12:14.306325] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-22T21:12:14.306400] [INFO ] [MAIN ] Update Progress: 1959/2367 symbols completed. SOC took 51.0s. Estimated remaining: 52m 31s. Rate: 7.8 symbols/min [2025-10-22T21:12:14.800265] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-22T21:12:14.802006] [INFO ] [REMOTE ] SOJF: Full fetch complete (14125 records). [2025-10-22T21:12:14.802077] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-10-22T21:12:14.983687] [WARN ] [VALIDATOR ] SOJF: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-22T21:12:14.984005] [FATAL] [MAIN ] SOJF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:12:14.984076] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:12:14.984147] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-22T21:12:14.984212] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-22T21:12:14.984247] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-22T21:12:14.984285] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-22T21:12:14.984341] [INFO ] [MAIN ] Update Progress: 1960/2367 symbols completed. SOJF took 19.0s. Estimated remaining: 52m 22s. Rate: 7.8 symbols/min [2025-10-22T21:12:15.677200] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:12:15.695624] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:12:15.659845] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:12:15.757312] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:12:15.772733] [DEBUG] [LOCAL ] SOL: Loaded 13572 existing records from primary storage. [2025-10-22T21:12:15.773158] [INFO ] [MAIN ] SOL: Loaded 13572 existing records. [2025-10-22T21:12:15.986348] [DEBUG] [LOCAL ] SON: Loaded 43528 existing records from primary storage. [2025-10-22T21:12:16.025719] [INFO ] [MAIN ] SON: Loaded 43528 existing records. [2025-10-22T21:12:16.025572] [DEBUG] [LOCAL ] SOLV: Loaded 43445 existing records from primary storage. [2025-10-22T21:12:16.034223] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:12:16.049895] [DEBUG] [LOCAL ] SONY: Loaded 53378 existing records from primary storage. [2025-10-22T21:12:16.039736] [INFO ] [MAIN ] SOLV: Loaded 43445 existing records. [2025-10-22T21:12:16.059011] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-22T21:12:16.084066] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-22T21:12:16.083946] [INFO ] [MAIN ] SONY: Loaded 53378 existing records. [2025-10-22T21:12:16.155125] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-22T21:12:16.163961] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-22T21:12:16.565251] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:12:16.629594] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-22T21:12:16.720371] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-22T21:12:16.766741] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:12:16.784193] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-22T21:12:16.820151] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-22T21:12:16.794546] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:12:16.825580] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-22T21:12:16.830923] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-22T21:12:16.831083] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-10-22T21:12:16.831176] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-22T21:12:16.864714] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-22T21:12:16.864604] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-22T21:12:16.941974] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-10-22T21:12:16.942146] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-22T21:12:17.248421] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:12:17.315589] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-22T21:12:18.012080] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:12:18.078058] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-22T21:12:18.108459] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:12:18.135724] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:12:18.137034] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-22T21:12:18.136826] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-22T21:12:18.665181] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T21:12:18.669812] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-22T21:12:19.878507] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T21:12:19.887392] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-22T21:12:20.167779] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-22T21:12:20.176385] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-22T21:12:20.378065] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T21:12:20.381906] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-22T21:12:21.097120] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (3.02 seconds). [2025-10-22T21:12:21.108176] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-22T21:12:21.372023] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-22T21:12:21.514743] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T21:12:21.717678] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-22T21:12:21.892561] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T21:12:22.517685] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-22T21:12:22.995725] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T21:12:23.317698] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-22T21:12:23.357773] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-22T21:12:23.514911] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T21:12:24.117725] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-22T21:12:24.917710] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-22T21:12:25.252901] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-22T21:12:25.472601] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-22T21:12:25.717719] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-22T21:12:26.517700] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-22T21:12:26.648959] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T21:12:26.896609] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T21:12:27.317680] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-22T21:12:28.117719] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-22T21:12:28.661571] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-22T21:12:28.917629] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-22T21:12:29.059606] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T21:12:29.269866] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T21:12:29.717713] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-22T21:12:30.493603] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T21:12:30.517673] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-10-22T21:12:31.317733] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-22T21:12:31.710903] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-22T21:12:32.117682] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-22T21:12:32.252941] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T21:12:32.368418] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T21:12:32.917697] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-22T21:12:33.577336] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T21:12:33.717637] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-10-22T21:12:34.517685] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-22T21:12:34.971924] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-22T21:12:35.317692] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-22T21:12:35.385395] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-22T21:12:36.117701] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-10-22T21:12:36.200241] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T21:12:36.917753] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-22T21:12:37.570525] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-22T21:12:37.607899] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T21:12:37.653128] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T21:12:37.717721] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-22T21:12:38.517729] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-10-22T21:12:39.317705] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-22T21:12:40.002355] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-22T21:12:40.117724] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-10-22T21:12:40.212839] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T21:12:40.516981] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T21:12:40.520510] [INFO ] [REMOTE ] SOL: Full fetch complete (21141 records). [2025-10-22T21:12:40.520615] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-22T21:12:40.881551] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-22T21:12:40.881633] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-22T21:12:40.882108] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-22T21:12:40.882157] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-22T21:12:40.882725] [DEBUG] [LOCAL ] SOL: Trimmed 21141 records to 13561 (keeping 200 days of data) [2025-10-22T21:12:40.920512] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-10-22T21:12:40.961273] [DEBUG] [LOCAL ] SOL: Primary data saved (13561 records). [2025-10-22T21:12:40.961402] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-22T21:12:40.961480] [INFO ] [MAIN ] Update Progress: 1961/2367 symbols completed. SOL took 26.0s. Estimated remaining: 52m 18s. Rate: 7.8 symbols/min [2025-10-22T21:12:41.131222] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:12:41.135920] [DEBUG] [LOCAL ] SOR: Loaded 2835 existing records from primary storage. [2025-10-22T21:12:41.136057] [INFO ] [MAIN ] SOR: Loaded 2835 existing records. [2025-10-22T21:12:41.305717] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:12:41.305906] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-22T21:12:41.305956] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-22T21:12:41.306079] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-22T21:12:41.306116] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-22T21:12:41.654820] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:12:41.717667] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-22T21:12:41.803107] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T21:12:42.230520] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-22T21:12:42.517698] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-22T21:12:42.662266] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T21:12:42.938029] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-22T21:12:43.317693] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-10. [2025-10-22T21:12:44.117711] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-22T21:12:44.738906] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T21:12:44.808855] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T21:12:44.816734] [INFO ] [REMOTE ] SON: Full fetch complete (62995 records). [2025-10-22T21:12:44.816837] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-22T21:12:44.922841] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-22T21:12:45.200930] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-10-22T21:12:45.201013] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-10-22T21:12:45.202189] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-10-22T21:12:45.202262] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-10-22T21:12:45.203453] [DEBUG] [LOCAL ] SON: Trimmed 62995 records to 43544 (keeping 200 days of data) [2025-10-22T21:12:45.459551] [DEBUG] [LOCAL ] SON: Primary data saved (43544 records). [2025-10-22T21:12:45.459701] [INFO ] [MAIN ] SON: Full history saved. [2025-10-22T21:12:45.459790] [INFO ] [MAIN ] Update Progress: 1962/2367 symbols completed. SON took 30.5s. Estimated remaining: 52m 10s. Rate: 7.8 symbols/min [2025-10-22T21:12:45.626616] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:12:45.637157] [DEBUG] [LOCAL ] SOS: Loaded 9535 existing records from primary storage. [2025-10-22T21:12:45.637340] [INFO ] [MAIN ] SOS: Loaded 9535 existing records. [2025-10-22T21:12:45.722735] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-10-22T21:12:45.744505] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T21:12:45.821421] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:12:45.821636] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-22T21:12:45.821718] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-22T21:12:45.821864] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-22T21:12:45.821902] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-22T21:12:46.171887] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:12:46.517633] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-22T21:12:47.317690] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-22T21:12:47.668495] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-22T21:12:47.721344] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T21:12:47.824255] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-22T21:12:48.117701] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-22T21:12:48.851352] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-22T21:12:48.917632] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-22T21:12:49.496007] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-22T21:12:49.717698] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-10-22T21:12:50.517696] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-22T21:12:51.249829] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T21:12:51.317716] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-22T21:12:51.513569] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T21:12:52.019858] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-22T21:12:52.117685] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-22T21:12:52.732542] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-22T21:12:52.917682] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-22T21:12:53.614661] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-22T21:12:53.717712] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-22T21:12:54.240720] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-22T21:12:54.517694] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-10. [2025-10-22T21:12:55.317678] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-22T21:12:56.078252] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T21:12:56.085543] [INFO ] [REMOTE ] SOLV: Full fetch complete (63442 records). [2025-10-22T21:12:56.085753] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-22T21:12:56.122900] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-22T21:12:56.469623] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-10-22T21:12:56.469736] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-10-22T21:12:56.470808] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-10-22T21:12:56.470908] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-10-22T21:12:56.472215] [DEBUG] [LOCAL ] SOLV: Trimmed 63442 records to 43384 (keeping 200 days of data) [2025-10-22T21:12:56.720166] [DEBUG] [LOCAL ] SOLV: Primary data saved (43384 records). [2025-10-22T21:12:56.720297] [INFO ] [MAIN ] SOLV: Full history saved. [2025-10-22T21:12:56.721167] [INFO ] [MAIN ] Update Progress: 1963/2367 symbols completed. SOLV took 41.7s. Estimated remaining: 52m 3s. Rate: 7.8 symbols/min [2025-10-22T21:12:56.886926] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:12:56.918509] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-22T21:12:56.919215] [DEBUG] [LOCAL ] SPB: Loaded 34128 existing records from primary storage. [2025-10-22T21:12:56.920516] [INFO ] [MAIN ] SPB: Loaded 34128 existing records. [2025-10-22T21:12:57.106798] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:12:57.107130] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-22T21:12:57.107189] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-22T21:12:57.107718] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-22T21:12:57.107795] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-22T21:12:57.466476] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:12:57.512516] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-22T21:12:57.534300] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T21:12:57.607310] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-22T21:12:57.717703] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-22T21:12:58.396544] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T21:12:58.517697] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-22T21:12:59.317689] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-22T21:12:59.701213] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T21:13:00.117719] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-22T21:13:00.917697] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-22T21:13:01.512314] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-22T21:13:01.530352] [INFO ] [REMOTE ] SOR: Full fetch complete (4363 records). [2025-10-22T21:13:01.530742] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-22T21:13:01.591705] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T21:13:01.705821] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-22T21:13:01.721589] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-22T21:13:01.763411] [INFO ] [REMOTE ] SONY: Full fetch complete (77412 records). [2025-10-22T21:13:01.777957] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-22T21:13:02.221166] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-22T21:13:02.242333] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-22T21:13:02.293534] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-22T21:13:02.332911] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-22T21:13:02.355967] [DEBUG] [LOCAL ] SOR: Trimmed 4363 records to 2818 (keeping 200 days of data) [2025-10-22T21:13:02.449896] [DEBUG] [LOCAL ] SOR: Primary data saved (2818 records). [2025-10-22T21:13:02.453635] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-22T21:13:02.472182] [INFO ] [MAIN ] Update Progress: 1964/2367 symbols completed. SOR took 21.5s. Estimated remaining: 51m 54s. Rate: 7.8 symbols/min [2025-10-22T21:13:02.472316] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-22T21:13:02.472488] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-22T21:13:02.521003] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-22T21:13:02.508543] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-22T21:13:02.521165] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-22T21:13:02.581778] [DEBUG] [LOCAL ] SONY: Trimmed 77412 records to 53376 (keeping 200 days of data) [2025-10-22T21:13:02.734695] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:13:02.908075] [DEBUG] [LOCAL ] SPCE: Loaded 50041 existing records from primary storage. [2025-10-22T21:13:02.918414] [INFO ] [MAIN ] SPCE: Loaded 50041 existing records. [2025-10-22T21:13:03.178915] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:13:03.181459] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-22T21:13:03.182489] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-22T21:13:03.187031] [DEBUG] [LOCAL ] SONY: Primary data saved (53376 records). [2025-10-22T21:13:03.187140] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-22T21:13:03.187308] [INFO ] [MAIN ] Update Progress: 1965/2367 symbols completed. SONY took 48.2s. Estimated remaining: 51m 45s. Rate: 7.8 symbols/min [2025-10-22T21:13:03.187466] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-22T21:13:03.198922] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-22T21:13:03.524783] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:13:03.610001] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T21:13:03.666606] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-22T21:13:03.698874] [DEBUG] [LOCAL ] SPE: Loaded 6238 existing records from primary storage. [2025-10-22T21:13:03.735259] [INFO ] [MAIN ] SPE: Loaded 6238 existing records. [2025-10-22T21:13:03.798476] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:13:03.946740] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:13:03.947011] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-22T21:13:03.947062] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-22T21:13:03.947200] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-22T21:13:03.947239] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-22T21:13:04.121590] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-22T21:13:04.240213] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-22T21:13:04.320180] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:13:04.917712] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-22T21:13:05.370057] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T21:13:05.717705] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-22T21:13:06.099016] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T21:13:06.101673] [INFO ] [REMOTE ] SOS: Full fetch complete (11284 records). [2025-10-22T21:13:06.101756] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-22T21:13:06.313724] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-22T21:13:06.516199] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-22T21:13:06.516271] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-22T21:13:06.516527] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-22T21:13:06.516566] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-22T21:13:06.517035] [DEBUG] [LOCAL ] SOS: Trimmed 11284 records to 9686 (keeping 200 days of data) [2025-10-22T21:13:06.517708] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-22T21:13:06.571444] [DEBUG] [LOCAL ] SOS: Primary data saved (9686 records). [2025-10-22T21:13:06.571536] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-22T21:13:06.571606] [INFO ] [MAIN ] Update Progress: 1966/2367 symbols completed. SOS took 21.1s. Estimated remaining: 51m 37s. Rate: 7.8 symbols/min [2025-10-22T21:13:06.756169] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:13:06.801469] [DEBUG] [LOCAL ] SPG: Loaded 50015 existing records from primary storage. [2025-10-22T21:13:06.801778] [INFO ] [MAIN ] SPG: Loaded 50015 existing records. [2025-10-22T21:13:06.975431] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:13:06.975723] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-22T21:13:06.975777] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-22T21:13:06.975978] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-10-22T21:13:06.976020] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-22T21:13:07.333140] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:13:07.329680] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-22T21:13:07.373250] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T21:13:07.951906] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-22T21:13:08.117635] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-22T21:13:08.155356] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T21:13:08.917782] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-22T21:13:09.717688] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-22T21:13:10.111149] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-22T21:13:10.495762] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T21:13:10.517636] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-22T21:13:10.624957] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-22T21:13:11.317676] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-22T21:13:12.014143] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-22T21:13:12.117699] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-22T21:13:12.261725] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T21:13:12.917681] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-22T21:13:13.146635] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-22T21:13:13.717670] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-22T21:13:14.304869] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-22T21:13:14.517687] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-22T21:13:14.592211] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T21:13:15.317703] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-22T21:13:16.117747] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-22T21:13:16.724215] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-22T21:13:16.922779] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-22T21:13:16.936829] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T21:13:17.717743] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-22T21:13:17.843695] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T21:13:18.517778] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-22T21:13:18.943752] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T21:13:18.986388] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T21:13:19.318394] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-22T21:13:19.320737] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-22T21:13:20.117723] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-22T21:13:20.917733] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-22T21:13:21.508705] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-22T21:13:21.545058] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T21:13:21.718428] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-22T21:13:21.721006] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-22T21:13:22.517728] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-22T21:13:22.966146] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-22T21:13:22.971138] [INFO ] [REMOTE ] SPB: Full fetch complete (47766 records). [2025-10-22T21:13:22.971228] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-22T21:13:23.317910] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-22T21:13:23.373065] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-22T21:13:23.372794] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T21:13:23.373323] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-22T21:13:23.377203] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-22T21:13:23.377620] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-22T21:13:23.378850] [DEBUG] [LOCAL ] SPB: Trimmed 47766 records to 34013 (keeping 200 days of data) [2025-10-22T21:13:23.604289] [DEBUG] [LOCAL ] SPB: Primary data saved (34013 records). [2025-10-22T21:13:23.604481] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-22T21:13:23.604580] [INFO ] [MAIN ] Update Progress: 1967/2367 symbols completed. SPB took 26.9s. Estimated remaining: 51m 31s. Rate: 7.8 symbols/min [2025-10-22T21:13:23.774975] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:13:23.821429] [DEBUG] [LOCAL ] SPGI: Loaded 45905 existing records from primary storage. [2025-10-22T21:13:23.821879] [INFO ] [MAIN ] SPGI: Loaded 45905 existing records. [2025-10-22T21:13:24.014053] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:13:24.014350] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-22T21:13:24.014402] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-22T21:13:24.014670] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-10-22T21:13:24.014733] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-22T21:13:24.122806] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-22T21:13:24.386468] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:13:24.917729] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-22T21:13:25.363137] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-22T21:13:25.717736] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-22T21:13:26.022009] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T21:13:26.521373] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-22T21:13:26.523119] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-22T21:13:26.524567] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T21:13:27.317682] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-22T21:13:27.596944] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-22T21:13:28.117747] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-22T21:13:28.917801] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-22T21:13:28.967371] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-22T21:13:28.969938] [INFO ] [REMOTE ] SPE: Full fetch complete (9818 records). [2025-10-22T21:13:28.970574] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-22T21:13:29.488810] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-22T21:13:29.489046] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-22T21:13:29.489734] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-22T21:13:29.489990] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-22T21:13:29.491500] [DEBUG] [LOCAL ] SPE: Trimmed 9818 records to 6149 (keeping 200 days of data) [2025-10-22T21:13:29.537237] [DEBUG] [LOCAL ] SPE: Primary data saved (6149 records). [2025-10-22T21:13:29.537439] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-22T21:13:29.537815] [INFO ] [MAIN ] Update Progress: 1968/2367 symbols completed. SPE took 26.4s. Estimated remaining: 51m 23s. Rate: 7.8 symbols/min [2025-10-22T21:13:29.726066] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:13:29.726191] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-22T21:13:29.781255] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-22T21:13:29.801741] [DEBUG] [LOCAL ] SPH: Loaded 16617 existing records from primary storage. [2025-10-22T21:13:29.802037] [INFO ] [MAIN ] SPH: Loaded 16617 existing records. [2025-10-22T21:13:29.989135] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:13:29.989536] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-22T21:13:29.989597] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-22T21:13:29.989831] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-22T21:13:29.989907] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-22T21:13:30.280777] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T21:13:30.395034] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:13:30.517682] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-22T21:13:31.317746] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-22T21:13:31.829094] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-22T21:13:31.872453] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T21:13:32.117731] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-22T21:13:32.527459] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-22T21:13:32.917690] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-22T21:13:33.717694] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-22T21:13:34.119479] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-22T21:13:34.517676] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-22T21:13:35.076132] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T21:13:35.112135] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-22T21:13:35.317684] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-22T21:13:36.117684] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-22T21:13:36.248619] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T21:13:36.674243] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T21:13:36.917715] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-22T21:13:37.425065] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T21:13:37.717720] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-22T21:13:38.517678] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-22T21:13:38.604874] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-22T21:13:38.773736] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T21:13:39.317718] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-22T21:13:39.619467] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-22T21:13:40.117674] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-22T21:13:40.917689] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-22T21:13:41.085337] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-22T21:13:41.464671] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-22T21:13:41.717685] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-22T21:13:42.005173] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T21:13:42.517637] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-22T21:13:42.716249] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T21:13:43.317667] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-22T21:13:44.117631] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-22T21:13:44.320197] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T21:13:44.328889] [INFO ] [REMOTE ] SPCE: Full fetch complete (72657 records). [2025-10-22T21:13:44.329013] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-22T21:13:44.456602] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-22T21:13:44.501540] [INFO ] [REMOTE ] SPG: Full fetch complete (72048 records). [2025-10-22T21:13:44.525841] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-22T21:13:44.918886] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-22T21:13:45.072309] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-22T21:13:45.096436] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-22T21:13:45.097684] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-22T21:13:45.097800] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-22T21:13:45.224228] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-22T21:13:45.224755] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-22T21:13:45.224581] [DEBUG] [LOCAL ] SPCE: Trimmed 72657 records to 50052 (keeping 200 days of data) [2025-10-22T21:13:45.225947] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-22T21:13:45.226052] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-22T21:13:45.281134] [DEBUG] [LOCAL ] SPG: Trimmed 72048 records to 49934 (keeping 200 days of data) [2025-10-22T21:13:45.551038] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T21:13:45.721980] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-22T21:13:45.869354] [DEBUG] [LOCAL ] SPG: Primary data saved (49934 records). [2025-10-22T21:13:45.880009] [DEBUG] [LOCAL ] SPCE: Primary data saved (50052 records). [2025-10-22T21:13:45.880116] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-22T21:13:45.875326] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-22T21:13:45.880353] [INFO ] [MAIN ] Update Progress: 1969/2367 symbols completed. SPG took 39.3s. Estimated remaining: 51m 17s. Rate: 7.8 symbols/min [2025-10-22T21:13:45.881304] [INFO ] [MAIN ] Update Progress: 1970/2367 symbols completed. SPCE took 43.4s. Estimated remaining: 51m 7s. Rate: 7.8 symbols/min [2025-10-22T21:13:45.882132] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-22T21:13:46.223276] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:13:46.226299] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:13:46.281508] [DEBUG] [LOCAL ] SPIR: Loaded 37525 existing records from primary storage. [2025-10-22T21:13:46.281846] [INFO ] [MAIN ] SPIR: Loaded 37525 existing records. [2025-10-22T21:13:46.315131] [DEBUG] [LOCAL ] SPHR: Loaded 40695 existing records from primary storage. [2025-10-22T21:13:46.353763] [INFO ] [MAIN ] SPHR: Loaded 40695 existing records. [2025-10-22T21:13:46.521820] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-22T21:13:46.593101] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:13:46.640363] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-22T21:13:46.645149] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:13:46.645270] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-22T21:13:46.645434] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-22T21:13:46.645483] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-22T21:13:46.645709] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-22T21:13:46.645683] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-10-22T21:13:46.645899] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-22T21:13:46.645838] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-22T21:13:47.377851] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:13:47.373114] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:13:47.378153] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-22T21:13:47.803570] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-22T21:13:47.966332] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-22T21:13:47.975245] [INFO ] [REMOTE ] SPGI: Full fetch complete (67775 records). [2025-10-22T21:13:47.975396] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-22T21:13:48.125976] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-22T21:13:48.379266] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-22T21:13:48.379347] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-22T21:13:48.380457] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-22T21:13:48.380521] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-22T21:13:48.381789] [DEBUG] [LOCAL ] SPGI: Trimmed 67775 records to 45897 (keeping 200 days of data) [2025-10-22T21:13:48.625661] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T21:13:48.716781] [DEBUG] [LOCAL ] SPGI: Primary data saved (45897 records). [2025-10-22T21:13:48.716914] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-22T21:13:48.717672] [INFO ] [MAIN ] Update Progress: 1971/2367 symbols completed. SPGI took 25.1s. Estimated remaining: 50m 59s. Rate: 7.8 symbols/min [2025-10-22T21:13:48.885328] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:13:48.893471] [DEBUG] [LOCAL ] SPMC: Loaded 5407 existing records from primary storage. [2025-10-22T21:13:48.893707] [INFO ] [MAIN ] SPMC: Loaded 5407 existing records. [2025-10-22T21:13:48.922802] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-22T21:13:49.073026] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:13:49.073284] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-22T21:13:49.073333] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-22T21:13:49.073471] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-22T21:13:49.073507] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-22T21:13:49.362334] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-22T21:13:49.454149] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:13:49.717699] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-10-22T21:13:50.517699] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-22T21:13:50.605355] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T21:13:51.317668] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-22T21:13:51.339686] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-22T21:13:51.702383] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T21:13:52.117730] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-22T21:13:52.917670] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-22T21:13:52.976391] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T21:13:53.230227] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-22T21:13:53.637854] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-22T21:13:53.717670] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-22T21:13:54.517674] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-22T21:13:55.317743] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-10-22T21:13:55.453700] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T21:13:55.481763] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T21:13:55.484589] [INFO ] [REMOTE ] SPH: Full fetch complete (27749 records). [2025-10-22T21:13:55.484686] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-22T21:13:55.843883] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-22T21:13:55.843976] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-22T21:13:55.844362] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-22T21:13:55.844400] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-22T21:13:55.845023] [DEBUG] [LOCAL ] SPH: Trimmed 27749 records to 16482 (keeping 200 days of data) [2025-10-22T21:13:55.940748] [DEBUG] [LOCAL ] SPH: Primary data saved (16482 records). [2025-10-22T21:13:55.940872] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-22T21:13:55.940948] [INFO ] [MAIN ] Update Progress: 1972/2367 symbols completed. SPH took 26.4s. Estimated remaining: 50m 51s. Rate: 7.8 symbols/min [2025-10-22T21:13:56.108065] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:13:56.108234] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-22T21:13:56.108271] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-22T21:13:56.108391] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-22T21:13:56.108433] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-22T21:13:56.108473] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-22T21:13:56.108503] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-22T21:13:56.123164] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-22T21:13:56.478064] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:13:56.917722] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-22T21:13:56.963046] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-22T21:13:57.669119] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-22T21:13:57.717612] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-22T21:13:57.837201] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T21:13:58.517707] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-01. [2025-10-22T21:13:58.623289] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-22T21:13:58.814054] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:13:58.814379] [WARN ] [REMOTE ] SPME: No data returned for month 2025-01 [2025-10-22T21:13:58.814467] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:13:58.814518] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-22T21:13:58.814583] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:13:58.814677] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-22T21:13:58.814755] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-22T21:13:58.814796] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-22T21:13:58.814837] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-22T21:13:58.814880] [INFO ] [MAIN ] Update Progress: 1973/2367 symbols completed. SPME took 2.9s. Estimated remaining: 50m 42s. Rate: 7.8 symbols/min [2025-10-22T21:13:58.977951] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:13:59.010870] [DEBUG] [LOCAL ] SPNT: Loaded 34304 existing records from primary storage. [2025-10-22T21:13:59.011149] [INFO ] [MAIN ] SPNT: Loaded 34304 existing records. [2025-10-22T21:13:59.184851] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:13:59.185094] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-22T21:13:59.185142] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-22T21:13:59.185569] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-10-22T21:13:59.185626] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-22T21:13:59.326468] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-22T21:13:59.550746] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:14:00.117673] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-22T21:14:00.917738] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-22T21:14:01.074819] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T21:14:01.094043] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-22T21:14:01.717742] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-22T21:14:02.236248] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-22T21:14:02.336443] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T21:14:02.517712] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-10-22T21:14:03.317725] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-22T21:14:04.117715] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-22T21:14:04.307609] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T21:14:04.805701] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T21:14:04.917791] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-22T21:14:05.717630] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-22T21:14:05.814906] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T21:14:06.304853] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T21:14:06.522877] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-22T21:14:06.536516] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T21:14:07.276522] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-22T21:14:07.317660] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-22T21:14:07.797712] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-22T21:14:08.117694] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-22T21:14:08.917734] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-10-22T21:14:09.717727] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-22T21:14:09.810884] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T21:14:10.374861] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-22T21:14:10.517695] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-22T21:14:10.592871] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T21:14:11.227428] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T21:14:11.229043] [INFO ] [REMOTE ] SPMC: Full fetch complete (8370 records). [2025-10-22T21:14:11.229112] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-22T21:14:11.322730] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-22T21:14:11.594591] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-22T21:14:11.594690] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-22T21:14:11.594916] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-22T21:14:11.594977] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-22T21:14:11.595358] [DEBUG] [LOCAL ] SPMC: Trimmed 8370 records to 5246 (keeping 200 days of data) [2025-10-22T21:14:11.629834] [DEBUG] [LOCAL ] SPMC: Primary data saved (5246 records). [2025-10-22T21:14:11.629972] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-22T21:14:11.630078] [INFO ] [MAIN ] Update Progress: 1974/2367 symbols completed. SPMC took 22.9s. Estimated remaining: 50m 35s. Rate: 7.8 symbols/min [2025-10-22T21:14:11.808147] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:14:11.808326] [DEBUG] [LOCAL ] SPOT: No existing data file found in primary storage. [2025-10-22T21:14:11.808375] [WARN ] [MAIN ] SPOT: No existing data found, performing full refresh instead. [2025-10-22T21:14:11.808496] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-22T21:14:11.808538] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-22T21:14:11.808579] [DEBUG] [LOCAL ] SPOT: No primary data file found to delete. [2025-10-22T21:14:11.808611] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-22T21:14:12.126222] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-10-22T21:14:12.156937] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:14:12.917727] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-22T21:14:13.109482] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T21:14:13.461483] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-22T21:14:13.717691] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-22T21:14:13.883686] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T21:14:14.517668] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-10-22T21:14:15.317627] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-22T21:14:15.507990] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T21:14:16.029227] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-22T21:14:16.117623] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-22T21:14:16.185027] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T21:14:16.917666] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-22T21:14:17.322943] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-22T21:14:17.717722] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-22T21:14:18.305871] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-22T21:14:18.440825] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T21:14:18.517714] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-22T21:14:19.317699] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-22T21:14:20.117697] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-10-22T21:14:20.152771] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T21:14:20.917688] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-22T21:14:21.002278] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T21:14:21.717710] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-22T21:14:21.828090] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T21:14:22.517715] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-10-22T21:14:22.703809] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T21:14:23.268698] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T21:14:23.317686] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-22T21:14:24.105505] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T21:14:24.117613] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-10. [2025-10-22T21:14:24.590677] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-22T21:14:24.917719] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-22T21:14:25.717713] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-22T21:14:25.903725] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T21:14:25.911569] [INFO ] [REMOTE ] SPHR: Full fetch complete (58835 records). [2025-10-22T21:14:25.911727] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-22T21:14:26.285119] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-22T21:14:26.285216] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-22T21:14:26.286268] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-22T21:14:26.286331] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-22T21:14:26.287608] [DEBUG] [LOCAL ] SPHR: Trimmed 58835 records to 40681 (keeping 200 days of data) [2025-10-22T21:14:26.520703] [DEBUG] [LOCAL ] SPHR: Primary data saved (40681 records). [2025-10-22T21:14:26.519714] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-22T21:14:26.520929] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-22T21:14:26.523019] [INFO ] [MAIN ] Update Progress: 1975/2367 symbols completed. SPHR took 40.6s. Estimated remaining: 50m 29s. Rate: 7.8 symbols/min [2025-10-22T21:14:26.697632] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:14:26.734801] [DEBUG] [LOCAL ] SPR: Loaded 40875 existing records from primary storage. [2025-10-22T21:14:26.735089] [INFO ] [MAIN ] SPR: Loaded 40875 existing records. [2025-10-22T21:14:26.911263] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:14:26.911593] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-22T21:14:26.911754] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-22T21:14:26.911995] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-22T21:14:26.912036] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-22T21:14:27.063540] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T21:14:27.313786] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:14:27.317631] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-22T21:14:27.591761] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T21:14:27.599588] [INFO ] [REMOTE ] SPIR: Full fetch complete (54183 records). [2025-10-22T21:14:27.599878] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-22T21:14:28.020233] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-22T21:14:28.037498] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-22T21:14:28.042578] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-22T21:14:28.044131] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-22T21:14:28.044238] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-22T21:14:28.044352] [INFO ] [REMOTE ] SPNT: Full fetch complete (48447 records). [2025-10-22T21:14:28.044710] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-22T21:14:28.124849] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-22T21:14:28.142705] [DEBUG] [LOCAL ] SPIR: Trimmed 54183 records to 37535 (keeping 200 days of data) [2025-10-22T21:14:28.595419] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-22T21:14:28.595851] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-22T21:14:28.620384] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-22T21:14:28.620714] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-22T21:14:28.632600] [DEBUG] [LOCAL ] SPNT: Trimmed 48447 records to 34220 (keeping 200 days of data) [2025-10-22T21:14:28.745364] [DEBUG] [LOCAL ] SPIR: Primary data saved (37535 records). [2025-10-22T21:14:28.754124] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-22T21:14:28.758690] [INFO ] [MAIN ] Update Progress: 1976/2367 symbols completed. SPIR took 42.9s. Estimated remaining: 50m 20s. Rate: 7.8 symbols/min [2025-10-22T21:14:29.012278] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:14:29.022220] [DEBUG] [LOCAL ] SPNT: Primary data saved (34220 records). [2025-10-22T21:14:29.023788] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-22T21:14:29.023890] [INFO ] [MAIN ] Update Progress: 1977/2367 symbols completed. SPNT took 30.2s. Estimated remaining: 50m 11s. Rate: 7.8 symbols/min [2025-10-22T21:14:29.177415] [DEBUG] [LOCAL ] SPRU: Loaded 10030 existing records from primary storage. [2025-10-22T21:14:29.202636] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:14:29.202828] [INFO ] [MAIN ] SPRU: Loaded 10030 existing records. [2025-10-22T21:14:29.336196] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-22T21:14:29.350766] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-22T21:14:29.442493] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:14:29.442843] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-22T21:14:29.443633] [DEBUG] [LOCAL ] SPXC: Loaded 23233 existing records from primary storage. [2025-10-22T21:14:29.443029] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-22T21:14:29.444014] [INFO ] [MAIN ] SPXC: Loaded 23233 existing records. [2025-10-22T21:14:29.444070] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-10-22T21:14:29.464534] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-22T21:14:29.642166] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T21:14:29.761041] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-22T21:14:29.820991] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:14:29.821340] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-22T21:14:29.844782] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-22T21:14:29.879283] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-10-22T21:14:29.882209] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-22T21:14:30.279290] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:14:30.466994] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:14:30.517616] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-22T21:14:31.044373] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T21:14:31.239921] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-22T21:14:31.317625] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-22T21:14:31.581720] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T21:14:32.117728] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-22T21:14:32.841246] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T21:14:32.917703] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-22T21:14:33.059862] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T21:14:33.717713] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-22T21:14:34.209707] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-22T21:14:34.517672] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-22T21:14:34.730534] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-22T21:14:35.277434] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-22T21:14:35.317614] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-22T21:14:36.117722] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-22T21:14:36.188107] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-22T21:14:36.917731] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-22T21:14:37.717730] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-10-22T21:14:37.948907] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T21:14:38.284256] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-22T21:14:38.289846] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T21:14:38.517715] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-22T21:14:39.317691] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-10-22T21:14:39.544582] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T21:14:40.002111] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-22T21:14:40.117673] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-10-22T21:14:40.917630] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-22T21:14:41.002893] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-22T21:14:41.717708] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-22T21:14:41.881670] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T21:14:41.890371] [INFO ] [REMOTE ] SPOT: Full fetch complete (73398 records). [2025-10-22T21:14:41.890708] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-22T21:14:41.892179] [FATAL] [VALIDATOR ] SPOT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T21:14:41.892278] [FATAL] [MAIN ] SPOT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:14:41.892323] [WARN ] [MAIN ] SPOT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:14:41.892365] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-22T21:14:41.892427] [DEBUG] [LOCAL ] SPOT: No primary data file found to delete. [2025-10-22T21:14:41.892463] [INFO ] [LOCAL ] SPOT: Starting deletion of derivative data. [2025-10-22T21:14:41.892504] [DEBUG] [LOCAL ] SPOT: No derivative data file found to delete. [2025-10-22T21:14:41.892568] [INFO ] [MAIN ] Update Progress: 1978/2367 symbols completed. SPOT took 30.3s. Estimated remaining: 50m 4s. Rate: 7.8 symbols/min [2025-10-22T21:14:42.071790] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:14:42.083462] [DEBUG] [LOCAL ] SPXX: Loaded 9192 existing records from primary storage. [2025-10-22T21:14:42.083739] [INFO ] [MAIN ] SPXX: Loaded 9192 existing records. [2025-10-22T21:14:42.261994] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:14:42.262225] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-22T21:14:42.262282] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-22T21:14:42.262438] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-10-22T21:14:42.262475] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-22T21:14:42.525864] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-22T21:14:42.617665] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:14:43.072891] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T21:14:43.317681] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-22T21:14:44.117670] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-10-22T21:14:44.329816] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T21:14:44.627589] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T21:14:44.917682] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-22T21:14:45.295291] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T21:14:45.717707] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-22T21:14:46.173091] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-22T21:14:46.517703] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-10-22T21:14:47.263368] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T21:14:47.317740] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-22T21:14:47.429002] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-22T21:14:48.117708] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-22T21:14:48.917706] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-22T21:14:49.018699] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-22T21:14:49.369790] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-22T21:14:49.717681] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-22T21:14:50.226130] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-22T21:14:50.517709] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-22T21:14:51.273730] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T21:14:51.317614] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-22T21:14:51.747333] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-22T21:14:52.117744] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-22T21:14:52.917693] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-10. [2025-10-22T21:14:52.998275] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-22T21:14:53.023869] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T21:14:53.717686] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-22T21:14:53.850077] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T21:14:53.853046] [INFO ] [REMOTE ] SPRU: Full fetch complete (12228 records). [2025-10-22T21:14:53.853117] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-10-22T21:14:54.202480] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-10-22T21:14:54.202551] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-10-22T21:14:54.202863] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-10-22T21:14:54.202924] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-10-22T21:14:54.203386] [DEBUG] [LOCAL ] SPRU: Trimmed 12228 records to 9997 (keeping 200 days of data) [2025-10-22T21:14:54.257420] [DEBUG] [LOCAL ] SPRU: Primary data saved (9997 records). [2025-10-22T21:14:54.257582] [INFO ] [MAIN ] SPRU: Full history saved. [2025-10-22T21:14:54.257708] [INFO ] [MAIN ] Update Progress: 1979/2367 symbols completed. SPRU took 25.5s. Estimated remaining: 49m 58s. Rate: 7.8 symbols/min [2025-10-22T21:14:54.424249] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:14:54.464904] [DEBUG] [LOCAL ] SQM: Loaded 48969 existing records from primary storage. [2025-10-22T21:14:54.465217] [INFO ] [MAIN ] SQM: Loaded 48969 existing records. [2025-10-22T21:14:54.527367] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-22T21:14:54.643929] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:14:54.644136] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-22T21:14:54.644187] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-22T21:14:54.644688] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-10-22T21:14:54.644745] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-22T21:14:54.909807] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-22T21:14:55.023757] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:14:55.317707] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-22T21:14:55.936413] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T21:14:55.943920] [INFO ] [REMOTE ] SPR: Full fetch complete (59928 records). [2025-10-22T21:14:55.944050] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-22T21:14:56.122562] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-22T21:14:56.366967] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-22T21:14:56.367067] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-22T21:14:56.368274] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-22T21:14:56.368350] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-22T21:14:56.369603] [DEBUG] [LOCAL ] SPR: Trimmed 59928 records to 40712 (keeping 200 days of data) [2025-10-22T21:14:56.618754] [DEBUG] [LOCAL ] SPR: Primary data saved (40712 records). [2025-10-22T21:14:56.618996] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-22T21:14:56.619096] [INFO ] [MAIN ] Update Progress: 1980/2367 symbols completed. SPR took 30.1s. Estimated remaining: 49m 49s. Rate: 7.8 symbols/min [2025-10-22T21:14:56.807820] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:14:56.831630] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T21:14:56.858844] [DEBUG] [LOCAL ] SQNS: Loaded 27998 existing records from primary storage. [2025-10-22T21:14:56.859115] [INFO ] [MAIN ] SQNS: Loaded 27998 existing records. [2025-10-22T21:14:56.922768] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-22T21:14:57.039027] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:14:57.039229] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-22T21:14:57.039302] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-22T21:14:57.039502] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-22T21:14:57.039545] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-22T21:14:57.384988] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:14:57.717721] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-22T21:14:57.939949] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T21:14:57.967507] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-22T21:14:58.517719] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-22T21:14:58.875031] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-22T21:14:59.317749] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-22T21:15:00.117636] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-22T21:15:00.240242] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T21:15:00.642364] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-22T21:15:00.917709] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-22T21:15:01.042083] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-22T21:15:01.717737] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-22T21:15:02.500599] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T21:15:02.517612] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-22T21:15:03.073204] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-22T21:15:03.317709] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-22T21:15:03.534983] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T21:15:04.117685] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-22T21:15:04.412427] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T21:15:04.917680] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-22T21:15:05.717628] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-22T21:15:05.815967] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T21:15:05.913486] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-22T21:15:06.517725] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-22T21:15:06.989326] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T21:15:06.995067] [INFO ] [REMOTE ] SPXC: Full fetch complete (34149 records). [2025-10-22T21:15:06.995190] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-22T21:15:07.325006] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-22T21:15:07.378260] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T21:15:07.378063] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-10-22T21:15:07.380035] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-10-22T21:15:07.381418] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-10-22T21:15:07.381815] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-10-22T21:15:07.382556] [DEBUG] [LOCAL ] SPXC: Trimmed 34149 records to 23163 (keeping 200 days of data) [2025-10-22T21:15:07.521189] [DEBUG] [LOCAL ] SPXC: Primary data saved (23163 records). [2025-10-22T21:15:07.521313] [INFO ] [MAIN ] SPXC: Full history saved. [2025-10-22T21:15:07.521387] [INFO ] [MAIN ] Update Progress: 1981/2367 symbols completed. SPXC took 38.5s. Estimated remaining: 49m 42s. Rate: 7.8 symbols/min [2025-10-22T21:15:07.687964] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:15:07.718120] [DEBUG] [LOCAL ] SR: Loaded 32385 existing records from primary storage. [2025-10-22T21:15:07.718403] [INFO ] [MAIN ] SR: Loaded 32385 existing records. [2025-10-22T21:15:07.902670] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:15:07.902900] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-22T21:15:07.902947] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-22T21:15:07.903122] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-10-22T21:15:07.903159] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-22T21:15:08.122874] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-22T21:15:08.256887] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:15:08.382527] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T21:15:08.917731] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-22T21:15:09.161383] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T21:15:09.717692] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-22T21:15:09.905785] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T21:15:10.517690] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-22T21:15:11.317627] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-22T21:15:11.696739] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-22T21:15:12.045172] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-22T21:15:12.117631] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-22T21:15:12.505500] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T21:15:12.917744] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-22T21:15:13.677358] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T21:15:13.717677] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-22T21:15:14.517633] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-22T21:15:15.229969] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-22T21:15:15.252943] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T21:15:15.268525] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T21:15:15.271018] [INFO ] [REMOTE ] SPXX: Full fetch complete (13459 records). [2025-10-22T21:15:15.271088] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-22T21:15:15.322821] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-22T21:15:15.628999] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-22T21:15:15.629103] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-22T21:15:15.629435] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-22T21:15:15.629478] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-22T21:15:15.630000] [DEBUG] [LOCAL ] SPXX: Trimmed 13459 records to 9114 (keeping 200 days of data) [2025-10-22T21:15:15.684302] [DEBUG] [LOCAL ] SPXX: Primary data saved (9114 records). [2025-10-22T21:15:15.684430] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-22T21:15:15.684509] [INFO ] [MAIN ] Update Progress: 1982/2367 symbols completed. SPXX took 33.8s. Estimated remaining: 49m 34s. Rate: 7.8 symbols/min [2025-10-22T21:15:15.848468] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:15:15.896574] [DEBUG] [LOCAL ] SRE: Loaded 53414 existing records from primary storage. [2025-10-22T21:15:15.896975] [INFO ] [MAIN ] SRE: Loaded 53414 existing records. [2025-10-22T21:15:16.068734] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:15:16.068965] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-22T21:15:16.069039] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-22T21:15:16.069384] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-10-22T21:15:16.069452] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-22T21:15:16.130745] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-22T21:15:16.420441] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:15:16.917711] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-22T21:15:17.385919] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-22T21:15:17.717678] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-22T21:15:18.480107] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-22T21:15:18.517678] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-22T21:15:18.927098] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T21:15:19.317689] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-22T21:15:19.436591] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T21:15:20.069551] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T21:15:20.117697] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-22T21:15:20.917639] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-22T21:15:20.945257] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T21:15:21.319047] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T21:15:21.323200] [INFO ] [REMOTE ] SQNS: Full fetch complete (33106 records). [2025-10-22T21:15:21.323272] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-22T21:15:21.685173] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-22T21:15:21.685251] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-22T21:15:21.685921] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-22T21:15:21.685982] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-22T21:15:21.686824] [DEBUG] [LOCAL ] SQNS: Trimmed 33106 records to 28139 (keeping 200 days of data) [2025-10-22T21:15:21.732005] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-22T21:15:21.846601] [DEBUG] [LOCAL ] SQNS: Primary data saved (28139 records). [2025-10-22T21:15:21.846757] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-22T21:15:21.846842] [INFO ] [MAIN ] Update Progress: 1983/2367 symbols completed. SQNS took 25.2s. Estimated remaining: 49m 26s. Rate: 7.8 symbols/min [2025-10-22T21:15:22.010667] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:15:22.020120] [DEBUG] [LOCAL ] SREA: Loaded 9778 existing records from primary storage. [2025-10-22T21:15:22.020301] [INFO ] [MAIN ] SREA: Loaded 9778 existing records. [2025-10-22T21:15:22.191785] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:15:22.192038] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-22T21:15:22.192086] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-22T21:15:22.192283] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-22T21:15:22.192339] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-22T21:15:22.525004] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-22T21:15:22.547633] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:15:22.745925] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-22T21:15:23.318032] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-22T21:15:23.317927] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T21:15:23.895835] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T21:15:24.117712] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-22T21:15:24.904375] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T21:15:24.917747] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-22T21:15:25.609470] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T21:15:25.717708] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-22T21:15:26.006331] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-22T21:15:26.517739] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-22T21:15:27.322855] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-22T21:15:27.340217] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T21:15:27.393128] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-22T21:15:28.117636] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-22T21:15:28.546309] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T21:15:28.917769] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-22T21:15:29.717727] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-22T21:15:29.840699] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T21:15:30.370307] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-22T21:15:30.522727] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-22T21:15:30.534621] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T21:15:31.248426] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-22T21:15:31.257088] [INFO ] [REMOTE ] SQM: Full fetch complete (69534 records). [2025-10-22T21:15:31.257216] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-22T21:15:31.258186] [FATAL] [VALIDATOR ] SQM: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T21:15:31.258294] [FATAL] [MAIN ] SQM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:15:31.258347] [WARN ] [MAIN ] SQM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:15:31.258416] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-22T21:15:31.258484] [DEBUG] [LOCAL ] SQM: No primary data file found to delete. [2025-10-22T21:15:31.258519] [INFO ] [LOCAL ] SQM: Starting deletion of derivative data. [2025-10-22T21:15:31.258702] [DEBUG] [LOCAL ] SQM: Deleted derivative data file. [2025-10-22T21:15:31.258793] [INFO ] [MAIN ] Update Progress: 1984/2367 symbols completed. SQM took 37.0s. Estimated remaining: 49m 19s. Rate: 7.8 symbols/min [2025-10-22T21:15:31.326632] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-22T21:15:31.443444] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:15:31.480213] [DEBUG] [LOCAL ] SRFM: Loaded 39815 existing records from primary storage. [2025-10-22T21:15:31.480565] [INFO ] [MAIN ] SRFM: Loaded 39815 existing records. [2025-10-22T21:15:31.679211] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:15:31.679444] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-22T21:15:31.679505] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-22T21:15:31.679937] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-22T21:15:31.679993] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-22T21:15:32.051042] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:15:32.117611] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-22T21:15:32.917728] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-22T21:15:33.323604] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-22T21:15:33.653178] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T21:15:33.717612] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-22T21:15:33.950420] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-22T21:15:34.517741] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-22T21:15:34.978710] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-22T21:15:35.317712] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-22T21:15:35.368510] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T21:15:36.117745] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-22T21:15:36.917757] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-22T21:15:37.549547] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-22T21:15:37.694967] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T21:15:37.717625] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-22T21:15:38.320460] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T21:15:38.517705] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-22T21:15:39.109742] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-22T21:15:39.317697] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-22T21:15:39.477345] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T21:15:40.117628] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-22T21:15:40.465854] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T21:15:40.917625] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-22T21:15:41.717710] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-22T21:15:42.040698] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T21:15:42.086064] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-22T21:15:42.091002] [INFO ] [REMOTE ] SR: Full fetch complete (46161 records). [2025-10-22T21:15:42.091096] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-22T21:15:42.465055] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-22T21:15:42.465177] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-22T21:15:42.466244] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-22T21:15:42.466311] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-22T21:15:42.467861] [DEBUG] [LOCAL ] SR: Trimmed 46161 records to 32257 (keeping 200 days of data) [2025-10-22T21:15:42.522248] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-22T21:15:42.674175] [DEBUG] [LOCAL ] SR: Primary data saved (32257 records). [2025-10-22T21:15:42.674318] [INFO ] [MAIN ] SR: Full history saved. [2025-10-22T21:15:42.674399] [INFO ] [MAIN ] Update Progress: 1985/2367 symbols completed. SR took 35.2s. Estimated remaining: 49m 12s. Rate: 7.8 symbols/min [2025-10-22T21:15:42.843391] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:15:42.858825] [DEBUG] [LOCAL ] SRG: Loaded 14827 existing records from primary storage. [2025-10-22T21:15:42.859063] [INFO ] [MAIN ] SRG: Loaded 14827 existing records. [2025-10-22T21:15:43.003929] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T21:15:43.062217] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:15:43.062925] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-22T21:15:43.063000] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-22T21:15:43.063306] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-22T21:15:43.063423] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-22T21:15:43.319209] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-22T21:15:43.420529] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:15:43.453969] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T21:15:44.117758] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-22T21:15:44.917717] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-22T21:15:45.361070] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-22T21:15:45.717715] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-22T21:15:45.908309] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T21:15:46.115475] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T21:15:46.124447] [INFO ] [REMOTE ] SRE: Full fetch complete (77499 records). [2025-10-22T21:15:46.124592] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-22T21:15:46.512783] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-22T21:15:46.512862] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-22T21:15:46.513986] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-22T21:15:46.514049] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-22T21:15:46.515392] [DEBUG] [LOCAL ] SRE: Trimmed 77499 records to 53408 (keeping 200 days of data) [2025-10-22T21:15:46.568134] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-22T21:15:46.834008] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T21:15:46.859227] [DEBUG] [LOCAL ] SRE: Primary data saved (53408 records). [2025-10-22T21:15:46.859311] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-22T21:15:46.859970] [INFO ] [MAIN ] Update Progress: 1986/2367 symbols completed. SRE took 31.2s. Estimated remaining: 49m 3s. Rate: 7.8 symbols/min [2025-10-22T21:15:47.024077] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:15:47.048592] [DEBUG] [LOCAL ] SRI: Loaded 26340 existing records from primary storage. [2025-10-22T21:15:47.048865] [INFO ] [MAIN ] SRI: Loaded 26340 existing records. [2025-10-22T21:15:47.225479] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:15:47.225896] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-22T21:15:47.225953] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-22T21:15:47.226275] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-22T21:15:47.226330] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-22T21:15:47.323570] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-22T21:15:47.566824] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:15:48.117725] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-22T21:15:48.539052] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-22T21:15:48.917706] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-22T21:15:49.236875] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T21:15:49.273878] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-22T21:15:49.717669] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-22T21:15:50.042684] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T21:15:50.517683] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-22T21:15:50.781590] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-22T21:15:51.317733] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-22T21:15:52.117736] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-22T21:15:52.658399] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-22T21:15:52.917740] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-22T21:15:53.046393] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-22T21:15:53.624338] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T21:15:53.717614] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-22T21:15:53.756569] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T21:15:54.517670] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-22T21:15:55.293015] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T21:15:55.321037] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-22T21:15:55.322393] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-22T21:15:55.324290] [INFO ] [REMOTE ] SREA: Full fetch complete (14821 records). [2025-10-22T21:15:55.324361] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-22T21:15:55.684095] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-22T21:15:55.684169] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-22T21:15:55.684444] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-22T21:15:55.684483] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-22T21:15:55.684983] [DEBUG] [LOCAL ] SREA: Trimmed 14821 records to 9661 (keeping 200 days of data) [2025-10-22T21:15:55.742113] [DEBUG] [LOCAL ] SREA: Primary data saved (9661 records). [2025-10-22T21:15:55.742232] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-22T21:15:55.742307] [INFO ] [MAIN ] Update Progress: 1987/2367 symbols completed. SREA took 33.9s. Estimated remaining: 48m 56s. Rate: 7.8 symbols/min [2025-10-22T21:15:55.905258] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:15:55.905404] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-22T21:15:55.905446] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-22T21:15:55.905554] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-22T21:15:55.905612] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-22T21:15:55.905685] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-22T21:15:55.905736] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-22T21:15:56.127061] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-22T21:15:56.258056] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:15:56.477959] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T21:15:56.917719] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-22T21:15:57.586729] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-22T21:15:57.717676] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-22T21:15:57.926710] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-22T21:15:58.517692] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-22T21:15:59.317701] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-22T21:15:59.561912] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T21:16:00.022293] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-22T21:16:00.092102] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-22T21:16:00.117616] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-22T21:16:00.917687] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-22T21:16:01.717718] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-22T21:16:02.114514] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-22T21:16:02.517714] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-22T21:16:03.317698] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-22T21:16:04.071964] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-22T21:16:04.117711] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-22T21:16:04.670441] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T21:16:04.723637] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (3.81 seconds). [2025-10-22T21:16:04.732189] [INFO ] [REMOTE ] SRFM: Full fetch complete (51198 records). [2025-10-22T21:16:04.732310] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-22T21:16:04.923235] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-22T21:16:04.977168] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-22T21:16:05.089255] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-22T21:16:05.167633] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-22T21:16:05.167734] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-22T21:16:05.168686] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-22T21:16:05.168747] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-22T21:16:05.169775] [DEBUG] [LOCAL ] SRFM: Trimmed 51198 records to 40036 (keeping 200 days of data) [2025-10-22T21:16:05.393161] [DEBUG] [LOCAL ] SRFM: Primary data saved (40036 records). [2025-10-22T21:16:05.393267] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-22T21:16:05.393341] [INFO ] [MAIN ] Update Progress: 1988/2367 symbols completed. SRFM took 34.1s. Estimated remaining: 48m 48s. Rate: 7.8 symbols/min [2025-10-22T21:16:05.561198] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:16:05.569258] [DEBUG] [LOCAL ] SRV: Loaded 7446 existing records from primary storage. [2025-10-22T21:16:05.569429] [INFO ] [MAIN ] SRV: Loaded 7446 existing records. [2025-10-22T21:16:05.722860] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-22T21:16:05.751527] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:16:05.751715] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-22T21:16:05.751772] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-22T21:16:05.751978] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-22T21:16:05.752034] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-22T21:16:06.112437] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:16:06.391766] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T21:16:06.495755] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-22T21:16:06.517633] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-22T21:16:07.317758] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-22T21:16:07.632862] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T21:16:07.635203] [INFO ] [REMOTE ] SRG: Full fetch complete (23150 records). [2025-10-22T21:16:07.635378] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-22T21:16:07.998461] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-22T21:16:07.998535] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-22T21:16:07.998993] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-22T21:16:07.999053] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-22T21:16:07.999596] [DEBUG] [LOCAL ] SRG: Trimmed 23150 records to 14642 (keeping 200 days of data) [2025-10-22T21:16:08.078198] [DEBUG] [LOCAL ] SRG: Primary data saved (14642 records). [2025-10-22T21:16:08.078318] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-22T21:16:08.078395] [INFO ] [MAIN ] Update Progress: 1989/2367 symbols completed. SRG took 25.4s. Estimated remaining: 48m 40s. Rate: 7.8 symbols/min [2025-10-22T21:16:08.122867] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-22T21:16:08.250415] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:16:08.286711] [DEBUG] [LOCAL ] SSB: Loaded 42721 existing records from primary storage. [2025-10-22T21:16:08.286985] [INFO ] [MAIN ] SSB: Loaded 42721 existing records. [2025-10-22T21:16:08.398971] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T21:16:08.478968] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:16:08.479170] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-22T21:16:08.479229] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-22T21:16:08.479620] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-10-22T21:16:08.479704] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-22T21:16:08.833342] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:16:08.882766] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T21:16:08.917618] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-22T21:16:09.717631] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-22T21:16:10.517624] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-22T21:16:10.575686] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T21:16:10.869343] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T21:16:10.953224] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-22T21:16:11.317714] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-22T21:16:12.117706] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-22T21:16:12.724484] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T21:16:12.867187] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T21:16:12.917619] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-22T21:16:13.717689] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-22T21:16:14.517703] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-22T21:16:14.709332] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-22T21:16:14.791262] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T21:16:14.991051] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-22T21:16:15.317741] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-22T21:16:16.117721] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-22T21:16:16.245825] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-22T21:16:16.917720] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-22T21:16:17.451496] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-22T21:16:17.717716] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-22T21:16:17.765779] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T21:16:18.517716] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-22T21:16:18.646902] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T21:16:19.317775] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-22T21:16:19.838505] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T21:16:20.117703] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-22T21:16:20.235508] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-22T21:16:20.917702] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-22T21:16:21.723929] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-22T21:16:21.726264] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T21:16:21.835599] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-22T21:16:22.517708] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-22T21:16:23.317683] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-22T21:16:23.491409] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T21:16:23.542542] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T21:16:24.117705] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-22T21:16:24.625190] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T21:16:24.628825] [INFO ] [REMOTE ] SRI: Full fetch complete (39665 records). [2025-10-22T21:16:24.628898] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-22T21:16:24.922821] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-22T21:16:24.967248] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-22T21:16:25.035442] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-22T21:16:25.035521] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-22T21:16:25.036350] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-22T21:16:25.036431] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-22T21:16:25.037252] [DEBUG] [LOCAL ] SRI: Trimmed 39665 records to 26227 (keeping 200 days of data) [2025-10-22T21:16:25.179193] [DEBUG] [LOCAL ] SRI: Primary data saved (26227 records). [2025-10-22T21:16:25.179364] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-22T21:16:25.179450] [INFO ] [MAIN ] Update Progress: 1990/2367 symbols completed. SRI took 38.3s. Estimated remaining: 48m 34s. Rate: 7.8 symbols/min [2025-10-22T21:16:25.345976] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:16:25.368553] [DEBUG] [LOCAL ] SSD: Loaded 22487 existing records from primary storage. [2025-10-22T21:16:25.368817] [INFO ] [MAIN ] SSD: Loaded 22487 existing records. [2025-10-22T21:16:25.543596] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:16:25.543868] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-22T21:16:25.543926] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-22T21:16:25.544107] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-10-22T21:16:25.544162] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-22T21:16:25.727947] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-22T21:16:25.891753] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:16:26.382361] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-22T21:16:26.383256] [INFO ] [REMOTE ] SRL: Full fetch complete (1659 records). [2025-10-22T21:16:26.383327] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-22T21:16:26.530707] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-22T21:16:26.571317] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-22T21:16:26.571465] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:16:26.571537] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:16:26.571607] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-22T21:16:26.571695] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-22T21:16:26.571745] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-22T21:16:26.571788] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-22T21:16:26.571840] [INFO ] [MAIN ] Update Progress: 1991/2367 symbols completed. SRL took 30.8s. Estimated remaining: 48m 25s. Rate: 7.8 symbols/min [2025-10-22T21:16:26.740062] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:16:26.779714] [DEBUG] [LOCAL ] SSL: Loaded 41459 existing records from primary storage. [2025-10-22T21:16:26.780031] [INFO ] [MAIN ] SSL: Loaded 41459 existing records. [2025-10-22T21:16:26.984162] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:16:26.984373] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-22T21:16:26.984448] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-22T21:16:26.985049] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-22T21:16:26.986174] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-22T21:16:26.986220] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-22T21:16:27.323368] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-22T21:16:27.353685] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:16:28.001749] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T21:16:28.117683] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-22T21:16:28.917674] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-22T21:16:29.151415] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-22T21:16:29.461597] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T21:16:29.519400] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T21:16:29.521139] [INFO ] [REMOTE ] SRV: Full fetch complete (11270 records). [2025-10-22T21:16:29.521209] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-22T21:16:29.722798] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-22T21:16:29.884724] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-22T21:16:29.884807] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-22T21:16:29.885095] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-22T21:16:29.885136] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-22T21:16:29.885585] [DEBUG] [LOCAL ] SRV: Trimmed 11270 records to 7379 (keeping 200 days of data) [2025-10-22T21:16:29.930683] [DEBUG] [LOCAL ] SRV: Primary data saved (7379 records). [2025-10-22T21:16:29.930821] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-22T21:16:29.930905] [INFO ] [MAIN ] Update Progress: 1992/2367 symbols completed. SRV took 24.5s. Estimated remaining: 48m 16s. Rate: 7.8 symbols/min [2025-10-22T21:16:30.104497] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:16:30.116861] [DEBUG] [LOCAL ] SST: Loaded 11434 existing records from primary storage. [2025-10-22T21:16:30.117069] [INFO ] [MAIN ] SST: Loaded 11434 existing records. [2025-10-22T21:16:30.294698] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:16:30.294934] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-22T21:16:30.294983] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-22T21:16:30.295136] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-22T21:16:30.295174] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-22T21:16:30.524366] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-22T21:16:30.650950] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:16:31.317767] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-22T21:16:31.578715] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T21:16:31.950475] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T21:16:32.117636] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-22T21:16:32.294840] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T21:16:32.917703] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-22T21:16:33.717701] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-22T21:16:33.846186] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-22T21:16:34.008842] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T21:16:34.517710] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-22T21:16:35.210041] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T21:16:35.317707] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-22T21:16:36.117623] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-22T21:16:36.261638] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T21:16:36.618809] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-22T21:16:36.917638] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-22T21:16:37.717738] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-22T21:16:38.517635] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-22T21:16:38.636802] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-22T21:16:38.761260] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T21:16:39.140514] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-22T21:16:39.317709] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-22T21:16:40.117705] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-22T21:16:40.151627] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-22T21:16:40.313561] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T21:16:40.917668] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-22T21:16:41.717676] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-22T21:16:41.783972] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T21:16:41.790932] [INFO ] [REMOTE ] SSB: Full fetch complete (61535 records). [2025-10-22T21:16:41.791032] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-22T21:16:42.166135] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-22T21:16:42.166229] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-22T21:16:42.167248] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-22T21:16:42.167312] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-22T21:16:42.168545] [DEBUG] [LOCAL ] SSB: Trimmed 61535 records to 42715 (keeping 200 days of data) [2025-10-22T21:16:42.437672] [DEBUG] [LOCAL ] SSB: Primary data saved (42715 records). [2025-10-22T21:16:42.437809] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-22T21:16:42.437889] [INFO ] [MAIN ] Update Progress: 1993/2367 symbols completed. SSB took 34.4s. Estimated remaining: 48m 10s. Rate: 7.8 symbols/min [2025-10-22T21:16:42.522727] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-22T21:16:42.619581] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:16:42.640779] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-22T21:16:42.651717] [DEBUG] [LOCAL ] SSTK: Loaded 25352 existing records from primary storage. [2025-10-22T21:16:42.651945] [INFO ] [MAIN ] SSTK: Loaded 25352 existing records. [2025-10-22T21:16:42.830679] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:16:42.830990] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-22T21:16:42.831142] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-22T21:16:42.831449] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-10-22T21:16:42.831564] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-22T21:16:43.003357] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-22T21:16:43.225981] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:16:43.317614] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-22T21:16:44.117705] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-22T21:16:44.489715] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-22T21:16:44.917709] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-22T21:16:45.466330] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-22T21:16:45.717695] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-22T21:16:46.222715] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-22T21:16:46.517705] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-22T21:16:46.640849] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T21:16:46.866475] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T21:16:47.317691] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-22T21:16:47.964338] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T21:16:48.117727] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-22T21:16:48.928667] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-10-22T21:16:48.931241] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T21:16:49.380143] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-22T21:16:49.717730] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-22T21:16:50.064153] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-22T21:16:50.517673] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-10-22T21:16:51.275171] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T21:16:51.317689] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-10-22T21:16:51.769009] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T21:16:52.117702] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-22T21:16:52.208779] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T21:16:52.917664] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-22T21:16:53.352668] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-22T21:16:53.717715] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-22T21:16:54.517707] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-10-22T21:16:54.573240] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T21:16:55.317727] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-22T21:16:55.544360] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-22T21:16:55.756965] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-22T21:16:56.117747] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-22T21:16:56.917764] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-10. [2025-10-22T21:16:57.207926] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T21:16:57.554571] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T21:16:57.717710] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-10. [2025-10-22T21:16:57.964269] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T21:16:57.968119] [INFO ] [REMOTE ] SSD: Full fetch complete (32509 records). [2025-10-22T21:16:57.968214] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-22T21:16:58.265230] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-22T21:16:58.306616] [INFO ] [REMOTE ] SST: Full fetch complete (17977 records). [2025-10-22T21:16:58.325728] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-22T21:16:58.417241] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-10-22T21:16:58.428499] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-10-22T21:16:58.434435] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-10-22T21:16:58.458891] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-10-22T21:16:58.506215] [DEBUG] [LOCAL ] SSD: Trimmed 32509 records to 22377 (keeping 200 days of data) [2025-10-22T21:16:58.520740] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-22T21:16:58.868570] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-22T21:16:58.870885] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-22T21:16:58.872269] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-22T21:16:58.872347] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-22T21:16:58.884036] [DEBUG] [LOCAL ] SST: Trimmed 17977 records to 11382 (keeping 200 days of data) [2025-10-22T21:16:58.960617] [DEBUG] [LOCAL ] SSD: Primary data saved (22377 records). [2025-10-22T21:16:58.965880] [INFO ] [MAIN ] SSD: Full history saved. [2025-10-22T21:16:58.966021] [INFO ] [MAIN ] Update Progress: 1994/2367 symbols completed. SSD took 33.8s. Estimated remaining: 48m 3s. Rate: 7.8 symbols/min [2025-10-22T21:16:59.141347] [DEBUG] [LOCAL ] SST: Primary data saved (11382 records). [2025-10-22T21:16:59.166567] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:16:59.166747] [INFO ] [MAIN ] SST: Full history saved. [2025-10-22T21:16:59.167468] [INFO ] [MAIN ] Update Progress: 1995/2367 symbols completed. SST took 29.2s. Estimated remaining: 47m 54s. Rate: 7.8 symbols/min [2025-10-22T21:16:59.323848] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-22T21:16:59.352146] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:16:59.398224] [DEBUG] [LOCAL ] ST: Loaded 49719 existing records from primary storage. [2025-10-22T21:16:59.398834] [INFO ] [MAIN ] ST: Loaded 49719 existing records. [2025-10-22T21:16:59.604149] [DEBUG] [LOCAL ] STAG: Loaded 50089 existing records from primary storage. [2025-10-22T21:16:59.605980] [INFO ] [MAIN ] STAG: Loaded 50089 existing records. [2025-10-22T21:16:59.627035] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:16:59.648244] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-22T21:16:59.682284] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-22T21:16:59.691096] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-10-22T21:16:59.696355] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-22T21:16:59.914195] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:16:59.925529] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-22T21:16:59.926682] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-22T21:16:59.954002] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-10-22T21:16:59.959296] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-22T21:17:00.010133] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T21:17:00.135600] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-22T21:17:00.491044] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:17:00.622679] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:17:00.917737] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-22T21:17:01.399191] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-22T21:17:01.717717] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-22T21:17:01.774282] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T21:17:02.517746] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-22T21:17:02.975233] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-22T21:17:03.215483] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T21:17:03.317626] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-22T21:17:04.117627] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-22T21:17:04.505240] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-22T21:17:04.917694] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-22T21:17:05.103218] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T21:17:05.110467] [INFO ] [REMOTE ] SSL: Full fetch complete (60085 records). [2025-10-22T21:17:05.110608] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-22T21:17:05.512820] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-22T21:17:05.513043] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-22T21:17:05.514178] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-22T21:17:05.514318] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-22T21:17:05.515797] [DEBUG] [LOCAL ] SSL: Trimmed 60085 records to 41386 (keeping 200 days of data) [2025-10-22T21:17:05.717240] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T21:17:05.753029] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-22T21:17:05.807857] [DEBUG] [LOCAL ] SSL: Primary data saved (41386 records). [2025-10-22T21:17:05.807999] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-22T21:17:05.808083] [INFO ] [MAIN ] Update Progress: 1996/2367 symbols completed. SSL took 39.2s. Estimated remaining: 47m 46s. Rate: 7.8 symbols/min [2025-10-22T21:17:05.978525] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:17:05.993197] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T21:17:05.998664] [INFO ] [REMOTE ] SSTK: Full fetch complete (41743 records). [2025-10-22T21:17:05.998833] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-22T21:17:06.127670] [DEBUG] [LOCAL ] STC: Loaded 17388 existing records from primary storage. [2025-10-22T21:17:06.155235] [INFO ] [MAIN ] STC: Loaded 17388 existing records. [2025-10-22T21:17:06.508398] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:17:06.518904] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-22T21:17:06.519079] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-22T21:17:06.537926] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-22T21:17:06.575181] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-10-22T21:17:06.576480] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-22T21:17:06.643329] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-22T21:17:06.677059] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-22T21:17:06.699488] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-22T21:17:06.702285] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-22T21:17:06.764801] [DEBUG] [LOCAL ] SSTK: Trimmed 41743 records to 25244 (keeping 200 days of data) [2025-10-22T21:17:07.119320] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:17:07.135492] [DEBUG] [LOCAL ] SSTK: Primary data saved (25244 records). [2025-10-22T21:17:07.135576] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-22T21:17:07.135710] [INFO ] [MAIN ] Update Progress: 1997/2367 symbols completed. SSTK took 24.7s. Estimated remaining: 47m 37s. Rate: 7.8 symbols/min [2025-10-22T21:17:07.317735] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-22T21:17:07.595763] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T21:17:08.117745] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-22T21:17:08.557403] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T21:17:08.588291] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-22T21:17:08.917697] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-22T21:17:09.717622] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-22T21:17:09.923286] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T21:17:10.517627] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-22T21:17:10.877559] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T21:17:10.967936] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T21:17:11.317670] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-22T21:17:12.117725] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-22T21:17:14.033119] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (3.52 seconds). [2025-10-22T21:17:14.045025] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-22T21:17:14.092538] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-22T21:17:14.103982] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-22T21:17:14.302978] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-22T21:17:14.517735] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-22T21:17:15.839551] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T21:17:15.843786] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-22T21:17:16.489794] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-22T21:17:16.501567] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-22T21:17:16.771291] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-10-22T21:17:16.917639] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-22T21:17:17.886570] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-22T21:17:17.891013] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-22T21:17:19.492926] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-22T21:17:19.503687] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-22T21:17:19.536188] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (3.03 seconds). [2025-10-22T21:17:19.547619] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-22T21:17:19.781553] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-22T21:17:20.117688] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-22T21:17:21.520620] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T21:17:21.525786] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-22T21:17:21.974701] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-22T21:17:21.986197] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-22T21:17:22.068913] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-22T21:17:22.517756] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-22T21:17:22.718107] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T21:17:23.317751] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-22T21:17:23.927995] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T21:17:23.992155] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T21:17:24.117689] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-22T21:17:24.118098] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T21:17:24.917698] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-22T21:17:25.717726] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-22T21:17:25.939279] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T21:17:25.942334] [INFO ] [REMOTE ] STC: Full fetch complete (25645 records). [2025-10-22T21:17:25.942407] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-22T21:17:26.316253] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-22T21:17:26.316433] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-22T21:17:26.317234] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-22T21:17:26.317339] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-22T21:17:26.318450] [DEBUG] [LOCAL ] STC: Trimmed 25645 records to 17391 (keeping 200 days of data) [2025-10-22T21:17:26.427243] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-22T21:17:26.462810] [DEBUG] [LOCAL ] STC: Primary data saved (17391 records). [2025-10-22T21:17:26.462930] [INFO ] [MAIN ] STC: Full history saved. [2025-10-22T21:17:26.463005] [INFO ] [MAIN ] Update Progress: 1998/2367 symbols completed. STC took 20.7s. Estimated remaining: 47m 32s. Rate: 7.8 symbols/min [2025-10-22T21:17:26.517626] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-22T21:17:27.573050] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T21:17:27.581160] [INFO ] [REMOTE ] ST: Full fetch complete (72139 records). [2025-10-22T21:17:27.581277] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-22T21:17:27.970605] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-22T21:17:27.970718] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-22T21:17:27.971820] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-22T21:17:27.971883] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-22T21:17:27.973313] [DEBUG] [LOCAL ] ST: Trimmed 72139 records to 49668 (keeping 200 days of data) [2025-10-22T21:17:28.286176] [DEBUG] [LOCAL ] ST: Primary data saved (49668 records). [2025-10-22T21:17:28.286317] [INFO ] [MAIN ] ST: Full history saved. [2025-10-22T21:17:28.286966] [INFO ] [MAIN ] Update Progress: 1999/2367 symbols completed. ST took 29.3s. Estimated remaining: 47m 23s. Rate: 7.8 symbols/min [2025-10-22T21:17:28.404078] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-22T21:17:28.412772] [INFO ] [REMOTE ] STAG: Full fetch complete (72542 records). [2025-10-22T21:17:28.412954] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-22T21:17:28.823717] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-22T21:17:28.823898] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-22T21:17:28.825117] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-22T21:17:28.825190] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-22T21:17:28.826627] [DEBUG] [LOCAL ] STAG: Trimmed 72542 records to 50046 (keeping 200 days of data) [2025-10-22T21:17:29.138020] [DEBUG] [LOCAL ] STAG: Primary data saved (50046 records). [2025-10-22T21:17:29.138178] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-22T21:17:29.138261] [INFO ] [MAIN ] Update Progress: 2000/2367 symbols completed. STAG took 30.0s. Estimated remaining: 47m 14s. Rate: 7.8 symbols/min [2025-10-22T21:17:29.745955] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:17:29.850578] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:17:29.877389] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:17:29.878574] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:17:29.901685] [DEBUG] [LOCAL ] STEL: Loaded 22486 existing records from primary storage. [2025-10-22T21:17:29.902183] [INFO ] [MAIN ] STEL: Loaded 22486 existing records. [2025-10-22T21:17:29.918629] [DEBUG] [LOCAL ] STEW: Loaded 15274 existing records from primary storage. [2025-10-22T21:17:29.953725] [INFO ] [MAIN ] STEW: Loaded 15274 existing records. [2025-10-22T21:17:30.146629] [DEBUG] [LOCAL ] STEM: Loaded 38495 existing records from primary storage. [2025-10-22T21:17:30.221960] [INFO ] [MAIN ] STEM: Loaded 38495 existing records. [2025-10-22T21:17:30.240137] [DEBUG] [LOCAL ] STE: Loaded 35240 existing records from primary storage. [2025-10-22T21:17:30.326268] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:17:30.337331] [INFO ] [MAIN ] STE: Loaded 35240 existing records. [2025-10-22T21:17:30.337219] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:17:30.353282] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-22T21:17:30.358535] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-22T21:17:30.348053] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-22T21:17:30.385705] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-22T21:17:30.390901] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-22T21:17:30.409697] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-22T21:17:30.418576] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-10-22T21:17:30.429373] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-22T21:17:30.973530] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:17:31.033795] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-22T21:17:31.048769] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:17:31.048896] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-22T21:17:31.098600] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-22T21:17:31.132995] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-22T21:17:31.161541] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-22T21:17:31.213604] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-10-22T21:17:31.218938] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-22T21:17:31.224235] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-22T21:17:31.610247] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:17:31.697846] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-22T21:17:31.765753] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:17:31.786841] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-22T21:17:32.102023] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:17:32.112745] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-22T21:17:32.177051] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:17:32.177421] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-22T21:17:32.922776] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T21:17:32.926000] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-22T21:17:33.042242] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-22T21:17:33.046091] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-22T21:17:33.894112] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T21:17:33.901554] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-22T21:17:33.913560] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-22T21:17:33.916637] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-22T21:17:34.153037] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T21:17:34.157321] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-22T21:17:34.731254] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-10-22T21:17:34.741504] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-22T21:17:34.980201] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-22T21:17:35.213879] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-22T21:17:35.254594] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T21:17:35.317621] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-22T21:17:36.117695] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-22T21:17:36.602219] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T21:17:36.917720] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-22T21:17:37.047886] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T21:17:37.694392] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T21:17:37.717698] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-22T21:17:38.065316] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T21:17:38.517712] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-22T21:17:39.317700] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-22T21:17:39.668846] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T21:17:39.831586] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T21:17:40.117707] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-22T21:17:40.576405] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-22T21:17:40.917675] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-22T21:17:41.717701] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-22T21:17:41.846457] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T21:17:42.517717] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-22T21:17:42.629504] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T21:17:43.025925] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-22T21:17:43.317678] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-22T21:17:43.904566] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T21:17:44.117699] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-22T21:17:44.917715] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-22T21:17:45.403894] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-22T21:17:45.477807] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T21:17:45.717716] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-22T21:17:46.167747] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T21:17:46.517672] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-22T21:17:46.747768] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T21:17:47.317688] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-22T21:17:47.347723] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T21:17:48.117710] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-22T21:17:48.854404] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T21:17:48.917682] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-22T21:17:48.980719] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T21:17:49.675330] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-22T21:17:49.717729] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-22T21:17:50.517726] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-22T21:17:51.324948] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-22T21:17:51.329968] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T21:17:51.372854] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-22T21:17:51.379344] [INFO ] [REMOTE ] STE: Full fetch complete (50723 records). [2025-10-22T21:17:51.379536] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-22T21:17:51.380426] [FATAL] [VALIDATOR ] STE: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T21:17:51.380521] [FATAL] [MAIN ] STE: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:17:51.380565] [WARN ] [MAIN ] STE: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:17:51.380608] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-22T21:17:51.380706] [DEBUG] [LOCAL ] STE: No primary data file found to delete. [2025-10-22T21:17:51.380763] [INFO ] [LOCAL ] STE: Starting deletion of derivative data. [2025-10-22T21:17:51.380935] [DEBUG] [LOCAL ] STE: Deleted derivative data file. [2025-10-22T21:17:51.381034] [INFO ] [MAIN ] Update Progress: 2001/2367 symbols completed. STE took 22.2s. Estimated remaining: 47m 9s. Rate: 7.8 symbols/min [2025-10-22T21:17:51.566400] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:17:51.566676] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-22T21:17:51.566733] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-22T21:17:51.566855] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-22T21:17:51.566896] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-22T21:17:51.566937] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-22T21:17:51.567000] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-22T21:17:51.933289] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:17:52.117682] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-22T21:17:52.356046] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T21:17:52.917695] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-22T21:17:53.717724] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-22T21:17:53.845810] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T21:17:53.848791] [INFO ] [REMOTE ] STEW: Full fetch complete (21749 records). [2025-10-22T21:17:53.848911] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-22T21:17:54.247736] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-22T21:17:54.247864] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-22T21:17:54.248640] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-22T21:17:54.248748] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-22T21:17:54.273930] [DEBUG] [LOCAL ] STEW: Trimmed 21749 records to 15067 (keeping 200 days of data) [2025-10-22T21:17:54.276168] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-22T21:17:54.384032] [DEBUG] [LOCAL ] STEW: Primary data saved (15067 records). [2025-10-22T21:17:54.384261] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-22T21:17:54.384381] [INFO ] [MAIN ] Update Progress: 2002/2367 symbols completed. STEW took 25.2s. Estimated remaining: 47m 0s. Rate: 7.8 symbols/min [2025-10-22T21:17:54.531976] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-22T21:17:54.567751] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:17:54.581109] [DEBUG] [LOCAL ] STK: Loaded 9780 existing records from primary storage. [2025-10-22T21:17:54.581417] [INFO ] [MAIN ] STK: Loaded 9780 existing records. [2025-10-22T21:17:54.774852] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:17:54.775135] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-22T21:17:54.775187] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-22T21:17:54.775361] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-22T21:17:54.775401] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-22T21:17:55.161143] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:17:55.163193] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T21:17:55.317751] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-22T21:17:55.910872] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-22T21:17:56.117687] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-22T21:17:56.266073] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T21:17:56.630434] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-22T21:17:56.917749] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-22T21:17:57.717718] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-22T21:17:57.849824] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-22T21:17:58.117308] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-22T21:17:58.517691] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-22T21:17:59.046248] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-22T21:17:59.317739] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-22T21:18:00.117725] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-22T21:18:00.275613] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-22T21:18:00.917737] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-22T21:18:01.417289] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T21:18:01.717727] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-22T21:18:01.740776] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T21:18:02.517714] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-22T21:18:03.317683] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-22T21:18:03.387696] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-22T21:18:03.406243] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-22T21:18:04.117632] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-22T21:18:04.514931] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T21:18:04.519065] [INFO ] [REMOTE ] STEL: Full fetch complete (32333 records). [2025-10-22T21:18:04.519181] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-22T21:18:04.901715] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-22T21:18:04.901813] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-22T21:18:04.902590] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-22T21:18:04.902633] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-22T21:18:04.903567] [DEBUG] [LOCAL ] STEL: Trimmed 32333 records to 22328 (keeping 200 days of data) [2025-10-22T21:18:04.956737] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-22T21:18:05.054425] [DEBUG] [LOCAL ] STEL: Primary data saved (22328 records). [2025-10-22T21:18:05.054562] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-22T21:18:05.054673] [INFO ] [MAIN ] Update Progress: 2003/2367 symbols completed. STEL took 35.9s. Estimated remaining: 46m 53s. Rate: 7.8 symbols/min [2025-10-22T21:18:05.220882] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:18:05.269567] [DEBUG] [LOCAL ] STLA: Loaded 53557 existing records from primary storage. [2025-10-22T21:18:05.269917] [INFO ] [MAIN ] STLA: Loaded 53557 existing records. [2025-10-22T21:18:05.443740] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:18:05.443947] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-22T21:18:05.443995] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-22T21:18:05.444189] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-10-22T21:18:05.444227] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-22T21:18:05.721818] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-22T21:18:05.803783] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:18:05.876726] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T21:18:05.989262] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T21:18:06.256092] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-22T21:18:06.517732] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-22T21:18:07.317726] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-22T21:18:08.117730] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-22T21:18:08.242939] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T21:18:08.349328] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T21:18:08.356506] [INFO ] [REMOTE ] STEM: Full fetch complete (60789 records). [2025-10-22T21:18:08.356712] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-22T21:18:08.780424] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-22T21:18:08.780541] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-22T21:18:08.782178] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-22T21:18:08.782249] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-22T21:18:08.783948] [DEBUG] [LOCAL ] STEM: Trimmed 60789 records to 38406 (keeping 200 days of data) [2025-10-22T21:18:08.917715] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-22T21:18:09.037705] [DEBUG] [LOCAL ] STEM: Primary data saved (38406 records). [2025-10-22T21:18:09.037921] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-22T21:18:09.038848] [INFO ] [MAIN ] Update Progress: 2004/2367 symbols completed. STEM took 39.9s. Estimated remaining: 46m 45s. Rate: 7.8 symbols/min [2025-10-22T21:18:09.224069] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:18:09.280556] [DEBUG] [LOCAL ] STM: Loaded 53573 existing records from primary storage. [2025-10-22T21:18:09.280997] [INFO ] [MAIN ] STM: Loaded 53573 existing records. [2025-10-22T21:18:09.468225] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:18:09.468549] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-22T21:18:09.468598] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-22T21:18:09.469022] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-10-22T21:18:09.469080] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-22T21:18:09.732842] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-22T21:18:09.850303] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:18:09.959880] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T21:18:10.213740] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-22T21:18:10.313565] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-22T21:18:10.517769] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-22T21:18:11.317706] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-22T21:18:11.449434] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-22T21:18:12.117679] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-22T21:18:12.168025] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-22T21:18:12.917728] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-22T21:18:13.092267] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-22T21:18:13.480592] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T21:18:13.717678] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-22T21:18:14.517711] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-22T21:18:15.317739] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-22T21:18:16.008621] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-22T21:18:16.117705] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-22T21:18:16.290048] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-22T21:18:16.294222] [INFO ] [REMOTE ] STK: Full fetch complete (14357 records). [2025-10-22T21:18:16.294412] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-22T21:18:16.606315] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-22T21:18:16.694708] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-22T21:18:16.694833] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-22T21:18:16.695307] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-22T21:18:16.695411] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-22T21:18:16.696167] [DEBUG] [LOCAL ] STK: Trimmed 14357 records to 9700 (keeping 200 days of data) [2025-10-22T21:18:16.755118] [DEBUG] [LOCAL ] STK: Primary data saved (9700 records). [2025-10-22T21:18:16.755319] [INFO ] [MAIN ] STK: Full history saved. [2025-10-22T21:18:16.755409] [INFO ] [MAIN ] Update Progress: 2005/2367 symbols completed. STK took 22.4s. Estimated remaining: 46m 37s. Rate: 7.8 symbols/min [2025-10-22T21:18:16.932850] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:18:16.929899] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-22T21:18:16.954691] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-22T21:18:16.983748] [DEBUG] [LOCAL ] STN: Loaded 22707 existing records from primary storage. [2025-10-22T21:18:16.983987] [INFO ] [MAIN ] STN: Loaded 22707 existing records. [2025-10-22T21:18:17.157247] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:18:17.157446] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-22T21:18:17.157493] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-22T21:18:17.157731] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-22T21:18:17.157786] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-22T21:18:17.504379] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:18:17.504532] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-22T21:18:17.505803] [INFO ] [REMOTE ] STG: Full fetch complete (2481 records). [2025-10-22T21:18:17.505901] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-22T21:18:17.693727] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-22T21:18:17.693942] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:18:17.694011] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:18:17.694081] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-22T21:18:17.694144] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-22T21:18:17.694179] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-22T21:18:17.694218] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-22T21:18:17.694270] [INFO ] [MAIN ] Update Progress: 2006/2367 symbols completed. STG took 26.3s. Estimated remaining: 46m 28s. Rate: 7.8 symbols/min [2025-10-22T21:18:17.722780] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-22T21:18:17.876471] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:18:17.916000] [DEBUG] [LOCAL ] STNG: Loaded 43434 existing records from primary storage. [2025-10-22T21:18:17.916332] [INFO ] [MAIN ] STNG: Loaded 43434 existing records. [2025-10-22T21:18:18.104996] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:18:18.105248] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-22T21:18:18.105318] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-22T21:18:18.105772] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-22T21:18:18.105829] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-22T21:18:18.483865] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:18:18.517671] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-22T21:18:19.317735] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-22T21:18:19.929210] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-22T21:18:20.117619] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-22T21:18:20.382379] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T21:18:20.889384] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T21:18:20.917724] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-22T21:18:21.717729] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-22T21:18:22.310244] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T21:18:22.432079] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-22T21:18:22.517676] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-22T21:18:23.317705] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-22T21:18:23.610686] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T21:18:24.117722] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-22T21:18:24.638737] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-22T21:18:24.714841] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T21:18:24.917669] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-22T21:18:25.634290] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T21:18:25.717624] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-22T21:18:26.517694] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-22T21:18:27.233594] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-22T21:18:27.317677] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-22T21:18:27.571096] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T21:18:28.117688] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-22T21:18:28.917714] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-22T21:18:29.026670] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-22T21:18:29.111484] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T21:18:29.452769] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-22T21:18:29.717690] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-22T21:18:30.324381] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T21:18:30.517741] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-22T21:18:31.105215] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T21:18:31.317705] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-22T21:18:32.117707] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-22T21:18:32.922778] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-22T21:18:32.938455] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-10-22T21:18:33.255504] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T21:18:33.326895] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T21:18:33.717674] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-22T21:18:34.517782] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-22T21:18:34.739724] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-22T21:18:35.317678] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-22T21:18:35.608073] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-22T21:18:36.117671] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-22T21:18:36.832784] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-22T21:18:36.917624] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-22T21:18:37.066989] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T21:18:37.717702] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-22T21:18:38.330512] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-22T21:18:38.517718] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-22T21:18:38.938204] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T21:18:39.149609] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-22T21:18:39.317675] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-22T21:18:40.117667] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-22T21:18:40.243143] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T21:18:40.917709] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-22T21:18:41.732753] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-22T21:18:41.736084] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-22T21:18:42.223031] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-22T21:18:42.232291] [INFO ] [REMOTE ] STM: Full fetch complete (77695 records). [2025-10-22T21:18:42.232422] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-22T21:18:42.406840] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T21:18:42.522716] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-22T21:18:42.653582] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-22T21:18:42.653699] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-22T21:18:42.654870] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-22T21:18:42.654932] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-22T21:18:42.656320] [DEBUG] [LOCAL ] STM: Trimmed 77695 records to 53573 (keeping 200 days of data) [2025-10-22T21:18:42.974486] [DEBUG] [LOCAL ] STM: Primary data saved (53573 records). [2025-10-22T21:18:42.974596] [INFO ] [MAIN ] STM: Full history saved. [2025-10-22T21:18:42.975393] [INFO ] [MAIN ] Update Progress: 2007/2367 symbols completed. STM took 33.9s. Estimated remaining: 46m 24s. Rate: 7.8 symbols/min [2025-10-22T21:18:43.143630] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:18:43.156732] [DEBUG] [LOCAL ] STRV: Loaded 10844 existing records from primary storage. [2025-10-22T21:18:43.156950] [INFO ] [MAIN ] STRV: Loaded 10844 existing records. [2025-10-22T21:18:43.338764] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:18:43.330917] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-22T21:18:43.339857] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-22T21:18:43.339927] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-22T21:18:43.340215] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-22T21:18:43.340329] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-22T21:18:43.549839] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T21:18:43.727182] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:18:44.117673] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-22T21:18:44.790005] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-22T21:18:44.814542] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T21:18:44.917609] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-22T21:18:45.717717] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-22T21:18:45.907926] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T21:18:45.914766] [INFO ] [REMOTE ] STNG: Full fetch complete (64108 records). [2025-10-22T21:18:45.914922] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-22T21:18:46.107825] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T21:18:46.188752] [INFO ] [REMOTE ] STN: Full fetch complete (32688 records). [2025-10-22T21:18:46.200031] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-22T21:18:46.491385] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-22T21:18:46.502279] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-22T21:18:46.508487] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-22T21:18:46.535172] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-22T21:18:46.524670] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-22T21:18:46.610678] [DEBUG] [LOCAL ] STNG: Trimmed 64108 records to 43272 (keeping 200 days of data) [2025-10-22T21:18:46.789322] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-22T21:18:46.792850] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-22T21:18:46.796916] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-22T21:18:46.797247] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-22T21:18:46.809716] [DEBUG] [LOCAL ] STN: Trimmed 32688 records to 22576 (keeping 200 days of data) [2025-10-22T21:18:47.100364] [DEBUG] [LOCAL ] STNG: Primary data saved (43272 records). [2025-10-22T21:18:47.105769] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-22T21:18:47.106907] [INFO ] [MAIN ] Update Progress: 2008/2367 symbols completed. STNG took 29.4s. Estimated remaining: 46m 15s. Rate: 7.8 symbols/min [2025-10-22T21:18:47.183144] [DEBUG] [LOCAL ] STN: Primary data saved (22576 records). [2025-10-22T21:18:47.194269] [INFO ] [MAIN ] STN: Full history saved. [2025-10-22T21:18:47.213262] [INFO ] [MAIN ] Update Progress: 2009/2367 symbols completed. STN took 30.5s. Estimated remaining: 46m 6s. Rate: 7.8 symbols/min [2025-10-22T21:18:47.403573] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:18:47.467318] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:18:47.467757] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-22T21:18:47.467809] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-22T21:18:47.467931] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-22T21:18:47.467988] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-22T21:18:47.468083] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-22T21:18:47.468122] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-22T21:18:47.729558] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T21:18:47.766870] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-22T21:18:47.857345] [DEBUG] [LOCAL ] STT: Loaded 51089 existing records from primary storage. [2025-10-22T21:18:47.878405] [INFO ] [MAIN ] STT: Loaded 51089 existing records. [2025-10-22T21:18:47.903086] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:18:48.090579] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:18:48.090914] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-22T21:18:48.091069] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-22T21:18:48.091409] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-10-22T21:18:48.091473] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-22T21:18:48.122735] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-01. [2025-10-22T21:18:48.243331] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-22T21:18:48.492873] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:18:48.529621] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:18:48.530076] [WARN ] [REMOTE ] STUB: No data returned for month 2025-01 [2025-10-22T21:18:48.530179] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:18:48.530230] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-22T21:18:48.530266] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:18:48.530308] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-22T21:18:48.530372] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-22T21:18:48.530413] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-22T21:18:48.531055] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-22T21:18:48.531132] [INFO ] [MAIN ] Update Progress: 2010/2367 symbols completed. STUB took 1.3s. Estimated remaining: 45m 57s. Rate: 7.8 symbols/min [2025-10-22T21:18:48.704565] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:18:48.730359] [DEBUG] [LOCAL ] STVN: Loaded 26735 existing records from primary storage. [2025-10-22T21:18:48.730634] [INFO ] [MAIN ] STVN: Loaded 26735 existing records. [2025-10-22T21:18:48.906797] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:18:48.914483] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-22T21:18:48.915302] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T21:18:48.915463] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-22T21:18:48.918141] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-22T21:18:48.919269] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-22T21:18:48.919386] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-22T21:18:49.278306] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:18:49.717728] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-22T21:18:50.517687] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-22T21:18:50.891430] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-22T21:18:51.317752] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-22T21:18:51.350844] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-22T21:18:51.360110] [INFO ] [REMOTE ] STLA: Full fetch complete (77664 records). [2025-10-22T21:18:51.360276] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-22T21:18:51.747074] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-22T21:18:51.747171] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-22T21:18:51.748328] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-22T21:18:51.748393] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-22T21:18:51.749758] [DEBUG] [LOCAL ] STLA: Trimmed 77664 records to 53557 (keeping 200 days of data) [2025-10-22T21:18:52.065787] [DEBUG] [LOCAL ] STLA: Primary data saved (53557 records). [2025-10-22T21:18:52.065912] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-22T21:18:52.065985] [INFO ] [MAIN ] Update Progress: 2011/2367 symbols completed. STLA took 47.0s. Estimated remaining: 45m 49s. Rate: 7.8 symbols/min [2025-10-22T21:18:52.129211] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-22T21:18:52.236639] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:18:52.284099] [DEBUG] [LOCAL ] STWD: Loaded 51968 existing records from primary storage. [2025-10-22T21:18:52.284391] [INFO ] [MAIN ] STWD: Loaded 51968 existing records. [2025-10-22T21:18:52.479221] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:18:52.479621] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-22T21:18:52.479779] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-22T21:18:52.480548] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-10-22T21:18:52.481103] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-22T21:18:52.481298] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-22T21:18:52.758561] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-22T21:18:52.876415] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:18:52.917629] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-22T21:18:53.335999] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T21:18:53.717687] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-22T21:18:54.517678] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-22T21:18:54.743332] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-22T21:18:55.317711] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-22T21:18:55.448282] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-22T21:18:55.514089] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T21:18:56.117690] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-22T21:18:56.623412] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T21:18:56.917717] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-22T21:18:57.046531] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T21:18:57.717731] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-22T21:18:58.517706] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-22T21:18:58.672485] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T21:18:58.796030] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T21:18:59.317691] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-22T21:18:59.784563] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-22T21:19:00.117742] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-22T21:19:00.917739] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-22T21:19:01.152721] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-22T21:19:01.314685] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-22T21:19:01.717690] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-22T21:19:02.517707] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-22T21:19:02.829033] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T21:19:03.106239] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-22T21:19:03.317724] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-22T21:19:04.117622] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-22T21:19:04.255762] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T21:19:04.652770] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-22T21:19:04.917725] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-22T21:19:05.717634] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-22T21:19:05.818016] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T21:19:06.409310] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T21:19:06.517624] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-22T21:19:06.599433] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-22T21:19:07.317613] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-22T21:19:08.117751] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-22T21:19:08.586566] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-22T21:19:08.719431] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T21:19:08.917634] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-22T21:19:09.717717] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-22T21:19:10.214021] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-22T21:19:10.517716] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-22T21:19:10.652332] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T21:19:10.655301] [INFO ] [REMOTE ] STRV: Full fetch complete (17380 records). [2025-10-22T21:19:10.655383] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-22T21:19:11.027869] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-22T21:19:11.028050] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-22T21:19:11.028508] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-22T21:19:11.028621] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-22T21:19:11.029550] [DEBUG] [LOCAL ] STRV: Trimmed 17380 records to 10686 (keeping 200 days of data) [2025-10-22T21:19:11.106981] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-22T21:19:11.137212] [DEBUG] [LOCAL ] STRV: Primary data saved (10686 records). [2025-10-22T21:19:11.137330] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-22T21:19:11.137424] [INFO ] [MAIN ] Update Progress: 2012/2367 symbols completed. STRV took 28.2s. Estimated remaining: 45m 43s. Rate: 7.8 symbols/min [2025-10-22T21:19:11.304484] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:19:11.307846] [DEBUG] [LOCAL ] STXD: Loaded 1345 existing records from primary storage. [2025-10-22T21:19:11.307978] [INFO ] [MAIN ] STXD: Loaded 1345 existing records. [2025-10-22T21:19:11.328311] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-22T21:19:11.490817] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:19:11.490992] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-22T21:19:11.491036] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-22T21:19:11.491170] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-22T21:19:11.491225] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-22T21:19:11.788232] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-22T21:19:11.870153] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:19:12.117628] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-22T21:19:12.917622] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-22T21:19:13.279384] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T21:19:13.556723] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T21:19:13.717691] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-22T21:19:13.995346] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-22T21:19:14.491210] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T21:19:14.517686] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-22T21:19:15.317710] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-22T21:19:16.117693] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-22T21:19:16.850342] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-22T21:19:16.890474] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T21:19:16.917638] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-22T21:19:17.276589] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-22T21:19:17.717709] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-22T21:19:18.330736] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T21:19:18.517733] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-22T21:19:18.780087] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T21:19:19.071891] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-22T21:19:19.317677] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-22T21:19:20.117690] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-22T21:19:20.160043] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-22T21:19:20.168215] [INFO ] [REMOTE ] STT: Full fetch complete (74128 records). [2025-10-22T21:19:20.168365] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-22T21:19:20.169216] [FATAL] [VALIDATOR ] STT: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T21:19:20.169313] [FATAL] [MAIN ] STT: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:19:20.169376] [WARN ] [MAIN ] STT: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:19:20.169446] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-22T21:19:20.169516] [DEBUG] [LOCAL ] STT: No primary data file found to delete. [2025-10-22T21:19:20.169560] [INFO ] [LOCAL ] STT: Starting deletion of derivative data. [2025-10-22T21:19:20.169781] [DEBUG] [LOCAL ] STT: Deleted derivative data file. [2025-10-22T21:19:20.169874] [INFO ] [MAIN ] Update Progress: 2013/2367 symbols completed. STT took 33.1s. Estimated remaining: 45m 36s. Rate: 7.8 symbols/min [2025-10-22T21:19:20.338984] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:19:20.343497] [DEBUG] [LOCAL ] STXE: Loaded 2078 existing records from primary storage. [2025-10-22T21:19:20.343728] [INFO ] [MAIN ] STXE: Loaded 2078 existing records. [2025-10-22T21:19:20.519297] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:19:20.519527] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-22T21:19:20.519576] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-22T21:19:20.519727] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-22T21:19:20.519781] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-22T21:19:20.875659] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:19:20.917716] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-22T21:19:21.445627] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T21:19:21.452753] [INFO ] [REMOTE ] STVN: Full fetch complete (39197 records). [2025-10-22T21:19:21.452948] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-22T21:19:21.649705] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T21:19:21.723013] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-22T21:19:21.876145] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-22T21:19:21.876228] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-22T21:19:21.877094] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-22T21:19:21.877158] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-22T21:19:21.878154] [DEBUG] [LOCAL ] STVN: Trimmed 39197 records to 26683 (keeping 200 days of data) [2025-10-22T21:19:22.033311] [DEBUG] [LOCAL ] STVN: Primary data saved (26683 records). [2025-10-22T21:19:22.033444] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-22T21:19:22.033522] [INFO ] [MAIN ] Update Progress: 2014/2367 symbols completed. STVN took 33.5s. Estimated remaining: 45m 27s. Rate: 7.8 symbols/min [2025-10-22T21:19:22.216611] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:19:22.221450] [DEBUG] [LOCAL ] STXG: Loaded 2349 existing records from primary storage. [2025-10-22T21:19:22.221679] [INFO ] [MAIN ] STXG: Loaded 2349 existing records. [2025-10-22T21:19:22.402112] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-22T21:19:22.408679] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:19:22.410484] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-22T21:19:22.410544] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-22T21:19:22.410709] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-10-22T21:19:22.410767] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-22T21:19:22.522788] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-22T21:19:22.818083] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:19:23.144110] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T21:19:23.317676] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-22T21:19:23.771163] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-22T21:19:24.117679] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-22T21:19:24.840031] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-22T21:19:24.917690] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-22T21:19:25.646053] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T21:19:25.717626] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-22T21:19:26.384981] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-22T21:19:26.517698] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-22T21:19:27.228913] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-22T21:19:27.317681] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-22T21:19:27.834628] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-22T21:19:28.117683] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-22T21:19:28.727864] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-22T21:19:28.917715] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-22T21:19:29.657825] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-22T21:19:29.717695] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-22T21:19:30.477319] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T21:19:30.517621] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-22T21:19:31.023352] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-22T21:19:31.317636] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-22T21:19:32.081159] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-22T21:19:32.117624] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-22T21:19:32.793785] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-22T21:19:32.917633] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-22T21:19:33.448770] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-22T21:19:33.717677] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-22T21:19:34.129156] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-22T21:19:34.517718] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-22T21:19:35.066802] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-22T21:19:35.067811] [INFO ] [REMOTE ] STXD: Full fetch complete (2165 records). [2025-10-22T21:19:35.067879] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-22T21:19:35.322811] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-22T21:19:35.420840] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-22T21:19:35.420957] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-22T21:19:35.421085] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-22T21:19:35.421126] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-22T21:19:35.421452] [DEBUG] [LOCAL ] STXD: Trimmed 2165 records to 1337 (keeping 200 days of data) [2025-10-22T21:19:35.430053] [DEBUG] [LOCAL ] STXD: Primary data saved (1337 records). [2025-10-22T21:19:35.430147] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-22T21:19:35.430221] [INFO ] [MAIN ] Update Progress: 2015/2367 symbols completed. STXD took 24.3s. Estimated remaining: 45m 20s. Rate: 7.8 symbols/min [2025-10-22T21:19:35.595945] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:19:35.599887] [DEBUG] [LOCAL ] STXK: Loaded 1487 existing records from primary storage. [2025-10-22T21:19:35.600038] [INFO ] [MAIN ] STXK: Loaded 1487 existing records. [2025-10-22T21:19:35.770423] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:19:35.770664] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-22T21:19:35.770724] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-22T21:19:35.770885] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-22T21:19:35.770940] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-22T21:19:36.116155] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:19:36.117627] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-22T21:19:36.697323] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-22T21:19:36.917717] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-10-22T21:19:37.515106] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-22T21:19:37.516817] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-22T21:19:37.717688] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-22T21:19:38.517706] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-10-22T21:19:39.011237] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-22T21:19:39.317633] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-10-22T21:19:39.694126] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T21:19:39.702807] [INFO ] [REMOTE ] STWD: Full fetch complete (75349 records). [2025-10-22T21:19:39.702928] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-22T21:19:40.011002] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-22T21:19:40.108798] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-22T21:19:40.108890] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-22T21:19:40.110189] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-22T21:19:40.110258] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-22T21:19:40.111830] [DEBUG] [LOCAL ] STWD: Trimmed 75349 records to 51960 (keeping 200 days of data) [2025-10-22T21:19:40.166146] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-22T21:19:40.434783] [DEBUG] [LOCAL ] STWD: Primary data saved (51960 records). [2025-10-22T21:19:40.434910] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-22T21:19:40.434990] [INFO ] [MAIN ] Update Progress: 2016/2367 symbols completed. STWD took 48.4s. Estimated remaining: 45m 12s. Rate: 7.8 symbols/min [2025-10-22T21:19:40.599617] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:19:40.599861] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-22T21:19:40.599904] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-22T21:19:40.600016] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-22T21:19:40.600057] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-22T21:19:40.600115] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-22T21:19:40.600146] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-22T21:19:40.868060] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T21:19:40.922714] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-22T21:19:40.958034] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:19:41.534227] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T21:19:41.717671] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-22T21:19:42.327341] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-22T21:19:42.517634] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-22T21:19:43.095397] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-22T21:19:43.317625] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-22T21:19:43.796009] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-22T21:19:44.117665] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-10-22T21:19:44.917801] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-22T21:19:44.959963] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-22T21:19:45.717629] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-10-22T21:19:45.722463] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T21:19:46.325610] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-22T21:19:46.517771] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-22T21:19:47.159528] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-22T21:19:47.317677] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-10-22T21:19:47.819940] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-22T21:19:48.117661] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-22T21:19:48.800296] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-22T21:19:48.917703] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-10-22T21:19:49.460259] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-22T21:19:49.717681] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-22T21:19:50.248181] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-22T21:19:50.517703] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-22T21:19:51.119631] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T21:19:51.317683] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-22T21:19:51.821317] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-22T21:19:52.117672] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-22T21:19:52.568224] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-22T21:19:52.917663] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-22T21:19:53.417704] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-22T21:19:53.717673] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-22T21:19:54.517628] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-10-22T21:19:54.671164] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-22T21:19:54.672229] [INFO ] [REMOTE ] STXG: Full fetch complete (4053 records). [2025-10-22T21:19:54.672326] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-22T21:19:55.037252] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-22T21:19:55.037328] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-22T21:19:55.037463] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-22T21:19:55.037539] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-22T21:19:55.037917] [DEBUG] [LOCAL ] STXG: Trimmed 4053 records to 2290 (keeping 200 days of data) [2025-10-22T21:19:55.052545] [DEBUG] [LOCAL ] STXG: Primary data saved (2290 records). [2025-10-22T21:19:55.052605] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-22T21:19:55.052691] [INFO ] [MAIN ] Update Progress: 2017/2367 symbols completed. STXG took 33.0s. Estimated remaining: 45m 5s. Rate: 7.8 symbols/min [2025-10-22T21:19:55.209166] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-22T21:19:55.226844] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:19:55.232571] [DEBUG] [LOCAL ] STXT: Loaded 2505 existing records from primary storage. [2025-10-22T21:19:55.232742] [INFO ] [MAIN ] STXT: Loaded 2505 existing records. [2025-10-22T21:19:55.322715] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-10. [2025-10-22T21:19:55.417211] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:19:55.417439] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-22T21:19:55.417538] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-22T21:19:55.417761] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-22T21:19:55.417829] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-22T21:19:55.777182] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:19:55.965447] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T21:19:55.966394] [INFO ] [REMOTE ] STXK: Full fetch complete (2402 records). [2025-10-22T21:19:55.966479] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-22T21:19:56.124470] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-22T21:19:56.349755] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-22T21:19:56.349835] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-22T21:19:56.349966] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-22T21:19:56.350005] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-22T21:19:56.350330] [DEBUG] [LOCAL ] STXK: Trimmed 2402 records to 1477 (keeping 200 days of data) [2025-10-22T21:19:56.360239] [DEBUG] [LOCAL ] STXK: Primary data saved (1477 records). [2025-10-22T21:19:56.360309] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-22T21:19:56.360386] [INFO ] [MAIN ] Update Progress: 2018/2367 symbols completed. STXK took 20.9s. Estimated remaining: 44m 56s. Rate: 7.8 symbols/min [2025-10-22T21:19:56.536780] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:19:56.541676] [DEBUG] [LOCAL ] STXV: Loaded 1469 existing records from primary storage. [2025-10-22T21:19:56.541855] [INFO ] [MAIN ] STXV: Loaded 1469 existing records. [2025-10-22T21:19:56.648187] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-22T21:19:56.739812] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:19:56.740036] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-22T21:19:56.740091] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-22T21:19:56.740239] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-10-22T21:19:56.740292] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-22T21:19:56.917746] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-22T21:19:57.098001] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:19:57.544873] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-22T21:19:57.545797] [INFO ] [REMOTE ] STXE: Full fetch complete (3477 records). [2025-10-22T21:19:57.545864] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-22T21:19:57.721139] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-22T21:19:57.906215] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-22T21:19:57.906291] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-22T21:19:57.906431] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-22T21:19:57.906470] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-22T21:19:57.906862] [DEBUG] [LOCAL ] STXE: Trimmed 3477 records to 2051 (keeping 200 days of data) [2025-10-22T21:19:57.919537] [DEBUG] [LOCAL ] STXE: Primary data saved (2051 records). [2025-10-22T21:19:57.919613] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-22T21:19:57.919707] [INFO ] [MAIN ] Update Progress: 2019/2367 symbols completed. STXE took 37.7s. Estimated remaining: 44m 48s. Rate: 7.8 symbols/min [2025-10-22T21:19:58.089605] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:19:58.089803] [DEBUG] [LOCAL ] STZ: No existing data file found in primary storage. [2025-10-22T21:19:58.089845] [WARN ] [MAIN ] STZ: No existing data found, performing full refresh instead. [2025-10-22T21:19:58.089954] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-22T21:19:58.089995] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-22T21:19:58.090036] [DEBUG] [LOCAL ] STZ: No primary data file found to delete. [2025-10-22T21:19:58.090067] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-22T21:19:58.443033] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:19:58.453411] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T21:19:58.517634] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-22T21:19:59.317632] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-22T21:19:59.791444] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-22T21:20:00.117718] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-22T21:20:00.597016] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T21:20:00.917733] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-22T21:20:00.949718] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T21:20:01.717739] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-22T21:20:02.504824] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T21:20:02.517691] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-22T21:20:03.317630] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-22T21:20:03.347615] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-22T21:20:03.560700] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-10-22T21:20:03.849184] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-22T21:20:04.117675] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-22T21:20:04.869036] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-22T21:20:04.917693] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-22T21:20:05.547817] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-22T21:20:05.548572] [INFO ] [REMOTE ] STXM: Full fetch complete (1381 records). [2025-10-22T21:20:05.548682] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-22T21:20:05.729523] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-22T21:20:05.736563] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-22T21:20:05.737751] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:20:05.737840] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:20:05.737924] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-22T21:20:05.737998] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-22T21:20:05.738046] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-22T21:20:05.738098] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-22T21:20:05.738170] [INFO ] [MAIN ] Update Progress: 2020/2367 symbols completed. STXM took 25.3s. Estimated remaining: 44m 40s. Rate: 7.8 symbols/min [2025-10-22T21:20:06.017760] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:20:06.080466] [DEBUG] [LOCAL ] SU: Loaded 53432 existing records from primary storage. [2025-10-22T21:20:06.080961] [INFO ] [MAIN ] SU: Loaded 53432 existing records. [2025-10-22T21:20:06.362717] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:20:06.363005] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-22T21:20:06.363071] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-22T21:20:06.363452] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-10-22T21:20:06.363520] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-22T21:20:06.522887] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-22T21:20:06.760854] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:20:07.287036] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T21:20:07.317604] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-22T21:20:08.004784] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-22T21:20:08.117711] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-22T21:20:08.397250] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-22T21:20:08.828592] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T21:20:08.917617] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-22T21:20:09.559849] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-22T21:20:09.717678] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-22T21:20:10.517638] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-22T21:20:11.213349] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T21:20:11.317733] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-22T21:20:11.902487] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-22T21:20:11.953612] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-22T21:20:12.117704] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-22T21:20:12.917669] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-22T21:20:13.518830] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T21:20:13.519823] [INFO ] [REMOTE ] STXT: Full fetch complete (3903 records). [2025-10-22T21:20:13.519890] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-22T21:20:13.726113] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-22T21:20:13.880087] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-22T21:20:13.880259] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-22T21:20:13.880490] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-22T21:20:13.880574] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-22T21:20:13.881067] [DEBUG] [LOCAL ] STXT: Trimmed 3903 records to 2509 (keeping 200 days of data) [2025-10-22T21:20:13.896263] [DEBUG] [LOCAL ] STXT: Primary data saved (2509 records). [2025-10-22T21:20:13.896333] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-22T21:20:13.896401] [INFO ] [MAIN ] Update Progress: 2021/2367 symbols completed. STXT took 18.8s. Estimated remaining: 44m 32s. Rate: 7.8 symbols/min [2025-10-22T21:20:14.065582] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:20:14.103186] [DEBUG] [LOCAL ] SUI: Loaded 41883 existing records from primary storage. [2025-10-22T21:20:14.103463] [INFO ] [MAIN ] SUI: Loaded 41883 existing records. [2025-10-22T21:20:14.286302] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:20:14.286618] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-22T21:20:14.286776] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-22T21:20:14.296053] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-22T21:20:14.301538] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-22T21:20:14.391928] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-22T21:20:14.424602] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-22T21:20:14.522933] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-22T21:20:14.687954] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:20:15.317741] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-22T21:20:16.117693] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-22T21:20:16.730727] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-22T21:20:16.777101] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-22T21:20:16.917713] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-10-22T21:20:17.421485] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-22T21:20:17.717692] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-22T21:20:18.517728] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-22T21:20:18.998375] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-22T21:20:19.042468] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-22T21:20:19.317639] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-22T21:20:19.781052] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-22T21:20:20.117711] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-10-22T21:20:20.750096] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-22T21:20:20.758375] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-22T21:20:20.917683] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-22T21:20:21.717745] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-10-22T21:20:22.517706] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-22T21:20:23.314585] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-22T21:20:23.322002] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-10-22T21:20:23.892669] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-22T21:20:24.020962] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-22T21:20:24.109519] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T21:20:24.120387] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-10-22T21:20:24.678133] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T21:20:24.917707] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-22T21:20:25.717685] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-10-22T21:20:26.517659] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-22T21:20:26.903364] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-22T21:20:27.317700] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-22T21:20:28.117619] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-10-22T21:20:28.268149] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-22T21:20:28.334558] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T21:20:28.704245] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-22T21:20:28.917683] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-22T21:20:29.065037] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T21:20:29.717721] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-10-22T21:20:30.517687] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-10. [2025-10-22T21:20:30.670865] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-22T21:20:30.704969] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T21:20:30.962088] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-22T21:20:30.962903] [INFO ] [REMOTE ] STXV: Full fetch complete (2515 records). [2025-10-22T21:20:30.962977] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-22T21:20:31.316201] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-22T21:20:31.316314] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-22T21:20:31.316446] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-22T21:20:31.316507] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-22T21:20:31.316855] [DEBUG] [LOCAL ] STXV: Trimmed 2515 records to 1462 (keeping 200 days of data) [2025-10-22T21:20:31.326431] [DEBUG] [LOCAL ] STXV: Primary data saved (1462 records). [2025-10-22T21:20:31.321949] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-10-22T21:20:31.326767] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-22T21:20:31.327837] [INFO ] [MAIN ] Update Progress: 2022/2367 symbols completed. STXV took 35.0s. Estimated remaining: 44m 26s. Rate: 7.8 symbols/min [2025-10-22T21:20:31.496608] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:20:31.533234] [DEBUG] [LOCAL ] SUN: Loaded 38843 existing records from primary storage. [2025-10-22T21:20:31.533554] [INFO ] [MAIN ] SUN: Loaded 38843 existing records. [2025-10-22T21:20:31.714123] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:20:31.714340] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-22T21:20:31.714388] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-22T21:20:31.714574] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-22T21:20:31.714630] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-22T21:20:32.065754] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:20:32.117634] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-22T21:20:32.508938] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-22T21:20:32.917636] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-10. [2025-10-22T21:20:33.704235] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T21:20:33.717617] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-22T21:20:33.841325] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-22T21:20:33.849625] [INFO ] [REMOTE ] STZ: Full fetch complete (75840 records). [2025-10-22T21:20:33.849794] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-10-22T21:20:33.850476] [FATAL] [VALIDATOR ] STZ: Data is stale - most recent date (2025-10-21) is before last completed trading day (2025-10-22). Symbol may be delisted or halted. [2025-10-22T21:20:33.850578] [FATAL] [MAIN ] STZ: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:20:33.850621] [WARN ] [MAIN ] STZ: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:20:33.850748] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-22T21:20:33.850812] [DEBUG] [LOCAL ] STZ: No primary data file found to delete. [2025-10-22T21:20:33.850847] [INFO ] [LOCAL ] STZ: Starting deletion of derivative data. [2025-10-22T21:20:33.850886] [DEBUG] [LOCAL ] STZ: No derivative data file found to delete. [2025-10-22T21:20:33.850941] [INFO ] [MAIN ] Update Progress: 2023/2367 symbols completed. STZ took 35.9s. Estimated remaining: 44m 18s. Rate: 7.8 symbols/min [2025-10-22T21:20:34.034308] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:20:34.075906] [DEBUG] [LOCAL ] SUPV: Loaded 48049 existing records from primary storage. [2025-10-22T21:20:34.076193] [INFO ] [MAIN ] SUPV: Loaded 48049 existing records. [2025-10-22T21:20:34.252501] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:20:34.252728] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-22T21:20:34.252786] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-22T21:20:34.253441] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-22T21:20:34.253497] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-22T21:20:34.522874] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-22T21:20:34.600241] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:20:35.317700] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-22T21:20:35.777233] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-22T21:20:36.117634] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-22T21:20:36.393278] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-22T21:20:36.917723] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-22T21:20:37.198097] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-22T21:20:37.717694] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-22T21:20:38.007218] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T21:20:38.196003] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T21:20:38.517688] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-22T21:20:39.317704] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-22T21:20:39.485477] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T21:20:40.117694] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-22T21:20:40.299124] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T21:20:40.917733] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-22T21:20:40.953832] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T21:20:41.717667] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-22T21:20:41.894350] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T21:20:42.517752] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-22T21:20:42.640012] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T21:20:43.317626] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-22T21:20:43.424992] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T21:20:44.117722] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-22T21:20:44.312567] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-22T21:20:44.321484] [INFO ] [REMOTE ] SU: Full fetch complete (77569 records). [2025-10-22T21:20:44.321677] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-22T21:20:44.722422] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-22T21:20:44.722515] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-22T21:20:44.723736] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-22T21:20:44.723842] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-22T21:20:44.725337] [DEBUG] [LOCAL ] SU: Trimmed 77569 records to 53430 (keeping 200 days of data) [2025-10-22T21:20:44.843707] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T21:20:44.937852] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-22T21:20:45.086460] [DEBUG] [LOCAL ] SU: Primary data saved (53430 records). [2025-10-22T21:20:45.086591] [INFO ] [MAIN ] SU: Full history saved. [2025-10-22T21:20:45.086688] [INFO ] [MAIN ] Update Progress: 2024/2367 symbols completed. SU took 39.3s. Estimated remaining: 44m 11s. Rate: 7.8 symbols/min [2025-10-22T21:20:45.256993] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:20:45.294291] [DEBUG] [LOCAL ] SUZ: Loaded 45564 existing records from primary storage. [2025-10-22T21:20:45.294580] [INFO ] [MAIN ] SUZ: Loaded 45564 existing records. [2025-10-22T21:20:45.480242] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:20:45.480538] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-22T21:20:45.480590] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-22T21:20:45.480897] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-22T21:20:45.480953] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-22T21:20:45.726730] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-22T21:20:45.849828] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:20:45.873843] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T21:20:46.517693] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-22T21:20:46.568295] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T21:20:47.292956] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-22T21:20:47.317623] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-22T21:20:48.117717] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-22T21:20:48.402576] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T21:20:48.774783] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T21:20:48.917622] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-22T21:20:49.717629] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-22T21:20:49.755229] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T21:20:50.496519] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-22T21:20:50.503414] [INFO ] [REMOTE ] SUI: Full fetch complete (60786 records). [2025-10-22T21:20:50.503518] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-22T21:20:50.524609] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-22T21:20:50.897205] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-22T21:20:50.897310] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-22T21:20:50.901360] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-22T21:20:50.901568] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-22T21:20:50.914732] [DEBUG] [LOCAL ] SUI: Trimmed 60786 records to 41833 (keeping 200 days of data) [2025-10-22T21:20:50.923176] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T21:20:51.183248] [DEBUG] [LOCAL ] SUI: Primary data saved (41833 records). [2025-10-22T21:20:51.183368] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-22T21:20:51.183441] [INFO ] [MAIN ] Update Progress: 2025/2367 symbols completed. SUI took 37.3s. Estimated remaining: 44m 3s. Rate: 7.8 symbols/min [2025-10-22T21:20:51.322815] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-22T21:20:51.353000] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:20:51.389606] [DEBUG] [LOCAL ] SVV: Loaded 40296 existing records from primary storage. [2025-10-22T21:20:51.389931] [INFO ] [MAIN ] SVV: Loaded 40296 existing records. [2025-10-22T21:20:51.564903] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:20:51.565123] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-22T21:20:51.565173] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-22T21:20:51.565352] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-22T21:20:51.565427] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-22T21:20:51.921586] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:20:52.117626] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-22T21:20:52.204934] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T21:20:52.840292] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T21:20:52.917623] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-22T21:20:53.589109] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T21:20:53.717636] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-22T21:20:54.487425] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T21:20:54.517621] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-22T21:20:55.212159] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T21:20:55.317677] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-22T21:20:56.117756] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-22T21:20:56.228701] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T21:20:56.904363] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T21:20:56.917612] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-22T21:20:57.390221] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-22T21:20:57.717705] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-22T21:20:58.516303] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-22T21:20:58.531118] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-22T21:20:58.807590] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T21:20:59.317737] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-22T21:21:00.123711] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-22T21:21:00.127402] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-22T21:21:00.917639] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-22T21:21:01.284351] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-22T21:21:01.717686] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-22T21:21:02.118713] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-22T21:21:02.517676] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-22T21:21:02.700613] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T21:21:03.098388] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T21:21:03.317682] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-22T21:21:04.117623] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-22T21:21:04.184530] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T21:21:04.917672] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-22T21:21:04.995623] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T21:21:05.707044] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T21:21:05.717634] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-22T21:21:06.408858] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T21:21:06.417537] [INFO ] [REMOTE ] SUPV: Full fetch complete (68981 records). [2025-10-22T21:21:06.417741] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-22T21:21:06.522854] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-22T21:21:06.810233] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-22T21:21:06.810309] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-22T21:21:06.811270] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-22T21:21:06.811332] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-22T21:21:06.812561] [DEBUG] [LOCAL ] SUPV: Trimmed 68981 records to 48048 (keeping 200 days of data) [2025-10-22T21:21:07.083877] [DEBUG] [LOCAL ] SUPV: Primary data saved (48048 records). [2025-10-22T21:21:07.083999] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-22T21:21:07.084073] [INFO ] [MAIN ] Update Progress: 2026/2367 symbols completed. SUPV took 33.2s. Estimated remaining: 43m 56s. Rate: 7.8 symbols/min [2025-10-22T21:21:07.257451] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:21:07.279703] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T21:21:07.287520] [INFO ] [REMOTE ] SUN: Full fetch complete (55574 records). [2025-10-22T21:21:07.287819] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-22T21:21:07.322829] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-22T21:21:07.631633] [DEBUG] [LOCAL ] SW: Loaded 53179 existing records from primary storage. [2025-10-22T21:21:07.632372] [INFO ] [MAIN ] SW: Loaded 53179 existing records. [2025-10-22T21:21:07.853378] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-22T21:21:07.886079] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-22T21:21:07.887377] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-22T21:21:07.920526] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:21:07.916543] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-22T21:21:07.920831] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-22T21:21:07.921010] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-22T21:21:07.921427] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-22T21:21:07.921602] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-22T21:21:07.966081] [DEBUG] [LOCAL ] SUN: Trimmed 55574 records to 38757 (keeping 200 days of data) [2025-10-22T21:21:08.228076] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T21:21:08.269613] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-22T21:21:08.580267] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:21:08.588109] [DEBUG] [LOCAL ] SUN: Primary data saved (38757 records). [2025-10-22T21:21:08.588363] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-22T21:21:08.589400] [INFO ] [MAIN ] Update Progress: 2027/2367 symbols completed. SUN took 37.3s. Estimated remaining: 43m 47s. Rate: 7.8 symbols/min [2025-10-22T21:21:08.757138] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:21:08.805591] [DEBUG] [LOCAL ] SWK: Loaded 52419 existing records from primary storage. [2025-10-22T21:21:08.805904] [INFO ] [MAIN ] SWK: Loaded 52419 existing records. [2025-10-22T21:21:08.922873] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-10-22T21:21:08.984115] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:21:08.984385] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-22T21:21:08.984554] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-22T21:21:08.985002] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-22T21:21:08.985277] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-22T21:21:09.168174] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T21:21:09.371901] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:21:09.706805] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T21:21:09.717618] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-22T21:21:10.517704] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-22T21:21:10.745806] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T21:21:11.320027] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-10-22T21:21:11.324608] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T21:21:11.332866] [INFO ] [REMOTE ] SUZ: Full fetch complete (66788 records). [2025-10-22T21:21:11.332994] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-22T21:21:11.739523] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-22T21:21:11.739742] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-22T21:21:11.741082] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-22T21:21:11.741160] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-22T21:21:11.767921] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-22T21:21:11.768074] [DEBUG] [LOCAL ] SUZ: Trimmed 66788 records to 45524 (keeping 200 days of data) [2025-10-22T21:21:12.058462] [DEBUG] [LOCAL ] SUZ: Primary data saved (45524 records). [2025-10-22T21:21:12.058587] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-22T21:21:12.058685] [INFO ] [MAIN ] Update Progress: 2028/2367 symbols completed. SUZ took 27.0s. Estimated remaining: 43m 39s. Rate: 7.8 symbols/min [2025-10-22T21:21:12.122947] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-10-22T21:21:12.226937] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:21:12.255637] [DEBUG] [LOCAL ] SWX: Loaded 30720 existing records from primary storage. [2025-10-22T21:21:12.255938] [INFO ] [MAIN ] SWX: Loaded 30720 existing records. [2025-10-22T21:21:12.434699] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:21:12.434929] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-22T21:21:12.434975] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-22T21:21:12.435165] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-22T21:21:12.435219] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-22T21:21:12.784510] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:21:12.917724] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-22T21:21:13.165487] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-22T21:21:13.708776] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T21:21:13.718577] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-10-22T21:21:14.484100] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T21:21:14.517680] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-22T21:21:15.317627] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-10-22T21:21:15.774433] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-22T21:21:16.105929] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T21:21:16.114175] [INFO ] [REMOTE ] SVV: Full fetch complete (57522 records). [2025-10-22T21:21:16.114332] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-22T21:21:16.126852] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-10-22T21:21:16.530542] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-22T21:21:16.530634] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-22T21:21:16.531680] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-22T21:21:16.531751] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-22T21:21:16.532838] [DEBUG] [LOCAL ] SVV: Trimmed 57522 records to 40253 (keeping 200 days of data) [2025-10-22T21:21:16.647367] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T21:21:16.782166] [DEBUG] [LOCAL ] SVV: Primary data saved (40253 records). [2025-10-22T21:21:16.782285] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-22T21:21:16.782359] [INFO ] [MAIN ] Update Progress: 2029/2367 symbols completed. SVV took 25.6s. Estimated remaining: 43m 31s. Rate: 7.8 symbols/min [2025-10-22T21:21:16.927838] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-10-22T21:21:16.960904] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:21:16.968511] [DEBUG] [LOCAL ] SWZ: Loaded 6032 existing records from primary storage. [2025-10-22T21:21:16.968742] [INFO ] [MAIN ] SWZ: Loaded 6032 existing records. [2025-10-22T21:21:17.146959] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:21:17.147223] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-22T21:21:17.147285] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-22T21:21:17.147426] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-22T21:21:17.147465] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-22T21:21:17.517420] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:21:17.717667] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-10-22T21:21:17.782544] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T21:21:18.182922] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-22T21:21:18.517698] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-10-22T21:21:19.151897] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-22T21:21:19.317708] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-10-22T21:21:19.606634] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-22T21:21:20.117718] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-10-22T21:21:20.696766] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-22T21:21:20.917621] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-10-22T21:21:21.122561] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T21:21:21.540007] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T21:21:21.717689] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-10-22T21:21:22.517759] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-10-22T21:21:23.018258] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T21:21:23.317717] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-10-22T21:21:23.336889] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T21:21:24.117746] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-10-22T21:21:24.689204] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-22T21:21:24.917683] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-10-22T21:21:25.535070] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T21:21:25.717620] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-10-22T21:21:26.077956] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-22T21:21:26.241638] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-22T21:21:26.517705] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-10-22T21:21:27.317721] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-10-22T21:21:28.117714] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-10-22T21:21:28.246032] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T21:21:28.704349] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T21:21:28.917719] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-10-22T21:21:29.629076] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-22T21:21:29.717612] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-10-22T21:21:29.849247] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T21:21:30.517628] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-10-22T21:21:30.602949] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-22T21:21:31.317698] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-10-22T21:21:32.117626] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-10-22T21:21:32.391963] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T21:21:32.644848] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T21:21:32.917679] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-10-22T21:21:33.378760] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-22T21:21:33.717700] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-10. [2025-10-22T21:21:34.033210] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-22T21:21:34.436299] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-22T21:21:34.437841] [INFO ] [REMOTE ] SWZ: Full fetch complete (8274 records). [2025-10-22T21:21:34.437913] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-22T21:21:34.522860] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-10-22T21:21:34.812867] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-22T21:21:34.812959] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-22T21:21:34.813192] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-22T21:21:34.813236] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-22T21:21:34.813723] [DEBUG] [LOCAL ] SWZ: Trimmed 8274 records to 5997 (keeping 200 days of data) [2025-10-22T21:21:34.847446] [DEBUG] [LOCAL ] SWZ: Primary data saved (5997 records). [2025-10-22T21:21:34.847627] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-22T21:21:34.847751] [INFO ] [MAIN ] Update Progress: 2030/2367 symbols completed. SWZ took 18.1s. Estimated remaining: 43m 25s. Rate: 7.8 symbols/min [2025-10-22T21:21:35.025044] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:21:35.063759] [DEBUG] [LOCAL ] SXC: Loaded 41628 existing records from primary storage. [2025-10-22T21:21:35.064143] [INFO ] [MAIN ] SXC: Loaded 41628 existing records. [2025-10-22T21:21:35.241535] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:21:35.241784] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-22T21:21:35.241858] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-22T21:21:35.242094] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-22T21:21:35.242154] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-22T21:21:35.322874] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-10-22T21:21:35.596341] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:21:36.117677] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-10-22T21:21:36.647755] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-22T21:21:36.917700] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-10-22T21:21:37.322489] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-22T21:21:37.717696] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-10-22T21:21:37.984330] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-22T21:21:38.457269] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T21:21:38.517698] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-10-22T21:21:39.317701] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-10-22T21:21:39.728788] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T21:21:39.863320] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T21:21:40.117701] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-10-22T21:21:40.917682] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-10-22T21:21:41.090175] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T21:21:41.404015] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-22T21:21:41.717687] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-10-22T21:21:42.517629] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-10. [2025-10-22T21:21:43.005300] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-22T21:21:43.317733] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-10-22T21:21:43.486345] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T21:21:44.117639] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-10. [2025-10-22T21:21:44.703969] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-22T21:21:44.713228] [INFO ] [REMOTE ] SW: Full fetch complete (77107 records). [2025-10-22T21:21:44.713379] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-22T21:21:44.926213] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-10-22T21:21:45.145928] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T21:21:45.170887] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-22T21:21:45.179616] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-22T21:21:45.180992] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-22T21:21:45.181681] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-22T21:21:45.183998] [DEBUG] [LOCAL ] SW: Trimmed 77107 records to 53179 (keeping 200 days of data) [2025-10-22T21:21:45.384483] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T21:21:45.428409] [INFO ] [REMOTE ] SWX: Full fetch complete (43839 records). [2025-10-22T21:21:45.452186] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-22T21:21:45.646175] [DEBUG] [LOCAL ] SW: Primary data saved (53179 records). [2025-10-22T21:21:45.661669] [INFO ] [MAIN ] SW: Full history saved. [2025-10-22T21:21:45.661785] [INFO ] [MAIN ] Update Progress: 2031/2367 symbols completed. SW took 38.6s. Estimated remaining: 43m 18s. Rate: 7.8 symbols/min [2025-10-22T21:21:45.741714] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-10-22T21:21:46.057195] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:21:46.110928] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-22T21:21:46.111010] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-22T21:21:46.111952] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-22T21:21:46.112085] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-22T21:21:46.113421] [DEBUG] [LOCAL ] SWX: Trimmed 43839 records to 30595 (keeping 200 days of data) [2025-10-22T21:21:46.118950] [DEBUG] [LOCAL ] SXI: Loaded 12082 existing records from primary storage. [2025-10-22T21:21:46.119241] [INFO ] [MAIN ] SXI: Loaded 12082 existing records. [2025-10-22T21:21:46.431899] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:21:46.433722] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-22T21:21:46.434099] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-22T21:21:46.435547] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-22T21:21:46.435861] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-22T21:21:46.802819] [DEBUG] [LOCAL ] SWX: Primary data saved (30595 records). [2025-10-22T21:21:46.820315] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-22T21:21:46.820497] [INFO ] [MAIN ] Update Progress: 2032/2367 symbols completed. SWX took 34.8s. Estimated remaining: 43m 9s. Rate: 7.8 symbols/min [2025-10-22T21:21:47.034907] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:21:47.077839] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-10-22T21:21:47.113009] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-22T21:21:47.137443] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:21:47.172893] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-22T21:21:47.203784] [DEBUG] [LOCAL ] SXT: Loaded 29847 existing records from primary storage. [2025-10-22T21:21:47.204071] [INFO ] [MAIN ] SXT: Loaded 29847 existing records. [2025-10-22T21:21:47.322787] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-10-22T21:21:47.380125] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:21:47.380334] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-22T21:21:47.380381] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-22T21:21:47.380748] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-22T21:21:47.380803] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-22T21:21:47.731625] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:21:47.898007] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-22T21:21:48.117638] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-10-22T21:21:48.909274] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T21:21:48.917877] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-10-22T21:21:49.141947] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-22T21:21:49.717696] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-10-22T21:21:50.483817] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-22T21:21:50.519336] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-10-22T21:21:50.522170] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T21:21:51.317719] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-10. [2025-10-22T21:21:52.117681] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-10-22T21:21:52.651058] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-22T21:21:52.905190] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-22T21:21:52.917609] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-10-22T21:21:53.427232] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-22T21:21:53.436223] [INFO ] [REMOTE ] SWK: Full fetch complete (75573 records). [2025-10-22T21:21:53.436373] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-22T21:21:53.721903] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-10-22T21:21:53.800821] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-22T21:21:53.862164] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-22T21:21:53.862259] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-22T21:21:53.863543] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-22T21:21:53.863616] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-22T21:21:53.865159] [DEBUG] [LOCAL ] SWK: Trimmed 75573 records to 52397 (keeping 200 days of data) [2025-10-22T21:21:54.190534] [DEBUG] [LOCAL ] SWK: Primary data saved (52397 records). [2025-10-22T21:21:54.190710] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-22T21:21:54.191375] [INFO ] [MAIN ] Update Progress: 2033/2367 symbols completed. SWK took 45.6s. Estimated remaining: 43m 1s. Rate: 7.8 symbols/min [2025-10-22T21:21:54.361989] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:21:54.362180] [DEBUG] [LOCAL ] SYF: No existing data file found in primary storage. [2025-10-22T21:21:54.362218] [WARN ] [MAIN ] SYF: No existing data found, performing full refresh instead. [2025-10-22T21:21:54.362331] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-22T21:21:54.362372] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-22T21:21:54.362414] [DEBUG] [LOCAL ] SYF: No primary data file found to delete. [2025-10-22T21:21:54.362448] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-22T21:21:54.529218] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-10-22T21:21:54.732820] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:21:54.796526] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-22T21:21:55.317732] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-10-22T21:21:56.117731] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-10-22T21:21:56.181560] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T21:21:56.270376] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T21:21:56.917758] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-10-22T21:21:57.341286] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-22T21:21:57.717630] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-10-22T21:21:57.860403] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-22T21:21:58.517690] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-10-22T21:21:59.317687] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-10-22T21:21:59.589571] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-22T21:22:00.044773] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-22T21:22:00.117701] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-10-22T21:22:00.784455] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T21:22:00.917633] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-10. [2025-10-22T21:22:01.072399] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T21:22:01.717707] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-10-22T21:22:02.517726] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-10-22T21:22:02.737950] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T21:22:02.745336] [INFO ] [REMOTE ] SXC: Full fetch complete (61018 records). [2025-10-22T21:22:02.745445] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-22T21:22:03.158767] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-22T21:22:03.158847] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-22T21:22:03.159971] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-22T21:22:03.160035] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-22T21:22:03.161204] [DEBUG] [LOCAL ] SXC: Trimmed 61018 records to 41575 (keeping 200 days of data) [2025-10-22T21:22:03.324922] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-10-22T21:22:03.378513] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T21:22:03.424665] [DEBUG] [LOCAL ] SXC: Primary data saved (41575 records). [2025-10-22T21:22:03.424805] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-22T21:22:03.424886] [INFO ] [MAIN ] Update Progress: 2034/2367 symbols completed. SXC took 28.6s. Estimated remaining: 42m 53s. Rate: 7.8 symbols/min [2025-10-22T21:22:03.589078] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:22:03.632144] [DEBUG] [LOCAL ] SYK: Loaded 46824 existing records from primary storage. [2025-10-22T21:22:03.632472] [INFO ] [MAIN ] SYK: Loaded 46824 existing records. [2025-10-22T21:22:03.828527] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:22:03.828774] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-22T21:22:03.828822] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-22T21:22:03.828997] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-22T21:22:03.829033] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-22T21:22:04.118097] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-10-22T21:22:04.199892] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:22:04.326547] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-22T21:22:04.452227] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-22T21:22:04.917719] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-10-22T21:22:05.577119] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T21:22:05.641617] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-22T21:22:05.717899] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-10-22T21:22:06.517777] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-10-22T21:22:07.264264] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T21:22:07.317677] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-10-22T21:22:08.117730] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-10. [2025-10-22T21:22:08.283174] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T21:22:08.665574] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T21:22:08.917727] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-10-22T21:22:09.028429] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T21:22:09.031232] [INFO ] [REMOTE ] SXI: Full fetch complete (15858 records). [2025-10-22T21:22:09.031304] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-22T21:22:09.396578] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-22T21:22:09.396721] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-22T21:22:09.397088] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-22T21:22:09.397149] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-22T21:22:09.397681] [DEBUG] [LOCAL ] SXI: Trimmed 15858 records to 12002 (keeping 200 days of data) [2025-10-22T21:22:09.471361] [DEBUG] [LOCAL ] SXI: Primary data saved (12002 records). [2025-10-22T21:22:09.471493] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-22T21:22:09.471566] [INFO ] [MAIN ] Update Progress: 2035/2367 symbols completed. SXI took 23.8s. Estimated remaining: 42m 45s. Rate: 7.8 symbols/min [2025-10-22T21:22:09.636021] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:22:09.682480] [DEBUG] [LOCAL ] SYY: Loaded 53206 existing records from primary storage. [2025-10-22T21:22:09.682790] [INFO ] [MAIN ] SYY: Loaded 53206 existing records. [2025-10-22T21:22:09.724931] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-10-22T21:22:09.857967] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:22:09.858199] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-22T21:22:09.858245] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-22T21:22:09.858462] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-22T21:22:09.858522] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-22T21:22:10.213331] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:22:10.517674] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-10-22T21:22:10.629453] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T21:22:11.317679] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-10-22T21:22:11.472563] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T21:22:12.117763] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-10-22T21:22:12.342181] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T21:22:12.866694] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T21:22:12.917624] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-10-22T21:22:13.682257] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T21:22:13.717693] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-10-22T21:22:14.518061] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-10-22T21:22:14.517986] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T21:22:15.317728] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-10-22T21:22:15.557159] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T21:22:16.117632] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-10-22T21:22:16.765118] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-22T21:22:16.917695] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-10-22T21:22:17.251328] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-22T21:22:17.717627] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-10. [2025-10-22T21:22:17.909043] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-22T21:22:18.517701] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-10-22T21:22:18.735670] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T21:22:18.785188] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T21:22:18.790293] [INFO ] [REMOTE ] SXT: Full fetch complete (39635 records). [2025-10-22T21:22:18.790399] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-22T21:22:19.162730] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-22T21:22:19.162916] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-22T21:22:19.163773] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-22T21:22:19.163835] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-22T21:22:19.164859] [DEBUG] [LOCAL ] SXT: Trimmed 39635 records to 29654 (keeping 200 days of data) [2025-10-22T21:22:19.330022] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-10-22T21:22:19.347577] [DEBUG] [LOCAL ] SXT: Primary data saved (29654 records). [2025-10-22T21:22:19.347908] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-22T21:22:19.348006] [INFO ] [MAIN ] Update Progress: 2036/2367 symbols completed. SXT took 32.5s. Estimated remaining: 42m 38s. Rate: 7.8 symbols/min [2025-10-22T21:22:19.516020] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:22:19.562450] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-22T21:22:19.562804] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-10-22T21:22:19.740628] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:22:19.740900] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-22T21:22:19.740947] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-22T21:22:19.741423] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-22T21:22:19.741480] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-22T21:22:20.097063] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:22:20.117685] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-10-22T21:22:20.344424] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T21:22:20.917668] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-10-22T21:22:21.287931] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T21:22:21.717696] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-10-22T21:22:21.876071] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T21:22:22.517759] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-10-22T21:22:22.879913] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-22T21:22:23.317730] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-10-22T21:22:23.445786] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T21:22:24.117687] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-10-22T21:22:24.467702] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T21:22:24.917738] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-10-22T21:22:25.583849] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-22T21:22:25.717633] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-10-22T21:22:25.798256] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T21:22:26.403262] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T21:22:26.517708] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-10-22T21:22:27.317737] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-10-22T21:22:28.086237] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T21:22:28.117604] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-10. [2025-10-22T21:22:28.161898] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-22T21:22:28.201950] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T21:22:28.917716] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-10-22T21:22:29.717717] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-10-22T21:22:30.205444] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-22T21:22:30.214175] [INFO ] [REMOTE ] SYF: Full fetch complete (77578 records). [2025-10-22T21:22:30.214293] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-10-22T21:22:30.522779] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-10-22T21:22:30.613944] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-10-22T21:22:30.614015] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-10-22T21:22:30.615135] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-10-22T21:22:30.615197] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-10-22T21:22:30.616569] [DEBUG] [LOCAL ] SYF: Trimmed 77578 records to 53451 (keeping 200 days of data) [2025-10-22T21:22:30.942429] [DEBUG] [LOCAL ] SYF: Primary data saved (53451 records). [2025-10-22T21:22:30.942587] [INFO ] [MAIN ] SYF: Full history saved. [2025-10-22T21:22:30.942726] [INFO ] [MAIN ] Update Progress: 2037/2367 symbols completed. SYF took 36.8s. Estimated remaining: 42m 31s. Rate: 7.8 symbols/min [2025-10-22T21:22:30.991704] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-22T21:22:31.317738] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-10-22T21:22:32.137144] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T21:22:32.147180] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-10. [2025-10-22T21:22:32.436267] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-10-22T21:22:32.917729] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-10-22T21:22:33.290011] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-22T21:22:33.717734] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-10-22T21:22:33.949277] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T21:22:33.957635] [INFO ] [REMOTE ] SYK: Full fetch complete (69201 records). [2025-10-22T21:22:33.957795] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-22T21:22:34.340107] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-22T21:22:34.340182] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-22T21:22:34.341244] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-22T21:22:34.341307] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-22T21:22:34.342572] [DEBUG] [LOCAL ] SYK: Trimmed 69201 records to 46804 (keeping 200 days of data) [2025-10-22T21:22:34.635059] [DEBUG] [LOCAL ] SYK: Primary data saved (46804 records). [2025-10-22T21:22:34.635216] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-22T21:22:34.635319] [INFO ] [MAIN ] Update Progress: 2038/2367 symbols completed. SYK took 31.2s. Estimated remaining: 42m 23s. Rate: 7.8 symbols/min [2025-10-22T21:22:35.429987] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-22T21:22:35.441256] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-10-22T21:22:35.631473] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-22T21:22:35.642677] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-10-22T21:22:37.511380] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-22T21:22:37.522840] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-10. [2025-10-22T21:22:37.641785] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-22T21:22:37.652535] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-10-22T21:22:39.263581] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T21:22:39.277113] [INFO ] [REMOTE ] SYY: Full fetch complete (77243 records). [2025-10-22T21:22:39.277380] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-22T21:22:39.681059] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-22T21:22:39.681139] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-22T21:22:39.682361] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-22T21:22:39.682425] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-22T21:22:39.683863] [DEBUG] [LOCAL ] SYY: Trimmed 77243 records to 53204 (keeping 200 days of data) [2025-10-22T21:22:40.013349] [DEBUG] [LOCAL ] SYY: Primary data saved (53204 records). [2025-10-22T21:22:40.013511] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-22T21:22:40.013594] [INFO ] [MAIN ] Update Progress: 2039/2367 symbols completed. SYY took 30.5s. Estimated remaining: 42m 14s. Rate: 7.8 symbols/min [2025-10-22T21:22:40.220872] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-22T21:22:40.232711] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-10-22T21:22:42.703501] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-22T21:22:42.717970] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-10-22T21:22:45.072732] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-10-22T21:22:45.084068] [INFO ] [REMOTE ] T: Fetching primary data for 2025-10. [2025-10-22T21:22:47.565558] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-10 (2.48 seconds). [2025-10-22T21:22:47.574939] [INFO ] [REMOTE ] T: Full fetch complete (77978 records). [2025-10-22T21:22:47.575083] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-22T21:22:47.985635] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-22T21:22:47.985754] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-22T21:22:47.986912] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-22T21:22:47.986975] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-22T21:22:47.988469] [DEBUG] [LOCAL ] T: Trimmed 77978 records to 53798 (keeping 200 days of data) [2025-10-22T21:22:48.322426] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-10-22T21:22:48.322591] [INFO ] [MAIN ] T: Full history saved. [2025-10-22T21:22:48.322706] [INFO ] [MAIN ] Update Progress: 2040/2367 symbols completed. T took 29.0s. Estimated remaining: 42m 7s. Rate: 7.8 symbols/min [2025-10-22T21:22:48.953628] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:22:48.962136] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:22:49.005606] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:22:49.037858] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:22:49.112559] [DEBUG] [LOCAL ] TALO: Loaded 51003 existing records from primary storage. [2025-10-22T21:22:49.112951] [INFO ] [MAIN ] TALO: Loaded 51003 existing records. [2025-10-22T21:22:49.259336] [DEBUG] [LOCAL ] TAC: Loaded 43392 existing records from primary storage. [2025-10-22T21:22:49.271361] [INFO ] [MAIN ] TAC: Loaded 43392 existing records. [2025-10-22T21:22:49.272118] [DEBUG] [LOCAL ] TAL: Loaded 51724 existing records from primary storage. [2025-10-22T21:22:49.266023] [DEBUG] [LOCAL ] TAK: Loaded 50230 existing records from primary storage. [2025-10-22T21:22:49.294420] [INFO ] [MAIN ] TAL: Loaded 51724 existing records. [2025-10-22T21:22:49.289155] [INFO ] [MAIN ] TAK: Loaded 50230 existing records. [2025-10-22T21:22:49.649304] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:22:49.746785] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-22T21:22:49.752182] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-22T21:22:49.783725] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:22:49.804035] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-22T21:22:49.842112] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-22T21:22:49.888981] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-22T21:22:49.895291] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:22:49.918294] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-22T21:22:49.895462] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-22T21:22:49.920508] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-22T21:22:49.947097] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:22:49.918430] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-22T21:22:49.957066] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-22T21:22:49.956897] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-22T21:22:50.007339] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-22T21:22:49.995337] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-22T21:22:50.023192] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-22T21:22:50.028600] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-22T21:22:50.065452] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-22T21:22:51.186096] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:22:51.254752] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-10-22T21:22:51.393720] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:22:51.466562] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-10-22T21:22:51.512114] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:22:51.523813] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-10-22T21:22:51.558978] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:22:51.559677] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-10-22T21:22:53.074292] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T21:22:53.084556] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-10-22T21:22:53.225286] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T21:22:53.235237] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-10-22T21:22:53.263104] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T21:22:53.273129] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-10-22T21:22:53.510379] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-22T21:22:53.520561] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-10-22T21:22:54.435166] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T21:22:54.444770] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-10-22T21:22:54.860835] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T21:22:54.866184] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T21:22:54.881509] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-10-22T21:22:54.883244] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-10-22T21:22:55.429684] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-22T21:22:55.440120] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-10-22T21:22:55.980747] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T21:22:55.991211] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-10-22T21:22:56.498214] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T21:22:56.508028] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-10-22T21:22:56.591962] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T21:22:56.602938] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-10-22T21:22:57.382039] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T21:22:57.393760] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-10-22T21:22:57.717569] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T21:22:57.735333] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-10-22T21:22:57.967748] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-22T21:22:57.982350] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-10-22T21:22:58.178742] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T21:22:58.193929] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-10-22T21:22:59.248400] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T21:22:59.259768] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-10-22T21:22:59.431907] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T21:22:59.443330] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-10-22T21:22:59.645935] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T21:22:59.656501] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-10-22T21:23:05.266448] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (5.82 seconds). [2025-10-22T21:23:05.277539] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-10-22T21:23:05.398474] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (6.14 seconds). [2025-10-22T21:23:05.410569] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-10-22T21:23:05.440220] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (7.25 seconds). [2025-10-22T21:23:05.452802] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-10-22T21:23:06.183955] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (6.53 seconds). [2025-10-22T21:23:06.194100] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-10-22T21:23:06.525541] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T21:23:06.536832] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-10-22T21:23:07.122918] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T21:23:07.142170] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-10-22T21:23:07.159700] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T21:23:07.169497] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-10-22T21:23:07.609698] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-22T21:23:07.621121] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-10-22T21:23:08.195511] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T21:23:08.208026] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-10-22T21:23:08.653515] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T21:23:08.666092] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-10-22T21:23:08.946092] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T21:23:08.956074] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-10-22T21:23:09.048386] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T21:23:09.059345] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-10-22T21:23:09.679208] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T21:23:09.691256] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-10. [2025-10-22T21:23:10.398179] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T21:23:10.409763] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-10-22T21:23:10.497118] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T21:23:10.506314] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-10-22T21:23:10.680701] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T21:23:10.692139] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-10. [2025-10-22T21:23:11.106185] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T21:23:11.114555] [INFO ] [REMOTE ] TALO: Full fetch complete (73403 records). [2025-10-22T21:23:11.114703] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-22T21:23:11.493313] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-22T21:23:11.493391] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-22T21:23:11.494496] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-22T21:23:11.494558] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-22T21:23:11.495892] [DEBUG] [LOCAL ] TALO: Trimmed 73403 records to 50988 (keeping 200 days of data) [2025-10-22T21:23:11.806475] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T21:23:11.818231] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-10. [2025-10-22T21:23:11.865272] [DEBUG] [LOCAL ] TALO: Primary data saved (50988 records). [2025-10-22T21:23:11.865483] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-22T21:23:11.865591] [INFO ] [MAIN ] Update Progress: 2041/2367 symbols completed. TALO took 23.5s. Estimated remaining: 42m 2s. Rate: 7.8 symbols/min [2025-10-22T21:23:11.932506] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T21:23:11.981979] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-10. [2025-10-22T21:23:12.054681] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:23:12.105129] [DEBUG] [LOCAL ] TAP: Loaded 52976 existing records from primary storage. [2025-10-22T21:23:12.105444] [INFO ] [MAIN ] TAP: Loaded 52976 existing records. [2025-10-22T21:23:12.283011] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:23:12.283215] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-22T21:23:12.283366] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-22T21:23:12.283606] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-22T21:23:12.283705] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-22T21:23:12.508964] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T21:23:12.596665] [INFO ] [REMOTE ] TAK: Full fetch complete (72065 records). [2025-10-22T21:23:12.596812] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-22T21:23:12.796547] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:23:12.814109] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-10-22T21:23:13.059226] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-22T21:23:13.059387] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-22T21:23:13.060618] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-22T21:23:13.060702] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-22T21:23:13.062020] [DEBUG] [LOCAL ] TAK: Trimmed 72065 records to 50230 (keeping 200 days of data) [2025-10-22T21:23:13.308254] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T21:23:13.325833] [INFO ] [REMOTE ] TAC: Full fetch complete (64788 records). [2025-10-22T21:23:13.325990] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-22T21:23:13.516437] [DEBUG] [LOCAL ] TAK: Primary data saved (50230 records). [2025-10-22T21:23:13.534494] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-22T21:23:13.544919] [INFO ] [MAIN ] Update Progress: 2042/2367 symbols completed. TAK took 25.2s. Estimated remaining: 41m 53s. Rate: 7.8 symbols/min [2025-10-22T21:23:13.957940] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:23:13.961533] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-22T21:23:13.962050] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-22T21:23:13.963336] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-22T21:23:13.963534] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-22T21:23:13.988244] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-22T21:23:13.999254] [DEBUG] [LOCAL ] TAC: Trimmed 64788 records to 43411 (keeping 200 days of data) [2025-10-22T21:23:13.999527] [INFO ] [REMOTE ] TAL: Full fetch complete (75713 records). [2025-10-22T21:23:14.004240] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-22T21:23:14.004508] [DEBUG] [LOCAL ] TBB: Loaded 11406 existing records from primary storage. [2025-10-22T21:23:14.005037] [INFO ] [MAIN ] TBB: Loaded 11406 existing records. [2025-10-22T21:23:14.439856] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:23:14.483975] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-22T21:23:14.497720] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-22T21:23:14.533837] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-10-22T21:23:14.541791] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-22T21:23:14.943377] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-22T21:23:14.964416] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-22T21:23:14.996902] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-22T21:23:15.016433] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-22T21:23:15.121885] [DEBUG] [LOCAL ] TAL: Trimmed 75713 records to 51715 (keeping 200 days of data) [2025-10-22T21:23:15.241466] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-22T21:23:15.339969] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-10-22T21:23:15.413070] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:23:15.425911] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-10-22T21:23:15.518306] [DEBUG] [LOCAL ] TAC: Primary data saved (43411 records). [2025-10-22T21:23:15.523557] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-22T21:23:15.536855] [INFO ] [MAIN ] Update Progress: 2043/2367 symbols completed. TAC took 27.2s. Estimated remaining: 41m 44s. Rate: 7.8 symbols/min [2025-10-22T21:23:15.789772] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:23:15.802887] [DEBUG] [LOCAL ] TAL: Primary data saved (51715 records). [2025-10-22T21:23:15.803192] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-22T21:23:15.803299] [INFO ] [MAIN ] Update Progress: 2044/2367 symbols completed. TAL took 27.5s. Estimated remaining: 41m 35s. Rate: 7.8 symbols/min [2025-10-22T21:23:15.985798] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:23:15.999374] [DEBUG] [LOCAL ] TBBB: Loaded 35673 existing records from primary storage. [2025-10-22T21:23:15.999825] [INFO ] [MAIN ] TBBB: Loaded 35673 existing records. [2025-10-22T21:23:16.140159] [DEBUG] [LOCAL ] TBI: Loaded 22817 existing records from primary storage. [2025-10-22T21:23:16.155900] [INFO ] [MAIN ] TBI: Loaded 22817 existing records. [2025-10-22T21:23:16.285702] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:23:16.324197] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-22T21:23:16.324415] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-22T21:23:16.330187] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-22T21:23:16.335363] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-22T21:23:16.498870] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:23:16.509407] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-22T21:23:16.509525] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-22T21:23:16.543864] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-10-22T21:23:16.544193] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T21:23:16.559123] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-22T21:23:16.600622] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-10-22T21:23:17.003432] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:23:17.031470] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-10-22T21:23:17.154120] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:23:17.154843] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-10-22T21:23:17.331925] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-22T21:23:17.341815] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-10-22T21:23:17.463358] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-22T21:23:17.717718] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-10-22T21:23:17.913736] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T21:23:17.976361] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T21:23:18.517677] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-10-22T21:23:18.604108] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-22T21:23:19.190877] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T21:23:19.294166] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T21:23:19.317711] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-10-22T21:23:20.117631] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-10-22T21:23:20.397623] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T21:23:20.917678] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-10-22T21:23:21.621527] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T21:23:21.717697] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-10-22T21:23:22.517711] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-10-22T21:23:22.631315] [DEBUG] [REMOTE ] TBB: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-22T21:23:22.631786] [WARN ] [REMOTE ] TBB: No data returned for month 2025-04 [2025-10-22T21:23:22.631890] [FATAL] [REMOTE ] TBB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:23:22.631983] [FATAL] [MAIN ] TBB: Failed to fetch primary data. [2025-10-22T21:23:22.632024] [WARN ] [MAIN ] TBB: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:23:22.632070] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-22T21:23:22.632137] [DEBUG] [LOCAL ] TBB: No primary data file found to delete. [2025-10-22T21:23:22.632174] [INFO ] [LOCAL ] TBB: Starting deletion of derivative data. [2025-10-22T21:23:22.632480] [DEBUG] [LOCAL ] TBB: Deleted derivative data file. [2025-10-22T21:23:22.632578] [INFO ] [MAIN ] Update Progress: 2045/2367 symbols completed. TBB took 9.0s. Estimated remaining: 41m 28s. Rate: 7.8 symbols/min [2025-10-22T21:23:22.817984] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:23:22.818433] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-22T21:23:22.818722] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-22T21:23:22.819022] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-22T21:23:22.819239] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-22T21:23:22.819328] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-22T21:23:22.819557] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-22T21:23:23.120410] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-22T21:23:23.257152] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:23:23.281820] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-22T21:23:23.317621] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-10-22T21:23:24.117711] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-10-22T21:23:24.501916] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-22T21:23:24.841940] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T21:23:24.917611] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-10-22T21:23:25.717666] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-10-22T21:23:26.255396] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-22T21:23:26.517668] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-10-22T21:23:26.872395] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-22T21:23:27.317633] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-10-22T21:23:27.550283] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T21:23:28.117676] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-10-22T21:23:28.456962] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-22T21:23:28.549272] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-22T21:23:28.917637] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-10-22T21:23:29.717747] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-10-22T21:23:30.327742] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T21:23:30.517726] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-10-22T21:23:30.957193] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-22T21:23:31.317692] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-10-22T21:23:31.957427] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-22T21:23:32.117683] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-10-22T21:23:32.230753] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-22T21:23:32.378996] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-22T21:23:32.917694] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-10-22T21:23:33.717720] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-10-22T21:23:34.239427] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-22T21:23:34.517634] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-10-22T21:23:35.100580] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T21:23:35.317688] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-10-22T21:23:35.957973] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T21:23:36.117683] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-10. [2025-10-22T21:23:36.862624] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T21:23:36.917676] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-10-22T21:23:37.560224] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T21:23:37.566745] [INFO ] [REMOTE ] TBBB: Full fetch complete (52138 records). [2025-10-22T21:23:37.566842] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-22T21:23:37.739217] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-10-22T21:23:37.944829] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-22T21:23:37.944953] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-22T21:23:37.945935] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-22T21:23:37.945999] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-22T21:23:37.947152] [DEBUG] [LOCAL ] TBBB: Trimmed 52138 records to 35604 (keeping 200 days of data) [2025-10-22T21:23:38.052338] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T21:23:38.179153] [DEBUG] [LOCAL ] TBBB: Primary data saved (35604 records). [2025-10-22T21:23:38.179300] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-22T21:23:38.179382] [INFO ] [MAIN ] Update Progress: 2046/2367 symbols completed. TBBB took 22.6s. Estimated remaining: 41m 21s. Rate: 7.8 symbols/min [2025-10-22T21:23:38.331736] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-22T21:23:38.349781] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:23:38.356069] [DEBUG] [LOCAL ] TBN: Loaded 4035 existing records from primary storage. [2025-10-22T21:23:38.356252] [INFO ] [MAIN ] TBN: Loaded 4035 existing records. [2025-10-22T21:23:38.530172] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-10-22T21:23:38.534970] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:23:38.535569] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-22T21:23:38.536485] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-22T21:23:38.536698] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-22T21:23:38.536755] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-22T21:23:38.882975] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:23:39.137698] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-22T21:23:39.317707] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-10-22T21:23:39.679420] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-22T21:23:40.117688] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-10-22T21:23:40.917735] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-10-22T21:23:41.717721] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-10-22T21:23:41.969121] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-22T21:23:41.970017] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T21:23:42.300299] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-22T21:23:42.517742] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-10-22T21:23:43.029926] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-22T21:23:43.317686] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-10-22T21:23:44.117712] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-10-22T21:23:44.379402] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T21:23:44.467542] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-22T21:23:44.917720] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-10-22T21:23:45.290077] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-22T21:23:45.717705] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-10-22T21:23:46.320979] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T21:23:46.517720] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-10-22T21:23:46.948677] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-22T21:23:47.317758] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-10-22T21:23:47.762899] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-22T21:23:48.117698] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-10-22T21:23:48.612905] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-22T21:23:48.917683] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-10-22T21:23:49.717740] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-10. [2025-10-22T21:23:50.517708] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-10. [2025-10-22T21:23:50.820279] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T21:23:50.825204] [INFO ] [REMOTE ] TBI: Full fetch complete (32142 records). [2025-10-22T21:23:50.844035] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-22T21:23:50.883018] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-22T21:23:50.907019] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T21:23:50.908473] [INFO ] [REMOTE ] TBLU: Full fetch complete (1217 records). [2025-10-22T21:23:50.908803] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-22T21:23:51.320632] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-10-22T21:23:51.362781] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-22T21:23:51.364068] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:23:51.375148] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:23:51.375372] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-22T21:23:51.375458] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-22T21:23:51.375818] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-22T21:23:51.375913] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-22T21:23:51.381375] [INFO ] [MAIN ] Update Progress: 2047/2367 symbols completed. TBLU took 28.7s. Estimated remaining: 41m 14s. Rate: 7.8 symbols/min [2025-10-22T21:23:51.561041] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-22T21:23:51.561159] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-22T21:23:51.562155] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-22T21:23:51.562235] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-22T21:23:51.614071] [DEBUG] [LOCAL ] TBI: Trimmed 32142 records to 22761 (keeping 200 days of data) [2025-10-22T21:23:51.632218] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:23:51.632577] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-22T21:23:51.632628] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-22T21:23:51.633197] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-22T21:23:51.633266] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-22T21:23:51.633313] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-22T21:23:51.633346] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-22T21:23:51.832137] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-22T21:23:51.895352] [DEBUG] [LOCAL ] TBI: Primary data saved (22761 records). [2025-10-22T21:23:51.918679] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-22T21:23:51.918816] [INFO ] [MAIN ] Update Progress: 2048/2367 symbols completed. TBI took 36.1s. Estimated remaining: 41m 5s. Rate: 7.8 symbols/min [2025-10-22T21:23:52.133270] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-10. [2025-10-22T21:23:52.280974] [INFO ] [MAIN ] TCBX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:23:52.301308] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:23:52.312706] [DEBUG] [LOCAL ] TCBX: Loaded 10240 existing records from primary storage. [2025-10-22T21:23:52.312979] [INFO ] [MAIN ] TCBX: Loaded 10240 existing records. [2025-10-22T21:23:52.487957] [WARN ] [MAIN ] TCBX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:23:52.488187] [INFO ] [MAIN ] TCBX: Wiping existing primary data before full refresh. [2025-10-22T21:23:52.488235] [INFO ] [LOCAL ] TCBX: Starting deletion of primary data. [2025-10-22T21:23:52.488373] [DEBUG] [LOCAL ] TCBX: Deleted primary data file. [2025-10-22T21:23:52.488411] [INFO ] [MAIN ] TCBX: Starting full primary refresh. [2025-10-22T21:23:52.857388] [INFO ] [REMOTE ] TCBX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:23:52.917633] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-01. [2025-10-22T21:23:53.152135] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:23:53.152504] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-01 [2025-10-22T21:23:53.152616] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:23:53.152723] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-22T21:23:53.152806] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:23:53.152888] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-22T21:23:53.152989] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-22T21:23:53.153058] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-22T21:23:53.153118] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-22T21:23:53.153178] [INFO ] [MAIN ] Update Progress: 2049/2367 symbols completed. TCAI took 1.8s. Estimated remaining: 40m 57s. Rate: 7.8 symbols/min [2025-10-22T21:23:53.336672] [INFO ] [MAIN ] TCPA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:23:53.336864] [DEBUG] [LOCAL ] TCPA: No existing data file found in primary storage. [2025-10-22T21:23:53.336905] [WARN ] [MAIN ] TCPA: No existing data found, performing full refresh instead. [2025-10-22T21:23:53.337016] [INFO ] [MAIN ] TCPA: Wiping existing primary data before full refresh. [2025-10-22T21:23:53.337057] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-22T21:23:53.337097] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-22T21:23:53.337129] [INFO ] [MAIN ] TCPA: Starting full primary refresh. [2025-10-22T21:23:53.689059] [INFO ] [REMOTE ] TCPA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:23:53.717617] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-01. [2025-10-22T21:23:53.964935] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-22T21:23:53.973800] [INFO ] [REMOTE ] TAP: Full fetch complete (76526 records). [2025-10-22T21:23:53.973929] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-22T21:23:54.360842] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-22T21:23:54.360920] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-22T21:23:54.362037] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-22T21:23:54.362108] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-22T21:23:54.363476] [DEBUG] [LOCAL ] TAP: Trimmed 76526 records to 52959 (keeping 200 days of data) [2025-10-22T21:23:54.536053] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-10-22T21:23:54.668723] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-22T21:23:54.693575] [DEBUG] [LOCAL ] TAP: Primary data saved (52959 records). [2025-10-22T21:23:54.693700] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-22T21:23:54.693781] [INFO ] [MAIN ] Update Progress: 2050/2367 symbols completed. TAP took 42.8s. Estimated remaining: 40m 48s. Rate: 7.8 symbols/min [2025-10-22T21:23:54.862490] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:23:54.908175] [DEBUG] [LOCAL ] TD: Loaded 52251 existing records from primary storage. [2025-10-22T21:23:54.908474] [INFO ] [MAIN ] TD: Loaded 52251 existing records. [2025-10-22T21:23:55.013337] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-22T21:23:55.110912] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:23:55.111136] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-22T21:23:55.111183] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-22T21:23:55.111636] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-22T21:23:55.111723] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-22T21:23:55.322822] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-10-22T21:23:55.458103] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:23:56.117977] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-10-22T21:23:56.117831] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T21:23:56.917701] [INFO ] [REMOTE ] TCPA: Fetching primary data for 2025-01. [2025-10-22T21:23:57.287628] [DEBUG] [REMOTE ] TCPA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:23:57.288126] [WARN ] [REMOTE ] TCPA: No data returned for month 2025-01 [2025-10-22T21:23:57.288226] [FATAL] [REMOTE ] TCPA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:23:57.288275] [FATAL] [MAIN ] TCPA: Failed to fetch primary data. [2025-10-22T21:23:57.288335] [WARN ] [MAIN ] TCPA: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:23:57.288411] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-22T21:23:57.288535] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-22T21:23:57.288581] [INFO ] [LOCAL ] TCPA: Starting deletion of derivative data. [2025-10-22T21:23:57.288622] [DEBUG] [LOCAL ] TCPA: No derivative data file found to delete. [2025-10-22T21:23:57.288708] [INFO ] [MAIN ] Update Progress: 2051/2367 symbols completed. TCPA took 4.1s. Estimated remaining: 40m 39s. Rate: 7.8 symbols/min [2025-10-22T21:23:57.464420] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:23:57.508738] [DEBUG] [LOCAL ] TDC: Loaded 46430 existing records from primary storage. [2025-10-22T21:23:57.509145] [INFO ] [MAIN ] TDC: Loaded 46430 existing records. [2025-10-22T21:23:57.693262] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:23:57.693711] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-22T21:23:57.693785] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-22T21:23:57.694285] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-22T21:23:57.694351] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-22T21:23:57.724316] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-02. [2025-10-22T21:23:58.093417] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:23:58.125505] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-22T21:23:58.517676] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-10. [2025-10-22T21:23:58.593571] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-22T21:23:59.309633] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-22T21:23:59.311879] [INFO ] [REMOTE ] TBN: Full fetch complete (5968 records). [2025-10-22T21:23:59.311950] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-22T21:23:59.323426] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-10-22T21:23:59.689508] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-22T21:23:59.689660] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-22T21:23:59.689963] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-22T21:23:59.690027] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-22T21:23:59.690473] [DEBUG] [LOCAL ] TBN: Trimmed 5968 records to 4034 (keeping 200 days of data) [2025-10-22T21:23:59.717226] [DEBUG] [LOCAL ] TBN: Primary data saved (4034 records). [2025-10-22T21:23:59.717426] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-22T21:23:59.717568] [INFO ] [MAIN ] Update Progress: 2052/2367 symbols completed. TBN took 21.5s. Estimated remaining: 40m 31s. Rate: 7.8 symbols/min [2025-10-22T21:23:59.898567] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:23:59.907262] [DEBUG] [LOCAL ] TDF: Loaded 6251 existing records from primary storage. [2025-10-22T21:23:59.907564] [INFO ] [MAIN ] TDF: Loaded 6251 existing records. [2025-10-22T21:24:00.115403] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:24:00.115744] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-22T21:24:00.115819] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-22T21:24:00.116086] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-22T21:24:00.116146] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-22T21:24:00.128476] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-10-22T21:24:00.515705] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:24:00.917676] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-10-22T21:24:01.341420] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-22T21:24:01.720437] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T21:24:01.718536] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-03. [2025-10-22T21:24:01.736335] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-22T21:24:02.517682] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-10-22T21:24:02.528798] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T21:24:03.266755] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-22T21:24:03.317690] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-04. [2025-10-22T21:24:04.117706] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-10-22T21:24:04.306278] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T21:24:04.917759] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-10-22T21:24:05.717688] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-05. [2025-10-22T21:24:05.838668] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T21:24:06.474713] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T21:24:06.517697] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-06. [2025-10-22T21:24:06.727778] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T21:24:07.257409] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-22T21:24:07.317710] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-10-22T21:24:08.066554] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-22T21:24:08.117703] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-10-22T21:24:08.917751] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-10-22T21:24:09.639580] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-22T21:24:09.717713] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-10-22T21:24:09.900620] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T21:24:10.517750] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-10-22T21:24:11.317741] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-10-22T21:24:11.377752] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T21:24:11.975868] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-22T21:24:12.117693] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-07. [2025-10-22T21:24:12.407580] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T21:24:12.874864] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-22T21:24:12.917707] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-08. [2025-10-22T21:24:13.500508] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T21:24:13.717728] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-10-22T21:24:14.517713] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-10-22T21:24:15.093518] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-22T21:24:15.273926] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T21:24:15.317721] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-10-22T21:24:16.007240] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-22T21:24:16.117627] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-10-22T21:24:16.917674] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-09. [2025-10-22T21:24:17.688294] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T21:24:17.717681] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-10. [2025-10-22T21:24:17.768755] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T21:24:18.478226] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-22T21:24:18.480497] [INFO ] [REMOTE ] TCBX: Full fetch complete (15836 records). [2025-10-22T21:24:18.480574] [DEBUG] [VALIDATOR ] TCBX: Validating primary data. [2025-10-22T21:24:18.522788] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-10-22T21:24:18.841403] [DEBUG] [VALIDATOR ] TCBX: All expected trading days are present. [2025-10-22T21:24:18.841513] [DEBUG] [VALIDATOR ] TCBX: Primary data validation passed. [2025-10-22T21:24:18.841896] [INFO ] [MAIN ] TCBX: Fetched primary data is valid. [2025-10-22T21:24:18.841957] [DEBUG] [LOCAL ] TCBX: Saving primary data. [2025-10-22T21:24:18.842529] [DEBUG] [LOCAL ] TCBX: Trimmed 15836 records to 10195 (keeping 200 days of data) [2025-10-22T21:24:18.903517] [DEBUG] [LOCAL ] TCBX: Primary data saved (10195 records). [2025-10-22T21:24:18.903703] [INFO ] [MAIN ] TCBX: Full history saved. [2025-10-22T21:24:18.903798] [INFO ] [MAIN ] Update Progress: 2053/2367 symbols completed. TCBX took 27.0s. Estimated remaining: 40m 25s. Rate: 7.8 symbols/min [2025-10-22T21:24:19.076778] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:24:19.100372] [DEBUG] [LOCAL ] TDG: Loaded 22101 existing records from primary storage. [2025-10-22T21:24:19.100602] [INFO ] [MAIN ] TDG: Loaded 22101 existing records. [2025-10-22T21:24:19.227348] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-22T21:24:19.318790] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-10-22T21:24:19.322689] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:24:19.322987] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-22T21:24:19.323201] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-22T21:24:19.324032] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-22T21:24:19.324098] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-22T21:24:19.676133] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:24:20.117678] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-10-22T21:24:20.917633] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-10-22T21:24:21.063210] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T21:24:21.246001] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-22T21:24:21.717740] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-10-22T21:24:22.530055] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-10-22T21:24:22.537245] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T21:24:22.563459] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-22T21:24:23.290479] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-22T21:24:23.317616] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-10. [2025-10-22T21:24:24.072518] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T21:24:24.074153] [INFO ] [REMOTE ] TDF: Full fetch complete (10357 records). [2025-10-22T21:24:24.074223] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-22T21:24:24.122862] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-10-22T21:24:24.438714] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-22T21:24:24.438799] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-22T21:24:24.439088] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-22T21:24:24.439129] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-22T21:24:24.439571] [DEBUG] [LOCAL ] TDF: Trimmed 10357 records to 6197 (keeping 200 days of data) [2025-10-22T21:24:24.480836] [DEBUG] [LOCAL ] TDF: Primary data saved (6197 records). [2025-10-22T21:24:24.480970] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-22T21:24:24.481052] [INFO ] [MAIN ] Update Progress: 2054/2367 symbols completed. TDF took 24.8s. Estimated remaining: 40m 17s. Rate: 7.8 symbols/min [2025-10-22T21:24:24.668837] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:24:24.719471] [DEBUG] [LOCAL ] TDOC: Loaded 53368 existing records from primary storage. [2025-10-22T21:24:24.719885] [INFO ] [MAIN ] TDOC: Loaded 53368 existing records. [2025-10-22T21:24:24.921691] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-10-22T21:24:24.925722] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:24:24.926604] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-22T21:24:24.926697] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-22T21:24:24.926965] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-10-22T21:24:24.927023] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-22T21:24:25.308261] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:24:25.717751] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-10-22T21:24:25.948830] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T21:24:26.517693] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-10-22T21:24:26.594988] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T21:24:27.217702] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T21:24:27.317635] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-10-22T21:24:28.117678] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-10-22T21:24:28.446026] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T21:24:28.647733] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-22T21:24:28.917692] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-10-22T21:24:29.717750] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-10-22T21:24:29.873350] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T21:24:30.517720] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-10-22T21:24:31.114669] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-22T21:24:31.317634] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-10. [2025-10-22T21:24:31.420768] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T21:24:32.117676] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-10-22T21:24:32.917698] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-10-22T21:24:33.658876] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T21:24:33.717638] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-10-22T21:24:33.969251] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (3.45 seconds). [2025-10-22T21:24:34.517686] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-10-22T21:24:34.730516] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T21:24:35.317630] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-10-22T21:24:35.371581] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T21:24:35.674619] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-22T21:24:36.117688] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-10. [2025-10-22T21:24:36.315557] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-10 (5.00 seconds). [2025-10-22T21:24:36.324759] [INFO ] [REMOTE ] TD: Full fetch complete (75900 records). [2025-10-22T21:24:36.324944] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-22T21:24:36.727939] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-22T21:24:36.728061] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-22T21:24:36.729312] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-22T21:24:36.729379] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-22T21:24:36.730824] [DEBUG] [LOCAL ] TD: Trimmed 75900 records to 52240 (keeping 200 days of data) [2025-10-22T21:24:36.941371] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-10-22T21:24:37.057098] [DEBUG] [LOCAL ] TD: Primary data saved (52240 records). [2025-10-22T21:24:37.057303] [INFO ] [MAIN ] TD: Full history saved. [2025-10-22T21:24:37.057414] [INFO ] [MAIN ] Update Progress: 2055/2367 symbols completed. TD took 42.4s. Estimated remaining: 40m 10s. Rate: 7.8 symbols/min [2025-10-22T21:24:37.235575] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:24:37.273996] [DEBUG] [LOCAL ] TDS: Loaded 42285 existing records from primary storage. [2025-10-22T21:24:37.274297] [INFO ] [MAIN ] TDS: Loaded 42285 existing records. [2025-10-22T21:24:37.454505] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:24:37.454895] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-22T21:24:37.455076] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-22T21:24:37.455343] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-22T21:24:37.455409] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-22T21:24:37.628998] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-22T21:24:37.724824] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-10-22T21:24:37.885698] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:24:37.888666] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T21:24:37.896824] [INFO ] [REMOTE ] TDC: Full fetch complete (67781 records). [2025-10-22T21:24:37.896919] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-22T21:24:38.164842] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T21:24:38.317288] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-22T21:24:38.317382] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-22T21:24:38.318487] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-22T21:24:38.318553] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-22T21:24:38.319964] [DEBUG] [LOCAL ] TDC: Trimmed 67781 records to 46401 (keeping 200 days of data) [2025-10-22T21:24:38.522836] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-10-22T21:24:38.590123] [DEBUG] [LOCAL ] TDC: Primary data saved (46401 records). [2025-10-22T21:24:38.590272] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-22T21:24:38.590372] [INFO ] [MAIN ] Update Progress: 2056/2367 symbols completed. TDC took 41.3s. Estimated remaining: 40m 1s. Rate: 7.8 symbols/min [2025-10-22T21:24:38.757698] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:24:38.796490] [DEBUG] [LOCAL ] TDW: Loaded 44963 existing records from primary storage. [2025-10-22T21:24:38.796788] [INFO ] [MAIN ] TDW: Loaded 44963 existing records. [2025-10-22T21:24:38.969875] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:24:38.970053] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-22T21:24:38.970099] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-22T21:24:38.970271] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-22T21:24:38.970308] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-22T21:24:39.319574] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-10-22T21:24:39.319496] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:24:40.117771] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-10-22T21:24:40.283109] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T21:24:40.832861] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T21:24:40.917611] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-10-22T21:24:41.717699] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-10-22T21:24:41.789794] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (4.06 seconds). [2025-10-22T21:24:42.517665] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-10-22T21:24:42.732416] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-22T21:24:42.982104] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-22T21:24:43.259198] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-22T21:24:43.317732] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-10. [2025-10-22T21:24:44.117686] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-10-22T21:24:44.410428] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T21:24:44.414814] [INFO ] [REMOTE ] TDG: Full fetch complete (32068 records). [2025-10-22T21:24:44.414910] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-22T21:24:44.809168] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-22T21:24:44.809288] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-22T21:24:44.810232] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-22T21:24:44.810295] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-22T21:24:44.811275] [DEBUG] [LOCAL ] TDG: Trimmed 32068 records to 21943 (keeping 200 days of data) [2025-10-22T21:24:44.921013] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-10-22T21:24:44.962379] [DEBUG] [LOCAL ] TDG: Primary data saved (21943 records). [2025-10-22T21:24:44.962563] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-22T21:24:44.962694] [INFO ] [MAIN ] Update Progress: 2057/2367 symbols completed. TDG took 26.1s. Estimated remaining: 39m 53s. Rate: 7.8 symbols/min [2025-10-22T21:24:45.139627] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:24:45.161751] [DEBUG] [LOCAL ] TDY: Loaded 22123 existing records from primary storage. [2025-10-22T21:24:45.162113] [INFO ] [MAIN ] TDY: Loaded 22123 existing records. [2025-10-22T21:24:45.355999] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:24:45.356328] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-22T21:24:45.356392] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-22T21:24:45.356729] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-22T21:24:45.356789] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-22T21:24:45.700769] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (3.18 seconds). [2025-10-22T21:24:45.763485] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-10-22T21:24:45.796132] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:24:45.826067] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T21:24:46.517732] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-10-22T21:24:46.569459] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T21:24:47.317674] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-10-22T21:24:47.595160] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T21:24:48.122985] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-10-22T21:24:48.152223] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-22T21:24:48.917630] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-10-22T21:24:49.090452] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T21:24:49.717707] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-10-22T21:24:50.418590] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-22T21:24:50.517683] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-10-22T21:24:50.811929] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T21:24:50.867128] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-22T21:24:51.317700] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-10-22T21:24:51.975609] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-22T21:24:52.117685] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-10-22T21:24:52.501337] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-22T21:24:52.917691] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-10-22T21:24:53.717711] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-10-22T21:24:54.390126] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-22T21:24:54.414281] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T21:24:54.517631] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-10-22T21:24:55.317677] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-10-22T21:24:55.414509] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T21:24:55.987795] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T21:24:56.117737] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-10-22T21:24:56.464995] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T21:24:56.917674] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-10-22T21:24:57.717694] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-10-22T21:24:58.207057] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-22T21:24:58.517671] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-10-22T21:24:59.068217] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-22T21:24:59.224016] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-22T21:24:59.317687] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-10-22T21:24:59.444543] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T21:25:00.117678] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-10. [2025-10-22T21:25:00.917713] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-10-22T21:25:00.972693] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T21:25:01.717776] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-10-22T21:25:02.292281] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-22T21:25:02.306213] [INFO ] [REMOTE ] TDOC: Full fetch complete (77439 records). [2025-10-22T21:25:02.306425] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-22T21:25:02.426840] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T21:25:02.525892] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-10-22T21:25:02.728478] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-22T21:25:02.728587] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-22T21:25:02.729813] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-22T21:25:02.729884] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-22T21:25:02.731424] [DEBUG] [LOCAL ] TDOC: Trimmed 77439 records to 53369 (keeping 200 days of data) [2025-10-22T21:25:03.040273] [DEBUG] [LOCAL ] TDOC: Primary data saved (53369 records). [2025-10-22T21:25:03.040452] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-22T21:25:03.041214] [INFO ] [MAIN ] Update Progress: 2058/2367 symbols completed. TDOC took 38.6s. Estimated remaining: 39m 47s. Rate: 7.8 symbols/min [2025-10-22T21:25:03.212290] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:25:03.212514] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-22T21:25:03.212683] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-22T21:25:03.212820] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-22T21:25:03.212862] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-22T21:25:03.212903] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-22T21:25:03.212935] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-22T21:25:03.322888] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-10-22T21:25:03.570469] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:25:03.716559] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T21:25:03.749805] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-22T21:25:04.117714] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-10-22T21:25:04.917699] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-10-22T21:25:04.988734] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T21:25:05.544405] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-22T21:25:05.717703] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-01. [2025-10-22T21:25:05.920678] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:25:05.921016] [WARN ] [REMOTE ] TE: No data returned for month 2025-01 [2025-10-22T21:25:05.921104] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:25:05.921154] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-22T21:25:05.921187] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:25:05.921222] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-22T21:25:05.921277] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-22T21:25:05.921318] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-22T21:25:05.921357] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-22T21:25:05.921402] [INFO ] [MAIN ] Update Progress: 2059/2367 symbols completed. TE took 2.9s. Estimated remaining: 39m 39s. Rate: 7.8 symbols/min [2025-10-22T21:25:06.090899] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-22T21:25:06.123581] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:25:06.134549] [DEBUG] [LOCAL ] TEAF: Loaded 7398 existing records from primary storage. [2025-10-22T21:25:06.134790] [INFO ] [MAIN ] TEAF: Loaded 7398 existing records. [2025-10-22T21:25:06.307270] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:25:06.307438] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-22T21:25:06.307513] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-22T21:25:06.307698] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-22T21:25:06.307753] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-22T21:25:06.522862] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-10. [2025-10-22T21:25:06.674483] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:25:07.317722] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-10-22T21:25:07.948504] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-22T21:25:08.117701] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-10-22T21:25:08.218331] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T21:25:08.224787] [INFO ] [REMOTE ] TDS: Full fetch complete (61395 records). [2025-10-22T21:25:08.224876] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-22T21:25:08.595427] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-22T21:25:08.595507] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-22T21:25:08.596428] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-22T21:25:08.596490] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-22T21:25:08.597618] [DEBUG] [LOCAL ] TDS: Trimmed 61395 records to 42187 (keeping 200 days of data) [2025-10-22T21:25:08.845006] [DEBUG] [LOCAL ] TDS: Primary data saved (42187 records). [2025-10-22T21:25:08.845153] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-22T21:25:08.845239] [INFO ] [MAIN ] Update Progress: 2060/2367 symbols completed. TDS took 31.8s. Estimated remaining: 39m 30s. Rate: 7.8 symbols/min [2025-10-22T21:25:08.922860] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-10-22T21:25:09.012781] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:25:09.058882] [DEBUG] [LOCAL ] TECK: Loaded 53435 existing records from primary storage. [2025-10-22T21:25:09.059172] [INFO ] [MAIN ] TECK: Loaded 53435 existing records. [2025-10-22T21:25:09.234725] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:25:09.234904] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-22T21:25:09.234953] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-22T21:25:09.235128] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-22T21:25:09.235165] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-22T21:25:09.593017] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:25:09.594207] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-22T21:25:09.717632] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-10-22T21:25:09.765590] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T21:25:10.517627] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-10. [2025-10-22T21:25:11.317686] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-10-22T21:25:11.503588] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T21:25:12.017530] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-22T21:25:12.121822] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-10-22T21:25:12.126517] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T21:25:12.134262] [INFO ] [REMOTE ] TDW: Full fetch complete (66687 records). [2025-10-22T21:25:12.134386] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-22T21:25:12.547750] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-22T21:25:12.547833] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-22T21:25:12.549016] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-22T21:25:12.549081] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-22T21:25:12.550351] [DEBUG] [LOCAL ] TDW: Trimmed 66687 records to 44907 (keeping 200 days of data) [2025-10-22T21:25:12.817638] [DEBUG] [LOCAL ] TDW: Primary data saved (44907 records). [2025-10-22T21:25:12.817811] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-22T21:25:12.817899] [INFO ] [MAIN ] Update Progress: 2061/2367 symbols completed. TDW took 34.2s. Estimated remaining: 39m 22s. Rate: 7.8 symbols/min [2025-10-22T21:25:12.922752] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-10-22T21:25:12.988950] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:25:13.020909] [DEBUG] [LOCAL ] TEF: Loaded 36837 existing records from primary storage. [2025-10-22T21:25:13.021182] [INFO ] [MAIN ] TEF: Loaded 36837 existing records. [2025-10-22T21:25:13.193629] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:25:13.193843] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-22T21:25:13.193888] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-22T21:25:13.194120] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-22T21:25:13.194156] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-22T21:25:13.547713] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:25:13.629688] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-22T21:25:13.717624] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-10-22T21:25:14.015754] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-22T21:25:14.185358] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-22T21:25:14.517671] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-10-22T21:25:15.240255] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-22T21:25:15.317627] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-10-22T21:25:16.117696] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-10-22T21:25:16.838828] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-22T21:25:16.870413] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T21:25:16.917679] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-10. [2025-10-22T21:25:17.717624] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-10-22T21:25:17.954275] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T21:25:17.957824] [INFO ] [REMOTE ] TDY: Full fetch complete (32094 records). [2025-10-22T21:25:17.957906] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-22T21:25:18.341208] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-22T21:25:18.341331] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-22T21:25:18.342560] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-22T21:25:18.342628] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-22T21:25:18.343489] [DEBUG] [LOCAL ] TDY: Trimmed 32094 records to 22146 (keeping 200 days of data) [2025-10-22T21:25:18.481967] [DEBUG] [LOCAL ] TDY: Primary data saved (22146 records). [2025-10-22T21:25:18.482095] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-22T21:25:18.482176] [INFO ] [MAIN ] Update Progress: 2062/2367 symbols completed. TDY took 33.5s. Estimated remaining: 39m 14s. Rate: 7.8 symbols/min [2025-10-22T21:25:18.522804] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-10-22T21:25:18.670298] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:25:18.688715] [DEBUG] [LOCAL ] TEI: Loaded 21227 existing records from primary storage. [2025-10-22T21:25:18.688973] [INFO ] [MAIN ] TEI: Loaded 21227 existing records. [2025-10-22T21:25:18.865588] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:25:18.865897] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-22T21:25:18.865956] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-22T21:25:18.866171] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-22T21:25:18.866222] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-22T21:25:19.225157] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:25:19.283453] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-22T21:25:19.317684] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-10-22T21:25:19.744411] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-22T21:25:20.117786] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-10-22T21:25:20.295134] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T21:25:20.917733] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-10-22T21:25:21.534556] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T21:25:21.717697] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-10-22T21:25:22.014530] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T21:25:22.517679] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-10-22T21:25:23.317684] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-10-22T21:25:23.590082] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T21:25:24.117691] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-10-22T21:25:24.177218] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T21:25:24.380097] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-22T21:25:24.917687] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-10-22T21:25:25.689873] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T21:25:25.717625] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-10-22T21:25:25.949442] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T21:25:26.517678] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-10. [2025-10-22T21:25:26.776866] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T21:25:26.970362] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-22T21:25:26.972223] [INFO ] [REMOTE ] TEAF: Full fetch complete (10189 records). [2025-10-22T21:25:26.972297] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-22T21:25:27.325176] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-10-22T21:25:27.325425] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-22T21:25:27.325685] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-22T21:25:27.326532] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-22T21:25:27.326606] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-22T21:25:27.327260] [DEBUG] [LOCAL ] TEAF: Trimmed 10189 records to 7331 (keeping 200 days of data) [2025-10-22T21:25:27.374516] [DEBUG] [LOCAL ] TEAF: Primary data saved (7331 records). [2025-10-22T21:25:27.374618] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-22T21:25:27.374734] [INFO ] [MAIN ] Update Progress: 2063/2367 symbols completed. TEAF took 21.5s. Estimated remaining: 39m 6s. Rate: 7.8 symbols/min [2025-10-22T21:25:27.541431] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:25:27.591137] [DEBUG] [LOCAL ] TEL: Loaded 51052 existing records from primary storage. [2025-10-22T21:25:27.591466] [INFO ] [MAIN ] TEL: Loaded 51052 existing records. [2025-10-22T21:25:27.762860] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:25:27.763098] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-22T21:25:27.763158] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-22T21:25:27.763347] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-22T21:25:27.763403] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-22T21:25:28.111581] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:25:28.117608] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-10-22T21:25:28.917626] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-10-22T21:25:29.034338] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T21:25:29.717671] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-10-22T21:25:30.000576] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T21:25:30.458379] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T21:25:30.517661] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-10-22T21:25:31.317669] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-10-22T21:25:31.601104] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T21:25:31.978270] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T21:25:32.117679] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-10-22T21:25:32.917688] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-10-22T21:25:32.945353] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T21:25:33.543034] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T21:25:33.717677] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-10-22T21:25:33.993962] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T21:25:34.517715] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-10-22T21:25:35.317712] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-10-22T21:25:35.542602] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T21:25:35.658380] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T21:25:36.117695] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-10-22T21:25:36.917636] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-10-22T21:25:37.176674] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T21:25:37.178194] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T21:25:37.717625] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-10-22T21:25:38.069913] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T21:25:38.517631] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-10-22T21:25:39.317677] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-10-22T21:25:39.695683] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T21:25:39.899315] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T21:25:40.117633] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-10. [2025-10-22T21:25:40.370218] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T21:25:40.917694] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-10-22T21:25:41.497394] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T21:25:41.504245] [INFO ] [REMOTE ] TEF: Full fetch complete (54535 records). [2025-10-22T21:25:41.504381] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-22T21:25:41.729753] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-10-22T21:25:41.893888] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-22T21:25:41.893974] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-22T21:25:41.894984] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-22T21:25:41.895048] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-22T21:25:41.896188] [DEBUG] [LOCAL ] TEF: Trimmed 54535 records to 36800 (keeping 200 days of data) [2025-10-22T21:25:42.106972] [DEBUG] [LOCAL ] TEF: Primary data saved (36800 records). [2025-10-22T21:25:42.107100] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-22T21:25:42.107174] [INFO ] [MAIN ] Update Progress: 2064/2367 symbols completed. TEF took 29.3s. Estimated remaining: 38m 60s. Rate: 7.8 symbols/min [2025-10-22T21:25:42.276196] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:25:42.303137] [DEBUG] [LOCAL ] TEN: Loaded 30504 existing records from primary storage. [2025-10-22T21:25:42.303390] [INFO ] [MAIN ] TEN: Loaded 30504 existing records. [2025-10-22T21:25:42.477979] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:25:42.478235] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-22T21:25:42.478291] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-22T21:25:42.478491] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-22T21:25:42.478531] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-22T21:25:42.540220] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-10. [2025-10-22T21:25:42.833018] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:25:42.867131] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T21:25:42.895235] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-22T21:25:43.317675] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-10. [2025-10-22T21:25:44.117634] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-10-22T21:25:44.238800] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-22T21:25:44.242885] [INFO ] [REMOTE ] TEI: Full fetch complete (30720 records). [2025-10-22T21:25:44.242962] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-22T21:25:44.639243] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-22T21:25:44.649748] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-22T21:25:44.650256] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-22T21:25:44.650952] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-22T21:25:44.651028] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-22T21:25:44.651748] [INFO ] [REMOTE ] TECK: Full fetch complete (77531 records). [2025-10-22T21:25:44.652120] [DEBUG] [LOCAL ] TEI: Trimmed 30720 records to 21181 (keeping 200 days of data) [2025-10-22T21:25:44.652040] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-22T21:25:44.934464] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-10-22T21:25:45.035401] [DEBUG] [LOCAL ] TEI: Primary data saved (21181 records). [2025-10-22T21:25:45.056032] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-22T21:25:45.082738] [INFO ] [MAIN ] Update Progress: 2065/2367 symbols completed. TEI took 26.6s. Estimated remaining: 38m 51s. Rate: 7.8 symbols/min [2025-10-22T21:25:45.326968] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-22T21:25:45.342269] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-22T21:25:45.343588] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-22T21:25:45.346303] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:25:45.346438] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-22T21:25:45.348330] [DEBUG] [LOCAL ] TECK: Trimmed 77531 records to 53435 (keeping 200 days of data) [2025-10-22T21:25:45.464479] [DEBUG] [LOCAL ] TEO: Loaded 22817 existing records from primary storage. [2025-10-22T21:25:45.472331] [INFO ] [MAIN ] TEO: Loaded 22817 existing records. [2025-10-22T21:25:45.771452] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:25:45.778748] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-22T21:25:45.782491] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-22T21:25:45.790131] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-22T21:25:45.790586] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-22T21:25:46.122201] [DEBUG] [LOCAL ] TECK: Primary data saved (53435 records). [2025-10-22T21:25:46.151116] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-22T21:25:46.151436] [INFO ] [MAIN ] Update Progress: 2066/2367 symbols completed. TECK took 37.3s. Estimated remaining: 38m 43s. Rate: 7.8 symbols/min [2025-10-22T21:25:46.313608] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-22T21:25:46.336297] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:25:46.381413] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-10-22T21:25:46.476662] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:25:46.474445] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T21:25:46.482922] [DEBUG] [LOCAL ] TEVA: No existing data file found in primary storage. [2025-10-22T21:25:46.482975] [WARN ] [MAIN ] TEVA: No existing data found, performing full refresh instead. [2025-10-22T21:25:46.483081] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-22T21:25:46.483122] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-22T21:25:46.483162] [DEBUG] [LOCAL ] TEVA: No primary data file found to delete. [2025-10-22T21:25:46.483193] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-22T21:25:46.523905] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-10-22T21:25:46.826116] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:25:47.317690] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-10-22T21:25:47.557323] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-22T21:25:47.754212] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T21:25:48.117697] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-10-22T21:25:48.917627] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-10-22T21:25:49.270856] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T21:25:49.450464] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T21:25:49.717700] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-10-22T21:25:50.517759] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-10-22T21:25:50.769350] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T21:25:51.160990] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T21:25:51.317620] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-10-22T21:25:52.117696] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-10-22T21:25:52.580210] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-22T21:25:52.917629] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-10-22T21:25:53.119142] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T21:25:53.167209] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T21:25:53.717619] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-10-22T21:25:54.041716] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-22T21:25:54.517679] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-10-22T21:25:55.317716] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-10-22T21:25:55.556990] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-22T21:25:56.085181] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T21:25:56.117610] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-10-22T21:25:56.341232] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T21:25:56.917717] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-10-22T21:25:57.210715] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T21:25:57.717622] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-10-22T21:25:57.968032] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T21:25:58.517670] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-10-22T21:25:58.716535] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T21:25:59.317685] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-10-22T21:26:00.117696] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-10-22T21:26:00.556535] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-22T21:26:00.677211] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T21:26:00.917718] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-10. [2025-10-22T21:26:01.452611] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T21:26:01.717720] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-10-22T21:26:02.094956] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-22T21:26:02.099841] [INFO ] [REMOTE ] TEN: Full fetch complete (44000 records). [2025-10-22T21:26:02.099966] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-22T21:26:02.472141] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-22T21:26:02.472214] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-22T21:26:02.473054] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-22T21:26:02.473116] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-22T21:26:02.473984] [DEBUG] [LOCAL ] TEN: Trimmed 44000 records to 30257 (keeping 200 days of data) [2025-10-22T21:26:02.524056] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-10-22T21:26:02.654783] [DEBUG] [LOCAL ] TEN: Primary data saved (30257 records). [2025-10-22T21:26:02.654937] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-22T21:26:02.655059] [INFO ] [MAIN ] Update Progress: 2067/2367 symbols completed. TEN took 20.5s. Estimated remaining: 38m 36s. Rate: 7.8 symbols/min [2025-10-22T21:26:02.822511] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:26:02.860768] [DEBUG] [LOCAL ] TEX: Loaded 43602 existing records from primary storage. [2025-10-22T21:26:02.861090] [INFO ] [MAIN ] TEX: Loaded 43602 existing records. [2025-10-22T21:26:03.038589] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:26:03.038880] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-22T21:26:03.038977] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-22T21:26:03.039190] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-22T21:26:03.039250] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-22T21:26:03.320472] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-10-22T21:26:03.397355] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:26:03.483111] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T21:26:04.117696] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-10-22T21:26:04.521506] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-22T21:26:04.732309] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-22T21:26:04.917639] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-10-22T21:26:05.717736] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-10-22T21:26:05.850683] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-22T21:26:06.518614] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-10. [2025-10-22T21:26:06.521289] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T21:26:06.907522] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-22T21:26:07.317667] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-10-22T21:26:08.117714] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-10-22T21:26:08.293898] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T21:26:08.302195] [INFO ] [REMOTE ] TEL: Full fetch complete (73831 records). [2025-10-22T21:26:08.302316] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-22T21:26:08.681849] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-22T21:26:08.681925] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-22T21:26:08.683019] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-22T21:26:08.683085] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-22T21:26:08.684391] [DEBUG] [LOCAL ] TEL: Trimmed 73831 records to 51046 (keeping 200 days of data) [2025-10-22T21:26:08.919456] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-10-22T21:26:09.014866] [DEBUG] [LOCAL ] TEL: Primary data saved (51046 records). [2025-10-22T21:26:09.015004] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-22T21:26:09.015601] [INFO ] [MAIN ] Update Progress: 2068/2367 symbols completed. TEL took 41.6s. Estimated remaining: 38m 28s. Rate: 7.8 symbols/min [2025-10-22T21:26:09.200831] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:26:09.202181] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-22T21:26:09.256117] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-22T21:26:09.256433] [INFO ] [MAIN ] TFC: Loaded 53667 existing records. [2025-10-22T21:26:09.439168] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:26:09.466895] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-22T21:26:09.467017] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-22T21:26:09.467585] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-10-22T21:26:09.468730] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T21:26:09.468787] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-22T21:26:09.729970] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-10-22T21:26:09.863440] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:26:10.207356] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-22T21:26:10.517692] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-10-22T21:26:11.086942] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T21:26:11.317638] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-10-22T21:26:12.117675] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-10-22T21:26:12.506709] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-22T21:26:12.917634] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-10. [2025-10-22T21:26:13.122626] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T21:26:13.717711] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-10-22T21:26:13.783883] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T21:26:13.789152] [INFO ] [REMOTE ] TEO: Full fetch complete (32666 records). [2025-10-22T21:26:13.789266] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-22T21:26:14.235002] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-22T21:26:14.235112] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-22T21:26:14.235944] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-22T21:26:14.236056] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-22T21:26:14.237381] [DEBUG] [LOCAL ] TEO: Trimmed 32666 records to 22745 (keeping 200 days of data) [2025-10-22T21:26:14.351117] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-22T21:26:14.412543] [DEBUG] [LOCAL ] TEO: Primary data saved (22745 records). [2025-10-22T21:26:14.412733] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-22T21:26:14.412837] [INFO ] [MAIN ] Update Progress: 2069/2367 symbols completed. TEO took 29.3s. Estimated remaining: 38m 20s. Rate: 7.8 symbols/min [2025-10-22T21:26:14.522889] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-10-22T21:26:14.610526] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:26:14.644059] [DEBUG] [LOCAL ] TFII: Loaded 32402 existing records from primary storage. [2025-10-22T21:26:14.644400] [INFO ] [MAIN ] TFII: Loaded 32402 existing records. [2025-10-22T21:26:14.834570] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:26:14.834832] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-22T21:26:14.834879] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-22T21:26:14.835086] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-22T21:26:14.835141] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-22T21:26:15.215012] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:26:15.244744] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T21:26:15.317623] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-10-22T21:26:16.117628] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-10-22T21:26:16.917634] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-10-22T21:26:17.064911] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-22T21:26:17.468085] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-10-22T21:26:17.717725] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-10-22T21:26:17.776442] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T21:26:17.865402] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-22T21:26:18.517733] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-10-22T21:26:19.317625] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-10-22T21:26:19.567928] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T21:26:20.106595] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T21:26:20.117635] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-10-22T21:26:20.917716] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-10-22T21:26:21.301432] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T21:26:21.447895] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T21:26:21.717803] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-10-22T21:26:22.517634] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-10-22T21:26:22.894584] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T21:26:23.322773] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-10-22T21:26:23.345094] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T21:26:23.909772] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T21:26:24.117811] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-10-22T21:26:24.917684] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-10-22T21:26:25.483484] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-22T21:26:25.635822] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T21:26:25.717679] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-10-22T21:26:26.517710] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-10. [2025-10-22T21:26:26.603812] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T21:26:27.317690] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-10-22T21:26:27.657897] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-22T21:26:28.117637] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-10-22T21:26:28.448215] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T21:26:28.458406] [INFO ] [REMOTE ] TEVA: Full fetch complete (77785 records). [2025-10-22T21:26:28.458594] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-10-22T21:26:28.901446] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-10-22T21:26:28.901809] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-10-22T21:26:28.903514] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-10-22T21:26:28.903687] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-10-22T21:26:28.905404] [DEBUG] [LOCAL ] TEVA: Trimmed 77785 records to 53622 (keeping 200 days of data) [2025-10-22T21:26:28.956435] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-10. [2025-10-22T21:26:29.158590] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T21:26:29.301449] [DEBUG] [LOCAL ] TEVA: Primary data saved (53622 records). [2025-10-22T21:26:29.301673] [INFO ] [MAIN ] TEVA: Full history saved. [2025-10-22T21:26:29.301783] [INFO ] [MAIN ] Update Progress: 2070/2367 symbols completed. TEVA took 43.1s. Estimated remaining: 38m 13s. Rate: 7.8 symbols/min [2025-10-22T21:26:29.473781] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:26:29.498470] [DEBUG] [LOCAL ] TFIN: Loaded 23764 existing records from primary storage. [2025-10-22T21:26:29.498878] [INFO ] [MAIN ] TFIN: Loaded 23764 existing records. [2025-10-22T21:26:29.689758] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:26:29.690081] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-22T21:26:29.690142] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-22T21:26:29.690380] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-22T21:26:29.690420] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-22T21:26:29.722374] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-10-22T21:26:30.113461] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:26:30.151252] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-22T21:26:30.518333] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-10-22T21:26:30.522947] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T21:26:30.530782] [INFO ] [REMOTE ] TEX: Full fetch complete (64375 records). [2025-10-22T21:26:30.530942] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-22T21:26:30.939674] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-22T21:26:30.939763] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-22T21:26:30.940916] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-22T21:26:30.940978] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-22T21:26:30.942229] [DEBUG] [LOCAL ] TEX: Trimmed 64375 records to 43477 (keeping 200 days of data) [2025-10-22T21:26:31.189797] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T21:26:31.227745] [DEBUG] [LOCAL ] TEX: Primary data saved (43477 records). [2025-10-22T21:26:31.227864] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-22T21:26:31.227937] [INFO ] [MAIN ] Update Progress: 2071/2367 symbols completed. TEX took 28.6s. Estimated remaining: 38m 5s. Rate: 7.8 symbols/min [2025-10-22T21:26:31.325483] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-10-22T21:26:31.399609] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:26:31.435128] [DEBUG] [LOCAL ] TFPM: Loaded 39841 existing records from primary storage. [2025-10-22T21:26:31.435401] [INFO ] [MAIN ] TFPM: Loaded 39841 existing records. [2025-10-22T21:26:31.620151] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:26:31.620460] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-22T21:26:31.621408] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T21:26:31.620957] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-22T21:26:31.625591] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-22T21:26:31.625670] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-22T21:26:31.976935] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:26:32.117685] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-10-22T21:26:32.605493] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-22T21:26:32.917691] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-10-22T21:26:33.258446] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T21:26:33.717637] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-10-22T21:26:34.114882] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T21:26:34.517749] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-10-22T21:26:34.732308] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T21:26:35.317708] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-10-22T21:26:35.760369] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-22T21:26:36.117689] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-10-22T21:26:36.418049] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T21:26:36.917694] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-10-22T21:26:37.540247] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T21:26:37.717638] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-10-22T21:26:38.517707] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-10-22T21:26:39.019667] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-22T21:26:39.043229] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-22T21:26:39.317629] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-10-22T21:26:39.759884] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-22T21:26:40.117731] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-10-22T21:26:40.917679] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-10-22T21:26:41.216980] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T21:26:41.268001] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-22T21:26:41.717727] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-10-22T21:26:42.232221] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-22T21:26:42.517730] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-10. [2025-10-22T21:26:43.317695] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-10-22T21:26:43.692680] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-22T21:26:43.889793] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-22T21:26:43.894920] [INFO ] [REMOTE ] TFII: Full fetch complete (47945 records). [2025-10-22T21:26:43.895008] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-22T21:26:44.122898] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-10. [2025-10-22T21:26:44.270853] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-22T21:26:44.270950] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-22T21:26:44.271994] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-22T21:26:44.272145] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-22T21:26:44.273188] [DEBUG] [LOCAL ] TFII: Trimmed 47945 records to 32251 (keeping 200 days of data) [2025-10-22T21:26:44.380117] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-22T21:26:44.485876] [DEBUG] [LOCAL ] TFII: Primary data saved (32251 records). [2025-10-22T21:26:44.485999] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-22T21:26:44.486073] [INFO ] [MAIN ] Update Progress: 2072/2367 symbols completed. TFII took 30.1s. Estimated remaining: 37m 58s. Rate: 7.8 symbols/min [2025-10-22T21:26:44.653579] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:26:44.687280] [DEBUG] [LOCAL ] TFX: Loaded 35780 existing records from primary storage. [2025-10-22T21:26:44.687586] [INFO ] [MAIN ] TFX: Loaded 35780 existing records. [2025-10-22T21:26:44.860168] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:26:44.860387] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-22T21:26:44.860433] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-22T21:26:44.860604] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-22T21:26:44.860666] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-22T21:26:44.925200] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-10-22T21:26:45.240619] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:26:45.717701] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-10-22T21:26:46.032061] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-22T21:26:46.041591] [INFO ] [REMOTE ] TFC: Full fetch complete (77843 records). [2025-10-22T21:26:46.041764] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-22T21:26:46.444855] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-22T21:26:46.445059] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-22T21:26:46.446274] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-22T21:26:46.446361] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-22T21:26:46.448023] [DEBUG] [LOCAL ] TFC: Trimmed 77843 records to 53667 (keeping 200 days of data) [2025-10-22T21:26:46.536906] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-10-22T21:26:46.567905] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T21:26:46.608446] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-22T21:26:46.827936] [DEBUG] [LOCAL ] TFC: Primary data saved (53667 records). [2025-10-22T21:26:46.828075] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-22T21:26:46.828946] [INFO ] [MAIN ] Update Progress: 2073/2367 symbols completed. TFC took 37.8s. Estimated remaining: 37m 49s. Rate: 7.8 symbols/min [2025-10-22T21:26:46.995124] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:26:47.007341] [DEBUG] [LOCAL ] TG: Loaded 10652 existing records from primary storage. [2025-10-22T21:26:47.007579] [INFO ] [MAIN ] TG: Loaded 10652 existing records. [2025-10-22T21:26:47.190093] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:26:47.190343] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-22T21:26:47.190412] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-22T21:26:47.190595] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-22T21:26:47.190688] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-22T21:26:47.329440] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-10-22T21:26:47.547872] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:26:48.117734] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-10-22T21:26:48.122637] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T21:26:48.231804] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-22T21:26:48.917727] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-10-22T21:26:49.607103] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T21:26:49.719590] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T21:26:49.718820] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-10-22T21:26:50.517619] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-10-22T21:26:50.899150] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-22T21:26:51.317725] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-10-22T21:26:51.745486] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-22T21:26:52.019954] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T21:26:52.117612] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-10-22T21:26:52.917737] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-10. [2025-10-22T21:26:53.717633] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-10-22T21:26:53.882006] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T21:26:53.999217] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-22T21:26:54.003704] [INFO ] [REMOTE ] TFIN: Full fetch complete (32645 records). [2025-10-22T21:26:54.003801] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-22T21:26:54.364672] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-22T21:26:54.364769] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-22T21:26:54.365422] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-22T21:26:54.365463] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-22T21:26:54.366199] [DEBUG] [LOCAL ] TFIN: Trimmed 32645 records to 23665 (keeping 200 days of data) [2025-10-22T21:26:54.499183] [DEBUG] [LOCAL ] TFIN: Primary data saved (23665 records). [2025-10-22T21:26:54.499304] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-22T21:26:54.499379] [INFO ] [MAIN ] Update Progress: 2074/2367 symbols completed. TFIN took 25.2s. Estimated remaining: 37m 42s. Rate: 7.8 symbols/min [2025-10-22T21:26:54.529430] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-10-22T21:26:54.667096] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:26:54.667272] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-22T21:26:54.667310] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-22T21:26:54.667423] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-22T21:26:54.667513] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-22T21:26:54.667587] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-22T21:26:54.667633] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-22T21:26:55.031132] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:26:55.051170] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T21:26:55.317635] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-10-22T21:26:55.416722] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-22T21:26:56.117692] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-10-22T21:26:56.812424] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T21:26:56.917636] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-10-22T21:26:57.699983] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T21:26:57.717617] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-10-22T21:26:58.432620] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T21:26:58.517639] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-01. [2025-10-22T21:26:58.626680] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-22T21:26:58.722437] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:26:58.722805] [WARN ] [REMOTE ] TGE: No data returned for month 2025-01 [2025-10-22T21:26:58.722908] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:26:58.723006] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-22T21:26:58.723093] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:26:58.723187] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-22T21:26:58.723272] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-22T21:26:58.723310] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-22T21:26:58.723349] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-22T21:26:58.723395] [INFO ] [MAIN ] Update Progress: 2075/2367 symbols completed. TGE took 4.2s. Estimated remaining: 37m 34s. Rate: 7.8 symbols/min [2025-10-22T21:26:58.922737] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:26:58.950210] [DEBUG] [LOCAL ] TGLS: Loaded 27714 existing records from primary storage. [2025-10-22T21:26:58.950464] [INFO ] [MAIN ] TGLS: Loaded 27714 existing records. [2025-10-22T21:26:59.120486] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:26:59.120699] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-22T21:26:59.120778] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-22T21:26:59.120971] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-22T21:26:59.121025] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-22T21:26:59.322744] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-10-22T21:26:59.469066] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:27:00.117680] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-10-22T21:27:00.917768] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-10-22T21:27:01.085840] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T21:27:01.468012] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T21:27:01.717683] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-10-22T21:27:02.467027] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T21:27:02.517725] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-10-22T21:27:02.974685] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-22T21:27:03.268947] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-22T21:27:03.317634] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-10-22T21:27:04.095211] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T21:27:04.117600] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-10-22T21:27:04.917699] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-10-22T21:27:04.963447] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-22T21:27:05.717759] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-10. [2025-10-22T21:27:06.182044] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T21:27:06.517720] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-10-22T21:27:07.317679] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-10-22T21:27:07.466198] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T21:27:07.474286] [INFO ] [REMOTE ] TFPM: Full fetch complete (53030 records). [2025-10-22T21:27:07.474443] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-22T21:27:07.807093] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-22T21:27:07.938901] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-22T21:27:07.938985] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-22T21:27:07.939979] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-22T21:27:07.940043] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-22T21:27:07.941185] [DEBUG] [LOCAL ] TFPM: Trimmed 53030 records to 39860 (keeping 200 days of data) [2025-10-22T21:27:08.118492] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-10-22T21:27:08.180921] [DEBUG] [LOCAL ] TFPM: Primary data saved (39860 records). [2025-10-22T21:27:08.181043] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-22T21:27:08.181120] [INFO ] [MAIN ] Update Progress: 2076/2367 symbols completed. TFPM took 37.0s. Estimated remaining: 37m 26s. Rate: 7.8 symbols/min [2025-10-22T21:27:08.360362] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:27:08.381039] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-22T21:27:08.430010] [DEBUG] [LOCAL ] TGNA: Loaded 48566 existing records from primary storage. [2025-10-22T21:27:08.430336] [INFO ] [MAIN ] TGNA: Loaded 48566 existing records. [2025-10-22T21:27:08.614935] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:27:08.615144] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-22T21:27:08.615193] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-22T21:27:08.615416] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-22T21:27:08.615483] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-22T21:27:08.775143] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-22T21:27:08.922960] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-10-22T21:27:09.024187] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:27:09.717762] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-10-22T21:27:10.376807] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T21:27:10.517627] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-10-22T21:27:11.259084] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T21:27:11.317619] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-10-22T21:27:11.665870] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-22T21:27:12.117726] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-10-22T21:27:12.172698] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T21:27:12.917695] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-10-22T21:27:13.717703] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-10-22T21:27:14.104219] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-22T21:27:14.170880] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T21:27:14.517690] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-10. [2025-10-22T21:27:15.154728] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T21:27:15.317692] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-10-22T21:27:15.331418] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T21:27:15.334157] [INFO ] [REMOTE ] TG: Full fetch complete (15156 records). [2025-10-22T21:27:15.334232] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-22T21:27:15.690128] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-22T21:27:15.690202] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-22T21:27:15.690533] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-22T21:27:15.690571] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-22T21:27:15.691071] [DEBUG] [LOCAL ] TG: Trimmed 15156 records to 10631 (keeping 200 days of data) [2025-10-22T21:27:15.749494] [DEBUG] [LOCAL ] TG: Primary data saved (10631 records). [2025-10-22T21:27:15.749606] [INFO ] [MAIN ] TG: Full history saved. [2025-10-22T21:27:15.749712] [INFO ] [MAIN ] Update Progress: 2077/2367 symbols completed. TG took 28.9s. Estimated remaining: 37m 18s. Rate: 7.8 symbols/min [2025-10-22T21:27:16.117668] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-10-22T21:27:16.818535] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T21:27:16.917717] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-10. [2025-10-22T21:27:17.717740] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-10-22T21:27:17.798393] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T21:27:18.198217] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T21:27:18.204244] [INFO ] [REMOTE ] TFX: Full fetch complete (54755 records). [2025-10-22T21:27:18.204383] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-22T21:27:18.522884] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-10-22T21:27:18.592914] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-22T21:27:18.592999] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-22T21:27:18.594040] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-22T21:27:18.594103] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-22T21:27:18.595254] [DEBUG] [LOCAL ] TFX: Trimmed 54755 records to 35633 (keeping 200 days of data) [2025-10-22T21:27:18.811751] [DEBUG] [LOCAL ] TFX: Primary data saved (35633 records). [2025-10-22T21:27:18.811881] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-22T21:27:18.811958] [INFO ] [MAIN ] Update Progress: 2078/2367 symbols completed. TFX took 34.3s. Estimated remaining: 37m 10s. Rate: 7.8 symbols/min [2025-10-22T21:27:19.086357] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T21:27:19.317741] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-10-22T21:27:20.203679] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T21:27:20.214027] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-10-22T21:27:20.667407] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-22T21:27:20.917747] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-10. [2025-10-22T21:27:21.955115] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T21:27:21.959768] [INFO ] [REMOTE ] TGLS: Full fetch complete (40580 records). [2025-10-22T21:27:21.959857] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-22T21:27:22.335287] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-22T21:27:22.335393] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-22T21:27:22.336317] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-22T21:27:22.336381] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-22T21:27:22.337256] [DEBUG] [LOCAL ] TGLS: Trimmed 40580 records to 27643 (keeping 200 days of data) [2025-10-22T21:27:22.523580] [DEBUG] [LOCAL ] TGLS: Primary data saved (27643 records). [2025-10-22T21:27:22.523819] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-22T21:27:22.523935] [INFO ] [MAIN ] Update Progress: 2079/2367 symbols completed. TGLS took 23.8s. Estimated remaining: 37m 2s. Rate: 7.8 symbols/min [2025-10-22T21:27:22.693836] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-22T21:27:22.704457] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-10-22T21:27:24.389632] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T21:27:24.399980] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-10-22T21:27:25.921849] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T21:27:25.931259] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-10-22T21:27:27.654873] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T21:27:27.665012] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-10-22T21:27:29.271791] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T21:27:29.283443] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-10-22T21:27:31.036431] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T21:27:31.047972] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-10. [2025-10-22T21:27:32.733906] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T21:27:32.742526] [INFO ] [REMOTE ] TGNA: Full fetch complete (70062 records). [2025-10-22T21:27:32.742743] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-22T21:27:33.156739] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-22T21:27:33.156891] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-22T21:27:33.158980] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-22T21:27:33.159108] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-22T21:27:33.161207] [DEBUG] [LOCAL ] TGNA: Trimmed 70062 records to 48517 (keeping 200 days of data) [2025-10-22T21:27:33.475822] [DEBUG] [LOCAL ] TGNA: Primary data saved (48517 records). [2025-10-22T21:27:33.476010] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-22T21:27:33.476116] [INFO ] [MAIN ] Update Progress: 2080/2367 symbols completed. TGNA took 25.3s. Estimated remaining: 36m 54s. Rate: 7.8 symbols/min [2025-10-22T21:27:34.077721] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:27:34.177256] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:27:34.228866] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:27:34.248064] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:27:34.290927] [DEBUG] [LOCAL ] THG: Loaded 21609 existing records from primary storage. [2025-10-22T21:27:34.291418] [INFO ] [MAIN ] THG: Loaded 21609 existing records. [2025-10-22T21:27:34.292434] [DEBUG] [LOCAL ] TGS: Loaded 33875 existing records from primary storage. [2025-10-22T21:27:34.303758] [INFO ] [MAIN ] TGS: Loaded 33875 existing records. [2025-10-22T21:27:34.573783] [DEBUG] [LOCAL ] THC: Loaded 46709 existing records from primary storage. [2025-10-22T21:27:34.579368] [INFO ] [MAIN ] THC: Loaded 46709 existing records. [2025-10-22T21:27:34.685979] [DEBUG] [LOCAL ] TGT: Loaded 53777 existing records from primary storage. [2025-10-22T21:27:34.811278] [INFO ] [MAIN ] TGT: Loaded 53777 existing records. [2025-10-22T21:27:34.923359] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:27:34.979718] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:27:34.985177] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-22T21:27:35.002453] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-22T21:27:35.008141] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-22T21:27:35.013717] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-22T21:27:35.046777] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-22T21:27:35.074273] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-22T21:27:35.057983] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-22T21:27:35.121684] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-22T21:27:35.535431] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:27:35.606191] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-22T21:27:35.654626] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-22T21:27:35.686177] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:27:35.686242] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-22T21:27:35.724776] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-22T21:27:35.735234] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-22T21:27:35.745774] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-22T21:27:35.777433] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-22T21:27:35.830053] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-22T21:27:36.097787] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:27:36.228797] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-10-22T21:27:36.514350] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:27:36.550741] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-10-22T21:27:36.794794] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:27:36.799377] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-10-22T21:27:36.886697] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:27:36.887111] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-10-22T21:27:37.975209] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T21:27:37.984139] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-10-22T21:27:38.052141] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T21:27:38.056296] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-10-22T21:27:38.556137] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T21:27:38.565452] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-10-22T21:27:38.883116] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-22T21:27:38.888291] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-10-22T21:27:38.965013] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T21:27:38.971931] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-10-22T21:27:39.094281] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-22T21:27:39.107227] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-10-22T21:27:39.753481] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T21:27:39.758775] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-10-22T21:27:40.150414] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T21:27:40.164177] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-10-22T21:27:40.373999] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T21:27:40.381107] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-10-22T21:27:40.820318] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T21:27:40.826778] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-10-22T21:27:41.175282] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-22T21:27:41.185611] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-10-22T21:27:41.598149] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-22T21:27:41.605342] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-10-22T21:27:41.735150] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-22T21:27:41.742211] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-10-22T21:27:41.886462] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T21:27:41.896994] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-10-22T21:27:42.630916] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T21:27:42.635713] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-10-22T21:27:43.073260] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T21:27:43.080094] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-10-22T21:27:43.627739] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-22T21:27:43.639265] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-10-22T21:27:43.668586] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T21:27:43.680126] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-10-22T21:27:43.765920] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T21:27:44.014918] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-22T21:27:44.117780] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-10-22T21:27:44.917709] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-10-22T21:27:45.230267] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T21:27:45.589201] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T21:27:45.717695] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-10-22T21:27:45.755282] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-22T21:27:46.253413] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-22T21:27:46.517709] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-10-22T21:27:46.812013] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T21:27:47.317761] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-10. [2025-10-22T21:27:48.117665] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-10-22T21:27:48.352493] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T21:27:48.356346] [INFO ] [REMOTE ] THG: Full fetch complete (31479 records). [2025-10-22T21:27:48.356425] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-22T21:27:48.688795] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-22T21:27:48.768328] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-22T21:27:48.768412] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-22T21:27:48.769115] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-22T21:27:48.769176] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-22T21:27:48.769893] [DEBUG] [LOCAL ] THG: Trimmed 31479 records to 21455 (keeping 200 days of data) [2025-10-22T21:27:48.899124] [DEBUG] [LOCAL ] THG: Primary data saved (21455 records). [2025-10-22T21:27:48.899250] [INFO ] [MAIN ] THG: Full history saved. [2025-10-22T21:27:48.899325] [INFO ] [MAIN ] Update Progress: 2081/2367 symbols completed. THG took 15.4s. Estimated remaining: 36m 48s. Rate: 7.8 symbols/min [2025-10-22T21:27:48.927955] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-10-22T21:27:49.067066] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:27:49.071473] [DEBUG] [LOCAL ] THIR: Loaded 2426 existing records from primary storage. [2025-10-22T21:27:49.071606] [INFO ] [MAIN ] THIR: Loaded 2426 existing records. [2025-10-22T21:27:49.242840] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:27:49.243069] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-22T21:27:49.243115] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-22T21:27:49.243230] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-22T21:27:49.243268] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-22T21:27:49.590625] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:27:49.717623] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-10-22T21:27:50.079586] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-22T21:27:50.347135] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T21:27:50.517716] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-10-22T21:27:50.590055] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-22T21:27:51.317692] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-10-22T21:27:52.117674] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-10-22T21:27:52.333106] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T21:27:52.922843] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-10-22T21:27:52.936468] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T21:27:53.279605] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-22T21:27:53.717692] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-10. [2025-10-22T21:27:54.304308] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-22T21:27:54.517707] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-10-22T21:27:54.988704] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T21:27:54.995293] [INFO ] [REMOTE ] TGS: Full fetch complete (48666 records). [2025-10-22T21:27:54.995452] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-22T21:27:55.322744] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-10-22T21:27:55.402212] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-22T21:27:55.402292] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-22T21:27:55.403355] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-22T21:27:55.403440] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-22T21:27:55.404760] [DEBUG] [LOCAL ] TGS: Trimmed 48666 records to 33787 (keeping 200 days of data) [2025-10-22T21:27:55.603952] [DEBUG] [LOCAL ] TGS: Primary data saved (33787 records). [2025-10-22T21:27:55.604075] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-22T21:27:55.604152] [INFO ] [MAIN ] Update Progress: 2082/2367 symbols completed. TGS took 22.1s. Estimated remaining: 36m 40s. Rate: 7.8 symbols/min [2025-10-22T21:27:55.777372] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:27:55.781345] [DEBUG] [LOCAL ] THLV: Loaded 1495 existing records from primary storage. [2025-10-22T21:27:55.781520] [INFO ] [MAIN ] THLV: Loaded 1495 existing records. [2025-10-22T21:27:55.962991] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:27:55.963240] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-22T21:27:55.963301] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-22T21:27:55.963462] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-22T21:27:55.963533] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-22T21:27:56.118027] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-10-22T21:27:56.319462] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:27:56.617196] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-22T21:27:56.917711] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-10-22T21:27:57.367418] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-22T21:27:57.710372] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (3.19 seconds). [2025-10-22T21:27:57.721105] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-10-22T21:27:58.152777] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-22T21:27:58.524997] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-10-22T21:27:58.542100] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (3.22 seconds). [2025-10-22T21:27:59.317713] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-10-22T21:28:00.117696] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-10-22T21:28:00.917728] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-10-22T21:28:00.969617] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T21:28:01.717762] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-10-22T21:28:01.799730] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-22T21:28:01.939829] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (3.41 seconds). [2025-10-22T21:28:01.967344] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-22T21:28:02.179922] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-22T21:28:02.517709] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-10-22T21:28:03.317682] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-10-22T21:28:03.774813] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-22T21:28:04.117698] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-10-22T21:28:04.595301] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-22T21:28:04.922729] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-10-22T21:28:04.942512] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-22T21:28:05.417396] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-22T21:28:05.717685] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-10. [2025-10-22T21:28:06.517692] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-10. [2025-10-22T21:28:07.182246] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T21:28:07.189182] [INFO ] [REMOTE ] THC: Full fetch complete (68660 records). [2025-10-22T21:28:07.189303] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-22T21:28:07.329319] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-10-22T21:28:07.596121] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-22T21:28:07.596247] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-22T21:28:07.597917] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-22T21:28:07.597989] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-22T21:28:07.599545] [DEBUG] [LOCAL ] THC: Trimmed 68660 records to 46634 (keeping 200 days of data) [2025-10-22T21:28:07.885693] [DEBUG] [LOCAL ] THC: Primary data saved (46634 records). [2025-10-22T21:28:07.885881] [INFO ] [MAIN ] THC: Full history saved. [2025-10-22T21:28:07.886011] [INFO ] [MAIN ] Update Progress: 2083/2367 symbols completed. THC took 34.4s. Estimated remaining: 36m 33s. Rate: 7.8 symbols/min [2025-10-22T21:28:08.050895] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-22T21:28:08.071605] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:28:08.114593] [DEBUG] [LOCAL ] THO: Loaded 41053 existing records from primary storage. [2025-10-22T21:28:08.114955] [INFO ] [MAIN ] THO: Loaded 41053 existing records. [2025-10-22T21:28:08.126765] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-10-22T21:28:08.293580] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:28:08.293849] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-22T21:28:08.293898] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-22T21:28:08.294087] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-22T21:28:08.294129] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-22T21:28:08.643858] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:28:08.813778] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-22T21:28:08.917690] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-10. [2025-10-22T21:28:09.062314] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-10 (2.54 seconds). [2025-10-22T21:28:09.074472] [INFO ] [REMOTE ] TGT: Full fetch complete (77955 records). [2025-10-22T21:28:09.074683] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-22T21:28:09.460636] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-22T21:28:09.461993] [INFO ] [REMOTE ] THIR: Full fetch complete (2961 records). [2025-10-22T21:28:09.462423] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-22T21:28:09.720250] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-22T21:28:09.726074] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-22T21:28:09.731202] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-22T21:28:09.720393] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-10-22T21:28:09.731406] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-22T21:28:09.855820] [DEBUG] [LOCAL ] TGT: Trimmed 77955 records to 53777 (keeping 200 days of data) [2025-10-22T21:28:10.081583] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-22T21:28:10.081745] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-22T21:28:10.081900] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-22T21:28:10.081956] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-22T21:28:10.082336] [DEBUG] [LOCAL ] THIR: Trimmed 2961 records to 2461 (keeping 200 days of data) [2025-10-22T21:28:10.182996] [DEBUG] [LOCAL ] THIR: Primary data saved (2461 records). [2025-10-22T21:28:10.184223] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-22T21:28:10.184860] [INFO ] [MAIN ] Update Progress: 2084/2367 symbols completed. THIR took 21.3s. Estimated remaining: 36m 24s. Rate: 7.8 symbols/min [2025-10-22T21:28:10.473598] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:28:10.486830] [DEBUG] [LOCAL ] TGT: Primary data saved (53777 records). [2025-10-22T21:28:10.487016] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-22T21:28:10.487108] [INFO ] [MAIN ] Update Progress: 2085/2367 symbols completed. TGT took 37.0s. Estimated remaining: 36m 16s. Rate: 7.8 symbols/min [2025-10-22T21:28:10.520019] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-10-22T21:28:10.681883] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:28:10.682509] [DEBUG] [LOCAL ] THQ: Loaded 25421 existing records from primary storage. [2025-10-22T21:28:10.683346] [INFO ] [MAIN ] THQ: Loaded 25421 existing records. [2025-10-22T21:28:10.878422] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:28:10.855908] [DEBUG] [LOCAL ] THR: Loaded 19653 existing records from primary storage. [2025-10-22T21:28:10.878805] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-22T21:28:10.878900] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-22T21:28:10.879041] [INFO ] [MAIN ] THR: Loaded 19653 existing records. [2025-10-22T21:28:10.918423] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-22T21:28:10.938623] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-22T21:28:11.079978] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-22T21:28:11.184378] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:28:11.195801] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-22T21:28:11.206144] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-22T21:28:11.261003] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-10-22T21:28:11.280076] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-22T21:28:11.342226] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-10-22T21:28:11.604756] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:28:11.750094] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-22T21:28:11.829777] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:28:11.851857] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-22T21:28:12.117726] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-10-22T21:28:12.917694] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-10-22T21:28:13.268709] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-22T21:28:13.547240] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T21:28:13.717682] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-10-22T21:28:14.517675] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-10-22T21:28:14.630193] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-22T21:28:15.103152] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-22T21:28:15.317689] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-10-22T21:28:16.117689] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-10-22T21:28:16.549266] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-22T21:28:16.917639] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-10-22T21:28:17.082609] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T21:28:17.717719] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-10-22T21:28:17.895589] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T21:28:18.517729] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-10. [2025-10-22T21:28:18.866136] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-22T21:28:18.866979] [INFO ] [REMOTE ] THLV: Full fetch complete (2538 records). [2025-10-22T21:28:18.867047] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-22T21:28:19.222364] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-22T21:28:19.222587] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-22T21:28:19.222752] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-22T21:28:19.222812] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-22T21:28:19.223132] [DEBUG] [LOCAL ] THLV: Trimmed 2538 records to 1491 (keeping 200 days of data) [2025-10-22T21:28:19.231912] [DEBUG] [LOCAL ] THLV: Primary data saved (1491 records). [2025-10-22T21:28:19.231977] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-22T21:28:19.232042] [INFO ] [MAIN ] Update Progress: 2086/2367 symbols completed. THLV took 23.6s. Estimated remaining: 36m 8s. Rate: 7.8 symbols/min [2025-10-22T21:28:19.320715] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-10-22T21:28:19.402637] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:28:19.441133] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T21:28:19.482477] [DEBUG] [LOCAL ] THS: Loaded 38685 existing records from primary storage. [2025-10-22T21:28:19.482788] [INFO ] [MAIN ] THS: Loaded 38685 existing records. [2025-10-22T21:28:19.653948] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:28:19.654171] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-22T21:28:19.654216] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-22T21:28:19.654416] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-22T21:28:19.654471] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-22T21:28:20.005585] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:28:20.117624] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-10-22T21:28:20.475143] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T21:28:20.917680] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-10-22T21:28:21.467823] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T21:28:21.717772] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-10-22T21:28:21.964729] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T21:28:22.517676] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-10-22T21:28:23.296401] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-22T21:28:23.317608] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-10-22T21:28:23.982699] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T21:28:24.117677] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-10-22T21:28:24.917706] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-10-22T21:28:25.003194] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T21:28:25.098023] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T21:28:25.717670] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-10-22T21:28:26.301196] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T21:28:26.517707] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-10-22T21:28:26.757494] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T21:28:27.317783] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-10-22T21:28:28.125213] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-10-22T21:28:28.146713] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T21:28:28.461071] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T21:28:28.892187] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-22T21:28:28.917616] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-10-22T21:28:29.717676] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-10-22T21:28:29.972181] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T21:28:30.517734] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-10-22T21:28:31.223283] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T21:28:31.276814] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-22T21:28:31.317611] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-10-22T21:28:32.117636] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-10-22T21:28:32.257759] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-22T21:28:32.917680] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-10-22T21:28:33.570422] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T21:28:33.717627] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-10-22T21:28:33.957444] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T21:28:34.517692] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-10-22T21:28:34.916634] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-22T21:28:35.317639] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-10-22T21:28:35.549153] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T21:28:36.117683] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-10-22T21:28:36.649738] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T21:28:36.917631] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-10-22T21:28:37.223106] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T21:28:37.717670] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-10. [2025-10-22T21:28:38.421172] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T21:28:38.517625] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-10-22T21:28:38.749371] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T21:28:38.752767] [INFO ] [REMOTE ] THR: Full fetch complete (28843 records). [2025-10-22T21:28:38.752893] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-22T21:28:39.122903] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-22T21:28:39.122980] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-22T21:28:39.123594] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-22T21:28:39.123635] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-22T21:28:39.124348] [DEBUG] [LOCAL ] THR: Trimmed 28843 records to 19563 (keeping 200 days of data) [2025-10-22T21:28:39.252350] [DEBUG] [LOCAL ] THR: Primary data saved (19563 records). [2025-10-22T21:28:39.252527] [INFO ] [MAIN ] THR: Full history saved. [2025-10-22T21:28:39.252664] [INFO ] [MAIN ] Update Progress: 2087/2367 symbols completed. THR took 28.8s. Estimated remaining: 36m 2s. Rate: 7.8 symbols/min [2025-10-22T21:28:39.327314] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-10-22T21:28:39.422797] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:28:39.441938] [DEBUG] [LOCAL ] THW: Loaded 19658 existing records from primary storage. [2025-10-22T21:28:39.442181] [INFO ] [MAIN ] THW: Loaded 19658 existing records. [2025-10-22T21:28:39.619525] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:28:39.619821] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-22T21:28:39.619876] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-22T21:28:39.620094] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-22T21:28:39.620151] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-22T21:28:39.984329] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T21:28:40.004276] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:28:40.117688] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-10-22T21:28:40.807851] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T21:28:40.917618] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-10-22T21:28:41.286404] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T21:28:41.717746] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-10-22T21:28:42.359314] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T21:28:42.517720] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-10-22T21:28:43.189966] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-22T21:28:43.317703] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-10-22T21:28:43.643112] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T21:28:44.117630] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-10-22T21:28:44.833849] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T21:28:44.917671] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-10. [2025-10-22T21:28:45.717668] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-10-22T21:28:46.098929] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T21:28:46.331169] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T21:28:46.337138] [INFO ] [REMOTE ] THO: Full fetch complete (60208 records). [2025-10-22T21:28:46.337260] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-22T21:28:46.523472] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-10. [2025-10-22T21:28:46.719524] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-22T21:28:46.719731] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-22T21:28:46.720785] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-22T21:28:46.720849] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-22T21:28:46.722079] [DEBUG] [LOCAL ] THO: Trimmed 60208 records to 41016 (keeping 200 days of data) [2025-10-22T21:28:46.828395] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T21:28:46.985387] [DEBUG] [LOCAL ] THO: Primary data saved (41016 records). [2025-10-22T21:28:46.985500] [INFO ] [MAIN ] THO: Full history saved. [2025-10-22T21:28:46.985575] [INFO ] [MAIN ] Update Progress: 2088/2367 symbols completed. THO took 39.1s. Estimated remaining: 35m 54s. Rate: 7.8 symbols/min [2025-10-22T21:28:47.160015] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:28:47.160184] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-22T21:28:47.160220] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-22T21:28:47.160335] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-22T21:28:47.160375] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-22T21:28:47.160414] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-22T21:28:47.160445] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-22T21:28:47.329291] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-10. [2025-10-22T21:28:47.512995] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:28:47.685038] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-22T21:28:47.689214] [INFO ] [REMOTE ] THQ: Full fetch complete (34751 records). [2025-10-22T21:28:47.689304] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-22T21:28:48.051073] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-22T21:28:48.051175] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-22T21:28:48.051915] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-22T21:28:48.051978] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-22T21:28:48.052938] [DEBUG] [LOCAL ] THQ: Trimmed 34751 records to 25335 (keeping 200 days of data) [2025-10-22T21:28:48.137845] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-10-22T21:28:48.204234] [DEBUG] [LOCAL ] THQ: Primary data saved (25335 records). [2025-10-22T21:28:48.204364] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-22T21:28:48.204452] [INFO ] [MAIN ] Update Progress: 2089/2367 symbols completed. THQ took 38.0s. Estimated remaining: 35m 46s. Rate: 7.8 symbols/min [2025-10-22T21:28:48.367734] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:28:48.400667] [DEBUG] [LOCAL ] TIMB: Loaded 34863 existing records from primary storage. [2025-10-22T21:28:48.400951] [INFO ] [MAIN ] TIMB: Loaded 34863 existing records. [2025-10-22T21:28:48.584000] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:28:48.584241] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-22T21:28:48.584310] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-22T21:28:48.584526] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-22T21:28:48.584584] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-22T21:28:48.919246] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-01. [2025-10-22T21:28:48.962275] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:28:48.967378] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-22T21:28:48.974600] [INFO ] [REMOTE ] THS: Full fetch complete (54613 records). [2025-10-22T21:28:48.974862] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-22T21:28:49.259316] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:28:49.286523] [WARN ] [REMOTE ] TIC: No data returned for month 2025-01 [2025-10-22T21:28:49.309888] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-22T21:28:49.309095] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:28:49.324460] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-22T21:28:49.365067] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:28:49.394474] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-22T21:28:49.408695] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-22T21:28:49.411515] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-22T21:28:49.411744] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-22T21:28:49.411869] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-22T21:28:49.413009] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-22T21:28:49.413088] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-22T21:28:49.413167] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-22T21:28:49.413455] [INFO ] [MAIN ] Update Progress: 2090/2367 symbols completed. TIC took 2.4s. Estimated remaining: 35m 37s. Rate: 7.8 symbols/min [2025-10-22T21:28:49.521736] [DEBUG] [LOCAL ] THS: Trimmed 54613 records to 38681 (keeping 200 days of data) [2025-10-22T21:28:49.697105] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:28:49.718824] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-10-22T21:28:49.732734] [DEBUG] [LOCAL ] TISI: Loaded 3247 existing records from primary storage. [2025-10-22T21:28:49.737157] [INFO ] [MAIN ] TISI: Loaded 3247 existing records. [2025-10-22T21:28:50.011959] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:28:50.015378] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-22T21:28:50.016366] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-22T21:28:50.018482] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-22T21:28:50.018865] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-22T21:28:50.260420] [DEBUG] [LOCAL ] THS: Primary data saved (38681 records). [2025-10-22T21:28:50.286744] [INFO ] [MAIN ] THS: Full history saved. [2025-10-22T21:28:50.298124] [INFO ] [MAIN ] Update Progress: 2091/2367 symbols completed. THS took 31.1s. Estimated remaining: 35m 28s. Rate: 7.8 symbols/min [2025-10-22T21:28:50.528330] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:28:50.523401] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-10-22T21:28:50.577562] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:28:50.606095] [DEBUG] [LOCAL ] TIXT: Loaded 32637 existing records from primary storage. [2025-10-22T21:28:50.606352] [INFO ] [MAIN ] TIXT: Loaded 32637 existing records. [2025-10-22T21:28:50.782480] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:28:50.782752] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-22T21:28:50.782805] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-22T21:28:50.783052] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-22T21:28:50.783090] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-22T21:28:51.053708] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-22T21:28:51.158936] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:28:51.317619] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-10-22T21:28:52.117706] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-10-22T21:28:52.177290] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T21:28:52.694897] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-22T21:28:52.714297] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T21:28:52.917717] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-10-22T21:28:53.717737] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-10-22T21:28:54.478460] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T21:28:54.517606] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-10-22T21:28:54.981808] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-22T21:28:55.317727] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-10-22T21:28:55.802288] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-22T21:28:55.906675] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-22T21:28:56.117705] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-10-22T21:28:56.917628] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-10-22T21:28:57.135636] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-22T21:28:57.601419] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-22T21:28:57.717620] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-10-22T21:28:58.462954] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-22T21:28:58.517608] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-10-22T21:28:59.317686] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-10-22T21:28:59.593734] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T21:28:59.736371] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-22T21:29:00.117751] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-10-22T21:29:00.917683] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-10-22T21:29:01.243575] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-22T21:29:01.717723] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-10-22T21:29:02.325877] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T21:29:02.517687] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-10-22T21:29:02.616389] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T21:29:03.317690] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-10-22T21:29:03.583678] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-22T21:29:03.766172] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-22T21:29:04.117717] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-10-22T21:29:04.561331] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-22T21:29:04.917708] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-10-22T21:29:05.717690] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-10-22T21:29:06.325619] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T21:29:06.517683] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-10-22T21:29:06.889471] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T21:29:07.317682] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-10-22T21:29:07.661497] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T21:29:08.117695] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-10-22T21:29:08.552878] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-22T21:29:08.917720] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-10. [2025-10-22T21:29:09.083179] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-22T21:29:09.421410] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-22T21:29:09.422419] [INFO ] [REMOTE ] TISI: Full fetch complete (4809 records). [2025-10-22T21:29:09.422487] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-22T21:29:09.731956] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-10-22T21:29:09.774970] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-22T21:29:09.775045] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-22T21:29:09.775182] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-22T21:29:09.775223] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-22T21:29:09.775587] [DEBUG] [LOCAL ] TISI: Trimmed 4809 records to 3153 (keeping 200 days of data) [2025-10-22T21:29:09.793811] [DEBUG] [LOCAL ] TISI: Primary data saved (3153 records). [2025-10-22T21:29:09.793876] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-22T21:29:09.793942] [INFO ] [MAIN ] Update Progress: 2092/2367 symbols completed. TISI took 20.4s. Estimated remaining: 35m 22s. Rate: 7.8 symbols/min [2025-10-22T21:29:09.958774] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:29:10.009171] [DEBUG] [LOCAL ] TJX: Loaded 53663 existing records from primary storage. [2025-10-22T21:29:10.009487] [INFO ] [MAIN ] TJX: Loaded 53663 existing records. [2025-10-22T21:29:10.181906] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:29:10.182104] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-22T21:29:10.182153] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-22T21:29:10.182328] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-10-22T21:29:10.182365] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-22T21:29:10.525156] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-10-22T21:29:10.529852] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:29:10.928554] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-22T21:29:11.317624] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-10-22T21:29:12.086682] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T21:29:12.117629] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-10-22T21:29:12.917697] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-10-22T21:29:13.202498] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T21:29:13.488819] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T21:29:13.717626] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-10-22T21:29:13.959781] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T21:29:14.517638] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-10-22T21:29:15.317663] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-10-22T21:29:15.353690] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T21:29:15.902412] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-22T21:29:16.117688] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-10-22T21:29:16.895384] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T21:29:16.917610] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-10-22T21:29:17.717707] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-10. [2025-10-22T21:29:18.174775] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-22T21:29:18.276769] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T21:29:18.336890] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-22T21:29:18.340366] [INFO ] [REMOTE ] THW: Full fetch complete (28757 records). [2025-10-22T21:29:18.340439] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-22T21:29:18.522732] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-10-22T21:29:18.706183] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-22T21:29:18.706262] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-22T21:29:18.706847] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-22T21:29:18.706918] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-22T21:29:18.707593] [DEBUG] [LOCAL ] THW: Trimmed 28757 records to 19592 (keeping 200 days of data) [2025-10-22T21:29:18.824492] [DEBUG] [LOCAL ] THW: Primary data saved (19592 records). [2025-10-22T21:29:18.824618] [INFO ] [MAIN ] THW: Full history saved. [2025-10-22T21:29:18.824723] [INFO ] [MAIN ] Update Progress: 2093/2367 symbols completed. THW took 39.6s. Estimated remaining: 35m 15s. Rate: 7.8 symbols/min [2025-10-22T21:29:18.991159] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:29:19.026467] [DEBUG] [LOCAL ] TK: Loaded 39169 existing records from primary storage. [2025-10-22T21:29:19.026788] [INFO ] [MAIN ] TK: Loaded 39169 existing records. [2025-10-22T21:29:19.203990] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:29:19.204189] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-22T21:29:19.204235] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-22T21:29:19.204402] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-10-22T21:29:19.204439] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-22T21:29:19.322713] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-10-22T21:29:19.560043] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:29:20.117714] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-10. [2025-10-22T21:29:20.718741] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-22T21:29:20.751218] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T21:29:20.917634] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-10-22T21:29:21.269794] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T21:29:21.274751] [INFO ] [REMOTE ] TIMB: Full fetch complete (53105 records). [2025-10-22T21:29:21.274879] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-22T21:29:21.655861] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-22T21:29:21.655979] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-22T21:29:21.658084] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-22T21:29:21.658169] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-22T21:29:21.659628] [DEBUG] [LOCAL ] TIMB: Trimmed 53105 records to 34700 (keeping 200 days of data) [2025-10-22T21:29:21.725720] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-10-22T21:29:21.898115] [DEBUG] [LOCAL ] TIMB: Primary data saved (34700 records). [2025-10-22T21:29:21.898245] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-22T21:29:21.898319] [INFO ] [MAIN ] Update Progress: 2094/2367 symbols completed. TIMB took 33.7s. Estimated remaining: 35m 6s. Rate: 7.8 symbols/min [2025-10-22T21:29:22.073196] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:29:22.100404] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-22T21:29:22.149795] [DEBUG] [LOCAL ] TKC: Loaded 39988 existing records from primary storage. [2025-10-22T21:29:22.150112] [INFO ] [MAIN ] TKC: Loaded 39988 existing records. [2025-10-22T21:29:22.327977] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:29:22.328205] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-22T21:29:22.328252] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-22T21:29:22.328492] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-22T21:29:22.328575] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-22T21:29:22.525053] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-10. [2025-10-22T21:29:22.695563] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:29:23.317665] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-10-22T21:29:23.419115] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T21:29:23.984417] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T21:29:23.990855] [INFO ] [REMOTE ] TIXT: Full fetch complete (46073 records). [2025-10-22T21:29:23.990971] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-22T21:29:24.122458] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-10-22T21:29:24.423587] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-22T21:29:24.423737] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-22T21:29:24.425356] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-22T21:29:24.425456] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-22T21:29:24.427042] [DEBUG] [LOCAL ] TIXT: Trimmed 46073 records to 32607 (keeping 200 days of data) [2025-10-22T21:29:24.616336] [DEBUG] [LOCAL ] TIXT: Primary data saved (32607 records). [2025-10-22T21:29:24.616537] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-22T21:29:24.616699] [INFO ] [MAIN ] Update Progress: 2095/2367 symbols completed. TIXT took 34.3s. Estimated remaining: 34m 58s. Rate: 7.8 symbols/min [2025-10-22T21:29:24.798045] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:29:24.844778] [DEBUG] [LOCAL ] TKO: Loaded 43540 existing records from primary storage. [2025-10-22T21:29:24.845151] [INFO ] [MAIN ] TKO: Loaded 43540 existing records. [2025-10-22T21:29:24.931272] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-10-22T21:29:25.049015] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:29:25.049373] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-22T21:29:25.049553] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-22T21:29:25.049813] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-10-22T21:29:25.049872] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-22T21:29:25.417836] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-22T21:29:25.450003] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:29:25.471418] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T21:29:25.717718] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-10-22T21:29:26.296806] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T21:29:26.517677] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-10-22T21:29:26.626292] [DEBUG] [REMOTE ] TK: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-22T21:29:26.626588] [WARN ] [REMOTE ] TK: No data returned for month 2025-03 [2025-10-22T21:29:26.626709] [FATAL] [REMOTE ] TK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:29:26.626787] [FATAL] [MAIN ] TK: Failed to fetch primary data. [2025-10-22T21:29:26.626849] [WARN ] [MAIN ] TK: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:29:26.626920] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-22T21:29:26.626983] [DEBUG] [LOCAL ] TK: No primary data file found to delete. [2025-10-22T21:29:26.627018] [INFO ] [LOCAL ] TK: Starting deletion of derivative data. [2025-10-22T21:29:26.627175] [DEBUG] [LOCAL ] TK: Deleted derivative data file. [2025-10-22T21:29:26.627255] [INFO ] [MAIN ] Update Progress: 2096/2367 symbols completed. TK took 7.8s. Estimated remaining: 34m 50s. Rate: 7.8 symbols/min [2025-10-22T21:29:26.804354] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:29:26.840029] [DEBUG] [LOCAL ] TKR: Loaded 39382 existing records from primary storage. [2025-10-22T21:29:26.840313] [INFO ] [MAIN ] TKR: Loaded 39382 existing records. [2025-10-22T21:29:27.033018] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-22T21:29:27.039122] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:29:27.045487] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-22T21:29:27.045554] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-22T21:29:27.045795] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-10-22T21:29:27.045852] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-22T21:29:27.323500] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-10-22T21:29:27.406585] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:29:28.117721] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-10-22T21:29:28.620129] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-22T21:29:28.917730] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-10-22T21:29:29.717637] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-10-22T21:29:29.975012] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T21:29:30.517711] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-10-22T21:29:30.845129] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-22T21:29:31.319410] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-10-22T21:29:31.321732] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T21:29:31.953057] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T21:29:32.117670] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-10-22T21:29:32.917619] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-10-22T21:29:33.295991] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-22T21:29:33.618557] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T21:29:33.717717] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-10-22T21:29:34.517637] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-10-22T21:29:34.788114] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-22T21:29:35.170953] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T21:29:35.317722] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-10-22T21:29:35.978681] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T21:29:36.117735] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-10-22T21:29:36.917683] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-10-22T21:29:36.976052] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T21:29:37.717669] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-10-22T21:29:38.106961] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T21:29:38.517712] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-10-22T21:29:38.581347] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T21:29:39.317735] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-10-22T21:29:39.441975] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-22T21:29:39.944619] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T21:29:40.117713] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-10-22T21:29:40.917673] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-10-22T21:29:41.140880] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T21:29:41.656518] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T21:29:41.717698] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-10-22T21:29:41.859555] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T21:29:42.517692] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-10-22T21:29:43.320214] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-10-22T21:29:43.324848] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T21:29:44.117726] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-10-22T21:29:44.215874] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-22T21:29:44.917625] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-10-22T21:29:45.293183] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-22T21:29:45.717741] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-10. [2025-10-22T21:29:45.843009] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T21:29:46.493101] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T21:29:46.517604] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-10-22T21:29:47.317671] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-10. [2025-10-22T21:29:47.536316] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T21:29:47.545369] [INFO ] [REMOTE ] TJX: Full fetch complete (77831 records). [2025-10-22T21:29:47.545470] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-22T21:29:47.950855] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-22T21:29:47.951008] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-22T21:29:47.952369] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-22T21:29:47.952444] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-22T21:29:47.953966] [DEBUG] [LOCAL ] TJX: Trimmed 77831 records to 53661 (keeping 200 days of data) [2025-10-22T21:29:48.136929] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-10-22T21:29:48.204734] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T21:29:48.325230] [DEBUG] [LOCAL ] TJX: Primary data saved (53661 records). [2025-10-22T21:29:48.325366] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-22T21:29:48.325445] [INFO ] [MAIN ] Update Progress: 2097/2367 symbols completed. TJX took 38.5s. Estimated remaining: 34m 44s. Rate: 7.8 symbols/min [2025-10-22T21:29:48.495906] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:29:48.532467] [DEBUG] [LOCAL ] TLK: Loaded 38728 existing records from primary storage. [2025-10-22T21:29:48.532769] [INFO ] [MAIN ] TLK: Loaded 38728 existing records. [2025-10-22T21:29:48.710436] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:29:48.710734] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-22T21:29:48.710790] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-22T21:29:48.710953] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-22T21:29:48.710989] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-22T21:29:48.927170] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-10-22T21:29:49.097129] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:29:49.099203] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T21:29:49.106879] [INFO ] [REMOTE ] TKC: Full fetch complete (54480 records). [2025-10-22T21:29:49.106968] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-22T21:29:49.483203] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-22T21:29:49.483277] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-22T21:29:49.484281] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-22T21:29:49.484342] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-22T21:29:49.485475] [DEBUG] [LOCAL ] TKC: Trimmed 54480 records to 40053 (keeping 200 days of data) [2025-10-22T21:29:49.714487] [DEBUG] [LOCAL ] TKC: Primary data saved (40053 records). [2025-10-22T21:29:49.714692] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-22T21:29:49.714801] [INFO ] [MAIN ] Update Progress: 2098/2367 symbols completed. TKC took 27.8s. Estimated remaining: 34m 35s. Rate: 7.8 symbols/min [2025-10-22T21:29:49.726606] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-10-22T21:29:49.914091] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:29:49.916833] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-22T21:29:49.940826] [DEBUG] [LOCAL ] TLYS: Loaded 16514 existing records from primary storage. [2025-10-22T21:29:49.941076] [INFO ] [MAIN ] TLYS: Loaded 16514 existing records. [2025-10-22T21:29:50.117492] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:29:50.117793] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-22T21:29:50.117846] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-22T21:29:50.117996] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-22T21:29:50.118034] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-22T21:29:50.483777] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:29:50.511260] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T21:29:50.519876] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-10-22T21:29:51.029132] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T21:29:51.317708] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-10. [2025-10-22T21:29:52.081225] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T21:29:52.117624] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-10-22T21:29:52.706179] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-22T21:29:52.713868] [INFO ] [REMOTE ] TKR: Full fetch complete (57968 records). [2025-10-22T21:29:52.714142] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-22T21:29:52.923855] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-10-22T21:29:53.147531] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-22T21:29:53.147672] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-22T21:29:53.149474] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-22T21:29:53.149542] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-22T21:29:53.151195] [DEBUG] [LOCAL ] TKR: Trimmed 57968 records to 39247 (keeping 200 days of data) [2025-10-22T21:29:53.427315] [DEBUG] [LOCAL ] TKR: Primary data saved (39247 records). [2025-10-22T21:29:53.427541] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-22T21:29:53.427689] [INFO ] [MAIN ] Update Progress: 2099/2367 symbols completed. TKR took 26.8s. Estimated remaining: 34m 27s. Rate: 7.8 symbols/min [2025-10-22T21:29:53.670443] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:29:53.713155] [DEBUG] [LOCAL ] TM: Loaded 36158 existing records from primary storage. [2025-10-22T21:29:53.713540] [INFO ] [MAIN ] TM: Loaded 36158 existing records. [2025-10-22T21:29:53.725402] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-10-22T21:29:53.909907] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:29:53.910392] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-22T21:29:53.910466] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-22T21:29:53.910868] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-22T21:29:53.910998] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-22T21:29:54.052334] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-22T21:29:54.380724] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:29:54.405199] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T21:29:54.517669] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-10-22T21:29:54.567258] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-22T21:29:55.231730] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-22T21:29:55.317697] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-10-22T21:29:56.060997] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-22T21:29:56.117736] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-10-22T21:29:56.917705] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-10. [2025-10-22T21:29:57.717742] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-10-22T21:29:57.745815] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T21:29:58.183454] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T21:29:58.191684] [INFO ] [REMOTE ] TKO: Full fetch complete (65556 records). [2025-10-22T21:29:58.191870] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-10-22T21:29:58.522957] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-10-22T21:29:58.585971] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-10-22T21:29:58.586109] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-10-22T21:29:58.587755] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-10-22T21:29:58.587824] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-10-22T21:29:58.589696] [DEBUG] [LOCAL ] TKO: Trimmed 65556 records to 43490 (keeping 200 days of data) [2025-10-22T21:29:58.887204] [DEBUG] [LOCAL ] TKO: Primary data saved (43490 records). [2025-10-22T21:29:58.887387] [INFO ] [MAIN ] TKO: Full history saved. [2025-10-22T21:29:58.888228] [INFO ] [MAIN ] Update Progress: 2100/2367 symbols completed. TKO took 34.3s. Estimated remaining: 34m 19s. Rate: 7.8 symbols/min [2025-10-22T21:29:59.080243] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:29:59.171557] [DEBUG] [LOCAL ] TME: Loaded 53206 existing records from primary storage. [2025-10-22T21:29:59.175413] [INFO ] [MAIN ] TME: Loaded 53206 existing records. [2025-10-22T21:29:59.213081] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T21:29:59.322834] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-10-22T21:29:59.395213] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:29:59.395528] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-22T21:29:59.395580] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-22T21:29:59.395886] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-22T21:29:59.395945] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-22T21:29:59.523080] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-22T21:29:59.796747] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:30:00.117722] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-10-22T21:30:00.917674] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-10-22T21:30:00.982059] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T21:30:00.998612] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-22T21:30:01.717708] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-10-22T21:30:02.434749] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T21:30:02.517692] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-10-22T21:30:03.317706] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-10-22T21:30:03.376456] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T21:30:04.117734] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-10-22T21:30:04.265691] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T21:30:04.422544] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T21:30:04.917709] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-10-22T21:30:05.717668] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-10-22T21:30:06.071013] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T21:30:06.498313] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T21:30:06.517622] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-10-22T21:30:07.317635] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-10-22T21:30:07.483975] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T21:30:07.607672] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-22T21:30:08.117704] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-10-22T21:30:08.753156] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T21:30:08.917698] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-10-22T21:30:09.717624] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-10-22T21:30:10.075683] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-22T21:30:10.288035] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-22T21:30:10.517698] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-10-22T21:30:11.317699] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-10-22T21:30:11.384634] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-22T21:30:12.117676] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-10-22T21:30:12.156749] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T21:30:12.174974] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T21:30:12.917711] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-10-22T21:30:13.717699] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-10-22T21:30:13.829343] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T21:30:14.371323] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T21:30:14.517710] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-10. [2025-10-22T21:30:14.730383] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T21:30:15.317742] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-10. [2025-10-22T21:30:15.974712] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T21:30:15.981255] [INFO ] [REMOTE ] TLK: Full fetch complete (57681 records). [2025-10-22T21:30:15.981372] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-22T21:30:16.093282] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-22T21:30:16.128608] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-10-22T21:30:16.133922] [INFO ] [REMOTE ] TLYS: Full fetch complete (21144 records). [2025-10-22T21:30:16.183489] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-22T21:30:16.640964] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-22T21:30:16.646562] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-22T21:30:16.653437] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-22T21:30:16.653533] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-22T21:30:16.698219] [DEBUG] [LOCAL ] TLK: Trimmed 57681 records to 38709 (keeping 200 days of data) [2025-10-22T21:30:16.827997] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-22T21:30:16.828416] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-22T21:30:16.855025] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-22T21:30:16.855479] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-22T21:30:16.867242] [DEBUG] [LOCAL ] TLYS: Trimmed 21144 records to 16539 (keeping 200 days of data) [2025-10-22T21:30:16.945410] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-10-22T21:30:17.081080] [DEBUG] [LOCAL ] TLK: Primary data saved (38709 records). [2025-10-22T21:30:17.084183] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-22T21:30:17.084306] [INFO ] [MAIN ] Update Progress: 2101/2367 symbols completed. TLK took 28.8s. Estimated remaining: 34m 13s. Rate: 7.8 symbols/min [2025-10-22T21:30:17.197937] [DEBUG] [LOCAL ] TLYS: Primary data saved (16539 records). [2025-10-22T21:30:17.203634] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-22T21:30:17.208980] [INFO ] [MAIN ] Update Progress: 2102/2367 symbols completed. TLYS took 27.5s. Estimated remaining: 34m 4s. Rate: 7.8 symbols/min [2025-10-22T21:30:17.350099] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:30:17.464731] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:30:17.500461] [DEBUG] [LOCAL ] TMHC: Loaded 45654 existing records from primary storage. [2025-10-22T21:30:17.501000] [INFO ] [MAIN ] TMHC: Loaded 45654 existing records. [2025-10-22T21:30:17.709696] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:30:17.724601] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-22T21:30:17.726087] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-22T21:30:17.727108] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-10-22T21:30:17.727027] [DEBUG] [LOCAL ] TMO: Loaded 52404 existing records from primary storage. [2025-10-22T21:30:17.727300] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-22T21:30:17.739357] [INFO ] [MAIN ] TMO: Loaded 52404 existing records. [2025-10-22T21:30:18.195451] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:30:18.210985] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-22T21:30:18.237015] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-22T21:30:18.304091] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-22T21:30:18.332516] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-22T21:30:18.327673] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:30:18.338410] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-10-22T21:30:18.383351] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-22T21:30:18.531103] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-10-22T21:30:18.744498] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T21:30:18.788925] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:30:19.317680] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-10-22T21:30:19.615038] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T21:30:20.117746] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-10-22T21:30:20.183096] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-22T21:30:20.917719] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-10-22T21:30:21.180851] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-22T21:30:21.717639] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-10-22T21:30:21.899843] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T21:30:22.517720] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-10-22T21:30:22.581981] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T21:30:23.317674] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-10-22T21:30:23.607248] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-22T21:30:24.117799] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-10-22T21:30:24.597100] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-22T21:30:24.665914] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-22T21:30:24.917686] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-10-22T21:30:25.717728] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-10-22T21:30:26.244726] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-22T21:30:26.431986] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T21:30:26.517633] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-10-22T21:30:27.317626] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-10. [2025-10-22T21:30:27.415881] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T21:30:28.117774] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-10-22T21:30:28.571710] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-22T21:30:28.869704] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-22T21:30:28.875265] [INFO ] [REMOTE ] TM: Full fetch complete (51973 records). [2025-10-22T21:30:28.875389] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-22T21:30:28.922843] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-10-22T21:30:29.262334] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-22T21:30:29.262417] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-22T21:30:29.263385] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-22T21:30:29.263447] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-22T21:30:29.264570] [DEBUG] [LOCAL ] TM: Trimmed 51973 records to 36037 (keeping 200 days of data) [2025-10-22T21:30:29.483234] [DEBUG] [LOCAL ] TM: Primary data saved (36037 records). [2025-10-22T21:30:29.483511] [INFO ] [MAIN ] TM: Full history saved. [2025-10-22T21:30:29.483662] [INFO ] [MAIN ] Update Progress: 2103/2367 symbols completed. TM took 36.1s. Estimated remaining: 33m 57s. Rate: 7.8 symbols/min [2025-10-22T21:30:29.651781] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:30:29.667216] [DEBUG] [LOCAL ] TNC: Loaded 14293 existing records from primary storage. [2025-10-22T21:30:29.667467] [INFO ] [MAIN ] TNC: Loaded 14293 existing records. [2025-10-22T21:30:29.722280] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-10-22T21:30:29.868130] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T21:30:29.880749] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:30:29.889854] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-22T21:30:29.890214] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-22T21:30:29.890870] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-22T21:30:29.890937] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-22T21:30:30.239357] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:30:30.517629] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-10-22T21:30:31.031433] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-22T21:30:31.317712] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-10. [2025-10-22T21:30:31.656777] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T21:30:31.693891] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-22T21:30:32.117739] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-10-22T21:30:32.917724] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-10-22T21:30:33.224754] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-22T21:30:33.234447] [INFO ] [REMOTE ] TME: Full fetch complete (77161 records). [2025-10-22T21:30:33.234602] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-22T21:30:33.621052] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-22T21:30:33.621188] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-22T21:30:33.622365] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-22T21:30:33.622426] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-22T21:30:33.623793] [DEBUG] [LOCAL ] TME: Trimmed 77161 records to 53197 (keeping 200 days of data) [2025-10-22T21:30:33.719236] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-10-22T21:30:33.928395] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T21:30:33.954860] [DEBUG] [LOCAL ] TME: Primary data saved (53197 records). [2025-10-22T21:30:33.954948] [INFO ] [MAIN ] TME: Full history saved. [2025-10-22T21:30:33.955566] [INFO ] [MAIN ] Update Progress: 2104/2367 symbols completed. TME took 35.1s. Estimated remaining: 33m 49s. Rate: 7.8 symbols/min [2025-10-22T21:30:34.123026] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:30:34.154181] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-22T21:30:34.187466] [DEBUG] [LOCAL ] TNET: Loaded 28267 existing records from primary storage. [2025-10-22T21:30:34.187750] [INFO ] [MAIN ] TNET: Loaded 28267 existing records. [2025-10-22T21:30:34.360067] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:30:34.360212] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-22T21:30:34.360258] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-22T21:30:34.360424] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-22T21:30:34.360460] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-22T21:30:34.522508] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-10-22T21:30:34.711601] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:30:35.317678] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-10-22T21:30:35.531846] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T21:30:35.635061] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T21:30:36.117718] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-10-22T21:30:36.917665] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-10-22T21:30:37.254972] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T21:30:37.355215] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-22T21:30:37.717686] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-10-22T21:30:38.514887] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T21:30:38.523897] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-10-22T21:30:39.124245] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-22T21:30:39.317718] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-10-22T21:30:40.117685] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-10-22T21:30:40.259496] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T21:30:40.917751] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-10-22T21:30:40.962184] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T21:30:41.553148] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-22T21:30:41.717669] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-10. [2025-10-22T21:30:42.517710] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-10-22T21:30:43.025427] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-22T21:30:43.322914] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-10-22T21:30:43.339503] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-22T21:30:43.349097] [INFO ] [REMOTE ] TMHC: Full fetch complete (66631 records). [2025-10-22T21:30:43.349290] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-22T21:30:43.758322] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-22T21:30:43.758477] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-22T21:30:43.759749] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-22T21:30:43.759887] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-22T21:30:43.761352] [DEBUG] [LOCAL ] TMHC: Trimmed 66631 records to 45657 (keeping 200 days of data) [2025-10-22T21:30:43.986363] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T21:30:44.056933] [DEBUG] [LOCAL ] TMHC: Primary data saved (45657 records). [2025-10-22T21:30:44.057079] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-22T21:30:44.057162] [INFO ] [MAIN ] Update Progress: 2105/2367 symbols completed. TMHC took 27.0s. Estimated remaining: 33m 41s. Rate: 7.8 symbols/min [2025-10-22T21:30:44.122966] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-10-22T21:30:44.224114] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:30:44.224322] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-22T21:30:44.224360] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-22T21:30:44.224472] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-22T21:30:44.224513] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-22T21:30:44.224552] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-22T21:30:44.224583] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-22T21:30:44.593953] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:30:44.917625] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-01. [2025-10-22T21:30:45.132291] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:30:45.132607] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-01 [2025-10-22T21:30:45.132714] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:30:45.132765] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-22T21:30:45.132818] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:30:45.132884] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-22T21:30:45.132949] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-22T21:30:45.132983] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-22T21:30:45.133021] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-22T21:30:45.133065] [INFO ] [MAIN ] Update Progress: 2106/2367 symbols completed. TNGY took 1.1s. Estimated remaining: 33m 33s. Rate: 7.8 symbols/min [2025-10-22T21:30:45.335442] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:30:45.349550] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-22T21:30:45.383627] [DEBUG] [LOCAL ] TNK: Loaded 35374 existing records from primary storage. [2025-10-22T21:30:45.383947] [INFO ] [MAIN ] TNK: Loaded 35374 existing records. [2025-10-22T21:30:45.568431] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:30:45.568793] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-22T21:30:45.568897] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-22T21:30:45.569270] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-22T21:30:45.569343] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-22T21:30:45.722329] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-10-22T21:30:45.807038] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-22T21:30:45.990135] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:30:46.517681] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-10-22T21:30:47.080805] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T21:30:47.317722] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-10-22T21:30:48.061320] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T21:30:48.117704] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-10-22T21:30:48.169601] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T21:30:48.917617] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-10-22T21:30:49.255625] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T21:30:49.717710] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-10-22T21:30:49.971569] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-22T21:30:50.517687] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-10-22T21:30:51.065547] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T21:30:51.317627] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-10-22T21:30:51.479629] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T21:30:52.117729] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-10-22T21:30:52.714814] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T21:30:52.917727] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-10-22T21:30:53.717630] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-10-22T21:30:54.041536] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T21:30:54.182394] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-22T21:30:54.517639] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-10-22T21:30:54.657443] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-22T21:30:55.317682] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-10-22T21:30:55.902516] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T21:30:56.117713] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-10-22T21:30:56.244487] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-22T21:30:56.917629] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-10-22T21:30:57.364930] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-22T21:30:57.717686] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-10-22T21:30:58.517676] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-10-22T21:30:58.736497] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T21:30:59.197366] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-22T21:30:59.216324] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T21:30:59.317625] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-10. [2025-10-22T21:31:00.117633] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-10. [2025-10-22T21:31:00.125289] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T21:31:00.128354] [INFO ] [REMOTE ] TNC: Full fetch complete (22208 records). [2025-10-22T21:31:00.128548] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-22T21:31:00.495089] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-22T21:31:00.495200] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-22T21:31:00.495741] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-22T21:31:00.495804] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-22T21:31:00.496369] [DEBUG] [LOCAL ] TNC: Trimmed 22208 records to 14163 (keeping 200 days of data) [2025-10-22T21:31:00.585680] [DEBUG] [LOCAL ] TNC: Primary data saved (14163 records). [2025-10-22T21:31:00.585832] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-22T21:31:00.585911] [INFO ] [MAIN ] Update Progress: 2107/2367 symbols completed. TNC took 31.1s. Estimated remaining: 33m 26s. Rate: 7.8 symbols/min [2025-10-22T21:31:00.758849] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:31:00.799805] [DEBUG] [LOCAL ] TNL: Loaded 41725 existing records from primary storage. [2025-10-22T21:31:00.800102] [INFO ] [MAIN ] TNL: Loaded 41725 existing records. [2025-10-22T21:31:00.922829] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-10. [2025-10-22T21:31:01.004222] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:31:01.004427] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-22T21:31:01.004476] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-22T21:31:01.004992] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-22T21:31:01.005057] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-22T21:31:01.428125] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:31:01.435788] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-22T21:31:01.440425] [INFO ] [REMOTE ] TNET: Full fetch complete (41829 records). [2025-10-22T21:31:01.440526] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-22T21:31:01.722747] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-10-22T21:31:01.850402] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-22T21:31:01.850506] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-22T21:31:01.851457] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-22T21:31:01.851519] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-22T21:31:01.852426] [DEBUG] [LOCAL ] TNET: Trimmed 41829 records to 28176 (keeping 200 days of data) [2025-10-22T21:31:02.045567] [DEBUG] [LOCAL ] TNET: Primary data saved (28176 records). [2025-10-22T21:31:02.045785] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-22T21:31:02.045909] [INFO ] [MAIN ] Update Progress: 2108/2367 symbols completed. TNET took 28.1s. Estimated remaining: 33m 17s. Rate: 7.8 symbols/min [2025-10-22T21:31:02.247346] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:31:02.297093] [DEBUG] [LOCAL ] TOL: Loaded 50598 existing records from primary storage. [2025-10-22T21:31:02.297476] [INFO ] [MAIN ] TOL: Loaded 50598 existing records. [2025-10-22T21:31:02.498559] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:31:02.498860] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-22T21:31:02.498932] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-22T21:31:02.499508] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-22T21:31:02.499790] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-22T21:31:02.523688] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-10-22T21:31:02.887861] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:31:02.948215] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-22T21:31:02.956665] [INFO ] [REMOTE ] TMO: Full fetch complete (75757 records). [2025-10-22T21:31:02.956793] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-22T21:31:03.330637] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-10-22T21:31:03.352770] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-22T21:31:03.353668] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-22T21:31:03.354883] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-22T21:31:03.354992] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-22T21:31:03.356806] [DEBUG] [LOCAL ] TMO: Trimmed 75757 records to 52400 (keeping 200 days of data) [2025-10-22T21:31:03.381588] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T21:31:03.727396] [DEBUG] [LOCAL ] TMO: Primary data saved (52400 records). [2025-10-22T21:31:03.727596] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-22T21:31:03.728576] [INFO ] [MAIN ] Update Progress: 2109/2367 symbols completed. TMO took 46.5s. Estimated remaining: 33m 9s. Rate: 7.8 symbols/min [2025-10-22T21:31:03.899710] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:31:03.950048] [DEBUG] [LOCAL ] TOST: Loaded 53690 existing records from primary storage. [2025-10-22T21:31:03.950347] [INFO ] [MAIN ] TOST: Loaded 53690 existing records. [2025-10-22T21:31:04.131561] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:31:04.126304] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-10-22T21:31:04.131999] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-22T21:31:04.132187] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-22T21:31:04.149422] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-10-22T21:31:04.152047] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-22T21:31:04.174323] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T21:31:04.527356] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:31:04.917634] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-10-22T21:31:05.221557] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-22T21:31:05.278010] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-22T21:31:05.717675] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-10-22T21:31:06.517695] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-10-22T21:31:06.873812] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-22T21:31:07.317697] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-10-22T21:31:07.466595] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-22T21:31:07.674107] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T21:31:08.117688] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-10-22T21:31:08.244136] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T21:31:08.917733] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-10-22T21:31:09.717670] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-10-22T21:31:09.775694] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T21:31:10.346717] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-22T21:31:10.517691] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-10-22T21:31:11.317707] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-10-22T21:31:11.669724] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-22T21:31:12.117712] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-10-22T21:31:12.376804] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T21:31:12.917740] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-10-22T21:31:13.051106] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T21:31:13.717695] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-10-22T21:31:14.073293] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T21:31:14.415044] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T21:31:14.517629] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-10-22T21:31:14.987921] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T21:31:15.317711] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-10-22T21:31:15.532085] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T21:31:16.117632] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-10. [2025-10-22T21:31:16.917689] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-10-22T21:31:17.370883] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-22T21:31:17.426283] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T21:31:17.434422] [INFO ] [REMOTE ] TNK: Full fetch complete (51891 records). [2025-10-22T21:31:17.434632] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-22T21:31:17.726074] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-10-22T21:31:17.833424] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-22T21:31:17.833536] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-22T21:31:17.834705] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-22T21:31:17.834783] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-22T21:31:17.836075] [DEBUG] [LOCAL ] TNK: Trimmed 51891 records to 35270 (keeping 200 days of data) [2025-10-22T21:31:18.050569] [DEBUG] [LOCAL ] TNK: Primary data saved (35270 records). [2025-10-22T21:31:18.050751] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-22T21:31:18.050842] [INFO ] [MAIN ] Update Progress: 2110/2367 symbols completed. TNK took 32.9s. Estimated remaining: 33m 2s. Rate: 7.8 symbols/min [2025-10-22T21:31:18.257639] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:31:18.283098] [DEBUG] [LOCAL ] TPB: Loaded 26263 existing records from primary storage. [2025-10-22T21:31:18.283355] [INFO ] [MAIN ] TPB: Loaded 26263 existing records. [2025-10-22T21:31:18.469405] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:31:18.490776] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-22T21:31:18.490855] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-22T21:31:18.491486] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-22T21:31:18.491552] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-22T21:31:18.492376] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T21:31:18.524359] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-10-22T21:31:18.860144] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:31:19.317630] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-10-22T21:31:19.672765] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T21:31:20.117696] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-10-22T21:31:20.387815] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-22T21:31:20.629386] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-22T21:31:20.917723] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-10-22T21:31:21.717686] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-10-22T21:31:22.036711] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-22T21:31:22.486464] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T21:31:22.517632] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-10-22T21:31:23.317689] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-10-22T21:31:23.407345] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T21:31:24.001604] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T21:31:24.117620] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-10-22T21:31:24.379957] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-22T21:31:24.917676] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-10-22T21:31:25.717718] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-10-22T21:31:26.017147] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T21:31:26.075351] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T21:31:26.517690] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-10-22T21:31:27.189748] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T21:31:27.317683] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-10. [2025-10-22T21:31:28.117732] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-10-22T21:31:28.593541] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-22T21:31:28.758933] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T21:31:28.766073] [INFO ] [REMOTE ] TNL: Full fetch complete (59703 records). [2025-10-22T21:31:28.766251] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-22T21:31:28.923273] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-10-22T21:31:29.175978] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T21:31:29.199000] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-22T21:31:29.199412] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-22T21:31:29.200808] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-22T21:31:29.200875] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-22T21:31:29.202149] [DEBUG] [LOCAL ] TNL: Trimmed 59703 records to 41725 (keeping 200 days of data) [2025-10-22T21:31:29.449253] [DEBUG] [LOCAL ] TNL: Primary data saved (41725 records). [2025-10-22T21:31:29.449380] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-22T21:31:29.449452] [INFO ] [MAIN ] Update Progress: 2111/2367 symbols completed. TNL took 28.9s. Estimated remaining: 32m 55s. Rate: 7.8 symbols/min [2025-10-22T21:31:29.620581] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:31:29.653754] [DEBUG] [LOCAL ] TPC: Loaded 39129 existing records from primary storage. [2025-10-22T21:31:29.654034] [INFO ] [MAIN ] TPC: Loaded 39129 existing records. [2025-10-22T21:31:29.722875] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-10-22T21:31:29.838996] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:31:29.839250] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-22T21:31:29.839301] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-22T21:31:29.839592] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-22T21:31:29.839688] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-22T21:31:30.190978] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:31:30.517682] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-10-22T21:31:30.879100] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T21:31:31.081844] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-22T21:31:31.317698] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-10-22T21:31:31.712287] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-22T21:31:32.117685] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-10-22T21:31:32.443252] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-22T21:31:32.917688] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-10-22T21:31:33.505170] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T21:31:33.717683] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-10-22T21:31:34.517703] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-10-22T21:31:34.711828] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T21:31:35.178870] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-22T21:31:35.317703] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-10-22T21:31:36.082750] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T21:31:36.117639] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-10-22T21:31:36.556768] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-22T21:31:36.917677] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-10-22T21:31:37.717710] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-10. [2025-10-22T21:31:38.027632] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-22T21:31:38.089245] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-22T21:31:38.517703] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-10-22T21:31:39.317634] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-10. [2025-10-22T21:31:39.637753] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-22T21:31:39.647174] [INFO ] [REMOTE ] TOST: Full fetch complete (77852 records). [2025-10-22T21:31:39.647357] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-22T21:31:40.099631] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-22T21:31:40.099775] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-22T21:31:40.101069] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-22T21:31:40.101156] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-22T21:31:40.103048] [DEBUG] [LOCAL ] TOST: Trimmed 77852 records to 53690 (keeping 200 days of data) [2025-10-22T21:31:40.121785] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-10-22T21:31:40.211517] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T21:31:40.447302] [DEBUG] [LOCAL ] TOST: Primary data saved (53690 records). [2025-10-22T21:31:40.447464] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-22T21:31:40.447564] [INFO ] [MAIN ] Update Progress: 2112/2367 symbols completed. TOST took 36.7s. Estimated remaining: 32m 48s. Rate: 7.8 symbols/min [2025-10-22T21:31:40.611240] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:31:40.653130] [DEBUG] [LOCAL ] TPH: Loaded 44813 existing records from primary storage. [2025-10-22T21:31:40.653612] [INFO ] [MAIN ] TPH: Loaded 44813 existing records. [2025-10-22T21:31:40.833948] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:31:40.834177] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-22T21:31:40.834379] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-22T21:31:40.834690] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-22T21:31:40.834785] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-22T21:31:40.934492] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-10-22T21:31:40.990391] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T21:31:41.051080] [INFO ] [REMOTE ] TOL: Full fetch complete (73732 records). [2025-10-22T21:31:41.096762] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-22T21:31:41.388425] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:31:41.639598] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-22T21:31:41.639759] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-22T21:31:41.641017] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-22T21:31:41.641119] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-22T21:31:41.660379] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T21:31:41.666903] [DEBUG] [LOCAL ] TOL: Trimmed 73732 records to 50535 (keeping 200 days of data) [2025-10-22T21:31:41.721851] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-10-22T21:31:41.989868] [DEBUG] [LOCAL ] TOL: Primary data saved (50535 records). [2025-10-22T21:31:41.990008] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-22T21:31:41.990914] [INFO ] [MAIN ] Update Progress: 2113/2367 symbols completed. TOL took 39.9s. Estimated remaining: 32m 39s. Rate: 7.8 symbols/min [2025-10-22T21:31:42.165049] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:31:42.179060] [DEBUG] [LOCAL ] TPL: Loaded 12355 existing records from primary storage. [2025-10-22T21:31:42.179291] [INFO ] [MAIN ] TPL: Loaded 12355 existing records. [2025-10-22T21:31:42.367157] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:31:42.367378] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-22T21:31:42.367558] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-22T21:31:42.367765] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-10-22T21:31:42.367881] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-22T21:31:42.528065] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-10-22T21:31:42.607530] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T21:31:42.759970] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:31:43.016383] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-22T21:31:43.317669] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-10. [2025-10-22T21:31:44.077405] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T21:31:44.117695] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-10-22T21:31:44.808506] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T21:31:44.814366] [INFO ] [REMOTE ] TPB: Full fetch complete (36351 records). [2025-10-22T21:31:44.814466] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-22T21:31:44.918555] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-10-22T21:31:45.197914] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-22T21:31:45.197984] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-22T21:31:45.198736] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-22T21:31:45.198797] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-22T21:31:45.199581] [DEBUG] [LOCAL ] TPB: Trimmed 36351 records to 26309 (keeping 200 days of data) [2025-10-22T21:31:45.365321] [DEBUG] [LOCAL ] TPB: Primary data saved (26309 records). [2025-10-22T21:31:45.365416] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-22T21:31:45.365495] [INFO ] [MAIN ] Update Progress: 2114/2367 symbols completed. TPB took 27.3s. Estimated remaining: 32m 31s. Rate: 7.8 symbols/min [2025-10-22T21:31:45.533604] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:31:45.583435] [DEBUG] [LOCAL ] TPR: Loaded 53367 existing records from primary storage. [2025-10-22T21:31:45.583762] [INFO ] [MAIN ] TPR: Loaded 53367 existing records. [2025-10-22T21:31:45.740157] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-10-22T21:31:45.793160] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:31:45.794017] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-22T21:31:45.794075] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-22T21:31:45.796505] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-22T21:31:45.796460] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T21:31:45.796715] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-22T21:31:46.150279] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:31:46.517753] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-10-22T21:31:46.551096] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T21:31:46.847176] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T21:31:47.317686] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-10-22T21:31:48.122785] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-10-22T21:31:48.142023] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T21:31:48.421330] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T21:31:48.917693] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-10-22T21:31:49.717670] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-10-22T21:31:49.761592] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-22T21:31:50.517624] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-10-22T21:31:50.569053] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-22T21:31:50.617128] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-22T21:31:51.317717] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-10-22T21:31:52.117627] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-10-22T21:31:52.423628] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T21:31:52.424739] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-22T21:31:52.917685] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-10-22T21:31:53.691294] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T21:31:53.717619] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-10. [2025-10-22T21:31:54.504160] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T21:31:54.517607] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-10-22T21:31:55.148516] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-22T21:31:55.155150] [INFO ] [REMOTE ] TPC: Full fetch complete (55515 records). [2025-10-22T21:31:55.155320] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-22T21:31:55.329869] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-10-22T21:31:55.544399] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-22T21:31:55.544482] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-22T21:31:55.545484] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-22T21:31:55.545548] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-22T21:31:55.546782] [DEBUG] [LOCAL ] TPC: Trimmed 55515 records to 39105 (keeping 200 days of data) [2025-10-22T21:31:55.772792] [DEBUG] [LOCAL ] TPC: Primary data saved (39105 records). [2025-10-22T21:31:55.772923] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-22T21:31:55.772997] [INFO ] [MAIN ] Update Progress: 2115/2367 symbols completed. TPC took 26.3s. Estimated remaining: 32m 23s. Rate: 7.8 symbols/min [2025-10-22T21:31:55.945012] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:31:55.970152] [DEBUG] [LOCAL ] TPVG: Loaded 27256 existing records from primary storage. [2025-10-22T21:31:55.970420] [INFO ] [MAIN ] TPVG: Loaded 27256 existing records. [2025-10-22T21:31:56.162484] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-10-22T21:31:56.175568] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T21:31:56.214443] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:31:56.215018] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-22T21:31:56.215454] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-22T21:31:56.215764] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-22T21:31:56.215822] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-22T21:31:56.561007] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:31:56.917626] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-10-22T21:31:57.235407] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-22T21:31:57.269267] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-22T21:31:57.717718] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-10-22T21:31:58.517635] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-10-22T21:31:58.559130] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T21:31:58.751734] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T21:31:59.317688] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-10-22T21:31:59.736600] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-22T21:32:00.117717] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-10-22T21:32:00.398952] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-22T21:32:00.917764] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-10-22T21:32:01.466205] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-22T21:32:01.717717] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-10-22T21:32:02.436271] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T21:32:02.517671] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-10-22T21:32:02.871149] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T21:32:03.317706] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-10-22T21:32:04.117693] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-10-22T21:32:04.365319] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T21:32:04.585687] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-22T21:32:04.917710] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-10-22T21:32:05.047084] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-22T21:32:05.717682] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-10-22T21:32:06.180672] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-22T21:32:06.227840] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-22T21:32:06.517679] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-10. [2025-10-22T21:32:07.317676] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-10-22T21:32:07.476785] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T21:32:07.479125] [INFO ] [REMOTE ] TPL: Full fetch complete (17560 records). [2025-10-22T21:32:07.479198] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-22T21:32:07.833989] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-22T21:32:07.834062] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-22T21:32:07.834431] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-22T21:32:07.834471] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-22T21:32:07.834992] [DEBUG] [LOCAL ] TPL: Trimmed 17560 records to 12262 (keeping 200 days of data) [2025-10-22T21:32:07.913122] [DEBUG] [LOCAL ] TPL: Primary data saved (12262 records). [2025-10-22T21:32:07.913252] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-22T21:32:07.913360] [INFO ] [MAIN ] Update Progress: 2116/2367 symbols completed. TPL took 25.9s. Estimated remaining: 32m 16s. Rate: 7.8 symbols/min [2025-10-22T21:32:08.079748] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:32:08.089608] [DEBUG] [LOCAL ] TPYP: Loaded 7931 existing records from primary storage. [2025-10-22T21:32:08.089832] [INFO ] [MAIN ] TPYP: Loaded 7931 existing records. [2025-10-22T21:32:08.122927] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-10-22T21:32:08.267387] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:32:08.267690] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-22T21:32:08.267749] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-22T21:32:08.267948] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-22T21:32:08.268004] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-22T21:32:08.609952] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:32:08.917718] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-10-22T21:32:09.287052] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T21:32:09.696501] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T21:32:09.717619] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-10. [2025-10-22T21:32:09.764221] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-22T21:32:10.517665] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-10-22T21:32:11.214228] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-22T21:32:11.222456] [INFO ] [REMOTE ] TPH: Full fetch complete (64999 records). [2025-10-22T21:32:11.222616] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-22T21:32:11.322727] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-10-22T21:32:11.620944] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-22T21:32:11.621140] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-22T21:32:11.622248] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-22T21:32:11.622311] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-22T21:32:11.623639] [DEBUG] [LOCAL ] TPH: Trimmed 64999 records to 44779 (keeping 200 days of data) [2025-10-22T21:32:11.732428] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-22T21:32:11.903068] [DEBUG] [LOCAL ] TPH: Primary data saved (44779 records). [2025-10-22T21:32:11.903196] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-22T21:32:11.903274] [INFO ] [MAIN ] Update Progress: 2117/2367 symbols completed. TPH took 31.5s. Estimated remaining: 32m 8s. Rate: 7.8 symbols/min [2025-10-22T21:32:12.117841] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-10-22T21:32:12.161489] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-22T21:32:12.917753] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-10-22T21:32:13.160053] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T21:32:13.670065] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-22T21:32:13.717623] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-10-22T21:32:14.481050] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-22T21:32:14.517618] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-10-22T21:32:15.253123] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T21:32:15.317735] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-10-22T21:32:16.117743] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-10-22T21:32:16.522694] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T21:32:16.917726] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-10-22T21:32:17.717742] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-10-22T21:32:17.881534] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T21:32:18.178116] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-22T21:32:18.453926] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-22T21:32:18.517711] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-10-22T21:32:19.317728] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-10-22T21:32:20.117632] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-10-22T21:32:20.538217] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-22T21:32:20.632525] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T21:32:20.857720] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-22T21:32:20.917716] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-10-22T21:32:21.633602] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-22T21:32:21.717633] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-10. [2025-10-22T21:32:22.517667] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-10-22T21:32:22.973850] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T21:32:22.979140] [INFO ] [REMOTE ] TPVG: Full fetch complete (39252 records). [2025-10-22T21:32:22.979260] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-22T21:32:23.318254] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-10-22T21:32:23.348701] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-22T21:32:23.348797] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-22T21:32:23.349731] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-22T21:32:23.349797] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-22T21:32:23.350995] [DEBUG] [LOCAL ] TPVG: Trimmed 39252 records to 27151 (keeping 200 days of data) [2025-10-22T21:32:23.501638] [DEBUG] [LOCAL ] TPVG: Primary data saved (27151 records). [2025-10-22T21:32:23.501792] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-22T21:32:23.501870] [INFO ] [MAIN ] Update Progress: 2118/2367 symbols completed. TPVG took 27.7s. Estimated remaining: 32m 1s. Rate: 7.8 symbols/min [2025-10-22T21:32:24.916846] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-22T21:32:24.928440] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-10-22T21:32:24.962246] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T21:32:24.964471] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-10. [2025-10-22T21:32:25.610992] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-22T21:32:25.612738] [INFO ] [REMOTE ] TPYP: Full fetch complete (12337 records). [2025-10-22T21:32:25.612819] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-22T21:32:25.998729] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-22T21:32:26.043980] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-10. [2025-10-22T21:32:26.044368] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-22T21:32:26.045085] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-22T21:32:26.045415] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-22T21:32:26.045458] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-22T21:32:26.046063] [DEBUG] [LOCAL ] TPYP: Trimmed 12337 records to 7866 (keeping 200 days of data) [2025-10-22T21:32:26.094505] [DEBUG] [LOCAL ] TPYP: Primary data saved (7866 records). [2025-10-22T21:32:26.094631] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-22T21:32:26.094745] [INFO ] [MAIN ] Update Progress: 2119/2367 symbols completed. TPYP took 18.2s. Estimated remaining: 31m 53s. Rate: 7.8 symbols/min [2025-10-22T21:32:27.902264] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T21:32:27.911159] [INFO ] [REMOTE ] TPR: Full fetch complete (77501 records). [2025-10-22T21:32:27.911286] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-22T21:32:28.299278] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-22T21:32:28.299359] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-22T21:32:28.300499] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-22T21:32:28.300566] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-22T21:32:28.302057] [DEBUG] [LOCAL ] TPR: Trimmed 77501 records to 53368 (keeping 200 days of data) [2025-10-22T21:32:28.625391] [DEBUG] [LOCAL ] TPR: Primary data saved (53368 records). [2025-10-22T21:32:28.625521] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-22T21:32:28.625609] [INFO ] [MAIN ] Update Progress: 2120/2367 symbols completed. TPR took 43.3s. Estimated remaining: 31m 44s. Rate: 7.8 symbols/min [2025-10-22T21:32:29.145144] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:32:29.306905] [DEBUG] [LOCAL ] TPZ: Loaded 4643 existing records from primary storage. [2025-10-22T21:32:29.317291] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:32:29.339208] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:32:29.357830] [INFO ] [MAIN ] TPZ: Loaded 4643 existing records. [2025-10-22T21:32:29.356823] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:32:29.481506] [DEBUG] [LOCAL ] TRAK: Loaded 9636 existing records from primary storage. [2025-10-22T21:32:29.497603] [DEBUG] [LOCAL ] TRC: Loaded 15460 existing records from primary storage. [2025-10-22T21:32:29.502921] [INFO ] [MAIN ] TRAK: Loaded 9636 existing records. [2025-10-22T21:32:29.532362] [INFO ] [MAIN ] TRC: Loaded 15460 existing records. [2025-10-22T21:32:29.656832] [DEBUG] [LOCAL ] TR: Loaded 19126 existing records from primary storage. [2025-10-22T21:32:29.727394] [INFO ] [MAIN ] TR: Loaded 19126 existing records. [2025-10-22T21:32:29.738325] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:32:29.791261] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-22T21:32:29.801679] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-22T21:32:29.840529] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-22T21:32:29.865290] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-22T21:32:30.026231] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:32:30.101015] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:32:30.115306] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-22T21:32:30.173464] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-22T21:32:30.230158] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-22T21:32:30.244530] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-22T21:32:30.230056] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:32:30.244943] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-22T21:32:30.244683] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-22T21:32:30.245108] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-22T21:32:30.245745] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-22T21:32:30.285142] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-22T21:32:30.300828] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-22T21:32:30.326670] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-22T21:32:30.326751] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-22T21:32:31.357234] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:32:31.393559] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-10-22T21:32:31.556293] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:32:31.619485] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:32:31.623817] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-10-22T21:32:31.624176] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-10-22T21:32:31.623530] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:32:31.624586] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-10-22T21:32:32.379380] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T21:32:32.382422] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-10-22T21:32:32.396432] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-22T21:32:32.399487] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-10-22T21:32:32.459457] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-22T21:32:32.462566] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-10-22T21:32:32.580078] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-22T21:32:32.583711] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-10-22T21:32:33.100981] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-22T21:32:33.103710] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-10-22T21:32:33.182977] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-22T21:32:33.337684] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-22T21:32:33.422283] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-22T21:32:33.703691] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T21:32:33.717604] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-10-22T21:32:34.435470] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-22T21:32:34.517619] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-10-22T21:32:35.105974] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-22T21:32:35.317777] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-10-22T21:32:35.915437] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-22T21:32:36.117718] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-10-22T21:32:36.917718] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-10-22T21:32:37.081827] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-22T21:32:37.565401] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T21:32:37.717626] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-10-22T21:32:38.262217] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-22T21:32:38.517686] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-10-22T21:32:39.298332] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-22T21:32:39.317604] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-10-22T21:32:40.117679] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-10-22T21:32:40.127426] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T21:32:40.704048] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-22T21:32:40.917705] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-10-22T21:32:41.717671] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-10-22T21:32:41.863752] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-22T21:32:42.517713] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-10-22T21:32:42.899283] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-22T21:32:43.049195] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-22T21:32:43.317724] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-10-22T21:32:44.117667] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-10. [2025-10-22T21:32:44.170163] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-22T21:32:44.683074] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-22T21:32:44.684330] [INFO ] [REMOTE ] TPZ: Full fetch complete (8400 records). [2025-10-22T21:32:44.684399] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-22T21:32:44.926107] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-10-22T21:32:45.058690] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-22T21:32:45.058771] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-22T21:32:45.058980] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-22T21:32:45.059018] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-22T21:32:45.059396] [DEBUG] [LOCAL ] TPZ: Trimmed 8400 records to 4600 (keeping 200 days of data) [2025-10-22T21:32:45.089405] [DEBUG] [LOCAL ] TPZ: Primary data saved (4600 records). [2025-10-22T21:32:45.089521] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-22T21:32:45.089617] [INFO ] [MAIN ] Update Progress: 2121/2367 symbols completed. TPZ took 16.5s. Estimated remaining: 31m 38s. Rate: 7.8 symbols/min [2025-10-22T21:32:45.260491] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:32:45.301339] [DEBUG] [LOCAL ] TREX: Loaded 49829 existing records from primary storage. [2025-10-22T21:32:45.301633] [INFO ] [MAIN ] TREX: Loaded 49829 existing records. [2025-10-22T21:32:45.473072] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:32:45.473268] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-22T21:32:45.473315] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-22T21:32:45.473793] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-22T21:32:45.473848] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-22T21:32:45.724758] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-10-22T21:32:45.832201] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:32:46.059744] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-22T21:32:46.517698] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-10-22T21:32:46.857005] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T21:32:47.321381] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-10-22T21:32:47.323568] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T21:32:48.117682] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-10-22T21:32:48.377011] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-22T21:32:48.862843] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-22T21:32:48.917690] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-10-22T21:32:49.717624] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-10-22T21:32:50.078564] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-22T21:32:50.517696] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-10-22T21:32:50.715638] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-22T21:32:51.317722] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-10-22T21:32:52.058347] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T21:32:52.117668] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-10-22T21:32:52.408740] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T21:32:52.917682] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-10-22T21:32:53.709165] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T21:32:53.717601] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-10. [2025-10-22T21:32:53.989710] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-22T21:32:54.517693] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-10-22T21:32:54.552159] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-22T21:32:54.554835] [INFO ] [REMOTE ] TRAK: Full fetch complete (13687 records). [2025-10-22T21:32:54.554922] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-22T21:32:54.979841] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-22T21:32:54.979929] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-22T21:32:54.980311] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-22T21:32:54.980393] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-22T21:32:54.980932] [DEBUG] [LOCAL ] TRAK: Trimmed 13687 records to 9585 (keeping 200 days of data) [2025-10-22T21:32:55.044294] [DEBUG] [LOCAL ] TRAK: Primary data saved (9585 records). [2025-10-22T21:32:55.044434] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-22T21:32:55.044515] [INFO ] [MAIN ] Update Progress: 2122/2367 symbols completed. TRAK took 26.4s. Estimated remaining: 31m 30s. Rate: 7.8 symbols/min [2025-10-22T21:32:55.210459] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:32:55.259079] [DEBUG] [LOCAL ] TRGP: Loaded 50756 existing records from primary storage. [2025-10-22T21:32:55.259389] [INFO ] [MAIN ] TRGP: Loaded 50756 existing records. [2025-10-22T21:32:55.321210] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-10-22T21:32:55.434608] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:32:55.434860] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-22T21:32:55.434908] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-22T21:32:55.435169] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-10-22T21:32:55.435224] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-22T21:32:55.740963] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-22T21:32:55.809075] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:32:56.117698] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-10. [2025-10-22T21:32:56.917711] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-10-22T21:32:57.118188] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T21:32:57.119863] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T21:32:57.133354] [INFO ] [REMOTE ] TR: Full fetch complete (25495 records). [2025-10-22T21:32:57.133553] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-22T21:32:57.519165] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-22T21:32:57.519253] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-22T21:32:57.519937] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-22T21:32:57.519999] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-22T21:32:57.520760] [DEBUG] [LOCAL ] TR: Trimmed 25495 records to 19117 (keeping 200 days of data) [2025-10-22T21:32:57.613957] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-22T21:32:57.651354] [DEBUG] [LOCAL ] TR: Primary data saved (19117 records). [2025-10-22T21:32:57.651526] [INFO ] [MAIN ] TR: Full history saved. [2025-10-22T21:32:57.651612] [INFO ] [MAIN ] Update Progress: 2123/2367 symbols completed. TR took 29.0s. Estimated remaining: 31m 22s. Rate: 7.8 symbols/min [2025-10-22T21:32:57.722942] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-10-22T21:32:57.829931] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:32:57.863381] [DEBUG] [LOCAL ] TRN: Loaded 36427 existing records from primary storage. [2025-10-22T21:32:57.863693] [INFO ] [MAIN ] TRN: Loaded 36427 existing records. [2025-10-22T21:32:58.048593] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:32:58.048857] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-22T21:32:58.048905] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-22T21:32:58.049113] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-22T21:32:58.049170] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-22T21:32:58.416599] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:32:58.517670] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-10-22T21:32:59.317760] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-10-22T21:32:59.494986] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T21:32:59.559515] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-22T21:33:00.117683] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-10-22T21:33:00.873603] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-22T21:33:00.917705] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-10-22T21:33:01.196389] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-22T21:33:01.717670] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-10-22T21:33:02.517729] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-10-22T21:33:02.650347] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-22T21:33:02.652337] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T21:33:03.317680] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-10-22T21:33:04.117636] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-10-22T21:33:04.266032] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-22T21:33:04.340557] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T21:33:04.917745] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-10-22T21:33:05.717637] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-10-22T21:33:06.352224] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-22T21:33:06.517633] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-10-22T21:33:07.050151] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-22T21:33:07.202614] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-22T21:33:07.317636] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-10-22T21:33:07.923148] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-22T21:33:08.117685] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-10-22T21:33:08.856721] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T21:33:08.917701] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-10-22T21:33:09.717740] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-10-22T21:33:09.888014] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T21:33:10.517702] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-10. [2025-10-22T21:33:10.733686] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T21:33:11.317729] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-10-22T21:33:11.356362] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-22T21:33:11.362046] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T21:33:11.362822] [INFO ] [REMOTE ] TRC: Full fetch complete (21788 records). [2025-10-22T21:33:11.371708] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-22T21:33:11.735879] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-22T21:33:11.735963] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-22T21:33:11.736573] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-22T21:33:11.736639] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-22T21:33:11.737550] [DEBUG] [LOCAL ] TRC: Trimmed 21788 records to 15391 (keeping 200 days of data) [2025-10-22T21:33:11.832326] [DEBUG] [LOCAL ] TRC: Primary data saved (15391 records). [2025-10-22T21:33:11.832511] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-22T21:33:11.832629] [INFO ] [MAIN ] Update Progress: 2124/2367 symbols completed. TRC took 43.2s. Estimated remaining: 31m 15s. Rate: 7.8 symbols/min [2025-10-22T21:33:12.003962] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:33:12.042811] [DEBUG] [LOCAL ] TRNO: Loaded 43765 existing records from primary storage. [2025-10-22T21:33:12.043115] [INFO ] [MAIN ] TRNO: Loaded 43765 existing records. [2025-10-22T21:33:12.122792] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-10-22T21:33:12.219529] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:33:12.219763] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-22T21:33:12.219815] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-22T21:33:12.220016] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-22T21:33:12.220071] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-22T21:33:12.562837] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:33:12.917679] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-10-22T21:33:13.564358] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-22T21:33:13.717688] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-10-22T21:33:14.094946] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T21:33:14.457763] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T21:33:14.517611] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-10-22T21:33:15.321300] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-10-22T21:33:15.326624] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T21:33:16.039273] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T21:33:16.117628] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-10-22T21:33:16.736618] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T21:33:16.917701] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-10-22T21:33:17.661734] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T21:33:17.717619] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-10-22T21:33:18.292466] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T21:33:18.517692] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-10. [2025-10-22T21:33:19.317636] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-10-22T21:33:19.411035] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T21:33:20.117747] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-10-22T21:33:20.164431] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-22T21:33:20.174552] [INFO ] [REMOTE ] TREX: Full fetch complete (71862 records). [2025-10-22T21:33:20.175000] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-22T21:33:20.705628] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-22T21:33:20.705813] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-22T21:33:20.708949] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-22T21:33:20.709027] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-22T21:33:20.710737] [DEBUG] [LOCAL ] TREX: Trimmed 71862 records to 49790 (keeping 200 days of data) [2025-10-22T21:33:20.922704] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-10-22T21:33:21.019008] [DEBUG] [LOCAL ] TREX: Primary data saved (49790 records). [2025-10-22T21:33:21.019137] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-22T21:33:21.019217] [INFO ] [MAIN ] Update Progress: 2125/2367 symbols completed. TREX took 35.9s. Estimated remaining: 31m 7s. Rate: 7.8 symbols/min [2025-10-22T21:33:21.188677] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:33:21.219063] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T21:33:21.273045] [DEBUG] [LOCAL ] TROX: Loaded 52247 existing records from primary storage. [2025-10-22T21:33:21.273388] [INFO ] [MAIN ] TROX: Loaded 52247 existing records. [2025-10-22T21:33:21.475607] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:33:21.476044] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-22T21:33:21.476138] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-22T21:33:21.476444] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-22T21:33:21.476503] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-22T21:33:21.733260] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-10-22T21:33:21.876176] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:33:21.880201] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-22T21:33:22.517687] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-10-22T21:33:22.544632] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T21:33:23.317682] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-10-22T21:33:23.831917] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-22T21:33:24.117666] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-10-22T21:33:24.157248] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T21:33:24.927430] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-10-22T21:33:24.934055] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T21:33:25.304577] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T21:33:25.717684] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-10-22T21:33:26.153937] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-22T21:33:26.517683] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-10-22T21:33:27.250043] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-22T21:33:27.317673] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-10. [2025-10-22T21:33:28.117665] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-10-22T21:33:28.574237] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T21:33:28.579759] [INFO ] [REMOTE ] TRN: Full fetch complete (52671 records). [2025-10-22T21:33:28.579857] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-22T21:33:28.778961] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-22T21:33:28.922722] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-10-22T21:33:29.005540] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-22T21:33:29.005620] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-22T21:33:29.006587] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-22T21:33:29.006662] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-22T21:33:29.007829] [DEBUG] [LOCAL ] TRN: Trimmed 52671 records to 36276 (keeping 200 days of data) [2025-10-22T21:33:29.233709] [DEBUG] [LOCAL ] TRN: Primary data saved (36276 records). [2025-10-22T21:33:29.233837] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-22T21:33:29.233916] [INFO ] [MAIN ] Update Progress: 2126/2367 symbols completed. TRN took 31.6s. Estimated remaining: 30m 60s. Rate: 7.8 symbols/min [2025-10-22T21:33:29.412565] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:33:29.460051] [DEBUG] [LOCAL ] TRP: Loaded 52128 existing records from primary storage. [2025-10-22T21:33:29.478791] [INFO ] [MAIN ] TRP: Loaded 52128 existing records. [2025-10-22T21:33:29.563429] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T21:33:29.682329] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:33:29.682571] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-22T21:33:29.682620] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-22T21:33:29.683061] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-22T21:33:29.683121] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-22T21:33:29.722811] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-10-22T21:33:30.046850] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:33:30.499960] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T21:33:30.517637] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-10-22T21:33:31.317695] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-10-22T21:33:31.987638] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-22T21:33:32.117705] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-10. [2025-10-22T21:33:32.293752] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T21:33:32.917682] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-10-22T21:33:33.107429] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T21:33:33.163962] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T21:33:33.171509] [INFO ] [REMOTE ] TRNO: Full fetch complete (62823 records). [2025-10-22T21:33:33.171665] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-22T21:33:33.607104] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-22T21:33:33.607187] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-22T21:33:33.608394] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-22T21:33:33.608458] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-22T21:33:33.609754] [DEBUG] [LOCAL ] TRNO: Trimmed 62823 records to 43615 (keeping 200 days of data) [2025-10-22T21:33:33.736996] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-10. [2025-10-22T21:33:33.909814] [DEBUG] [LOCAL ] TRNO: Primary data saved (43615 records). [2025-10-22T21:33:33.909979] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-22T21:33:33.910123] [INFO ] [MAIN ] Update Progress: 2127/2367 symbols completed. TRNO took 22.1s. Estimated remaining: 30m 52s. Rate: 7.8 symbols/min [2025-10-22T21:33:34.088523] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:33:34.120430] [DEBUG] [LOCAL ] TRTX: Loaded 37056 existing records from primary storage. [2025-10-22T21:33:34.120796] [INFO ] [MAIN ] TRTX: Loaded 37056 existing records. [2025-10-22T21:33:34.292219] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:33:34.292437] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-22T21:33:34.292485] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-22T21:33:34.292881] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-10-22T21:33:34.292937] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-22T21:33:34.526017] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-10-22T21:33:34.650078] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:33:35.181977] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-22T21:33:35.317701] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-10-22T21:33:35.490610] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-22T21:33:35.499132] [INFO ] [REMOTE ] TRGP: Full fetch complete (73644 records). [2025-10-22T21:33:35.499310] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-22T21:33:35.891142] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-22T21:33:35.891232] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-22T21:33:35.892546] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-22T21:33:35.892623] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-22T21:33:35.894172] [DEBUG] [LOCAL ] TRGP: Trimmed 73644 records to 50729 (keeping 200 days of data) [2025-10-22T21:33:36.120568] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-10-22T21:33:36.205567] [DEBUG] [LOCAL ] TRGP: Primary data saved (50729 records). [2025-10-22T21:33:36.205724] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-22T21:33:36.206237] [INFO ] [MAIN ] Update Progress: 2128/2367 symbols completed. TRGP took 41.2s. Estimated remaining: 30m 43s. Rate: 7.8 symbols/min [2025-10-22T21:33:36.373760] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:33:36.406487] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T21:33:36.461987] [DEBUG] [LOCAL ] TRU: Loaded 51460 existing records from primary storage. [2025-10-22T21:33:36.462351] [INFO ] [MAIN ] TRU: Loaded 51460 existing records. [2025-10-22T21:33:36.642200] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:33:36.642773] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-22T21:33:36.642883] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-22T21:33:36.643177] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-22T21:33:36.643247] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-22T21:33:36.917763] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-10-22T21:33:37.029342] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:33:37.025569] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T21:33:37.679636] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T21:33:37.717630] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-10-22T21:33:38.517696] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-10-22T21:33:38.856669] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-22T21:33:39.032205] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T21:33:39.317682] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-10-22T21:33:40.117637] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-10-22T21:33:40.176788] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T21:33:40.917637] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-10-22T21:33:41.112064] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T21:33:41.717744] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-10-22T21:33:41.793818] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T21:33:42.413371] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T21:33:42.517723] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-10-22T21:33:43.317671] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-10-22T21:33:43.474582] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-22T21:33:43.700279] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T21:33:44.117725] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-10-22T21:33:44.917733] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-10-22T21:33:45.113018] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-22T21:33:45.717727] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-10-22T21:33:45.885788] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T21:33:46.517765] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-10-22T21:33:46.576597] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T21:33:46.720755] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-22T21:33:47.317691] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-10-22T21:33:48.117637] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-10-22T21:33:48.692170] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-22T21:33:48.917725] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-10-22T21:33:49.051527] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T21:33:49.717695] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-10-22T21:33:50.037748] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T21:33:50.517741] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-10-22T21:33:50.729035] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T21:33:51.141434] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-22T21:33:51.317690] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-10-22T21:33:52.117722] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-10-22T21:33:52.272069] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T21:33:52.917637] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-10. [2025-10-22T21:33:53.058453] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T21:33:53.340527] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T21:33:53.717690] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-10-22T21:33:54.517725] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-10-22T21:33:54.720860] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-22T21:33:54.730350] [INFO ] [REMOTE ] TROX: Full fetch complete (74138 records). [2025-10-22T21:33:54.730570] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-22T21:33:55.180455] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-22T21:33:55.180788] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-22T21:33:55.182626] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-22T21:33:55.182737] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-22T21:33:55.184870] [DEBUG] [LOCAL ] TROX: Trimmed 74138 records to 52233 (keeping 200 days of data) [2025-10-22T21:33:55.322706] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-10. [2025-10-22T21:33:55.342775] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T21:33:55.557437] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T21:33:55.573624] [DEBUG] [LOCAL ] TROX: Primary data saved (52233 records). [2025-10-22T21:33:55.573797] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-22T21:33:55.573886] [INFO ] [MAIN ] Update Progress: 2129/2367 symbols completed. TROX took 34.6s. Estimated remaining: 30m 37s. Rate: 7.8 symbols/min [2025-10-22T21:33:55.737190] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:33:55.778215] [DEBUG] [LOCAL ] TRV: Loaded 47486 existing records from primary storage. [2025-10-22T21:33:55.778504] [INFO ] [MAIN ] TRV: Loaded 47486 existing records. [2025-10-22T21:33:55.948945] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:33:55.949160] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-22T21:33:55.949206] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-22T21:33:55.949412] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-22T21:33:55.949466] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-22T21:33:56.123896] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-10-22T21:33:56.301663] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:33:56.917714] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-10-22T21:33:57.058118] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T21:33:57.066788] [INFO ] [REMOTE ] TRP: Full fetch complete (75759 records). [2025-10-22T21:33:57.066918] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-22T21:33:57.465399] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-22T21:33:57.465527] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-22T21:33:57.466738] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-22T21:33:57.466802] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-22T21:33:57.468320] [DEBUG] [LOCAL ] TRP: Trimmed 75759 records to 52127 (keeping 200 days of data) [2025-10-22T21:33:57.739109] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-10-22T21:33:57.784693] [DEBUG] [LOCAL ] TRP: Primary data saved (52127 records). [2025-10-22T21:33:57.784857] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-22T21:33:57.784947] [INFO ] [MAIN ] Update Progress: 2130/2367 symbols completed. TRP took 28.6s. Estimated remaining: 30m 28s. Rate: 7.8 symbols/min [2025-10-22T21:33:57.956607] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:33:58.004937] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T21:33:58.028925] [DEBUG] [LOCAL ] TS: Loaded 51660 existing records from primary storage. [2025-10-22T21:33:58.029230] [INFO ] [MAIN ] TS: Loaded 51660 existing records. [2025-10-22T21:33:58.201461] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:33:58.201723] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-22T21:33:58.201779] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-22T21:33:58.201976] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-22T21:33:58.202032] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-22T21:33:58.522804] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-10. [2025-10-22T21:33:58.560990] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:33:58.695017] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T21:33:59.317693] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-10-22T21:33:59.607049] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-22T21:33:59.951156] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-22T21:33:59.957753] [INFO ] [REMOTE ] TRTX: Full fetch complete (53008 records). [2025-10-22T21:33:59.957854] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-22T21:34:00.127735] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-10-22T21:34:00.333188] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-22T21:34:00.333278] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-22T21:34:00.334299] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-22T21:34:00.334361] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-22T21:34:00.335443] [DEBUG] [LOCAL ] TRTX: Trimmed 53008 records to 36901 (keeping 200 days of data) [2025-10-22T21:34:00.546846] [DEBUG] [LOCAL ] TRTX: Primary data saved (36901 records). [2025-10-22T21:34:00.546965] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-22T21:34:00.547053] [INFO ] [MAIN ] Update Progress: 2131/2367 symbols completed. TRTX took 26.6s. Estimated remaining: 30m 20s. Rate: 7.8 symbols/min [2025-10-22T21:34:00.713803] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:34:00.739564] [DEBUG] [LOCAL ] TSE: Loaded 27688 existing records from primary storage. [2025-10-22T21:34:00.739867] [INFO ] [MAIN ] TSE: Loaded 27688 existing records. [2025-10-22T21:34:00.914843] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:34:00.915096] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-22T21:34:00.915149] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-22T21:34:00.915527] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-22T21:34:00.915583] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-22T21:34:00.926949] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-10-22T21:34:01.237795] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-22T21:34:01.318889] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:34:01.717711] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-10-22T21:34:01.949172] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-22T21:34:02.517711] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-10-22T21:34:02.872150] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-22T21:34:03.317631] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-10-22T21:34:03.397832] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T21:34:03.692089] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T21:34:04.117740] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-10-22T21:34:04.917720] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-10-22T21:34:05.070910] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T21:34:05.110511] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-22T21:34:05.717669] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-10-22T21:34:06.517696] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-10-22T21:34:06.905861] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-22T21:34:06.947104] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-22T21:34:07.317679] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-10-22T21:34:08.121563] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-10-22T21:34:08.123948] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-22T21:34:08.917718] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-10-22T21:34:09.141690] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T21:34:09.451178] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-22T21:34:09.717671] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-10-22T21:34:10.517718] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-10-22T21:34:11.082293] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-22T21:34:11.184449] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T21:34:11.317617] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-10-22T21:34:12.117626] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-10-22T21:34:12.546280] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-22T21:34:12.706777] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T21:34:12.917754] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-10-22T21:34:13.717722] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-10-22T21:34:13.829339] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T21:34:14.517746] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-10. [2025-10-22T21:34:14.826124] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-22T21:34:15.033472] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-22T21:34:15.317682] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-10-22T21:34:16.066974] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-22T21:34:16.075865] [INFO ] [REMOTE ] TRU: Full fetch complete (74191 records). [2025-10-22T21:34:16.076021] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-22T21:34:16.123710] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-10-22T21:34:16.514609] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-22T21:34:16.514738] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-22T21:34:16.515908] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-22T21:34:16.515971] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-22T21:34:16.517422] [DEBUG] [LOCAL ] TRU: Trimmed 74191 records to 51459 (keeping 200 days of data) [2025-10-22T21:34:16.827969] [DEBUG] [LOCAL ] TRU: Primary data saved (51459 records). [2025-10-22T21:34:16.828107] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-22T21:34:16.828778] [INFO ] [MAIN ] Update Progress: 2132/2367 symbols completed. TRU took 40.6s. Estimated remaining: 30m 13s. Rate: 7.8 symbols/min [2025-10-22T21:34:16.921372] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-10-22T21:34:17.003863] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:34:17.013556] [DEBUG] [LOCAL ] TSI: Loaded 8226 existing records from primary storage. [2025-10-22T21:34:17.013963] [INFO ] [MAIN ] TSI: Loaded 8226 existing records. [2025-10-22T21:34:17.224839] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:34:17.229128] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-22T21:34:17.229211] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-22T21:34:17.231209] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-10-22T21:34:17.231139] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-22T21:34:17.231333] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-22T21:34:17.594420] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T21:34:17.623812] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:34:17.717683] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-10-22T21:34:18.342887] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T21:34:18.522730] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-10-22T21:34:18.530969] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-22T21:34:19.171904] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-22T21:34:19.317763] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-10-22T21:34:20.117685] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-10-22T21:34:20.917638] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-10-22T21:34:21.239491] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-22T21:34:21.442793] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-22T21:34:21.717690] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-10. [2025-10-22T21:34:22.517623] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-10-22T21:34:22.782146] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T21:34:22.832912] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T21:34:22.837340] [INFO ] [REMOTE ] TSE: Full fetch complete (40746 records). [2025-10-22T21:34:22.837481] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-22T21:34:23.225865] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-22T21:34:23.225997] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-22T21:34:23.226843] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-22T21:34:23.226907] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-22T21:34:23.227905] [DEBUG] [LOCAL ] TSE: Trimmed 40746 records to 27651 (keeping 200 days of data) [2025-10-22T21:34:23.317913] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-10-22T21:34:23.387929] [DEBUG] [LOCAL ] TSE: Primary data saved (27651 records). [2025-10-22T21:34:23.388063] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-22T21:34:23.388139] [INFO ] [MAIN ] Update Progress: 2133/2367 symbols completed. TSE took 22.8s. Estimated remaining: 30m 6s. Rate: 7.8 symbols/min [2025-10-22T21:34:23.559084] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:34:23.593066] [DEBUG] [LOCAL ] TSLX: Loaded 35822 existing records from primary storage. [2025-10-22T21:34:23.593356] [INFO ] [MAIN ] TSLX: Loaded 35822 existing records. [2025-10-22T21:34:23.768322] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:34:23.768569] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-22T21:34:23.768616] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-22T21:34:23.768945] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-22T21:34:23.769002] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-22T21:34:24.128446] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-10-22T21:34:24.134234] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:34:24.163082] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T21:34:24.917686] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-10-22T21:34:25.090306] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T21:34:25.133768] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T21:34:25.717683] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-10-22T21:34:26.140293] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-22T21:34:26.517630] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-10-22T21:34:26.645856] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-22T21:34:27.317680] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-10-22T21:34:27.594638] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T21:34:28.117667] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-10-22T21:34:28.138888] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-22T21:34:28.917683] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-10-22T21:34:29.504600] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-22T21:34:29.717681] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-10-22T21:34:29.938303] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T21:34:30.517738] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-10-22T21:34:31.057317] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-22T21:34:31.244854] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-22T21:34:31.317677] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-10-22T21:34:32.070081] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-22T21:34:32.117685] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-10-22T21:34:32.222314] [DEBUG] [REMOTE ] TSI: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-22T21:34:32.222674] [WARN ] [REMOTE ] TSI: No data returned for month 2025-08 [2025-10-22T21:34:32.222764] [FATAL] [REMOTE ] TSI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:34:32.222840] [FATAL] [MAIN ] TSI: Failed to fetch primary data. [2025-10-22T21:34:32.222879] [WARN ] [MAIN ] TSI: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:34:32.222919] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-22T21:34:32.222977] [DEBUG] [LOCAL ] TSI: No primary data file found to delete. [2025-10-22T21:34:32.223015] [INFO ] [LOCAL ] TSI: Starting deletion of derivative data. [2025-10-22T21:34:32.223190] [DEBUG] [LOCAL ] TSI: Deleted derivative data file. [2025-10-22T21:34:32.223271] [INFO ] [MAIN ] Update Progress: 2134/2367 symbols completed. TSI took 15.4s. Estimated remaining: 29m 58s. Rate: 7.8 symbols/min [2025-10-22T21:34:32.391735] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:34:32.443706] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-22T21:34:32.444031] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-10-22T21:34:32.616205] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:34:32.616417] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-22T21:34:32.616463] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-22T21:34:32.616694] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-22T21:34:32.616761] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-22T21:34:32.928344] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-10. [2025-10-22T21:34:32.967830] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:34:33.717680] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-10-22T21:34:34.517742] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-10-22T21:34:34.713076] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T21:34:34.721494] [INFO ] [REMOTE ] TS: Full fetch complete (74842 records). [2025-10-22T21:34:34.721631] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-22T21:34:35.106291] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-22T21:34:35.106381] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-22T21:34:35.107595] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-22T21:34:35.107685] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-22T21:34:35.109160] [DEBUG] [LOCAL ] TS: Trimmed 74842 records to 51646 (keeping 200 days of data) [2025-10-22T21:34:35.320898] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-10. [2025-10-22T21:34:35.415567] [DEBUG] [LOCAL ] TS: Primary data saved (51646 records). [2025-10-22T21:34:35.415723] [INFO ] [MAIN ] TS: Full history saved. [2025-10-22T21:34:35.415809] [INFO ] [MAIN ] Update Progress: 2135/2367 symbols completed. TS took 37.6s. Estimated remaining: 29m 50s. Rate: 7.8 symbols/min [2025-10-22T21:34:35.591372] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:34:35.639761] [DEBUG] [LOCAL ] TSN: Loaded 53088 existing records from primary storage. [2025-10-22T21:34:35.640116] [INFO ] [MAIN ] TSN: Loaded 53088 existing records. [2025-10-22T21:34:35.842573] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:34:35.843190] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-22T21:34:35.843294] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-22T21:34:35.843677] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-22T21:34:35.843742] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-22T21:34:36.042634] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T21:34:36.141047] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-10-22T21:34:36.234952] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:34:36.917763] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-10-22T21:34:36.958991] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (3.24 seconds). [2025-10-22T21:34:37.024497] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-22T21:34:37.032832] [INFO ] [REMOTE ] TRV: Full fetch complete (69968 records). [2025-10-22T21:34:37.033026] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-22T21:34:37.427254] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-22T21:34:37.427473] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-22T21:34:37.428742] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-22T21:34:37.428848] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-22T21:34:37.430363] [DEBUG] [LOCAL ] TRV: Trimmed 69968 records to 47467 (keeping 200 days of data) [2025-10-22T21:34:37.520163] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T21:34:37.718819] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-10-22T21:34:37.767766] [DEBUG] [LOCAL ] TRV: Primary data saved (47467 records). [2025-10-22T21:34:37.767944] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-22T21:34:37.768060] [INFO ] [MAIN ] Update Progress: 2136/2367 symbols completed. TRV took 42.2s. Estimated remaining: 29m 42s. Rate: 7.8 symbols/min [2025-10-22T21:34:37.957670] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:34:37.970044] [DEBUG] [LOCAL ] TSQ: Loaded 11587 existing records from primary storage. [2025-10-22T21:34:37.970306] [INFO ] [MAIN ] TSQ: Loaded 11587 existing records. [2025-10-22T21:34:38.146783] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:34:38.147020] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-22T21:34:38.147066] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-22T21:34:38.147234] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-22T21:34:38.147289] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-22T21:34:38.506774] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:34:38.517605] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-10-22T21:34:38.700382] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T21:34:39.311888] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-22T21:34:39.317601] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-10-22T21:34:39.966973] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-22T21:34:40.117721] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-10-22T21:34:40.149193] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-22T21:34:40.917746] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-10-22T21:34:41.521424] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-22T21:34:41.717701] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-10-22T21:34:42.517683] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-10-22T21:34:42.682188] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T21:34:43.317735] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-10-22T21:34:43.332325] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T21:34:44.117626] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-10-22T21:34:44.545080] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T21:34:44.644876] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.93 seconds). [2025-10-22T21:34:44.912958] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-22T21:34:44.917614] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-10-22T21:34:45.717742] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-10-22T21:34:46.517730] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-10-22T21:34:46.603461] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-22T21:34:47.317731] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-10-22T21:34:48.117721] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-10-22T21:34:48.400494] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T21:34:48.585530] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T21:34:48.697231] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-10-22T21:34:48.917628] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-10-22T21:34:49.069915] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-22T21:34:49.717717] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-10-22T21:34:50.272192] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-22T21:34:50.517636] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-10. [2025-10-22T21:34:50.724472] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-22T21:34:51.317675] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-10-22T21:34:51.995808] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-22T21:34:52.002574] [INFO ] [REMOTE ] TSLX: Full fetch complete (50798 records). [2025-10-22T21:34:52.002698] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-22T21:34:52.122869] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-10-22T21:34:52.392364] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-22T21:34:52.392434] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-22T21:34:52.393390] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-22T21:34:52.393455] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-22T21:34:52.394436] [DEBUG] [LOCAL ] TSLX: Trimmed 50798 records to 35762 (keeping 200 days of data) [2025-10-22T21:34:52.604864] [DEBUG] [LOCAL ] TSLX: Primary data saved (35762 records). [2025-10-22T21:34:52.604980] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-22T21:34:52.605055] [INFO ] [MAIN ] Update Progress: 2137/2367 symbols completed. TSLX took 29.2s. Estimated remaining: 29m 35s. Rate: 7.8 symbols/min [2025-10-22T21:34:52.771254] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:34:52.815421] [DEBUG] [LOCAL ] TT: Loaded 47010 existing records from primary storage. [2025-10-22T21:34:52.815767] [INFO ] [MAIN ] TT: Loaded 47010 existing records. [2025-10-22T21:34:52.922853] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-10-22T21:34:52.993390] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:34:52.993567] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-22T21:34:52.993613] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-22T21:34:52.993807] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-22T21:34:52.993858] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-22T21:34:53.341409] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:34:53.717624] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-10-22T21:34:53.825564] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-22T21:34:54.150633] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-22T21:34:54.251412] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-10-22T21:34:54.517682] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-10-22T21:34:55.317681] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-10-22T21:34:55.672695] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-22T21:34:56.117724] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-10-22T21:34:56.620515] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-22T21:34:56.917682] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-10-22T21:34:57.717631] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-10-22T21:34:57.978878] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T21:34:58.072596] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.75 seconds). [2025-10-22T21:34:58.490002] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-22T21:34:58.517615] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-10-22T21:34:58.601957] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T21:34:59.257142] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T21:34:59.317669] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-10. [2025-10-22T21:35:00.059837] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T21:35:00.061901] [INFO ] [REMOTE ] TSQ: Full fetch complete (16307 records). [2025-10-22T21:35:00.061978] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-22T21:35:00.122827] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-10-22T21:35:00.435023] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-22T21:35:00.435103] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-22T21:35:00.435496] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-22T21:35:00.435580] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-22T21:35:00.436118] [DEBUG] [LOCAL ] TSQ: Trimmed 16307 records to 11595 (keeping 200 days of data) [2025-10-22T21:35:00.504068] [DEBUG] [LOCAL ] TSQ: Primary data saved (11595 records). [2025-10-22T21:35:00.504208] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-22T21:35:00.504286] [INFO ] [MAIN ] Update Progress: 2138/2367 symbols completed. TSQ took 22.7s. Estimated remaining: 29m 27s. Rate: 7.8 symbols/min [2025-10-22T21:35:00.676858] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:35:00.677028] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-22T21:35:00.677067] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-22T21:35:00.677179] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-22T21:35:00.677220] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-22T21:35:00.677263] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-22T21:35:00.677296] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-22T21:35:00.922783] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-10-22T21:35:01.038881] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:35:01.717737] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-10-22T21:35:02.517702] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-01. [2025-10-22T21:35:02.734208] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:35:02.734593] [WARN ] [REMOTE ] TTAM: No data returned for month 2025-01 [2025-10-22T21:35:02.734709] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:35:02.734758] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-22T21:35:02.734791] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:35:02.734856] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-22T21:35:02.734940] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-22T21:35:02.734995] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-22T21:35:02.735037] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-22T21:35:02.735081] [INFO ] [MAIN ] Update Progress: 2139/2367 symbols completed. TTAM took 2.2s. Estimated remaining: 29m 19s. Rate: 7.8 symbols/min [2025-10-22T21:35:02.911756] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:35:02.948209] [DEBUG] [LOCAL ] TTC: Loaded 41627 existing records from primary storage. [2025-10-22T21:35:02.948580] [INFO ] [MAIN ] TTC: Loaded 41627 existing records. [2025-10-22T21:35:03.159978] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:35:03.161028] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-22T21:35:03.163844] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-22T21:35:03.161669] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-22T21:35:03.175839] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-22T21:35:03.175978] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-22T21:35:03.318804] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-10-22T21:35:03.511048] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (3.39 seconds). [2025-10-22T21:35:03.630068] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:35:03.683448] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T21:35:04.117682] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-10-22T21:35:04.917739] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-10-22T21:35:05.073243] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-22T21:35:05.717694] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-10-22T21:35:06.511468] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T21:35:06.522130] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-10-22T21:35:06.556464] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T21:35:06.973839] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-10-22T21:35:07.317720] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-10. [2025-10-22T21:35:08.117679] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-10-22T21:35:08.475722] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T21:35:08.917688] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-10-22T21:35:09.265261] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-22T21:35:09.274285] [INFO ] [REMOTE ] TSN: Full fetch complete (76676 records). [2025-10-22T21:35:09.274482] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-22T21:35:09.689803] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-22T21:35:09.689966] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-22T21:35:09.691222] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-22T21:35:09.691287] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-22T21:35:09.692789] [DEBUG] [LOCAL ] TSN: Trimmed 76676 records to 53088 (keeping 200 days of data) [2025-10-22T21:35:09.745086] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-10-22T21:35:09.939389] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-22T21:35:10.063049] [DEBUG] [LOCAL ] TSN: Primary data saved (53088 records). [2025-10-22T21:35:10.063213] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-22T21:35:10.063299] [INFO ] [MAIN ] Update Progress: 2140/2367 symbols completed. TSN took 34.6s. Estimated remaining: 29m 11s. Rate: 7.8 symbols/min [2025-10-22T21:35:10.230839] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:35:10.277108] [DEBUG] [LOCAL ] TTE: Loaded 51560 existing records from primary storage. [2025-10-22T21:35:10.277414] [INFO ] [MAIN ] TTE: Loaded 51560 existing records. [2025-10-22T21:35:10.454357] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:35:10.454737] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-22T21:35:10.454845] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-22T21:35:10.455173] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-22T21:35:10.455229] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-22T21:35:10.522798] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-10-22T21:35:10.819385] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:35:10.851310] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-22T21:35:11.317717] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-10-22T21:35:12.117672] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-10-22T21:35:12.336236] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T21:35:12.590140] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-10-22T21:35:12.917699] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-10. [2025-10-22T21:35:12.947773] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-22T21:35:13.717692] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-10-22T21:35:14.027281] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T21:35:14.517746] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-10-22T21:35:15.117604] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-22T21:35:15.317708] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-10-22T21:35:15.664987] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-22T21:35:15.673896] [INFO ] [REMOTE ] TSM: Full fetch complete (77999 records). [2025-10-22T21:35:15.674043] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-22T21:35:16.070824] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-22T21:35:16.071025] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-22T21:35:16.072262] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-22T21:35:16.072379] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-22T21:35:16.073974] [DEBUG] [LOCAL ] TSM: Trimmed 77999 records to 53819 (keeping 200 days of data) [2025-10-22T21:35:16.129014] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-10-22T21:35:16.349121] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-22T21:35:16.456525] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-10-22T21:35:16.456692] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-22T21:35:16.457307] [INFO ] [MAIN ] Update Progress: 2141/2367 symbols completed. TSM took 44.2s. Estimated remaining: 29m 3s. Rate: 7.8 symbols/min [2025-10-22T21:35:16.631112] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:35:16.676490] [DEBUG] [LOCAL ] TTI: Loaded 46631 existing records from primary storage. [2025-10-22T21:35:16.676854] [INFO ] [MAIN ] TTI: Loaded 46631 existing records. [2025-10-22T21:35:16.860038] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:35:16.860392] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-22T21:35:16.860590] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-22T21:35:16.870171] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-22T21:35:16.876975] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-22T21:35:16.933682] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-10-22T21:35:16.947816] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T21:35:17.258165] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:35:17.321547] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T21:35:17.717673] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-10-22T21:35:18.517633] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-10-22T21:35:19.243307] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-22T21:35:19.317691] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-10-22T21:35:19.421774] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T21:35:19.763219] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T21:35:20.117712] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-10-22T21:35:20.917624] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-10-22T21:35:21.234681] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T21:35:21.717711] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-10-22T21:35:21.878711] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-22T21:35:22.522887] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-10. [2025-10-22T21:35:22.537492] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T21:35:23.317704] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-10-22T21:35:23.561048] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-22T21:35:24.117668] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-10-22T21:35:24.390814] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-22T21:35:24.398382] [INFO ] [REMOTE ] TT: Full fetch complete (69971 records). [2025-10-22T21:35:24.398550] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-22T21:35:24.788917] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-22T21:35:24.789009] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-22T21:35:24.790142] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-22T21:35:24.790204] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-22T21:35:24.791517] [DEBUG] [LOCAL ] TT: Trimmed 69971 records to 47001 (keeping 200 days of data) [2025-10-22T21:35:24.931616] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-10-22T21:35:24.965338] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T21:35:25.142887] [DEBUG] [LOCAL ] TT: Primary data saved (47001 records). [2025-10-22T21:35:25.143020] [INFO ] [MAIN ] TT: Full history saved. [2025-10-22T21:35:25.143095] [INFO ] [MAIN ] Update Progress: 2142/2367 symbols completed. TT took 32.5s. Estimated remaining: 28m 55s. Rate: 7.8 symbols/min [2025-10-22T21:35:25.313260] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:35:25.358601] [DEBUG] [LOCAL ] TU: Loaded 49803 existing records from primary storage. [2025-10-22T21:35:25.359085] [INFO ] [MAIN ] TU: Loaded 49803 existing records. [2025-10-22T21:35:25.537984] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:35:25.538300] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-22T21:35:25.538454] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-22T21:35:25.538710] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-22T21:35:25.538768] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-22T21:35:25.719586] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-10-22T21:35:25.937426] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:35:25.932018] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T21:35:26.517729] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-10-22T21:35:26.793571] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-22T21:35:27.234385] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T21:35:27.317671] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-10-22T21:35:28.117692] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-10-22T21:35:28.154169] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T21:35:28.563367] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-22T21:35:28.917627] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-10-22T21:35:29.717627] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-10-22T21:35:30.042317] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-22T21:35:30.518164] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T21:35:30.518247] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-10-22T21:35:31.226139] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T21:35:31.317670] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-10-22T21:35:32.085222] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-22T21:35:32.117623] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-10. [2025-10-22T21:35:32.917624] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-10-22T21:35:33.106690] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-22T21:35:33.604612] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T21:35:33.611328] [INFO ] [REMOTE ] TTC: Full fetch complete (61897 records). [2025-10-22T21:35:33.611462] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-22T21:35:33.722854] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-10-22T21:35:34.000891] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-22T21:35:34.000966] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-22T21:35:34.002014] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-22T21:35:34.002073] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-22T21:35:34.003237] [DEBUG] [LOCAL ] TTC: Trimmed 61897 records to 41525 (keeping 200 days of data) [2025-10-22T21:35:34.253483] [DEBUG] [LOCAL ] TTC: Primary data saved (41525 records). [2025-10-22T21:35:34.253598] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-22T21:35:34.253697] [INFO ] [MAIN ] Update Progress: 2143/2367 symbols completed. TTC took 31.5s. Estimated remaining: 28m 48s. Rate: 7.8 symbols/min [2025-10-22T21:35:34.430351] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:35:34.470456] [DEBUG] [LOCAL ] TUYA: Loaded 45890 existing records from primary storage. [2025-10-22T21:35:34.470835] [INFO ] [MAIN ] TUYA: Loaded 45890 existing records. [2025-10-22T21:35:34.528815] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-10-22T21:35:34.661796] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:35:34.662027] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-22T21:35:34.662210] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-22T21:35:34.662473] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-22T21:35:34.662541] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-22T21:35:35.049864] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-22T21:35:35.081128] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:35:35.317699] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-10-22T21:35:35.496550] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-22T21:35:36.117632] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-10-22T21:35:36.197332] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T21:35:36.782581] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T21:35:36.917744] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-10-22T21:35:37.717716] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-10-22T21:35:37.931828] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T21:35:38.523100] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-10-22T21:35:38.525482] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T21:35:39.317728] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-10-22T21:35:40.047565] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-22T21:35:40.117629] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-10-22T21:35:40.235451] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T21:35:40.917761] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-10-22T21:35:41.091437] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T21:35:41.717696] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-10-22T21:35:41.926684] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T21:35:42.517637] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-10-22T21:35:42.647825] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T21:35:43.293597] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T21:35:43.317638] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-10-22T21:35:44.117693] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-10. [2025-10-22T21:35:44.225914] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T21:35:44.917634] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-10-22T21:35:44.976709] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T21:35:45.717628] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-10. [2025-10-22T21:35:45.972268] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T21:35:45.982051] [INFO ] [REMOTE ] TTE: Full fetch complete (75083 records). [2025-10-22T21:35:45.982220] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-22T21:35:46.377934] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-22T21:35:46.378017] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-22T21:35:46.379158] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-22T21:35:46.379223] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-22T21:35:46.380609] [DEBUG] [LOCAL ] TTE: Trimmed 75083 records to 51552 (keeping 200 days of data) [2025-10-22T21:35:46.553250] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-10-22T21:35:46.658260] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T21:35:46.737107] [DEBUG] [LOCAL ] TTE: Primary data saved (51552 records). [2025-10-22T21:35:46.737227] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-22T21:35:46.737300] [INFO ] [MAIN ] Update Progress: 2144/2367 symbols completed. TTE took 36.7s. Estimated remaining: 28m 41s. Rate: 7.8 symbols/min [2025-10-22T21:35:46.900425] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:35:46.938820] [DEBUG] [LOCAL ] TV: Loaded 41369 existing records from primary storage. [2025-10-22T21:35:46.939077] [INFO ] [MAIN ] TV: Loaded 41369 existing records. [2025-10-22T21:35:47.112042] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:35:47.112238] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-22T21:35:47.112285] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-22T21:35:47.112835] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-22T21:35:47.112892] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-22T21:35:47.319222] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-10-22T21:35:47.475661] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:35:47.499941] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T21:35:47.508410] [INFO ] [REMOTE ] TTI: Full fetch complete (66546 records). [2025-10-22T21:35:47.508558] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-22T21:35:47.892142] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-22T21:35:47.892240] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-22T21:35:47.893314] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-22T21:35:47.893411] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-22T21:35:47.894895] [DEBUG] [LOCAL ] TTI: Trimmed 66546 records to 46650 (keeping 200 days of data) [2025-10-22T21:35:48.036834] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T21:35:48.124306] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-10-22T21:35:48.196488] [DEBUG] [LOCAL ] TTI: Primary data saved (46650 records). [2025-10-22T21:35:48.196613] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-22T21:35:48.197338] [INFO ] [MAIN ] Update Progress: 2145/2367 symbols completed. TTI took 31.7s. Estimated remaining: 28m 32s. Rate: 7.8 symbols/min [2025-10-22T21:35:48.362932] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:35:48.367035] [DEBUG] [LOCAL ] TVC: Loaded 3141 existing records from primary storage. [2025-10-22T21:35:48.367181] [INFO ] [MAIN ] TVC: Loaded 3141 existing records. [2025-10-22T21:35:48.539521] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:35:48.539753] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-22T21:35:48.539805] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-22T21:35:48.540047] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-22T21:35:48.540101] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-22T21:35:48.894600] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:35:48.917673] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-10-22T21:35:49.406835] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-22T21:35:49.512318] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-22T21:35:49.717691] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-10-22T21:35:49.796311] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T21:35:50.517725] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-10-22T21:35:51.317830] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-10-22T21:35:51.442319] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T21:35:52.058329] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-22T21:35:52.085896] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T21:35:52.117628] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-10-22T21:35:52.753235] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-22T21:35:52.917718] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-10-22T21:35:53.717704] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-10-22T21:35:54.517679] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-10-22T21:35:54.597879] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-22T21:35:55.114757] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-22T21:35:55.294163] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T21:35:55.317635] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-10-22T21:35:56.117677] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-10-22T21:35:56.917725] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-10. [2025-10-22T21:35:56.972160] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T21:35:57.717737] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-10-22T21:35:57.791851] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-22T21:35:58.288822] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-22T21:35:58.517683] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-10-22T21:35:58.630102] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-22T21:35:58.638343] [INFO ] [REMOTE ] TU: Full fetch complete (72882 records). [2025-10-22T21:35:58.638473] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-22T21:35:59.021847] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-22T21:35:59.021918] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-22T21:35:59.023020] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-22T21:35:59.023083] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-22T21:35:59.024449] [DEBUG] [LOCAL ] TU: Trimmed 72882 records to 49774 (keeping 200 days of data) [2025-10-22T21:35:59.317715] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-10-22T21:35:59.321709] [DEBUG] [LOCAL ] TU: Primary data saved (49774 records). [2025-10-22T21:35:59.322500] [INFO ] [MAIN ] TU: Full history saved. [2025-10-22T21:35:59.322592] [INFO ] [MAIN ] Update Progress: 2146/2367 symbols completed. TU took 34.2s. Estimated remaining: 28m 25s. Rate: 7.8 symbols/min [2025-10-22T21:35:59.487189] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:35:59.492398] [DEBUG] [LOCAL ] TVE: Loaded 2575 existing records from primary storage. [2025-10-22T21:35:59.492579] [INFO ] [MAIN ] TVE: Loaded 2575 existing records. [2025-10-22T21:35:59.669549] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:35:59.669780] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-22T21:35:59.669831] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-22T21:35:59.669975] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-10-22T21:35:59.670013] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-22T21:36:00.028166] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:36:00.040456] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-22T21:36:00.117618] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-10-22T21:36:00.195858] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T21:36:00.670732] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-22T21:36:00.917688] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-10-22T21:36:01.717710] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-10-22T21:36:02.469728] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-22T21:36:02.517619] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-10-22T21:36:02.876379] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T21:36:03.079539] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-22T21:36:03.317714] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-10-22T21:36:03.822622] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-22T21:36:04.117739] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-10. [2025-10-22T21:36:04.917718] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-10-22T21:36:05.644434] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-22T21:36:05.651609] [INFO ] [REMOTE ] TUYA: Full fetch complete (66930 records). [2025-10-22T21:36:05.651751] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-22T21:36:05.725210] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-10-22T21:36:06.043113] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-22T21:36:06.043219] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-22T21:36:06.044307] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-22T21:36:06.044370] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-22T21:36:06.045679] [DEBUG] [LOCAL ] TUYA: Trimmed 66930 records to 45737 (keeping 200 days of data) [2025-10-22T21:36:06.296424] [DEBUG] [LOCAL ] TUYA: Primary data saved (45737 records). [2025-10-22T21:36:06.296558] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-22T21:36:06.296632] [INFO ] [MAIN ] Update Progress: 2147/2367 symbols completed. TUYA took 32.0s. Estimated remaining: 28m 17s. Rate: 7.8 symbols/min [2025-10-22T21:36:06.469294] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-22T21:36:06.469022] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:36:06.502876] [DEBUG] [LOCAL ] TWI: Loaded 33883 existing records from primary storage. [2025-10-22T21:36:06.503202] [INFO ] [MAIN ] TWI: Loaded 33883 existing records. [2025-10-22T21:36:06.524288] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-10-22T21:36:06.715622] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T21:36:06.736609] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:36:06.745869] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-22T21:36:06.745943] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-22T21:36:06.746369] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-10-22T21:36:06.746435] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-22T21:36:07.093198] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:36:07.138458] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-22T21:36:07.317690] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-10-22T21:36:08.117694] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-10-22T21:36:08.669669] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-22T21:36:08.826615] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T21:36:08.917692] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-10-22T21:36:09.717745] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-10. [2025-10-22T21:36:10.211610] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-22T21:36:10.212566] [INFO ] [REMOTE ] TVC: Full fetch complete (5062 records). [2025-10-22T21:36:10.212633] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-22T21:36:10.414824] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T21:36:10.522777] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-10-22T21:36:10.613765] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-22T21:36:10.613844] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-22T21:36:10.613986] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-22T21:36:10.614024] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-22T21:36:10.614374] [DEBUG] [LOCAL ] TVC: Trimmed 5062 records to 3118 (keeping 200 days of data) [2025-10-22T21:36:10.633802] [DEBUG] [LOCAL ] TVC: Primary data saved (3118 records). [2025-10-22T21:36:10.633963] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-22T21:36:10.634074] [INFO ] [MAIN ] Update Progress: 2148/2367 symbols completed. TVC took 22.4s. Estimated remaining: 28m 9s. Rate: 7.8 symbols/min [2025-10-22T21:36:10.824350] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:36:10.877678] [DEBUG] [LOCAL ] TWLO: Loaded 52824 existing records from primary storage. [2025-10-22T21:36:10.878005] [INFO ] [MAIN ] TWLO: Loaded 52824 existing records. [2025-10-22T21:36:11.055003] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:36:11.055332] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-22T21:36:11.055392] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-22T21:36:11.055608] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-10-22T21:36:11.055704] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-22T21:36:11.326507] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-10-22T21:36:11.408214] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:36:12.118841] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-10-22T21:36:12.122265] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-22T21:36:12.582398] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-22T21:36:12.827161] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T21:36:12.917695] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-10-22T21:36:13.717694] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-10-22T21:36:14.433799] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T21:36:14.517637] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-10-22T21:36:15.317670] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-10-22T21:36:15.906295] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T21:36:16.091191] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T21:36:16.123525] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-10-22T21:36:16.128867] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-22T21:36:16.917689] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-10-22T21:36:17.582037] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T21:36:17.717687] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-10-22T21:36:18.517670] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-10-22T21:36:18.938081] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-22T21:36:19.002401] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-22T21:36:19.013720] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-22T21:36:19.317719] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-10-22T21:36:20.117707] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-10-22T21:36:20.776104] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-22T21:36:20.824088] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-22T21:36:20.917691] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-10-22T21:36:21.531144] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-22T21:36:21.717685] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-10. [2025-10-22T21:36:22.227747] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-22T21:36:22.228621] [INFO ] [REMOTE ] TVE: Full fetch complete (4226 records). [2025-10-22T21:36:22.228713] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-22T21:36:22.540075] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-10. [2025-10-22T21:36:22.620417] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-22T21:36:22.620489] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-22T21:36:22.620633] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-22T21:36:22.620718] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-22T21:36:22.621066] [DEBUG] [LOCAL ] TVE: Trimmed 4226 records to 2547 (keeping 200 days of data) [2025-10-22T21:36:22.636537] [DEBUG] [LOCAL ] TVE: Primary data saved (2547 records). [2025-10-22T21:36:22.636599] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-22T21:36:22.636689] [INFO ] [MAIN ] Update Progress: 2149/2367 symbols completed. TVE took 23.3s. Estimated remaining: 28m 2s. Rate: 7.8 symbols/min [2025-10-22T21:36:22.805074] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:36:22.810674] [DEBUG] [LOCAL ] TWN: Loaded 3232 existing records from primary storage. [2025-10-22T21:36:22.810835] [INFO ] [MAIN ] TWN: Loaded 3232 existing records. [2025-10-22T21:36:22.991280] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:36:22.991566] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-22T21:36:22.991622] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-22T21:36:22.991806] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-22T21:36:22.991862] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-22T21:36:23.322772] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-10-22T21:36:23.361033] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:36:23.852303] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T21:36:23.858341] [INFO ] [REMOTE ] TV: Full fetch complete (60957 records). [2025-10-22T21:36:23.858447] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-22T21:36:24.128056] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-10-22T21:36:24.278068] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-22T21:36:24.278139] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-22T21:36:24.279280] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-22T21:36:24.279347] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-22T21:36:24.280725] [DEBUG] [LOCAL ] TV: Trimmed 60957 records to 41238 (keeping 200 days of data) [2025-10-22T21:36:24.525283] [DEBUG] [LOCAL ] TV: Primary data saved (41238 records). [2025-10-22T21:36:24.525445] [INFO ] [MAIN ] TV: Full history saved. [2025-10-22T21:36:24.525531] [INFO ] [MAIN ] Update Progress: 2150/2367 symbols completed. TV took 37.8s. Estimated remaining: 27m 53s. Rate: 7.8 symbols/min [2025-10-22T21:36:24.700909] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:36:24.744037] [DEBUG] [LOCAL ] TWO: Loaded 48595 existing records from primary storage. [2025-10-22T21:36:24.744453] [INFO ] [MAIN ] TWO: Loaded 48595 existing records. [2025-10-22T21:36:24.802000] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-22T21:36:24.913481] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-22T21:36:24.918747] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-10-22T21:36:24.963463] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:36:24.964043] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-22T21:36:24.964092] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-22T21:36:24.964514] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-22T21:36:24.964551] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-22T21:36:25.316589] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:36:25.717717] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-10-22T21:36:26.517686] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-10-22T21:36:26.895399] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-22T21:36:27.328523] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-10-22T21:36:27.334008] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T21:36:27.576081] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T21:36:27.721335] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-22T21:36:28.117663] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-10-22T21:36:28.917750] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-10-22T21:36:29.410803] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-22T21:36:29.566221] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-22T21:36:29.717738] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-10-22T21:36:30.200323] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-22T21:36:30.517692] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-10-22T21:36:31.122059] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-22T21:36:31.317746] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-10-22T21:36:32.117698] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-10-22T21:36:32.917694] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-10-22T21:36:33.050971] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-22T21:36:33.354420] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-22T21:36:33.365045] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-22T21:36:33.717688] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-10-22T21:36:34.517713] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-10. [2025-10-22T21:36:35.317636] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-10-22T21:36:35.633377] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T21:36:35.804582] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-22T21:36:35.810546] [INFO ] [REMOTE ] TWI: Full fetch complete (52132 records). [2025-10-22T21:36:35.810710] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-22T21:36:35.895321] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-22T21:36:36.122733] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-10-22T21:36:36.202385] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-22T21:36:36.202474] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-22T21:36:36.203483] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-22T21:36:36.203546] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-22T21:36:36.204558] [DEBUG] [LOCAL ] TWI: Trimmed 52132 records to 33814 (keeping 200 days of data) [2025-10-22T21:36:36.388722] [DEBUG] [LOCAL ] TWI: Primary data saved (33814 records). [2025-10-22T21:36:36.388834] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-22T21:36:36.388909] [INFO ] [MAIN ] Update Progress: 2151/2367 symbols completed. TWI took 30.1s. Estimated remaining: 27m 46s. Rate: 7.8 symbols/min [2025-10-22T21:36:36.552771] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:36:36.552959] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-22T21:36:36.552996] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-22T21:36:36.553104] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-22T21:36:36.553146] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-22T21:36:36.553187] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-22T21:36:36.553219] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-22T21:36:36.901198] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:36:36.917617] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-01. [2025-10-22T21:36:37.123614] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:36:37.123983] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-01 [2025-10-22T21:36:37.124090] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:36:37.124186] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-22T21:36:37.124270] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:36:37.124364] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-22T21:36:37.124448] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-22T21:36:37.124489] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-22T21:36:37.124549] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-22T21:36:37.124599] [INFO ] [MAIN ] Update Progress: 2152/2367 symbols completed. TWOD took 0.7s. Estimated remaining: 27m 38s. Rate: 7.8 symbols/min [2025-10-22T21:36:37.297249] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:36:37.318171] [DEBUG] [LOCAL ] TX: Loaded 23337 existing records from primary storage. [2025-10-22T21:36:37.318408] [INFO ] [MAIN ] TX: Loaded 23337 existing records. [2025-10-22T21:36:37.490858] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:36:37.491111] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-22T21:36:37.491167] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-22T21:36:37.491334] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-10-22T21:36:37.491396] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-22T21:36:37.726926] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-10-22T21:36:37.842167] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:36:38.103344] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-22T21:36:38.218552] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-22T21:36:38.517679] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-10-22T21:36:39.009250] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-22T21:36:39.317679] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-10-22T21:36:40.117729] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-10-22T21:36:40.419693] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T21:36:40.917685] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-10-22T21:36:41.717885] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-10-22T21:36:42.242102] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-22T21:36:42.517722] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-10. [2025-10-22T21:36:42.955797] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-22T21:36:43.064001] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T21:36:43.122367] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T21:36:43.124271] [INFO ] [REMOTE ] TWN: Full fetch complete (5213 records). [2025-10-22T21:36:43.124359] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-22T21:36:43.326879] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-10-22T21:36:43.491864] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-22T21:36:43.491941] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-22T21:36:43.492091] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-22T21:36:43.492157] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-22T21:36:43.492533] [DEBUG] [LOCAL ] TWN: Trimmed 5213 records to 3211 (keeping 200 days of data) [2025-10-22T21:36:43.510951] [DEBUG] [LOCAL ] TWN: Primary data saved (3211 records). [2025-10-22T21:36:43.511076] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-22T21:36:43.511154] [INFO ] [MAIN ] Update Progress: 2153/2367 symbols completed. TWN took 20.9s. Estimated remaining: 27m 30s. Rate: 7.8 symbols/min [2025-10-22T21:36:43.679478] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:36:43.718669] [DEBUG] [LOCAL ] TXNM: Loaded 42998 existing records from primary storage. [2025-10-22T21:36:43.719004] [INFO ] [MAIN ] TXNM: Loaded 42998 existing records. [2025-10-22T21:36:43.895139] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:36:43.895388] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-22T21:36:43.895453] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-22T21:36:43.895731] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-10-22T21:36:43.895798] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-22T21:36:44.129418] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-10-22T21:36:44.259274] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:36:44.621600] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-22T21:36:44.917671] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-10-22T21:36:45.717686] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-10-22T21:36:45.928484] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-22T21:36:45.980899] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T21:36:46.517674] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-10-22T21:36:47.227224] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T21:36:47.317625] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-10-22T21:36:47.616620] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T21:36:48.117729] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-10-22T21:36:48.917681] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-10-22T21:36:49.175163] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T21:36:49.194061] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T21:36:49.717722] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-10-22T21:36:50.489256] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-22T21:36:50.517624] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-10-22T21:36:51.317725] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-10-22T21:36:51.973016] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T21:36:52.127843] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-10-22T21:36:52.135951] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-22T21:36:52.431703] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T21:36:52.917728] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-10-22T21:36:53.717637] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-10-22T21:36:53.836338] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T21:36:54.517631] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-10-22T21:36:54.595899] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T21:36:55.317725] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-10-22T21:36:55.671554] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-22T21:36:56.117631] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-10. [2025-10-22T21:36:56.455584] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T21:36:56.484623] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-22T21:36:56.917681] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-10-22T21:36:57.717701] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-10-22T21:36:58.014213] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-22T21:36:58.023073] [INFO ] [REMOTE ] TWLO: Full fetch complete (76627 records). [2025-10-22T21:36:58.023227] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-22T21:36:58.447856] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-22T21:36:58.447954] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-22T21:36:58.449172] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-22T21:36:58.449247] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-22T21:36:58.450726] [DEBUG] [LOCAL ] TWLO: Trimmed 76627 records to 52813 (keeping 200 days of data) [2025-10-22T21:36:58.536320] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-10-22T21:36:58.691151] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T21:36:58.807937] [DEBUG] [LOCAL ] TWLO: Primary data saved (52813 records). [2025-10-22T21:36:58.808079] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-22T21:36:58.808763] [INFO ] [MAIN ] Update Progress: 2154/2367 symbols completed. TWLO took 48.2s. Estimated remaining: 27m 23s. Rate: 7.8 symbols/min [2025-10-22T21:36:58.992327] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-22T21:36:58.994667] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:36:59.019979] [DEBUG] [LOCAL ] TXO: Loaded 20033 existing records from primary storage. [2025-10-22T21:36:59.020222] [INFO ] [MAIN ] TXO: Loaded 20033 existing records. [2025-10-22T21:36:59.190939] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:36:59.191137] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-22T21:36:59.191184] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-22T21:36:59.191348] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-22T21:36:59.191385] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-22T21:36:59.328366] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-10. [2025-10-22T21:36:59.539993] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:37:00.117724] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-10-22T21:37:00.364477] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-22T21:37:00.519930] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T21:37:00.524521] [INFO ] [REMOTE ] TX: Full fetch complete (35519 records). [2025-10-22T21:37:00.524670] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-22T21:37:00.914822] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-22T21:37:00.914904] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-22T21:37:00.915693] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-22T21:37:00.915756] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-22T21:37:00.916494] [DEBUG] [LOCAL ] TX: Trimmed 35519 records to 23146 (keeping 200 days of data) [2025-10-22T21:37:00.917639] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-10-22T21:37:01.052934] [DEBUG] [LOCAL ] TX: Primary data saved (23146 records). [2025-10-22T21:37:01.053082] [INFO ] [MAIN ] TX: Full history saved. [2025-10-22T21:37:01.053168] [INFO ] [MAIN ] Update Progress: 2155/2367 symbols completed. TX took 23.9s. Estimated remaining: 27m 15s. Rate: 7.8 symbols/min [2025-10-22T21:37:01.200983] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T21:37:01.248063] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:37:01.290298] [DEBUG] [LOCAL ] TXT: Loaded 49516 existing records from primary storage. [2025-10-22T21:37:01.290622] [INFO ] [MAIN ] TXT: Loaded 49516 existing records. [2025-10-22T21:37:01.468617] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:37:01.468915] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-22T21:37:01.468969] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-22T21:37:01.469246] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-10-22T21:37:01.469307] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-22T21:37:01.722911] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-10-22T21:37:01.841394] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:37:02.517677] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-10-22T21:37:02.793181] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-22T21:37:03.317696] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-10-22T21:37:03.472189] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T21:37:03.525561] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T21:37:04.117634] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-10. [2025-10-22T21:37:04.917737] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-10-22T21:37:05.009830] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T21:37:05.717634] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-10-22T21:37:05.960924] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T21:37:05.968846] [INFO ] [REMOTE ] TWO: Full fetch complete (69285 records). [2025-10-22T21:37:05.968960] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-22T21:37:06.350680] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-22T21:37:06.350838] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-22T21:37:06.351944] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-22T21:37:06.352018] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-22T21:37:06.353523] [DEBUG] [LOCAL ] TWO: Trimmed 69285 records to 48553 (keeping 200 days of data) [2025-10-22T21:37:06.494033] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T21:37:06.563840] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-10-22T21:37:06.681771] [DEBUG] [LOCAL ] TWO: Primary data saved (48553 records). [2025-10-22T21:37:06.681897] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-22T21:37:06.681974] [INFO ] [MAIN ] Update Progress: 2156/2367 symbols completed. TWO took 42.2s. Estimated remaining: 27m 7s. Rate: 7.8 symbols/min [2025-10-22T21:37:06.848381] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:37:06.857258] [DEBUG] [LOCAL ] TY: Loaded 7550 existing records from primary storage. [2025-10-22T21:37:06.857427] [INFO ] [MAIN ] TY: Loaded 7550 existing records. [2025-10-22T21:37:07.032579] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:37:07.033037] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-22T21:37:07.033174] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-22T21:37:07.033489] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-10-22T21:37:07.033561] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-22T21:37:07.374968] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-22T21:37:07.325301] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-10-22T21:37:07.404131] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:37:07.432002] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T21:37:08.117707] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-10-22T21:37:08.881231] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-22T21:37:08.917681] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-10-22T21:37:09.063571] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T21:37:09.648804] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T21:37:09.717706] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-10-22T21:37:10.517715] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-10-22T21:37:11.256565] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T21:37:11.290634] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-22T21:37:11.317622] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-10-22T21:37:12.117702] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-10-22T21:37:12.860727] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T21:37:12.917637] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-10. [2025-10-22T21:37:13.670887] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T21:37:13.717615] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-10-22T21:37:14.333867] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-22T21:37:14.340558] [INFO ] [REMOTE ] TXNM: Full fetch complete (62839 records). [2025-10-22T21:37:14.340713] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-10-22T21:37:14.533533] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-10-22T21:37:14.757060] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-10-22T21:37:14.757138] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-10-22T21:37:14.758205] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-10-22T21:37:14.758267] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-10-22T21:37:14.759447] [DEBUG] [LOCAL ] TXNM: Trimmed 62839 records to 42857 (keeping 200 days of data) [2025-10-22T21:37:15.016934] [DEBUG] [LOCAL ] TXNM: Primary data saved (42857 records). [2025-10-22T21:37:15.017042] [INFO ] [MAIN ] TXNM: Full history saved. [2025-10-22T21:37:15.017119] [INFO ] [MAIN ] Update Progress: 2157/2367 symbols completed. TXNM took 31.5s. Estimated remaining: 26m 59s. Rate: 7.8 symbols/min [2025-10-22T21:37:15.317735] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-10-22T21:37:15.373448] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-22T21:37:15.518500] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T21:37:16.109472] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T21:37:16.117602] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-10-22T21:37:16.917640] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-10-22T21:37:17.217955] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-22T21:37:17.586416] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-22T21:37:17.717620] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-10-22T21:37:18.454216] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-22T21:37:18.517714] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-10-22T21:37:19.274032] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-22T21:37:19.317615] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-10-22T21:37:20.117726] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-10-22T21:37:20.917703] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-10-22T21:37:20.997243] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T21:37:21.253296] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-22T21:37:21.644794] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-22T21:37:21.717635] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-10-22T21:37:22.457435] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T21:37:22.517691] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-10-22T21:37:23.317753] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-10-22T21:37:24.117631] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-10. [2025-10-22T21:37:24.220971] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T21:37:24.256977] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-22T21:37:24.604749] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-22T21:37:24.606402] [INFO ] [REMOTE ] TY: Full fetch complete (11331 records). [2025-10-22T21:37:24.606475] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-22T21:37:24.923413] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-10-22T21:37:24.968701] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-22T21:37:24.968790] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-22T21:37:24.969080] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-22T21:37:24.969118] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-22T21:37:24.969546] [DEBUG] [LOCAL ] TY: Trimmed 11331 records to 7524 (keeping 200 days of data) [2025-10-22T21:37:25.018133] [DEBUG] [LOCAL ] TY: Primary data saved (7524 records). [2025-10-22T21:37:25.018262] [INFO ] [MAIN ] TY: Full history saved. [2025-10-22T21:37:25.018376] [INFO ] [MAIN ] Update Progress: 2158/2367 symbols completed. TY took 18.3s. Estimated remaining: 26m 52s. Rate: 7.8 symbols/min [2025-10-22T21:37:25.717685] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-10-22T21:37:26.109461] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-22T21:37:26.517675] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-10-22T21:37:27.603714] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T21:37:27.626374] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-10-22T21:37:27.628338] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-22T21:37:28.117691] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-10. [2025-10-22T21:37:29.144500] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T21:37:29.148783] [INFO ] [REMOTE ] TXO: Full fetch complete (27270 records). [2025-10-22T21:37:29.148934] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-22T21:37:29.539164] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-22T21:37:29.539278] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-22T21:37:29.540086] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-22T21:37:29.540165] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-22T21:37:29.570181] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-22T21:37:29.568312] [DEBUG] [LOCAL ] TXO: Trimmed 27270 records to 20043 (keeping 200 days of data) [2025-10-22T21:37:29.582165] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-10-22T21:37:29.713087] [DEBUG] [LOCAL ] TXO: Primary data saved (20043 records). [2025-10-22T21:37:29.713222] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-22T21:37:29.713300] [INFO ] [MAIN ] Update Progress: 2159/2367 symbols completed. TXO took 30.9s. Estimated remaining: 26m 44s. Rate: 7.8 symbols/min [2025-10-22T21:37:30.440978] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T21:37:30.451455] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-10. [2025-10-22T21:37:32.082037] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-22T21:37:32.090189] [INFO ] [REMOTE ] TXT: Full fetch complete (72417 records). [2025-10-22T21:37:32.090299] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-22T21:37:32.474719] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-22T21:37:32.474800] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-22T21:37:32.476000] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-22T21:37:32.476071] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-22T21:37:32.477350] [DEBUG] [LOCAL ] TXT: Trimmed 72417 records to 49510 (keeping 200 days of data) [2025-10-22T21:37:32.773455] [DEBUG] [LOCAL ] TXT: Primary data saved (49510 records). [2025-10-22T21:37:32.773582] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-22T21:37:32.773676] [INFO ] [MAIN ] Update Progress: 2160/2367 symbols completed. TXT took 31.7s. Estimated remaining: 26m 35s. Rate: 7.8 symbols/min [2025-10-22T21:37:33.380060] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:37:33.512202] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:37:33.509471] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:37:33.539420] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:37:33.573911] [DEBUG] [LOCAL ] TYG: Loaded 13977 existing records from primary storage. [2025-10-22T21:37:33.574532] [DEBUG] [LOCAL ] TYL: Loaded 22129 existing records from primary storage. [2025-10-22T21:37:33.574900] [INFO ] [MAIN ] TYG: Loaded 13977 existing records. [2025-10-22T21:37:33.586124] [INFO ] [MAIN ] TYL: Loaded 22129 existing records. [2025-10-22T21:37:33.877902] [DEBUG] [LOCAL ] UA: Loaded 50476 existing records from primary storage. [2025-10-22T21:37:33.878528] [INFO ] [MAIN ] UA: Loaded 50476 existing records. [2025-10-22T21:37:33.886027] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-22T21:37:34.017189] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-10-22T21:37:34.196415] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:37:34.288833] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-22T21:37:34.289010] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-22T21:37:34.317562] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:37:34.330709] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-22T21:37:34.331048] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-22T21:37:34.338225] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-22T21:37:34.338141] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-22T21:37:34.442622] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-22T21:37:34.486691] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-22T21:37:34.528072] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:37:34.620781] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-22T21:37:34.707714] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-22T21:37:34.702228] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:37:34.755843] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-22T21:37:34.781881] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-22T21:37:34.797601] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-22T21:37:34.797680] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-22T21:37:34.850101] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-22T21:37:34.927048] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-22T21:37:35.908873] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:37:35.988526] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-10-22T21:37:36.135863] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:37:36.183193] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-10-22T21:37:36.255232] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:37:36.250710] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:37:36.256509] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-10-22T21:37:36.256109] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-10-22T21:37:37.223140] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T21:37:37.228433] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-10-22T21:37:37.353941] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-22T21:37:37.358310] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-10-22T21:37:37.880537] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T21:37:37.890808] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-10-22T21:37:37.905352] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-22T21:37:37.909412] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-10-22T21:37:38.202434] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T21:37:38.213218] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-10-22T21:37:38.512216] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T21:37:38.519328] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-10-22T21:37:38.589814] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-22T21:37:38.594208] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-10-22T21:37:39.541004] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T21:37:39.559227] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-10-22T21:37:39.560089] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-22T21:37:39.679408] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T21:37:40.117707] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-10-22T21:37:40.433081] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-22T21:37:40.917733] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-10-22T21:37:41.034969] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-22T21:37:41.295406] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-22T21:37:41.717679] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-10-22T21:37:42.517719] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-10-22T21:37:42.625820] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-22T21:37:43.120327] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-22T21:37:43.317709] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-10-22T21:37:43.643701] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-22T21:37:44.117715] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-10-22T21:37:44.808056] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-22T21:37:44.917717] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-10-22T21:37:45.346014] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-22T21:37:45.724369] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-10-22T21:37:45.728151] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T21:37:46.517743] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-10-22T21:37:46.837968] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T21:37:47.317693] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-10-22T21:37:47.662551] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-22T21:37:48.117634] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-10-22T21:37:48.223668] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-22T21:37:48.917696] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-10-22T21:37:49.717732] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-10-22T21:37:49.844005] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T21:37:49.873138] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-22T21:37:50.517728] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-10. [2025-10-22T21:37:51.317726] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-10-22T21:37:51.330804] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T21:37:51.333269] [INFO ] [REMOTE ] TYG: Full fetch complete (22127 records). [2025-10-22T21:37:51.333349] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-22T21:37:51.697959] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-22T21:37:51.698104] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-22T21:37:51.698603] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-22T21:37:51.698689] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-22T21:37:51.699464] [DEBUG] [LOCAL ] TYG: Trimmed 22127 records to 13892 (keeping 200 days of data) [2025-10-22T21:37:51.794385] [DEBUG] [LOCAL ] TYG: Primary data saved (13892 records). [2025-10-22T21:37:51.794532] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-22T21:37:51.794613] [INFO ] [MAIN ] Update Progress: 2161/2367 symbols completed. TYG took 19.0s. Estimated remaining: 26m 29s. Rate: 7.8 symbols/min [2025-10-22T21:37:51.988227] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:37:52.040061] [DEBUG] [LOCAL ] UAA: Loaded 53498 existing records from primary storage. [2025-10-22T21:37:52.040403] [INFO ] [MAIN ] UAA: Loaded 53498 existing records. [2025-10-22T21:37:52.118753] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-10-22T21:37:52.221443] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:37:52.221968] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-22T21:37:52.222057] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-22T21:37:52.232843] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-22T21:37:52.250425] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-22T21:37:52.297532] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-22T21:37:52.554735] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-22T21:37:52.633855] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:37:52.917727] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-10-22T21:37:53.717636] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-10-22T21:37:53.945172] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T21:37:54.517707] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-10-22T21:37:55.192037] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-22T21:37:55.317634] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-10-22T21:37:55.531717] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T21:37:55.888527] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-22T21:37:56.117677] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-10-22T21:37:56.227984] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T21:37:56.917683] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-10. [2025-10-22T21:37:57.717735] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-10-22T21:37:58.017057] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T21:37:58.021153] [INFO ] [REMOTE ] TYL: Full fetch complete (31649 records). [2025-10-22T21:37:58.021234] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-22T21:37:58.398042] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-22T21:37:58.398123] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-22T21:37:58.398838] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-22T21:37:58.398900] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-22T21:37:58.399723] [DEBUG] [LOCAL ] TYL: Trimmed 31649 records to 21988 (keeping 200 days of data) [2025-10-22T21:37:58.518468] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-10-22T21:37:58.545625] [DEBUG] [LOCAL ] TYL: Primary data saved (21988 records). [2025-10-22T21:37:58.545764] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-22T21:37:58.545842] [INFO ] [MAIN ] Update Progress: 2162/2367 symbols completed. TYL took 25.8s. Estimated remaining: 26m 21s. Rate: 7.8 symbols/min [2025-10-22T21:37:58.720361] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:37:58.752822] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-22T21:37:58.766609] [DEBUG] [LOCAL ] UAN: Loaded 5407 existing records from primary storage. [2025-10-22T21:37:58.766906] [INFO ] [MAIN ] UAN: Loaded 5407 existing records. [2025-10-22T21:37:58.941879] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:37:58.942110] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-22T21:37:58.942208] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-22T21:37:58.942356] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-22T21:37:58.942394] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-22T21:37:59.295567] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:37:59.317613] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-10-22T21:37:59.507891] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-22T21:37:59.746179] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-22T21:38:00.117704] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-10-22T21:38:00.163897] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T21:38:00.917716] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-10-22T21:38:01.558020] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T21:38:01.717738] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-10-22T21:38:02.073299] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T21:38:02.517722] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-10-22T21:38:03.139069] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T21:38:03.317713] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-10-22T21:38:03.956907] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-22T21:38:04.117675] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-10-22T21:38:04.917635] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-10-22T21:38:05.175503] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T21:38:05.653344] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-22T21:38:05.717674] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-10-22T21:38:06.150319] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-22T21:38:06.517697] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-10-22T21:38:07.255986] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T21:38:07.317614] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-10-22T21:38:07.518386] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T21:38:07.998336] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-22T21:38:08.117707] [INFO ] [REMOTE ] U: Fetching primary data for 2025-10. [2025-10-22T21:38:08.917711] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-10-22T21:38:09.510037] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-22T21:38:09.717671] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-10-22T21:38:10.410776] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-22T21:38:10.419632] [INFO ] [REMOTE ] U: Full fetch complete (77975 records). [2025-10-22T21:38:10.419825] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-22T21:38:10.520302] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-10-22T21:38:10.837313] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-22T21:38:10.837402] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-22T21:38:10.838592] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-22T21:38:10.838681] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-22T21:38:10.840136] [DEBUG] [LOCAL ] U: Trimmed 77975 records to 53799 (keeping 200 days of data) [2025-10-22T21:38:11.173433] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-10-22T21:38:11.173628] [INFO ] [MAIN ] U: Full history saved. [2025-10-22T21:38:11.174566] [INFO ] [MAIN ] Update Progress: 2163/2367 symbols completed. U took 38.4s. Estimated remaining: 26m 14s. Rate: 7.8 symbols/min [2025-10-22T21:38:11.276705] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-22T21:38:11.331453] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-10-22T21:38:11.367246] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:38:11.422209] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-22T21:38:11.422746] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-10-22T21:38:11.634025] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:38:11.634417] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-22T21:38:11.634498] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-22T21:38:11.634885] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-22T21:38:11.634992] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-22T21:38:11.805862] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-22T21:38:12.067430] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:38:12.117680] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-10-22T21:38:12.917637] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-10-22T21:38:13.482950] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T21:38:13.565292] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-22T21:38:13.717635] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-10. [2025-10-22T21:38:14.257148] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-22T21:38:14.313827] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-22T21:38:14.315043] [INFO ] [REMOTE ] UAN: Full fetch complete (7890 records). [2025-10-22T21:38:14.315112] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-22T21:38:14.525410] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-10-22T21:38:14.674977] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-22T21:38:14.675050] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-22T21:38:14.675241] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-22T21:38:14.675278] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-22T21:38:14.675674] [DEBUG] [LOCAL ] UAN: Trimmed 7890 records to 5302 (keeping 200 days of data) [2025-10-22T21:38:14.706693] [DEBUG] [LOCAL ] UAN: Primary data saved (5302 records). [2025-10-22T21:38:14.706761] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-22T21:38:14.706827] [INFO ] [MAIN ] Update Progress: 2164/2367 symbols completed. UAN took 16.2s. Estimated remaining: 26m 6s. Rate: 7.8 symbols/min [2025-10-22T21:38:14.870435] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:38:14.918780] [DEBUG] [LOCAL ] UBS: Loaded 52290 existing records from primary storage. [2025-10-22T21:38:14.919142] [INFO ] [MAIN ] UBS: Loaded 52290 existing records. [2025-10-22T21:38:15.090446] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:38:15.090703] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-22T21:38:15.090760] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-22T21:38:15.091022] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-22T21:38:15.091073] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-22T21:38:15.325084] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-10-22T21:38:15.449783] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:38:15.955370] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T21:38:16.117633] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-10. [2025-10-22T21:38:16.917707] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-10-22T21:38:17.453235] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-22T21:38:17.529535] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-22T21:38:17.538144] [INFO ] [REMOTE ] UA: Full fetch complete (73225 records). [2025-10-22T21:38:17.538291] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-22T21:38:17.727309] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-10-22T21:38:17.924493] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-22T21:38:17.924569] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-22T21:38:17.925713] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-22T21:38:17.925777] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-22T21:38:17.927157] [DEBUG] [LOCAL ] UA: Trimmed 73225 records to 50473 (keeping 200 days of data) [2025-10-22T21:38:18.205143] [DEBUG] [LOCAL ] UA: Primary data saved (50473 records). [2025-10-22T21:38:18.205273] [INFO ] [MAIN ] UA: Full history saved. [2025-10-22T21:38:18.205349] [INFO ] [MAIN ] Update Progress: 2165/2367 symbols completed. UA took 45.4s. Estimated remaining: 25m 58s. Rate: 7.8 symbols/min [2025-10-22T21:38:18.375528] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:38:18.419520] [DEBUG] [LOCAL ] UCB: Loaded 37764 existing records from primary storage. [2025-10-22T21:38:18.419937] [INFO ] [MAIN ] UCB: Loaded 37764 existing records. [2025-10-22T21:38:18.521741] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-10-22T21:38:18.602917] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:38:18.603178] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-22T21:38:18.603225] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-22T21:38:18.603467] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-10-22T21:38:18.603523] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-22T21:38:18.967194] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:38:18.999707] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-22T21:38:19.318341] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-10-22T21:38:19.324602] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T21:38:20.117740] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-10-22T21:38:20.834331] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T21:38:20.917670] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-10-22T21:38:20.964798] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-22T21:38:21.717679] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-10-22T21:38:21.825879] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T21:38:22.517693] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-10-22T21:38:23.015120] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-22T21:38:23.317729] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-10-22T21:38:23.919144] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T21:38:24.130199] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-10-22T21:38:24.156163] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-22T21:38:24.909872] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T21:38:24.920674] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-10-22T21:38:25.717709] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-10-22T21:38:25.776560] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T21:38:26.517716] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-10. [2025-10-22T21:38:27.269619] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T21:38:27.317677] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-10-22T21:38:27.485242] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-22T21:38:28.117678] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-10-22T21:38:28.495094] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-22T21:38:28.504024] [INFO ] [REMOTE ] UAA: Full fetch complete (77643 records). [2025-10-22T21:38:28.504161] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-22T21:38:28.904176] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-22T21:38:28.904372] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-22T21:38:28.905593] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-22T21:38:28.905761] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-22T21:38:28.907281] [DEBUG] [LOCAL ] UAA: Trimmed 77643 records to 53498 (keeping 200 days of data) [2025-10-22T21:38:28.966572] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-10-22T21:38:29.024996] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T21:38:29.246763] [DEBUG] [LOCAL ] UAA: Primary data saved (53498 records). [2025-10-22T21:38:29.246894] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-22T21:38:29.246972] [INFO ] [MAIN ] Update Progress: 2166/2367 symbols completed. UAA took 37.5s. Estimated remaining: 25m 50s. Rate: 7.8 symbols/min [2025-10-22T21:38:29.425004] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:38:29.472135] [DEBUG] [LOCAL ] UDR: Loaded 52107 existing records from primary storage. [2025-10-22T21:38:29.472439] [INFO ] [MAIN ] UDR: Loaded 52107 existing records. [2025-10-22T21:38:29.654840] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:38:29.655079] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-22T21:38:29.655127] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-22T21:38:29.655335] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-22T21:38:29.655392] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-22T21:38:29.722802] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-10-22T21:38:30.063708] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:38:30.339929] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-22T21:38:30.517629] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-10-22T21:38:30.973947] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-22T21:38:31.015700] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T21:38:31.317676] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-10-22T21:38:32.117751] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-10-22T21:38:32.917717] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-10-22T21:38:33.037071] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-22T21:38:33.106806] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T21:38:33.556065] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T21:38:33.717736] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-10-22T21:38:34.517732] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-10-22T21:38:34.594538] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T21:38:35.317759] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-10-22T21:38:36.117699] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-10-22T21:38:36.217415] [DEBUG] [REMOTE ] UCB: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-22T21:38:36.217848] [WARN ] [REMOTE ] UCB: No data returned for month 2025-07 [2025-10-22T21:38:36.217958] [FATAL] [REMOTE ] UCB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:38:36.218071] [FATAL] [MAIN ] UCB: Failed to fetch primary data. [2025-10-22T21:38:36.218152] [WARN ] [MAIN ] UCB: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:38:36.218237] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-22T21:38:36.218321] [DEBUG] [LOCAL ] UCB: No primary data file found to delete. [2025-10-22T21:38:36.218378] [INFO ] [LOCAL ] UCB: Starting deletion of derivative data. [2025-10-22T21:38:36.219289] [DEBUG] [LOCAL ] UCB: Deleted derivative data file. [2025-10-22T21:38:36.219396] [INFO ] [MAIN ] Update Progress: 2167/2367 symbols completed. UCB took 18.0s. Estimated remaining: 25m 42s. Rate: 7.8 symbols/min [2025-10-22T21:38:36.397696] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:38:36.432865] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-10-22T21:38:36.477936] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-22T21:38:36.520778] [DEBUG] [LOCAL ] UE: Loaded 42559 existing records from primary storage. [2025-10-22T21:38:36.521279] [INFO ] [MAIN ] UE: Loaded 42559 existing records. [2025-10-22T21:38:36.748124] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:38:36.748563] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-22T21:38:36.748719] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-22T21:38:36.749009] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-22T21:38:36.749069] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-22T21:38:36.933735] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-10-22T21:38:37.200149] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-22T21:38:37.204574] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:38:37.717744] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-10-22T21:38:38.517686] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-10-22T21:38:39.317637] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-10-22T21:38:39.353118] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-22T21:38:39.475306] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T21:38:39.963834] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T21:38:40.117697] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-10-22T21:38:40.917682] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-10-22T21:38:41.212033] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T21:38:41.717638] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-10. [2025-10-22T21:38:41.879735] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T21:38:42.465755] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T21:38:42.476768] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T21:38:42.476997] [INFO ] [REMOTE ] UBER: Full fetch complete (77986 records). [2025-10-22T21:38:42.484980] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-22T21:38:42.523930] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-10-22T21:38:42.866980] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-22T21:38:42.867061] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-22T21:38:42.868233] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-22T21:38:42.868302] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-22T21:38:42.869747] [DEBUG] [LOCAL ] UBER: Trimmed 77986 records to 53806 (keeping 200 days of data) [2025-10-22T21:38:43.187772] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-10-22T21:38:43.187918] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-22T21:38:43.188613] [INFO ] [MAIN ] Update Progress: 2168/2367 symbols completed. UBER took 32.0s. Estimated remaining: 25m 35s. Rate: 7.8 symbols/min [2025-10-22T21:38:43.325524] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-10-22T21:38:43.356071] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:38:43.366548] [DEBUG] [LOCAL ] UFI: Loaded 8223 existing records from primary storage. [2025-10-22T21:38:43.366817] [INFO ] [MAIN ] UFI: Loaded 8223 existing records. [2025-10-22T21:38:43.539088] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:38:43.539289] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-22T21:38:43.539336] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-22T21:38:43.539503] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-10-22T21:38:43.539540] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-22T21:38:43.887940] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:38:44.117629] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-10-22T21:38:44.380342] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T21:38:44.825785] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T21:38:44.852324] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-22T21:38:44.917619] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-10-22T21:38:45.722449] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-10-22T21:38:45.723398] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T21:38:46.517705] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-10-22T21:38:47.317631] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-10-22T21:38:47.402938] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T21:38:47.906245] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-22T21:38:48.117629] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-10. [2025-10-22T21:38:48.917718] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-10-22T21:38:49.030019] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T21:38:49.717730] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-10-22T21:38:49.933557] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T21:38:49.942548] [INFO ] [REMOTE ] UBS: Full fetch complete (75971 records). [2025-10-22T21:38:49.942787] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-22T21:38:50.347780] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-22T21:38:50.408713] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T21:38:50.471593] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-22T21:38:50.472201] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-22T21:38:50.474545] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-22T21:38:50.474637] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-22T21:38:50.476639] [DEBUG] [LOCAL ] UBS: Trimmed 75971 records to 52286 (keeping 200 days of data) [2025-10-22T21:38:50.552010] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-10-22T21:38:50.934103] [DEBUG] [LOCAL ] UBS: Primary data saved (52286 records). [2025-10-22T21:38:50.934296] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-22T21:38:50.934416] [INFO ] [MAIN ] Update Progress: 2169/2367 symbols completed. UBS took 36.2s. Estimated remaining: 25m 27s. Rate: 7.8 symbols/min [2025-10-22T21:38:51.185757] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:38:51.235023] [DEBUG] [LOCAL ] UGI: Loaded 50513 existing records from primary storage. [2025-10-22T21:38:51.235380] [INFO ] [MAIN ] UGI: Loaded 50513 existing records. [2025-10-22T21:38:51.322952] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-10-22T21:38:51.431798] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:38:51.432210] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-22T21:38:51.432263] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-22T21:38:51.432859] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-22T21:38:51.432919] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-22T21:38:51.588729] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-22T21:38:51.842215] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:38:52.117736] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-10-22T21:38:52.885067] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-22T21:38:52.887259] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T21:38:52.917631] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-10-22T21:38:53.612348] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-22T21:38:53.717685] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-10-22T21:38:54.517675] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-10-22T21:38:55.317670] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-10-22T21:38:55.484599] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T21:38:56.126184] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-10-22T21:38:56.144789] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-22T21:38:56.828527] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-22T21:38:56.917680] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-10-22T21:38:57.166018] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T21:38:57.670949] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-22T21:38:57.717629] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-10-22T21:38:58.500313] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T21:38:58.517617] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-10. [2025-10-22T21:38:59.317636] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-10-22T21:38:59.349936] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-22T21:38:59.352087] [INFO ] [REMOTE ] UFI: Full fetch complete (12442 records). [2025-10-22T21:38:59.352156] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-22T21:38:59.727859] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-22T21:38:59.727976] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-22T21:38:59.728982] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-22T21:38:59.729055] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-22T21:38:59.729948] [DEBUG] [LOCAL ] UFI: Trimmed 12442 records to 8232 (keeping 200 days of data) [2025-10-22T21:38:59.780347] [DEBUG] [LOCAL ] UFI: Primary data saved (8232 records). [2025-10-22T21:38:59.780537] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-22T21:38:59.780663] [INFO ] [MAIN ] Update Progress: 2170/2367 symbols completed. UFI took 16.6s. Estimated remaining: 25m 19s. Rate: 7.8 symbols/min [2025-10-22T21:38:59.970408] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:39:00.021666] [DEBUG] [LOCAL ] UGP: Loaded 42954 existing records from primary storage. [2025-10-22T21:39:00.022077] [INFO ] [MAIN ] UGP: Loaded 42954 existing records. [2025-10-22T21:39:00.123960] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-10-22T21:39:00.204084] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:39:00.204251] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-22T21:39:00.204299] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-22T21:39:00.204476] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-22T21:39:00.204513] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-22T21:39:00.552581] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:39:00.917723] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-10-22T21:39:00.993853] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T21:39:01.574999] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T21:39:01.717698] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-10-22T21:39:02.517720] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-10-22T21:39:02.578494] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-22T21:39:03.317668] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-10-22T21:39:03.434960] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T21:39:04.117689] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-10-22T21:39:04.286076] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T21:39:04.925746] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-10-22T21:39:04.957039] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T21:39:05.659149] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T21:39:05.717697] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-10. [2025-10-22T21:39:06.517711] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-10-22T21:39:06.768008] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T21:39:07.119920] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T21:39:07.126426] [INFO ] [REMOTE ] UE: Full fetch complete (61131 records). [2025-10-22T21:39:07.126538] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-22T21:39:07.324614] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-10-22T21:39:07.519816] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-22T21:39:07.519920] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-22T21:39:07.521149] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-22T21:39:07.521214] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-22T21:39:07.522391] [DEBUG] [LOCAL ] UE: Trimmed 61131 records to 42468 (keeping 200 days of data) [2025-10-22T21:39:07.766618] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T21:39:07.823140] [DEBUG] [LOCAL ] UE: Primary data saved (42468 records). [2025-10-22T21:39:07.823285] [INFO ] [MAIN ] UE: Full history saved. [2025-10-22T21:39:07.823365] [INFO ] [MAIN ] Update Progress: 2171/2367 symbols completed. UE took 31.6s. Estimated remaining: 25m 12s. Rate: 7.8 symbols/min [2025-10-22T21:39:07.996395] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:39:08.013381] [DEBUG] [LOCAL ] UHAL: Loaded 16906 existing records from primary storage. [2025-10-22T21:39:08.013660] [INFO ] [MAIN ] UHAL: Loaded 16906 existing records. [2025-10-22T21:39:08.118793] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-10-22T21:39:08.194958] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:39:08.195300] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-22T21:39:08.195364] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-22T21:39:08.195703] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-22T21:39:08.195778] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-22T21:39:08.408252] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T21:39:08.599810] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:39:08.917710] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-10-22T21:39:09.717693] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-10-22T21:39:09.837483] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-22T21:39:09.880741] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-22T21:39:10.517718] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-10-22T21:39:11.317726] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-10. [2025-10-22T21:39:11.389697] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T21:39:11.408496] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-22T21:39:12.117738] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-10-22T21:39:12.643128] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-22T21:39:12.651982] [INFO ] [REMOTE ] UDR: Full fetch complete (75120 records). [2025-10-22T21:39:12.652127] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-22T21:39:12.925586] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-10-22T21:39:13.071232] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-22T21:39:13.071327] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-22T21:39:13.072589] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-22T21:39:13.072674] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-22T21:39:13.074185] [DEBUG] [LOCAL ] UDR: Trimmed 75120 records to 52105 (keeping 200 days of data) [2025-10-22T21:39:13.392134] [DEBUG] [LOCAL ] UDR: Primary data saved (52105 records). [2025-10-22T21:39:13.392444] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-22T21:39:13.392634] [INFO ] [MAIN ] Update Progress: 2172/2367 symbols completed. UDR took 44.1s. Estimated remaining: 25m 4s. Rate: 7.8 symbols/min [2025-10-22T21:39:13.594708] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:39:13.600317] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T21:39:13.645556] [DEBUG] [LOCAL ] UHS: Loaded 39747 existing records from primary storage. [2025-10-22T21:39:13.645870] [INFO ] [MAIN ] UHS: Loaded 39747 existing records. [2025-10-22T21:39:13.722793] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-10-22T21:39:13.821715] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:39:13.821962] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-22T21:39:13.822010] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-22T21:39:13.822185] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-22T21:39:13.822222] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-22T21:39:14.213387] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:39:14.517685] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-10-22T21:39:14.581625] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T21:39:14.819412] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T21:39:15.317686] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-10-22T21:39:15.983093] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T21:39:16.117671] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-10-22T21:39:16.918729] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-10-22T21:39:16.924311] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T21:39:17.139152] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-22T21:39:17.717667] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-10-22T21:39:18.517674] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-10-22T21:39:18.568974] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T21:39:19.236544] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T21:39:19.317673] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-10-22T21:39:19.644192] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-22T21:39:20.117673] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-10-22T21:39:20.860197] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T21:39:20.917621] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-10-22T21:39:21.717682] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-10-22T21:39:21.747759] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T21:39:22.250842] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T21:39:22.517635] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-10-22T21:39:22.747955] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T21:39:23.317690] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-10-22T21:39:24.117676] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-10-22T21:39:24.351491] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-22T21:39:24.387876] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T21:39:24.917694] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-10-22T21:39:25.717723] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-10-22T21:39:25.777037] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T21:39:25.973694] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-22T21:39:26.517734] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-10. [2025-10-22T21:39:27.257467] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-22T21:39:27.317737] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-10-22T21:39:28.117635] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-10-22T21:39:28.204413] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T21:39:28.212720] [INFO ] [REMOTE ] UGI: Full fetch complete (73491 records). [2025-10-22T21:39:28.212848] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-22T21:39:28.617295] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-22T21:39:28.617387] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-22T21:39:28.618912] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-22T21:39:28.618979] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-22T21:39:28.620472] [DEBUG] [LOCAL ] UGI: Trimmed 73491 records to 50495 (keeping 200 days of data) [2025-10-22T21:39:28.926502] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-10-22T21:39:28.934162] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T21:39:28.980303] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T21:39:28.995559] [DEBUG] [LOCAL ] UGI: Primary data saved (50495 records). [2025-10-22T21:39:28.995692] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-22T21:39:28.995782] [INFO ] [MAIN ] Update Progress: 2173/2367 symbols completed. UGI took 38.1s. Estimated remaining: 24m 57s. Rate: 7.8 symbols/min [2025-10-22T21:39:29.159625] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:39:29.171806] [DEBUG] [LOCAL ] UHT: Loaded 10251 existing records from primary storage. [2025-10-22T21:39:29.172053] [INFO ] [MAIN ] UHT: Loaded 10251 existing records. [2025-10-22T21:39:29.346320] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:39:29.346577] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-22T21:39:29.346627] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-22T21:39:29.346870] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-10-22T21:39:29.346926] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-22T21:39:29.706279] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:39:29.717624] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-10-22T21:39:30.511048] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T21:39:30.519621] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-10-22T21:39:30.640293] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T21:39:31.317775] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-10-22T21:39:31.383452] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T21:39:32.117660] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-10. [2025-10-22T21:39:32.917671] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-10-22T21:39:33.029095] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T21:39:33.080049] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-22T21:39:33.083204] [INFO ] [REMOTE ] UHAL: Full fetch complete (23405 records). [2025-10-22T21:39:33.083273] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-22T21:39:33.439538] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-22T21:39:33.439610] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-22T21:39:33.440122] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-22T21:39:33.440182] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-22T21:39:33.440777] [DEBUG] [LOCAL ] UHAL: Trimmed 23405 records to 16849 (keeping 200 days of data) [2025-10-22T21:39:33.535114] [DEBUG] [LOCAL ] UHAL: Primary data saved (16849 records). [2025-10-22T21:39:33.535243] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-22T21:39:33.535318] [INFO ] [MAIN ] Update Progress: 2174/2367 symbols completed. UHAL took 25.7s. Estimated remaining: 24m 49s. Rate: 7.8 symbols/min [2025-10-22T21:39:33.698094] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:39:33.712693] [DEBUG] [LOCAL ] UI: Loaded 14137 existing records from primary storage. [2025-10-22T21:39:33.712898] [INFO ] [MAIN ] UI: Loaded 14137 existing records. [2025-10-22T21:39:33.723909] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-10-22T21:39:33.887171] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:39:33.887353] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-22T21:39:33.887398] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-22T21:39:33.887669] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-22T21:39:33.887730] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-22T21:39:34.234513] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:39:34.515493] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T21:39:34.524058] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-10-22T21:39:35.282014] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T21:39:35.315348] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T21:39:35.323135] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-10-22T21:39:36.117726] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-10-22T21:39:36.261417] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-22T21:39:36.917727] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-10-22T21:39:36.934968] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T21:39:37.717747] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-10-22T21:39:37.907900] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-22T21:39:38.424364] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-22T21:39:38.517628] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-10. [2025-10-22T21:39:39.317683] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-10-22T21:39:40.117631] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-10-22T21:39:40.195012] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T21:39:40.203312] [INFO ] [REMOTE ] UHS: Full fetch complete (58185 records). [2025-10-22T21:39:40.203496] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-22T21:39:40.319874] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-22T21:39:40.604010] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-22T21:39:40.604124] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-22T21:39:40.605211] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-22T21:39:40.605272] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-22T21:39:40.606484] [DEBUG] [LOCAL ] UHS: Trimmed 58185 records to 39620 (keeping 200 days of data) [2025-10-22T21:39:40.847426] [DEBUG] [LOCAL ] UHS: Primary data saved (39620 records). [2025-10-22T21:39:40.847603] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-22T21:39:40.847808] [INFO ] [MAIN ] Update Progress: 2175/2367 symbols completed. UHS took 27.5s. Estimated remaining: 24m 41s. Rate: 7.8 symbols/min [2025-10-22T21:39:40.924716] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-10-22T21:39:41.025810] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:39:41.035006] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-22T21:39:41.067338] [DEBUG] [LOCAL ] UIS: Loaded 36713 existing records from primary storage. [2025-10-22T21:39:41.067670] [INFO ] [MAIN ] UIS: Loaded 36713 existing records. [2025-10-22T21:39:41.242804] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:39:41.243023] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-22T21:39:41.243072] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-22T21:39:41.243298] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-22T21:39:41.243355] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-22T21:39:41.606516] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:39:41.717692] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-10. [2025-10-22T21:39:41.733060] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-22T21:39:42.517720] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-10-22T21:39:43.279973] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T21:39:43.291373] [INFO ] [REMOTE ] UGP: Full fetch complete (62257 records). [2025-10-22T21:39:43.291592] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-22T21:39:43.324781] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-10-22T21:39:43.434396] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-22T21:39:43.781507] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-22T21:39:43.781599] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-22T21:39:43.782688] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-22T21:39:43.782752] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-22T21:39:43.784334] [DEBUG] [LOCAL ] UGP: Trimmed 62257 records to 42993 (keeping 200 days of data) [2025-10-22T21:39:44.025027] [DEBUG] [LOCAL ] UGP: Primary data saved (42993 records). [2025-10-22T21:39:44.025167] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-22T21:39:44.025704] [INFO ] [MAIN ] Update Progress: 2176/2367 symbols completed. UGP took 44.2s. Estimated remaining: 24m 33s. Rate: 7.8 symbols/min [2025-10-22T21:39:44.122918] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-10-22T21:39:44.198606] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:39:44.249467] [DEBUG] [LOCAL ] UL: Loaded 53072 existing records from primary storage. [2025-10-22T21:39:44.249839] [INFO ] [MAIN ] UL: Loaded 53072 existing records. [2025-10-22T21:39:44.425088] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:39:44.425442] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-22T21:39:44.425497] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-22T21:39:44.425746] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-10-22T21:39:44.425802] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-22T21:39:44.781294] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:39:44.803471] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T21:39:44.917740] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-10-22T21:39:45.110544] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T21:39:45.717927] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-10-22T21:39:45.729531] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T21:39:46.517690] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-10-22T21:39:46.601214] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-22T21:39:47.317737] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-10-22T21:39:47.945133] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-22T21:39:48.117742] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-10-22T21:39:48.917632] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-10-22T21:39:49.097625] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T21:39:49.297021] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-22T21:39:49.428833] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-22T21:39:49.717630] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-10-22T21:39:50.517732] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-10-22T21:39:51.317875] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-10-22T21:39:51.347676] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-22T21:39:51.492021] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-22T21:39:52.117733] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-10-22T21:39:52.419890] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-22T21:39:52.917697] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-10-22T21:39:52.937113] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T21:39:53.717715] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-10-22T21:39:53.826269] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T21:39:54.517623] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-10-22T21:39:55.206609] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T21:39:55.317702] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-10. [2025-10-22T21:39:55.590608] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-22T21:39:56.117679] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-10-22T21:39:56.160943] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-22T21:39:56.163577] [INFO ] [REMOTE ] UHT: Full fetch complete (15096 records). [2025-10-22T21:39:56.163693] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-22T21:39:56.529086] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-22T21:39:56.529179] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-22T21:39:56.529539] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-22T21:39:56.529592] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-22T21:39:56.530071] [DEBUG] [LOCAL ] UHT: Trimmed 15096 records to 10210 (keeping 200 days of data) [2025-10-22T21:39:56.591277] [DEBUG] [LOCAL ] UHT: Primary data saved (10210 records). [2025-10-22T21:39:56.591399] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-22T21:39:56.591475] [INFO ] [MAIN ] Update Progress: 2177/2367 symbols completed. UHT took 27.6s. Estimated remaining: 24m 26s. Rate: 7.8 symbols/min [2025-10-22T21:39:56.759571] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:39:56.794999] [DEBUG] [LOCAL ] ULS: Loaded 38649 existing records from primary storage. [2025-10-22T21:39:56.795271] [INFO ] [MAIN ] ULS: Loaded 38649 existing records. [2025-10-22T21:39:56.922793] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-10-22T21:39:56.973587] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:39:56.973807] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-22T21:39:56.973854] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-22T21:39:56.974024] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-22T21:39:56.974061] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-22T21:39:57.325871] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:39:57.717634] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-10-22T21:39:57.981523] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-22T21:39:58.517721] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-10-22T21:39:58.558438] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T21:39:58.629396] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-22T21:39:59.317784] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-10. [2025-10-22T21:39:59.366825] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-22T21:40:00.117819] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-10-22T21:40:00.522621] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-22T21:40:00.526395] [INFO ] [REMOTE ] UI: Full fetch complete (19783 records). [2025-10-22T21:40:00.526481] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-22T21:40:00.888629] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-22T21:40:00.888783] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-22T21:40:00.889258] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-22T21:40:00.889302] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-22T21:40:00.889965] [DEBUG] [LOCAL ] UI: Trimmed 19783 records to 14196 (keeping 200 days of data) [2025-10-22T21:40:00.928070] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-10-22T21:40:00.980348] [DEBUG] [LOCAL ] UI: Primary data saved (14196 records). [2025-10-22T21:40:00.980475] [INFO ] [MAIN ] UI: Full history saved. [2025-10-22T21:40:00.980554] [INFO ] [MAIN ] Update Progress: 2178/2367 symbols completed. UI took 27.4s. Estimated remaining: 24m 18s. Rate: 7.8 symbols/min [2025-10-22T21:40:01.158081] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:40:01.206718] [DEBUG] [LOCAL ] UMC: Loaded 52685 existing records from primary storage. [2025-10-22T21:40:01.207074] [INFO ] [MAIN ] UMC: Loaded 52685 existing records. [2025-10-22T21:40:01.384247] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:40:01.384525] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-22T21:40:01.384708] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-22T21:40:01.385001] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-22T21:40:01.385058] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-22T21:40:01.722439] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-10-22T21:40:01.760257] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T21:40:01.791301] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:40:02.517730] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-10-22T21:40:02.559035] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T21:40:03.317732] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-10-22T21:40:03.801841] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-22T21:40:04.117703] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-10-22T21:40:04.514846] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-22T21:40:04.911145] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T21:40:04.919789] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-10-22T21:40:05.197846] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-22T21:40:05.717735] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-10-22T21:40:06.405290] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T21:40:06.517721] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-10-22T21:40:07.317755] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-10-22T21:40:07.676960] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-22T21:40:08.117680] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-10-22T21:40:08.219823] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T21:40:08.679317] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-22T21:40:08.917688] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-10. [2025-10-22T21:40:09.717680] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-10-22T21:40:09.987251] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T21:40:10.366377] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T21:40:10.372273] [INFO ] [REMOTE ] UIS: Full fetch complete (52035 records). [2025-10-22T21:40:10.372389] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-22T21:40:10.524049] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-10-22T21:40:10.829224] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-22T21:40:10.829315] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-22T21:40:10.830337] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-22T21:40:10.830404] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-22T21:40:10.831536] [DEBUG] [LOCAL ] UIS: Trimmed 52035 records to 36623 (keeping 200 days of data) [2025-10-22T21:40:11.035705] [DEBUG] [LOCAL ] UIS: Primary data saved (36623 records). [2025-10-22T21:40:11.035849] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-22T21:40:11.035932] [INFO ] [MAIN ] Update Progress: 2179/2367 symbols completed. UIS took 30.2s. Estimated remaining: 24m 10s. Rate: 7.8 symbols/min [2025-10-22T21:40:11.201301] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:40:11.234348] [DEBUG] [LOCAL ] UMH: Loaded 34236 existing records from primary storage. [2025-10-22T21:40:11.234626] [INFO ] [MAIN ] UMH: Loaded 34236 existing records. [2025-10-22T21:40:11.326100] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-10-22T21:40:11.423737] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:40:11.424098] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-22T21:40:11.424359] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-22T21:40:11.424670] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-22T21:40:11.424774] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-22T21:40:11.744867] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-22T21:40:11.833745] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:40:12.117684] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-10-22T21:40:12.276399] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T21:40:12.917711] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-10-22T21:40:12.969117] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T21:40:13.370859] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T21:40:13.717704] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-10-22T21:40:14.517703] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-10-22T21:40:14.881403] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T21:40:15.317639] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-10-22T21:40:15.520622] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T21:40:15.832136] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T21:40:16.117679] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-10-22T21:40:16.917662] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-10-22T21:40:17.273245] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-22T21:40:17.492289] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T21:40:17.717673] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-10-22T21:40:18.241123] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-22T21:40:18.517742] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-10-22T21:40:19.150206] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-22T21:40:19.317685] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-10-22T21:40:19.958297] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T21:40:20.117695] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-10-22T21:40:20.880133] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T21:40:20.917613] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-10-22T21:40:21.717628] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-10-22T21:40:21.820686] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T21:40:22.378777] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-22T21:40:22.517625] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-10-22T21:40:23.317630] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-10-22T21:40:23.544966] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T21:40:23.955578] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-22T21:40:24.117727] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-10. [2025-10-22T21:40:24.917696] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-10. [2025-10-22T21:40:25.133315] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T21:40:25.717682] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-10-22T21:40:26.051199] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T21:40:26.060214] [INFO ] [REMOTE ] UL: Full fetch complete (77081 records). [2025-10-22T21:40:26.060404] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-22T21:40:26.489315] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-22T21:40:26.485122] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T21:40:26.489522] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-22T21:40:26.496246] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-22T21:40:26.496540] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-22T21:40:26.497771] [INFO ] [REMOTE ] ULS: Full fetch complete (53893 records). [2025-10-22T21:40:26.498094] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-22T21:40:26.498992] [DEBUG] [LOCAL ] UL: Trimmed 77081 records to 53069 (keeping 200 days of data) [2025-10-22T21:40:26.522902] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-10-22T21:40:27.156158] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-22T21:40:27.156559] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-22T21:40:27.158385] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-22T21:40:27.158804] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-22T21:40:27.190390] [DEBUG] [LOCAL ] ULS: Trimmed 53893 records to 38524 (keeping 200 days of data) [2025-10-22T21:40:27.193079] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T21:40:27.341763] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-10-22T21:40:27.530711] [DEBUG] [LOCAL ] UL: Primary data saved (53069 records). [2025-10-22T21:40:27.539522] [INFO ] [MAIN ] UL: Full history saved. [2025-10-22T21:40:27.540496] [INFO ] [MAIN ] Update Progress: 2180/2367 symbols completed. UL took 43.5s. Estimated remaining: 24m 3s. Rate: 7.8 symbols/min [2025-10-22T21:40:27.539666] [DEBUG] [LOCAL ] ULS: Primary data saved (38524 records). [2025-10-22T21:40:27.540732] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-22T21:40:27.546166] [INFO ] [MAIN ] Update Progress: 2181/2367 symbols completed. ULS took 30.9s. Estimated remaining: 23m 55s. Rate: 7.8 symbols/min [2025-10-22T21:40:27.879608] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:40:27.898241] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:40:27.911462] [DEBUG] [LOCAL ] UNF: Loaded 11736 existing records from primary storage. [2025-10-22T21:40:27.911718] [INFO ] [MAIN ] UNF: Loaded 11736 existing records. [2025-10-22T21:40:28.118117] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:40:28.119967] [DEBUG] [LOCAL ] UNFI: Loaded 42625 existing records from primary storage. [2025-10-22T21:40:28.120176] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-22T21:40:28.120487] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-22T21:40:28.120606] [INFO ] [MAIN ] UNFI: Loaded 42625 existing records. [2025-10-22T21:40:28.152316] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-10-22T21:40:28.193316] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-22T21:40:28.418246] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:40:28.419088] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-22T21:40:28.424535] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-22T21:40:28.511347] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-22T21:40:28.525721] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-22T21:40:28.936591] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:40:28.959980] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-10-22T21:40:28.961188] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T21:40:28.998118] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-22T21:40:29.046683] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-10-22T21:40:29.169028] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:40:29.717685] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-10-22T21:40:30.050451] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-22T21:40:30.270374] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-22T21:40:30.517773] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-10-22T21:40:31.100982] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T21:40:31.317697] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-10-22T21:40:31.945192] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T21:40:32.079147] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-22T21:40:32.117730] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-10. [2025-10-22T21:40:32.917713] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-10-22T21:40:33.574440] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-22T21:40:33.584061] [INFO ] [REMOTE ] UMH: Full fetch complete (47400 records). [2025-10-22T21:40:33.584246] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-22T21:40:33.722945] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-10-22T21:40:34.011735] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-22T21:40:34.011836] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-22T21:40:34.012906] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-22T21:40:34.012972] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-22T21:40:34.014142] [DEBUG] [LOCAL ] UMH: Trimmed 47400 records to 34213 (keeping 200 days of data) [2025-10-22T21:40:34.229140] [DEBUG] [LOCAL ] UMH: Primary data saved (34213 records). [2025-10-22T21:40:34.229551] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-22T21:40:34.229696] [INFO ] [MAIN ] Update Progress: 2182/2367 symbols completed. UMH took 23.2s. Estimated remaining: 23m 47s. Rate: 7.8 symbols/min [2025-10-22T21:40:34.422809] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T21:40:34.426275] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:40:34.486295] [DEBUG] [LOCAL ] UNH: Loaded 53819 existing records from primary storage. [2025-10-22T21:40:34.486696] [INFO ] [MAIN ] UNH: Loaded 53819 existing records. [2025-10-22T21:40:34.522819] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-10-22T21:40:34.673310] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:40:34.673521] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-22T21:40:34.673569] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-22T21:40:34.673806] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-22T21:40:34.673864] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-22T21:40:34.835635] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T21:40:35.057082] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:40:35.317734] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-10-22T21:40:36.117628] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-10-22T21:40:36.406902] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-22T21:40:36.513122] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-22T21:40:36.917718] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-10. [2025-10-22T21:40:37.634639] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T21:40:37.717624] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-10-22T21:40:38.517690] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-10-22T21:40:38.849113] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T21:40:38.857742] [INFO ] [REMOTE ] UMC: Full fetch complete (76667 records). [2025-10-22T21:40:38.857868] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-22T21:40:39.275127] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-22T21:40:39.275204] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-22T21:40:39.276342] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-22T21:40:39.276404] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-22T21:40:39.277787] [DEBUG] [LOCAL ] UMC: Trimmed 76667 records to 52671 (keeping 200 days of data) [2025-10-22T21:40:39.365856] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T21:40:39.334133] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-10-22T21:40:39.593375] [DEBUG] [LOCAL ] UMC: Primary data saved (52671 records). [2025-10-22T21:40:39.593541] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-22T21:40:39.593626] [INFO ] [MAIN ] Update Progress: 2183/2367 symbols completed. UMC took 38.6s. Estimated remaining: 23m 39s. Rate: 7.8 symbols/min [2025-10-22T21:40:39.764171] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:40:39.795186] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T21:40:39.842439] [DEBUG] [LOCAL ] UNM: Loaded 47997 existing records from primary storage. [2025-10-22T21:40:39.842769] [INFO ] [MAIN ] UNM: Loaded 47997 existing records. [2025-10-22T21:40:40.014041] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:40:40.014326] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-22T21:40:40.014373] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-22T21:40:40.014563] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-22T21:40:40.014618] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-22T21:40:40.122852] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-10-22T21:40:40.367950] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:40:40.551621] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T21:40:40.917733] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-10-22T21:40:41.717699] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-10-22T21:40:42.432165] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T21:40:42.468775] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-22T21:40:42.517718] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-10-22T21:40:43.184699] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-22T21:40:43.317683] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-10-22T21:40:44.117702] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-10-22T21:40:44.204211] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T21:40:44.895778] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T21:40:44.917619] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-10-22T21:40:44.961811] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-22T21:40:45.717640] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-10-22T21:40:46.517636] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-10-22T21:40:46.686428] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T21:40:46.707676] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-22T21:40:47.317729] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-10-22T21:40:48.074059] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-22T21:40:48.117633] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-10-22T21:40:48.337753] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-22T21:40:48.917662] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-10-22T21:40:48.933615] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T21:40:49.717683] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-10-22T21:40:50.517782] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-10-22T21:40:50.662285] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T21:40:51.317943] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-10. [2025-10-22T21:40:51.933599] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-22T21:40:52.053355] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T21:40:52.117667] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-10-22T21:40:52.182169] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-22T21:40:52.185081] [INFO ] [REMOTE ] UNF: Full fetch complete (17969 records). [2025-10-22T21:40:52.185153] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-22T21:40:52.545547] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-22T21:40:52.545625] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-22T21:40:52.546076] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-22T21:40:52.546128] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-22T21:40:52.546670] [DEBUG] [LOCAL ] UNF: Trimmed 17969 records to 11751 (keeping 200 days of data) [2025-10-22T21:40:52.620988] [DEBUG] [LOCAL ] UNF: Primary data saved (11751 records). [2025-10-22T21:40:52.621131] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-22T21:40:52.621209] [INFO ] [MAIN ] Update Progress: 2184/2367 symbols completed. UNF took 25.1s. Estimated remaining: 23m 32s. Rate: 7.8 symbols/min [2025-10-22T21:40:52.787609] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:40:52.793394] [DEBUG] [LOCAL ] UNMA: Loaded 3456 existing records from primary storage. [2025-10-22T21:40:52.793608] [INFO ] [MAIN ] UNMA: Loaded 3456 existing records. [2025-10-22T21:40:52.920825] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-10-22T21:40:53.003276] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:40:53.003561] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-22T21:40:53.003618] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-22T21:40:53.003791] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-22T21:40:53.003846] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-22T21:40:53.374270] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:40:53.596989] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-22T21:40:53.717690] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-10-22T21:40:54.318738] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-22T21:40:54.517720] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-10-22T21:40:55.317685] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-10-22T21:40:55.777802] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-10-22T21:40:56.117698] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-10-22T21:40:56.191474] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T21:40:56.794491] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T21:40:56.917728] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-10-22T21:40:57.717716] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-10-22T21:40:58.476713] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T21:40:58.517633] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-10. [2025-10-22T21:40:58.594586] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-22T21:40:59.317713] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-10-22T21:40:59.420705] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T21:41:00.126448] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-10-22T21:41:00.128360] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T21:41:00.137630] [INFO ] [REMOTE ] UNFI: Full fetch complete (59901 records). [2025-10-22T21:41:00.137806] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-22T21:41:00.522119] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-22T21:41:00.522195] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-22T21:41:00.523226] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-22T21:41:00.523289] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-22T21:41:00.524469] [DEBUG] [LOCAL ] UNFI: Trimmed 59901 records to 42609 (keeping 200 days of data) [2025-10-22T21:41:00.762766] [DEBUG] [LOCAL ] UNFI: Primary data saved (42609 records). [2025-10-22T21:41:00.762890] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-22T21:41:00.762965] [INFO ] [MAIN ] Update Progress: 2185/2367 symbols completed. UNFI took 33.2s. Estimated remaining: 23m 24s. Rate: 7.8 symbols/min [2025-10-22T21:41:00.930483] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-10-22T21:41:00.932934] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:41:00.987964] [DEBUG] [LOCAL ] UNP: Loaded 53362 existing records from primary storage. [2025-10-22T21:41:00.988320] [INFO ] [MAIN ] UNP: Loaded 53362 existing records. [2025-10-22T21:41:01.187901] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:41:01.188119] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-22T21:41:01.188193] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-22T21:41:01.188459] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-22T21:41:01.188515] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-22T21:41:01.606869] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:41:01.717635] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-10-22T21:41:02.351861] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T21:41:02.517725] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-10-22T21:41:02.584878] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-22T21:41:02.830391] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (3.51 seconds). [2025-10-22T21:41:03.317696] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-10-22T21:41:03.453159] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T21:41:04.117680] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-10-22T21:41:04.419891] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-10-22T21:41:04.669639] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-22T21:41:04.917716] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-10-22T21:41:05.717772] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-10-22T21:41:05.821133] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-22T21:41:06.295595] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-22T21:41:06.517680] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-10-22T21:41:06.680950] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T21:41:07.081271] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-22T21:41:07.317673] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-10-22T21:41:08.117678] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-10-22T21:41:08.734811] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-22T21:41:08.917696] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-10-22T21:41:09.717710] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-10-22T21:41:10.170411] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-10-22T21:41:10.270934] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-22T21:41:10.517731] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-10-22T21:41:10.552248] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T21:41:11.112231] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-22T21:41:11.317671] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-10. [2025-10-22T21:41:11.697715] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-22T21:41:11.698798] [INFO ] [REMOTE ] UNMA: Full fetch complete (5421 records). [2025-10-22T21:41:11.698865] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-22T21:41:12.044192] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-22T21:41:12.044268] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-22T21:41:12.044416] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-22T21:41:12.044454] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-22T21:41:12.044837] [DEBUG] [LOCAL ] UNMA: Trimmed 5421 records to 3413 (keeping 200 days of data) [2025-10-22T21:41:12.064626] [DEBUG] [LOCAL ] UNMA: Primary data saved (3413 records). [2025-10-22T21:41:12.064732] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-22T21:41:12.064833] [INFO ] [MAIN ] Update Progress: 2186/2367 symbols completed. UNMA took 19.4s. Estimated remaining: 23m 17s. Rate: 7.8 symbols/min [2025-10-22T21:41:12.124899] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-10. [2025-10-22T21:41:12.233799] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:41:12.274218] [DEBUG] [LOCAL ] UP: Loaded 44384 existing records from primary storage. [2025-10-22T21:41:12.274496] [INFO ] [MAIN ] UP: Loaded 44384 existing records. [2025-10-22T21:41:12.449191] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:41:12.449419] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-22T21:41:12.449466] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-22T21:41:12.449678] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-22T21:41:12.449734] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-22T21:41:12.797042] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:41:12.917685] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-10. [2025-10-22T21:41:13.698883] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-22T21:41:13.712764] [INFO ] [REMOTE ] UNH: Full fetch complete (77960 records). [2025-10-22T21:41:13.713117] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-22T21:41:13.725187] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-10-22T21:41:13.853535] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T21:41:13.903051] [INFO ] [REMOTE ] UNM: Full fetch complete (69975 records). [2025-10-22T21:41:13.918688] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-22T21:41:14.328337] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-22T21:41:14.341830] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-22T21:41:14.348349] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-22T21:41:14.348440] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-22T21:41:14.451140] [DEBUG] [LOCAL ] UNH: Trimmed 77960 records to 53819 (keeping 200 days of data) [2025-10-22T21:41:14.601772] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-10-22T21:41:14.611076] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-22T21:41:14.611174] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-22T21:41:14.638269] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-22T21:41:14.644932] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-22T21:41:14.650795] [DEBUG] [LOCAL ] UNM: Trimmed 69975 records to 47961 (keeping 200 days of data) [2025-10-22T21:41:15.124536] [DEBUG] [LOCAL ] UNH: Primary data saved (53819 records). [2025-10-22T21:41:15.132557] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-22T21:41:15.133844] [INFO ] [MAIN ] Update Progress: 2187/2367 symbols completed. UNH took 40.9s. Estimated remaining: 23m 9s. Rate: 7.8 symbols/min [2025-10-22T21:41:15.372374] [DEBUG] [LOCAL ] UNM: Primary data saved (47961 records). [2025-10-22T21:41:15.376214] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-22T21:41:15.376066] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:41:15.376511] [INFO ] [MAIN ] Update Progress: 2188/2367 symbols completed. UNM took 35.8s. Estimated remaining: 23m 0s. Rate: 7.8 symbols/min [2025-10-22T21:41:15.493752] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T21:41:15.542252] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-10-22T21:41:15.587229] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:41:15.632304] [DEBUG] [LOCAL ] UPS: Loaded 53720 existing records from primary storage. [2025-10-22T21:41:15.644024] [INFO ] [MAIN ] UPS: Loaded 53720 existing records. [2025-10-22T21:41:15.764753] [DEBUG] [LOCAL ] URI: Loaded 34400 existing records from primary storage. [2025-10-22T21:41:15.775768] [INFO ] [MAIN ] URI: Loaded 34400 existing records. [2025-10-22T21:41:15.941002] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:41:15.952554] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-22T21:41:15.963308] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-22T21:41:15.974431] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-10-22T21:41:15.974531] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-22T21:41:16.112158] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:41:16.123366] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-22T21:41:16.141671] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-22T21:41:16.143950] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-10-22T21:41:16.144254] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-22T21:41:16.646634] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:41:16.673557] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-10-22T21:41:16.764526] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:41:16.821168] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-22T21:41:16.830709] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-22T21:41:16.917621] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-10-22T21:41:17.717699] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-10-22T21:41:18.517725] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-10-22T21:41:18.762987] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-22T21:41:18.870422] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T21:41:19.317674] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-10-22T21:41:19.385312] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T21:41:20.020683] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T21:41:20.117678] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-10-22T21:41:20.917696] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-10-22T21:41:21.182144] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T21:41:21.717764] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-10-22T21:41:22.146068] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-22T21:41:22.415875] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T21:41:22.517703] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-10-22T21:41:23.250747] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-22T21:41:23.317625] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-10-22T21:41:24.117727] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-10-22T21:41:24.264036] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T21:41:24.877865] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T21:41:24.917614] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-10-22T21:41:25.717635] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-10-22T21:41:25.866630] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T21:41:26.468261] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T21:41:26.517615] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-10-22T21:41:27.317673] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-10-22T21:41:27.661255] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T21:41:28.117661] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-10-22T21:41:28.174104] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T21:41:28.727836] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T21:41:28.917676] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-10-22T21:41:29.717673] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-10-22T21:41:30.117052] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-22T21:41:30.517636] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-10-22T21:41:30.625965] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T21:41:31.317628] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-10-22T21:41:31.811865] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-22T21:41:32.122322] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-10-22T21:41:32.126405] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T21:41:32.917635] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-10-22T21:41:33.191349] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-22T21:41:33.717722] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-10-22T21:41:34.293158] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T21:41:34.512519] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-22T21:41:34.523425] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-10-22T21:41:35.317638] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-10. [2025-10-22T21:41:35.733034] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-22T21:41:36.054475] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T21:41:36.064140] [INFO ] [REMOTE ] UNP: Full fetch complete (77145 records). [2025-10-22T21:41:36.064395] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-22T21:41:36.123776] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-10-22T21:41:36.260241] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T21:41:36.545110] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-22T21:41:36.545212] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-22T21:41:36.546532] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-22T21:41:36.546599] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-22T21:41:36.548230] [DEBUG] [LOCAL ] UNP: Trimmed 77145 records to 53362 (keeping 200 days of data) [2025-10-22T21:41:36.894913] [DEBUG] [LOCAL ] UNP: Primary data saved (53362 records). [2025-10-22T21:41:36.895041] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-22T21:41:36.895120] [INFO ] [MAIN ] Update Progress: 2189/2367 symbols completed. UNP took 36.1s. Estimated remaining: 22m 54s. Rate: 7.8 symbols/min [2025-10-22T21:41:36.929765] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-10-22T21:41:37.088053] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:41:37.122712] [DEBUG] [LOCAL ] USA: Loaded 36487 existing records from primary storage. [2025-10-22T21:41:37.122993] [INFO ] [MAIN ] USA: Loaded 36487 existing records. [2025-10-22T21:41:37.322195] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:41:37.322430] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-22T21:41:37.322496] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-22T21:41:37.322866] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-22T21:41:37.322925] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-22T21:41:37.699589] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:41:37.717613] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-10-22T21:41:38.423613] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-22T21:41:38.503145] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T21:41:38.517685] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-10-22T21:41:39.096970] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T21:41:39.317692] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-10-22T21:41:40.117625] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-10. [2025-10-22T21:41:40.598382] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-22T21:41:40.744725] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T21:41:40.917743] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-10-22T21:41:41.717702] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-10-22T21:41:41.886803] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T21:41:41.895268] [INFO ] [REMOTE ] UP: Full fetch complete (63066 records). [2025-10-22T21:41:41.895388] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-22T21:41:42.267313] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-22T21:41:42.267402] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-22T21:41:42.271491] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-22T21:41:42.271624] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-22T21:41:42.273081] [DEBUG] [LOCAL ] UP: Trimmed 63066 records to 44436 (keeping 200 days of data) [2025-10-22T21:41:42.517934] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-10. [2025-10-22T21:41:42.589099] [DEBUG] [LOCAL ] UP: Primary data saved (44436 records). [2025-10-22T21:41:42.589289] [INFO ] [MAIN ] UP: Full history saved. [2025-10-22T21:41:42.589414] [INFO ] [MAIN ] Update Progress: 2190/2367 symbols completed. UP took 30.5s. Estimated remaining: 22m 46s. Rate: 7.8 symbols/min [2025-10-22T21:41:42.833151] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:41:42.866586] [DEBUG] [LOCAL ] USAC: Loaded 21711 existing records from primary storage. [2025-10-22T21:41:42.866991] [INFO ] [MAIN ] USAC: Loaded 21711 existing records. [2025-10-22T21:41:43.083576] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T21:41:43.177133] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:41:43.177967] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-22T21:41:43.178117] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-22T21:41:43.178574] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-22T21:41:43.178749] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-22T21:41:43.323553] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-10-22T21:41:43.348558] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-22T21:41:43.482127] [INFO ] [REMOTE ] URI: Full fetch complete (52637 records). [2025-10-22T21:41:43.489936] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-10-22T21:41:43.745577] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:41:43.854154] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-10-22T21:41:44.078093] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-10-22T21:41:44.078178] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-10-22T21:41:44.079256] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-10-22T21:41:44.079319] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-10-22T21:41:44.080344] [DEBUG] [LOCAL ] URI: Trimmed 52637 records to 34264 (keeping 200 days of data) [2025-10-22T21:41:44.135697] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-10-22T21:41:44.295569] [DEBUG] [LOCAL ] URI: Primary data saved (34264 records). [2025-10-22T21:41:44.295721] [INFO ] [MAIN ] URI: Full history saved. [2025-10-22T21:41:44.295808] [INFO ] [MAIN ] Update Progress: 2191/2367 symbols completed. URI took 28.9s. Estimated remaining: 22m 38s. Rate: 7.8 symbols/min [2025-10-22T21:41:44.462771] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:41:44.510688] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-22T21:41:44.511006] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-10-22T21:41:44.690362] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:41:44.690631] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-22T21:41:44.690750] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-22T21:41:44.691037] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-22T21:41:44.691094] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-22T21:41:44.926180] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-10-22T21:41:45.076247] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:41:45.078202] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T21:41:45.106862] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-22T21:41:45.717636] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-10-22T21:41:46.517730] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-10-22T21:41:47.236373] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-22T21:41:47.317711] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-10-22T21:41:47.491490] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-10-22T21:41:47.786948] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-22T21:41:48.117688] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-10-22T21:41:48.917703] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-10-22T21:41:49.115167] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-22T21:41:49.717723] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-10-22T21:41:50.172915] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T21:41:50.525749] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-10-22T21:41:50.531635] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-22T21:41:51.275458] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T21:41:51.317688] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-10-22T21:41:51.726889] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-22T21:41:52.117734] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-10-22T21:41:52.896336] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T21:41:52.917625] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-10-22T21:41:53.224937] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-22T21:41:53.717690] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-10. [2025-10-22T21:41:54.428181] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T21:41:54.438231] [INFO ] [REMOTE ] UPS: Full fetch complete (77880 records). [2025-10-22T21:41:54.438381] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-10-22T21:41:54.522780] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-10-22T21:41:54.889866] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-10-22T21:41:54.889986] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-10-22T21:41:54.891349] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-10-22T21:41:54.891434] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-10-22T21:41:54.893271] [DEBUG] [LOCAL ] UPS: Trimmed 77880 records to 53721 (keeping 200 days of data) [2025-10-22T21:41:55.026887] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-22T21:41:55.268026] [DEBUG] [LOCAL ] UPS: Primary data saved (53721 records). [2025-10-22T21:41:55.268198] [INFO ] [MAIN ] UPS: Full history saved. [2025-10-22T21:41:55.268293] [INFO ] [MAIN ] Update Progress: 2192/2367 symbols completed. UPS took 40.1s. Estimated remaining: 22m 30s. Rate: 7.8 symbols/min [2025-10-22T21:41:55.323316] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-10-22T21:41:55.447182] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:41:55.495865] [DEBUG] [LOCAL ] USFD: Loaded 51154 existing records from primary storage. [2025-10-22T21:41:55.496198] [INFO ] [MAIN ] USFD: Loaded 51154 existing records. [2025-10-22T21:41:55.676917] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:41:55.677568] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-22T21:41:55.677868] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-22T21:41:55.678091] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-22T21:41:55.683309] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-22T21:41:55.755368] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-22T21:41:56.066926] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:41:56.117622] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-10-22T21:41:56.917638] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-10-22T21:41:57.270960] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T21:41:57.724496] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-10-22T21:41:57.729926] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T21:41:58.273525] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T21:41:58.517680] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-10-22T21:41:59.317714] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-10-22T21:41:59.563813] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-22T21:41:59.637812] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-22T21:42:00.117718] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-10-22T21:42:00.370865] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-22T21:42:00.917704] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-10-22T21:42:01.717747] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-10-22T21:42:02.232419] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-22T21:42:02.350570] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-22T21:42:02.517679] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-10-22T21:42:03.317733] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-10-22T21:42:03.640443] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-22T21:42:03.974165] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-22T21:42:04.117621] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-10-22T21:42:04.449452] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-22T21:42:04.917725] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-10-22T21:42:05.344817] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T21:42:05.717668] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-10. [2025-10-22T21:42:06.388582] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T21:42:06.517668] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-10-22T21:42:06.818720] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-22T21:42:06.822249] [INFO ] [REMOTE ] USAC: Full fetch complete (35191 records). [2025-10-22T21:42:06.822331] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-22T21:42:07.195256] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-22T21:42:07.195342] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-22T21:42:07.196053] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-22T21:42:07.196122] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-22T21:42:07.196965] [DEBUG] [LOCAL ] USAC: Trimmed 35191 records to 21590 (keeping 200 days of data) [2025-10-22T21:42:07.323577] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-10. [2025-10-22T21:42:07.326876] [DEBUG] [LOCAL ] USAC: Primary data saved (21590 records). [2025-10-22T21:42:07.326939] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-22T21:42:07.327009] [INFO ] [MAIN ] Update Progress: 2193/2367 symbols completed. USAC took 24.7s. Estimated remaining: 22m 23s. Rate: 7.8 symbols/min [2025-10-22T21:42:07.499150] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:42:07.516567] [DEBUG] [LOCAL ] USNA: Loaded 18002 existing records from primary storage. [2025-10-22T21:42:07.516836] [INFO ] [MAIN ] USNA: Loaded 18002 existing records. [2025-10-22T21:42:07.690480] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:42:07.690703] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-22T21:42:07.690760] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-22T21:42:07.690942] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-22T21:42:07.690998] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-22T21:42:08.041015] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:42:08.117620] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-10-22T21:42:08.530174] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-22T21:42:08.559353] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T21:42:08.566030] [INFO ] [REMOTE ] USA: Full fetch complete (52550 records). [2025-10-22T21:42:08.566141] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-22T21:42:08.926417] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-10-22T21:42:08.943984] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-22T21:42:08.944875] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-22T21:42:08.945950] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-22T21:42:08.946123] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-22T21:42:08.947242] [DEBUG] [LOCAL ] USA: Trimmed 52550 records to 36378 (keeping 200 days of data) [2025-10-22T21:42:09.155580] [DEBUG] [LOCAL ] USA: Primary data saved (36378 records). [2025-10-22T21:42:09.155748] [INFO ] [MAIN ] USA: Full history saved. [2025-10-22T21:42:09.155834] [INFO ] [MAIN ] Update Progress: 2194/2367 symbols completed. USA took 32.3s. Estimated remaining: 22m 15s. Rate: 7.8 symbols/min [2025-10-22T21:42:09.271265] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-22T21:42:09.343619] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:42:09.359726] [DEBUG] [LOCAL ] USPH: Loaded 17099 existing records from primary storage. [2025-10-22T21:42:09.359967] [INFO ] [MAIN ] USPH: Loaded 17099 existing records. [2025-10-22T21:42:09.534427] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:42:09.534682] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-22T21:42:09.534743] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-22T21:42:09.534917] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-22T21:42:09.534954] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-22T21:42:09.726076] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-10-22T21:42:09.881762] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:42:10.517692] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-10-22T21:42:11.030007] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-22T21:42:11.317613] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-10-22T21:42:11.403476] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T21:42:11.731231] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-22T21:42:12.117739] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-10-22T21:42:12.917702] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-10-22T21:42:13.107045] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T21:42:13.162042] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-22T21:42:13.656695] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-22T21:42:13.717617] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-10-22T21:42:14.517627] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-10-22T21:42:14.836832] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-22T21:42:15.317748] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-10-22T21:42:16.117708] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-10-22T21:42:16.194105] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T21:42:16.303031] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-22T21:42:16.903182] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-22T21:42:16.917604] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-10-22T21:42:17.717709] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-10-22T21:42:18.517626] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-10-22T21:42:18.630399] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T21:42:18.755924] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-22T21:42:19.317682] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-10-22T21:42:20.117737] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-10-22T21:42:20.412573] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-22T21:42:20.906453] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T21:42:20.917608] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-10-22T21:42:21.054969] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T21:42:21.717638] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-10. [2025-10-22T21:42:21.960854] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T21:42:22.439511] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-22T21:42:22.448532] [INFO ] [REMOTE ] USB: Full fetch complete (77867 records). [2025-10-22T21:42:22.448715] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-22T21:42:22.522748] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-10-22T21:42:22.849248] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-22T21:42:22.849379] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-22T21:42:22.850732] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-22T21:42:22.850804] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-22T21:42:22.852322] [DEBUG] [LOCAL ] USB: Trimmed 77867 records to 53688 (keeping 200 days of data) [2025-10-22T21:42:23.180990] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-10-22T21:42:23.181123] [INFO ] [MAIN ] USB: Full history saved. [2025-10-22T21:42:23.181203] [INFO ] [MAIN ] Update Progress: 2195/2367 symbols completed. USB took 38.9s. Estimated remaining: 22m 7s. Rate: 7.8 symbols/min [2025-10-22T21:42:23.323515] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-10-22T21:42:23.357017] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:42:23.391194] [DEBUG] [LOCAL ] UTF: Loaded 31001 existing records from primary storage. [2025-10-22T21:42:23.391557] [INFO ] [MAIN ] UTF: Loaded 31001 existing records. [2025-10-22T21:42:23.572328] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:42:23.572982] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-22T21:42:23.573152] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-22T21:42:23.573462] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-22T21:42:23.573565] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-22T21:42:23.685196] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-22T21:42:23.939893] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:42:24.117701] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-10-22T21:42:24.385393] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T21:42:24.917668] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-10-22T21:42:25.028818] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-22T21:42:25.717632] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-10-22T21:42:26.054402] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-22T21:42:26.517637] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-10-22T21:42:26.702339] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-22T21:42:27.317686] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-10-22T21:42:27.624770] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T21:42:27.895868] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-22T21:42:28.117633] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-10-22T21:42:28.917687] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-10-22T21:42:29.177407] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-22T21:42:29.717725] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-10. [2025-10-22T21:42:30.517729] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-10-22T21:42:30.655066] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T21:42:30.792238] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T21:42:30.796205] [INFO ] [REMOTE ] USNA: Full fetch complete (27104 records). [2025-10-22T21:42:30.796326] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-22T21:42:31.168839] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-22T21:42:31.168917] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-22T21:42:31.169495] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-22T21:42:31.169536] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-22T21:42:31.170191] [DEBUG] [LOCAL ] USNA: Trimmed 27104 records to 17995 (keeping 200 days of data) [2025-10-22T21:42:31.275719] [DEBUG] [LOCAL ] USNA: Primary data saved (17995 records). [2025-10-22T21:42:31.275901] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-22T21:42:31.276018] [INFO ] [MAIN ] Update Progress: 2196/2367 symbols completed. USNA took 23.9s. Estimated remaining: 21m 60s. Rate: 7.8 symbols/min [2025-10-22T21:42:31.322766] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-10. [2025-10-22T21:42:31.445768] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:42:31.483201] [DEBUG] [LOCAL ] UTI: Loaded 40317 existing records from primary storage. [2025-10-22T21:42:31.483517] [INFO ] [MAIN ] UTI: Loaded 40317 existing records. [2025-10-22T21:42:31.670693] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:42:31.670930] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-22T21:42:31.671009] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-22T21:42:31.671307] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-10-22T21:42:31.671364] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-22T21:42:31.865556] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T21:42:32.050255] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:42:32.117614] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-10-22T21:42:32.917631] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-10-22T21:42:33.014748] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-22T21:42:33.023000] [INFO ] [REMOTE ] USFD: Full fetch complete (74324 records). [2025-10-22T21:42:33.023127] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-22T21:42:33.416957] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-22T21:42:33.417062] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-22T21:42:33.418395] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-22T21:42:33.418477] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-22T21:42:33.419993] [DEBUG] [LOCAL ] USFD: Trimmed 74324 records to 51132 (keeping 200 days of data) [2025-10-22T21:42:33.669078] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T21:42:33.718304] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-10-22T21:42:33.753904] [DEBUG] [LOCAL ] USFD: Primary data saved (51132 records). [2025-10-22T21:42:33.754003] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-22T21:42:33.754077] [INFO ] [MAIN ] Update Progress: 2197/2367 symbols completed. USFD took 38.5s. Estimated remaining: 21m 51s. Rate: 7.8 symbols/min [2025-10-22T21:42:33.946065] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-22T21:42:34.517685] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-10-22T21:42:35.278995] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-22T21:42:35.323131] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-10-22T21:42:35.327967] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T21:42:36.117705] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-10. [2025-10-22T21:42:36.832029] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T21:42:36.917673] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-10-22T21:42:37.029479] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T21:42:37.033964] [INFO ] [REMOTE ] USPH: Full fetch complete (22989 records). [2025-10-22T21:42:37.034055] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-22T21:42:37.396099] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-22T21:42:37.396179] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-22T21:42:37.396684] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-22T21:42:37.396766] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-22T21:42:37.397408] [DEBUG] [LOCAL ] USPH: Trimmed 22989 records to 17006 (keeping 200 days of data) [2025-10-22T21:42:37.498913] [DEBUG] [LOCAL ] USPH: Primary data saved (17006 records). [2025-10-22T21:42:37.499045] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-22T21:42:37.499123] [INFO ] [MAIN ] Update Progress: 2198/2367 symbols completed. USPH took 28.3s. Estimated remaining: 21m 43s. Rate: 7.8 symbols/min [2025-10-22T21:42:37.717717] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-10-22T21:42:38.326916] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-22T21:42:38.517750] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-10-22T21:42:38.620953] [DEBUG] [REMOTE ] UTI: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-22T21:42:38.621283] [WARN ] [REMOTE ] UTI: No data returned for month 2025-05 [2025-10-22T21:42:38.621370] [FATAL] [REMOTE ] UTI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:42:38.621444] [FATAL] [MAIN ] UTI: Failed to fetch primary data. [2025-10-22T21:42:38.621506] [WARN ] [MAIN ] UTI: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:42:38.621574] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-22T21:42:38.621635] [DEBUG] [LOCAL ] UTI: No primary data file found to delete. [2025-10-22T21:42:38.621712] [INFO ] [LOCAL ] UTI: Starting deletion of derivative data. [2025-10-22T21:42:38.621861] [DEBUG] [LOCAL ] UTI: Deleted derivative data file. [2025-10-22T21:42:38.622619] [INFO ] [MAIN ] Update Progress: 2199/2367 symbols completed. UTI took 7.3s. Estimated remaining: 21m 35s. Rate: 7.8 symbols/min [2025-10-22T21:42:39.051874] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-22T21:42:39.317737] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-10-22T21:42:40.643974] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T21:42:40.650347] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-10-22T21:42:41.826584] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-22T21:42:41.832516] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-10-22T21:42:43.121457] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-22T21:42:43.128173] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-10-22T21:42:44.237058] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T21:42:44.242774] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-10-22T21:42:45.680017] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T21:42:45.689096] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-10. [2025-10-22T21:42:47.084991] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-22T21:42:47.093845] [INFO ] [REMOTE ] UTF: Full fetch complete (43843 records). [2025-10-22T21:42:47.094026] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-22T21:42:47.478468] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-22T21:42:47.478576] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-22T21:42:47.480289] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-22T21:42:47.480359] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-22T21:42:47.481625] [DEBUG] [LOCAL ] UTF: Trimmed 43843 records to 30943 (keeping 200 days of data) [2025-10-22T21:42:47.684997] [DEBUG] [LOCAL ] UTF: Primary data saved (30943 records). [2025-10-22T21:42:47.685233] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-22T21:42:47.685344] [INFO ] [MAIN ] Update Progress: 2200/2367 symbols completed. UTF took 24.5s. Estimated remaining: 21m 28s. Rate: 7.8 symbols/min [2025-10-22T21:42:48.201604] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:42:48.289461] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:42:48.367175] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:42:48.404866] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:42:48.415756] [DEBUG] [LOCAL ] UVE: Loaded 21996 existing records from primary storage. [2025-10-22T21:42:48.416159] [INFO ] [MAIN ] UVE: Loaded 21996 existing records. [2025-10-22T21:42:48.541731] [DEBUG] [LOCAL ] UTL: Loaded 11875 existing records from primary storage. [2025-10-22T21:42:48.553520] [INFO ] [MAIN ] UTL: Loaded 11875 existing records. [2025-10-22T21:42:48.554252] [DEBUG] [LOCAL ] UVV: Loaded 22842 existing records from primary storage. [2025-10-22T21:42:48.554572] [INFO ] [MAIN ] UVV: Loaded 22842 existing records. [2025-10-22T21:42:48.825314] [DEBUG] [LOCAL ] UTZ: Loaded 44393 existing records from primary storage. [2025-10-22T21:42:48.850963] [INFO ] [MAIN ] UTZ: Loaded 44393 existing records. [2025-10-22T21:42:48.876955] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:42:48.933785] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-22T21:42:48.944191] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-22T21:42:48.972684] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-10-22T21:42:49.080919] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-22T21:42:49.068489] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:42:49.105951] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:42:49.109415] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-22T21:42:49.149129] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-22T21:42:49.143845] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-22T21:42:49.186563] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-22T21:42:49.212381] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-22T21:42:49.181352] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-22T21:42:49.329513] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-22T21:42:49.387219] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:42:49.401399] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-22T21:42:49.465789] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-22T21:42:49.541425] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-22T21:42:49.659598] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-22T21:42:49.670114] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-22T21:42:50.277314] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:42:50.278883] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-10-22T21:42:50.485721] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:42:50.532877] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-10-22T21:42:50.708429] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:42:50.728922] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-10-22T21:42:50.728671] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:42:50.729905] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-10-22T21:42:51.405790] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-22T21:42:51.409972] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-10-22T21:42:51.417006] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-22T21:42:51.419679] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-10-22T21:42:51.570496] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-22T21:42:51.574504] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-10-22T21:42:51.980277] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T21:42:51.989176] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-10-22T21:42:52.195904] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-22T21:42:52.200418] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-10-22T21:42:52.232823] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T21:42:52.235349] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-10-22T21:42:52.588176] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T21:42:52.591787] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-10-22T21:42:53.166620] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-22T21:42:53.169032] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-10-22T21:42:53.547370] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T21:42:53.624058] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-22T21:42:53.717684] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-10-22T21:42:53.934756] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-22T21:42:53.951955] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-22T21:42:54.517627] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-10-22T21:42:54.835607] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T21:42:55.317710] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-10-22T21:42:56.117706] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-10-22T21:42:56.143915] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-22T21:42:56.193637] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T21:42:56.917627] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-10-22T21:42:57.291676] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-22T21:42:57.698981] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T21:42:57.717738] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-10-22T21:42:58.517757] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-10-22T21:42:58.924671] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-22T21:42:59.317717] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-10-22T21:42:59.661030] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-22T21:43:00.117631] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-10-22T21:43:00.167137] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-22T21:43:00.917697] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-10-22T21:43:01.444360] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-22T21:43:01.717720] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-10-22T21:43:01.917841] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T21:43:02.517629] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-10-22T21:43:02.823405] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-22T21:43:03.317683] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-10-22T21:43:04.117627] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-10-22T21:43:04.148124] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T21:43:04.250595] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-22T21:43:04.917680] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-10-22T21:43:05.522066] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-22T21:43:05.717695] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-10. [2025-10-22T21:43:06.517715] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-10-22T21:43:06.591712] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-22T21:43:06.594389] [INFO ] [REMOTE ] UTL: Full fetch complete (15870 records). [2025-10-22T21:43:06.594459] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-22T21:43:06.818911] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-22T21:43:07.009040] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-22T21:43:07.009117] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-22T21:43:07.009459] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-22T21:43:07.009500] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-22T21:43:07.010101] [DEBUG] [LOCAL ] UTL: Trimmed 15870 records to 11858 (keeping 200 days of data) [2025-10-22T21:43:07.079305] [DEBUG] [LOCAL ] UTL: Primary data saved (11858 records). [2025-10-22T21:43:07.079430] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-22T21:43:07.079508] [INFO ] [MAIN ] Update Progress: 2201/2367 symbols completed. UTL took 19.4s. Estimated remaining: 21m 21s. Rate: 7.8 symbols/min [2025-10-22T21:43:07.244038] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:43:07.287875] [DEBUG] [LOCAL ] UWMC: Loaded 52961 existing records from primary storage. [2025-10-22T21:43:07.288216] [INFO ] [MAIN ] UWMC: Loaded 52961 existing records. [2025-10-22T21:43:07.322867] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-10-22T21:43:07.469141] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:43:07.469473] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-22T21:43:07.469547] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-22T21:43:07.469971] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-22T21:43:07.470078] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-22T21:43:07.621963] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-22T21:43:07.854937] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:43:08.117698] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-10-22T21:43:08.917638] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-10-22T21:43:08.978806] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T21:43:09.717725] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-10-22T21:43:09.800211] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T21:43:09.861822] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T21:43:10.517695] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-10-22T21:43:10.897605] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T21:43:11.317667] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-10-22T21:43:11.599809] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-22T21:43:12.117689] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-10. [2025-10-22T21:43:12.368716] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T21:43:12.917638] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-10. [2025-10-22T21:43:13.162378] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T21:43:13.165964] [INFO ] [REMOTE ] UVV: Full fetch complete (30202 records). [2025-10-22T21:43:13.166064] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-22T21:43:13.533437] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-22T21:43:13.533514] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-22T21:43:13.534128] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-22T21:43:13.534189] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-22T21:43:13.534891] [DEBUG] [LOCAL ] UVV: Trimmed 30202 records to 22770 (keeping 200 days of data) [2025-10-22T21:43:13.676288] [DEBUG] [LOCAL ] UVV: Primary data saved (22770 records). [2025-10-22T21:43:13.676422] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-22T21:43:13.676509] [INFO ] [MAIN ] Update Progress: 2202/2367 symbols completed. UVV took 26.0s. Estimated remaining: 21m 13s. Rate: 7.8 symbols/min [2025-10-22T21:43:13.722905] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-10-22T21:43:13.849251] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:43:13.856415] [DEBUG] [LOCAL ] UZD: Loaded 5886 existing records from primary storage. [2025-10-22T21:43:13.856561] [INFO ] [MAIN ] UZD: Loaded 5886 existing records. [2025-10-22T21:43:14.025540] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-22T21:43:14.051146] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:43:14.051484] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-22T21:43:14.051679] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-22T21:43:14.051598] [INFO ] [REMOTE ] UVE: Full fetch complete (30362 records). [2025-10-22T21:43:14.051911] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-22T21:43:14.052013] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-22T21:43:14.051859] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-22T21:43:14.522815] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-10-22T21:43:14.757113] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:43:14.815303] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-22T21:43:14.815368] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-22T21:43:14.816054] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-22T21:43:14.816115] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-22T21:43:14.816892] [DEBUG] [LOCAL ] UVE: Trimmed 30362 records to 21957 (keeping 200 days of data) [2025-10-22T21:43:14.954535] [DEBUG] [LOCAL ] UVE: Primary data saved (21957 records). [2025-10-22T21:43:14.954685] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-22T21:43:14.954780] [INFO ] [MAIN ] Update Progress: 2203/2367 symbols completed. UVE took 27.3s. Estimated remaining: 21m 5s. Rate: 7.8 symbols/min [2025-10-22T21:43:15.136188] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:43:15.144854] [DEBUG] [LOCAL ] UZE: Loaded 7025 existing records from primary storage. [2025-10-22T21:43:15.145052] [INFO ] [MAIN ] UZE: Loaded 7025 existing records. [2025-10-22T21:43:15.318241] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-10-22T21:43:15.321851] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:43:15.323149] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-22T21:43:15.323210] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-22T21:43:15.323359] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-22T21:43:15.323407] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-22T21:43:15.673385] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-22T21:43:15.718284] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:43:16.116317] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T21:43:16.118565] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-10-22T21:43:16.285187] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T21:43:16.520980] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-22T21:43:16.917663] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-10-22T21:43:17.717675] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-10-22T21:43:18.191353] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-22T21:43:18.517693] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-10-22T21:43:18.613338] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-22T21:43:19.063635] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-22T21:43:19.317681] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-10-22T21:43:20.059278] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-22T21:43:20.117616] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-10-22T21:43:20.898468] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-22T21:43:20.917616] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-10-22T21:43:21.610701] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-22T21:43:21.717675] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-10-22T21:43:22.517691] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-10-22T21:43:23.317697] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-10-22T21:43:23.563364] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T21:43:23.661721] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T21:43:23.726336] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-22T21:43:24.117677] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-10-22T21:43:24.917707] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-10-22T21:43:25.632453] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-22T21:43:25.717639] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-10-22T21:43:25.922719] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-22T21:43:26.517694] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-10-22T21:43:27.176421] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-22T21:43:27.260715] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T21:43:27.317740] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-10-22T21:43:28.117727] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-10-22T21:43:28.839153] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-22T21:43:28.917635] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-10-22T21:43:29.091588] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T21:43:29.594622] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-22T21:43:29.717740] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-10-22T21:43:30.517719] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-10. [2025-10-22T21:43:31.317768] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-10-22T21:43:31.436733] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T21:43:31.985137] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-22T21:43:32.002230] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-22T21:43:32.001900] [INFO ] [REMOTE ] UTZ: Full fetch complete (64544 records). [2025-10-22T21:43:32.005459] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-22T21:43:32.122814] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-10-22T21:43:32.395219] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-22T21:43:32.395292] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-22T21:43:32.396396] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-22T21:43:32.396457] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-22T21:43:32.397679] [DEBUG] [LOCAL ] UTZ: Trimmed 64544 records to 44265 (keeping 200 days of data) [2025-10-22T21:43:32.657366] [DEBUG] [LOCAL ] UTZ: Primary data saved (44265 records). [2025-10-22T21:43:32.657522] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-22T21:43:32.657608] [INFO ] [MAIN ] Update Progress: 2204/2367 symbols completed. UTZ took 45.0s. Estimated remaining: 20m 58s. Rate: 7.8 symbols/min [2025-10-22T21:43:32.830608] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:43:32.828515] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-22T21:43:32.830807] [DEBUG] [LOCAL ] UZF: No existing data file found in primary storage. [2025-10-22T21:43:32.831382] [WARN ] [MAIN ] UZF: No existing data found, performing full refresh instead. [2025-10-22T21:43:32.833047] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-22T21:43:32.833092] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-22T21:43:32.833136] [DEBUG] [LOCAL ] UZF: No primary data file found to delete. [2025-10-22T21:43:32.833169] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-22T21:43:32.922716] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-10-22T21:43:33.183674] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:43:33.581322] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-22T21:43:33.717682] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-10-22T21:43:34.313411] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-22T21:43:34.517690] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-10. [2025-10-22T21:43:35.150886] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-22T21:43:35.152729] [INFO ] [REMOTE ] UZE: Full fetch complete (9785 records). [2025-10-22T21:43:35.152811] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-22T21:43:35.322870] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-10-22T21:43:35.552152] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-22T21:43:35.552270] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-22T21:43:35.552535] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-22T21:43:35.552594] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-22T21:43:35.553089] [DEBUG] [LOCAL ] UZE: Trimmed 9785 records to 6947 (keeping 200 days of data) [2025-10-22T21:43:35.593951] [DEBUG] [LOCAL ] UZE: Primary data saved (6947 records). [2025-10-22T21:43:35.594062] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-22T21:43:35.594137] [INFO ] [MAIN ] Update Progress: 2205/2367 symbols completed. UZE took 20.6s. Estimated remaining: 20m 50s. Rate: 7.8 symbols/min [2025-10-22T21:43:35.758070] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:43:35.807335] [DEBUG] [LOCAL ] V: Loaded 53751 existing records from primary storage. [2025-10-22T21:43:35.807731] [INFO ] [MAIN ] V: Loaded 53751 existing records. [2025-10-22T21:43:35.981697] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:43:35.981945] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-22T21:43:35.981991] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-22T21:43:35.982197] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-22T21:43:35.982251] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-22T21:43:36.125844] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-10-22T21:43:36.339419] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:43:36.779610] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T21:43:36.917687] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-10-22T21:43:37.305280] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T21:43:37.505394] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-22T21:43:37.717743] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-10-22T21:43:38.517699] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-10-22T21:43:38.947200] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-22T21:43:39.317615] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-10-22T21:43:39.483452] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T21:43:39.995130] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-22T21:43:40.117715] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-10-22T21:43:40.860697] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T21:43:40.917619] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-10-22T21:43:41.531742] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-22T21:43:41.717673] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-10-22T21:43:42.180885] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-22T21:43:42.517695] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-10-22T21:43:43.317712] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-10-22T21:43:43.339782] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-22T21:43:44.117719] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-10-22T21:43:44.151183] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-22T21:43:44.717797] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-22T21:43:44.917740] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-10. [2025-10-22T21:43:45.405863] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-22T21:43:45.406908] [INFO ] [REMOTE ] UZF: Full fetch complete (8385 records). [2025-10-22T21:43:45.406978] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-22T21:43:45.589982] [WARN ] [VALIDATOR ] UZF: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T21:43:45.590226] [FATAL] [MAIN ] UZF: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:43:45.590303] [WARN ] [MAIN ] UZF: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:43:45.590395] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-22T21:43:45.590500] [DEBUG] [LOCAL ] UZF: No primary data file found to delete. [2025-10-22T21:43:45.590566] [INFO ] [LOCAL ] UZF: Starting deletion of derivative data. [2025-10-22T21:43:45.590663] [DEBUG] [LOCAL ] UZF: No derivative data file found to delete. [2025-10-22T21:43:45.590768] [INFO ] [MAIN ] Update Progress: 2206/2367 symbols completed. UZF took 12.9s. Estimated remaining: 20m 42s. Rate: 7.8 symbols/min [2025-10-22T21:43:45.722830] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-10. [2025-10-22T21:43:45.767219] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:43:45.799435] [DEBUG] [LOCAL ] VAC: Loaded 33699 existing records from primary storage. [2025-10-22T21:43:45.799758] [INFO ] [MAIN ] VAC: Loaded 33699 existing records. [2025-10-22T21:43:45.978500] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:43:45.978771] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-22T21:43:45.978834] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-22T21:43:45.979050] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-22T21:43:45.979107] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-22T21:43:46.342120] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:43:46.517740] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-10-22T21:43:47.106217] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-22T21:43:47.317639] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-10-22T21:43:47.487565] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-22T21:43:47.496275] [INFO ] [REMOTE ] UWMC: Full fetch complete (75925 records). [2025-10-22T21:43:47.496398] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-22T21:43:47.877196] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-22T21:43:47.877280] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-22T21:43:47.878437] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-22T21:43:47.878545] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-22T21:43:47.879937] [DEBUG] [LOCAL ] UWMC: Trimmed 75925 records to 52960 (keeping 200 days of data) [2025-10-22T21:43:48.137510] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-10. [2025-10-22T21:43:48.183663] [DEBUG] [LOCAL ] UWMC: Primary data saved (52960 records). [2025-10-22T21:43:48.183779] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-22T21:43:48.183856] [INFO ] [MAIN ] Update Progress: 2207/2367 symbols completed. UWMC took 41.1s. Estimated remaining: 20m 34s. Rate: 7.8 symbols/min [2025-10-22T21:43:48.348573] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:43:48.390425] [DEBUG] [LOCAL ] VAL: Loaded 49919 existing records from primary storage. [2025-10-22T21:43:48.390755] [INFO ] [MAIN ] VAL: Loaded 49919 existing records. [2025-10-22T21:43:48.567122] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:43:48.567338] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-22T21:43:48.567397] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-22T21:43:48.567686] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-22T21:43:48.567744] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-22T21:43:48.675024] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-22T21:43:48.719377] [INFO ] [REMOTE ] UZD: Full fetch complete (8872 records). [2025-10-22T21:43:48.727892] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-22T21:43:48.929942] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-10-22T21:43:49.192377] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:43:49.302594] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-22T21:43:49.302730] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-22T21:43:49.302966] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-22T21:43:49.303027] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-22T21:43:49.303431] [DEBUG] [LOCAL ] UZD: Trimmed 8872 records to 5801 (keeping 200 days of data) [2025-10-22T21:43:49.337678] [DEBUG] [LOCAL ] UZD: Primary data saved (5801 records). [2025-10-22T21:43:49.337796] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-22T21:43:49.337875] [INFO ] [MAIN ] Update Progress: 2208/2367 symbols completed. UZD took 35.7s. Estimated remaining: 20m 26s. Rate: 7.8 symbols/min [2025-10-22T21:43:49.503248] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:43:49.552369] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-22T21:43:49.552735] [INFO ] [MAIN ] VALE: Loaded 53693 existing records. [2025-10-22T21:43:49.726249] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-10-22T21:43:49.758433] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:43:49.758922] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-22T21:43:49.759948] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-22T21:43:49.760241] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-22T21:43:49.760299] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-22T21:43:50.136315] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:43:50.149136] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-10-22T21:43:50.324185] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-22T21:43:50.517723] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-10-22T21:43:51.317712] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-10-22T21:43:51.484427] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T21:43:51.872010] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-22T21:43:52.117693] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-10-22T21:43:52.917762] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-10-22T21:43:53.445583] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-22T21:43:53.717781] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-10-22T21:43:53.772119] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T21:43:54.517770] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-10-22T21:43:54.870616] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-22T21:43:54.922534] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-22T21:43:55.317730] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-10-22T21:43:55.907901] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-22T21:43:56.117693] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-10-22T21:43:56.917726] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-10-22T21:43:57.717711] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-10-22T21:43:57.887701] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-22T21:43:58.517787] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-10-22T21:43:58.955183] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-22T21:43:59.230541] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T21:43:59.317697] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-10-22T21:43:59.933272] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (4.62 seconds). [2025-10-22T21:44:00.117677] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-10-22T21:44:00.303476] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T21:44:00.917730] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-10-22T21:44:01.717726] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-10-22T21:44:02.257689] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (2.94 seconds). [2025-10-22T21:44:02.517767] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-10-22T21:44:02.894935] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-22T21:44:03.317726] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-10-22T21:44:03.889774] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-22T21:44:03.932277] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (3.81 seconds). [2025-10-22T21:44:04.117624] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-10-22T21:44:04.657750] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-22T21:44:04.821716] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-22T21:44:04.917637] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-10-22T21:44:05.717702] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-10-22T21:44:06.310621] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-22T21:44:06.370406] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-22T21:44:06.517633] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-10-22T21:44:07.317626] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-10-22T21:44:07.429100] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T21:44:08.117677] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-10-22T21:44:08.543671] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-22T21:44:08.761151] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T21:44:08.917691] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-10-22T21:44:09.436419] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-22T21:44:09.717683] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-10. [2025-10-22T21:44:10.517674] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-10-22T21:44:10.837143] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-22T21:44:11.306909] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T21:44:11.315040] [INFO ] [REMOTE ] VAL: Full fetch complete (72911 records). [2025-10-22T21:44:11.315206] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-22T21:44:11.327296] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-10-22T21:44:11.713354] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-22T21:44:11.713485] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-22T21:44:11.714848] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-22T21:44:11.714913] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-22T21:44:11.716616] [DEBUG] [LOCAL ] VAL: Trimmed 72911 records to 49858 (keeping 200 days of data) [2025-10-22T21:44:12.002380] [DEBUG] [LOCAL ] VAL: Primary data saved (49858 records). [2025-10-22T21:44:12.002508] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-22T21:44:12.002584] [INFO ] [MAIN ] Update Progress: 2209/2367 symbols completed. VAL took 23.8s. Estimated remaining: 20m 19s. Rate: 7.8 symbols/min [2025-10-22T21:44:12.122972] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-10-22T21:44:12.171354] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:44:12.178051] [DEBUG] [LOCAL ] VATE: Loaded 5093 existing records from primary storage. [2025-10-22T21:44:12.178728] [INFO ] [MAIN ] VATE: Loaded 5093 existing records. [2025-10-22T21:44:12.353903] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:44:12.354133] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-22T21:44:12.354191] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-22T21:44:12.354343] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-22T21:44:12.354398] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-22T21:44:12.722360] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:44:12.742207] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-22T21:44:12.786828] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-22T21:44:12.917687] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-10. [2025-10-22T21:44:13.717622] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-10-22T21:44:14.046137] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-22T21:44:14.106362] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T21:44:14.111836] [INFO ] [REMOTE ] VAC: Full fetch complete (48737 records). [2025-10-22T21:44:14.111957] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-22T21:44:14.488166] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-22T21:44:14.488243] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-22T21:44:14.489202] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-22T21:44:14.489272] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-22T21:44:14.490391] [DEBUG] [LOCAL ] VAC: Trimmed 48737 records to 33667 (keeping 200 days of data) [2025-10-22T21:44:14.542975] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-10-22T21:44:14.698354] [DEBUG] [LOCAL ] VAC: Primary data saved (33667 records). [2025-10-22T21:44:14.698491] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-22T21:44:14.698567] [INFO ] [MAIN ] Update Progress: 2210/2367 symbols completed. VAC took 29.1s. Estimated remaining: 20m 11s. Rate: 7.8 symbols/min [2025-10-22T21:44:14.864868] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:44:14.873935] [DEBUG] [LOCAL ] VBF: Loaded 7245 existing records from primary storage. [2025-10-22T21:44:14.874113] [INFO ] [MAIN ] VBF: Loaded 7245 existing records. [2025-10-22T21:44:15.048987] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:44:15.049194] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-22T21:44:15.049245] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-22T21:44:15.049402] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-22T21:44:15.049455] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-22T21:44:15.317930] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-10-22T21:44:15.395479] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:44:15.705722] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T21:44:16.117616] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-10-22T21:44:16.308742] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T21:44:16.405897] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-22T21:44:16.917685] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-10-22T21:44:17.717720] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-10-22T21:44:18.237197] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-22T21:44:18.297686] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-22T21:44:18.517751] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-10-22T21:44:19.100297] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-22T21:44:19.317670] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-10-22T21:44:19.326465] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T21:44:20.117681] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-10-22T21:44:20.185189] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-22T21:44:20.917684] [INFO ] [REMOTE ] V: Fetching primary data for 2025-10. [2025-10-22T21:44:21.677017] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-22T21:44:21.686526] [INFO ] [REMOTE ] V: Full fetch complete (77927 records). [2025-10-22T21:44:21.686711] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-22T21:44:21.724302] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-10-22T21:44:22.118138] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-22T21:44:22.118271] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-22T21:44:22.119513] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-22T21:44:22.119595] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-22T21:44:22.121242] [DEBUG] [LOCAL ] V: Trimmed 77927 records to 53751 (keeping 200 days of data) [2025-10-22T21:44:22.267357] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-22T21:44:22.496381] [DEBUG] [LOCAL ] V: Primary data saved (53751 records). [2025-10-22T21:44:22.496574] [INFO ] [MAIN ] V: Full history saved. [2025-10-22T21:44:22.497281] [INFO ] [MAIN ] Update Progress: 2211/2367 symbols completed. V took 46.9s. Estimated remaining: 20m 4s. Rate: 7.8 symbols/min [2025-10-22T21:44:22.527682] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-10-22T21:44:22.606025] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-22T21:44:22.676664] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:44:22.691686] [DEBUG] [LOCAL ] VCV: Loaded 13321 existing records from primary storage. [2025-10-22T21:44:22.691959] [INFO ] [MAIN ] VCV: Loaded 13321 existing records. [2025-10-22T21:44:22.870405] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:44:22.870594] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-22T21:44:22.870639] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-22T21:44:22.870830] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-10-22T21:44:22.870869] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-22T21:44:23.224589] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:44:23.317628] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-10-22T21:44:23.346545] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T21:44:24.118261] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-10-22T21:44:24.120239] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-22T21:44:24.844150] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-22T21:44:24.917672] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-10-22T21:44:25.556188] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T21:44:25.717624] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-10-22T21:44:26.520300] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-10-22T21:44:26.522907] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T21:44:27.109507] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-22T21:44:27.317627] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-10-22T21:44:28.118148] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-10-22T21:44:28.119287] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-22T21:44:28.690850] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-22T21:44:28.917690] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-10-22T21:44:29.511504] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-22T21:44:29.717683] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-10-22T21:44:30.389257] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-22T21:44:30.517616] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-10-22T21:44:31.317701] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-10-22T21:44:31.959075] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-22T21:44:32.117665] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-10-22T21:44:32.498235] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-22T21:44:32.765771] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-22T21:44:32.917670] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-10-22T21:44:33.348733] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-22T21:44:33.717667] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-10. [2025-10-22T21:44:34.337394] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-22T21:44:34.339121] [INFO ] [REMOTE ] VATE: Full fetch complete (10636 records). [2025-10-22T21:44:34.339192] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-22T21:44:34.528511] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-10-22T21:44:34.721050] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-22T21:44:34.721133] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-22T21:44:34.721526] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-22T21:44:34.721591] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-22T21:44:34.722144] [DEBUG] [LOCAL ] VATE: Trimmed 10636 records to 5039 (keeping 200 days of data) [2025-10-22T21:44:34.750920] [DEBUG] [LOCAL ] VATE: Primary data saved (5039 records). [2025-10-22T21:44:34.751057] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-22T21:44:34.751136] [INFO ] [MAIN ] Update Progress: 2212/2367 symbols completed. VATE took 22.7s. Estimated remaining: 19m 56s. Rate: 7.8 symbols/min [2025-10-22T21:44:34.936541] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:44:35.001162] [DEBUG] [LOCAL ] VEEV: Loaded 47200 existing records from primary storage. [2025-10-22T21:44:35.001621] [INFO ] [MAIN ] VEEV: Loaded 47200 existing records. [2025-10-22T21:44:35.285714] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:44:35.286091] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-22T21:44:35.286176] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-22T21:44:35.286571] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-22T21:44:35.296074] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-22T21:44:35.299129] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-22T21:44:35.322918] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-10-22T21:44:35.812693] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:44:36.117669] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-10. [2025-10-22T21:44:36.168482] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-22T21:44:36.917703] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-10-22T21:44:37.644559] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-22T21:44:37.717625] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-10-22T21:44:37.972873] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T21:44:37.981814] [INFO ] [REMOTE ] VALE: Full fetch complete (77873 records). [2025-10-22T21:44:37.981969] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-22T21:44:38.375001] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-22T21:44:38.375126] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-22T21:44:38.376321] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-22T21:44:38.376407] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-22T21:44:38.386270] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-22T21:44:38.390585] [DEBUG] [LOCAL ] VALE: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-22T21:44:38.563054] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-10-22T21:44:38.718539] [DEBUG] [LOCAL ] VALE: Primary data saved (53693 records). [2025-10-22T21:44:38.718697] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-22T21:44:38.718786] [INFO ] [MAIN ] Update Progress: 2213/2367 symbols completed. VALE took 49.4s. Estimated remaining: 19m 48s. Rate: 7.8 symbols/min [2025-10-22T21:44:38.889482] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:44:38.902079] [DEBUG] [LOCAL ] VEL: Loaded 11980 existing records from primary storage. [2025-10-22T21:44:38.902258] [INFO ] [MAIN ] VEL: Loaded 11980 existing records. [2025-10-22T21:44:39.075617] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:44:39.075877] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-22T21:44:39.075938] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-22T21:44:39.076103] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-22T21:44:39.076158] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-22T21:44:39.323894] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-10. [2025-10-22T21:44:39.426837] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:44:40.117632] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-10-22T21:44:40.147182] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-22T21:44:40.149523] [INFO ] [REMOTE ] VBF: Full fetch complete (10939 records). [2025-10-22T21:44:40.149599] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-22T21:44:40.468751] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-22T21:44:40.550778] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-22T21:44:40.550852] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-22T21:44:40.551100] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-22T21:44:40.551139] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-22T21:44:40.551568] [DEBUG] [LOCAL ] VBF: Trimmed 10939 records to 7200 (keeping 200 days of data) [2025-10-22T21:44:40.593716] [DEBUG] [LOCAL ] VBF: Primary data saved (7200 records). [2025-10-22T21:44:40.593828] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-22T21:44:40.593900] [INFO ] [MAIN ] Update Progress: 2214/2367 symbols completed. VBF took 25.9s. Estimated remaining: 19m 40s. Rate: 7.8 symbols/min [2025-10-22T21:44:40.765692] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:44:40.804557] [DEBUG] [LOCAL ] VET: Loaded 44150 existing records from primary storage. [2025-10-22T21:44:40.804887] [INFO ] [MAIN ] VET: Loaded 44150 existing records. [2025-10-22T21:44:40.884414] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-22T21:44:40.922760] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-10-22T21:44:40.992421] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:44:40.992614] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-22T21:44:40.992689] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-22T21:44:40.992879] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-22T21:44:40.992922] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-22T21:44:41.349384] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:44:41.717632] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-10-22T21:44:41.819080] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-22T21:44:42.362391] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-22T21:44:42.517672] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-10-22T21:44:43.317625] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-10-22T21:44:43.488685] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-22T21:44:43.996474] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-22T21:44:44.117722] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-10-22T21:44:44.917684] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-10-22T21:44:45.011432] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-22T21:44:45.717676] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-10-22T21:44:46.504086] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-22T21:44:46.517637] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-10-22T21:44:46.623673] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-22T21:44:47.317745] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-10-22T21:44:48.041270] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T21:44:48.117627] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-10-22T21:44:48.917668] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-10-22T21:44:48.957109] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T21:44:49.042514] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-22T21:44:49.717699] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-10-22T21:44:49.746498] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-22T21:44:50.517682] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-10-22T21:44:51.317726] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-10-22T21:44:51.459179] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-22T21:44:52.117694] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-10. [2025-10-22T21:44:52.284479] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-22T21:44:52.290811] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-22T21:44:52.817622] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-22T21:44:52.819847] [INFO ] [REMOTE ] VCV: Full fetch complete (18396 records). [2025-10-22T21:44:52.819934] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-22T21:44:52.922849] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-10-22T21:44:53.210225] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-22T21:44:53.210339] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-22T21:44:53.211113] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-22T21:44:53.211180] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-22T21:44:53.212040] [DEBUG] [LOCAL ] VCV: Trimmed 18396 records to 13198 (keeping 200 days of data) [2025-10-22T21:44:53.307006] [DEBUG] [LOCAL ] VCV: Primary data saved (13198 records). [2025-10-22T21:44:53.307371] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-22T21:44:53.307528] [INFO ] [MAIN ] Update Progress: 2215/2367 symbols completed. VCV took 30.8s. Estimated remaining: 19m 33s. Rate: 7.8 symbols/min [2025-10-22T21:44:53.497133] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:44:53.551194] [DEBUG] [LOCAL ] VFC: Loaded 53607 existing records from primary storage. [2025-10-22T21:44:53.551631] [INFO ] [MAIN ] VFC: Loaded 53607 existing records. [2025-10-22T21:44:53.722940] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-10-22T21:44:53.779242] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:44:53.787064] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-22T21:44:53.787182] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-22T21:44:53.788207] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-22T21:44:53.788138] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T21:44:53.788431] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-22T21:44:54.169813] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:44:54.517681] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-10-22T21:44:55.317704] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-10-22T21:44:55.553858] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T21:44:56.117725] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-10-22T21:44:56.202240] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T21:44:56.202668] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T21:44:56.917698] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-10-22T21:44:57.717750] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-10-22T21:44:57.735105] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-22T21:44:57.946585] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-22T21:44:58.517712] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-10-22T21:44:59.317631] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-10-22T21:44:59.410120] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T21:45:00.117634] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-10-22T21:45:00.180177] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T21:45:00.917636] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-10-22T21:45:01.035098] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T21:45:01.717694] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-10-22T21:45:02.371592] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-22T21:45:02.517638] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-10-22T21:45:02.806835] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-22T21:45:03.317633] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-10-22T21:45:03.489343] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T21:45:04.117742] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-10-22T21:45:04.415453] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T21:45:04.917690] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-10-22T21:45:04.920673] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-22T21:45:05.717695] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-10. [2025-10-22T21:45:06.227366] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-22T21:45:06.517667] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-10-22T21:45:06.753718] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-22T21:45:06.772287] [INFO ] [REMOTE ] VEL: Full fetch complete (17184 records). [2025-10-22T21:45:06.772515] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-22T21:45:06.774212] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-22T21:45:07.141890] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-22T21:45:07.141967] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-22T21:45:07.142323] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-22T21:45:07.142362] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-22T21:45:07.142898] [DEBUG] [LOCAL ] VEL: Trimmed 17184 records to 11927 (keeping 200 days of data) [2025-10-22T21:45:07.209183] [DEBUG] [LOCAL ] VEL: Primary data saved (11927 records). [2025-10-22T21:45:07.209305] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-22T21:45:07.209382] [INFO ] [MAIN ] Update Progress: 2216/2367 symbols completed. VEL took 28.5s. Estimated remaining: 19m 25s. Rate: 7.8 symbols/min [2025-10-22T21:45:07.322828] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-10-22T21:45:07.376735] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:45:07.377310] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-22T21:45:07.377397] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-22T21:45:07.377580] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-22T21:45:07.377622] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-22T21:45:07.377704] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-22T21:45:07.377749] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-22T21:45:07.720155] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:45:08.117700] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-10-22T21:45:08.561850] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-22T21:45:08.917637] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-10-22T21:45:09.116111] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-22T21:45:09.629998] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T21:45:09.717677] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-01. [2025-10-22T21:45:10.484926] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T21:45:10.517619] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-10-22T21:45:10.698108] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-22T21:45:11.317698] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-02. [2025-10-22T21:45:12.117689] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-10. [2025-10-22T21:45:12.466410] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T21:45:12.917629] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-10-22T21:45:13.289502] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-22T21:45:13.715126] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-22T21:45:13.722525] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-10-22T21:45:13.724294] [INFO ] [REMOTE ] VEEV: Full fetch complete (68382 records). [2025-10-22T21:45:13.724383] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-22T21:45:14.173576] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-22T21:45:14.173708] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-22T21:45:14.174978] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-22T21:45:14.175046] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-22T21:45:14.176544] [DEBUG] [LOCAL ] VEEV: Trimmed 68382 records to 47109 (keeping 200 days of data) [2025-10-22T21:45:14.462799] [DEBUG] [LOCAL ] VEEV: Primary data saved (47109 records). [2025-10-22T21:45:14.462970] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-22T21:45:14.463077] [INFO ] [MAIN ] Update Progress: 2217/2367 symbols completed. VEEV took 39.7s. Estimated remaining: 19m 18s. Rate: 7.8 symbols/min [2025-10-22T21:45:14.531035] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-03. [2025-10-22T21:45:14.636200] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:45:14.671635] [DEBUG] [LOCAL ] VGI: Loaded 5225 existing records from primary storage. [2025-10-22T21:45:14.671907] [INFO ] [MAIN ] VGI: Loaded 5225 existing records. [2025-10-22T21:45:14.707044] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T21:45:14.873551] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:45:14.873827] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-22T21:45:14.873876] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-22T21:45:14.874013] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-22T21:45:14.874050] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-22T21:45:15.229313] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:45:15.313020] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T21:45:15.321868] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-10-22T21:45:15.934206] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-22T21:45:16.117696] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-10-22T21:45:16.609184] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-22T21:45:16.917680] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-10-22T21:45:17.709930] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-22T21:45:17.718771] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-04. [2025-10-22T21:45:18.422784] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T21:45:18.517638] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-10-22T21:45:19.205485] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-22T21:45:19.317609] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-10-22T21:45:19.802157] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-22T21:45:19.935475] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T21:45:20.120637] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-10. [2025-10-22T21:45:20.917683] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-05. [2025-10-22T21:45:21.717634] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-10. [2025-10-22T21:45:21.978611] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T21:45:21.988228] [INFO ] [REMOTE ] VFC: Full fetch complete (77749 records). [2025-10-22T21:45:21.988402] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-22T21:45:22.385740] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-22T21:45:22.385822] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-22T21:45:22.386960] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-22T21:45:22.387025] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-22T21:45:22.388420] [DEBUG] [LOCAL ] VFC: Trimmed 77749 records to 53607 (keeping 200 days of data) [2025-10-22T21:45:22.566786] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-10-22T21:45:22.737420] [DEBUG] [LOCAL ] VFC: Primary data saved (53607 records). [2025-10-22T21:45:22.737597] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-22T21:45:22.738364] [INFO ] [MAIN ] Update Progress: 2218/2367 symbols completed. VFC took 29.4s. Estimated remaining: 19m 10s. Rate: 7.8 symbols/min [2025-10-22T21:45:22.916809] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:45:22.936210] [DEBUG] [LOCAL ] VGM: Loaded 18689 existing records from primary storage. [2025-10-22T21:45:22.936542] [INFO ] [MAIN ] VGM: Loaded 18689 existing records. [2025-10-22T21:45:23.115474] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:45:23.115893] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-22T21:45:23.116035] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-22T21:45:23.116261] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-22T21:45:23.116309] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-22T21:45:23.427479] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-22T21:45:23.428358] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-22T21:45:23.450828] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-10-22T21:45:23.550456] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:45:23.553035] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T21:45:23.561179] [INFO ] [REMOTE ] VET: Full fetch complete (64515 records). [2025-10-22T21:45:23.561270] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-22T21:45:23.941995] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-22T21:45:23.942080] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-22T21:45:23.943223] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-22T21:45:23.943288] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-22T21:45:23.944587] [DEBUG] [LOCAL ] VET: Trimmed 64515 records to 44082 (keeping 200 days of data) [2025-10-22T21:45:24.122628] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-06. [2025-10-22T21:45:24.162202] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-22T21:45:24.214632] [DEBUG] [LOCAL ] VET: Primary data saved (44082 records). [2025-10-22T21:45:24.214786] [INFO ] [MAIN ] VET: Full history saved. [2025-10-22T21:45:24.214865] [INFO ] [MAIN ] Update Progress: 2219/2367 symbols completed. VET took 43.6s. Estimated remaining: 19m 2s. Rate: 7.8 symbols/min [2025-10-22T21:45:24.382825] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:45:24.386825] [DEBUG] [LOCAL ] VHI: Loaded 2711 existing records from primary storage. [2025-10-22T21:45:24.386974] [INFO ] [MAIN ] VHI: Loaded 2711 existing records. [2025-10-22T21:45:24.561177] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:45:24.561400] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-22T21:45:24.561455] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-22T21:45:24.561580] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-22T21:45:24.561616] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-22T21:45:24.906204] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:45:24.917609] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-10-22T21:45:25.547084] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-22T21:45:25.717687] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-10-22T21:45:26.092341] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-22T21:45:26.517752] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-07. [2025-10-22T21:45:26.635950] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T21:45:27.317728] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-10-22T21:45:27.852541] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-22T21:45:28.117724] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-10-22T21:45:28.667851] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-22T21:45:28.917681] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-08. [2025-10-22T21:45:29.210992] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T21:45:29.717722] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-10-22T21:45:30.351990] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-22T21:45:30.517696] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-10-22T21:45:30.925676] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-22T21:45:30.959271] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-22T21:45:31.317723] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-10-22T21:45:31.916598] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-22T21:45:32.117672] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-10-22T21:45:32.599586] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-22T21:45:32.917715] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-10-22T21:45:33.385882] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-22T21:45:33.717722] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-10-22T21:45:34.334215] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-22T21:45:34.517692] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-10-22T21:45:35.069507] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-22T21:45:35.317702] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-10-22T21:45:36.056561] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-22T21:45:36.117630] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-10. [2025-10-22T21:45:36.790551] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-22T21:45:36.791858] [INFO ] [REMOTE ] VGI: Full fetch complete (7570 records). [2025-10-22T21:45:36.791926] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-22T21:45:36.922780] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-09. [2025-10-22T21:45:37.161178] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-22T21:45:37.161251] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-22T21:45:37.161458] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-22T21:45:37.161498] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-22T21:45:37.161913] [DEBUG] [LOCAL ] VGI: Trimmed 7570 records to 5213 (keeping 200 days of data) [2025-10-22T21:45:37.190590] [DEBUG] [LOCAL ] VGI: Primary data saved (5213 records). [2025-10-22T21:45:37.190687] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-22T21:45:37.190771] [INFO ] [MAIN ] Update Progress: 2220/2367 symbols completed. VGI took 22.7s. Estimated remaining: 18m 54s. Rate: 7.8 symbols/min [2025-10-22T21:45:37.360619] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:45:37.360816] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-22T21:45:37.360858] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-22T21:45:37.360969] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-22T21:45:37.361010] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-22T21:45:37.361054] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-22T21:45:37.361089] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-22T21:45:37.722929] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-10-22T21:45:37.757895] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:45:38.517681] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-10-22T21:45:38.707769] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-22T21:45:38.950126] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-22T21:45:39.081125] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-22T21:45:39.317681] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-10-22T21:45:40.117692] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-10-22T21:45:40.304807] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T21:45:40.615585] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-22T21:45:40.917689] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-10-22T21:45:41.448006] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-22T21:45:41.717710] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-10. [2025-10-22T21:45:42.517724] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-10-22T21:45:43.317713] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-10. [2025-10-22T21:45:43.552155] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-22T21:45:43.719334] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-22T21:45:43.731803] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-22T21:45:43.733533] [INFO ] [REMOTE ] VG: Full fetch complete (72688 records). [2025-10-22T21:45:43.733444] [INFO ] [REMOTE ] VHI: Full fetch complete (4326 records). [2025-10-22T21:45:43.733727] [DEBUG] [VALIDATOR ] VG: Validating primary data. [2025-10-22T21:45:43.733780] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-22T21:45:44.136158] [WARN ] [VALIDATOR ] VG: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-22T21:45:44.136260] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-10-22T21:45:44.137253] [FATAL] [MAIN ] VG: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:45:44.166288] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:45:44.237336] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-22T21:45:44.247997] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-22T21:45:44.258561] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-22T21:45:44.268946] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-22T21:45:44.291742] [INFO ] [MAIN ] Update Progress: 2221/2367 symbols completed. VG took 37.1s. Estimated remaining: 18m 47s. Rate: 7.8 symbols/min [2025-10-22T21:45:44.412421] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-22T21:45:44.431586] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-22T21:45:44.434412] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-22T21:45:44.434517] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-22T21:45:44.441016] [DEBUG] [LOCAL ] VHI: Trimmed 4326 records to 2673 (keeping 200 days of data) [2025-10-22T21:45:44.522316] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:45:44.526683] [DEBUG] [LOCAL ] VHI: Primary data saved (2673 records). [2025-10-22T21:45:44.526875] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-22T21:45:44.526981] [INFO ] [MAIN ] Update Progress: 2222/2367 symbols completed. VHI took 20.3s. Estimated remaining: 18m 38s. Rate: 7.8 symbols/min [2025-10-22T21:45:44.708562] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:45:44.747400] [DEBUG] [LOCAL ] VICI: Loaded 53653 existing records from primary storage. [2025-10-22T21:45:44.748024] [INFO ] [MAIN ] VICI: Loaded 53653 existing records. [2025-10-22T21:45:44.950868] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:45:44.919609] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-01. [2025-10-22T21:45:44.951301] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-22T21:45:44.952147] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-22T21:45:44.969997] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-22T21:45:44.970185] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-22T21:45:44.976187] [DEBUG] [LOCAL ] VIK: Loaded 52374 existing records from primary storage. [2025-10-22T21:45:44.992926] [INFO ] [MAIN ] VIK: Loaded 52374 existing records. [2025-10-22T21:45:45.267687] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:45:45.309597] [WARN ] [REMOTE ] VIA: No data returned for month 2025-01 [2025-10-22T21:45:45.312943] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:45:45.369270] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:45:45.313119] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-22T21:45:45.379929] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-22T21:45:45.395020] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-22T21:45:45.395113] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:45:45.420455] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-22T21:45:45.420384] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-22T21:45:45.431113] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-22T21:45:45.441794] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-22T21:45:45.500160] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T21:45:45.468601] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-22T21:45:45.500991] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-22T21:45:45.546849] [INFO ] [MAIN ] Update Progress: 2223/2367 symbols completed. VIA took 8.4s. Estimated remaining: 18m 30s. Rate: 7.8 symbols/min [2025-10-22T21:45:45.755542] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-10-22T21:45:45.774601] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:45:46.001189] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:45:46.089211] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:45:46.127139] [DEBUG] [LOCAL ] VIPS: Loaded 51260 existing records from primary storage. [2025-10-22T21:45:46.127428] [INFO ] [MAIN ] VIPS: Loaded 51260 existing records. [2025-10-22T21:45:46.299494] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:45:46.299702] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-22T21:45:46.299759] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-22T21:45:46.300022] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-10-22T21:45:46.300058] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-22T21:45:46.525197] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-10-22T21:45:46.647910] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:45:46.884864] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-22T21:45:47.317700] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-10-22T21:45:48.117697] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-10-22T21:45:48.245203] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-22T21:45:48.917631] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-10-22T21:45:48.997254] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T21:45:49.102559] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-22T21:45:49.717732] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-10-22T21:45:50.517667] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-10-22T21:45:50.602171] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T21:45:50.757201] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T21:45:51.317698] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-10. [2025-10-22T21:45:52.117633] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-10-22T21:45:52.337403] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T21:45:52.341026] [INFO ] [REMOTE ] VGM: Full fetch complete (25775 records). [2025-10-22T21:45:52.341111] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-22T21:45:52.728318] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-22T21:45:52.728435] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-22T21:45:52.729143] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-22T21:45:52.729385] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-22T21:45:52.730563] [DEBUG] [LOCAL ] VGM: Trimmed 25775 records to 18643 (keeping 200 days of data) [2025-10-22T21:45:52.849085] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-22T21:45:52.892087] [DEBUG] [LOCAL ] VGM: Primary data saved (18643 records). [2025-10-22T21:45:52.892228] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-22T21:45:52.892312] [INFO ] [MAIN ] Update Progress: 2224/2367 symbols completed. VGM took 30.2s. Estimated remaining: 18m 23s. Rate: 7.8 symbols/min [2025-10-22T21:45:52.924379] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-10-22T21:45:53.084891] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:45:53.128147] [DEBUG] [LOCAL ] VIRT: Loaded 46483 existing records from primary storage. [2025-10-22T21:45:53.128465] [INFO ] [MAIN ] VIRT: Loaded 46483 existing records. [2025-10-22T21:45:53.320058] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:45:53.320323] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-22T21:45:53.320372] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-22T21:45:53.320622] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-10-22T21:45:53.320717] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-22T21:45:53.711833] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:45:53.717614] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-10-22T21:45:53.931853] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-22T21:45:54.517632] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-10-22T21:45:54.861766] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-22T21:45:55.297089] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-22T21:45:55.317664] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-10-22T21:45:56.117679] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-10-22T21:45:56.205496] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T21:45:56.917732] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-10-22T21:45:57.348064] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-22T21:45:57.717714] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-10-22T21:45:57.752877] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T21:45:58.517741] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-10-22T21:45:58.675864] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-22T21:45:59.317675] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-10-22T21:45:59.743942] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-22T21:46:00.117673] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-10-22T21:46:00.287252] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-22T21:46:00.924542] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-10-22T21:46:00.930866] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T21:46:01.717733] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-10-22T21:46:01.861722] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T21:46:02.517701] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-10-22T21:46:03.015873] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-22T21:46:03.059300] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T21:46:03.317691] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-10-22T21:46:04.117635] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-10-22T21:46:04.232155] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T21:46:04.917622] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-10-22T21:46:05.092907] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T21:46:05.717631] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-10-22T21:46:05.942813] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-22T21:46:06.517744] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-10-22T21:46:06.555967] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T21:46:07.128726] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-22T21:46:07.317720] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-10-22T21:46:08.117756] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-10-22T21:46:08.876451] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-22T21:46:08.908970] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-22T21:46:08.920074] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-10-22T21:46:09.717680] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-10-22T21:46:09.977297] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T21:46:10.517639] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-10-22T21:46:10.605325] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T21:46:11.317706] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-10-22T21:46:11.384080] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T21:46:12.117683] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-10-22T21:46:12.359066] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T21:46:12.917689] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-10-22T21:46:13.320156] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-22T21:46:13.712207] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T21:46:13.721312] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-10-22T21:46:14.517675] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-10-22T21:46:14.622042] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-22T21:46:15.317632] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-10-22T21:46:15.492844] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-22T21:46:16.117712] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-10. [2025-10-22T21:46:16.173390] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T21:46:16.605675] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-22T21:46:16.917751] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-10. [2025-10-22T21:46:17.717633] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-10-22T21:46:17.900882] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-22T21:46:17.909550] [INFO ] [REMOTE ] VIK: Full fetch complete (75969 records). [2025-10-22T21:46:17.909752] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-22T21:46:18.309448] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-22T21:46:18.309577] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-22T21:46:18.310990] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-22T21:46:18.311133] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-22T21:46:18.312632] [DEBUG] [LOCAL ] VIK: Trimmed 75969 records to 52371 (keeping 200 days of data) [2025-10-22T21:46:18.538789] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-10-22T21:46:18.546789] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-22T21:46:18.569108] [INFO ] [REMOTE ] VIRT: Full fetch complete (67570 records). [2025-10-22T21:46:18.573701] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-22T21:46:18.959991] [DEBUG] [LOCAL ] VIK: Primary data saved (52371 records). [2025-10-22T21:46:18.972374] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-22T21:46:18.978196] [INFO ] [MAIN ] Update Progress: 2225/2367 symbols completed. VIK took 34.5s. Estimated remaining: 18m 16s. Rate: 7.8 symbols/min [2025-10-22T21:46:19.108141] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-22T21:46:19.108299] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-22T21:46:19.114732] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-22T21:46:19.120033] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-22T21:46:19.193888] [DEBUG] [LOCAL ] VIRT: Trimmed 67570 records to 46460 (keeping 200 days of data) [2025-10-22T21:46:19.462522] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:46:19.526300] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-22T21:46:19.547966] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-10. [2025-10-22T21:46:19.752554] [DEBUG] [LOCAL ] VIST: Loaded 46653 existing records from primary storage. [2025-10-22T21:46:19.762119] [INFO ] [MAIN ] VIST: Loaded 46653 existing records. [2025-10-22T21:46:20.104207] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:46:20.113584] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-22T21:46:20.113811] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-22T21:46:20.113475] [DEBUG] [LOCAL ] VIRT: Primary data saved (46460 records). [2025-10-22T21:46:20.113999] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-22T21:46:20.115200] [INFO ] [MAIN ] Update Progress: 2226/2367 symbols completed. VIRT took 27.2s. Estimated remaining: 18m 8s. Rate: 7.8 symbols/min [2025-10-22T21:46:20.115315] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-22T21:46:20.115424] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-22T21:46:20.475013] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:46:20.721635] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:46:20.724035] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-22T21:46:20.724594] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-10-22T21:46:20.767229] [DEBUG] [LOCAL ] VIV: Loaded 44664 existing records from primary storage. [2025-10-22T21:46:20.767567] [INFO ] [MAIN ] VIV: Loaded 44664 existing records. [2025-10-22T21:46:20.932232] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-10. [2025-10-22T21:46:20.978838] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:46:20.979082] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-22T21:46:20.979132] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-22T21:46:20.979376] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-22T21:46:20.979415] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-22T21:46:21.395676] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:46:21.410500] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-22T21:46:21.419185] [INFO ] [REMOTE ] VIPS: Full fetch complete (74868 records). [2025-10-22T21:46:21.419346] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-22T21:46:21.722905] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-10-22T21:46:21.807861] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-22T21:46:21.807948] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-22T21:46:21.809123] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-22T21:46:21.809256] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-22T21:46:21.810719] [DEBUG] [LOCAL ] VIPS: Trimmed 74868 records to 51251 (keeping 200 days of data) [2025-10-22T21:46:22.122984] [DEBUG] [LOCAL ] VIPS: Primary data saved (51251 records). [2025-10-22T21:46:22.123123] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-22T21:46:22.123202] [INFO ] [MAIN ] Update Progress: 2227/2367 symbols completed. VIPS took 36.5s. Estimated remaining: 17m 60s. Rate: 7.8 symbols/min [2025-10-22T21:46:22.299263] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:46:22.316710] [DEBUG] [LOCAL ] VKQ: Loaded 17897 existing records from primary storage. [2025-10-22T21:46:22.316971] [INFO ] [MAIN ] VKQ: Loaded 17897 existing records. [2025-10-22T21:46:22.497438] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:46:22.498411] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-22T21:46:22.498718] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-22T21:46:22.499089] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-10-22T21:46:22.499217] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-22T21:46:22.658350] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-22T21:46:22.727081] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-10-22T21:46:22.957297] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:46:22.981960] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-22T21:46:22.993900] [INFO ] [REMOTE ] VICI: Full fetch complete (77803 records). [2025-10-22T21:46:22.994177] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-22T21:46:23.331740] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-10-22T21:46:23.445539] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-22T21:46:23.445848] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-22T21:46:23.447329] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-22T21:46:23.447435] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-22T21:46:23.476153] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T21:46:23.484806] [DEBUG] [LOCAL ] VICI: Trimmed 77803 records to 53653 (keeping 200 days of data) [2025-10-22T21:46:23.810893] [DEBUG] [LOCAL ] VICI: Primary data saved (53653 records). [2025-10-22T21:46:23.811039] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-22T21:46:23.811126] [INFO ] [MAIN ] Update Progress: 2228/2367 symbols completed. VICI took 39.5s. Estimated remaining: 17m 52s. Rate: 7.8 symbols/min [2025-10-22T21:46:23.982758] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:46:24.009808] [DEBUG] [LOCAL ] VLN: Loaded 30957 existing records from primary storage. [2025-10-22T21:46:24.010082] [INFO ] [MAIN ] VLN: Loaded 30957 existing records. [2025-10-22T21:46:24.122672] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-10-22T21:46:24.192281] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:46:24.202446] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-22T21:46:24.205201] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-22T21:46:24.205047] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-22T21:46:24.209284] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-22T21:46:24.209383] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-22T21:46:24.403244] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-22T21:46:24.648864] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:46:24.917687] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-10-22T21:46:25.586410] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-22T21:46:25.717626] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-10-22T21:46:26.403582] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T21:46:26.517736] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-10-22T21:46:27.260054] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-22T21:46:27.317676] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-10-22T21:46:27.440154] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-22T21:46:28.117700] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-10-22T21:46:28.917710] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-10-22T21:46:29.051227] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T21:46:29.717612] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-10-22T21:46:29.811335] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T21:46:30.096610] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T21:46:30.517681] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-10-22T21:46:31.239710] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-22T21:46:31.317620] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-10-22T21:46:31.396576] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T21:46:32.121415] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-10-22T21:46:32.123200] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-22T21:46:32.917732] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-10-22T21:46:33.717632] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-10-22T21:46:33.802461] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T21:46:34.528980] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-10-22T21:46:34.534741] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T21:46:34.657686] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-22T21:46:35.317685] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-10-22T21:46:36.092379] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T21:46:36.117618] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-10-22T21:46:36.297023] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-22T21:46:36.917686] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-10-22T21:46:37.384882] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-22T21:46:37.717634] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-10-22T21:46:37.959428] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T21:46:38.517698] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-10-22T21:46:39.303312] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-22T21:46:39.317623] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-10-22T21:46:39.360891] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-22T21:46:40.117683] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-10-22T21:46:40.913364] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T21:46:40.922046] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-10-22T21:46:41.342287] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T21:46:41.717669] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-10-22T21:46:42.517630] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-10-22T21:46:42.561947] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T21:46:42.760336] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-22T21:46:43.317751] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-10-22T21:46:43.990802] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-22T21:46:44.117710] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-10-22T21:46:44.367061] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T21:46:44.917639] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-10-22T21:46:45.210471] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T21:46:45.717723] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-10. [2025-10-22T21:46:46.449379] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T21:46:46.517629] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-10-22T21:46:47.204460] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T21:46:47.211756] [INFO ] [REMOTE ] VIV: Full fetch complete (64373 records). [2025-10-22T21:46:47.211911] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-22T21:46:47.318733] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-10-22T21:46:47.619565] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-22T21:46:47.619689] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-22T21:46:47.620923] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-22T21:46:47.621002] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-22T21:46:47.622362] [DEBUG] [LOCAL ] VIV: Trimmed 64373 records to 44584 (keeping 200 days of data) [2025-10-22T21:46:47.890017] [DEBUG] [LOCAL ] VIV: Primary data saved (44584 records). [2025-10-22T21:46:47.890139] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-22T21:46:47.890713] [INFO ] [MAIN ] Update Progress: 2229/2367 symbols completed. VIV took 27.8s. Estimated remaining: 17m 45s. Rate: 7.8 symbols/min [2025-10-22T21:46:48.058776] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:46:48.111524] [DEBUG] [LOCAL ] VLO: Loaded 52963 existing records from primary storage. [2025-10-22T21:46:48.111874] [INFO ] [MAIN ] VLO: Loaded 52963 existing records. [2025-10-22T21:46:48.142988] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-10-22T21:46:48.306236] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:46:48.306723] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-22T21:46:48.306856] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-22T21:46:48.307105] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-22T21:46:48.307231] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-22T21:46:48.538975] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-22T21:46:48.598369] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-22T21:46:48.724515] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:46:48.917610] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-10-22T21:46:49.336490] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-22T21:46:49.717631] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-10. [2025-10-22T21:46:50.517669] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-10-22T21:46:50.822501] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-22T21:46:51.317918] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-10. [2025-10-22T21:46:51.317862] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-22T21:46:51.327115] [INFO ] [REMOTE ] VIST: Full fetch complete (67467 records). [2025-10-22T21:46:51.327260] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-22T21:46:51.726773] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-22T21:46:51.726855] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-22T21:46:51.727992] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-22T21:46:51.728065] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-22T21:46:51.729549] [DEBUG] [LOCAL ] VIST: Trimmed 67467 records to 46640 (keeping 200 days of data) [2025-10-22T21:46:51.995516] [DEBUG] [LOCAL ] VIST: Primary data saved (46640 records). [2025-10-22T21:46:51.995755] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-22T21:46:51.995855] [INFO ] [MAIN ] Update Progress: 2230/2367 symbols completed. VIST took 33.0s. Estimated remaining: 17m 37s. Rate: 7.8 symbols/min [2025-10-22T21:46:52.122128] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-10-22T21:46:52.192120] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:46:52.198357] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-22T21:46:52.240970] [DEBUG] [LOCAL ] VLRS: Loaded 39297 existing records from primary storage. [2025-10-22T21:46:52.241248] [INFO ] [MAIN ] VLRS: Loaded 39297 existing records. [2025-10-22T21:46:52.419975] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:46:52.427954] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-22T21:46:52.428039] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-22T21:46:52.433617] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-22T21:46:52.433721] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-22T21:46:52.466993] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-22T21:46:52.544999] [INFO ] [REMOTE ] VKQ: Full fetch complete (24592 records). [2025-10-22T21:46:52.550082] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-22T21:46:52.921018] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-10-22T21:46:53.077270] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:46:53.232082] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-22T21:46:53.232163] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-22T21:46:53.232768] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-22T21:46:53.232832] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-22T21:46:53.233519] [DEBUG] [LOCAL ] VKQ: Trimmed 24592 records to 17853 (keeping 200 days of data) [2025-10-22T21:46:53.340795] [DEBUG] [LOCAL ] VKQ: Primary data saved (17853 records). [2025-10-22T21:46:53.340969] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-22T21:46:53.341075] [INFO ] [MAIN ] Update Progress: 2231/2367 symbols completed. VKQ took 31.2s. Estimated remaining: 17m 29s. Rate: 7.8 symbols/min [2025-10-22T21:46:53.522383] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:46:53.528936] [DEBUG] [LOCAL ] VLT: Loaded 4344 existing records from primary storage. [2025-10-22T21:46:53.529132] [INFO ] [MAIN ] VLT: Loaded 4344 existing records. [2025-10-22T21:46:53.718785] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:46:53.719375] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-22T21:46:53.718925] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-10-22T21:46:53.719799] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-22T21:46:53.721023] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-22T21:46:53.721077] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-22T21:46:54.102766] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:46:54.129313] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-22T21:46:54.433864] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T21:46:54.517668] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-10. [2025-10-22T21:46:54.797987] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T21:46:55.317701] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-10-22T21:46:55.964833] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T21:46:55.971548] [INFO ] [REMOTE ] VLN: Full fetch complete (43329 records). [2025-10-22T21:46:55.971704] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-22T21:46:56.141812] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-10-22T21:46:56.340681] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-22T21:46:56.340764] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-22T21:46:56.341609] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-22T21:46:56.341672] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-22T21:46:56.342510] [DEBUG] [LOCAL ] VLN: Trimmed 43329 records to 31057 (keeping 200 days of data) [2025-10-22T21:46:56.509552] [DEBUG] [LOCAL ] VLN: Primary data saved (31057 records). [2025-10-22T21:46:56.509708] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-22T21:46:56.509801] [INFO ] [MAIN ] Update Progress: 2232/2367 symbols completed. VLN took 32.7s. Estimated remaining: 17m 21s. Rate: 7.8 symbols/min [2025-10-22T21:46:56.678449] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:46:56.719251] [DEBUG] [LOCAL ] VLTO: Loaded 46100 existing records from primary storage. [2025-10-22T21:46:56.719544] [INFO ] [MAIN ] VLTO: Loaded 46100 existing records. [2025-10-22T21:46:56.894862] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:46:56.895171] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-22T21:46:56.895302] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-22T21:46:56.895548] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-22T21:46:56.895596] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-22T21:46:56.925759] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-10-22T21:46:57.189514] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T21:46:57.294305] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:46:57.315915] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-22T21:46:57.705349] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-22T21:46:57.717608] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-10-22T21:46:58.517716] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-10-22T21:46:59.322805] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-10-22T21:46:59.338316] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-22T21:47:00.117666] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-10-22T21:47:00.187977] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-22T21:47:00.778305] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-22T21:47:00.917618] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-10-22T21:47:01.314307] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T21:47:01.717626] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-10-22T21:47:02.463962] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T21:47:02.517620] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-10-22T21:47:03.170373] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-22T21:47:03.317718] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-10-22T21:47:03.453972] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T21:47:04.117740] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-10-22T21:47:04.781853] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-22T21:47:04.917627] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-10-22T21:47:05.004607] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T21:47:05.717750] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-10-22T21:47:06.517722] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-10-22T21:47:06.783843] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-22T21:47:06.864300] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T21:47:07.141911] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T21:47:07.317710] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-10-22T21:47:08.117714] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-10-22T21:47:08.917713] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-10-22T21:47:09.064799] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T21:47:09.518743] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-22T21:47:09.717710] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-10-22T21:47:10.011601] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-22T21:47:10.517734] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-10-22T21:47:11.213873] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-22T21:47:11.317691] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-10-22T21:47:11.945536] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-22T21:47:12.117705] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-10-22T21:47:12.286483] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-22T21:47:12.917667] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-10-22T21:47:13.503372] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-22T21:47:13.717710] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-10-22T21:47:13.904149] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T21:47:14.517701] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-10-22T21:47:15.158514] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-22T21:47:15.317679] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-10-22T21:47:16.117673] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-10-22T21:47:16.162176] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T21:47:16.822393] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-22T21:47:16.827374] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T21:47:16.917639] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-10. [2025-10-22T21:47:17.426464] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-22T21:47:17.428193] [INFO ] [REMOTE ] VLT: Full fetch complete (7453 records). [2025-10-22T21:47:17.428273] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-22T21:47:17.722864] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-10-22T21:47:17.826264] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-22T21:47:17.826369] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-22T21:47:17.826659] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-22T21:47:17.826726] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-22T21:47:17.827227] [DEBUG] [LOCAL ] VLT: Trimmed 7453 records to 4282 (keeping 200 days of data) [2025-10-22T21:47:17.854363] [DEBUG] [LOCAL ] VLT: Primary data saved (4282 records). [2025-10-22T21:47:17.854468] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-22T21:47:17.854567] [INFO ] [MAIN ] Update Progress: 2233/2367 symbols completed. VLT took 24.5s. Estimated remaining: 17m 14s. Rate: 7.8 symbols/min [2025-10-22T21:47:18.034106] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:47:18.075678] [DEBUG] [LOCAL ] VMC: Loaded 42258 existing records from primary storage. [2025-10-22T21:47:18.076090] [INFO ] [MAIN ] VMC: Loaded 42258 existing records. [2025-10-22T21:47:18.259827] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:47:18.260097] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-22T21:47:18.260146] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-22T21:47:18.260401] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-22T21:47:18.260439] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-22T21:47:18.526879] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-10. [2025-10-22T21:47:18.608598] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:47:19.260372] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-22T21:47:19.269101] [INFO ] [REMOTE ] VLO: Full fetch complete (76910 records). [2025-10-22T21:47:19.269238] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-22T21:47:19.331991] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-10-22T21:47:19.478591] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T21:47:19.701094] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-22T21:47:19.701185] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-22T21:47:19.702716] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-22T21:47:19.702822] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-22T21:47:19.704317] [DEBUG] [LOCAL ] VLO: Trimmed 76910 records to 52956 (keeping 200 days of data) [2025-10-22T21:47:20.023518] [DEBUG] [LOCAL ] VLO: Primary data saved (52956 records). [2025-10-22T21:47:20.023673] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-22T21:47:20.024357] [INFO ] [MAIN ] Update Progress: 2234/2367 symbols completed. VLO took 32.1s. Estimated remaining: 17m 6s. Rate: 7.8 symbols/min [2025-10-22T21:47:20.122208] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-10-22T21:47:20.190802] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:47:20.207360] [DEBUG] [LOCAL ] VMI: Loaded 14976 existing records from primary storage. [2025-10-22T21:47:20.207608] [INFO ] [MAIN ] VMI: Loaded 14976 existing records. [2025-10-22T21:47:20.386042] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:47:20.386267] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-22T21:47:20.386399] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-22T21:47:20.386590] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-22T21:47:20.386674] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-22T21:47:20.764044] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:47:20.776891] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T21:47:20.917679] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-10-22T21:47:21.723873] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-10-22T21:47:21.741898] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-22T21:47:21.840303] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-22T21:47:22.517756] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-10-22T21:47:23.248121] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T21:47:23.317696] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-10-22T21:47:24.120093] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-10. [2025-10-22T21:47:24.122438] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-22T21:47:24.167781] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-22T21:47:24.917743] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-10-22T21:47:25.395169] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T21:47:25.401106] [INFO ] [REMOTE ] VLRS: Full fetch complete (58258 records). [2025-10-22T21:47:25.401204] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-22T21:47:25.722758] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-10-22T21:47:25.819367] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-22T21:47:25.819466] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-22T21:47:25.820624] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-22T21:47:25.820712] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-22T21:47:25.822057] [DEBUG] [LOCAL ] VLRS: Trimmed 58258 records to 39240 (keeping 200 days of data) [2025-10-22T21:47:26.040269] [DEBUG] [LOCAL ] VLRS: Primary data saved (39240 records). [2025-10-22T21:47:26.040401] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-22T21:47:26.040480] [INFO ] [MAIN ] Update Progress: 2235/2367 symbols completed. VLRS took 34.0s. Estimated remaining: 16m 58s. Rate: 7.8 symbols/min [2025-10-22T21:47:26.211928] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:47:26.234736] [DEBUG] [LOCAL ] VMO: Loaded 20749 existing records from primary storage. [2025-10-22T21:47:26.234993] [INFO ] [MAIN ] VMO: Loaded 20749 existing records. [2025-10-22T21:47:26.413067] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:47:26.413267] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-22T21:47:26.413314] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-22T21:47:26.413475] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-10-22T21:47:26.413513] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-22T21:47:26.521699] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-10-22T21:47:26.778806] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:47:26.800795] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-22T21:47:26.821856] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-22T21:47:27.330324] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-10-22T21:47:27.333476] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T21:47:28.117719] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-10-22T21:47:28.346438] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-22T21:47:28.917665] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-10. [2025-10-22T21:47:29.307840] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-22T21:47:29.717732] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-10-22T21:47:30.518526] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-10-22T21:47:30.520254] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-22T21:47:30.530105] [INFO ] [REMOTE ] VLTO: Full fetch complete (67403 records). [2025-10-22T21:47:30.530291] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-22T21:47:30.935878] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-22T21:47:30.935992] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-22T21:47:30.937660] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-22T21:47:30.937740] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-22T21:47:30.939518] [DEBUG] [LOCAL ] VLTO: Trimmed 67403 records to 46055 (keeping 200 days of data) [2025-10-22T21:47:31.250938] [DEBUG] [LOCAL ] VLTO: Primary data saved (46055 records). [2025-10-22T21:47:31.251130] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-22T21:47:31.251235] [INFO ] [MAIN ] Update Progress: 2236/2367 symbols completed. VLTO took 34.7s. Estimated remaining: 16m 50s. Rate: 7.8 symbols/min [2025-10-22T21:47:31.319769] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-10-22T21:47:31.442682] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:47:31.468818] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-22T21:47:31.518742] [DEBUG] [LOCAL ] VNO: Loaded 48874 existing records from primary storage. [2025-10-22T21:47:31.519154] [INFO ] [MAIN ] VNO: Loaded 48874 existing records. [2025-10-22T21:47:31.706726] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:47:31.707151] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-22T21:47:31.707268] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-22T21:47:31.726574] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-22T21:47:31.726495] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T21:47:31.732463] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-22T21:47:32.120608] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:47:32.120687] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-10-22T21:47:32.314362] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-22T21:47:32.917717] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-10-22T21:47:33.717689] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-10-22T21:47:33.957163] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T21:47:34.207748] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-22T21:47:34.517749] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-10-22T21:47:35.273266] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-22T21:47:35.317614] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-10-22T21:47:36.117698] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-10-22T21:47:36.331368] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-22T21:47:36.905606] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T21:47:36.917605] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-10-22T21:47:36.963475] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-22T21:47:37.717755] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-10-22T21:47:38.517707] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-10-22T21:47:38.592261] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T21:47:38.647942] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-22T21:47:39.317710] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-10-22T21:47:39.644403] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-22T21:47:40.117769] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-10-22T21:47:40.287846] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-22T21:47:40.917723] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-10-22T21:47:41.705094] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T21:47:41.717600] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-10-22T21:47:41.964759] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-22T21:47:42.517792] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-10-22T21:47:43.232673] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T21:47:43.317668] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-10. [2025-10-22T21:47:43.742571] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T21:47:43.865380] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-22T21:47:43.868238] [INFO ] [REMOTE ] VMI: Full fetch complete (21428 records). [2025-10-22T21:47:43.868308] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-22T21:47:44.122920] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-10-22T21:47:44.233717] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-22T21:47:44.233796] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-22T21:47:44.234271] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-22T21:47:44.234331] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-22T21:47:44.234933] [DEBUG] [LOCAL ] VMI: Trimmed 21428 records to 14939 (keeping 200 days of data) [2025-10-22T21:47:44.326877] [DEBUG] [LOCAL ] VMI: Primary data saved (14939 records). [2025-10-22T21:47:44.327006] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-22T21:47:44.327082] [INFO ] [MAIN ] Update Progress: 2237/2367 symbols completed. VMI took 24.3s. Estimated remaining: 16m 43s. Rate: 7.8 symbols/min [2025-10-22T21:47:44.917741] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-10-22T21:47:45.717627] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-10-22T21:47:45.791470] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-22T21:47:46.101586] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T21:47:46.517702] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-10-22T21:47:46.715439] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-22T21:47:47.317676] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-10-22T21:47:48.067907] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T21:47:48.117610] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-10-22T21:47:48.380467] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-22T21:47:48.917729] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-10-22T21:47:49.698069] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T21:47:49.717618] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-10. [2025-10-22T21:47:50.325005] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-22T21:47:50.331951] [INFO ] [REMOTE ] VMC: Full fetch complete (62357 records). [2025-10-22T21:47:50.332117] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-22T21:47:50.529120] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-10-22T21:47:50.767600] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-22T21:47:50.768088] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-22T21:47:50.770772] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-22T21:47:50.772381] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-22T21:47:50.772252] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-22T21:47:50.785101] [DEBUG] [LOCAL ] VMC: Trimmed 62357 records to 42153 (keeping 200 days of data) [2025-10-22T21:47:51.072072] [DEBUG] [LOCAL ] VMC: Primary data saved (42153 records). [2025-10-22T21:47:51.072271] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-22T21:47:51.072387] [INFO ] [MAIN ] Update Progress: 2238/2367 symbols completed. VMC took 33.2s. Estimated remaining: 16m 35s. Rate: 7.8 symbols/min [2025-10-22T21:47:51.317688] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-10-22T21:47:51.648674] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-22T21:47:52.117681] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-10-22T21:47:52.951346] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-22T21:47:52.962824] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-10-22T21:47:53.001486] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-22T21:47:53.717757] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-10-22T21:47:54.457754] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T21:47:54.517712] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-10-22T21:47:54.926596] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-22T21:47:55.317745] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-10. [2025-10-22T21:47:55.943605] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-22T21:47:56.117729] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-10. [2025-10-22T21:47:56.306896] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-22T21:47:56.310575] [INFO ] [REMOTE ] VMO: Full fetch complete (30808 records). [2025-10-22T21:47:56.310734] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-22T21:47:56.670183] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-22T21:47:56.670260] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-22T21:47:56.670880] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-22T21:47:56.670942] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-22T21:47:56.671626] [DEBUG] [LOCAL ] VMO: Trimmed 30808 records to 20692 (keeping 200 days of data) [2025-10-22T21:47:56.797350] [DEBUG] [LOCAL ] VMO: Primary data saved (20692 records). [2025-10-22T21:47:56.797764] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-22T21:47:56.797858] [INFO ] [MAIN ] Update Progress: 2239/2367 symbols completed. VMO took 30.8s. Estimated remaining: 16m 27s. Rate: 7.8 symbols/min [2025-10-22T21:47:57.382688] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T21:47:57.390478] [INFO ] [REMOTE ] VNO: Full fetch complete (70555 records). [2025-10-22T21:47:57.390597] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-22T21:47:57.781171] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-22T21:47:57.781257] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-22T21:47:57.782397] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-22T21:47:57.782468] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-22T21:47:57.783789] [DEBUG] [LOCAL ] VNO: Trimmed 70555 records to 48826 (keeping 200 days of data) [2025-10-22T21:47:58.061403] [DEBUG] [LOCAL ] VNO: Primary data saved (48826 records). [2025-10-22T21:47:58.061535] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-22T21:47:58.061611] [INFO ] [MAIN ] Update Progress: 2240/2367 symbols completed. VNO took 26.8s. Estimated remaining: 16m 19s. Rate: 7.8 symbols/min [2025-10-22T21:47:58.699231] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:47:58.761414] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:47:58.756854] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:47:58.813714] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-22T21:47:58.815441] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-22T21:47:58.814991] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:47:58.819240] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-22T21:47:58.819888] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-22T21:47:58.820002] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-22T21:47:58.820182] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-22T21:47:58.853890] [DEBUG] [LOCAL ] VOC: Loaded 8997 existing records from primary storage. [2025-10-22T21:47:58.868565] [INFO ] [MAIN ] VOC: Loaded 8997 existing records. [2025-10-22T21:47:59.121018] [DEBUG] [LOCAL ] VNT: Loaded 43930 existing records from primary storage. [2025-10-22T21:47:59.176840] [INFO ] [MAIN ] VNT: Loaded 43930 existing records. [2025-10-22T21:47:59.183001] [DEBUG] [LOCAL ] VOYA: Loaded 41929 existing records from primary storage. [2025-10-22T21:47:59.302162] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:47:59.268977] [INFO ] [MAIN ] VOYA: Loaded 41929 existing records. [2025-10-22T21:47:59.401228] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-22T21:47:59.512751] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-22T21:47:59.628559] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-22T21:47:59.705303] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-22T21:47:59.852433] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:47:59.911989] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:47:59.934083] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:47:59.934379] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-22T21:47:59.934271] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-22T21:47:59.934552] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-22T21:47:59.948920] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-22T21:47:59.949319] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-01. [2025-10-22T21:47:59.959884] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-22T21:47:59.966132] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-22T21:47:59.987526] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-22T21:48:00.033158] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-22T21:48:00.250793] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:48:00.354164] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-01 [2025-10-22T21:48:00.419939] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:48:00.466553] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-22T21:48:00.497538] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:48:00.591618] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-22T21:48:00.744342] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-22T21:48:00.759718] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-22T21:48:00.811608] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-22T21:48:00.868930] [INFO ] [MAIN ] Update Progress: 2241/2367 symbols completed. VOYG took 2.8s. Estimated remaining: 16m 11s. Rate: 7.8 symbols/min [2025-10-22T21:48:01.026206] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:48:01.100346] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-10-22T21:48:01.143092] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:48:01.205306] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-10-22T21:48:01.324201] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:48:01.329544] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-10-22T21:48:01.328595] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:48:01.351402] [DEBUG] [LOCAL ] VPG: Loaded 16982 existing records from primary storage. [2025-10-22T21:48:01.351753] [INFO ] [MAIN ] VPG: Loaded 16982 existing records. [2025-10-22T21:48:01.534360] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:48:01.534741] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-22T21:48:01.534802] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-22T21:48:01.535026] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-22T21:48:01.535085] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-22T21:48:01.937481] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:48:01.937940] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-10-22T21:48:02.206488] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T21:48:02.209372] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-10-22T21:48:02.854191] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T21:48:02.863563] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-10-22T21:48:02.954015] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-22T21:48:02.975260] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-10-22T21:48:02.976092] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-22T21:48:03.035048] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-22T21:48:03.317716] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-10-22T21:48:04.117664] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-10-22T21:48:04.160291] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-22T21:48:04.255148] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-22T21:48:04.609383] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T21:48:04.896571] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-22T21:48:04.917630] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-10-22T21:48:05.717708] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-10-22T21:48:05.749585] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-22T21:48:06.517730] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-10-22T21:48:07.317718] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-10-22T21:48:07.344518] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T21:48:07.387043] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-22T21:48:08.117717] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-10-22T21:48:08.917681] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-10-22T21:48:08.962898] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-22T21:48:08.973319] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-22T21:48:09.717696] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-10-22T21:48:10.072414] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T21:48:10.517722] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-10-22T21:48:11.317683] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-10-22T21:48:11.372902] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T21:48:12.119109] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-10-22T21:48:12.122034] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T21:48:12.278686] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-22T21:48:12.917722] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-10-22T21:48:13.707103] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-22T21:48:13.717608] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-10-22T21:48:13.743198] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T21:48:14.517670] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-10-22T21:48:14.567669] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-22T21:48:15.317682] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-10-22T21:48:15.972922] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-22T21:48:16.117669] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-10-22T21:48:16.504758] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T21:48:16.917708] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-10-22T21:48:17.630210] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T21:48:17.717639] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-10-22T21:48:18.075838] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-22T21:48:18.517701] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-10-22T21:48:18.955022] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T21:48:19.317611] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-10-22T21:48:19.479989] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-22T21:48:20.117680] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-10-22T21:48:20.922839] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-10-22T21:48:20.954107] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-22T21:48:21.055926] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-22T21:48:21.717719] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-10-22T21:48:22.464499] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T21:48:22.516403] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-22T21:48:22.518880] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-10-22T21:48:23.317635] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-10-22T21:48:24.059715] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T21:48:24.117612] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-10. [2025-10-22T21:48:24.588611] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-22T21:48:24.917627] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-10-22T21:48:25.562699] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T21:48:25.569732] [INFO ] [REMOTE ] VOYA: Full fetch complete (61595 records). [2025-10-22T21:48:25.569903] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-22T21:48:25.728551] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-10-22T21:48:25.880583] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-22T21:48:25.967256] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-22T21:48:25.967333] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-22T21:48:25.968381] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-22T21:48:25.968444] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-22T21:48:25.969555] [DEBUG] [LOCAL ] VOYA: Trimmed 61595 records to 41801 (keeping 200 days of data) [2025-10-22T21:48:26.216763] [DEBUG] [LOCAL ] VOYA: Primary data saved (41801 records). [2025-10-22T21:48:26.216889] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-22T21:48:26.216964] [INFO ] [MAIN ] Update Progress: 2242/2367 symbols completed. VOYA took 28.1s. Estimated remaining: 16m 5s. Rate: 7.8 symbols/min [2025-10-22T21:48:26.385776] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:48:26.393002] [DEBUG] [LOCAL ] VPV: Loaded 5414 existing records from primary storage. [2025-10-22T21:48:26.393175] [INFO ] [MAIN ] VPV: Loaded 5414 existing records. [2025-10-22T21:48:26.531942] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-10-22T21:48:26.574141] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:48:26.574444] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-22T21:48:26.574504] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-22T21:48:26.574670] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-22T21:48:26.574733] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-22T21:48:26.758880] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-22T21:48:26.958502] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:48:27.317733] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-10-22T21:48:28.035901] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T21:48:28.117615] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-10. [2025-10-22T21:48:28.134359] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-22T21:48:28.917684] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-10. [2025-10-22T21:48:29.602422] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-22T21:48:29.610258] [INFO ] [REMOTE ] VNT: Full fetch complete (64324 records). [2025-10-22T21:48:29.610404] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-22T21:48:29.722814] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-10. [2025-10-22T21:48:29.971164] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-22T21:48:30.004144] [INFO ] [REMOTE ] VPG: Full fetch complete (23134 records). [2025-10-22T21:48:30.019560] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-22T21:48:30.019669] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-22T21:48:30.020876] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-22T21:48:30.020952] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-22T21:48:30.021162] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-22T21:48:30.122454] [DEBUG] [LOCAL ] VNT: Trimmed 64324 records to 43884 (keeping 200 days of data) [2025-10-22T21:48:30.516815] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-22T21:48:30.519810] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-10-22T21:48:30.522870] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-22T21:48:30.519706] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-22T21:48:30.526940] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-22T21:48:30.527089] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-22T21:48:30.526275] [INFO ] [REMOTE ] VOC: Full fetch complete (13221 records). [2025-10-22T21:48:30.527807] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-22T21:48:30.613104] [DEBUG] [LOCAL ] VPG: Trimmed 23134 records to 16880 (keeping 200 days of data) [2025-10-22T21:48:31.001300] [DEBUG] [LOCAL ] VPG: Primary data saved (16880 records). [2025-10-22T21:48:31.011935] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-22T21:48:31.048930] [INFO ] [MAIN ] Update Progress: 2243/2367 symbols completed. VPG took 30.1s. Estimated remaining: 15m 57s. Rate: 7.8 symbols/min [2025-10-22T21:48:31.149033] [DEBUG] [LOCAL ] VNT: Primary data saved (43884 records). [2025-10-22T21:48:31.157118] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-22T21:48:31.170936] [INFO ] [MAIN ] Update Progress: 2244/2367 symbols completed. VNT took 33.1s. Estimated remaining: 15m 49s. Rate: 7.8 symbols/min [2025-10-22T21:48:31.383051] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-22T21:48:31.421869] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-22T21:48:31.442223] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-22T21:48:31.459883] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-22T21:48:31.526573] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:48:31.500372] [DEBUG] [LOCAL ] VOC: Trimmed 13221 records to 9041 (keeping 200 days of data) [2025-10-22T21:48:31.574447] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:48:31.596013] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-22T21:48:31.617143] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-10-22T21:48:31.635128] [DEBUG] [LOCAL ] VOC: Primary data saved (9041 records). [2025-10-22T21:48:31.635448] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-22T21:48:31.635545] [INFO ] [MAIN ] Update Progress: 2245/2367 symbols completed. VOC took 33.6s. Estimated remaining: 15m 41s. Rate: 7.8 symbols/min [2025-10-22T21:48:31.842961] [DEBUG] [LOCAL ] VRE: Loaded 35322 existing records from primary storage. [2025-10-22T21:48:31.864334] [INFO ] [MAIN ] VRE: Loaded 35322 existing records. [2025-10-22T21:48:31.864104] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:48:31.961564] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-22T21:48:31.985225] [INFO ] [MAIN ] VRT: Loaded 53753 existing records. [2025-10-22T21:48:32.121574] [DEBUG] [LOCAL ] VRTS: Loaded 9391 existing records from primary storage. [2025-10-22T21:48:32.157756] [INFO ] [MAIN ] VRTS: Loaded 9391 existing records. [2025-10-22T21:48:32.190086] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:48:32.225776] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-22T21:48:32.243385] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-22T21:48:32.277389] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-22T21:48:32.289452] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-22T21:48:32.289344] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-22T21:48:32.368402] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-10-22T21:48:32.441034] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:48:32.509569] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-22T21:48:32.509701] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-22T21:48:32.561067] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-22T21:48:32.561213] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-22T21:48:32.560896] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:48:32.588310] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-22T21:48:32.617628] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-22T21:48:32.686253] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-22T21:48:32.721620] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-22T21:48:33.306895] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:48:33.336774] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-10-22T21:48:33.446252] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:48:33.461486] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-22T21:48:33.562561] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:48:33.717628] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-10-22T21:48:34.364357] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-22T21:48:34.517699] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-10-22T21:48:34.738778] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T21:48:35.317733] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-10-22T21:48:35.941228] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-22T21:48:36.117716] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-10-22T21:48:36.741154] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T21:48:36.917620] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-10-22T21:48:37.050446] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-22T21:48:37.536477] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T21:48:37.717665] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-10-22T21:48:38.314770] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-22T21:48:38.517632] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-10-22T21:48:39.317675] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-10-22T21:48:40.117695] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-10-22T21:48:40.468490] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-22T21:48:40.900468] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-22T21:48:40.900264] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-22T21:48:40.917607] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-10-22T21:48:41.559099] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-22T21:48:41.717707] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-10-22T21:48:42.517637] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-10-22T21:48:42.716723] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-22T21:48:43.088882] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-22T21:48:43.317678] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-10-22T21:48:43.986385] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-22T21:48:44.117715] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-10-22T21:48:44.917673] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-10-22T21:48:44.982099] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-22T21:48:45.717637] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-10-22T21:48:46.311019] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-22T21:48:46.517633] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-10-22T21:48:46.577553] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-22T21:48:47.317735] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-10-22T21:48:48.012204] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-22T21:48:48.117672] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-10-22T21:48:48.917725] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-10-22T21:48:49.415638] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-22T21:48:49.717731] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-10-22T21:48:49.726556] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-22T21:48:49.764159] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-22T21:48:50.517667] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-10-22T21:48:51.193171] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-22T21:48:51.239292] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-22T21:48:51.317693] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-10. [2025-10-22T21:48:52.070973] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T21:48:52.072368] [INFO ] [REMOTE ] VPV: Full fetch complete (8864 records). [2025-10-22T21:48:52.072438] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-22T21:48:52.125013] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-10-22T21:48:52.443931] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-22T21:48:52.444013] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-22T21:48:52.444227] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-22T21:48:52.444291] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-22T21:48:52.444755] [DEBUG] [LOCAL ] VPV: Trimmed 8864 records to 5221 (keeping 200 days of data) [2025-10-22T21:48:52.475153] [DEBUG] [LOCAL ] VPV: Primary data saved (5221 records). [2025-10-22T21:48:52.475261] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-22T21:48:52.475340] [INFO ] [MAIN ] Update Progress: 2246/2367 symbols completed. VPV took 26.3s. Estimated remaining: 15m 34s. Rate: 7.8 symbols/min [2025-10-22T21:48:52.641260] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:48:52.689923] [DEBUG] [LOCAL ] VSCO: Loaded 52708 existing records from primary storage. [2025-10-22T21:48:52.690248] [INFO ] [MAIN ] VSCO: Loaded 52708 existing records. [2025-10-22T21:48:52.864637] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:48:52.864916] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-22T21:48:52.864963] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-22T21:48:52.865138] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-22T21:48:52.865175] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-22T21:48:52.926146] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-10. [2025-10-22T21:48:53.217155] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:48:53.717633] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-10-22T21:48:53.726080] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-22T21:48:53.728411] [INFO ] [REMOTE ] VRTS: Full fetch complete (11804 records). [2025-10-22T21:48:53.728489] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-22T21:48:54.091960] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-22T21:48:54.092038] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-22T21:48:54.092329] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-22T21:48:54.092367] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-22T21:48:54.092874] [DEBUG] [LOCAL ] VRTS: Trimmed 11804 records to 9371 (keeping 200 days of data) [2025-10-22T21:48:54.150155] [DEBUG] [LOCAL ] VRTS: Primary data saved (9371 records). [2025-10-22T21:48:54.150287] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-22T21:48:54.150364] [INFO ] [MAIN ] Update Progress: 2247/2367 symbols completed. VRTS took 22.5s. Estimated remaining: 15m 25s. Rate: 7.8 symbols/min [2025-10-22T21:48:54.319170] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:48:54.362135] [DEBUG] [LOCAL ] VSH: Loaded 48240 existing records from primary storage. [2025-10-22T21:48:54.362433] [INFO ] [MAIN ] VSH: Loaded 48240 existing records. [2025-10-22T21:48:54.521513] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-10-22T21:48:54.540950] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:48:54.541934] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-22T21:48:54.542055] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-22T21:48:54.542285] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-22T21:48:54.542336] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-22T21:48:54.943441] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:48:54.939562] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-10-22T21:48:55.208715] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T21:48:55.317697] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-10-22T21:48:56.117687] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-10-22T21:48:56.264014] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-22T21:48:56.332868] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-22T21:48:56.917685] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-10-22T21:48:57.449506] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-22T21:48:57.717709] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-10-22T21:48:58.399473] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T21:48:58.517677] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-10. [2025-10-22T21:48:59.317727] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-10-22T21:48:59.794148] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T21:48:59.800214] [INFO ] [REMOTE ] VRE: Full fetch complete (48706 records). [2025-10-22T21:48:59.800317] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-22T21:49:00.133405] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-10-22T21:49:00.186210] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-22T21:49:00.186350] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-22T21:49:00.187510] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-22T21:49:00.187612] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-22T21:49:00.189418] [DEBUG] [LOCAL ] VRE: Trimmed 48706 records to 35221 (keeping 200 days of data) [2025-10-22T21:49:00.416080] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-10-22T21:49:00.454253] [DEBUG] [LOCAL ] VRE: Primary data saved (35221 records). [2025-10-22T21:49:00.454446] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-22T21:49:00.454566] [INFO ] [MAIN ] Update Progress: 2248/2367 symbols completed. VRE took 29.4s. Estimated remaining: 15m 18s. Rate: 7.8 symbols/min [2025-10-22T21:49:00.630146] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:49:00.677213] [DEBUG] [LOCAL ] VST: Loaded 53709 existing records from primary storage. [2025-10-22T21:49:00.677578] [INFO ] [MAIN ] VST: Loaded 53709 existing records. [2025-10-22T21:49:00.853492] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:49:00.853768] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-22T21:49:00.853820] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-22T21:49:00.854365] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-10-22T21:49:00.854421] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-22T21:49:00.917775] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-10-22T21:49:01.208498] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:49:01.346767] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-22T21:49:01.717638] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-10-22T21:49:02.517724] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-10-22T21:49:02.614580] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-22T21:49:03.326766] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-10-22T21:49:03.329332] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-22T21:49:03.775252] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-22T21:49:04.117677] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-10-22T21:49:04.719246] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-22T21:49:04.860136] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-22T21:49:04.917617] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-10-22T21:49:05.717679] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-10-22T21:49:06.517720] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-10-22T21:49:06.818446] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-22T21:49:07.317627] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-10-22T21:49:07.386469] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T21:49:07.490902] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-10-22T21:49:08.117739] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-10-22T21:49:08.467997] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T21:49:08.917772] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-10-22T21:49:09.717630] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-10-22T21:49:09.794124] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T21:49:09.945698] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-22T21:49:10.517755] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-10-22T21:49:10.765426] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T21:49:11.317747] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-10-22T21:49:12.117726] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-10-22T21:49:12.235487] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T21:49:12.295730] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-22T21:49:12.792240] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T21:49:12.917703] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-10-22T21:49:13.717764] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-10-22T21:49:14.517685] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-10-22T21:49:14.698913] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-10-22T21:49:15.199606] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T21:49:15.317629] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-10-22T21:49:15.556367] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-22T21:49:16.117675] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-10. [2025-10-22T21:49:16.272931] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T21:49:16.917746] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-10-22T21:49:17.031979] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T21:49:17.717756] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-10-22T21:49:18.517720] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-10-22T21:49:18.756177] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-10 (2.64 seconds). [2025-10-22T21:49:18.766133] [INFO ] [REMOTE ] VRT: Full fetch complete (77932 records). [2025-10-22T21:49:18.766334] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-22T21:49:19.220556] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-22T21:49:19.238448] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-22T21:49:19.243503] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-22T21:49:19.243606] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-22T21:49:19.246745] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T21:49:19.258794] [DEBUG] [LOCAL ] VRT: Trimmed 77932 records to 53753 (keeping 200 days of data) [2025-10-22T21:49:19.328495] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-10-22T21:49:19.662344] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-10-22T21:49:19.684674] [DEBUG] [LOCAL ] VRT: Primary data saved (53753 records). [2025-10-22T21:49:19.685437] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-22T21:49:19.685563] [INFO ] [MAIN ] Update Progress: 2249/2367 symbols completed. VRT took 48.5s. Estimated remaining: 15m 11s. Rate: 7.8 symbols/min [2025-10-22T21:49:19.855935] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:49:19.905943] [DEBUG] [LOCAL ] VSTS: Loaded 48872 existing records from primary storage. [2025-10-22T21:49:19.906374] [INFO ] [MAIN ] VSTS: Loaded 48872 existing records. [2025-10-22T21:49:20.096550] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:49:20.096958] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-22T21:49:20.097232] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-22T21:49:20.127246] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-10-22T21:49:20.131545] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-10-22T21:49:20.135094] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-22T21:49:20.134979] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T21:49:20.569997] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:49:20.670622] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-22T21:49:20.917758] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-10. [2025-10-22T21:49:21.717709] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-10. [2025-10-22T21:49:22.339920] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-22T21:49:22.517689] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-10-22T21:49:22.602447] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T21:49:22.612248] [INFO ] [REMOTE ] VSCO: Full fetch complete (76447 records). [2025-10-22T21:49:22.612471] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-22T21:49:23.022511] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-22T21:49:23.022624] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-22T21:49:23.024808] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-22T21:49:23.024878] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-22T21:49:23.026896] [DEBUG] [LOCAL ] VSCO: Trimmed 76447 records to 52694 (keeping 200 days of data) [2025-10-22T21:49:23.320190] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-10-22T21:49:23.395755] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-22T21:49:23.394757] [DEBUG] [LOCAL ] VSCO: Primary data saved (52694 records). [2025-10-22T21:49:23.396062] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-22T21:49:23.403918] [INFO ] [MAIN ] Update Progress: 2250/2367 symbols completed. VSCO took 30.9s. Estimated remaining: 15m 3s. Rate: 7.8 symbols/min [2025-10-22T21:49:23.479166] [INFO ] [REMOTE ] VSH: Full fetch complete (70938 records). [2025-10-22T21:49:23.490322] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-22T21:49:23.702989] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:49:24.035160] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-22T21:49:24.037245] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-22T21:49:24.038717] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-22T21:49:24.038811] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-22T21:49:24.037125] [DEBUG] [LOCAL ] VTEX: Loaded 42894 existing records from primary storage. [2025-10-22T21:49:24.040016] [INFO ] [MAIN ] VTEX: Loaded 42894 existing records. [2025-10-22T21:49:24.122794] [DEBUG] [LOCAL ] VSH: Trimmed 70938 records to 48228 (keeping 200 days of data) [2025-10-22T21:49:24.345585] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:49:24.351170] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-22T21:49:24.351890] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-22T21:49:24.363244] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-22T21:49:24.363447] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-22T21:49:24.935278] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:49:24.935950] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-10-22T21:49:24.976825] [DEBUG] [LOCAL ] VSH: Primary data saved (48228 records). [2025-10-22T21:49:24.977222] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-22T21:49:24.978430] [INFO ] [MAIN ] Update Progress: 2251/2367 symbols completed. VSH took 30.8s. Estimated remaining: 14m 55s. Rate: 7.8 symbols/min [2025-10-22T21:49:24.979888] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T21:49:25.044435] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-10-22T21:49:25.175263] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:49:25.214093] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-22T21:49:25.265394] [DEBUG] [LOCAL ] VTLE: Loaded 47663 existing records from primary storage. [2025-10-22T21:49:25.265777] [INFO ] [MAIN ] VTLE: Loaded 47663 existing records. [2025-10-22T21:49:25.443935] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:49:25.444157] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-22T21:49:25.444206] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-22T21:49:25.444400] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-22T21:49:25.444440] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-22T21:49:25.725231] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-10-22T21:49:25.807932] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:49:26.133499] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T21:49:26.517695] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-10-22T21:49:26.612300] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-22T21:49:27.317732] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-10-22T21:49:27.935108] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-22T21:49:27.999875] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-22T21:49:28.117628] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-10-22T21:49:28.871598] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T21:49:28.917622] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-10-22T21:49:29.634147] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-22T21:49:29.717683] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-10-22T21:49:30.517700] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-10-22T21:49:30.546260] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-22T21:49:31.317694] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-10-22T21:49:32.096423] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T21:49:32.117605] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-10-22T21:49:32.246424] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-22T21:49:32.898695] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-22T21:49:32.917630] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-10-22T21:49:33.594895] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-22T21:49:33.717665] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-10-22T21:49:34.520711] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-10. [2025-10-22T21:49:34.523499] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T21:49:35.048602] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-22T21:49:35.248507] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-22T21:49:35.257428] [INFO ] [REMOTE ] VST: Full fetch complete (77888 records). [2025-10-22T21:49:35.257596] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-22T21:49:35.322841] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-10-22T21:49:35.645351] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-22T21:49:35.645429] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-22T21:49:35.646613] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-22T21:49:35.646698] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-22T21:49:35.648202] [DEBUG] [LOCAL ] VST: Trimmed 77888 records to 53709 (keeping 200 days of data) [2025-10-22T21:49:35.983760] [DEBUG] [LOCAL ] VST: Primary data saved (53709 records). [2025-10-22T21:49:35.983894] [INFO ] [MAIN ] VST: Full history saved. [2025-10-22T21:49:35.983984] [INFO ] [MAIN ] Update Progress: 2252/2367 symbols completed. VST took 35.5s. Estimated remaining: 14m 47s. Rate: 7.8 symbols/min [2025-10-22T21:49:36.122816] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-10-22T21:49:36.153581] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:49:36.172773] [DEBUG] [LOCAL ] VTMX: Loaded 17484 existing records from primary storage. [2025-10-22T21:49:36.173028] [INFO ] [MAIN ] VTMX: Loaded 17484 existing records. [2025-10-22T21:49:36.372163] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:49:36.372371] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-22T21:49:36.372418] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-22T21:49:36.372616] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-22T21:49:36.372714] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-22T21:49:36.727967] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:49:36.896023] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T21:49:36.917636] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-10-22T21:49:37.717708] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-10-22T21:49:37.862294] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-22T21:49:37.907959] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-22T21:49:38.517734] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-10-22T21:49:39.317716] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-10-22T21:49:39.416718] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T21:49:40.117678] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-10-22T21:49:40.217718] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T21:49:40.899048] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T21:49:40.917616] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-10-22T21:49:40.953140] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-22T21:49:41.717724] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-10-22T21:49:42.517715] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-10-22T21:49:42.617979] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T21:49:42.656296] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-22T21:49:43.317709] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-10-22T21:49:43.847185] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-22T21:49:44.117758] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-10. [2025-10-22T21:49:44.609465] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-22T21:49:44.917689] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-10-22T21:49:45.690202] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T21:49:45.697130] [INFO ] [REMOTE ] VTEX: Full fetch complete (61084 records). [2025-10-22T21:49:45.697266] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-22T21:49:45.728121] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-10-22T21:49:46.072027] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-22T21:49:46.072108] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-22T21:49:46.073137] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-22T21:49:46.073200] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-22T21:49:46.074395] [DEBUG] [LOCAL ] VTEX: Trimmed 61084 records to 42874 (keeping 200 days of data) [2025-10-22T21:49:46.307737] [DEBUG] [LOCAL ] VTEX: Primary data saved (42874 records). [2025-10-22T21:49:46.307857] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-22T21:49:46.307931] [INFO ] [MAIN ] Update Progress: 2253/2367 symbols completed. VTEX took 22.9s. Estimated remaining: 14m 39s. Rate: 7.8 symbols/min [2025-10-22T21:49:46.489245] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:49:46.501353] [DEBUG] [LOCAL ] VTN: Loaded 7086 existing records from primary storage. [2025-10-22T21:49:46.501588] [INFO ] [MAIN ] VTN: Loaded 7086 existing records. [2025-10-22T21:49:46.524263] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-10-22T21:49:46.691560] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:49:46.692516] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-22T21:49:46.705385] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-22T21:49:46.725292] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-22T21:49:46.725429] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-22T21:49:46.786342] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-22T21:49:46.874847] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T21:49:47.117105] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:49:47.317694] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-10-22T21:49:47.871824] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-22T21:49:47.908824] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T21:49:48.117726] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-10-22T21:49:48.917753] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-10-22T21:49:49.717746] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-10-22T21:49:49.996458] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T21:49:50.513559] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-22T21:49:50.517598] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-10-22T21:49:50.841538] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T21:49:51.261942] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-22T21:49:51.317669] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-10-22T21:49:52.117698] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-10-22T21:49:52.830181] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-22T21:49:52.917730] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-10-22T21:49:53.040561] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T21:49:53.717626] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-10-22T21:49:53.958560] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-22T21:49:54.517742] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-10-22T21:49:55.317730] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-10-22T21:49:55.411178] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T21:49:55.944358] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-22T21:49:56.117754] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-10-22T21:49:56.148727] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T21:49:56.917663] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-10-22T21:49:57.066802] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-22T21:49:57.320614] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-22T21:49:57.717693] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-10. [2025-10-22T21:49:58.517775] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-10. [2025-10-22T21:49:59.219036] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-22T21:49:59.225751] [INFO ] [REMOTE ] VTLE: Full fetch complete (68399 records). [2025-10-22T21:49:59.225871] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-22T21:49:59.322802] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-10-22T21:49:59.608478] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-22T21:49:59.608570] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-22T21:49:59.609706] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-22T21:49:59.609770] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-22T21:49:59.611121] [DEBUG] [LOCAL ] VTLE: Trimmed 68399 records to 47548 (keeping 200 days of data) [2025-10-22T21:49:59.890309] [DEBUG] [LOCAL ] VTLE: Primary data saved (47548 records). [2025-10-22T21:49:59.890452] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-22T21:49:59.890552] [INFO ] [MAIN ] Update Progress: 2254/2367 symbols completed. VTLE took 34.9s. Estimated remaining: 14m 32s. Rate: 7.8 symbols/min [2025-10-22T21:50:00.060436] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:50:00.081951] [DEBUG] [LOCAL ] VTOL: Loaded 19443 existing records from primary storage. [2025-10-22T21:50:00.082235] [INFO ] [MAIN ] VTOL: Loaded 19443 existing records. [2025-10-22T21:50:00.124759] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-10-22T21:50:00.193514] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T21:50:00.275927] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:50:00.276338] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-22T21:50:00.289731] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-22T21:50:00.297165] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-22T21:50:00.297846] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-22T21:50:00.331047] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-22T21:50:00.406015] [INFO ] [REMOTE ] VSTS: Full fetch complete (69778 records). [2025-10-22T21:50:00.408443] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-22T21:50:00.931406] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-10-22T21:50:00.937838] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:50:01.081197] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-22T21:50:01.081276] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-22T21:50:01.082393] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-22T21:50:01.082455] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-22T21:50:01.083793] [DEBUG] [LOCAL ] VSTS: Trimmed 69778 records to 48857 (keeping 200 days of data) [2025-10-22T21:50:01.347033] [DEBUG] [LOCAL ] VSTS: Primary data saved (48857 records). [2025-10-22T21:50:01.347161] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-22T21:50:01.347763] [INFO ] [MAIN ] Update Progress: 2255/2367 symbols completed. VSTS took 41.7s. Estimated remaining: 14m 24s. Rate: 7.8 symbols/min [2025-10-22T21:50:01.514020] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:50:01.564508] [DEBUG] [LOCAL ] VTR: Loaded 52712 existing records from primary storage. [2025-10-22T21:50:01.564849] [INFO ] [MAIN ] VTR: Loaded 52712 existing records. [2025-10-22T21:50:01.728844] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-10-22T21:50:01.750578] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:50:01.751358] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-22T21:50:01.752669] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-22T21:50:01.753065] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-22T21:50:01.766027] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-22T21:50:01.800808] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T21:50:02.166566] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-22T21:50:02.229808] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:50:02.517695] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-10-22T21:50:02.620432] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-22T21:50:03.317636] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-10-22T21:50:03.352757] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-22T21:50:04.117700] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-10-22T21:50:04.917708] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-10-22T21:50:05.166975] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T21:50:05.215176] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-22T21:50:05.717746] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-10. [2025-10-22T21:50:05.928589] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-22T21:50:06.517690] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-10-22T21:50:06.684699] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-22T21:50:06.687982] [INFO ] [REMOTE ] VTMX: Full fetch complete (25762 records). [2025-10-22T21:50:06.688055] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-22T21:50:07.083575] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-22T21:50:07.083681] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-22T21:50:07.084230] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-22T21:50:07.084270] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-22T21:50:07.084926] [DEBUG] [LOCAL ] VTMX: Trimmed 25762 records to 17525 (keeping 200 days of data) [2025-10-22T21:50:07.192212] [DEBUG] [LOCAL ] VTMX: Primary data saved (17525 records). [2025-10-22T21:50:07.192351] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-22T21:50:07.192431] [INFO ] [MAIN ] Update Progress: 2256/2367 symbols completed. VTMX took 31.2s. Estimated remaining: 14m 16s. Rate: 7.8 symbols/min [2025-10-22T21:50:07.331340] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-10-22T21:50:07.364402] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:50:07.393847] [DEBUG] [LOCAL ] VTS: Loaded 29970 existing records from primary storage. [2025-10-22T21:50:07.394165] [INFO ] [MAIN ] VTS: Loaded 29970 existing records. [2025-10-22T21:50:07.567722] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T21:50:07.593742] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:50:07.594025] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-22T21:50:07.594075] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-22T21:50:07.594809] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-22T21:50:07.594870] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-22T21:50:07.961860] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:50:08.117688] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-10-22T21:50:08.355121] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T21:50:08.917708] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-10-22T21:50:09.717735] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-10. [2025-10-22T21:50:09.781225] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-22T21:50:09.828857] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-22T21:50:10.468806] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T21:50:10.470668] [INFO ] [REMOTE ] VTN: Full fetch complete (10836 records). [2025-10-22T21:50:10.470741] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-22T21:50:10.522822] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-10-22T21:50:10.854252] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-22T21:50:10.854332] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-22T21:50:10.854614] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-22T21:50:10.854689] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-22T21:50:10.855223] [DEBUG] [LOCAL ] VTN: Trimmed 10836 records to 7114 (keeping 200 days of data) [2025-10-22T21:50:10.898247] [DEBUG] [LOCAL ] VTN: Primary data saved (7114 records). [2025-10-22T21:50:10.898387] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-22T21:50:10.898468] [INFO ] [MAIN ] Update Progress: 2257/2367 symbols completed. VTN took 24.6s. Estimated remaining: 14m 8s. Rate: 7.8 symbols/min [2025-10-22T21:50:11.065050] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:50:11.093532] [DEBUG] [LOCAL ] VVR: Loaded 31317 existing records from primary storage. [2025-10-22T21:50:11.093814] [INFO ] [MAIN ] VVR: Loaded 31317 existing records. [2025-10-22T21:50:11.268087] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:50:11.268325] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-22T21:50:11.268389] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-22T21:50:11.268820] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-22T21:50:11.268914] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-22T21:50:11.326902] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-10-22T21:50:11.633117] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:50:11.680572] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-22T21:50:12.117634] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-10-22T21:50:12.917682] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-10-22T21:50:13.360315] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-22T21:50:13.516881] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T21:50:13.717633] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-10-22T21:50:14.020412] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T21:50:14.517634] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-10-22T21:50:14.979323] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-22T21:50:15.317671] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-10-22T21:50:15.543162] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-22T21:50:16.117710] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-10-22T21:50:16.381277] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-22T21:50:16.917718] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-10-22T21:50:17.717708] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-10-22T21:50:18.051892] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-22T21:50:18.078008] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-22T21:50:18.517744] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-10-22T21:50:18.666896] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-22T21:50:19.317730] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-10-22T21:50:20.117670] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-10-22T21:50:20.338042] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T21:50:20.610979] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-22T21:50:20.917710] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-10-22T21:50:21.124212] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-22T21:50:21.717742] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-10-22T21:50:22.517731] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-10-22T21:50:22.648807] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T21:50:23.135389] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-22T21:50:23.317693] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-10-22T21:50:23.509327] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T21:50:24.117623] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-10-22T21:50:24.917717] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-10-22T21:50:25.255113] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T21:50:25.282200] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-22T21:50:25.717616] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-10-22T21:50:26.231836] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-22T21:50:26.517705] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-10-22T21:50:27.033145] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T21:50:27.317715] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-10-22T21:50:27.800538] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-22T21:50:28.117674] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-10-22T21:50:28.917681] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-10-22T21:50:29.165609] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-22T21:50:29.447883] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T21:50:29.717702] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-10-22T21:50:29.985550] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-22T21:50:30.517712] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-10-22T21:50:31.019094] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-22T21:50:31.317698] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-10-22T21:50:31.537621] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T21:50:32.117634] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-10. [2025-10-22T21:50:32.550118] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-22T21:50:32.917700] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-10-22T21:50:32.996270] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-22T21:50:32.999372] [INFO ] [REMOTE ] VTOL: Full fetch complete (26406 records). [2025-10-22T21:50:32.999444] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-22T21:50:33.384067] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-22T21:50:33.384146] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-22T21:50:33.384802] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-22T21:50:33.384865] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-22T21:50:33.385579] [DEBUG] [LOCAL ] VTOL: Trimmed 26406 records to 19344 (keeping 200 days of data) [2025-10-22T21:50:33.496896] [DEBUG] [LOCAL ] VTOL: Primary data saved (19344 records). [2025-10-22T21:50:33.497039] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-22T21:50:33.497118] [INFO ] [MAIN ] Update Progress: 2258/2367 symbols completed. VTOL took 33.6s. Estimated remaining: 14m 1s. Rate: 7.8 symbols/min [2025-10-22T21:50:33.660960] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:50:33.702733] [DEBUG] [LOCAL ] VVV: Loaded 50174 existing records from primary storage. [2025-10-22T21:50:33.703032] [INFO ] [MAIN ] VVV: Loaded 50174 existing records. [2025-10-22T21:50:33.723149] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-10-22T21:50:33.881135] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:50:33.881368] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-22T21:50:33.881419] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-22T21:50:33.881726] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-22T21:50:33.881783] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-22T21:50:34.226747] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:50:34.521035] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-10-22T21:50:34.523849] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-22T21:50:34.734816] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-22T21:50:35.320182] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-10. [2025-10-22T21:50:35.325080] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T21:50:36.117719] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-10-22T21:50:36.634537] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-22T21:50:36.639714] [INFO ] [REMOTE ] VTS: Full fetch complete (41601 records). [2025-10-22T21:50:36.639795] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-22T21:50:36.924434] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-10. [2025-10-22T21:50:37.012070] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-22T21:50:37.012140] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-22T21:50:37.012941] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-22T21:50:37.013002] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-22T21:50:37.013828] [DEBUG] [LOCAL ] VTS: Trimmed 41601 records to 29835 (keeping 200 days of data) [2025-10-22T21:50:37.187543] [DEBUG] [LOCAL ] VTS: Primary data saved (29835 records). [2025-10-22T21:50:37.187697] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-22T21:50:37.187790] [INFO ] [MAIN ] Update Progress: 2259/2367 symbols completed. VTS took 30.0s. Estimated remaining: 13m 53s. Rate: 7.8 symbols/min [2025-10-22T21:50:37.354105] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:50:37.375009] [DEBUG] [LOCAL ] VVX: Loaded 23041 existing records from primary storage. [2025-10-22T21:50:37.375246] [INFO ] [MAIN ] VVX: Loaded 23041 existing records. [2025-10-22T21:50:37.553676] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:50:37.554052] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-22T21:50:37.554242] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-22T21:50:37.554473] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-22T21:50:37.554533] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-22T21:50:37.728122] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-10. [2025-10-22T21:50:37.910862] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T21:50:37.959017] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:50:38.370717] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T21:50:38.376968] [INFO ] [REMOTE ] VVR: Full fetch complete (46812 records). [2025-10-22T21:50:38.377088] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-22T21:50:38.527166] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-10-22T21:50:38.754413] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T21:50:38.803046] [INFO ] [REMOTE ] VTR: Full fetch complete (76459 records). [2025-10-22T21:50:38.803281] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-22T21:50:38.803368] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-22T21:50:38.803439] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-22T21:50:38.804548] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-22T21:50:38.804629] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-22T21:50:38.886384] [DEBUG] [LOCAL ] VVR: Trimmed 46812 records to 31188 (keeping 200 days of data) [2025-10-22T21:50:39.322102] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-10-22T21:50:39.322325] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-22T21:50:39.323416] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-22T21:50:39.349884] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-22T21:50:39.375691] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-22T21:50:39.393523] [DEBUG] [LOCAL ] VVR: Primary data saved (31188 records). [2025-10-22T21:50:39.393922] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-22T21:50:39.394027] [INFO ] [MAIN ] Update Progress: 2260/2367 symbols completed. VVR took 28.5s. Estimated remaining: 13m 45s. Rate: 7.8 symbols/min [2025-10-22T21:50:39.394303] [DEBUG] [LOCAL ] VTR: Trimmed 76459 records to 52678 (keeping 200 days of data) [2025-10-22T21:50:39.675354] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:50:39.845209] [DEBUG] [LOCAL ] VYX: Loaded 48341 existing records from primary storage. [2025-10-22T21:50:39.901427] [INFO ] [MAIN ] VYX: Loaded 48341 existing records. [2025-10-22T21:50:40.099570] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:50:40.103667] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-22T21:50:40.104814] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-22T21:50:40.105893] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-22T21:50:40.106575] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-22T21:50:40.156869] [DEBUG] [LOCAL ] VTR: Primary data saved (52678 records). [2025-10-22T21:50:40.188081] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-22T21:50:40.196185] [INFO ] [MAIN ] Update Progress: 2261/2367 symbols completed. VTR took 38.8s. Estimated remaining: 13m 37s. Rate: 7.8 symbols/min [2025-10-22T21:50:40.527147] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-22T21:50:40.646777] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-10-22T21:50:40.646278] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:50:40.739017] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:50:40.740907] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T21:50:40.788441] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-22T21:50:40.788764] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-10-22T21:50:40.922720] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-10-22T21:50:40.976955] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:50:40.977151] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-22T21:50:40.977205] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-22T21:50:40.977414] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-22T21:50:40.977503] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-22T21:50:41.324727] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:50:41.717743] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-10-22T21:50:42.134949] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T21:50:42.316095] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T21:50:42.517713] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-10-22T21:50:43.139735] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T21:50:43.317715] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-10-22T21:50:43.555543] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-22T21:50:44.117750] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-10-22T21:50:44.917754] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-10-22T21:50:45.120948] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-22T21:50:45.719584] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-10-22T21:50:45.722407] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-22T21:50:46.464529] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T21:50:46.517686] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-10-22T21:50:47.317673] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-10-22T21:50:47.449787] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-22T21:50:48.117627] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-10-22T21:50:48.287807] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-22T21:50:48.507957] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T21:50:48.917724] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-10-22T21:50:49.717706] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-10-22T21:50:49.789096] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-22T21:50:49.967106] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-22T21:50:50.517702] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-10-22T21:50:51.317627] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-10-22T21:50:51.398750] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T21:50:52.117707] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-10-22T21:50:52.211085] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T21:50:52.917627] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-10-22T21:50:53.533588] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T21:50:53.572336] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-22T21:50:53.717679] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-10-22T21:50:54.520016] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-10-22T21:50:54.525296] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T21:50:55.317748] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-10-22T21:50:55.484748] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-22T21:50:56.117708] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-10-22T21:50:56.931835] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-10-22T21:50:56.939689] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T21:50:57.008534] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-22T21:50:57.230793] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T21:50:57.717739] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-10-22T21:50:58.152324] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-22T21:50:58.517690] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-10-22T21:50:59.317633] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-10-22T21:50:59.396189] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T21:51:00.117753] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-10-22T21:51:00.863817] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-22T21:51:00.917675] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-10-22T21:51:01.215520] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-22T21:51:01.717691] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-10-22T21:51:01.962844] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T21:51:02.517711] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-10-22T21:51:03.317678] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-10. [2025-10-22T21:51:03.521130] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-22T21:51:03.620733] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-22T21:51:03.810994] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-22T21:51:04.117678] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-10-22T21:51:04.917741] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-10. [2025-10-22T21:51:05.060624] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T21:51:05.071259] [INFO ] [REMOTE ] VVV: Full fetch complete (72449 records). [2025-10-22T21:51:05.071437] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-22T21:51:05.475112] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-22T21:51:05.475211] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-22T21:51:05.476438] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-22T21:51:05.476519] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-22T21:51:05.501607] [DEBUG] [LOCAL ] VVV: Trimmed 72449 records to 50131 (keeping 200 days of data) [2025-10-22T21:51:05.503102] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-22T21:51:05.724831] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-10-22T21:51:05.808108] [DEBUG] [LOCAL ] VVV: Primary data saved (50131 records). [2025-10-22T21:51:05.808255] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-22T21:51:05.808339] [INFO ] [MAIN ] Update Progress: 2262/2367 symbols completed. VVV took 32.3s. Estimated remaining: 13m 31s. Rate: 7.8 symbols/min [2025-10-22T21:51:05.987282] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:51:06.003964] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-22T21:51:06.008268] [INFO ] [REMOTE ] VVX: Full fetch complete (33073 records). [2025-10-22T21:51:06.008384] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-22T21:51:06.366941] [DEBUG] [LOCAL ] W: Loaded 53408 existing records from primary storage. [2025-10-22T21:51:06.408674] [INFO ] [MAIN ] W: Loaded 53408 existing records. [2025-10-22T21:51:06.509495] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-22T21:51:06.520563] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-22T21:51:06.521378] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-22T21:51:06.528894] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-10. [2025-10-22T21:51:06.532290] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-22T21:51:06.598940] [DEBUG] [LOCAL ] VVX: Trimmed 33073 records to 23034 (keeping 200 days of data) [2025-10-22T21:51:06.621723] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:51:06.621958] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-22T21:51:06.622007] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-22T21:51:06.622224] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-22T21:51:06.622281] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-22T21:51:06.975722] [DEBUG] [LOCAL ] VVX: Primary data saved (23034 records). [2025-10-22T21:51:07.007625] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-22T21:51:07.019058] [INFO ] [MAIN ] Update Progress: 2263/2367 symbols completed. VVX took 29.8s. Estimated remaining: 13m 23s. Rate: 7.8 symbols/min [2025-10-22T21:51:07.280557] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:51:07.304693] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:51:07.317610] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-10-22T21:51:07.351596] [DEBUG] [LOCAL ] WAB: Loaded 43805 existing records from primary storage. [2025-10-22T21:51:07.351958] [INFO ] [MAIN ] WAB: Loaded 43805 existing records. [2025-10-22T21:51:07.526489] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:51:07.526707] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-22T21:51:07.526762] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-22T21:51:07.526941] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-22T21:51:07.526978] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-22T21:51:07.884309] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:51:08.103187] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T21:51:08.111238] [INFO ] [REMOTE ] VYX: Full fetch complete (70246 records). [2025-10-22T21:51:08.111362] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-22T21:51:08.146974] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-10-22T21:51:08.498783] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-22T21:51:08.593603] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-22T21:51:08.593746] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-22T21:51:08.595157] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-22T21:51:08.595226] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-22T21:51:08.596957] [DEBUG] [LOCAL ] VYX: Trimmed 70246 records to 48308 (keeping 200 days of data) [2025-10-22T21:51:08.894115] [DEBUG] [LOCAL ] VYX: Primary data saved (48308 records). [2025-10-22T21:51:08.894272] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-22T21:51:08.894371] [INFO ] [MAIN ] Update Progress: 2264/2367 symbols completed. VYX took 29.5s. Estimated remaining: 13m 15s. Rate: 7.8 symbols/min [2025-10-22T21:51:08.929172] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-10-22T21:51:09.091157] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:51:09.126943] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-22T21:51:09.168491] [DEBUG] [LOCAL ] WAL: Loaded 45675 existing records from primary storage. [2025-10-22T21:51:09.168824] [INFO ] [MAIN ] WAL: Loaded 45675 existing records. [2025-10-22T21:51:09.355307] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:51:09.355520] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-22T21:51:09.355569] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-22T21:51:09.355784] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-22T21:51:09.355843] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-22T21:51:09.719552] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-10-22T21:51:09.724161] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:51:09.749780] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T21:51:10.517735] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-10-22T21:51:11.285694] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-22T21:51:11.317612] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-10-22T21:51:11.476485] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T21:51:11.831314] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-22T21:51:12.117713] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-10-22T21:51:12.917692] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-10-22T21:51:13.417700] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-22T21:51:13.501619] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-22T21:51:13.717680] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-10. [2025-10-22T21:51:14.496500] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-22T21:51:14.505323] [INFO ] [REMOTE ] VZ: Full fetch complete (77971 records). [2025-10-22T21:51:14.505448] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-22T21:51:14.526494] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-10-22T21:51:14.902731] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-22T21:51:14.902910] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-22T21:51:14.904136] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-22T21:51:14.904216] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-22T21:51:14.905898] [DEBUG] [LOCAL ] VZ: Trimmed 77971 records to 53791 (keeping 200 days of data) [2025-10-22T21:51:15.060619] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-22T21:51:15.276883] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-10-22T21:51:15.277013] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-22T21:51:15.277090] [INFO ] [MAIN ] Update Progress: 2265/2367 symbols completed. VZ took 35.1s. Estimated remaining: 13m 7s. Rate: 7.8 symbols/min [2025-10-22T21:51:15.322774] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-10-22T21:51:15.444876] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:51:15.479830] [DEBUG] [LOCAL ] WAT: Loaded 35721 existing records from primary storage. [2025-10-22T21:51:15.480100] [INFO ] [MAIN ] WAT: Loaded 35721 existing records. [2025-10-22T21:51:15.658456] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:51:15.658663] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-22T21:51:15.658723] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-22T21:51:15.658901] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-22T21:51:15.658938] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-22T21:51:16.015523] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:51:16.117618] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-10-22T21:51:16.302574] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T21:51:16.917722] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-10-22T21:51:17.168292] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-22T21:51:17.464098] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-22T21:51:17.717732] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-10-22T21:51:18.517621] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-10-22T21:51:18.756688] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-22T21:51:19.322747] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-10-22T21:51:19.339429] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T21:51:19.656932] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-22T21:51:20.117716] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-10-22T21:51:20.917750] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-10-22T21:51:21.394433] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-22T21:51:21.669682] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T21:51:21.717791] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-10-22T21:51:22.517717] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-10-22T21:51:22.851026] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-22T21:51:22.926006] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-22T21:51:23.317689] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-10-22T21:51:24.117700] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-10-22T21:51:24.323770] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T21:51:24.917701] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-10-22T21:51:25.050333] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T21:51:25.717751] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-10-22T21:51:25.900175] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-22T21:51:26.276762] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T21:51:26.517710] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-10-22T21:51:27.317677] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-10-22T21:51:27.659950] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-22T21:51:28.111153] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T21:51:28.119829] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-10-22T21:51:28.917630] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-10-22T21:51:29.010271] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T21:51:29.717668] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-10-22T21:51:30.100769] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-22T21:51:30.263519] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-22T21:51:30.517679] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-10. [2025-10-22T21:51:30.822089] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-22T21:51:30.904306] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-22T21:51:30.912258] [INFO ] [REMOTE ] WAB: Full fetch complete (64432 records). [2025-10-22T21:51:30.912380] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-22T21:51:31.328307] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-10-22T21:51:31.332885] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-22T21:51:31.333004] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-22T21:51:31.334365] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-22T21:51:31.334436] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-22T21:51:31.335931] [DEBUG] [LOCAL ] WAB: Trimmed 64432 records to 43796 (keeping 200 days of data) [2025-10-22T21:51:31.623838] [DEBUG] [LOCAL ] WAB: Primary data saved (43796 records). [2025-10-22T21:51:31.623988] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-22T21:51:31.624087] [INFO ] [MAIN ] Update Progress: 2266/2367 symbols completed. WAB took 24.6s. Estimated remaining: 12m 59s. Rate: 7.8 symbols/min [2025-10-22T21:51:31.808366] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:51:31.808555] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-22T21:51:31.808591] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-22T21:51:31.808743] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-22T21:51:31.808785] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-22T21:51:31.808824] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-22T21:51:31.808855] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-22T21:51:32.122758] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-10-22T21:51:32.185305] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:51:32.917730] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-10-22T21:51:33.159466] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T21:51:33.624125] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-22T21:51:33.717701] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-10-22T21:51:34.517674] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-01. [2025-10-22T21:51:34.664299] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T21:51:34.726576] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:51:34.726956] [WARN ] [REMOTE ] WBI: No data returned for month 2025-01 [2025-10-22T21:51:34.727051] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:51:34.727099] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-22T21:51:34.727160] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:51:34.727234] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-22T21:51:34.727300] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-22T21:51:34.727339] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-22T21:51:34.727379] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-22T21:51:34.727425] [INFO ] [MAIN ] Update Progress: 2267/2367 symbols completed. WBI took 3.1s. Estimated remaining: 12m 52s. Rate: 7.8 symbols/min [2025-10-22T21:51:34.924195] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:51:34.975540] [DEBUG] [LOCAL ] WBS: Loaded 48842 existing records from primary storage. [2025-10-22T21:51:34.976410] [INFO ] [MAIN ] WBS: Loaded 48842 existing records. [2025-10-22T21:51:35.173267] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:51:35.174000] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-22T21:51:35.174082] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-22T21:51:35.183836] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-22T21:51:35.183939] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-22T21:51:35.274510] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-22T21:51:35.322716] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-10-22T21:51:35.572529] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:51:36.117726] [INFO ] [REMOTE ] W: Fetching primary data for 2025-10. [2025-10-22T21:51:36.873165] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T21:51:36.917620] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-10-22T21:51:37.717727] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-10-22T21:51:37.967034] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-22T21:51:37.976009] [INFO ] [REMOTE ] W: Full fetch complete (77513 records). [2025-10-22T21:51:37.976161] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-22T21:51:38.381008] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-22T21:51:38.381111] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-22T21:51:38.382549] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-22T21:51:38.382632] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-22T21:51:38.384304] [DEBUG] [LOCAL ] W: Trimmed 77513 records to 53410 (keeping 200 days of data) [2025-10-22T21:51:38.553353] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-10-22T21:51:38.710124] [DEBUG] [LOCAL ] W: Primary data saved (53410 records). [2025-10-22T21:51:38.710414] [INFO ] [MAIN ] W: Full history saved. [2025-10-22T21:51:38.710517] [INFO ] [MAIN ] Update Progress: 2268/2367 symbols completed. W took 32.9s. Estimated remaining: 12m 44s. Rate: 7.8 symbols/min [2025-10-22T21:51:38.816366] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-22T21:51:38.924164] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:51:38.935465] [DEBUG] [LOCAL ] WBX: Loaded 10081 existing records from primary storage. [2025-10-22T21:51:38.935700] [INFO ] [MAIN ] WBX: Loaded 10081 existing records. [2025-10-22T21:51:39.120119] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:51:39.120469] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-22T21:51:39.120531] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-22T21:51:39.120746] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-10-22T21:51:39.120803] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-22T21:51:39.327252] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-10. [2025-10-22T21:51:39.478878] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:51:39.510950] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T21:51:40.029547] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T21:51:40.117697] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-10-22T21:51:40.917659] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-10-22T21:51:41.162858] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T21:51:41.171047] [INFO ] [REMOTE ] WAL: Full fetch complete (67335 records). [2025-10-22T21:51:41.171163] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-22T21:51:41.569883] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-22T21:51:41.575497] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-22T21:51:41.575683] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-22T21:51:41.577502] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-22T21:51:41.577593] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-22T21:51:41.578952] [DEBUG] [LOCAL ] WAL: Trimmed 67335 records to 45667 (keeping 200 days of data) [2025-10-22T21:51:41.763739] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-10-22T21:51:41.879587] [DEBUG] [LOCAL ] WAL: Primary data saved (45667 records). [2025-10-22T21:51:41.879798] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-22T21:51:41.879934] [INFO ] [MAIN ] Update Progress: 2269/2367 symbols completed. WAL took 33.0s. Estimated remaining: 12m 36s. Rate: 7.8 symbols/min [2025-10-22T21:51:42.046987] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:51:42.083746] [DEBUG] [LOCAL ] WCC: Loaded 38619 existing records from primary storage. [2025-10-22T21:51:42.084046] [INFO ] [MAIN ] WCC: Loaded 38619 existing records. [2025-10-22T21:51:42.257130] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:51:42.257334] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-22T21:51:42.257380] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-22T21:51:42.257619] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-22T21:51:42.257713] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-22T21:51:42.521740] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-10-22T21:51:42.641987] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:51:42.666145] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T21:51:42.948742] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-22T21:51:43.317698] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-10-22T21:51:44.014619] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T21:51:44.117669] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-10-22T21:51:44.510244] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-22T21:51:44.917685] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-10-22T21:51:45.717714] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-10-22T21:51:45.895698] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T21:51:45.920575] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-22T21:51:46.517688] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-10-22T21:51:47.267278] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-22T21:51:47.317615] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-10-22T21:51:48.117687] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-10-22T21:51:48.176226] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T21:51:48.268757] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T21:51:48.917676] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-10-22T21:51:49.607762] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-22T21:51:49.717724] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-10-22T21:51:50.029894] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T21:51:50.517703] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-10-22T21:51:50.762274] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-22T21:51:51.317683] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-10-22T21:51:51.978722] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-22T21:51:52.117710] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-10-22T21:51:52.269303] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-22T21:51:52.698406] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-22T21:51:52.917682] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-10-22T21:51:53.667502] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-22T21:51:53.717682] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-10-22T21:51:54.517692] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-10. [2025-10-22T21:51:55.317668] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-10-22T21:51:55.354894] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T21:51:55.945506] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-22T21:51:55.952614] [INFO ] [REMOTE ] WAT: Full fetch complete (50897 records). [2025-10-22T21:51:55.952757] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-22T21:51:56.122733] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-10-22T21:51:56.330223] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-22T21:51:56.330326] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-22T21:51:56.331344] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-22T21:51:56.331436] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-22T21:51:56.332604] [DEBUG] [LOCAL ] WAT: Trimmed 50897 records to 35665 (keeping 200 days of data) [2025-10-22T21:51:56.549991] [DEBUG] [LOCAL ] WAT: Primary data saved (35665 records). [2025-10-22T21:51:56.550120] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-22T21:51:56.550197] [INFO ] [MAIN ] Update Progress: 2270/2367 symbols completed. WAT took 41.3s. Estimated remaining: 12m 28s. Rate: 7.8 symbols/min [2025-10-22T21:51:56.720037] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:51:56.764976] [DEBUG] [LOCAL ] WCN: Loaded 47894 existing records from primary storage. [2025-10-22T21:51:56.765530] [INFO ] [MAIN ] WCN: Loaded 47894 existing records. [2025-10-22T21:51:56.925361] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-10-22T21:51:56.956131] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:51:56.957322] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-22T21:51:56.957397] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-22T21:51:56.957706] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-22T21:51:56.957810] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-22T21:51:57.142625] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T21:51:57.349263] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:51:57.379622] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-22T21:51:57.634759] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-22T21:51:57.717698] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-10-22T21:51:58.517727] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-10. [2025-10-22T21:51:59.232800] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-22T21:51:59.234627] [INFO ] [REMOTE ] WBX: Full fetch complete (21703 records). [2025-10-22T21:51:59.234723] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-22T21:51:59.323904] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-10-22T21:51:59.635583] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-22T21:51:59.635717] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-22T21:51:59.636291] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-22T21:51:59.636429] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-22T21:51:59.665470] [DEBUG] [LOCAL ] WBX: Trimmed 21703 records to 9953 (keeping 200 days of data) [2025-10-22T21:51:59.667620] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-22T21:51:59.747752] [DEBUG] [LOCAL ] WBX: Primary data saved (9953 records). [2025-10-22T21:51:59.747901] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-22T21:51:59.747983] [INFO ] [MAIN ] Update Progress: 2271/2367 symbols completed. WBX took 21.0s. Estimated remaining: 12m 20s. Rate: 7.8 symbols/min [2025-10-22T21:51:59.922474] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:51:59.944233] [DEBUG] [LOCAL ] WD: Loaded 22704 existing records from primary storage. [2025-10-22T21:51:59.944488] [INFO ] [MAIN ] WD: Loaded 22704 existing records. [2025-10-22T21:52:00.116406] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:52:00.116600] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-22T21:52:00.116673] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-22T21:52:00.116865] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-22T21:52:00.116909] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-22T21:52:00.127763] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-10-22T21:52:00.464342] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:52:00.917717] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-10-22T21:52:01.293807] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T21:52:01.508180] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T21:52:01.717726] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-10-22T21:52:01.997513] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-22T21:52:02.517694] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-10-22T21:52:03.317632] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-10-22T21:52:03.433078] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T21:52:03.679441] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-22T21:52:04.117674] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-10-22T21:52:04.786192] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-22T21:52:04.917685] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-10-22T21:52:05.458455] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T21:52:05.717737] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-10-22T21:52:06.319776] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-22T21:52:06.517711] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-10-22T21:52:07.316804] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T21:52:07.326680] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-10-22T21:52:07.790463] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-22T21:52:08.117674] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-10-22T21:52:08.922745] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-10-22T21:52:08.936809] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T21:52:09.717628] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-10-22T21:52:09.804615] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T21:52:10.170827] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-22T21:52:10.517674] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-10-22T21:52:11.217354] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-22T21:52:11.317625] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-10. [2025-10-22T21:52:11.709566] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-22T21:52:12.117668] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-10-22T21:52:12.919334] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-10-22T21:52:12.924009] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-22T21:52:12.932889] [INFO ] [REMOTE ] WBS: Full fetch complete (70370 records). [2025-10-22T21:52:12.933037] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-22T21:52:13.327378] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-22T21:52:13.327496] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-22T21:52:13.328825] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-22T21:52:13.328899] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-22T21:52:13.330371] [DEBUG] [LOCAL ] WBS: Trimmed 70370 records to 48843 (keeping 200 days of data) [2025-10-22T21:52:13.627685] [DEBUG] [LOCAL ] WBS: Primary data saved (48843 records). [2025-10-22T21:52:13.627815] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-22T21:52:13.627894] [INFO ] [MAIN ] Update Progress: 2272/2367 symbols completed. WBS took 38.9s. Estimated remaining: 12m 13s. Rate: 7.8 symbols/min [2025-10-22T21:52:13.719239] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-10-22T21:52:13.801548] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:52:13.826009] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-22T21:52:13.847378] [DEBUG] [LOCAL ] WDH: Loaded 18141 existing records from primary storage. [2025-10-22T21:52:13.847676] [INFO ] [MAIN ] WDH: Loaded 18141 existing records. [2025-10-22T21:52:14.025867] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:52:14.026088] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-22T21:52:14.026144] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-22T21:52:14.026306] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-22T21:52:14.026361] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-22T21:52:14.166266] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-22T21:52:14.399030] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:52:14.517700] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-10-22T21:52:15.317733] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-10-22T21:52:15.495747] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-22T21:52:15.768034] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T21:52:15.857120] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-22T21:52:16.117677] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-10-22T21:52:16.917683] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-10. [2025-10-22T21:52:17.044154] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-22T21:52:17.717705] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-10-22T21:52:18.279737] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-22T21:52:18.285416] [INFO ] [REMOTE ] WCC: Full fetch complete (57182 records). [2025-10-22T21:52:18.285542] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-22T21:52:18.522880] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-10-22T21:52:18.676501] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-22T21:52:18.676598] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-22T21:52:18.677662] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-22T21:52:18.677725] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-22T21:52:18.678934] [DEBUG] [LOCAL ] WCC: Trimmed 57182 records to 38478 (keeping 200 days of data) [2025-10-22T21:52:18.917979] [DEBUG] [LOCAL ] WCC: Primary data saved (38478 records). [2025-10-22T21:52:18.918259] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-22T21:52:18.918357] [INFO ] [MAIN ] Update Progress: 2273/2367 symbols completed. WCC took 37.0s. Estimated remaining: 12m 5s. Rate: 7.8 symbols/min [2025-10-22T21:52:19.087291] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:52:19.106921] [DEBUG] [LOCAL ] WDI: Loaded 21320 existing records from primary storage. [2025-10-22T21:52:19.107175] [INFO ] [MAIN ] WDI: Loaded 21320 existing records. [2025-10-22T21:52:19.286202] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:52:19.286511] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-22T21:52:19.286623] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-22T21:52:19.286948] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-22T21:52:19.287008] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-22T21:52:19.318403] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-10-22T21:52:19.541222] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-22T21:52:19.685358] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:52:19.696064] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-22T21:52:20.117692] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-10-22T21:52:20.498497] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T21:52:20.917631] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-10-22T21:52:20.970875] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-22T21:52:21.717638] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-10-22T21:52:21.967628] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T21:52:22.517674] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-10-22T21:52:23.317710] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-10-22T21:52:23.451046] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T21:52:23.657706] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-22T21:52:24.117711] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-10-22T21:52:24.297615] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T21:52:24.917619] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-10-22T21:52:24.975364] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-22T21:52:25.717705] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-10-22T21:52:25.965975] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-22T21:52:26.517629] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-10-22T21:52:27.317628] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-10. [2025-10-22T21:52:27.402587] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-22T21:52:27.436300] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-22T21:52:28.117626] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-10-22T21:52:28.254734] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T21:52:28.257841] [INFO ] [REMOTE ] WD: Full fetch complete (33041 records). [2025-10-22T21:52:28.257943] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-22T21:52:28.615988] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-22T21:52:28.616103] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-22T21:52:28.616776] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-22T21:52:28.616838] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-22T21:52:28.617614] [DEBUG] [LOCAL ] WD: Trimmed 33041 records to 22521 (keeping 200 days of data) [2025-10-22T21:52:28.754523] [DEBUG] [LOCAL ] WD: Primary data saved (22521 records). [2025-10-22T21:52:28.754659] [INFO ] [MAIN ] WD: Full history saved. [2025-10-22T21:52:28.754758] [INFO ] [MAIN ] Update Progress: 2274/2367 symbols completed. WD took 29.0s. Estimated remaining: 11m 58s. Rate: 7.8 symbols/min [2025-10-22T21:52:28.924564] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-10-22T21:52:28.927751] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:52:28.970802] [DEBUG] [LOCAL ] WDS: Loaded 43057 existing records from primary storage. [2025-10-22T21:52:28.971167] [INFO ] [MAIN ] WDS: Loaded 43057 existing records. [2025-10-22T21:52:29.147719] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:52:29.147932] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-22T21:52:29.147990] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-22T21:52:29.148276] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-10-22T21:52:29.148334] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-22T21:52:29.499834] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:52:29.648884] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-22T21:52:29.717623] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-10. [2025-10-22T21:52:30.104579] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T21:52:30.517678] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-10-22T21:52:31.317716] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-10-22T21:52:31.381157] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T21:52:31.389486] [INFO ] [REMOTE ] WCN: Full fetch complete (69480 records). [2025-10-22T21:52:31.389620] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-22T21:52:31.534707] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-22T21:52:31.817759] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-22T21:52:31.817872] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-22T21:52:31.819044] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-22T21:52:31.819111] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-22T21:52:31.820525] [DEBUG] [LOCAL ] WCN: Trimmed 69480 records to 47886 (keeping 200 days of data) [2025-10-22T21:52:32.079957] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-22T21:52:32.126902] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-10-22T21:52:32.143387] [DEBUG] [LOCAL ] WCN: Primary data saved (47886 records). [2025-10-22T21:52:32.143541] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-22T21:52:32.144271] [INFO ] [MAIN ] Update Progress: 2275/2367 symbols completed. WCN took 35.6s. Estimated remaining: 11m 50s. Rate: 7.8 symbols/min [2025-10-22T21:52:32.310519] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:52:32.320337] [DEBUG] [LOCAL ] WEA: Loaded 7901 existing records from primary storage. [2025-10-22T21:52:32.320554] [INFO ] [MAIN ] WEA: Loaded 7901 existing records. [2025-10-22T21:52:32.495999] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:52:32.496259] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-22T21:52:32.496317] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-22T21:52:32.496491] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-22T21:52:32.496545] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-22T21:52:32.845541] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:52:32.917678] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-10-22T21:52:33.220220] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-22T21:52:33.717735] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-10-22T21:52:34.517707] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-10-22T21:52:34.604085] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-22T21:52:34.755471] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-22T21:52:35.149074] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-22T21:52:35.317683] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-10-22T21:52:36.117678] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-10-22T21:52:36.917661] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-10-22T21:52:36.966084] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-22T21:52:37.161231] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T21:52:37.717619] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-10-22T21:52:37.920788] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-22T21:52:38.517708] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-10-22T21:52:38.887206] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-22T21:52:39.317631] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-10. [2025-10-22T21:52:39.534011] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-22T21:52:40.117700] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-10-22T21:52:40.130028] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T21:52:40.134446] [INFO ] [REMOTE ] WDH: Full fetch complete (23930 records). [2025-10-22T21:52:40.134559] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-22T21:52:40.500405] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-22T21:52:40.500500] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-22T21:52:40.501078] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-22T21:52:40.501187] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-22T21:52:40.501872] [DEBUG] [LOCAL ] WDH: Trimmed 23930 records to 18039 (keeping 200 days of data) [2025-10-22T21:52:40.603427] [DEBUG] [LOCAL ] WDH: Primary data saved (18039 records). [2025-10-22T21:52:40.603556] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-22T21:52:40.603669] [INFO ] [MAIN ] Update Progress: 2276/2367 symbols completed. WDH took 27.0s. Estimated remaining: 11m 42s. Rate: 7.8 symbols/min [2025-10-22T21:52:40.769332] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:52:40.805324] [DEBUG] [LOCAL ] WEAV: Loaded 42398 existing records from primary storage. [2025-10-22T21:52:40.805684] [INFO ] [MAIN ] WEAV: Loaded 42398 existing records. [2025-10-22T21:52:40.922803] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-10-22T21:52:40.985030] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:52:40.985211] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-22T21:52:40.985256] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-22T21:52:40.985445] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-22T21:52:40.985501] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-22T21:52:41.333130] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:52:41.573023] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-22T21:52:41.717629] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-10. [2025-10-22T21:52:41.880800] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-22T21:52:42.369867] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-22T21:52:42.373735] [INFO ] [REMOTE ] WDI: Full fetch complete (30346 records). [2025-10-22T21:52:42.373814] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-22T21:52:42.523073] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-10-22T21:52:42.750816] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-22T21:52:42.750894] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-22T21:52:42.751555] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-22T21:52:42.751596] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-22T21:52:42.752296] [DEBUG] [LOCAL ] WDI: Trimmed 30346 records to 21235 (keeping 200 days of data) [2025-10-22T21:52:42.877365] [DEBUG] [LOCAL ] WDI: Primary data saved (21235 records). [2025-10-22T21:52:42.877509] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-22T21:52:42.877603] [INFO ] [MAIN ] Update Progress: 2277/2367 symbols completed. WDI took 24.0s. Estimated remaining: 11m 34s. Rate: 7.8 symbols/min [2025-10-22T21:52:43.292816] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-22T21:52:43.317614] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-10-22T21:52:43.879792] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-22T21:52:44.117668] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-10-22T21:52:44.857434] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T21:52:44.917697] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-10-22T21:52:45.717689] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-10-22T21:52:46.419399] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-22T21:52:46.442282] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-22T21:52:46.517747] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-10-22T21:52:47.317708] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-10-22T21:52:48.117668] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-10-22T21:52:48.149032] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T21:52:48.167409] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-22T21:52:48.917672] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-10-22T21:52:49.608806] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-22T21:52:49.722302] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-10-22T21:52:49.724922] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T21:52:50.497490] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-22T21:52:50.517605] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-10. [2025-10-22T21:52:51.303755] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-22T21:52:51.306054] [INFO ] [REMOTE ] WEA: Full fetch complete (10149 records). [2025-10-22T21:52:51.306127] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-22T21:52:51.322756] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-10-22T21:52:51.682198] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-22T21:52:51.682286] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-22T21:52:51.682534] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-22T21:52:51.682573] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-22T21:52:51.683041] [DEBUG] [LOCAL ] WEA: Trimmed 10149 records to 7893 (keeping 200 days of data) [2025-10-22T21:52:51.730282] [DEBUG] [LOCAL ] WEA: Primary data saved (7893 records). [2025-10-22T21:52:51.730391] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-22T21:52:51.730465] [INFO ] [MAIN ] Update Progress: 2278/2367 symbols completed. WEA took 19.6s. Estimated remaining: 11m 26s. Rate: 7.8 symbols/min [2025-10-22T21:52:52.117629] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-10-22T21:52:53.022407] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-22T21:52:53.031549] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-10-22T21:52:53.610875] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T21:52:53.717633] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-10-22T21:52:54.578695] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T21:52:54.593195] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-10-22T21:52:55.338912] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T21:52:55.348117] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-10-22T21:52:56.153138] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T21:52:56.165220] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-10-22T21:52:56.877680] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T21:52:56.917617] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-10-22T21:52:57.346934] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T21:52:57.717736] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-10-22T21:52:58.369842] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T21:52:58.517767] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-10-22T21:52:59.360154] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T21:52:59.369690] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-10. [2025-10-22T21:52:59.995878] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T21:53:00.117710] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-10-22T21:53:00.893359] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T21:53:00.900836] [INFO ] [REMOTE ] WDS: Full fetch complete (64158 records). [2025-10-22T21:53:00.900943] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-22T21:53:01.297010] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-22T21:53:01.297087] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-22T21:53:01.298175] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-22T21:53:01.298237] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-22T21:53:01.299509] [DEBUG] [LOCAL ] WDS: Trimmed 64158 records to 43018 (keeping 200 days of data) [2025-10-22T21:53:01.553117] [DEBUG] [LOCAL ] WDS: Primary data saved (43018 records). [2025-10-22T21:53:01.553241] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-22T21:53:01.553315] [INFO ] [MAIN ] Update Progress: 2279/2367 symbols completed. WDS took 32.8s. Estimated remaining: 11m 19s. Rate: 7.8 symbols/min [2025-10-22T21:53:01.831840] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T21:53:01.841588] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-10-22T21:53:03.420135] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T21:53:03.434589] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-10. [2025-10-22T21:53:05.035199] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-22T21:53:05.043114] [INFO ] [REMOTE ] WEAV: Full fetch complete (61801 records). [2025-10-22T21:53:05.043272] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-22T21:53:05.441907] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-22T21:53:05.441987] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-22T21:53:05.443058] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-22T21:53:05.443121] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-22T21:53:05.444312] [DEBUG] [LOCAL ] WEAV: Trimmed 61801 records to 42360 (keeping 200 days of data) [2025-10-22T21:53:05.682309] [DEBUG] [LOCAL ] WEAV: Primary data saved (42360 records). [2025-10-22T21:53:05.682431] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-22T21:53:05.682508] [INFO ] [MAIN ] Update Progress: 2280/2367 symbols completed. WEAV took 25.1s. Estimated remaining: 11m 11s. Rate: 7.8 symbols/min [2025-10-22T21:53:06.270800] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:53:06.369854] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:53:06.348744] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:53:06.401693] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:53:06.458480] [DEBUG] [LOCAL ] WEX: Loaded 32548 existing records from primary storage. [2025-10-22T21:53:06.469103] [INFO ] [MAIN ] WEX: Loaded 32548 existing records. [2025-10-22T21:53:06.626083] [DEBUG] [LOCAL ] WEC: Loaded 52175 existing records from primary storage. [2025-10-22T21:53:06.639504] [INFO ] [MAIN ] WEC: Loaded 52175 existing records. [2025-10-22T21:53:06.634105] [DEBUG] [LOCAL ] WELL: Loaded 52310 existing records from primary storage. [2025-10-22T21:53:06.665995] [INFO ] [MAIN ] WELL: Loaded 52310 existing records. [2025-10-22T21:53:06.752216] [DEBUG] [LOCAL ] WES: Loaded 48732 existing records from primary storage. [2025-10-22T21:53:06.778803] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:53:06.852223] [INFO ] [MAIN ] WES: Loaded 48732 existing records. [2025-10-22T21:53:06.867809] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-22T21:53:06.873065] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-22T21:53:06.908663] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-22T21:53:06.940989] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-22T21:53:07.239555] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:53:07.206837] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:53:07.256146] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-22T21:53:07.307892] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-22T21:53:07.321259] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-22T21:53:07.340956] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-22T21:53:07.373256] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-22T21:53:07.373638] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-22T21:53:07.373173] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:53:07.373775] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-22T21:53:07.379143] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-22T21:53:07.389448] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-22T21:53:07.500837] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-22T21:53:07.553429] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-22T21:53:07.588742] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-22T21:53:08.265242] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:53:08.289588] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-10-22T21:53:08.617371] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:53:08.668893] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-10-22T21:53:08.746026] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:53:08.747760] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-10-22T21:53:08.835770] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:53:08.836119] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-10-22T21:53:09.765195] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T21:53:09.771685] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-10-22T21:53:10.540795] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T21:53:10.551501] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-10-22T21:53:10.629593] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-22T21:53:10.639553] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-10-22T21:53:10.742261] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-22T21:53:10.754676] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-10-22T21:53:11.244005] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T21:53:11.253332] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-10-22T21:53:11.911385] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T21:53:11.921262] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-10-22T21:53:12.192282] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T21:53:12.201907] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-10-22T21:53:12.620879] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-22T21:53:12.630823] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-10-22T21:53:13.098179] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-22T21:53:13.108047] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-10-22T21:53:13.495294] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T21:53:13.506710] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-10-22T21:53:13.563611] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T21:53:13.717635] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-10-22T21:53:14.576639] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-22T21:53:14.587716] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-10-22T21:53:14.726591] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T21:53:15.317705] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-10-22T21:53:15.384090] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T21:53:15.464021] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T21:53:16.117701] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-10-22T21:53:16.556669] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-22T21:53:16.589084] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-22T21:53:16.917703] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-10-22T21:53:17.722815] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-10-22T21:53:17.749690] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-22T21:53:18.527968] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-10-22T21:53:18.533371] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T21:53:19.089125] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-22T21:53:19.317624] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-10-22T21:53:20.117628] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-10-22T21:53:20.704069] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-22T21:53:20.920164] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-10-22T21:53:20.926188] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T21:53:21.441848] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-22T21:53:21.717727] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-10-22T21:53:22.517719] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-10-22T21:53:22.646368] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T21:53:23.317751] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-10-22T21:53:23.481398] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-22T21:53:24.117681] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-10-22T21:53:24.246224] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T21:53:24.307542] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T21:53:24.917705] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-10-22T21:53:25.602053] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T21:53:25.717683] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-10-22T21:53:26.517731] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-10-22T21:53:26.660546] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-22T21:53:27.317705] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-10-22T21:53:27.453807] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-22T21:53:27.745861] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-22T21:53:28.117723] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-10. [2025-10-22T21:53:28.917714] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-10-22T21:53:29.111985] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T21:53:29.378184] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-22T21:53:29.385216] [INFO ] [REMOTE ] WEX: Full fetch complete (50450 records). [2025-10-22T21:53:29.385376] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-22T21:53:29.722892] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-10-22T21:53:29.764414] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-22T21:53:29.764492] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-22T21:53:29.765477] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-22T21:53:29.765539] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-22T21:53:29.766737] [DEBUG] [LOCAL ] WEX: Trimmed 50450 records to 32398 (keeping 200 days of data) [2025-10-22T21:53:29.958001] [DEBUG] [LOCAL ] WEX: Primary data saved (32398 records). [2025-10-22T21:53:29.958131] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-22T21:53:29.958206] [INFO ] [MAIN ] Update Progress: 2281/2367 symbols completed. WEX took 24.3s. Estimated remaining: 11m 4s. Rate: 7.8 symbols/min [2025-10-22T21:53:30.123735] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:53:30.135095] [DEBUG] [LOCAL ] WF: Loaded 10842 existing records from primary storage. [2025-10-22T21:53:30.135280] [INFO ] [MAIN ] WF: Loaded 10842 existing records. [2025-10-22T21:53:30.317248] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:53:30.317490] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-22T21:53:30.317553] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-22T21:53:30.317773] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-22T21:53:30.317830] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-22T21:53:30.525762] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-10-22T21:53:30.704765] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T21:53:30.708956] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:53:31.317670] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-10-22T21:53:31.561412] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T21:53:32.117634] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-10-22T21:53:32.277257] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T21:53:32.877784] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T21:53:32.917633] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-10. [2025-10-22T21:53:33.023894] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-22T21:53:33.717684] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-10. [2025-10-22T21:53:34.472216] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T21:53:34.480898] [INFO ] [REMOTE ] WELL: Full fetch complete (76003 records). [2025-10-22T21:53:34.481051] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-22T21:53:34.523675] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-10. [2025-10-22T21:53:34.883893] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-22T21:53:34.897257] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-22T21:53:34.907546] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-22T21:53:34.907712] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-22T21:53:34.912502] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-22T21:53:34.922919] [DEBUG] [LOCAL ] WELL: Trimmed 76003 records to 52296 (keeping 200 days of data) [2025-10-22T21:53:34.923191] [INFO ] [REMOTE ] WES: Full fetch complete (70656 records). [2025-10-22T21:53:34.923882] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-22T21:53:35.352790] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-10-22T21:53:35.591391] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-22T21:53:35.641779] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-22T21:53:35.647052] [INFO ] [REMOTE ] WEC: Full fetch complete (75910 records). [2025-10-22T21:53:35.647188] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-22T21:53:35.646935] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-22T21:53:35.650391] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-22T21:53:35.650492] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-22T21:53:35.743398] [DEBUG] [LOCAL ] WES: Trimmed 70656 records to 48723 (keeping 200 days of data) [2025-10-22T21:53:36.322854] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-22T21:53:36.340783] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-10-22T21:53:36.410303] [DEBUG] [LOCAL ] WELL: Primary data saved (52296 records). [2025-10-22T21:53:36.419205] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-22T21:53:36.419491] [INFO ] [MAIN ] Update Progress: 2282/2367 symbols completed. WELL took 30.7s. Estimated remaining: 10m 56s. Rate: 7.8 symbols/min [2025-10-22T21:53:36.563297] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-22T21:53:36.599120] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-22T21:53:36.642123] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-22T21:53:36.664848] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-22T21:53:36.664687] [DEBUG] [LOCAL ] WES: Primary data saved (48723 records). [2025-10-22T21:53:36.665496] [INFO ] [MAIN ] WES: Full history saved. [2025-10-22T21:53:36.665727] [INFO ] [MAIN ] Update Progress: 2283/2367 symbols completed. WES took 31.0s. Estimated remaining: 10m 48s. Rate: 7.8 symbols/min [2025-10-22T21:53:36.792590] [DEBUG] [LOCAL ] WEC: Trimmed 75910 records to 52169 (keeping 200 days of data) [2025-10-22T21:53:36.859933] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:53:37.022266] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:53:37.157963] [DEBUG] [LOCAL ] WFG: Loaded 24602 existing records from primary storage. [2025-10-22T21:53:37.184876] [INFO ] [MAIN ] WFG: Loaded 24602 existing records. [2025-10-22T21:53:37.335438] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-22T21:53:37.351313] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-22T21:53:37.385462] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-10-22T21:53:37.385181] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-10-22T21:53:37.567560] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:53:37.602281] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-22T21:53:37.602812] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-22T21:53:37.638732] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-22T21:53:37.639309] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-22T21:53:37.719093] [DEBUG] [LOCAL ] WEC: Primary data saved (52169 records). [2025-10-22T21:53:37.746940] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-22T21:53:37.780149] [INFO ] [MAIN ] Update Progress: 2284/2367 symbols completed. WEC took 32.1s. Estimated remaining: 10m 40s. Rate: 7.8 symbols/min [2025-10-22T21:53:37.854126] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:53:37.926422] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-22T21:53:37.931702] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-22T21:53:38.027897] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-22T21:53:38.038109] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-22T21:53:38.298825] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:53:38.451631] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:53:38.471691] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-10-22T21:53:38.656944] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-22T21:53:38.663379] [DEBUG] [LOCAL ] WGO: Loaded 37930 existing records from primary storage. [2025-10-22T21:53:38.722683] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:53:38.723171] [INFO ] [MAIN ] WGO: Loaded 37930 existing records. [2025-10-22T21:53:38.723065] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-10-22T21:53:38.902717] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:53:38.902955] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-22T21:53:38.903032] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-22T21:53:38.903305] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-22T21:53:38.903359] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-22T21:53:39.284052] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:53:39.317622] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-10-22T21:53:39.748615] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-22T21:53:40.103809] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-22T21:53:40.117625] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-10-22T21:53:40.802404] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-22T21:53:40.917736] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-10-22T21:53:40.928305] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T21:53:41.717919] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-10-22T21:53:42.517720] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-10-22T21:53:42.791925] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-22T21:53:43.261376] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T21:53:43.317618] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-10-22T21:53:43.714489] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-22T21:53:44.117695] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-10-22T21:53:44.917630] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-10-22T21:53:45.399538] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-22T21:53:45.540498] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T21:53:45.562601] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-22T21:53:45.717679] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-10-22T21:53:46.450535] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-22T21:53:46.517621] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-10-22T21:53:47.317744] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-10-22T21:53:48.117953] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-10-22T21:53:48.120801] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-22T21:53:48.658275] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T21:53:48.917718] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-10-22T21:53:49.717702] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-10-22T21:53:49.750147] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-22T21:53:50.363018] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-22T21:53:50.517748] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-10. [2025-10-22T21:53:51.312861] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T21:53:51.318425] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-10-22T21:53:51.329472] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-22T21:53:51.331933] [INFO ] [REMOTE ] WF: Full fetch complete (16032 records). [2025-10-22T21:53:51.332014] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-22T21:53:51.692688] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-22T21:53:51.692781] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-22T21:53:51.693310] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-22T21:53:51.693349] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-22T21:53:51.694040] [DEBUG] [LOCAL ] WF: Trimmed 16032 records to 10726 (keeping 200 days of data) [2025-10-22T21:53:51.758112] [DEBUG] [LOCAL ] WF: Primary data saved (10726 records). [2025-10-22T21:53:51.758235] [INFO ] [MAIN ] WF: Full history saved. [2025-10-22T21:53:51.758312] [INFO ] [MAIN ] Update Progress: 2285/2367 symbols completed. WF took 21.8s. Estimated remaining: 10m 33s. Rate: 7.8 symbols/min [2025-10-22T21:53:51.925255] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:53:51.963916] [DEBUG] [LOCAL ] WH: Loaded 45230 existing records from primary storage. [2025-10-22T21:53:51.964232] [INFO ] [MAIN ] WH: Loaded 45230 existing records. [2025-10-22T21:53:52.135628] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-10-22T21:53:52.163897] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:53:52.164810] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-22T21:53:52.164901] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-22T21:53:52.165091] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-22T21:53:52.165132] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-22T21:53:52.518914] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:53:52.917706] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-10-22T21:53:53.309255] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-22T21:53:53.389258] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T21:53:53.717673] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-10-22T21:53:54.395444] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-22T21:53:54.517670] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-10-22T21:53:54.956493] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-22T21:53:55.317716] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-10-22T21:53:56.117713] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-10-22T21:53:56.179267] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T21:53:56.917677] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-10-22T21:53:57.173264] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T21:53:57.427374] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-22T21:53:57.717678] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-10-22T21:53:58.476076] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-22T21:53:58.517720] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-10-22T21:53:59.317730] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-10-22T21:53:59.961937] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-22T21:54:00.026476] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T21:54:00.054672] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-22T21:54:00.117663] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-10-22T21:54:00.917722] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-10-22T21:54:01.482262] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-22T21:54:01.717706] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-10-22T21:54:02.522771] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-10-22T21:54:02.536281] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T21:54:03.317684] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-10-22T21:54:03.947398] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-22T21:54:04.089729] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T21:54:04.117611] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-10-22T21:54:04.521595] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-22T21:54:04.917720] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-10-22T21:54:05.713941] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T21:54:05.723010] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-10. [2025-10-22T21:54:06.517710] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-10-22T21:54:06.913611] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-22T21:54:07.159304] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T21:54:07.168917] [INFO ] [REMOTE ] WGO: Full fetch complete (57105 records). [2025-10-22T21:54:07.169150] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-22T21:54:07.325619] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-10-22T21:54:07.548506] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-22T21:54:07.548599] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-22T21:54:07.549672] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-22T21:54:07.549735] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-22T21:54:07.550929] [DEBUG] [LOCAL ] WGO: Trimmed 57105 records to 37944 (keeping 200 days of data) [2025-10-22T21:54:07.795890] [DEBUG] [LOCAL ] WGO: Primary data saved (37944 records). [2025-10-22T21:54:07.796039] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-22T21:54:07.796153] [INFO ] [MAIN ] Update Progress: 2286/2367 symbols completed. WGO took 30.0s. Estimated remaining: 10m 25s. Rate: 7.8 symbols/min [2025-10-22T21:54:07.979154] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:54:08.015036] [DEBUG] [LOCAL ] WHD: Loaded 39984 existing records from primary storage. [2025-10-22T21:54:08.015423] [INFO ] [MAIN ] WHD: Loaded 39984 existing records. [2025-10-22T21:54:08.122858] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-10. [2025-10-22T21:54:08.212948] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:54:08.213566] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-22T21:54:08.213679] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-22T21:54:08.214052] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-22T21:54:08.214119] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-22T21:54:08.489351] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T21:54:08.506465] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T21:54:08.663003] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:54:08.917620] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-10-22T21:54:09.070215] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-22T21:54:09.078906] [INFO ] [REMOTE ] WFC: Full fetch complete (77926 records). [2025-10-22T21:54:09.079019] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-22T21:54:09.462161] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-22T21:54:09.462240] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-22T21:54:09.463414] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-22T21:54:09.463476] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-22T21:54:09.464997] [DEBUG] [LOCAL ] WFC: Trimmed 77926 records to 53748 (keeping 200 days of data) [2025-10-22T21:54:09.741085] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-10-22T21:54:09.791533] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-10-22T21:54:09.791635] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-22T21:54:09.791748] [INFO ] [MAIN ] Update Progress: 2287/2367 symbols completed. WFC took 33.4s. Estimated remaining: 10m 17s. Rate: 7.8 symbols/min [2025-10-22T21:54:09.968582] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:54:09.973933] [DEBUG] [LOCAL ] WHG: Loaded 3061 existing records from primary storage. [2025-10-22T21:54:09.974092] [INFO ] [MAIN ] WHG: Loaded 3061 existing records. [2025-10-22T21:54:10.153520] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-22T21:54:10.179495] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:54:10.180167] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-22T21:54:10.180258] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-22T21:54:10.180750] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-22T21:54:10.180809] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-22T21:54:10.522863] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-10. [2025-10-22T21:54:10.528216] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:54:11.317676] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-10-22T21:54:11.361578] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-22T21:54:11.417132] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-22T21:54:11.421456] [INFO ] [REMOTE ] WFG: Full fetch complete (36472 records). [2025-10-22T21:54:11.421531] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-22T21:54:11.780020] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-22T21:54:11.780096] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-22T21:54:11.780808] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-22T21:54:11.780867] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-22T21:54:11.781601] [DEBUG] [LOCAL ] WFG: Trimmed 36472 records to 24486 (keeping 200 days of data) [2025-10-22T21:54:11.931199] [DEBUG] [LOCAL ] WFG: Primary data saved (24486 records). [2025-10-22T21:54:11.931318] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-22T21:54:11.931393] [INFO ] [MAIN ] Update Progress: 2288/2367 symbols completed. WFG took 35.3s. Estimated remaining: 10m 9s. Rate: 7.8 symbols/min [2025-10-22T21:54:12.099249] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:54:12.122573] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-10-22T21:54:12.142563] [DEBUG] [LOCAL ] WHR: Loaded 48906 existing records from primary storage. [2025-10-22T21:54:12.142891] [INFO ] [MAIN ] WHR: Loaded 48906 existing records. [2025-10-22T21:54:12.317309] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:54:12.317540] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-22T21:54:12.317597] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-22T21:54:12.317947] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-22T21:54:12.318000] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-22T21:54:12.679103] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:54:12.658752] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-22T21:54:12.742796] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T21:54:12.917615] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-10-22T21:54:13.717637] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-10-22T21:54:14.517701] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-10-22T21:54:14.682416] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-22T21:54:15.096918] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-22T21:54:15.161497] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T21:54:15.317614] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-10-22T21:54:16.117731] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-10-22T21:54:16.917687] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-10-22T21:54:17.290590] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-22T21:54:17.484173] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-22T21:54:17.717670] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-10-22T21:54:17.932387] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-22T21:54:18.517697] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-10-22T21:54:19.317634] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-10-22T21:54:19.434971] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-22T21:54:19.877565] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-22T21:54:20.117726] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-10-22T21:54:20.912288] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-22T21:54:20.921500] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-10-22T21:54:21.510321] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-22T21:54:21.717892] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-10-22T21:54:21.786317] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-22T21:54:22.517721] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-10-22T21:54:23.317680] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-10-22T21:54:23.606110] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-22T21:54:24.117743] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-10-22T21:54:24.179987] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T21:54:24.822427] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-22T21:54:24.917691] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-10-22T21:54:25.717619] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-10-22T21:54:25.913409] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-22T21:54:26.329323] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T21:54:26.341135] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T21:54:26.517668] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-10-22T21:54:27.317734] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-10-22T21:54:28.064793] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T21:54:28.117709] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-10-22T21:54:28.801345] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-22T21:54:28.917690] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-10-22T21:54:28.984337] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-22T21:54:29.717716] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-10. [2025-10-22T21:54:30.423286] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T21:54:30.517694] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-10-22T21:54:31.290144] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T21:54:31.297745] [INFO ] [REMOTE ] WH: Full fetch complete (65664 records). [2025-10-22T21:54:31.297873] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-22T21:54:31.328695] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-10-22T21:54:31.680164] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-22T21:54:31.680242] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-22T21:54:31.681354] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-22T21:54:31.681428] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-22T21:54:31.682625] [DEBUG] [LOCAL ] WH: Trimmed 65664 records to 45260 (keeping 200 days of data) [2025-10-22T21:54:31.959816] [DEBUG] [LOCAL ] WH: Primary data saved (45260 records). [2025-10-22T21:54:31.960092] [INFO ] [MAIN ] WH: Full history saved. [2025-10-22T21:54:31.960202] [INFO ] [MAIN ] Update Progress: 2289/2367 symbols completed. WH took 40.2s. Estimated remaining: 10m 2s. Rate: 7.8 symbols/min [2025-10-22T21:54:32.117972] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-10-22T21:54:32.128431] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:54:32.137268] [DEBUG] [LOCAL ] WIA: Loaded 5024 existing records from primary storage. [2025-10-22T21:54:32.137445] [INFO ] [MAIN ] WIA: Loaded 5024 existing records. [2025-10-22T21:54:32.312747] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:54:32.313182] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-22T21:54:32.313275] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-22T21:54:32.313622] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-22T21:54:32.313765] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-22T21:54:32.712575] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:54:32.721809] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-22T21:54:32.765409] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-22T21:54:32.834388] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T21:54:32.917619] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-10. [2025-10-22T21:54:33.717692] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-10-22T21:54:34.436679] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-22T21:54:34.517759] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-10-22T21:54:34.580247] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-22T21:54:34.586999] [INFO ] [REMOTE ] WHD: Full fetch complete (57975 records). [2025-10-22T21:54:34.587099] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-22T21:54:34.969178] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-22T21:54:34.969258] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-22T21:54:34.970615] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-22T21:54:34.970712] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-22T21:54:34.971919] [DEBUG] [LOCAL ] WHD: Trimmed 57975 records to 39955 (keeping 200 days of data) [2025-10-22T21:54:35.066438] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-22T21:54:35.224004] [DEBUG] [LOCAL ] WHD: Primary data saved (39955 records). [2025-10-22T21:54:35.224151] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-22T21:54:35.224237] [INFO ] [MAIN ] Update Progress: 2290/2367 symbols completed. WHD took 27.4s. Estimated remaining: 9m 54s. Rate: 7.8 symbols/min [2025-10-22T21:54:35.322925] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-10-22T21:54:35.395749] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:54:35.408160] [DEBUG] [LOCAL ] WINN: Loaded 11361 existing records from primary storage. [2025-10-22T21:54:35.408391] [INFO ] [MAIN ] WINN: Loaded 11361 existing records. [2025-10-22T21:54:35.584626] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:54:35.585003] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-22T21:54:35.585056] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-22T21:54:35.585273] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-22T21:54:35.585328] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-22T21:54:35.942886] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:54:36.117674] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-10-22T21:54:36.917702] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-10-22T21:54:37.017955] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-22T21:54:37.129577] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T21:54:37.298125] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-22T21:54:37.717674] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-10-22T21:54:38.517710] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-10-22T21:54:39.309895] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-22T21:54:39.317608] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-10-22T21:54:39.885951] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-22T21:54:40.070344] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-22T21:54:40.117620] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-10. [2025-10-22T21:54:40.917629] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-10-22T21:54:41.717714] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-10-22T21:54:41.748861] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-22T21:54:41.888379] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-22T21:54:41.896426] [INFO ] [REMOTE ] WHR: Full fetch complete (69730 records). [2025-10-22T21:54:41.896545] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-22T21:54:42.288964] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-22T21:54:42.289062] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-22T21:54:42.290522] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-22T21:54:42.290599] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-22T21:54:42.292251] [DEBUG] [LOCAL ] WHR: Trimmed 69730 records to 48900 (keeping 200 days of data) [2025-10-22T21:54:42.417912] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-22T21:54:42.534254] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-10-22T21:54:42.722591] [DEBUG] [LOCAL ] WHR: Primary data saved (48900 records). [2025-10-22T21:54:42.722813] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-22T21:54:42.722948] [INFO ] [MAIN ] Update Progress: 2291/2367 symbols completed. WHR took 30.8s. Estimated remaining: 9m 46s. Rate: 7.8 symbols/min [2025-10-22T21:54:42.942779] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:54:42.993701] [DEBUG] [LOCAL ] WIT: Loaded 52532 existing records from primary storage. [2025-10-22T21:54:42.994042] [INFO ] [MAIN ] WIT: Loaded 52532 existing records. [2025-10-22T21:54:43.214545] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:54:43.214927] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-22T21:54:43.214999] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-22T21:54:43.215452] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-22T21:54:43.215511] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-22T21:54:43.322828] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-10. [2025-10-22T21:54:43.353016] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-22T21:54:43.618224] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:54:43.751595] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-22T21:54:43.752432] [INFO ] [REMOTE ] WHG: Full fetch complete (4376 records). [2025-10-22T21:54:43.752503] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-22T21:54:44.139035] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-10-22T21:54:44.148552] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-22T21:54:44.148629] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-22T21:54:44.148840] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-22T21:54:44.148890] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-22T21:54:44.149293] [DEBUG] [LOCAL ] WHG: Trimmed 4376 records to 3052 (keeping 200 days of data) [2025-10-22T21:54:44.170761] [DEBUG] [LOCAL ] WHG: Primary data saved (3052 records). [2025-10-22T21:54:44.170851] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-22T21:54:44.170926] [INFO ] [MAIN ] Update Progress: 2292/2367 symbols completed. WHG took 34.4s. Estimated remaining: 9m 39s. Rate: 7.8 symbols/min [2025-10-22T21:54:44.366225] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:54:44.387369] [DEBUG] [LOCAL ] WIW: Loaded 20275 existing records from primary storage. [2025-10-22T21:54:44.387983] [INFO ] [MAIN ] WIW: Loaded 20275 existing records. [2025-10-22T21:54:44.573725] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:54:44.573979] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-22T21:54:44.574028] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-22T21:54:44.574194] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-10-22T21:54:44.574232] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-22T21:54:44.922910] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-10-22T21:54:44.927766] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:54:45.130472] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T21:54:45.717680] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-10-22T21:54:46.517670] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-10-22T21:54:46.519957] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-22T21:54:46.651937] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T21:54:47.150489] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-22T21:54:47.317697] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-10-22T21:54:48.093311] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T21:54:48.117689] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-10-22T21:54:48.917855] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-10-22T21:54:49.717755] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-10-22T21:54:49.774837] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T21:54:50.041828] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T21:54:50.374387] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-22T21:54:50.517680] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-10-22T21:54:51.317703] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-10-22T21:54:52.122498] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-10-22T21:54:52.123522] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T21:54:52.321209] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T21:54:52.917747] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-10-22T21:54:53.119235] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-22T21:54:53.710408] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-22T21:54:53.717603] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-10-22T21:54:54.504567] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T21:54:54.517601] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-10. [2025-10-22T21:54:55.298968] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-22T21:54:55.301232] [INFO ] [REMOTE ] WINN: Full fetch complete (17373 records). [2025-10-22T21:54:55.301302] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-22T21:54:55.322786] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-10-22T21:54:55.667572] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-22T21:54:55.667674] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-22T21:54:55.668066] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-22T21:54:55.668106] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-22T21:54:55.668590] [DEBUG] [LOCAL ] WINN: Trimmed 17373 records to 11207 (keeping 200 days of data) [2025-10-22T21:54:55.733171] [DEBUG] [LOCAL ] WINN: Primary data saved (11207 records). [2025-10-22T21:54:55.733293] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-22T21:54:55.733370] [INFO ] [MAIN ] Update Progress: 2293/2367 symbols completed. WINN took 20.5s. Estimated remaining: 9m 31s. Rate: 7.8 symbols/min [2025-10-22T21:54:55.905877] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:54:55.939747] [DEBUG] [LOCAL ] WK: Loaded 37158 existing records from primary storage. [2025-10-22T21:54:55.940025] [INFO ] [MAIN ] WK: Loaded 37158 existing records. [2025-10-22T21:54:56.126298] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-10-22T21:54:56.128525] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T21:54:56.132321] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:54:56.135282] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-22T21:54:56.135354] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-22T21:54:56.135736] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-22T21:54:56.135825] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-22T21:54:56.485872] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:54:56.917757] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-10-22T21:54:57.717668] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-10-22T21:54:57.989209] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T21:54:58.102059] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-22T21:54:58.349261] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T21:54:58.517633] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-10-22T21:54:59.317728] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-10-22T21:55:00.117710] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-10-22T21:55:00.275028] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-22T21:55:00.917702] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-10-22T21:55:00.943968] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T21:55:01.280120] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-22T21:55:01.576797] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-22T21:55:01.717691] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-10-22T21:55:02.517733] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-10-22T21:55:03.317681] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-10. [2025-10-22T21:55:03.488886] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-22T21:55:04.006149] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-22T21:55:04.007716] [INFO ] [REMOTE ] WIA: Full fetch complete (7271 records). [2025-10-22T21:55:04.007786] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-22T21:55:04.118023] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-10-22T21:55:04.197503] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-22T21:55:04.412332] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-22T21:55:04.412417] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-22T21:55:04.412619] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-22T21:55:04.412692] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-22T21:55:04.413123] [DEBUG] [LOCAL ] WIA: Trimmed 7271 records to 5029 (keeping 200 days of data) [2025-10-22T21:55:04.442924] [DEBUG] [LOCAL ] WIA: Primary data saved (5029 records). [2025-10-22T21:55:04.443054] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-22T21:55:04.443179] [INFO ] [MAIN ] Update Progress: 2294/2367 symbols completed. WIA took 32.5s. Estimated remaining: 9m 23s. Rate: 7.8 symbols/min [2025-10-22T21:55:04.614589] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:55:04.646541] [DEBUG] [LOCAL ] WKC: Loaded 34474 existing records from primary storage. [2025-10-22T21:55:04.646844] [INFO ] [MAIN ] WKC: Loaded 34474 existing records. [2025-10-22T21:55:04.819242] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:55:04.819458] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-22T21:55:04.819508] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-22T21:55:04.819755] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-22T21:55:04.819813] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-22T21:55:04.918152] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-10-22T21:55:05.203996] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:55:05.717705] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-10-22T21:55:06.171417] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-22T21:55:06.517717] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-10-22T21:55:06.673378] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-22T21:55:06.674420] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-22T21:55:07.317675] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-10-22T21:55:07.699447] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-22T21:55:08.117629] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-10-22T21:55:08.812099] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T21:55:08.917628] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-10-22T21:55:09.478772] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-22T21:55:09.717624] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-10-22T21:55:10.517700] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-10-22T21:55:10.835921] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-22T21:55:10.869603] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-22T21:55:11.317713] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-10-22T21:55:12.117679] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-10-22T21:55:12.320205] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T21:55:12.709099] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T21:55:12.917627] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-10-22T21:55:13.139716] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-22T21:55:13.717736] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-10-22T21:55:14.517742] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-10-22T21:55:14.572840] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-22T21:55:14.939808] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-22T21:55:15.317682] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-10-22T21:55:16.036342] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-22T21:55:16.117674] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-10-22T21:55:16.761854] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-22T21:55:16.917661] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-10-22T21:55:17.668175] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T21:55:17.722702] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-10-22T21:55:17.724799] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-22T21:55:18.517725] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-10-22T21:55:19.317682] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-10-22T21:55:19.622122] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-22T21:55:19.679867] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-22T21:55:20.117725] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-10. [2025-10-22T21:55:20.748125] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-22T21:55:20.917709] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-10-22T21:55:21.489208] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-22T21:55:21.498431] [INFO ] [REMOTE ] WIT: Full fetch complete (76017 records). [2025-10-22T21:55:21.498620] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-22T21:55:21.723327] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-10-22T21:55:21.920447] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-22T21:55:21.920546] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-22T21:55:21.921704] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-22T21:55:21.921769] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-22T21:55:21.923131] [DEBUG] [LOCAL ] WIT: Trimmed 76017 records to 52537 (keeping 200 days of data) [2025-10-22T21:55:22.222538] [DEBUG] [LOCAL ] WIT: Primary data saved (52537 records). [2025-10-22T21:55:22.222879] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-22T21:55:22.222999] [INFO ] [MAIN ] Update Progress: 2295/2367 symbols completed. WIT took 39.5s. Estimated remaining: 9m 16s. Rate: 7.8 symbols/min [2025-10-22T21:55:22.383177] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T21:55:22.422680] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:55:22.461813] [DEBUG] [LOCAL ] WLK: Loaded 45878 existing records from primary storage. [2025-10-22T21:55:22.462115] [INFO ] [MAIN ] WLK: Loaded 45878 existing records. [2025-10-22T21:55:22.522909] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-10. [2025-10-22T21:55:22.640017] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:55:22.640252] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-22T21:55:22.640320] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-22T21:55:22.640580] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-22T21:55:22.640618] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-22T21:55:22.981238] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-22T21:55:23.030551] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:55:23.317675] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-10-22T21:55:24.012035] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T21:55:24.019489] [INFO ] [REMOTE ] WK: Full fetch complete (53561 records). [2025-10-22T21:55:24.019731] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-22T21:55:24.121396] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-10. [2025-10-22T21:55:24.397499] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-22T21:55:24.397586] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-22T21:55:24.398670] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-22T21:55:24.398732] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-22T21:55:24.399773] [DEBUG] [LOCAL ] WK: Trimmed 53561 records to 37058 (keeping 200 days of data) [2025-10-22T21:55:24.614806] [DEBUG] [LOCAL ] WK: Primary data saved (37058 records). [2025-10-22T21:55:24.614939] [INFO ] [MAIN ] WK: Full history saved. [2025-10-22T21:55:24.615016] [INFO ] [MAIN ] Update Progress: 2296/2367 symbols completed. WK took 28.9s. Estimated remaining: 9m 8s. Rate: 7.8 symbols/min [2025-10-22T21:55:24.785984] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:55:24.809938] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T21:55:24.820784] [DEBUG] [LOCAL ] WLKP: Loaded 7223 existing records from primary storage. [2025-10-22T21:55:24.820953] [INFO ] [MAIN ] WLKP: Loaded 7223 existing records. [2025-10-22T21:55:24.918170] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-10-22T21:55:25.001210] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:55:25.001471] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-22T21:55:25.001569] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-22T21:55:25.001777] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-22T21:55:25.001833] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-22T21:55:25.125731] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-22T21:55:25.170548] [INFO ] [REMOTE ] WIW: Full fetch complete (29256 records). [2025-10-22T21:55:25.186557] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-22T21:55:25.525576] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:55:25.721799] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-10-22T21:55:25.733064] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-22T21:55:25.733143] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-22T21:55:25.733804] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-22T21:55:25.733882] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-22T21:55:25.735355] [DEBUG] [LOCAL ] WIW: Trimmed 29256 records to 20236 (keeping 200 days of data) [2025-10-22T21:55:25.859977] [DEBUG] [LOCAL ] WIW: Primary data saved (20236 records). [2025-10-22T21:55:25.860130] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-22T21:55:25.860222] [INFO ] [MAIN ] Update Progress: 2297/2367 symbols completed. WIW took 41.7s. Estimated remaining: 9m 0s. Rate: 7.8 symbols/min [2025-10-22T21:55:26.033919] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:55:26.034130] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-22T21:55:26.034174] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-22T21:55:26.034295] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-22T21:55:26.034336] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-22T21:55:26.034379] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-22T21:55:26.034418] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-22T21:55:26.392108] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:55:26.517633] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-10-22T21:55:26.547346] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-22T21:55:26.560239] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-22T21:55:27.317698] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-10-22T21:55:27.934004] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-22T21:55:27.955523] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T21:55:28.117742] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-10-22T21:55:28.468485] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-22T21:55:28.917714] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-10-22T21:55:29.700483] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-22T21:55:29.717629] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-10-22T21:55:30.517708] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-10-22T21:55:31.133981] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-22T21:55:31.215717] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-22T21:55:31.317685] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-10. [2025-10-22T21:55:32.117633] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-10-22T21:55:32.510923] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T21:55:32.516637] [INFO ] [REMOTE ] WKC: Full fetch complete (50058 records). [2025-10-22T21:55:32.516793] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-22T21:55:32.915993] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-22T21:55:32.916536] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-22T21:55:32.919516] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-10-22T21:55:32.919704] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-22T21:55:32.922684] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-22T21:55:32.922771] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-22T21:55:32.923841] [DEBUG] [LOCAL ] WKC: Trimmed 50058 records to 34432 (keeping 200 days of data) [2025-10-22T21:55:33.144279] [DEBUG] [LOCAL ] WKC: Primary data saved (34432 records). [2025-10-22T21:55:33.144440] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-22T21:55:33.144520] [INFO ] [MAIN ] Update Progress: 2298/2367 symbols completed. WKC took 28.7s. Estimated remaining: 8m 52s. Rate: 7.8 symbols/min [2025-10-22T21:55:33.316540] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:55:33.345361] [DEBUG] [LOCAL ] WLY: Loaded 29776 existing records from primary storage. [2025-10-22T21:55:33.345673] [INFO ] [MAIN ] WLY: Loaded 29776 existing records. [2025-10-22T21:55:33.430951] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-22T21:55:33.532206] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:55:33.532427] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-22T21:55:33.532475] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-22T21:55:33.532865] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-22T21:55:33.532923] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-22T21:55:33.722885] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-10-22T21:55:33.894850] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:55:34.247437] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-22T21:55:34.517696] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-10-22T21:55:35.317680] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-10-22T21:55:36.117747] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-10-22T21:55:36.153706] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-22T21:55:36.155593] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T21:55:36.917630] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-10-22T21:55:37.029033] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-22T21:55:37.717703] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-10-22T21:55:38.457265] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-22T21:55:38.517699] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-10-22T21:55:38.554431] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-22T21:55:38.856073] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-22T21:55:39.317717] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-10-22T21:55:39.677138] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-22T21:55:40.117686] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-10-22T21:55:40.917685] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-10-22T21:55:41.245874] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T21:55:41.527296] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-22T21:55:41.717847] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-10-22T21:55:42.517712] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-10-22T21:55:43.233529] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-22T21:55:43.317635] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-10-22T21:55:43.432507] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-22T21:55:44.117727] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-10-22T21:55:44.404672] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T21:55:44.886702] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-22T21:55:44.917617] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-10. [2025-10-22T21:55:45.669828] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T21:55:45.671771] [INFO ] [REMOTE ] WLKP: Full fetch complete (10039 records). [2025-10-22T21:55:45.671843] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-22T21:55:45.723465] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-10-22T21:55:46.046707] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-22T21:55:46.046833] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-22T21:55:46.047199] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-22T21:55:46.047308] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-22T21:55:46.048220] [DEBUG] [LOCAL ] WLKP: Trimmed 10039 records to 7193 (keeping 200 days of data) [2025-10-22T21:55:46.102621] [DEBUG] [LOCAL ] WLKP: Primary data saved (7193 records). [2025-10-22T21:55:46.102786] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-22T21:55:46.102871] [INFO ] [MAIN ] Update Progress: 2299/2367 symbols completed. WLKP took 21.5s. Estimated remaining: 8m 45s. Rate: 7.8 symbols/min [2025-10-22T21:55:46.270284] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:55:46.317917] [DEBUG] [LOCAL ] WM: Loaded 50876 existing records from primary storage. [2025-10-22T21:55:46.318228] [INFO ] [MAIN ] WM: Loaded 50876 existing records. [2025-10-22T21:55:46.490965] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:55:46.491213] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-22T21:55:46.491273] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-22T21:55:46.491550] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-22T21:55:46.491606] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-22T21:55:46.522861] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-10-22T21:55:46.837529] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:55:47.317635] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-10-22T21:55:47.405901] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T21:55:47.991157] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-22T21:55:48.117623] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-10-22T21:55:48.917616] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-10-22T21:55:49.255594] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-22T21:55:49.286478] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-22T21:55:49.568103] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-22T21:55:49.717711] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-10-22T21:55:50.517719] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-10-22T21:55:51.317722] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-10-22T21:55:51.371194] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-22T21:55:51.929151] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-22T21:55:52.117695] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-10-22T21:55:52.917694] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-10-22T21:55:53.153252] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T21:55:53.344633] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-22T21:55:53.702327] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-22T21:55:53.717614] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-10-22T21:55:54.517729] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-10-22T21:55:55.317767] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-10-22T21:55:55.610349] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T21:55:56.117678] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-10-22T21:55:56.148114] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T21:55:56.806837] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T21:55:56.917696] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-10-22T21:55:57.270724] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-22T21:55:57.717630] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-10. [2025-10-22T21:55:58.111737] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-22T21:55:58.112517] [INFO ] [REMOTE ] WLTG: Full fetch complete (1669 records). [2025-10-22T21:55:58.112584] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-22T21:55:58.272475] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-22T21:55:58.333626] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T21:55:58.333823] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:55:58.333895] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:55:58.333962] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-22T21:55:58.334026] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-22T21:55:58.334061] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-22T21:55:58.334099] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-22T21:55:58.334151] [INFO ] [MAIN ] Update Progress: 2300/2367 symbols completed. WLTG took 32.5s. Estimated remaining: 8m 37s. Rate: 7.8 symbols/min [2025-10-22T21:55:58.502150] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:55:58.532037] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-10-22T21:55:58.554068] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-22T21:55:58.554359] [INFO ] [MAIN ] WMB: Loaded 53672 existing records. [2025-10-22T21:55:58.729477] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:55:58.729736] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-22T21:55:58.729803] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-22T21:55:58.730021] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-22T21:55:58.730076] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-22T21:55:59.090563] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:55:59.317710] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-10. [2025-10-22T21:56:00.117718] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-10-22T21:56:00.511311] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-22T21:56:00.518908] [INFO ] [REMOTE ] WLK: Full fetch complete (64057 records). [2025-10-22T21:56:00.519025] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-22T21:56:00.844053] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-22T21:56:00.924729] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-10-22T21:56:00.940920] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-22T21:56:00.940980] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-22T21:56:00.942058] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-22T21:56:00.942211] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-22T21:56:00.943462] [DEBUG] [LOCAL ] WLK: Trimmed 64057 records to 45827 (keeping 200 days of data) [2025-10-22T21:56:01.217134] [DEBUG] [LOCAL ] WLK: Primary data saved (45827 records). [2025-10-22T21:56:01.217283] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-22T21:56:01.217419] [INFO ] [MAIN ] Update Progress: 2301/2367 symbols completed. WLK took 39.0s. Estimated remaining: 8m 29s. Rate: 7.8 symbols/min [2025-10-22T21:56:01.384891] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:56:01.401603] [DEBUG] [LOCAL ] WMK: Loaded 14738 existing records from primary storage. [2025-10-22T21:56:01.401895] [INFO ] [MAIN ] WMK: Loaded 14738 existing records. [2025-10-22T21:56:01.583925] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:56:01.584176] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-22T21:56:01.584240] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-22T21:56:01.584416] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-22T21:56:01.584472] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-22T21:56:01.722968] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-10-22T21:56:01.960743] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:56:02.066209] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-22T21:56:02.145091] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-22T21:56:02.517720] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-10-22T21:56:03.317685] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-10-22T21:56:03.331236] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-22T21:56:03.520551] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-22T21:56:04.117730] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-10-22T21:56:04.917729] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-10-22T21:56:05.006432] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T21:56:05.717671] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-10-22T21:56:05.779569] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-22T21:56:06.189206] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-22T21:56:06.517718] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-10-22T21:56:07.317724] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-10-22T21:56:07.326964] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-22T21:56:07.611178] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-22T21:56:08.117676] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-10-22T21:56:08.862679] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-22T21:56:08.917676] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-10-22T21:56:09.717751] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-10. [2025-10-22T21:56:10.108437] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T21:56:10.517699] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-10-22T21:56:10.994993] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T21:56:11.000515] [INFO ] [REMOTE ] WLY: Full fetch complete (42955 records). [2025-10-22T21:56:11.000625] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-22T21:56:11.216143] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-22T21:56:11.323909] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-10-22T21:56:11.460941] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-22T21:56:11.461177] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-22T21:56:11.462208] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-22T21:56:11.462336] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-22T21:56:11.463348] [DEBUG] [LOCAL ] WLY: Trimmed 42955 records to 29776 (keeping 200 days of data) [2025-10-22T21:56:11.535223] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-22T21:56:11.663297] [DEBUG] [LOCAL ] WLY: Primary data saved (29776 records). [2025-10-22T21:56:11.663467] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-22T21:56:11.663565] [INFO ] [MAIN ] Update Progress: 2302/2367 symbols completed. WLY took 38.5s. Estimated remaining: 8m 22s. Rate: 7.8 symbols/min [2025-10-22T21:56:11.833834] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:56:11.869965] [DEBUG] [LOCAL ] WMS: Loaded 39604 existing records from primary storage. [2025-10-22T21:56:11.870239] [INFO ] [MAIN ] WMS: Loaded 39604 existing records. [2025-10-22T21:56:12.042316] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:56:12.042540] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-22T21:56:12.042587] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-22T21:56:12.042797] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-22T21:56:12.042853] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-22T21:56:12.122862] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-10-22T21:56:12.386632] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:56:12.917625] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-10. [2025-10-22T21:56:13.194126] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-10-22T21:56:13.202973] [INFO ] [REMOTE ] WM: Full fetch complete (73839 records). [2025-10-22T21:56:13.203096] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-22T21:56:13.423612] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-22T21:56:13.563317] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-22T21:56:13.658979] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-22T21:56:13.659055] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-22T21:56:13.660189] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-22T21:56:13.660249] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-22T21:56:13.661560] [DEBUG] [LOCAL ] WM: Trimmed 73839 records to 50847 (keeping 200 days of data) [2025-10-22T21:56:13.723889] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-10-22T21:56:13.971485] [DEBUG] [LOCAL ] WM: Primary data saved (50847 records). [2025-10-22T21:56:13.971612] [INFO ] [MAIN ] WM: Full history saved. [2025-10-22T21:56:13.971717] [INFO ] [MAIN ] Update Progress: 2303/2367 symbols completed. WM took 27.9s. Estimated remaining: 8m 14s. Rate: 7.8 symbols/min [2025-10-22T21:56:14.140175] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:56:14.188820] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-22T21:56:14.189127] [INFO ] [MAIN ] WMT: Loaded 53800 existing records. [2025-10-22T21:56:14.364258] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:56:14.364488] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-22T21:56:14.364547] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-22T21:56:14.364758] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-22T21:56:14.364814] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-22T21:56:14.521872] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-10-22T21:56:14.722396] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:56:15.198768] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T21:56:15.317735] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-10-22T21:56:15.723027] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-22T21:56:16.117627] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-10-22T21:56:16.394366] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T21:56:16.917707] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-10-22T21:56:17.717735] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-10-22T21:56:18.517809] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-10-22T21:56:18.782140] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-10-22T21:56:19.031635] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-22T21:56:19.235632] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T21:56:19.319674] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-10-22T21:56:19.324130] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-22T21:56:20.117694] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-10-22T21:56:20.864920] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T21:56:20.917703] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-10-22T21:56:20.989571] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-22T21:56:21.717748] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-10-22T21:56:22.517733] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-10-22T21:56:22.821212] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-22T21:56:23.317747] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-10-22T21:56:24.031795] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-22T21:56:24.118215] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-10-22T21:56:24.121311] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-22T21:56:24.917734] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-10-22T21:56:25.146680] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-22T21:56:25.717712] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-10-22T21:56:25.778748] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-22T21:56:25.910508] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-22T21:56:26.517684] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-10. [2025-10-22T21:56:27.240768] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-22T21:56:27.250599] [INFO ] [REMOTE ] WMB: Full fetch complete (77851 records). [2025-10-22T21:56:27.250792] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-22T21:56:27.323392] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-10-22T21:56:27.641758] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-22T21:56:27.641871] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-22T21:56:27.643121] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-22T21:56:27.643189] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-22T21:56:27.644790] [DEBUG] [LOCAL ] WMB: Trimmed 77851 records to 53672 (keeping 200 days of data) [2025-10-22T21:56:27.983028] [DEBUG] [LOCAL ] WMB: Primary data saved (53672 records). [2025-10-22T21:56:27.983163] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-22T21:56:27.983803] [INFO ] [MAIN ] Update Progress: 2304/2367 symbols completed. WMB took 29.6s. Estimated remaining: 8m 6s. Rate: 7.8 symbols/min [2025-10-22T21:56:28.121708] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-10-22T21:56:28.153767] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:56:28.193218] [DEBUG] [LOCAL ] WNC: Loaded 38268 existing records from primary storage. [2025-10-22T21:56:28.193499] [INFO ] [MAIN ] WNC: Loaded 38268 existing records. [2025-10-22T21:56:28.384579] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:56:28.385126] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-22T21:56:28.385235] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-22T21:56:28.385809] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-22T21:56:28.385869] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-22T21:56:28.616103] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.90 seconds). [2025-10-22T21:56:28.617424] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-22T21:56:28.818152] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:56:28.917708] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-10-22T21:56:29.413572] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-22T21:56:29.717737] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-10-22T21:56:30.521448] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-10-22T21:56:30.524861] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T21:56:31.253890] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T21:56:31.317724] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-10-22T21:56:32.117691] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-10. [2025-10-22T21:56:32.868453] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-22T21:56:32.917617] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-10-22T21:56:33.029386] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-22T21:56:33.032042] [INFO ] [REMOTE ] WMK: Full fetch complete (20053 records). [2025-10-22T21:56:33.032125] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-22T21:56:33.425073] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.90 seconds). [2025-10-22T21:56:33.447295] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-22T21:56:33.447409] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-22T21:56:33.448081] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-22T21:56:33.448177] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-22T21:56:33.449474] [DEBUG] [LOCAL ] WMK: Trimmed 20053 records to 14666 (keeping 200 days of data) [2025-10-22T21:56:33.538188] [DEBUG] [LOCAL ] WMK: Primary data saved (14666 records). [2025-10-22T21:56:33.538337] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-22T21:56:33.538418] [INFO ] [MAIN ] Update Progress: 2305/2367 symbols completed. WMK took 32.3s. Estimated remaining: 7m 58s. Rate: 7.8 symbols/min [2025-10-22T21:56:33.712552] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:56:33.717753] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-10-22T21:56:33.765068] [DEBUG] [LOCAL ] WOLF: Loaded 53084 existing records from primary storage. [2025-10-22T21:56:33.765440] [INFO ] [MAIN ] WOLF: Loaded 53084 existing records. [2025-10-22T21:56:33.947863] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:56:33.948076] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-22T21:56:33.948125] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-22T21:56:33.948362] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-10-22T21:56:33.948420] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-22T21:56:34.327633] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:56:34.448794] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-22T21:56:34.517711] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-10-22T21:56:35.317774] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-10. [2025-10-22T21:56:36.117741] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-10-22T21:56:36.221659] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-22T21:56:36.754932] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-22T21:56:36.762354] [INFO ] [REMOTE ] WMS: Full fetch complete (57120 records). [2025-10-22T21:56:36.762744] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-22T21:56:36.885121] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-22T21:56:36.917998] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-10-22T21:56:37.213617] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-22T21:56:37.213774] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-22T21:56:37.214925] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-22T21:56:37.215167] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-22T21:56:37.216602] [DEBUG] [LOCAL ] WMS: Trimmed 57120 records to 39517 (keeping 200 days of data) [2025-10-22T21:56:37.467036] [DEBUG] [LOCAL ] WMS: Primary data saved (39517 records). [2025-10-22T21:56:37.467199] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-22T21:56:37.467279] [INFO ] [MAIN ] Update Progress: 2306/2367 symbols completed. WMS took 25.8s. Estimated remaining: 7m 51s. Rate: 7.8 symbols/min [2025-10-22T21:56:37.636353] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:56:37.662733] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-22T21:56:37.691421] [DEBUG] [LOCAL ] WOR: Loaded 23644 existing records from primary storage. [2025-10-22T21:56:37.691714] [INFO ] [MAIN ] WOR: Loaded 23644 existing records. [2025-10-22T21:56:37.722878] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-10-22T21:56:37.870794] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:56:37.871041] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-22T21:56:37.871092] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-22T21:56:37.871260] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-22T21:56:37.871342] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-22T21:56:38.223057] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:56:38.517752] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-10-22T21:56:39.317714] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-10-22T21:56:39.417011] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-22T21:56:39.904229] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-22T21:56:39.983902] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T21:56:40.117682] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-10-22T21:56:40.552286] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-22T21:56:40.917708] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-10-22T21:56:41.695896] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-22T21:56:41.717724] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-10-22T21:56:42.517741] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-10-22T21:56:43.196452] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-22T21:56:43.309432] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-22T21:56:43.318078] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-10-22T21:56:44.117707] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-10-22T21:56:44.428511] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T21:56:44.917692] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-10-22T21:56:45.148537] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-22T21:56:45.717733] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-10-22T21:56:46.002731] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-22T21:56:46.525100] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-10-22T21:56:46.531144] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-22T21:56:47.034908] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T21:56:47.317685] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-10-22T21:56:47.791346] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-22T21:56:48.117720] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-10-22T21:56:48.572249] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-22T21:56:48.917675] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-10-22T21:56:48.954624] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-22T21:56:49.717731] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-10-22T21:56:50.447327] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T21:56:50.517680] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-10-22T21:56:51.317738] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-10-22T21:56:51.749690] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-22T21:56:52.117719] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-10-22T21:56:52.275316] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-22T21:56:52.340521] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-22T21:56:52.917719] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-10-22T21:56:53.717707] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-10-22T21:56:54.195421] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-22T21:56:54.517698] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-10. [2025-10-22T21:56:54.578664] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-22T21:56:55.317681] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-10-22T21:56:55.793138] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-22T21:56:55.800036] [INFO ] [REMOTE ] WNC: Full fetch complete (57815 records). [2025-10-22T21:56:55.800166] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-22T21:56:56.118722] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-10-22T21:56:56.191286] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-22T21:56:56.191494] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-22T21:56:56.192578] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-22T21:56:56.192758] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-22T21:56:56.223343] [DEBUG] [LOCAL ] WNC: Trimmed 57815 records to 38118 (keeping 200 days of data) [2025-10-22T21:56:56.224512] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-22T21:56:56.461317] [DEBUG] [LOCAL ] WNC: Primary data saved (38118 records). [2025-10-22T21:56:56.461459] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-22T21:56:56.462019] [INFO ] [MAIN ] Update Progress: 2307/2367 symbols completed. WNC took 28.5s. Estimated remaining: 7m 43s. Rate: 7.8 symbols/min [2025-10-22T21:56:56.625555] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:56:56.656344] [DEBUG] [LOCAL ] WOW: Loaded 31132 existing records from primary storage. [2025-10-22T21:56:56.656603] [INFO ] [MAIN ] WOW: Loaded 31132 existing records. [2025-10-22T21:56:56.828210] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:56:56.828466] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-22T21:56:56.828514] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-22T21:56:56.828750] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-22T21:56:56.828809] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-22T21:56:56.925034] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-10. [2025-10-22T21:56:57.178868] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:56:57.296067] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T21:56:57.593019] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-22T21:56:57.711718] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-22T21:56:57.720070] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-10-22T21:56:57.721534] [INFO ] [REMOTE ] WMT: Full fetch complete (77980 records). [2025-10-22T21:56:57.721628] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-22T21:56:58.112368] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-22T21:56:58.112445] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-22T21:56:58.113769] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-22T21:56:58.113842] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-22T21:56:58.115319] [DEBUG] [LOCAL ] WMT: Trimmed 77980 records to 53800 (keeping 200 days of data) [2025-10-22T21:56:58.446601] [DEBUG] [LOCAL ] WMT: Primary data saved (53800 records). [2025-10-22T21:56:58.446739] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-22T21:56:58.446821] [INFO ] [MAIN ] Update Progress: 2308/2367 symbols completed. WMT took 44.5s. Estimated remaining: 7m 35s. Rate: 7.8 symbols/min [2025-10-22T21:56:58.522732] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-10-22T21:56:58.618666] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:56:58.662753] [DEBUG] [LOCAL ] WPC: Loaded 48169 existing records from primary storage. [2025-10-22T21:56:58.663081] [INFO ] [MAIN ] WPC: Loaded 48169 existing records. [2025-10-22T21:56:58.878358] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:56:58.873377] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-22T21:56:58.883534] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-22T21:56:58.883956] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-22T21:56:58.884469] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-22T21:56:58.884529] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-22T21:56:59.224954] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:56:59.317674] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-10. [2025-10-22T21:56:59.642422] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T21:57:00.117712] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-10-22T21:57:00.441610] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T21:57:00.445608] [INFO ] [REMOTE ] WOR: Full fetch complete (36319 records). [2025-10-22T21:57:00.445727] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-22T21:57:00.806766] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-22T21:57:00.806846] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-22T21:57:00.807574] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-22T21:57:00.807635] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-22T21:57:00.808443] [DEBUG] [LOCAL ] WOR: Trimmed 36319 records to 23551 (keeping 200 days of data) [2025-10-22T21:57:00.920250] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-10-22T21:57:00.954304] [DEBUG] [LOCAL ] WOR: Primary data saved (23551 records). [2025-10-22T21:57:00.954455] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-22T21:57:00.954593] [INFO ] [MAIN ] Update Progress: 2309/2367 symbols completed. WOR took 23.5s. Estimated remaining: 7m 28s. Rate: 7.8 symbols/min [2025-10-22T21:57:01.126180] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:57:01.177756] [DEBUG] [LOCAL ] WPM: Loaded 52787 existing records from primary storage. [2025-10-22T21:57:01.178135] [INFO ] [MAIN ] WPM: Loaded 52787 existing records. [2025-10-22T21:57:01.355012] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:57:01.355260] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-22T21:57:01.355309] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-22T21:57:01.355524] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-22T21:57:01.355584] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-22T21:57:01.722725] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:57:01.718604] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-10-22T21:57:01.892378] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-22T21:57:02.517728] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-10-22T21:57:02.819626] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T21:57:03.317691] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-10-22T21:57:03.361743] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-22T21:57:03.899815] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T21:57:04.117722] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-10-22T21:57:04.580260] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-22T21:57:04.917690] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-10-22T21:57:05.717624] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-10-22T21:57:06.036781] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-22T21:57:06.265100] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-22T21:57:06.517681] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-10-22T21:57:07.317635] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-10-22T21:57:07.374199] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-22T21:57:08.117728] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-10-22T21:57:08.871477] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-22T21:57:08.917614] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-10-22T21:57:08.963376] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-22T21:57:09.717633] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-10-22T21:57:09.830445] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T21:57:10.517631] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-10-22T21:57:10.793670] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-22T21:57:10.828973] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-22T21:57:11.317694] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-10. [2025-10-22T21:57:12.117631] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-10-22T21:57:12.319938] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-22T21:57:12.917707] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-10-22T21:57:13.692742] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-22T21:57:13.701377] [INFO ] [REMOTE ] WOLF: Full fetch complete (77243 records). [2025-10-22T21:57:13.701492] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-22T21:57:13.733517] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-10-22T21:57:14.100387] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-22T21:57:14.100529] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-22T21:57:14.101737] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-22T21:57:14.101817] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-22T21:57:14.103453] [DEBUG] [LOCAL ] WOLF: Trimmed 77243 records to 53071 (keeping 200 days of data) [2025-10-22T21:57:14.235869] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-22T21:57:14.442160] [DEBUG] [LOCAL ] WOLF: Primary data saved (53071 records). [2025-10-22T21:57:14.442452] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-22T21:57:14.442566] [INFO ] [MAIN ] Update Progress: 2310/2367 symbols completed. WOLF took 40.9s. Estimated remaining: 7m 20s. Rate: 7.8 symbols/min [2025-10-22T21:57:14.518726] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-10-22T21:57:14.621181] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:57:14.653591] [DEBUG] [LOCAL ] WPP: Loaded 34389 existing records from primary storage. [2025-10-22T21:57:14.653909] [INFO ] [MAIN ] WPP: Loaded 34389 existing records. [2025-10-22T21:57:14.831444] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:57:14.831828] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-22T21:57:14.831910] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-22T21:57:14.832309] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-10-22T21:57:14.832371] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-22T21:57:14.960289] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-22T21:57:15.049332] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T21:57:15.257750] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:57:15.317675] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-10-22T21:57:16.117685] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-10-22T21:57:16.664118] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-22T21:57:16.696438] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T21:57:16.876265] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-22T21:57:16.917623] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-10-22T21:57:17.717676] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-10-22T21:57:18.482883] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T21:57:18.517704] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-10-22T21:57:19.298535] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-22T21:57:19.317625] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-10-22T21:57:20.117639] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-10-22T21:57:20.234182] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-22T21:57:20.917672] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-10-22T21:57:21.052208] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-22T21:57:21.100343] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-22T21:57:21.717686] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-10-22T21:57:22.312892] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-22T21:57:22.517702] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-10-22T21:57:23.322708] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-10-22T21:57:23.328438] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-22T21:57:24.104241] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-22T21:57:24.117602] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-10-22T21:57:24.917749] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-10-22T21:57:25.057507] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-22T21:57:25.169454] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T21:57:25.717694] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-10-22T21:57:26.517617] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-10. [2025-10-22T21:57:26.760490] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-22T21:57:27.109766] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-22T21:57:27.317686] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-10-22T21:57:27.544804] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T21:57:27.550681] [INFO ] [REMOTE ] WOW: Full fetch complete (43040 records). [2025-10-22T21:57:27.550780] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-22T21:57:27.918204] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-22T21:57:27.918284] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-22T21:57:27.919124] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-22T21:57:27.919184] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-22T21:57:27.920099] [DEBUG] [LOCAL ] WOW: Trimmed 43040 records to 31103 (keeping 200 days of data) [2025-10-22T21:57:28.086444] [DEBUG] [LOCAL ] WOW: Primary data saved (31103 records). [2025-10-22T21:57:28.086572] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-22T21:57:28.086667] [INFO ] [MAIN ] Update Progress: 2311/2367 symbols completed. WOW took 31.6s. Estimated remaining: 7m 12s. Rate: 7.8 symbols/min [2025-10-22T21:57:28.118448] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-10-22T21:57:28.288151] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:57:28.333452] [DEBUG] [LOCAL ] WRB: Loaded 50782 existing records from primary storage. [2025-10-22T21:57:28.333898] [INFO ] [MAIN ] WRB: Loaded 50782 existing records. [2025-10-22T21:57:28.513273] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:57:28.513520] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-22T21:57:28.513599] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-22T21:57:28.513924] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-22T21:57:28.513981] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-22T21:57:28.849067] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T21:57:28.912967] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:57:28.917612] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-10-22T21:57:29.603073] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T21:57:29.717701] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-10. [2025-10-22T21:57:30.096858] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-22T21:57:30.517681] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-10-22T21:57:31.317635] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-10-22T21:57:31.388758] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T21:57:31.396862] [INFO ] [REMOTE ] WPC: Full fetch complete (70514 records). [2025-10-22T21:57:31.396997] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-22T21:57:31.797413] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-22T21:57:31.797563] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-22T21:57:31.798797] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-22T21:57:31.798904] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-22T21:57:31.822818] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-22T21:57:31.830695] [DEBUG] [LOCAL ] WPC: Trimmed 70514 records to 48154 (keeping 200 days of data) [2025-10-22T21:57:32.120865] [DEBUG] [LOCAL ] WPC: Primary data saved (48154 records). [2025-10-22T21:57:32.117811] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-10-22T21:57:32.121172] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-22T21:57:32.121919] [INFO ] [MAIN ] Update Progress: 2312/2367 symbols completed. WPC took 33.7s. Estimated remaining: 7m 5s. Rate: 7.8 symbols/min [2025-10-22T21:57:32.289159] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:57:32.333065] [DEBUG] [LOCAL ] WRBY: Loaded 50694 existing records from primary storage. [2025-10-22T21:57:32.333372] [INFO ] [MAIN ] WRBY: Loaded 50694 existing records. [2025-10-22T21:57:32.509116] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:57:32.509373] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-22T21:57:32.509424] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-22T21:57:32.509725] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-22T21:57:32.509784] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-22T21:57:32.860623] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:57:32.917633] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-10-22T21:57:33.026779] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T21:57:33.569548] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-22T21:57:33.717633] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-10-22T21:57:34.341155] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-22T21:57:34.517923] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-10-22T21:57:35.317724] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-10. [2025-10-22T21:57:35.560338] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-22T21:57:36.117636] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-10-22T21:57:36.237452] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-22T21:57:36.665524] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-22T21:57:36.671993] [INFO ] [REMOTE ] WPP: Full fetch complete (47718 records). [2025-10-22T21:57:36.672076] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-22T21:57:36.922937] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-10. [2025-10-22T21:57:37.048798] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-22T21:57:37.049327] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-22T21:57:37.050279] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-22T21:57:37.050340] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-22T21:57:37.051380] [DEBUG] [LOCAL ] WPP: Trimmed 47718 records to 34340 (keeping 200 days of data) [2025-10-22T21:57:37.262594] [DEBUG] [LOCAL ] WPP: Primary data saved (34340 records). [2025-10-22T21:57:37.262765] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-22T21:57:37.262876] [INFO ] [MAIN ] Update Progress: 2313/2367 symbols completed. WPP took 22.8s. Estimated remaining: 6m 57s. Rate: 7.8 symbols/min [2025-10-22T21:57:37.433983] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:57:37.459773] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-22T21:57:37.485320] [DEBUG] [LOCAL ] WS: Loaded 23498 existing records from primary storage. [2025-10-22T21:57:37.485544] [INFO ] [MAIN ] WS: Loaded 23498 existing records. [2025-10-22T21:57:37.658686] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:57:37.658875] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-22T21:57:37.658922] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-22T21:57:37.659273] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-22T21:57:37.659329] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-22T21:57:37.722882] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-10-22T21:57:38.015409] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:57:38.517682] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-10-22T21:57:38.940724] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-22T21:57:38.949553] [INFO ] [REMOTE ] WPM: Full fetch complete (76394 records). [2025-10-22T21:57:38.949737] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-22T21:57:39.324354] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-10-22T21:57:39.349292] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-22T21:57:39.349475] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-22T21:57:39.350664] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-22T21:57:39.350826] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-22T21:57:39.352272] [DEBUG] [LOCAL ] WPM: Trimmed 76394 records to 52787 (keeping 200 days of data) [2025-10-22T21:57:39.684287] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-22T21:57:39.741202] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-22T21:57:39.763452] [DEBUG] [LOCAL ] WPM: Primary data saved (52787 records). [2025-10-22T21:57:39.763562] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-22T21:57:39.763636] [INFO ] [MAIN ] Update Progress: 2314/2367 symbols completed. WPM took 38.8s. Estimated remaining: 6m 49s. Rate: 7.8 symbols/min [2025-10-22T21:57:39.928551] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:57:39.973572] [DEBUG] [LOCAL ] WSM: Loaded 48798 existing records from primary storage. [2025-10-22T21:57:39.973926] [INFO ] [MAIN ] WSM: Loaded 48798 existing records. [2025-10-22T21:57:40.122875] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-10-22T21:57:40.162024] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:57:40.162381] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-22T21:57:40.162465] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-22T21:57:40.162701] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-22T21:57:40.162761] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-22T21:57:40.507196] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:57:40.917741] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-10-22T21:57:41.175545] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T21:57:41.369005] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T21:57:41.717737] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-10-22T21:57:42.429865] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-22T21:57:42.517693] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-10-22T21:57:43.317635] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-10-22T21:57:43.470457] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T21:57:44.018737] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T21:57:44.117682] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-10-22T21:57:44.917698] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-10-22T21:57:45.270623] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-22T21:57:45.717630] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-10-22T21:57:46.091024] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-22T21:57:46.517716] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-10-22T21:57:46.652354] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-22T21:57:47.317691] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-10-22T21:57:47.462759] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-22T21:57:47.843200] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-22T21:57:48.117753] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-10-22T21:57:48.735528] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-22T21:57:48.917723] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-10-22T21:57:49.717728] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-10-22T21:57:49.779364] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T21:57:50.517629] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-10-22T21:57:50.777089] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-22T21:57:51.317622] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-10-22T21:57:51.601395] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-22T21:57:51.689329] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-22T21:57:52.117713] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-10-22T21:57:52.917637] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-10-22T21:57:53.216791] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-22T21:57:53.717680] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-10-22T21:57:53.859165] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-22T21:57:54.206684] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-22T21:57:54.517678] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-10-22T21:57:55.317716] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-10-22T21:57:55.498725] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T21:57:55.566423] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-22T21:57:56.117713] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-10. [2025-10-22T21:57:56.917901] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-10-22T21:57:57.170278] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-22T21:57:57.717720] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-10-22T21:57:57.858010] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T21:57:57.866347] [INFO ] [REMOTE ] WRBY: Full fetch complete (73677 records). [2025-10-22T21:57:57.866470] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-22T21:57:58.248670] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-22T21:57:58.248818] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-22T21:57:58.249970] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-22T21:57:58.250031] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-22T21:57:58.251385] [DEBUG] [LOCAL ] WRBY: Trimmed 73677 records to 50685 (keeping 200 days of data) [2025-10-22T21:57:58.519529] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-10-22T21:57:58.538142] [DEBUG] [LOCAL ] WRBY: Primary data saved (50685 records). [2025-10-22T21:57:58.538217] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-22T21:57:58.538290] [INFO ] [MAIN ] Update Progress: 2315/2367 symbols completed. WRBY took 26.4s. Estimated remaining: 6m 41s. Rate: 7.8 symbols/min [2025-10-22T21:57:58.719525] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:57:58.737348] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-22T21:57:58.770596] [DEBUG] [LOCAL ] WSO: Loaded 25862 existing records from primary storage. [2025-10-22T21:57:58.770871] [INFO ] [MAIN ] WSO: Loaded 25862 existing records. [2025-10-22T21:57:58.942512] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:57:58.942719] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-22T21:57:58.942771] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-22T21:57:58.942953] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-22T21:57:58.943007] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-22T21:57:59.288717] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:57:59.317607] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-10-22T21:57:59.473585] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-22T21:57:59.671485] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-22T21:58:00.117697] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-10-22T21:58:00.433517] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-22T21:58:00.917702] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-10-22T21:58:01.105701] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T21:58:01.717744] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-10-22T21:58:02.517721] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-10. [2025-10-22T21:58:02.735839] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T21:58:02.768019] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-22T21:58:03.247353] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-22T21:58:03.255927] [INFO ] [REMOTE ] WRB: Full fetch complete (73853 records). [2025-10-22T21:58:03.256056] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-22T21:58:03.322733] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-10-22T21:58:03.663143] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-22T21:58:03.663237] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-22T21:58:03.664433] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-22T21:58:03.664494] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-22T21:58:03.665839] [DEBUG] [LOCAL ] WRB: Trimmed 73853 records to 50788 (keeping 200 days of data) [2025-10-22T21:58:03.971036] [DEBUG] [LOCAL ] WRB: Primary data saved (50788 records). [2025-10-22T21:58:03.971176] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-22T21:58:03.971966] [INFO ] [MAIN ] Update Progress: 2316/2367 symbols completed. WRB took 35.9s. Estimated remaining: 6m 34s. Rate: 7.8 symbols/min [2025-10-22T21:58:04.119240] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-10-22T21:58:04.151902] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:58:04.175662] [DEBUG] [LOCAL ] WSR: Loaded 22702 existing records from primary storage. [2025-10-22T21:58:04.175910] [INFO ] [MAIN ] WSR: Loaded 22702 existing records. [2025-10-22T21:58:04.356613] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:58:04.356825] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-22T21:58:04.356874] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-22T21:58:04.357060] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-22T21:58:04.357116] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-22T21:58:04.696663] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-22T21:58:04.765966] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:58:04.917687] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-10-22T21:58:05.298316] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-22T21:58:05.717634] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-10-22T21:58:06.013341] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-22T21:58:06.517627] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-10-22T21:58:06.612217] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-22T21:58:07.317691] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-10-22T21:58:07.605360] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-22T21:58:08.117636] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-10-22T21:58:08.373468] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-22T21:58:08.917626] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-10-22T21:58:08.982311] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-22T21:58:09.717680] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-10. [2025-10-22T21:58:10.135409] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-22T21:58:10.517697] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-10-22T21:58:10.841897] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-22T21:58:10.846166] [INFO ] [REMOTE ] WS: Full fetch complete (35527 records). [2025-10-22T21:58:10.846263] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-22T21:58:11.244397] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-22T21:58:11.244524] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-22T21:58:11.245447] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-22T21:58:11.245528] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-22T21:58:11.246802] [DEBUG] [LOCAL ] WS: Trimmed 35527 records to 23459 (keeping 200 days of data) [2025-10-22T21:58:11.318395] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-10-22T21:58:11.402031] [DEBUG] [LOCAL ] WS: Primary data saved (23459 records). [2025-10-22T21:58:11.402168] [INFO ] [MAIN ] WS: Full history saved. [2025-10-22T21:58:11.402257] [INFO ] [MAIN ] Update Progress: 2317/2367 symbols completed. WS took 34.1s. Estimated remaining: 6m 26s. Rate: 7.8 symbols/min [2025-10-22T21:58:12.117663] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-10-22T21:58:12.327981] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T21:58:12.373245] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-22T21:58:12.917720] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-10-22T21:58:13.283243] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-22T21:58:13.705979] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-22T21:58:13.717627] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-10. [2025-10-22T21:58:14.428163] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-22T21:58:14.439121] [INFO ] [REMOTE ] WSM: Full fetch complete (71342 records). [2025-10-22T21:58:14.439332] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-22T21:58:14.522867] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-10-22T21:58:14.829444] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-22T21:58:14.829522] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-22T21:58:14.830780] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-22T21:58:14.830843] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-22T21:58:14.832141] [DEBUG] [LOCAL ] WSM: Trimmed 71342 records to 48709 (keeping 200 days of data) [2025-10-22T21:58:15.133065] [DEBUG] [LOCAL ] WSM: Primary data saved (48709 records). [2025-10-22T21:58:15.133211] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-22T21:58:15.133302] [INFO ] [MAIN ] Update Progress: 2318/2367 symbols completed. WSM took 35.4s. Estimated remaining: 6m 18s. Rate: 7.8 symbols/min [2025-10-22T21:58:15.317754] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-10-22T21:58:15.738964] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-22T21:58:16.117679] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-10-22T21:58:16.274595] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-22T21:58:16.917634] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-10-22T21:58:17.268268] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-22T21:58:17.693080] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-22T21:58:17.717612] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-10-22T21:58:18.517745] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-10-22T21:58:18.881928] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-22T21:58:19.317713] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-10-22T21:58:19.696733] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-22T21:58:20.117770] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-10. [2025-10-22T21:58:20.423487] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-22T21:58:20.917702] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-10-22T21:58:21.392222] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-22T21:58:21.398433] [INFO ] [REMOTE ] WSO: Full fetch complete (35907 records). [2025-10-22T21:58:21.398627] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-22T21:58:21.807706] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-22T21:58:21.807916] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-22T21:58:21.809548] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-22T21:58:21.809731] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-22T21:58:21.811073] [DEBUG] [LOCAL ] WSO: Trimmed 35907 records to 25878 (keeping 200 days of data) [2025-10-22T21:58:21.954486] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T21:58:21.970136] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-10. [2025-10-22T21:58:22.053908] [DEBUG] [LOCAL ] WSO: Primary data saved (25878 records). [2025-10-22T21:58:22.054106] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-22T21:58:22.054209] [INFO ] [MAIN ] Update Progress: 2319/2367 symbols completed. WSO took 23.5s. Estimated remaining: 6m 10s. Rate: 7.8 symbols/min [2025-10-22T21:58:22.997309] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-22T21:58:23.000951] [INFO ] [REMOTE ] WSR: Full fetch complete (32715 records). [2025-10-22T21:58:23.001044] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-22T21:58:23.380676] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-22T21:58:23.380767] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-22T21:58:23.381413] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-22T21:58:23.381478] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-22T21:58:23.382265] [DEBUG] [LOCAL ] WSR: Trimmed 32715 records to 22566 (keeping 200 days of data) [2025-10-22T21:58:23.520413] [DEBUG] [LOCAL ] WSR: Primary data saved (22566 records). [2025-10-22T21:58:23.520541] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-22T21:58:23.520619] [INFO ] [MAIN ] Update Progress: 2320/2367 symbols completed. WSR took 19.5s. Estimated remaining: 6m 3s. Rate: 7.8 symbols/min [2025-10-22T21:58:24.147261] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:58:24.153704] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:58:24.226323] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-22T21:58:24.248253] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:58:24.248410] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-22T21:58:24.294607] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:58:24.295120] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-22T21:58:24.295342] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-22T21:58:24.295594] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-22T21:58:24.295639] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-22T21:58:24.645199] [DEBUG] [LOCAL ] WTI: Loaded 44703 existing records from primary storage. [2025-10-22T21:58:24.654476] [DEBUG] [LOCAL ] WST: Loaded 36665 existing records from primary storage. [2025-10-22T21:58:24.655729] [INFO ] [MAIN ] WTI: Loaded 44703 existing records. [2025-10-22T21:58:24.655860] [DEBUG] [LOCAL ] WT: Loaded 48173 existing records from primary storage. [2025-10-22T21:58:24.661323] [INFO ] [MAIN ] WT: Loaded 48173 existing records. [2025-10-22T21:58:24.667029] [INFO ] [MAIN ] WST: Loaded 36665 existing records. [2025-10-22T21:58:25.038848] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:58:25.069257] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-10-22T21:58:25.262822] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:58:25.296240] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-22T21:58:25.248774] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:58:25.296665] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-22T21:58:25.296900] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-22T21:58:25.296799] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-22T21:58:25.295852] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:58:25.297323] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-22T21:58:25.297389] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-22T21:58:25.297492] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-22T21:58:25.297586] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-22T21:58:25.297681] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-22T21:58:25.297906] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-22T21:58:25.303263] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-22T21:58:25.298061] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-22T21:58:25.608067] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-22T21:58:25.643531] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-10-22T21:58:26.232303] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-22T21:58:26.266316] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-10-22T21:58:26.393674] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:58:26.419843] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:58:26.417011] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-10-22T21:58:26.430084] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-10-22T21:58:26.460493] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:58:26.517694] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-10-22T21:58:26.918127] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-22T21:58:27.317748] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-10-22T21:58:27.831877] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-22T21:58:28.063125] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-22T21:58:28.098024] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-22T21:58:28.117684] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-10-22T21:58:28.225734] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-22T21:58:28.917705] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-10-22T21:58:29.588393] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-22T21:58:29.717708] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-10-22T21:58:30.333808] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T21:58:30.517616] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-10-22T21:58:31.325146] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-10-22T21:58:31.330608] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-22T21:58:31.740004] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-22T21:58:32.022524] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T21:58:32.117679] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-10-22T21:58:32.917723] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-10-22T21:58:33.603090] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T21:58:33.717699] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-10-22T21:58:34.207150] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-22T21:58:34.517698] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-10-22T21:58:34.616832] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-22T21:58:35.317723] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-10-22T21:58:35.772518] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-22T21:58:36.027367] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-22T21:58:36.117635] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-10-22T21:58:36.917683] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-10-22T21:58:37.717713] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-10-22T21:58:37.774462] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T21:58:38.276359] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-22T21:58:38.517735] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-10-22T21:58:38.544777] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-22T21:58:39.126978] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-22T21:58:39.317697] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-10. [2025-10-22T21:58:39.956791] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-22T21:58:39.958064] [INFO ] [REMOTE ] WTM: Full fetch complete (2770 records). [2025-10-22T21:58:39.958132] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-22T21:58:40.126095] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-10-22T21:58:40.138365] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-22T21:58:40.138557] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-22T21:58:40.138629] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-22T21:58:40.138724] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-22T21:58:40.138783] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-22T21:58:40.138818] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-22T21:58:40.138857] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-22T21:58:40.138908] [INFO ] [MAIN ] Update Progress: 2321/2367 symbols completed. WTM took 16.6s. Estimated remaining: 5m 55s. Rate: 7.8 symbols/min [2025-10-22T21:58:40.303887] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:58:40.353533] [DEBUG] [LOCAL ] WTRG: Loaded 50964 existing records from primary storage. [2025-10-22T21:58:40.353906] [INFO ] [MAIN ] WTRG: Loaded 50964 existing records. [2025-10-22T21:58:40.527730] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:58:40.527986] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-22T21:58:40.528032] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-22T21:58:40.528220] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-22T21:58:40.528275] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-22T21:58:40.892107] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:58:40.917673] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-10-22T21:58:41.717625] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-10-22T21:58:41.817291] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-22T21:58:42.160306] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-22T21:58:42.517674] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-10-22T21:58:43.317703] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-10-22T21:58:43.394632] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T21:58:44.011019] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-22T21:58:44.117691] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-10-22T21:58:44.917703] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-10-22T21:58:44.954760] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T21:58:45.691515] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T21:58:45.717623] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-10-22T21:58:46.460686] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-22T21:58:46.517684] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-10-22T21:58:47.317747] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-10-22T21:58:47.390024] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-22T21:58:48.003870] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-22T21:58:48.117682] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-10-22T21:58:48.917716] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-10-22T21:58:49.192325] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-22T21:58:49.599183] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-22T21:58:49.717702] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-10-22T21:58:50.517676] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-10-22T21:58:50.572918] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-22T21:58:51.223262] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-22T21:58:51.317672] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-10-22T21:58:52.117712] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-10-22T21:58:52.346560] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-22T21:58:52.828806] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-22T21:58:52.917698] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-10-22T21:58:53.717674] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-10-22T21:58:53.838319] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-22T21:58:54.407436] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-22T21:58:54.517708] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-10. [2025-10-22T21:58:54.593732] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T21:58:55.255929] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T21:58:55.262430] [INFO ] [REMOTE ] WST: Full fetch complete (54528 records). [2025-10-22T21:58:55.262520] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-22T21:58:55.322891] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-10-22T21:58:55.657603] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-22T21:58:55.657743] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-22T21:58:55.659258] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-22T21:58:55.659326] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-22T21:58:55.660879] [DEBUG] [LOCAL ] WST: Trimmed 54528 records to 36684 (keeping 200 days of data) [2025-10-22T21:58:55.907494] [DEBUG] [LOCAL ] WST: Primary data saved (36684 records). [2025-10-22T21:58:55.907766] [INFO ] [MAIN ] WST: Full history saved. [2025-10-22T21:58:55.907891] [INFO ] [MAIN ] Update Progress: 2322/2367 symbols completed. WST took 32.4s. Estimated remaining: 5m 48s. Rate: 7.8 symbols/min [2025-10-22T21:58:56.089425] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:58:56.110154] [DEBUG] [LOCAL ] WTS: Loaded 17270 existing records from primary storage. [2025-10-22T21:58:56.110470] [INFO ] [MAIN ] WTS: Loaded 17270 existing records. [2025-10-22T21:58:56.122898] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-10. [2025-10-22T21:58:56.309468] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:58:56.309829] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-22T21:58:56.309904] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-22T21:58:56.310123] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-22T21:58:56.310166] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-22T21:58:56.695830] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:58:56.917728] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-10-22T21:58:57.015165] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-22T21:58:57.717665] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-10-22T21:58:57.938991] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-22T21:58:57.959867] [INFO ] [REMOTE ] WTI: Full fetch complete (63940 records). [2025-10-22T21:58:57.961393] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-22T21:58:57.961242] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-22T21:58:58.373297] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-22T21:58:58.373420] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-22T21:58:58.374842] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-22T21:58:58.374931] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-22T21:58:58.376458] [DEBUG] [LOCAL ] WTI: Trimmed 63940 records to 44731 (keeping 200 days of data) [2025-10-22T21:58:58.547547] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-10-22T21:58:58.644675] [DEBUG] [LOCAL ] WTI: Primary data saved (44731 records). [2025-10-22T21:58:58.644805] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-22T21:58:58.644886] [INFO ] [MAIN ] Update Progress: 2323/2367 symbols completed. WTI took 35.1s. Estimated remaining: 5m 40s. Rate: 7.8 symbols/min [2025-10-22T21:58:58.817681] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:58:58.854539] [DEBUG] [LOCAL ] WTTR: Loaded 44583 existing records from primary storage. [2025-10-22T21:58:58.854841] [INFO ] [MAIN ] WTTR: Loaded 44583 existing records. [2025-10-22T21:58:59.031325] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:58:59.031547] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-22T21:58:59.031596] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-22T21:58:59.031851] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-22T21:58:59.031918] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-22T21:58:59.321635] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-10-22T21:58:59.437792] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:58:59.508168] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-22T21:58:59.655176] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-22T21:59:00.117749] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-10-22T21:59:00.917638] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-10-22T21:59:01.273250] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-22T21:59:01.717631] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-10-22T21:59:01.833690] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-22T21:59:02.517672] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-10-22T21:59:02.672927] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-22T21:59:02.979932] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-22T21:59:03.317620] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-10-22T21:59:04.006772] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-22T21:59:04.117672] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-10-22T21:59:04.917713] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-10-22T21:59:05.071840] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-22T21:59:05.717702] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-10. [2025-10-22T21:59:05.831473] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-22T21:59:06.023102] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-22T21:59:06.517716] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-10-22T21:59:07.317633] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-10. [2025-10-22T21:59:07.391537] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-22T21:59:07.403032] [INFO ] [REMOTE ] WTRG: Full fetch complete (73910 records). [2025-10-22T21:59:07.403209] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-22T21:59:07.803144] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-22T21:59:07.803679] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-22T21:59:07.804258] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-22T21:59:07.805445] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-22T21:59:07.809801] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-22T21:59:07.811515] [DEBUG] [LOCAL ] WTRG: Trimmed 73910 records to 50940 (keeping 200 days of data) [2025-10-22T21:59:08.106236] [DEBUG] [LOCAL ] WTRG: Primary data saved (50940 records). [2025-10-22T21:59:08.106383] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-22T21:59:08.107183] [INFO ] [MAIN ] Update Progress: 2324/2367 symbols completed. WTRG took 28.0s. Estimated remaining: 5m 32s. Rate: 7.8 symbols/min [2025-10-22T21:59:08.127508] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-10-22T21:59:08.278269] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:59:08.330090] [DEBUG] [LOCAL ] WU: Loaded 53494 existing records from primary storage. [2025-10-22T21:59:08.330398] [INFO ] [MAIN ] WU: Loaded 53494 existing records. [2025-10-22T21:59:08.525771] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:59:08.525991] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-22T21:59:08.526038] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-22T21:59:08.526225] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-22T21:59:08.526262] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-22T21:59:08.874032] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:59:08.917632] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-10-22T21:59:09.074018] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-22T21:59:09.082423] [INFO ] [REMOTE ] WT: Full fetch complete (69822 records). [2025-10-22T21:59:09.082538] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-22T21:59:09.484686] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-22T21:59:09.484814] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-22T21:59:09.488800] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-22T21:59:09.487333] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-22T21:59:09.489044] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-22T21:59:09.496041] [DEBUG] [LOCAL ] WT: Trimmed 69822 records to 48178 (keeping 200 days of data) [2025-10-22T21:59:09.721040] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-10-22T21:59:09.775776] [DEBUG] [LOCAL ] WT: Primary data saved (48178 records). [2025-10-22T21:59:09.775878] [INFO ] [MAIN ] WT: Full history saved. [2025-10-22T21:59:09.775954] [INFO ] [MAIN ] Update Progress: 2325/2367 symbols completed. WT took 46.3s. Estimated remaining: 5m 24s. Rate: 7.8 symbols/min [2025-10-22T21:59:09.940778] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:59:09.983059] [DEBUG] [LOCAL ] WWW: Loaded 49270 existing records from primary storage. [2025-10-22T21:59:09.983352] [INFO ] [MAIN ] WWW: Loaded 49270 existing records. [2025-10-22T21:59:10.156447] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:59:10.156676] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-22T21:59:10.156735] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-22T21:59:10.156930] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-22T21:59:10.156985] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-22T21:59:10.505057] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:59:10.522816] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-10-22T21:59:10.535494] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-22T21:59:11.317731] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-10-22T21:59:11.567561] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-22T21:59:11.584744] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-22T21:59:12.117717] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-10-22T21:59:12.917629] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-10-22T21:59:13.251232] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-22T21:59:13.415732] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-22T21:59:13.717710] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-10-22T21:59:14.526971] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-10-22T21:59:14.531963] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-22T21:59:14.753242] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-22T21:59:15.317673] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-10-22T21:59:16.117693] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-10-22T21:59:16.267230] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-22T21:59:16.863885] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-22T21:59:16.917634] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-10-22T21:59:17.065371] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-22T21:59:17.717675] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-10. [2025-10-22T21:59:18.156334] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-22T21:59:18.517695] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-10-22T21:59:18.637262] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-22T21:59:18.639759] [INFO ] [REMOTE ] WTS: Full fetch complete (25689 records). [2025-10-22T21:59:18.639832] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-22T21:59:19.004713] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-22T21:59:19.004790] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-22T21:59:19.005294] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-22T21:59:19.005335] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-22T21:59:19.005946] [DEBUG] [LOCAL ] WTS: Trimmed 25689 records to 17226 (keeping 200 days of data) [2025-10-22T21:59:19.110359] [DEBUG] [LOCAL ] WTS: Primary data saved (17226 records). [2025-10-22T21:59:19.110479] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-22T21:59:19.110555] [INFO ] [MAIN ] Update Progress: 2326/2367 symbols completed. WTS took 23.2s. Estimated remaining: 5m 16s. Rate: 7.8 symbols/min [2025-10-22T21:59:19.275824] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:59:19.322153] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-10-22T21:59:19.324450] [DEBUG] [LOCAL ] WY: Loaded 53215 existing records from primary storage. [2025-10-22T21:59:19.324835] [INFO ] [MAIN ] WY: Loaded 53215 existing records. [2025-10-22T21:59:19.505445] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:59:19.506324] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-22T21:59:19.506384] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-22T21:59:19.507081] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-22T21:59:19.507137] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-22T21:59:19.850147] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:59:20.117625] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-10-22T21:59:20.394809] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-22T21:59:20.917702] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-10-22T21:59:21.013427] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-22T21:59:21.344394] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-22T21:59:21.717713] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-10-22T21:59:22.517756] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-10-22T21:59:22.791518] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-22T21:59:23.317635] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-10-22T21:59:23.503311] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T21:59:24.078846] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-22T21:59:24.117638] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-10-22T21:59:24.917627] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-10-22T21:59:25.063472] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-22T21:59:25.717751] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-10-22T21:59:25.896372] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T21:59:26.517711] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-10. [2025-10-22T21:59:26.657058] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-22T21:59:27.267552] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-22T21:59:27.317676] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-10-22T21:59:28.074383] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-22T21:59:28.082065] [INFO ] [REMOTE ] WTTR: Full fetch complete (65546 records). [2025-10-22T21:59:28.082243] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-22T21:59:28.124631] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-10-22T21:59:28.473292] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-22T21:59:28.473400] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-22T21:59:28.475001] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-22T21:59:28.475069] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-22T21:59:28.476800] [DEBUG] [LOCAL ] WTTR: Trimmed 65546 records to 44535 (keeping 200 days of data) [2025-10-22T21:59:28.761142] [DEBUG] [LOCAL ] WTTR: Primary data saved (44535 records). [2025-10-22T21:59:28.761566] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-22T21:59:28.761727] [INFO ] [MAIN ] Update Progress: 2327/2367 symbols completed. WTTR took 30.1s. Estimated remaining: 5m 9s. Rate: 7.8 symbols/min [2025-10-22T21:59:28.944463] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-10-22T21:59:28.948469] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:59:28.999473] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-22T21:59:29.035295] [DEBUG] [LOCAL ] XFLT: Loaded 30047 existing records from primary storage. [2025-10-22T21:59:29.035675] [INFO ] [MAIN ] XFLT: Loaded 30047 existing records. [2025-10-22T21:59:29.220355] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:59:29.220686] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-22T21:59:29.220757] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-22T21:59:29.221008] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-22T21:59:29.221087] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-22T21:59:29.590062] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:59:29.717771] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-10-22T21:59:29.856614] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T21:59:30.517634] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-10-22T21:59:30.766008] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-22T21:59:30.805709] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-22T21:59:31.317731] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-10-22T21:59:32.117704] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-10-22T21:59:32.223092] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-22T21:59:32.568813] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-22T21:59:32.917720] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-10-22T21:59:33.717701] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-10-22T21:59:34.208575] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-22T21:59:34.220806] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-22T21:59:34.517757] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-10-22T21:59:35.170972] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-22T21:59:35.317751] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-10-22T21:59:35.510330] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-22T21:59:36.117712] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-10-22T21:59:36.917677] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-10-22T21:59:36.986107] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-22T21:59:37.717620] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-10. [2025-10-22T21:59:37.921978] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T21:59:38.193946] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-22T21:59:38.517619] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-10-22T21:59:39.317711] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-10-22T21:59:39.554129] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-22T21:59:39.562170] [INFO ] [REMOTE ] WWW: Full fetch complete (70656 records). [2025-10-22T21:59:39.562275] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-22T21:59:39.943432] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-22T21:59:39.943528] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-22T21:59:39.944660] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-22T21:59:39.944721] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-22T21:59:39.946008] [DEBUG] [LOCAL ] WWW: Trimmed 70656 records to 49243 (keeping 200 days of data) [2025-10-22T21:59:40.120182] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-10-22T21:59:40.247076] [DEBUG] [LOCAL ] WWW: Primary data saved (49243 records). [2025-10-22T21:59:40.247219] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-22T21:59:40.247304] [INFO ] [MAIN ] Update Progress: 2328/2367 symbols completed. WWW took 30.5s. Estimated remaining: 5m 1s. Rate: 7.8 symbols/min [2025-10-22T21:59:40.422817] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-22T21:59:40.447214] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:59:40.497012] [DEBUG] [LOCAL ] XHR: Loaded 43423 existing records from primary storage. [2025-10-22T21:59:40.497286] [INFO ] [MAIN ] XHR: Loaded 43423 existing records. [2025-10-22T21:59:40.672150] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:59:40.672381] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-22T21:59:40.672432] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-22T21:59:40.672626] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-22T21:59:40.672715] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-22T21:59:40.918690] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-10-22T21:59:41.021079] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:59:41.308715] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-22T21:59:41.338433] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T21:59:41.717716] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-10-22T21:59:42.517758] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-10-22T21:59:42.735259] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T21:59:43.073367] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T21:59:43.317700] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-10-22T21:59:44.117713] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-10-22T21:59:44.253603] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-22T21:59:44.696871] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-22T21:59:44.917787] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-10. [2025-10-22T21:59:45.717805] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-10-22T21:59:45.822116] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-22T21:59:46.434716] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T21:59:46.444278] [INFO ] [REMOTE ] WU: Full fetch complete (77513 records). [2025-10-22T21:59:46.444481] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-22T21:59:46.522853] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-10-22T21:59:46.872751] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-22T21:59:46.872901] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-22T21:59:46.875007] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-22T21:59:46.875106] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-22T21:59:46.877611] [DEBUG] [LOCAL ] WU: Trimmed 77513 records to 53487 (keeping 200 days of data) [2025-10-22T21:59:47.171354] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-22T21:59:47.267686] [DEBUG] [LOCAL ] WU: Primary data saved (53487 records). [2025-10-22T21:59:47.267911] [INFO ] [MAIN ] WU: Full history saved. [2025-10-22T21:59:47.268851] [INFO ] [MAIN ] Update Progress: 2329/2367 symbols completed. WU took 39.2s. Estimated remaining: 4m 53s. Rate: 7.8 symbols/min [2025-10-22T21:59:47.330205] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-10-22T21:59:47.458704] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:59:47.459012] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-22T21:59:47.459071] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-22T21:59:47.459267] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-22T21:59:47.459399] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-22T21:59:47.459467] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-22T21:59:47.459505] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-22T21:59:47.836201] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:59:47.966864] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-22T21:59:48.117678] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-10-22T21:59:48.917733] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-10-22T21:59:49.158528] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T21:59:49.683405] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-22T21:59:49.717624] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-10-22T21:59:50.206012] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-22T21:59:50.517698] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-01. [2025-10-22T21:59:50.722949] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-22T21:59:50.723268] [WARN ] [REMOTE ] XIFR: No data returned for month 2025-01 [2025-10-22T21:59:50.723363] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-22T21:59:50.723409] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-22T21:59:50.723471] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-22T21:59:50.723542] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-22T21:59:50.723606] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-22T21:59:50.723660] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-22T21:59:50.723729] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-22T21:59:50.723776] [INFO ] [MAIN ] Update Progress: 2330/2367 symbols completed. XIFR took 3.5s. Estimated remaining: 4m 46s. Rate: 7.8 symbols/min [2025-10-22T21:59:50.889837] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:59:50.945257] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-22T21:59:50.945580] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-10-22T21:59:51.126046] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:59:51.126261] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-22T21:59:51.126309] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-22T21:59:51.126760] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-22T21:59:51.126818] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-22T21:59:51.323717] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-10. [2025-10-22T21:59:51.485047] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:59:51.571559] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-22T21:59:52.117671] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-10-22T21:59:52.705845] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-22T21:59:52.711975] [INFO ] [REMOTE ] XFLT: Full fetch complete (43995 records). [2025-10-22T21:59:52.712163] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-22T21:59:52.919924] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-10-22T21:59:53.106117] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-22T21:59:53.175950] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-22T21:59:53.176083] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-22T21:59:53.177428] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-22T21:59:53.177536] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-22T21:59:53.179369] [DEBUG] [LOCAL ] XFLT: Trimmed 43995 records to 29930 (keeping 200 days of data) [2025-10-22T21:59:53.363349] [DEBUG] [LOCAL ] XFLT: Primary data saved (29930 records). [2025-10-22T21:59:53.363540] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-22T21:59:53.363664] [INFO ] [MAIN ] Update Progress: 2331/2367 symbols completed. XFLT took 24.6s. Estimated remaining: 4m 38s. Rate: 7.8 symbols/min [2025-10-22T21:59:53.533738] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:59:53.566453] [DEBUG] [LOCAL ] XPER: Loaded 30741 existing records from primary storage. [2025-10-22T21:59:53.566857] [INFO ] [MAIN ] XPER: Loaded 30741 existing records. [2025-10-22T21:59:53.722874] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-10-22T21:59:53.761436] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:59:53.761944] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-22T21:59:53.762021] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-22T21:59:53.762216] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-22T21:59:53.762274] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-22T21:59:54.112604] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:59:54.517676] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-10. [2025-10-22T21:59:54.613835] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-22T21:59:55.255576] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T21:59:55.264297] [INFO ] [REMOTE ] WY: Full fetch complete (77043 records). [2025-10-22T21:59:55.264424] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-22T21:59:55.326504] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-10-22T21:59:55.653070] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-22T21:59:55.653268] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-22T21:59:55.654589] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-22T21:59:55.654690] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-22T21:59:55.656380] [DEBUG] [LOCAL ] WY: Trimmed 77043 records to 53213 (keeping 200 days of data) [2025-10-22T21:59:55.916078] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-22T21:59:56.022517] [DEBUG] [LOCAL ] WY: Primary data saved (53213 records). [2025-10-22T21:59:56.022681] [INFO ] [MAIN ] WY: Full history saved. [2025-10-22T21:59:56.022779] [INFO ] [MAIN ] Update Progress: 2332/2367 symbols completed. WY took 36.9s. Estimated remaining: 4m 30s. Rate: 7.8 symbols/min [2025-10-22T21:59:56.120938] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-10-22T21:59:56.190136] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T21:59:56.240936] [DEBUG] [LOCAL ] XPEV: Loaded 53619 existing records from primary storage. [2025-10-22T21:59:56.241268] [INFO ] [MAIN ] XPEV: Loaded 53619 existing records. [2025-10-22T21:59:56.418249] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T21:59:56.418502] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-22T21:59:56.418550] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-22T21:59:56.418755] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-22T21:59:56.418810] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-22T21:59:56.772548] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T21:59:56.917680] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-10-22T21:59:56.944025] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-22T21:59:57.385246] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-22T21:59:57.717741] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-10-22T21:59:58.517696] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-10-22T21:59:58.813479] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-22T21:59:59.086692] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-22T21:59:59.317629] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-10-22T22:00:00.002079] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-22T22:00:00.117716] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-10-22T22:00:00.917703] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-10-22T22:00:01.677397] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-22T22:00:01.717678] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-10-22T22:00:02.517692] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-10-22T22:00:02.702058] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-22T22:00:02.802332] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-22T22:00:03.317707] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-10-22T22:00:04.006242] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-22T22:00:04.117728] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-10-22T22:00:04.627675] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-10-22T22:00:04.917715] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-10-22T22:00:05.655021] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-22T22:00:05.717670] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-10-22T22:00:05.764944] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T22:00:06.517747] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-10-22T22:00:07.271257] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-22T22:00:07.317710] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-10-22T22:00:07.959541] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-22T22:00:08.117726] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-10-22T22:00:08.856984] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-22T22:00:08.917721] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-10-22T22:00:09.063405] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-22T22:00:09.094902] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-22T22:00:09.717807] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-10-22T22:00:10.517683] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-10. [2025-10-22T22:00:11.317638] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-10-22T22:00:11.483861] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-22T22:00:12.036074] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-22T22:00:12.043000] [INFO ] [REMOTE ] XHR: Full fetch complete (61905 records). [2025-10-22T22:00:12.043115] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-22T22:00:12.120025] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-10-22T22:00:12.480026] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-22T22:00:12.482000] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-22T22:00:12.483422] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-22T22:00:12.499965] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-22T22:00:12.509748] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-22T22:00:12.520444] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.80 seconds). [2025-10-22T22:00:12.531523] [DEBUG] [LOCAL ] XHR: Trimmed 61905 records to 43369 (keeping 200 days of data) [2025-10-22T22:00:12.788435] [DEBUG] [LOCAL ] XHR: Primary data saved (43369 records). [2025-10-22T22:00:12.788568] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-22T22:00:12.788667] [INFO ] [MAIN ] Update Progress: 2333/2367 symbols completed. XHR took 32.5s. Estimated remaining: 4m 22s. Rate: 7.8 symbols/min [2025-10-22T22:00:12.923782] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-10-22T22:00:12.954616] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:00:12.996126] [DEBUG] [LOCAL ] XPO: Loaded 47511 existing records from primary storage. [2025-10-22T22:00:12.996415] [INFO ] [MAIN ] XPO: Loaded 47511 existing records. [2025-10-22T22:00:13.195993] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:00:13.196242] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-22T22:00:13.196291] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-22T22:00:13.196528] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-22T22:00:13.196590] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-22T22:00:13.542625] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:00:13.717714] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-10-22T22:00:14.517680] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-10-22T22:00:14.627986] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-22T22:00:14.979716] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-22T22:00:15.317696] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-10-22T22:00:15.541974] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-22T22:00:15.943061] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T22:00:16.117714] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-10-22T22:00:16.917696] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-10-22T22:00:17.714397] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-22T22:00:17.723460] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-10-22T22:00:17.978737] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-10-22T22:00:18.292341] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-22T22:00:18.517675] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-10-22T22:00:19.317628] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-10-22T22:00:19.823117] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-22T22:00:20.025277] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-22T22:00:20.117703] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-10. [2025-10-22T22:00:20.720930] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T22:00:20.917682] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-10-22T22:00:21.413695] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-22T22:00:21.419745] [INFO ] [REMOTE ] XPER: Full fetch complete (43684 records). [2025-10-22T22:00:21.419857] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-22T22:00:21.722779] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-10-22T22:00:21.804828] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-22T22:00:21.804916] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-22T22:00:21.805825] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-22T22:00:21.805888] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-22T22:00:21.806885] [DEBUG] [LOCAL ] XPER: Trimmed 43684 records to 30694 (keeping 200 days of data) [2025-10-22T22:00:21.972075] [DEBUG] [LOCAL ] XPER: Primary data saved (30694 records). [2025-10-22T22:00:21.972202] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-22T22:00:21.972276] [INFO ] [MAIN ] Update Progress: 2334/2367 symbols completed. XPER took 28.6s. Estimated remaining: 4m 15s. Rate: 7.8 symbols/min [2025-10-22T22:00:22.137500] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:00:22.169089] [DEBUG] [LOCAL ] XPOF: Loaded 37043 existing records from primary storage. [2025-10-22T22:00:22.169433] [INFO ] [MAIN ] XPOF: Loaded 37043 existing records. [2025-10-22T22:00:22.344133] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:00:22.344332] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-22T22:00:22.344378] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-22T22:00:22.344609] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-22T22:00:22.344698] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-22T22:00:22.548942] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-10-22T22:00:22.694745] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:00:23.329514] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-10-22T22:00:23.335398] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-22T22:00:23.545793] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-22T22:00:24.117622] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-10. [2025-10-22T22:00:24.686833] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-22T22:00:24.759943] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-22T22:00:24.848033] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-22T22:00:24.857379] [INFO ] [REMOTE ] XOM: Full fetch complete (77973 records). [2025-10-22T22:00:24.857616] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-22T22:00:24.922741] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-10-22T22:00:25.255427] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-22T22:00:25.255517] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-22T22:00:25.256759] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-22T22:00:25.256835] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-22T22:00:25.258390] [DEBUG] [LOCAL ] XOM: Trimmed 77973 records to 53793 (keeping 200 days of data) [2025-10-22T22:00:25.603872] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-10-22T22:00:25.604012] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-22T22:00:25.604697] [INFO ] [MAIN ] Update Progress: 2335/2367 symbols completed. XOM took 34.9s. Estimated remaining: 4m 7s. Rate: 7.8 symbols/min [2025-10-22T22:00:25.722763] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-10-22T22:00:25.784243] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:00:25.833666] [DEBUG] [LOCAL ] XPRO: Loaded 45822 existing records from primary storage. [2025-10-22T22:00:25.834031] [INFO ] [MAIN ] XPRO: Loaded 45822 existing records. [2025-10-22T22:00:26.050213] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:00:26.050787] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-22T22:00:26.050950] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-22T22:00:26.051385] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-22T22:00:26.051460] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-22T22:00:26.366800] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T22:00:26.520882] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-10-22T22:00:26.623524] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:00:27.317667] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-10-22T22:00:28.117738] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-10-22T22:00:28.187605] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-22T22:00:28.318216] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T22:00:28.917695] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-10-22T22:00:28.965593] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-22T22:00:29.717671] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-10-22T22:00:29.949138] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T22:00:30.517713] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-10-22T22:00:31.227457] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-22T22:00:31.317741] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-10-22T22:00:31.383629] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-22T22:00:31.669590] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-22T22:00:32.117750] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-10-22T22:00:32.917685] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-10. [2025-10-22T22:00:32.955280] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-22T22:00:33.336760] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-22T22:00:33.717694] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-10-22T22:00:34.517724] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-10-22T22:00:35.175495] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-22T22:00:35.184429] [INFO ] [REMOTE ] XPEV: Full fetch complete (77774 records). [2025-10-22T22:00:35.184577] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-22T22:00:35.322337] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-10-22T22:00:35.574387] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-22T22:00:35.574482] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-22T22:00:35.575706] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-22T22:00:35.575841] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-22T22:00:35.612015] [DEBUG] [LOCAL ] XPEV: Trimmed 77774 records to 53619 (keeping 200 days of data) [2025-10-22T22:00:35.613839] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-22T22:00:35.933544] [DEBUG] [LOCAL ] XPEV: Primary data saved (53619 records). [2025-10-22T22:00:35.933695] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-22T22:00:35.933782] [INFO ] [MAIN ] Update Progress: 2336/2367 symbols completed. XPEV took 39.9s. Estimated remaining: 3m 59s. Rate: 7.8 symbols/min [2025-10-22T22:00:36.104420] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:00:36.120337] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-10-22T22:00:36.133153] [DEBUG] [LOCAL ] XYF: Loaded 27523 existing records from primary storage. [2025-10-22T22:00:36.133795] [INFO ] [MAIN ] XYF: Loaded 27523 existing records. [2025-10-22T22:00:36.310100] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:00:36.310336] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-22T22:00:36.310383] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-22T22:00:36.310549] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-22T22:00:36.310587] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-22T22:00:36.596874] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-22T22:00:36.721138] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:00:36.922762] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-10-22T22:00:36.935122] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T22:00:37.717724] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-10-22T22:00:37.814850] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-22T22:00:37.871540] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-22T22:00:38.517718] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-10-22T22:00:39.204277] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-22T22:00:39.317638] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-10-22T22:00:40.125180] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-10-22T22:00:40.130988] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-22T22:00:40.917850] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-10-22T22:00:40.967141] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-22T22:00:41.665267] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T22:00:41.717694] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-10-22T22:00:41.880839] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-22T22:00:42.517716] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-10-22T22:00:43.317732] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-10. [2025-10-22T22:00:43.456055] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-22T22:00:44.123016] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-10-22T22:00:44.135142] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T22:00:44.904857] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-22T22:00:44.912591] [INFO ] [REMOTE ] XPO: Full fetch complete (69611 records). [2025-10-22T22:00:44.912752] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-22T22:00:44.925101] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-10-22T22:00:45.318177] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-22T22:00:45.318260] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-22T22:00:45.319544] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-22T22:00:45.319611] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-22T22:00:45.321176] [DEBUG] [LOCAL ] XPO: Trimmed 69611 records to 47458 (keeping 200 days of data) [2025-10-22T22:00:45.626943] [DEBUG] [LOCAL ] XPO: Primary data saved (47458 records). [2025-10-22T22:00:45.627084] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-22T22:00:45.627164] [INFO ] [MAIN ] Update Progress: 2337/2367 symbols completed. XPO took 32.8s. Estimated remaining: 3m 52s. Rate: 7.8 symbols/min [2025-10-22T22:00:45.722768] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-10-22T22:00:45.823611] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:00:45.876201] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-22T22:00:45.901501] [DEBUG] [LOCAL ] XYL: Loaded 47603 existing records from primary storage. [2025-10-22T22:00:45.902119] [INFO ] [MAIN ] XYL: Loaded 47603 existing records. [2025-10-22T22:00:46.075551] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:00:46.075861] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-22T22:00:46.075922] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-22T22:00:46.076099] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-22T22:00:46.076137] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-22T22:00:46.429160] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:00:46.447215] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-22T22:00:46.517679] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-10-22T22:00:46.603230] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-22T22:00:47.317711] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-10-22T22:00:48.127184] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-10-22T22:00:48.146855] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-22T22:00:48.531678] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-22T22:00:48.917693] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-10. [2025-10-22T22:00:49.055374] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-22T22:00:49.717675] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-10-22T22:00:50.159944] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-22T22:00:50.166374] [INFO ] [REMOTE ] XPOF: Full fetch complete (52912 records). [2025-10-22T22:00:50.166486] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-22T22:00:50.518669] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-10-22T22:00:50.553253] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-22T22:00:50.554405] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-22T22:00:50.555566] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-22T22:00:50.555633] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-22T22:00:50.556841] [DEBUG] [LOCAL ] XPOF: Trimmed 52912 records to 36943 (keeping 200 days of data) [2025-10-22T22:00:50.761376] [DEBUG] [LOCAL ] XPOF: Primary data saved (36943 records). [2025-10-22T22:00:50.761507] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-22T22:00:50.761582] [INFO ] [MAIN ] Update Progress: 2338/2367 symbols completed. XPOF took 28.8s. Estimated remaining: 3m 44s. Rate: 7.8 symbols/min [2025-10-22T22:00:50.934194] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:00:50.934344] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-22T22:00:50.934384] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-22T22:00:50.934538] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-22T22:00:50.934580] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-22T22:00:50.934621] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-22T22:00:50.934693] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-22T22:00:51.314611] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:00:51.317608] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-01. [2025-10-22T22:00:51.409756] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-22T22:00:52.117723] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-10-22T22:00:52.425834] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-22T22:00:52.917715] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-02. [2025-10-22T22:00:53.145215] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-22T22:00:53.717701] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-10. [2025-10-22T22:00:53.970617] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-22T22:00:54.517693] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-10-22T22:00:55.091618] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-22T22:00:55.164504] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T22:00:55.172455] [INFO ] [REMOTE ] XPRO: Full fetch complete (66453 records). [2025-10-22T22:00:55.172634] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-22T22:00:55.326048] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-03. [2025-10-22T22:00:55.571631] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-22T22:00:55.571756] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-22T22:00:55.573057] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-22T22:00:55.573121] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-22T22:00:55.574429] [DEBUG] [LOCAL ] XPRO: Trimmed 66453 records to 45796 (keeping 200 days of data) [2025-10-22T22:00:55.797907] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-22T22:00:55.868677] [DEBUG] [LOCAL ] XPRO: Primary data saved (45796 records). [2025-10-22T22:00:55.868820] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-22T22:00:55.869549] [INFO ] [MAIN ] Update Progress: 2339/2367 symbols completed. XPRO took 30.3s. Estimated remaining: 3m 36s. Rate: 7.8 symbols/min [2025-10-22T22:00:56.038533] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:00:56.077354] [DEBUG] [LOCAL ] YALA: Loaded 36483 existing records from primary storage. [2025-10-22T22:00:56.077712] [INFO ] [MAIN ] YALA: Loaded 36483 existing records. [2025-10-22T22:00:56.122890] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-10-22T22:00:56.259527] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:00:56.259763] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-22T22:00:56.259814] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-22T22:00:56.260244] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-22T22:00:56.260301] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-22T22:00:56.621341] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:00:56.917681] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-10-22T22:00:57.665304] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-22T22:00:57.718188] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T22:00:57.718300] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-04. [2025-10-22T22:00:57.927776] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-22T22:00:58.517693] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-10-22T22:00:59.317678] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-10-22T22:01:00.005313] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-22T22:01:00.042812] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-22T22:01:00.117677] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-10-22T22:01:00.167371] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T22:01:00.917706] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-10-22T22:01:01.700552] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-22T22:01:01.717741] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-10-22T22:01:02.517721] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-05. [2025-10-22T22:01:02.775846] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-22T22:01:03.097529] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-22T22:01:03.317693] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-10-22T22:01:04.117680] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-10-22T22:01:04.915083] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-22T22:01:04.924172] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-10-22T22:01:05.005701] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-22T22:01:05.587167] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-22T22:01:05.717686] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-06. [2025-10-22T22:01:06.517731] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-10-22T22:01:06.655760] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-22T22:01:07.317689] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-10-22T22:01:07.623702] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-22T22:01:07.701323] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-22T22:01:08.117679] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-07. [2025-10-22T22:01:08.635068] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-22T22:01:08.917719] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-10-22T22:01:09.717707] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-10-22T22:01:10.011606] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-22T22:01:10.519290] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-22T22:01:10.517877] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-10. [2025-10-22T22:01:11.247624] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-22T22:01:11.271766] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-22T22:01:11.278027] [INFO ] [REMOTE ] XYF: Full fetch complete (33729 records). [2025-10-22T22:01:11.278148] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-22T22:01:11.322786] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-10-22T22:01:11.678528] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-22T22:01:11.678603] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-22T22:01:11.679304] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-22T22:01:11.679365] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-22T22:01:11.680144] [DEBUG] [LOCAL ] XYF: Trimmed 33729 records to 27365 (keeping 200 days of data) [2025-10-22T22:01:11.848947] [DEBUG] [LOCAL ] XYF: Primary data saved (27365 records). [2025-10-22T22:01:11.849068] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-22T22:01:11.849145] [INFO ] [MAIN ] Update Progress: 2340/2367 symbols completed. XYF took 35.9s. Estimated remaining: 3m 28s. Rate: 7.8 symbols/min [2025-10-22T22:01:12.020578] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:01:12.058560] [DEBUG] [LOCAL ] YELP: Loaded 45259 existing records from primary storage. [2025-10-22T22:01:12.058872] [INFO ] [MAIN ] YELP: Loaded 45259 existing records. [2025-10-22T22:01:12.122954] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-08. [2025-10-22T22:01:12.235547] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:01:12.235799] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-22T22:01:12.235846] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-22T22:01:12.236110] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-22T22:01:12.236165] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-22T22:01:12.581899] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:01:12.917706] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-10-22T22:01:13.003740] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-22T22:01:13.717669] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-10-22T22:01:14.436313] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-22T22:01:14.517634] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-10-22T22:01:14.558491] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-22T22:01:14.811073] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T22:01:15.317629] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-09. [2025-10-22T22:01:16.117688] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-10-22T22:01:16.231565] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-22T22:01:16.917691] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-10-22T22:01:17.170966] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T22:01:17.499619] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-22T22:01:17.717696] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-10. [2025-10-22T22:01:18.517742] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-10. [2025-10-22T22:01:18.701703] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-22T22:01:19.011932] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-22T22:01:19.018060] [INFO ] [REMOTE ] YALA: Full fetch complete (47146 records). [2025-10-22T22:01:19.018317] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-22T22:01:19.322869] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-10-22T22:01:19.465967] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-22T22:01:19.466142] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-22T22:01:19.467288] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-22T22:01:19.467411] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-22T22:01:19.494105] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-22T22:01:19.492923] [DEBUG] [LOCAL ] YALA: Trimmed 47146 records to 36411 (keeping 200 days of data) [2025-10-22T22:01:19.504343] [INFO ] [REMOTE ] XYZ: Full fetch complete (74413 records). [2025-10-22T22:01:19.504522] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-10-22T22:01:19.824248] [WARN ] [VALIDATOR ] XYZ: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-22T22:01:19.826477] [FATAL] [MAIN ] XYZ: Fetched primary data is invalid. Refusing to save it. [2025-10-22T22:01:19.834277] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to validation failure. [2025-10-22T22:01:19.834379] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-22T22:01:19.834459] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-22T22:01:19.834500] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-22T22:01:19.834541] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-22T22:01:19.834621] [INFO ] [MAIN ] Update Progress: 2341/2367 symbols completed. XYZ took 29.1s. Estimated remaining: 3m 21s. Rate: 7.8 symbols/min [2025-10-22T22:01:20.105248] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:01:20.118402] [DEBUG] [LOCAL ] YALA: Primary data saved (36411 records). [2025-10-22T22:01:20.118712] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-22T22:01:20.118839] [INFO ] [MAIN ] Update Progress: 2342/2367 symbols completed. YALA took 24.2s. Estimated remaining: 3m 13s. Rate: 7.8 symbols/min [2025-10-22T22:01:20.118949] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-10-22T22:01:20.309411] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:01:20.329452] [DEBUG] [LOCAL ] YETI: Loaded 52528 existing records from primary storage. [2025-10-22T22:01:20.329906] [INFO ] [MAIN ] YETI: Loaded 52528 existing records. [2025-10-22T22:01:20.532601] [DEBUG] [LOCAL ] YEXT: Loaded 43105 existing records from primary storage. [2025-10-22T22:01:20.540029] [INFO ] [MAIN ] YEXT: Loaded 43105 existing records. [2025-10-22T22:01:20.539672] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:01:20.606410] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-22T22:01:20.618249] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-22T22:01:20.646120] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-22T22:01:20.656877] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-22T22:01:20.849021] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:01:20.866909] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-22T22:01:20.883035] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-22T22:01:20.911921] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-22T22:01:20.912114] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-22T22:01:21.390155] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:01:21.421048] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-10-22T22:01:21.574220] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:01:21.622995] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-22T22:01:21.717732] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-10-22T22:01:21.787674] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-22T22:01:22.517687] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-10-22T22:01:23.083853] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-22T22:01:23.315947] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-22T22:01:23.324635] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-10-22T22:01:24.117634] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-10. [2025-10-22T22:01:24.194269] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-22T22:01:24.746455] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-22T22:01:24.858864] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-22T22:01:24.866700] [INFO ] [REMOTE ] XYL: Full fetch complete (70060 records). [2025-10-22T22:01:24.866839] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-22T22:01:24.922922] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-10-22T22:01:25.264513] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-22T22:01:25.264615] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-22T22:01:25.265769] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-22T22:01:25.265832] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-22T22:01:25.267096] [DEBUG] [LOCAL ] XYL: Trimmed 70060 records to 47551 (keeping 200 days of data) [2025-10-22T22:01:25.552941] [DEBUG] [LOCAL ] XYL: Primary data saved (47551 records). [2025-10-22T22:01:25.553066] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-22T22:01:25.553143] [INFO ] [MAIN ] Update Progress: 2343/2367 symbols completed. XYL took 39.9s. Estimated remaining: 3m 5s. Rate: 7.8 symbols/min [2025-10-22T22:01:25.720702] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-10-22T22:01:25.720405] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:01:25.769948] [DEBUG] [LOCAL ] YMM: Loaded 52583 existing records from primary storage. [2025-10-22T22:01:25.770226] [INFO ] [MAIN ] YMM: Loaded 52583 existing records. [2025-10-22T22:01:25.948084] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:01:25.948286] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-22T22:01:25.948340] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-22T22:01:25.948537] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-22T22:01:25.948591] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-22T22:01:26.302422] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:01:26.517629] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-10-22T22:01:26.705678] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T22:01:27.317735] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-10-22T22:01:27.905059] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-22T22:01:28.117794] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-10-22T22:01:28.243166] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-22T22:01:28.917632] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-10-22T22:01:29.632079] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-22T22:01:29.717980] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-10-22T22:01:29.754992] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-22T22:01:30.517718] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-10-22T22:01:30.950919] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-22T22:01:31.317721] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-10-22T22:01:31.684460] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T22:01:32.101362] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-22T22:01:32.117608] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-10-22T22:01:32.917676] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-10-22T22:01:33.238780] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-22T22:01:33.314014] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-22T22:01:33.717680] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-10-22T22:01:34.317960] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-22T22:01:34.517682] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-10-22T22:01:35.317699] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-10-22T22:01:35.579167] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-22T22:01:36.068765] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-22T22:01:36.117668] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-10-22T22:01:36.917634] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-10-22T22:01:37.318489] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-22T22:01:37.724328] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-10-22T22:01:37.754616] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-22T22:01:38.517718] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-10. [2025-10-22T22:01:38.750136] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-22T22:01:39.317696] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-10-22T22:01:39.718256] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-22T22:01:39.750235] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-22T22:01:39.758159] [INFO ] [REMOTE ] YELP: Full fetch complete (64760 records). [2025-10-22T22:01:39.758332] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-22T22:01:40.122850] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-10-22T22:01:40.170187] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-22T22:01:40.170300] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-22T22:01:40.172038] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-22T22:01:40.172108] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-22T22:01:40.173827] [DEBUG] [LOCAL ] YELP: Trimmed 64760 records to 45182 (keeping 200 days of data) [2025-10-22T22:01:40.458740] [DEBUG] [LOCAL ] YELP: Primary data saved (45182 records). [2025-10-22T22:01:40.458939] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-22T22:01:40.459045] [INFO ] [MAIN ] Update Progress: 2344/2367 symbols completed. YELP took 28.6s. Estimated remaining: 2m 58s. Rate: 7.8 symbols/min [2025-10-22T22:01:40.636380] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:01:40.636627] [DEBUG] [LOCAL ] YOU: No existing data file found in primary storage. [2025-10-22T22:01:40.636705] [WARN ] [MAIN ] YOU: No existing data found, performing full refresh instead. [2025-10-22T22:01:40.636853] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-22T22:01:40.636906] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-22T22:01:40.636948] [DEBUG] [LOCAL ] YOU: No primary data file found to delete. [2025-10-22T22:01:40.636981] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-22T22:01:40.918394] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-10-22T22:01:40.999730] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:01:41.031696] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T22:01:41.717688] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-10-22T22:01:41.780117] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-22T22:01:42.319146] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-22T22:01:42.517633] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-10-22T22:01:43.317736] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-10-22T22:01:43.436279] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-22T22:01:44.117719] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-10-22T22:01:44.334894] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-22T22:01:44.917637] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-10-22T22:01:45.115185] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-22T22:01:45.348741] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-22T22:01:45.717714] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-10-22T22:01:46.517638] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-10. [2025-10-22T22:01:47.317745] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-10-22T22:01:47.413786] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-22T22:01:47.501106] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-22T22:01:48.122719] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-10-22T22:01:48.137588] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-22T22:01:48.146977] [INFO ] [REMOTE ] YETI: Full fetch complete (75500 records). [2025-10-22T22:01:48.147099] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-22T22:01:48.543409] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-22T22:01:48.543671] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-22T22:01:48.544898] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-22T22:01:48.544985] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-22T22:01:48.566502] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-22T22:01:48.575698] [DEBUG] [LOCAL ] YETI: Trimmed 75500 records to 52517 (keeping 200 days of data) [2025-10-22T22:01:48.881604] [DEBUG] [LOCAL ] YETI: Primary data saved (52517 records). [2025-10-22T22:01:48.881822] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-22T22:01:48.881940] [INFO ] [MAIN ] Update Progress: 2345/2367 symbols completed. YETI took 29.0s. Estimated remaining: 2m 50s. Rate: 7.8 symbols/min [2025-10-22T22:01:48.925372] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-10-22T22:01:49.050582] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:01:49.095917] [DEBUG] [LOCAL ] YPF: Loaded 50761 existing records from primary storage. [2025-10-22T22:01:49.096215] [INFO ] [MAIN ] YPF: Loaded 50761 existing records. [2025-10-22T22:01:49.268752] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:01:49.268992] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-22T22:01:49.269040] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-22T22:01:49.269215] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-22T22:01:49.269252] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-22T22:01:49.629870] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:01:49.659293] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-22T22:01:49.717621] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-10-22T22:01:50.517679] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-10-22T22:01:50.640000] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-22T22:01:51.251868] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-22T22:01:51.317686] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-10-22T22:01:52.117702] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-10-22T22:01:52.366166] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-22T22:01:52.867171] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-22T22:01:52.917632] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-10-22T22:01:53.717701] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-10-22T22:01:53.865015] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-22T22:01:54.517728] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-10. [2025-10-22T22:01:54.992129] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-22T22:01:55.317748] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-10-22T22:01:55.952172] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-22T22:01:56.117677] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-10-22T22:01:56.255038] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-22T22:01:56.263697] [INFO ] [REMOTE ] YMM: Full fetch complete (76462 records). [2025-10-22T22:01:56.263844] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-22T22:01:56.647777] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-22T22:01:56.647911] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-22T22:01:56.649115] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-22T22:01:56.649229] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-22T22:01:56.650838] [DEBUG] [LOCAL ] YMM: Trimmed 76462 records to 52576 (keeping 200 days of data) [2025-10-22T22:01:56.853616] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T22:01:56.921365] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-10-22T22:01:57.014553] [DEBUG] [LOCAL ] YMM: Primary data saved (52576 records). [2025-10-22T22:01:57.014728] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-22T22:01:57.014821] [INFO ] [MAIN ] Update Progress: 2346/2367 symbols completed. YMM took 31.5s. Estimated remaining: 2m 42s. Rate: 7.8 symbols/min [2025-10-22T22:01:57.182609] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:01:57.195049] [DEBUG] [LOCAL ] YRD: Loaded 11290 existing records from primary storage. [2025-10-22T22:01:57.195242] [INFO ] [MAIN ] YRD: Loaded 11290 existing records. [2025-10-22T22:01:57.369564] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:01:57.369815] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-22T22:01:57.369863] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-22T22:01:57.370023] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-22T22:01:57.370060] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-22T22:01:57.718611] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-10-22T22:01:57.724109] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:01:57.759076] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-22T22:01:58.517683] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-10-22T22:01:58.708916] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-22T22:01:59.283323] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T22:01:59.317613] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-10. [2025-10-22T22:01:59.788676] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-22T22:02:00.117695] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-10-22T22:02:00.917677] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-10-22T22:02:01.031958] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-22T22:02:01.355325] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-22T22:02:01.362894] [INFO ] [REMOTE ] YEXT: Full fetch complete (63138 records). [2025-10-22T22:02:01.363022] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-22T22:02:01.722853] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-10-22T22:02:01.780480] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-22T22:02:01.780602] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-22T22:02:01.781751] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-22T22:02:01.781819] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-22T22:02:01.783226] [DEBUG] [LOCAL ] YEXT: Trimmed 63138 records to 43044 (keeping 200 days of data) [2025-10-22T22:02:02.046407] [DEBUG] [LOCAL ] YEXT: Primary data saved (43044 records). [2025-10-22T22:02:02.046524] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-22T22:02:02.046601] [INFO ] [MAIN ] Update Progress: 2347/2367 symbols completed. YEXT took 41.9s. Estimated remaining: 2m 34s. Rate: 7.8 symbols/min [2025-10-22T22:02:02.220559] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:02:02.246806] [DEBUG] [LOCAL ] YSG: Loaded 25683 existing records from primary storage. [2025-10-22T22:02:02.247073] [INFO ] [MAIN ] YSG: Loaded 25683 existing records. [2025-10-22T22:02:02.437021] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:02:02.437293] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-22T22:02:02.437366] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-22T22:02:02.437578] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-10-22T22:02:02.437636] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-22T22:02:02.520105] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-10-22T22:02:02.828512] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:02:02.873082] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-22T22:02:03.207252] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-22T22:02:03.317694] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-10. [2025-10-22T22:02:03.385931] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-22T22:02:04.117732] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-10-22T22:02:04.917671] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-10-22T22:02:04.977571] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-22T22:02:05.038703] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-22T22:02:05.047535] [INFO ] [REMOTE ] YOU: Full fetch complete (72375 records). [2025-10-22T22:02:05.047698] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-10-22T22:02:05.446280] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-10-22T22:02:05.446359] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-10-22T22:02:05.447676] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-10-22T22:02:05.447742] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-10-22T22:02:05.449113] [DEBUG] [LOCAL ] YOU: Trimmed 72375 records to 49536 (keeping 200 days of data) [2025-10-22T22:02:05.723719] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-10-22T22:02:05.758078] [DEBUG] [LOCAL ] YOU: Primary data saved (49536 records). [2025-10-22T22:02:05.758178] [INFO ] [MAIN ] YOU: Full history saved. [2025-10-22T22:02:05.758243] [INFO ] [MAIN ] Update Progress: 2348/2367 symbols completed. YOU took 25.3s. Estimated remaining: 2m 27s. Rate: 7.8 symbols/min [2025-10-22T22:02:05.936854] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:02:05.986868] [DEBUG] [LOCAL ] YUM: Loaded 51171 existing records from primary storage. [2025-10-22T22:02:05.987182] [INFO ] [MAIN ] YUM: Loaded 51171 existing records. [2025-10-22T22:02:06.146120] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-22T22:02:06.191274] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:02:06.191514] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-22T22:02:06.191562] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-22T22:02:06.191762] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-22T22:02:06.191817] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-22T22:02:06.522911] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-10-22T22:02:06.562803] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:02:07.317673] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-10-22T22:02:07.542160] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T22:02:07.588999] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-22T22:02:08.117638] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-10-22T22:02:08.138491] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-22T22:02:08.917681] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-10-22T22:02:09.717738] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-10-22T22:02:09.809396] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-22T22:02:09.937974] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-22T22:02:10.517729] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-10-22T22:02:11.287543] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-22T22:02:11.317732] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-10-22T22:02:11.705306] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-22T22:02:12.117697] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-10-22T22:02:12.143589] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-22T22:02:12.917725] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-10-22T22:02:13.717723] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-10-22T22:02:13.870437] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-22T22:02:14.110965] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-22T22:02:14.517715] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-10-22T22:02:15.317692] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-10-22T22:02:15.567636] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-22T22:02:16.004190] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-22T22:02:16.117683] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-10-22T22:02:16.571606] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-22T22:02:16.917789] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-10-22T22:02:17.155732] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-22T22:02:17.717755] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-10. [2025-10-22T22:02:18.517706] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-10-22T22:02:18.561277] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-22T22:02:18.563521] [INFO ] [REMOTE ] YRD: Full fetch complete (18897 records). [2025-10-22T22:02:18.563593] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-22T22:02:18.903660] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T22:02:19.004765] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-22T22:02:19.004848] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-22T22:02:19.005346] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-22T22:02:19.005416] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-22T22:02:19.006045] [DEBUG] [LOCAL ] YRD: Trimmed 18897 records to 11169 (keeping 200 days of data) [2025-10-22T22:02:19.076330] [DEBUG] [LOCAL ] YRD: Primary data saved (11169 records). [2025-10-22T22:02:19.076490] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-22T22:02:19.076606] [INFO ] [MAIN ] Update Progress: 2349/2367 symbols completed. YRD took 22.1s. Estimated remaining: 2m 19s. Rate: 7.8 symbols/min [2025-10-22T22:02:19.264631] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:02:19.313442] [DEBUG] [LOCAL ] YUMC: Loaded 52586 existing records from primary storage. [2025-10-22T22:02:19.313797] [INFO ] [MAIN ] YUMC: Loaded 52586 existing records. [2025-10-22T22:02:19.326761] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-10-22T22:02:19.522349] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:02:19.533064] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-22T22:02:19.534839] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-22T22:02:19.535535] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-22T22:02:19.535612] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-22T22:02:19.536269] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-22T22:02:19.893583] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:02:20.117673] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-10-22T22:02:20.917739] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-10-22T22:02:21.277962] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-22T22:02:21.546527] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-22T22:02:21.717714] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-10-22T22:02:22.517665] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-10-22T22:02:22.619802] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-22T22:02:22.662059] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-22T22:02:23.317760] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-10-22T22:02:24.117719] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-10-22T22:02:24.324572] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-22T22:02:24.711944] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-22T22:02:24.917683] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-10-22T22:02:25.678785] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-22T22:02:25.717626] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-10. [2025-10-22T22:02:26.517724] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-10-22T22:02:27.317750] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-10-22T22:02:27.547834] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-22T22:02:27.703072] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-22T22:02:27.712195] [INFO ] [REMOTE ] YPF: Full fetch complete (73865 records). [2025-10-22T22:02:27.712374] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-22T22:02:28.125570] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-10-22T22:02:28.151172] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-22T22:02:28.152628] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-22T22:02:28.161266] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-22T22:02:28.161449] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-22T22:02:28.176927] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-22T22:02:28.185862] [DEBUG] [LOCAL ] YPF: Trimmed 73865 records to 50750 (keeping 200 days of data) [2025-10-22T22:02:28.488106] [DEBUG] [LOCAL ] YPF: Primary data saved (50750 records). [2025-10-22T22:02:28.488224] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-22T22:02:28.488299] [INFO ] [MAIN ] Update Progress: 2350/2367 symbols completed. YPF took 39.6s. Estimated remaining: 2m 11s. Rate: 7.8 symbols/min [2025-10-22T22:02:28.662355] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:02:28.714753] [DEBUG] [LOCAL ] ZBH: Loaded 50718 existing records from primary storage. [2025-10-22T22:02:28.715096] [INFO ] [MAIN ] ZBH: Loaded 50718 existing records. [2025-10-22T22:02:28.915171] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:02:28.915488] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-22T22:02:28.915672] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-22T22:02:28.915925] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-22T22:02:28.915990] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-22T22:02:28.921226] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-10-22T22:02:29.219681] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-22T22:02:29.395434] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:02:29.717737] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-10-22T22:02:30.023763] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-22T22:02:30.059631] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-22T22:02:30.517748] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-10-22T22:02:31.192402] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-22T22:02:31.315985] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-22T22:02:31.321501] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-10-22T22:02:32.117748] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-10-22T22:02:32.917699] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-10. [2025-10-22T22:02:33.101200] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T22:02:33.717682] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-10. [2025-10-22T22:02:33.799726] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-22T22:02:33.804611] [INFO ] [REMOTE ] YSG: Full fetch complete (32551 records). [2025-10-22T22:02:33.804781] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-22T22:02:34.250246] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-22T22:02:34.250389] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-22T22:02:34.261156] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-22T22:02:34.262819] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-22T22:02:34.262908] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-22T22:02:34.264208] [DEBUG] [LOCAL ] YSG: Trimmed 32551 records to 25642 (keeping 200 days of data) [2025-10-22T22:02:34.420049] [DEBUG] [LOCAL ] YSG: Primary data saved (25642 records). [2025-10-22T22:02:34.420196] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-22T22:02:34.420326] [INFO ] [MAIN ] Update Progress: 2351/2367 symbols completed. YSG took 32.4s. Estimated remaining: 2m 4s. Rate: 7.8 symbols/min [2025-10-22T22:02:34.522947] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-10-22T22:02:34.643116] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:02:34.645766] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-22T22:02:34.655891] [INFO ] [REMOTE ] YUM: Full fetch complete (74685 records). [2025-10-22T22:02:34.656032] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-22T22:02:34.811417] [DEBUG] [LOCAL ] ZEPP: Loaded 19519 existing records from primary storage. [2025-10-22T22:02:34.847633] [INFO ] [MAIN ] ZEPP: Loaded 19519 existing records. [2025-10-22T22:02:35.285373] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-22T22:02:35.285458] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-22T22:02:35.286753] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-22T22:02:35.285151] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:02:35.286888] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-22T22:02:35.287339] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-22T22:02:35.287401] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-22T22:02:35.287838] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-10-22T22:02:35.287953] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-22T22:02:35.322878] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-10-22T22:02:35.376070] [DEBUG] [LOCAL ] YUM: Trimmed 74685 records to 51147 (keeping 200 days of data) [2025-10-22T22:02:35.937722] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:02:36.034342] [DEBUG] [LOCAL ] YUM: Primary data saved (51147 records). [2025-10-22T22:02:36.034546] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-22T22:02:36.034681] [INFO ] [MAIN ] Update Progress: 2352/2367 symbols completed. YUM took 30.3s. Estimated remaining: 1m 56s. Rate: 7.8 symbols/min [2025-10-22T22:02:36.125335] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-10-22T22:02:36.240730] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:02:36.293421] [DEBUG] [LOCAL ] ZETA: Loaded 53618 existing records from primary storage. [2025-10-22T22:02:36.293772] [INFO ] [MAIN ] ZETA: Loaded 53618 existing records. [2025-10-22T22:02:36.493209] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:02:36.493428] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-22T22:02:36.493499] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-22T22:02:36.493873] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-22T22:02:36.493951] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-22T22:02:36.700969] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-22T22:02:36.765298] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-22T22:02:36.918585] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:02:36.918671] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-10-22T22:02:37.107178] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T22:02:37.533008] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-22T22:02:37.717702] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-10-22T22:02:38.517729] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-10-22T22:02:39.317757] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-10-22T22:02:39.735513] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-22T22:02:40.117744] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-10-22T22:02:40.164709] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-22T22:02:40.471819] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-22T22:02:40.693503] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-22T22:02:40.917707] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-10-22T22:02:41.536549] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-22T22:02:41.717674] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-10-22T22:02:42.517678] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-10-22T22:02:43.317701] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-10-22T22:02:43.815005] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-22T22:02:44.117713] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-10-22T22:02:44.917718] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-10-22T22:02:44.977544] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-22T22:02:45.081734] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-22T22:02:45.323866] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-22T22:02:45.460480] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-22T22:02:45.717680] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-10-22T22:02:46.517715] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-10-22T22:02:47.317626] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-10-22T22:02:47.868208] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-22T22:02:47.922140] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-22T22:02:48.117665] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-10-22T22:02:48.889614] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-22T22:02:48.917630] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-10-22T22:02:49.717636] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-10-22T22:02:49.933230] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-22T22:02:50.517672] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-10-22T22:02:50.704664] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-22T22:02:51.317696] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-10-22T22:02:51.836340] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-22T22:02:52.117673] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-10. [2025-10-22T22:02:52.516574] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-22T22:02:52.917730] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-10-22T22:02:53.134537] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-22T22:02:53.717675] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-10-22T22:02:53.844773] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-22T22:02:53.853689] [INFO ] [REMOTE ] YUMC: Full fetch complete (76454 records). [2025-10-22T22:02:53.853842] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-22T22:02:54.253779] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-22T22:02:54.253875] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-22T22:02:54.255101] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-22T22:02:54.255182] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-22T22:02:54.256684] [DEBUG] [LOCAL ] YUMC: Trimmed 76454 records to 52576 (keeping 200 days of data) [2025-10-22T22:02:54.496544] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-22T22:02:54.517691] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-10-22T22:02:54.610187] [DEBUG] [LOCAL ] YUMC: Primary data saved (52576 records). [2025-10-22T22:02:54.610360] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-22T22:02:54.610463] [INFO ] [MAIN ] Update Progress: 2353/2367 symbols completed. YUMC took 35.5s. Estimated remaining: 1m 48s. Rate: 7.8 symbols/min [2025-10-22T22:02:54.775126] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:02:54.813854] [DEBUG] [LOCAL ] ZGN: Loaded 40965 existing records from primary storage. [2025-10-22T22:02:54.814155] [INFO ] [MAIN ] ZGN: Loaded 40965 existing records. [2025-10-22T22:02:54.995220] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:02:54.995488] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-22T22:02:54.995548] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-22T22:02:54.995811] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-22T22:02:54.995869] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-22T22:02:55.323414] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-10. [2025-10-22T22:02:55.347000] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:02:55.860765] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-22T22:02:55.960737] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T22:02:56.117693] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-10-22T22:02:56.174081] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-22T22:02:56.178234] [INFO ] [REMOTE ] ZEPP: Full fetch complete (21216 records). [2025-10-22T22:02:56.178309] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-22T22:02:56.544248] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-22T22:02:56.544324] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-22T22:02:56.544834] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-22T22:02:56.544896] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-22T22:02:56.545478] [DEBUG] [LOCAL ] ZEPP: Trimmed 21216 records to 19612 (keeping 200 days of data) [2025-10-22T22:02:56.656150] [DEBUG] [LOCAL ] ZEPP: Primary data saved (19612 records). [2025-10-22T22:02:56.656282] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-22T22:02:56.656360] [INFO ] [MAIN ] Update Progress: 2354/2367 symbols completed. ZEPP took 22.2s. Estimated remaining: 1m 40s. Rate: 7.8 symbols/min [2025-10-22T22:02:56.829899] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:02:56.851173] [DEBUG] [LOCAL ] ZH: Loaded 24749 existing records from primary storage. [2025-10-22T22:02:56.851413] [INFO ] [MAIN ] ZH: Loaded 24749 existing records. [2025-10-22T22:02:56.926022] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-10-22T22:02:57.030766] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:02:57.030978] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-22T22:02:57.031026] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-22T22:02:57.031267] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-22T22:02:57.031323] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-22T22:02:57.391295] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:02:57.413865] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-22T22:02:57.717669] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-10-22T22:02:58.517635] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-10-22T22:02:58.756023] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-22T22:02:59.086900] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-22T22:02:59.317680] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-10-22T22:03:00.117746] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-10-22T22:03:00.735086] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-22T22:03:00.820228] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-22T22:03:00.917618] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-10-22T22:03:01.717634] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-10-22T22:03:02.513824] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-22T22:03:02.528810] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-10-22T22:03:02.672109] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-22T22:03:02.779389] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-22T22:03:03.317723] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-10-22T22:03:04.117692] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-10-22T22:03:04.822706] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-22T22:03:04.927411] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-10-22T22:03:04.933583] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-22T22:03:05.592594] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-22T22:03:05.717734] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-10-22T22:03:06.059590] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-22T22:03:06.517717] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-10-22T22:03:07.183816] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-22T22:03:07.317749] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-10-22T22:03:07.835240] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-22T22:03:08.117686] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-10-22T22:03:08.917750] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-10-22T22:03:08.943822] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-22T22:03:09.717737] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-10-22T22:03:09.831259] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-10-22T22:03:10.425292] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-22T22:03:10.517688] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-10-22T22:03:10.801128] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-22T22:03:11.317721] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-10-22T22:03:12.126489] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-10-22T22:03:12.159291] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-22T22:03:12.917738] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-10-22T22:03:12.952354] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-22T22:03:13.440365] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-22T22:03:13.717720] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-10. [2025-10-22T22:03:14.517696] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-10-22T22:03:14.569481] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-22T22:03:15.317721] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-10. [2025-10-22T22:03:15.880475] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-22T22:03:16.117688] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-10-22T22:03:16.341694] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-22T22:03:16.349595] [INFO ] [REMOTE ] ZBH: Full fetch complete (73939 records). [2025-10-22T22:03:16.349747] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-22T22:03:16.742466] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-22T22:03:16.742545] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-22T22:03:16.743703] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-22T22:03:16.743766] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-22T22:03:16.745122] [DEBUG] [LOCAL ] ZBH: Trimmed 73939 records to 50705 (keeping 200 days of data) [2025-10-22T22:03:16.931474] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-10-22T22:03:17.007371] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-10 (3.29 seconds). [2025-10-22T22:03:17.026081] [INFO ] [REMOTE ] ZETA: Full fetch complete (77735 records). [2025-10-22T22:03:17.027759] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-22T22:03:17.457339] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-22T22:03:17.480199] [DEBUG] [LOCAL ] ZBH: Primary data saved (50705 records). [2025-10-22T22:03:17.485601] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-22T22:03:17.496407] [INFO ] [MAIN ] Update Progress: 2355/2367 symbols completed. ZBH took 49.0s. Estimated remaining: 1m 33s. Rate: 7.8 symbols/min [2025-10-22T22:03:17.671016] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-22T22:03:17.671149] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-22T22:03:17.672403] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-22T22:03:17.672806] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-22T22:03:17.722802] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-10. [2025-10-22T22:03:17.746497] [DEBUG] [LOCAL ] ZETA: Trimmed 77735 records to 53618 (keeping 200 days of data) [2025-10-22T22:03:17.746386] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:03:18.009955] [DEBUG] [LOCAL ] ZIM: Loaded 53470 existing records from primary storage. [2025-10-22T22:03:18.018461] [INFO ] [MAIN ] ZIM: Loaded 53470 existing records. [2025-10-22T22:03:18.208848] [DEBUG] [LOCAL ] ZETA: Primary data saved (53618 records). [2025-10-22T22:03:18.211447] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-22T22:03:18.211569] [INFO ] [MAIN ] Update Progress: 2356/2367 symbols completed. ZETA took 42.2s. Estimated remaining: 1m 25s. Rate: 7.8 symbols/min [2025-10-22T22:03:18.398292] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:03:18.419742] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-22T22:03:18.425108] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-22T22:03:18.452438] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-10-22T22:03:18.471294] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:03:18.471528] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-22T22:03:18.620107] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-22T22:03:18.699610] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-10. [2025-10-22T22:03:18.830945] [DEBUG] [LOCAL ] ZIP: Loaded 43531 existing records from primary storage. [2025-10-22T22:03:18.857768] [INFO ] [MAIN ] ZIP: Loaded 43531 existing records. [2025-10-22T22:03:18.930724] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:03:19.017794] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-22T22:03:19.058520] [INFO ] [REMOTE ] ZH: Full fetch complete (39741 records). [2025-10-22T22:03:19.091377] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-22T22:03:19.168975] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:03:19.260272] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-22T22:03:19.276245] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-22T22:03:19.286349] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-22T22:03:19.307933] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-22T22:03:19.325816] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-10-22T22:03:20.023566] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-22T22:03:20.043726] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-22T22:03:20.046828] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-22T22:03:20.046941] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-22T22:03:20.091714] [DEBUG] [LOCAL ] ZH: Trimmed 39741 records to 24633 (keeping 200 days of data) [2025-10-22T22:03:20.127386] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:03:20.128203] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-10-22T22:03:20.268482] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-22T22:03:20.282457] [INFO ] [REMOTE ] ZGN: Full fetch complete (58801 records). [2025-10-22T22:03:20.283689] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-22T22:03:20.364699] [DEBUG] [LOCAL ] ZH: Primary data saved (24633 records). [2025-10-22T22:03:20.380780] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-22T22:03:20.388797] [INFO ] [MAIN ] Update Progress: 2357/2367 symbols completed. ZH took 23.7s. Estimated remaining: 1m 17s. Rate: 7.8 symbols/min [2025-10-22T22:03:20.702938] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-22T22:03:20.703030] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-22T22:03:20.704226] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-22T22:03:20.704290] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-22T22:03:20.705526] [DEBUG] [LOCAL ] ZGN: Trimmed 58801 records to 40896 (keeping 200 days of data) [2025-10-22T22:03:20.951165] [DEBUG] [LOCAL ] ZGN: Primary data saved (40896 records). [2025-10-22T22:03:20.951291] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-22T22:03:20.951370] [INFO ] [MAIN ] Update Progress: 2358/2367 symbols completed. ZGN took 26.3s. Estimated remaining: 1m 9s. Rate: 7.8 symbols/min [2025-10-22T22:03:21.583246] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-22T22:03:21.589859] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-10-22T22:03:21.618950] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-22T22:03:21.717743] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-10-22T22:03:23.199244] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T22:03:23.206530] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-10-22T22:03:23.920494] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-22T22:03:23.931056] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-10-22T22:03:25.398912] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-22T22:03:25.409789] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-10-22T22:03:26.535680] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-10-22T22:03:26.547054] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-10-22T22:03:27.008882] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T22:03:27.019547] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-10-22T22:03:28.658999] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T22:03:28.668678] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-10-22T22:03:29.261344] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-10-22T22:03:29.274095] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-10-22T22:03:30.198892] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-22T22:03:30.208069] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-10-22T22:03:31.329017] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-22T22:03:31.340561] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-10-22T22:03:31.746968] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-22T22:03:31.757375] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-10-22T22:03:33.294179] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-22T22:03:33.305334] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-10-22T22:03:33.375369] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-22T22:03:33.385837] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-10-22T22:03:34.952260] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-22T22:03:34.961874] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-10. [2025-10-22T22:03:35.562976] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-22T22:03:35.574762] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-10-22T22:03:36.123597] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-22T22:03:36.131943] [INFO ] [REMOTE ] ZIP: Full fetch complete (60817 records). [2025-10-22T22:03:36.132197] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-22T22:03:36.531965] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-22T22:03:36.532091] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-22T22:03:36.534540] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-22T22:03:36.534693] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-22T22:03:36.536562] [DEBUG] [LOCAL ] ZIP: Trimmed 60817 records to 43466 (keeping 200 days of data) [2025-10-22T22:03:36.817414] [DEBUG] [LOCAL ] ZIP: Primary data saved (43466 records). [2025-10-22T22:03:36.817690] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-22T22:03:36.817814] [INFO ] [MAIN ] Update Progress: 2359/2367 symbols completed. ZIP took 18.6s. Estimated remaining: 1m 2s. Rate: 7.8 symbols/min [2025-10-22T22:03:37.634366] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-22T22:03:37.647274] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-10-22T22:03:40.117622] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-22T22:03:40.129863] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-10. [2025-10-22T22:03:42.278567] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-22T22:03:42.288570] [INFO ] [REMOTE ] ZIM: Full fetch complete (77583 records). [2025-10-22T22:03:42.288819] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-22T22:03:42.699983] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-22T22:03:42.700146] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-22T22:03:42.702212] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-22T22:03:42.702338] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-22T22:03:42.704594] [DEBUG] [LOCAL ] ZIM: Trimmed 77583 records to 53462 (keeping 200 days of data) [2025-10-22T22:03:43.070058] [DEBUG] [LOCAL ] ZIM: Primary data saved (53462 records). [2025-10-22T22:03:43.070298] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-22T22:03:43.070423] [INFO ] [MAIN ] Update Progress: 2360/2367 symbols completed. ZIM took 25.6s. Estimated remaining: 54.0s. Rate: 7.8 symbols/min [2025-10-22T22:03:43.721047] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:03:43.803857] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:03:43.824319] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:03:43.801957] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:03:43.835512] [DEBUG] [LOCAL ] ZKH: Loaded 7360 existing records from primary storage. [2025-10-22T22:03:43.835795] [INFO ] [MAIN ] ZKH: Loaded 7360 existing records. [2025-10-22T22:03:43.977831] [DEBUG] [LOCAL ] ZTR: Loaded 16602 existing records from primary storage. [2025-10-22T22:03:43.976610] [DEBUG] [LOCAL ] ZK: Loaded 39001 existing records from primary storage. [2025-10-22T22:03:43.999212] [INFO ] [MAIN ] ZK: Loaded 39001 existing records. [2025-10-22T22:03:43.999305] [INFO ] [MAIN ] ZTR: Loaded 16602 existing records. [2025-10-22T22:03:44.136212] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:03:44.215241] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-22T22:03:44.247028] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-22T22:03:44.304550] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-22T22:03:44.304889] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-22T22:03:44.317514] [DEBUG] [LOCAL ] ZTO: Loaded 49407 existing records from primary storage. [2025-10-22T22:03:44.333141] [INFO ] [MAIN ] ZTO: Loaded 49407 existing records. [2025-10-22T22:03:44.571628] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:03:44.631554] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-22T22:03:44.617329] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:03:44.663158] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-22T22:03:44.668463] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-22T22:03:44.663071] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-22T22:03:44.684460] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-22T22:03:44.694905] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-22T22:03:44.718581] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-22T22:03:44.960914] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-22T22:03:45.031175] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:03:45.103982] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-22T22:03:45.138478] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-22T22:03:45.234332] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-22T22:03:45.392445] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:03:45.332569] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-22T22:03:45.429589] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-10-22T22:03:46.050635] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:03:46.087192] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-10-22T22:03:46.073869] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:03:46.105971] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-10-22T22:03:46.266998] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:03:46.267299] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-10-22T22:03:46.465894] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-22T22:03:46.469408] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-10-22T22:03:47.272128] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-22T22:03:47.275148] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-10-22T22:03:47.341266] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-22T22:03:47.347379] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-10-22T22:03:47.540938] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-22T22:03:47.550884] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-10-22T22:03:47.597900] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-22T22:03:47.604949] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-10-22T22:03:47.778195] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-22T22:03:47.780933] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-10-22T22:03:48.068144] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-22T22:03:48.073377] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-10-22T22:03:48.527953] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-22T22:03:48.530322] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-10-22T22:03:48.939440] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-22T22:03:48.941099] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-10-22T22:03:49.035245] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-22T22:03:49.040112] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-10-22T22:03:49.125573] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-22T22:03:49.133691] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-10-22T22:03:49.160521] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-22T22:03:49.170687] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-10-22T22:03:49.522317] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-22T22:03:49.523957] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-10-22T22:03:49.788601] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-22T22:03:49.792777] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-10-22T22:03:50.433556] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-22T22:03:50.437771] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-10-22T22:03:50.629165] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-22T22:03:50.632428] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-10-22T22:03:50.863372] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-22T22:03:50.906433] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-22T22:03:50.967547] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-22T22:03:51.295722] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-22T22:03:51.317721] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-10-22T22:03:52.005470] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-22T22:03:52.117708] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-10-22T22:03:52.917708] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-10-22T22:03:53.717672] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-10-22T22:03:53.831352] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-22T22:03:54.032298] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-22T22:03:54.517739] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-10. [2025-10-22T22:03:54.878473] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-22T22:03:54.879754] [INFO ] [REMOTE ] ZKH: Full fetch complete (11792 records). [2025-10-22T22:03:54.879821] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-22T22:03:55.246734] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-22T22:03:55.246877] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-22T22:03:55.247305] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-22T22:03:55.247417] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-22T22:03:55.248265] [DEBUG] [LOCAL ] ZKH: Trimmed 11792 records to 7323 (keeping 200 days of data) [2025-10-22T22:03:55.320089] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-22T22:03:55.320211] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-10-22T22:03:55.340051] [DEBUG] [LOCAL ] ZKH: Primary data saved (7323 records). [2025-10-22T22:03:55.340152] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-22T22:03:55.340240] [INFO ] [MAIN ] Update Progress: 2361/2367 symbols completed. ZKH took 12.3s. Estimated remaining: 46.3s. Rate: 7.8 symbols/min [2025-10-22T22:03:55.508498] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:03:55.556918] [DEBUG] [LOCAL ] ZTS: Loaded 53131 existing records from primary storage. [2025-10-22T22:03:55.557226] [INFO ] [MAIN ] ZTS: Loaded 53131 existing records. [2025-10-22T22:03:55.733727] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:03:55.733982] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-22T22:03:55.734041] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-22T22:03:55.734363] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-22T22:03:55.734402] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-22T22:03:56.094800] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:03:56.117617] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-10-22T22:03:56.917631] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-10-22T22:03:57.002609] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-22T22:03:57.717679] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-10-22T22:03:57.894082] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-22T22:03:58.006703] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-22T22:03:58.517723] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-10-22T22:03:59.172540] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-22T22:03:59.317694] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-10-22T22:04:00.117677] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-10-22T22:04:00.354799] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-22T22:04:00.647562] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-22T22:04:00.917742] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-10-22T22:04:01.175098] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-22T22:04:01.717730] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-10. [2025-10-22T22:04:02.517755] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-10-22T22:04:02.659810] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-22T22:04:02.663366] [INFO ] [REMOTE ] ZTR: Full fetch complete (26825 records). [2025-10-22T22:04:02.663493] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-22T22:04:03.085814] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-22T22:04:03.085917] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-22T22:04:03.086990] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-22T22:04:03.087056] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-22T22:04:03.087899] [DEBUG] [LOCAL ] ZTR: Trimmed 26825 records to 16504 (keeping 200 days of data) [2025-10-22T22:04:03.197241] [DEBUG] [LOCAL ] ZTR: Primary data saved (16504 records). [2025-10-22T22:04:03.197527] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-22T22:04:03.197670] [INFO ] [MAIN ] Update Progress: 2362/2367 symbols completed. ZTR took 20.1s. Estimated remaining: 38.6s. Rate: 7.8 symbols/min [2025-10-22T22:04:03.319404] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-10-22T22:04:03.411108] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-22T22:04:03.415237] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:04:03.465121] [DEBUG] [LOCAL ] ZVIA: Loaded 35811 existing records from primary storage. [2025-10-22T22:04:03.465705] [INFO ] [MAIN ] ZVIA: Loaded 35811 existing records. [2025-10-22T22:04:03.649872] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:04:03.650187] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-22T22:04:03.650238] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-22T22:04:03.650576] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-10-22T22:04:03.650633] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-22T22:04:04.025208] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:04:04.117669] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-10-22T22:04:04.310070] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-22T22:04:04.850729] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-22T22:04:04.917745] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-10-22T22:04:05.656272] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-22T22:04:05.717758] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-10-22T22:04:06.522881] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-10-22T22:04:06.550010] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-22T22:04:07.154725] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-22T22:04:07.317711] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-10-22T22:04:08.117739] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-10-22T22:04:08.512885] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-22T22:04:08.656100] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-22T22:04:08.917754] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-10-22T22:04:09.723942] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-10-22T22:04:09.730636] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-22T22:04:10.338166] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-22T22:04:10.517720] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-10-22T22:04:11.317788] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-10. [2025-10-22T22:04:11.698944] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-22T22:04:11.878984] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-22T22:04:12.117740] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-10-22T22:04:12.733119] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-22T22:04:12.740833] [INFO ] [REMOTE ] ZK: Full fetch complete (57055 records). [2025-10-22T22:04:12.740985] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-22T22:04:12.926623] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-10-22T22:04:13.151385] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-22T22:04:13.151498] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-22T22:04:13.153611] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-22T22:04:13.153704] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-22T22:04:13.155474] [DEBUG] [LOCAL ] ZK: Trimmed 57055 records to 38961 (keeping 200 days of data) [2025-10-22T22:04:13.401068] [DEBUG] [LOCAL ] ZK: Primary data saved (38961 records). [2025-10-22T22:04:13.401271] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-22T22:04:13.401370] [INFO ] [MAIN ] Update Progress: 2363/2367 symbols completed. ZK took 30.3s. Estimated remaining: 30.9s. Rate: 7.8 symbols/min [2025-10-22T22:04:13.583741] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-10-14 to 2025-10-22. [2025-10-22T22:04:13.625712] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-22T22:04:13.675415] [DEBUG] [LOCAL ] ZWS: Loaded 42220 existing records from primary storage. [2025-10-22T22:04:13.676016] [INFO ] [MAIN ] ZWS: Loaded 42220 existing records. [2025-10-22T22:04:13.722783] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-10-22T22:04:13.876130] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-04-04, but need from 2025-01-06 for 200 day retention. Performing full refresh. [2025-10-22T22:04:13.876465] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-22T22:04:13.876517] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-22T22:04:13.876796] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-22T22:04:13.876855] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-22T22:04:14.269104] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2025-01-06 to 2025-10-22 (requires 10 months of data pull). [2025-10-22T22:04:14.517744] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-10-22T22:04:14.840351] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-22T22:04:15.101953] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-22T22:04:15.317760] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-10-22T22:04:16.117680] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-10-22T22:04:16.161938] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-22T22:04:16.917744] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-10-22T22:04:17.274711] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-22T22:04:17.598401] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-22T22:04:17.717747] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-10-22T22:04:18.517714] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-10-22T22:04:18.727284] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-22T22:04:18.845424] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-22T22:04:19.317710] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-10-22T22:04:20.086344] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-22T22:04:20.117624] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-10-22T22:04:20.609138] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-22T22:04:20.917666] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-10-22T22:04:21.717700] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-10-22T22:04:21.742139] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-22T22:04:22.517697] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-10. [2025-10-22T22:04:22.935441] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-22T22:04:23.317704] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-10-22T22:04:23.495071] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-22T22:04:24.009285] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-22T22:04:24.017841] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52574 records). [2025-10-22T22:04:24.018100] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-22T22:04:24.120723] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-10. [2025-10-22T22:04:24.405788] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-22T22:04:24.405893] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-22T22:04:24.407093] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-22T22:04:24.407159] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-22T22:04:24.408402] [DEBUG] [LOCAL ] ZVIA: Trimmed 52574 records to 35832 (keeping 200 days of data) [2025-10-22T22:04:24.627881] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35832 records). [2025-10-22T22:04:24.628081] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-22T22:04:24.628180] [INFO ] [MAIN ] Update Progress: 2364/2367 symbols completed. ZVIA took 21.4s. Estimated remaining: 23.2s. Rate: 7.8 symbols/min [2025-10-22T22:04:24.917717] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-10-22T22:04:24.957491] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-22T22:04:25.717720] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-10-22T22:04:26.053733] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-22T22:04:26.061707] [INFO ] [REMOTE ] ZTO: Full fetch complete (72788 records). [2025-10-22T22:04:26.061830] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-22T22:04:26.452176] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-22T22:04:26.452277] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-22T22:04:26.453560] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-22T22:04:26.453625] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-22T22:04:26.454997] [DEBUG] [LOCAL ] ZTO: Trimmed 72788 records to 49371 (keeping 200 days of data) [2025-10-22T22:04:26.766873] [DEBUG] [LOCAL ] ZTO: Primary data saved (49371 records). [2025-10-22T22:04:26.766997] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-22T22:04:26.767074] [INFO ] [MAIN ] Update Progress: 2365/2367 symbols completed. ZTO took 43.7s. Estimated remaining: 15.4s. Rate: 7.8 symbols/min [2025-10-22T22:04:26.797462] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-22T22:04:26.808841] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-10-22T22:04:27.156843] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-22T22:04:27.317677] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-10-22T22:04:28.766762] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-22T22:04:28.778525] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-10. [2025-10-22T22:04:29.102638] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-22T22:04:29.112847] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-10-22T22:04:29.501997] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-22T22:04:29.510952] [INFO ] [REMOTE ] ZTS: Full fetch complete (76896 records). [2025-10-22T22:04:29.511095] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-22T22:04:29.928747] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-22T22:04:29.928852] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-22T22:04:29.930047] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-22T22:04:29.930109] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-22T22:04:29.931431] [DEBUG] [LOCAL ] ZTS: Trimmed 76896 records to 53128 (keeping 200 days of data) [2025-10-22T22:04:30.259417] [DEBUG] [LOCAL ] ZTS: Primary data saved (53128 records). [2025-10-22T22:04:30.259525] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-22T22:04:30.259601] [INFO ] [MAIN ] Update Progress: 2366/2367 symbols completed. ZTS took 34.9s. Estimated remaining: 7.7s. Rate: 7.8 symbols/min [2025-10-22T22:04:30.628564] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-22T22:04:30.638051] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-10-22T22:04:32.236116] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-22T22:04:32.246076] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-10. [2025-10-22T22:04:33.696836] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-22T22:04:33.704407] [INFO ] [REMOTE ] ZWS: Full fetch complete (62047 records). [2025-10-22T22:04:33.704579] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-22T22:04:34.099116] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-22T22:04:34.099202] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-22T22:04:34.100286] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-22T22:04:34.100349] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-22T22:04:34.101685] [DEBUG] [LOCAL ] ZWS: Trimmed 62047 records to 42136 (keeping 200 days of data) [2025-10-22T22:04:34.361242] [DEBUG] [LOCAL ] ZWS: Primary data saved (42136 records). [2025-10-22T22:04:34.361378] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-22T22:04:34.361982] [INFO ] [MAIN ] Update Progress: 2367/2367 symbols completed. ZWS took 21.0s. Estimated remaining: 0.0s. Rate: 7.8 symbols/min [2025-10-22T22:04:34.363307] [INFO ] [MAIN ] Parallel update completed in 5h 4m 30s [2025-10-22T22:04:34.363399] [WARN ] [MAIN ] Failed symbols (315): AAM, AAUC, ABBV, ABM, ACA, ABR, ACCO, ACM, ACP, ACN... [2025-10-22T22:04:34.363493] [INFO ] [MAIN ] Update success rate: 86.7% (2052/2367 symbols) [2025-10-22T22:04:35.104524] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2052/2367 @ 86.69%)' [2025-10-22T22:04:35.105336] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-22T22:04:35.105409] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-22T22:04:35.105454] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-22T22:04:35.105620] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-22T22:04:35.105706] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-22T22:04:36.758614] [DEBUG] [SYMBOL ] Found 2419 valid NYSE symbols. [2025-10-22T22:04:36.758882] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-22T22:04:36.759101] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-22T22:04:36.759770] [INFO ] [LOCAL ] Symbols cache updated with 2367 symbols. [2025-10-22T22:04:36.759829] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-22T22:04:36.759861] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-22T22:04:36.759918] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-22T22:04:36.759950] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-22T22:04:36.759980] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-22T22:04:36.760356] [DEBUG] [LOCAL ] Found 2367 symbols in cached list. [2025-10-22T22:04:36.760408] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-22T22:04:36.760591] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-22T22:04:36.760625] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2367 valid symbols. [2025-10-22T22:04:36.760691] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-22T22:04:36.760738] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-22T22:04:36.787669] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-22T22:04:36.814138] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-22T22:04:36.814277] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-22T22:04:36.814316] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-22T22:04:36.814346] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-22T22:04:36.814402] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-22T22:04:36.814435] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-22T22:04:36.814528] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-22T22:04:36.815751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-10-22T22:04:36.815883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-22T22:04:36.815966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-22T22:04:36.816092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-22T22:04:36.816206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-22T22:04:36.816316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-10-22T22:04:36.816412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-10-22T22:04:36.816488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-10-22T22:04:36.816580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-22T22:04:36.816726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-22T22:04:36.816885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-10-22T22:04:36.817016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-10-22T22:04:36.817124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-10-22T22:04:36.817250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-10-22T22:04:36.817366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-10-22T22:04:36.817499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-10-22T22:04:36.817602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-10-22T22:04:36.817720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-22T22:04:36.817818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-22T22:04:36.817913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-22T22:04:36.818011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-10-22T22:04:36.818135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-10-22T22:04:36.818292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-10-22T22:04:36.818372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-10-22T22:04:36.818494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-10-22T22:04:36.818595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-10-22T22:04:36.818713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-22T22:04:36.818809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-10-22T22:04:36.818944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-10-22T22:04:36.819039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-10-22T22:04:36.819127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-22T22:04:36.819196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-10-22T22:04:36.819266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-10-22T22:04:36.819358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-10-22T22:04:36.819450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-22T22:04:36.819593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-22T22:04:36.819713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-10-22T22:04:36.819823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-10-22T22:04:36.819895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-10-22T22:04:36.819964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-10-22T22:04:36.820044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-10-22T22:04:36.820112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRK.csv [2025-10-22T22:04:36.820194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-22T22:04:36.820277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-22T22:04:36.820394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-22T22:04:36.820487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-10-22T22:04:36.820598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-10-22T22:04:36.820733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-22T22:04:36.820850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-22T22:04:36.820950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-10-22T22:04:36.821024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-22T22:04:36.821092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-10-22T22:04:36.821213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-22T22:04:36.821322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-22T22:04:36.821414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-22T22:04:36.821506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-22T22:04:36.821579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-22T22:04:36.821692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-10-22T22:04:36.821785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-10-22T22:04:36.821856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-22T22:04:36.821940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-10-22T22:04:36.822008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-10-22T22:04:36.822072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-22T22:04:36.822158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-10-22T22:04:36.822236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-22T22:04:36.822304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-22T22:04:36.822387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-10-22T22:04:36.822480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-22T22:04:36.822565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-22T22:04:36.822688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-10-22T22:04:36.822810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-22T22:04:36.822913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-10-22T22:04:36.822982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-22T22:04:36.823082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-10-22T22:04:36.823178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-10-22T22:04:36.823249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-10-22T22:04:36.823318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-10-22T22:04:36.823386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-10-22T22:04:36.823455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-22T22:04:36.823541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-22T22:04:36.823671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-10-22T22:04:36.823770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-10-22T22:04:36.823843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-10-22T22:04:36.823917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-10-22T22:04:36.823985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-10-22T22:04:36.824052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-10-22T22:04:36.824122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-22T22:04:36.824198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-10-22T22:04:36.824287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-10-22T22:04:36.824370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-10-22T22:04:36.824452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-22T22:04:36.824561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-10-22T22:04:36.824663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-22T22:04:36.824776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-22T22:04:36.824855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-22T22:04:36.824945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-22T22:04:36.825063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-10-22T22:04:36.825136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-22T22:04:36.825208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-22T22:04:36.825277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-22T22:04:36.825375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-10-22T22:04:36.825485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-10-22T22:04:36.825575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-22T22:04:36.825718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-22T22:04:36.825808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-10-22T22:04:36.825878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-22T22:04:36.825945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-22T22:04:36.826013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-22T22:04:36.826078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-22T22:04:36.826149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-22T22:04:36.826216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-10-22T22:04:36.826300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-10-22T22:04:36.826403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-10-22T22:04:36.826497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-22T22:04:36.826571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-10-22T22:04:36.826667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-10-22T22:04:36.826766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-10-22T22:04:36.826845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-22T22:04:36.826931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-22T22:04:36.827001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-22T22:04:36.827084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-10-22T22:04:36.827153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-10-22T22:04:36.827221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-22T22:04:36.827289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-10-22T22:04:36.827380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-10-22T22:04:36.827523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-22T22:04:36.827627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-22T22:04:36.827751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-10-22T22:04:36.827839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-22T22:04:36.828016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-10-22T22:04:36.828087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PG.csv [2025-10-22T22:04:36.828157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-22T22:04:36.828224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-10-22T22:04:36.828316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-22T22:04:36.828421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-22T22:04:36.828507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-22T22:04:36.828597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-22T22:04:36.828703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-10-22T22:04:36.828797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-22T22:04:36.828869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-10-22T22:04:36.828989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-10-22T22:04:36.829113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-22T22:04:36.829193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-22T22:04:36.829266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-22T22:04:36.829334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-10-22T22:04:36.829412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-22T22:04:36.829497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-22T22:04:36.829570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-10-22T22:04:36.829666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-10-22T22:04:36.829765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-22T22:04:36.829842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-10-22T22:04:36.829938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-10-22T22:04:36.830034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-22T22:04:36.830109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-10-22T22:04:36.830180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-10-22T22:04:36.830266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-10-22T22:04:36.830335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-10-22T22:04:36.830430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-10-22T22:04:36.830540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-22T22:04:36.830671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-22T22:04:36.830771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-10-22T22:04:36.830845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-22T22:04:36.830937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-22T22:04:36.831047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-10-22T22:04:36.831126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-22T22:04:36.831199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-10-22T22:04:36.831272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-10-22T22:04:36.831383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-22T22:04:36.831479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-10-22T22:04:36.831573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-22T22:04:36.831755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-22T22:04:36.831867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-10-22T22:04:36.831946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-10-22T22:04:36.832032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-22T22:04:36.832130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-22T22:04:36.832216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-22T22:04:36.832327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-22T22:04:36.832413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-22T22:04:36.832531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-10-22T22:04:36.832622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-22T22:04:36.832906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-22T22:04:36.833001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-10-22T22:04:36.833069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-10-22T22:04:36.833139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-22T22:04:36.833212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-22T22:04:36.833286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-10-22T22:04:36.833357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-10-22T22:04:36.833425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-22T22:04:36.833497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-10-22T22:04:36.833588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-10-22T22:04:36.833711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-10-22T22:04:36.833808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-10-22T22:04:36.833885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-10-22T22:04:36.834591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-22T22:04:36.834726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-10-22T22:04:36.834818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-10-22T22:04:36.834893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-10-22T22:04:36.834981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-22T22:04:36.835069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-10-22T22:04:36.835166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-22T22:04:36.835296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-10-22T22:04:36.835380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-22T22:04:36.835465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-10-22T22:04:36.835541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-22T22:04:36.835612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-10-22T22:04:36.835727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-10-22T22:04:36.835821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-22T22:04:36.835979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBTM.csv [2025-10-22T22:04:36.836087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-10-22T22:04:36.836166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-10-22T22:04:36.836272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-22T22:04:36.836385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-10-22T22:04:36.836508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-10-22T22:04:36.836627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-10-22T22:04:36.836756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-10-22T22:04:36.836837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-10-22T22:04:36.836909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-10-22T22:04:36.836977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-22T22:04:36.837093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-10-22T22:04:36.837288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-10-22T22:04:36.837509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-10-22T22:04:36.837624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-22T22:04:36.837782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-22T22:04:36.837877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-22T22:04:36.837956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-22T22:04:36.838041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-10-22T22:04:36.838113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-10-22T22:04:36.838198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-22T22:04:36.838354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-10-22T22:04:36.838466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-10-22T22:04:36.838597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-10-22T22:04:36.838730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-10-22T22:04:36.838852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-10-22T22:04:36.838951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-22T22:04:36.839029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-10-22T22:04:36.839353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-10-22T22:04:36.839452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-10-22T22:04:36.839530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-10-22T22:04:36.839609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-10-22T22:04:36.839734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-22T22:04:36.839841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-10-22T22:04:36.839919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-10-22T22:04:36.840104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-10-22T22:04:36.840201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-22T22:04:36.840292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-10-22T22:04:36.840368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-22T22:04:36.840437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-10-22T22:04:36.840522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-22T22:04:36.840599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-10-22T22:04:36.840999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-10-22T22:04:36.841103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-10-22T22:04:36.841202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-10-22T22:04:36.841271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-10-22T22:04:36.841351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-22T22:04:36.841423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-10-22T22:04:36.841489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-22T22:04:36.841580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-22T22:04:36.841716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-22T22:04:36.841811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-10-22T22:04:36.841887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-10-22T22:04:36.841953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-22T22:04:36.842022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-22T22:04:36.842088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-10-22T22:04:36.842158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-10-22T22:04:36.842281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-10-22T22:04:36.842478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-22T22:04:36.842618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-22T22:04:36.842745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-22T22:04:36.842850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-22T22:04:36.842947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-10-22T22:04:36.843024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-22T22:04:36.843094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-10-22T22:04:36.843182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-10-22T22:04:36.843300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-22T22:04:36.843402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-22T22:04:36.843478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-22T22:04:36.843553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-22T22:04:36.843623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-22T22:04:36.843751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-22T22:04:36.843836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-10-22T22:04:36.843911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-22T22:04:36.843990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-22T22:04:36.844071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-22T22:04:36.844190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCG.csv [2025-10-22T22:04:36.844272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-22T22:04:36.844361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-10-22T22:04:36.844449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-22T22:04:36.844541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-10-22T22:04:36.844611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-22T22:04:36.844714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-10-22T22:04:36.844825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-22T22:04:36.844933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-22T22:04:36.845013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-22T22:04:36.845100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-10-22T22:04:36.845189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-10-22T22:04:36.845285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-22T22:04:36.845376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-22T22:04:36.845471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-10-22T22:04:36.845543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-22T22:04:36.845659] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-10-22T22:04:36.845773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-22T22:04:36.845849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-10-22T22:04:36.845924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-10-22T22:04:36.846011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-22T22:04:36.846085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-22T22:04:36.846154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-22T22:04:36.846221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-10-22T22:04:36.846286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-22T22:04:36.846356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-10-22T22:04:36.846426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-22T22:04:36.846529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-10-22T22:04:36.846723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-10-22T22:04:36.846845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-22T22:04:36.846938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-22T22:04:36.847008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-10-22T22:04:36.847095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-22T22:04:36.847172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-10-22T22:04:36.847246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-22T22:04:36.847312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-10-22T22:04:36.847386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-22T22:04:36.847502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-10-22T22:04:36.847606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-10-22T22:04:36.847726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-10-22T22:04:36.847829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-10-22T22:04:36.847920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-22T22:04:36.847990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-22T22:04:36.848074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-22T22:04:36.848141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-10-22T22:04:36.848208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-10-22T22:04:36.848283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-10-22T22:04:36.848367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-10-22T22:04:36.848432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-22T22:04:36.848516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-22T22:04:36.848589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-22T22:04:36.849161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-10-22T22:04:36.849263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-22T22:04:36.849346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-22T22:04:36.849417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-10-22T22:04:36.849499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-10-22T22:04:36.849582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-10-22T22:04:36.849719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-22T22:04:36.849812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-10-22T22:04:36.849882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-10-22T22:04:36.849956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-22T22:04:36.850028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-22T22:04:36.850097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-10-22T22:04:36.850164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-10-22T22:04:36.850229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-10-22T22:04:36.850310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-10-22T22:04:36.850392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-10-22T22:04:36.850474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-10-22T22:04:36.850543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-22T22:04:36.850612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-10-22T22:04:36.850709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-10-22T22:04:36.850838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-22T22:04:36.850929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-10-22T22:04:36.850998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-22T22:04:36.851064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-22T22:04:36.851145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-10-22T22:04:36.851270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-22T22:04:36.851342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-10-22T22:04:36.851412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-10-22T22:04:36.851483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-10-22T22:04:36.851564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNC.csv [2025-10-22T22:04:36.851636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-10-22T22:04:36.851775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-10-22T22:04:36.851886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-10-22T22:04:36.851995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-22T22:04:36.852068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-10-22T22:04:36.852176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-10-22T22:04:36.852286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-22T22:04:36.852358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-10-22T22:04:36.852441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETSY.csv [2025-10-22T22:04:36.852509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-10-22T22:04:36.852603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-10-22T22:04:36.852747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-22T22:04:36.852845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-22T22:04:36.852987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-22T22:04:36.853069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-10-22T22:04:36.853140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-22T22:04:36.853219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-22T22:04:36.853296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-10-22T22:04:36.853363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-10-22T22:04:36.853434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-22T22:04:36.853499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-10-22T22:04:36.853565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-22T22:04:36.853630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-10-22T22:04:36.853761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-10-22T22:04:36.853874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-22T22:04:36.853972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-22T22:04:36.854045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-10-22T22:04:36.854118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-22T22:04:36.854200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-22T22:04:36.854280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-22T22:04:36.854348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-10-22T22:04:36.854417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-10-22T22:04:36.854487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-22T22:04:36.854557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-10-22T22:04:36.854639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRSU.csv [2025-10-22T22:04:36.854769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-22T22:04:36.854842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-22T22:04:36.854911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-10-22T22:04:36.854979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-10-22T22:04:36.855060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-10-22T22:04:36.855127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-10-22T22:04:36.855203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-22T22:04:36.855269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-10-22T22:04:36.855337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-10-22T22:04:36.855404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-22T22:04:36.855483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-22T22:04:36.855561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-22T22:04:36.855632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-22T22:04:36.855805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-10-22T22:04:36.855916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-22T22:04:36.856007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-10-22T22:04:36.856093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-10-22T22:04:36.856181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-10-22T22:04:36.856288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-22T22:04:36.856359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-22T22:04:36.856428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-22T22:04:36.856513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-22T22:04:36.856599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-22T22:04:36.856950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-22T22:04:36.857051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-22T22:04:36.857121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-10-22T22:04:36.857240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-22T22:04:36.857321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-22T22:04:36.857454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-22T22:04:36.857604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-22T22:04:36.857824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-22T22:04:36.857912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-10-22T22:04:36.858006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-22T22:04:36.858078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-10-22T22:04:36.858150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-10-22T22:04:36.858227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-10-22T22:04:36.858301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-10-22T22:04:36.858388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-10-22T22:04:36.858459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-22T22:04:36.858549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-10-22T22:04:36.858669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-10-22T22:04:36.858788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-22T22:04:36.858862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-10-22T22:04:36.858937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-22T22:04:36.859008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-22T22:04:36.859078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-22T22:04:36.859161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-10-22T22:04:36.859237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-22T22:04:36.859305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-22T22:04:36.859389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-22T22:04:36.859480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-22T22:04:36.859587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-10-22T22:04:36.859702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-22T22:04:36.859796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-22T22:04:36.859869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-10-22T22:04:36.860024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-22T22:04:36.860096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-22T22:04:36.860190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-10-22T22:04:36.860287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-22T22:04:36.860376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-22T22:04:36.860443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-10-22T22:04:36.860513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-22T22:04:36.860588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-22T22:04:36.860711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-10-22T22:04:36.860804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-10-22T22:04:36.860873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-10-22T22:04:36.860943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-10-22T22:04:36.861022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-10-22T22:04:36.861097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-10-22T22:04:36.861172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-10-22T22:04:36.861248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-10-22T22:04:36.861319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-10-22T22:04:36.861390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-10-22T22:04:36.861466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-10-22T22:04:36.861538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-10-22T22:04:36.861624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-22T22:04:36.861750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-22T22:04:36.861836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-10-22T22:04:36.861903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-22T22:04:36.861985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-22T22:04:36.862109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-10-22T22:04:36.862206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-10-22T22:04:36.862282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-22T22:04:36.862352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-22T22:04:36.862437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-22T22:04:36.862503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-10-22T22:04:36.862582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-10-22T22:04:36.862698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-10-22T22:04:36.862810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-10-22T22:04:36.862899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-22T22:04:36.862979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-22T22:04:36.863047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-10-22T22:04:36.863120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-10-22T22:04:36.863199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-22T22:04:36.863269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-10-22T22:04:36.863340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-10-22T22:04:36.863411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-22T22:04:36.863592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-10-22T22:04:36.863722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-10-22T22:04:36.863815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-10-22T22:04:36.863886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-22T22:04:36.863955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-10-22T22:04:36.864022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-22T22:04:36.864091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-10-22T22:04:36.864161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-22T22:04:36.864231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-22T22:04:36.864332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-22T22:04:36.864440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-10-22T22:04:36.864526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-10-22T22:04:36.864594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-22T22:04:36.865002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-10-22T22:04:36.865120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-10-22T22:04:36.865189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-22T22:04:36.865257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-22T22:04:36.865325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-10-22T22:04:36.865390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-10-22T22:04:36.865468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-10-22T22:04:36.865542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-22T22:04:36.865673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-22T22:04:36.865775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-22T22:04:36.865857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-10-22T22:04:36.865929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-10-22T22:04:36.866008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-22T22:04:36.866085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-10-22T22:04:36.866164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-10-22T22:04:36.866234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-22T22:04:36.866306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-22T22:04:36.866372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-22T22:04:36.866437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-22T22:04:36.866502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-22T22:04:36.866567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-22T22:04:36.866631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-22T22:04:36.866740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-10-22T22:04:36.866867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-22T22:04:36.866958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-22T22:04:36.867039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-10-22T22:04:36.867105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-22T22:04:36.867170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-22T22:04:36.867246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-10-22T22:04:36.867335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-10-22T22:04:36.867445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-10-22T22:04:36.867558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-10-22T22:04:36.867719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-10-22T22:04:36.867821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-10-22T22:04:36.867892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-10-22T22:04:36.867960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-22T22:04:36.868036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-10-22T22:04:36.868104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-10-22T22:04:36.868170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-22T22:04:36.868236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-10-22T22:04:36.868301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-22T22:04:36.868366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-22T22:04:36.868431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-22T22:04:36.868499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-10-22T22:04:36.868583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-22T22:04:36.868918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-22T22:04:36.869066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-22T22:04:36.869135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-22T22:04:36.869224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-22T22:04:36.869315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-22T22:04:36.869398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-10-22T22:04:36.869468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-22T22:04:36.869549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-22T22:04:36.869615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-10-22T22:04:36.869716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-10-22T22:04:36.869832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-22T22:04:36.869926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEM.csv [2025-10-22T22:04:36.870024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-22T22:04:36.870142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-22T22:04:36.870217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-22T22:04:36.870300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-22T22:04:36.870388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-22T22:04:36.870461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-22T22:04:36.870533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPL.csv [2025-10-22T22:04:36.870604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-22T22:04:36.870707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-10-22T22:04:36.870801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-22T22:04:36.870877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-22T22:04:36.870965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-10-22T22:04:36.871052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-22T22:04:36.871174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-22T22:04:36.871294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-22T22:04:36.871398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-10-22T22:04:36.871470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-22T22:04:36.871687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-22T22:04:36.871794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-10-22T22:04:36.871883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-22T22:04:36.871954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-10-22T22:04:36.872040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-22T22:04:36.872117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRCS.csv [2025-10-22T22:04:36.872186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-10-22T22:04:36.872259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-22T22:04:36.872329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-22T22:04:36.872401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-10-22T22:04:36.872483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-22T22:04:36.872559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-10-22T22:04:36.872632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-22T22:04:36.872987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-10-22T22:04:36.873063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-10-22T22:04:36.873140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-10-22T22:04:36.873235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-22T22:04:36.873330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-10-22T22:04:36.873401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-22T22:04:36.873478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-10-22T22:04:36.873563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-22T22:04:36.873632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-10-22T22:04:36.873750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-10-22T22:04:36.873828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-22T22:04:36.873897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-10-22T22:04:36.873966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-22T22:04:36.874056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-10-22T22:04:36.874139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-22T22:04:36.874206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-22T22:04:36.874274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-10-22T22:04:36.874347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-22T22:04:36.874416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-22T22:04:36.874521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-10-22T22:04:36.874615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-22T22:04:36.874721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-10-22T22:04:36.874819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-10-22T22:04:36.874889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-22T22:04:36.874974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-22T22:04:36.875058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-22T22:04:36.875174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-22T22:04:36.875242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-10-22T22:04:36.875309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-22T22:04:36.875387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-22T22:04:36.875462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-22T22:04:36.875540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-10-22T22:04:36.875621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-22T22:04:36.875753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-22T22:04:36.875835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-10-22T22:04:36.875903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-10-22T22:04:36.875971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-10-22T22:04:36.876037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-10-22T22:04:36.876102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-10-22T22:04:36.876169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-22T22:04:36.876236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-22T22:04:36.876303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-10-22T22:04:36.876441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-10-22T22:04:36.876520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-22T22:04:36.876599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-22T22:04:36.876717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-10-22T22:04:36.876811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NI.csv [2025-10-22T22:04:36.876939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-10-22T22:04:36.877033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-22T22:04:36.877104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-22T22:04:36.877173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-10-22T22:04:36.877246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-22T22:04:36.877323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-22T22:04:36.877388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-22T22:04:36.877456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-22T22:04:36.877592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-22T22:04:36.877944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-10-22T22:04:36.878037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-10-22T22:04:36.878110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-22T22:04:36.878183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-22T22:04:36.878252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-22T22:04:36.878320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-22T22:04:36.878408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-22T22:04:36.878500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-10-22T22:04:36.878578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-22T22:04:36.878693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-22T22:04:36.878785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-22T22:04:36.878868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-22T22:04:36.878935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-22T22:04:36.879001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-10-22T22:04:36.879081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-22T22:04:36.879146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-10-22T22:04:36.879212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-10-22T22:04:36.879277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-22T22:04:36.879344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-22T22:04:36.879410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGR.csv [2025-10-22T22:04:36.879476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-22T22:04:36.879540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-22T22:04:36.879615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-22T22:04:36.879738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-22T22:04:36.879822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-10-22T22:04:36.879892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-10-22T22:04:36.879955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-22T22:04:36.880021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-10-22T22:04:36.880141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-10-22T22:04:36.880218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-22T22:04:36.880284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-22T22:04:36.880362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-10-22T22:04:36.880428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-10-22T22:04:36.880494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-22T22:04:36.880563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-10-22T22:04:36.880803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-22T22:04:36.880904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-22T22:04:36.880974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-22T22:04:36.881039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-22T22:04:36.881103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-10-22T22:04:36.881182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-10-22T22:04:36.881263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-10-22T22:04:36.881343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-22T22:04:36.881420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-22T22:04:36.881483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-22T22:04:36.881547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-22T22:04:36.881624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-22T22:04:36.881734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-22T22:04:36.881818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-10-22T22:04:36.881889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-10-22T22:04:36.881958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-10-22T22:04:36.882025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-10-22T22:04:36.882103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-10-22T22:04:36.882169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-10-22T22:04:36.882239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-22T22:04:36.882307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-10-22T22:04:36.882376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-10-22T22:04:36.882497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-22T22:04:36.882588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-10-22T22:04:36.882723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-10-22T22:04:36.882837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-10-22T22:04:36.882909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-10-22T22:04:36.882980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-10-22T22:04:36.883049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-10-22T22:04:36.883160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-22T22:04:36.883230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-22T22:04:36.883300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-22T22:04:36.883367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-22T22:04:36.883434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-22T22:04:36.883503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-10-22T22:04:36.883572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-10-22T22:04:36.883693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHM.csv [2025-10-22T22:04:36.883789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-22T22:04:36.883880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-10-22T22:04:36.883950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-10-22T22:04:36.884022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-22T22:04:36.884089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-10-22T22:04:36.884155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-22T22:04:36.884224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-22T22:04:36.884292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-10-22T22:04:36.884362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-22T22:04:36.884431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-10-22T22:04:36.884500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-10-22T22:04:36.884572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-22T22:04:36.884638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-10-22T22:04:36.884899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-22T22:04:36.885005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-22T22:04:36.885098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-10-22T22:04:36.885167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-10-22T22:04:36.885234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-22T22:04:36.885303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-10-22T22:04:36.885413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-22T22:04:36.885493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-22T22:04:36.885558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-22T22:04:36.885625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-10-22T22:04:36.885735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-22T22:04:36.885814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-10-22T22:04:36.885877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-22T22:04:36.885945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-10-22T22:04:36.886013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-10-22T22:04:36.886083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-22T22:04:36.886183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-10-22T22:04:36.886271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-10-22T22:04:36.886352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-22T22:04:36.886424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-22T22:04:36.886490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-10-22T22:04:36.886559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-10-22T22:04:36.886625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-22T22:04:36.886733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-22T22:04:36.886828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-22T22:04:36.886896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-10-22T22:04:36.886974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-10-22T22:04:36.887042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-10-22T22:04:36.887114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-22T22:04:36.887180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-10-22T22:04:36.887244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-10-22T22:04:36.887310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-10-22T22:04:36.887387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-10-22T22:04:36.887452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-22T22:04:36.887580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-10-22T22:04:36.887697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-10-22T22:04:36.887805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-10-22T22:04:36.887883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-22T22:04:36.888174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-22T22:04:36.888243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-10-22T22:04:36.888312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-22T22:04:36.888394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-22T22:04:36.888465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-22T22:04:36.888604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-10-22T22:04:36.888725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-22T22:04:36.888810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-22T22:04:36.888886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-10-22T22:04:36.888977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-10-22T22:04:36.889073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-10-22T22:04:36.889200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-22T22:04:36.889322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-10-22T22:04:36.889443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-10-22T22:04:36.889544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-10-22T22:04:36.889611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-10-22T22:04:36.889977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-10-22T22:04:36.890087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-10-22T22:04:36.890168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-10-22T22:04:36.890262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-22T22:04:36.890363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-10-22T22:04:36.890436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-22T22:04:36.890506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-22T22:04:36.890666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-10-22T22:04:36.890766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-10-22T22:04:36.890847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-22T22:04:36.890973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-10-22T22:04:36.891060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-22T22:04:36.891151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-22T22:04:36.891323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-22T22:04:36.891400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-22T22:04:36.891471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-22T22:04:36.891558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-10-22T22:04:36.891702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-10-22T22:04:36.891796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-10-22T22:04:36.891888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-10-22T22:04:36.891995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-22T22:04:36.892082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-10-22T22:04:36.892189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-22T22:04:36.892282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-10-22T22:04:36.892352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-10-22T22:04:36.892470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-22T22:04:36.892610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-10-22T22:04:36.892795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-10-22T22:04:36.892903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-22T22:04:36.893010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-22T22:04:36.893142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-10-22T22:04:36.893242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-22T22:04:36.893333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-10-22T22:04:36.893456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-10-22T22:04:36.893555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-22T22:04:36.893627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-10-22T22:04:36.893766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-10-22T22:04:36.893881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-22T22:04:36.893953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-10-22T22:04:36.894059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-22T22:04:36.894181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-22T22:04:36.894304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-10-22T22:04:36.894438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-22T22:04:36.894562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-22T22:04:36.894701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-10-22T22:04:36.894802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-22T22:04:36.894878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-10-22T22:04:36.894965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-22T22:04:36.895099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-22T22:04:36.895231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-22T22:04:36.895334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-10-22T22:04:36.895419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-10-22T22:04:36.895531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-22T22:04:36.895622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-22T22:04:36.895756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-22T22:04:36.895855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-10-22T22:04:36.895931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-10-22T22:04:36.896028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-22T22:04:36.896134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-22T22:04:36.896208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-22T22:04:36.896387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-22T22:04:36.896499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-10-22T22:04:36.896581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-10-22T22:04:36.896724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-10-22T22:04:36.896828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-22T22:04:36.896906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-10-22T22:04:36.897017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-22T22:04:36.897121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-10-22T22:04:36.897201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-10-22T22:04:36.897273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-10-22T22:04:36.897405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-10-22T22:04:36.897534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-10-22T22:04:36.897807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-22T22:04:36.897930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-22T22:04:36.898044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-10-22T22:04:36.898122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-10-22T22:04:36.898212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-10-22T22:04:36.898328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-22T22:04:36.898419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-10-22T22:04:36.898491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-10-22T22:04:36.898669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-22T22:04:36.898794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-22T22:04:36.898897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-22T22:04:36.898972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-22T22:04:36.899072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-10-22T22:04:36.899202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-10-22T22:04:36.899287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-22T22:04:36.899367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-22T22:04:36.899475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-22T22:04:36.899572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-22T22:04:36.899684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-22T22:04:36.899809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-22T22:04:36.899919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-10-22T22:04:36.900038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-10-22T22:04:36.900155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-10-22T22:04:36.900291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-22T22:04:36.900426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-22T22:04:36.900547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-10-22T22:04:36.900721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-22T22:04:36.900849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-22T22:04:36.900973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-10-22T22:04:36.901105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-22T22:04:36.901197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-10-22T22:04:36.901316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-10-22T22:04:36.901413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-22T22:04:36.901484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-22T22:04:36.901601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-10-22T22:04:36.901732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-22T22:04:36.901861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-22T22:04:36.901968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-10-22T22:04:36.902040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-22T22:04:36.902136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-22T22:04:36.902272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-22T22:04:36.902428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-10-22T22:04:36.902543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-10-22T22:04:36.902673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-10-22T22:04:36.902794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-22T22:04:36.902882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-10-22T22:04:36.902968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-10-22T22:04:36.903038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-22T22:04:36.903105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-22T22:04:36.903172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-22T22:04:36.903243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-10-22T22:04:36.903323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-22T22:04:36.903392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-10-22T22:04:36.903457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-10-22T22:04:36.903522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-22T22:04:36.903619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-10-22T22:04:36.903729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-22T22:04:36.903813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-10-22T22:04:36.903883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-10-22T22:04:36.904012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-10-22T22:04:36.904105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-10-22T22:04:36.904177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-10-22T22:04:36.904244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-22T22:04:36.904308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-22T22:04:36.904394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-22T22:04:36.904473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-10-22T22:04:36.904543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-22T22:04:36.904618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-10-22T22:04:36.904746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-10-22T22:04:36.904832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-10-22T22:04:36.904906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-22T22:04:36.904988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-22T22:04:36.905053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-10-22T22:04:36.905120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-10-22T22:04:36.905202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-22T22:04:36.905278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-10-22T22:04:36.905353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-22T22:04:36.905425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-10-22T22:04:36.905499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-10-22T22:04:36.905581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-22T22:04:36.905844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-10-22T22:04:36.905991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-22T22:04:36.906068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-22T22:04:36.906219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-22T22:04:36.906320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-10-22T22:04:36.906416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-22T22:04:36.906488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-10-22T22:04:36.906559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-22T22:04:36.906707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-10-22T22:04:36.906817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-22T22:04:36.906899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-22T22:04:36.907003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-10-22T22:04:36.907082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-10-22T22:04:36.907227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-10-22T22:04:36.907321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-10-22T22:04:36.907409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-10-22T22:04:36.907537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-22T22:04:36.907678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-10-22T22:04:36.907791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-10-22T22:04:36.907870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-10-22T22:04:36.907939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-22T22:04:36.908006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-22T22:04:36.908087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-22T22:04:36.908165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-10-22T22:04:36.908239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-10-22T22:04:36.908309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-10-22T22:04:36.908413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-10-22T22:04:36.908509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-22T22:04:36.908703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-10-22T22:04:36.908811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-22T22:04:36.908901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-10-22T22:04:36.908974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-10-22T22:04:36.909043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-10-22T22:04:36.909112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-22T22:04:36.909180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-10-22T22:04:36.909266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-10-22T22:04:36.909351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-22T22:04:36.909415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-22T22:04:36.909483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-22T22:04:36.909552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-10-22T22:04:36.909620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-22T22:04:36.909733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-10-22T22:04:36.909835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-22T22:04:36.909920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-22T22:04:36.909989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-10-22T22:04:36.910056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-10-22T22:04:36.910124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-22T22:04:36.910190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-10-22T22:04:36.910271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-10-22T22:04:36.910337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-10-22T22:04:36.910470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-10-22T22:04:36.910556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-22T22:04:36.910668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-10-22T22:04:36.910769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-10-22T22:04:36.910845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-22T22:04:36.910923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-10-22T22:04:36.911007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-22T22:04:36.911079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-22T22:04:36.911162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-10-22T22:04:36.911233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-22T22:04:36.911310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-22T22:04:36.911397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-22T22:04:36.911630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-10-22T22:04:36.911753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-10-22T22:04:36.911843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-10-22T22:04:36.911914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-22T22:04:36.911985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-22T22:04:36.912073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-10-22T22:04:36.912156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-22T22:04:36.912226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-22T22:04:36.912292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-22T22:04:36.912363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-10-22T22:04:36.912447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-22T22:04:36.912531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-10-22T22:04:36.912625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-22T22:04:36.912763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-10-22T22:04:36.912844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-22T22:04:36.912914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-22T22:04:36.912980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-22T22:04:36.913064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-22T22:04:36.913129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-22T22:04:36.913194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-22T22:04:36.913262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-22T22:04:36.913329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-22T22:04:36.913461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-10-22T22:04:36.913530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-22T22:04:36.913596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-10-22T22:04:36.913889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-22T22:04:36.913993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-10-22T22:04:36.914064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-10-22T22:04:36.914134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-10-22T22:04:36.914204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-10-22T22:04:36.914271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-22T22:04:36.914353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-10-22T22:04:36.914418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-22T22:04:36.914487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-22T22:04:36.914556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-22T22:04:36.914622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-10-22T22:04:36.914728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-22T22:04:36.914817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-22T22:04:36.914889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-10-22T22:04:36.914956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-10-22T22:04:36.915041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-22T22:04:36.915106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-10-22T22:04:36.915174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-10-22T22:04:36.915241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-22T22:04:36.915307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-22T22:04:36.915372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-10-22T22:04:36.915441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-22T22:04:36.915505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-10-22T22:04:36.915589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-22T22:04:36.915677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-10-22T22:04:36.915772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-22T22:04:36.915841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-22T22:04:36.915910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-22T22:04:36.915976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-22T22:04:36.916044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-10-22T22:04:36.916126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-22T22:04:36.916193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-10-22T22:04:36.916271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-22T22:04:36.916373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-10-22T22:04:36.916517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-22T22:04:36.916630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-22T22:04:36.916777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-10-22T22:04:36.916877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-10-22T22:04:36.916988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-22T22:04:36.917107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-10-22T22:04:36.917178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-10-22T22:04:36.917257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-10-22T22:04:36.917338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-10-22T22:04:36.917408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-22T22:04:36.917506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-22T22:04:36.917603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-10-22T22:04:36.917719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-10-22T22:04:36.917815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-10-22T22:04:36.917903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-22T22:04:36.917971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-10-22T22:04:36.918059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-22T22:04:36.918136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-10-22T22:04:36.918205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-22T22:04:36.918289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-10-22T22:04:36.918361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-22T22:04:36.918445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-10-22T22:04:36.918530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-22T22:04:36.918609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-10-22T22:04:36.918718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-10-22T22:04:36.918811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-22T22:04:36.918894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-10-22T22:04:36.918960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-22T22:04:36.919033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-22T22:04:36.919102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-10-22T22:04:36.919185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-22T22:04:36.919251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-10-22T22:04:36.919319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-22T22:04:36.919392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-22T22:04:36.919464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-10-22T22:04:36.919539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-10-22T22:04:36.919834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-10-22T22:04:36.919928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-22T22:04:36.920014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-10-22T22:04:36.920082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-22T22:04:36.920157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-10-22T22:04:36.920234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-10-22T22:04:36.920366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-22T22:04:36.920472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-22T22:04:36.920564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-22T22:04:36.920687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-22T22:04:36.920799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-10-22T22:04:36.920929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-10-22T22:04:36.921010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-10-22T22:04:36.921101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-10-22T22:04:36.921228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-22T22:04:36.921307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-10-22T22:04:36.921417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-10-22T22:04:36.921538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-22T22:04:36.921918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-22T22:04:36.922041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEE.csv [2025-10-22T22:04:36.922120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-22T22:04:36.922193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-22T22:04:36.922296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-22T22:04:36.922373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-10-22T22:04:36.922455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-22T22:04:36.922541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-22T22:04:36.922616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-10-22T22:04:36.922723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-22T22:04:36.922812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-22T22:04:36.922883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-10-22T22:04:36.922954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-22T22:04:36.923019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-10-22T22:04:36.923089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-10-22T22:04:36.923158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-10-22T22:04:36.923226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-10-22T22:04:36.923360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-10-22T22:04:36.923443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-22T22:04:36.923515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-22T22:04:36.923586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-10-22T22:04:36.923694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-22T22:04:36.923789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-22T22:04:36.923869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-22T22:04:36.923939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-10-22T22:04:36.924017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-10-22T22:04:36.924131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSC.csv [2025-10-22T22:04:36.924202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-10-22T22:04:36.924270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-22T22:04:36.924336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-22T22:04:36.924409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-10-22T22:04:36.924500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFE.csv [2025-10-22T22:04:36.924606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-22T22:04:36.924720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-10-22T22:04:36.924811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEG.csv [2025-10-22T22:04:36.924881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-10-22T22:04:36.924947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-10-22T22:04:36.925015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-22T22:04:36.925086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-22T22:04:36.925177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-22T22:04:36.925244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-22T22:04:36.925335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-22T22:04:36.925458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-10-22T22:04:36.925573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-22T22:04:36.925707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-10-22T22:04:36.925808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLNT.csv [2025-10-22T22:04:36.925877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-10-22T22:04:36.925959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-22T22:04:36.926037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-22T22:04:36.926104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-22T22:04:36.926170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-22T22:04:36.926278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-22T22:04:36.926343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-10-22T22:04:36.926406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-10-22T22:04:36.926483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-10-22T22:04:36.926548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-22T22:04:36.926617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-22T22:04:36.926725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-10-22T22:04:36.926822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-22T22:04:36.926889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-22T22:04:36.926954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-22T22:04:36.927029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-22T22:04:36.927096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-10-22T22:04:36.927161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-10-22T22:04:36.927228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-10-22T22:04:36.927305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-10-22T22:04:36.927371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOW.csv [2025-10-22T22:04:36.927452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-22T22:04:36.927561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-10-22T22:04:36.927669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-22T22:04:36.927775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-22T22:04:36.927848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-22T22:04:36.927918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-22T22:04:36.927986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-10-22T22:04:36.928060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRC.csv [2025-10-22T22:04:36.928157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-22T22:04:36.928281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-22T22:04:36.928391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-22T22:04:36.928470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-10-22T22:04:36.928550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-10-22T22:04:36.928624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-10-22T22:04:36.928748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-22T22:04:36.928832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-22T22:04:36.928907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-22T22:04:36.928979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-22T22:04:36.929053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-10-22T22:04:36.929210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-10-22T22:04:36.929282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-22T22:04:36.929402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-22T22:04:36.929483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-22T22:04:36.929554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-10-22T22:04:36.929622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-10-22T22:04:36.929961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-10-22T22:04:36.930058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-22T22:04:36.930138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-10-22T22:04:36.930220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-22T22:04:36.930288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-22T22:04:36.930357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-22T22:04:36.930424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-22T22:04:36.930495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-22T22:04:36.930566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-10-22T22:04:36.930633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-10-22T22:04:36.930954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-10-22T22:04:36.931055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-22T22:04:36.931131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-10-22T22:04:36.931199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-22T22:04:36.931281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-22T22:04:36.931350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-22T22:04:36.931422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-10-22T22:04:36.931487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-10-22T22:04:36.931553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-22T22:04:36.931629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-22T22:04:36.931739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-10-22T22:04:36.931879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-22T22:04:36.931989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-10-22T22:04:36.932071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-22T22:04:36.932142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-10-22T22:04:36.932213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-10-22T22:04:36.932288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-22T22:04:36.932356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-22T22:04:36.932425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-10-22T22:04:36.932499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-22T22:04:36.932582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-22T22:04:36.932711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-10-22T22:04:36.932819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-22T22:04:36.932939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-22T22:04:36.933012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-10-22T22:04:36.933082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-10-22T22:04:36.933151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-10-22T22:04:36.933233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-10-22T22:04:36.933314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-22T22:04:36.933399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-10-22T22:04:36.933496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCD.csv [2025-10-22T22:04:36.933605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-22T22:04:36.933710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-10-22T22:04:36.933800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-22T22:04:36.933871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-10-22T22:04:36.933970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-22T22:04:36.934066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-10-22T22:04:36.934141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-22T22:04:36.934217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-22T22:04:36.934287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-10-22T22:04:36.934356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-10-22T22:04:36.934425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-22T22:04:36.934507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-10-22T22:04:36.934591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-22T22:04:36.934693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-22T22:04:36.934803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-10-22T22:04:36.934878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-22T22:04:36.934949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-22T22:04:36.935020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-22T22:04:36.935091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-22T22:04:36.935161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-10-22T22:04:36.935326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-22T22:04:36.935397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-10-22T22:04:36.935466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-22T22:04:36.935533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-10-22T22:04:36.935619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-22T22:04:36.935727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-10-22T22:04:36.935870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-22T22:04:36.935962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-10-22T22:04:36.936033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-10-22T22:04:36.936104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-22T22:04:36.936175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-22T22:04:36.936244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-10-22T22:04:36.936321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-10-22T22:04:36.936389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-10-22T22:04:36.936463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-10-22T22:04:36.936529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-22T22:04:36.936676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-10-22T22:04:36.936784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-10-22T22:04:36.936862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-22T22:04:36.936931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-10-22T22:04:36.937000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-10-22T22:04:36.937074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-10-22T22:04:36.937144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-22T22:04:36.937212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-10-22T22:04:36.937279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-10-22T22:04:36.937350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-10-22T22:04:36.937603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-22T22:04:36.938013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-10-22T22:04:36.938098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-10-22T22:04:36.938181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-22T22:04:36.938251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-10-22T22:04:36.938317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-10-22T22:04:36.938385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-10-22T22:04:36.938452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-22T22:04:36.938532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-22T22:04:36.938597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-10-22T22:04:36.938699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-10-22T22:04:36.938792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-10-22T22:04:36.938863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-22T22:04:36.938965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-10-22T22:04:36.939051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-22T22:04:36.939134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-10-22T22:04:36.939203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-22T22:04:36.939269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-22T22:04:36.939349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-10-22T22:04:36.939415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-10-22T22:04:36.939482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-10-22T22:04:36.939547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-22T22:04:36.939627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-22T22:04:36.939747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-22T22:04:36.939844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-22T22:04:36.939918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-10-22T22:04:36.939988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-10-22T22:04:36.940062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-10-22T22:04:36.940133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-10-22T22:04:36.940219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-10-22T22:04:36.940284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-10-22T22:04:36.940354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-22T22:04:36.940420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-10-22T22:04:36.940491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-22T22:04:36.940564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-22T22:04:36.940683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-22T22:04:36.940784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-10-22T22:04:36.940870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-22T22:04:36.940941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-10-22T22:04:36.941012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-10-22T22:04:36.941096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-10-22T22:04:36.941168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-10-22T22:04:36.941726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-22T22:04:36.941843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-10-22T22:04:36.941916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-10-22T22:04:36.941998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-10-22T22:04:36.942070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-22T22:04:36.942150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-22T22:04:36.942232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-10-22T22:04:36.942320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-10-22T22:04:36.942396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-22T22:04:36.942528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-22T22:04:36.942613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-22T22:04:36.942730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-10-22T22:04:36.942818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-22T22:04:36.942900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-22T22:04:36.942967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-22T22:04:36.943036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-22T22:04:36.943106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-22T22:04:36.943188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-22T22:04:36.943264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-10-22T22:04:36.943334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-10-22T22:04:36.943412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-10-22T22:04:36.943507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-22T22:04:36.943613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-22T22:04:36.943723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-10-22T22:04:36.943814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-22T22:04:36.943914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-22T22:04:36.944010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-22T22:04:36.944083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-22T22:04:36.944150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-10-22T22:04:36.944226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-10-22T22:04:36.944294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-22T22:04:36.944364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-22T22:04:36.944431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-10-22T22:04:36.944510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-10-22T22:04:36.944594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-10-22T22:04:36.944708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-22T22:04:36.944801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-10-22T22:04:36.944875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-10-22T22:04:36.944949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-22T22:04:36.945036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-10-22T22:04:36.945101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-10-22T22:04:36.945168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-10-22T22:04:36.945258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-10-22T22:04:36.945341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-22T22:04:36.945411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-22T22:04:36.945482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-10-22T22:04:36.945555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-10-22T22:04:36.945636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-22T22:04:36.945989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-10-22T22:04:36.946121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGE.csv [2025-10-22T22:04:36.946233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-22T22:04:36.946336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-10-22T22:04:36.946409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-10-22T22:04:36.946478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-10-22T22:04:36.946548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-10-22T22:04:36.946631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-10-22T22:04:36.946747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-22T22:04:36.946838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-10-22T22:04:36.946910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-22T22:04:36.946986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-10-22T22:04:36.947060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-22T22:04:36.947162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PM.csv [2025-10-22T22:04:36.947310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-22T22:04:36.947419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-10-22T22:04:36.947526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TCBX.csv [2025-10-22T22:04:36.947624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-10-22T22:04:36.947748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-10-22T22:04:36.947827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-10-22T22:04:36.947914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-10-22T22:04:36.948201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-10-22T22:04:36.948295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-10-22T22:04:36.948387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-10-22T22:04:36.948457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-22T22:04:36.948531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-10-22T22:04:36.948598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-22T22:04:36.948703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-10-22T22:04:36.948799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-22T22:04:36.948867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-22T22:04:36.948935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-10-22T22:04:36.949002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-10-22T22:04:36.949130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-22T22:04:36.949210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-10-22T22:04:36.949290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-10-22T22:04:36.949372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-10-22T22:04:36.949442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-22T22:04:36.949517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-22T22:04:36.949588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-22T22:04:36.949680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-22T22:04:36.949787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-22T22:04:36.949860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-22T22:04:36.949926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-10-22T22:04:36.949994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-10-22T22:04:36.950060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-22T22:04:36.950126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-22T22:04:36.950190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-22T22:04:36.950257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-22T22:04:36.950331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-10-22T22:04:36.950395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-10-22T22:04:36.950464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-22T22:04:36.950532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-22T22:04:36.950615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-22T22:04:36.950719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-10-22T22:04:36.950803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-10-22T22:04:36.950886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-10-22T22:04:36.950951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-22T22:04:36.951033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNR.csv [2025-10-22T22:04:36.951098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-10-22T22:04:36.951167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-10-22T22:04:36.951248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-22T22:04:36.951311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-22T22:04:36.951374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-22T22:04:36.951506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-22T22:04:36.951571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-10-22T22:04:36.951671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-10-22T22:04:36.951767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-22T22:04:36.951836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-10-22T22:04:36.951901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-10-22T22:04:36.951966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-22T22:04:36.952032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-10-22T22:04:36.952095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-22T22:04:36.952158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-10-22T22:04:36.952222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPKI.csv [2025-10-22T22:04:36.952287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-22T22:04:36.952360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-10-22T22:04:36.952433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-22T22:04:36.952503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-10-22T22:04:36.952571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-22T22:04:36.952636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-22T22:04:36.952766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-10-22T22:04:36.952884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-22T22:04:36.952979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-10-22T22:04:36.953047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-10-22T22:04:36.953119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-10-22T22:04:36.953184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-10-22T22:04:36.953252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-10-22T22:04:36.953324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-22T22:04:36.953400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-10-22T22:04:36.953467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-10-22T22:04:36.953534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-22T22:04:36.953620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-22T22:04:36.953942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-10-22T22:04:36.954042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-10-22T22:04:36.954111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-10-22T22:04:36.954182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-22T22:04:36.954248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-10-22T22:04:36.954312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-22T22:04:36.954377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-10-22T22:04:36.954453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-22T22:04:36.954518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-10-22T22:04:36.954736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-10-22T22:04:36.954834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-22T22:04:36.954963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-10-22T22:04:36.955046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-22T22:04:36.955116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-22T22:04:36.955200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-10-22T22:04:36.955272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-10-22T22:04:36.955337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-10-22T22:04:36.955405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-10-22T22:04:36.955476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-10-22T22:04:36.955543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-10-22T22:04:36.955609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-10-22T22:04:36.955705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-10-22T22:04:36.955809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-22T22:04:36.955881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-10-22T22:04:36.955966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-10-22T22:04:36.956035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-10-22T22:04:36.956099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-22T22:04:36.956171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-22T22:04:36.956234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-10-22T22:04:36.956303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-22T22:04:36.956370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-10-22T22:04:36.956436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-10-22T22:04:36.956505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-22T22:04:36.956576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-22T22:04:36.956707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-22T22:04:36.956801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-10-22T22:04:36.956870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-10-22T22:04:36.956937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-22T22:04:36.957006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-10-22T22:04:36.957072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-10-22T22:04:36.957193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-22T22:04:36.957298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-22T22:04:36.957396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-10-22T22:04:36.957495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-10-22T22:04:36.957606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-10-22T22:04:36.957719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-22T22:04:36.957808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-22T22:04:36.957876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-22T22:04:36.957945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-10-22T22:04:36.958019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-10-22T22:04:36.958085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-10-22T22:04:36.958149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-22T22:04:36.958217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-10-22T22:04:36.958282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-22T22:04:36.958347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-10-22T22:04:36.958427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-22T22:04:36.958508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-22T22:04:36.958578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-22T22:04:36.958665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-10-22T22:04:36.958776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-22T22:04:36.958888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-22T22:04:36.958972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-22T22:04:36.959037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-10-22T22:04:36.959102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-10-22T22:04:36.959166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-10-22T22:04:36.959239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-10-22T22:04:36.959318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-22T22:04:36.959380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-10-22T22:04:36.959445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-10-22T22:04:36.959565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-10-22T22:04:36.959629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-22T22:04:36.959739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-22T22:04:36.959817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-10-22T22:04:36.959882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-10-22T22:04:36.959946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-10-22T22:04:36.960026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-22T22:04:36.960092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-22T22:04:36.960180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-10-22T22:04:36.960249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-10-22T22:04:36.960314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-10-22T22:04:36.960377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-10-22T22:04:36.960442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-22T22:04:36.960565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-10-22T22:04:36.960687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-22T22:04:36.960785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-10-22T22:04:36.960873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-10-22T22:04:36.960944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-10-22T22:04:36.961011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-22T22:04:36.961083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-10-22T22:04:36.961149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-22T22:04:36.961212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-22T22:04:36.961279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-10-22T22:04:36.961344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-22T22:04:36.961408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-10-22T22:04:36.961485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-10-22T22:04:36.961558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-22T22:04:36.961860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-10-22T22:04:36.961995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-22T22:04:36.962105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-10-22T22:04:36.962184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-10-22T22:04:36.962254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-22T22:04:36.962330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-10-22T22:04:36.962404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-10-22T22:04:36.962471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-10-22T22:04:36.962541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-10-22T22:04:36.962608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-10-22T22:04:36.962728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-10-22T22:04:36.962818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-22T22:04:36.962893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-10-22T22:04:36.962968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-10-22T22:04:36.963044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-10-22T22:04:36.963111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-22T22:04:36.963177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-22T22:04:36.963273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-10-22T22:04:36.963548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-22T22:04:36.963628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-10-22T22:04:36.963741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-10-22T22:04:36.963828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-22T22:04:36.963901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-10-22T22:04:36.963973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-22T22:04:36.964039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-22T22:04:36.964106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-22T22:04:36.964170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-22T22:04:36.964234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-22T22:04:36.964299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-22T22:04:36.964366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-10-22T22:04:36.964432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-22T22:04:36.964502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-10-22T22:04:36.964568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-10-22T22:04:36.964632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-10-22T22:04:36.964771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-10-22T22:04:36.964848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-10-22T22:04:36.964917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-10-22T22:04:36.964985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-22T22:04:36.965053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-22T22:04:36.965118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-10-22T22:04:36.965203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-22T22:04:36.965286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-22T22:04:36.965366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-22T22:04:36.965433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-22T22:04:36.965499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-10-22T22:04:36.965565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-22T22:04:36.965635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-22T22:04:36.965749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-22T22:04:36.965894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-22T22:04:36.965996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-22T22:04:36.966092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-10-22T22:04:36.966163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-10-22T22:04:36.966229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-10-22T22:04:36.966313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-10-22T22:04:36.966385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-10-22T22:04:36.966456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-22T22:04:36.966520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-10-22T22:04:36.966635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRG.csv [2025-10-22T22:04:36.966765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-10-22T22:04:36.966843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-10-22T22:04:36.966925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-22T22:04:36.966997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-22T22:04:36.967065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-10-22T22:04:36.967135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-10-22T22:04:36.967220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-10-22T22:04:36.967311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-10-22T22:04:36.967385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-10-22T22:04:36.967453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-22T22:04:36.967571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-22T22:04:36.967701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-10-22T22:04:36.967797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-22T22:04:36.967881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-22T22:04:36.967951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-10-22T22:04:36.968019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-10-22T22:04:36.968088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-10-22T22:04:36.968156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-22T22:04:36.968221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-10-22T22:04:36.968295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-10-22T22:04:36.968385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-10-22T22:04:36.968454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-22T22:04:36.968522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-22T22:04:36.968586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-10-22T22:04:36.968713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-22T22:04:36.968862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-10-22T22:04:36.968948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-10-22T22:04:36.969017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-22T22:04:36.969098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-10-22T22:04:36.969163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-22T22:04:36.969241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-22T22:04:36.969306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-10-22T22:04:36.969370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-22T22:04:36.969435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-22T22:04:36.969516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-10-22T22:04:36.969597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-22T22:04:36.969905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-22T22:04:36.969999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-22T22:04:36.970073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-22T22:04:36.970141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-22T22:04:36.970205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-22T22:04:36.970295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-10-22T22:04:36.970367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-22T22:04:36.970447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-10-22T22:04:36.970511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-22T22:04:36.970581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-10-22T22:04:36.970668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-10-22T22:04:36.970763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-22T22:04:36.970832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-22T22:04:36.970897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-22T22:04:36.970976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-22T22:04:36.971042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-10-22T22:04:36.971126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-10-22T22:04:36.971216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-10-22T22:04:36.971300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-10-22T22:04:36.971366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-10-22T22:04:36.971429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-10-22T22:04:36.971496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-10-22T22:04:36.971575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-22T22:04:36.971671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-10-22T22:04:36.971778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-22T22:04:36.971844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-22T22:04:36.971924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-10-22T22:04:36.972131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-10-22T22:04:36.972196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-10-22T22:04:36.972261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-10-22T22:04:36.972327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-22T22:04:36.972391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-10-22T22:04:36.972457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-22T22:04:36.972527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-22T22:04:36.972670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-10-22T22:04:36.972790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-10-22T22:04:36.972870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-22T22:04:36.972955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-10-22T22:04:36.973027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-22T22:04:36.973096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-22T22:04:36.973171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-22T22:04:36.973240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-10-22T22:04:36.973309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-22T22:04:36.973387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-22T22:04:36.973453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-22T22:04:36.973521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-10-22T22:04:36.973605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-10-22T22:04:36.973720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-10-22T22:04:36.973816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-10-22T22:04:36.973889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-10-22T22:04:36.973967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-22T22:04:36.974051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-10-22T22:04:36.974130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-10-22T22:04:36.974199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-10-22T22:04:36.974269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-10-22T22:04:36.974342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-10-22T22:04:36.974413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-10-22T22:04:36.974483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-22T22:04:36.974608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-10-22T22:04:36.974715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-10-22T22:04:36.974808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-22T22:04:36.974885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-10-22T22:04:36.974953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-22T22:04:36.975019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-10-22T22:04:36.975084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-22T22:04:36.975157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-10-22T22:04:36.975225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-10-22T22:04:36.975305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-10-22T22:04:36.975379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-22T22:04:36.975469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-22T22:04:36.975563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-10-22T22:04:36.975637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-22T22:04:36.975769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-10-22T22:04:36.975880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-10-22T22:04:36.976009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-10-22T22:04:36.976084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-10-22T22:04:36.976150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-22T22:04:36.976230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-10-22T22:04:36.976298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-10-22T22:04:36.976362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-22T22:04:36.976440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-22T22:04:36.976513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-10-22T22:04:36.976575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-22T22:04:36.976730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-22T22:04:36.976829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-22T22:04:36.976900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-22T22:04:36.976966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-10-22T22:04:36.977049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-22T22:04:36.977116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-10-22T22:04:36.977194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-10-22T22:04:36.977309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-22T22:04:36.977411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-10-22T22:04:36.977502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-10-22T22:04:36.977593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-10-22T22:04:36.977940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-22T22:04:36.978038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-10-22T22:04:36.978203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-10-22T22:04:36.978271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-22T22:04:36.978338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-10-22T22:04:36.978423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-22T22:04:36.978490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-10-22T22:04:36.978572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-22T22:04:36.978670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-22T22:04:36.978769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-10-22T22:04:36.978847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-22T22:04:36.978963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-22T22:04:36.979039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-10-22T22:04:36.979141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-22T22:04:36.979229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-10-22T22:04:36.979309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-22T22:04:36.979384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-22T22:04:36.979455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-22T22:04:36.979519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-10-22T22:04:36.979587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-10-22T22:04:36.979698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-22T22:04:36.979793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-22T22:04:36.979863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-22T22:04:36.979929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-10-22T22:04:36.979994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-10-22T22:04:36.980060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-10-22T22:04:36.980139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-22T22:04:36.980221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-10-22T22:04:36.980290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-10-22T22:04:36.980358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-22T22:04:36.980423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-10-22T22:04:36.980512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-10-22T22:04:36.980615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-10-22T22:04:36.980736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-22T22:04:36.980831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-22T22:04:36.980909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-22T22:04:36.980992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-10-22T22:04:36.981060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-22T22:04:36.981125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-10-22T22:04:36.981193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-10-22T22:04:36.981257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-22T22:04:36.981335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-10-22T22:04:36.981404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-22T22:04:36.981489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-22T22:04:36.981563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-22T22:04:36.981627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-22T22:04:36.981744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-22T22:04:36.981823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-22T22:04:36.981891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-22T22:04:36.981971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-22T22:04:36.982095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-10-22T22:04:36.982159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-22T22:04:36.982223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-10-22T22:04:36.982292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-10-22T22:04:36.982376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-22T22:04:36.982445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-22T22:04:36.982512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-10-22T22:04:36.982580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-22T22:04:36.982712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-10-22T22:04:36.982812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-10-22T22:04:36.982882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-10-22T22:04:36.982952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-10-22T22:04:36.983025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-22T22:04:36.983093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-10-22T22:04:36.983166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-22T22:04:36.983246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-22T22:04:36.983315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-10-22T22:04:36.983398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-22T22:04:36.983465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-10-22T22:04:36.983603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-22T22:04:36.983710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-10-22T22:04:36.983801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-10-22T22:04:36.983887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-10-22T22:04:36.983964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-10-22T22:04:36.984033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-22T22:04:36.984099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-22T22:04:36.984180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-10-22T22:04:36.984248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-10-22T22:04:36.984313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-10-22T22:04:36.984379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-10-22T22:04:36.984443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-22T22:04:36.984522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-22T22:04:36.984748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCLH.csv [2025-10-22T22:04:36.984855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-22T22:04:36.984928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-22T22:04:36.985020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-22T22:04:36.985094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-10-22T22:04:36.985163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-10-22T22:04:36.985236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-10-22T22:04:36.985305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-22T22:04:36.985371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-10-22T22:04:36.985442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-22T22:04:36.985521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-10-22T22:04:36.985593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-10-22T22:04:36.985975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-22T22:04:36.986088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-10-22T22:04:36.986163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-22T22:04:36.986240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-10-22T22:04:36.986560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-10-22T22:04:36.986679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-22T22:04:36.986787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-10-22T22:04:36.986877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-10-22T22:04:36.986950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-22T22:04:36.987020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-10-22T22:04:36.987088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-10-22T22:04:36.987157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-22T22:04:36.987226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-22T22:04:36.987309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-10-22T22:04:36.987380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-10-22T22:04:36.987450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-22T22:04:36.987573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-22T22:04:36.987682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-10-22T22:04:36.987793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-22T22:04:36.987868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-10-22T22:04:36.987937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-10-22T22:04:36.988005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-22T22:04:36.988075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-22T22:04:36.988144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-10-22T22:04:36.988210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-10-22T22:04:36.988277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-22T22:04:36.988366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-22T22:04:36.988434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-22T22:04:36.988504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-22T22:04:36.988582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-10-22T22:04:36.988684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-22T22:04:36.988780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-10-22T22:04:36.988853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-10-22T22:04:36.988919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-10-22T22:04:36.988991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-22T22:04:36.989063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-22T22:04:36.989133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-22T22:04:36.989212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-22T22:04:36.989280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-10-22T22:04:36.989351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-22T22:04:36.989416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-10-22T22:04:36.989481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-10-22T22:04:36.989545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-10-22T22:04:36.989747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-10-22T22:04:36.989840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-22T22:04:36.989908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-10-22T22:04:36.989979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-10-22T22:04:36.990059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-22T22:04:36.990126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-22T22:04:36.990190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-10-22T22:04:36.990265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-10-22T22:04:36.990329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-22T22:04:36.990408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-10-22T22:04:36.990473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-10-22T22:04:36.990538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-10-22T22:04:36.990615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-22T22:04:36.990748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-10-22T22:04:36.990833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-10-22T22:04:36.990903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-22T22:04:36.991038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-22T22:04:36.991114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-22T22:04:36.991198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-22T22:04:36.991266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-10-22T22:04:36.991335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-22T22:04:36.991432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-22T22:04:36.991500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-10-22T22:04:36.991574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMD.csv [2025-10-22T22:04:36.991665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-22T22:04:36.991787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-22T22:04:36.991875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-10-22T22:04:36.991972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-10-22T22:04:36.992045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-10-22T22:04:36.992130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-22T22:04:36.992203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-10-22T22:04:36.992283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-22T22:04:36.992360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-10-22T22:04:36.992466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-22T22:04:36.992552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-10-22T22:04:36.992635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-22T22:04:36.992820] [INFO ] [LOCAL ] Deleted 1936 derivative data files. [2025-10-22T22:04:36.992861] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-22T22:04:36.995373] [INFO ] [LOCAL ] Found 2052 symbols with primary data. [2025-10-22T22:04:36.996220] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2052 symbols [2025-10-22T22:04:36.997537] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:36.997898] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:36.998929] [INFO ] [MAIN ] AAMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:37.027776] [DEBUG] [LOCAL ] AAMI: Loaded 24441 existing records from primary storage. [2025-10-22T22:04:37.045120] [INFO ] [MAIN ] AAMI: Loaded 24441 primary data records. [2025-10-22T22:04:37.216882] [DEBUG] [LOCAL ] AA: Loaded 53622 existing records from primary storage. [2025-10-22T22:04:37.222244] [INFO ] [MAIN ] AA: Loaded 53622 primary data records. [2025-10-22T22:04:37.245401] [DEBUG] [LOCAL ] A: Loaded 50664 existing records from primary storage. [2025-10-22T22:04:37.301828] [INFO ] [MAIN ] A: Loaded 50664 primary data records. [2025-10-22T22:04:38.164359] [DEBUG] [MAIN ] AAMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:38.168767] [INFO ] [MAIN ] AAMI: Generated 1794 derivative records from 24441 primary records. [2025-10-22T22:04:38.169703] [DEBUG] [LOCAL ] AAMI: Saving derivative data. [2025-10-22T22:04:38.188318] [DEBUG] [MAIN ] AA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:38.206152] [INFO ] [MAIN ] AA: Generated 1794 derivative records from 53622 primary records. [2025-10-22T22:04:38.206439] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-22T22:04:38.204870] [DEBUG] [LOCAL ] AAMI: Derivative data saved (1794 records). [2025-10-22T22:04:38.208149] [INFO ] [MAIN ] AAMI: Successfully saved derivative data. [2025-10-22T22:04:38.210569] [INFO ] [MAIN ] Derivative Progress: 1/2052 symbols completed. AAMI took 1.2s. Estimated remaining: 41m 32s. Rate: 49.4 symbols/min [2025-10-22T22:04:38.211154] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:38.231266] [DEBUG] [LOCAL ] AA: Derivative data saved (1794 records). [2025-10-22T22:04:38.233247] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-10-22T22:04:38.236748] [INFO ] [MAIN ] Derivative Progress: 2/2052 symbols completed. AA took 1.2s. Estimated remaining: 21m 12s. Rate: 96.7 symbols/min [2025-10-22T22:04:38.237191] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:38.251432] [DEBUG] [MAIN ] A: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:38.252304] [INFO ] [MAIN ] A: Generated 1794 derivative records from 50664 primary records. [2025-10-22T22:04:38.252479] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-22T22:04:38.270166] [DEBUG] [LOCAL ] A: Derivative data saved (1794 records). [2025-10-22T22:04:38.270416] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-10-22T22:04:38.273064] [INFO ] [MAIN ] Derivative Progress: 3/2052 symbols completed. A took 1.3s. Estimated remaining: 14m 33s. Rate: 140.9 symbols/min [2025-10-22T22:04:38.273463] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:38.328875] [DEBUG] [LOCAL ] AAT: Loaded 30227 existing records from primary storage. [2025-10-22T22:04:38.346459] [INFO ] [MAIN ] AAT: Loaded 30227 primary data records. [2025-10-22T22:04:38.347086] [DEBUG] [LOCAL ] AB: Loaded 24673 existing records from primary storage. [2025-10-22T22:04:38.359414] [INFO ] [MAIN ] AB: Loaded 24673 primary data records. [2025-10-22T22:04:38.371163] [DEBUG] [LOCAL ] AAP: Loaded 51734 existing records from primary storage. [2025-10-22T22:04:38.455631] [INFO ] [MAIN ] AAP: Loaded 51734 primary data records. [2025-10-22T22:04:39.375244] [DEBUG] [MAIN ] AAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:39.383802] [INFO ] [MAIN ] AAT: Generated 1794 derivative records from 30227 primary records. [2025-10-22T22:04:39.388941] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-22T22:04:39.390183] [DEBUG] [MAIN ] AB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:39.393254] [INFO ] [MAIN ] AB: Generated 1794 derivative records from 24673 primary records. [2025-10-22T22:04:39.401048] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-10-22T22:04:39.422582] [DEBUG] [LOCAL ] AAT: Derivative data saved (1794 records). [2025-10-22T22:04:39.433486] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-10-22T22:04:39.440065] [INFO ] [MAIN ] Derivative Progress: 4/2052 symbols completed. AAT took 1.2s. Estimated remaining: 20m 52s. Rate: 98.2 symbols/min [2025-10-22T22:04:39.433965] [DEBUG] [MAIN ] AAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:39.438221] [DEBUG] [LOCAL ] AB: Derivative data saved (1794 records). [2025-10-22T22:04:39.440327] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:39.440835] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-10-22T22:04:39.443917] [INFO ] [MAIN ] Derivative Progress: 5/2052 symbols completed. AB took 1.2s. Estimated remaining: 16m 42s. Rate: 122.5 symbols/min [2025-10-22T22:04:39.445309] [INFO ] [MAIN ] AAP: Generated 1794 derivative records from 51734 primary records. [2025-10-22T22:04:39.445684] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:39.445888] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-22T22:04:39.464530] [DEBUG] [LOCAL ] AAP: Derivative data saved (1794 records). [2025-10-22T22:04:39.464895] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-22T22:04:39.467141] [INFO ] [MAIN ] Derivative Progress: 6/2052 symbols completed. AAP took 1.3s. Estimated remaining: 14m 3s. Rate: 145.7 symbols/min [2025-10-22T22:04:39.467460] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:39.504627] [DEBUG] [LOCAL ] ABCB: Loaded 30308 existing records from primary storage. [2025-10-22T22:04:39.503890] [DEBUG] [LOCAL ] ABG: Loaded 17859 existing records from primary storage. [2025-10-22T22:04:39.505103] [INFO ] [MAIN ] ABG: Loaded 17859 primary data records. [2025-10-22T22:04:39.510472] [INFO ] [MAIN ] ABCB: Loaded 30308 primary data records. [2025-10-22T22:04:39.828504] [DEBUG] [LOCAL ] ABEV: Loaded 53284 existing records from primary storage. [2025-10-22T22:04:39.870629] [INFO ] [MAIN ] ABEV: Loaded 53284 primary data records. [2025-10-22T22:04:40.523391] [DEBUG] [MAIN ] ABCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:40.525299] [INFO ] [MAIN ] ABCB: Generated 1794 derivative records from 30308 primary records. [2025-10-22T22:04:40.525680] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-10-22T22:04:40.539436] [DEBUG] [MAIN ] ABG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:40.542409] [INFO ] [MAIN ] ABG: Generated 1794 derivative records from 17859 primary records. [2025-10-22T22:04:40.543112] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-10-22T22:04:40.580096] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1794 records). [2025-10-22T22:04:40.576529] [DEBUG] [LOCAL ] ABG: Derivative data saved (1794 records). [2025-10-22T22:04:40.580488] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-10-22T22:04:40.580581] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-10-22T22:04:40.582759] [INFO ] [MAIN ] Derivative Progress: 7/2052 symbols completed. ABCB took 1.1s. Estimated remaining: 17m 28s. Rate: 117.1 symbols/min [2025-10-22T22:04:40.585205] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:40.585310] [INFO ] [MAIN ] Derivative Progress: 8/2052 symbols completed. ABG took 1.1s. Estimated remaining: 15m 17s. Rate: 133.7 symbols/min [2025-10-22T22:04:40.586071] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:40.604472] [DEBUG] [MAIN ] ABEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:40.605420] [INFO ] [MAIN ] ABEV: Generated 1794 derivative records from 53284 primary records. [2025-10-22T22:04:40.605634] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-22T22:04:40.622614] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1794 records). [2025-10-22T22:04:40.631714] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-22T22:04:40.635593] [INFO ] [MAIN ] Derivative Progress: 9/2052 symbols completed. ABEV took 1.2s. Estimated remaining: 13m 46s. Rate: 148.4 symbols/min [2025-10-22T22:04:40.635939] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:40.660766] [DEBUG] [LOCAL ] ACEL: Loaded 26346 existing records from primary storage. [2025-10-22T22:04:40.661101] [INFO ] [MAIN ] ACEL: Loaded 26346 primary data records. [2025-10-22T22:04:40.790567] [DEBUG] [LOCAL ] ABT: Loaded 53624 existing records from primary storage. [2025-10-22T22:04:40.796871] [INFO ] [MAIN ] ABT: Loaded 53624 primary data records. [2025-10-22T22:04:41.183888] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-22T22:04:41.215705] [INFO ] [MAIN ] ACHR: Loaded 53818 primary data records. [2025-10-22T22:04:41.732199] [DEBUG] [MAIN ] ACEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:41.733301] [INFO ] [MAIN ] ACEL: Generated 1794 derivative records from 26346 primary records. [2025-10-22T22:04:41.740947] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-10-22T22:04:41.748439] [DEBUG] [MAIN ] ABT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:04:41.759825] [INFO ] [MAIN ] ABT: Generated 1793 derivative records from 53624 primary records. [2025-10-22T22:04:41.763855] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-10-22T22:04:41.763791] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1794 records). [2025-10-22T22:04:41.764998] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-10-22T22:04:41.767008] [INFO ] [MAIN ] Derivative Progress: 10/2052 symbols completed. ACEL took 1.2s. Estimated remaining: 16m 14s. Rate: 125.7 symbols/min [2025-10-22T22:04:41.767339] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:41.783519] [DEBUG] [LOCAL ] ABT: Derivative data saved (1793 records). [2025-10-22T22:04:41.784559] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-10-22T22:04:41.786694] [INFO ] [MAIN ] Derivative Progress: 11/2052 symbols completed. ABT took 1.2s. Estimated remaining: 14m 49s. Rate: 137.8 symbols/min [2025-10-22T22:04:41.786987] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:41.794937] [DEBUG] [LOCAL ] ACR: Loaded 5310 existing records from primary storage. [2025-10-22T22:04:41.795143] [INFO ] [MAIN ] ACR: Loaded 5310 primary data records. [2025-10-22T22:04:41.930220] [DEBUG] [MAIN ] ACHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:41.931566] [INFO ] [MAIN ] ACHR: Generated 1794 derivative records from 53818 primary records. [2025-10-22T22:04:41.931687] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-10-22T22:04:42.155892] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1794 records). [2025-10-22T22:04:42.158505] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-10-22T22:04:42.158251] [DEBUG] [LOCAL ] ACI: Loaded 53286 existing records from primary storage. [2025-10-22T22:04:42.158754] [INFO ] [MAIN ] ACI: Loaded 53286 primary data records. [2025-10-22T22:04:42.162026] [INFO ] [MAIN ] Derivative Progress: 12/2052 symbols completed. ACHR took 1.5s. Estimated remaining: 14m 38s. Rate: 139.4 symbols/min [2025-10-22T22:04:42.174117] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:42.494174] [DEBUG] [LOCAL ] ACRE: Loaded 33223 existing records from primary storage. [2025-10-22T22:04:42.494803] [INFO ] [MAIN ] ACRE: Loaded 33223 primary data records. [2025-10-22T22:04:42.553586] [DEBUG] [MAIN ] ACR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:42.597278] [INFO ] [MAIN ] ACR: Generated 1794 derivative records from 5310 primary records. [2025-10-22T22:04:42.614572] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-22T22:04:42.828024] [DEBUG] [LOCAL ] ACR: Derivative data saved (1794 records). [2025-10-22T22:04:42.837044] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-10-22T22:04:42.839820] [INFO ] [MAIN ] Derivative Progress: 13/2052 symbols completed. ACR took 1.1s. Estimated remaining: 15m 17s. Rate: 133.5 symbols/min [2025-10-22T22:04:42.864872] [DEBUG] [MAIN ] ACI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:42.866191] [INFO ] [MAIN ] ACI: Generated 1794 derivative records from 53286 primary records. [2025-10-22T22:04:42.866285] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-22T22:04:42.886174] [DEBUG] [LOCAL ] ACI: Derivative data saved (1794 records). [2025-10-22T22:04:42.886461] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-10-22T22:04:42.890003] [INFO ] [MAIN ] Derivative Progress: 14/2052 symbols completed. ACI took 1.1s. Estimated remaining: 14m 18s. Rate: 142.5 symbols/min [2025-10-22T22:04:42.904172] [DEBUG] [MAIN ] ACRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:42.904884] [INFO ] [MAIN ] ACRE: Generated 1794 derivative records from 33223 primary records. [2025-10-22T22:04:42.904960] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-22T22:04:42.920308] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1794 records). [2025-10-22T22:04:42.920366] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-10-22T22:04:42.922820] [INFO ] [MAIN ] Derivative Progress: 15/2052 symbols completed. ACRE took 0.7s. Estimated remaining: 13m 25s. Rate: 151.8 symbols/min [2025-10-22T22:04:42.923322] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:42.923456] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:42.924229] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:42.998172] [DEBUG] [LOCAL ] ADT: Loaded 53435 existing records from primary storage. [2025-10-22T22:04:42.998604] [INFO ] [MAIN ] ADT: Loaded 53435 primary data records. [2025-10-22T22:04:43.078497] [DEBUG] [LOCAL ] ADCT: Loaded 35462 existing records from primary storage. [2025-10-22T22:04:43.101400] [INFO ] [MAIN ] ADCT: Loaded 35462 primary data records. [2025-10-22T22:04:43.212996] [DEBUG] [LOCAL ] ADM: Loaded 53394 existing records from primary storage. [2025-10-22T22:04:43.226820] [INFO ] [MAIN ] ADM: Loaded 53394 primary data records. [2025-10-22T22:04:44.071443] [DEBUG] [MAIN ] ADT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:44.073436] [INFO ] [MAIN ] ADT: Generated 1794 derivative records from 53435 primary records. [2025-10-22T22:04:44.074038] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-22T22:04:44.094135] [DEBUG] [LOCAL ] ADT: Derivative data saved (1794 records). [2025-10-22T22:04:44.095089] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-10-22T22:04:44.097022] [INFO ] [MAIN ] Derivative Progress: 16/2052 symbols completed. ADT took 1.2s. Estimated remaining: 15m 4s. Rate: 135.2 symbols/min [2025-10-22T22:04:44.097318] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:44.115155] [DEBUG] [MAIN ] ADCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:44.116311] [INFO ] [MAIN ] ADCT: Generated 1794 derivative records from 35462 primary records. [2025-10-22T22:04:44.116475] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-10-22T22:04:44.154008] [DEBUG] [MAIN ] ADM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:44.158979] [INFO ] [MAIN ] ADM: Generated 1794 derivative records from 53394 primary records. [2025-10-22T22:04:44.159316] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-22T22:04:44.159155] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1794 records). [2025-10-22T22:04:44.159711] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-10-22T22:04:44.161817] [INFO ] [MAIN ] Derivative Progress: 17/2052 symbols completed. ADCT took 1.2s. Estimated remaining: 14m 18s. Rate: 142.3 symbols/min [2025-10-22T22:04:44.178105] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:44.188961] [DEBUG] [LOCAL ] ADM: Derivative data saved (1794 records). [2025-10-22T22:04:44.189142] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-22T22:04:44.192205] [INFO ] [MAIN ] Derivative Progress: 18/2052 symbols completed. ADM took 1.3s. Estimated remaining: 13m 33s. Rate: 150.1 symbols/min [2025-10-22T22:04:44.184540] [DEBUG] [LOCAL ] ADX: Loaded 27644 existing records from primary storage. [2025-10-22T22:04:44.192500] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:44.192831] [INFO ] [MAIN ] ADX: Loaded 27644 primary data records. [2025-10-22T22:04:44.300065] [DEBUG] [LOCAL ] AEFC: Loaded 7650 existing records from primary storage. [2025-10-22T22:04:44.303820] [INFO ] [MAIN ] AEFC: Loaded 7650 primary data records. [2025-10-22T22:04:44.628287] [DEBUG] [LOCAL ] AEE: Loaded 50072 existing records from primary storage. [2025-10-22T22:04:44.648669] [INFO ] [MAIN ] AEE: Loaded 50072 primary data records. [2025-10-22T22:04:45.152594] [DEBUG] [MAIN ] ADX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:45.153949] [INFO ] [MAIN ] ADX: Generated 1794 derivative records from 27644 primary records. [2025-10-22T22:04:45.154615] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-22T22:04:45.175852] [DEBUG] [LOCAL ] ADX: Derivative data saved (1794 records). [2025-10-22T22:04:45.177823] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-22T22:04:45.179851] [INFO ] [MAIN ] Derivative Progress: 19/2052 symbols completed. ADX took 1.1s. Estimated remaining: 14m 36s. Rate: 139.3 symbols/min [2025-10-22T22:04:45.180195] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:45.195177] [DEBUG] [MAIN ] AEFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:45.198681] [INFO ] [MAIN ] AEFC: Generated 1794 derivative records from 7650 primary records. [2025-10-22T22:04:45.199527] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-10-22T22:04:45.222864] [DEBUG] [MAIN ] AEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:45.229996] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1794 records). [2025-10-22T22:04:45.231008] [INFO ] [MAIN ] AEE: Generated 1794 derivative records from 50072 primary records. [2025-10-22T22:04:45.231169] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-10-22T22:04:45.233688] [INFO ] [MAIN ] Derivative Progress: 20/2052 symbols completed. AEFC took 1.0s. Estimated remaining: 13m 57s. Rate: 145.7 symbols/min [2025-10-22T22:04:45.234105] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:45.233791] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-10-22T22:04:45.263795] [DEBUG] [LOCAL ] AEE: Derivative data saved (1794 records). [2025-10-22T22:04:45.264000] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-10-22T22:04:45.266422] [INFO ] [MAIN ] Derivative Progress: 21/2052 symbols completed. AEE took 1.1s. Estimated remaining: 13m 20s. Rate: 152.3 symbols/min [2025-10-22T22:04:45.267514] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:45.282435] [DEBUG] [LOCAL ] AEG: Loaded 49558 existing records from primary storage. [2025-10-22T22:04:45.282744] [INFO ] [MAIN ] AEG: Loaded 49558 primary data records. [2025-10-22T22:04:45.674959] [DEBUG] [LOCAL ] AEM: Loaded 53477 existing records from primary storage. [2025-10-22T22:04:45.684899] [INFO ] [MAIN ] AEM: Loaded 53477 primary data records. [2025-10-22T22:04:45.777716] [DEBUG] [LOCAL ] AEO: Loaded 53564 existing records from primary storage. [2025-10-22T22:04:45.788322] [INFO ] [MAIN ] AEO: Loaded 53564 primary data records. [2025-10-22T22:04:46.441773] [DEBUG] [MAIN ] AEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:46.443305] [INFO ] [MAIN ] AEG: Generated 1794 derivative records from 49558 primary records. [2025-10-22T22:04:46.443501] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-10-22T22:04:46.465329] [DEBUG] [LOCAL ] AEG: Derivative data saved (1794 records). [2025-10-22T22:04:46.465828] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-10-22T22:04:46.468380] [INFO ] [MAIN ] Derivative Progress: 22/2052 symbols completed. AEG took 1.3s. Estimated remaining: 14m 34s. Rate: 139.3 symbols/min [2025-10-22T22:04:46.468625] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:46.496952] [DEBUG] [MAIN ] AEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:46.503122] [INFO ] [MAIN ] AEO: Generated 1794 derivative records from 53564 primary records. [2025-10-22T22:04:46.502334] [DEBUG] [MAIN ] AEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:46.503364] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-22T22:04:46.504507] [INFO ] [MAIN ] AEM: Generated 1794 derivative records from 53477 primary records. [2025-10-22T22:04:46.504806] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-22T22:04:46.530373] [DEBUG] [LOCAL ] AEO: Derivative data saved (1794 records). [2025-10-22T22:04:46.535286] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-10-22T22:04:46.538678] [INFO ] [MAIN ] Derivative Progress: 23/2052 symbols completed. AEO took 1.3s. Estimated remaining: 14m 2s. Rate: 144.6 symbols/min [2025-10-22T22:04:46.540057] [DEBUG] [LOCAL ] AEM: Derivative data saved (1794 records). [2025-10-22T22:04:46.540326] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:46.540412] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-22T22:04:46.553566] [INFO ] [MAIN ] Derivative Progress: 24/2052 symbols completed. AEM took 1.3s. Estimated remaining: 13m 28s. Rate: 150.7 symbols/min [2025-10-22T22:04:46.554036] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:46.573676] [DEBUG] [LOCAL ] AER: Loaded 47899 existing records from primary storage. [2025-10-22T22:04:46.573912] [INFO ] [MAIN ] AER: Loaded 47899 primary data records. [2025-10-22T22:04:46.922406] [DEBUG] [LOCAL ] AES: Loaded 53665 existing records from primary storage. [2025-10-22T22:04:46.923160] [DEBUG] [LOCAL ] AESI: Loaded 49817 existing records from primary storage. [2025-10-22T22:04:46.923441] [INFO ] [MAIN ] AES: Loaded 53665 primary data records. [2025-10-22T22:04:46.923692] [INFO ] [MAIN ] AESI: Loaded 49817 primary data records. [2025-10-22T22:04:47.618086] [DEBUG] [MAIN ] AER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:47.619963] [INFO ] [MAIN ] AER: Generated 1794 derivative records from 47899 primary records. [2025-10-22T22:04:47.621054] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-22T22:04:47.639394] [DEBUG] [LOCAL ] AER: Derivative data saved (1794 records). [2025-10-22T22:04:47.639684] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-22T22:04:47.642321] [INFO ] [MAIN ] Derivative Progress: 25/2052 symbols completed. AER took 1.2s. Estimated remaining: 14m 23s. Rate: 140.9 symbols/min [2025-10-22T22:04:47.643047] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:47.671354] [DEBUG] [MAIN ] AES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:47.672611] [INFO ] [MAIN ] AES: Generated 1794 derivative records from 53665 primary records. [2025-10-22T22:04:47.673394] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-22T22:04:47.673286] [DEBUG] [LOCAL ] AFB: Loaded 11018 existing records from primary storage. [2025-10-22T22:04:47.674184] [INFO ] [MAIN ] AFB: Loaded 11018 primary data records. [2025-10-22T22:04:47.735438] [DEBUG] [LOCAL ] AES: Derivative data saved (1794 records). [2025-10-22T22:04:47.735585] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-22T22:04:47.737440] [INFO ] [MAIN ] Derivative Progress: 26/2052 symbols completed. AES took 1.2s. Estimated remaining: 13m 57s. Rate: 145.2 symbols/min [2025-10-22T22:04:47.737759] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:47.835255] [DEBUG] [MAIN ] AESI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:47.863633] [INFO ] [MAIN ] AESI: Generated 1794 derivative records from 49817 primary records. [2025-10-22T22:04:47.891838] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-22T22:04:48.038574] [DEBUG] [LOCAL ] AESI: Derivative data saved (1794 records). [2025-10-22T22:04:48.049002] [DEBUG] [LOCAL ] AFG: Loaded 31910 existing records from primary storage. [2025-10-22T22:04:48.049820] [INFO ] [MAIN ] AFG: Loaded 31910 primary data records. [2025-10-22T22:04:48.048488] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-22T22:04:48.052878] [INFO ] [MAIN ] Derivative Progress: 27/2052 symbols completed. AESI took 1.5s. Estimated remaining: 13m 49s. Rate: 146.5 symbols/min [2025-10-22T22:04:48.087183] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:48.173084] [DEBUG] [LOCAL ] AFGB: Loaded 2210 existing records from primary storage. [2025-10-22T22:04:48.184268] [INFO ] [MAIN ] AFGB: Loaded 2210 primary data records. [2025-10-22T22:04:48.674970] [DEBUG] [MAIN ] AFB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:48.676696] [INFO ] [MAIN ] AFB: Generated 1794 derivative records from 11018 primary records. [2025-10-22T22:04:48.677149] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-22T22:04:48.694593] [DEBUG] [LOCAL ] AFB: Derivative data saved (1794 records). [2025-10-22T22:04:48.696315] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-22T22:04:48.698921] [INFO ] [MAIN ] Derivative Progress: 28/2052 symbols completed. AFB took 1.1s. Estimated remaining: 14m 6s. Rate: 143.5 symbols/min [2025-10-22T22:04:48.713856] [DEBUG] [MAIN ] AFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:48.714544] [INFO ] [MAIN ] AFG: Generated 1794 derivative records from 31910 primary records. [2025-10-22T22:04:48.714756] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-22T22:04:48.730775] [DEBUG] [LOCAL ] AFG: Derivative data saved (1794 records). [2025-10-22T22:04:48.730975] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-10-22T22:04:48.732867] [INFO ] [MAIN ] Derivative Progress: 29/2052 symbols completed. AFG took 1.0s. Estimated remaining: 13m 39s. Rate: 148.2 symbols/min [2025-10-22T22:04:48.750159] [DEBUG] [MAIN ] AFGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:48.750746] [INFO ] [MAIN ] AFGB: Generated 1794 derivative records from 2210 primary records. [2025-10-22T22:04:48.750808] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-10-22T22:04:48.763907] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1794 records). [2025-10-22T22:04:48.763964] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-10-22T22:04:48.766275] [INFO ] [MAIN ] Derivative Progress: 30/2052 symbols completed. AFGB took 0.7s. Estimated remaining: 13m 13s. Rate: 152.9 symbols/min [2025-10-22T22:04:48.766903] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:48.767033] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:48.766806] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:48.775361] [DEBUG] [LOCAL ] AFGE: Loaded 2245 existing records from primary storage. [2025-10-22T22:04:48.775740] [INFO ] [MAIN ] AFGE: Loaded 2245 primary data records. [2025-10-22T22:04:48.775568] [DEBUG] [LOCAL ] AFGC: Loaded 2540 existing records from primary storage. [2025-10-22T22:04:48.787090] [INFO ] [MAIN ] AFGC: Loaded 2540 primary data records. [2025-10-22T22:04:49.413833] [DEBUG] [LOCAL ] AFL: Loaded 53174 existing records from primary storage. [2025-10-22T22:04:49.414435] [INFO ] [MAIN ] AFL: Loaded 53174 primary data records. [2025-10-22T22:04:49.460227] [DEBUG] [MAIN ] AFGE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:04:49.479067] [INFO ] [MAIN ] AFGE: Generated 1793 derivative records from 2245 primary records. [2025-10-22T22:04:49.496361] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-22T22:04:49.556489] [DEBUG] [MAIN ] AFGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:49.572233] [INFO ] [MAIN ] AFGC: Generated 1794 derivative records from 2540 primary records. [2025-10-22T22:04:49.584561] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-22T22:04:49.590389] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1793 records). [2025-10-22T22:04:49.707260] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-22T22:04:49.715027] [INFO ] [MAIN ] Derivative Progress: 31/2052 symbols completed. AFGE took 0.9s. Estimated remaining: 13m 49s. Rate: 146.2 symbols/min [2025-10-22T22:04:49.807131] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1794 records). [2025-10-22T22:04:49.803064] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:49.820457] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-22T22:04:49.822824] [INFO ] [MAIN ] Derivative Progress: 32/2052 symbols completed. AFGC took 1.1s. Estimated remaining: 13m 30s. Rate: 149.7 symbols/min [2025-10-22T22:04:49.823218] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:49.849574] [DEBUG] [MAIN ] AFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:49.850498] [INFO ] [MAIN ] AFL: Generated 1794 derivative records from 53174 primary records. [2025-10-22T22:04:49.850637] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-22T22:04:49.887630] [DEBUG] [LOCAL ] AFL: Derivative data saved (1794 records). [2025-10-22T22:04:49.887773] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-10-22T22:04:49.889817] [INFO ] [MAIN ] Derivative Progress: 33/2052 symbols completed. AFL took 1.1s. Estimated remaining: 13m 9s. Rate: 153.6 symbols/min [2025-10-22T22:04:49.890016] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:49.919638] [DEBUG] [LOCAL ] AGCO: Loaded 42149 existing records from primary storage. [2025-10-22T22:04:49.919945] [INFO ] [MAIN ] AGCO: Loaded 42149 primary data records. [2025-10-22T22:04:49.931736] [DEBUG] [LOCAL ] AG: Loaded 53644 existing records from primary storage. [2025-10-22T22:04:49.963403] [INFO ] [MAIN ] AG: Loaded 53644 primary data records. [2025-10-22T22:04:50.111054] [DEBUG] [LOCAL ] AGD: Loaded 19283 existing records from primary storage. [2025-10-22T22:04:50.132947] [INFO ] [MAIN ] AGD: Loaded 19283 primary data records. [2025-10-22T22:04:50.888186] [DEBUG] [MAIN ] AGCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:50.888428] [DEBUG] [MAIN ] AG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:50.891966] [INFO ] [MAIN ] AG: Generated 1794 derivative records from 53644 primary records. [2025-10-22T22:04:50.890440] [INFO ] [MAIN ] AGCO: Generated 1794 derivative records from 42149 primary records. [2025-10-22T22:04:50.892148] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-22T22:04:50.892232] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-22T22:04:50.932937] [DEBUG] [LOCAL ] AG: Derivative data saved (1794 records). [2025-10-22T22:04:50.937407] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1794 records). [2025-10-22T22:04:50.933310] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-10-22T22:04:50.937758] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-10-22T22:04:50.939740] [INFO ] [MAIN ] Derivative Progress: 34/2052 symbols completed. AG took 1.1s. Estimated remaining: 13m 48s. Rate: 146.3 symbols/min [2025-10-22T22:04:50.941984] [DEBUG] [MAIN ] AGD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:50.942822] [INFO ] [MAIN ] AGD: Generated 1794 derivative records from 19283 primary records. [2025-10-22T22:04:50.943161] [INFO ] [MAIN ] Derivative Progress: 35/2052 symbols completed. AGCO took 1.1s. Estimated remaining: 13m 24s. Rate: 150.6 symbols/min [2025-10-22T22:04:50.942949] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:50.943009] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-22T22:04:50.943602] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:50.960951] [DEBUG] [LOCAL ] AGD: Derivative data saved (1794 records). [2025-10-22T22:04:50.961121] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-10-22T22:04:50.963498] [INFO ] [MAIN ] Derivative Progress: 36/2052 symbols completed. AGD took 1.1s. Estimated remaining: 13m 2s. Rate: 154.6 symbols/min [2025-10-22T22:04:50.963708] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:50.977020] [DEBUG] [LOCAL ] AGM: Loaded 10617 existing records from primary storage. [2025-10-22T22:04:50.977672] [INFO ] [MAIN ] AGM: Loaded 10617 primary data records. [2025-10-22T22:04:51.173691] [DEBUG] [LOCAL ] AGL: Loaded 52595 existing records from primary storage. [2025-10-22T22:04:51.180748] [INFO ] [MAIN ] AGL: Loaded 52595 primary data records. [2025-10-22T22:04:51.253407] [DEBUG] [LOCAL ] AGI: Loaded 53423 existing records from primary storage. [2025-10-22T22:04:51.365346] [INFO ] [MAIN ] AGI: Loaded 53423 primary data records. [2025-10-22T22:04:52.016337] [DEBUG] [MAIN ] AGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:52.017242] [INFO ] [MAIN ] AGM: Generated 1794 derivative records from 10617 primary records. [2025-10-22T22:04:52.018286] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-22T22:04:52.036396] [DEBUG] [LOCAL ] AGM: Derivative data saved (1794 records). [2025-10-22T22:04:52.036883] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-22T22:04:52.038619] [INFO ] [MAIN ] Derivative Progress: 37/2052 symbols completed. AGM took 1.1s. Estimated remaining: 13m 39s. Rate: 147.6 symbols/min [2025-10-22T22:04:52.039135] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:52.069315] [DEBUG] [MAIN ] AGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:52.075392] [INFO ] [MAIN ] AGI: Generated 1794 derivative records from 53423 primary records. [2025-10-22T22:04:52.076057] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-10-22T22:04:52.075789] [DEBUG] [MAIN ] AGL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:52.085249] [INFO ] [MAIN ] AGL: Generated 1794 derivative records from 52595 primary records. [2025-10-22T22:04:52.085404] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-22T22:04:52.115986] [DEBUG] [LOCAL ] AGI: Derivative data saved (1794 records). [2025-10-22T22:04:52.129155] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-10-22T22:04:52.134883] [INFO ] [MAIN ] Derivative Progress: 38/2052 symbols completed. AGI took 1.2s. Estimated remaining: 13m 22s. Rate: 150.6 symbols/min [2025-10-22T22:04:52.135160] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:52.135789] [DEBUG] [LOCAL ] AGO: Loaded 27710 existing records from primary storage. [2025-10-22T22:04:52.134992] [DEBUG] [LOCAL ] AGL: Derivative data saved (1794 records). [2025-10-22T22:04:52.136409] [INFO ] [MAIN ] AGO: Loaded 27710 primary data records. [2025-10-22T22:04:52.136347] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-22T22:04:52.138628] [INFO ] [MAIN ] Derivative Progress: 39/2052 symbols completed. AGL took 1.2s. Estimated remaining: 13m 2s. Rate: 154.5 symbols/min [2025-10-22T22:04:52.138942] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:52.458068] [DEBUG] [LOCAL ] AGRO: Loaded 32457 existing records from primary storage. [2025-10-22T22:04:52.458280] [INFO ] [MAIN ] AGRO: Loaded 32457 primary data records. [2025-10-22T22:04:52.545406] [DEBUG] [LOCAL ] AGX: Loaded 32652 existing records from primary storage. [2025-10-22T22:04:52.556398] [INFO ] [MAIN ] AGX: Loaded 32652 primary data records. [2025-10-22T22:04:53.098497] [DEBUG] [MAIN ] AGO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:04:53.100628] [INFO ] [MAIN ] AGO: Generated 1793 derivative records from 27710 primary records. [2025-10-22T22:04:53.101389] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-22T22:04:53.119982] [DEBUG] [LOCAL ] AGO: Derivative data saved (1793 records). [2025-10-22T22:04:53.120326] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-10-22T22:04:53.123714] [INFO ] [MAIN ] Derivative Progress: 40/2052 symbols completed. AGO took 1.1s. Estimated remaining: 13m 31s. Rate: 148.8 symbols/min [2025-10-22T22:04:53.124169] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:53.159630] [DEBUG] [MAIN ] AGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:53.166726] [INFO ] [MAIN ] AGX: Generated 1794 derivative records from 32652 primary records. [2025-10-22T22:04:53.167802] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-22T22:04:53.168832] [DEBUG] [MAIN ] AGRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:53.179932] [INFO ] [MAIN ] AGRO: Generated 1794 derivative records from 32457 primary records. [2025-10-22T22:04:53.191140] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-22T22:04:53.196578] [DEBUG] [LOCAL ] AGX: Derivative data saved (1794 records). [2025-10-22T22:04:53.204031] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-22T22:04:53.206192] [INFO ] [MAIN ] Derivative Progress: 41/2052 symbols completed. AGX took 1.1s. Estimated remaining: 13m 15s. Rate: 151.8 symbols/min [2025-10-22T22:04:53.207590] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:53.226150] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1794 records). [2025-10-22T22:04:53.226900] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-10-22T22:04:53.229198] [INFO ] [MAIN ] Derivative Progress: 42/2052 symbols completed. AGRO took 1.1s. Estimated remaining: 12m 57s. Rate: 155.2 symbols/min [2025-10-22T22:04:53.230414] [DEBUG] [LOCAL ] AHH: Loaded 40160 existing records from primary storage. [2025-10-22T22:04:53.232130] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:53.232402] [INFO ] [MAIN ] AHH: Loaded 40160 primary data records. [2025-10-22T22:04:53.247256] [DEBUG] [LOCAL ] AHT: Loaded 6358 existing records from primary storage. [2025-10-22T22:04:53.267569] [INFO ] [MAIN ] AHT: Loaded 6358 primary data records. [2025-10-22T22:04:53.891210] [DEBUG] [LOCAL ] AI: Loaded 53765 existing records from primary storage. [2025-10-22T22:04:53.893088] [INFO ] [MAIN ] AI: Loaded 53765 primary data records. [2025-10-22T22:04:54.241606] [DEBUG] [MAIN ] AHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:54.241993] [DEBUG] [MAIN ] AHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:54.242978] [INFO ] [MAIN ] AHT: Generated 1794 derivative records from 6358 primary records. [2025-10-22T22:04:54.243134] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-22T22:04:54.244706] [INFO ] [MAIN ] AHH: Generated 1794 derivative records from 40160 primary records. [2025-10-22T22:04:54.245734] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-22T22:04:54.267810] [DEBUG] [LOCAL ] AHT: Derivative data saved (1794 records). [2025-10-22T22:04:54.272099] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-22T22:04:54.276587] [INFO ] [MAIN ] Derivative Progress: 43/2052 symbols completed. AHT took 1.1s. Estimated remaining: 13m 27s. Rate: 149.3 symbols/min [2025-10-22T22:04:54.278871] [DEBUG] [LOCAL ] AHH: Derivative data saved (1794 records). [2025-10-22T22:04:54.279069] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-22T22:04:54.281466] [INFO ] [MAIN ] Derivative Progress: 44/2052 symbols completed. AHH took 1.2s. Estimated remaining: 13m 9s. Rate: 152.7 symbols/min [2025-10-22T22:04:54.296818] [DEBUG] [MAIN ] AI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:54.297359] [INFO ] [MAIN ] AI: Generated 1794 derivative records from 53765 primary records. [2025-10-22T22:04:54.297417] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-22T22:04:54.312574] [DEBUG] [LOCAL ] AI: Derivative data saved (1794 records). [2025-10-22T22:04:54.312630] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-10-22T22:04:54.314745] [INFO ] [MAIN ] Derivative Progress: 45/2052 symbols completed. AI took 1.1s. Estimated remaining: 12m 52s. Rate: 155.9 symbols/min [2025-10-22T22:04:54.315335] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:54.315231] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:54.315136] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:54.328721] [DEBUG] [LOCAL ] AIO: Loaded 12916 existing records from primary storage. [2025-10-22T22:04:54.329010] [INFO ] [MAIN ] AIO: Loaded 12916 primary data records. [2025-10-22T22:04:54.445995] [DEBUG] [LOCAL ] AIN: Loaded 24301 existing records from primary storage. [2025-10-22T22:04:54.449324] [INFO ] [MAIN ] AIN: Loaded 24301 primary data records. [2025-10-22T22:04:54.782607] [DEBUG] [LOCAL ] AIG: Loaded 53459 existing records from primary storage. [2025-10-22T22:04:54.794069] [INFO ] [MAIN ] AIG: Loaded 53459 primary data records. [2025-10-22T22:04:55.338949] [DEBUG] [MAIN ] AIO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:04:55.340771] [INFO ] [MAIN ] AIO: Generated 1793 derivative records from 12916 primary records. [2025-10-22T22:04:55.341777] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-10-22T22:04:55.356222] [DEBUG] [MAIN ] AIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:55.373542] [DEBUG] [LOCAL ] AIO: Derivative data saved (1793 records). [2025-10-22T22:04:55.369531] [INFO ] [MAIN ] AIN: Generated 1794 derivative records from 24301 primary records. [2025-10-22T22:04:55.373837] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-22T22:04:55.374030] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-10-22T22:04:55.376794] [INFO ] [MAIN ] Derivative Progress: 46/2052 symbols completed. AIO took 1.1s. Estimated remaining: 13m 22s. Rate: 150.2 symbols/min [2025-10-22T22:04:55.384349] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:55.395415] [DEBUG] [LOCAL ] AIN: Derivative data saved (1794 records). [2025-10-22T22:04:55.395578] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-22T22:04:55.397701] [INFO ] [MAIN ] Derivative Progress: 47/2052 symbols completed. AIN took 1.1s. Estimated remaining: 13m 5s. Rate: 153.2 symbols/min [2025-10-22T22:04:55.409999] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:55.410828] [DEBUG] [MAIN ] AIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:55.411552] [INFO ] [MAIN ] AIG: Generated 1794 derivative records from 53459 primary records. [2025-10-22T22:04:55.411669] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-22T22:04:55.435811] [DEBUG] [LOCAL ] AIG: Derivative data saved (1794 records). [2025-10-22T22:04:55.435910] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-22T22:04:55.438026] [INFO ] [MAIN ] Derivative Progress: 48/2052 symbols completed. AIG took 1.1s. Estimated remaining: 12m 50s. Rate: 156.2 symbols/min [2025-10-22T22:04:55.438319] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:55.450530] [DEBUG] [LOCAL ] AIT: Loaded 26566 existing records from primary storage. [2025-10-22T22:04:55.450699] [INFO ] [MAIN ] AIT: Loaded 26566 primary data records. [2025-10-22T22:04:55.648940] [DEBUG] [LOCAL ] AIZ: Loaded 29244 existing records from primary storage. [2025-10-22T22:04:55.682133] [INFO ] [MAIN ] AIZ: Loaded 29244 primary data records. [2025-10-22T22:04:55.683117] [DEBUG] [LOCAL ] AIV: Loaded 41857 existing records from primary storage. [2025-10-22T22:04:55.857985] [INFO ] [MAIN ] AIV: Loaded 41857 primary data records. [2025-10-22T22:04:56.459019] [DEBUG] [MAIN ] AIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:56.461206] [INFO ] [MAIN ] AIT: Generated 1794 derivative records from 26566 primary records. [2025-10-22T22:04:56.461757] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-22T22:04:56.481693] [DEBUG] [LOCAL ] AIT: Derivative data saved (1794 records). [2025-10-22T22:04:56.482023] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-22T22:04:56.491530] [INFO ] [MAIN ] Derivative Progress: 49/2052 symbols completed. AIT took 1.1s. Estimated remaining: 13m 17s. Rate: 150.8 symbols/min [2025-10-22T22:04:56.496359] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:56.497438] [DEBUG] [MAIN ] AIZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:56.498698] [INFO ] [MAIN ] AIZ: Generated 1794 derivative records from 29244 primary records. [2025-10-22T22:04:56.498835] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-22T22:04:56.517428] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1794 records). [2025-10-22T22:04:56.529808] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-22T22:04:56.531981] [INFO ] [MAIN ] Derivative Progress: 50/2052 symbols completed. AIZ took 1.1s. Estimated remaining: 13m 2s. Rate: 153.6 symbols/min [2025-10-22T22:04:56.532805] [DEBUG] [MAIN ] AIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:56.532963] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:56.533713] [INFO ] [MAIN ] AIV: Generated 1794 derivative records from 41857 primary records. [2025-10-22T22:04:56.534276] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-22T22:04:56.550125] [DEBUG] [LOCAL ] AIV: Derivative data saved (1794 records). [2025-10-22T22:04:56.550388] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-22T22:04:56.552712] [INFO ] [MAIN ] Derivative Progress: 51/2052 symbols completed. AIV took 1.1s. Estimated remaining: 12m 47s. Rate: 156.5 symbols/min [2025-10-22T22:04:56.553000] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:56.595274] [DEBUG] [LOCAL ] AJG: Loaded 46386 existing records from primary storage. [2025-10-22T22:04:56.595506] [INFO ] [MAIN ] AJG: Loaded 46386 primary data records. [2025-10-22T22:04:56.749351] [DEBUG] [LOCAL ] AKR: Loaded 46103 existing records from primary storage. [2025-10-22T22:04:56.793683] [DEBUG] [LOCAL ] AL: Loaded 44805 existing records from primary storage. [2025-10-22T22:04:56.814481] [INFO ] [MAIN ] AKR: Loaded 46103 primary data records. [2025-10-22T22:04:56.956418] [INFO ] [MAIN ] AL: Loaded 44805 primary data records. [2025-10-22T22:04:57.654613] [DEBUG] [MAIN ] AJG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:04:57.656263] [INFO ] [MAIN ] AJG: Generated 1793 derivative records from 46386 primary records. [2025-10-22T22:04:57.656568] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-22T22:04:57.676767] [DEBUG] [LOCAL ] AJG: Derivative data saved (1793 records). [2025-10-22T22:04:57.677220] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-22T22:04:57.680483] [INFO ] [MAIN ] Derivative Progress: 52/2052 symbols completed. AJG took 1.2s. Estimated remaining: 13m 16s. Rate: 150.8 symbols/min [2025-10-22T22:04:57.681423] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:57.698370] [DEBUG] [MAIN ] AKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:57.699256] [INFO ] [MAIN ] AKR: Generated 1794 derivative records from 46103 primary records. [2025-10-22T22:04:57.699547] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-22T22:04:57.720478] [DEBUG] [MAIN ] AL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:57.730233] [DEBUG] [LOCAL ] AKR: Derivative data saved (1794 records). [2025-10-22T22:04:57.725879] [INFO ] [MAIN ] AL: Generated 1794 derivative records from 44805 primary records. [2025-10-22T22:04:57.730637] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-22T22:04:57.730456] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-22T22:04:57.734096] [INFO ] [MAIN ] Derivative Progress: 53/2052 symbols completed. AKR took 1.2s. Estimated remaining: 13m 2s. Rate: 153.3 symbols/min [2025-10-22T22:04:57.741926] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:57.750997] [DEBUG] [LOCAL ] AL: Derivative data saved (1794 records). [2025-10-22T22:04:57.751112] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-22T22:04:57.754889] [INFO ] [MAIN ] Derivative Progress: 54/2052 symbols completed. AL took 1.2s. Estimated remaining: 12m 48s. Rate: 156.1 symbols/min [2025-10-22T22:04:57.755120] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:57.812407] [DEBUG] [LOCAL ] ALB: Loaded 53362 existing records from primary storage. [2025-10-22T22:04:57.824601] [DEBUG] [LOCAL ] ALE: Loaded 32075 existing records from primary storage. [2025-10-22T22:04:57.824876] [INFO ] [MAIN ] ALB: Loaded 53362 primary data records. [2025-10-22T22:04:57.825245] [INFO ] [MAIN ] ALE: Loaded 32075 primary data records. [2025-10-22T22:04:58.047884] [DEBUG] [LOCAL ] ALC: Loaded 51212 existing records from primary storage. [2025-10-22T22:04:58.057380] [INFO ] [MAIN ] ALC: Loaded 51212 primary data records. [2025-10-22T22:04:58.786219] [DEBUG] [MAIN ] ALB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:58.794501] [INFO ] [MAIN ] ALB: Generated 1794 derivative records from 53362 primary records. [2025-10-22T22:04:58.794864] [DEBUG] [MAIN ] ALE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:58.795115] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-22T22:04:58.796897] [INFO ] [MAIN ] ALE: Generated 1794 derivative records from 32075 primary records. [2025-10-22T22:04:58.797108] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-22T22:04:58.844020] [DEBUG] [LOCAL ] ALB: Derivative data saved (1794 records). [2025-10-22T22:04:58.845311] [DEBUG] [LOCAL ] ALE: Derivative data saved (1794 records). [2025-10-22T22:04:58.845466] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-22T22:04:58.847684] [INFO ] [MAIN ] Derivative Progress: 55/2052 symbols completed. ALB took 1.2s. Estimated remaining: 13m 13s. Rate: 151.0 symbols/min [2025-10-22T22:04:58.845617] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-22T22:04:58.848300] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:58.850893] [INFO ] [MAIN ] Derivative Progress: 56/2052 symbols completed. ALE took 1.1s. Estimated remaining: 12m 59s. Rate: 153.7 symbols/min [2025-10-22T22:04:58.851037] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:58.848044] [DEBUG] [MAIN ] ALC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:58.852724] [INFO ] [MAIN ] ALC: Generated 1794 derivative records from 51212 primary records. [2025-10-22T22:04:58.852912] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-10-22T22:04:58.871816] [DEBUG] [LOCAL ] ALC: Derivative data saved (1794 records). [2025-10-22T22:04:58.871990] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-10-22T22:04:58.874511] [INFO ] [MAIN ] Derivative Progress: 57/2052 symbols completed. ALC took 1.1s. Estimated remaining: 12m 46s. Rate: 156.3 symbols/min [2025-10-22T22:04:58.874821] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:58.879890] [DEBUG] [LOCAL ] ALG: Loaded 9714 existing records from primary storage. [2025-10-22T22:04:58.880048] [INFO ] [MAIN ] ALG: Loaded 9714 primary data records. [2025-10-22T22:04:59.062929] [DEBUG] [LOCAL ] ALEX: Loaded 30810 existing records from primary storage. [2025-10-22T22:04:59.063126] [INFO ] [MAIN ] ALEX: Loaded 30810 primary data records. [2025-10-22T22:04:59.529955] [DEBUG] [LOCAL ] ALIT: Loaded 52781 existing records from primary storage. [2025-10-22T22:04:59.583530] [INFO ] [MAIN ] ALIT: Loaded 52781 primary data records. [2025-10-22T22:04:59.894224] [DEBUG] [MAIN ] ALG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:59.908539] [INFO ] [MAIN ] ALG: Generated 1794 derivative records from 9714 primary records. [2025-10-22T22:04:59.908898] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-22T22:04:59.925891] [DEBUG] [LOCAL ] ALG: Derivative data saved (1794 records). [2025-10-22T22:04:59.926511] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-22T22:04:59.928834] [INFO ] [MAIN ] Derivative Progress: 58/2052 symbols completed. ALG took 1.1s. Estimated remaining: 13m 8s. Rate: 151.7 symbols/min [2025-10-22T22:04:59.947275] [DEBUG] [MAIN ] ALEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:59.948012] [INFO ] [MAIN ] ALEX: Generated 1794 derivative records from 30810 primary records. [2025-10-22T22:04:59.948299] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-22T22:04:59.964434] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1794 records). [2025-10-22T22:04:59.966110] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-22T22:04:59.968969] [INFO ] [MAIN ] Derivative Progress: 59/2052 symbols completed. ALEX took 1.1s. Estimated remaining: 12m 56s. Rate: 154.1 symbols/min [2025-10-22T22:04:59.981372] [DEBUG] [MAIN ] ALIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:04:59.982001] [INFO ] [MAIN ] ALIT: Generated 1794 derivative records from 52781 primary records. [2025-10-22T22:04:59.982062] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-22T22:04:59.996861] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1794 records). [2025-10-22T22:04:59.996919] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-22T22:04:59.999142] [INFO ] [MAIN ] Derivative Progress: 60/2052 symbols completed. ALIT took 1.1s. Estimated remaining: 12m 44s. Rate: 156.5 symbols/min [2025-10-22T22:04:59.999668] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:04:59.999741] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:00.000225] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:00.089090] [DEBUG] [LOCAL ] ALL: Loaded 49604 existing records from primary storage. [2025-10-22T22:05:00.090310] [INFO ] [MAIN ] ALL: Loaded 49604 primary data records. [2025-10-22T22:05:00.091083] [DEBUG] [LOCAL ] ALK: Loaded 53087 existing records from primary storage. [2025-10-22T22:05:00.127749] [INFO ] [MAIN ] ALK: Loaded 53087 primary data records. [2025-10-22T22:05:00.122449] [DEBUG] [LOCAL ] ALLE: Loaded 43945 existing records from primary storage. [2025-10-22T22:05:00.181299] [INFO ] [MAIN ] ALLE: Loaded 43945 primary data records. [2025-10-22T22:05:01.010297] [DEBUG] [MAIN ] ALL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:01.011120] [INFO ] [MAIN ] ALL: Generated 1794 derivative records from 49604 primary records. [2025-10-22T22:05:01.011383] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-22T22:05:01.030852] [DEBUG] [LOCAL ] ALL: Derivative data saved (1794 records). [2025-10-22T22:05:01.031818] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-22T22:05:01.046481] [DEBUG] [MAIN ] ALK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:01.046059] [INFO ] [MAIN ] Derivative Progress: 61/2052 symbols completed. ALL took 1.0s. Estimated remaining: 13m 5s. Rate: 152.2 symbols/min [2025-10-22T22:05:01.047336] [INFO ] [MAIN ] ALK: Generated 1794 derivative records from 53087 primary records. [2025-10-22T22:05:01.059560] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:01.059816] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-22T22:05:01.060211] [DEBUG] [MAIN ] ALLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:01.062101] [INFO ] [MAIN ] ALLE: Generated 1794 derivative records from 43945 primary records. [2025-10-22T22:05:01.070726] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-10-22T22:05:01.078453] [DEBUG] [LOCAL ] ALK: Derivative data saved (1794 records). [2025-10-22T22:05:01.079907] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-22T22:05:01.090957] [INFO ] [MAIN ] Derivative Progress: 62/2052 symbols completed. ALK took 1.1s. Estimated remaining: 12m 53s. Rate: 154.4 symbols/min [2025-10-22T22:05:01.095101] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:01.101425] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1794 records). [2025-10-22T22:05:01.101602] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-10-22T22:05:01.104556] [INFO ] [MAIN ] Derivative Progress: 63/2052 symbols completed. ALLE took 1.1s. Estimated remaining: 12m 41s. Rate: 156.8 symbols/min [2025-10-22T22:05:01.104838] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:01.123114] [DEBUG] [LOCAL ] ALUR: Loaded 9277 existing records from primary storage. [2025-10-22T22:05:01.123475] [INFO ] [MAIN ] ALUR: Loaded 9277 primary data records. [2025-10-22T22:05:01.205957] [DEBUG] [LOCAL ] ALTG: Loaded 23079 existing records from primary storage. [2025-10-22T22:05:01.222865] [INFO ] [MAIN ] ALTG: Loaded 23079 primary data records. [2025-10-22T22:05:01.621974] [DEBUG] [LOCAL ] ALLY: Loaded 53222 existing records from primary storage. [2025-10-22T22:05:01.701542] [INFO ] [MAIN ] ALLY: Loaded 53222 primary data records. [2025-10-22T22:05:02.180226] [DEBUG] [MAIN ] ALUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:02.193300] [INFO ] [MAIN ] ALUR: Generated 1794 derivative records from 9277 primary records. [2025-10-22T22:05:02.194101] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-22T22:05:02.194423] [DEBUG] [MAIN ] ALTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:02.196474] [INFO ] [MAIN ] ALTG: Generated 1794 derivative records from 23079 primary records. [2025-10-22T22:05:02.196560] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-22T22:05:02.235536] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1794 records). [2025-10-22T22:05:02.236585] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-22T22:05:02.238789] [INFO ] [MAIN ] Derivative Progress: 64/2052 symbols completed. ALTG took 1.1s. Estimated remaining: 13m 4s. Rate: 152.1 symbols/min [2025-10-22T22:05:02.252774] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1794 records). [2025-10-22T22:05:02.252691] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:02.252980] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-22T22:05:02.255819] [INFO ] [MAIN ] Derivative Progress: 65/2052 symbols completed. ALUR took 1.2s. Estimated remaining: 12m 52s. Rate: 154.4 symbols/min [2025-10-22T22:05:02.256233] [DEBUG] [MAIN ] ALLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:02.257299] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:02.257045] [INFO ] [MAIN ] ALLY: Generated 1794 derivative records from 53222 primary records. [2025-10-22T22:05:02.257492] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-22T22:05:02.274687] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1794 records). [2025-10-22T22:05:02.274877] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-22T22:05:02.277293] [INFO ] [MAIN ] Derivative Progress: 66/2052 symbols completed. ALLY took 1.2s. Estimated remaining: 12m 41s. Rate: 156.6 symbols/min [2025-10-22T22:05:02.279961] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:02.286202] [DEBUG] [LOCAL ] ALX: Loaded 7271 existing records from primary storage. [2025-10-22T22:05:02.286554] [INFO ] [MAIN ] ALX: Loaded 7271 primary data records. [2025-10-22T22:05:02.610809] [DEBUG] [LOCAL ] ALV: Loaded 42191 existing records from primary storage. [2025-10-22T22:05:02.638138] [INFO ] [MAIN ] ALV: Loaded 42191 primary data records. [2025-10-22T22:05:02.765607] [DEBUG] [LOCAL ] AM: Loaded 51849 existing records from primary storage. [2025-10-22T22:05:02.807510] [INFO ] [MAIN ] AM: Loaded 51849 primary data records. [2025-10-22T22:05:03.276861] [DEBUG] [MAIN ] ALX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:03.278546] [INFO ] [MAIN ] ALX: Generated 1794 derivative records from 7271 primary records. [2025-10-22T22:05:03.278807] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-22T22:05:03.294743] [DEBUG] [LOCAL ] ALX: Derivative data saved (1794 records). [2025-10-22T22:05:03.295081] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-22T22:05:03.297291] [INFO ] [MAIN ] Derivative Progress: 67/2052 symbols completed. ALX took 1.0s. Estimated remaining: 12m 59s. Rate: 152.8 symbols/min [2025-10-22T22:05:03.301839] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:03.318122] [DEBUG] [MAIN ] ALV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:03.319569] [INFO ] [MAIN ] ALV: Generated 1794 derivative records from 42191 primary records. [2025-10-22T22:05:03.319813] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-22T22:05:03.337910] [DEBUG] [LOCAL ] ALV: Derivative data saved (1794 records). [2025-10-22T22:05:03.338427] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-22T22:05:03.340625] [INFO ] [MAIN ] Derivative Progress: 68/2052 symbols completed. ALV took 1.1s. Estimated remaining: 12m 49s. Rate: 154.9 symbols/min [2025-10-22T22:05:03.352300] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:03.366182] [DEBUG] [MAIN ] AM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:03.366936] [INFO ] [MAIN ] AM: Generated 1794 derivative records from 51849 primary records. [2025-10-22T22:05:03.367143] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-22T22:05:03.389181] [DEBUG] [LOCAL ] AMBC: Loaded 35885 existing records from primary storage. [2025-10-22T22:05:03.393684] [DEBUG] [LOCAL ] AM: Derivative data saved (1794 records). [2025-10-22T22:05:03.392818] [INFO ] [MAIN ] AMBC: Loaded 35885 primary data records. [2025-10-22T22:05:03.393813] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-22T22:05:03.406993] [INFO ] [MAIN ] Derivative Progress: 69/2052 symbols completed. AM took 1.1s. Estimated remaining: 12m 39s. Rate: 156.8 symbols/min [2025-10-22T22:05:03.416503] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:03.709581] [DEBUG] [LOCAL ] AMBP: Loaded 44318 existing records from primary storage. [2025-10-22T22:05:03.803819] [INFO ] [MAIN ] AMBP: Loaded 44318 primary data records. [2025-10-22T22:05:03.959773] [DEBUG] [LOCAL ] AMC: Loaded 53766 existing records from primary storage. [2025-10-22T22:05:03.982388] [INFO ] [MAIN ] AMC: Loaded 53766 primary data records. [2025-10-22T22:05:04.463189] [DEBUG] [MAIN ] AMBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:04.464520] [INFO ] [MAIN ] AMBC: Generated 1794 derivative records from 35885 primary records. [2025-10-22T22:05:04.464760] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-22T22:05:04.561187] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1794 records). [2025-10-22T22:05:04.594204] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-22T22:05:04.717830] [INFO ] [MAIN ] Derivative Progress: 70/2052 symbols completed. AMBC took 1.4s. Estimated remaining: 13m 5s. Rate: 151.5 symbols/min [2025-10-22T22:05:04.736197] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:04.758990] [DEBUG] [MAIN ] AMBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:04.760194] [INFO ] [MAIN ] AMBP: Generated 1794 derivative records from 44318 primary records. [2025-10-22T22:05:04.760283] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-22T22:05:04.779071] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1794 records). [2025-10-22T22:05:04.779756] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-22T22:05:04.782466] [INFO ] [MAIN ] Derivative Progress: 71/2052 symbols completed. AMBP took 1.4s. Estimated remaining: 12m 55s. Rate: 153.3 symbols/min [2025-10-22T22:05:04.782930] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:04.817810] [DEBUG] [MAIN ] AMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:04.818479] [INFO ] [MAIN ] AMC: Generated 1794 derivative records from 53766 primary records. [2025-10-22T22:05:04.818540] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-22T22:05:04.836211] [DEBUG] [LOCAL ] AMC: Derivative data saved (1794 records). [2025-10-22T22:05:04.836450] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-22T22:05:04.838545] [INFO ] [MAIN ] Derivative Progress: 72/2052 symbols completed. AMC took 1.4s. Estimated remaining: 12m 46s. Rate: 155.2 symbols/min [2025-10-22T22:05:04.838867] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:04.856966] [DEBUG] [LOCAL ] AMCR: Loaded 53670 existing records from primary storage. [2025-10-22T22:05:04.857201] [INFO ] [MAIN ] AMCR: Loaded 53670 primary data records. [2025-10-22T22:05:05.004534] [DEBUG] [LOCAL ] AMG: Loaded 20036 existing records from primary storage. [2025-10-22T22:05:05.046680] [INFO ] [MAIN ] AMG: Loaded 20036 primary data records. [2025-10-22T22:05:05.041388] [DEBUG] [LOCAL ] AME: Loaded 48418 existing records from primary storage. [2025-10-22T22:05:05.067311] [INFO ] [MAIN ] AME: Loaded 48418 primary data records. [2025-10-22T22:05:05.905954] [DEBUG] [MAIN ] AMCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:05.908227] [INFO ] [MAIN ] AMCR: Generated 1794 derivative records from 53670 primary records. [2025-10-22T22:05:05.909318] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-22T22:05:05.924786] [DEBUG] [MAIN ] AMG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:05:05.932780] [INFO ] [MAIN ] AMG: Generated 1793 derivative records from 20036 primary records. [2025-10-22T22:05:05.932960] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-22T22:05:05.940934] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1794 records). [2025-10-22T22:05:05.953130] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-22T22:05:05.962107] [INFO ] [MAIN ] Derivative Progress: 73/2052 symbols completed. AMCR took 1.2s. Estimated remaining: 13m 5s. Rate: 151.2 symbols/min [2025-10-22T22:05:05.966060] [DEBUG] [MAIN ] AME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:05.969064] [INFO ] [MAIN ] AME: Generated 1794 derivative records from 48418 primary records. [2025-10-22T22:05:05.969760] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-22T22:05:05.971764] [DEBUG] [LOCAL ] AMG: Derivative data saved (1793 records). [2025-10-22T22:05:05.972005] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-22T22:05:05.974130] [INFO ] [MAIN ] Derivative Progress: 74/2052 symbols completed. AMG took 1.1s. Estimated remaining: 12m 55s. Rate: 153.2 symbols/min [2025-10-22T22:05:05.989228] [DEBUG] [LOCAL ] AME: Derivative data saved (1794 records). [2025-10-22T22:05:05.989309] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-22T22:05:05.991536] [INFO ] [MAIN ] Derivative Progress: 75/2052 symbols completed. AME took 1.2s. Estimated remaining: 12m 44s. Rate: 155.2 symbols/min [2025-10-22T22:05:05.991936] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:05.991883] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:05.992238] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:06.060621] [DEBUG] [LOCAL ] AMP: Loaded 31807 existing records from primary storage. [2025-10-22T22:05:06.061328] [INFO ] [MAIN ] AMP: Loaded 31807 primary data records. [2025-10-22T22:05:06.086154] [DEBUG] [LOCAL ] AMN: Loaded 41641 existing records from primary storage. [2025-10-22T22:05:06.111718] [INFO ] [MAIN ] AMN: Loaded 41641 primary data records. [2025-10-22T22:05:06.254255] [DEBUG] [LOCAL ] AMH: Loaded 51830 existing records from primary storage. [2025-10-22T22:05:06.301176] [INFO ] [MAIN ] AMH: Loaded 51830 primary data records. [2025-10-22T22:05:07.013669] [DEBUG] [MAIN ] AMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:07.008525] [DEBUG] [MAIN ] AMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:07.014631] [INFO ] [MAIN ] AMP: Generated 1794 derivative records from 31807 primary records. [2025-10-22T22:05:07.015298] [INFO ] [MAIN ] AMN: Generated 1794 derivative records from 41641 primary records. [2025-10-22T22:05:07.014754] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-22T22:05:07.015389] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-10-22T22:05:07.031936] [DEBUG] [LOCAL ] AMP: Derivative data saved (1794 records). [2025-10-22T22:05:07.041782] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-22T22:05:07.047512] [INFO ] [MAIN ] Derivative Progress: 76/2052 symbols completed. AMP took 1.1s. Estimated remaining: 13m 1s. Rate: 151.7 symbols/min [2025-10-22T22:05:07.048950] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:07.065215] [DEBUG] [MAIN ] AMH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:07.052246] [DEBUG] [LOCAL ] AMN: Derivative data saved (1794 records). [2025-10-22T22:05:07.066234] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-10-22T22:05:07.066077] [INFO ] [MAIN ] AMH: Generated 1794 derivative records from 51830 primary records. [2025-10-22T22:05:07.066343] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-22T22:05:07.068499] [INFO ] [MAIN ] Derivative Progress: 77/2052 symbols completed. AMN took 1.1s. Estimated remaining: 12m 51s. Rate: 153.6 symbols/min [2025-10-22T22:05:07.069540] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:07.085328] [DEBUG] [LOCAL ] AMH: Derivative data saved (1794 records). [2025-10-22T22:05:07.085603] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-22T22:05:07.087740] [INFO ] [MAIN ] Derivative Progress: 78/2052 symbols completed. AMH took 1.1s. Estimated remaining: 12m 42s. Rate: 155.5 symbols/min [2025-10-22T22:05:07.088039] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:07.125684] [DEBUG] [LOCAL ] AMPY: Loaded 39376 existing records from primary storage. [2025-10-22T22:05:07.133562] [INFO ] [MAIN ] AMPY: Loaded 39376 primary data records. [2025-10-22T22:05:07.135166] [DEBUG] [LOCAL ] AMR: Loaded 28786 existing records from primary storage. [2025-10-22T22:05:07.168711] [INFO ] [MAIN ] AMR: Loaded 28786 primary data records. [2025-10-22T22:05:07.352191] [DEBUG] [LOCAL ] AMRC: Loaded 38551 existing records from primary storage. [2025-10-22T22:05:07.363247] [INFO ] [MAIN ] AMRC: Loaded 38551 primary data records. [2025-10-22T22:05:08.148466] [DEBUG] [MAIN ] AMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:08.149878] [INFO ] [MAIN ] AMR: Generated 1794 derivative records from 28786 primary records. [2025-10-22T22:05:08.150252] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-22T22:05:08.168559] [DEBUG] [LOCAL ] AMR: Derivative data saved (1794 records). [2025-10-22T22:05:08.169625] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-22T22:05:08.171679] [INFO ] [MAIN ] Derivative Progress: 79/2052 symbols completed. AMR took 1.1s. Estimated remaining: 12m 59s. Rate: 152.0 symbols/min [2025-10-22T22:05:08.174167] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:08.202689] [DEBUG] [MAIN ] AMPY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:08.203816] [INFO ] [MAIN ] AMPY: Generated 1794 derivative records from 39376 primary records. [2025-10-22T22:05:08.204017] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-22T22:05:08.203053] [DEBUG] [MAIN ] AMRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:08.205662] [INFO ] [MAIN ] AMRC: Generated 1794 derivative records from 38551 primary records. [2025-10-22T22:05:08.205751] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-22T22:05:08.221358] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1794 records). [2025-10-22T22:05:08.221951] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-10-22T22:05:08.224018] [INFO ] [MAIN ] Derivative Progress: 80/2052 symbols completed. AMPY took 1.2s. Estimated remaining: 12m 50s. Rate: 153.7 symbols/min [2025-10-22T22:05:08.235848] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:08.241925] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1794 records). [2025-10-22T22:05:08.242253] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-22T22:05:08.244623] [INFO ] [MAIN ] Derivative Progress: 81/2052 symbols completed. AMRC took 1.2s. Estimated remaining: 12m 40s. Rate: 155.5 symbols/min [2025-10-22T22:05:08.244946] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:08.250882] [DEBUG] [LOCAL ] AMTD: Loaded 3812 existing records from primary storage. [2025-10-22T22:05:08.256169] [INFO ] [MAIN ] AMTD: Loaded 3812 primary data records. [2025-10-22T22:05:08.382542] [DEBUG] [LOCAL ] AMTB: Loaded 20336 existing records from primary storage. [2025-10-22T22:05:08.394831] [INFO ] [MAIN ] AMTB: Loaded 20336 primary data records. [2025-10-22T22:05:08.486512] [DEBUG] [LOCAL ] AMT: Loaded 52430 existing records from primary storage. [2025-10-22T22:05:08.549496] [INFO ] [MAIN ] AMT: Loaded 52430 primary data records. [2025-10-22T22:05:09.232577] [DEBUG] [MAIN ] AMTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:09.233683] [INFO ] [MAIN ] AMTD: Generated 1794 derivative records from 3812 primary records. [2025-10-22T22:05:09.233862] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-22T22:05:09.249933] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1794 records). [2025-10-22T22:05:09.251723] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-22T22:05:09.253668] [INFO ] [MAIN ] Derivative Progress: 82/2052 symbols completed. AMTD took 1.0s. Estimated remaining: 12m 55s. Rate: 152.5 symbols/min [2025-10-22T22:05:09.254019] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:09.268629] [DEBUG] [MAIN ] AMTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:09.270719] [INFO ] [MAIN ] AMTB: Generated 1794 derivative records from 20336 primary records. [2025-10-22T22:05:09.270911] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-22T22:05:09.299556] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1794 records). [2025-10-22T22:05:09.299800] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-22T22:05:09.301857] [INFO ] [MAIN ] Derivative Progress: 83/2052 symbols completed. AMTB took 1.1s. Estimated remaining: 12m 46s. Rate: 154.1 symbols/min [2025-10-22T22:05:09.302136] [DEBUG] [MAIN ] AMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:09.303065] [INFO ] [MAIN ] AMT: Generated 1794 derivative records from 52430 primary records. [2025-10-22T22:05:09.302299] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:09.303289] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-22T22:05:09.323064] [DEBUG] [LOCAL ] AMT: Derivative data saved (1794 records). [2025-10-22T22:05:09.323312] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-22T22:05:09.325773] [INFO ] [MAIN ] Derivative Progress: 84/2052 symbols completed. AMT took 1.2s. Estimated remaining: 12m 37s. Rate: 155.9 symbols/min [2025-10-22T22:05:09.325994] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:09.342082] [DEBUG] [LOCAL ] AMWL: Loaded 9814 existing records from primary storage. [2025-10-22T22:05:09.342247] [INFO ] [MAIN ] AMWL: Loaded 9814 primary data records. [2025-10-22T22:05:09.468175] [DEBUG] [LOCAL ] AMTM: Loaded 50253 existing records from primary storage. [2025-10-22T22:05:09.480343] [INFO ] [MAIN ] AMTM: Loaded 50253 primary data records. [2025-10-22T22:05:09.860891] [DEBUG] [LOCAL ] AMX: Loaded 49176 existing records from primary storage. [2025-10-22T22:05:09.911219] [INFO ] [MAIN ] AMX: Loaded 49176 primary data records. [2025-10-22T22:05:10.367187] [DEBUG] [MAIN ] AMWL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:10.368421] [INFO ] [MAIN ] AMWL: Generated 1794 derivative records from 9814 primary records. [2025-10-22T22:05:10.369393] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-22T22:05:10.386457] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1794 records). [2025-10-22T22:05:10.387060] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-22T22:05:10.390024] [INFO ] [MAIN ] Derivative Progress: 85/2052 symbols completed. AMWL took 1.1s. Estimated remaining: 12m 53s. Rate: 152.7 symbols/min [2025-10-22T22:05:10.397761] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:10.403263] [DEBUG] [MAIN ] AMTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:10.404323] [INFO ] [MAIN ] AMTM: Generated 1794 derivative records from 50253 primary records. [2025-10-22T22:05:10.404482] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-22T22:05:10.421591] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1794 records). [2025-10-22T22:05:10.421916] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-10-22T22:05:10.424714] [INFO ] [MAIN ] Derivative Progress: 86/2052 symbols completed. AMTM took 1.2s. Estimated remaining: 12m 44s. Rate: 154.4 symbols/min [2025-10-22T22:05:10.425201] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:10.441841] [DEBUG] [MAIN ] AMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:10.442687] [INFO ] [MAIN ] AMX: Generated 1794 derivative records from 49176 primary records. [2025-10-22T22:05:10.451087] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-10-22T22:05:10.467032] [DEBUG] [LOCAL ] AMX: Derivative data saved (1794 records). [2025-10-22T22:05:10.467274] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-10-22T22:05:10.469573] [INFO ] [MAIN ] Derivative Progress: 87/2052 symbols completed. AMX took 1.1s. Estimated remaining: 12m 36s. Rate: 155.9 symbols/min [2025-10-22T22:05:10.469754] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:10.481565] [DEBUG] [LOCAL ] AN: Loaded 31030 existing records from primary storage. [2025-10-22T22:05:10.481819] [INFO ] [MAIN ] AN: Loaded 31030 primary data records. [2025-10-22T22:05:10.846043] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-22T22:05:10.846310] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-10-22T22:05:10.867990] [DEBUG] [LOCAL ] ANF: Loaded 52040 existing records from primary storage. [2025-10-22T22:05:10.902623] [INFO ] [MAIN ] ANF: Loaded 52040 primary data records. [2025-10-22T22:05:11.475729] [DEBUG] [MAIN ] AN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:11.476781] [INFO ] [MAIN ] AN: Generated 1794 derivative records from 31030 primary records. [2025-10-22T22:05:11.477224] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-10-22T22:05:11.495481] [DEBUG] [LOCAL ] AN: Derivative data saved (1794 records). [2025-10-22T22:05:11.495902] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-10-22T22:05:11.499287] [INFO ] [MAIN ] Derivative Progress: 88/2052 symbols completed. AN took 1.1s. Estimated remaining: 12m 50s. Rate: 153.0 symbols/min [2025-10-22T22:05:11.515558] [DEBUG] [MAIN ] ANET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:11.517695] [INFO ] [MAIN ] ANET: Generated 1794 derivative records from 53766 primary records. [2025-10-22T22:05:11.517847] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-22T22:05:11.537811] [DEBUG] [MAIN ] ANF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:11.543306] [INFO ] [MAIN ] ANF: Generated 1794 derivative records from 52040 primary records. [2025-10-22T22:05:11.544747] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-22T22:05:11.546420] [DEBUG] [LOCAL ] ANET: Derivative data saved (1794 records). [2025-10-22T22:05:11.546686] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-22T22:05:11.555946] [INFO ] [MAIN ] Derivative Progress: 89/2052 symbols completed. ANET took 1.1s. Estimated remaining: 12m 42s. Rate: 154.5 symbols/min [2025-10-22T22:05:11.563429] [DEBUG] [LOCAL ] ANF: Derivative data saved (1794 records). [2025-10-22T22:05:11.563512] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-10-22T22:05:11.565924] [INFO ] [MAIN ] Derivative Progress: 90/2052 symbols completed. ANF took 1.1s. Estimated remaining: 12m 34s. Rate: 156.2 symbols/min [2025-10-22T22:05:11.566478] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:11.566424] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:11.566332] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:11.604677] [DEBUG] [LOCAL ] ANRO: Loaded 19715 existing records from primary storage. [2025-10-22T22:05:11.606144] [INFO ] [MAIN ] ANRO: Loaded 19715 primary data records. [2025-10-22T22:05:11.606058] [DEBUG] [LOCAL ] ANVS: Loaded 23982 existing records from primary storage. [2025-10-22T22:05:11.649617] [INFO ] [MAIN ] ANVS: Loaded 23982 primary data records. [2025-10-22T22:05:11.745863] [DEBUG] [LOCAL ] AOD: Loaded 30865 existing records from primary storage. [2025-10-22T22:05:11.782258] [INFO ] [MAIN ] AOD: Loaded 30865 primary data records. [2025-10-22T22:05:12.607774] [DEBUG] [MAIN ] ANRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:12.608961] [INFO ] [MAIN ] ANRO: Generated 1794 derivative records from 19715 primary records. [2025-10-22T22:05:12.609202] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-10-22T22:05:12.638199] [DEBUG] [MAIN ] ANVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:12.642449] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1794 records). [2025-10-22T22:05:12.641045] [INFO ] [MAIN ] ANVS: Generated 1794 derivative records from 23982 primary records. [2025-10-22T22:05:12.642757] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-22T22:05:12.642922] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-10-22T22:05:12.645291] [INFO ] [MAIN ] Derivative Progress: 91/2052 symbols completed. ANRO took 1.1s. Estimated remaining: 12m 48s. Rate: 153.2 symbols/min [2025-10-22T22:05:12.648587] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:12.666262] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1794 records). [2025-10-22T22:05:12.673946] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-10-22T22:05:12.681366] [INFO ] [MAIN ] Derivative Progress: 92/2052 symbols completed. ANVS took 1.1s. Estimated remaining: 12m 40s. Rate: 154.7 symbols/min [2025-10-22T22:05:12.681767] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:12.682717] [DEBUG] [MAIN ] AOD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:12.688567] [INFO ] [MAIN ] AOD: Generated 1794 derivative records from 30865 primary records. [2025-10-22T22:05:12.688866] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-10-22T22:05:12.708028] [DEBUG] [LOCAL ] AOMR: Loaded 16310 existing records from primary storage. [2025-10-22T22:05:12.712118] [DEBUG] [LOCAL ] AOD: Derivative data saved (1794 records). [2025-10-22T22:05:12.712276] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-10-22T22:05:12.715457] [INFO ] [MAIN ] Derivative Progress: 93/2052 symbols completed. AOD took 1.1s. Estimated remaining: 12m 32s. Rate: 156.2 symbols/min [2025-10-22T22:05:12.715603] [INFO ] [MAIN ] AOMR: Loaded 16310 primary data records. [2025-10-22T22:05:12.716118] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:13.038411] [DEBUG] [LOCAL ] AON: Loaded 45033 existing records from primary storage. [2025-10-22T22:05:13.038703] [INFO ] [MAIN ] AON: Loaded 45033 primary data records. [2025-10-22T22:05:13.113756] [DEBUG] [LOCAL ] AORT: Loaded 28916 existing records from primary storage. [2025-10-22T22:05:13.127125] [INFO ] [MAIN ] AORT: Loaded 28916 primary data records. [2025-10-22T22:05:13.746302] [DEBUG] [MAIN ] AOMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:13.747527] [INFO ] [MAIN ] AOMR: Generated 1794 derivative records from 16310 primary records. [2025-10-22T22:05:13.747965] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-10-22T22:05:13.770720] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1794 records). [2025-10-22T22:05:13.784360] [DEBUG] [MAIN ] AON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:13.784485] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-10-22T22:05:13.787046] [INFO ] [MAIN ] Derivative Progress: 94/2052 symbols completed. AOMR took 1.1s. Estimated remaining: 12m 46s. Rate: 153.3 symbols/min [2025-10-22T22:05:13.787270] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:13.789294] [INFO ] [MAIN ] AON: Generated 1794 derivative records from 45033 primary records. [2025-10-22T22:05:13.789708] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-22T22:05:13.810356] [DEBUG] [LOCAL ] AON: Derivative data saved (1794 records). [2025-10-22T22:05:13.810731] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-10-22T22:05:13.814153] [INFO ] [MAIN ] Derivative Progress: 95/2052 symbols completed. AON took 1.1s. Estimated remaining: 12m 38s. Rate: 154.8 symbols/min [2025-10-22T22:05:13.814670] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:13.833702] [DEBUG] [MAIN ] AORT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:13.834758] [INFO ] [MAIN ] AORT: Generated 1794 derivative records from 28916 primary records. [2025-10-22T22:05:13.835033] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-10-22T22:05:13.854223] [DEBUG] [LOCAL ] AORT: Derivative data saved (1794 records). [2025-10-22T22:05:13.854574] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-10-22T22:05:13.861022] [INFO ] [MAIN ] Derivative Progress: 96/2052 symbols completed. AORT took 1.1s. Estimated remaining: 12m 31s. Rate: 156.2 symbols/min [2025-10-22T22:05:13.861702] [DEBUG] [LOCAL ] AP: Loaded 7414 existing records from primary storage. [2025-10-22T22:05:13.862192] [INFO ] [MAIN ] AP: Loaded 7414 primary data records. [2025-10-22T22:05:13.861840] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:14.010320] [DEBUG] [LOCAL ] AOS: Loaded 48646 existing records from primary storage. [2025-10-22T22:05:14.021282] [INFO ] [MAIN ] AOS: Loaded 48646 primary data records. [2025-10-22T22:05:14.332381] [DEBUG] [LOCAL ] APD: Loaded 45416 existing records from primary storage. [2025-10-22T22:05:14.332973] [INFO ] [MAIN ] APD: Loaded 45416 primary data records. [2025-10-22T22:05:14.857824] [DEBUG] [MAIN ] AP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:14.859144] [INFO ] [MAIN ] AP: Generated 1794 derivative records from 7414 primary records. [2025-10-22T22:05:14.859862] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-10-22T22:05:14.876945] [DEBUG] [LOCAL ] AP: Derivative data saved (1794 records). [2025-10-22T22:05:14.878326] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-10-22T22:05:14.880636] [INFO ] [MAIN ] Derivative Progress: 97/2052 symbols completed. AP took 1.1s. Estimated remaining: 12m 44s. Rate: 153.6 symbols/min [2025-10-22T22:05:14.881160] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:14.899984] [DEBUG] [MAIN ] AOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:14.901104] [INFO ] [MAIN ] AOS: Generated 1794 derivative records from 48646 primary records. [2025-10-22T22:05:14.901276] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-10-22T22:05:14.933873] [DEBUG] [MAIN ] APD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:14.933637] [DEBUG] [LOCAL ] AOS: Derivative data saved (1794 records). [2025-10-22T22:05:14.934744] [INFO ] [MAIN ] APD: Generated 1794 derivative records from 45416 primary records. [2025-10-22T22:05:14.934899] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-22T22:05:14.934959] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-10-22T22:05:14.937537] [INFO ] [MAIN ] Derivative Progress: 98/2052 symbols completed. AOS took 1.2s. Estimated remaining: 12m 37s. Rate: 155.0 symbols/min [2025-10-22T22:05:14.937766] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:14.969468] [DEBUG] [LOCAL ] APD: Derivative data saved (1794 records). [2025-10-22T22:05:14.969722] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-10-22T22:05:14.972279] [INFO ] [MAIN ] Derivative Progress: 99/2052 symbols completed. APD took 1.1s. Estimated remaining: 12m 29s. Rate: 156.4 symbols/min [2025-10-22T22:05:14.972597] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:14.995374] [DEBUG] [LOCAL ] APG: Loaded 50617 existing records from primary storage. [2025-10-22T22:05:14.995787] [INFO ] [MAIN ] APG: Loaded 50617 primary data records. [2025-10-22T22:05:15.204292] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-22T22:05:15.228189] [INFO ] [MAIN ] APH: Loaded 53691 primary data records. [2025-10-22T22:05:15.406451] [DEBUG] [LOCAL ] APLE: Loaded 51958 existing records from primary storage. [2025-10-22T22:05:15.440541] [INFO ] [MAIN ] APLE: Loaded 51958 primary data records. [2025-10-22T22:05:16.083911] [DEBUG] [MAIN ] APG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:16.085432] [INFO ] [MAIN ] APG: Generated 1794 derivative records from 50617 primary records. [2025-10-22T22:05:16.085699] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-10-22T22:05:16.103152] [DEBUG] [LOCAL ] APG: Derivative data saved (1794 records). [2025-10-22T22:05:16.103534] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-10-22T22:05:16.106092] [INFO ] [MAIN ] Derivative Progress: 100/2052 symbols completed. APG took 1.2s. Estimated remaining: 12m 43s. Rate: 153.4 symbols/min [2025-10-22T22:05:16.106350] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:16.125806] [DEBUG] [MAIN ] APH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:16.129069] [INFO ] [MAIN ] APH: Generated 1794 derivative records from 53691 primary records. [2025-10-22T22:05:16.129767] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-10-22T22:05:16.159987] [DEBUG] [LOCAL ] APH: Derivative data saved (1794 records). [2025-10-22T22:05:16.160526] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-10-22T22:05:16.160431] [DEBUG] [MAIN ] APLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:16.163608] [INFO ] [MAIN ] Derivative Progress: 101/2052 symbols completed. APH took 1.2s. Estimated remaining: 12m 37s. Rate: 154.7 symbols/min [2025-10-22T22:05:16.161421] [INFO ] [MAIN ] APLE: Generated 1794 derivative records from 51958 primary records. [2025-10-22T22:05:16.163799] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-10-22T22:05:16.164008] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:16.197457] [DEBUG] [LOCAL ] APLE: Derivative data saved (1794 records). [2025-10-22T22:05:16.197718] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-10-22T22:05:16.200068] [INFO ] [MAIN ] Derivative Progress: 102/2052 symbols completed. APLE took 1.2s. Estimated remaining: 12m 29s. Rate: 156.1 symbols/min [2025-10-22T22:05:16.200404] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:16.204978] [DEBUG] [LOCAL ] APOS: Loaded 7058 existing records from primary storage. [2025-10-22T22:05:16.205166] [INFO ] [MAIN ] APOS: Loaded 7058 primary data records. [2025-10-22T22:05:16.338127] [DEBUG] [LOCAL ] APO: Loaded 53388 existing records from primary storage. [2025-10-22T22:05:16.338841] [INFO ] [MAIN ] APO: Loaded 53388 primary data records. [2025-10-22T22:05:16.743047] [DEBUG] [LOCAL ] APTV: Loaded 51849 existing records from primary storage. [2025-10-22T22:05:16.766343] [INFO ] [MAIN ] APTV: Loaded 51849 primary data records. [2025-10-22T22:05:17.214925] [DEBUG] [MAIN ] APOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:17.216435] [INFO ] [MAIN ] APOS: Generated 1794 derivative records from 7058 primary records. [2025-10-22T22:05:17.217672] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-10-22T22:05:17.239867] [DEBUG] [LOCAL ] APOS: Derivative data saved (1794 records). [2025-10-22T22:05:17.240284] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-10-22T22:05:17.242700] [INFO ] [MAIN ] Derivative Progress: 103/2052 symbols completed. APOS took 1.1s. Estimated remaining: 12m 42s. Rate: 153.6 symbols/min [2025-10-22T22:05:17.257507] [DEBUG] [MAIN ] APO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:17.258749] [INFO ] [MAIN ] APO: Generated 1794 derivative records from 53388 primary records. [2025-10-22T22:05:17.258881] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-10-22T22:05:17.275165] [DEBUG] [LOCAL ] APO: Derivative data saved (1794 records). [2025-10-22T22:05:17.275419] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-10-22T22:05:17.277758] [INFO ] [MAIN ] Derivative Progress: 104/2052 symbols completed. APO took 1.2s. Estimated remaining: 12m 35s. Rate: 154.9 symbols/min [2025-10-22T22:05:17.293668] [DEBUG] [MAIN ] APTV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:17.294487] [INFO ] [MAIN ] APTV: Generated 1794 derivative records from 51849 primary records. [2025-10-22T22:05:17.294553] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-10-22T22:05:17.310280] [DEBUG] [LOCAL ] APTV: Derivative data saved (1794 records). [2025-10-22T22:05:17.310401] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-10-22T22:05:17.313834] [INFO ] [MAIN ] Derivative Progress: 105/2052 symbols completed. APTV took 1.1s. Estimated remaining: 12m 28s. Rate: 156.3 symbols/min [2025-10-22T22:05:17.314387] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:17.314470] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:17.314576] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:17.323420] [DEBUG] [LOCAL ] AQNB: Loaded 3886 existing records from primary storage. [2025-10-22T22:05:17.323786] [INFO ] [MAIN ] AQNB: Loaded 3886 primary data records. [2025-10-22T22:05:17.477927] [DEBUG] [LOCAL ] ARDT: Loaded 27391 existing records from primary storage. [2025-10-22T22:05:17.488805] [INFO ] [MAIN ] ARDT: Loaded 27391 primary data records. [2025-10-22T22:05:17.656316] [DEBUG] [LOCAL ] ARE: Loaded 50927 existing records from primary storage. [2025-10-22T22:05:17.814508] [INFO ] [MAIN ] ARE: Loaded 50927 primary data records. [2025-10-22T22:05:18.391912] [DEBUG] [MAIN ] AQNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:18.393131] [INFO ] [MAIN ] AQNB: Generated 1794 derivative records from 3886 primary records. [2025-10-22T22:05:18.394080] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-22T22:05:18.422910] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1794 records). [2025-10-22T22:05:18.423275] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-22T22:05:18.425296] [INFO ] [MAIN ] Derivative Progress: 106/2052 symbols completed. AQNB took 1.1s. Estimated remaining: 12m 41s. Rate: 153.5 symbols/min [2025-10-22T22:05:18.425694] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:18.426126] [DEBUG] [MAIN ] ARDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:18.427743] [INFO ] [MAIN ] ARDT: Generated 1794 derivative records from 27391 primary records. [2025-10-22T22:05:18.427931] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-22T22:05:18.446675] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1794 records). [2025-10-22T22:05:18.446870] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-22T22:05:18.449412] [INFO ] [MAIN ] Derivative Progress: 107/2052 symbols completed. ARDT took 1.1s. Estimated remaining: 12m 34s. Rate: 154.9 symbols/min [2025-10-22T22:05:18.462132] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:18.463390] [DEBUG] [MAIN ] ARE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:18.464141] [INFO ] [MAIN ] ARE: Generated 1794 derivative records from 50927 primary records. [2025-10-22T22:05:18.464207] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-10-22T22:05:18.480123] [DEBUG] [LOCAL ] ARE: Derivative data saved (1794 records). [2025-10-22T22:05:18.480331] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-10-22T22:05:18.483289] [INFO ] [MAIN ] Derivative Progress: 108/2052 symbols completed. ARE took 1.2s. Estimated remaining: 12m 27s. Rate: 156.2 symbols/min [2025-10-22T22:05:18.483488] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:18.529426] [DEBUG] [LOCAL ] ARES: Loaded 49676 existing records from primary storage. [2025-10-22T22:05:18.552086] [INFO ] [MAIN ] ARES: Loaded 49676 primary data records. [2025-10-22T22:05:18.624100] [DEBUG] [LOCAL ] ARLO: Loaded 43510 existing records from primary storage. [2025-10-22T22:05:18.624442] [INFO ] [MAIN ] ARLO: Loaded 43510 primary data records. [2025-10-22T22:05:18.794494] [DEBUG] [LOCAL ] ARMK: Loaded 50369 existing records from primary storage. [2025-10-22T22:05:18.853065] [INFO ] [MAIN ] ARMK: Loaded 50369 primary data records. [2025-10-22T22:05:19.513529] [DEBUG] [MAIN ] ARES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:19.514511] [INFO ] [MAIN ] ARES: Generated 1794 derivative records from 49676 primary records. [2025-10-22T22:05:19.517085] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-10-22T22:05:19.547270] [DEBUG] [LOCAL ] ARES: Derivative data saved (1794 records). [2025-10-22T22:05:19.547857] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-10-22T22:05:19.549806] [INFO ] [MAIN ] Derivative Progress: 109/2052 symbols completed. ARES took 1.1s. Estimated remaining: 12m 39s. Rate: 153.7 symbols/min [2025-10-22T22:05:19.547595] [DEBUG] [MAIN ] ARLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:19.550029] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:19.550901] [INFO ] [MAIN ] ARLO: Generated 1794 derivative records from 43510 primary records. [2025-10-22T22:05:19.551006] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-10-22T22:05:19.583071] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1794 records). [2025-10-22T22:05:19.583611] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-10-22T22:05:19.583416] [DEBUG] [MAIN ] ARMK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:19.587081] [INFO ] [MAIN ] ARMK: Generated 1794 derivative records from 50369 primary records. [2025-10-22T22:05:19.586212] [INFO ] [MAIN ] Derivative Progress: 110/2052 symbols completed. ARLO took 1.1s. Estimated remaining: 12m 32s. Rate: 155.0 symbols/min [2025-10-22T22:05:19.587434] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:19.587325] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-22T22:05:19.604497] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1794 records). [2025-10-22T22:05:19.604998] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-10-22T22:05:19.607337] [INFO ] [MAIN ] Derivative Progress: 111/2052 symbols completed. ARMK took 1.1s. Estimated remaining: 12m 25s. Rate: 156.3 symbols/min [2025-10-22T22:05:19.607597] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:19.662422] [DEBUG] [LOCAL ] ARW: Loaded 33141 existing records from primary storage. [2025-10-22T22:05:19.661852] [DEBUG] [LOCAL ] ARR: Loaded 52091 existing records from primary storage. [2025-10-22T22:05:19.662543] [INFO ] [MAIN ] ARR: Loaded 52091 primary data records. [2025-10-22T22:05:19.662736] [INFO ] [MAIN ] ARW: Loaded 33141 primary data records. [2025-10-22T22:05:19.922075] [DEBUG] [LOCAL ] AS: Loaded 53198 existing records from primary storage. [2025-10-22T22:05:19.959361] [INFO ] [MAIN ] AS: Loaded 53198 primary data records. [2025-10-22T22:05:20.674320] [DEBUG] [MAIN ] ARW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:20.674150] [DEBUG] [MAIN ] ARR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:20.675215] [INFO ] [MAIN ] ARR: Generated 1794 derivative records from 52091 primary records. [2025-10-22T22:05:20.677269] [INFO ] [MAIN ] ARW: Generated 1794 derivative records from 33141 primary records. [2025-10-22T22:05:20.677351] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-10-22T22:05:20.678920] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-22T22:05:20.719953] [DEBUG] [LOCAL ] ARW: Derivative data saved (1794 records). [2025-10-22T22:05:20.720137] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-10-22T22:05:20.721260] [DEBUG] [LOCAL ] ARR: Derivative data saved (1794 records). [2025-10-22T22:05:20.723989] [INFO ] [MAIN ] Derivative Progress: 112/2052 symbols completed. ARW took 1.1s. Estimated remaining: 12m 37s. Rate: 153.7 symbols/min [2025-10-22T22:05:20.721528] [DEBUG] [MAIN ] AS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:20.724108] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-10-22T22:05:20.724264] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:20.725133] [INFO ] [MAIN ] AS: Generated 1794 derivative records from 53198 primary records. [2025-10-22T22:05:20.727440] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-22T22:05:20.727257] [INFO ] [MAIN ] Derivative Progress: 113/2052 symbols completed. ARR took 1.2s. Estimated remaining: 12m 30s. Rate: 155.0 symbols/min [2025-10-22T22:05:20.728292] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:20.744712] [DEBUG] [LOCAL ] AS: Derivative data saved (1794 records). [2025-10-22T22:05:20.745075] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-22T22:05:20.748465] [INFO ] [MAIN ] Derivative Progress: 114/2052 symbols completed. AS took 1.1s. Estimated remaining: 12m 24s. Rate: 156.3 symbols/min [2025-10-22T22:05:20.752420] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:20.760672] [DEBUG] [LOCAL ] ASA: Loaded 15680 existing records from primary storage. [2025-10-22T22:05:20.760903] [INFO ] [MAIN ] ASA: Loaded 15680 primary data records. [2025-10-22T22:05:21.092180] [DEBUG] [LOCAL ] ASAN: Loaded 52732 existing records from primary storage. [2025-10-22T22:05:21.105522] [INFO ] [MAIN ] ASAN: Loaded 52732 primary data records. [2025-10-22T22:05:21.106221] [DEBUG] [LOCAL ] ASB: Loaded 49696 existing records from primary storage. [2025-10-22T22:05:21.107021] [INFO ] [MAIN ] ASB: Loaded 49696 primary data records. [2025-10-22T22:05:21.787291] [DEBUG] [MAIN ] ASA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:21.789081] [INFO ] [MAIN ] ASA: Generated 1794 derivative records from 15680 primary records. [2025-10-22T22:05:21.791283] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-22T22:05:21.809583] [DEBUG] [LOCAL ] ASA: Derivative data saved (1794 records). [2025-10-22T22:05:21.809764] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-10-22T22:05:21.812573] [INFO ] [MAIN ] Derivative Progress: 115/2052 symbols completed. ASA took 1.1s. Estimated remaining: 12m 35s. Rate: 154.0 symbols/min [2025-10-22T22:05:21.813096] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:21.824099] [DEBUG] [LOCAL ] ASBA: Loaded 3475 existing records from primary storage. [2025-10-22T22:05:21.832014] [INFO ] [MAIN ] ASBA: Loaded 3475 primary data records. [2025-10-22T22:05:21.870714] [DEBUG] [MAIN ] ASAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:21.881819] [DEBUG] [MAIN ] ASB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:21.923991] [INFO ] [MAIN ] ASB: Generated 1794 derivative records from 49696 primary records. [2025-10-22T22:05:21.930419] [INFO ] [MAIN ] ASAN: Generated 1794 derivative records from 52732 primary records. [2025-10-22T22:05:21.955241] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-22T22:05:21.958571] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-22T22:05:22.174278] [DEBUG] [LOCAL ] ASB: Derivative data saved (1794 records). [2025-10-22T22:05:22.187681] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-10-22T22:05:22.181628] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1794 records). [2025-10-22T22:05:22.198618] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-10-22T22:05:22.201616] [INFO ] [MAIN ] Derivative Progress: 116/2052 symbols completed. ASB took 1.4s. Estimated remaining: 12m 34s. Rate: 154.0 symbols/min [2025-10-22T22:05:22.204002] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:22.204074] [INFO ] [MAIN ] Derivative Progress: 117/2052 symbols completed. ASAN took 1.5s. Estimated remaining: 12m 28s. Rate: 155.3 symbols/min [2025-10-22T22:05:22.204681] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:22.276138] [DEBUG] [MAIN ] ASBA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:22.276977] [INFO ] [MAIN ] ASBA: Generated 1794 derivative records from 3475 primary records. [2025-10-22T22:05:22.278211] [DEBUG] [LOCAL ] ASGN: Loaded 36689 existing records from primary storage. [2025-10-22T22:05:22.277571] [DEBUG] [LOCAL ] ASC: Loaded 37184 existing records from primary storage. [2025-10-22T22:05:22.278424] [INFO ] [MAIN ] ASC: Loaded 37184 primary data records. [2025-10-22T22:05:22.278594] [INFO ] [MAIN ] ASGN: Loaded 36689 primary data records. [2025-10-22T22:05:22.278483] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-22T22:05:22.371081] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1794 records). [2025-10-22T22:05:22.422449] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-22T22:05:22.453423] [INFO ] [MAIN ] Derivative Progress: 118/2052 symbols completed. ASBA took 0.6s. Estimated remaining: 12m 25s. Rate: 155.7 symbols/min [2025-10-22T22:05:22.937270] [DEBUG] [MAIN ] ASC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:22.938317] [INFO ] [MAIN ] ASC: Generated 1794 derivative records from 37184 primary records. [2025-10-22T22:05:22.938542] [DEBUG] [MAIN ] ASGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:22.939168] [INFO ] [MAIN ] ASGN: Generated 1794 derivative records from 36689 primary records. [2025-10-22T22:05:22.939214] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-22T22:05:22.940064] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-22T22:05:22.968196] [DEBUG] [LOCAL ] ASC: Derivative data saved (1794 records). [2025-10-22T22:05:22.970721] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-10-22T22:05:22.972623] [INFO ] [MAIN ] Derivative Progress: 119/2052 symbols completed. ASC took 0.8s. Estimated remaining: 12m 27s. Rate: 155.3 symbols/min [2025-10-22T22:05:22.972754] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1794 records). [2025-10-22T22:05:22.972944] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-22T22:05:22.975714] [INFO ] [MAIN ] Derivative Progress: 120/2052 symbols completed. ASGN took 0.8s. Estimated remaining: 12m 20s. Rate: 156.6 symbols/min [2025-10-22T22:05:22.976088] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:22.976387] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:22.976034] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:23.020432] [DEBUG] [LOCAL ] ASIX: Loaded 22992 existing records from primary storage. [2025-10-22T22:05:23.020690] [INFO ] [MAIN ] ASIX: Loaded 22992 primary data records. [2025-10-22T22:05:23.101046] [DEBUG] [LOCAL ] ASH: Loaded 37383 existing records from primary storage. [2025-10-22T22:05:23.113780] [INFO ] [MAIN ] ASH: Loaded 37383 primary data records. [2025-10-22T22:05:23.235128] [DEBUG] [LOCAL ] ASPN: Loaded 49875 existing records from primary storage. [2025-10-22T22:05:23.246151] [INFO ] [MAIN ] ASPN: Loaded 49875 primary data records. [2025-10-22T22:05:24.030989] [DEBUG] [MAIN ] ASIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:24.046455] [INFO ] [MAIN ] ASIX: Generated 1794 derivative records from 22992 primary records. [2025-10-22T22:05:24.058358] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-22T22:05:24.045619] [DEBUG] [MAIN ] ASH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:24.059836] [INFO ] [MAIN ] ASH: Generated 1794 derivative records from 37383 primary records. [2025-10-22T22:05:24.060251] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-22T22:05:24.060184] [DEBUG] [MAIN ] ASPN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:24.061116] [INFO ] [MAIN ] ASPN: Generated 1794 derivative records from 49875 primary records. [2025-10-22T22:05:24.072257] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-22T22:05:24.084489] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1794 records). [2025-10-22T22:05:24.105578] [DEBUG] [LOCAL ] ASH: Derivative data saved (1794 records). [2025-10-22T22:05:24.106665] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1794 records). [2025-10-22T22:05:24.105682] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-10-22T22:05:24.106836] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-22T22:05:24.106934] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-22T22:05:24.109358] [INFO ] [MAIN ] Derivative Progress: 121/2052 symbols completed. ASH took 1.1s. Estimated remaining: 12m 32s. Rate: 154.1 symbols/min [2025-10-22T22:05:24.109505] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:24.111483] [INFO ] [MAIN ] Derivative Progress: 122/2052 symbols completed. ASIX took 1.1s. Estimated remaining: 12m 25s. Rate: 155.4 symbols/min [2025-10-22T22:05:24.114187] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:24.114397] [INFO ] [MAIN ] Derivative Progress: 123/2052 symbols completed. ASPN took 1.1s. Estimated remaining: 12m 19s. Rate: 156.6 symbols/min [2025-10-22T22:05:24.114883] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:24.166500] [DEBUG] [LOCAL ] ATGE: Loaded 30426 existing records from primary storage. [2025-10-22T22:05:24.166700] [INFO ] [MAIN ] ATGE: Loaded 30426 primary data records. [2025-10-22T22:05:24.209837] [DEBUG] [LOCAL ] ATEN: Loaded 37731 existing records from primary storage. [2025-10-22T22:05:24.255752] [INFO ] [MAIN ] ATEN: Loaded 37731 primary data records. [2025-10-22T22:05:24.304604] [DEBUG] [LOCAL ] ASX: Loaded 52880 existing records from primary storage. [2025-10-22T22:05:24.329491] [INFO ] [MAIN ] ASX: Loaded 52880 primary data records. [2025-10-22T22:05:25.154920] [DEBUG] [MAIN ] ATGE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:05:25.156766] [INFO ] [MAIN ] ATGE: Generated 1793 derivative records from 30426 primary records. [2025-10-22T22:05:25.157148] [DEBUG] [MAIN ] ATEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:25.157231] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-22T22:05:25.157931] [INFO ] [MAIN ] ATEN: Generated 1794 derivative records from 37731 primary records. [2025-10-22T22:05:25.158969] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-22T22:05:25.179620] [DEBUG] [MAIN ] ASX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:25.201965] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1794 records). [2025-10-22T22:05:25.202063] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-22T22:05:25.204535] [INFO ] [MAIN ] Derivative Progress: 124/2052 symbols completed. ATEN took 1.1s. Estimated remaining: 12m 30s. Rate: 154.3 symbols/min [2025-10-22T22:05:25.205027] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:25.205920] [INFO ] [MAIN ] ASX: Generated 1794 derivative records from 52880 primary records. [2025-10-22T22:05:25.206148] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-22T22:05:25.208166] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1793 records). [2025-10-22T22:05:25.208814] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-22T22:05:25.211029] [INFO ] [MAIN ] Derivative Progress: 125/2052 symbols completed. ATGE took 1.1s. Estimated remaining: 12m 23s. Rate: 155.6 symbols/min [2025-10-22T22:05:25.211817] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:25.227794] [DEBUG] [LOCAL ] ASX: Derivative data saved (1794 records). [2025-10-22T22:05:25.228035] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-10-22T22:05:25.230374] [INFO ] [MAIN ] Derivative Progress: 126/2052 symbols completed. ASX took 1.1s. Estimated remaining: 12m 17s. Rate: 156.7 symbols/min [2025-10-22T22:05:25.230603] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:25.237965] [DEBUG] [LOCAL ] ATHS: Loaded 6496 existing records from primary storage. [2025-10-22T22:05:25.238196] [INFO ] [MAIN ] ATHS: Loaded 6496 primary data records. [2025-10-22T22:05:25.373124] [DEBUG] [LOCAL ] ATHM: Loaded 31208 existing records from primary storage. [2025-10-22T22:05:25.384927] [INFO ] [MAIN ] ATHM: Loaded 31208 primary data records. [2025-10-22T22:05:25.754391] [DEBUG] [LOCAL ] ATI: Loaded 51283 existing records from primary storage. [2025-10-22T22:05:25.779204] [INFO ] [MAIN ] ATI: Loaded 51283 primary data records. [2025-10-22T22:05:26.265138] [DEBUG] [MAIN ] ATHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:26.266936] [INFO ] [MAIN ] ATHS: Generated 1794 derivative records from 6496 primary records. [2025-10-22T22:05:26.267153] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-22T22:05:26.308302] [DEBUG] [MAIN ] ATHM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:26.310125] [INFO ] [MAIN ] ATHM: Generated 1794 derivative records from 31208 primary records. [2025-10-22T22:05:26.311001] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-10-22T22:05:26.332931] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1794 records). [2025-10-22T22:05:26.333793] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-10-22T22:05:26.336362] [INFO ] [MAIN ] Derivative Progress: 127/2052 symbols completed. ATHM took 1.1s. Estimated remaining: 12m 28s. Rate: 154.4 symbols/min [2025-10-22T22:05:26.333597] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1794 records). [2025-10-22T22:05:26.348947] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:26.350162] [DEBUG] [MAIN ] ATI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:26.349038] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-22T22:05:26.353855] [INFO ] [MAIN ] Derivative Progress: 128/2052 symbols completed. ATHS took 1.1s. Estimated remaining: 12m 22s. Rate: 155.6 symbols/min [2025-10-22T22:05:26.351013] [INFO ] [MAIN ] ATI: Generated 1794 derivative records from 51283 primary records. [2025-10-22T22:05:26.354079] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-10-22T22:05:26.354260] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:26.371365] [DEBUG] [LOCAL ] ATI: Derivative data saved (1794 records). [2025-10-22T22:05:26.371607] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-10-22T22:05:26.374103] [INFO ] [MAIN ] Derivative Progress: 129/2052 symbols completed. ATI took 1.1s. Estimated remaining: 12m 16s. Rate: 156.7 symbols/min [2025-10-22T22:05:26.374424] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:26.399072] [DEBUG] [LOCAL ] ATKR: Loaded 34853 existing records from primary storage. [2025-10-22T22:05:26.399211] [INFO ] [MAIN ] ATKR: Loaded 34853 primary data records. [2025-10-22T22:05:26.582689] [DEBUG] [LOCAL ] ATMU: Loaded 38718 existing records from primary storage. [2025-10-22T22:05:26.614844] [INFO ] [MAIN ] ATMU: Loaded 38718 primary data records. [2025-10-22T22:05:26.855149] [DEBUG] [LOCAL ] ATO: Loaded 41529 existing records from primary storage. [2025-10-22T22:05:26.866249] [INFO ] [MAIN ] ATO: Loaded 41529 primary data records. [2025-10-22T22:05:27.369869] [DEBUG] [MAIN ] ATKR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:05:27.370910] [INFO ] [MAIN ] ATKR: Generated 1793 derivative records from 34853 primary records. [2025-10-22T22:05:27.371007] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-22T22:05:27.389349] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1793 records). [2025-10-22T22:05:27.390052] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-10-22T22:05:27.392511] [INFO ] [MAIN ] Derivative Progress: 130/2052 symbols completed. ATKR took 1.0s. Estimated remaining: 12m 25s. Rate: 154.8 symbols/min [2025-10-22T22:05:27.393454] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:27.411028] [DEBUG] [MAIN ] ATMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:27.411773] [INFO ] [MAIN ] ATMU: Generated 1794 derivative records from 38718 primary records. [2025-10-22T22:05:27.411923] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-10-22T22:05:27.428401] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1794 records). [2025-10-22T22:05:27.429509] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-10-22T22:05:27.432419] [INFO ] [MAIN ] Derivative Progress: 131/2052 symbols completed. ATMU took 1.1s. Estimated remaining: 12m 20s. Rate: 155.8 symbols/min [2025-10-22T22:05:27.440933] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:27.454504] [DEBUG] [MAIN ] ATO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:27.455190] [INFO ] [MAIN ] ATO: Generated 1794 derivative records from 41529 primary records. [2025-10-22T22:05:27.455331] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-10-22T22:05:27.483964] [DEBUG] [LOCAL ] ATR: Loaded 30392 existing records from primary storage. [2025-10-22T22:05:27.484595] [DEBUG] [LOCAL ] ATO: Derivative data saved (1794 records). [2025-10-22T22:05:27.484843] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-10-22T22:05:27.484735] [INFO ] [MAIN ] ATR: Loaded 30392 primary data records. [2025-10-22T22:05:27.487130] [INFO ] [MAIN ] Derivative Progress: 132/2052 symbols completed. ATO took 1.1s. Estimated remaining: 12m 14s. Rate: 156.9 symbols/min [2025-10-22T22:05:27.493108] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:27.504790] [DEBUG] [LOCAL ] ATS: Loaded 17012 existing records from primary storage. [2025-10-22T22:05:27.524763] [INFO ] [MAIN ] ATS: Loaded 17012 primary data records. [2025-10-22T22:05:28.158385] [DEBUG] [LOCAL ] ATUS: Loaded 49957 existing records from primary storage. [2025-10-22T22:05:28.167413] [INFO ] [MAIN ] ATUS: Loaded 49957 primary data records. [2025-10-22T22:05:28.486767] [DEBUG] [MAIN ] ATR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:28.489771] [INFO ] [MAIN ] ATR: Generated 1794 derivative records from 30392 primary records. [2025-10-22T22:05:28.490059] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-10-22T22:05:28.512679] [DEBUG] [MAIN ] ATS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:28.515993] [INFO ] [MAIN ] ATS: Generated 1794 derivative records from 17012 primary records. [2025-10-22T22:05:28.519709] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-10-22T22:05:28.522182] [DEBUG] [LOCAL ] ATR: Derivative data saved (1794 records). [2025-10-22T22:05:28.522451] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-10-22T22:05:28.524696] [INFO ] [MAIN ] Derivative Progress: 133/2052 symbols completed. ATR took 1.1s. Estimated remaining: 12m 23s. Rate: 154.9 symbols/min [2025-10-22T22:05:28.539922] [DEBUG] [LOCAL ] ATS: Derivative data saved (1794 records). [2025-10-22T22:05:28.540095] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-10-22T22:05:28.542578] [INFO ] [MAIN ] Derivative Progress: 134/2052 symbols completed. ATS took 1.1s. Estimated remaining: 12m 18s. Rate: 156.0 symbols/min [2025-10-22T22:05:28.557719] [DEBUG] [MAIN ] ATUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:28.558272] [INFO ] [MAIN ] ATUS: Generated 1794 derivative records from 49957 primary records. [2025-10-22T22:05:28.558331] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-22T22:05:28.572996] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1794 records). [2025-10-22T22:05:28.573053] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-22T22:05:28.575441] [INFO ] [MAIN ] Derivative Progress: 135/2052 symbols completed. ATUS took 1.1s. Estimated remaining: 12m 12s. Rate: 157.0 symbols/min [2025-10-22T22:05:28.575814] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:28.576003] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:28.575923] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:28.583325] [DEBUG] [LOCAL ] AUNA: Loaded 5250 existing records from primary storage. [2025-10-22T22:05:28.583541] [INFO ] [MAIN ] AUNA: Loaded 5250 primary data records. [2025-10-22T22:05:28.925968] [DEBUG] [LOCAL ] AU: Loaded 53089 existing records from primary storage. [2025-10-22T22:05:28.925215] [DEBUG] [LOCAL ] AUB: Loaded 45843 existing records from primary storage. [2025-10-22T22:05:28.927436] [INFO ] [MAIN ] AUB: Loaded 45843 primary data records. [2025-10-22T22:05:28.927373] [INFO ] [MAIN ] AU: Loaded 53089 primary data records. [2025-10-22T22:05:29.621866] [DEBUG] [MAIN ] AUNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:29.623564] [INFO ] [MAIN ] AUNA: Generated 1794 derivative records from 5250 primary records. [2025-10-22T22:05:29.623842] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-22T22:05:29.641375] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1794 records). [2025-10-22T22:05:29.641539] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-10-22T22:05:29.644133] [INFO ] [MAIN ] Derivative Progress: 136/2052 symbols completed. AUNA took 1.1s. Estimated remaining: 12m 22s. Rate: 155.0 symbols/min [2025-10-22T22:05:29.644755] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:29.668356] [DEBUG] [MAIN ] AU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:29.677045] [INFO ] [MAIN ] AU: Generated 1794 derivative records from 53089 primary records. [2025-10-22T22:05:29.682034] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-10-22T22:05:29.682278] [DEBUG] [MAIN ] AUB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:29.683391] [INFO ] [MAIN ] AUB: Generated 1794 derivative records from 45843 primary records. [2025-10-22T22:05:29.683725] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-22T22:05:29.722985] [DEBUG] [LOCAL ] AUB: Derivative data saved (1794 records). [2025-10-22T22:05:29.722907] [DEBUG] [LOCAL ] AU: Derivative data saved (1794 records). [2025-10-22T22:05:29.723177] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-22T22:05:29.725358] [INFO ] [MAIN ] Derivative Progress: 137/2052 symbols completed. AUB took 1.1s. Estimated remaining: 12m 17s. Rate: 155.9 symbols/min [2025-10-22T22:05:29.723338] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-10-22T22:05:29.741339] [INFO ] [MAIN ] Derivative Progress: 138/2052 symbols completed. AU took 1.2s. Estimated remaining: 12m 12s. Rate: 157.0 symbols/min [2025-10-22T22:05:29.741279] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:29.741600] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:29.744981] [DEBUG] [LOCAL ] AVA: Loaded 38305 existing records from primary storage. [2025-10-22T22:05:29.745300] [INFO ] [MAIN ] AVA: Loaded 38305 primary data records. [2025-10-22T22:05:29.839433] [DEBUG] [LOCAL ] AVAL: Loaded 8482 existing records from primary storage. [2025-10-22T22:05:29.853527] [INFO ] [MAIN ] AVAL: Loaded 8482 primary data records. [2025-10-22T22:05:30.360144] [DEBUG] [LOCAL ] AVB: Loaded 42169 existing records from primary storage. [2025-10-22T22:05:30.360881] [INFO ] [MAIN ] AVB: Loaded 42169 primary data records. [2025-10-22T22:05:30.687383] [DEBUG] [MAIN ] AVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:30.700103] [INFO ] [MAIN ] AVA: Generated 1794 derivative records from 38305 primary records. [2025-10-22T22:05:30.700204] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-22T22:05:30.701098] [DEBUG] [MAIN ] AVAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:30.701984] [INFO ] [MAIN ] AVAL: Generated 1794 derivative records from 8482 primary records. [2025-10-22T22:05:30.702969] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-10-22T22:05:30.724726] [DEBUG] [LOCAL ] AVA: Derivative data saved (1794 records). [2025-10-22T22:05:30.728620] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-22T22:05:30.730751] [INFO ] [MAIN ] Derivative Progress: 139/2052 symbols completed. AVA took 1.1s. Estimated remaining: 12m 20s. Rate: 155.2 symbols/min [2025-10-22T22:05:30.734804] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1794 records). [2025-10-22T22:05:30.732910] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:30.734932] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-10-22T22:05:30.737828] [INFO ] [MAIN ] Derivative Progress: 140/2052 symbols completed. AVAL took 1.0s. Estimated remaining: 12m 14s. Rate: 156.3 symbols/min [2025-10-22T22:05:30.738154] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:30.760520] [DEBUG] [MAIN ] AVB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:30.761331] [INFO ] [MAIN ] AVB: Generated 1794 derivative records from 42169 primary records. [2025-10-22T22:05:30.765409] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-22T22:05:30.781530] [DEBUG] [LOCAL ] AVD: Loaded 21323 existing records from primary storage. [2025-10-22T22:05:30.793779] [DEBUG] [LOCAL ] AVB: Derivative data saved (1794 records). [2025-10-22T22:05:30.787574] [INFO ] [MAIN ] AVD: Loaded 21323 primary data records. [2025-10-22T22:05:30.793880] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-10-22T22:05:30.796908] [INFO ] [MAIN ] Derivative Progress: 141/2052 symbols completed. AVB took 1.1s. Estimated remaining: 12m 9s. Rate: 157.2 symbols/min [2025-10-22T22:05:30.808046] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:30.817677] [DEBUG] [LOCAL ] AVK: Loaded 18618 existing records from primary storage. [2025-10-22T22:05:30.852502] [INFO ] [MAIN ] AVK: Loaded 18618 primary data records. [2025-10-22T22:05:31.242600] [DEBUG] [LOCAL ] AVNS: Loaded 33534 existing records from primary storage. [2025-10-22T22:05:31.300204] [INFO ] [MAIN ] AVNS: Loaded 33534 primary data records. [2025-10-22T22:05:31.796054] [DEBUG] [MAIN ] AVD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:31.797554] [INFO ] [MAIN ] AVD: Generated 1794 derivative records from 21323 primary records. [2025-10-22T22:05:31.797674] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-22T22:05:31.826673] [DEBUG] [LOCAL ] AVD: Derivative data saved (1794 records). [2025-10-22T22:05:31.827136] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-22T22:05:31.829362] [INFO ] [MAIN ] Derivative Progress: 142/2052 symbols completed. AVD took 1.1s. Estimated remaining: 12m 18s. Rate: 155.4 symbols/min [2025-10-22T22:05:31.829869] [DEBUG] [MAIN ] AVK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:31.830018] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:31.831085] [INFO ] [MAIN ] AVK: Generated 1794 derivative records from 18618 primary records. [2025-10-22T22:05:31.831767] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-22T22:05:31.849666] [DEBUG] [LOCAL ] AVK: Derivative data saved (1794 records). [2025-10-22T22:05:31.851397] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-22T22:05:31.853941] [INFO ] [MAIN ] Derivative Progress: 143/2052 symbols completed. AVK took 1.1s. Estimated remaining: 12m 12s. Rate: 156.4 symbols/min [2025-10-22T22:05:31.854156] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:31.868179] [DEBUG] [MAIN ] AVNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:31.868880] [INFO ] [MAIN ] AVNS: Generated 1794 derivative records from 33534 primary records. [2025-10-22T22:05:31.869026] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-22T22:05:31.894093] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1794 records). [2025-10-22T22:05:31.894336] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-22T22:05:31.897045] [INFO ] [MAIN ] Derivative Progress: 144/2052 symbols completed. AVNS took 1.1s. Estimated remaining: 12m 7s. Rate: 157.4 symbols/min [2025-10-22T22:05:31.897372] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:31.913836] [DEBUG] [LOCAL ] AVNT: Loaded 38618 existing records from primary storage. [2025-10-22T22:05:31.913972] [INFO ] [MAIN ] AVNT: Loaded 38618 primary data records. [2025-10-22T22:05:32.097800] [DEBUG] [LOCAL ] AVTR: Loaded 53571 existing records from primary storage. [2025-10-22T22:05:32.140538] [INFO ] [MAIN ] AVTR: Loaded 53571 primary data records. [2025-10-22T22:05:32.316957] [DEBUG] [LOCAL ] AVY: Loaded 38119 existing records from primary storage. [2025-10-22T22:05:32.341925] [INFO ] [MAIN ] AVY: Loaded 38119 primary data records. [2025-10-22T22:05:32.902112] [DEBUG] [MAIN ] AVNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:32.903199] [INFO ] [MAIN ] AVNT: Generated 1794 derivative records from 38618 primary records. [2025-10-22T22:05:32.903380] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-10-22T22:05:32.922582] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1794 records). [2025-10-22T22:05:32.923256] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-10-22T22:05:32.937851] [INFO ] [MAIN ] Derivative Progress: 145/2052 symbols completed. AVNT took 1.1s. Estimated remaining: 12m 16s. Rate: 155.5 symbols/min [2025-10-22T22:05:32.938608] [DEBUG] [MAIN ] AVTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:32.938818] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:32.940723] [INFO ] [MAIN ] AVTR: Generated 1794 derivative records from 53571 primary records. [2025-10-22T22:05:32.942800] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-10-22T22:05:32.973292] [DEBUG] [MAIN ] AVY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:32.973972] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1794 records). [2025-10-22T22:05:32.974119] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-10-22T22:05:32.977194] [INFO ] [MAIN ] AVY: Generated 1794 derivative records from 38119 primary records. [2025-10-22T22:05:32.976227] [INFO ] [MAIN ] Derivative Progress: 146/2052 symbols completed. AVTR took 1.1s. Estimated remaining: 12m 11s. Rate: 156.5 symbols/min [2025-10-22T22:05:32.977346] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-10-22T22:05:32.978515] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:33.001062] [DEBUG] [LOCAL ] AVY: Derivative data saved (1794 records). [2025-10-22T22:05:33.001278] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-10-22T22:05:33.003778] [INFO ] [MAIN ] Derivative Progress: 147/2052 symbols completed. AVY took 1.1s. Estimated remaining: 12m 6s. Rate: 157.5 symbols/min [2025-10-22T22:05:33.004049] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:33.013098] [DEBUG] [LOCAL ] AWF: Loaded 24048 existing records from primary storage. [2025-10-22T22:05:33.013232] [INFO ] [MAIN ] AWF: Loaded 24048 primary data records. [2025-10-22T22:05:33.205618] [DEBUG] [LOCAL ] AWI: Loaded 25139 existing records from primary storage. [2025-10-22T22:05:33.322407] [INFO ] [MAIN ] AWI: Loaded 25139 primary data records. [2025-10-22T22:05:33.483621] [DEBUG] [LOCAL ] AWK: Loaded 48388 existing records from primary storage. [2025-10-22T22:05:33.529299] [INFO ] [MAIN ] AWK: Loaded 48388 primary data records. [2025-10-22T22:05:34.008361] [DEBUG] [MAIN ] AWF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:34.010314] [INFO ] [MAIN ] AWF: Generated 1794 derivative records from 24048 primary records. [2025-10-22T22:05:34.010982] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-22T22:05:34.029625] [DEBUG] [LOCAL ] AWF: Derivative data saved (1794 records). [2025-10-22T22:05:34.030045] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-22T22:05:34.031996] [INFO ] [MAIN ] Derivative Progress: 148/2052 symbols completed. AWF took 1.1s. Estimated remaining: 12m 14s. Rate: 155.7 symbols/min [2025-10-22T22:05:34.047493] [DEBUG] [MAIN ] AWI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:05:34.048286] [INFO ] [MAIN ] AWI: Generated 1793 derivative records from 25139 primary records. [2025-10-22T22:05:34.048432] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-22T22:05:34.066563] [DEBUG] [LOCAL ] AWI: Derivative data saved (1793 records). [2025-10-22T22:05:34.066734] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-10-22T22:05:34.069481] [INFO ] [MAIN ] Derivative Progress: 149/2052 symbols completed. AWI took 1.1s. Estimated remaining: 12m 9s. Rate: 156.6 symbols/min [2025-10-22T22:05:34.082087] [DEBUG] [MAIN ] AWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:34.082629] [INFO ] [MAIN ] AWK: Generated 1794 derivative records from 48388 primary records. [2025-10-22T22:05:34.082722] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-22T22:05:34.097524] [DEBUG] [LOCAL ] AWK: Derivative data saved (1794 records). [2025-10-22T22:05:34.097587] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-22T22:05:34.100163] [INFO ] [MAIN ] Derivative Progress: 150/2052 symbols completed. AWK took 1.1s. Estimated remaining: 12m 4s. Rate: 157.6 symbols/min [2025-10-22T22:05:34.100568] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:34.100622] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:34.100525] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:34.138638] [DEBUG] [LOCAL ] AWP: Loaded 21587 existing records from primary storage. [2025-10-22T22:05:34.139037] [DEBUG] [LOCAL ] AWR: Loaded 22661 existing records from primary storage. [2025-10-22T22:05:34.139188] [INFO ] [MAIN ] AWP: Loaded 21587 primary data records. [2025-10-22T22:05:34.139438] [INFO ] [MAIN ] AWR: Loaded 22661 primary data records. [2025-10-22T22:05:34.256022] [DEBUG] [LOCAL ] AX: Loaded 27804 existing records from primary storage. [2025-10-22T22:05:34.300962] [INFO ] [MAIN ] AX: Loaded 27804 primary data records. [2025-10-22T22:05:35.094419] [DEBUG] [MAIN ] AWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:35.109464] [INFO ] [MAIN ] AWR: Generated 1794 derivative records from 22661 primary records. [2025-10-22T22:05:35.110388] [DEBUG] [MAIN ] AWP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:35.122882] [INFO ] [MAIN ] AWP: Generated 1794 derivative records from 21587 primary records. [2025-10-22T22:05:35.122118] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-22T22:05:35.123164] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-22T22:05:35.124389] [DEBUG] [MAIN ] AX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:35.125073] [INFO ] [MAIN ] AX: Generated 1794 derivative records from 27804 primary records. [2025-10-22T22:05:35.125556] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-22T22:05:35.166068] [DEBUG] [LOCAL ] AWR: Derivative data saved (1794 records). [2025-10-22T22:05:35.172757] [DEBUG] [LOCAL ] AX: Derivative data saved (1794 records). [2025-10-22T22:05:35.171831] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-22T22:05:35.176223] [DEBUG] [LOCAL ] AWP: Derivative data saved (1794 records). [2025-10-22T22:05:35.176134] [INFO ] [MAIN ] Derivative Progress: 151/2052 symbols completed. AWR took 1.1s. Estimated remaining: 12m 12s. Rate: 155.7 symbols/min [2025-10-22T22:05:35.173088] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-10-22T22:05:35.178935] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:35.179004] [INFO ] [MAIN ] Derivative Progress: 152/2052 symbols completed. AX took 1.1s. Estimated remaining: 12m 7s. Rate: 156.7 symbols/min [2025-10-22T22:05:35.176412] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-10-22T22:05:35.182340] [INFO ] [MAIN ] Derivative Progress: 153/2052 symbols completed. AWP took 1.1s. Estimated remaining: 12m 2s. Rate: 157.8 symbols/min [2025-10-22T22:05:35.182451] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:35.182185] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:35.188130] [DEBUG] [LOCAL ] AXR: Loaded 2907 existing records from primary storage. [2025-10-22T22:05:35.188340] [INFO ] [MAIN ] AXR: Loaded 2907 primary data records. [2025-10-22T22:05:35.592761] [DEBUG] [LOCAL ] AXL: Loaded 50533 existing records from primary storage. [2025-10-22T22:05:35.607616] [INFO ] [MAIN ] AXL: Loaded 50533 primary data records. [2025-10-22T22:05:35.619823] [DEBUG] [LOCAL ] AXP: Loaded 53162 existing records from primary storage. [2025-10-22T22:05:35.639436] [INFO ] [MAIN ] AXP: Loaded 53162 primary data records. [2025-10-22T22:05:36.216546] [DEBUG] [MAIN ] AXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:36.217734] [INFO ] [MAIN ] AXR: Generated 1794 derivative records from 2907 primary records. [2025-10-22T22:05:36.218418] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-10-22T22:05:36.233632] [DEBUG] [LOCAL ] AXR: Derivative data saved (1794 records). [2025-10-22T22:05:36.233807] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-10-22T22:05:36.236359] [INFO ] [MAIN ] Derivative Progress: 154/2052 symbols completed. AXR took 1.1s. Estimated remaining: 12m 10s. Rate: 156.0 symbols/min [2025-10-22T22:05:36.237548] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:36.258448] [DEBUG] [MAIN ] AXL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:36.259458] [INFO ] [MAIN ] AXL: Generated 1794 derivative records from 50533 primary records. [2025-10-22T22:05:36.259596] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-22T22:05:36.272359] [DEBUG] [MAIN ] AXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:36.273171] [INFO ] [MAIN ] AXP: Generated 1794 derivative records from 53162 primary records. [2025-10-22T22:05:36.279882] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-22T22:05:36.298885] [DEBUG] [LOCAL ] AXL: Derivative data saved (1794 records). [2025-10-22T22:05:36.298981] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-10-22T22:05:36.300912] [INFO ] [MAIN ] Derivative Progress: 155/2052 symbols completed. AXL took 1.1s. Estimated remaining: 12m 6s. Rate: 156.8 symbols/min [2025-10-22T22:05:36.304279] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:36.305568] [DEBUG] [LOCAL ] AXP: Derivative data saved (1794 records). [2025-10-22T22:05:36.319468] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-10-22T22:05:36.322058] [INFO ] [MAIN ] Derivative Progress: 156/2052 symbols completed. AXP took 1.1s. Estimated remaining: 12m 1s. Rate: 157.8 symbols/min [2025-10-22T22:05:36.322278] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:36.333611] [DEBUG] [LOCAL ] AZO: Loaded 10731 existing records from primary storage. [2025-10-22T22:05:36.352230] [INFO ] [MAIN ] AZO: Loaded 10731 primary data records. [2025-10-22T22:05:36.364932] [DEBUG] [LOCAL ] AXTA: Loaded 52290 existing records from primary storage. [2025-10-22T22:05:36.391769] [INFO ] [MAIN ] AXTA: Loaded 52290 primary data records. [2025-10-22T22:05:36.469356] [DEBUG] [LOCAL ] AZZ: Loaded 22928 existing records from primary storage. [2025-10-22T22:05:36.505793] [INFO ] [MAIN ] AZZ: Loaded 22928 primary data records. [2025-10-22T22:05:37.322374] [DEBUG] [MAIN ] AXTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:37.334884] [DEBUG] [MAIN ] AZO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:37.335617] [INFO ] [MAIN ] AXTA: Generated 1794 derivative records from 52290 primary records. [2025-10-22T22:05:37.336492] [INFO ] [MAIN ] AZO: Generated 1794 derivative records from 10731 primary records. [2025-10-22T22:05:37.336557] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-22T22:05:37.337179] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-22T22:05:37.365003] [DEBUG] [LOCAL ] AZO: Derivative data saved (1794 records). [2025-10-22T22:05:37.365135] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-10-22T22:05:37.367126] [INFO ] [MAIN ] Derivative Progress: 157/2052 symbols completed. AZO took 1.1s. Estimated remaining: 12m 9s. Rate: 156.0 symbols/min [2025-10-22T22:05:37.372689] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:37.374713] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1794 records). [2025-10-22T22:05:37.374817] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-10-22T22:05:37.377833] [INFO ] [MAIN ] Derivative Progress: 158/2052 symbols completed. AXTA took 1.1s. Estimated remaining: 12m 4s. Rate: 157.0 symbols/min [2025-10-22T22:05:37.385530] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:37.391378] [DEBUG] [MAIN ] AZZ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:05:37.392364] [INFO ] [MAIN ] AZZ: Generated 1793 derivative records from 22928 primary records. [2025-10-22T22:05:37.392539] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-22T22:05:37.408888] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1793 records). [2025-10-22T22:05:37.409052] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-22T22:05:37.411584] [INFO ] [MAIN ] Derivative Progress: 159/2052 symbols completed. AZZ took 1.1s. Estimated remaining: 11m 59s. Rate: 157.9 symbols/min [2025-10-22T22:05:37.411840] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:37.470869] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-22T22:05:37.482749] [INFO ] [MAIN ] BA: Loaded 53790 primary data records. [2025-10-22T22:05:37.513942] [DEBUG] [LOCAL ] BAK: Loaded 39419 existing records from primary storage. [2025-10-22T22:05:37.538719] [INFO ] [MAIN ] BAK: Loaded 39419 primary data records. [2025-10-22T22:05:37.609246] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-22T22:05:37.642301] [INFO ] [MAIN ] BABA: Loaded 53820 primary data records. [2025-10-22T22:05:38.444552] [DEBUG] [MAIN ] BA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:38.446502] [INFO ] [MAIN ] BA: Generated 1794 derivative records from 53790 primary records. [2025-10-22T22:05:38.447424] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-22T22:05:38.465022] [DEBUG] [LOCAL ] BA: Derivative data saved (1794 records). [2025-10-22T22:05:38.465250] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-10-22T22:05:38.466906] [INFO ] [MAIN ] Derivative Progress: 160/2052 symbols completed. BA took 1.1s. Estimated remaining: 12m 7s. Rate: 156.2 symbols/min [2025-10-22T22:05:38.467055] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:38.491437] [DEBUG] [MAIN ] BAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:38.504928] [INFO ] [MAIN ] BAK: Generated 1794 derivative records from 39419 primary records. [2025-10-22T22:05:38.505918] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-22T22:05:38.505844] [DEBUG] [MAIN ] BABA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:38.507777] [INFO ] [MAIN ] BABA: Generated 1794 derivative records from 53820 primary records. [2025-10-22T22:05:38.515795] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-22T22:05:38.530988] [DEBUG] [LOCAL ] BAK: Derivative data saved (1794 records). [2025-10-22T22:05:38.539372] [DEBUG] [LOCAL ] BABA: Derivative data saved (1794 records). [2025-10-22T22:05:38.538743] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-22T22:05:38.539500] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-10-22T22:05:38.542124] [INFO ] [MAIN ] Derivative Progress: 161/2052 symbols completed. BAK took 1.1s. Estimated remaining: 12m 3s. Rate: 157.0 symbols/min [2025-10-22T22:05:38.545067] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:38.545230] [INFO ] [MAIN ] Derivative Progress: 162/2052 symbols completed. BABA took 1.2s. Estimated remaining: 11m 58s. Rate: 157.9 symbols/min [2025-10-22T22:05:38.545418] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:38.580457] [DEBUG] [LOCAL ] BALL: Loaded 51932 existing records from primary storage. [2025-10-22T22:05:38.580702] [INFO ] [MAIN ] BALL: Loaded 51932 primary data records. [2025-10-22T22:05:38.816835] [DEBUG] [LOCAL ] BAM: Loaded 52081 existing records from primary storage. [2025-10-22T22:05:38.923098] [DEBUG] [LOCAL ] BANC: Loaded 51385 existing records from primary storage. [2025-10-22T22:05:38.932263] [INFO ] [MAIN ] BANC: Loaded 51385 primary data records. [2025-10-22T22:05:38.931994] [INFO ] [MAIN ] BAM: Loaded 52081 primary data records. [2025-10-22T22:05:39.590673] [DEBUG] [MAIN ] BALL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:39.591782] [INFO ] [MAIN ] BALL: Generated 1794 derivative records from 51932 primary records. [2025-10-22T22:05:39.592046] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-22T22:05:39.609083] [DEBUG] [LOCAL ] BALL: Derivative data saved (1794 records). [2025-10-22T22:05:39.609315] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-22T22:05:39.611608] [INFO ] [MAIN ] Derivative Progress: 163/2052 symbols completed. BALL took 1.1s. Estimated remaining: 12m 6s. Rate: 156.2 symbols/min [2025-10-22T22:05:39.627043] [DEBUG] [MAIN ] BANC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:39.627789] [INFO ] [MAIN ] BANC: Generated 1794 derivative records from 51385 primary records. [2025-10-22T22:05:39.627931] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-22T22:05:39.657686] [DEBUG] [MAIN ] BAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:39.658316] [INFO ] [MAIN ] BAM: Generated 1794 derivative records from 52081 primary records. [2025-10-22T22:05:39.657480] [DEBUG] [LOCAL ] BANC: Derivative data saved (1794 records). [2025-10-22T22:05:39.658413] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-10-22T22:05:39.658491] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-22T22:05:39.660579] [INFO ] [MAIN ] Derivative Progress: 164/2052 symbols completed. BANC took 1.1s. Estimated remaining: 12m 1s. Rate: 157.0 symbols/min [2025-10-22T22:05:39.675898] [DEBUG] [LOCAL ] BAM: Derivative data saved (1794 records). [2025-10-22T22:05:39.675960] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-10-22T22:05:39.678542] [INFO ] [MAIN ] Derivative Progress: 165/2052 symbols completed. BAM took 1.1s. Estimated remaining: 11m 57s. Rate: 157.9 symbols/min [2025-10-22T22:05:39.678937] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:39.679135] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:39.679005] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:39.730410] [DEBUG] [LOCAL ] BAP: Loaded 25563 existing records from primary storage. [2025-10-22T22:05:39.730569] [INFO ] [MAIN ] BAP: Loaded 25563 primary data records. [2025-10-22T22:05:39.861458] [DEBUG] [LOCAL ] BAX: Loaded 53537 existing records from primary storage. [2025-10-22T22:05:39.873164] [INFO ] [MAIN ] BAX: Loaded 53537 primary data records. [2025-10-22T22:05:39.933190] [DEBUG] [LOCAL ] BARK: Loaded 38227 existing records from primary storage. [2025-10-22T22:05:39.966254] [INFO ] [MAIN ] BARK: Loaded 38227 primary data records. [2025-10-22T22:05:40.681887] [DEBUG] [MAIN ] BAP: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:05:40.682960] [INFO ] [MAIN ] BAP: Generated 1793 derivative records from 25563 primary records. [2025-10-22T22:05:40.684521] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-22T22:05:40.702016] [DEBUG] [LOCAL ] BAP: Derivative data saved (1793 records). [2025-10-22T22:05:40.702172] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-22T22:05:40.704834] [INFO ] [MAIN ] Derivative Progress: 166/2052 symbols completed. BAP took 1.0s. Estimated remaining: 12m 4s. Rate: 156.3 symbols/min [2025-10-22T22:05:40.717909] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:40.726049] [DEBUG] [MAIN ] BAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:40.726940] [INFO ] [MAIN ] BAX: Generated 1794 derivative records from 53537 primary records. [2025-10-22T22:05:40.731693] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-22T22:05:40.732699] [DEBUG] [MAIN ] BARK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:40.733401] [INFO ] [MAIN ] BARK: Generated 1794 derivative records from 38227 primary records. [2025-10-22T22:05:40.733631] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-22T22:05:40.762734] [DEBUG] [LOCAL ] BAX: Derivative data saved (1794 records). [2025-10-22T22:05:40.762870] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-10-22T22:05:40.763966] [DEBUG] [LOCAL ] BARK: Derivative data saved (1794 records). [2025-10-22T22:05:40.766280] [INFO ] [MAIN ] Derivative Progress: 167/2052 symbols completed. BAX took 1.1s. Estimated remaining: 11m 60s. Rate: 157.1 symbols/min [2025-10-22T22:05:40.766525] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:40.766442] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-22T22:05:40.769638] [INFO ] [MAIN ] Derivative Progress: 168/2052 symbols completed. BARK took 1.1s. Estimated remaining: 11m 55s. Rate: 158.1 symbols/min [2025-10-22T22:05:40.770055] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:40.810804] [DEBUG] [LOCAL ] BB: Loaded 52882 existing records from primary storage. [2025-10-22T22:05:40.810971] [INFO ] [MAIN ] BB: Loaded 52882 primary data records. [2025-10-22T22:05:41.167033] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-22T22:05:41.164938] [DEBUG] [LOCAL ] BBAR: Loaded 42605 existing records from primary storage. [2025-10-22T22:05:41.167258] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-10-22T22:05:41.167385] [INFO ] [MAIN ] BBAR: Loaded 42605 primary data records. [2025-10-22T22:05:41.826512] [DEBUG] [MAIN ] BB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:41.828776] [INFO ] [MAIN ] BB: Generated 1794 derivative records from 52882 primary records. [2025-10-22T22:05:41.829119] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-22T22:05:41.845904] [DEBUG] [LOCAL ] BB: Derivative data saved (1794 records). [2025-10-22T22:05:41.846199] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-22T22:05:41.848569] [INFO ] [MAIN ] Derivative Progress: 169/2052 symbols completed. BB took 1.1s. Estimated remaining: 12m 3s. Rate: 156.4 symbols/min [2025-10-22T22:05:41.848965] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:41.868564] [DEBUG] [MAIN ] BBAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:41.870173] [INFO ] [MAIN ] BBAI: Generated 1794 derivative records from 53820 primary records. [2025-10-22T22:05:41.870412] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-22T22:05:41.902910] [DEBUG] [MAIN ] BBAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:41.907012] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1794 records). [2025-10-22T22:05:41.907137] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-22T22:05:41.909835] [INFO ] [MAIN ] Derivative Progress: 170/2052 symbols completed. BBAI took 1.1s. Estimated remaining: 11m 59s. Rate: 157.1 symbols/min [2025-10-22T22:05:41.910025] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:41.911039] [INFO ] [MAIN ] BBAR: Generated 1794 derivative records from 42605 primary records. [2025-10-22T22:05:41.911971] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-22T22:05:41.923482] [DEBUG] [LOCAL ] BBDC: Loaded 32835 existing records from primary storage. [2025-10-22T22:05:41.923601] [INFO ] [MAIN ] BBDC: Loaded 32835 primary data records. [2025-10-22T22:05:41.961237] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1794 records). [2025-10-22T22:05:41.976892] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-22T22:05:41.979121] [INFO ] [MAIN ] Derivative Progress: 171/2052 symbols completed. BBAR took 1.2s. Estimated remaining: 11m 55s. Rate: 157.9 symbols/min [2025-10-22T22:05:41.961441] [DEBUG] [LOCAL ] BBDO: Loaded 4953 existing records from primary storage. [2025-10-22T22:05:41.991304] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:42.000796] [INFO ] [MAIN ] BBDO: Loaded 4953 primary data records. [2025-10-22T22:05:42.230238] [DEBUG] [LOCAL ] BBN: Loaded 17840 existing records from primary storage. [2025-10-22T22:05:42.339929] [INFO ] [MAIN ] BBN: Loaded 17840 primary data records. [2025-10-22T22:05:42.907363] [DEBUG] [MAIN ] BBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:42.908719] [INFO ] [MAIN ] BBDC: Generated 1794 derivative records from 32835 primary records. [2025-10-22T22:05:42.908932] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-22T22:05:42.928053] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1794 records). [2025-10-22T22:05:42.928162] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-10-22T22:05:42.930408] [INFO ] [MAIN ] Derivative Progress: 172/2052 symbols completed. BBDC took 1.1s. Estimated remaining: 12m 1s. Rate: 156.5 symbols/min [2025-10-22T22:05:42.930562] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:42.958160] [DEBUG] [MAIN ] BBDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:42.964771] [DEBUG] [LOCAL ] BBU: Loaded 5773 existing records from primary storage. [2025-10-22T22:05:42.961247] [INFO ] [MAIN ] BBDO: Generated 1794 derivative records from 4953 primary records. [2025-10-22T22:05:42.965126] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-10-22T22:05:42.965298] [INFO ] [MAIN ] BBU: Loaded 5773 primary data records. [2025-10-22T22:05:43.035926] [DEBUG] [MAIN ] BBN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:43.074864] [INFO ] [MAIN ] BBN: Generated 1794 derivative records from 17840 primary records. [2025-10-22T22:05:43.082556] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1794 records). [2025-10-22T22:05:43.083002] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-10-22T22:05:43.082910] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-10-22T22:05:43.102985] [INFO ] [MAIN ] Derivative Progress: 173/2052 symbols completed. BBDO took 1.2s. Estimated remaining: 11m 58s. Rate: 157.0 symbols/min [2025-10-22T22:05:43.103464] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:43.160203] [DEBUG] [LOCAL ] BBN: Derivative data saved (1794 records). [2025-10-22T22:05:43.160364] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-10-22T22:05:43.195893] [INFO ] [MAIN ] Derivative Progress: 174/2052 symbols completed. BBN took 1.2s. Estimated remaining: 11m 55s. Rate: 157.7 symbols/min [2025-10-22T22:05:43.203462] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:43.347840] [DEBUG] [LOCAL ] BBUC: Loaded 13946 existing records from primary storage. [2025-10-22T22:05:43.348162] [INFO ] [MAIN ] BBUC: Loaded 13946 primary data records. [2025-10-22T22:05:43.714396] [DEBUG] [LOCAL ] BBVA: Loaded 49107 existing records from primary storage. [2025-10-22T22:05:43.714957] [INFO ] [MAIN ] BBVA: Loaded 49107 primary data records. [2025-10-22T22:05:43.850700] [DEBUG] [MAIN ] BBU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:43.872701] [INFO ] [MAIN ] BBU: Generated 1794 derivative records from 5773 primary records. [2025-10-22T22:05:43.895004] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-10-22T22:05:44.060280] [DEBUG] [LOCAL ] BBU: Derivative data saved (1794 records). [2025-10-22T22:05:44.060824] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-10-22T22:05:44.062862] [INFO ] [MAIN ] Derivative Progress: 175/2052 symbols completed. BBU took 1.1s. Estimated remaining: 11m 59s. Rate: 156.6 symbols/min [2025-10-22T22:05:44.063004] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:44.082431] [DEBUG] [MAIN ] BBUC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:44.084272] [INFO ] [MAIN ] BBUC: Generated 1794 derivative records from 13946 primary records. [2025-10-22T22:05:44.084485] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-10-22T22:05:44.107766] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1794 records). [2025-10-22T22:05:44.108133] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-10-22T22:05:44.110416] [INFO ] [MAIN ] Derivative Progress: 176/2052 symbols completed. BBUC took 1.0s. Estimated remaining: 11m 55s. Rate: 157.3 symbols/min [2025-10-22T22:05:44.121030] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:44.122509] [DEBUG] [LOCAL ] BBW: Loaded 27233 existing records from primary storage. [2025-10-22T22:05:44.123609] [INFO ] [MAIN ] BBW: Loaded 27233 primary data records. [2025-10-22T22:05:44.200744] [DEBUG] [MAIN ] BBVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:44.219403] [INFO ] [MAIN ] BBVA: Generated 1794 derivative records from 49107 primary records. [2025-10-22T22:05:44.237732] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-22T22:05:44.443272] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1794 records). [2025-10-22T22:05:44.451995] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-10-22T22:05:44.454757] [INFO ] [MAIN ] Derivative Progress: 177/2052 symbols completed. BBVA took 1.3s. Estimated remaining: 11m 55s. Rate: 157.4 symbols/min [2025-10-22T22:05:44.455090] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:44.498817] [DEBUG] [LOCAL ] BBWI: Loaded 53591 existing records from primary storage. [2025-10-22T22:05:44.499320] [INFO ] [MAIN ] BBWI: Loaded 53591 primary data records. [2025-10-22T22:05:44.631705] [DEBUG] [MAIN ] BBW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:44.632917] [INFO ] [MAIN ] BBW: Generated 1794 derivative records from 27233 primary records. [2025-10-22T22:05:44.657105] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-22T22:05:44.822170] [DEBUG] [LOCAL ] BBY: Loaded 53437 existing records from primary storage. [2025-10-22T22:05:44.844116] [INFO ] [MAIN ] BBY: Loaded 53437 primary data records. [2025-10-22T22:05:44.883745] [DEBUG] [LOCAL ] BBW: Derivative data saved (1794 records). [2025-10-22T22:05:44.910890] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-10-22T22:05:44.920413] [INFO ] [MAIN ] Derivative Progress: 178/2052 symbols completed. BBW took 0.9s. Estimated remaining: 11m 55s. Rate: 157.2 symbols/min [2025-10-22T22:05:45.164069] [DEBUG] [MAIN ] BBWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:45.165124] [INFO ] [MAIN ] BBWI: Generated 1794 derivative records from 53591 primary records. [2025-10-22T22:05:45.165303] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-22T22:05:45.182933] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1794 records). [2025-10-22T22:05:45.183072] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-22T22:05:45.185603] [INFO ] [MAIN ] Derivative Progress: 179/2052 symbols completed. BBWI took 1.1s. Estimated remaining: 11m 54s. Rate: 157.5 symbols/min [2025-10-22T22:05:45.202455] [DEBUG] [MAIN ] BBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:45.203011] [INFO ] [MAIN ] BBY: Generated 1794 derivative records from 53437 primary records. [2025-10-22T22:05:45.203071] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-22T22:05:45.217881] [DEBUG] [LOCAL ] BBY: Derivative data saved (1794 records). [2025-10-22T22:05:45.217939] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-10-22T22:05:45.219988] [INFO ] [MAIN ] Derivative Progress: 180/2052 symbols completed. BBY took 0.8s. Estimated remaining: 11m 50s. Rate: 158.3 symbols/min [2025-10-22T22:05:45.220539] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:45.220670] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:45.221138] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:45.280495] [DEBUG] [LOCAL ] BCAT: Loaded 34203 existing records from primary storage. [2025-10-22T22:05:45.281557] [INFO ] [MAIN ] BCAT: Loaded 34203 primary data records. [2025-10-22T22:05:45.293362] [DEBUG] [LOCAL ] BCC: Loaded 28624 existing records from primary storage. [2025-10-22T22:05:45.303146] [INFO ] [MAIN ] BCC: Loaded 28624 primary data records. [2025-10-22T22:05:45.489307] [DEBUG] [LOCAL ] BC: Loaded 43892 existing records from primary storage. [2025-10-22T22:05:45.500701] [INFO ] [MAIN ] BC: Loaded 43892 primary data records. [2025-10-22T22:05:46.252613] [DEBUG] [MAIN ] BCC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:05:46.257931] [DEBUG] [MAIN ] BCAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:46.259348] [INFO ] [MAIN ] BCC: Generated 1793 derivative records from 28624 primary records. [2025-10-22T22:05:46.258697] [INFO ] [MAIN ] BCAT: Generated 1794 derivative records from 34203 primary records. [2025-10-22T22:05:46.259752] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-10-22T22:05:46.259710] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-22T22:05:46.291756] [DEBUG] [LOCAL ] BCC: Derivative data saved (1793 records). [2025-10-22T22:05:46.293037] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1794 records). [2025-10-22T22:05:46.293193] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-10-22T22:05:46.293116] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-10-22T22:05:46.295918] [INFO ] [MAIN ] Derivative Progress: 181/2052 symbols completed. BCC took 1.1s. Estimated remaining: 11m 56s. Rate: 156.7 symbols/min [2025-10-22T22:05:46.297915] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:46.310675] [DEBUG] [MAIN ] BC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:46.305303] [INFO ] [MAIN ] Derivative Progress: 182/2052 symbols completed. BCAT took 1.1s. Estimated remaining: 11m 52s. Rate: 157.6 symbols/min [2025-10-22T22:05:46.310912] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:46.312378] [INFO ] [MAIN ] BC: Generated 1794 derivative records from 43892 primary records. [2025-10-22T22:05:46.312700] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-22T22:05:46.328703] [DEBUG] [LOCAL ] BC: Derivative data saved (1794 records). [2025-10-22T22:05:46.328908] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-10-22T22:05:46.331346] [INFO ] [MAIN ] Derivative Progress: 183/2052 symbols completed. BC took 1.1s. Estimated remaining: 11m 48s. Rate: 158.4 symbols/min [2025-10-22T22:05:46.331531] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:46.372944] [DEBUG] [LOCAL ] BCH: Loaded 30088 existing records from primary storage. [2025-10-22T22:05:46.373191] [INFO ] [MAIN ] BCH: Loaded 30088 primary data records. [2025-10-22T22:05:46.455548] [DEBUG] [LOCAL ] BCO: Loaded 24959 existing records from primary storage. [2025-10-22T22:05:46.472926] [INFO ] [MAIN ] BCO: Loaded 24959 primary data records. [2025-10-22T22:05:46.574678] [DEBUG] [LOCAL ] BCE: Loaded 52266 existing records from primary storage. [2025-10-22T22:05:46.588773] [INFO ] [MAIN ] BCE: Loaded 52266 primary data records. [2025-10-22T22:05:47.382387] [DEBUG] [MAIN ] BCH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:47.383562] [INFO ] [MAIN ] BCH: Generated 1794 derivative records from 30088 primary records. [2025-10-22T22:05:47.383864] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-10-22T22:05:47.409267] [DEBUG] [MAIN ] BCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:47.412686] [INFO ] [MAIN ] BCO: Generated 1794 derivative records from 24959 primary records. [2025-10-22T22:05:47.412786] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-22T22:05:47.440734] [DEBUG] [LOCAL ] BCH: Derivative data saved (1794 records). [2025-10-22T22:05:47.445925] [DEBUG] [MAIN ] BCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:47.446022] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-10-22T22:05:47.448134] [DEBUG] [LOCAL ] BCO: Derivative data saved (1794 records). [2025-10-22T22:05:47.450725] [INFO ] [MAIN ] Derivative Progress: 184/2052 symbols completed. BCH took 1.1s. Estimated remaining: 11m 55s. Rate: 156.7 symbols/min [2025-10-22T22:05:47.448889] [INFO ] [MAIN ] BCE: Generated 1794 derivative records from 52266 primary records. [2025-10-22T22:05:47.450994] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-10-22T22:05:47.450937] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-22T22:05:47.454407] [INFO ] [MAIN ] Derivative Progress: 185/2052 symbols completed. BCO took 1.1s. Estimated remaining: 11m 51s. Rate: 157.5 symbols/min [2025-10-22T22:05:47.454336] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:47.461995] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:47.470785] [DEBUG] [LOCAL ] BCE: Derivative data saved (1794 records). [2025-10-22T22:05:47.470928] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-10-22T22:05:47.473605] [INFO ] [MAIN ] Derivative Progress: 186/2052 symbols completed. BCE took 1.2s. Estimated remaining: 11m 47s. Rate: 158.3 symbols/min [2025-10-22T22:05:47.473904] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:47.509858] [DEBUG] [LOCAL ] BCX: Loaded 22044 existing records from primary storage. [2025-10-22T22:05:47.510046] [INFO ] [MAIN ] BCX: Loaded 22044 primary data records. [2025-10-22T22:05:47.510539] [DEBUG] [LOCAL ] BCSF: Loaded 28115 existing records from primary storage. [2025-10-22T22:05:47.529238] [INFO ] [MAIN ] BCSF: Loaded 28115 primary data records. [2025-10-22T22:05:47.757211] [DEBUG] [LOCAL ] BCS: Loaded 53441 existing records from primary storage. [2025-10-22T22:05:47.788738] [INFO ] [MAIN ] BCS: Loaded 53441 primary data records. [2025-10-22T22:05:48.527177] [DEBUG] [MAIN ] BCSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:48.526905] [DEBUG] [MAIN ] BCX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:48.528238] [INFO ] [MAIN ] BCX: Generated 1794 derivative records from 22044 primary records. [2025-10-22T22:05:48.529088] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-10-22T22:05:48.530016] [INFO ] [MAIN ] BCSF: Generated 1794 derivative records from 28115 primary records. [2025-10-22T22:05:48.539050] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-22T22:05:48.560935] [DEBUG] [LOCAL ] BCX: Derivative data saved (1794 records). [2025-10-22T22:05:48.571396] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-10-22T22:05:48.575503] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1794 records). [2025-10-22T22:05:48.575766] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-22T22:05:48.578781] [INFO ] [MAIN ] Derivative Progress: 187/2052 symbols completed. BCX took 1.1s. Estimated remaining: 11m 54s. Rate: 156.7 symbols/min [2025-10-22T22:05:48.581410] [INFO ] [MAIN ] Derivative Progress: 188/2052 symbols completed. BCSF took 1.1s. Estimated remaining: 11m 50s. Rate: 157.6 symbols/min [2025-10-22T22:05:48.581633] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:48.578943] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:48.576126] [DEBUG] [MAIN ] BCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:48.583018] [INFO ] [MAIN ] BCS: Generated 1794 derivative records from 53441 primary records. [2025-10-22T22:05:48.583396] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-10-22T22:05:48.600222] [DEBUG] [LOCAL ] BCS: Derivative data saved (1794 records). [2025-10-22T22:05:48.600310] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-10-22T22:05:48.602861] [INFO ] [MAIN ] Derivative Progress: 189/2052 symbols completed. BCS took 1.1s. Estimated remaining: 11m 46s. Rate: 158.4 symbols/min [2025-10-22T22:05:48.603037] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:48.630172] [DEBUG] [LOCAL ] BDC: Loaded 24000 existing records from primary storage. [2025-10-22T22:05:48.630309] [INFO ] [MAIN ] BDC: Loaded 24000 primary data records. [2025-10-22T22:05:48.737786] [DEBUG] [LOCAL ] BDJ: Loaded 29333 existing records from primary storage. [2025-10-22T22:05:48.741310] [INFO ] [MAIN ] BDJ: Loaded 29333 primary data records. [2025-10-22T22:05:49.139733] [DEBUG] [LOCAL ] BDX: Loaded 52141 existing records from primary storage. [2025-10-22T22:05:49.141707] [INFO ] [MAIN ] BDX: Loaded 52141 primary data records. [2025-10-22T22:05:49.630215] [DEBUG] [MAIN ] BDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:49.632336] [INFO ] [MAIN ] BDC: Generated 1794 derivative records from 24000 primary records. [2025-10-22T22:05:49.632512] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-22T22:05:49.663366] [DEBUG] [MAIN ] BDJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:49.664138] [INFO ] [MAIN ] BDJ: Generated 1794 derivative records from 29333 primary records. [2025-10-22T22:05:49.663070] [DEBUG] [LOCAL ] BDC: Derivative data saved (1794 records). [2025-10-22T22:05:49.664354] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-22T22:05:49.665206] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-10-22T22:05:49.667408] [INFO ] [MAIN ] Derivative Progress: 190/2052 symbols completed. BDC took 1.1s. Estimated remaining: 11m 52s. Rate: 156.9 symbols/min [2025-10-22T22:05:49.675122] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:49.684565] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1794 records). [2025-10-22T22:05:49.684846] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-22T22:05:49.687414] [INFO ] [MAIN ] Derivative Progress: 191/2052 symbols completed. BDJ took 1.1s. Estimated remaining: 11m 48s. Rate: 157.7 symbols/min [2025-10-22T22:05:49.687771] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:49.705970] [DEBUG] [MAIN ] BDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:49.707103] [INFO ] [MAIN ] BDX: Generated 1794 derivative records from 52141 primary records. [2025-10-22T22:05:49.707247] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-22T22:05:49.723415] [DEBUG] [LOCAL ] BDX: Derivative data saved (1794 records). [2025-10-22T22:05:49.723764] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-22T22:05:49.726144] [INFO ] [MAIN ] Derivative Progress: 192/2052 symbols completed. BDX took 1.1s. Estimated remaining: 11m 45s. Rate: 158.4 symbols/min [2025-10-22T22:05:49.726437] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:49.774689] [DEBUG] [LOCAL ] BE: Loaded 53661 existing records from primary storage. [2025-10-22T22:05:49.775513] [INFO ] [MAIN ] BE: Loaded 53661 primary data records. [2025-10-22T22:05:49.873051] [DEBUG] [LOCAL ] BEKE: Loaded 53197 existing records from primary storage. [2025-10-22T22:05:49.892415] [INFO ] [MAIN ] BEKE: Loaded 53197 primary data records. [2025-10-22T22:05:50.104488] [DEBUG] [LOCAL ] BEN: Loaded 53114 existing records from primary storage. [2025-10-22T22:05:50.214360] [INFO ] [MAIN ] BEN: Loaded 53114 primary data records. [2025-10-22T22:05:50.740309] [DEBUG] [MAIN ] BE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:50.742823] [INFO ] [MAIN ] BE: Generated 1794 derivative records from 53661 primary records. [2025-10-22T22:05:50.743048] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-10-22T22:05:50.763024] [DEBUG] [LOCAL ] BE: Derivative data saved (1794 records). [2025-10-22T22:05:50.763217] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-10-22T22:05:50.765462] [INFO ] [MAIN ] Derivative Progress: 193/2052 symbols completed. BE took 1.1s. Estimated remaining: 11m 51s. Rate: 157.0 symbols/min [2025-10-22T22:05:50.779097] [DEBUG] [MAIN ] BEKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:50.779988] [INFO ] [MAIN ] BEKE: Generated 1794 derivative records from 53197 primary records. [2025-10-22T22:05:50.780086] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-22T22:05:50.799627] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1794 records). [2025-10-22T22:05:50.812091] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-22T22:05:50.812440] [DEBUG] [MAIN ] BEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:50.815094] [INFO ] [MAIN ] Derivative Progress: 194/2052 symbols completed. BEKE took 1.1s. Estimated remaining: 11m 47s. Rate: 157.7 symbols/min [2025-10-22T22:05:50.816043] [INFO ] [MAIN ] BEN: Generated 1794 derivative records from 53114 primary records. [2025-10-22T22:05:50.816143] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-22T22:05:50.831419] [DEBUG] [LOCAL ] BEN: Derivative data saved (1794 records). [2025-10-22T22:05:50.831486] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-22T22:05:50.833999] [INFO ] [MAIN ] Derivative Progress: 195/2052 symbols completed. BEN took 1.1s. Estimated remaining: 11m 43s. Rate: 158.5 symbols/min [2025-10-22T22:05:50.834534] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:50.834595] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:50.834679] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:50.843758] [DEBUG] [LOCAL ] BEPI: Loaded 3563 existing records from primary storage. [2025-10-22T22:05:50.844049] [INFO ] [MAIN ] BEPI: Loaded 3563 primary data records. [2025-10-22T22:05:51.059604] [DEBUG] [LOCAL ] BEP: Loaded 38937 existing records from primary storage. [2025-10-22T22:05:51.175901] [INFO ] [MAIN ] BEP: Loaded 38937 primary data records. [2025-10-22T22:05:51.246258] [DEBUG] [LOCAL ] BEPC: Loaded 46357 existing records from primary storage. [2025-10-22T22:05:51.268480] [INFO ] [MAIN ] BEPC: Loaded 46357 primary data records. [2025-10-22T22:05:51.845881] [DEBUG] [MAIN ] BEPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:51.847114] [INFO ] [MAIN ] BEPI: Generated 1794 derivative records from 3563 primary records. [2025-10-22T22:05:51.847288] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-22T22:05:51.863098] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1794 records). [2025-10-22T22:05:51.863495] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-22T22:05:51.866801] [INFO ] [MAIN ] Derivative Progress: 196/2052 symbols completed. BEPI took 1.0s. Estimated remaining: 11m 49s. Rate: 157.1 symbols/min [2025-10-22T22:05:51.867623] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:51.879521] [DEBUG] [LOCAL ] BEPJ: Loaded 3041 existing records from primary storage. [2025-10-22T22:05:51.892275] [DEBUG] [MAIN ] BEP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:51.892000] [INFO ] [MAIN ] BEPJ: Loaded 3041 primary data records. [2025-10-22T22:05:51.904319] [INFO ] [MAIN ] BEP: Generated 1794 derivative records from 38937 primary records. [2025-10-22T22:05:51.934725] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-22T22:05:52.003120] [DEBUG] [MAIN ] BEPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:52.029595] [INFO ] [MAIN ] BEPC: Generated 1794 derivative records from 46357 primary records. [2025-10-22T22:05:52.068814] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-10-22T22:05:52.078246] [DEBUG] [LOCAL ] BEP: Derivative data saved (1794 records). [2025-10-22T22:05:52.078349] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-10-22T22:05:52.110545] [INFO ] [MAIN ] Derivative Progress: 197/2052 symbols completed. BEP took 1.3s. Estimated remaining: 11m 47s. Rate: 157.4 symbols/min [2025-10-22T22:05:52.110772] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:52.244380] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1794 records). [2025-10-22T22:05:52.245059] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-10-22T22:05:52.248726] [INFO ] [MAIN ] Derivative Progress: 198/2052 symbols completed. BEPC took 1.4s. Estimated remaining: 11m 45s. Rate: 157.9 symbols/min [2025-10-22T22:05:52.249781] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:52.272804] [DEBUG] [LOCAL ] BFK: Loaded 13872 existing records from primary storage. [2025-10-22T22:05:52.273228] [INFO ] [MAIN ] BFK: Loaded 13872 primary data records. [2025-10-22T22:05:52.384860] [DEBUG] [LOCAL ] BFAM: Loaded 33784 existing records from primary storage. [2025-10-22T22:05:52.404293] [INFO ] [MAIN ] BFAM: Loaded 33784 primary data records. [2025-10-22T22:05:52.408204] [DEBUG] [MAIN ] BEPJ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:05:52.409010] [INFO ] [MAIN ] BEPJ: Generated 1793 derivative records from 3041 primary records. [2025-10-22T22:05:52.429860] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-22T22:05:52.607903] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1793 records). [2025-10-22T22:05:52.724913] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-10-22T22:05:52.750833] [INFO ] [MAIN ] Derivative Progress: 199/2052 symbols completed. BEPJ took 0.9s. Estimated remaining: 11m 45s. Rate: 157.6 symbols/min [2025-10-22T22:05:52.780090] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:52.943596] [DEBUG] [MAIN ] BFK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:52.944340] [INFO ] [MAIN ] BFK: Generated 1794 derivative records from 13872 primary records. [2025-10-22T22:05:52.944587] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-10-22T22:05:52.978983] [DEBUG] [LOCAL ] BFK: Derivative data saved (1794 records). [2025-10-22T22:05:52.979358] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-10-22T22:05:52.981562] [INFO ] [MAIN ] Derivative Progress: 200/2052 symbols completed. BFK took 0.7s. Estimated remaining: 11m 44s. Rate: 157.9 symbols/min [2025-10-22T22:05:52.982020] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:52.996295] [DEBUG] [MAIN ] BFAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:53.010156] [INFO ] [MAIN ] BFAM: Generated 1794 derivative records from 33784 primary records. [2025-10-22T22:05:53.011191] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-22T22:05:53.012551] [DEBUG] [LOCAL ] BFLY: Loaded 51865 existing records from primary storage. [2025-10-22T22:05:53.012990] [INFO ] [MAIN ] BFLY: Loaded 51865 primary data records. [2025-10-22T22:05:53.062246] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1794 records). [2025-10-22T22:05:53.084378] [DEBUG] [LOCAL ] BFS: Loaded 9560 existing records from primary storage. [2025-10-22T22:05:53.102389] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-10-22T22:05:53.102319] [INFO ] [MAIN ] BFS: Loaded 9560 primary data records. [2025-10-22T22:05:53.110042] [INFO ] [MAIN ] Derivative Progress: 201/2052 symbols completed. BFAM took 1.0s. Estimated remaining: 11m 41s. Rate: 158.4 symbols/min [2025-10-22T22:05:53.137908] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:53.426329] [DEBUG] [LOCAL ] BFZ: Loaded 12049 existing records from primary storage. [2025-10-22T22:05:53.496712] [INFO ] [MAIN ] BFZ: Loaded 12049 primary data records. [2025-10-22T22:05:53.996685] [DEBUG] [MAIN ] BFLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:53.997002] [DEBUG] [MAIN ] BFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:53.998014] [INFO ] [MAIN ] BFLY: Generated 1794 derivative records from 51865 primary records. [2025-10-22T22:05:53.998875] [INFO ] [MAIN ] BFS: Generated 1794 derivative records from 9560 primary records. [2025-10-22T22:05:53.999130] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-22T22:05:53.999404] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-10-22T22:05:54.023157] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1794 records). [2025-10-22T22:05:54.024400] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-10-22T22:05:54.032556] [INFO ] [MAIN ] Derivative Progress: 202/2052 symbols completed. BFLY took 1.3s. Estimated remaining: 11m 46s. Rate: 157.3 symbols/min [2025-10-22T22:05:54.034821] [DEBUG] [LOCAL ] BFS: Derivative data saved (1794 records). [2025-10-22T22:05:54.035533] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-10-22T22:05:54.037963] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:54.038274] [INFO ] [MAIN ] Derivative Progress: 203/2052 symbols completed. BFS took 1.1s. Estimated remaining: 11m 42s. Rate: 158.1 symbols/min [2025-10-22T22:05:54.046562] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:54.052199] [DEBUG] [MAIN ] BFZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:54.052866] [INFO ] [MAIN ] BFZ: Generated 1794 derivative records from 12049 primary records. [2025-10-22T22:05:54.052976] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-22T22:05:54.068512] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1794 records). [2025-10-22T22:05:54.068772] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-10-22T22:05:54.071327] [INFO ] [MAIN ] Derivative Progress: 204/2052 symbols completed. BFZ took 0.9s. Estimated remaining: 11m 38s. Rate: 158.8 symbols/min [2025-10-22T22:05:54.071512] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:54.090242] [DEBUG] [LOCAL ] BGB: Loaded 17618 existing records from primary storage. [2025-10-22T22:05:54.090431] [INFO ] [MAIN ] BGB: Loaded 17618 primary data records. [2025-10-22T22:05:54.160334] [DEBUG] [LOCAL ] BGH: Loaded 17133 existing records from primary storage. [2025-10-22T22:05:54.190749] [INFO ] [MAIN ] BGH: Loaded 17133 primary data records. [2025-10-22T22:05:54.438001] [DEBUG] [LOCAL ] BG: Loaded 50547 existing records from primary storage. [2025-10-22T22:05:54.583762] [INFO ] [MAIN ] BG: Loaded 50547 primary data records. [2025-10-22T22:05:55.111176] [DEBUG] [MAIN ] BGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:55.112809] [INFO ] [MAIN ] BGB: Generated 1794 derivative records from 17618 primary records. [2025-10-22T22:05:55.112925] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-22T22:05:55.148141] [DEBUG] [LOCAL ] BGB: Derivative data saved (1794 records). [2025-10-22T22:05:55.148591] [DEBUG] [MAIN ] BGH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:55.148768] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-10-22T22:05:55.151326] [INFO ] [MAIN ] Derivative Progress: 205/2052 symbols completed. BGB took 1.1s. Estimated remaining: 11m 44s. Rate: 157.4 symbols/min [2025-10-22T22:05:55.152304] [INFO ] [MAIN ] BGH: Generated 1794 derivative records from 17133 primary records. [2025-10-22T22:05:55.152688] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-10-22T22:05:55.152833] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:55.170194] [DEBUG] [LOCAL ] BGH: Derivative data saved (1794 records). [2025-10-22T22:05:55.170574] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-10-22T22:05:55.179325] [INFO ] [MAIN ] Derivative Progress: 206/2052 symbols completed. BGH took 1.1s. Estimated remaining: 11m 41s. Rate: 158.1 symbols/min [2025-10-22T22:05:55.179571] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:55.197743] [DEBUG] [LOCAL ] BGR: Loaded 13405 existing records from primary storage. [2025-10-22T22:05:55.198431] [INFO ] [MAIN ] BGR: Loaded 13405 primary data records. [2025-10-22T22:05:55.198252] [DEBUG] [MAIN ] BG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:55.199202] [INFO ] [MAIN ] BG: Generated 1794 derivative records from 50547 primary records. [2025-10-22T22:05:55.229504] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-22T22:05:55.315017] [DEBUG] [LOCAL ] BG: Derivative data saved (1794 records). [2025-10-22T22:05:55.315526] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-10-22T22:05:55.323557] [INFO ] [MAIN ] Derivative Progress: 207/2052 symbols completed. BG took 1.3s. Estimated remaining: 11m 38s. Rate: 158.6 symbols/min [2025-10-22T22:05:55.328947] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:55.532364] [DEBUG] [LOCAL ] BGSF: Loaded 8227 existing records from primary storage. [2025-10-22T22:05:55.532700] [INFO ] [MAIN ] BGSF: Loaded 8227 primary data records. [2025-10-22T22:05:55.647174] [DEBUG] [LOCAL ] BGS: Loaded 50530 existing records from primary storage. [2025-10-22T22:05:55.659983] [INFO ] [MAIN ] BGS: Loaded 50530 primary data records. [2025-10-22T22:05:56.134101] [DEBUG] [MAIN ] BGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:56.135346] [INFO ] [MAIN ] BGR: Generated 1794 derivative records from 13405 primary records. [2025-10-22T22:05:56.343510] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-22T22:05:56.388760] [DEBUG] [MAIN ] BGSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:56.390011] [INFO ] [MAIN ] BGSF: Generated 1794 derivative records from 8227 primary records. [2025-10-22T22:05:56.388853] [DEBUG] [LOCAL ] BGR: Derivative data saved (1794 records). [2025-10-22T22:05:56.390579] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-10-22T22:05:56.393235] [INFO ] [MAIN ] Derivative Progress: 208/2052 symbols completed. BGR took 1.2s. Estimated remaining: 11m 44s. Rate: 157.2 symbols/min [2025-10-22T22:05:56.390868] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-22T22:05:56.413262] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1794 records). [2025-10-22T22:05:56.413407] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-10-22T22:05:56.415803] [INFO ] [MAIN ] Derivative Progress: 209/2052 symbols completed. BGSF took 1.1s. Estimated remaining: 11m 40s. Rate: 157.9 symbols/min [2025-10-22T22:05:56.436785] [DEBUG] [MAIN ] BGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:56.437600] [INFO ] [MAIN ] BGS: Generated 1794 derivative records from 50530 primary records. [2025-10-22T22:05:56.437690] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-22T22:05:56.455786] [DEBUG] [LOCAL ] BGS: Derivative data saved (1794 records). [2025-10-22T22:05:56.455929] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-22T22:05:56.458768] [INFO ] [MAIN ] Derivative Progress: 210/2052 symbols completed. BGS took 1.3s. Estimated remaining: 11m 37s. Rate: 158.6 symbols/min [2025-10-22T22:05:56.459335] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:56.459400] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:56.459865] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:56.480521] [DEBUG] [LOCAL ] BGX: Loaded 11188 existing records from primary storage. [2025-10-22T22:05:56.480856] [INFO ] [MAIN ] BGX: Loaded 11188 primary data records. [2025-10-22T22:05:56.556204] [DEBUG] [LOCAL ] BGT: Loaded 16184 existing records from primary storage. [2025-10-22T22:05:56.574279] [INFO ] [MAIN ] BGT: Loaded 16184 primary data records. [2025-10-22T22:05:56.613891] [DEBUG] [LOCAL ] BGY: Loaded 21389 existing records from primary storage. [2025-10-22T22:05:56.640277] [INFO ] [MAIN ] BGY: Loaded 21389 primary data records. [2025-10-22T22:05:57.552616] [DEBUG] [MAIN ] BGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:57.554489] [INFO ] [MAIN ] BGX: Generated 1794 derivative records from 11188 primary records. [2025-10-22T22:05:57.555911] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-22T22:05:57.582230] [DEBUG] [LOCAL ] BGX: Derivative data saved (1794 records). [2025-10-22T22:05:57.594619] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-22T22:05:57.601246] [INFO ] [MAIN ] Derivative Progress: 211/2052 symbols completed. BGX took 1.1s. Estimated remaining: 11m 43s. Rate: 157.1 symbols/min [2025-10-22T22:05:57.601864] [DEBUG] [MAIN ] BGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:57.602239] [DEBUG] [MAIN ] BGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:57.602380] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:57.603231] [INFO ] [MAIN ] BGY: Generated 1794 derivative records from 21389 primary records. [2025-10-22T22:05:57.603853] [INFO ] [MAIN ] BGT: Generated 1794 derivative records from 16184 primary records. [2025-10-22T22:05:57.604379] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-22T22:05:57.604471] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-22T22:05:57.635063] [DEBUG] [LOCAL ] BGT: Derivative data saved (1794 records). [2025-10-22T22:05:57.635155] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-22T22:05:57.638612] [INFO ] [MAIN ] Derivative Progress: 212/2052 symbols completed. BGT took 1.2s. Estimated remaining: 11m 40s. Rate: 157.7 symbols/min [2025-10-22T22:05:57.640163] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:57.639958] [DEBUG] [LOCAL ] BGY: Derivative data saved (1794 records). [2025-10-22T22:05:57.641459] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-22T22:05:57.644267] [INFO ] [MAIN ] Derivative Progress: 213/2052 symbols completed. BGY took 1.2s. Estimated remaining: 11m 36s. Rate: 158.5 symbols/min [2025-10-22T22:05:57.644451] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:57.685451] [DEBUG] [LOCAL ] BHC: Loaded 46589 existing records from primary storage. [2025-10-22T22:05:57.685727] [INFO ] [MAIN ] BHC: Loaded 46589 primary data records. [2025-10-22T22:05:57.738749] [DEBUG] [LOCAL ] BHK: Loaded 23957 existing records from primary storage. [2025-10-22T22:05:57.752366] [DEBUG] [LOCAL ] BHE: Loaded 23698 existing records from primary storage. [2025-10-22T22:05:57.762265] [INFO ] [MAIN ] BHK: Loaded 23957 primary data records. [2025-10-22T22:05:57.771617] [INFO ] [MAIN ] BHE: Loaded 23698 primary data records. [2025-10-22T22:05:58.649170] [DEBUG] [MAIN ] BHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:58.652098] [INFO ] [MAIN ] BHC: Generated 1794 derivative records from 46589 primary records. [2025-10-22T22:05:58.652383] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-22T22:05:58.669103] [DEBUG] [MAIN ] BHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:58.684387] [DEBUG] [LOCAL ] BHC: Derivative data saved (1794 records). [2025-10-22T22:05:58.684532] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-22T22:05:58.699914] [INFO ] [MAIN ] Derivative Progress: 214/2052 symbols completed. BHC took 1.1s. Estimated remaining: 11m 42s. Rate: 157.2 symbols/min [2025-10-22T22:05:58.693104] [INFO ] [MAIN ] BHK: Generated 1794 derivative records from 23957 primary records. [2025-10-22T22:05:58.700815] [DEBUG] [MAIN ] BHE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:58.700904] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-10-22T22:05:58.700441] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:58.701904] [INFO ] [MAIN ] BHE: Generated 1794 derivative records from 23698 primary records. [2025-10-22T22:05:58.703664] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-22T22:05:58.719736] [DEBUG] [LOCAL ] BHK: Derivative data saved (1794 records). [2025-10-22T22:05:58.720189] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-10-22T22:05:58.733791] [INFO ] [MAIN ] Derivative Progress: 215/2052 symbols completed. BHK took 1.1s. Estimated remaining: 11m 38s. Rate: 157.8 symbols/min [2025-10-22T22:05:58.738081] [DEBUG] [LOCAL ] BHE: Derivative data saved (1794 records). [2025-10-22T22:05:58.738488] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:58.738778] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-22T22:05:58.741624] [INFO ] [MAIN ] Derivative Progress: 216/2052 symbols completed. BHE took 1.1s. Estimated remaining: 11m 35s. Rate: 158.5 symbols/min [2025-10-22T22:05:58.741899] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:58.760126] [DEBUG] [LOCAL ] BHR: Loaded 21979 existing records from primary storage. [2025-10-22T22:05:58.760735] [INFO ] [MAIN ] BHR: Loaded 21979 primary data records. [2025-10-22T22:05:59.120779] [DEBUG] [LOCAL ] BHVN: Loaded 50633 existing records from primary storage. [2025-10-22T22:05:59.122097] [DEBUG] [LOCAL ] BILL: Loaded 52500 existing records from primary storage. [2025-10-22T22:05:59.122236] [INFO ] [MAIN ] BHVN: Loaded 50633 primary data records. [2025-10-22T22:05:59.122341] [INFO ] [MAIN ] BILL: Loaded 52500 primary data records. [2025-10-22T22:05:59.822528] [DEBUG] [MAIN ] BHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:59.823918] [INFO ] [MAIN ] BHR: Generated 1794 derivative records from 21979 primary records. [2025-10-22T22:05:59.824200] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-22T22:05:59.846015] [DEBUG] [LOCAL ] BHR: Derivative data saved (1794 records). [2025-10-22T22:05:59.846985] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-10-22T22:05:59.849486] [INFO ] [MAIN ] Derivative Progress: 217/2052 symbols completed. BHR took 1.1s. Estimated remaining: 11m 41s. Rate: 157.1 symbols/min [2025-10-22T22:05:59.850193] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:05:59.873151] [DEBUG] [MAIN ] BHVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:59.892323] [INFO ] [MAIN ] BHVN: Generated 1794 derivative records from 50633 primary records. [2025-10-22T22:05:59.892893] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-22T22:05:59.892825] [DEBUG] [MAIN ] BILL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:05:59.893487] [INFO ] [MAIN ] BILL: Generated 1794 derivative records from 52500 primary records. [2025-10-22T22:05:59.894311] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-22T22:05:59.914694] [DEBUG] [LOCAL ] BIO: Loaded 23819 existing records from primary storage. [2025-10-22T22:05:59.918013] [INFO ] [MAIN ] BIO: Loaded 23819 primary data records. [2025-10-22T22:05:59.918986] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1794 records). [2025-10-22T22:05:59.926112] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-22T22:05:59.963222] [INFO ] [MAIN ] Derivative Progress: 218/2052 symbols completed. BHVN took 1.2s. Estimated remaining: 11m 38s. Rate: 157.7 symbols/min [2025-10-22T22:05:59.979116] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:00.009096] [DEBUG] [LOCAL ] BILL: Derivative data saved (1794 records). [2025-10-22T22:06:00.016289] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-22T22:06:00.024268] [INFO ] [MAIN ] Derivative Progress: 219/2052 symbols completed. BILL took 1.3s. Estimated remaining: 11m 35s. Rate: 158.3 symbols/min [2025-10-22T22:06:00.039635] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:00.295295] [DEBUG] [LOCAL ] BIP: Loaded 38919 existing records from primary storage. [2025-10-22T22:06:00.295896] [INFO ] [MAIN ] BIP: Loaded 38919 primary data records. [2025-10-22T22:06:00.414546] [DEBUG] [LOCAL ] BIPC: Loaded 41113 existing records from primary storage. [2025-10-22T22:06:00.416170] [INFO ] [MAIN ] BIPC: Loaded 41113 primary data records. [2025-10-22T22:06:00.791046] [DEBUG] [MAIN ] BIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:00.815288] [INFO ] [MAIN ] BIO: Generated 1794 derivative records from 23819 primary records. [2025-10-22T22:06:00.941366] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-10-22T22:06:00.960408] [DEBUG] [LOCAL ] BIO: Derivative data saved (1794 records). [2025-10-22T22:06:00.961488] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-10-22T22:06:00.964029] [INFO ] [MAIN ] Derivative Progress: 220/2052 symbols completed. BIO took 1.1s. Estimated remaining: 11m 39s. Rate: 157.2 symbols/min [2025-10-22T22:06:00.964571] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:00.972859] [DEBUG] [LOCAL ] BIPH: Loaded 2352 existing records from primary storage. [2025-10-22T22:06:00.973125] [INFO ] [MAIN ] BIPH: Loaded 2352 primary data records. [2025-10-22T22:06:01.033479] [DEBUG] [MAIN ] BIP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:01.061376] [INFO ] [MAIN ] BIP: Generated 1794 derivative records from 38919 primary records. [2025-10-22T22:06:01.069070] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-22T22:06:01.128157] [DEBUG] [LOCAL ] BIP: Derivative data saved (1794 records). [2025-10-22T22:06:01.133671] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-22T22:06:01.146284] [INFO ] [MAIN ] Derivative Progress: 221/2052 symbols completed. BIP took 1.2s. Estimated remaining: 11m 37s. Rate: 157.6 symbols/min [2025-10-22T22:06:01.157080] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:01.398106] [DEBUG] [LOCAL ] BIPI: Loaded 2816 existing records from primary storage. [2025-10-22T22:06:01.400158] [INFO ] [MAIN ] BIPI: Loaded 2816 primary data records. [2025-10-22T22:06:01.400498] [DEBUG] [MAIN ] BIPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:01.423065] [INFO ] [MAIN ] BIPC: Generated 1794 derivative records from 41113 primary records. [2025-10-22T22:06:01.458493] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-10-22T22:06:01.525204] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1794 records). [2025-10-22T22:06:01.541141] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-10-22T22:06:01.548633] [INFO ] [MAIN ] Derivative Progress: 222/2052 symbols completed. BIPC took 1.5s. Estimated remaining: 11m 37s. Rate: 157.5 symbols/min [2025-10-22T22:06:01.598249] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:01.722988] [DEBUG] [LOCAL ] BIPJ: Loaded 3106 existing records from primary storage. [2025-10-22T22:06:01.724077] [INFO ] [MAIN ] BIPJ: Loaded 3106 primary data records. [2025-10-22T22:06:01.915472] [DEBUG] [MAIN ] BIPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:02.032562] [INFO ] [MAIN ] BIPH: Generated 1794 derivative records from 2352 primary records. [2025-10-22T22:06:02.033281] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-22T22:06:02.049150] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1794 records). [2025-10-22T22:06:02.049828] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-22T22:06:02.052103] [INFO ] [MAIN ] Derivative Progress: 223/2052 symbols completed. BIPH took 1.1s. Estimated remaining: 11m 38s. Rate: 157.3 symbols/min [2025-10-22T22:06:02.068819] [DEBUG] [MAIN ] BIPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:02.069448] [INFO ] [MAIN ] BIPI: Generated 1794 derivative records from 2816 primary records. [2025-10-22T22:06:02.069590] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-22T22:06:02.086306] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1794 records). [2025-10-22T22:06:02.098525] [DEBUG] [MAIN ] BIPJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:02.098580] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-22T22:06:02.099265] [INFO ] [MAIN ] BIPJ: Generated 1794 derivative records from 3106 primary records. [2025-10-22T22:06:02.101414] [INFO ] [MAIN ] Derivative Progress: 224/2052 symbols completed. BIPI took 0.9s. Estimated remaining: 11m 35s. Rate: 157.9 symbols/min [2025-10-22T22:06:02.101602] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-22T22:06:02.114889] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1794 records). [2025-10-22T22:06:02.114945] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-22T22:06:02.117247] [INFO ] [MAIN ] Derivative Progress: 225/2052 symbols completed. BIPJ took 0.5s. Estimated remaining: 11m 31s. Rate: 158.6 symbols/min [2025-10-22T22:06:02.118100] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:02.118274] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:02.118205] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:02.154680] [DEBUG] [LOCAL ] BIT: Loaded 23774 existing records from primary storage. [2025-10-22T22:06:02.154951] [INFO ] [MAIN ] BIT: Loaded 23774 primary data records. [2025-10-22T22:06:02.319683] [DEBUG] [LOCAL ] BIRK: Loaded 51188 existing records from primary storage. [2025-10-22T22:06:02.338064] [INFO ] [MAIN ] BIRK: Loaded 51188 primary data records. [2025-10-22T22:06:02.429594] [DEBUG] [LOCAL ] BJ: Loaded 51505 existing records from primary storage. [2025-10-22T22:06:02.518749] [INFO ] [MAIN ] BJ: Loaded 51505 primary data records. [2025-10-22T22:06:03.100127] [DEBUG] [MAIN ] BIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:03.101335] [INFO ] [MAIN ] BIT: Generated 1794 derivative records from 23774 primary records. [2025-10-22T22:06:03.101750] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-22T22:06:03.120341] [DEBUG] [LOCAL ] BIT: Derivative data saved (1794 records). [2025-10-22T22:06:03.121210] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-22T22:06:03.123939] [INFO ] [MAIN ] Derivative Progress: 226/2052 symbols completed. BIT took 1.0s. Estimated remaining: 11m 36s. Rate: 157.4 symbols/min [2025-10-22T22:06:03.124307] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:03.139318] [DEBUG] [MAIN ] BIRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:03.140340] [INFO ] [MAIN ] BIRK: Generated 1794 derivative records from 51188 primary records. [2025-10-22T22:06:03.140592] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-22T22:06:03.154232] [DEBUG] [MAIN ] BJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:03.162147] [INFO ] [MAIN ] BJ: Generated 1794 derivative records from 51505 primary records. [2025-10-22T22:06:03.163272] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-22T22:06:03.186305] [DEBUG] [LOCAL ] BJ: Derivative data saved (1794 records). [2025-10-22T22:06:03.187725] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-22T22:06:03.187622] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1794 records). [2025-10-22T22:06:03.190001] [INFO ] [MAIN ] Derivative Progress: 227/2052 symbols completed. BJ took 1.1s. Estimated remaining: 11m 33s. Rate: 158.0 symbols/min [2025-10-22T22:06:03.190161] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-22T22:06:03.193003] [INFO ] [MAIN ] Derivative Progress: 228/2052 symbols completed. BIRK took 1.1s. Estimated remaining: 11m 30s. Rate: 158.7 symbols/min [2025-10-22T22:06:03.193281] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:03.192915] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:03.232485] [DEBUG] [LOCAL ] BK: Loaded 53546 existing records from primary storage. [2025-10-22T22:06:03.232848] [INFO ] [MAIN ] BK: Loaded 53546 primary data records. [2025-10-22T22:06:03.368444] [DEBUG] [LOCAL ] BKKT: Loaded 37391 existing records from primary storage. [2025-10-22T22:06:03.407369] [INFO ] [MAIN ] BKKT: Loaded 37391 primary data records. [2025-10-22T22:06:03.696188] [DEBUG] [LOCAL ] BKD: Loaded 50408 existing records from primary storage. [2025-10-22T22:06:03.713097] [INFO ] [MAIN ] BKD: Loaded 50408 primary data records. [2025-10-22T22:06:04.201569] [DEBUG] [MAIN ] BK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:04.202715] [INFO ] [MAIN ] BK: Generated 1794 derivative records from 53546 primary records. [2025-10-22T22:06:04.203146] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-22T22:06:04.223347] [DEBUG] [LOCAL ] BK: Derivative data saved (1794 records). [2025-10-22T22:06:04.223625] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-22T22:06:04.226056] [INFO ] [MAIN ] Derivative Progress: 229/2052 symbols completed. BK took 1.1s. Estimated remaining: 11m 34s. Rate: 157.5 symbols/min [2025-10-22T22:06:04.226386] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:04.240253] [DEBUG] [MAIN ] BKKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:04.240975] [INFO ] [MAIN ] BKKT: Generated 1794 derivative records from 37391 primary records. [2025-10-22T22:06:04.241133] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-22T22:06:04.276359] [DEBUG] [MAIN ] BKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:04.273018] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1794 records). [2025-10-22T22:06:04.276678] [DEBUG] [LOCAL ] BKN: Loaded 7279 existing records from primary storage. [2025-10-22T22:06:04.276741] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-22T22:06:04.279485] [INFO ] [MAIN ] Derivative Progress: 230/2052 symbols completed. BKKT took 1.1s. Estimated remaining: 11m 31s. Rate: 158.1 symbols/min [2025-10-22T22:06:04.277320] [INFO ] [MAIN ] BKD: Generated 1794 derivative records from 50408 primary records. [2025-10-22T22:06:04.279773] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-22T22:06:04.279701] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:04.279599] [INFO ] [MAIN ] BKN: Loaded 7279 primary data records. [2025-10-22T22:06:04.375785] [DEBUG] [LOCAL ] BKD: Derivative data saved (1794 records). [2025-10-22T22:06:04.381105] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-22T22:06:04.396601] [INFO ] [MAIN ] Derivative Progress: 231/2052 symbols completed. BKD took 1.2s. Estimated remaining: 11m 29s. Rate: 158.6 symbols/min [2025-10-22T22:06:04.400282] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:04.614131] [DEBUG] [LOCAL ] BKT: Loaded 12833 existing records from primary storage. [2025-10-22T22:06:04.614491] [INFO ] [MAIN ] BKT: Loaded 12833 primary data records. [2025-10-22T22:06:04.671913] [DEBUG] [LOCAL ] BKSY: Loaded 48912 existing records from primary storage. [2025-10-22T22:06:04.698062] [INFO ] [MAIN ] BKSY: Loaded 48912 primary data records. [2025-10-22T22:06:05.271189] [DEBUG] [MAIN ] BKN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:05.273057] [INFO ] [MAIN ] BKN: Generated 1794 derivative records from 7279 primary records. [2025-10-22T22:06:05.273397] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-22T22:06:05.293124] [DEBUG] [LOCAL ] BKN: Derivative data saved (1794 records). [2025-10-22T22:06:05.294683] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-22T22:06:05.296933] [INFO ] [MAIN ] Derivative Progress: 232/2052 symbols completed. BKN took 1.1s. Estimated remaining: 11m 33s. Rate: 157.6 symbols/min [2025-10-22T22:06:05.297210] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:05.318894] [DEBUG] [MAIN ] BKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:05.320941] [INFO ] [MAIN ] BKT: Generated 1794 derivative records from 12833 primary records. [2025-10-22T22:06:05.321120] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-22T22:06:05.348758] [DEBUG] [LOCAL ] BKT: Derivative data saved (1794 records). [2025-10-22T22:06:05.349090] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-22T22:06:05.351163] [INFO ] [MAIN ] Derivative Progress: 233/2052 symbols completed. BKT took 1.0s. Estimated remaining: 11m 30s. Rate: 158.2 symbols/min [2025-10-22T22:06:05.349021] [DEBUG] [MAIN ] BKSY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:05.351356] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:05.352191] [INFO ] [MAIN ] BKSY: Generated 1794 derivative records from 48912 primary records. [2025-10-22T22:06:05.352582] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-22T22:06:05.369806] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1794 records). [2025-10-22T22:06:05.370049] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-22T22:06:05.372775] [INFO ] [MAIN ] Derivative Progress: 234/2052 symbols completed. BKSY took 1.1s. Estimated remaining: 11m 27s. Rate: 158.9 symbols/min [2025-10-22T22:06:05.372986] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:05.416748] [DEBUG] [LOCAL ] BKV: Loaded 29342 existing records from primary storage. [2025-10-22T22:06:05.417003] [INFO ] [MAIN ] BKV: Loaded 29342 primary data records. [2025-10-22T22:06:05.417867] [DEBUG] [LOCAL ] BKU: Loaded 42169 existing records from primary storage. [2025-10-22T22:06:05.501259] [INFO ] [MAIN ] BKU: Loaded 42169 primary data records. [2025-10-22T22:06:05.670579] [DEBUG] [LOCAL ] BLCO: Loaded 34928 existing records from primary storage. [2025-10-22T22:06:05.688890] [INFO ] [MAIN ] BLCO: Loaded 34928 primary data records. [2025-10-22T22:06:06.356548] [DEBUG] [MAIN ] BKV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:06.357402] [INFO ] [MAIN ] BKV: Generated 1794 derivative records from 29342 primary records. [2025-10-22T22:06:06.357619] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-22T22:06:06.378856] [DEBUG] [LOCAL ] BKV: Derivative data saved (1794 records). [2025-10-22T22:06:06.386354] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-10-22T22:06:06.388774] [INFO ] [MAIN ] Derivative Progress: 235/2052 symbols completed. BKV took 1.0s. Estimated remaining: 11m 31s. Rate: 157.7 symbols/min [2025-10-22T22:06:06.394040] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:06.394548] [DEBUG] [MAIN ] BKU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:06.395419] [INFO ] [MAIN ] BKU: Generated 1794 derivative records from 42169 primary records. [2025-10-22T22:06:06.395981] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-22T22:06:06.412744] [DEBUG] [LOCAL ] BKU: Derivative data saved (1794 records). [2025-10-22T22:06:06.414331] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-22T22:06:06.416734] [INFO ] [MAIN ] Derivative Progress: 236/2052 symbols completed. BKU took 1.1s. Estimated remaining: 11m 28s. Rate: 158.4 symbols/min [2025-10-22T22:06:06.416974] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:06.431740] [DEBUG] [MAIN ] BLCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:06.440510] [INFO ] [MAIN ] BLCO: Generated 1794 derivative records from 34928 primary records. [2025-10-22T22:06:06.440763] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-22T22:06:06.466845] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1794 records). [2025-10-22T22:06:06.467011] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-22T22:06:06.470499] [DEBUG] [LOCAL ] BLD: Loaded 27046 existing records from primary storage. [2025-10-22T22:06:06.469491] [INFO ] [MAIN ] Derivative Progress: 237/2052 symbols completed. BLCO took 1.1s. Estimated remaining: 11m 25s. Rate: 158.9 symbols/min [2025-10-22T22:06:06.470733] [INFO ] [MAIN ] BLD: Loaded 27046 primary data records. [2025-10-22T22:06:06.470847] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:06.618293] [DEBUG] [LOCAL ] BLE: Loaded 13616 existing records from primary storage. [2025-10-22T22:06:06.624087] [INFO ] [MAIN ] BLE: Loaded 13616 primary data records. [2025-10-22T22:06:06.942743] [DEBUG] [LOCAL ] BLDR: Loaded 51855 existing records from primary storage. [2025-10-22T22:06:06.954984] [INFO ] [MAIN ] BLDR: Loaded 51855 primary data records. [2025-10-22T22:06:07.508834] [DEBUG] [MAIN ] BLD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:06:07.509963] [INFO ] [MAIN ] BLD: Generated 1793 derivative records from 27046 primary records. [2025-10-22T22:06:07.510437] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-10-22T22:06:07.530794] [DEBUG] [LOCAL ] BLD: Derivative data saved (1793 records). [2025-10-22T22:06:07.530975] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-10-22T22:06:07.533353] [INFO ] [MAIN ] Derivative Progress: 238/2052 symbols completed. BLD took 1.1s. Estimated remaining: 11m 30s. Rate: 157.7 symbols/min [2025-10-22T22:06:07.549756] [DEBUG] [MAIN ] BLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:07.550616] [INFO ] [MAIN ] BLE: Generated 1794 derivative records from 13616 primary records. [2025-10-22T22:06:07.550781] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-22T22:06:07.568532] [DEBUG] [LOCAL ] BLE: Derivative data saved (1794 records). [2025-10-22T22:06:07.581234] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-22T22:06:07.583560] [INFO ] [MAIN ] Derivative Progress: 239/2052 symbols completed. BLE took 1.1s. Estimated remaining: 11m 27s. Rate: 158.3 symbols/min [2025-10-22T22:06:07.584186] [DEBUG] [MAIN ] BLDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:07.584834] [INFO ] [MAIN ] BLDR: Generated 1794 derivative records from 51855 primary records. [2025-10-22T22:06:07.584896] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-22T22:06:07.601291] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1794 records). [2025-10-22T22:06:07.601357] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-22T22:06:07.604390] [INFO ] [MAIN ] Derivative Progress: 240/2052 symbols completed. BLDR took 1.2s. Estimated remaining: 11m 24s. Rate: 158.9 symbols/min [2025-10-22T22:06:07.604905] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:07.605171] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:07.605368] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:07.624409] [DEBUG] [LOCAL ] BLX: Loaded 15410 existing records from primary storage. [2025-10-22T22:06:07.624622] [INFO ] [MAIN ] BLX: Loaded 15410 primary data records. [2025-10-22T22:06:07.798922] [DEBUG] [LOCAL ] BLK: Loaded 34184 existing records from primary storage. [2025-10-22T22:06:07.965357] [INFO ] [MAIN ] BLK: Loaded 34184 primary data records. [2025-10-22T22:06:08.020422] [DEBUG] [LOCAL ] BLND: Loaded 49215 existing records from primary storage. [2025-10-22T22:06:08.030700] [INFO ] [MAIN ] BLND: Loaded 49215 primary data records. [2025-10-22T22:06:08.650034] [DEBUG] [MAIN ] BLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:08.651283] [INFO ] [MAIN ] BLX: Generated 1794 derivative records from 15410 primary records. [2025-10-22T22:06:08.651940] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-22T22:06:08.671327] [DEBUG] [LOCAL ] BLX: Derivative data saved (1794 records). [2025-10-22T22:06:08.671888] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-22T22:06:08.674215] [INFO ] [MAIN ] Derivative Progress: 241/2052 symbols completed. BLX took 1.1s. Estimated remaining: 11m 29s. Rate: 157.7 symbols/min [2025-10-22T22:06:08.674723] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:08.694171] [DEBUG] [MAIN ] BLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:08.696143] [INFO ] [MAIN ] BLK: Generated 1794 derivative records from 34184 primary records. [2025-10-22T22:06:08.698491] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-22T22:06:08.721201] [DEBUG] [MAIN ] BLND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:08.730378] [INFO ] [MAIN ] BLND: Generated 1794 derivative records from 49215 primary records. [2025-10-22T22:06:08.739359] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-22T22:06:08.729435] [DEBUG] [LOCAL ] BLK: Derivative data saved (1794 records). [2025-10-22T22:06:08.740131] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-22T22:06:08.743099] [INFO ] [MAIN ] Derivative Progress: 242/2052 symbols completed. BLK took 1.1s. Estimated remaining: 11m 26s. Rate: 158.3 symbols/min [2025-10-22T22:06:08.743315] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:08.760181] [DEBUG] [LOCAL ] BLND: Derivative data saved (1794 records). [2025-10-22T22:06:08.770735] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-22T22:06:08.773472] [INFO ] [MAIN ] Derivative Progress: 243/2052 symbols completed. BLND took 1.2s. Estimated remaining: 11m 23s. Rate: 158.9 symbols/min [2025-10-22T22:06:08.774767] [DEBUG] [LOCAL ] BMA: Loaded 36532 existing records from primary storage. [2025-10-22T22:06:08.773705] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:08.778067] [INFO ] [MAIN ] BMA: Loaded 36532 primary data records. [2025-10-22T22:06:08.850635] [DEBUG] [LOCAL ] BME: Loaded 11221 existing records from primary storage. [2025-10-22T22:06:08.870889] [INFO ] [MAIN ] BME: Loaded 11221 primary data records. [2025-10-22T22:06:09.067042] [DEBUG] [LOCAL ] BMEZ: Loaded 25062 existing records from primary storage. [2025-10-22T22:06:09.107236] [INFO ] [MAIN ] BMEZ: Loaded 25062 primary data records. [2025-10-22T22:06:09.765250] [DEBUG] [MAIN ] BMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:09.768697] [INFO ] [MAIN ] BMA: Generated 1794 derivative records from 36532 primary records. [2025-10-22T22:06:09.777378] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-22T22:06:09.784239] [DEBUG] [MAIN ] BME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:09.799511] [INFO ] [MAIN ] BME: Generated 1794 derivative records from 11221 primary records. [2025-10-22T22:06:09.800806] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-22T22:06:09.801768] [DEBUG] [LOCAL ] BMA: Derivative data saved (1794 records). [2025-10-22T22:06:09.813753] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-22T22:06:09.820225] [DEBUG] [LOCAL ] BME: Derivative data saved (1794 records). [2025-10-22T22:06:09.820386] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-22T22:06:09.820127] [INFO ] [MAIN ] Derivative Progress: 244/2052 symbols completed. BMA took 1.1s. Estimated remaining: 11m 28s. Rate: 157.7 symbols/min [2025-10-22T22:06:09.823195] [INFO ] [MAIN ] Derivative Progress: 245/2052 symbols completed. BME took 1.1s. Estimated remaining: 11m 25s. Rate: 158.4 symbols/min [2025-10-22T22:06:09.820589] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:09.824188] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:09.841994] [DEBUG] [MAIN ] BMEZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:09.843032] [INFO ] [MAIN ] BMEZ: Generated 1794 derivative records from 25062 primary records. [2025-10-22T22:06:09.843263] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-10-22T22:06:09.845900] [DEBUG] [LOCAL ] BMN: Loaded 2644 existing records from primary storage. [2025-10-22T22:06:09.846783] [INFO ] [MAIN ] BMN: Loaded 2644 primary data records. [2025-10-22T22:06:09.983262] [DEBUG] [LOCAL ] BMI: Loaded 24901 existing records from primary storage. [2025-10-22T22:06:09.982769] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1794 records). [2025-10-22T22:06:09.987064] [INFO ] [MAIN ] BMI: Loaded 24901 primary data records. [2025-10-22T22:06:09.987624] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-10-22T22:06:10.024088] [INFO ] [MAIN ] Derivative Progress: 246/2052 symbols completed. BMEZ took 1.3s. Estimated remaining: 11m 23s. Rate: 158.7 symbols/min [2025-10-22T22:06:10.211764] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:10.534559] [DEBUG] [MAIN ] BMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:10.535390] [INFO ] [MAIN ] BMN: Generated 1794 derivative records from 2644 primary records. [2025-10-22T22:06:10.537837] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-22T22:06:10.567769] [DEBUG] [LOCAL ] BMN: Derivative data saved (1794 records). [2025-10-22T22:06:10.563940] [DEBUG] [LOCAL ] BMO: Loaded 40992 existing records from primary storage. [2025-10-22T22:06:10.568047] [INFO ] [MAIN ] BMO: Loaded 40992 primary data records. [2025-10-22T22:06:10.568161] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-10-22T22:06:10.570817] [INFO ] [MAIN ] Derivative Progress: 247/2052 symbols completed. BMN took 0.7s. Estimated remaining: 11m 24s. Rate: 158.4 symbols/min [2025-10-22T22:06:10.576292] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:10.763312] [DEBUG] [MAIN ] BMI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:06:10.785976] [INFO ] [MAIN ] BMI: Generated 1793 derivative records from 24901 primary records. [2025-10-22T22:06:10.895348] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-22T22:06:10.953417] [DEBUG] [LOCAL ] BMI: Derivative data saved (1793 records). [2025-10-22T22:06:10.976389] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-22T22:06:10.979340] [INFO ] [MAIN ] Derivative Progress: 248/2052 symbols completed. BMI took 1.2s. Estimated remaining: 11m 24s. Rate: 158.3 symbols/min [2025-10-22T22:06:10.979727] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:10.981626] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-22T22:06:10.983966] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-10-22T22:06:11.408529] [DEBUG] [MAIN ] BMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:11.412113] [INFO ] [MAIN ] BMO: Generated 1794 derivative records from 40992 primary records. [2025-10-22T22:06:11.412412] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-22T22:06:11.414308] [DEBUG] [LOCAL ] BN: Loaded 52983 existing records from primary storage. [2025-10-22T22:06:11.414925] [INFO ] [MAIN ] BN: Loaded 52983 primary data records. [2025-10-22T22:06:11.472236] [DEBUG] [LOCAL ] BMO: Derivative data saved (1794 records). [2025-10-22T22:06:11.480133] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-22T22:06:11.482326] [INFO ] [MAIN ] Derivative Progress: 249/2052 symbols completed. BMO took 1.3s. Estimated remaining: 11m 24s. Rate: 158.1 symbols/min [2025-10-22T22:06:11.487944] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:11.781865] [DEBUG] [LOCAL ] BNED: Loaded 28217 existing records from primary storage. [2025-10-22T22:06:11.782477] [DEBUG] [MAIN ] BMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:11.787945] [INFO ] [MAIN ] BNED: Loaded 28217 primary data records. [2025-10-22T22:06:11.799157] [INFO ] [MAIN ] BMY: Generated 1794 derivative records from 53757 primary records. [2025-10-22T22:06:11.830593] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-22T22:06:11.913302] [DEBUG] [LOCAL ] BMY: Derivative data saved (1794 records). [2025-10-22T22:06:11.925718] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-10-22T22:06:11.929679] [INFO ] [MAIN ] Derivative Progress: 250/2052 symbols completed. BMY took 1.4s. Estimated remaining: 11m 24s. Rate: 158.0 symbols/min [2025-10-22T22:06:11.929934] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:12.131115] [DEBUG] [LOCAL ] BNH: Loaded 4701 existing records from primary storage. [2025-10-22T22:06:12.131299] [INFO ] [MAIN ] BNH: Loaded 4701 primary data records. [2025-10-22T22:06:12.446619] [DEBUG] [MAIN ] BN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:12.448176] [INFO ] [MAIN ] BN: Generated 1794 derivative records from 52983 primary records. [2025-10-22T22:06:12.448519] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-22T22:06:12.470859] [DEBUG] [LOCAL ] BN: Derivative data saved (1794 records). [2025-10-22T22:06:12.471434] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-10-22T22:06:12.486577] [INFO ] [MAIN ] Derivative Progress: 251/2052 symbols completed. BN took 1.5s. Estimated remaining: 11m 25s. Rate: 157.7 symbols/min [2025-10-22T22:06:12.487434] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:12.488479] [DEBUG] [MAIN ] BNED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:12.489524] [INFO ] [MAIN ] BNED: Generated 1794 derivative records from 28217 primary records. [2025-10-22T22:06:12.489749] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-22T22:06:12.502218] [DEBUG] [LOCAL ] BNJ: Loaded 2500 existing records from primary storage. [2025-10-22T22:06:12.506364] [INFO ] [MAIN ] BNJ: Loaded 2500 primary data records. [2025-10-22T22:06:12.548543] [DEBUG] [LOCAL ] BNED: Derivative data saved (1794 records). [2025-10-22T22:06:12.567814] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-22T22:06:12.591065] [INFO ] [MAIN ] Derivative Progress: 252/2052 symbols completed. BNED took 1.1s. Estimated remaining: 11m 23s. Rate: 158.2 symbols/min [2025-10-22T22:06:12.596410] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:12.837408] [DEBUG] [MAIN ] BNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:12.838818] [INFO ] [MAIN ] BNH: Generated 1794 derivative records from 4701 primary records. [2025-10-22T22:06:12.838908] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-22T22:06:12.866830] [DEBUG] [LOCAL ] BNH: Derivative data saved (1794 records). [2025-10-22T22:06:12.867078] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-22T22:06:12.869547] [INFO ] [MAIN ] Derivative Progress: 253/2052 symbols completed. BNH took 0.9s. Estimated remaining: 11m 22s. Rate: 158.3 symbols/min [2025-10-22T22:06:12.892753] [DEBUG] [LOCAL ] BNL: Loaded 47073 existing records from primary storage. [2025-10-22T22:06:12.893114] [INFO ] [MAIN ] BNL: Loaded 47073 primary data records. [2025-10-22T22:06:12.985076] [DEBUG] [MAIN ] BNJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:13.001418] [INFO ] [MAIN ] BNJ: Generated 1794 derivative records from 2500 primary records. [2025-10-22T22:06:13.001499] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-22T22:06:13.080261] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1794 records). [2025-10-22T22:06:13.095781] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-22T22:06:13.103896] [INFO ] [MAIN ] Derivative Progress: 254/2052 symbols completed. BNJ took 0.6s. Estimated remaining: 11m 20s. Rate: 158.6 symbols/min [2025-10-22T22:06:13.270336] [DEBUG] [MAIN ] BNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:13.270983] [INFO ] [MAIN ] BNL: Generated 1794 derivative records from 47073 primary records. [2025-10-22T22:06:13.271046] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-22T22:06:13.285847] [DEBUG] [LOCAL ] BNL: Derivative data saved (1794 records). [2025-10-22T22:06:13.285902] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-22T22:06:13.288046] [INFO ] [MAIN ] Derivative Progress: 255/2052 symbols completed. BNL took 0.7s. Estimated remaining: 11m 19s. Rate: 158.9 symbols/min [2025-10-22T22:06:13.288749] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:13.289132] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:13.288808] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:13.297554] [DEBUG] [LOCAL ] BNT: Loaded 3527 existing records from primary storage. [2025-10-22T22:06:13.297858] [INFO ] [MAIN ] BNT: Loaded 3527 primary data records. [2025-10-22T22:06:13.357607] [DEBUG] [LOCAL ] BNY: Loaded 7253 existing records from primary storage. [2025-10-22T22:06:13.366898] [INFO ] [MAIN ] BNY: Loaded 7253 primary data records. [2025-10-22T22:06:13.944097] [DEBUG] [LOCAL ] BNS: Loaded 51416 existing records from primary storage. [2025-10-22T22:06:13.944862] [INFO ] [MAIN ] BNS: Loaded 51416 primary data records. [2025-10-22T22:06:14.266116] [DEBUG] [MAIN ] BNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:14.268116] [INFO ] [MAIN ] BNT: Generated 1794 derivative records from 3527 primary records. [2025-10-22T22:06:14.270597] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-22T22:06:14.293760] [DEBUG] [MAIN ] BNY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:14.300692] [DEBUG] [LOCAL ] BNT: Derivative data saved (1794 records). [2025-10-22T22:06:14.300887] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-22T22:06:14.301853] [INFO ] [MAIN ] BNY: Generated 1794 derivative records from 7253 primary records. [2025-10-22T22:06:14.304527] [INFO ] [MAIN ] Derivative Progress: 256/2052 symbols completed. BNT took 1.0s. Estimated remaining: 11m 23s. Rate: 157.8 symbols/min [2025-10-22T22:06:14.304672] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-22T22:06:14.304902] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:14.338325] [DEBUG] [LOCAL ] BNY: Derivative data saved (1794 records). [2025-10-22T22:06:14.339421] [DEBUG] [MAIN ] BNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:14.339567] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-10-22T22:06:14.341921] [INFO ] [MAIN ] Derivative Progress: 257/2052 symbols completed. BNY took 1.1s. Estimated remaining: 11m 20s. Rate: 158.4 symbols/min [2025-10-22T22:06:14.342744] [INFO ] [MAIN ] BNS: Generated 1794 derivative records from 51416 primary records. [2025-10-22T22:06:14.347418] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-22T22:06:14.347937] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:14.369760] [DEBUG] [LOCAL ] BNS: Derivative data saved (1794 records). [2025-10-22T22:06:14.369901] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-22T22:06:14.372264] [INFO ] [MAIN ] Derivative Progress: 258/2052 symbols completed. BNS took 1.1s. Estimated remaining: 11m 17s. Rate: 159.0 symbols/min [2025-10-22T22:06:14.373682] [DEBUG] [LOCAL ] BOC: Loaded 18186 existing records from primary storage. [2025-10-22T22:06:14.373820] [INFO ] [MAIN ] BOC: Loaded 18186 primary data records. [2025-10-22T22:06:14.373183] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:14.473581] [DEBUG] [LOCAL ] BOE: Loaded 18068 existing records from primary storage. [2025-10-22T22:06:14.484326] [INFO ] [MAIN ] BOE: Loaded 18068 primary data records. [2025-10-22T22:06:14.917815] [DEBUG] [LOCAL ] BOH: Loaded 30638 existing records from primary storage. [2025-10-22T22:06:15.101223] [INFO ] [MAIN ] BOH: Loaded 30638 primary data records. [2025-10-22T22:06:15.469347] [DEBUG] [MAIN ] BOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:15.471443] [INFO ] [MAIN ] BOC: Generated 1794 derivative records from 18186 primary records. [2025-10-22T22:06:15.471601] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-22T22:06:15.495955] [DEBUG] [MAIN ] BOE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:15.502277] [INFO ] [MAIN ] BOE: Generated 1794 derivative records from 18068 primary records. [2025-10-22T22:06:15.505548] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-10-22T22:06:15.509031] [DEBUG] [LOCAL ] BOC: Derivative data saved (1794 records). [2025-10-22T22:06:15.509588] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-22T22:06:15.512809] [INFO ] [MAIN ] Derivative Progress: 259/2052 symbols completed. BOC took 1.2s. Estimated remaining: 11m 22s. Rate: 157.7 symbols/min [2025-10-22T22:06:15.526935] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:15.529821] [DEBUG] [LOCAL ] BOE: Derivative data saved (1794 records). [2025-10-22T22:06:15.529928] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-10-22T22:06:15.534001] [INFO ] [MAIN ] Derivative Progress: 260/2052 symbols completed. BOE took 1.2s. Estimated remaining: 11m 19s. Rate: 158.3 symbols/min [2025-10-22T22:06:15.534419] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:15.552220] [DEBUG] [MAIN ] BOH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:15.553059] [INFO ] [MAIN ] BOH: Generated 1794 derivative records from 30638 primary records. [2025-10-22T22:06:15.553227] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-22T22:06:15.569300] [DEBUG] [LOCAL ] BOH: Derivative data saved (1794 records). [2025-10-22T22:06:15.569701] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-22T22:06:15.572238] [INFO ] [MAIN ] Derivative Progress: 261/2052 symbols completed. BOH took 1.2s. Estimated remaining: 11m 16s. Rate: 158.9 symbols/min [2025-10-22T22:06:15.572447] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:15.622395] [DEBUG] [LOCAL ] BOW: Loaded 22829 existing records from primary storage. [2025-10-22T22:06:15.624238] [INFO ] [MAIN ] BOW: Loaded 22829 primary data records. [2025-10-22T22:06:15.638687] [DEBUG] [LOCAL ] BOND: Loaded 32409 existing records from primary storage. [2025-10-22T22:06:15.693916] [INFO ] [MAIN ] BOND: Loaded 32409 primary data records. [2025-10-22T22:06:15.688477] [DEBUG] [LOCAL ] BOOT: Loaded 39419 existing records from primary storage. [2025-10-22T22:06:15.699408] [INFO ] [MAIN ] BOOT: Loaded 39419 primary data records. [2025-10-22T22:06:16.644569] [DEBUG] [MAIN ] BOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:16.666446] [INFO ] [MAIN ] BOW: Generated 1794 derivative records from 22829 primary records. [2025-10-22T22:06:16.665583] [DEBUG] [MAIN ] BOND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:16.667363] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-22T22:06:16.668758] [INFO ] [MAIN ] BOND: Generated 1794 derivative records from 32409 primary records. [2025-10-22T22:06:16.670119] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-22T22:06:16.708761] [DEBUG] [LOCAL ] BOW: Derivative data saved (1794 records). [2025-10-22T22:06:16.716070] [DEBUG] [LOCAL ] BOND: Derivative data saved (1794 records). [2025-10-22T22:06:16.716299] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-22T22:06:16.716214] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-22T22:06:16.719191] [INFO ] [MAIN ] Derivative Progress: 262/2052 symbols completed. BOW took 1.1s. Estimated remaining: 11m 21s. Rate: 157.6 symbols/min [2025-10-22T22:06:16.727559] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:16.730331] [INFO ] [MAIN ] Derivative Progress: 263/2052 symbols completed. BOND took 1.2s. Estimated remaining: 11m 18s. Rate: 158.2 symbols/min [2025-10-22T22:06:16.736190] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:16.737143] [DEBUG] [MAIN ] BOOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:16.738184] [INFO ] [MAIN ] BOOT: Generated 1794 derivative records from 39419 primary records. [2025-10-22T22:06:16.738484] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-22T22:06:16.757548] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1794 records). [2025-10-22T22:06:16.758007] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-22T22:06:16.761880] [INFO ] [MAIN ] Derivative Progress: 264/2052 symbols completed. BOOT took 1.2s. Estimated remaining: 11m 16s. Rate: 158.8 symbols/min [2025-10-22T22:06:16.762289] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:16.820898] [DEBUG] [LOCAL ] BOX: Loaded 50125 existing records from primary storage. [2025-10-22T22:06:16.821118] [INFO ] [MAIN ] BOX: Loaded 50125 primary data records. [2025-10-22T22:06:16.952715] [DEBUG] [LOCAL ] BP: Loaded 53706 existing records from primary storage. [2025-10-22T22:06:16.953254] [INFO ] [MAIN ] BP: Loaded 53706 primary data records. [2025-10-22T22:06:16.952024] [DEBUG] [LOCAL ] BR: Loaded 34554 existing records from primary storage. [2025-10-22T22:06:16.980010] [INFO ] [MAIN ] BR: Loaded 34554 primary data records. [2025-10-22T22:06:17.845914] [DEBUG] [MAIN ] BOX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:17.846964] [INFO ] [MAIN ] BOX: Generated 1794 derivative records from 50125 primary records. [2025-10-22T22:06:17.847536] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-10-22T22:06:17.865188] [DEBUG] [LOCAL ] BOX: Derivative data saved (1794 records). [2025-10-22T22:06:17.865503] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-10-22T22:06:17.867211] [INFO ] [MAIN ] Derivative Progress: 265/2052 symbols completed. BOX took 1.1s. Estimated remaining: 11m 20s. Rate: 157.6 symbols/min [2025-10-22T22:06:17.868038] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:17.885162] [DEBUG] [MAIN ] BP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:17.886312] [INFO ] [MAIN ] BP: Generated 1794 derivative records from 53706 primary records. [2025-10-22T22:06:17.886897] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-10-22T22:06:17.904064] [DEBUG] [LOCAL ] BP: Derivative data saved (1794 records). [2025-10-22T22:06:17.904255] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-10-22T22:06:17.907910] [INFO ] [MAIN ] Derivative Progress: 266/2052 symbols completed. BP took 1.2s. Estimated remaining: 11m 18s. Rate: 158.2 symbols/min [2025-10-22T22:06:17.920425] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:17.920749] [DEBUG] [MAIN ] BR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:17.921885] [INFO ] [MAIN ] BR: Generated 1794 derivative records from 34554 primary records. [2025-10-22T22:06:17.922055] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-22T22:06:17.951892] [DEBUG] [LOCAL ] BR: Derivative data saved (1794 records). [2025-10-22T22:06:17.955678] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-22T22:06:17.958409] [INFO ] [MAIN ] Derivative Progress: 267/2052 symbols completed. BR took 1.2s. Estimated remaining: 11m 15s. Rate: 158.7 symbols/min [2025-10-22T22:06:17.959362] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:17.981533] [DEBUG] [LOCAL ] BRC: Loaded 18341 existing records from primary storage. [2025-10-22T22:06:17.982989] [DEBUG] [LOCAL ] BRBR: Loaded 51828 existing records from primary storage. [2025-10-22T22:06:17.983200] [INFO ] [MAIN ] BRC: Loaded 18341 primary data records. [2025-10-22T22:06:17.983404] [INFO ] [MAIN ] BRBR: Loaded 51828 primary data records. [2025-10-22T22:06:18.351922] [DEBUG] [LOCAL ] BRCC: Loaded 40024 existing records from primary storage. [2025-10-22T22:06:18.412700] [INFO ] [MAIN ] BRCC: Loaded 40024 primary data records. [2025-10-22T22:06:18.961563] [DEBUG] [MAIN ] BRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:18.962065] [DEBUG] [MAIN ] BRBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:18.962896] [INFO ] [MAIN ] BRC: Generated 1794 derivative records from 18341 primary records. [2025-10-22T22:06:18.963009] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-22T22:06:18.964399] [INFO ] [MAIN ] BRBR: Generated 1794 derivative records from 51828 primary records. [2025-10-22T22:06:18.964678] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-10-22T22:06:19.000270] [DEBUG] [LOCAL ] BRC: Derivative data saved (1794 records). [2025-10-22T22:06:19.000759] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1794 records). [2025-10-22T22:06:19.000930] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-10-22T22:06:19.003006] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-10-22T22:06:19.002932] [INFO ] [MAIN ] Derivative Progress: 268/2052 symbols completed. BRC took 1.1s. Estimated remaining: 11m 19s. Rate: 157.6 symbols/min [2025-10-22T22:06:19.013744] [INFO ] [MAIN ] Derivative Progress: 269/2052 symbols completed. BRBR took 1.1s. Estimated remaining: 11m 16s. Rate: 158.2 symbols/min [2025-10-22T22:06:19.019102] [DEBUG] [MAIN ] BRCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:19.019722] [INFO ] [MAIN ] BRCC: Generated 1794 derivative records from 40024 primary records. [2025-10-22T22:06:19.019784] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-10-22T22:06:19.034463] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1794 records). [2025-10-22T22:06:19.034550] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-10-22T22:06:19.037109] [INFO ] [MAIN ] Derivative Progress: 270/2052 symbols completed. BRCC took 1.1s. Estimated remaining: 11m 13s. Rate: 158.8 symbols/min [2025-10-22T22:06:19.037527] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:19.037666] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:19.037707] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:19.098419] [DEBUG] [LOCAL ] BRSP: Loaded 36477 existing records from primary storage. [2025-10-22T22:06:19.098710] [INFO ] [MAIN ] BRSP: Loaded 36477 primary data records. [2025-10-22T22:06:19.208768] [DEBUG] [LOCAL ] BROS: Loaded 53301 existing records from primary storage. [2025-10-22T22:06:19.230201] [INFO ] [MAIN ] BROS: Loaded 53301 primary data records. [2025-10-22T22:06:19.250224] [DEBUG] [LOCAL ] BRO: Loaded 52096 existing records from primary storage. [2025-10-22T22:06:19.297700] [INFO ] [MAIN ] BRO: Loaded 52096 primary data records. [2025-10-22T22:06:20.078546] [DEBUG] [MAIN ] BRSP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:20.079478] [INFO ] [MAIN ] BRSP: Generated 1794 derivative records from 36477 primary records. [2025-10-22T22:06:20.079767] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-10-22T22:06:20.101068] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1794 records). [2025-10-22T22:06:20.101588] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-10-22T22:06:20.115580] [INFO ] [MAIN ] Derivative Progress: 271/2052 symbols completed. BRSP took 1.1s. Estimated remaining: 11m 18s. Rate: 157.7 symbols/min [2025-10-22T22:06:20.128184] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:20.128478] [DEBUG] [MAIN ] BRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:20.129144] [DEBUG] [MAIN ] BROS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:20.129884] [INFO ] [MAIN ] BRO: Generated 1794 derivative records from 52096 primary records. [2025-10-22T22:06:20.130948] [INFO ] [MAIN ] BROS: Generated 1794 derivative records from 53301 primary records. [2025-10-22T22:06:20.130261] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-10-22T22:06:20.131565] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-22T22:06:20.159362] [DEBUG] [LOCAL ] BRO: Derivative data saved (1794 records). [2025-10-22T22:06:20.162746] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-10-22T22:06:20.165030] [INFO ] [MAIN ] Derivative Progress: 272/2052 symbols completed. BRO took 1.1s. Estimated remaining: 11m 15s. Rate: 158.2 symbols/min [2025-10-22T22:06:20.166278] [DEBUG] [LOCAL ] BROS: Derivative data saved (1794 records). [2025-10-22T22:06:20.166391] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:20.166626] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-22T22:06:20.169258] [INFO ] [MAIN ] Derivative Progress: 273/2052 symbols completed. BROS took 1.1s. Estimated remaining: 11m 12s. Rate: 158.8 symbols/min [2025-10-22T22:06:20.172376] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:20.172909] [DEBUG] [LOCAL ] BRT: Loaded 5261 existing records from primary storage. [2025-10-22T22:06:20.173416] [INFO ] [MAIN ] BRT: Loaded 5261 primary data records. [2025-10-22T22:06:20.507459] [DEBUG] [LOCAL ] BSBR: Loaded 35877 existing records from primary storage. [2025-10-22T22:06:20.507816] [INFO ] [MAIN ] BSBR: Loaded 35877 primary data records. [2025-10-22T22:06:20.631228] [DEBUG] [LOCAL ] BRX: Loaded 51818 existing records from primary storage. [2025-10-22T22:06:20.632318] [INFO ] [MAIN ] BRX: Loaded 51818 primary data records. [2025-10-22T22:06:21.201875] [DEBUG] [MAIN ] BRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:21.203304] [INFO ] [MAIN ] BRT: Generated 1794 derivative records from 5261 primary records. [2025-10-22T22:06:21.203444] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-10-22T22:06:21.220488] [DEBUG] [LOCAL ] BRT: Derivative data saved (1794 records). [2025-10-22T22:06:21.220902] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-10-22T22:06:21.223076] [INFO ] [MAIN ] Derivative Progress: 274/2052 symbols completed. BRT took 1.1s. Estimated remaining: 11m 16s. Rate: 157.7 symbols/min [2025-10-22T22:06:21.223287] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:21.234434] [DEBUG] [LOCAL ] BSL: Loaded 7898 existing records from primary storage. [2025-10-22T22:06:21.236212] [INFO ] [MAIN ] BSL: Loaded 7898 primary data records. [2025-10-22T22:06:21.328724] [DEBUG] [MAIN ] BSBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:21.335379] [INFO ] [MAIN ] BSBR: Generated 1794 derivative records from 35877 primary records. [2025-10-22T22:06:21.341710] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-10-22T22:06:21.402279] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1794 records). [2025-10-22T22:06:21.420288] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-10-22T22:06:21.400902] [DEBUG] [MAIN ] BRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:21.429363] [INFO ] [MAIN ] BRX: Generated 1794 derivative records from 51818 primary records. [2025-10-22T22:06:21.454843] [INFO ] [MAIN ] Derivative Progress: 275/2052 symbols completed. BSBR took 1.3s. Estimated remaining: 11m 15s. Rate: 158.0 symbols/min [2025-10-22T22:06:21.455073] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:21.545689] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-22T22:06:21.595596] [DEBUG] [LOCAL ] BRX: Derivative data saved (1794 records). [2025-10-22T22:06:21.595786] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-10-22T22:06:21.598456] [INFO ] [MAIN ] Derivative Progress: 276/2052 symbols completed. BRX took 1.4s. Estimated remaining: 11m 13s. Rate: 158.3 symbols/min [2025-10-22T22:06:21.598677] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:21.636675] [DEBUG] [LOCAL ] BST: Loaded 18388 existing records from primary storage. [2025-10-22T22:06:21.645025] [DEBUG] [LOCAL ] BSM: Loaded 32282 existing records from primary storage. [2025-10-22T22:06:21.636958] [INFO ] [MAIN ] BST: Loaded 18388 primary data records. [2025-10-22T22:06:21.649829] [INFO ] [MAIN ] BSM: Loaded 32282 primary data records. [2025-10-22T22:06:21.661474] [DEBUG] [MAIN ] BSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:21.702460] [INFO ] [MAIN ] BSL: Generated 1794 derivative records from 7898 primary records. [2025-10-22T22:06:21.759902] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-10-22T22:06:21.929807] [DEBUG] [LOCAL ] BSL: Derivative data saved (1794 records). [2025-10-22T22:06:21.999472] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-10-22T22:06:22.012379] [INFO ] [MAIN ] Derivative Progress: 277/2052 symbols completed. BSL took 0.8s. Estimated remaining: 11m 13s. Rate: 158.3 symbols/min [2025-10-22T22:06:22.012505] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:22.289331] [DEBUG] [LOCAL ] BSTZ: Loaded 24418 existing records from primary storage. [2025-10-22T22:06:22.290110] [INFO ] [MAIN ] BSTZ: Loaded 24418 primary data records. [2025-10-22T22:06:22.431559] [DEBUG] [MAIN ] BST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:22.477910] [INFO ] [MAIN ] BST: Generated 1794 derivative records from 18388 primary records. [2025-10-22T22:06:22.496459] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-10-22T22:06:22.635578] [DEBUG] [LOCAL ] BST: Derivative data saved (1794 records). [2025-10-22T22:06:22.637073] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-10-22T22:06:22.652488] [INFO ] [MAIN ] Derivative Progress: 278/2052 symbols completed. BST took 1.1s. Estimated remaining: 11m 14s. Rate: 157.9 symbols/min [2025-10-22T22:06:22.652916] [DEBUG] [MAIN ] BSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:22.653011] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:22.654130] [INFO ] [MAIN ] BSM: Generated 1794 derivative records from 32282 primary records. [2025-10-22T22:06:22.654739] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-10-22T22:06:22.672187] [DEBUG] [LOCAL ] BSM: Derivative data saved (1794 records). [2025-10-22T22:06:22.672777] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-10-22T22:06:22.675163] [INFO ] [MAIN ] Derivative Progress: 279/2052 symbols completed. BSM took 1.2s. Estimated remaining: 11m 12s. Rate: 158.4 symbols/min [2025-10-22T22:06:22.675563] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:22.688612] [DEBUG] [LOCAL ] BTA: Loaded 5760 existing records from primary storage. [2025-10-22T22:06:22.700803] [INFO ] [MAIN ] BTA: Loaded 5760 primary data records. [2025-10-22T22:06:22.740757] [DEBUG] [MAIN ] BSTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:22.776431] [INFO ] [MAIN ] BSTZ: Generated 1794 derivative records from 24418 primary records. [2025-10-22T22:06:22.783021] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-10-22T22:06:22.868827] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1794 records). [2025-10-22T22:06:22.909489] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-10-22T22:06:22.936036] [INFO ] [MAIN ] Derivative Progress: 280/2052 symbols completed. BSTZ took 0.9s. Estimated remaining: 11m 10s. Rate: 158.6 symbols/min [2025-10-22T22:06:23.041061] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-22T22:06:23.047537] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:23.061410] [INFO ] [MAIN ] BSX: Loaded 53688 primary data records. [2025-10-22T22:06:23.461519] [DEBUG] [LOCAL ] BTE: Loaded 52696 existing records from primary storage. [2025-10-22T22:06:23.461690] [INFO ] [MAIN ] BTE: Loaded 52696 primary data records. [2025-10-22T22:06:23.460197] [DEBUG] [MAIN ] BTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:23.462565] [INFO ] [MAIN ] BTA: Generated 1794 derivative records from 5760 primary records. [2025-10-22T22:06:23.486004] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-22T22:06:23.563264] [DEBUG] [LOCAL ] BTA: Derivative data saved (1794 records). [2025-10-22T22:06:23.568549] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-10-22T22:06:23.576601] [INFO ] [MAIN ] Derivative Progress: 281/2052 symbols completed. BTA took 0.9s. Estimated remaining: 11m 12s. Rate: 158.2 symbols/min [2025-10-22T22:06:23.585923] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:23.807044] [DEBUG] [MAIN ] BSX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:23.808048] [INFO ] [MAIN ] BSX: Generated 1794 derivative records from 53688 primary records. [2025-10-22T22:06:23.808277] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-10-22T22:06:23.827274] [DEBUG] [LOCAL ] BSX: Derivative data saved (1794 records). [2025-10-22T22:06:23.841934] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-10-22T22:06:23.844538] [INFO ] [MAIN ] Derivative Progress: 282/2052 symbols completed. BSX took 1.2s. Estimated remaining: 11m 11s. Rate: 158.4 symbols/min [2025-10-22T22:06:23.846126] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:23.869278] [DEBUG] [LOCAL ] BTI: Loaded 53592 existing records from primary storage. [2025-10-22T22:06:23.873340] [DEBUG] [LOCAL ] BTO: Loaded 8703 existing records from primary storage. [2025-10-22T22:06:23.873746] [INFO ] [MAIN ] BTI: Loaded 53592 primary data records. [2025-10-22T22:06:23.874027] [INFO ] [MAIN ] BTO: Loaded 8703 primary data records. [2025-10-22T22:06:24.131057] [DEBUG] [MAIN ] BTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:24.175749] [INFO ] [MAIN ] BTE: Generated 1794 derivative records from 52696 primary records. [2025-10-22T22:06:24.240939] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-10-22T22:06:24.525780] [DEBUG] [LOCAL ] BTE: Derivative data saved (1794 records). [2025-10-22T22:06:24.526098] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-10-22T22:06:24.528865] [INFO ] [MAIN ] Derivative Progress: 283/2052 symbols completed. BTE took 1.5s. Estimated remaining: 11m 12s. Rate: 157.9 symbols/min [2025-10-22T22:06:24.551603] [DEBUG] [MAIN ] BTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:24.552491] [INFO ] [MAIN ] BTI: Generated 1794 derivative records from 53592 primary records. [2025-10-22T22:06:24.553231] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-10-22T22:06:24.578052] [DEBUG] [MAIN ] BTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:24.581392] [INFO ] [MAIN ] BTO: Generated 1794 derivative records from 8703 primary records. [2025-10-22T22:06:24.581846] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-22T22:06:24.583139] [DEBUG] [LOCAL ] BTI: Derivative data saved (1794 records). [2025-10-22T22:06:24.583239] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-10-22T22:06:24.585756] [INFO ] [MAIN ] Derivative Progress: 284/2052 symbols completed. BTI took 1.0s. Estimated remaining: 11m 10s. Rate: 158.4 symbols/min [2025-10-22T22:06:24.600057] [DEBUG] [LOCAL ] BTO: Derivative data saved (1794 records). [2025-10-22T22:06:24.600115] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-22T22:06:24.602707] [INFO ] [MAIN ] Derivative Progress: 285/2052 symbols completed. BTO took 0.8s. Estimated remaining: 11m 7s. Rate: 158.9 symbols/min [2025-10-22T22:06:24.603063] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:24.603323] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:24.603200] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:24.624404] [DEBUG] [LOCAL ] BTT: Loaded 15359 existing records from primary storage. [2025-10-22T22:06:24.624539] [INFO ] [MAIN ] BTT: Loaded 15359 primary data records. [2025-10-22T22:06:24.678034] [DEBUG] [LOCAL ] BTZ: Loaded 22396 existing records from primary storage. [2025-10-22T22:06:24.706325] [INFO ] [MAIN ] BTZ: Loaded 22396 primary data records. [2025-10-22T22:06:25.140006] [DEBUG] [LOCAL ] BTU: Loaded 53337 existing records from primary storage. [2025-10-22T22:06:25.291738] [INFO ] [MAIN ] BTU: Loaded 53337 primary data records. [2025-10-22T22:06:25.624702] [DEBUG] [MAIN ] BTT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:25.638307] [INFO ] [MAIN ] BTT: Generated 1794 derivative records from 15359 primary records. [2025-10-22T22:06:25.638530] [DEBUG] [MAIN ] BTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:25.639606] [INFO ] [MAIN ] BTZ: Generated 1794 derivative records from 22396 primary records. [2025-10-22T22:06:25.639749] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-22T22:06:25.638912] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-10-22T22:06:25.664547] [DEBUG] [LOCAL ] BTT: Derivative data saved (1794 records). [2025-10-22T22:06:25.666401] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-10-22T22:06:25.671171] [INFO ] [MAIN ] Derivative Progress: 286/2052 symbols completed. BTT took 1.1s. Estimated remaining: 11m 11s. Rate: 157.9 symbols/min [2025-10-22T22:06:25.675439] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:25.677169] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1794 records). [2025-10-22T22:06:25.677286] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-22T22:06:25.679386] [INFO ] [MAIN ] Derivative Progress: 287/2052 symbols completed. BTZ took 1.1s. Estimated remaining: 11m 8s. Rate: 158.4 symbols/min [2025-10-22T22:06:25.679713] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:25.701485] [DEBUG] [MAIN ] BTU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:25.702232] [INFO ] [MAIN ] BTU: Generated 1794 derivative records from 53337 primary records. [2025-10-22T22:06:25.705396] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-10-22T22:06:25.719428] [DEBUG] [LOCAL ] BUI: Loaded 11824 existing records from primary storage. [2025-10-22T22:06:25.726259] [DEBUG] [LOCAL ] BTU: Derivative data saved (1794 records). [2025-10-22T22:06:25.726377] [INFO ] [MAIN ] BUI: Loaded 11824 primary data records. [2025-10-22T22:06:25.726560] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-10-22T22:06:25.750777] [INFO ] [MAIN ] Derivative Progress: 288/2052 symbols completed. BTU took 1.1s. Estimated remaining: 11m 6s. Rate: 158.9 symbols/min [2025-10-22T22:06:25.807325] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:25.920525] [DEBUG] [LOCAL ] BUD: Loaded 52597 existing records from primary storage. [2025-10-22T22:06:26.050272] [INFO ] [MAIN ] BUD: Loaded 52597 primary data records. [2025-10-22T22:06:26.179702] [DEBUG] [LOCAL ] BUR: Loaded 45446 existing records from primary storage. [2025-10-22T22:06:26.180460] [INFO ] [MAIN ] BUR: Loaded 45446 primary data records. [2025-10-22T22:06:26.705694] [DEBUG] [MAIN ] BUI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:26.708229] [INFO ] [MAIN ] BUI: Generated 1794 derivative records from 11824 primary records. [2025-10-22T22:06:26.708877] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-10-22T22:06:26.727616] [DEBUG] [LOCAL ] BUI: Derivative data saved (1794 records). [2025-10-22T22:06:26.727911] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-10-22T22:06:26.730199] [INFO ] [MAIN ] Derivative Progress: 289/2052 symbols completed. BUI took 1.1s. Estimated remaining: 11m 9s. Rate: 158.0 symbols/min [2025-10-22T22:06:26.731950] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:26.747699] [DEBUG] [MAIN ] BUD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:26.748770] [INFO ] [MAIN ] BUD: Generated 1794 derivative records from 52597 primary records. [2025-10-22T22:06:26.749008] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-22T22:06:26.768696] [DEBUG] [LOCAL ] BUD: Derivative data saved (1794 records). [2025-10-22T22:06:26.769059] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-22T22:06:26.778848] [INFO ] [MAIN ] Derivative Progress: 290/2052 symbols completed. BUD took 1.1s. Estimated remaining: 11m 7s. Rate: 158.5 symbols/min [2025-10-22T22:06:26.784062] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:26.784939] [DEBUG] [MAIN ] BUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:26.786121] [INFO ] [MAIN ] BUR: Generated 1794 derivative records from 45446 primary records. [2025-10-22T22:06:26.786282] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-22T22:06:26.802402] [DEBUG] [LOCAL ] BUR: Derivative data saved (1794 records). [2025-10-22T22:06:26.802745] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-10-22T22:06:26.805236] [INFO ] [MAIN ] Derivative Progress: 291/2052 symbols completed. BUR took 1.0s. Estimated remaining: 11m 5s. Rate: 159.0 symbols/min [2025-10-22T22:06:26.815753] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:26.828992] [DEBUG] [LOCAL ] BUXX: Loaded 15332 existing records from primary storage. [2025-10-22T22:06:26.829154] [INFO ] [MAIN ] BUXX: Loaded 15332 primary data records. [2025-10-22T22:06:26.947969] [DEBUG] [LOCAL ] BURL: Loaded 45416 existing records from primary storage. [2025-10-22T22:06:26.948383] [INFO ] [MAIN ] BURL: Loaded 45416 primary data records. [2025-10-22T22:06:27.299833] [DEBUG] [LOCAL ] BVN: Loaded 44515 existing records from primary storage. [2025-10-22T22:06:27.300024] [INFO ] [MAIN ] BVN: Loaded 44515 primary data records. [2025-10-22T22:06:27.828896] [DEBUG] [MAIN ] BUXX: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:06:27.830286] [INFO ] [MAIN ] BUXX: Generated 1793 derivative records from 15332 primary records. [2025-10-22T22:06:27.830713] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-10-22T22:06:27.850549] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1793 records). [2025-10-22T22:06:27.850857] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-10-22T22:06:27.853199] [INFO ] [MAIN ] Derivative Progress: 292/2052 symbols completed. BUXX took 1.1s. Estimated remaining: 11m 8s. Rate: 158.0 symbols/min [2025-10-22T22:06:27.865461] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:27.867280] [DEBUG] [MAIN ] BURL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:27.868052] [INFO ] [MAIN ] BURL: Generated 1794 derivative records from 45416 primary records. [2025-10-22T22:06:27.868380] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-22T22:06:27.902110] [DEBUG] [LOCAL ] BURL: Derivative data saved (1794 records). [2025-10-22T22:06:27.902686] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-22T22:06:27.905065] [INFO ] [MAIN ] Derivative Progress: 293/2052 symbols completed. BURL took 1.2s. Estimated remaining: 11m 6s. Rate: 158.5 symbols/min [2025-10-22T22:06:27.905686] [DEBUG] [MAIN ] BVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:27.905340] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:27.906997] [INFO ] [MAIN ] BVN: Generated 1794 derivative records from 44515 primary records. [2025-10-22T22:06:27.907116] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-10-22T22:06:27.923585] [DEBUG] [LOCAL ] BVN: Derivative data saved (1794 records). [2025-10-22T22:06:27.923973] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-10-22T22:06:27.940289] [INFO ] [MAIN ] Derivative Progress: 294/2052 symbols completed. BVN took 1.1s. Estimated remaining: 11m 3s. Rate: 159.0 symbols/min [2025-10-22T22:06:27.942959] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:27.949593] [DEBUG] [LOCAL ] BWG: Loaded 12559 existing records from primary storage. [2025-10-22T22:06:27.949822] [INFO ] [MAIN ] BWG: Loaded 12559 primary data records. [2025-10-22T22:06:28.071128] [DEBUG] [LOCAL ] BWA: Loaded 52078 existing records from primary storage. [2025-10-22T22:06:28.071694] [INFO ] [MAIN ] BWA: Loaded 52078 primary data records. [2025-10-22T22:06:28.217891] [DEBUG] [LOCAL ] BWLP: Loaded 32092 existing records from primary storage. [2025-10-22T22:06:28.374539] [INFO ] [MAIN ] BWLP: Loaded 32092 primary data records. [2025-10-22T22:06:28.965115] [DEBUG] [MAIN ] BWG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:28.965911] [INFO ] [MAIN ] BWG: Generated 1794 derivative records from 12559 primary records. [2025-10-22T22:06:28.966315] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-22T22:06:28.998098] [DEBUG] [LOCAL ] BWG: Derivative data saved (1794 records). [2025-10-22T22:06:28.998592] [DEBUG] [MAIN ] BWA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:28.998974] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-10-22T22:06:29.001756] [INFO ] [MAIN ] Derivative Progress: 295/2052 symbols completed. BWG took 1.1s. Estimated remaining: 11m 7s. Rate: 158.0 symbols/min [2025-10-22T22:06:28.999709] [INFO ] [MAIN ] BWA: Generated 1794 derivative records from 52078 primary records. [2025-10-22T22:06:29.002065] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-22T22:06:29.002339] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:29.018958] [DEBUG] [LOCAL ] BWA: Derivative data saved (1794 records). [2025-10-22T22:06:29.020465] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-22T22:06:29.022780] [INFO ] [MAIN ] Derivative Progress: 296/2052 symbols completed. BWA took 1.2s. Estimated remaining: 11m 5s. Rate: 158.5 symbols/min [2025-10-22T22:06:29.023072] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:29.026619] [DEBUG] [LOCAL ] BWNB: Loaded 4051 existing records from primary storage. [2025-10-22T22:06:29.028382] [INFO ] [MAIN ] BWNB: Loaded 4051 primary data records. [2025-10-22T22:06:29.119276] [DEBUG] [LOCAL ] BWSN: Loaded 5048 existing records from primary storage. [2025-10-22T22:06:29.124747] [INFO ] [MAIN ] BWSN: Loaded 5048 primary data records. [2025-10-22T22:06:29.125038] [DEBUG] [MAIN ] BWLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:29.146545] [INFO ] [MAIN ] BWLP: Generated 1794 derivative records from 32092 primary records. [2025-10-22T22:06:29.182561] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-22T22:06:29.502680] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1794 records). [2025-10-22T22:06:29.508367] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-10-22T22:06:29.521829] [INFO ] [MAIN ] Derivative Progress: 297/2052 symbols completed. BWLP took 1.6s. Estimated remaining: 11m 5s. Rate: 158.4 symbols/min [2025-10-22T22:06:29.543863] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:29.723776] [DEBUG] [MAIN ] BWNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:29.724687] [INFO ] [MAIN ] BWNB: Generated 1794 derivative records from 4051 primary records. [2025-10-22T22:06:29.724970] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-22T22:06:29.741785] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1794 records). [2025-10-22T22:06:29.742029] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-22T22:06:29.744364] [INFO ] [MAIN ] Derivative Progress: 298/2052 symbols completed. BWNB took 0.7s. Estimated remaining: 11m 4s. Rate: 158.6 symbols/min [2025-10-22T22:06:29.777259] [DEBUG] [LOCAL ] BWXT: Loaded 47260 existing records from primary storage. [2025-10-22T22:06:29.777851] [INFO ] [MAIN ] BWXT: Loaded 47260 primary data records. [2025-10-22T22:06:29.778204] [DEBUG] [MAIN ] BWSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:29.779411] [INFO ] [MAIN ] BWSN: Generated 1794 derivative records from 5048 primary records. [2025-10-22T22:06:29.779528] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-22T22:06:29.898161] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1794 records). [2025-10-22T22:06:29.908797] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-10-22T22:06:29.921513] [INFO ] [MAIN ] Derivative Progress: 299/2052 symbols completed. BWSN took 0.9s. Estimated remaining: 11m 2s. Rate: 158.9 symbols/min [2025-10-22T22:06:30.103534] [DEBUG] [MAIN ] BWXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:30.104264] [INFO ] [MAIN ] BWXT: Generated 1794 derivative records from 47260 primary records. [2025-10-22T22:06:30.104331] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-22T22:06:30.119501] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1794 records). [2025-10-22T22:06:30.119575] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-10-22T22:06:30.121592] [INFO ] [MAIN ] Derivative Progress: 300/2052 symbols completed. BWXT took 0.6s. Estimated remaining: 11m 1s. Rate: 159.1 symbols/min [2025-10-22T22:06:30.122121] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:30.122063] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:30.122217] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:30.156006] [DEBUG] [LOCAL ] BY: Loaded 21636 existing records from primary storage. [2025-10-22T22:06:30.156216] [INFO ] [MAIN ] BY: Loaded 21636 primary data records. [2025-10-22T22:06:30.284166] [DEBUG] [LOCAL ] BYD: Loaded 44941 existing records from primary storage. [2025-10-22T22:06:30.313343] [INFO ] [MAIN ] BYD: Loaded 44941 primary data records. [2025-10-22T22:06:30.354639] [DEBUG] [LOCAL ] BXP: Loaded 49849 existing records from primary storage. [2025-10-22T22:06:30.416611] [INFO ] [MAIN ] BXP: Loaded 49849 primary data records. [2025-10-22T22:06:31.153285] [DEBUG] [MAIN ] BY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:31.155320] [INFO ] [MAIN ] BY: Generated 1794 derivative records from 21636 primary records. [2025-10-22T22:06:31.155581] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-10-22T22:06:31.185825] [DEBUG] [LOCAL ] BY: Derivative data saved (1794 records). [2025-10-22T22:06:31.186585] [DEBUG] [MAIN ] BYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:31.186313] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-10-22T22:06:31.188718] [INFO ] [MAIN ] Derivative Progress: 301/2052 symbols completed. BY took 1.1s. Estimated remaining: 11m 4s. Rate: 158.2 symbols/min [2025-10-22T22:06:31.189457] [INFO ] [MAIN ] BYD: Generated 1794 derivative records from 44941 primary records. [2025-10-22T22:06:31.189741] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-22T22:06:31.189860] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:31.206044] [DEBUG] [LOCAL ] BYD: Derivative data saved (1794 records). [2025-10-22T22:06:31.206257] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-10-22T22:06:31.213428] [INFO ] [MAIN ] Derivative Progress: 302/2052 symbols completed. BYD took 1.1s. Estimated remaining: 11m 2s. Rate: 158.6 symbols/min [2025-10-22T22:06:31.213739] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:31.231411] [DEBUG] [MAIN ] BXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:31.231838] [DEBUG] [LOCAL ] BYM: Loaded 11369 existing records from primary storage. [2025-10-22T22:06:31.231918] [INFO ] [MAIN ] BYM: Loaded 11369 primary data records. [2025-10-22T22:06:31.232521] [INFO ] [MAIN ] BXP: Generated 1794 derivative records from 49849 primary records. [2025-10-22T22:06:31.232623] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-10-22T22:06:31.327102] [DEBUG] [LOCAL ] BXP: Derivative data saved (1794 records). [2025-10-22T22:06:31.345699] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-10-22T22:06:31.351456] [INFO ] [MAIN ] Derivative Progress: 303/2052 symbols completed. BXP took 1.2s. Estimated remaining: 11m 0s. Rate: 159.0 symbols/min [2025-10-22T22:06:31.359692] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:31.547226] [DEBUG] [LOCAL ] BZH: Loaded 32065 existing records from primary storage. [2025-10-22T22:06:31.560471] [INFO ] [MAIN ] BZH: Loaded 32065 primary data records. [2025-10-22T22:06:31.655808] [DEBUG] [LOCAL ] CAAP: Loaded 19805 existing records from primary storage. [2025-10-22T22:06:31.666778] [INFO ] [MAIN ] CAAP: Loaded 19805 primary data records. [2025-10-22T22:06:32.182832] [DEBUG] [MAIN ] BYM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:32.185091] [INFO ] [MAIN ] BYM: Generated 1794 derivative records from 11369 primary records. [2025-10-22T22:06:32.186227] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-22T22:06:32.203620] [DEBUG] [LOCAL ] BYM: Derivative data saved (1794 records). [2025-10-22T22:06:32.203944] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-10-22T22:06:32.207427] [INFO ] [MAIN ] Derivative Progress: 304/2052 symbols completed. BYM took 1.0s. Estimated remaining: 11m 2s. Rate: 158.3 symbols/min [2025-10-22T22:06:32.208389] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:32.235762] [DEBUG] [MAIN ] BZH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:32.242676] [INFO ] [MAIN ] BZH: Generated 1794 derivative records from 32065 primary records. [2025-10-22T22:06:32.243247] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-22T22:06:32.243004] [DEBUG] [LOCAL ] CABO: Loaded 16659 existing records from primary storage. [2025-10-22T22:06:32.258899] [INFO ] [MAIN ] CABO: Loaded 16659 primary data records. [2025-10-22T22:06:32.283870] [DEBUG] [MAIN ] CAAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:32.295902] [DEBUG] [LOCAL ] BZH: Derivative data saved (1794 records). [2025-10-22T22:06:32.318513] [INFO ] [MAIN ] CAAP: Generated 1794 derivative records from 19805 primary records. [2025-10-22T22:06:32.330260] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-22T22:06:32.330371] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-22T22:06:32.332839] [INFO ] [MAIN ] Derivative Progress: 305/2052 symbols completed. BZH took 1.1s. Estimated remaining: 11m 1s. Rate: 158.7 symbols/min [2025-10-22T22:06:32.333436] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:32.375959] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1794 records). [2025-10-22T22:06:32.381303] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-22T22:06:32.389731] [INFO ] [MAIN ] Derivative Progress: 306/2052 symbols completed. CAAP took 1.0s. Estimated remaining: 10m 58s. Rate: 159.1 symbols/min [2025-10-22T22:06:32.397585] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:32.488378] [DEBUG] [LOCAL ] CACI: Loaded 22378 existing records from primary storage. [2025-10-22T22:06:32.492177] [INFO ] [MAIN ] CACI: Loaded 22378 primary data records. [2025-10-22T22:06:32.931433] [DEBUG] [LOCAL ] CADE: Loaded 49685 existing records from primary storage. [2025-10-22T22:06:32.964363] [INFO ] [MAIN ] CADE: Loaded 49685 primary data records. [2025-10-22T22:06:33.299795] [DEBUG] [MAIN ] CABO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:33.301198] [INFO ] [MAIN ] CABO: Generated 1794 derivative records from 16659 primary records. [2025-10-22T22:06:33.302105] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-22T22:06:33.326679] [DEBUG] [LOCAL ] CABO: Derivative data saved (1794 records). [2025-10-22T22:06:33.326890] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-22T22:06:33.329081] [INFO ] [MAIN ] Derivative Progress: 307/2052 symbols completed. CABO took 1.1s. Estimated remaining: 11m 1s. Rate: 158.3 symbols/min [2025-10-22T22:06:33.343273] [DEBUG] [MAIN ] CACI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:06:33.342863] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:33.344889] [INFO ] [MAIN ] CACI: Generated 1793 derivative records from 22378 primary records. [2025-10-22T22:06:33.345041] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-22T22:06:33.365319] [DEBUG] [LOCAL ] CACI: Derivative data saved (1793 records). [2025-10-22T22:06:33.365633] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-22T22:06:33.380618] [DEBUG] [MAIN ] CADE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:33.381494] [INFO ] [MAIN ] CADE: Generated 1794 derivative records from 49685 primary records. [2025-10-22T22:06:33.381632] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-22T22:06:33.380360] [INFO ] [MAIN ] Derivative Progress: 308/2052 symbols completed. CACI took 1.0s. Estimated remaining: 10m 59s. Rate: 158.8 symbols/min [2025-10-22T22:06:33.399271] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:33.407921] [DEBUG] [LOCAL ] CADE: Derivative data saved (1794 records). [2025-10-22T22:06:33.408789] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-22T22:06:33.411833] [INFO ] [MAIN ] Derivative Progress: 309/2052 symbols completed. CADE took 1.0s. Estimated remaining: 10m 57s. Rate: 159.3 symbols/min [2025-10-22T22:06:33.412070] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:33.424990] [DEBUG] [LOCAL ] CAE: Loaded 39045 existing records from primary storage. [2025-10-22T22:06:33.425317] [INFO ] [MAIN ] CAE: Loaded 39045 primary data records. [2025-10-22T22:06:33.776622] [DEBUG] [LOCAL ] CAG: Loaded 53666 existing records from primary storage. [2025-10-22T22:06:33.776848] [INFO ] [MAIN ] CAG: Loaded 53666 primary data records. [2025-10-22T22:06:33.879534] [DEBUG] [LOCAL ] CAH: Loaded 51420 existing records from primary storage. [2025-10-22T22:06:33.899906] [INFO ] [MAIN ] CAH: Loaded 51420 primary data records. [2025-10-22T22:06:34.424024] [DEBUG] [MAIN ] CAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:34.424874] [INFO ] [MAIN ] CAE: Generated 1794 derivative records from 39045 primary records. [2025-10-22T22:06:34.426004] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-22T22:06:34.445830] [DEBUG] [LOCAL ] CAE: Derivative data saved (1794 records). [2025-10-22T22:06:34.446074] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-22T22:06:34.448273] [INFO ] [MAIN ] Derivative Progress: 310/2052 symbols completed. CAE took 1.1s. Estimated remaining: 11m 0s. Rate: 158.4 symbols/min [2025-10-22T22:06:34.448545] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:34.466771] [DEBUG] [MAIN ] CAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:34.467587] [INFO ] [MAIN ] CAG: Generated 1794 derivative records from 53666 primary records. [2025-10-22T22:06:34.467847] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-22T22:06:34.487368] [DEBUG] [LOCAL ] CAG: Derivative data saved (1794 records). [2025-10-22T22:06:34.487681] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-10-22T22:06:34.489619] [INFO ] [MAIN ] Derivative Progress: 311/2052 symbols completed. CAG took 1.1s. Estimated remaining: 10m 58s. Rate: 158.8 symbols/min [2025-10-22T22:06:34.513229] [DEBUG] [MAIN ] CAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:34.502215] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:34.513999] [INFO ] [MAIN ] CAH: Generated 1794 derivative records from 51420 primary records. [2025-10-22T22:06:34.514191] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-22T22:06:34.530444] [DEBUG] [LOCAL ] CAH: Derivative data saved (1794 records). [2025-10-22T22:06:34.530736] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-22T22:06:34.533396] [INFO ] [MAIN ] Derivative Progress: 312/2052 symbols completed. CAH took 1.1s. Estimated remaining: 10m 55s. Rate: 159.3 symbols/min [2025-10-22T22:06:34.534395] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:34.548961] [DEBUG] [LOCAL ] CAL: Loaded 42762 existing records from primary storage. [2025-10-22T22:06:34.549295] [INFO ] [MAIN ] CAL: Loaded 42762 primary data records. [2025-10-22T22:06:34.753206] [DEBUG] [LOCAL ] CANG: Loaded 27031 existing records from primary storage. [2025-10-22T22:06:34.876859] [INFO ] [MAIN ] CANG: Loaded 27031 primary data records. [2025-10-22T22:06:34.890129] [DEBUG] [LOCAL ] CALX: Loaded 37238 existing records from primary storage. [2025-10-22T22:06:34.909972] [INFO ] [MAIN ] CALX: Loaded 37238 primary data records. [2025-10-22T22:06:35.530393] [DEBUG] [MAIN ] CAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:35.532326] [INFO ] [MAIN ] CAL: Generated 1794 derivative records from 42762 primary records. [2025-10-22T22:06:35.532614] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-22T22:06:35.550616] [DEBUG] [LOCAL ] CAL: Derivative data saved (1794 records). [2025-10-22T22:06:35.550877] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-22T22:06:35.553243] [INFO ] [MAIN ] Derivative Progress: 313/2052 symbols completed. CAL took 1.1s. Estimated remaining: 10m 59s. Rate: 158.4 symbols/min [2025-10-22T22:06:35.584189] [DEBUG] [MAIN ] CANG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:35.585415] [INFO ] [MAIN ] CANG: Generated 1794 derivative records from 27031 primary records. [2025-10-22T22:06:35.585500] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-10-22T22:06:35.584509] [DEBUG] [MAIN ] CALX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:35.586894] [INFO ] [MAIN ] CALX: Generated 1794 derivative records from 37238 primary records. [2025-10-22T22:06:35.587233] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-22T22:06:35.617414] [DEBUG] [LOCAL ] CALX: Derivative data saved (1794 records). [2025-10-22T22:06:35.617882] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-22T22:06:35.621085] [INFO ] [MAIN ] Derivative Progress: 314/2052 symbols completed. CALX took 1.1s. Estimated remaining: 10m 57s. Rate: 158.8 symbols/min [2025-10-22T22:06:35.618499] [DEBUG] [LOCAL ] CANG: Derivative data saved (1794 records). [2025-10-22T22:06:35.621356] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-10-22T22:06:35.623859] [INFO ] [MAIN ] Derivative Progress: 315/2052 symbols completed. CANG took 1.1s. Estimated remaining: 10m 54s. Rate: 159.3 symbols/min [2025-10-22T22:06:35.624280] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:35.624351] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:35.624442] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:35.632412] [DEBUG] [LOCAL ] CAPL: Loaded 5383 existing records from primary storage. [2025-10-22T22:06:35.632530] [INFO ] [MAIN ] CAPL: Loaded 5383 primary data records. [2025-10-22T22:06:35.968790] [DEBUG] [LOCAL ] CARS: Loaded 39772 existing records from primary storage. [2025-10-22T22:06:35.969080] [INFO ] [MAIN ] CARS: Loaded 39772 primary data records. [2025-10-22T22:06:36.093949] [DEBUG] [LOCAL ] CARR: Loaded 53603 existing records from primary storage. [2025-10-22T22:06:36.138356] [INFO ] [MAIN ] CARR: Loaded 53603 primary data records. [2025-10-22T22:06:36.631050] [DEBUG] [MAIN ] CAPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:36.632591] [INFO ] [MAIN ] CAPL: Generated 1794 derivative records from 5383 primary records. [2025-10-22T22:06:36.632989] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-22T22:06:36.654347] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1794 records). [2025-10-22T22:06:36.654577] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-22T22:06:36.657929] [INFO ] [MAIN ] Derivative Progress: 316/2052 symbols completed. CAPL took 1.0s. Estimated remaining: 10m 57s. Rate: 158.4 symbols/min [2025-10-22T22:06:36.658825] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:36.678728] [DEBUG] [MAIN ] CARS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:36.680047] [INFO ] [MAIN ] CARS: Generated 1794 derivative records from 39772 primary records. [2025-10-22T22:06:36.680227] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-22T22:06:36.698798] [DEBUG] [LOCAL ] CARS: Derivative data saved (1794 records). [2025-10-22T22:06:36.699057] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-10-22T22:06:36.702027] [INFO ] [MAIN ] Derivative Progress: 317/2052 symbols completed. CARS took 1.1s. Estimated remaining: 10m 55s. Rate: 158.9 symbols/min [2025-10-22T22:06:36.703245] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:36.718039] [DEBUG] [MAIN ] CARR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:36.718907] [INFO ] [MAIN ] CARR: Generated 1794 derivative records from 53603 primary records. [2025-10-22T22:06:36.721248] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-22T22:06:36.743740] [DEBUG] [LOCAL ] CARR: Derivative data saved (1794 records). [2025-10-22T22:06:36.744026] [DEBUG] [LOCAL ] CATO: Loaded 6647 existing records from primary storage. [2025-10-22T22:06:36.761097] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-22T22:06:36.764521] [INFO ] [MAIN ] Derivative Progress: 318/2052 symbols completed. CARR took 1.1s. Estimated remaining: 10m 53s. Rate: 159.3 symbols/min [2025-10-22T22:06:36.764807] [INFO ] [MAIN ] CATO: Loaded 6647 primary data records. [2025-10-22T22:06:36.776934] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:36.885600] [DEBUG] [LOCAL ] CAT: Loaded 52953 existing records from primary storage. [2025-10-22T22:06:36.886199] [INFO ] [MAIN ] CAT: Loaded 52953 primary data records. [2025-10-22T22:06:37.454411] [DEBUG] [LOCAL ] CAVA: Loaded 53551 existing records from primary storage. [2025-10-22T22:06:37.461026] [INFO ] [MAIN ] CAVA: Loaded 53551 primary data records. [2025-10-22T22:06:37.792105] [DEBUG] [MAIN ] CATO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:37.793527] [INFO ] [MAIN ] CATO: Generated 1794 derivative records from 6647 primary records. [2025-10-22T22:06:37.794638] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-22T22:06:37.811806] [DEBUG] [LOCAL ] CATO: Derivative data saved (1794 records). [2025-10-22T22:06:37.812095] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-22T22:06:37.814533] [INFO ] [MAIN ] Derivative Progress: 319/2052 symbols completed. CATO took 1.1s. Estimated remaining: 10m 56s. Rate: 158.4 symbols/min [2025-10-22T22:06:37.815311] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:37.834215] [DEBUG] [MAIN ] CAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:37.834990] [INFO ] [MAIN ] CAT: Generated 1794 derivative records from 52953 primary records. [2025-10-22T22:06:37.835224] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-22T22:06:37.854174] [DEBUG] [LOCAL ] CAT: Derivative data saved (1794 records). [2025-10-22T22:06:37.854293] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-22T22:06:37.856675] [INFO ] [MAIN ] Derivative Progress: 320/2052 symbols completed. CAT took 1.2s. Estimated remaining: 10m 54s. Rate: 158.9 symbols/min [2025-10-22T22:06:37.857053] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:37.870944] [DEBUG] [MAIN ] CAVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:37.871818] [INFO ] [MAIN ] CAVA: Generated 1794 derivative records from 53551 primary records. [2025-10-22T22:06:37.872115] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-10-22T22:06:37.907190] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1794 records). [2025-10-22T22:06:37.895484] [DEBUG] [LOCAL ] CBAN: Loaded 10154 existing records from primary storage. [2025-10-22T22:06:37.907345] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-10-22T22:06:37.907561] [INFO ] [MAIN ] CBAN: Loaded 10154 primary data records. [2025-10-22T22:06:37.910204] [INFO ] [MAIN ] Derivative Progress: 321/2052 symbols completed. CAVA took 1.1s. Estimated remaining: 10m 52s. Rate: 159.3 symbols/min [2025-10-22T22:06:37.910424] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:38.034185] [DEBUG] [LOCAL ] CB: Loaded 49964 existing records from primary storage. [2025-10-22T22:06:38.040195] [INFO ] [MAIN ] CB: Loaded 49964 primary data records. [2025-10-22T22:06:38.097919] [DEBUG] [LOCAL ] CBL: Loaded 16048 existing records from primary storage. [2025-10-22T22:06:38.157185] [INFO ] [MAIN ] CBL: Loaded 16048 primary data records. [2025-10-22T22:06:38.934361] [DEBUG] [MAIN ] CBAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:38.937382] [INFO ] [MAIN ] CBAN: Generated 1794 derivative records from 10154 primary records. [2025-10-22T22:06:38.938172] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-22T22:06:38.966564] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1794 records). [2025-10-22T22:06:38.966719] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-10-22T22:06:38.968724] [INFO ] [MAIN ] Derivative Progress: 322/2052 symbols completed. CBAN took 1.1s. Estimated remaining: 10m 55s. Rate: 158.4 symbols/min [2025-10-22T22:06:38.969117] [DEBUG] [MAIN ] CB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:38.969976] [INFO ] [MAIN ] CB: Generated 1794 derivative records from 49964 primary records. [2025-10-22T22:06:38.970269] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:38.970194] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-22T22:06:38.988844] [DEBUG] [LOCAL ] CB: Derivative data saved (1794 records). [2025-10-22T22:06:38.990410] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-22T22:06:38.995087] [DEBUG] [LOCAL ] CBNA: Loaded 2864 existing records from primary storage. [2025-10-22T22:06:38.995282] [INFO ] [MAIN ] CBNA: Loaded 2864 primary data records. [2025-10-22T22:06:38.994893] [INFO ] [MAIN ] Derivative Progress: 323/2052 symbols completed. CB took 1.2s. Estimated remaining: 10m 53s. Rate: 158.9 symbols/min [2025-10-22T22:06:39.015906] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:39.083612] [DEBUG] [MAIN ] CBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:39.099929] [INFO ] [MAIN ] CBL: Generated 1794 derivative records from 16048 primary records. [2025-10-22T22:06:39.110613] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-22T22:06:39.204061] [DEBUG] [LOCAL ] CBL: Derivative data saved (1794 records). [2025-10-22T22:06:39.304127] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-22T22:06:39.320122] [INFO ] [MAIN ] Derivative Progress: 324/2052 symbols completed. CBL took 1.4s. Estimated remaining: 10m 52s. Rate: 158.9 symbols/min [2025-10-22T22:06:39.320515] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:39.357122] [DEBUG] [MAIN ] CBNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:39.358121] [INFO ] [MAIN ] CBNA: Generated 1794 derivative records from 2864 primary records. [2025-10-22T22:06:39.358352] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-22T22:06:39.394911] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1794 records). [2025-10-22T22:06:39.402921] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-22T22:06:39.394174] [DEBUG] [LOCAL ] CBRE: Loaded 50278 existing records from primary storage. [2025-10-22T22:06:39.406123] [INFO ] [MAIN ] Derivative Progress: 325/2052 symbols completed. CBNA took 0.4s. Estimated remaining: 10m 50s. Rate: 159.3 symbols/min [2025-10-22T22:06:39.403958] [INFO ] [MAIN ] CBRE: Loaded 50278 primary data records. [2025-10-22T22:06:39.406986] [DEBUG] [LOCAL ] CBT: Loaded 30925 existing records from primary storage. [2025-10-22T22:06:39.406469] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:39.418591] [INFO ] [MAIN ] CBT: Loaded 30925 primary data records. [2025-10-22T22:06:39.761199] [DEBUG] [LOCAL ] CBU: Loaded 22633 existing records from primary storage. [2025-10-22T22:06:39.786813] [INFO ] [MAIN ] CBU: Loaded 22633 primary data records. [2025-10-22T22:06:40.368366] [DEBUG] [MAIN ] CBRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:40.370724] [INFO ] [MAIN ] CBRE: Generated 1794 derivative records from 50278 primary records. [2025-10-22T22:06:40.384357] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-22T22:06:40.386022] [DEBUG] [MAIN ] CBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:40.400549] [INFO ] [MAIN ] CBT: Generated 1794 derivative records from 30925 primary records. [2025-10-22T22:06:40.403147] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-22T22:06:40.402969] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1794 records). [2025-10-22T22:06:40.404012] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-22T22:06:40.406340] [INFO ] [MAIN ] Derivative Progress: 326/2052 symbols completed. CBRE took 1.4s. Estimated remaining: 10m 53s. Rate: 158.5 symbols/min [2025-10-22T22:06:40.406715] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:40.427074] [DEBUG] [LOCAL ] CBT: Derivative data saved (1794 records). [2025-10-22T22:06:40.427378] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-22T22:06:40.429615] [INFO ] [MAIN ] Derivative Progress: 327/2052 symbols completed. CBT took 1.1s. Estimated remaining: 10m 51s. Rate: 159.0 symbols/min [2025-10-22T22:06:40.430054] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:40.444539] [DEBUG] [MAIN ] CBU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:40.445531] [INFO ] [MAIN ] CBU: Generated 1794 derivative records from 22633 primary records. [2025-10-22T22:06:40.445696] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-22T22:06:40.472128] [DEBUG] [LOCAL ] CBU: Derivative data saved (1794 records). [2025-10-22T22:06:40.472453] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-22T22:06:40.475056] [INFO ] [MAIN ] Derivative Progress: 328/2052 symbols completed. CBU took 1.1s. Estimated remaining: 10m 49s. Rate: 159.4 symbols/min [2025-10-22T22:06:40.487036] [DEBUG] [LOCAL ] CBZ: Loaded 34267 existing records from primary storage. [2025-10-22T22:06:40.487160] [INFO ] [MAIN ] CBZ: Loaded 34267 primary data records. [2025-10-22T22:06:40.838716] [DEBUG] [LOCAL ] CC: Loaded 53015 existing records from primary storage. [2025-10-22T22:06:40.839509] [INFO ] [MAIN ] CC: Loaded 53015 primary data records. [2025-10-22T22:06:41.158292] [DEBUG] [MAIN ] CBZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:41.159159] [INFO ] [MAIN ] CBZ: Generated 1794 derivative records from 34267 primary records. [2025-10-22T22:06:41.159366] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-22T22:06:41.175675] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1794 records). [2025-10-22T22:06:41.175885] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-10-22T22:06:41.178167] [INFO ] [MAIN ] Derivative Progress: 329/2052 symbols completed. CBZ took 0.8s. Estimated remaining: 10m 50s. Rate: 159.0 symbols/min [2025-10-22T22:06:41.194609] [DEBUG] [MAIN ] CC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:41.195266] [INFO ] [MAIN ] CC: Generated 1794 derivative records from 53015 primary records. [2025-10-22T22:06:41.195338] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-22T22:06:41.211288] [DEBUG] [LOCAL ] CC: Derivative data saved (1794 records). [2025-10-22T22:06:41.211377] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-22T22:06:41.213808] [INFO ] [MAIN ] Derivative Progress: 330/2052 symbols completed. CC took 0.8s. Estimated remaining: 10m 48s. Rate: 159.4 symbols/min [2025-10-22T22:06:41.214225] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:41.214352] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:41.214716] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:41.231596] [DEBUG] [LOCAL ] CCIF: Loaded 15143 existing records from primary storage. [2025-10-22T22:06:41.231841] [INFO ] [MAIN ] CCIF: Loaded 15143 primary data records. [2025-10-22T22:06:41.564881] [DEBUG] [LOCAL ] CCJ: Loaded 53690 existing records from primary storage. [2025-10-22T22:06:41.565500] [INFO ] [MAIN ] CCJ: Loaded 53690 primary data records. [2025-10-22T22:06:41.673975] [DEBUG] [LOCAL ] CCI: Loaded 53109 existing records from primary storage. [2025-10-22T22:06:41.690776] [INFO ] [MAIN ] CCI: Loaded 53109 primary data records. [2025-10-22T22:06:42.191625] [DEBUG] [MAIN ] CCIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:42.194006] [INFO ] [MAIN ] CCIF: Generated 1794 derivative records from 15143 primary records. [2025-10-22T22:06:42.194332] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-22T22:06:42.211611] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1794 records). [2025-10-22T22:06:42.212085] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-22T22:06:42.214557] [INFO ] [MAIN ] Derivative Progress: 331/2052 symbols completed. CCIF took 1.0s. Estimated remaining: 10m 51s. Rate: 158.6 symbols/min [2025-10-22T22:06:42.214921] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:42.233434] [DEBUG] [MAIN ] CCJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:42.234159] [INFO ] [MAIN ] CCJ: Generated 1794 derivative records from 53690 primary records. [2025-10-22T22:06:42.234402] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-22T22:06:42.252400] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1794 records). [2025-10-22T22:06:42.254083] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-22T22:06:42.256271] [INFO ] [MAIN ] Derivative Progress: 332/2052 symbols completed. CCJ took 1.0s. Estimated remaining: 10m 49s. Rate: 159.0 symbols/min [2025-10-22T22:06:42.256497] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:42.269788] [DEBUG] [MAIN ] CCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:42.270516] [INFO ] [MAIN ] CCI: Generated 1794 derivative records from 53109 primary records. [2025-10-22T22:06:42.270696] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-22T22:06:42.297260] [DEBUG] [LOCAL ] CCI: Derivative data saved (1794 records). [2025-10-22T22:06:42.297392] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-22T22:06:42.299789] [INFO ] [MAIN ] Derivative Progress: 333/2052 symbols completed. CCI took 1.1s. Estimated remaining: 10m 47s. Rate: 159.5 symbols/min [2025-10-22T22:06:42.300056] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:42.315519] [DEBUG] [LOCAL ] CCK: Loaded 46505 existing records from primary storage. [2025-10-22T22:06:42.315713] [INFO ] [MAIN ] CCK: Loaded 46505 primary data records. [2025-10-22T22:06:42.646482] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-22T22:06:42.668352] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-10-22T22:06:42.680325] [DEBUG] [LOCAL ] CCO: Loaded 48537 existing records from primary storage. [2025-10-22T22:06:42.690722] [INFO ] [MAIN ] CCO: Loaded 48537 primary data records. [2025-10-22T22:06:43.346612] [DEBUG] [MAIN ] CCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:43.348200] [INFO ] [MAIN ] CCK: Generated 1794 derivative records from 46505 primary records. [2025-10-22T22:06:43.348487] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-22T22:06:43.365289] [DEBUG] [LOCAL ] CCK: Derivative data saved (1794 records). [2025-10-22T22:06:43.366376] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-10-22T22:06:43.369750] [INFO ] [MAIN ] Derivative Progress: 334/2052 symbols completed. CCK took 1.2s. Estimated remaining: 10m 50s. Rate: 158.6 symbols/min [2025-10-22T22:06:43.370690] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:43.390961] [DEBUG] [MAIN ] CCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:43.391793] [INFO ] [MAIN ] CCL: Generated 1794 derivative records from 53800 primary records. [2025-10-22T22:06:43.391971] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-22T22:06:43.400017] [DEBUG] [LOCAL ] CCRD: Loaded 9562 existing records from primary storage. [2025-10-22T22:06:43.411388] [INFO ] [MAIN ] CCRD: Loaded 9562 primary data records. [2025-10-22T22:06:43.452429] [DEBUG] [LOCAL ] CCL: Derivative data saved (1794 records). [2025-10-22T22:06:43.452578] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-22T22:06:43.499697] [INFO ] [MAIN ] Derivative Progress: 335/2052 symbols completed. CCL took 1.2s. Estimated remaining: 10m 48s. Rate: 158.9 symbols/min [2025-10-22T22:06:43.505400] [DEBUG] [MAIN ] CCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:43.516981] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:43.539233] [INFO ] [MAIN ] CCO: Generated 1794 derivative records from 48537 primary records. [2025-10-22T22:06:43.539738] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-22T22:06:43.738370] [DEBUG] [LOCAL ] CCO: Derivative data saved (1794 records). [2025-10-22T22:06:43.746831] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-22T22:06:43.749630] [INFO ] [MAIN ] Derivative Progress: 336/2052 symbols completed. CCO took 1.4s. Estimated remaining: 10m 47s. Rate: 159.0 symbols/min [2025-10-22T22:06:43.750000] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:43.786516] [DEBUG] [LOCAL ] CCS: Loaded 29903 existing records from primary storage. [2025-10-22T22:06:43.793326] [INFO ] [MAIN ] CCS: Loaded 29903 primary data records. [2025-10-22T22:06:43.805201] [DEBUG] [LOCAL ] CCU: Loaded 21640 existing records from primary storage. [2025-10-22T22:06:43.815753] [INFO ] [MAIN ] CCU: Loaded 21640 primary data records. [2025-10-22T22:06:43.990837] [DEBUG] [MAIN ] CCRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:44.014202] [INFO ] [MAIN ] CCRD: Generated 1794 derivative records from 9562 primary records. [2025-10-22T22:06:44.021968] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-22T22:06:44.411482] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1794 records). [2025-10-22T22:06:44.421017] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-22T22:06:44.423090] [INFO ] [MAIN ] Derivative Progress: 337/2052 symbols completed. CCRD took 1.1s. Estimated remaining: 10m 48s. Rate: 158.7 symbols/min [2025-10-22T22:06:44.423238] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:44.483279] [DEBUG] [MAIN ] CCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:44.483777] [DEBUG] [MAIN ] CCU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:44.485211] [INFO ] [MAIN ] CCS: Generated 1794 derivative records from 29903 primary records. [2025-10-22T22:06:44.484618] [INFO ] [MAIN ] CCU: Generated 1794 derivative records from 21640 primary records. [2025-10-22T22:06:44.485351] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-22T22:06:44.485765] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-22T22:06:44.517167] [DEBUG] [LOCAL ] CCU: Derivative data saved (1794 records). [2025-10-22T22:06:44.518123] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-10-22T22:06:44.515670] [DEBUG] [LOCAL ] CCS: Derivative data saved (1794 records). [2025-10-22T22:06:44.520676] [INFO ] [MAIN ] Derivative Progress: 338/2052 symbols completed. CCU took 0.8s. Estimated remaining: 10m 47s. Rate: 159.0 symbols/min [2025-10-22T22:06:44.520887] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-10-22T22:06:44.521049] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:44.538088] [INFO ] [MAIN ] Derivative Progress: 339/2052 symbols completed. CCS took 1.0s. Estimated remaining: 10m 44s. Rate: 159.5 symbols/min [2025-10-22T22:06:44.538666] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:44.540060] [DEBUG] [LOCAL ] CDE: Loaded 53644 existing records from primary storage. [2025-10-22T22:06:44.540334] [INFO ] [MAIN ] CDE: Loaded 53644 primary data records. [2025-10-22T22:06:44.648671] [DEBUG] [LOCAL ] CDLR: Loaded 10195 existing records from primary storage. [2025-10-22T22:06:44.652333] [INFO ] [MAIN ] CDLR: Loaded 10195 primary data records. [2025-10-22T22:06:45.216683] [DEBUG] [LOCAL ] CDP: Loaded 42262 existing records from primary storage. [2025-10-22T22:06:45.218550] [INFO ] [MAIN ] CDP: Loaded 42262 primary data records. [2025-10-22T22:06:45.587758] [DEBUG] [MAIN ] CDE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:45.590006] [INFO ] [MAIN ] CDE: Generated 1794 derivative records from 53644 primary records. [2025-10-22T22:06:45.590776] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-22T22:06:45.620025] [DEBUG] [LOCAL ] CDE: Derivative data saved (1794 records). [2025-10-22T22:06:45.620773] [DEBUG] [MAIN ] CDLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:45.622010] [INFO ] [MAIN ] CDLR: Generated 1794 derivative records from 10195 primary records. [2025-10-22T22:06:45.622310] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-22T22:06:45.622679] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-22T22:06:45.624918] [INFO ] [MAIN ] Derivative Progress: 340/2052 symbols completed. CDE took 1.2s. Estimated remaining: 10m 48s. Rate: 158.6 symbols/min [2025-10-22T22:06:45.625703] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:45.641448] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1794 records). [2025-10-22T22:06:45.643035] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-22T22:06:45.645277] [INFO ] [MAIN ] Derivative Progress: 341/2052 symbols completed. CDLR took 1.1s. Estimated remaining: 10m 46s. Rate: 159.0 symbols/min [2025-10-22T22:06:45.645509] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:45.665875] [DEBUG] [LOCAL ] CDRE: Loaded 24728 existing records from primary storage. [2025-10-22T22:06:45.666303] [INFO ] [MAIN ] CDRE: Loaded 24728 primary data records. [2025-10-22T22:06:45.717017] [DEBUG] [MAIN ] CDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:45.743758] [INFO ] [MAIN ] CDP: Generated 1794 derivative records from 42262 primary records. [2025-10-22T22:06:45.755359] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-22T22:06:45.852633] [DEBUG] [LOCAL ] CDP: Derivative data saved (1794 records). [2025-10-22T22:06:45.888714] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-22T22:06:46.022445] [INFO ] [MAIN ] Derivative Progress: 342/2052 symbols completed. CDP took 1.5s. Estimated remaining: 10m 45s. Rate: 159.0 symbols/min [2025-10-22T22:06:46.022750] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:46.024265] [DEBUG] [LOCAL ] CE: Loaded 51253 existing records from primary storage. [2025-10-22T22:06:46.024359] [INFO ] [MAIN ] CE: Loaded 51253 primary data records. [2025-10-22T22:06:46.339806] [DEBUG] [LOCAL ] CEPU: Loaded 27008 existing records from primary storage. [2025-10-22T22:06:46.345225] [INFO ] [MAIN ] CEPU: Loaded 27008 primary data records. [2025-10-22T22:06:46.549291] [DEBUG] [MAIN ] CDRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:46.732420] [INFO ] [MAIN ] CDRE: Generated 1794 derivative records from 24728 primary records. [2025-10-22T22:06:46.741142] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-22T22:06:46.761376] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1794 records). [2025-10-22T22:06:46.764849] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-22T22:06:46.767214] [INFO ] [MAIN ] Derivative Progress: 343/2052 symbols completed. CDRE took 1.1s. Estimated remaining: 10m 47s. Rate: 158.6 symbols/min [2025-10-22T22:06:46.780872] [DEBUG] [MAIN ] CE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:46.781791] [INFO ] [MAIN ] CE: Generated 1794 derivative records from 51253 primary records. [2025-10-22T22:06:46.781870] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-22T22:06:46.798839] [DEBUG] [LOCAL ] CE: Derivative data saved (1794 records). [2025-10-22T22:06:46.799129] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-22T22:06:46.801250] [INFO ] [MAIN ] Derivative Progress: 344/2052 symbols completed. CE took 1.2s. Estimated remaining: 10m 45s. Rate: 159.0 symbols/min [2025-10-22T22:06:46.820886] [DEBUG] [MAIN ] CEPU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:46.821719] [INFO ] [MAIN ] CEPU: Generated 1794 derivative records from 27008 primary records. [2025-10-22T22:06:46.821808] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-22T22:06:46.837638] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1794 records). [2025-10-22T22:06:46.837740] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-22T22:06:46.840183] [INFO ] [MAIN ] Derivative Progress: 345/2052 symbols completed. CEPU took 0.8s. Estimated remaining: 10m 42s. Rate: 159.4 symbols/min [2025-10-22T22:06:46.840578] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:46.840725] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:46.841705] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:46.846248] [DEBUG] [LOCAL ] CGV: Loaded 1359 existing records from primary storage. [2025-10-22T22:06:46.846539] [INFO ] [MAIN ] CGV: Loaded 1359 primary data records. [2025-10-22T22:06:47.223495] [DEBUG] [LOCAL ] CGAU: Loaded 43921 existing records from primary storage. [2025-10-22T22:06:47.224403] [INFO ] [MAIN ] CGAU: Loaded 43921 primary data records. [2025-10-22T22:06:47.230908] [DEBUG] [LOCAL ] CFG: Loaded 53623 existing records from primary storage. [2025-10-22T22:06:47.241595] [INFO ] [MAIN ] CFG: Loaded 53623 primary data records. [2025-10-22T22:06:47.888625] [DEBUG] [MAIN ] CGV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:06:47.890327] [INFO ] [MAIN ] CGV: Generated 1793 derivative records from 1359 primary records. [2025-10-22T22:06:47.890588] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-22T22:06:47.906585] [DEBUG] [LOCAL ] CGV: Derivative data saved (1793 records). [2025-10-22T22:06:47.906896] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-22T22:06:47.909482] [INFO ] [MAIN ] Derivative Progress: 346/2052 symbols completed. CGV took 1.1s. Estimated remaining: 10m 45s. Rate: 158.6 symbols/min [2025-10-22T22:06:47.910044] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:47.939862] [DEBUG] [MAIN ] CGAU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:47.945797] [INFO ] [MAIN ] CGAU: Generated 1794 derivative records from 43921 primary records. [2025-10-22T22:06:47.946047] [DEBUG] [MAIN ] CFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:47.946768] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-22T22:06:47.946700] [INFO ] [MAIN ] CFG: Generated 1794 derivative records from 53623 primary records. [2025-10-22T22:06:47.946964] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-22T22:06:47.992494] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1794 records). [2025-10-22T22:06:47.993710] [DEBUG] [LOCAL ] CFG: Derivative data saved (1794 records). [2025-10-22T22:06:47.994370] [DEBUG] [LOCAL ] CHCT: Loaded 24266 existing records from primary storage. [2025-10-22T22:06:47.993925] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-10-22T22:06:47.994540] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-22T22:06:47.994672] [INFO ] [MAIN ] CHCT: Loaded 24266 primary data records. [2025-10-22T22:06:47.997011] [INFO ] [MAIN ] Derivative Progress: 347/2052 symbols completed. CFG took 1.2s. Estimated remaining: 10m 44s. Rate: 158.9 symbols/min [2025-10-22T22:06:47.999395] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:48.004821] [INFO ] [MAIN ] Derivative Progress: 348/2052 symbols completed. CGAU took 1.2s. Estimated remaining: 10m 41s. Rate: 159.4 symbols/min [2025-10-22T22:06:48.011691] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:48.188790] [DEBUG] [LOCAL ] CHE: Loaded 15327 existing records from primary storage. [2025-10-22T22:06:48.345539] [INFO ] [MAIN ] CHE: Loaded 15327 primary data records. [2025-10-22T22:06:48.486628] [DEBUG] [LOCAL ] CHD: Loaded 52320 existing records from primary storage. [2025-10-22T22:06:48.526502] [INFO ] [MAIN ] CHD: Loaded 52320 primary data records. [2025-10-22T22:06:49.039708] [DEBUG] [MAIN ] CHCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:49.041502] [INFO ] [MAIN ] CHCT: Generated 1794 derivative records from 24266 primary records. [2025-10-22T22:06:49.042439] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-10-22T22:06:49.060843] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1794 records). [2025-10-22T22:06:49.060989] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-10-22T22:06:49.063186] [INFO ] [MAIN ] Derivative Progress: 349/2052 symbols completed. CHCT took 1.2s. Estimated remaining: 10m 44s. Rate: 158.6 symbols/min [2025-10-22T22:06:49.063615] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:49.084903] [DEBUG] [MAIN ] CHE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:49.086298] [INFO ] [MAIN ] CHE: Generated 1794 derivative records from 15327 primary records. [2025-10-22T22:06:49.086611] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-22T22:06:49.107613] [DEBUG] [LOCAL ] CHE: Derivative data saved (1794 records). [2025-10-22T22:06:49.108193] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-22T22:06:49.131260] [INFO ] [MAIN ] Derivative Progress: 350/2052 symbols completed. CHE took 1.1s. Estimated remaining: 10m 43s. Rate: 158.9 symbols/min [2025-10-22T22:06:49.136836] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:49.136536] [DEBUG] [MAIN ] CHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:49.138325] [INFO ] [MAIN ] CHD: Generated 1794 derivative records from 52320 primary records. [2025-10-22T22:06:49.138618] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-22T22:06:49.155454] [DEBUG] [LOCAL ] CHD: Derivative data saved (1794 records). [2025-10-22T22:06:49.155587] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-10-22T22:06:49.158097] [INFO ] [MAIN ] Derivative Progress: 351/2052 symbols completed. CHD took 1.2s. Estimated remaining: 10m 40s. Rate: 159.3 symbols/min [2025-10-22T22:06:49.170455] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:49.172851] [DEBUG] [LOCAL ] CHGG: Loaded 47586 existing records from primary storage. [2025-10-22T22:06:49.173107] [INFO ] [MAIN ] CHGG: Loaded 47586 primary data records. [2025-10-22T22:06:49.389546] [DEBUG] [LOCAL ] CHH: Loaded 32225 existing records from primary storage. [2025-10-22T22:06:49.505614] [INFO ] [MAIN ] CHH: Loaded 32225 primary data records. [2025-10-22T22:06:49.388067] [DEBUG] [LOCAL ] CHMI: Loaded 21188 existing records from primary storage. [2025-10-22T22:06:49.518556] [INFO ] [MAIN ] CHMI: Loaded 21188 primary data records. [2025-10-22T22:06:50.158097] [DEBUG] [MAIN ] CHGG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:50.159763] [INFO ] [MAIN ] CHGG: Generated 1794 derivative records from 47586 primary records. [2025-10-22T22:06:50.162118] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-10-22T22:06:50.180736] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1794 records). [2025-10-22T22:06:50.181539] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-10-22T22:06:50.183609] [INFO ] [MAIN ] Derivative Progress: 352/2052 symbols completed. CHGG took 1.1s. Estimated remaining: 10m 43s. Rate: 158.6 symbols/min [2025-10-22T22:06:50.184208] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:50.193140] [DEBUG] [LOCAL ] CHN: Loaded 4983 existing records from primary storage. [2025-10-22T22:06:50.193498] [INFO ] [MAIN ] CHN: Loaded 4983 primary data records. [2025-10-22T22:06:50.319289] [DEBUG] [MAIN ] CHMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:50.331480] [DEBUG] [MAIN ] CHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:50.338381] [INFO ] [MAIN ] CHMI: Generated 1794 derivative records from 21188 primary records. [2025-10-22T22:06:50.355325] [INFO ] [MAIN ] CHH: Generated 1794 derivative records from 32225 primary records. [2025-10-22T22:06:50.375385] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-10-22T22:06:50.375550] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-22T22:06:50.446939] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1794 records). [2025-10-22T22:06:50.551867] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-10-22T22:06:50.561362] [DEBUG] [LOCAL ] CHH: Derivative data saved (1794 records). [2025-10-22T22:06:50.571839] [INFO ] [MAIN ] Derivative Progress: 353/2052 symbols completed. CHMI took 1.4s. Estimated remaining: 10m 43s. Rate: 158.6 symbols/min [2025-10-22T22:06:50.569088] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-10-22T22:06:50.572095] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:50.574808] [INFO ] [MAIN ] Derivative Progress: 354/2052 symbols completed. CHH took 1.4s. Estimated remaining: 10m 41s. Rate: 159.0 symbols/min [2025-10-22T22:06:50.576233] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:50.595669] [DEBUG] [LOCAL ] CIA: Loaded 16492 existing records from primary storage. [2025-10-22T22:06:50.596745] [INFO ] [MAIN ] CIA: Loaded 16492 primary data records. [2025-10-22T22:06:50.729450] [DEBUG] [MAIN ] CHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:50.746188] [INFO ] [MAIN ] CHN: Generated 1794 derivative records from 4983 primary records. [2025-10-22T22:06:50.746870] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-10-22T22:06:50.935261] [DEBUG] [LOCAL ] CHN: Derivative data saved (1794 records). [2025-10-22T22:06:50.935427] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-10-22T22:06:50.931691] [DEBUG] [LOCAL ] CHPT: Loaded 47004 existing records from primary storage. [2025-10-22T22:06:51.005333] [INFO ] [MAIN ] Derivative Progress: 355/2052 symbols completed. CHN took 0.8s. Estimated remaining: 10m 41s. Rate: 158.9 symbols/min [2025-10-22T22:06:51.006473] [INFO ] [MAIN ] CHPT: Loaded 47004 primary data records. [2025-10-22T22:06:51.011978] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:51.356934] [DEBUG] [LOCAL ] CIB: Loaded 30292 existing records from primary storage. [2025-10-22T22:06:51.357589] [INFO ] [MAIN ] CIB: Loaded 30292 primary data records. [2025-10-22T22:06:51.519891] [DEBUG] [MAIN ] CIA: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:06:51.554317] [INFO ] [MAIN ] CIA: Generated 1793 derivative records from 16492 primary records. [2025-10-22T22:06:51.569863] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-22T22:06:51.717522] [DEBUG] [LOCAL ] CIA: Derivative data saved (1793 records). [2025-10-22T22:06:51.719957] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-10-22T22:06:51.725484] [INFO ] [MAIN ] Derivative Progress: 356/2052 symbols completed. CIA took 1.1s. Estimated remaining: 10m 42s. Rate: 158.5 symbols/min [2025-10-22T22:06:51.734717] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:51.741368] [DEBUG] [MAIN ] CHPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:51.742282] [INFO ] [MAIN ] CHPT: Generated 1794 derivative records from 47004 primary records. [2025-10-22T22:06:51.742919] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-10-22T22:06:51.768958] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1794 records). [2025-10-22T22:06:51.769327] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-10-22T22:06:51.772607] [INFO ] [MAIN ] Derivative Progress: 357/2052 symbols completed. CHPT took 1.2s. Estimated remaining: 10m 40s. Rate: 158.9 symbols/min [2025-10-22T22:06:51.773170] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:51.782880] [DEBUG] [LOCAL ] CIF: Loaded 3978 existing records from primary storage. [2025-10-22T22:06:51.791532] [INFO ] [MAIN ] CIF: Loaded 3978 primary data records. [2025-10-22T22:06:51.850683] [DEBUG] [MAIN ] CIB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:51.884706] [INFO ] [MAIN ] CIB: Generated 1794 derivative records from 30292 primary records. [2025-10-22T22:06:51.891093] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-10-22T22:06:51.967583] [DEBUG] [LOCAL ] CIEN: Loaded 52121 existing records from primary storage. [2025-10-22T22:06:52.011820] [INFO ] [MAIN ] CIEN: Loaded 52121 primary data records. [2025-10-22T22:06:51.982130] [DEBUG] [LOCAL ] CIB: Derivative data saved (1794 records). [2025-10-22T22:06:52.028438] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-10-22T22:06:52.038315] [INFO ] [MAIN ] Derivative Progress: 358/2052 symbols completed. CIB took 1.0s. Estimated remaining: 10m 39s. Rate: 159.1 symbols/min [2025-10-22T22:06:52.495808] [DEBUG] [MAIN ] CIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:52.496505] [INFO ] [MAIN ] CIF: Generated 1794 derivative records from 3978 primary records. [2025-10-22T22:06:52.496727] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-22T22:06:52.511510] [DEBUG] [LOCAL ] CIF: Derivative data saved (1794 records). [2025-10-22T22:06:52.511714] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-10-22T22:06:52.513808] [INFO ] [MAIN ] Derivative Progress: 359/2052 symbols completed. CIF took 0.7s. Estimated remaining: 10m 39s. Rate: 158.9 symbols/min [2025-10-22T22:06:52.529684] [DEBUG] [MAIN ] CIEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:52.530257] [INFO ] [MAIN ] CIEN: Generated 1794 derivative records from 52121 primary records. [2025-10-22T22:06:52.530316] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-10-22T22:06:52.545682] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1794 records). [2025-10-22T22:06:52.545745] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-10-22T22:06:52.547983] [INFO ] [MAIN ] Derivative Progress: 360/2052 symbols completed. CIEN took 0.8s. Estimated remaining: 10m 37s. Rate: 159.3 symbols/min [2025-10-22T22:06:52.548407] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:52.548746] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:52.548570] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:52.566359] [DEBUG] [LOCAL ] CII: Loaded 15134 existing records from primary storage. [2025-10-22T22:06:52.566777] [INFO ] [MAIN ] CII: Loaded 15134 primary data records. [2025-10-22T22:06:52.762474] [DEBUG] [LOCAL ] CIM: Loaded 37394 existing records from primary storage. [2025-10-22T22:06:52.788225] [DEBUG] [LOCAL ] CIG: Loaded 44526 existing records from primary storage. [2025-10-22T22:06:52.773465] [INFO ] [MAIN ] CIM: Loaded 37394 primary data records. [2025-10-22T22:06:52.912577] [INFO ] [MAIN ] CIG: Loaded 44526 primary data records. [2025-10-22T22:06:53.601429] [DEBUG] [MAIN ] CII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:53.603725] [INFO ] [MAIN ] CII: Generated 1794 derivative records from 15134 primary records. [2025-10-22T22:06:53.604064] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-10-22T22:06:53.621317] [DEBUG] [LOCAL ] CII: Derivative data saved (1794 records). [2025-10-22T22:06:53.621551] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-10-22T22:06:53.623723] [INFO ] [MAIN ] Derivative Progress: 361/2052 symbols completed. CII took 1.1s. Estimated remaining: 10m 40s. Rate: 158.5 symbols/min [2025-10-22T22:06:53.624266] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:53.648244] [DEBUG] [LOCAL ] CIMN: Loaded 2705 existing records from primary storage. [2025-10-22T22:06:53.644248] [DEBUG] [MAIN ] CIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:53.649335] [INFO ] [MAIN ] CIMN: Loaded 2705 primary data records. [2025-10-22T22:06:53.650225] [INFO ] [MAIN ] CIM: Generated 1794 derivative records from 37394 primary records. [2025-10-22T22:06:53.657710] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-10-22T22:06:53.713580] [DEBUG] [MAIN ] CIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:53.741262] [INFO ] [MAIN ] CIG: Generated 1794 derivative records from 44526 primary records. [2025-10-22T22:06:53.761983] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-10-22T22:06:53.798669] [DEBUG] [LOCAL ] CIM: Derivative data saved (1794 records). [2025-10-22T22:06:53.807689] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-10-22T22:06:53.811148] [INFO ] [MAIN ] Derivative Progress: 362/2052 symbols completed. CIM took 1.3s. Estimated remaining: 10m 39s. Rate: 158.8 symbols/min [2025-10-22T22:06:53.811306] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:53.828560] [DEBUG] [LOCAL ] CIG: Derivative data saved (1794 records). [2025-10-22T22:06:53.860034] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-10-22T22:06:53.862592] [INFO ] [MAIN ] Derivative Progress: 363/2052 symbols completed. CIG took 1.3s. Estimated remaining: 10m 37s. Rate: 159.1 symbols/min [2025-10-22T22:06:53.862915] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:54.023064] [DEBUG] [LOCAL ] CINT: Loaded 20384 existing records from primary storage. [2025-10-22T22:06:54.023854] [INFO ] [MAIN ] CINT: Loaded 20384 primary data records. [2025-10-22T22:06:54.142248] [DEBUG] [LOCAL ] CIO: Loaded 21207 existing records from primary storage. [2025-10-22T22:06:54.148089] [INFO ] [MAIN ] CIO: Loaded 21207 primary data records. [2025-10-22T22:06:54.528006] [DEBUG] [MAIN ] CIMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:54.643789] [INFO ] [MAIN ] CIMN: Generated 1794 derivative records from 2705 primary records. [2025-10-22T22:06:54.653107] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-10-22T22:06:54.669978] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1794 records). [2025-10-22T22:06:54.670969] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-10-22T22:06:54.673168] [INFO ] [MAIN ] Derivative Progress: 364/2052 symbols completed. CIMN took 1.0s. Estimated remaining: 10m 38s. Rate: 158.6 symbols/min [2025-10-22T22:06:54.673420] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:54.694604] [DEBUG] [MAIN ] CINT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:54.695373] [INFO ] [MAIN ] CINT: Generated 1794 derivative records from 20384 primary records. [2025-10-22T22:06:54.695674] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-10-22T22:06:54.718794] [DEBUG] [LOCAL ] CINT: Derivative data saved (1794 records). [2025-10-22T22:06:54.720210] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-10-22T22:06:54.723470] [INFO ] [MAIN ] Derivative Progress: 365/2052 symbols completed. CINT took 0.9s. Estimated remaining: 10m 37s. Rate: 159.0 symbols/min [2025-10-22T22:06:54.731440] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:54.733113] [DEBUG] [LOCAL ] CION: Loaded 28073 existing records from primary storage. [2025-10-22T22:06:54.733428] [INFO ] [MAIN ] CION: Loaded 28073 primary data records. [2025-10-22T22:06:54.783977] [DEBUG] [MAIN ] CIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:54.803212] [INFO ] [MAIN ] CIO: Generated 1794 derivative records from 21207 primary records. [2025-10-22T22:06:54.817330] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-22T22:06:54.871822] [DEBUG] [LOCAL ] CIO: Derivative data saved (1794 records). [2025-10-22T22:06:54.877144] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-10-22T22:06:54.895070] [INFO ] [MAIN ] Derivative Progress: 366/2052 symbols completed. CIO took 1.0s. Estimated remaining: 10m 35s. Rate: 159.2 symbols/min [2025-10-22T22:06:54.895309] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:55.116834] [DEBUG] [LOCAL ] CIVI: Loaded 52730 existing records from primary storage. [2025-10-22T22:06:55.118613] [INFO ] [MAIN ] CIVI: Loaded 52730 primary data records. [2025-10-22T22:06:55.437807] [DEBUG] [LOCAL ] CL: Loaded 53649 existing records from primary storage. [2025-10-22T22:06:55.446493] [INFO ] [MAIN ] CL: Loaded 53649 primary data records. [2025-10-22T22:06:55.532361] [DEBUG] [MAIN ] CION: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:55.539765] [INFO ] [MAIN ] CION: Generated 1794 derivative records from 28073 primary records. [2025-10-22T22:06:55.556116] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-10-22T22:06:55.769392] [DEBUG] [LOCAL ] CION: Derivative data saved (1794 records). [2025-10-22T22:06:55.778038] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-10-22T22:06:55.781113] [INFO ] [MAIN ] Derivative Progress: 367/2052 symbols completed. CION took 1.1s. Estimated remaining: 10m 37s. Rate: 158.7 symbols/min [2025-10-22T22:06:55.781312] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:55.808884] [DEBUG] [MAIN ] CIVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:55.810005] [INFO ] [MAIN ] CIVI: Generated 1794 derivative records from 52730 primary records. [2025-10-22T22:06:55.819255] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-22T22:06:55.847133] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1794 records). [2025-10-22T22:06:55.847992] [DEBUG] [LOCAL ] CLB: Loaded 33453 existing records from primary storage. [2025-10-22T22:06:55.847298] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-22T22:06:55.848415] [INFO ] [MAIN ] CLB: Loaded 33453 primary data records. [2025-10-22T22:06:55.851054] [INFO ] [MAIN ] Derivative Progress: 368/2052 symbols completed. CIVI took 1.1s. Estimated remaining: 10m 35s. Rate: 159.0 symbols/min [2025-10-22T22:06:55.852404] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:55.966802] [DEBUG] [MAIN ] CL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:55.976550] [INFO ] [MAIN ] CL: Generated 1794 derivative records from 53649 primary records. [2025-10-22T22:06:55.982259] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-10-22T22:06:56.174016] [DEBUG] [LOCAL ] CLDT: Loaded 25165 existing records from primary storage. [2025-10-22T22:06:56.190438] [INFO ] [MAIN ] CLDT: Loaded 25165 primary data records. [2025-10-22T22:06:56.190348] [DEBUG] [LOCAL ] CL: Derivative data saved (1794 records). [2025-10-22T22:06:56.201939] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-10-22T22:06:56.204540] [INFO ] [MAIN ] Derivative Progress: 369/2052 symbols completed. CL took 1.3s. Estimated remaining: 10m 35s. Rate: 159.0 symbols/min [2025-10-22T22:06:56.226004] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:56.525940] [DEBUG] [MAIN ] CLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:56.541861] [INFO ] [MAIN ] CLB: Generated 1794 derivative records from 33453 primary records. [2025-10-22T22:06:56.542874] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-22T22:06:56.543196] [INFO ] [MAIN ] CLF: Loaded 53741 primary data records. [2025-10-22T22:06:56.542055] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-10-22T22:06:56.666698] [DEBUG] [LOCAL ] CLB: Derivative data saved (1794 records). [2025-10-22T22:06:56.684327] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-10-22T22:06:56.719095] [INFO ] [MAIN ] Derivative Progress: 370/2052 symbols completed. CLB took 0.9s. Estimated remaining: 10m 35s. Rate: 158.9 symbols/min [2025-10-22T22:06:56.748466] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:56.913311] [DEBUG] [MAIN ] CLDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:56.914535] [INFO ] [MAIN ] CLDT: Generated 1794 derivative records from 25165 primary records. [2025-10-22T22:06:56.914618] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-22T22:06:56.930924] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1794 records). [2025-10-22T22:06:56.931781] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-10-22T22:06:56.934241] [INFO ] [MAIN ] Derivative Progress: 371/2052 symbols completed. CLDT took 1.1s. Estimated remaining: 10m 34s. Rate: 159.1 symbols/min [2025-10-22T22:06:56.934859] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:56.962197] [DEBUG] [LOCAL ] CLH: Loaded 27584 existing records from primary storage. [2025-10-22T22:06:56.962594] [DEBUG] [LOCAL ] CLPR: Loaded 9996 existing records from primary storage. [2025-10-22T22:06:56.962794] [INFO ] [MAIN ] CLPR: Loaded 9996 primary data records. [2025-10-22T22:06:56.962882] [INFO ] [MAIN ] CLH: Loaded 27584 primary data records. [2025-10-22T22:06:57.189031] [DEBUG] [MAIN ] CLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:57.200065] [INFO ] [MAIN ] CLF: Generated 1794 derivative records from 53741 primary records. [2025-10-22T22:06:57.220637] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-10-22T22:06:57.575961] [DEBUG] [LOCAL ] CLF: Derivative data saved (1794 records). [2025-10-22T22:06:57.576237] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-10-22T22:06:57.578568] [INFO ] [MAIN ] Derivative Progress: 372/2052 symbols completed. CLF took 1.4s. Estimated remaining: 10m 35s. Rate: 158.8 symbols/min [2025-10-22T22:06:57.578861] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:57.614788] [DEBUG] [MAIN ] CLH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:57.627837] [DEBUG] [MAIN ] CLPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:57.627538] [INFO ] [MAIN ] CLH: Generated 1794 derivative records from 27584 primary records. [2025-10-22T22:06:57.628504] [INFO ] [MAIN ] CLPR: Generated 1794 derivative records from 9996 primary records. [2025-10-22T22:06:57.628580] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-22T22:06:57.642273] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-10-22T22:06:57.672232] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1794 records). [2025-10-22T22:06:57.673096] [DEBUG] [LOCAL ] CLH: Derivative data saved (1794 records). [2025-10-22T22:06:57.673275] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-10-22T22:06:57.675858] [INFO ] [MAIN ] Derivative Progress: 373/2052 symbols completed. CLPR took 0.7s. Estimated remaining: 10m 33s. Rate: 159.1 symbols/min [2025-10-22T22:06:57.673228] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-10-22T22:06:57.678553] [INFO ] [MAIN ] Derivative Progress: 374/2052 symbols completed. CLH took 0.9s. Estimated remaining: 10m 31s. Rate: 159.5 symbols/min [2025-10-22T22:06:57.693869] [DEBUG] [LOCAL ] CLS: Loaded 53563 existing records from primary storage. [2025-10-22T22:06:57.693969] [INFO ] [MAIN ] CLS: Loaded 53563 primary data records. [2025-10-22T22:06:57.996519] [DEBUG] [MAIN ] CLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:57.997184] [INFO ] [MAIN ] CLS: Generated 1794 derivative records from 53563 primary records. [2025-10-22T22:06:57.997246] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-10-22T22:06:58.012161] [DEBUG] [LOCAL ] CLS: Derivative data saved (1794 records). [2025-10-22T22:06:58.012236] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-10-22T22:06:58.014236] [INFO ] [MAIN ] Derivative Progress: 375/2052 symbols completed. CLS took 0.4s. Estimated remaining: 10m 31s. Rate: 159.6 symbols/min [2025-10-22T22:06:58.015021] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:58.014943] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:58.015092] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:58.037134] [DEBUG] [LOCAL ] CLW: Loaded 21127 existing records from primary storage. [2025-10-22T22:06:58.037318] [INFO ] [MAIN ] CLW: Loaded 21127 primary data records. [2025-10-22T22:06:58.389078] [DEBUG] [LOCAL ] CLVT: Loaded 51912 existing records from primary storage. [2025-10-22T22:06:58.389271] [INFO ] [MAIN ] CLVT: Loaded 51912 primary data records. [2025-10-22T22:06:58.390004] [DEBUG] [LOCAL ] CLX: Loaded 51814 existing records from primary storage. [2025-10-22T22:06:58.426618] [INFO ] [MAIN ] CLX: Loaded 51814 primary data records. [2025-10-22T22:06:59.054757] [DEBUG] [MAIN ] CLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:59.056091] [INFO ] [MAIN ] CLW: Generated 1794 derivative records from 21127 primary records. [2025-10-22T22:06:59.056424] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-22T22:06:59.074984] [DEBUG] [LOCAL ] CLW: Derivative data saved (1794 records). [2025-10-22T22:06:59.075164] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-22T22:06:59.077586] [INFO ] [MAIN ] Derivative Progress: 376/2052 symbols completed. CLW took 1.1s. Estimated remaining: 10m 33s. Rate: 158.8 symbols/min [2025-10-22T22:06:59.077999] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:59.095768] [DEBUG] [MAIN ] CLVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:59.096759] [INFO ] [MAIN ] CLVT: Generated 1794 derivative records from 51912 primary records. [2025-10-22T22:06:59.096978] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-10-22T22:06:59.129087] [DEBUG] [MAIN ] CLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:06:59.130455] [INFO ] [MAIN ] CLX: Generated 1794 derivative records from 51814 primary records. [2025-10-22T22:06:59.129718] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1794 records). [2025-10-22T22:06:59.130546] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-22T22:06:59.130726] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-10-22T22:06:59.133278] [INFO ] [MAIN ] Derivative Progress: 377/2052 symbols completed. CLVT took 1.1s. Estimated remaining: 10m 32s. Rate: 159.1 symbols/min [2025-10-22T22:06:59.133495] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:59.159953] [DEBUG] [LOCAL ] CLX: Derivative data saved (1794 records). [2025-10-22T22:06:59.160105] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-10-22T22:06:59.162706] [INFO ] [MAIN ] Derivative Progress: 378/2052 symbols completed. CLX took 1.1s. Estimated remaining: 10m 30s. Rate: 159.5 symbols/min [2025-10-22T22:06:59.162927] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:06:59.182180] [DEBUG] [LOCAL ] CM: Loaded 48431 existing records from primary storage. [2025-10-22T22:06:59.182342] [INFO ] [MAIN ] CM: Loaded 48431 primary data records. [2025-10-22T22:06:59.300936] [DEBUG] [LOCAL ] CMBT: Loaded 27509 existing records from primary storage. [2025-10-22T22:06:59.301203] [INFO ] [MAIN ] CMBT: Loaded 27509 primary data records. [2025-10-22T22:06:59.644480] [DEBUG] [LOCAL ] CMA: Loaded 50170 existing records from primary storage. [2025-10-22T22:06:59.666801] [INFO ] [MAIN ] CMA: Loaded 50170 primary data records. [2025-10-22T22:07:00.140143] [DEBUG] [MAIN ] CM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:00.141501] [INFO ] [MAIN ] CM: Generated 1794 derivative records from 48431 primary records. [2025-10-22T22:07:00.142620] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-22T22:07:00.175296] [DEBUG] [LOCAL ] CM: Derivative data saved (1794 records). [2025-10-22T22:07:00.176139] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-22T22:07:00.176581] [DEBUG] [MAIN ] CMBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:00.178846] [INFO ] [MAIN ] Derivative Progress: 379/2052 symbols completed. CM took 1.1s. Estimated remaining: 10m 32s. Rate: 158.8 symbols/min [2025-10-22T22:07:00.180138] [INFO ] [MAIN ] CMBT: Generated 1794 derivative records from 27509 primary records. [2025-10-22T22:07:00.180308] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:00.180425] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-22T22:07:00.198680] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1794 records). [2025-10-22T22:07:00.199071] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-22T22:07:00.201459] [INFO ] [MAIN ] Derivative Progress: 380/2052 symbols completed. CMBT took 1.0s. Estimated remaining: 10m 30s. Rate: 159.2 symbols/min [2025-10-22T22:07:00.202132] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:00.223494] [DEBUG] [LOCAL ] CMCM: Loaded 4828 existing records from primary storage. [2025-10-22T22:07:00.223815] [DEBUG] [MAIN ] CMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:00.224790] [INFO ] [MAIN ] CMCM: Loaded 4828 primary data records. [2025-10-22T22:07:00.224582] [INFO ] [MAIN ] CMA: Generated 1794 derivative records from 50170 primary records. [2025-10-22T22:07:00.230207] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-10-22T22:07:00.362687] [DEBUG] [LOCAL ] CMA: Derivative data saved (1794 records). [2025-10-22T22:07:00.383453] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-10-22T22:07:00.399243] [INFO ] [MAIN ] Derivative Progress: 381/2052 symbols completed. CMA took 1.3s. Estimated remaining: 10m 29s. Rate: 159.4 symbols/min [2025-10-22T22:07:00.445741] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:00.559686] [DEBUG] [LOCAL ] CMC: Loaded 45548 existing records from primary storage. [2025-10-22T22:07:00.568185] [INFO ] [MAIN ] CMC: Loaded 45548 primary data records. [2025-10-22T22:07:00.931400] [DEBUG] [LOCAL ] CMI: Loaded 41637 existing records from primary storage. [2025-10-22T22:07:00.932785] [INFO ] [MAIN ] CMI: Loaded 41637 primary data records. [2025-10-22T22:07:01.092984] [DEBUG] [MAIN ] CMCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:01.235512] [INFO ] [MAIN ] CMCM: Generated 1794 derivative records from 4828 primary records. [2025-10-22T22:07:01.249694] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-22T22:07:01.266783] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1794 records). [2025-10-22T22:07:01.267599] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-22T22:07:01.270114] [INFO ] [MAIN ] Derivative Progress: 382/2052 symbols completed. CMCM took 1.1s. Estimated remaining: 10m 31s. Rate: 158.9 symbols/min [2025-10-22T22:07:01.270865] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:01.289876] [DEBUG] [MAIN ] CMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:01.290969] [INFO ] [MAIN ] CMC: Generated 1794 derivative records from 45548 primary records. [2025-10-22T22:07:01.291615] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-22T22:07:01.320315] [DEBUG] [LOCAL ] CMC: Derivative data saved (1794 records). [2025-10-22T22:07:01.322132] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-10-22T22:07:01.324625] [INFO ] [MAIN ] Derivative Progress: 383/2052 symbols completed. CMC took 1.1s. Estimated remaining: 10m 29s. Rate: 159.2 symbols/min [2025-10-22T22:07:01.325065] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:01.338241] [DEBUG] [MAIN ] CMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:01.339057] [INFO ] [MAIN ] CMI: Generated 1794 derivative records from 41637 primary records. [2025-10-22T22:07:01.339162] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-22T22:07:01.365416] [DEBUG] [LOCAL ] CMP: Loaded 35683 existing records from primary storage. [2025-10-22T22:07:01.367526] [DEBUG] [LOCAL ] CMI: Derivative data saved (1794 records). [2025-10-22T22:07:01.367714] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-22T22:07:01.371060] [INFO ] [MAIN ] Derivative Progress: 384/2052 symbols completed. CMI took 0.9s. Estimated remaining: 10m 27s. Rate: 159.6 symbols/min [2025-10-22T22:07:01.366981] [INFO ] [MAIN ] CMP: Loaded 35683 primary data records. [2025-10-22T22:07:01.371423] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:01.592539] [DEBUG] [LOCAL ] CMPO: Loaded 38424 existing records from primary storage. [2025-10-22T22:07:01.718311] [INFO ] [MAIN ] CMPO: Loaded 38424 primary data records. [2025-10-22T22:07:01.776431] [DEBUG] [LOCAL ] CMRE: Loaded 35651 existing records from primary storage. [2025-10-22T22:07:01.790795] [INFO ] [MAIN ] CMRE: Loaded 35651 primary data records. [2025-10-22T22:07:02.363860] [DEBUG] [MAIN ] CMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:02.365121] [INFO ] [MAIN ] CMP: Generated 1794 derivative records from 35683 primary records. [2025-10-22T22:07:02.365228] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-22T22:07:02.382190] [DEBUG] [LOCAL ] CMP: Derivative data saved (1794 records). [2025-10-22T22:07:02.382490] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-22T22:07:02.385915] [INFO ] [MAIN ] Derivative Progress: 385/2052 symbols completed. CMP took 1.1s. Estimated remaining: 10m 30s. Rate: 158.9 symbols/min [2025-10-22T22:07:02.386181] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:02.409916] [DEBUG] [MAIN ] CMPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:02.411630] [INFO ] [MAIN ] CMPO: Generated 1794 derivative records from 38424 primary records. [2025-10-22T22:07:02.412269] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-22T22:07:02.430417] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1794 records). [2025-10-22T22:07:02.430602] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-22T22:07:02.432922] [INFO ] [MAIN ] Derivative Progress: 386/2052 symbols completed. CMPO took 1.1s. Estimated remaining: 10m 28s. Rate: 159.2 symbols/min [2025-10-22T22:07:02.433126] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:02.446385] [DEBUG] [MAIN ] CMRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:02.447111] [INFO ] [MAIN ] CMRE: Generated 1794 derivative records from 35651 primary records. [2025-10-22T22:07:02.447227] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-22T22:07:02.478148] [DEBUG] [LOCAL ] CMSA: Loaded 3471 existing records from primary storage. [2025-10-22T22:07:02.482302] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1794 records). [2025-10-22T22:07:02.482577] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-10-22T22:07:02.482448] [INFO ] [MAIN ] CMSA: Loaded 3471 primary data records. [2025-10-22T22:07:02.485205] [INFO ] [MAIN ] Derivative Progress: 387/2052 symbols completed. CMRE took 1.1s. Estimated remaining: 10m 26s. Rate: 159.6 symbols/min [2025-10-22T22:07:02.499180] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:02.611887] [DEBUG] [LOCAL ] CMSC: Loaded 4809 existing records from primary storage. [2025-10-22T22:07:02.605433] [DEBUG] [LOCAL ] CMS: Loaded 52551 existing records from primary storage. [2025-10-22T22:07:02.617259] [INFO ] [MAIN ] CMSC: Loaded 4809 primary data records. [2025-10-22T22:07:02.617425] [INFO ] [MAIN ] CMS: Loaded 52551 primary data records. [2025-10-22T22:07:03.480754] [DEBUG] [MAIN ] CMSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:03.481893] [INFO ] [MAIN ] CMSA: Generated 1794 derivative records from 3471 primary records. [2025-10-22T22:07:03.481990] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-10-22T22:07:03.497728] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1794 records). [2025-10-22T22:07:03.501951] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-10-22T22:07:03.504564] [INFO ] [MAIN ] Derivative Progress: 388/2052 symbols completed. CMSA took 1.1s. Estimated remaining: 10m 28s. Rate: 158.9 symbols/min [2025-10-22T22:07:03.530592] [DEBUG] [MAIN ] CMSC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:03.531584] [INFO ] [MAIN ] CMSC: Generated 1794 derivative records from 4809 primary records. [2025-10-22T22:07:03.531956] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-22T22:07:03.531843] [DEBUG] [MAIN ] CMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:03.533198] [INFO ] [MAIN ] CMS: Generated 1794 derivative records from 52551 primary records. [2025-10-22T22:07:03.533524] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-10-22T22:07:03.555665] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1794 records). [2025-10-22T22:07:03.555817] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-10-22T22:07:03.559694] [INFO ] [MAIN ] Derivative Progress: 389/2052 symbols completed. CMSC took 1.1s. Estimated remaining: 10m 27s. Rate: 159.2 symbols/min [2025-10-22T22:07:03.566437] [DEBUG] [LOCAL ] CMS: Derivative data saved (1794 records). [2025-10-22T22:07:03.566507] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-10-22T22:07:03.569023] [INFO ] [MAIN ] Derivative Progress: 390/2052 symbols completed. CMS took 1.2s. Estimated remaining: 10m 25s. Rate: 159.6 symbols/min [2025-10-22T22:07:03.569498] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:03.569432] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:03.570407] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:03.583706] [DEBUG] [LOCAL ] CMU: Loaded 6348 existing records from primary storage. [2025-10-22T22:07:03.583437] [DEBUG] [LOCAL ] CMSD: Loaded 7603 existing records from primary storage. [2025-10-22T22:07:03.583944] [INFO ] [MAIN ] CMSD: Loaded 7603 primary data records. [2025-10-22T22:07:03.584009] [INFO ] [MAIN ] CMU: Loaded 6348 primary data records. [2025-10-22T22:07:03.877584] [DEBUG] [LOCAL ] CMTG: Loaded 35217 existing records from primary storage. [2025-10-22T22:07:03.958498] [INFO ] [MAIN ] CMTG: Loaded 35217 primary data records. [2025-10-22T22:07:04.579977] [DEBUG] [MAIN ] CMSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:04.580926] [INFO ] [MAIN ] CMSD: Generated 1794 derivative records from 7603 primary records. [2025-10-22T22:07:04.581029] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-22T22:07:04.603759] [DEBUG] [MAIN ] CMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:04.607404] [INFO ] [MAIN ] CMU: Generated 1794 derivative records from 6348 primary records. [2025-10-22T22:07:04.607782] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-10-22T22:07:04.612245] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1794 records). [2025-10-22T22:07:04.612328] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-22T22:07:04.614457] [INFO ] [MAIN ] Derivative Progress: 391/2052 symbols completed. CMSD took 1.0s. Estimated remaining: 10m 27s. Rate: 158.9 symbols/min [2025-10-22T22:07:04.614954] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:04.630312] [DEBUG] [LOCAL ] CMU: Derivative data saved (1794 records). [2025-10-22T22:07:04.630798] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-10-22T22:07:04.633490] [INFO ] [MAIN ] Derivative Progress: 392/2052 symbols completed. CMU took 1.1s. Estimated remaining: 10m 25s. Rate: 159.3 symbols/min [2025-10-22T22:07:04.633836] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:04.652417] [DEBUG] [MAIN ] CMTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:04.653449] [INFO ] [MAIN ] CMTG: Generated 1794 derivative records from 35217 primary records. [2025-10-22T22:07:04.653589] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-22T22:07:04.684194] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1794 records). [2025-10-22T22:07:04.684493] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-10-22T22:07:04.687278] [INFO ] [MAIN ] Derivative Progress: 393/2052 symbols completed. CMTG took 1.1s. Estimated remaining: 10m 23s. Rate: 159.7 symbols/min [2025-10-22T22:07:04.687560] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:04.698977] [DEBUG] [LOCAL ] CNA: Loaded 32534 existing records from primary storage. [2025-10-22T22:07:04.699105] [INFO ] [MAIN ] CNA: Loaded 32534 primary data records. [2025-10-22T22:07:04.913889] [DEBUG] [LOCAL ] CNC: Loaded 53779 existing records from primary storage. [2025-10-22T22:07:05.035868] [INFO ] [MAIN ] CNC: Loaded 53779 primary data records. [2025-10-22T22:07:05.211048] [DEBUG] [LOCAL ] CNI: Loaded 51658 existing records from primary storage. [2025-10-22T22:07:05.233727] [INFO ] [MAIN ] CNI: Loaded 51658 primary data records. [2025-10-22T22:07:05.933797] [DEBUG] [MAIN ] CNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:05.934873] [INFO ] [MAIN ] CNA: Generated 1794 derivative records from 32534 primary records. [2025-10-22T22:07:05.935097] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-10-22T22:07:05.961516] [DEBUG] [LOCAL ] CNA: Derivative data saved (1794 records). [2025-10-22T22:07:05.961619] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-10-22T22:07:05.963724] [INFO ] [MAIN ] Derivative Progress: 394/2052 symbols completed. CNA took 1.3s. Estimated remaining: 10m 27s. Rate: 158.7 symbols/min [2025-10-22T22:07:05.964029] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:05.987385] [DEBUG] [MAIN ] CNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:05.990210] [INFO ] [MAIN ] CNC: Generated 1794 derivative records from 53779 primary records. [2025-10-22T22:07:05.990597] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-22T22:07:06.016244] [DEBUG] [MAIN ] CNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:06.021063] [INFO ] [MAIN ] CNI: Generated 1794 derivative records from 51658 primary records. [2025-10-22T22:07:06.021745] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-22T22:07:06.022078] [DEBUG] [LOCAL ] CNC: Derivative data saved (1794 records). [2025-10-22T22:07:06.022184] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-22T22:07:06.025595] [INFO ] [MAIN ] Derivative Progress: 395/2052 symbols completed. CNC took 1.4s. Estimated remaining: 10m 25s. Rate: 159.0 symbols/min [2025-10-22T22:07:06.026170] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:06.056464] [DEBUG] [LOCAL ] CNI: Derivative data saved (1794 records). [2025-10-22T22:07:06.056840] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-10-22T22:07:06.060272] [INFO ] [MAIN ] Derivative Progress: 396/2052 symbols completed. CNI took 1.4s. Estimated remaining: 10m 23s. Rate: 159.4 symbols/min [2025-10-22T22:07:06.061227] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:06.079813] [DEBUG] [LOCAL ] CNK: Loaded 52908 existing records from primary storage. [2025-10-22T22:07:06.080118] [INFO ] [MAIN ] CNK: Loaded 52908 primary data records. [2025-10-22T22:07:06.270051] [DEBUG] [LOCAL ] CNMD: Loaded 32058 existing records from primary storage. [2025-10-22T22:07:06.294476] [INFO ] [MAIN ] CNMD: Loaded 32058 primary data records. [2025-10-22T22:07:06.471185] [DEBUG] [LOCAL ] CNO: Loaded 40344 existing records from primary storage. [2025-10-22T22:07:06.489628] [INFO ] [MAIN ] CNO: Loaded 40344 primary data records. [2025-10-22T22:07:07.178979] [DEBUG] [MAIN ] CNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:07.180012] [INFO ] [MAIN ] CNK: Generated 1794 derivative records from 52908 primary records. [2025-10-22T22:07:07.180239] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-10-22T22:07:07.201384] [DEBUG] [LOCAL ] CNK: Derivative data saved (1794 records). [2025-10-22T22:07:07.201678] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-10-22T22:07:07.204148] [INFO ] [MAIN ] Derivative Progress: 397/2052 symbols completed. CNK took 1.2s. Estimated remaining: 10m 26s. Rate: 158.6 symbols/min [2025-10-22T22:07:07.204409] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:07.222897] [DEBUG] [MAIN ] CNMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:07.224474] [INFO ] [MAIN ] CNMD: Generated 1794 derivative records from 32058 primary records. [2025-10-22T22:07:07.225230] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-10-22T22:07:07.251959] [DEBUG] [MAIN ] CNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:07.255330] [INFO ] [MAIN ] CNO: Generated 1794 derivative records from 40344 primary records. [2025-10-22T22:07:07.255487] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-22T22:07:07.255389] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1794 records). [2025-10-22T22:07:07.256229] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-10-22T22:07:07.258803] [INFO ] [MAIN ] Derivative Progress: 398/2052 symbols completed. CNMD took 1.2s. Estimated remaining: 10m 24s. Rate: 158.9 symbols/min [2025-10-22T22:07:07.272624] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:07.273941] [DEBUG] [LOCAL ] CNO: Derivative data saved (1794 records). [2025-10-22T22:07:07.274039] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-10-22T22:07:07.277108] [INFO ] [MAIN ] Derivative Progress: 399/2052 symbols completed. CNO took 1.2s. Estimated remaining: 10m 23s. Rate: 159.3 symbols/min [2025-10-22T22:07:07.291020] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:07.314158] [DEBUG] [LOCAL ] CNP: Loaded 53475 existing records from primary storage. [2025-10-22T22:07:07.314419] [INFO ] [MAIN ] CNP: Loaded 53475 primary data records. [2025-10-22T22:07:07.476241] [DEBUG] [LOCAL ] CODI: Loaded 41954 existing records from primary storage. [2025-10-22T22:07:07.494160] [INFO ] [MAIN ] CODI: Loaded 41954 primary data records. [2025-10-22T22:07:07.571869] [DEBUG] [LOCAL ] CNQ: Loaded 53582 existing records from primary storage. [2025-10-22T22:07:07.742966] [INFO ] [MAIN ] CNQ: Loaded 53582 primary data records. [2025-10-22T22:07:08.292395] [DEBUG] [MAIN ] CNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:08.293177] [INFO ] [MAIN ] CNP: Generated 1794 derivative records from 53475 primary records. [2025-10-22T22:07:08.293569] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-22T22:07:08.310830] [DEBUG] [LOCAL ] CNP: Derivative data saved (1794 records). [2025-10-22T22:07:08.310996] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-22T22:07:08.312995] [INFO ] [MAIN ] Derivative Progress: 400/2052 symbols completed. CNP took 1.1s. Estimated remaining: 10m 25s. Rate: 158.6 symbols/min [2025-10-22T22:07:08.313255] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:08.332721] [DEBUG] [MAIN ] CODI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:08.340847] [INFO ] [MAIN ] CODI: Generated 1794 derivative records from 41954 primary records. [2025-10-22T22:07:08.340946] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-10-22T22:07:08.346127] [DEBUG] [MAIN ] CNQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:08.347362] [INFO ] [MAIN ] CNQ: Generated 1794 derivative records from 53582 primary records. [2025-10-22T22:07:08.347566] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-22T22:07:08.379216] [DEBUG] [LOCAL ] CODI: Derivative data saved (1794 records). [2025-10-22T22:07:08.379974] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-10-22T22:07:08.379775] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1794 records). [2025-10-22T22:07:08.380115] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-22T22:07:08.382778] [INFO ] [MAIN ] Derivative Progress: 401/2052 symbols completed. CODI took 1.1s. Estimated remaining: 10m 23s. Rate: 158.9 symbols/min [2025-10-22T22:07:08.385589] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:08.385811] [INFO ] [MAIN ] Derivative Progress: 402/2052 symbols completed. CNQ took 1.1s. Estimated remaining: 10m 21s. Rate: 159.3 symbols/min [2025-10-22T22:07:08.386484] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:08.430132] [DEBUG] [LOCAL ] COF: Loaded 53625 existing records from primary storage. [2025-10-22T22:07:08.456138] [INFO ] [MAIN ] COF: Loaded 53625 primary data records. [2025-10-22T22:07:08.633630] [DEBUG] [LOCAL ] COMP: Loaded 53404 existing records from primary storage. [2025-10-22T22:07:08.616210] [DEBUG] [LOCAL ] COLD: Loaded 52485 existing records from primary storage. [2025-10-22T22:07:08.657142] [INFO ] [MAIN ] COMP: Loaded 53404 primary data records. [2025-10-22T22:07:08.657056] [INFO ] [MAIN ] COLD: Loaded 52485 primary data records. [2025-10-22T22:07:09.474985] [DEBUG] [MAIN ] COF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:09.477502] [INFO ] [MAIN ] COF: Generated 1794 derivative records from 53625 primary records. [2025-10-22T22:07:09.478009] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-22T22:07:09.495229] [DEBUG] [LOCAL ] COF: Derivative data saved (1794 records). [2025-10-22T22:07:09.495406] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-22T22:07:09.497374] [INFO ] [MAIN ] Derivative Progress: 403/2052 symbols completed. COF took 1.2s. Estimated remaining: 10m 24s. Rate: 158.6 symbols/min [2025-10-22T22:07:09.517882] [DEBUG] [MAIN ] COLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:09.530681] [DEBUG] [MAIN ] COMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:09.531424] [INFO ] [MAIN ] COLD: Generated 1794 derivative records from 52485 primary records. [2025-10-22T22:07:09.531626] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-10-22T22:07:09.532420] [INFO ] [MAIN ] COMP: Generated 1794 derivative records from 53404 primary records. [2025-10-22T22:07:09.533264] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-10-22T22:07:09.561965] [DEBUG] [LOCAL ] COLD: Derivative data saved (1794 records). [2025-10-22T22:07:09.562498] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-10-22T22:07:09.567085] [INFO ] [MAIN ] Derivative Progress: 404/2052 symbols completed. COLD took 1.2s. Estimated remaining: 10m 22s. Rate: 158.9 symbols/min [2025-10-22T22:07:09.567199] [DEBUG] [LOCAL ] COMP: Derivative data saved (1794 records). [2025-10-22T22:07:09.567540] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-10-22T22:07:09.570465] [INFO ] [MAIN ] Derivative Progress: 405/2052 symbols completed. COMP took 1.2s. Estimated remaining: 10m 20s. Rate: 159.3 symbols/min [2025-10-22T22:07:09.571183] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:09.571129] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:09.571850] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:09.597227] [DEBUG] [LOCAL ] COOK: Loaded 24851 existing records from primary storage. [2025-10-22T22:07:09.597358] [INFO ] [MAIN ] COOK: Loaded 24851 primary data records. [2025-10-22T22:07:09.936405] [DEBUG] [LOCAL ] COR: Loaded 46258 existing records from primary storage. [2025-10-22T22:07:09.831023] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-22T22:07:09.945340] [INFO ] [MAIN ] COP: Loaded 53727 primary data records. [2025-10-22T22:07:09.945540] [INFO ] [MAIN ] COR: Loaded 46258 primary data records. [2025-10-22T22:07:10.567145] [DEBUG] [MAIN ] COOK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:10.569318] [INFO ] [MAIN ] COOK: Generated 1794 derivative records from 24851 primary records. [2025-10-22T22:07:10.569878] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-22T22:07:10.586783] [DEBUG] [LOCAL ] COOK: Derivative data saved (1794 records). [2025-10-22T22:07:10.588638] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-10-22T22:07:10.591055] [INFO ] [MAIN ] Derivative Progress: 406/2052 symbols completed. COOK took 1.0s. Estimated remaining: 10m 23s. Rate: 158.6 symbols/min [2025-10-22T22:07:10.592005] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:10.606498] [DEBUG] [MAIN ] COP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:10.607970] [INFO ] [MAIN ] COP: Generated 1794 derivative records from 53727 primary records. [2025-10-22T22:07:10.609421] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-10-22T22:07:10.638977] [DEBUG] [MAIN ] COR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:10.639731] [DEBUG] [LOCAL ] COP: Derivative data saved (1794 records). [2025-10-22T22:07:10.640596] [INFO ] [MAIN ] COR: Generated 1794 derivative records from 46258 primary records. [2025-10-22T22:07:10.640922] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-10-22T22:07:10.640700] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-10-22T22:07:10.643756] [INFO ] [MAIN ] Derivative Progress: 407/2052 symbols completed. COP took 1.1s. Estimated remaining: 10m 21s. Rate: 158.9 symbols/min [2025-10-22T22:07:10.644253] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:10.660794] [DEBUG] [LOCAL ] COR: Derivative data saved (1794 records). [2025-10-22T22:07:10.671455] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-10-22T22:07:10.674176] [INFO ] [MAIN ] Derivative Progress: 408/2052 symbols completed. COR took 1.1s. Estimated remaining: 10m 19s. Rate: 159.3 symbols/min [2025-10-22T22:07:10.674506] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:10.694251] [DEBUG] [LOCAL ] COUR: Loaded 49401 existing records from primary storage. [2025-10-22T22:07:10.694484] [INFO ] [MAIN ] COUR: Loaded 49401 primary data records. [2025-10-22T22:07:10.817725] [DEBUG] [LOCAL ] CPA: Loaded 27769 existing records from primary storage. [2025-10-22T22:07:10.834716] [INFO ] [MAIN ] CPA: Loaded 27769 primary data records. [2025-10-22T22:07:10.918396] [DEBUG] [LOCAL ] CP: Loaded 53228 existing records from primary storage. [2025-10-22T22:07:11.035697] [INFO ] [MAIN ] CP: Loaded 53228 primary data records. [2025-10-22T22:07:11.700623] [DEBUG] [MAIN ] COUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:11.702145] [INFO ] [MAIN ] COUR: Generated 1794 derivative records from 49401 primary records. [2025-10-22T22:07:11.702552] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-10-22T22:07:11.727625] [DEBUG] [LOCAL ] COUR: Derivative data saved (1794 records). [2025-10-22T22:07:11.741990] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-10-22T22:07:11.745452] [INFO ] [MAIN ] Derivative Progress: 409/2052 symbols completed. COUR took 1.2s. Estimated remaining: 10m 22s. Rate: 158.6 symbols/min [2025-10-22T22:07:11.746540] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:11.742335] [DEBUG] [MAIN ] CPA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:11.747975] [INFO ] [MAIN ] CPA: Generated 1794 derivative records from 27769 primary records. [2025-10-22T22:07:11.748146] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-10-22T22:07:11.761319] [DEBUG] [MAIN ] CP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:11.770305] [INFO ] [MAIN ] CP: Generated 1794 derivative records from 53228 primary records. [2025-10-22T22:07:11.773004] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-10-22T22:07:11.777409] [DEBUG] [LOCAL ] CPA: Derivative data saved (1794 records). [2025-10-22T22:07:11.777804] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-10-22T22:07:11.780229] [INFO ] [MAIN ] Derivative Progress: 410/2052 symbols completed. CPA took 1.1s. Estimated remaining: 10m 20s. Rate: 158.9 symbols/min [2025-10-22T22:07:11.780579] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:11.795944] [DEBUG] [LOCAL ] CP: Derivative data saved (1794 records). [2025-10-22T22:07:11.796028] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-10-22T22:07:11.798866] [INFO ] [MAIN ] Derivative Progress: 411/2052 symbols completed. CP took 1.2s. Estimated remaining: 10m 18s. Rate: 159.3 symbols/min [2025-10-22T22:07:11.799019] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:11.832892] [DEBUG] [LOCAL ] CPAY: Loaded 30086 existing records from primary storage. [2025-10-22T22:07:11.837119] [INFO ] [MAIN ] CPAY: Loaded 30086 primary data records. [2025-10-22T22:07:11.924390] [DEBUG] [LOCAL ] CPF: Loaded 15178 existing records from primary storage. [2025-10-22T22:07:11.948273] [INFO ] [MAIN ] CPF: Loaded 15178 primary data records. [2025-10-22T22:07:11.952115] [DEBUG] [LOCAL ] CPK: Loaded 13889 existing records from primary storage. [2025-10-22T22:07:11.963952] [INFO ] [MAIN ] CPK: Loaded 13889 primary data records. [2025-10-22T22:07:12.828558] [DEBUG] [MAIN ] CPAY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:12.829794] [INFO ] [MAIN ] CPAY: Generated 1794 derivative records from 30086 primary records. [2025-10-22T22:07:12.829991] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-22T22:07:12.848536] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1794 records). [2025-10-22T22:07:12.850402] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-22T22:07:12.853732] [INFO ] [MAIN ] Derivative Progress: 412/2052 symbols completed. CPAY took 1.1s. Estimated remaining: 10m 20s. Rate: 158.6 symbols/min [2025-10-22T22:07:12.854178] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:12.880122] [DEBUG] [MAIN ] CPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:12.879807] [DEBUG] [MAIN ] CPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:12.881248] [INFO ] [MAIN ] CPF: Generated 1794 derivative records from 15178 primary records. [2025-10-22T22:07:12.881342] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-10-22T22:07:12.882103] [INFO ] [MAIN ] CPK: Generated 1794 derivative records from 13889 primary records. [2025-10-22T22:07:12.882284] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-22T22:07:12.910182] [DEBUG] [LOCAL ] CPF: Derivative data saved (1794 records). [2025-10-22T22:07:12.914545] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-10-22T22:07:12.914618] [DEBUG] [LOCAL ] CPK: Derivative data saved (1794 records). [2025-10-22T22:07:12.917092] [INFO ] [MAIN ] Derivative Progress: 413/2052 symbols completed. CPF took 1.1s. Estimated remaining: 10m 19s. Rate: 158.9 symbols/min [2025-10-22T22:07:12.917423] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-10-22T22:07:12.917311] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:12.920577] [INFO ] [MAIN ] Derivative Progress: 414/2052 symbols completed. CPK took 1.1s. Estimated remaining: 10m 17s. Rate: 159.3 symbols/min [2025-10-22T22:07:12.920960] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:12.955582] [DEBUG] [LOCAL ] CPS: Loaded 24879 existing records from primary storage. [2025-10-22T22:07:12.955740] [INFO ] [MAIN ] CPS: Loaded 24879 primary data records. [2025-10-22T22:07:13.084748] [DEBUG] [LOCAL ] CPRI: Loaded 52430 existing records from primary storage. [2025-10-22T22:07:13.118163] [INFO ] [MAIN ] CPRI: Loaded 52430 primary data records. [2025-10-22T22:07:13.157037] [DEBUG] [LOCAL ] CPT: Loaded 44485 existing records from primary storage. [2025-10-22T22:07:13.202993] [INFO ] [MAIN ] CPT: Loaded 44485 primary data records. [2025-10-22T22:07:13.923991] [DEBUG] [MAIN ] CPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:13.925407] [INFO ] [MAIN ] CPS: Generated 1794 derivative records from 24879 primary records. [2025-10-22T22:07:13.925868] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-10-22T22:07:13.947736] [DEBUG] [LOCAL ] CPS: Derivative data saved (1794 records). [2025-10-22T22:07:13.948004] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-10-22T22:07:13.950032] [INFO ] [MAIN ] Derivative Progress: 415/2052 symbols completed. CPS took 1.0s. Estimated remaining: 10m 19s. Rate: 158.6 symbols/min [2025-10-22T22:07:13.950518] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:13.969616] [DEBUG] [MAIN ] CPRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:13.970926] [INFO ] [MAIN ] CPRI: Generated 1794 derivative records from 52430 primary records. [2025-10-22T22:07:13.971080] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-22T22:07:13.996130] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1794 records). [2025-10-22T22:07:14.001934] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-10-22T22:07:14.007307] [INFO ] [MAIN ] Derivative Progress: 416/2052 symbols completed. CPRI took 1.2s. Estimated remaining: 10m 17s. Rate: 159.0 symbols/min [2025-10-22T22:07:14.007934] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:14.029078] [DEBUG] [MAIN ] CPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:14.028772] [DEBUG] [LOCAL ] CQP: Loaded 18676 existing records from primary storage. [2025-10-22T22:07:14.029322] [INFO ] [MAIN ] CQP: Loaded 18676 primary data records. [2025-10-22T22:07:14.030032] [INFO ] [MAIN ] CPT: Generated 1794 derivative records from 44485 primary records. [2025-10-22T22:07:14.030203] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-22T22:07:14.119774] [DEBUG] [LOCAL ] CPT: Derivative data saved (1794 records). [2025-10-22T22:07:14.173231] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-22T22:07:14.183027] [INFO ] [MAIN ] Derivative Progress: 417/2052 symbols completed. CPT took 1.3s. Estimated remaining: 10m 16s. Rate: 159.2 symbols/min [2025-10-22T22:07:14.183271] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:14.218430] [DEBUG] [LOCAL ] CR: Loaded 23949 existing records from primary storage. [2025-10-22T22:07:14.241853] [INFO ] [MAIN ] CR: Loaded 23949 primary data records. [2025-10-22T22:07:14.450934] [DEBUG] [LOCAL ] CRBD: Loaded 8761 existing records from primary storage. [2025-10-22T22:07:14.462765] [INFO ] [MAIN ] CRBD: Loaded 8761 primary data records. [2025-10-22T22:07:15.068609] [DEBUG] [MAIN ] CQP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:15.070488] [INFO ] [MAIN ] CQP: Generated 1794 derivative records from 18676 primary records. [2025-10-22T22:07:15.070902] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-10-22T22:07:15.087118] [DEBUG] [LOCAL ] CQP: Derivative data saved (1794 records). [2025-10-22T22:07:15.087591] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-10-22T22:07:15.089626] [INFO ] [MAIN ] Derivative Progress: 418/2052 symbols completed. CQP took 1.1s. Estimated remaining: 10m 18s. Rate: 158.6 symbols/min [2025-10-22T22:07:15.106909] [DEBUG] [MAIN ] CR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:07:15.119605] [INFO ] [MAIN ] CR: Generated 1793 derivative records from 23949 primary records. [2025-10-22T22:07:15.120031] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-22T22:07:15.119971] [DEBUG] [MAIN ] CRBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:15.121171] [INFO ] [MAIN ] CRBD: Generated 1794 derivative records from 8761 primary records. [2025-10-22T22:07:15.121402] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-22T22:07:15.151034] [DEBUG] [LOCAL ] CR: Derivative data saved (1793 records). [2025-10-22T22:07:15.151735] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1794 records). [2025-10-22T22:07:15.151818] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-22T22:07:15.151876] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-10-22T22:07:15.154349] [INFO ] [MAIN ] Derivative Progress: 419/2052 symbols completed. CR took 1.1s. Estimated remaining: 10m 16s. Rate: 159.0 symbols/min [2025-10-22T22:07:15.157291] [INFO ] [MAIN ] Derivative Progress: 420/2052 symbols completed. CRBD took 1.0s. Estimated remaining: 10m 15s. Rate: 159.3 symbols/min [2025-10-22T22:07:15.157623] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:15.158013] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:15.157758] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:15.223733] [DEBUG] [LOCAL ] CRC: Loaded 44118 existing records from primary storage. [2025-10-22T22:07:15.224086] [INFO ] [MAIN ] CRC: Loaded 44118 primary data records. [2025-10-22T22:07:15.344077] [DEBUG] [LOCAL ] CRBG: Loaded 52600 existing records from primary storage. [2025-10-22T22:07:15.354719] [INFO ] [MAIN ] CRBG: Loaded 52600 primary data records. [2025-10-22T22:07:15.355479] [DEBUG] [LOCAL ] CRGY: Loaded 52497 existing records from primary storage. [2025-10-22T22:07:15.366537] [INFO ] [MAIN ] CRGY: Loaded 52497 primary data records. [2025-10-22T22:07:16.195228] [DEBUG] [MAIN ] CRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:16.196228] [INFO ] [MAIN ] CRC: Generated 1794 derivative records from 44118 primary records. [2025-10-22T22:07:16.196490] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-22T22:07:16.212875] [DEBUG] [LOCAL ] CRC: Derivative data saved (1794 records). [2025-10-22T22:07:16.213089] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-10-22T22:07:16.215303] [INFO ] [MAIN ] Derivative Progress: 421/2052 symbols completed. CRC took 1.1s. Estimated remaining: 10m 17s. Rate: 158.6 symbols/min [2025-10-22T22:07:16.215478] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:16.234998] [DEBUG] [MAIN ] CRBG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:16.248080] [INFO ] [MAIN ] CRBG: Generated 1794 derivative records from 52600 primary records. [2025-10-22T22:07:16.248260] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-22T22:07:16.247335] [DEBUG] [MAIN ] CRGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:16.248856] [INFO ] [MAIN ] CRGY: Generated 1794 derivative records from 52497 primary records. [2025-10-22T22:07:16.248937] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-22T22:07:16.282725] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1794 records). [2025-10-22T22:07:16.283109] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1794 records). [2025-10-22T22:07:16.283374] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-22T22:07:16.283517] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-22T22:07:16.286076] [INFO ] [MAIN ] Derivative Progress: 422/2052 symbols completed. CRGY took 1.1s. Estimated remaining: 10m 15s. Rate: 159.0 symbols/min [2025-10-22T22:07:16.289088] [INFO ] [MAIN ] Derivative Progress: 423/2052 symbols completed. CRBG took 1.1s. Estimated remaining: 10m 13s. Rate: 159.3 symbols/min [2025-10-22T22:07:16.289313] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:16.288962] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:16.331580] [DEBUG] [LOCAL ] CRH: Loaded 53422 existing records from primary storage. [2025-10-22T22:07:16.331956] [INFO ] [MAIN ] CRH: Loaded 53422 primary data records. [2025-10-22T22:07:16.521791] [DEBUG] [LOCAL ] CRK: Loaded 52226 existing records from primary storage. [2025-10-22T22:07:16.552416] [DEBUG] [LOCAL ] CRI: Loaded 49486 existing records from primary storage. [2025-10-22T22:07:16.552824] [INFO ] [MAIN ] CRI: Loaded 49486 primary data records. [2025-10-22T22:07:16.552611] [INFO ] [MAIN ] CRK: Loaded 52226 primary data records. [2025-10-22T22:07:17.362626] [DEBUG] [MAIN ] CRH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:17.364196] [INFO ] [MAIN ] CRH: Generated 1794 derivative records from 53422 primary records. [2025-10-22T22:07:17.364321] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-10-22T22:07:17.381668] [DEBUG] [LOCAL ] CRH: Derivative data saved (1794 records). [2025-10-22T22:07:17.381851] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-10-22T22:07:17.383964] [INFO ] [MAIN ] Derivative Progress: 424/2052 symbols completed. CRH took 1.2s. Estimated remaining: 10m 16s. Rate: 158.6 symbols/min [2025-10-22T22:07:17.385608] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:17.402696] [DEBUG] [MAIN ] CRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:17.403398] [INFO ] [MAIN ] CRK: Generated 1794 derivative records from 52226 primary records. [2025-10-22T22:07:17.404744] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-10-22T22:07:17.424037] [DEBUG] [LOCAL ] CRK: Derivative data saved (1794 records). [2025-10-22T22:07:17.424213] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-10-22T22:07:17.426896] [INFO ] [MAIN ] Derivative Progress: 425/2052 symbols completed. CRK took 1.1s. Estimated remaining: 10m 14s. Rate: 158.9 symbols/min [2025-10-22T22:07:17.427076] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:17.440993] [DEBUG] [MAIN ] CRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:17.441831] [INFO ] [MAIN ] CRI: Generated 1794 derivative records from 49486 primary records. [2025-10-22T22:07:17.441895] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-22T22:07:17.467501] [DEBUG] [LOCAL ] CRI: Derivative data saved (1794 records). [2025-10-22T22:07:17.467710] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-10-22T22:07:17.470699] [INFO ] [MAIN ] Derivative Progress: 426/2052 symbols completed. CRI took 1.2s. Estimated remaining: 10m 13s. Rate: 159.3 symbols/min [2025-10-22T22:07:17.471030] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:17.485371] [DEBUG] [LOCAL ] CRL: Loaded 42624 existing records from primary storage. [2025-10-22T22:07:17.485780] [INFO ] [MAIN ] CRL: Loaded 42624 primary data records. [2025-10-22T22:07:17.680293] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-22T22:07:17.711700] [INFO ] [MAIN ] CRM: Loaded 53770 primary data records. [2025-10-22T22:07:17.944675] [DEBUG] [LOCAL ] CRS: Loaded 43101 existing records from primary storage. [2025-10-22T22:07:17.948323] [INFO ] [MAIN ] CRS: Loaded 43101 primary data records. [2025-10-22T22:07:18.493762] [DEBUG] [MAIN ] CRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:18.495036] [INFO ] [MAIN ] CRL: Generated 1794 derivative records from 42624 primary records. [2025-10-22T22:07:18.495522] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-22T22:07:18.513770] [DEBUG] [LOCAL ] CRL: Derivative data saved (1794 records). [2025-10-22T22:07:18.514173] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-22T22:07:18.517783] [INFO ] [MAIN ] Derivative Progress: 427/2052 symbols completed. CRL took 1.1s. Estimated remaining: 10m 15s. Rate: 158.6 symbols/min [2025-10-22T22:07:18.518602] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:18.533129] [DEBUG] [MAIN ] CRM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:18.535101] [INFO ] [MAIN ] CRM: Generated 1794 derivative records from 53770 primary records. [2025-10-22T22:07:18.535344] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-22T22:07:18.546348] [DEBUG] [LOCAL ] CRT: Loaded 4763 existing records from primary storage. [2025-10-22T22:07:18.546560] [INFO ] [MAIN ] CRT: Loaded 4763 primary data records. [2025-10-22T22:07:18.574785] [DEBUG] [LOCAL ] CRM: Derivative data saved (1794 records). [2025-10-22T22:07:18.585125] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-10-22T22:07:18.593386] [INFO ] [MAIN ] Derivative Progress: 428/2052 symbols completed. CRM took 1.2s. Estimated remaining: 10m 13s. Rate: 158.9 symbols/min [2025-10-22T22:07:18.601742] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:18.658887] [DEBUG] [MAIN ] CRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:18.669018] [INFO ] [MAIN ] CRS: Generated 1794 derivative records from 43101 primary records. [2025-10-22T22:07:18.669099] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-10-22T22:07:18.703544] [DEBUG] [LOCAL ] CRS: Derivative data saved (1794 records). [2025-10-22T22:07:18.703681] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-10-22T22:07:18.706802] [INFO ] [MAIN ] Derivative Progress: 429/2052 symbols completed. CRS took 1.2s. Estimated remaining: 10m 12s. Rate: 159.2 symbols/min [2025-10-22T22:07:18.712393] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:18.962386] [DEBUG] [LOCAL ] CSAN: Loaded 42220 existing records from primary storage. [2025-10-22T22:07:18.963185] [INFO ] [MAIN ] CSAN: Loaded 42220 primary data records. [2025-10-22T22:07:19.060355] [DEBUG] [LOCAL ] CSL: Loaded 31148 existing records from primary storage. [2025-10-22T22:07:19.088786] [INFO ] [MAIN ] CSL: Loaded 31148 primary data records. [2025-10-22T22:07:19.642024] [DEBUG] [MAIN ] CRT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:07:19.643815] [INFO ] [MAIN ] CRT: Generated 1793 derivative records from 4763 primary records. [2025-10-22T22:07:19.644312] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-22T22:07:19.661222] [DEBUG] [LOCAL ] CRT: Derivative data saved (1793 records). [2025-10-22T22:07:19.661924] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-10-22T22:07:19.665370] [INFO ] [MAIN ] Derivative Progress: 430/2052 symbols completed. CRT took 1.1s. Estimated remaining: 10m 14s. Rate: 158.6 symbols/min [2025-10-22T22:07:19.666432] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:19.681122] [DEBUG] [MAIN ] CSAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:19.681884] [INFO ] [MAIN ] CSAN: Generated 1794 derivative records from 42220 primary records. [2025-10-22T22:07:19.682018] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-22T22:07:19.701971] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1794 records). [2025-10-22T22:07:19.704561] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-22T22:07:19.712094] [INFO ] [MAIN ] Derivative Progress: 431/2052 symbols completed. CSAN took 1.1s. Estimated remaining: 10m 12s. Rate: 158.9 symbols/min [2025-10-22T22:07:19.709902] [DEBUG] [LOCAL ] CSR: Loaded 13395 existing records from primary storage. [2025-10-22T22:07:19.712337] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:19.724702] [INFO ] [MAIN ] CSR: Loaded 13395 primary data records. [2025-10-22T22:07:19.725193] [DEBUG] [MAIN ] CSL: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:07:19.726257] [INFO ] [MAIN ] CSL: Generated 1793 derivative records from 31148 primary records. [2025-10-22T22:07:19.737490] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-22T22:07:19.862561] [DEBUG] [LOCAL ] CSL: Derivative data saved (1793 records). [2025-10-22T22:07:19.921384] [DEBUG] [LOCAL ] CSV: Loaded 12427 existing records from primary storage. [2025-10-22T22:07:19.925791] [INFO ] [MAIN ] CSV: Loaded 12427 primary data records. [2025-10-22T22:07:19.925953] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-22T22:07:19.934821] [INFO ] [MAIN ] Derivative Progress: 432/2052 symbols completed. CSL took 1.2s. Estimated remaining: 10m 11s. Rate: 159.1 symbols/min [2025-10-22T22:07:20.059090] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:20.194923] [DEBUG] [LOCAL ] CTBB: Loaded 6394 existing records from primary storage. [2025-10-22T22:07:20.349316] [INFO ] [MAIN ] CTBB: Loaded 6394 primary data records. [2025-10-22T22:07:20.558478] [DEBUG] [MAIN ] CSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:20.559468] [INFO ] [MAIN ] CSR: Generated 1794 derivative records from 13395 primary records. [2025-10-22T22:07:20.559694] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-22T22:07:20.691329] [DEBUG] [LOCAL ] CSR: Derivative data saved (1794 records). [2025-10-22T22:07:20.691557] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-10-22T22:07:20.693860] [INFO ] [MAIN ] Derivative Progress: 433/2052 symbols completed. CSR took 1.0s. Estimated remaining: 10m 12s. Rate: 158.7 symbols/min [2025-10-22T22:07:20.711874] [DEBUG] [MAIN ] CSV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:20.712992] [INFO ] [MAIN ] CSV: Generated 1794 derivative records from 12427 primary records. [2025-10-22T22:07:20.713479] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-22T22:07:20.730345] [DEBUG] [LOCAL ] CSV: Derivative data saved (1794 records). [2025-10-22T22:07:20.730566] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-22T22:07:20.732760] [INFO ] [MAIN ] Derivative Progress: 434/2052 symbols completed. CSV took 1.0s. Estimated remaining: 10m 10s. Rate: 159.0 symbols/min [2025-10-22T22:07:20.749252] [DEBUG] [MAIN ] CTBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:20.749927] [INFO ] [MAIN ] CTBB: Generated 1794 derivative records from 6394 primary records. [2025-10-22T22:07:20.749990] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-10-22T22:07:20.764767] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1794 records). [2025-10-22T22:07:20.764830] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-10-22T22:07:20.767778] [INFO ] [MAIN ] Derivative Progress: 435/2052 symbols completed. CTBB took 0.7s. Estimated remaining: 10m 9s. Rate: 159.4 symbols/min [2025-10-22T22:07:20.768316] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:20.768450] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:20.768247] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:20.777562] [DEBUG] [LOCAL ] CTDD: Loaded 5135 existing records from primary storage. [2025-10-22T22:07:20.777860] [INFO ] [MAIN ] CTDD: Loaded 5135 primary data records. [2025-10-22T22:07:20.993635] [DEBUG] [LOCAL ] CTOS: Loaded 37221 existing records from primary storage. [2025-10-22T22:07:20.998506] [INFO ] [MAIN ] CTOS: Loaded 37221 primary data records. [2025-10-22T22:07:21.201687] [DEBUG] [LOCAL ] CTRA: Loaded 53647 existing records from primary storage. [2025-10-22T22:07:21.214470] [INFO ] [MAIN ] CTRA: Loaded 53647 primary data records. [2025-10-22T22:07:21.782120] [DEBUG] [MAIN ] CTDD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:07:21.783434] [INFO ] [MAIN ] CTDD: Generated 1793 derivative records from 5135 primary records. [2025-10-22T22:07:21.784109] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-10-22T22:07:21.801841] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1793 records). [2025-10-22T22:07:21.802365] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-10-22T22:07:21.804773] [INFO ] [MAIN ] Derivative Progress: 436/2052 symbols completed. CTDD took 1.0s. Estimated remaining: 10m 11s. Rate: 158.7 symbols/min [2025-10-22T22:07:21.805065] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:21.825866] [DEBUG] [MAIN ] CTOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:21.828465] [INFO ] [MAIN ] CTOS: Generated 1794 derivative records from 37221 primary records. [2025-10-22T22:07:21.828696] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-10-22T22:07:21.859250] [DEBUG] [MAIN ] CTRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:21.860132] [INFO ] [MAIN ] CTRA: Generated 1794 derivative records from 53647 primary records. [2025-10-22T22:07:21.858890] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1794 records). [2025-10-22T22:07:21.860299] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-22T22:07:21.860409] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-10-22T22:07:21.862471] [INFO ] [MAIN ] Derivative Progress: 437/2052 symbols completed. CTOS took 1.1s. Estimated remaining: 10m 9s. Rate: 159.0 symbols/min [2025-10-22T22:07:21.863320] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:21.879820] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1794 records). [2025-10-22T22:07:21.880088] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-10-22T22:07:21.882905] [INFO ] [MAIN ] Derivative Progress: 438/2052 symbols completed. CTRA took 1.1s. Estimated remaining: 10m 8s. Rate: 159.4 symbols/min [2025-10-22T22:07:21.883140] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:21.910254] [DEBUG] [LOCAL ] CTS: Loaded 19510 existing records from primary storage. [2025-10-22T22:07:21.923628] [INFO ] [MAIN ] CTS: Loaded 19510 primary data records. [2025-10-22T22:07:21.968763] [DEBUG] [LOCAL ] CTRE: Loaded 49425 existing records from primary storage. [2025-10-22T22:07:22.001095] [INFO ] [MAIN ] CTRE: Loaded 49425 primary data records. [2025-10-22T22:07:22.271257] [DEBUG] [LOCAL ] CTVA: Loaded 53308 existing records from primary storage. [2025-10-22T22:07:22.425517] [INFO ] [MAIN ] CTVA: Loaded 53308 primary data records. [2025-10-22T22:07:22.940260] [DEBUG] [MAIN ] CTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:22.941928] [INFO ] [MAIN ] CTS: Generated 1794 derivative records from 19510 primary records. [2025-10-22T22:07:22.940758] [DEBUG] [MAIN ] CTRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:22.943400] [INFO ] [MAIN ] CTRE: Generated 1794 derivative records from 49425 primary records. [2025-10-22T22:07:22.943571] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-22T22:07:22.943731] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-10-22T22:07:22.979133] [DEBUG] [LOCAL ] CTS: Derivative data saved (1794 records). [2025-10-22T22:07:22.979959] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-10-22T22:07:22.983184] [INFO ] [MAIN ] Derivative Progress: 439/2052 symbols completed. CTS took 1.1s. Estimated remaining: 10m 10s. Rate: 158.7 symbols/min [2025-10-22T22:07:22.984192] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:22.983902] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1794 records). [2025-10-22T22:07:22.985247] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-10-22T22:07:22.989577] [INFO ] [MAIN ] Derivative Progress: 440/2052 symbols completed. CTRE took 1.2s. Estimated remaining: 10m 8s. Rate: 159.0 symbols/min [2025-10-22T22:07:22.990621] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:23.009797] [DEBUG] [MAIN ] CTVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:23.010945] [INFO ] [MAIN ] CTVA: Generated 1794 derivative records from 53308 primary records. [2025-10-22T22:07:23.011251] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-10-22T22:07:23.036461] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1794 records). [2025-10-22T22:07:23.036813] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-10-22T22:07:23.040595] [INFO ] [MAIN ] Derivative Progress: 441/2052 symbols completed. CTVA took 1.2s. Estimated remaining: 10m 7s. Rate: 159.4 symbols/min [2025-10-22T22:07:23.040983] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:23.066561] [DEBUG] [LOCAL ] CUBI: Loaded 26998 existing records from primary storage. [2025-10-22T22:07:23.066874] [INFO ] [MAIN ] CUBI: Loaded 26998 primary data records. [2025-10-22T22:07:23.197194] [DEBUG] [LOCAL ] CUBE: Loaded 50871 existing records from primary storage. [2025-10-22T22:07:23.273894] [INFO ] [MAIN ] CUBE: Loaded 50871 primary data records. [2025-10-22T22:07:23.515872] [DEBUG] [LOCAL ] CUK: Loaded 51064 existing records from primary storage. [2025-10-22T22:07:23.526629] [INFO ] [MAIN ] CUK: Loaded 51064 primary data records. [2025-10-22T22:07:24.042906] [DEBUG] [MAIN ] CUBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:24.044841] [INFO ] [MAIN ] CUBI: Generated 1794 derivative records from 26998 primary records. [2025-10-22T22:07:24.045263] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-10-22T22:07:24.067627] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1794 records). [2025-10-22T22:07:24.068423] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-10-22T22:07:24.070883] [INFO ] [MAIN ] Derivative Progress: 442/2052 symbols completed. CUBI took 1.1s. Estimated remaining: 10m 9s. Rate: 158.7 symbols/min [2025-10-22T22:07:24.071049] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:24.086611] [DEBUG] [LOCAL ] CULP: Loaded 2843 existing records from primary storage. [2025-10-22T22:07:24.092471] [DEBUG] [MAIN ] CUBE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:24.093218] [INFO ] [MAIN ] CUBE: Generated 1794 derivative records from 50871 primary records. [2025-10-22T22:07:24.091290] [INFO ] [MAIN ] CULP: Loaded 2843 primary data records. [2025-10-22T22:07:24.093559] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-10-22T22:07:24.177979] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1794 records). [2025-10-22T22:07:24.178245] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-10-22T22:07:24.181187] [INFO ] [MAIN ] Derivative Progress: 443/2052 symbols completed. CUBE took 1.2s. Estimated remaining: 10m 7s. Rate: 159.0 symbols/min [2025-10-22T22:07:24.187204] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:24.418635] [DEBUG] [MAIN ] CUK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:24.419775] [INFO ] [MAIN ] CUK: Generated 1794 derivative records from 51064 primary records. [2025-10-22T22:07:24.419968] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-22T22:07:24.451124] [DEBUG] [LOCAL ] CUK: Derivative data saved (1794 records). [2025-10-22T22:07:24.460749] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-22T22:07:24.464068] [DEBUG] [LOCAL ] CURB: Loaded 32786 existing records from primary storage. [2025-10-22T22:07:24.464214] [INFO ] [MAIN ] CURB: Loaded 32786 primary data records. [2025-10-22T22:07:24.463342] [INFO ] [MAIN ] Derivative Progress: 444/2052 symbols completed. CUK took 1.4s. Estimated remaining: 10m 7s. Rate: 159.1 symbols/min [2025-10-22T22:07:24.476206] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:24.707933] [DEBUG] [MAIN ] CULP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:24.731045] [INFO ] [MAIN ] CULP: Generated 1794 derivative records from 2843 primary records. [2025-10-22T22:07:24.796878] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-10-22T22:07:24.842521] [DEBUG] [LOCAL ] CURV: Loaded 27192 existing records from primary storage. [2025-10-22T22:07:24.844402] [INFO ] [MAIN ] CURV: Loaded 27192 primary data records. [2025-10-22T22:07:24.939667] [DEBUG] [LOCAL ] CULP: Derivative data saved (1794 records). [2025-10-22T22:07:24.966803] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-10-22T22:07:24.976900] [INFO ] [MAIN ] Derivative Progress: 445/2052 symbols completed. CULP took 0.9s. Estimated remaining: 10m 7s. Rate: 158.9 symbols/min [2025-10-22T22:07:24.988016] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:25.188086] [DEBUG] [MAIN ] CURB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:25.189429] [INFO ] [MAIN ] CURB: Generated 1794 derivative records from 32786 primary records. [2025-10-22T22:07:25.189924] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-10-22T22:07:25.220129] [DEBUG] [LOCAL ] CURB: Derivative data saved (1794 records). [2025-10-22T22:07:25.220420] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-10-22T22:07:25.223165] [INFO ] [MAIN ] Derivative Progress: 446/2052 symbols completed. CURB took 1.0s. Estimated remaining: 10m 6s. Rate: 159.1 symbols/min [2025-10-22T22:07:25.224026] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:25.246623] [DEBUG] [LOCAL ] CUZ: Loaded 49436 existing records from primary storage. [2025-10-22T22:07:25.247543] [INFO ] [MAIN ] CUZ: Loaded 49436 primary data records. [2025-10-22T22:07:25.398556] [DEBUG] [MAIN ] CURV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:25.441071] [INFO ] [MAIN ] CURV: Generated 1794 derivative records from 27192 primary records. [2025-10-22T22:07:25.562579] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-10-22T22:07:25.611343] [DEBUG] [LOCAL ] CVE: Loaded 53567 existing records from primary storage. [2025-10-22T22:07:25.613044] [INFO ] [MAIN ] CVE: Loaded 53567 primary data records. [2025-10-22T22:07:25.626810] [DEBUG] [LOCAL ] CURV: Derivative data saved (1794 records). [2025-10-22T22:07:25.652061] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-10-22T22:07:25.718084] [INFO ] [MAIN ] Derivative Progress: 447/2052 symbols completed. CURV took 1.2s. Estimated remaining: 10m 6s. Rate: 159.0 symbols/min [2025-10-22T22:07:25.737901] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:25.937054] [DEBUG] [MAIN ] CUZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:25.943517] [INFO ] [MAIN ] CUZ: Generated 1794 derivative records from 49436 primary records. [2025-10-22T22:07:25.943935] [DEBUG] [LOCAL ] CVLG: Loaded 15231 existing records from primary storage. [2025-10-22T22:07:25.944133] [INFO ] [MAIN ] CVLG: Loaded 15231 primary data records. [2025-10-22T22:07:25.944479] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-22T22:07:26.043164] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1794 records). [2025-10-22T22:07:26.043322] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-22T22:07:26.051029] [INFO ] [MAIN ] Derivative Progress: 448/2052 symbols completed. CUZ took 1.1s. Estimated remaining: 10m 5s. Rate: 159.0 symbols/min [2025-10-22T22:07:26.272566] [DEBUG] [MAIN ] CVE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:26.274455] [INFO ] [MAIN ] CVE: Generated 1794 derivative records from 53567 primary records. [2025-10-22T22:07:26.274598] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-10-22T22:07:26.292618] [DEBUG] [LOCAL ] CVE: Derivative data saved (1794 records). [2025-10-22T22:07:26.293000] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-10-22T22:07:26.295450] [INFO ] [MAIN ] Derivative Progress: 449/2052 symbols completed. CVE took 1.1s. Estimated remaining: 10m 4s. Rate: 159.1 symbols/min [2025-10-22T22:07:26.312279] [DEBUG] [MAIN ] CVLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:26.312884] [INFO ] [MAIN ] CVLG: Generated 1794 derivative records from 15231 primary records. [2025-10-22T22:07:26.312944] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-10-22T22:07:26.327909] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1794 records). [2025-10-22T22:07:26.327970] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-10-22T22:07:26.330531] [INFO ] [MAIN ] Derivative Progress: 450/2052 symbols completed. CVLG took 0.6s. Estimated remaining: 10m 3s. Rate: 159.4 symbols/min [2025-10-22T22:07:26.330909] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:26.331127] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:26.331027] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:26.411867] [DEBUG] [LOCAL ] CVNA: Loaded 52837 existing records from primary storage. [2025-10-22T22:07:26.412006] [INFO ] [MAIN ] CVNA: Loaded 52837 primary data records. [2025-10-22T22:07:26.545123] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-22T22:07:26.566432] [INFO ] [MAIN ] CVS: Loaded 53694 primary data records. [2025-10-22T22:07:26.585208] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-22T22:07:26.599065] [INFO ] [MAIN ] CVX: Loaded 53760 primary data records. [2025-10-22T22:07:27.391830] [DEBUG] [MAIN ] CVNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:27.392878] [INFO ] [MAIN ] CVNA: Generated 1794 derivative records from 52837 primary records. [2025-10-22T22:07:27.393254] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-10-22T22:07:27.410892] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1794 records). [2025-10-22T22:07:27.411124] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-10-22T22:07:27.412851] [INFO ] [MAIN ] Derivative Progress: 451/2052 symbols completed. CVNA took 1.1s. Estimated remaining: 10m 5s. Rate: 158.8 symbols/min [2025-10-22T22:07:27.413109] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:27.431397] [DEBUG] [MAIN ] CVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:27.432096] [INFO ] [MAIN ] CVS: Generated 1794 derivative records from 53694 primary records. [2025-10-22T22:07:27.432417] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-22T22:07:27.466987] [DEBUG] [MAIN ] CVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:27.468153] [DEBUG] [LOCAL ] CVS: Derivative data saved (1794 records). [2025-10-22T22:07:27.474899] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-22T22:07:27.468818] [INFO ] [MAIN ] CVX: Generated 1794 derivative records from 53760 primary records. [2025-10-22T22:07:27.477965] [INFO ] [MAIN ] Derivative Progress: 452/2052 symbols completed. CVS took 1.1s. Estimated remaining: 10m 3s. Rate: 159.1 symbols/min [2025-10-22T22:07:27.475742] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-10-22T22:07:27.478179] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:27.479105] [DEBUG] [LOCAL ] CW: Loaded 21935 existing records from primary storage. [2025-10-22T22:07:27.479906] [INFO ] [MAIN ] CW: Loaded 21935 primary data records. [2025-10-22T22:07:27.549754] [DEBUG] [LOCAL ] CVX: Derivative data saved (1794 records). [2025-10-22T22:07:27.570518] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-10-22T22:07:27.599388] [INFO ] [MAIN ] Derivative Progress: 453/2052 symbols completed. CVX took 1.3s. Estimated remaining: 10m 2s. Rate: 159.3 symbols/min [2025-10-22T22:07:27.605829] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:27.844905] [DEBUG] [LOCAL ] CWAN: Loaded 52687 existing records from primary storage. [2025-10-22T22:07:27.845395] [INFO ] [MAIN ] CWAN: Loaded 52687 primary data records. [2025-10-22T22:07:27.950070] [DEBUG] [LOCAL ] CWEN: Loaded 45287 existing records from primary storage. [2025-10-22T22:07:27.968959] [INFO ] [MAIN ] CWEN: Loaded 45287 primary data records. [2025-10-22T22:07:28.162939] [DEBUG] [MAIN ] CW: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:07:28.292596] [INFO ] [MAIN ] CW: Generated 1793 derivative records from 21935 primary records. [2025-10-22T22:07:28.311206] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-10-22T22:07:28.500001] [DEBUG] [LOCAL ] CW: Derivative data saved (1793 records). [2025-10-22T22:07:28.500549] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-10-22T22:07:28.503783] [INFO ] [MAIN ] Derivative Progress: 454/2052 symbols completed. CW took 1.1s. Estimated remaining: 10m 4s. Rate: 158.8 symbols/min [2025-10-22T22:07:28.504414] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:28.525414] [DEBUG] [MAIN ] CWAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:28.529293] [INFO ] [MAIN ] CWAN: Generated 1794 derivative records from 52687 primary records. [2025-10-22T22:07:28.529701] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-10-22T22:07:28.550005] [DEBUG] [MAIN ] CWEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:28.554256] [INFO ] [MAIN ] CWEN: Generated 1794 derivative records from 45287 primary records. [2025-10-22T22:07:28.557620] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-10-22T22:07:28.558537] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1794 records). [2025-10-22T22:07:28.558629] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-10-22T22:07:28.561226] [INFO ] [MAIN ] Derivative Progress: 455/2052 symbols completed. CWAN took 1.1s. Estimated remaining: 10m 2s. Rate: 159.1 symbols/min [2025-10-22T22:07:28.561582] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:28.589517] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1794 records). [2025-10-22T22:07:28.589796] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-10-22T22:07:28.592394] [INFO ] [MAIN ] Derivative Progress: 456/2052 symbols completed. CWEN took 1.0s. Estimated remaining: 10m 1s. Rate: 159.4 symbols/min [2025-10-22T22:07:28.592576] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:28.613130] [DEBUG] [LOCAL ] CWH: Loaded 51271 existing records from primary storage. [2025-10-22T22:07:28.613476] [INFO ] [MAIN ] CWH: Loaded 51271 primary data records. [2025-10-22T22:07:28.829576] [DEBUG] [LOCAL ] CWK: Loaded 49638 existing records from primary storage. [2025-10-22T22:07:28.965231] [INFO ] [MAIN ] CWK: Loaded 49638 primary data records. [2025-10-22T22:07:28.835446] [DEBUG] [LOCAL ] CWT: Loaded 28062 existing records from primary storage. [2025-10-22T22:07:28.965755] [INFO ] [MAIN ] CWT: Loaded 28062 primary data records. [2025-10-22T22:07:29.572586] [DEBUG] [MAIN ] CWH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:29.573908] [INFO ] [MAIN ] CWH: Generated 1794 derivative records from 51271 primary records. [2025-10-22T22:07:29.574016] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-10-22T22:07:29.590943] [DEBUG] [LOCAL ] CWH: Derivative data saved (1794 records). [2025-10-22T22:07:29.591052] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-10-22T22:07:29.593461] [INFO ] [MAIN ] Derivative Progress: 457/2052 symbols completed. CWH took 1.1s. Estimated remaining: 10m 2s. Rate: 158.9 symbols/min [2025-10-22T22:07:29.593938] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:29.614892] [DEBUG] [MAIN ] CWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:29.616694] [INFO ] [MAIN ] CWK: Generated 1794 derivative records from 49638 primary records. [2025-10-22T22:07:29.616977] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-22T22:07:29.630694] [DEBUG] [MAIN ] CWT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:29.639672] [INFO ] [MAIN ] CWT: Generated 1794 derivative records from 28062 primary records. [2025-10-22T22:07:29.642451] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-10-22T22:07:29.646700] [DEBUG] [LOCAL ] CWK: Derivative data saved (1794 records). [2025-10-22T22:07:29.647570] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-10-22T22:07:29.649793] [INFO ] [MAIN ] Derivative Progress: 458/2052 symbols completed. CWK took 1.1s. Estimated remaining: 10m 1s. Rate: 159.2 symbols/min [2025-10-22T22:07:29.650219] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:29.679804] [DEBUG] [LOCAL ] CWT: Derivative data saved (1794 records). [2025-10-22T22:07:29.681517] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-10-22T22:07:29.684063] [INFO ] [MAIN ] Derivative Progress: 459/2052 symbols completed. CWT took 1.1s. Estimated remaining: 9m 59s. Rate: 159.5 symbols/min [2025-10-22T22:07:29.684352] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:29.702772] [DEBUG] [LOCAL ] CXE: Loaded 6414 existing records from primary storage. [2025-10-22T22:07:29.703915] [INFO ] [MAIN ] CXE: Loaded 6414 primary data records. [2025-10-22T22:07:29.704908] [DEBUG] [LOCAL ] CX: Loaded 52826 existing records from primary storage. [2025-10-22T22:07:29.705206] [INFO ] [MAIN ] CX: Loaded 52826 primary data records. [2025-10-22T22:07:29.739616] [DEBUG] [LOCAL ] CXH: Loaded 4392 existing records from primary storage. [2025-10-22T22:07:29.786757] [INFO ] [MAIN ] CXH: Loaded 4392 primary data records. [2025-10-22T22:07:30.660007] [DEBUG] [MAIN ] CX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:30.672666] [INFO ] [MAIN ] CX: Generated 1794 derivative records from 52826 primary records. [2025-10-22T22:07:30.672011] [DEBUG] [MAIN ] CXH: Filtered 6931 bins outside market hours, 7727 incomplete bins [2025-10-22T22:07:30.672816] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-22T22:07:30.673490] [INFO ] [MAIN ] CXH: Generated 1791 derivative records from 4392 primary records. [2025-10-22T22:07:30.673628] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-22T22:07:30.697610] [DEBUG] [MAIN ] CXE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:30.710427] [INFO ] [MAIN ] CXE: Generated 1794 derivative records from 6414 primary records. [2025-10-22T22:07:30.712335] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-22T22:07:30.712240] [DEBUG] [LOCAL ] CXH: Derivative data saved (1791 records). [2025-10-22T22:07:30.714472] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-10-22T22:07:30.715452] [DEBUG] [LOCAL ] CX: Derivative data saved (1794 records). [2025-10-22T22:07:30.715706] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-10-22T22:07:30.723987] [INFO ] [MAIN ] Derivative Progress: 460/2052 symbols completed. CXH took 1.0s. Estimated remaining: 10m 1s. Rate: 158.9 symbols/min [2025-10-22T22:07:30.727620] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:30.731510] [DEBUG] [LOCAL ] CXE: Derivative data saved (1794 records). [2025-10-22T22:07:30.733571] [INFO ] [MAIN ] Derivative Progress: 461/2052 symbols completed. CX took 1.1s. Estimated remaining: 9m 60s. Rate: 159.2 symbols/min [2025-10-22T22:07:30.733839] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:30.734247] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-22T22:07:30.736889] [INFO ] [MAIN ] Derivative Progress: 462/2052 symbols completed. CXE took 1.1s. Estimated remaining: 9m 58s. Rate: 159.5 symbols/min [2025-10-22T22:07:30.737094] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:30.785454] [DEBUG] [LOCAL ] CXT: Loaded 30698 existing records from primary storage. [2025-10-22T22:07:30.785779] [INFO ] [MAIN ] CXT: Loaded 30698 primary data records. [2025-10-22T22:07:30.911397] [DEBUG] [LOCAL ] CXM: Loaded 47404 existing records from primary storage. [2025-10-22T22:07:30.912674] [INFO ] [MAIN ] CXM: Loaded 47404 primary data records. [2025-10-22T22:07:30.918334] [DEBUG] [LOCAL ] CXW: Loaded 43639 existing records from primary storage. [2025-10-22T22:07:30.923554] [INFO ] [MAIN ] CXW: Loaded 43639 primary data records. [2025-10-22T22:07:31.719962] [DEBUG] [MAIN ] CXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:31.721686] [INFO ] [MAIN ] CXT: Generated 1794 derivative records from 30698 primary records. [2025-10-22T22:07:31.722109] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-22T22:07:31.740636] [DEBUG] [LOCAL ] CXT: Derivative data saved (1794 records). [2025-10-22T22:07:31.741092] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-22T22:07:31.742824] [INFO ] [MAIN ] Derivative Progress: 463/2052 symbols completed. CXT took 1.0s. Estimated remaining: 9m 60s. Rate: 159.0 symbols/min [2025-10-22T22:07:31.761711] [DEBUG] [MAIN ] CXW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:31.763895] [INFO ] [MAIN ] CXW: Generated 1794 derivative records from 43639 primary records. [2025-10-22T22:07:31.764162] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-22T22:07:31.793447] [DEBUG] [MAIN ] CXM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:31.796760] [DEBUG] [LOCAL ] CXW: Derivative data saved (1794 records). [2025-10-22T22:07:31.796858] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-22T22:07:31.799331] [INFO ] [MAIN ] Derivative Progress: 464/2052 symbols completed. CXW took 1.1s. Estimated remaining: 9m 58s. Rate: 159.3 symbols/min [2025-10-22T22:07:31.800204] [INFO ] [MAIN ] CXM: Generated 1794 derivative records from 47404 primary records. [2025-10-22T22:07:31.800305] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-22T22:07:31.814951] [DEBUG] [LOCAL ] CXM: Derivative data saved (1794 records). [2025-10-22T22:07:31.815007] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-22T22:07:31.818338] [INFO ] [MAIN ] Derivative Progress: 465/2052 symbols completed. CXM took 1.1s. Estimated remaining: 9m 57s. Rate: 159.6 symbols/min [2025-10-22T22:07:31.818720] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:31.818847] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:31.819271] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:31.848073] [DEBUG] [LOCAL ] CYD: Loaded 27277 existing records from primary storage. [2025-10-22T22:07:31.848217] [INFO ] [MAIN ] CYD: Loaded 27277 primary data records. [2025-10-22T22:07:32.017401] [DEBUG] [LOCAL ] CYH: Loaded 47658 existing records from primary storage. [2025-10-22T22:07:32.048221] [INFO ] [MAIN ] CYH: Loaded 47658 primary data records. [2025-10-22T22:07:32.278229] [DEBUG] [LOCAL ] D: Loaded 53649 existing records from primary storage. [2025-10-22T22:07:32.301720] [INFO ] [MAIN ] D: Loaded 53649 primary data records. [2025-10-22T22:07:32.859623] [DEBUG] [MAIN ] CYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:32.860947] [INFO ] [MAIN ] CYD: Generated 1794 derivative records from 27277 primary records. [2025-10-22T22:07:32.861291] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-10-22T22:07:32.878986] [DEBUG] [LOCAL ] CYD: Derivative data saved (1794 records). [2025-10-22T22:07:32.879403] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-10-22T22:07:32.881556] [INFO ] [MAIN ] Derivative Progress: 466/2052 symbols completed. CYD took 1.1s. Estimated remaining: 9m 59s. Rate: 159.0 symbols/min [2025-10-22T22:07:32.881775] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:32.901789] [DEBUG] [MAIN ] CYH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:32.902483] [INFO ] [MAIN ] CYH: Generated 1794 derivative records from 47658 primary records. [2025-10-22T22:07:32.902666] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-22T22:07:32.924084] [DEBUG] [LOCAL ] CYH: Derivative data saved (1794 records). [2025-10-22T22:07:32.924713] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-22T22:07:32.926848] [INFO ] [MAIN ] Derivative Progress: 467/2052 symbols completed. CYH took 1.1s. Estimated remaining: 9m 57s. Rate: 159.3 symbols/min [2025-10-22T22:07:32.939382] [DEBUG] [LOCAL ] DAC: Loaded 12381 existing records from primary storage. [2025-10-22T22:07:32.939037] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:32.944815] [INFO ] [MAIN ] DAC: Loaded 12381 primary data records. [2025-10-22T22:07:32.945078] [DEBUG] [MAIN ] D: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:32.946029] [INFO ] [MAIN ] D: Generated 1794 derivative records from 53649 primary records. [2025-10-22T22:07:32.946219] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-10-22T22:07:33.043350] [DEBUG] [LOCAL ] D: Derivative data saved (1794 records). [2025-10-22T22:07:33.048694] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-10-22T22:07:33.057107] [INFO ] [MAIN ] Derivative Progress: 468/2052 symbols completed. D took 1.2s. Estimated remaining: 9m 56s. Rate: 159.5 symbols/min [2025-10-22T22:07:33.057319] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:33.301367] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-22T22:07:33.301790] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-10-22T22:07:33.417783] [DEBUG] [LOCAL ] DAN: Loaded 49384 existing records from primary storage. [2025-10-22T22:07:33.435293] [INFO ] [MAIN ] DAN: Loaded 49384 primary data records. [2025-10-22T22:07:33.583893] [DEBUG] [MAIN ] DAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:33.601702] [INFO ] [MAIN ] DAC: Generated 1794 derivative records from 12381 primary records. [2025-10-22T22:07:33.711998] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-10-22T22:07:33.812682] [DEBUG] [LOCAL ] DAC: Derivative data saved (1794 records). [2025-10-22T22:07:33.912340] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-10-22T22:07:33.928246] [INFO ] [MAIN ] Derivative Progress: 469/2052 symbols completed. DAC took 1.0s. Estimated remaining: 9m 57s. Rate: 159.0 symbols/min [2025-10-22T22:07:33.928735] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:33.963293] [DEBUG] [MAIN ] DAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:33.964559] [INFO ] [MAIN ] DAL: Generated 1794 derivative records from 53753 primary records. [2025-10-22T22:07:33.963774] [DEBUG] [LOCAL ] DAO: Loaded 19714 existing records from primary storage. [2025-10-22T22:07:33.965059] [INFO ] [MAIN ] DAO: Loaded 19714 primary data records. [2025-10-22T22:07:33.964981] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-10-22T22:07:34.049272] [DEBUG] [LOCAL ] DAL: Derivative data saved (1794 records). [2025-10-22T22:07:34.054639] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-10-22T22:07:34.074387] [INFO ] [MAIN ] Derivative Progress: 470/2052 symbols completed. DAL took 1.1s. Estimated remaining: 9m 56s. Rate: 159.3 symbols/min [2025-10-22T22:07:34.094583] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:34.216980] [DEBUG] [MAIN ] DAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:34.297312] [INFO ] [MAIN ] DAN: Generated 1794 derivative records from 49384 primary records. [2025-10-22T22:07:34.305057] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-10-22T22:07:34.322462] [DEBUG] [LOCAL ] DAN: Derivative data saved (1794 records). [2025-10-22T22:07:34.322684] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-10-22T22:07:34.325070] [INFO ] [MAIN ] Derivative Progress: 471/2052 symbols completed. DAN took 1.3s. Estimated remaining: 9m 55s. Rate: 159.4 symbols/min [2025-10-22T22:07:34.326167] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:34.377881] [DEBUG] [MAIN ] DAO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:34.378968] [DEBUG] [LOCAL ] DAR: Loaded 51998 existing records from primary storage. [2025-10-22T22:07:34.380244] [INFO ] [MAIN ] DAO: Generated 1794 derivative records from 19714 primary records. [2025-10-22T22:07:34.380329] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-10-22T22:07:34.380164] [INFO ] [MAIN ] DAR: Loaded 51998 primary data records. [2025-10-22T22:07:34.477324] [DEBUG] [LOCAL ] DAO: Derivative data saved (1794 records). [2025-10-22T22:07:34.510423] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-10-22T22:07:34.522996] [INFO ] [MAIN ] Derivative Progress: 472/2052 symbols completed. DAO took 0.6s. Estimated remaining: 9m 54s. Rate: 159.5 symbols/min [2025-10-22T22:07:34.540595] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:34.565128] [DEBUG] [LOCAL ] DAVA: Loaded 41943 existing records from primary storage. [2025-10-22T22:07:34.574215] [INFO ] [MAIN ] DAVA: Loaded 41943 primary data records. [2025-10-22T22:07:35.081542] [DEBUG] [LOCAL ] DAY: Loaded 49122 existing records from primary storage. [2025-10-22T22:07:35.082472] [INFO ] [MAIN ] DAY: Loaded 49122 primary data records. [2025-10-22T22:07:35.373723] [DEBUG] [MAIN ] DAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:35.388521] [INFO ] [MAIN ] DAR: Generated 1794 derivative records from 51998 primary records. [2025-10-22T22:07:35.388632] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-22T22:07:35.405153] [DEBUG] [LOCAL ] DAR: Derivative data saved (1794 records). [2025-10-22T22:07:35.406953] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-22T22:07:35.409973] [INFO ] [MAIN ] Derivative Progress: 473/2052 symbols completed. DAR took 1.3s. Estimated remaining: 9m 56s. Rate: 159.1 symbols/min [2025-10-22T22:07:35.411513] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:35.426181] [DEBUG] [MAIN ] DAVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:35.427147] [INFO ] [MAIN ] DAVA: Generated 1794 derivative records from 41943 primary records. [2025-10-22T22:07:35.427402] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-22T22:07:35.443503] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1794 records). [2025-10-22T22:07:35.443705] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-10-22T22:07:35.446059] [INFO ] [MAIN ] Derivative Progress: 474/2052 symbols completed. DAVA took 1.1s. Estimated remaining: 9m 54s. Rate: 159.4 symbols/min [2025-10-22T22:07:35.446317] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:35.462974] [DEBUG] [MAIN ] DAY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:35.463768] [INFO ] [MAIN ] DAY: Generated 1794 derivative records from 49122 primary records. [2025-10-22T22:07:35.463942] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-10-22T22:07:35.493077] [DEBUG] [LOCAL ] DAY: Derivative data saved (1794 records). [2025-10-22T22:07:35.493354] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-10-22T22:07:35.495575] [INFO ] [MAIN ] Derivative Progress: 475/2052 symbols completed. DAY took 1.0s. Estimated remaining: 9m 53s. Rate: 159.7 symbols/min [2025-10-22T22:07:35.503934] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:35.521395] [DEBUG] [LOCAL ] DB: Loaded 52466 existing records from primary storage. [2025-10-22T22:07:35.524398] [INFO ] [MAIN ] DB: Loaded 52466 primary data records. [2025-10-22T22:07:35.609133] [DEBUG] [LOCAL ] DBI: Loaded 43370 existing records from primary storage. [2025-10-22T22:07:35.629823] [DEBUG] [LOCAL ] DBL: Loaded 9247 existing records from primary storage. [2025-10-22T22:07:35.629932] [INFO ] [MAIN ] DBL: Loaded 9247 primary data records. [2025-10-22T22:07:35.676424] [INFO ] [MAIN ] DBI: Loaded 43370 primary data records. [2025-10-22T22:07:36.488562] [DEBUG] [MAIN ] DB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:36.492248] [INFO ] [MAIN ] DB: Generated 1794 derivative records from 52466 primary records. [2025-10-22T22:07:36.492491] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-22T22:07:36.513757] [DEBUG] [MAIN ] DBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:36.518101] [INFO ] [MAIN ] DBI: Generated 1794 derivative records from 43370 primary records. [2025-10-22T22:07:36.526094] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-22T22:07:36.534983] [DEBUG] [LOCAL ] DB: Derivative data saved (1794 records). [2025-10-22T22:07:36.533375] [DEBUG] [MAIN ] DBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:36.535664] [INFO ] [MAIN ] DBL: Generated 1794 derivative records from 9247 primary records. [2025-10-22T22:07:36.535752] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-10-22T22:07:36.537712] [INFO ] [MAIN ] Derivative Progress: 476/2052 symbols completed. DB took 1.1s. Estimated remaining: 9m 54s. Rate: 159.1 symbols/min [2025-10-22T22:07:36.537886] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:36.535834] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-10-22T22:07:36.565286] [DEBUG] [LOCAL ] DBI: Derivative data saved (1794 records). [2025-10-22T22:07:36.568627] [DEBUG] [LOCAL ] DBL: Derivative data saved (1794 records). [2025-10-22T22:07:36.568762] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-10-22T22:07:36.568843] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-10-22T22:07:36.571055] [INFO ] [MAIN ] Derivative Progress: 477/2052 symbols completed. DBI took 1.1s. Estimated remaining: 9m 53s. Rate: 159.4 symbols/min [2025-10-22T22:07:36.573633] [INFO ] [MAIN ] Derivative Progress: 478/2052 symbols completed. DBL took 1.1s. Estimated remaining: 9m 51s. Rate: 159.7 symbols/min [2025-10-22T22:07:36.573520] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:36.618151] [DEBUG] [LOCAL ] DBRG: Loaded 49979 existing records from primary storage. [2025-10-22T22:07:36.618328] [INFO ] [MAIN ] DBRG: Loaded 49979 primary data records. [2025-10-22T22:07:36.729369] [DEBUG] [LOCAL ] DCI: Loaded 36843 existing records from primary storage. [2025-10-22T22:07:36.735229] [INFO ] [MAIN ] DCI: Loaded 36843 primary data records. [2025-10-22T22:07:37.249609] [DEBUG] [MAIN ] DBRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:37.250376] [INFO ] [MAIN ] DBRG: Generated 1794 derivative records from 49979 primary records. [2025-10-22T22:07:37.250824] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-10-22T22:07:37.267606] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1794 records). [2025-10-22T22:07:37.267859] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-10-22T22:07:37.269763] [INFO ] [MAIN ] Derivative Progress: 479/2052 symbols completed. DBRG took 0.7s. Estimated remaining: 9m 52s. Rate: 159.4 symbols/min [2025-10-22T22:07:37.284932] [DEBUG] [MAIN ] DCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:37.285736] [INFO ] [MAIN ] DCI: Generated 1794 derivative records from 36843 primary records. [2025-10-22T22:07:37.285801] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-10-22T22:07:37.301073] [DEBUG] [LOCAL ] DCI: Derivative data saved (1794 records). [2025-10-22T22:07:37.301148] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-10-22T22:07:37.304305] [INFO ] [MAIN ] Derivative Progress: 480/2052 symbols completed. DCI took 0.7s. Estimated remaining: 9m 51s. Rate: 159.7 symbols/min [2025-10-22T22:07:37.304932] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:37.305000] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:37.304838] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:37.322939] [DEBUG] [LOCAL ] DCO: Loaded 14967 existing records from primary storage. [2025-10-22T22:07:37.323264] [INFO ] [MAIN ] DCO: Loaded 14967 primary data records. [2025-10-22T22:07:37.464332] [DEBUG] [LOCAL ] DDL: Loaded 37179 existing records from primary storage. [2025-10-22T22:07:37.470906] [INFO ] [MAIN ] DDL: Loaded 37179 primary data records. [2025-10-22T22:07:37.759168] [DEBUG] [LOCAL ] DDD: Loaded 50948 existing records from primary storage. [2025-10-22T22:07:37.776637] [INFO ] [MAIN ] DDD: Loaded 50948 primary data records. [2025-10-22T22:07:38.309308] [DEBUG] [MAIN ] DCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:38.310318] [INFO ] [MAIN ] DCO: Generated 1794 derivative records from 14967 primary records. [2025-10-22T22:07:38.310510] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-10-22T22:07:38.343998] [DEBUG] [LOCAL ] DCO: Derivative data saved (1794 records). [2025-10-22T22:07:38.345984] [DEBUG] [MAIN ] DDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:38.347116] [INFO ] [MAIN ] DDL: Generated 1794 derivative records from 37179 primary records. [2025-10-22T22:07:38.346248] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-10-22T22:07:38.349571] [INFO ] [MAIN ] Derivative Progress: 481/2052 symbols completed. DCO took 1.0s. Estimated remaining: 9m 52s. Rate: 159.1 symbols/min [2025-10-22T22:07:38.349787] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:38.349971] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-10-22T22:07:38.372949] [DEBUG] [MAIN ] DDD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:38.376627] [INFO ] [MAIN ] DDD: Generated 1794 derivative records from 50948 primary records. [2025-10-22T22:07:38.380997] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-10-22T22:07:38.380826] [DEBUG] [LOCAL ] DDL: Derivative data saved (1794 records). [2025-10-22T22:07:38.381119] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-10-22T22:07:38.383818] [INFO ] [MAIN ] Derivative Progress: 482/2052 symbols completed. DDL took 1.1s. Estimated remaining: 9m 51s. Rate: 159.4 symbols/min [2025-10-22T22:07:38.394142] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:38.402262] [DEBUG] [LOCAL ] DDD: Derivative data saved (1794 records). [2025-10-22T22:07:38.402402] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-10-22T22:07:38.404864] [INFO ] [MAIN ] Derivative Progress: 483/2052 symbols completed. DDD took 1.1s. Estimated remaining: 9m 49s. Rate: 159.7 symbols/min [2025-10-22T22:07:38.405404] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:38.410469] [DEBUG] [LOCAL ] DDS: Loaded 12375 existing records from primary storage. [2025-10-22T22:07:38.410547] [INFO ] [MAIN ] DDS: Loaded 12375 primary data records. [2025-10-22T22:07:38.806985] [DEBUG] [LOCAL ] DECK: Loaded 53301 existing records from primary storage. [2025-10-22T22:07:38.808808] [INFO ] [MAIN ] DECK: Loaded 53301 primary data records. [2025-10-22T22:07:38.808431] [DEBUG] [LOCAL ] DE: Loaded 47533 existing records from primary storage. [2025-10-22T22:07:38.809744] [INFO ] [MAIN ] DE: Loaded 47533 primary data records. [2025-10-22T22:07:39.452132] [DEBUG] [MAIN ] DDS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:07:39.454084] [INFO ] [MAIN ] DDS: Generated 1793 derivative records from 12375 primary records. [2025-10-22T22:07:39.454820] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-10-22T22:07:39.474364] [DEBUG] [LOCAL ] DDS: Derivative data saved (1793 records). [2025-10-22T22:07:39.474911] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-10-22T22:07:39.477148] [INFO ] [MAIN ] Derivative Progress: 484/2052 symbols completed. DDS took 1.1s. Estimated remaining: 9m 51s. Rate: 159.1 symbols/min [2025-10-22T22:07:39.477398] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:39.497767] [DEBUG] [MAIN ] DECK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:39.514003] [INFO ] [MAIN ] DECK: Generated 1794 derivative records from 53301 primary records. [2025-10-22T22:07:39.514461] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-10-22T22:07:39.514333] [DEBUG] [MAIN ] DE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:39.515720] [INFO ] [MAIN ] DE: Generated 1794 derivative records from 47533 primary records. [2025-10-22T22:07:39.516298] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-22T22:07:39.531206] [DEBUG] [LOCAL ] DECK: Derivative data saved (1794 records). [2025-10-22T22:07:39.531794] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-10-22T22:07:39.534383] [INFO ] [MAIN ] Derivative Progress: 485/2052 symbols completed. DECK took 1.1s. Estimated remaining: 9m 50s. Rate: 159.4 symbols/min [2025-10-22T22:07:39.551534] [DEBUG] [LOCAL ] DE: Derivative data saved (1794 records). [2025-10-22T22:07:39.547028] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:39.551861] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-10-22T22:07:39.554145] [INFO ] [MAIN ] Derivative Progress: 486/2052 symbols completed. DE took 1.2s. Estimated remaining: 9m 48s. Rate: 159.7 symbols/min [2025-10-22T22:07:39.554366] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:39.589046] [DEBUG] [LOCAL ] DEI: Loaded 48295 existing records from primary storage. [2025-10-22T22:07:39.589408] [INFO ] [MAIN ] DEI: Loaded 48295 primary data records. [2025-10-22T22:07:39.804478] [DEBUG] [LOCAL ] DEO: Loaded 49185 existing records from primary storage. [2025-10-22T22:07:39.923620] [INFO ] [MAIN ] DEO: Loaded 49185 primary data records. [2025-10-22T22:07:39.953373] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-22T22:07:39.976343] [INFO ] [MAIN ] DELL: Loaded 53736 primary data records. [2025-10-22T22:07:40.599031] [DEBUG] [MAIN ] DEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:40.600054] [INFO ] [MAIN ] DEI: Generated 1794 derivative records from 48295 primary records. [2025-10-22T22:07:40.601395] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-10-22T22:07:40.621148] [DEBUG] [LOCAL ] DEI: Derivative data saved (1794 records). [2025-10-22T22:07:40.621628] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-10-22T22:07:40.624577] [INFO ] [MAIN ] Derivative Progress: 487/2052 symbols completed. DEI took 1.1s. Estimated remaining: 9m 50s. Rate: 159.1 symbols/min [2025-10-22T22:07:40.625169] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:40.638965] [DEBUG] [MAIN ] DEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:40.642706] [INFO ] [MAIN ] DEO: Generated 1794 derivative records from 49185 primary records. [2025-10-22T22:07:40.643015] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-10-22T22:07:40.667970] [DEBUG] [MAIN ] DELL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:40.672225] [DEBUG] [LOCAL ] DEO: Derivative data saved (1794 records). [2025-10-22T22:07:40.672526] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-10-22T22:07:40.675386] [INFO ] [MAIN ] Derivative Progress: 488/2052 symbols completed. DEO took 1.1s. Estimated remaining: 9m 49s. Rate: 159.4 symbols/min [2025-10-22T22:07:40.673249] [INFO ] [MAIN ] DELL: Generated 1794 derivative records from 53736 primary records. [2025-10-22T22:07:40.675610] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:40.675916] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-10-22T22:07:40.693344] [DEBUG] [LOCAL ] DELL: Derivative data saved (1794 records). [2025-10-22T22:07:40.693423] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-10-22T22:07:40.696183] [INFO ] [MAIN ] Derivative Progress: 489/2052 symbols completed. DELL took 1.1s. Estimated remaining: 9m 47s. Rate: 159.7 symbols/min [2025-10-22T22:07:40.696430] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:40.736833] [DEBUG] [LOCAL ] DHF: Loaded 20878 existing records from primary storage. [2025-10-22T22:07:40.737583] [INFO ] [MAIN ] DHF: Loaded 20878 primary data records. [2025-10-22T22:07:40.827493] [DEBUG] [LOCAL ] DG: Loaded 53259 existing records from primary storage. [2025-10-22T22:07:40.850336] [INFO ] [MAIN ] DG: Loaded 53259 primary data records. [2025-10-22T22:07:40.897763] [DEBUG] [LOCAL ] DGX: Loaded 44610 existing records from primary storage. [2025-10-22T22:07:40.915155] [INFO ] [MAIN ] DGX: Loaded 44610 primary data records. [2025-10-22T22:07:41.687439] [DEBUG] [MAIN ] DHF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:41.688984] [INFO ] [MAIN ] DHF: Generated 1794 derivative records from 20878 primary records. [2025-10-22T22:07:41.696920] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-10-22T22:07:41.703307] [DEBUG] [MAIN ] DG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:41.712148] [INFO ] [MAIN ] DG: Generated 1794 derivative records from 53259 primary records. [2025-10-22T22:07:41.713790] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-10-22T22:07:41.722696] [DEBUG] [LOCAL ] DHF: Derivative data saved (1794 records). [2025-10-22T22:07:41.723569] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-10-22T22:07:41.726011] [INFO ] [MAIN ] Derivative Progress: 490/2052 symbols completed. DHF took 1.0s. Estimated remaining: 9m 49s. Rate: 159.2 symbols/min [2025-10-22T22:07:41.734008] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:41.752856] [DEBUG] [MAIN ] DGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:41.754574] [INFO ] [MAIN ] DGX: Generated 1794 derivative records from 44610 primary records. [2025-10-22T22:07:41.758146] [DEBUG] [LOCAL ] DG: Derivative data saved (1794 records). [2025-10-22T22:07:41.756782] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-10-22T22:07:41.758914] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-10-22T22:07:41.761464] [INFO ] [MAIN ] Derivative Progress: 491/2052 symbols completed. DG took 1.1s. Estimated remaining: 9m 47s. Rate: 159.4 symbols/min [2025-10-22T22:07:41.762185] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:41.779003] [DEBUG] [LOCAL ] DGX: Derivative data saved (1794 records). [2025-10-22T22:07:41.779212] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-10-22T22:07:41.782118] [INFO ] [MAIN ] Derivative Progress: 492/2052 symbols completed. DGX took 1.1s. Estimated remaining: 9m 46s. Rate: 159.8 symbols/min [2025-10-22T22:07:41.782366] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:41.794740] [DEBUG] [LOCAL ] DIAX: Loaded 12723 existing records from primary storage. [2025-10-22T22:07:41.808852] [INFO ] [MAIN ] DIAX: Loaded 12723 primary data records. [2025-10-22T22:07:41.937162] [DEBUG] [LOCAL ] DHI: Loaded 53363 existing records from primary storage. [2025-10-22T22:07:41.957959] [INFO ] [MAIN ] DHI: Loaded 53363 primary data records. [2025-10-22T22:07:42.041030] [DEBUG] [LOCAL ] DIN: Loaded 36752 existing records from primary storage. [2025-10-22T22:07:42.082898] [INFO ] [MAIN ] DIN: Loaded 36752 primary data records. [2025-10-22T22:07:42.820825] [DEBUG] [MAIN ] DIAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:42.834167] [INFO ] [MAIN ] DIAX: Generated 1794 derivative records from 12723 primary records. [2025-10-22T22:07:42.834295] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-10-22T22:07:42.834745] [DEBUG] [MAIN ] DHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:42.836792] [INFO ] [MAIN ] DHI: Generated 1794 derivative records from 53363 primary records. [2025-10-22T22:07:42.848610] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-10-22T22:07:42.852869] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1794 records). [2025-10-22T22:07:42.853992] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-10-22T22:07:42.857942] [INFO ] [MAIN ] Derivative Progress: 493/2052 symbols completed. DIAX took 1.1s. Estimated remaining: 9m 48s. Rate: 159.2 symbols/min [2025-10-22T22:07:42.887027] [DEBUG] [LOCAL ] DHI: Derivative data saved (1794 records). [2025-10-22T22:07:42.887128] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-10-22T22:07:42.886970] [DEBUG] [MAIN ] DIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:42.889561] [INFO ] [MAIN ] Derivative Progress: 494/2052 symbols completed. DHI took 1.2s. Estimated remaining: 9m 46s. Rate: 159.4 symbols/min [2025-10-22T22:07:42.890339] [INFO ] [MAIN ] DIN: Generated 1794 derivative records from 36752 primary records. [2025-10-22T22:07:42.890530] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-10-22T22:07:42.905937] [DEBUG] [LOCAL ] DIN: Derivative data saved (1794 records). [2025-10-22T22:07:42.905993] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-10-22T22:07:42.908453] [INFO ] [MAIN ] Derivative Progress: 495/2052 symbols completed. DIN took 1.1s. Estimated remaining: 9m 45s. Rate: 159.8 symbols/min [2025-10-22T22:07:42.908840] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:42.908993] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:42.908905] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:42.927702] [DEBUG] [LOCAL ] DKL: Loaded 16871 existing records from primary storage. [2025-10-22T22:07:42.927833] [INFO ] [MAIN ] DKL: Loaded 16871 primary data records. [2025-10-22T22:07:43.254888] [DEBUG] [LOCAL ] DK: Loaded 49230 existing records from primary storage. [2025-10-22T22:07:43.275446] [INFO ] [MAIN ] DK: Loaded 49230 primary data records. [2025-10-22T22:07:43.313286] [DEBUG] [LOCAL ] DINO: Loaded 52825 existing records from primary storage. [2025-10-22T22:07:43.320717] [INFO ] [MAIN ] DINO: Loaded 52825 primary data records. [2025-10-22T22:07:43.894398] [DEBUG] [MAIN ] DKL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:43.895884] [INFO ] [MAIN ] DKL: Generated 1794 derivative records from 16871 primary records. [2025-10-22T22:07:43.896074] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-10-22T22:07:43.912616] [DEBUG] [LOCAL ] DKL: Derivative data saved (1794 records). [2025-10-22T22:07:43.913158] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-10-22T22:07:43.915491] [INFO ] [MAIN ] Derivative Progress: 496/2052 symbols completed. DKL took 1.0s. Estimated remaining: 9m 46s. Rate: 159.2 symbols/min [2025-10-22T22:07:43.915662] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:43.933766] [DEBUG] [MAIN ] DK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:43.934756] [INFO ] [MAIN ] DK: Generated 1794 derivative records from 49230 primary records. [2025-10-22T22:07:43.934940] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-10-22T22:07:43.948477] [DEBUG] [MAIN ] DINO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:43.957446] [INFO ] [MAIN ] DINO: Generated 1794 derivative records from 52825 primary records. [2025-10-22T22:07:43.960262] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-10-22T22:07:43.973930] [DEBUG] [LOCAL ] DK: Derivative data saved (1794 records). [2025-10-22T22:07:43.974067] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-10-22T22:07:43.990030] [INFO ] [MAIN ] Derivative Progress: 497/2052 symbols completed. DK took 1.1s. Estimated remaining: 9m 45s. Rate: 159.5 symbols/min [2025-10-22T22:07:43.988074] [DEBUG] [LOCAL ] DINO: Derivative data saved (1794 records). [2025-10-22T22:07:43.990346] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-10-22T22:07:43.990289] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:43.993055] [INFO ] [MAIN ] Derivative Progress: 498/2052 symbols completed. DINO took 1.1s. Estimated remaining: 9m 44s. Rate: 159.8 symbols/min [2025-10-22T22:07:43.993528] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:44.005525] [DEBUG] [LOCAL ] DLB: Loaded 32217 existing records from primary storage. [2025-10-22T22:07:44.007007] [INFO ] [MAIN ] DLB: Loaded 32217 primary data records. [2025-10-22T22:07:44.069996] [DEBUG] [LOCAL ] DLNG: Loaded 6048 existing records from primary storage. [2025-10-22T22:07:44.097667] [INFO ] [MAIN ] DLNG: Loaded 6048 primary data records. [2025-10-22T22:07:44.666263] [DEBUG] [LOCAL ] DLR: Loaded 50597 existing records from primary storage. [2025-10-22T22:07:44.675360] [INFO ] [MAIN ] DLR: Loaded 50597 primary data records. [2025-10-22T22:07:45.007974] [DEBUG] [MAIN ] DLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:45.015978] [INFO ] [MAIN ] DLB: Generated 1794 derivative records from 32217 primary records. [2025-10-22T22:07:45.021002] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-10-22T22:07:45.021812] [DEBUG] [MAIN ] DLNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:45.023476] [INFO ] [MAIN ] DLNG: Generated 1794 derivative records from 6048 primary records. [2025-10-22T22:07:45.031127] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-10-22T22:07:45.053863] [DEBUG] [LOCAL ] DLB: Derivative data saved (1794 records). [2025-10-22T22:07:45.053913] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1794 records). [2025-10-22T22:07:45.054348] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-10-22T22:07:45.054162] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-10-22T22:07:45.056637] [INFO ] [MAIN ] Derivative Progress: 499/2052 symbols completed. DLNG took 1.1s. Estimated remaining: 9m 45s. Rate: 159.2 symbols/min [2025-10-22T22:07:45.058791] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:45.058902] [INFO ] [MAIN ] Derivative Progress: 500/2052 symbols completed. DLB took 1.1s. Estimated remaining: 9m 44s. Rate: 159.5 symbols/min [2025-10-22T22:07:45.059298] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:45.076556] [DEBUG] [MAIN ] DLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:45.077331] [INFO ] [MAIN ] DLR: Generated 1794 derivative records from 50597 primary records. [2025-10-22T22:07:45.077610] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-22T22:07:45.081083] [DEBUG] [LOCAL ] DMA: Loaded 4714 existing records from primary storage. [2025-10-22T22:07:45.088392] [INFO ] [MAIN ] DMA: Loaded 4714 primary data records. [2025-10-22T22:07:45.219711] [DEBUG] [LOCAL ] DLR: Derivative data saved (1794 records). [2025-10-22T22:07:45.220672] [DEBUG] [LOCAL ] DLX: Loaded 28049 existing records from primary storage. [2025-10-22T22:07:45.225273] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-10-22T22:07:45.228539] [INFO ] [MAIN ] DLX: Loaded 28049 primary data records. [2025-10-22T22:07:45.228402] [INFO ] [MAIN ] Derivative Progress: 501/2052 symbols completed. DLR took 1.2s. Estimated remaining: 9m 43s. Rate: 159.7 symbols/min [2025-10-22T22:07:45.312191] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:45.611914] [DEBUG] [LOCAL ] DMO: Loaded 9788 existing records from primary storage. [2025-10-22T22:07:45.612423] [INFO ] [MAIN ] DMO: Loaded 9788 primary data records. [2025-10-22T22:07:46.046301] [DEBUG] [MAIN ] DMA: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:07:46.048791] [INFO ] [MAIN ] DMA: Generated 1793 derivative records from 4714 primary records. [2025-10-22T22:07:46.048909] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-10-22T22:07:46.077389] [DEBUG] [LOCAL ] DMA: Derivative data saved (1793 records). [2025-10-22T22:07:46.077322] [DEBUG] [MAIN ] DLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:46.078382] [INFO ] [MAIN ] DLX: Generated 1794 derivative records from 28049 primary records. [2025-10-22T22:07:46.077572] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-10-22T22:07:46.080578] [INFO ] [MAIN ] Derivative Progress: 502/2052 symbols completed. DMA took 1.0s. Estimated remaining: 9m 44s. Rate: 159.3 symbols/min [2025-10-22T22:07:46.078521] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-10-22T22:07:46.082062] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:46.098733] [DEBUG] [LOCAL ] DLX: Derivative data saved (1794 records). [2025-10-22T22:07:46.099076] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-10-22T22:07:46.101615] [INFO ] [MAIN ] Derivative Progress: 503/2052 symbols completed. DLX took 1.0s. Estimated remaining: 9m 42s. Rate: 159.6 symbols/min [2025-10-22T22:07:46.101920] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:46.118276] [DEBUG] [MAIN ] DMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:46.118991] [INFO ] [MAIN ] DMO: Generated 1794 derivative records from 9788 primary records. [2025-10-22T22:07:46.119130] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-10-22T22:07:46.144533] [DEBUG] [LOCAL ] DMO: Derivative data saved (1794 records). [2025-10-22T22:07:46.144683] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-10-22T22:07:46.147350] [INFO ] [MAIN ] Derivative Progress: 504/2052 symbols completed. DMO took 0.8s. Estimated remaining: 9m 41s. Rate: 159.9 symbols/min [2025-10-22T22:07:46.147557] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:46.170832] [DEBUG] [LOCAL ] DNOW: Loaded 43752 existing records from primary storage. [2025-10-22T22:07:46.171031] [INFO ] [MAIN ] DNOW: Loaded 43752 primary data records. [2025-10-22T22:07:46.276261] [DEBUG] [LOCAL ] DNP: Loaded 32937 existing records from primary storage. [2025-10-22T22:07:46.288018] [INFO ] [MAIN ] DNP: Loaded 32937 primary data records. [2025-10-22T22:07:46.836383] [DEBUG] [LOCAL ] DOC: Loaded 53555 existing records from primary storage. [2025-10-22T22:07:46.837034] [INFO ] [MAIN ] DOC: Loaded 53555 primary data records. [2025-10-22T22:07:47.166484] [DEBUG] [MAIN ] DNOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:47.168601] [INFO ] [MAIN ] DNOW: Generated 1794 derivative records from 43752 primary records. [2025-10-22T22:07:47.168732] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-10-22T22:07:47.190061] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1794 records). [2025-10-22T22:07:47.190761] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-10-22T22:07:47.193175] [INFO ] [MAIN ] Derivative Progress: 505/2052 symbols completed. DNOW took 1.1s. Estimated remaining: 9m 43s. Rate: 159.3 symbols/min [2025-10-22T22:07:47.193383] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:47.207987] [DEBUG] [MAIN ] DNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:47.208973] [INFO ] [MAIN ] DNP: Generated 1794 derivative records from 32937 primary records. [2025-10-22T22:07:47.209183] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-10-22T22:07:47.228753] [DEBUG] [LOCAL ] DNP: Derivative data saved (1794 records). [2025-10-22T22:07:47.228869] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-10-22T22:07:47.231080] [INFO ] [MAIN ] Derivative Progress: 506/2052 symbols completed. DNP took 1.1s. Estimated remaining: 9m 41s. Rate: 159.6 symbols/min [2025-10-22T22:07:47.231307] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:47.245966] [DEBUG] [MAIN ] DOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:47.246878] [INFO ] [MAIN ] DOC: Generated 1794 derivative records from 53555 primary records. [2025-10-22T22:07:47.247050] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-22T22:07:47.264615] [DEBUG] [LOCAL ] DOC: Derivative data saved (1794 records). [2025-10-22T22:07:47.264962] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-22T22:07:47.267728] [INFO ] [MAIN ] Derivative Progress: 507/2052 symbols completed. DOC took 1.1s. Estimated remaining: 9m 40s. Rate: 159.9 symbols/min [2025-10-22T22:07:47.268244] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:47.320373] [DEBUG] [LOCAL ] DOCN: Loaded 51129 existing records from primary storage. [2025-10-22T22:07:47.332248] [INFO ] [MAIN ] DOCN: Loaded 51129 primary data records. [2025-10-22T22:07:47.384061] [DEBUG] [LOCAL ] DOCS: Loaded 50353 existing records from primary storage. [2025-10-22T22:07:47.389460] [INFO ] [MAIN ] DOCS: Loaded 50353 primary data records. [2025-10-22T22:07:47.460052] [DEBUG] [LOCAL ] DOUG: Loaded 33811 existing records from primary storage. [2025-10-22T22:07:47.515076] [INFO ] [MAIN ] DOUG: Loaded 33811 primary data records. [2025-10-22T22:07:48.402598] [DEBUG] [MAIN ] DOCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:48.403962] [INFO ] [MAIN ] DOCN: Generated 1794 derivative records from 51129 primary records. [2025-10-22T22:07:48.404179] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-22T22:07:48.418436] [DEBUG] [MAIN ] DOCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:48.430445] [INFO ] [MAIN ] DOCS: Generated 1794 derivative records from 50353 primary records. [2025-10-22T22:07:48.430609] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-10-22T22:07:48.435866] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1794 records). [2025-10-22T22:07:48.436111] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-10-22T22:07:48.438479] [INFO ] [MAIN ] Derivative Progress: 508/2052 symbols completed. DOCN took 1.2s. Estimated remaining: 9m 42s. Rate: 159.2 symbols/min [2025-10-22T22:07:48.454762] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1794 records). [2025-10-22T22:07:48.455785] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-10-22T22:07:48.458293] [INFO ] [MAIN ] Derivative Progress: 509/2052 symbols completed. DOCS took 1.2s. Estimated remaining: 9m 40s. Rate: 159.5 symbols/min [2025-10-22T22:07:48.471965] [DEBUG] [MAIN ] DOUG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:48.472693] [INFO ] [MAIN ] DOUG: Generated 1794 derivative records from 33811 primary records. [2025-10-22T22:07:48.472760] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-22T22:07:48.487767] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1794 records). [2025-10-22T22:07:48.487869] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-10-22T22:07:48.490482] [INFO ] [MAIN ] Derivative Progress: 510/2052 symbols completed. DOUG took 1.2s. Estimated remaining: 9m 39s. Rate: 159.8 symbols/min [2025-10-22T22:07:48.491350] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:48.491450] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:48.491836] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:48.510116] [DEBUG] [LOCAL ] DPG: Loaded 13345 existing records from primary storage. [2025-10-22T22:07:48.510391] [INFO ] [MAIN ] DPG: Loaded 13345 primary data records. [2025-10-22T22:07:48.822284] [DEBUG] [LOCAL ] DOV: Loaded 45584 existing records from primary storage. [2025-10-22T22:07:48.852824] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-22T22:07:48.861743] [INFO ] [MAIN ] DOV: Loaded 45584 primary data records. [2025-10-22T22:07:48.861635] [INFO ] [MAIN ] DOW: Loaded 53733 primary data records. [2025-10-22T22:07:49.496932] [DEBUG] [MAIN ] DPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:49.498355] [INFO ] [MAIN ] DPG: Generated 1794 derivative records from 13345 primary records. [2025-10-22T22:07:49.498531] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-10-22T22:07:49.518884] [DEBUG] [LOCAL ] DPG: Derivative data saved (1794 records). [2025-10-22T22:07:49.519521] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-10-22T22:07:49.521922] [INFO ] [MAIN ] Derivative Progress: 511/2052 symbols completed. DPG took 1.0s. Estimated remaining: 9m 41s. Rate: 159.3 symbols/min [2025-10-22T22:07:49.522517] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:49.541868] [DEBUG] [MAIN ] DOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:49.543868] [INFO ] [MAIN ] DOV: Generated 1794 derivative records from 45584 primary records. [2025-10-22T22:07:49.544629] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-10-22T22:07:49.574941] [DEBUG] [MAIN ] DOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:49.576473] [INFO ] [MAIN ] DOW: Generated 1794 derivative records from 53733 primary records. [2025-10-22T22:07:49.575050] [DEBUG] [LOCAL ] DOV: Derivative data saved (1794 records). [2025-10-22T22:07:49.576685] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-10-22T22:07:49.576791] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-10-22T22:07:49.579508] [INFO ] [MAIN ] Derivative Progress: 512/2052 symbols completed. DOV took 1.1s. Estimated remaining: 9m 39s. Rate: 159.5 symbols/min [2025-10-22T22:07:49.580244] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:49.606241] [DEBUG] [LOCAL ] DOW: Derivative data saved (1794 records). [2025-10-22T22:07:49.606474] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-10-22T22:07:49.609483] [INFO ] [MAIN ] Derivative Progress: 513/2052 symbols completed. DOW took 1.1s. Estimated remaining: 9m 38s. Rate: 159.8 symbols/min [2025-10-22T22:07:49.609767] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:49.624363] [DEBUG] [LOCAL ] DRD: Loaded 37899 existing records from primary storage. [2025-10-22T22:07:49.625215] [INFO ] [MAIN ] DRD: Loaded 37899 primary data records. [2025-10-22T22:07:49.754510] [DEBUG] [LOCAL ] DSL: Loaded 28887 existing records from primary storage. [2025-10-22T22:07:49.770571] [INFO ] [MAIN ] DSL: Loaded 28887 primary data records. [2025-10-22T22:07:49.853777] [DEBUG] [LOCAL ] DRI: Loaded 47513 existing records from primary storage. [2025-10-22T22:07:49.891723] [INFO ] [MAIN ] DRI: Loaded 47513 primary data records. [2025-10-22T22:07:50.677015] [DEBUG] [MAIN ] DRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:50.678354] [INFO ] [MAIN ] DRD: Generated 1794 derivative records from 37899 primary records. [2025-10-22T22:07:50.678614] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-10-22T22:07:50.696913] [DEBUG] [LOCAL ] DRD: Derivative data saved (1794 records). [2025-10-22T22:07:50.697358] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-10-22T22:07:50.699483] [INFO ] [MAIN ] Derivative Progress: 514/2052 symbols completed. DRD took 1.2s. Estimated remaining: 9m 40s. Rate: 159.2 symbols/min [2025-10-22T22:07:50.700201] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:50.727738] [DEBUG] [MAIN ] DSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:50.729475] [INFO ] [MAIN ] DSL: Generated 1794 derivative records from 28887 primary records. [2025-10-22T22:07:50.746866] [DEBUG] [LOCAL ] DSM: Loaded 14178 existing records from primary storage. [2025-10-22T22:07:50.747294] [INFO ] [MAIN ] DSM: Loaded 14178 primary data records. [2025-10-22T22:07:50.747104] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-10-22T22:07:50.747876] [DEBUG] [MAIN ] DRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:50.748763] [INFO ] [MAIN ] DRI: Generated 1794 derivative records from 47513 primary records. [2025-10-22T22:07:50.780675] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-10-22T22:07:50.842160] [DEBUG] [LOCAL ] DSL: Derivative data saved (1794 records). [2025-10-22T22:07:50.863979] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-10-22T22:07:50.847129] [DEBUG] [LOCAL ] DRI: Derivative data saved (1794 records). [2025-10-22T22:07:50.871824] [INFO ] [MAIN ] Derivative Progress: 515/2052 symbols completed. DSL took 1.3s. Estimated remaining: 9m 39s. Rate: 159.4 symbols/min [2025-10-22T22:07:50.877535] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-10-22T22:07:50.877730] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:50.891406] [INFO ] [MAIN ] Derivative Progress: 516/2052 symbols completed. DRI took 1.3s. Estimated remaining: 9m 37s. Rate: 159.7 symbols/min [2025-10-22T22:07:50.891960] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:51.108451] [DEBUG] [LOCAL ] DSU: Loaded 22871 existing records from primary storage. [2025-10-22T22:07:51.107326] [DEBUG] [LOCAL ] DSX: Loaded 23496 existing records from primary storage. [2025-10-22T22:07:51.108798] [INFO ] [MAIN ] DSU: Loaded 22871 primary data records. [2025-10-22T22:07:51.108950] [INFO ] [MAIN ] DSX: Loaded 23496 primary data records. [2025-10-22T22:07:51.736597] [DEBUG] [MAIN ] DSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:51.737607] [INFO ] [MAIN ] DSM: Generated 1794 derivative records from 14178 primary records. [2025-10-22T22:07:51.740835] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-10-22T22:07:51.758016] [DEBUG] [LOCAL ] DSM: Derivative data saved (1794 records). [2025-10-22T22:07:51.758232] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-10-22T22:07:51.760616] [INFO ] [MAIN ] Derivative Progress: 517/2052 symbols completed. DSM took 1.1s. Estimated remaining: 9m 38s. Rate: 159.3 symbols/min [2025-10-22T22:07:51.760878] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:51.780857] [DEBUG] [MAIN ] DSU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:51.781735] [INFO ] [MAIN ] DSU: Generated 1794 derivative records from 22871 primary records. [2025-10-22T22:07:51.781996] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-10-22T22:07:51.798893] [DEBUG] [LOCAL ] DSU: Derivative data saved (1794 records). [2025-10-22T22:07:51.800328] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-10-22T22:07:51.803913] [INFO ] [MAIN ] Derivative Progress: 518/2052 symbols completed. DSU took 0.9s. Estimated remaining: 9m 37s. Rate: 159.5 symbols/min [2025-10-22T22:07:51.804310] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:51.817711] [DEBUG] [MAIN ] DSX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:51.818393] [INFO ] [MAIN ] DSX: Generated 1794 derivative records from 23496 primary records. [2025-10-22T22:07:51.818524] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-10-22T22:07:51.834616] [DEBUG] [LOCAL ] DSX: Derivative data saved (1794 records). [2025-10-22T22:07:51.834994] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-10-22T22:07:51.851010] [INFO ] [MAIN ] Derivative Progress: 519/2052 symbols completed. DSX took 1.0s. Estimated remaining: 9m 36s. Rate: 159.8 symbols/min [2025-10-22T22:07:51.851273] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:51.859404] [DEBUG] [LOCAL ] DTG: Loaded 5687 existing records from primary storage. [2025-10-22T22:07:51.859501] [INFO ] [MAIN ] DTG: Loaded 5687 primary data records. [2025-10-22T22:07:51.991546] [DEBUG] [LOCAL ] DT: Loaded 52954 existing records from primary storage. [2025-10-22T22:07:51.997911] [INFO ] [MAIN ] DT: Loaded 52954 primary data records. [2025-10-22T22:07:52.227834] [DEBUG] [LOCAL ] DTE: Loaded 47121 existing records from primary storage. [2025-10-22T22:07:52.261715] [INFO ] [MAIN ] DTE: Loaded 47121 primary data records. [2025-10-22T22:07:52.909551] [DEBUG] [MAIN ] DTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:52.910669] [INFO ] [MAIN ] DTG: Generated 1794 derivative records from 5687 primary records. [2025-10-22T22:07:52.910950] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-10-22T22:07:52.928887] [DEBUG] [LOCAL ] DTG: Derivative data saved (1794 records). [2025-10-22T22:07:52.929200] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-10-22T22:07:52.931459] [INFO ] [MAIN ] Derivative Progress: 520/2052 symbols completed. DTG took 1.1s. Estimated remaining: 9m 37s. Rate: 159.2 symbols/min [2025-10-22T22:07:52.931768] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:52.951579] [DEBUG] [MAIN ] DT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:52.964632] [INFO ] [MAIN ] DT: Generated 1794 derivative records from 52954 primary records. [2025-10-22T22:07:52.965286] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-10-22T22:07:52.965198] [DEBUG] [MAIN ] DTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:52.966828] [INFO ] [MAIN ] DTE: Generated 1794 derivative records from 47121 primary records. [2025-10-22T22:07:52.967148] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-10-22T22:07:52.983332] [DEBUG] [LOCAL ] DT: Derivative data saved (1794 records). [2025-10-22T22:07:52.983710] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-10-22T22:07:53.001443] [DEBUG] [LOCAL ] DTE: Derivative data saved (1794 records). [2025-10-22T22:07:52.993295] [INFO ] [MAIN ] Derivative Progress: 521/2052 symbols completed. DT took 1.2s. Estimated remaining: 9m 36s. Rate: 159.5 symbols/min [2025-10-22T22:07:53.001625] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:53.001987] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-10-22T22:07:53.015052] [INFO ] [MAIN ] Derivative Progress: 522/2052 symbols completed. DTE took 1.2s. Estimated remaining: 9m 35s. Rate: 159.8 symbols/min [2025-10-22T22:07:53.015336] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:53.020814] [DEBUG] [LOCAL ] DTW: Loaded 4713 existing records from primary storage. [2025-10-22T22:07:53.021086] [INFO ] [MAIN ] DTW: Loaded 4713 primary data records. [2025-10-22T22:07:53.143502] [DEBUG] [LOCAL ] DUKB: Loaded 6134 existing records from primary storage. [2025-10-22T22:07:53.143095] [DEBUG] [LOCAL ] DTM: Loaded 43686 existing records from primary storage. [2025-10-22T22:07:53.147702] [INFO ] [MAIN ] DUKB: Loaded 6134 primary data records. [2025-10-22T22:07:53.147817] [INFO ] [MAIN ] DTM: Loaded 43686 primary data records. [2025-10-22T22:07:54.056635] [DEBUG] [MAIN ] DTW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:54.058469] [INFO ] [MAIN ] DTW: Generated 1794 derivative records from 4713 primary records. [2025-10-22T22:07:54.059354] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-10-22T22:07:54.090699] [DEBUG] [MAIN ] DUKB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:54.092703] [INFO ] [MAIN ] DUKB: Generated 1794 derivative records from 6134 primary records. [2025-10-22T22:07:54.093152] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-10-22T22:07:54.093949] [DEBUG] [LOCAL ] DTW: Derivative data saved (1794 records). [2025-10-22T22:07:54.094061] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-10-22T22:07:54.116523] [INFO ] [MAIN ] Derivative Progress: 523/2052 symbols completed. DTW took 1.1s. Estimated remaining: 9m 36s. Rate: 159.2 symbols/min [2025-10-22T22:07:54.122238] [DEBUG] [MAIN ] DTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:54.127717] [INFO ] [MAIN ] DTM: Generated 1794 derivative records from 43686 primary records. [2025-10-22T22:07:54.126607] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1794 records). [2025-10-22T22:07:54.127879] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-10-22T22:07:54.127962] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-10-22T22:07:54.130629] [INFO ] [MAIN ] Derivative Progress: 524/2052 symbols completed. DUKB took 1.1s. Estimated remaining: 9m 35s. Rate: 159.5 symbols/min [2025-10-22T22:07:54.147931] [DEBUG] [LOCAL ] DTM: Derivative data saved (1794 records). [2025-10-22T22:07:54.148004] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-10-22T22:07:54.150865] [INFO ] [MAIN ] Derivative Progress: 525/2052 symbols completed. DTM took 1.2s. Estimated remaining: 9m 33s. Rate: 159.8 symbols/min [2025-10-22T22:07:54.151309] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:54.151242] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:54.151745] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:54.242568] [DEBUG] [LOCAL ] DVA: Loaded 40649 existing records from primary storage. [2025-10-22T22:07:54.244354] [INFO ] [MAIN ] DVA: Loaded 40649 primary data records. [2025-10-22T22:07:54.244191] [DEBUG] [LOCAL ] DXC: Loaded 49919 existing records from primary storage. [2025-10-22T22:07:54.262830] [INFO ] [MAIN ] DXC: Loaded 49919 primary data records. [2025-10-22T22:07:54.342461] [DEBUG] [LOCAL ] DV: Loaded 51241 existing records from primary storage. [2025-10-22T22:07:54.399916] [INFO ] [MAIN ] DV: Loaded 51241 primary data records. [2025-10-22T22:07:55.343057] [DEBUG] [MAIN ] DVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:55.344178] [INFO ] [MAIN ] DVA: Generated 1794 derivative records from 40649 primary records. [2025-10-22T22:07:55.346594] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-10-22T22:07:55.365433] [DEBUG] [MAIN ] DXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:55.390838] [INFO ] [MAIN ] DXC: Generated 1794 derivative records from 49919 primary records. [2025-10-22T22:07:55.393011] [DEBUG] [MAIN ] DV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:55.395446] [DEBUG] [LOCAL ] DVA: Derivative data saved (1794 records). [2025-10-22T22:07:55.395539] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-10-22T22:07:55.396564] [INFO ] [MAIN ] DV: Generated 1794 derivative records from 51241 primary records. [2025-10-22T22:07:55.395586] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-10-22T22:07:55.398756] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-22T22:07:55.398409] [INFO ] [MAIN ] Derivative Progress: 526/2052 symbols completed. DVA took 1.2s. Estimated remaining: 9m 36s. Rate: 159.1 symbols/min [2025-10-22T22:07:55.406560] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:55.415238] [DEBUG] [LOCAL ] DXC: Derivative data saved (1794 records). [2025-10-22T22:07:55.415608] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-10-22T22:07:55.418631] [INFO ] [MAIN ] Derivative Progress: 527/2052 symbols completed. DXC took 1.3s. Estimated remaining: 9m 34s. Rate: 159.4 symbols/min [2025-10-22T22:07:55.419242] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:55.439223] [DEBUG] [LOCAL ] DV: Derivative data saved (1794 records). [2025-10-22T22:07:55.439796] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-22T22:07:55.442590] [INFO ] [MAIN ] Derivative Progress: 528/2052 symbols completed. DV took 1.3s. Estimated remaining: 9m 33s. Rate: 159.6 symbols/min [2025-10-22T22:07:55.442909] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:55.487809] [DEBUG] [LOCAL ] DY: Loaded 28046 existing records from primary storage. [2025-10-22T22:07:55.488739] [DEBUG] [LOCAL ] DXYZ: Loaded 37126 existing records from primary storage. [2025-10-22T22:07:55.489097] [INFO ] [MAIN ] DXYZ: Loaded 37126 primary data records. [2025-10-22T22:07:55.489284] [INFO ] [MAIN ] DY: Loaded 28046 primary data records. [2025-10-22T22:07:56.146075] [DEBUG] [LOCAL ] EAT: Loaded 49719 existing records from primary storage. [2025-10-22T22:07:56.156210] [INFO ] [MAIN ] EAT: Loaded 49719 primary data records. [2025-10-22T22:07:56.587425] [DEBUG] [MAIN ] DXYZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:56.589249] [INFO ] [MAIN ] DXYZ: Generated 1794 derivative records from 37126 primary records. [2025-10-22T22:07:56.590003] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-22T22:07:56.615945] [DEBUG] [MAIN ] DY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:56.618822] [INFO ] [MAIN ] DY: Generated 1794 derivative records from 28046 primary records. [2025-10-22T22:07:56.619578] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-10-22T22:07:56.622392] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1794 records). [2025-10-22T22:07:56.622698] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-10-22T22:07:56.625145] [INFO ] [MAIN ] Derivative Progress: 529/2052 symbols completed. DXYZ took 1.2s. Estimated remaining: 9m 35s. Rate: 159.0 symbols/min [2025-10-22T22:07:56.632368] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:56.641990] [DEBUG] [LOCAL ] DY: Derivative data saved (1794 records). [2025-10-22T22:07:56.642330] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-10-22T22:07:56.644761] [INFO ] [MAIN ] Derivative Progress: 530/2052 symbols completed. DY took 1.2s. Estimated remaining: 9m 33s. Rate: 159.3 symbols/min [2025-10-22T22:07:56.645013] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:56.661475] [DEBUG] [MAIN ] EAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:56.666998] [INFO ] [MAIN ] EAT: Generated 1794 derivative records from 49719 primary records. [2025-10-22T22:07:56.667164] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-10-22T22:07:56.683408] [DEBUG] [LOCAL ] EAT: Derivative data saved (1794 records). [2025-10-22T22:07:56.683493] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-10-22T22:07:56.691815] [INFO ] [MAIN ] Derivative Progress: 531/2052 symbols completed. EAT took 1.2s. Estimated remaining: 9m 32s. Rate: 159.5 symbols/min [2025-10-22T22:07:56.693048] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:56.693667] [DEBUG] [LOCAL ] EBF: Loaded 19250 existing records from primary storage. [2025-10-22T22:07:56.694211] [INFO ] [MAIN ] EBF: Loaded 19250 primary data records. [2025-10-22T22:07:57.028542] [DEBUG] [LOCAL ] EBR: Loaded 43347 existing records from primary storage. [2025-10-22T22:07:57.028878] [INFO ] [MAIN ] EBR: Loaded 43347 primary data records. [2025-10-22T22:07:57.173345] [DEBUG] [LOCAL ] EBS: Loaded 46589 existing records from primary storage. [2025-10-22T22:07:57.175045] [INFO ] [MAIN ] EBS: Loaded 46589 primary data records. [2025-10-22T22:07:57.618298] [DEBUG] [MAIN ] EBF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:57.657579] [INFO ] [MAIN ] EBF: Generated 1794 derivative records from 19250 primary records. [2025-10-22T22:07:57.788310] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-10-22T22:07:57.857239] [DEBUG] [LOCAL ] EBF: Derivative data saved (1794 records). [2025-10-22T22:07:57.857742] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-10-22T22:07:57.860492] [INFO ] [MAIN ] Derivative Progress: 532/2052 symbols completed. EBF took 1.2s. Estimated remaining: 9m 34s. Rate: 158.9 symbols/min [2025-10-22T22:07:57.862728] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:57.896775] [DEBUG] [MAIN ] EBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:57.899192] [INFO ] [MAIN ] EBR: Generated 1794 derivative records from 43347 primary records. [2025-10-22T22:07:57.899354] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-22T22:07:57.926393] [DEBUG] [LOCAL ] EBR: Derivative data saved (1794 records). [2025-10-22T22:07:57.926779] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-10-22T22:07:57.929818] [INFO ] [MAIN ] Derivative Progress: 533/2052 symbols completed. EBR took 1.3s. Estimated remaining: 9m 33s. Rate: 159.2 symbols/min [2025-10-22T22:07:57.940787] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:57.959620] [DEBUG] [MAIN ] EBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:57.960543] [INFO ] [MAIN ] EBS: Generated 1794 derivative records from 46589 primary records. [2025-10-22T22:07:57.960786] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-10-22T22:07:58.002370] [DEBUG] [LOCAL ] EBS: Derivative data saved (1794 records). [2025-10-22T22:07:58.002819] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-10-22T22:07:57.999730] [DEBUG] [LOCAL ] ECAT: Loaded 29135 existing records from primary storage. [2025-10-22T22:07:58.005692] [INFO ] [MAIN ] Derivative Progress: 534/2052 symbols completed. EBS took 1.3s. Estimated remaining: 9m 31s. Rate: 159.4 symbols/min [2025-10-22T22:07:58.006723] [INFO ] [MAIN ] ECCU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:58.006940] [INFO ] [MAIN ] ECAT: Loaded 29135 primary data records. [2025-10-22T22:07:58.074767] [DEBUG] [LOCAL ] ECCU: Loaded 2152 existing records from primary storage. [2025-10-22T22:07:58.124021] [INFO ] [MAIN ] ECCU: Loaded 2152 primary data records. [2025-10-22T22:07:58.305572] [DEBUG] [LOCAL ] ECC: Loaded 43377 existing records from primary storage. [2025-10-22T22:07:58.369147] [INFO ] [MAIN ] ECC: Loaded 43377 primary data records. [2025-10-22T22:07:59.177569] [DEBUG] [MAIN ] ECAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:59.179633] [INFO ] [MAIN ] ECAT: Generated 1794 derivative records from 29135 primary records. [2025-10-22T22:07:59.180090] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-10-22T22:07:59.197751] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1794 records). [2025-10-22T22:07:59.198006] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-10-22T22:07:59.199973] [INFO ] [MAIN ] Derivative Progress: 535/2052 symbols completed. ECAT took 1.3s. Estimated remaining: 9m 33s. Rate: 158.8 symbols/min [2025-10-22T22:07:59.201006] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:59.219838] [DEBUG] [MAIN ] ECCU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:59.220626] [INFO ] [MAIN ] ECCU: Generated 1794 derivative records from 2152 primary records. [2025-10-22T22:07:59.220947] [DEBUG] [LOCAL ] ECCU: Saving derivative data. [2025-10-22T22:07:59.235569] [DEBUG] [LOCAL ] ECCU: Derivative data saved (1794 records). [2025-10-22T22:07:59.235818] [INFO ] [MAIN ] ECCU: Successfully saved derivative data. [2025-10-22T22:07:59.238251] [INFO ] [MAIN ] Derivative Progress: 536/2052 symbols completed. ECCU took 1.2s. Estimated remaining: 9m 32s. Rate: 159.0 symbols/min [2025-10-22T22:07:59.238470] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:59.263769] [DEBUG] [MAIN ] ECC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:07:59.264475] [INFO ] [MAIN ] ECC: Generated 1794 derivative records from 43377 primary records. [2025-10-22T22:07:59.265168] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-10-22T22:07:59.285871] [DEBUG] [LOCAL ] ECG: Loaded 32780 existing records from primary storage. [2025-10-22T22:07:59.288811] [INFO ] [MAIN ] ECG: Loaded 32780 primary data records. [2025-10-22T22:07:59.310781] [DEBUG] [LOCAL ] ECC: Derivative data saved (1794 records). [2025-10-22T22:07:59.320861] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-10-22T22:07:59.346605] [INFO ] [MAIN ] Derivative Progress: 537/2052 symbols completed. ECC took 1.4s. Estimated remaining: 9m 31s. Rate: 159.2 symbols/min [2025-10-22T22:07:59.355639] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:07:59.616342] [DEBUG] [LOCAL ] ECL: Loaded 46689 existing records from primary storage. [2025-10-22T22:07:59.616805] [DEBUG] [LOCAL ] ECO: Loaded 18017 existing records from primary storage. [2025-10-22T22:07:59.617061] [INFO ] [MAIN ] ECL: Loaded 46689 primary data records. [2025-10-22T22:07:59.617272] [INFO ] [MAIN ] ECO: Loaded 18017 primary data records. [2025-10-22T22:08:00.254374] [DEBUG] [MAIN ] ECG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:00.255412] [INFO ] [MAIN ] ECG: Generated 1794 derivative records from 32780 primary records. [2025-10-22T22:08:00.255887] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-10-22T22:08:00.273076] [DEBUG] [LOCAL ] ECG: Derivative data saved (1794 records). [2025-10-22T22:08:00.273892] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-10-22T22:08:00.276198] [INFO ] [MAIN ] Derivative Progress: 538/2052 symbols completed. ECG took 1.1s. Estimated remaining: 9m 32s. Rate: 158.8 symbols/min [2025-10-22T22:08:00.293824] [DEBUG] [MAIN ] ECO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:00.294446] [INFO ] [MAIN ] ECO: Generated 1794 derivative records from 18017 primary records. [2025-10-22T22:08:00.294583] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-22T22:08:00.325186] [DEBUG] [MAIN ] ECL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:00.325599] [DEBUG] [LOCAL ] ECO: Derivative data saved (1794 records). [2025-10-22T22:08:00.326296] [INFO ] [MAIN ] ECL: Generated 1794 derivative records from 46689 primary records. [2025-10-22T22:08:00.326456] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-10-22T22:08:00.326503] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-22T22:08:00.328508] [INFO ] [MAIN ] Derivative Progress: 539/2052 symbols completed. ECO took 1.0s. Estimated remaining: 9m 31s. Rate: 159.0 symbols/min [2025-10-22T22:08:00.343752] [DEBUG] [LOCAL ] ECL: Derivative data saved (1794 records). [2025-10-22T22:08:00.343810] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-10-22T22:08:00.346445] [INFO ] [MAIN ] Derivative Progress: 540/2052 symbols completed. ECL took 1.1s. Estimated remaining: 9m 29s. Rate: 159.3 symbols/min [2025-10-22T22:08:00.346795] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:00.346845] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:00.347147] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:00.381981] [DEBUG] [LOCAL ] EDD: Loaded 27270 existing records from primary storage. [2025-10-22T22:08:00.382112] [INFO ] [MAIN ] EDD: Loaded 27270 primary data records. [2025-10-22T22:08:00.560227] [DEBUG] [LOCAL ] ED: Loaded 52572 existing records from primary storage. [2025-10-22T22:08:00.538834] [DEBUG] [LOCAL ] ECVT: Loaded 43112 existing records from primary storage. [2025-10-22T22:08:00.580989] [INFO ] [MAIN ] ED: Loaded 52572 primary data records. [2025-10-22T22:08:00.572503] [INFO ] [MAIN ] ECVT: Loaded 43112 primary data records. [2025-10-22T22:08:01.391716] [DEBUG] [MAIN ] EDD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:01.393723] [INFO ] [MAIN ] EDD: Generated 1794 derivative records from 27270 primary records. [2025-10-22T22:08:01.393921] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-10-22T22:08:01.416007] [DEBUG] [LOCAL ] EDD: Derivative data saved (1794 records). [2025-10-22T22:08:01.416280] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-10-22T22:08:01.418452] [INFO ] [MAIN ] Derivative Progress: 541/2052 symbols completed. EDD took 1.1s. Estimated remaining: 9m 31s. Rate: 158.8 symbols/min [2025-10-22T22:08:01.419177] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:01.435707] [DEBUG] [MAIN ] ED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:01.438541] [INFO ] [MAIN ] ED: Generated 1794 derivative records from 52572 primary records. [2025-10-22T22:08:01.438804] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-10-22T22:08:01.454278] [DEBUG] [MAIN ] ECVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:01.466248] [INFO ] [MAIN ] ECVT: Generated 1794 derivative records from 43112 primary records. [2025-10-22T22:08:01.467376] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-10-22T22:08:01.475171] [DEBUG] [LOCAL ] ED: Derivative data saved (1794 records). [2025-10-22T22:08:01.475340] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-10-22T22:08:01.480684] [INFO ] [MAIN ] Derivative Progress: 542/2052 symbols completed. ED took 1.1s. Estimated remaining: 9m 30s. Rate: 159.0 symbols/min [2025-10-22T22:08:01.480835] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:01.493384] [DEBUG] [LOCAL ] EDF: Loaded 12838 existing records from primary storage. [2025-10-22T22:08:01.494945] [INFO ] [MAIN ] EDF: Loaded 12838 primary data records. [2025-10-22T22:08:01.568985] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1794 records). [2025-10-22T22:08:01.591234] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-10-22T22:08:01.611704] [INFO ] [MAIN ] Derivative Progress: 543/2052 symbols completed. ECVT took 1.3s. Estimated remaining: 9m 29s. Rate: 159.2 symbols/min [2025-10-22T22:08:01.615460] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:01.672854] [DEBUG] [LOCAL ] EDN: Loaded 19304 existing records from primary storage. [2025-10-22T22:08:01.701728] [INFO ] [MAIN ] EDN: Loaded 19304 primary data records. [2025-10-22T22:08:02.176543] [DEBUG] [LOCAL ] EDU: Loaded 44813 existing records from primary storage. [2025-10-22T22:08:02.176902] [INFO ] [MAIN ] EDU: Loaded 44813 primary data records. [2025-10-22T22:08:02.323924] [DEBUG] [MAIN ] EDF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:02.330869] [INFO ] [MAIN ] EDF: Generated 1794 derivative records from 12838 primary records. [2025-10-22T22:08:02.331107] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-10-22T22:08:02.420807] [DEBUG] [LOCAL ] EDF: Derivative data saved (1794 records). [2025-10-22T22:08:02.544984] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-10-22T22:08:02.560944] [INFO ] [MAIN ] Derivative Progress: 544/2052 symbols completed. EDF took 1.1s. Estimated remaining: 9m 30s. Rate: 158.8 symbols/min [2025-10-22T22:08:02.561909] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:02.581347] [DEBUG] [MAIN ] EDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:02.582299] [INFO ] [MAIN ] EDN: Generated 1794 derivative records from 19304 primary records. [2025-10-22T22:08:02.582725] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-22T22:08:02.599940] [DEBUG] [LOCAL ] EDN: Derivative data saved (1794 records). [2025-10-22T22:08:02.608348] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-22T22:08:02.610695] [INFO ] [MAIN ] Derivative Progress: 545/2052 symbols completed. EDN took 1.1s. Estimated remaining: 9m 29s. Rate: 159.0 symbols/min [2025-10-22T22:08:02.611026] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:02.624974] [DEBUG] [LOCAL ] EE: Loaded 32539 existing records from primary storage. [2025-10-22T22:08:02.625257] [INFO ] [MAIN ] EE: Loaded 32539 primary data records. [2025-10-22T22:08:02.711738] [DEBUG] [LOCAL ] EEX: Loaded 9811 existing records from primary storage. [2025-10-22T22:08:02.738259] [INFO ] [MAIN ] EEX: Loaded 9811 primary data records. [2025-10-22T22:08:02.782283] [DEBUG] [MAIN ] EDU: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:08:02.821843] [INFO ] [MAIN ] EDU: Generated 1793 derivative records from 44813 primary records. [2025-10-22T22:08:02.843933] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-22T22:08:03.119501] [DEBUG] [LOCAL ] EDU: Derivative data saved (1793 records). [2025-10-22T22:08:03.146006] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-10-22T22:08:03.154473] [INFO ] [MAIN ] Derivative Progress: 546/2052 symbols completed. EDU took 1.5s. Estimated remaining: 9m 29s. Rate: 158.9 symbols/min [2025-10-22T22:08:03.154791] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:03.337332] [DEBUG] [MAIN ] EE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:03.338058] [INFO ] [MAIN ] EE: Generated 1794 derivative records from 32539 primary records. [2025-10-22T22:08:03.338138] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-10-22T22:08:03.352985] [DEBUG] [MAIN ] EEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:03.361107] [INFO ] [MAIN ] EEX: Generated 1794 derivative records from 9811 primary records. [2025-10-22T22:08:03.376401] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-10-22T22:08:03.382099] [DEBUG] [LOCAL ] EE: Derivative data saved (1794 records). [2025-10-22T22:08:03.382629] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-10-22T22:08:03.384864] [INFO ] [MAIN ] Derivative Progress: 547/2052 symbols completed. EE took 0.8s. Estimated remaining: 9m 28s. Rate: 159.0 symbols/min [2025-10-22T22:08:03.385687] [DEBUG] [LOCAL ] EFC: Loaded 46280 existing records from primary storage. [2025-10-22T22:08:03.397995] [INFO ] [MAIN ] EFC: Loaded 46280 primary data records. [2025-10-22T22:08:03.393390] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:03.422341] [DEBUG] [LOCAL ] EEX: Derivative data saved (1794 records). [2025-10-22T22:08:03.437923] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-10-22T22:08:03.440536] [INFO ] [MAIN ] Derivative Progress: 548/2052 symbols completed. EEX took 0.8s. Estimated remaining: 9m 27s. Rate: 159.3 symbols/min [2025-10-22T22:08:03.467868] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:03.586898] [DEBUG] [LOCAL ] EFR: Loaded 15025 existing records from primary storage. [2025-10-22T22:08:03.591496] [INFO ] [MAIN ] EFR: Loaded 15025 primary data records. [2025-10-22T22:08:03.878103] [DEBUG] [LOCAL ] EFXT: Loaded 29466 existing records from primary storage. [2025-10-22T22:08:03.896937] [INFO ] [MAIN ] EFXT: Loaded 29466 primary data records. [2025-10-22T22:08:04.338416] [DEBUG] [MAIN ] EFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:04.340193] [INFO ] [MAIN ] EFC: Generated 1794 derivative records from 46280 primary records. [2025-10-22T22:08:04.340401] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-10-22T22:08:04.361701] [DEBUG] [LOCAL ] EFC: Derivative data saved (1794 records). [2025-10-22T22:08:04.362220] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-10-22T22:08:04.364384] [INFO ] [MAIN ] Derivative Progress: 549/2052 symbols completed. EFC took 1.2s. Estimated remaining: 9m 28s. Rate: 158.8 symbols/min [2025-10-22T22:08:04.372243] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:04.378194] [DEBUG] [MAIN ] EFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:04.378983] [INFO ] [MAIN ] EFR: Generated 1794 derivative records from 15025 primary records. [2025-10-22T22:08:04.379146] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-22T22:08:04.395351] [DEBUG] [LOCAL ] EFR: Derivative data saved (1794 records). [2025-10-22T22:08:04.395539] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-10-22T22:08:04.397861] [INFO ] [MAIN ] Derivative Progress: 550/2052 symbols completed. EFR took 1.0s. Estimated remaining: 9m 26s. Rate: 159.1 symbols/min [2025-10-22T22:08:04.398232] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:04.422403] [DEBUG] [MAIN ] EFXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:04.423121] [INFO ] [MAIN ] EFXT: Generated 1794 derivative records from 29466 primary records. [2025-10-22T22:08:04.423341] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-10-22T22:08:04.448209] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1794 records). [2025-10-22T22:08:04.448740] [DEBUG] [LOCAL ] EG: Loaded 27544 existing records from primary storage. [2025-10-22T22:08:04.449028] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-10-22T22:08:04.451863] [INFO ] [MAIN ] Derivative Progress: 551/2052 symbols completed. EFXT took 1.0s. Estimated remaining: 9m 25s. Rate: 159.4 symbols/min [2025-10-22T22:08:04.452095] [INFO ] [MAIN ] EG: Loaded 27544 primary data records. [2025-10-22T22:08:04.452435] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:04.664925] [DEBUG] [LOCAL ] EGO: Loaded 51739 existing records from primary storage. [2025-10-22T22:08:04.668963] [INFO ] [MAIN ] EGO: Loaded 51739 primary data records. [2025-10-22T22:08:04.791436] [DEBUG] [LOCAL ] EGP: Loaded 30227 existing records from primary storage. [2025-10-22T22:08:04.863200] [INFO ] [MAIN ] EGP: Loaded 30227 primary data records. [2025-10-22T22:08:05.453558] [DEBUG] [MAIN ] EG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:05.455593] [INFO ] [MAIN ] EG: Generated 1794 derivative records from 27544 primary records. [2025-10-22T22:08:05.455912] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-10-22T22:08:05.473997] [DEBUG] [LOCAL ] EG: Derivative data saved (1794 records). [2025-10-22T22:08:05.474393] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-10-22T22:08:05.476396] [INFO ] [MAIN ] Derivative Progress: 552/2052 symbols completed. EG took 1.1s. Estimated remaining: 9m 27s. Rate: 158.9 symbols/min [2025-10-22T22:08:05.476693] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:05.507056] [DEBUG] [MAIN ] EGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:05.507299] [DEBUG] [MAIN ] EGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:05.508117] [INFO ] [MAIN ] EGP: Generated 1794 derivative records from 30227 primary records. [2025-10-22T22:08:05.508331] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-10-22T22:08:05.509524] [INFO ] [MAIN ] EGO: Generated 1794 derivative records from 51739 primary records. [2025-10-22T22:08:05.517026] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-10-22T22:08:05.526760] [DEBUG] [LOCAL ] EGP: Derivative data saved (1794 records). [2025-10-22T22:08:05.546012] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-10-22T22:08:05.552666] [DEBUG] [LOCAL ] EGO: Derivative data saved (1794 records). [2025-10-22T22:08:05.552766] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-10-22T22:08:05.552266] [INFO ] [MAIN ] Derivative Progress: 553/2052 symbols completed. EGP took 1.1s. Estimated remaining: 9m 25s. Rate: 159.1 symbols/min [2025-10-22T22:08:05.555296] [INFO ] [MAIN ] Derivative Progress: 554/2052 symbols completed. EGO took 1.2s. Estimated remaining: 9m 24s. Rate: 159.4 symbols/min [2025-10-22T22:08:05.570323] [DEBUG] [LOCAL ] EGY: Loaded 41231 existing records from primary storage. [2025-10-22T22:08:05.570436] [INFO ] [MAIN ] EGY: Loaded 41231 primary data records. [2025-10-22T22:08:05.872015] [DEBUG] [MAIN ] EGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:05.872615] [INFO ] [MAIN ] EGY: Generated 1794 derivative records from 41231 primary records. [2025-10-22T22:08:05.872705] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-10-22T22:08:05.887454] [DEBUG] [LOCAL ] EGY: Derivative data saved (1794 records). [2025-10-22T22:08:05.887546] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-10-22T22:08:05.889745] [INFO ] [MAIN ] Derivative Progress: 555/2052 symbols completed. EGY took 0.4s. Estimated remaining: 9m 23s. Rate: 159.4 symbols/min [2025-10-22T22:08:05.890254] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:05.890351] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:05.890196] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:05.902408] [DEBUG] [LOCAL ] EHI: Loaded 10532 existing records from primary storage. [2025-10-22T22:08:05.902618] [INFO ] [MAIN ] EHI: Loaded 10532 primary data records. [2025-10-22T22:08:06.036819] [DEBUG] [LOCAL ] EHAB: Loaded 29342 existing records from primary storage. [2025-10-22T22:08:06.092553] [INFO ] [MAIN ] EHAB: Loaded 29342 primary data records. [2025-10-22T22:08:06.319803] [DEBUG] [LOCAL ] EHC: Loaded 40923 existing records from primary storage. [2025-10-22T22:08:06.342543] [INFO ] [MAIN ] EHC: Loaded 40923 primary data records. [2025-10-22T22:08:06.924036] [DEBUG] [MAIN ] EHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:06.926830] [INFO ] [MAIN ] EHI: Generated 1794 derivative records from 10532 primary records. [2025-10-22T22:08:06.927758] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-10-22T22:08:06.947549] [DEBUG] [MAIN ] EHAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:06.955067] [INFO ] [MAIN ] EHAB: Generated 1794 derivative records from 29342 primary records. [2025-10-22T22:08:06.955834] [DEBUG] [LOCAL ] EHI: Derivative data saved (1794 records). [2025-10-22T22:08:06.955931] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-10-22T22:08:06.958454] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-10-22T22:08:06.958219] [INFO ] [MAIN ] Derivative Progress: 556/2052 symbols completed. EHI took 1.1s. Estimated remaining: 9m 25s. Rate: 158.9 symbols/min [2025-10-22T22:08:06.959487] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:06.975659] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1794 records). [2025-10-22T22:08:06.975910] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-10-22T22:08:06.978357] [INFO ] [MAIN ] Derivative Progress: 557/2052 symbols completed. EHAB took 1.1s. Estimated remaining: 9m 24s. Rate: 159.2 symbols/min [2025-10-22T22:08:06.980229] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:07.002134] [DEBUG] [MAIN ] EHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:07.003062] [INFO ] [MAIN ] EHC: Generated 1794 derivative records from 40923 primary records. [2025-10-22T22:08:07.003263] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-10-22T22:08:07.011551] [DEBUG] [LOCAL ] EIC: Loaded 22441 existing records from primary storage. [2025-10-22T22:08:07.011896] [INFO ] [MAIN ] EIC: Loaded 22441 primary data records. [2025-10-22T22:08:07.106480] [DEBUG] [LOCAL ] EIG: Loaded 20065 existing records from primary storage. [2025-10-22T22:08:07.114389] [INFO ] [MAIN ] EIG: Loaded 20065 primary data records. [2025-10-22T22:08:07.120519] [DEBUG] [LOCAL ] EHC: Derivative data saved (1794 records). [2025-10-22T22:08:07.131391] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-10-22T22:08:07.162764] [INFO ] [MAIN ] Derivative Progress: 558/2052 symbols completed. EHC took 1.3s. Estimated remaining: 9m 23s. Rate: 159.3 symbols/min [2025-10-22T22:08:07.188435] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:07.684677] [DEBUG] [LOCAL ] EIX: Loaded 53348 existing records from primary storage. [2025-10-22T22:08:07.685311] [INFO ] [MAIN ] EIX: Loaded 53348 primary data records. [2025-10-22T22:08:07.885985] [DEBUG] [MAIN ] EIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:07.994046] [INFO ] [MAIN ] EIC: Generated 1794 derivative records from 22441 primary records. [2025-10-22T22:08:08.014296] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-10-22T22:08:08.014886] [DEBUG] [MAIN ] EIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:08.016778] [INFO ] [MAIN ] EIG: Generated 1794 derivative records from 20065 primary records. [2025-10-22T22:08:08.017171] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-22T22:08:08.044094] [DEBUG] [LOCAL ] EIG: Derivative data saved (1794 records). [2025-10-22T22:08:08.048423] [DEBUG] [LOCAL ] EIC: Derivative data saved (1794 records). [2025-10-22T22:08:08.048520] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-10-22T22:08:08.048583] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-10-22T22:08:08.051356] [INFO ] [MAIN ] Derivative Progress: 559/2052 symbols completed. EIG took 1.1s. Estimated remaining: 9m 24s. Rate: 158.9 symbols/min [2025-10-22T22:08:08.051498] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:08.054415] [INFO ] [MAIN ] Derivative Progress: 560/2052 symbols completed. EIC took 1.1s. Estimated remaining: 9m 22s. Rate: 159.2 symbols/min [2025-10-22T22:08:08.054668] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:08.078090] [DEBUG] [MAIN ] EIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:08.078768] [INFO ] [MAIN ] EIX: Generated 1794 derivative records from 53348 primary records. [2025-10-22T22:08:08.078951] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-10-22T22:08:08.107440] [DEBUG] [LOCAL ] EIX: Derivative data saved (1794 records). [2025-10-22T22:08:08.120108] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-10-22T22:08:08.122312] [INFO ] [MAIN ] Derivative Progress: 561/2052 symbols completed. EIX took 0.9s. Estimated remaining: 9m 21s. Rate: 159.4 symbols/min [2025-10-22T22:08:08.122638] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:08.140795] [DEBUG] [LOCAL ] EL: Loaded 53385 existing records from primary storage. [2025-10-22T22:08:08.143359] [DEBUG] [LOCAL ] ELC: Loaded 3431 existing records from primary storage. [2025-10-22T22:08:08.141022] [INFO ] [MAIN ] EL: Loaded 53385 primary data records. [2025-10-22T22:08:08.144107] [INFO ] [MAIN ] ELC: Loaded 3431 primary data records. [2025-10-22T22:08:08.338762] [DEBUG] [LOCAL ] ELAN: Loaded 53314 existing records from primary storage. [2025-10-22T22:08:08.347523] [INFO ] [MAIN ] ELAN: Loaded 53314 primary data records. [2025-10-22T22:08:09.144276] [DEBUG] [MAIN ] EL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:09.148031] [INFO ] [MAIN ] EL: Generated 1794 derivative records from 53385 primary records. [2025-10-22T22:08:09.148912] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-10-22T22:08:09.187674] [DEBUG] [LOCAL ] EL: Derivative data saved (1794 records). [2025-10-22T22:08:09.187876] [DEBUG] [MAIN ] ELAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:09.192873] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-10-22T22:08:09.194072] [INFO ] [MAIN ] ELAN: Generated 1794 derivative records from 53314 primary records. [2025-10-22T22:08:09.194165] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-22T22:08:09.195289] [DEBUG] [MAIN ] ELC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:09.197536] [INFO ] [MAIN ] Derivative Progress: 562/2052 symbols completed. EL took 1.1s. Estimated remaining: 9m 23s. Rate: 158.9 symbols/min [2025-10-22T22:08:09.199028] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:09.198836] [INFO ] [MAIN ] ELC: Generated 1794 derivative records from 3431 primary records. [2025-10-22T22:08:09.212710] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-10-22T22:08:09.215526] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1794 records). [2025-10-22T22:08:09.215911] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-10-22T22:08:09.219115] [INFO ] [MAIN ] Derivative Progress: 563/2052 symbols completed. ELAN took 1.2s. Estimated remaining: 9m 21s. Rate: 159.2 symbols/min [2025-10-22T22:08:09.219961] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:09.237756] [DEBUG] [LOCAL ] ELC: Derivative data saved (1794 records). [2025-10-22T22:08:09.238007] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-10-22T22:08:09.241718] [INFO ] [MAIN ] Derivative Progress: 564/2052 symbols completed. ELC took 1.1s. Estimated remaining: 9m 20s. Rate: 159.4 symbols/min [2025-10-22T22:08:09.242049] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:09.259550] [DEBUG] [LOCAL ] EMF: Loaded 3081 existing records from primary storage. [2025-10-22T22:08:09.266483] [INFO ] [MAIN ] EMF: Loaded 3081 primary data records. [2025-10-22T22:08:09.363133] [DEBUG] [LOCAL ] EME: Loaded 30650 existing records from primary storage. [2025-10-22T22:08:09.377169] [DEBUG] [LOCAL ] ELME: Loaded 39292 existing records from primary storage. [2025-10-22T22:08:09.375993] [INFO ] [MAIN ] EME: Loaded 30650 primary data records. [2025-10-22T22:08:09.390275] [INFO ] [MAIN ] ELME: Loaded 39292 primary data records. [2025-10-22T22:08:10.254532] [DEBUG] [MAIN ] EMF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:10.255693] [INFO ] [MAIN ] EMF: Generated 1794 derivative records from 3081 primary records. [2025-10-22T22:08:10.257512] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-22T22:08:10.289849] [DEBUG] [MAIN ] ELME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:10.290707] [INFO ] [MAIN ] ELME: Generated 1794 derivative records from 39292 primary records. [2025-10-22T22:08:10.290818] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-10-22T22:08:10.289466] [DEBUG] [LOCAL ] EMF: Derivative data saved (1794 records). [2025-10-22T22:08:10.292821] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-10-22T22:08:10.304287] [INFO ] [MAIN ] Derivative Progress: 565/2052 symbols completed. EMF took 1.1s. Estimated remaining: 9m 21s. Rate: 158.9 symbols/min [2025-10-22T22:08:10.310738] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:10.313486] [DEBUG] [LOCAL ] ELME: Derivative data saved (1794 records). [2025-10-22T22:08:10.313602] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-10-22T22:08:10.316447] [INFO ] [MAIN ] Derivative Progress: 566/2052 symbols completed. ELME took 1.1s. Estimated remaining: 9m 20s. Rate: 159.2 symbols/min [2025-10-22T22:08:10.316935] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:10.329941] [DEBUG] [MAIN ] EME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:10.330981] [INFO ] [MAIN ] EME: Generated 1794 derivative records from 30650 primary records. [2025-10-22T22:08:10.331900] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-10-22T22:08:10.343267] [DEBUG] [LOCAL ] EMP: Loaded 2888 existing records from primary storage. [2025-10-22T22:08:10.351107] [DEBUG] [LOCAL ] EME: Derivative data saved (1794 records). [2025-10-22T22:08:10.351245] [INFO ] [MAIN ] EMP: Loaded 2888 primary data records. [2025-10-22T22:08:10.362663] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-10-22T22:08:10.384316] [INFO ] [MAIN ] Derivative Progress: 567/2052 symbols completed. EME took 1.2s. Estimated remaining: 9m 19s. Rate: 159.4 symbols/min [2025-10-22T22:08:10.389682] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:10.699202] [DEBUG] [LOCAL ] ENIC: Loaded 36415 existing records from primary storage. [2025-10-22T22:08:10.702795] [INFO ] [MAIN ] ENIC: Loaded 36415 primary data records. [2025-10-22T22:08:10.702704] [DEBUG] [LOCAL ] ENB: Loaded 53511 existing records from primary storage. [2025-10-22T22:08:10.714596] [INFO ] [MAIN ] ENB: Loaded 53511 primary data records. [2025-10-22T22:08:11.345681] [DEBUG] [MAIN ] EMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:11.346694] [INFO ] [MAIN ] EMP: Generated 1794 derivative records from 2888 primary records. [2025-10-22T22:08:11.348275] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-10-22T22:08:11.365974] [DEBUG] [LOCAL ] EMP: Derivative data saved (1794 records). [2025-10-22T22:08:11.366204] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-10-22T22:08:11.368679] [INFO ] [MAIN ] Derivative Progress: 568/2052 symbols completed. EMP took 1.1s. Estimated remaining: 9m 20s. Rate: 159.0 symbols/min [2025-10-22T22:08:11.407151] [DEBUG] [MAIN ] ENIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:11.406925] [DEBUG] [MAIN ] ENB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:11.408103] [INFO ] [MAIN ] ENIC: Generated 1794 derivative records from 36415 primary records. [2025-10-22T22:08:11.409016] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-10-22T22:08:11.408910] [INFO ] [MAIN ] ENB: Generated 1794 derivative records from 53511 primary records. [2025-10-22T22:08:11.409818] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-10-22T22:08:11.438159] [DEBUG] [LOCAL ] ENB: Derivative data saved (1794 records). [2025-10-22T22:08:11.440619] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-10-22T22:08:11.440548] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1794 records). [2025-10-22T22:08:11.442758] [INFO ] [MAIN ] Derivative Progress: 569/2052 symbols completed. ENB took 1.1s. Estimated remaining: 9m 19s. Rate: 159.2 symbols/min [2025-10-22T22:08:11.442980] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-10-22T22:08:11.445154] [INFO ] [MAIN ] Derivative Progress: 570/2052 symbols completed. ENIC took 1.1s. Estimated remaining: 9m 18s. Rate: 159.5 symbols/min [2025-10-22T22:08:11.445516] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:11.445844] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:11.445953] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:11.450042] [DEBUG] [LOCAL ] ENO: Loaded 1737 existing records from primary storage. [2025-10-22T22:08:11.450173] [INFO ] [MAIN ] ENO: Loaded 1737 primary data records. [2025-10-22T22:08:11.651005] [DEBUG] [LOCAL ] ENVA: Loaded 25234 existing records from primary storage. [2025-10-22T22:08:11.692686] [INFO ] [MAIN ] ENVA: Loaded 25234 primary data records. [2025-10-22T22:08:11.848408] [DEBUG] [LOCAL ] ENR: Loaded 43819 existing records from primary storage. [2025-10-22T22:08:11.865862] [INFO ] [MAIN ] ENR: Loaded 43819 primary data records. [2025-10-22T22:08:12.388881] [DEBUG] [MAIN ] ENO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:12.389610] [INFO ] [MAIN ] ENO: Generated 1794 derivative records from 1737 primary records. [2025-10-22T22:08:12.391818] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-10-22T22:08:12.408482] [DEBUG] [LOCAL ] ENO: Derivative data saved (1794 records). [2025-10-22T22:08:12.408955] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-10-22T22:08:12.411151] [INFO ] [MAIN ] Derivative Progress: 571/2052 symbols completed. ENO took 1.0s. Estimated remaining: 9m 19s. Rate: 159.0 symbols/min [2025-10-22T22:08:12.411488] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:12.429962] [DEBUG] [MAIN ] ENVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:12.442762] [INFO ] [MAIN ] ENVA: Generated 1794 derivative records from 25234 primary records. [2025-10-22T22:08:12.443087] [DEBUG] [MAIN ] ENR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:12.443773] [INFO ] [MAIN ] ENR: Generated 1794 derivative records from 43819 primary records. [2025-10-22T22:08:12.443910] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-22T22:08:12.443201] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-22T22:08:12.462048] [DEBUG] [LOCAL ] ENR: Derivative data saved (1794 records). [2025-10-22T22:08:12.469115] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-10-22T22:08:12.474668] [INFO ] [MAIN ] Derivative Progress: 572/2052 symbols completed. ENR took 1.0s. Estimated remaining: 9m 18s. Rate: 159.3 symbols/min [2025-10-22T22:08:12.474887] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:12.479558] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1794 records). [2025-10-22T22:08:12.479790] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-10-22T22:08:12.485456] [INFO ] [MAIN ] Derivative Progress: 573/2052 symbols completed. ENVA took 1.0s. Estimated remaining: 9m 16s. Rate: 159.5 symbols/min [2025-10-22T22:08:12.498286] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:12.503899] [DEBUG] [LOCAL ] EOI: Loaded 10436 existing records from primary storage. [2025-10-22T22:08:12.504130] [INFO ] [MAIN ] EOI: Loaded 10436 primary data records. [2025-10-22T22:08:12.641760] [DEBUG] [LOCAL ] EOS: Loaded 14668 existing records from primary storage. [2025-10-22T22:08:12.645800] [INFO ] [MAIN ] EOS: Loaded 14668 primary data records. [2025-10-22T22:08:12.647228] [DEBUG] [LOCAL ] EOG: Loaded 53390 existing records from primary storage. [2025-10-22T22:08:12.652589] [INFO ] [MAIN ] EOG: Loaded 53390 primary data records. [2025-10-22T22:08:13.477973] [DEBUG] [MAIN ] EOI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:13.479058] [INFO ] [MAIN ] EOI: Generated 1794 derivative records from 10436 primary records. [2025-10-22T22:08:13.479332] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-22T22:08:13.497175] [DEBUG] [LOCAL ] EOI: Derivative data saved (1794 records). [2025-10-22T22:08:13.497531] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-10-22T22:08:13.499749] [INFO ] [MAIN ] Derivative Progress: 574/2052 symbols completed. EOI took 1.0s. Estimated remaining: 9m 17s. Rate: 159.1 symbols/min [2025-10-22T22:08:13.501913] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:13.525795] [DEBUG] [MAIN ] EOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:13.531811] [INFO ] [MAIN ] EOS: Generated 1794 derivative records from 14668 primary records. [2025-10-22T22:08:13.531037] [DEBUG] [MAIN ] EOG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:13.532604] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-10-22T22:08:13.532456] [INFO ] [MAIN ] EOG: Generated 1794 derivative records from 53390 primary records. [2025-10-22T22:08:13.533385] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-22T22:08:13.565710] [DEBUG] [LOCAL ] EOS: Derivative data saved (1794 records). [2025-10-22T22:08:13.563996] [DEBUG] [LOCAL ] EOG: Derivative data saved (1794 records). [2025-10-22T22:08:13.565972] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-22T22:08:13.568447] [INFO ] [MAIN ] Derivative Progress: 575/2052 symbols completed. EOG took 1.2s. Estimated remaining: 9m 16s. Rate: 159.3 symbols/min [2025-10-22T22:08:13.568589] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-10-22T22:08:13.571161] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:13.571271] [INFO ] [MAIN ] Derivative Progress: 576/2052 symbols completed. EOS took 1.1s. Estimated remaining: 9m 15s. Rate: 159.6 symbols/min [2025-10-22T22:08:13.571557] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:13.613524] [DEBUG] [LOCAL ] EPAM: Loaded 39328 existing records from primary storage. [2025-10-22T22:08:13.613743] [INFO ] [MAIN ] EPAM: Loaded 39328 primary data records. [2025-10-22T22:08:13.727492] [DEBUG] [LOCAL ] EPC: Loaded 39741 existing records from primary storage. [2025-10-22T22:08:13.744391] [INFO ] [MAIN ] EPC: Loaded 39741 primary data records. [2025-10-22T22:08:14.055861] [DEBUG] [LOCAL ] EPD: Loaded 53608 existing records from primary storage. [2025-10-22T22:08:14.056395] [INFO ] [MAIN ] EPD: Loaded 53608 primary data records. [2025-10-22T22:08:14.616609] [DEBUG] [MAIN ] EPAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:14.619340] [INFO ] [MAIN ] EPAM: Generated 1794 derivative records from 39328 primary records. [2025-10-22T22:08:14.619539] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-10-22T22:08:14.644943] [DEBUG] [MAIN ] EPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:14.645804] [INFO ] [MAIN ] EPC: Generated 1794 derivative records from 39741 primary records. [2025-10-22T22:08:14.647939] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-10-22T22:08:14.651757] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1794 records). [2025-10-22T22:08:14.652119] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-10-22T22:08:14.654973] [INFO ] [MAIN ] Derivative Progress: 577/2052 symbols completed. EPAM took 1.2s. Estimated remaining: 9m 16s. Rate: 159.1 symbols/min [2025-10-22T22:08:14.655967] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:14.678973] [DEBUG] [LOCAL ] EPC: Derivative data saved (1794 records). [2025-10-22T22:08:14.679102] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-10-22T22:08:14.686668] [INFO ] [MAIN ] Derivative Progress: 578/2052 symbols completed. EPC took 1.1s. Estimated remaining: 9m 15s. Rate: 159.3 symbols/min [2025-10-22T22:08:14.684264] [DEBUG] [MAIN ] EPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:14.686880] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:14.687770] [INFO ] [MAIN ] EPD: Generated 1794 derivative records from 53608 primary records. [2025-10-22T22:08:14.688064] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-10-22T22:08:14.704625] [DEBUG] [LOCAL ] EPD: Derivative data saved (1794 records). [2025-10-22T22:08:14.704932] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-10-22T22:08:14.707508] [INFO ] [MAIN ] Derivative Progress: 579/2052 symbols completed. EPD took 1.1s. Estimated remaining: 9m 14s. Rate: 159.6 symbols/min [2025-10-22T22:08:14.707933] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:14.730670] [DEBUG] [LOCAL ] EQBK: Loaded 11303 existing records from primary storage. [2025-10-22T22:08:14.740195] [INFO ] [MAIN ] EQBK: Loaded 11303 primary data records. [2025-10-22T22:08:14.830920] [DEBUG] [LOCAL ] EPR: Loaded 43707 existing records from primary storage. [2025-10-22T22:08:14.860208] [INFO ] [MAIN ] EPR: Loaded 43707 primary data records. [2025-10-22T22:08:14.871897] [DEBUG] [LOCAL ] EPRT: Loaded 48479 existing records from primary storage. [2025-10-22T22:08:14.872120] [INFO ] [MAIN ] EPRT: Loaded 48479 primary data records. [2025-10-22T22:08:15.722336] [DEBUG] [MAIN ] EQBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:15.722781] [DEBUG] [MAIN ] EPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:15.724213] [INFO ] [MAIN ] EPR: Generated 1794 derivative records from 43707 primary records. [2025-10-22T22:08:15.723441] [INFO ] [MAIN ] EQBK: Generated 1794 derivative records from 11303 primary records. [2025-10-22T22:08:15.724321] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-10-22T22:08:15.725224] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-10-22T22:08:15.752611] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1794 records). [2025-10-22T22:08:15.756735] [DEBUG] [LOCAL ] EPR: Derivative data saved (1794 records). [2025-10-22T22:08:15.757079] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-10-22T22:08:15.757014] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-10-22T22:08:15.760056] [INFO ] [MAIN ] Derivative Progress: 580/2052 symbols completed. EQBK took 1.1s. Estimated remaining: 9m 15s. Rate: 159.1 symbols/min [2025-10-22T22:08:15.763688] [INFO ] [MAIN ] Derivative Progress: 581/2052 symbols completed. EPR took 1.1s. Estimated remaining: 9m 14s. Rate: 159.3 symbols/min [2025-10-22T22:08:15.763562] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:15.764267] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:15.778695] [DEBUG] [MAIN ] EPRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:15.779281] [INFO ] [MAIN ] EPRT: Generated 1794 derivative records from 48479 primary records. [2025-10-22T22:08:15.779362] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-10-22T22:08:15.795639] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1794 records). [2025-10-22T22:08:15.796045] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-10-22T22:08:15.798365] [INFO ] [MAIN ] Derivative Progress: 582/2052 symbols completed. EPRT took 1.1s. Estimated remaining: 9m 13s. Rate: 159.6 symbols/min [2025-10-22T22:08:15.798702] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:15.862176] [DEBUG] [LOCAL ] EQNR: Loaded 53050 existing records from primary storage. [2025-10-22T22:08:15.876353] [INFO ] [MAIN ] EQNR: Loaded 53050 primary data records. [2025-10-22T22:08:15.882471] [DEBUG] [LOCAL ] EQH: Loaded 52699 existing records from primary storage. [2025-10-22T22:08:15.909018] [INFO ] [MAIN ] EQH: Loaded 52699 primary data records. [2025-10-22T22:08:16.073943] [DEBUG] [LOCAL ] EQR: Loaded 51810 existing records from primary storage. [2025-10-22T22:08:16.106074] [INFO ] [MAIN ] EQR: Loaded 51810 primary data records. [2025-10-22T22:08:16.859350] [DEBUG] [MAIN ] EQNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:16.872046] [INFO ] [MAIN ] EQNR: Generated 1794 derivative records from 53050 primary records. [2025-10-22T22:08:16.872525] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-10-22T22:08:16.872872] [DEBUG] [MAIN ] EQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:16.874384] [INFO ] [MAIN ] EQH: Generated 1794 derivative records from 52699 primary records. [2025-10-22T22:08:16.874662] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-10-22T22:08:16.897545] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1794 records). [2025-10-22T22:08:16.901541] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-10-22T22:08:16.903246] [INFO ] [MAIN ] Derivative Progress: 583/2052 symbols completed. EQNR took 1.1s. Estimated remaining: 9m 14s. Rate: 159.1 symbols/min [2025-10-22T22:08:16.909360] [DEBUG] [LOCAL ] EQH: Derivative data saved (1794 records). [2025-10-22T22:08:16.909533] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-10-22T22:08:16.912288] [INFO ] [MAIN ] Derivative Progress: 584/2052 symbols completed. EQH took 1.1s. Estimated remaining: 9m 13s. Rate: 159.3 symbols/min [2025-10-22T22:08:16.926894] [DEBUG] [MAIN ] EQR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:16.927442] [INFO ] [MAIN ] EQR: Generated 1794 derivative records from 51810 primary records. [2025-10-22T22:08:16.927525] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-22T22:08:16.942274] [DEBUG] [LOCAL ] EQR: Derivative data saved (1794 records). [2025-10-22T22:08:16.942329] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-10-22T22:08:16.944624] [INFO ] [MAIN ] Derivative Progress: 585/2052 symbols completed. EQR took 1.1s. Estimated remaining: 9m 12s. Rate: 159.6 symbols/min [2025-10-22T22:08:16.945167] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:16.945266] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:16.945043] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:16.953724] [DEBUG] [LOCAL ] EQV: Loaded 2702 existing records from primary storage. [2025-10-22T22:08:16.953988] [INFO ] [MAIN ] EQV: Loaded 2702 primary data records. [2025-10-22T22:08:17.271479] [DEBUG] [LOCAL ] ERJ: Loaded 50289 existing records from primary storage. [2025-10-22T22:08:17.320557] [INFO ] [MAIN ] ERJ: Loaded 50289 primary data records. [2025-10-22T22:08:17.321955] [DEBUG] [LOCAL ] EQT: Loaded 53685 existing records from primary storage. [2025-10-22T22:08:17.360591] [INFO ] [MAIN ] EQT: Loaded 53685 primary data records. [2025-10-22T22:08:17.947352] [DEBUG] [MAIN ] EQV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:17.948331] [INFO ] [MAIN ] EQV: Generated 1794 derivative records from 2702 primary records. [2025-10-22T22:08:17.948491] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-22T22:08:17.966747] [DEBUG] [LOCAL ] EQV: Derivative data saved (1794 records). [2025-10-22T22:08:17.979773] [DEBUG] [MAIN ] ERJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:17.979088] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-10-22T22:08:17.982738] [INFO ] [MAIN ] ERJ: Generated 1794 derivative records from 50289 primary records. [2025-10-22T22:08:17.983046] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-22T22:08:17.981956] [INFO ] [MAIN ] Derivative Progress: 586/2052 symbols completed. EQV took 1.0s. Estimated remaining: 9m 13s. Rate: 159.1 symbols/min [2025-10-22T22:08:17.984118] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:18.002117] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1794 records). [2025-10-22T22:08:18.002346] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-22T22:08:18.005142] [INFO ] [MAIN ] Derivative Progress: 587/2052 symbols completed. ERJ took 1.1s. Estimated remaining: 9m 12s. Rate: 159.4 symbols/min [2025-10-22T22:08:18.006092] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:18.020189] [DEBUG] [MAIN ] EQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:18.021067] [INFO ] [MAIN ] EQT: Generated 1794 derivative records from 53685 primary records. [2025-10-22T22:08:18.021254] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-22T22:08:18.050156] [DEBUG] [LOCAL ] EQT: Derivative data saved (1794 records). [2025-10-22T22:08:18.050519] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-10-22T22:08:18.053308] [INFO ] [MAIN ] Derivative Progress: 588/2052 symbols completed. EQT took 1.1s. Estimated remaining: 9m 10s. Rate: 159.6 symbols/min [2025-10-22T22:08:18.053723] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:18.068104] [DEBUG] [LOCAL ] ERO: Loaded 42159 existing records from primary storage. [2025-10-22T22:08:18.068300] [INFO ] [MAIN ] ERO: Loaded 42159 primary data records. [2025-10-22T22:08:18.387764] [DEBUG] [LOCAL ] ESAB: Loaded 25928 existing records from primary storage. [2025-10-22T22:08:18.402575] [INFO ] [MAIN ] ESAB: Loaded 25928 primary data records. [2025-10-22T22:08:18.402413] [DEBUG] [LOCAL ] ES: Loaded 52699 existing records from primary storage. [2025-10-22T22:08:18.402775] [INFO ] [MAIN ] ES: Loaded 52699 primary data records. [2025-10-22T22:08:19.117011] [DEBUG] [MAIN ] ERO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:19.118935] [INFO ] [MAIN ] ERO: Generated 1794 derivative records from 42159 primary records. [2025-10-22T22:08:19.119101] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-22T22:08:19.138568] [DEBUG] [LOCAL ] ERO: Derivative data saved (1794 records). [2025-10-22T22:08:19.139103] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-22T22:08:19.141304] [INFO ] [MAIN ] Derivative Progress: 589/2052 symbols completed. ERO took 1.2s. Estimated remaining: 9m 12s. Rate: 159.1 symbols/min [2025-10-22T22:08:19.141579] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:19.169372] [DEBUG] [MAIN ] ES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:19.178536] [INFO ] [MAIN ] ES: Generated 1794 derivative records from 52699 primary records. [2025-10-22T22:08:19.183329] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-10-22T22:08:19.190948] [DEBUG] [LOCAL ] ESE: Loaded 16465 existing records from primary storage. [2025-10-22T22:08:19.198089] [INFO ] [MAIN ] ESE: Loaded 16465 primary data records. [2025-10-22T22:08:19.217055] [DEBUG] [LOCAL ] ES: Derivative data saved (1794 records). [2025-10-22T22:08:19.190608] [DEBUG] [MAIN ] ESAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:19.217256] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-10-22T22:08:19.229721] [INFO ] [MAIN ] ESAB: Generated 1794 derivative records from 25928 primary records. [2025-10-22T22:08:19.239976] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-22T22:08:19.219399] [INFO ] [MAIN ] Derivative Progress: 590/2052 symbols completed. ES took 1.2s. Estimated remaining: 9m 11s. Rate: 159.3 symbols/min [2025-10-22T22:08:19.252880] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:19.316781] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1794 records). [2025-10-22T22:08:19.327456] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-22T22:08:19.330037] [INFO ] [MAIN ] Derivative Progress: 591/2052 symbols completed. ESAB took 1.3s. Estimated remaining: 9m 10s. Rate: 159.5 symbols/min [2025-10-22T22:08:19.330534] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:19.569122] [DEBUG] [LOCAL ] ESI: Loaded 50618 existing records from primary storage. [2025-10-22T22:08:19.569563] [INFO ] [MAIN ] ESI: Loaded 50618 primary data records. [2025-10-22T22:08:19.682301] [DEBUG] [LOCAL ] ESNT: Loaded 37977 existing records from primary storage. [2025-10-22T22:08:19.700695] [INFO ] [MAIN ] ESNT: Loaded 37977 primary data records. [2025-10-22T22:08:19.924820] [DEBUG] [MAIN ] ESE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:19.943500] [INFO ] [MAIN ] ESE: Generated 1794 derivative records from 16465 primary records. [2025-10-22T22:08:19.958166] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-22T22:08:20.007741] [DEBUG] [LOCAL ] ESE: Derivative data saved (1794 records). [2025-10-22T22:08:20.008984] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-22T22:08:20.026559] [INFO ] [MAIN ] Derivative Progress: 592/2052 symbols completed. ESE took 0.9s. Estimated remaining: 9m 10s. Rate: 159.3 symbols/min [2025-10-22T22:08:20.032240] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:20.237662] [DEBUG] [MAIN ] ESI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:20.238590] [INFO ] [MAIN ] ESI: Generated 1794 derivative records from 50618 primary records. [2025-10-22T22:08:20.239606] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-22T22:08:20.256590] [DEBUG] [LOCAL ] ESI: Derivative data saved (1794 records). [2025-10-22T22:08:20.256812] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-22T22:08:20.270235] [INFO ] [MAIN ] Derivative Progress: 593/2052 symbols completed. ESI took 1.0s. Estimated remaining: 9m 9s. Rate: 159.4 symbols/min [2025-10-22T22:08:20.271946] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:20.273890] [DEBUG] [LOCAL ] ESRT: Loaded 46546 existing records from primary storage. [2025-10-22T22:08:20.274120] [INFO ] [MAIN ] ESRT: Loaded 46546 primary data records. [2025-10-22T22:08:20.395607] [DEBUG] [MAIN ] ESNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:20.446039] [INFO ] [MAIN ] ESNT: Generated 1794 derivative records from 37977 primary records. [2025-10-22T22:08:20.473978] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-22T22:08:20.636058] [DEBUG] [LOCAL ] ESS: Loaded 30164 existing records from primary storage. [2025-10-22T22:08:20.636896] [INFO ] [MAIN ] ESS: Loaded 30164 primary data records. [2025-10-22T22:08:20.674242] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1794 records). [2025-10-22T22:08:20.734468] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-10-22T22:08:20.755758] [INFO ] [MAIN ] Derivative Progress: 594/2052 symbols completed. ESNT took 1.4s. Estimated remaining: 9m 9s. Rate: 159.3 symbols/min [2025-10-22T22:08:20.766382] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:21.043943] [DEBUG] [MAIN ] ESRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:21.045467] [INFO ] [MAIN ] ESRT: Generated 1794 derivative records from 46546 primary records. [2025-10-22T22:08:21.045553] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-22T22:08:21.063353] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1794 records). [2025-10-22T22:08:21.063632] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-22T22:08:21.065678] [INFO ] [MAIN ] Derivative Progress: 595/2052 symbols completed. ESRT took 1.0s. Estimated remaining: 9m 9s. Rate: 159.3 symbols/min [2025-10-22T22:08:21.067307] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:21.084344] [DEBUG] [LOCAL ] ESTC: Loaded 50253 existing records from primary storage. [2025-10-22T22:08:21.084737] [INFO ] [MAIN ] ESTC: Loaded 50253 primary data records. [2025-10-22T22:08:21.277847] [DEBUG] [MAIN ] ESS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:21.314004] [INFO ] [MAIN ] ESS: Generated 1794 derivative records from 30164 primary records. [2025-10-22T22:08:21.314288] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-22T22:08:21.473617] [DEBUG] [LOCAL ] ESS: Derivative data saved (1794 records). [2025-10-22T22:08:21.473914] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-22T22:08:21.476105] [INFO ] [MAIN ] Derivative Progress: 596/2052 symbols completed. ESS took 1.2s. Estimated remaining: 9m 8s. Rate: 159.3 symbols/min [2025-10-22T22:08:21.477082] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:21.497179] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-22T22:08:21.501199] [INFO ] [MAIN ] ET: Loaded 53789 primary data records. [2025-10-22T22:08:21.566396] [DEBUG] [LOCAL ] ETB: Loaded 11764 existing records from primary storage. [2025-10-22T22:08:21.598694] [INFO ] [MAIN ] ETB: Loaded 11764 primary data records. [2025-10-22T22:08:21.974183] [DEBUG] [MAIN ] ESTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:22.009744] [INFO ] [MAIN ] ESTC: Generated 1794 derivative records from 50253 primary records. [2025-10-22T22:08:22.127591] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-22T22:08:22.148200] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1794 records). [2025-10-22T22:08:22.149330] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-10-22T22:08:22.151487] [INFO ] [MAIN ] Derivative Progress: 597/2052 symbols completed. ESTC took 1.4s. Estimated remaining: 9m 9s. Rate: 159.1 symbols/min [2025-10-22T22:08:22.152604] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:22.185974] [DEBUG] [MAIN ] ET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:22.199741] [DEBUG] [MAIN ] ETB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:22.199385] [INFO ] [MAIN ] ET: Generated 1794 derivative records from 53789 primary records. [2025-10-22T22:08:22.199875] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-22T22:08:22.200426] [INFO ] [MAIN ] ETB: Generated 1794 derivative records from 11764 primary records. [2025-10-22T22:08:22.211084] [DEBUG] [LOCAL ] ETD: Loaded 27141 existing records from primary storage. [2025-10-22T22:08:22.210534] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-22T22:08:22.211190] [INFO ] [MAIN ] ETD: Loaded 27141 primary data records. [2025-10-22T22:08:22.280766] [DEBUG] [LOCAL ] ETB: Derivative data saved (1794 records). [2025-10-22T22:08:22.320175] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-10-22T22:08:22.339754] [INFO ] [MAIN ] Derivative Progress: 598/2052 symbols completed. ETB took 0.9s. Estimated remaining: 9m 8s. Rate: 159.2 symbols/min [2025-10-22T22:08:22.369583] [DEBUG] [LOCAL ] ET: Derivative data saved (1794 records). [2025-10-22T22:08:22.380732] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-10-22T22:08:22.383878] [INFO ] [MAIN ] Derivative Progress: 599/2052 symbols completed. ET took 1.3s. Estimated remaining: 9m 7s. Rate: 159.5 symbols/min [2025-10-22T22:08:22.613472] [DEBUG] [MAIN ] ETD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:22.614127] [INFO ] [MAIN ] ETD: Generated 1794 derivative records from 27141 primary records. [2025-10-22T22:08:22.614211] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-22T22:08:22.629286] [DEBUG] [LOCAL ] ETD: Derivative data saved (1794 records). [2025-10-22T22:08:22.629346] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-22T22:08:22.631471] [INFO ] [MAIN ] Derivative Progress: 600/2052 symbols completed. ETD took 0.5s. Estimated remaining: 9m 6s. Rate: 159.5 symbols/min [2025-10-22T22:08:22.632085] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:22.632183] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:22.632380] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:22.641612] [DEBUG] [LOCAL ] ETO: Loaded 6892 existing records from primary storage. [2025-10-22T22:08:22.641971] [INFO ] [MAIN ] ETO: Loaded 6892 primary data records. [2025-10-22T22:08:22.751563] [DEBUG] [LOCAL ] ETJ: Loaded 16449 existing records from primary storage. [2025-10-22T22:08:22.761119] [INFO ] [MAIN ] ETJ: Loaded 16449 primary data records. [2025-10-22T22:08:23.262815] [DEBUG] [LOCAL ] ETN: Loaded 52571 existing records from primary storage. [2025-10-22T22:08:23.271420] [INFO ] [MAIN ] ETN: Loaded 52571 primary data records. [2025-10-22T22:08:23.588508] [DEBUG] [MAIN ] ETO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:23.590430] [INFO ] [MAIN ] ETO: Generated 1794 derivative records from 6892 primary records. [2025-10-22T22:08:23.591024] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-22T22:08:23.613281] [DEBUG] [LOCAL ] ETO: Derivative data saved (1794 records). [2025-10-22T22:08:23.622123] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-22T22:08:23.627310] [DEBUG] [MAIN ] ETJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:23.628096] [INFO ] [MAIN ] ETJ: Generated 1794 derivative records from 16449 primary records. [2025-10-22T22:08:23.630389] [INFO ] [MAIN ] Derivative Progress: 601/2052 symbols completed. ETO took 1.0s. Estimated remaining: 9m 7s. Rate: 159.1 symbols/min [2025-10-22T22:08:23.630983] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-22T22:08:23.630639] [INFO ] [MAIN ] ETSY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:23.647853] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1794 records). [2025-10-22T22:08:23.648033] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-22T22:08:23.650070] [INFO ] [MAIN ] Derivative Progress: 602/2052 symbols completed. ETJ took 1.0s. Estimated remaining: 9m 6s. Rate: 159.4 symbols/min [2025-10-22T22:08:23.650538] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:23.666613] [DEBUG] [MAIN ] ETN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:23.667415] [INFO ] [MAIN ] ETN: Generated 1794 derivative records from 52571 primary records. [2025-10-22T22:08:23.667548] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-22T22:08:23.689299] [DEBUG] [LOCAL ] ETN: Derivative data saved (1794 records). [2025-10-22T22:08:23.689547] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-10-22T22:08:23.691615] [INFO ] [MAIN ] Derivative Progress: 603/2052 symbols completed. ETN took 1.1s. Estimated remaining: 9m 5s. Rate: 159.6 symbols/min [2025-10-22T22:08:23.691878] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:23.713631] [DEBUG] [LOCAL ] ETV: Loaded 21830 existing records from primary storage. [2025-10-22T22:08:23.713892] [INFO ] [MAIN ] ETV: Loaded 21830 primary data records. [2025-10-22T22:08:23.857825] [DEBUG] [LOCAL ] ETSY: Loaded 53569 existing records from primary storage. [2025-10-22T22:08:23.882231] [INFO ] [MAIN ] ETSY: Loaded 53569 primary data records. [2025-10-22T22:08:23.893210] [DEBUG] [LOCAL ] ETW: Loaded 25106 existing records from primary storage. [2025-10-22T22:08:23.946566] [INFO ] [MAIN ] ETW: Loaded 25106 primary data records. [2025-10-22T22:08:24.762316] [DEBUG] [MAIN ] ETV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:24.767215] [INFO ] [MAIN ] ETV: Generated 1794 derivative records from 21830 primary records. [2025-10-22T22:08:24.767766] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-10-22T22:08:24.794798] [DEBUG] [MAIN ] ETSY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:24.800207] [INFO ] [MAIN ] ETSY: Generated 1794 derivative records from 53569 primary records. [2025-10-22T22:08:24.799318] [DEBUG] [LOCAL ] ETV: Derivative data saved (1794 records). [2025-10-22T22:08:24.800305] [DEBUG] [LOCAL ] ETSY: Saving derivative data. [2025-10-22T22:08:24.800663] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-10-22T22:08:24.803105] [INFO ] [MAIN ] Derivative Progress: 604/2052 symbols completed. ETV took 1.2s. Estimated remaining: 9m 6s. Rate: 159.1 symbols/min [2025-10-22T22:08:24.803791] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:24.828476] [DEBUG] [MAIN ] ETW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:24.834908] [INFO ] [MAIN ] ETW: Generated 1794 derivative records from 25106 primary records. [2025-10-22T22:08:24.835526] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-22T22:08:24.835190] [DEBUG] [LOCAL ] ETSY: Derivative data saved (1794 records). [2025-10-22T22:08:24.836476] [INFO ] [MAIN ] ETSY: Successfully saved derivative data. [2025-10-22T22:08:24.840394] [INFO ] [MAIN ] Derivative Progress: 605/2052 symbols completed. ETSY took 1.2s. Estimated remaining: 9m 5s. Rate: 159.3 symbols/min [2025-10-22T22:08:24.840557] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:24.857826] [DEBUG] [LOCAL ] ETX: Loaded 5336 existing records from primary storage. [2025-10-22T22:08:24.858038] [INFO ] [MAIN ] ETX: Loaded 5336 primary data records. [2025-10-22T22:08:24.860337] [DEBUG] [LOCAL ] ETW: Derivative data saved (1794 records). [2025-10-22T22:08:24.903499] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-10-22T22:08:24.917281] [INFO ] [MAIN ] Derivative Progress: 606/2052 symbols completed. ETW took 1.2s. Estimated remaining: 9m 4s. Rate: 159.5 symbols/min [2025-10-22T22:08:24.922665] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:24.987079] [DEBUG] [LOCAL ] EVC: Loaded 17862 existing records from primary storage. [2025-10-22T22:08:25.014855] [INFO ] [MAIN ] EVC: Loaded 17862 primary data records. [2025-10-22T22:08:25.345822] [DEBUG] [LOCAL ] EVEX: Loaded 33091 existing records from primary storage. [2025-10-22T22:08:25.375347] [INFO ] [MAIN ] EVEX: Loaded 33091 primary data records. [2025-10-22T22:08:25.808214] [DEBUG] [MAIN ] ETX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:25.810617] [INFO ] [MAIN ] ETX: Generated 1794 derivative records from 5336 primary records. [2025-10-22T22:08:25.810754] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-10-22T22:08:25.828769] [DEBUG] [LOCAL ] ETX: Derivative data saved (1794 records). [2025-10-22T22:08:25.830198] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-10-22T22:08:25.832368] [INFO ] [MAIN ] Derivative Progress: 607/2052 symbols completed. ETX took 1.0s. Estimated remaining: 9m 5s. Rate: 159.2 symbols/min [2025-10-22T22:08:25.832630] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:25.852165] [DEBUG] [MAIN ] EVC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:25.853348] [INFO ] [MAIN ] EVC: Generated 1794 derivative records from 17862 primary records. [2025-10-22T22:08:25.856208] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-22T22:08:25.861779] [DEBUG] [LOCAL ] EVF: Loaded 9694 existing records from primary storage. [2025-10-22T22:08:25.863351] [INFO ] [MAIN ] EVF: Loaded 9694 primary data records. [2025-10-22T22:08:25.916036] [DEBUG] [LOCAL ] EVC: Derivative data saved (1794 records). [2025-10-22T22:08:25.962335] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-22T22:08:25.975300] [INFO ] [MAIN ] Derivative Progress: 608/2052 symbols completed. EVC took 1.1s. Estimated remaining: 9m 4s. Rate: 159.3 symbols/min [2025-10-22T22:08:26.005966] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:26.007122] [DEBUG] [MAIN ] EVEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:26.009237] [INFO ] [MAIN ] EVEX: Generated 1794 derivative records from 33091 primary records. [2025-10-22T22:08:26.009422] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-22T22:08:26.110018] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1794 records). [2025-10-22T22:08:26.114043] [DEBUG] [LOCAL ] EVG: Loaded 5750 existing records from primary storage. [2025-10-22T22:08:26.114259] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-22T22:08:26.216628] [INFO ] [MAIN ] EVG: Loaded 5750 primary data records. [2025-10-22T22:08:26.220698] [INFO ] [MAIN ] Derivative Progress: 609/2052 symbols completed. EVEX took 1.3s. Estimated remaining: 9m 3s. Rate: 159.4 symbols/min [2025-10-22T22:08:26.250327] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:26.617351] [DEBUG] [MAIN ] EVF: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:08:26.632204] [INFO ] [MAIN ] EVF: Generated 1793 derivative records from 9694 primary records. [2025-10-22T22:08:26.634210] [DEBUG] [LOCAL ] EVH: Loaded 49602 existing records from primary storage. [2025-10-22T22:08:26.633187] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-22T22:08:26.635602] [INFO ] [MAIN ] EVH: Loaded 49602 primary data records. [2025-10-22T22:08:26.730834] [DEBUG] [LOCAL ] EVF: Derivative data saved (1793 records). [2025-10-22T22:08:26.747689] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-22T22:08:26.762402] [INFO ] [MAIN ] Derivative Progress: 610/2052 symbols completed. EVF took 0.9s. Estimated remaining: 9m 3s. Rate: 159.3 symbols/min [2025-10-22T22:08:26.773225] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:26.975159] [DEBUG] [MAIN ] EVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:26.979673] [DEBUG] [LOCAL ] EVN: Loaded 10780 existing records from primary storage. [2025-10-22T22:08:26.980336] [INFO ] [MAIN ] EVG: Generated 1794 derivative records from 5750 primary records. [2025-10-22T22:08:26.980446] [INFO ] [MAIN ] EVN: Loaded 10780 primary data records. [2025-10-22T22:08:26.980529] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-22T22:08:27.094362] [DEBUG] [LOCAL ] EVG: Derivative data saved (1794 records). [2025-10-22T22:08:27.102735] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-22T22:08:27.110280] [INFO ] [MAIN ] Derivative Progress: 611/2052 symbols completed. EVG took 1.1s. Estimated remaining: 9m 3s. Rate: 159.3 symbols/min [2025-10-22T22:08:27.126500] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:27.334022] [DEBUG] [MAIN ] EVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:27.344675] [INFO ] [MAIN ] EVH: Generated 1794 derivative records from 49602 primary records. [2025-10-22T22:08:27.344887] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-22T22:08:27.362780] [DEBUG] [LOCAL ] EVH: Derivative data saved (1794 records). [2025-10-22T22:08:27.374265] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-10-22T22:08:27.376471] [INFO ] [MAIN ] Derivative Progress: 612/2052 symbols completed. EVH took 1.1s. Estimated remaining: 9m 2s. Rate: 159.4 symbols/min [2025-10-22T22:08:27.377979] [DEBUG] [LOCAL ] EVR: Loaded 33601 existing records from primary storage. [2025-10-22T22:08:27.378141] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:27.378213] [INFO ] [MAIN ] EVR: Loaded 33601 primary data records. [2025-10-22T22:08:27.558925] [DEBUG] [LOCAL ] EVT: Loaded 16515 existing records from primary storage. [2025-10-22T22:08:27.559260] [INFO ] [MAIN ] EVT: Loaded 16515 primary data records. [2025-10-22T22:08:27.775846] [DEBUG] [MAIN ] EVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:27.794302] [INFO ] [MAIN ] EVN: Generated 1794 derivative records from 10780 primary records. [2025-10-22T22:08:27.805439] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-22T22:08:27.912395] [DEBUG] [LOCAL ] EVN: Derivative data saved (1794 records). [2025-10-22T22:08:28.020443] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-22T22:08:28.030618] [INFO ] [MAIN ] Derivative Progress: 613/2052 symbols completed. EVN took 1.3s. Estimated remaining: 9m 2s. Rate: 159.2 symbols/min [2025-10-22T22:08:28.052053] [DEBUG] [MAIN ] EVR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:08:28.052807] [INFO ] [MAIN ] EVR: Generated 1793 derivative records from 33601 primary records. [2025-10-22T22:08:28.052893] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-22T22:08:28.069985] [DEBUG] [LOCAL ] EVR: Derivative data saved (1793 records). [2025-10-22T22:08:28.070294] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-22T22:08:28.072399] [INFO ] [MAIN ] Derivative Progress: 614/2052 symbols completed. EVR took 0.9s. Estimated remaining: 9m 1s. Rate: 159.4 symbols/min [2025-10-22T22:08:28.088149] [DEBUG] [MAIN ] EVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:28.088802] [INFO ] [MAIN ] EVT: Generated 1794 derivative records from 16515 primary records. [2025-10-22T22:08:28.088863] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-22T22:08:28.104062] [DEBUG] [LOCAL ] EVT: Derivative data saved (1794 records). [2025-10-22T22:08:28.104120] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-10-22T22:08:28.106481] [INFO ] [MAIN ] Derivative Progress: 615/2052 symbols completed. EVT took 0.7s. Estimated remaining: 9m 0s. Rate: 159.7 symbols/min [2025-10-22T22:08:28.106985] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:28.107126] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:28.106916] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:28.139335] [DEBUG] [LOCAL ] EVTR: Loaded 25397 existing records from primary storage. [2025-10-22T22:08:28.139460] [INFO ] [MAIN ] EVTR: Loaded 25397 primary data records. [2025-10-22T22:08:28.226911] [DEBUG] [LOCAL ] EVTC: Loaded 26785 existing records from primary storage. [2025-10-22T22:08:28.232617] [INFO ] [MAIN ] EVTC: Loaded 26785 primary data records. [2025-10-22T22:08:28.421448] [DEBUG] [LOCAL ] EVTL: Loaded 41363 existing records from primary storage. [2025-10-22T22:08:28.454319] [INFO ] [MAIN ] EVTL: Loaded 41363 primary data records. [2025-10-22T22:08:29.130630] [DEBUG] [MAIN ] EVTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:29.131589] [INFO ] [MAIN ] EVTR: Generated 1794 derivative records from 25397 primary records. [2025-10-22T22:08:29.131809] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-22T22:08:29.151331] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1794 records). [2025-10-22T22:08:29.151530] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-10-22T22:08:29.161035] [INFO ] [MAIN ] Derivative Progress: 616/2052 symbols completed. EVTR took 1.1s. Estimated remaining: 9m 1s. Rate: 159.2 symbols/min [2025-10-22T22:08:29.166216] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:29.167391] [DEBUG] [MAIN ] EVTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:29.168269] [INFO ] [MAIN ] EVTC: Generated 1794 derivative records from 26785 primary records. [2025-10-22T22:08:29.169042] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-22T22:08:29.197730] [DEBUG] [MAIN ] EVTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:29.201171] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1794 records). [2025-10-22T22:08:29.201347] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-22T22:08:29.204832] [INFO ] [MAIN ] EVTL: Generated 1794 derivative records from 41363 primary records. [2025-10-22T22:08:29.203702] [INFO ] [MAIN ] Derivative Progress: 617/2052 symbols completed. EVTC took 1.1s. Estimated remaining: 9m 0s. Rate: 159.4 symbols/min [2025-10-22T22:08:29.205138] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-22T22:08:29.205348] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:29.236616] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1794 records). [2025-10-22T22:08:29.236859] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-10-22T22:08:29.239437] [INFO ] [MAIN ] Derivative Progress: 618/2052 symbols completed. EVTL took 1.1s. Estimated remaining: 8m 59s. Rate: 159.7 symbols/min [2025-10-22T22:08:29.239752] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:29.260569] [DEBUG] [LOCAL ] EW: Loaded 53399 existing records from primary storage. [2025-10-22T22:08:29.268231] [INFO ] [MAIN ] EW: Loaded 53399 primary data records. [2025-10-22T22:08:29.381004] [DEBUG] [LOCAL ] EXG: Loaded 33614 existing records from primary storage. [2025-10-22T22:08:29.391726] [INFO ] [MAIN ] EXG: Loaded 33614 primary data records. [2025-10-22T22:08:29.753153] [DEBUG] [LOCAL ] EXK: Loaded 53187 existing records from primary storage. [2025-10-22T22:08:29.777805] [INFO ] [MAIN ] EXK: Loaded 53187 primary data records. [2025-10-22T22:08:30.244434] [DEBUG] [MAIN ] EW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:30.247122] [INFO ] [MAIN ] EW: Generated 1794 derivative records from 53399 primary records. [2025-10-22T22:08:30.247359] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-22T22:08:30.278164] [DEBUG] [MAIN ] EXG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:30.277584] [DEBUG] [LOCAL ] EW: Derivative data saved (1794 records). [2025-10-22T22:08:30.279122] [INFO ] [MAIN ] EXG: Generated 1794 derivative records from 33614 primary records. [2025-10-22T22:08:30.279254] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-22T22:08:30.279330] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-22T22:08:30.281620] [INFO ] [MAIN ] Derivative Progress: 619/2052 symbols completed. EW took 1.1s. Estimated remaining: 9m 0s. Rate: 159.2 symbols/min [2025-10-22T22:08:30.282807] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:30.298899] [DEBUG] [LOCAL ] EXG: Derivative data saved (1794 records). [2025-10-22T22:08:30.299029] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-22T22:08:30.301257] [INFO ] [MAIN ] Derivative Progress: 620/2052 symbols completed. EXG took 1.1s. Estimated remaining: 8m 59s. Rate: 159.4 symbols/min [2025-10-22T22:08:30.302611] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:30.331207] [DEBUG] [MAIN ] EXK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:30.332303] [INFO ] [MAIN ] EXK: Generated 1794 derivative records from 53187 primary records. [2025-10-22T22:08:30.332470] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-22T22:08:30.357801] [DEBUG] [LOCAL ] EXK: Derivative data saved (1794 records). [2025-10-22T22:08:30.358069] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-22T22:08:30.360779] [INFO ] [MAIN ] Derivative Progress: 621/2052 symbols completed. EXK took 1.1s. Estimated remaining: 8m 58s. Rate: 159.7 symbols/min [2025-10-22T22:08:30.361111] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:30.371727] [DEBUG] [LOCAL ] EXP: Loaded 29175 existing records from primary storage. [2025-10-22T22:08:30.372030] [INFO ] [MAIN ] EXP: Loaded 29175 primary data records. [2025-10-22T22:08:30.500413] [DEBUG] [LOCAL ] EXPD: Loaded 47729 existing records from primary storage. [2025-10-22T22:08:30.539440] [INFO ] [MAIN ] EXPD: Loaded 47729 primary data records. [2025-10-22T22:08:30.826671] [DEBUG] [LOCAL ] EXR: Loaded 45503 existing records from primary storage. [2025-10-22T22:08:30.832577] [INFO ] [MAIN ] EXR: Loaded 45503 primary data records. [2025-10-22T22:08:31.383881] [DEBUG] [MAIN ] EXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:31.385324] [INFO ] [MAIN ] EXP: Generated 1794 derivative records from 29175 primary records. [2025-10-22T22:08:31.385738] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-22T22:08:31.406557] [DEBUG] [LOCAL ] EXP: Derivative data saved (1794 records). [2025-10-22T22:08:31.408994] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-10-22T22:08:31.413106] [INFO ] [MAIN ] Derivative Progress: 622/2052 symbols completed. EXP took 1.1s. Estimated remaining: 8m 59s. Rate: 159.2 symbols/min [2025-10-22T22:08:31.421323] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:31.427995] [DEBUG] [MAIN ] EXPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:31.428907] [INFO ] [MAIN ] EXPD: Generated 1794 derivative records from 47729 primary records. [2025-10-22T22:08:31.429062] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-22T22:08:31.457323] [DEBUG] [MAIN ] EXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:31.461544] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1794 records). [2025-10-22T22:08:31.461631] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-10-22T22:08:31.464853] [INFO ] [MAIN ] EXR: Generated 1794 derivative records from 45503 primary records. [2025-10-22T22:08:31.463796] [INFO ] [MAIN ] Derivative Progress: 623/2052 symbols completed. EXPD took 1.2s. Estimated remaining: 8m 58s. Rate: 159.4 symbols/min [2025-10-22T22:08:31.464999] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-22T22:08:31.466195] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:31.485670] [DEBUG] [LOCAL ] EXR: Derivative data saved (1794 records). [2025-10-22T22:08:31.485886] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-10-22T22:08:31.488322] [INFO ] [MAIN ] Derivative Progress: 624/2052 symbols completed. EXR took 1.1s. Estimated remaining: 8m 57s. Rate: 159.7 symbols/min [2025-10-22T22:08:31.488545] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:31.555108] [DEBUG] [LOCAL ] FBK: Loaded 27466 existing records from primary storage. [2025-10-22T22:08:31.557053] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-22T22:08:31.557496] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-10-22T22:08:31.557690] [INFO ] [MAIN ] FBK: Loaded 27466 primary data records. [2025-10-22T22:08:31.697737] [DEBUG] [LOCAL ] FAF: Loaded 41432 existing records from primary storage. [2025-10-22T22:08:31.784217] [INFO ] [MAIN ] FAF: Loaded 41432 primary data records. [2025-10-22T22:08:32.611692] [DEBUG] [MAIN ] F: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:32.626437] [DEBUG] [MAIN ] FBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:32.625851] [INFO ] [MAIN ] F: Generated 1794 derivative records from 53820 primary records. [2025-10-22T22:08:32.627973] [INFO ] [MAIN ] FBK: Generated 1794 derivative records from 27466 primary records. [2025-10-22T22:08:32.628231] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-22T22:08:32.626929] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-22T22:08:32.660176] [DEBUG] [LOCAL ] F: Derivative data saved (1794 records). [2025-10-22T22:08:32.662743] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-22T22:08:32.665396] [INFO ] [MAIN ] Derivative Progress: 625/2052 symbols completed. F took 1.2s. Estimated remaining: 8m 58s. Rate: 159.1 symbols/min [2025-10-22T22:08:32.666694] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:32.670572] [DEBUG] [LOCAL ] FBK: Derivative data saved (1794 records). [2025-10-22T22:08:32.671545] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-22T22:08:32.673978] [INFO ] [MAIN ] Derivative Progress: 626/2052 symbols completed. FBK took 1.2s. Estimated remaining: 8m 57s. Rate: 159.4 symbols/min [2025-10-22T22:08:32.674483] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:32.689088] [DEBUG] [MAIN ] FAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:32.689938] [INFO ] [MAIN ] FAF: Generated 1794 derivative records from 41432 primary records. [2025-10-22T22:08:32.690141] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-22T22:08:32.709544] [DEBUG] [LOCAL ] FAF: Derivative data saved (1794 records). [2025-10-22T22:08:32.709698] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-22T22:08:32.712213] [INFO ] [MAIN ] Derivative Progress: 627/2052 symbols completed. FAF took 1.2s. Estimated remaining: 8m 56s. Rate: 159.6 symbols/min [2025-10-22T22:08:32.712613] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:32.761952] [DEBUG] [LOCAL ] FBRT: Loaded 35216 existing records from primary storage. [2025-10-22T22:08:32.762344] [INFO ] [MAIN ] FBRT: Loaded 35216 primary data records. [2025-10-22T22:08:32.853366] [DEBUG] [LOCAL ] FBP: Loaded 45588 existing records from primary storage. [2025-10-22T22:08:32.858929] [DEBUG] [LOCAL ] FCN: Loaded 25886 existing records from primary storage. [2025-10-22T22:08:32.878561] [INFO ] [MAIN ] FBP: Loaded 45588 primary data records. [2025-10-22T22:08:32.924875] [INFO ] [MAIN ] FCN: Loaded 25886 primary data records. [2025-10-22T22:08:33.746794] [DEBUG] [MAIN ] FBRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:33.750345] [INFO ] [MAIN ] FBRT: Generated 1794 derivative records from 35216 primary records. [2025-10-22T22:08:33.750509] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-10-22T22:08:33.765362] [DEBUG] [MAIN ] FBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:33.767238] [INFO ] [MAIN ] FBP: Generated 1794 derivative records from 45588 primary records. [2025-10-22T22:08:33.774716] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-22T22:08:33.784427] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1794 records). [2025-10-22T22:08:33.785520] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-10-22T22:08:33.788461] [INFO ] [MAIN ] Derivative Progress: 628/2052 symbols completed. FBRT took 1.1s. Estimated remaining: 8m 57s. Rate: 159.1 symbols/min [2025-10-22T22:08:33.818947] [DEBUG] [MAIN ] FCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:33.822205] [DEBUG] [LOCAL ] FBP: Derivative data saved (1794 records). [2025-10-22T22:08:33.823316] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-22T22:08:33.823476] [INFO ] [MAIN ] FCN: Generated 1794 derivative records from 25886 primary records. [2025-10-22T22:08:33.823601] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-22T22:08:33.826581] [INFO ] [MAIN ] Derivative Progress: 629/2052 symbols completed. FBP took 1.2s. Estimated remaining: 8m 56s. Rate: 159.4 symbols/min [2025-10-22T22:08:33.843436] [DEBUG] [LOCAL ] FCN: Derivative data saved (1794 records). [2025-10-22T22:08:33.843708] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-22T22:08:33.845908] [INFO ] [MAIN ] Derivative Progress: 630/2052 symbols completed. FCN took 1.1s. Estimated remaining: 8m 55s. Rate: 159.6 symbols/min [2025-10-22T22:08:33.846384] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:33.846797] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:33.846509] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:33.871863] [DEBUG] [LOCAL ] FCT: Loaded 14722 existing records from primary storage. [2025-10-22T22:08:33.872221] [INFO ] [MAIN ] FCT: Loaded 14722 primary data records. [2025-10-22T22:08:34.023352] [DEBUG] [LOCAL ] FCPT: Loaded 36980 existing records from primary storage. [2025-10-22T22:08:34.034838] [INFO ] [MAIN ] FCPT: Loaded 36980 primary data records. [2025-10-22T22:08:34.322857] [DEBUG] [LOCAL ] FCX: Loaded 53701 existing records from primary storage. [2025-10-22T22:08:34.346681] [INFO ] [MAIN ] FCX: Loaded 53701 primary data records. [2025-10-22T22:08:34.915341] [DEBUG] [MAIN ] FCT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:08:34.917384] [INFO ] [MAIN ] FCT: Generated 1793 derivative records from 14722 primary records. [2025-10-22T22:08:34.917758] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-22T22:08:34.955517] [DEBUG] [MAIN ] FCPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:34.955639] [DEBUG] [LOCAL ] FCT: Derivative data saved (1793 records). [2025-10-22T22:08:34.956057] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-10-22T22:08:34.960225] [INFO ] [MAIN ] FCPT: Generated 1794 derivative records from 36980 primary records. [2025-10-22T22:08:34.959979] [INFO ] [MAIN ] Derivative Progress: 631/2052 symbols completed. FCT took 1.1s. Estimated remaining: 8m 56s. Rate: 159.1 symbols/min [2025-10-22T22:08:34.961105] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-22T22:08:34.962015] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:34.981928] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1794 records). [2025-10-22T22:08:34.984593] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-22T22:08:34.987038] [INFO ] [MAIN ] Derivative Progress: 632/2052 symbols completed. FCPT took 1.1s. Estimated remaining: 8m 55s. Rate: 159.3 symbols/min [2025-10-22T22:08:34.987357] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:35.002050] [DEBUG] [MAIN ] FCX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:35.003209] [INFO ] [MAIN ] FCX: Generated 1794 derivative records from 53701 primary records. [2025-10-22T22:08:35.003339] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-22T22:08:35.028577] [DEBUG] [LOCAL ] FCX: Derivative data saved (1794 records). [2025-10-22T22:08:35.028833] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-10-22T22:08:35.031946] [INFO ] [MAIN ] Derivative Progress: 633/2052 symbols completed. FCX took 1.2s. Estimated remaining: 8m 54s. Rate: 159.6 symbols/min [2025-10-22T22:08:35.032248] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:35.051029] [DEBUG] [LOCAL ] FDP: Loaded 29707 existing records from primary storage. [2025-10-22T22:08:35.051398] [INFO ] [MAIN ] FDP: Loaded 29707 primary data records. [2025-10-22T22:08:35.147805] [DEBUG] [LOCAL ] FDS: Loaded 28003 existing records from primary storage. [2025-10-22T22:08:35.165048] [INFO ] [MAIN ] FDS: Loaded 28003 primary data records. [2025-10-22T22:08:35.580953] [DEBUG] [LOCAL ] FDX: Loaded 51182 existing records from primary storage. [2025-10-22T22:08:35.585781] [INFO ] [MAIN ] FDX: Loaded 51182 primary data records. [2025-10-22T22:08:36.083244] [DEBUG] [MAIN ] FDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:36.089608] [INFO ] [MAIN ] FDP: Generated 1794 derivative records from 29707 primary records. [2025-10-22T22:08:36.090722] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-22T22:08:36.091927] [DEBUG] [MAIN ] FDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:36.101296] [INFO ] [MAIN ] FDS: Generated 1794 derivative records from 28003 primary records. [2025-10-22T22:08:36.103241] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-22T22:08:36.120846] [DEBUG] [LOCAL ] FDP: Derivative data saved (1794 records). [2025-10-22T22:08:36.126043] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-22T22:08:36.129117] [DEBUG] [LOCAL ] FDS: Derivative data saved (1794 records). [2025-10-22T22:08:36.129304] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-22T22:08:36.132554] [INFO ] [MAIN ] Derivative Progress: 634/2052 symbols completed. FDP took 1.2s. Estimated remaining: 8m 55s. Rate: 159.1 symbols/min [2025-10-22T22:08:36.135420] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:36.135663] [INFO ] [MAIN ] Derivative Progress: 635/2052 symbols completed. FDS took 1.1s. Estimated remaining: 8m 54s. Rate: 159.3 symbols/min [2025-10-22T22:08:36.136708] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:36.153105] [DEBUG] [MAIN ] FDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:36.153917] [INFO ] [MAIN ] FDX: Generated 1794 derivative records from 51182 primary records. [2025-10-22T22:08:36.154038] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-22T22:08:36.172187] [DEBUG] [LOCAL ] FDX: Derivative data saved (1794 records). [2025-10-22T22:08:36.172393] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-10-22T22:08:36.175257] [INFO ] [MAIN ] Derivative Progress: 636/2052 symbols completed. FDX took 1.1s. Estimated remaining: 8m 53s. Rate: 159.5 symbols/min [2025-10-22T22:08:36.175577] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:36.216296] [DEBUG] [LOCAL ] FET: Loaded 12875 existing records from primary storage. [2025-10-22T22:08:36.216428] [INFO ] [MAIN ] FET: Loaded 12875 primary data records. [2025-10-22T22:08:36.349677] [DEBUG] [LOCAL ] FE: Loaded 53433 existing records from primary storage. [2025-10-22T22:08:36.360291] [INFO ] [MAIN ] FE: Loaded 53433 primary data records. [2025-10-22T22:08:36.366231] [DEBUG] [LOCAL ] FERG: Loaded 48718 existing records from primary storage. [2025-10-22T22:08:36.371478] [INFO ] [MAIN ] FERG: Loaded 48718 primary data records. [2025-10-22T22:08:37.316952] [DEBUG] [MAIN ] FET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:37.319624] [INFO ] [MAIN ] FET: Generated 1794 derivative records from 12875 primary records. [2025-10-22T22:08:37.320548] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-22T22:08:37.339307] [DEBUG] [LOCAL ] FET: Derivative data saved (1794 records). [2025-10-22T22:08:37.339579] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-22T22:08:37.341566] [INFO ] [MAIN ] Derivative Progress: 637/2052 symbols completed. FET took 1.2s. Estimated remaining: 8m 54s. Rate: 159.0 symbols/min [2025-10-22T22:08:37.341906] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:37.374011] [DEBUG] [MAIN ] FE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:37.380595] [INFO ] [MAIN ] FE: Generated 1794 derivative records from 53433 primary records. [2025-10-22T22:08:37.380986] [DEBUG] [MAIN ] FERG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:37.387062] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-22T22:08:37.388096] [INFO ] [MAIN ] FERG: Generated 1794 derivative records from 48718 primary records. [2025-10-22T22:08:37.389164] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-22T22:08:37.430386] [DEBUG] [LOCAL ] FF: Loaded 23707 existing records from primary storage. [2025-10-22T22:08:37.434230] [DEBUG] [LOCAL ] FE: Derivative data saved (1794 records). [2025-10-22T22:08:37.431513] [DEBUG] [LOCAL ] FERG: Derivative data saved (1794 records). [2025-10-22T22:08:37.434635] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-22T22:08:37.437250] [INFO ] [MAIN ] FF: Loaded 23707 primary data records. [2025-10-22T22:08:37.437176] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-22T22:08:37.437077] [INFO ] [MAIN ] Derivative Progress: 638/2052 symbols completed. FE took 1.3s. Estimated remaining: 8m 53s. Rate: 159.2 symbols/min [2025-10-22T22:08:37.473009] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:37.478390] [INFO ] [MAIN ] Derivative Progress: 639/2052 symbols completed. FERG took 1.3s. Estimated remaining: 8m 52s. Rate: 159.4 symbols/min [2025-10-22T22:08:37.517537] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:37.634523] [DEBUG] [LOCAL ] FFA: Loaded 5586 existing records from primary storage. [2025-10-22T22:08:37.743255] [INFO ] [MAIN ] FFA: Loaded 5586 primary data records. [2025-10-22T22:08:37.829148] [DEBUG] [LOCAL ] FFC: Loaded 16583 existing records from primary storage. [2025-10-22T22:08:37.847121] [INFO ] [MAIN ] FFC: Loaded 16583 primary data records. [2025-10-22T22:08:38.388666] [DEBUG] [MAIN ] FF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:38.389779] [INFO ] [MAIN ] FF: Generated 1794 derivative records from 23707 primary records. [2025-10-22T22:08:38.390363] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-22T22:08:38.417323] [DEBUG] [LOCAL ] FF: Derivative data saved (1794 records). [2025-10-22T22:08:38.422257] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-22T22:08:38.422508] [DEBUG] [MAIN ] FFA: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:08:38.423362] [INFO ] [MAIN ] FFA: Generated 1793 derivative records from 5586 primary records. [2025-10-22T22:08:38.423454] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-22T22:08:38.426625] [INFO ] [MAIN ] Derivative Progress: 640/2052 symbols completed. FF took 1.1s. Estimated remaining: 8m 53s. Rate: 159.1 symbols/min [2025-10-22T22:08:38.441144] [DEBUG] [LOCAL ] FFA: Derivative data saved (1793 records). [2025-10-22T22:08:38.433521] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:38.441993] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-10-22T22:08:38.444388] [INFO ] [MAIN ] Derivative Progress: 641/2052 symbols completed. FFA took 1.0s. Estimated remaining: 8m 51s. Rate: 159.3 symbols/min [2025-10-22T22:08:38.444786] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:38.463974] [DEBUG] [MAIN ] FFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:38.464852] [INFO ] [MAIN ] FFC: Generated 1794 derivative records from 16583 primary records. [2025-10-22T22:08:38.465132] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-22T22:08:38.506096] [DEBUG] [LOCAL ] FFC: Derivative data saved (1794 records). [2025-10-22T22:08:38.505380] [DEBUG] [LOCAL ] FG: Loaded 21366 existing records from primary storage. [2025-10-22T22:08:38.506279] [INFO ] [MAIN ] FG: Loaded 21366 primary data records. [2025-10-22T22:08:38.506480] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-22T22:08:38.509243] [INFO ] [MAIN ] Derivative Progress: 642/2052 symbols completed. FFC took 1.0s. Estimated remaining: 8m 50s. Rate: 159.5 symbols/min [2025-10-22T22:08:38.553453] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:38.614438] [DEBUG] [LOCAL ] FFWM: Loaded 35671 existing records from primary storage. [2025-10-22T22:08:38.626694] [INFO ] [MAIN ] FFWM: Loaded 35671 primary data records. [2025-10-22T22:08:38.650457] [DEBUG] [LOCAL ] FGN: Loaded 3560 existing records from primary storage. [2025-10-22T22:08:38.661506] [INFO ] [MAIN ] FGN: Loaded 3560 primary data records. [2025-10-22T22:08:39.474063] [DEBUG] [MAIN ] FG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:39.475109] [INFO ] [MAIN ] FG: Generated 1794 derivative records from 21366 primary records. [2025-10-22T22:08:39.475284] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-22T22:08:39.493692] [DEBUG] [LOCAL ] FG: Derivative data saved (1794 records). [2025-10-22T22:08:39.493859] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-10-22T22:08:39.495866] [INFO ] [MAIN ] Derivative Progress: 643/2052 symbols completed. FG took 1.1s. Estimated remaining: 8m 51s. Rate: 159.1 symbols/min [2025-10-22T22:08:39.512982] [DEBUG] [MAIN ] FGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:39.515010] [INFO ] [MAIN ] FGN: Generated 1794 derivative records from 3560 primary records. [2025-10-22T22:08:39.515868] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-10-22T22:08:39.545698] [DEBUG] [MAIN ] FFWM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:39.546734] [INFO ] [MAIN ] FFWM: Generated 1794 derivative records from 35671 primary records. [2025-10-22T22:08:39.545803] [DEBUG] [LOCAL ] FGN: Derivative data saved (1794 records). [2025-10-22T22:08:39.546839] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-22T22:08:39.547048] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-10-22T22:08:39.551470] [INFO ] [MAIN ] Derivative Progress: 644/2052 symbols completed. FGN took 1.0s. Estimated remaining: 8m 50s. Rate: 159.3 symbols/min [2025-10-22T22:08:39.567419] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1794 records). [2025-10-22T22:08:39.567587] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-10-22T22:08:39.570084] [INFO ] [MAIN ] Derivative Progress: 645/2052 symbols completed. FFWM took 1.1s. Estimated remaining: 8m 49s. Rate: 159.5 symbols/min [2025-10-22T22:08:39.570502] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:39.570625] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:39.570589] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:39.645431] [DEBUG] [LOCAL ] FHI: Loaded 39410 existing records from primary storage. [2025-10-22T22:08:39.645797] [INFO ] [MAIN ] FHI: Loaded 39410 primary data records. [2025-10-22T22:08:39.787778] [DEBUG] [LOCAL ] FI: Loaded 53586 existing records from primary storage. [2025-10-22T22:08:39.828172] [INFO ] [MAIN ] FI: Loaded 53586 primary data records. [2025-10-22T22:08:39.814706] [DEBUG] [LOCAL ] FHN: Loaded 53399 existing records from primary storage. [2025-10-22T22:08:39.900061] [INFO ] [MAIN ] FHN: Loaded 53399 primary data records. [2025-10-22T22:08:40.729476] [DEBUG] [MAIN ] FHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:40.730478] [INFO ] [MAIN ] FHI: Generated 1794 derivative records from 39410 primary records. [2025-10-22T22:08:40.730767] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-22T22:08:40.749061] [DEBUG] [LOCAL ] FHI: Derivative data saved (1794 records). [2025-10-22T22:08:40.750921] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-10-22T22:08:40.754712] [INFO ] [MAIN ] Derivative Progress: 646/2052 symbols completed. FHI took 1.2s. Estimated remaining: 8m 51s. Rate: 159.0 symbols/min [2025-10-22T22:08:40.755043] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:40.770913] [DEBUG] [MAIN ] FI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:40.771957] [INFO ] [MAIN ] FI: Generated 1794 derivative records from 53586 primary records. [2025-10-22T22:08:40.772364] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-22T22:08:40.797791] [DEBUG] [LOCAL ] FI: Derivative data saved (1794 records). [2025-10-22T22:08:40.799707] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-22T22:08:40.803032] [INFO ] [MAIN ] Derivative Progress: 647/2052 symbols completed. FI took 1.2s. Estimated remaining: 8m 49s. Rate: 159.2 symbols/min [2025-10-22T22:08:40.803684] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:40.826114] [DEBUG] [LOCAL ] FICO: Loaded 21963 existing records from primary storage. [2025-10-22T22:08:40.827668] [INFO ] [MAIN ] FICO: Loaded 21963 primary data records. [2025-10-22T22:08:40.827523] [DEBUG] [MAIN ] FHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:40.861755] [INFO ] [MAIN ] FHN: Generated 1794 derivative records from 53399 primary records. [2025-10-22T22:08:40.874713] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-22T22:08:40.983581] [DEBUG] [LOCAL ] FHN: Derivative data saved (1794 records). [2025-10-22T22:08:41.020210] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-10-22T22:08:41.033551] [INFO ] [MAIN ] Derivative Progress: 648/2052 symbols completed. FHN took 1.5s. Estimated remaining: 8m 49s. Rate: 159.3 symbols/min [2025-10-22T22:08:41.057755] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:41.197978] [DEBUG] [LOCAL ] FIGS: Loaded 48545 existing records from primary storage. [2025-10-22T22:08:41.198387] [INFO ] [MAIN ] FIGS: Loaded 48545 primary data records. [2025-10-22T22:08:41.416905] [DEBUG] [LOCAL ] FIHL: Loaded 39044 existing records from primary storage. [2025-10-22T22:08:41.419704] [INFO ] [MAIN ] FIHL: Loaded 39044 primary data records. [2025-10-22T22:08:41.884314] [DEBUG] [MAIN ] FICO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:41.900395] [INFO ] [MAIN ] FICO: Generated 1794 derivative records from 21963 primary records. [2025-10-22T22:08:41.900564] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-22T22:08:41.918608] [DEBUG] [LOCAL ] FICO: Derivative data saved (1794 records). [2025-10-22T22:08:41.918841] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-10-22T22:08:41.921731] [INFO ] [MAIN ] Derivative Progress: 649/2052 symbols completed. FICO took 1.2s. Estimated remaining: 8m 49s. Rate: 159.0 symbols/min [2025-10-22T22:08:41.922188] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:41.945118] [DEBUG] [MAIN ] FIGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:41.945919] [INFO ] [MAIN ] FIGS: Generated 1794 derivative records from 48545 primary records. [2025-10-22T22:08:41.946125] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-22T22:08:41.961958] [DEBUG] [LOCAL ] FINS: Loaded 8261 existing records from primary storage. [2025-10-22T22:08:41.962357] [INFO ] [MAIN ] FINS: Loaded 8261 primary data records. [2025-10-22T22:08:41.978024] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1794 records). [2025-10-22T22:08:41.978130] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-22T22:08:41.999623] [INFO ] [MAIN ] Derivative Progress: 650/2052 symbols completed. FIGS took 1.2s. Estimated remaining: 8m 48s. Rate: 159.2 symbols/min [2025-10-22T22:08:42.011553] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:42.277235] [DEBUG] [MAIN ] FIHL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:42.286415] [INFO ] [MAIN ] FIHL: Generated 1794 derivative records from 39044 primary records. [2025-10-22T22:08:42.286589] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-22T22:08:42.314962] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1794 records). [2025-10-22T22:08:42.315107] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-22T22:08:42.318315] [INFO ] [MAIN ] Derivative Progress: 651/2052 symbols completed. FIHL took 1.3s. Estimated remaining: 8m 48s. Rate: 159.2 symbols/min [2025-10-22T22:08:42.318665] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:42.332787] [DEBUG] [LOCAL ] FINV: Loaded 45222 existing records from primary storage. [2025-10-22T22:08:42.332992] [INFO ] [MAIN ] FINV: Loaded 45222 primary data records. [2025-10-22T22:08:42.671017] [DEBUG] [MAIN ] FINS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:42.671876] [INFO ] [MAIN ] FINS: Generated 1794 derivative records from 8261 primary records. [2025-10-22T22:08:42.672076] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-22T22:08:42.688629] [DEBUG] [LOCAL ] FINS: Derivative data saved (1794 records). [2025-10-22T22:08:42.688972] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-22T22:08:42.691038] [INFO ] [MAIN ] Derivative Progress: 652/2052 symbols completed. FINS took 0.8s. Estimated remaining: 8m 48s. Rate: 159.2 symbols/min [2025-10-22T22:08:42.691599] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:42.718603] [DEBUG] [LOCAL ] FIS: Loaded 53325 existing records from primary storage. [2025-10-22T22:08:42.719096] [INFO ] [MAIN ] FIS: Loaded 53325 primary data records. [2025-10-22T22:08:42.901635] [DEBUG] [LOCAL ] FIX: Loaded 28424 existing records from primary storage. [2025-10-22T22:08:42.907162] [DEBUG] [MAIN ] FINV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:42.912881] [INFO ] [MAIN ] FIX: Loaded 28424 primary data records. [2025-10-22T22:08:42.913804] [INFO ] [MAIN ] FINV: Generated 1794 derivative records from 45222 primary records. [2025-10-22T22:08:42.919252] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-22T22:08:43.257541] [DEBUG] [LOCAL ] FINV: Derivative data saved (1794 records). [2025-10-22T22:08:43.263702] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-22T22:08:43.282678] [INFO ] [MAIN ] Derivative Progress: 653/2052 symbols completed. FINV took 1.3s. Estimated remaining: 8m 48s. Rate: 159.1 symbols/min [2025-10-22T22:08:43.288570] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:43.462593] [DEBUG] [LOCAL ] FLC: Loaded 5396 existing records from primary storage. [2025-10-22T22:08:43.463019] [INFO ] [MAIN ] FLC: Loaded 5396 primary data records. [2025-10-22T22:08:43.662014] [DEBUG] [MAIN ] FIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:43.770335] [INFO ] [MAIN ] FIS: Generated 1794 derivative records from 53325 primary records. [2025-10-22T22:08:43.784168] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-22T22:08:43.807503] [DEBUG] [LOCAL ] FIS: Derivative data saved (1794 records). [2025-10-22T22:08:43.820219] [DEBUG] [MAIN ] FIX: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:08:43.821159] [INFO ] [MAIN ] FIX: Generated 1793 derivative records from 28424 primary records. [2025-10-22T22:08:43.821251] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-22T22:08:43.820371] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-22T22:08:43.825286] [INFO ] [MAIN ] Derivative Progress: 654/2052 symbols completed. FIS took 1.5s. Estimated remaining: 8m 48s. Rate: 159.0 symbols/min [2025-10-22T22:08:43.832443] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:43.840960] [DEBUG] [LOCAL ] FIX: Derivative data saved (1793 records). [2025-10-22T22:08:43.841442] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-22T22:08:43.843625] [INFO ] [MAIN ] Derivative Progress: 655/2052 symbols completed. FIX took 1.2s. Estimated remaining: 8m 46s. Rate: 159.2 symbols/min [2025-10-22T22:08:43.843879] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:43.863102] [DEBUG] [MAIN ] FLC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:43.863921] [INFO ] [MAIN ] FLC: Generated 1794 derivative records from 5396 primary records. [2025-10-22T22:08:43.864046] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-22T22:08:43.879493] [DEBUG] [LOCAL ] FLC: Derivative data saved (1794 records). [2025-10-22T22:08:43.879723] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-22T22:08:43.890779] [INFO ] [MAIN ] Derivative Progress: 656/2052 symbols completed. FLC took 0.6s. Estimated remaining: 8m 45s. Rate: 159.4 symbols/min [2025-10-22T22:08:43.891065] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:43.917545] [DEBUG] [LOCAL ] FLNG: Loaded 33319 existing records from primary storage. [2025-10-22T22:08:43.917779] [INFO ] [MAIN ] FLNG: Loaded 33319 primary data records. [2025-10-22T22:08:44.043864] [DEBUG] [LOCAL ] FLG: Loaded 53319 existing records from primary storage. [2025-10-22T22:08:44.054285] [INFO ] [MAIN ] FLG: Loaded 53319 primary data records. [2025-10-22T22:08:44.396745] [DEBUG] [LOCAL ] FLO: Loaded 52073 existing records from primary storage. [2025-10-22T22:08:44.406592] [INFO ] [MAIN ] FLO: Loaded 52073 primary data records. [2025-10-22T22:08:44.916480] [DEBUG] [MAIN ] FLNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:44.918500] [INFO ] [MAIN ] FLNG: Generated 1794 derivative records from 33319 primary records. [2025-10-22T22:08:44.919200] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-22T22:08:44.938869] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1794 records). [2025-10-22T22:08:44.939918] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-22T22:08:44.941939] [INFO ] [MAIN ] Derivative Progress: 657/2052 symbols completed. FLNG took 1.1s. Estimated remaining: 8m 46s. Rate: 159.0 symbols/min [2025-10-22T22:08:44.942572] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:44.958053] [DEBUG] [MAIN ] FLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:44.959128] [INFO ] [MAIN ] FLG: Generated 1794 derivative records from 53319 primary records. [2025-10-22T22:08:44.959376] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-22T22:08:44.987961] [DEBUG] [LOCAL ] FLG: Derivative data saved (1794 records). [2025-10-22T22:08:44.993155] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-22T22:08:44.995798] [INFO ] [MAIN ] Derivative Progress: 658/2052 symbols completed. FLG took 1.2s. Estimated remaining: 8m 45s. Rate: 159.2 symbols/min [2025-10-22T22:08:44.993475] [DEBUG] [MAIN ] FLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:44.996728] [INFO ] [MAIN ] FLO: Generated 1794 derivative records from 52073 primary records. [2025-10-22T22:08:44.996837] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-22T22:08:45.025275] [DEBUG] [LOCAL ] FLO: Derivative data saved (1794 records). [2025-10-22T22:08:45.025416] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-22T22:08:45.028227] [INFO ] [MAIN ] Derivative Progress: 659/2052 symbols completed. FLO took 1.1s. Estimated remaining: 8m 44s. Rate: 159.4 symbols/min [2025-10-22T22:08:45.048811] [DEBUG] [LOCAL ] FLR: Loaded 53263 existing records from primary storage. [2025-10-22T22:08:45.048965] [INFO ] [MAIN ] FLR: Loaded 53263 primary data records. [2025-10-22T22:08:45.350422] [DEBUG] [MAIN ] FLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:45.351121] [INFO ] [MAIN ] FLR: Generated 1794 derivative records from 53263 primary records. [2025-10-22T22:08:45.351187] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-22T22:08:45.366574] [DEBUG] [LOCAL ] FLR: Derivative data saved (1794 records). [2025-10-22T22:08:45.366634] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-22T22:08:45.368797] [INFO ] [MAIN ] Derivative Progress: 660/2052 symbols completed. FLR took 0.4s. Estimated remaining: 8m 44s. Rate: 159.4 symbols/min [2025-10-22T22:08:45.369566] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:45.369761] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:45.369452] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:45.390889] [DEBUG] [LOCAL ] FLXR: Loaded 21360 existing records from primary storage. [2025-10-22T22:08:45.391090] [INFO ] [MAIN ] FLXR: Loaded 21360 primary data records. [2025-10-22T22:08:45.738900] [DEBUG] [LOCAL ] FLUT: Loaded 50672 existing records from primary storage. [2025-10-22T22:08:45.739175] [INFO ] [MAIN ] FLUT: Loaded 50672 primary data records. [2025-10-22T22:08:45.739988] [DEBUG] [LOCAL ] FLS: Loaded 50409 existing records from primary storage. [2025-10-22T22:08:45.753602] [INFO ] [MAIN ] FLS: Loaded 50409 primary data records. [2025-10-22T22:08:46.410438] [DEBUG] [MAIN ] FLXR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:08:46.412904] [INFO ] [MAIN ] FLXR: Generated 1793 derivative records from 21360 primary records. [2025-10-22T22:08:46.413499] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-22T22:08:46.432533] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1793 records). [2025-10-22T22:08:46.433373] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-10-22T22:08:46.436805] [INFO ] [MAIN ] Derivative Progress: 661/2052 symbols completed. FLXR took 1.1s. Estimated remaining: 8m 45s. Rate: 159.0 symbols/min [2025-10-22T22:08:46.437141] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:46.472113] [DEBUG] [MAIN ] FLUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:46.478373] [INFO ] [MAIN ] FLUT: Generated 1794 derivative records from 50672 primary records. [2025-10-22T22:08:46.478680] [DEBUG] [MAIN ] FLS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:08:46.479023] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-22T22:08:46.479979] [INFO ] [MAIN ] FLS: Generated 1793 derivative records from 50409 primary records. [2025-10-22T22:08:46.480617] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-22T22:08:46.526178] [DEBUG] [LOCAL ] FLS: Derivative data saved (1793 records). [2025-10-22T22:08:46.525337] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1794 records). [2025-10-22T22:08:46.526317] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-22T22:08:46.528357] [INFO ] [MAIN ] Derivative Progress: 662/2052 symbols completed. FLUT took 1.2s. Estimated remaining: 8m 44s. Rate: 159.2 symbols/min [2025-10-22T22:08:46.528605] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:46.529062] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-22T22:08:46.531793] [INFO ] [MAIN ] Derivative Progress: 663/2052 symbols completed. FLS took 1.2s. Estimated remaining: 8m 43s. Rate: 159.4 symbols/min [2025-10-22T22:08:46.532086] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:46.550201] [DEBUG] [LOCAL ] FMC: Loaded 51883 existing records from primary storage. [2025-10-22T22:08:46.550396] [INFO ] [MAIN ] FMC: Loaded 51883 primary data records. [2025-10-22T22:08:46.553569] [DEBUG] [LOCAL ] FMN: Loaded 5477 existing records from primary storage. [2025-10-22T22:08:46.553749] [INFO ] [MAIN ] FMN: Loaded 5477 primary data records. [2025-10-22T22:08:46.755488] [DEBUG] [LOCAL ] FMS: Loaded 30344 existing records from primary storage. [2025-10-22T22:08:46.795426] [INFO ] [MAIN ] FMS: Loaded 30344 primary data records. [2025-10-22T22:08:47.533233] [DEBUG] [MAIN ] FMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:47.546708] [INFO ] [MAIN ] FMN: Generated 1794 derivative records from 5477 primary records. [2025-10-22T22:08:47.547175] [DEBUG] [MAIN ] FMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:47.547973] [INFO ] [MAIN ] FMC: Generated 1794 derivative records from 51883 primary records. [2025-10-22T22:08:47.548193] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-22T22:08:47.547293] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-22T22:08:47.589026] [DEBUG] [LOCAL ] FMN: Derivative data saved (1794 records). [2025-10-22T22:08:47.590265] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-22T22:08:47.592440] [INFO ] [MAIN ] Derivative Progress: 664/2052 symbols completed. FMN took 1.1s. Estimated remaining: 8m 44s. Rate: 159.0 symbols/min [2025-10-22T22:08:47.592763] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:47.594146] [DEBUG] [LOCAL ] FMC: Derivative data saved (1794 records). [2025-10-22T22:08:47.594837] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-22T22:08:47.606390] [INFO ] [MAIN ] Derivative Progress: 665/2052 symbols completed. FMC took 1.2s. Estimated remaining: 8m 43s. Rate: 159.2 symbols/min [2025-10-22T22:08:47.612504] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:47.612375] [DEBUG] [MAIN ] FMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:47.614058] [INFO ] [MAIN ] FMS: Generated 1794 derivative records from 30344 primary records. [2025-10-22T22:08:47.614296] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-22T22:08:47.630096] [DEBUG] [LOCAL ] FMY: Loaded 1360 existing records from primary storage. [2025-10-22T22:08:47.631711] [INFO ] [MAIN ] FMY: Loaded 1360 primary data records. [2025-10-22T22:08:47.640415] [DEBUG] [LOCAL ] FMS: Derivative data saved (1794 records). [2025-10-22T22:08:47.667530] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-22T22:08:47.687607] [INFO ] [MAIN ] Derivative Progress: 666/2052 symbols completed. FMS took 1.2s. Estimated remaining: 8m 42s. Rate: 159.4 symbols/min [2025-10-22T22:08:47.726222] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:47.861482] [DEBUG] [LOCAL ] FMX: Loaded 40436 existing records from primary storage. [2025-10-22T22:08:47.960316] [INFO ] [MAIN ] FMX: Loaded 40436 primary data records. [2025-10-22T22:08:48.148093] [DEBUG] [LOCAL ] FN: Loaded 37392 existing records from primary storage. [2025-10-22T22:08:48.148572] [INFO ] [MAIN ] FN: Loaded 37392 primary data records. [2025-10-22T22:08:48.627197] [DEBUG] [MAIN ] FMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:48.628470] [INFO ] [MAIN ] FMY: Generated 1794 derivative records from 1360 primary records. [2025-10-22T22:08:48.629378] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-22T22:08:48.646149] [DEBUG] [LOCAL ] FMY: Derivative data saved (1794 records). [2025-10-22T22:08:48.646478] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-22T22:08:48.649767] [INFO ] [MAIN ] Derivative Progress: 667/2052 symbols completed. FMY took 1.0s. Estimated remaining: 8m 43s. Rate: 159.0 symbols/min [2025-10-22T22:08:48.650279] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:48.675249] [DEBUG] [MAIN ] FMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:48.676519] [INFO ] [MAIN ] FMX: Generated 1794 derivative records from 40436 primary records. [2025-10-22T22:08:48.676595] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-22T22:08:48.694082] [DEBUG] [LOCAL ] FMX: Derivative data saved (1794 records). [2025-10-22T22:08:48.694220] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-22T22:08:48.696631] [INFO ] [MAIN ] Derivative Progress: 668/2052 symbols completed. FMX took 1.1s. Estimated remaining: 8m 41s. Rate: 159.2 symbols/min [2025-10-22T22:08:48.697142] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:48.715587] [DEBUG] [MAIN ] FN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:48.716469] [INFO ] [MAIN ] FN: Generated 1794 derivative records from 37392 primary records. [2025-10-22T22:08:48.716539] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-22T22:08:48.748390] [DEBUG] [LOCAL ] FN: Derivative data saved (1794 records). [2025-10-22T22:08:48.748601] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-22T22:08:48.751399] [INFO ] [MAIN ] Derivative Progress: 669/2052 symbols completed. FN took 1.0s. Estimated remaining: 8m 40s. Rate: 159.4 symbols/min [2025-10-22T22:08:48.763368] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:48.782347] [DEBUG] [LOCAL ] FNB: Loaded 52602 existing records from primary storage. [2025-10-22T22:08:48.782551] [INFO ] [MAIN ] FNB: Loaded 52602 primary data records. [2025-10-22T22:08:48.886355] [DEBUG] [LOCAL ] FND: Loaded 52075 existing records from primary storage. [2025-10-22T22:08:48.900375] [INFO ] [MAIN ] FND: Loaded 52075 primary data records. [2025-10-22T22:08:49.175766] [DEBUG] [LOCAL ] FNF: Loaded 48737 existing records from primary storage. [2025-10-22T22:08:49.449285] [INFO ] [MAIN ] FNF: Loaded 48737 primary data records. [2025-10-22T22:08:49.879497] [DEBUG] [MAIN ] FND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:49.882846] [INFO ] [MAIN ] FND: Generated 1794 derivative records from 52075 primary records. [2025-10-22T22:08:49.883580] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-22T22:08:49.925622] [DEBUG] [MAIN ] FNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:49.926728] [INFO ] [MAIN ] FNB: Generated 1794 derivative records from 52602 primary records. [2025-10-22T22:08:49.929592] [DEBUG] [LOCAL ] FND: Derivative data saved (1794 records). [2025-10-22T22:08:49.930433] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-22T22:08:49.933486] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-22T22:08:49.933354] [INFO ] [MAIN ] Derivative Progress: 670/2052 symbols completed. FND took 1.2s. Estimated remaining: 8m 42s. Rate: 158.9 symbols/min [2025-10-22T22:08:49.934786] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:49.958453] [DEBUG] [LOCAL ] FNB: Derivative data saved (1794 records). [2025-10-22T22:08:49.960959] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-22T22:08:49.963560] [INFO ] [MAIN ] Derivative Progress: 671/2052 symbols completed. FNB took 1.3s. Estimated remaining: 8m 41s. Rate: 159.2 symbols/min [2025-10-22T22:08:49.964619] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:49.989433] [DEBUG] [MAIN ] FNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:49.996616] [INFO ] [MAIN ] FNF: Generated 1794 derivative records from 48737 primary records. [2025-10-22T22:08:49.996884] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-22T22:08:50.015868] [DEBUG] [LOCAL ] FOA: Loaded 13013 existing records from primary storage. [2025-10-22T22:08:50.017716] [INFO ] [MAIN ] FOA: Loaded 13013 primary data records. [2025-10-22T22:08:50.034208] [DEBUG] [LOCAL ] FNF: Derivative data saved (1794 records). [2025-10-22T22:08:50.058551] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-10-22T22:08:50.103801] [INFO ] [MAIN ] Derivative Progress: 672/2052 symbols completed. FNF took 1.3s. Estimated remaining: 8m 40s. Rate: 159.3 symbols/min [2025-10-22T22:08:50.123058] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:50.227632] [DEBUG] [LOCAL ] FNV: Loaded 46129 existing records from primary storage. [2025-10-22T22:08:50.228120] [INFO ] [MAIN ] FNV: Loaded 46129 primary data records. [2025-10-22T22:08:50.341729] [DEBUG] [LOCAL ] FOF: Loaded 8391 existing records from primary storage. [2025-10-22T22:08:50.485678] [INFO ] [MAIN ] FOF: Loaded 8391 primary data records. [2025-10-22T22:08:51.153370] [DEBUG] [MAIN ] FOA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:51.154583] [INFO ] [MAIN ] FOA: Generated 1794 derivative records from 13013 primary records. [2025-10-22T22:08:51.154737] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-22T22:08:51.172177] [DEBUG] [LOCAL ] FOA: Derivative data saved (1794 records). [2025-10-22T22:08:51.172417] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-10-22T22:08:51.174438] [INFO ] [MAIN ] Derivative Progress: 673/2052 symbols completed. FOA took 1.2s. Estimated remaining: 8m 41s. Rate: 158.9 symbols/min [2025-10-22T22:08:51.193962] [DEBUG] [MAIN ] FOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:51.194727] [INFO ] [MAIN ] FOF: Generated 1794 derivative records from 8391 primary records. [2025-10-22T22:08:51.206638] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-22T22:08:51.206914] [DEBUG] [MAIN ] FNV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:51.208050] [INFO ] [MAIN ] FNV: Generated 1794 derivative records from 46129 primary records. [2025-10-22T22:08:51.208300] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-22T22:08:51.230256] [DEBUG] [LOCAL ] FOF: Derivative data saved (1794 records). [2025-10-22T22:08:51.233669] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-22T22:08:51.239031] [INFO ] [MAIN ] Derivative Progress: 674/2052 symbols completed. FOF took 1.1s. Estimated remaining: 8m 40s. Rate: 159.1 symbols/min [2025-10-22T22:08:51.240438] [DEBUG] [LOCAL ] FNV: Derivative data saved (1794 records). [2025-10-22T22:08:51.240506] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-10-22T22:08:51.243308] [INFO ] [MAIN ] Derivative Progress: 675/2052 symbols completed. FNV took 1.3s. Estimated remaining: 8m 39s. Rate: 159.3 symbols/min [2025-10-22T22:08:51.243733] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:51.243864] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:51.244231] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:51.271492] [DEBUG] [LOCAL ] FOR: Loaded 19506 existing records from primary storage. [2025-10-22T22:08:51.273254] [INFO ] [MAIN ] FOR: Loaded 19506 primary data records. [2025-10-22T22:08:51.318242] [DEBUG] [LOCAL ] FPF: Loaded 18735 existing records from primary storage. [2025-10-22T22:08:51.349489] [INFO ] [MAIN ] FPF: Loaded 18735 primary data records. [2025-10-22T22:08:51.812410] [DEBUG] [LOCAL ] FOUR: Loaded 49712 existing records from primary storage. [2025-10-22T22:08:51.937225] [INFO ] [MAIN ] FOUR: Loaded 49712 primary data records. [2025-10-22T22:08:52.302208] [DEBUG] [MAIN ] FOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:52.303625] [INFO ] [MAIN ] FOR: Generated 1794 derivative records from 19506 primary records. [2025-10-22T22:08:52.303862] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-22T22:08:52.327516] [DEBUG] [LOCAL ] FOR: Derivative data saved (1794 records). [2025-10-22T22:08:52.328413] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-22T22:08:52.337951] [INFO ] [MAIN ] Derivative Progress: 676/2052 symbols completed. FOR took 1.1s. Estimated remaining: 8m 40s. Rate: 158.8 symbols/min [2025-10-22T22:08:52.350310] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:52.353317] [DEBUG] [MAIN ] FPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:52.354687] [INFO ] [MAIN ] FPF: Generated 1794 derivative records from 18735 primary records. [2025-10-22T22:08:52.354810] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-22T22:08:52.385551] [DEBUG] [LOCAL ] FPF: Derivative data saved (1794 records). [2025-10-22T22:08:52.386128] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-22T22:08:52.389270] [INFO ] [MAIN ] Derivative Progress: 677/2052 symbols completed. FPF took 1.1s. Estimated remaining: 8m 39s. Rate: 159.0 symbols/min [2025-10-22T22:08:52.395479] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:52.397744] [DEBUG] [LOCAL ] FPH: Loaded 19183 existing records from primary storage. [2025-10-22T22:08:52.398486] [INFO ] [MAIN ] FPH: Loaded 19183 primary data records. [2025-10-22T22:08:52.751102] [DEBUG] [MAIN ] FOUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:52.750604] [DEBUG] [LOCAL ] FPI: Loaded 31375 existing records from primary storage. [2025-10-22T22:08:52.751249] [INFO ] [MAIN ] FPI: Loaded 31375 primary data records. [2025-10-22T22:08:52.752089] [INFO ] [MAIN ] FOUR: Generated 1794 derivative records from 49712 primary records. [2025-10-22T22:08:52.752188] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-22T22:08:52.816618] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1794 records). [2025-10-22T22:08:52.822997] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-22T22:08:52.825520] [INFO ] [MAIN ] Derivative Progress: 678/2052 symbols completed. FOUR took 1.6s. Estimated remaining: 8m 38s. Rate: 159.0 symbols/min [2025-10-22T22:08:52.838704] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:53.164317] [DEBUG] [MAIN ] FPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:53.167302] [INFO ] [MAIN ] FPH: Generated 1794 derivative records from 19183 primary records. [2025-10-22T22:08:53.167906] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-22T22:08:53.184706] [DEBUG] [LOCAL ] FR: Loaded 46648 existing records from primary storage. [2025-10-22T22:08:53.198850] [INFO ] [MAIN ] FR: Loaded 46648 primary data records. [2025-10-22T22:08:53.203799] [DEBUG] [LOCAL ] FPH: Derivative data saved (1794 records). [2025-10-22T22:08:53.234980] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-22T22:08:53.274779] [INFO ] [MAIN ] Derivative Progress: 679/2052 symbols completed. FPH took 0.9s. Estimated remaining: 8m 38s. Rate: 159.0 symbols/min [2025-10-22T22:08:53.286618] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:53.537325] [DEBUG] [LOCAL ] FRA: Loaded 14058 existing records from primary storage. [2025-10-22T22:08:53.537812] [DEBUG] [MAIN ] FPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:53.538580] [INFO ] [MAIN ] FRA: Loaded 14058 primary data records. [2025-10-22T22:08:53.539747] [INFO ] [MAIN ] FPI: Generated 1794 derivative records from 31375 primary records. [2025-10-22T22:08:53.551890] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-22T22:08:53.659224] [DEBUG] [LOCAL ] FPI: Derivative data saved (1794 records). [2025-10-22T22:08:53.659402] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-10-22T22:08:53.674075] [INFO ] [MAIN ] Derivative Progress: 680/2052 symbols completed. FPI took 1.3s. Estimated remaining: 8m 38s. Rate: 159.0 symbols/min [2025-10-22T22:08:53.679904] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:53.906481] [DEBUG] [MAIN ] FR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:53.908375] [INFO ] [MAIN ] FR: Generated 1794 derivative records from 46648 primary records. [2025-10-22T22:08:53.909009] [DEBUG] [LOCAL ] FRGE: Loaded 15540 existing records from primary storage. [2025-10-22T22:08:53.909307] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-22T22:08:53.909594] [INFO ] [MAIN ] FRGE: Loaded 15540 primary data records. [2025-10-22T22:08:53.968323] [DEBUG] [LOCAL ] FR: Derivative data saved (1794 records). [2025-10-22T22:08:54.006568] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-10-22T22:08:54.020605] [INFO ] [MAIN ] Derivative Progress: 681/2052 symbols completed. FR took 1.2s. Estimated remaining: 8m 37s. Rate: 159.0 symbols/min [2025-10-22T22:08:54.031947] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:54.265584] [DEBUG] [MAIN ] FRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:54.266604] [INFO ] [MAIN ] FRA: Generated 1794 derivative records from 14058 primary records. [2025-10-22T22:08:54.266822] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-22T22:08:54.284999] [DEBUG] [LOCAL ] FRA: Derivative data saved (1794 records). [2025-10-22T22:08:54.285559] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-22T22:08:54.300581] [INFO ] [MAIN ] Derivative Progress: 682/2052 symbols completed. FRA took 1.0s. Estimated remaining: 8m 37s. Rate: 159.0 symbols/min [2025-10-22T22:08:54.302259] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:54.303591] [DEBUG] [LOCAL ] FRO: Loaded 51679 existing records from primary storage. [2025-10-22T22:08:54.303808] [INFO ] [MAIN ] FRO: Loaded 51679 primary data records. [2025-10-22T22:08:54.509559] [DEBUG] [MAIN ] FRGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:54.510326] [INFO ] [MAIN ] FRGE: Generated 1794 derivative records from 15540 primary records. [2025-10-22T22:08:54.617357] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-22T22:08:54.642152] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1794 records). [2025-10-22T22:08:54.643553] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-10-22T22:08:54.645982] [INFO ] [MAIN ] Derivative Progress: 683/2052 symbols completed. FRGE took 1.0s. Estimated remaining: 8m 36s. Rate: 159.1 symbols/min [2025-10-22T22:08:54.646218] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:54.662603] [DEBUG] [LOCAL ] FRT: Loaded 41468 existing records from primary storage. [2025-10-22T22:08:54.662865] [INFO ] [MAIN ] FRT: Loaded 41468 primary data records. [2025-10-22T22:08:55.046738] [DEBUG] [LOCAL ] FSCO: Loaded 38527 existing records from primary storage. [2025-10-22T22:08:55.048586] [INFO ] [MAIN ] FSCO: Loaded 38527 primary data records. [2025-10-22T22:08:55.099826] [DEBUG] [MAIN ] FRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:55.120536] [INFO ] [MAIN ] FRO: Generated 1794 derivative records from 51679 primary records. [2025-10-22T22:08:55.120623] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-22T22:08:55.207255] [DEBUG] [LOCAL ] FRO: Derivative data saved (1794 records). [2025-10-22T22:08:55.213071] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-22T22:08:55.215329] [INFO ] [MAIN ] Derivative Progress: 684/2052 symbols completed. FRO took 1.2s. Estimated remaining: 8m 36s. Rate: 158.9 symbols/min [2025-10-22T22:08:55.220873] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:55.407993] [DEBUG] [MAIN ] FRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:55.409307] [INFO ] [MAIN ] FRT: Generated 1794 derivative records from 41468 primary records. [2025-10-22T22:08:55.409719] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-10-22T22:08:55.426504] [DEBUG] [LOCAL ] FRT: Derivative data saved (1794 records). [2025-10-22T22:08:55.427146] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-10-22T22:08:55.429310] [INFO ] [MAIN ] Derivative Progress: 685/2052 symbols completed. FRT took 1.1s. Estimated remaining: 8m 36s. Rate: 159.0 symbols/min [2025-10-22T22:08:55.429674] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:55.466148] [DEBUG] [MAIN ] FSCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:55.467119] [INFO ] [MAIN ] FSCO: Generated 1794 derivative records from 38527 primary records. [2025-10-22T22:08:55.480630] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-22T22:08:55.484249] [DEBUG] [LOCAL ] FSK: Loaded 49476 existing records from primary storage. [2025-10-22T22:08:55.508752] [INFO ] [MAIN ] FSK: Loaded 49476 primary data records. [2025-10-22T22:08:55.513335] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1794 records). [2025-10-22T22:08:55.513532] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-22T22:08:55.555751] [INFO ] [MAIN ] Derivative Progress: 686/2052 symbols completed. FSCO took 0.9s. Estimated remaining: 8m 35s. Rate: 159.2 symbols/min [2025-10-22T22:08:55.591455] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:55.647213] [DEBUG] [LOCAL ] FSLY: Loaded 51303 existing records from primary storage. [2025-10-22T22:08:55.651703] [INFO ] [MAIN ] FSLY: Loaded 51303 primary data records. [2025-10-22T22:08:56.055111] [DEBUG] [LOCAL ] FSS: Loaded 33138 existing records from primary storage. [2025-10-22T22:08:56.057324] [INFO ] [MAIN ] FSS: Loaded 33138 primary data records. [2025-10-22T22:08:56.490862] [DEBUG] [MAIN ] FSK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:56.494016] [INFO ] [MAIN ] FSK: Generated 1794 derivative records from 49476 primary records. [2025-10-22T22:08:56.496150] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-22T22:08:56.521706] [DEBUG] [MAIN ] FSLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:56.525133] [INFO ] [MAIN ] FSLY: Generated 1794 derivative records from 51303 primary records. [2025-10-22T22:08:56.525274] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-22T22:08:56.536049] [DEBUG] [LOCAL ] FSK: Derivative data saved (1794 records). [2025-10-22T22:08:56.537270] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-22T22:08:56.542180] [INFO ] [MAIN ] Derivative Progress: 687/2052 symbols completed. FSK took 1.3s. Estimated remaining: 8m 36s. Rate: 158.8 symbols/min [2025-10-22T22:08:56.544760] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:56.547523] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1794 records). [2025-10-22T22:08:56.547887] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-22T22:08:56.550368] [INFO ] [MAIN ] Derivative Progress: 688/2052 symbols completed. FSLY took 1.1s. Estimated remaining: 8m 35s. Rate: 159.0 symbols/min [2025-10-22T22:08:56.557254] [DEBUG] [LOCAL ] FT: Loaded 6800 existing records from primary storage. [2025-10-22T22:08:56.558170] [INFO ] [MAIN ] FT: Loaded 6800 primary data records. [2025-10-22T22:08:56.677765] [DEBUG] [MAIN ] FSS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:56.689290] [INFO ] [MAIN ] FSS: Generated 1794 derivative records from 33138 primary records. [2025-10-22T22:08:56.704849] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-22T22:08:56.916433] [DEBUG] [LOCAL ] FSS: Derivative data saved (1794 records). [2025-10-22T22:08:56.916562] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-22T22:08:56.918920] [INFO ] [MAIN ] Derivative Progress: 689/2052 symbols completed. FSS took 1.3s. Estimated remaining: 8m 34s. Rate: 159.0 symbols/min [2025-10-22T22:08:56.940875] [DEBUG] [MAIN ] FT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:56.941490] [INFO ] [MAIN ] FT: Generated 1794 derivative records from 6800 primary records. [2025-10-22T22:08:56.941551] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-22T22:08:56.955520] [DEBUG] [LOCAL ] FT: Derivative data saved (1794 records). [2025-10-22T22:08:56.955617] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-10-22T22:08:56.957880] [INFO ] [MAIN ] Derivative Progress: 690/2052 symbols completed. FT took 0.4s. Estimated remaining: 8m 33s. Rate: 159.3 symbols/min [2025-10-22T22:08:56.958482] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:56.958418] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:56.958335] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:56.972198] [DEBUG] [LOCAL ] FTHY: Loaded 12294 existing records from primary storage. [2025-10-22T22:08:56.972384] [INFO ] [MAIN ] FTHY: Loaded 12294 primary data records. [2025-10-22T22:08:57.114639] [DEBUG] [LOCAL ] FTK: Loaded 32937 existing records from primary storage. [2025-10-22T22:08:57.130994] [INFO ] [MAIN ] FTK: Loaded 32937 primary data records. [2025-10-22T22:08:57.446396] [DEBUG] [LOCAL ] FTI: Loaded 53293 existing records from primary storage. [2025-10-22T22:08:57.457191] [INFO ] [MAIN ] FTI: Loaded 53293 primary data records. [2025-10-22T22:08:57.984040] [DEBUG] [MAIN ] FTHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:57.985032] [INFO ] [MAIN ] FTHY: Generated 1794 derivative records from 12294 primary records. [2025-10-22T22:08:57.985396] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-22T22:08:58.003346] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1794 records). [2025-10-22T22:08:58.003724] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-22T22:08:58.006017] [INFO ] [MAIN ] Derivative Progress: 691/2052 symbols completed. FTHY took 1.0s. Estimated remaining: 8m 34s. Rate: 158.8 symbols/min [2025-10-22T22:08:58.006543] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:58.026280] [DEBUG] [MAIN ] FTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:58.027429] [INFO ] [MAIN ] FTK: Generated 1794 derivative records from 32937 primary records. [2025-10-22T22:08:58.027668] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-22T22:08:58.044501] [DEBUG] [LOCAL ] FTK: Derivative data saved (1794 records). [2025-10-22T22:08:58.044738] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-22T22:08:58.047114] [INFO ] [MAIN ] Derivative Progress: 692/2052 symbols completed. FTK took 1.1s. Estimated remaining: 8m 33s. Rate: 159.0 symbols/min [2025-10-22T22:08:58.047603] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:58.065303] [DEBUG] [MAIN ] FTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:58.066146] [INFO ] [MAIN ] FTI: Generated 1794 derivative records from 53293 primary records. [2025-10-22T22:08:58.066247] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-22T22:08:58.094695] [DEBUG] [LOCAL ] FTI: Derivative data saved (1794 records). [2025-10-22T22:08:58.095015] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-22T22:08:58.097853] [INFO ] [MAIN ] Derivative Progress: 693/2052 symbols completed. FTI took 1.1s. Estimated remaining: 8m 32s. Rate: 159.2 symbols/min [2025-10-22T22:08:58.098085] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:58.112014] [DEBUG] [LOCAL ] FTS: Loaded 42482 existing records from primary storage. [2025-10-22T22:08:58.112311] [INFO ] [MAIN ] FTS: Loaded 42482 primary data records. [2025-10-22T22:08:58.198276] [DEBUG] [LOCAL ] FTWO: Loaded 1949 existing records from primary storage. [2025-10-22T22:08:58.221378] [INFO ] [MAIN ] FTWO: Loaded 1949 primary data records. [2025-10-22T22:08:58.441623] [DEBUG] [LOCAL ] FTV: Loaded 53022 existing records from primary storage. [2025-10-22T22:08:58.552000] [INFO ] [MAIN ] FTV: Loaded 53022 primary data records. [2025-10-22T22:08:59.110123] [DEBUG] [MAIN ] FTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:59.111411] [INFO ] [MAIN ] FTS: Generated 1794 derivative records from 42482 primary records. [2025-10-22T22:08:59.111602] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-22T22:08:59.129483] [DEBUG] [LOCAL ] FTS: Derivative data saved (1794 records). [2025-10-22T22:08:59.129613] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-22T22:08:59.133660] [INFO ] [MAIN ] Derivative Progress: 694/2052 symbols completed. FTS took 1.1s. Estimated remaining: 8m 33s. Rate: 158.8 symbols/min [2025-10-22T22:08:59.133896] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:59.149462] [DEBUG] [MAIN ] FTWO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:08:59.150551] [INFO ] [MAIN ] FTWO: Generated 1793 derivative records from 1949 primary records. [2025-10-22T22:08:59.150615] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-22T22:08:59.165325] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1793 records). [2025-10-22T22:08:59.165568] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-22T22:08:59.171745] [INFO ] [MAIN ] Derivative Progress: 695/2052 symbols completed. FTWO took 1.1s. Estimated remaining: 8m 32s. Rate: 159.1 symbols/min [2025-10-22T22:08:59.172022] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:59.189784] [DEBUG] [MAIN ] FTV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:08:59.190530] [INFO ] [MAIN ] FTV: Generated 1794 derivative records from 53022 primary records. [2025-10-22T22:08:59.190670] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-22T22:08:59.206504] [DEBUG] [LOCAL ] FTV: Derivative data saved (1794 records). [2025-10-22T22:08:59.219501] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-22T22:08:59.222089] [INFO ] [MAIN ] Derivative Progress: 696/2052 symbols completed. FTV took 1.2s. Estimated remaining: 8m 31s. Rate: 159.3 symbols/min [2025-10-22T22:08:59.222371] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:08:59.259295] [DEBUG] [LOCAL ] FUBO: Loaded 53718 existing records from primary storage. [2025-10-22T22:08:59.259588] [INFO ] [MAIN ] FUBO: Loaded 53718 primary data records. [2025-10-22T22:08:59.260165] [DEBUG] [LOCAL ] FUL: Loaded 31986 existing records from primary storage. [2025-10-22T22:08:59.291516] [INFO ] [MAIN ] FUL: Loaded 31986 primary data records. [2025-10-22T22:08:59.756562] [DEBUG] [LOCAL ] FUN: Loaded 52023 existing records from primary storage. [2025-10-22T22:08:59.787318] [INFO ] [MAIN ] FUN: Loaded 52023 primary data records. [2025-10-22T22:09:00.243818] [DEBUG] [MAIN ] FUBO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:00.244898] [INFO ] [MAIN ] FUBO: Generated 1794 derivative records from 53718 primary records. [2025-10-22T22:09:00.246545] [DEBUG] [MAIN ] FUL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:00.246922] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-22T22:09:00.248439] [INFO ] [MAIN ] FUL: Generated 1794 derivative records from 31986 primary records. [2025-10-22T22:09:00.260202] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-22T22:09:00.273000] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1794 records). [2025-10-22T22:09:00.277107] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-22T22:09:00.279689] [INFO ] [MAIN ] Derivative Progress: 697/2052 symbols completed. FUBO took 1.1s. Estimated remaining: 8m 32s. Rate: 158.8 symbols/min [2025-10-22T22:09:00.284325] [DEBUG] [LOCAL ] FUL: Derivative data saved (1794 records). [2025-10-22T22:09:00.284600] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-22T22:09:00.286885] [INFO ] [MAIN ] Derivative Progress: 698/2052 symbols completed. FUL took 1.1s. Estimated remaining: 8m 31s. Rate: 159.1 symbols/min [2025-10-22T22:09:00.284460] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:00.287064] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:00.304570] [DEBUG] [MAIN ] FUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:00.305439] [INFO ] [MAIN ] FUN: Generated 1794 derivative records from 52023 primary records. [2025-10-22T22:09:00.305504] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-22T22:09:00.327076] [DEBUG] [LOCAL ] FUN: Derivative data saved (1794 records). [2025-10-22T22:09:00.327262] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-22T22:09:00.329708] [INFO ] [MAIN ] Derivative Progress: 699/2052 symbols completed. FUN took 1.1s. Estimated remaining: 8m 30s. Rate: 159.3 symbols/min [2025-10-22T22:09:00.330102] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:00.342574] [DEBUG] [LOCAL ] FXED: Loaded 1227 existing records from primary storage. [2025-10-22T22:09:00.348866] [INFO ] [MAIN ] FXED: Loaded 1227 primary data records. [2025-10-22T22:09:00.372562] [DEBUG] [LOCAL ] FVR: Loaded 20820 existing records from primary storage. [2025-10-22T22:09:00.396259] [INFO ] [MAIN ] FVR: Loaded 20820 primary data records. [2025-10-22T22:09:00.468307] [DEBUG] [LOCAL ] FVRR: Loaded 40496 existing records from primary storage. [2025-10-22T22:09:00.512187] [INFO ] [MAIN ] FVRR: Loaded 40496 primary data records. [2025-10-22T22:09:01.357248] [DEBUG] [MAIN ] FXED: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:09:01.358174] [INFO ] [MAIN ] FXED: Generated 1793 derivative records from 1227 primary records. [2025-10-22T22:09:01.358362] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-22T22:09:01.376435] [DEBUG] [LOCAL ] FXED: Derivative data saved (1793 records). [2025-10-22T22:09:01.391085] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-22T22:09:01.394535] [INFO ] [MAIN ] Derivative Progress: 700/2052 symbols completed. FXED took 1.1s. Estimated remaining: 8m 31s. Rate: 158.9 symbols/min [2025-10-22T22:09:01.391724] [DEBUG] [MAIN ] FVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:01.395093] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:01.408768] [INFO ] [MAIN ] FVR: Generated 1794 derivative records from 20820 primary records. [2025-10-22T22:09:01.409171] [DEBUG] [MAIN ] FVRR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:01.409237] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-22T22:09:01.410289] [INFO ] [MAIN ] FVRR: Generated 1794 derivative records from 40496 primary records. [2025-10-22T22:09:01.411157] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-22T22:09:01.439691] [DEBUG] [LOCAL ] FVR: Derivative data saved (1794 records). [2025-10-22T22:09:01.441961] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-10-22T22:09:01.445492] [INFO ] [MAIN ] Derivative Progress: 701/2052 symbols completed. FVR took 1.2s. Estimated remaining: 8m 30s. Rate: 159.0 symbols/min [2025-10-22T22:09:01.446299] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:01.448363] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1794 records). [2025-10-22T22:09:01.449414] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-22T22:09:01.454612] [INFO ] [MAIN ] Derivative Progress: 702/2052 symbols completed. FVRR took 1.2s. Estimated remaining: 8m 29s. Rate: 159.3 symbols/min [2025-10-22T22:09:01.455000] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:01.462209] [DEBUG] [LOCAL ] GAM: Loaded 3825 existing records from primary storage. [2025-10-22T22:09:01.462561] [INFO ] [MAIN ] GAM: Loaded 3825 primary data records. [2025-10-22T22:09:01.629336] [DEBUG] [LOCAL ] GAB: Loaded 27447 existing records from primary storage. [2025-10-22T22:09:01.664711] [INFO ] [MAIN ] GAB: Loaded 27447 primary data records. [2025-10-22T22:09:01.665675] [DEBUG] [LOCAL ] G: Loaded 50090 existing records from primary storage. [2025-10-22T22:09:01.690367] [INFO ] [MAIN ] G: Loaded 50090 primary data records. [2025-10-22T22:09:02.442030] [DEBUG] [MAIN ] GAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:02.443031] [INFO ] [MAIN ] GAM: Generated 1794 derivative records from 3825 primary records. [2025-10-22T22:09:02.443149] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-22T22:09:02.459081] [DEBUG] [LOCAL ] GAM: Derivative data saved (1794 records). [2025-10-22T22:09:02.459536] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-22T22:09:02.461750] [INFO ] [MAIN ] Derivative Progress: 703/2052 symbols completed. GAM took 1.0s. Estimated remaining: 8m 29s. Rate: 158.9 symbols/min [2025-10-22T22:09:02.482067] [DEBUG] [MAIN ] GAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:02.494539] [INFO ] [MAIN ] GAB: Generated 1794 derivative records from 27447 primary records. [2025-10-22T22:09:02.494664] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-22T22:09:02.494926] [DEBUG] [MAIN ] G: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:02.496048] [INFO ] [MAIN ] G: Generated 1794 derivative records from 50090 primary records. [2025-10-22T22:09:02.496271] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-22T22:09:02.524577] [DEBUG] [LOCAL ] GAB: Derivative data saved (1794 records). [2025-10-22T22:09:02.524942] [DEBUG] [LOCAL ] G: Derivative data saved (1794 records). [2025-10-22T22:09:02.525049] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-22T22:09:02.527499] [INFO ] [MAIN ] Derivative Progress: 704/2052 symbols completed. G took 1.1s. Estimated remaining: 8m 28s. Rate: 159.1 symbols/min [2025-10-22T22:09:02.527604] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-22T22:09:02.530216] [INFO ] [MAIN ] Derivative Progress: 705/2052 symbols completed. GAB took 1.1s. Estimated remaining: 8m 27s. Rate: 159.3 symbols/min [2025-10-22T22:09:02.530673] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:02.530579] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:02.530708] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:02.549771] [DEBUG] [LOCAL ] GBAB: Loaded 12735 existing records from primary storage. [2025-10-22T22:09:02.549899] [INFO ] [MAIN ] GBAB: Loaded 12735 primary data records. [2025-10-22T22:09:02.625817] [DEBUG] [LOCAL ] GATX: Loaded 18061 existing records from primary storage. [2025-10-22T22:09:02.642906] [INFO ] [MAIN ] GATX: Loaded 18061 primary data records. [2025-10-22T22:09:03.037335] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-22T22:09:03.060736] [INFO ] [MAIN ] GAP: Loaded 53653 primary data records. [2025-10-22T22:09:03.530204] [DEBUG] [MAIN ] GBAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:03.531395] [INFO ] [MAIN ] GBAB: Generated 1794 derivative records from 12735 primary records. [2025-10-22T22:09:03.531696] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-22T22:09:03.549772] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1794 records). [2025-10-22T22:09:03.549934] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-10-22T22:09:03.552853] [INFO ] [MAIN ] Derivative Progress: 706/2052 symbols completed. GBAB took 1.0s. Estimated remaining: 8m 28s. Rate: 158.9 symbols/min [2025-10-22T22:09:03.554141] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:03.568109] [DEBUG] [MAIN ] GATX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:03.568825] [INFO ] [MAIN ] GATX: Generated 1794 derivative records from 18061 primary records. [2025-10-22T22:09:03.568999] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-22T22:09:03.585749] [DEBUG] [LOCAL ] GATX: Derivative data saved (1794 records). [2025-10-22T22:09:03.586081] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-22T22:09:03.589119] [INFO ] [MAIN ] Derivative Progress: 707/2052 symbols completed. GATX took 1.1s. Estimated remaining: 8m 27s. Rate: 159.1 symbols/min [2025-10-22T22:09:03.589313] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:03.615082] [DEBUG] [MAIN ] GAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:03.615853] [INFO ] [MAIN ] GAP: Generated 1794 derivative records from 53653 primary records. [2025-10-22T22:09:03.616005] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-22T22:09:03.632361] [DEBUG] [LOCAL ] GAP: Derivative data saved (1794 records). [2025-10-22T22:09:03.633124] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-22T22:09:03.635613] [INFO ] [MAIN ] Derivative Progress: 708/2052 symbols completed. GAP took 1.1s. Estimated remaining: 8m 26s. Rate: 159.3 symbols/min [2025-10-22T22:09:03.635975] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:03.649430] [DEBUG] [LOCAL ] GBCI: Loaded 41187 existing records from primary storage. [2025-10-22T22:09:03.657418] [INFO ] [MAIN ] GBCI: Loaded 41187 primary data records. [2025-10-22T22:09:03.789984] [DEBUG] [LOCAL ] GBTG: Loaded 40227 existing records from primary storage. [2025-10-22T22:09:03.800937] [INFO ] [MAIN ] GBTG: Loaded 40227 primary data records. [2025-10-22T22:09:03.928894] [DEBUG] [LOCAL ] GBX: Loaded 28211 existing records from primary storage. [2025-10-22T22:09:03.949427] [INFO ] [MAIN ] GBX: Loaded 28211 primary data records. [2025-10-22T22:09:04.599991] [DEBUG] [MAIN ] GBCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:04.600906] [INFO ] [MAIN ] GBCI: Generated 1794 derivative records from 41187 primary records. [2025-10-22T22:09:04.601010] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-22T22:09:04.620411] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1794 records). [2025-10-22T22:09:04.632835] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-22T22:09:04.635147] [INFO ] [MAIN ] Derivative Progress: 709/2052 symbols completed. GBCI took 1.1s. Estimated remaining: 8m 27s. Rate: 158.9 symbols/min [2025-10-22T22:09:04.635623] [DEBUG] [MAIN ] GBTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:04.636535] [INFO ] [MAIN ] GBTG: Generated 1794 derivative records from 40227 primary records. [2025-10-22T22:09:04.635316] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:04.637150] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-22T22:09:04.664729] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1794 records). [2025-10-22T22:09:04.670094] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-22T22:09:04.672411] [INFO ] [MAIN ] Derivative Progress: 710/2052 symbols completed. GBTG took 1.1s. Estimated remaining: 8m 26s. Rate: 159.1 symbols/min [2025-10-22T22:09:04.670041] [DEBUG] [MAIN ] GBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:04.672585] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:04.673919] [INFO ] [MAIN ] GBX: Generated 1794 derivative records from 28211 primary records. [2025-10-22T22:09:04.674269] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-22T22:09:04.701537] [DEBUG] [LOCAL ] GBX: Derivative data saved (1794 records). [2025-10-22T22:09:04.701845] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-22T22:09:04.704751] [INFO ] [MAIN ] Derivative Progress: 711/2052 symbols completed. GBX took 1.1s. Estimated remaining: 8m 25s. Rate: 159.4 symbols/min [2025-10-22T22:09:04.705108] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:04.720869] [DEBUG] [LOCAL ] GCO: Loaded 22815 existing records from primary storage. [2025-10-22T22:09:04.733068] [INFO ] [MAIN ] GCO: Loaded 22815 primary data records. [2025-10-22T22:09:04.759093] [DEBUG] [LOCAL ] GCI: Loaded 43579 existing records from primary storage. [2025-10-22T22:09:04.781465] [INFO ] [MAIN ] GCI: Loaded 43579 primary data records. [2025-10-22T22:09:04.824686] [DEBUG] [LOCAL ] GCTS: Loaded 20286 existing records from primary storage. [2025-10-22T22:09:04.861395] [INFO ] [MAIN ] GCTS: Loaded 20286 primary data records. [2025-10-22T22:09:05.700773] [DEBUG] [MAIN ] GCO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:09:05.701799] [INFO ] [MAIN ] GCO: Generated 1793 derivative records from 22815 primary records. [2025-10-22T22:09:05.702190] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-10-22T22:09:05.721727] [DEBUG] [LOCAL ] GCO: Derivative data saved (1793 records). [2025-10-22T22:09:05.733970] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-10-22T22:09:05.736972] [DEBUG] [MAIN ] GCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:05.736728] [INFO ] [MAIN ] Derivative Progress: 712/2052 symbols completed. GCO took 1.1s. Estimated remaining: 8m 26s. Rate: 159.0 symbols/min [2025-10-22T22:09:05.737121] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:05.750554] [INFO ] [MAIN ] GCI: Generated 1794 derivative records from 43579 primary records. [2025-10-22T22:09:05.751403] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-22T22:09:05.751277] [DEBUG] [MAIN ] GCTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:05.752979] [INFO ] [MAIN ] GCTS: Generated 1794 derivative records from 20286 primary records. [2025-10-22T22:09:05.755263] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-22T22:09:05.781410] [DEBUG] [LOCAL ] GCI: Derivative data saved (1794 records). [2025-10-22T22:09:05.788102] [DEBUG] [LOCAL ] GCV: Loaded 7752 existing records from primary storage. [2025-10-22T22:09:05.788208] [INFO ] [MAIN ] GCV: Loaded 7752 primary data records. [2025-10-22T22:09:05.789228] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1794 records). [2025-10-22T22:09:05.786767] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-22T22:09:05.810553] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-22T22:09:05.823748] [INFO ] [MAIN ] Derivative Progress: 713/2052 symbols completed. GCI took 1.2s. Estimated remaining: 8m 25s. Rate: 159.1 symbols/min [2025-10-22T22:09:05.860516] [INFO ] [MAIN ] Derivative Progress: 714/2052 symbols completed. GCTS took 1.2s. Estimated remaining: 8m 24s. Rate: 159.3 symbols/min [2025-10-22T22:09:05.858186] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:05.871031] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:06.151086] [DEBUG] [LOCAL ] GD: Loaded 46474 existing records from primary storage. [2025-10-22T22:09:06.152448] [INFO ] [MAIN ] GD: Loaded 46474 primary data records. [2025-10-22T22:09:06.153482] [DEBUG] [LOCAL ] GDDY: Loaded 49624 existing records from primary storage. [2025-10-22T22:09:06.164907] [INFO ] [MAIN ] GDDY: Loaded 49624 primary data records. [2025-10-22T22:09:06.390856] [DEBUG] [MAIN ] GCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:06.401304] [INFO ] [MAIN ] GCV: Generated 1794 derivative records from 7752 primary records. [2025-10-22T22:09:06.433095] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-22T22:09:06.845251] [DEBUG] [LOCAL ] GCV: Derivative data saved (1794 records). [2025-10-22T22:09:06.846169] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-10-22T22:09:06.849776] [INFO ] [MAIN ] Derivative Progress: 715/2052 symbols completed. GCV took 1.1s. Estimated remaining: 8m 25s. Rate: 159.0 symbols/min [2025-10-22T22:09:06.850750] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:06.858870] [DEBUG] [LOCAL ] GDIV: Loaded 3507 existing records from primary storage. [2025-10-22T22:09:06.859505] [INFO ] [MAIN ] GDIV: Loaded 3507 primary data records. [2025-10-22T22:09:06.990688] [DEBUG] [MAIN ] GDDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:07.019504] [INFO ] [MAIN ] GDDY: Generated 1794 derivative records from 49624 primary records. [2025-10-22T22:09:07.161954] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-22T22:09:07.181076] [DEBUG] [MAIN ] GD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:07.189073] [INFO ] [MAIN ] GD: Generated 1794 derivative records from 46474 primary records. [2025-10-22T22:09:07.189230] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-22T22:09:07.197383] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1794 records). [2025-10-22T22:09:07.197638] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-22T22:09:07.210943] [INFO ] [MAIN ] Derivative Progress: 716/2052 symbols completed. GDDY took 1.3s. Estimated remaining: 8m 24s. Rate: 159.0 symbols/min [2025-10-22T22:09:07.214489] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:07.216507] [DEBUG] [LOCAL ] GD: Derivative data saved (1794 records). [2025-10-22T22:09:07.217215] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-22T22:09:07.220957] [INFO ] [MAIN ] Derivative Progress: 717/2052 symbols completed. GD took 1.4s. Estimated remaining: 8m 23s. Rate: 159.2 symbols/min [2025-10-22T22:09:07.221467] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:07.227149] [DEBUG] [LOCAL ] GDL: Loaded 2510 existing records from primary storage. [2025-10-22T22:09:07.227448] [INFO ] [MAIN ] GDL: Loaded 2510 primary data records. [2025-10-22T22:09:07.332323] [DEBUG] [LOCAL ] GDO: Loaded 5852 existing records from primary storage. [2025-10-22T22:09:07.343031] [INFO ] [MAIN ] GDO: Loaded 5852 primary data records. [2025-10-22T22:09:07.645793] [DEBUG] [MAIN ] GDIV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:09:07.662441] [INFO ] [MAIN ] GDIV: Generated 1793 derivative records from 3507 primary records. [2025-10-22T22:09:07.673976] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-22T22:09:07.858638] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1793 records). [2025-10-22T22:09:07.859057] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-10-22T22:09:07.861413] [INFO ] [MAIN ] Derivative Progress: 718/2052 symbols completed. GDIV took 1.0s. Estimated remaining: 8m 23s. Rate: 159.0 symbols/min [2025-10-22T22:09:07.894483] [DEBUG] [MAIN ] GDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:07.895581] [INFO ] [MAIN ] GDL: Generated 1794 derivative records from 2510 primary records. [2025-10-22T22:09:07.907958] [DEBUG] [MAIN ] GDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:07.907707] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-22T22:09:07.908942] [INFO ] [MAIN ] GDO: Generated 1794 derivative records from 5852 primary records. [2025-10-22T22:09:07.909155] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-22T22:09:07.933580] [DEBUG] [LOCAL ] GDL: Derivative data saved (1794 records). [2025-10-22T22:09:07.936460] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-22T22:09:07.936525] [DEBUG] [LOCAL ] GDO: Derivative data saved (1794 records). [2025-10-22T22:09:07.936628] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-22T22:09:07.939177] [INFO ] [MAIN ] Derivative Progress: 719/2052 symbols completed. GDO took 0.7s. Estimated remaining: 8m 22s. Rate: 159.2 symbols/min [2025-10-22T22:09:07.941533] [INFO ] [MAIN ] Derivative Progress: 720/2052 symbols completed. GDL took 0.7s. Estimated remaining: 8m 21s. Rate: 159.4 symbols/min [2025-10-22T22:09:07.942124] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:07.942294] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:07.942236] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:07.964833] [DEBUG] [LOCAL ] GDV: Loaded 19143 existing records from primary storage. [2025-10-22T22:09:07.965474] [INFO ] [MAIN ] GDV: Loaded 19143 primary data records. [2025-10-22T22:09:08.094587] [DEBUG] [LOCAL ] GDOT: Loaded 37641 existing records from primary storage. [2025-10-22T22:09:08.128927] [INFO ] [MAIN ] GDOT: Loaded 37641 primary data records. [2025-10-22T22:09:08.420857] [DEBUG] [LOCAL ] GE: Loaded 53697 existing records from primary storage. [2025-10-22T22:09:08.434272] [INFO ] [MAIN ] GE: Loaded 53697 primary data records. [2025-10-22T22:09:08.987016] [DEBUG] [MAIN ] GDV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:08.988061] [INFO ] [MAIN ] GDV: Generated 1794 derivative records from 19143 primary records. [2025-10-22T22:09:08.988305] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-22T22:09:09.011114] [DEBUG] [LOCAL ] GDV: Derivative data saved (1794 records). [2025-10-22T22:09:09.023941] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-22T22:09:09.026806] [DEBUG] [MAIN ] GDOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:09.026457] [INFO ] [MAIN ] Derivative Progress: 721/2052 symbols completed. GDV took 1.1s. Estimated remaining: 8m 22s. Rate: 159.0 symbols/min [2025-10-22T22:09:09.027561] [INFO ] [MAIN ] GDOT: Generated 1794 derivative records from 37641 primary records. [2025-10-22T22:09:09.028046] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-22T22:09:09.027830] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:09.044470] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1794 records). [2025-10-22T22:09:09.044699] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-22T22:09:09.046877] [INFO ] [MAIN ] Derivative Progress: 722/2052 symbols completed. GDOT took 1.1s. Estimated remaining: 8m 21s. Rate: 159.2 symbols/min [2025-10-22T22:09:09.047033] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:09.068907] [DEBUG] [MAIN ] GE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:09.069621] [INFO ] [MAIN ] GE: Generated 1794 derivative records from 53697 primary records. [2025-10-22T22:09:09.069803] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-22T22:09:09.093047] [DEBUG] [LOCAL ] GE: Derivative data saved (1794 records). [2025-10-22T22:09:09.092956] [DEBUG] [LOCAL ] GEF: Loaded 20692 existing records from primary storage. [2025-10-22T22:09:09.093267] [INFO ] [MAIN ] GEF: Loaded 20692 primary data records. [2025-10-22T22:09:09.093352] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-22T22:09:09.095946] [INFO ] [MAIN ] Derivative Progress: 723/2052 symbols completed. GE took 1.2s. Estimated remaining: 8m 20s. Rate: 159.4 symbols/min [2025-10-22T22:09:09.117028] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:09.218050] [DEBUG] [LOCAL ] GEL: Loaded 31221 existing records from primary storage. [2025-10-22T22:09:09.233806] [INFO ] [MAIN ] GEL: Loaded 31221 primary data records. [2025-10-22T22:09:09.734153] [DEBUG] [LOCAL ] GENI: Loaded 52937 existing records from primary storage. [2025-10-22T22:09:09.734443] [INFO ] [MAIN ] GENI: Loaded 52937 primary data records. [2025-10-22T22:09:10.047559] [DEBUG] [MAIN ] GEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:10.048857] [INFO ] [MAIN ] GEF: Generated 1794 derivative records from 20692 primary records. [2025-10-22T22:09:10.048998] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-22T22:09:10.083197] [DEBUG] [LOCAL ] GEF: Derivative data saved (1794 records). [2025-10-22T22:09:10.083402] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-22T22:09:10.085798] [INFO ] [MAIN ] Derivative Progress: 724/2052 symbols completed. GEF took 1.1s. Estimated remaining: 8m 21s. Rate: 159.1 symbols/min [2025-10-22T22:09:10.083002] [DEBUG] [MAIN ] GEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:10.086749] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:10.086624] [INFO ] [MAIN ] GEL: Generated 1794 derivative records from 31221 primary records. [2025-10-22T22:09:10.086932] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-10-22T22:09:10.103434] [DEBUG] [LOCAL ] GEL: Derivative data saved (1794 records). [2025-10-22T22:09:10.103532] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-10-22T22:09:10.105991] [INFO ] [MAIN ] Derivative Progress: 725/2052 symbols completed. GEL took 1.1s. Estimated remaining: 8m 20s. Rate: 159.3 symbols/min [2025-10-22T22:09:10.106316] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:10.122980] [DEBUG] [MAIN ] GENI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:10.123600] [INFO ] [MAIN ] GENI: Generated 1794 derivative records from 52937 primary records. [2025-10-22T22:09:10.123724] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-22T22:09:10.141602] [DEBUG] [LOCAL ] GENI: Derivative data saved (1794 records). [2025-10-22T22:09:10.141835] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-22T22:09:10.144058] [INFO ] [MAIN ] Derivative Progress: 726/2052 symbols completed. GENI took 1.0s. Estimated remaining: 8m 19s. Rate: 159.5 symbols/min [2025-10-22T22:09:10.144329] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:10.181913] [DEBUG] [LOCAL ] GES: Loaded 37820 existing records from primary storage. [2025-10-22T22:09:10.195479] [INFO ] [MAIN ] GES: Loaded 37820 primary data records. [2025-10-22T22:09:10.241855] [DEBUG] [LOCAL ] GEO: Loaded 51707 existing records from primary storage. [2025-10-22T22:09:10.272166] [INFO ] [MAIN ] GEO: Loaded 51707 primary data records. [2025-10-22T22:09:10.357214] [DEBUG] [LOCAL ] GETY: Loaded 35237 existing records from primary storage. [2025-10-22T22:09:10.398388] [INFO ] [MAIN ] GETY: Loaded 35237 primary data records. [2025-10-22T22:09:11.168097] [DEBUG] [MAIN ] GES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:11.168981] [INFO ] [MAIN ] GES: Generated 1794 derivative records from 37820 primary records. [2025-10-22T22:09:11.170065] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-22T22:09:11.208469] [DEBUG] [MAIN ] GEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:11.213267] [DEBUG] [LOCAL ] GES: Derivative data saved (1794 records). [2025-10-22T22:09:11.214386] [DEBUG] [MAIN ] GETY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:11.215035] [INFO ] [MAIN ] GETY: Generated 1794 derivative records from 35237 primary records. [2025-10-22T22:09:11.214134] [INFO ] [MAIN ] GEO: Generated 1794 derivative records from 51707 primary records. [2025-10-22T22:09:11.215129] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-22T22:09:11.215189] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-22T22:09:11.215287] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-22T22:09:11.217932] [INFO ] [MAIN ] Derivative Progress: 727/2052 symbols completed. GES took 1.1s. Estimated remaining: 8m 20s. Rate: 159.1 symbols/min [2025-10-22T22:09:11.218328] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:11.247438] [DEBUG] [LOCAL ] GETY: Derivative data saved (1794 records). [2025-10-22T22:09:11.247823] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-22T22:09:11.250120] [INFO ] [MAIN ] Derivative Progress: 728/2052 symbols completed. GETY took 1.1s. Estimated remaining: 8m 19s. Rate: 159.3 symbols/min [2025-10-22T22:09:11.250603] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:11.257608] [DEBUG] [LOCAL ] GEO: Derivative data saved (1794 records). [2025-10-22T22:09:11.260247] [DEBUG] [LOCAL ] GF: Loaded 2623 existing records from primary storage. [2025-10-22T22:09:11.260454] [INFO ] [MAIN ] GF: Loaded 2623 primary data records. [2025-10-22T22:09:11.260094] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-22T22:09:11.274307] [INFO ] [MAIN ] Derivative Progress: 729/2052 symbols completed. GEO took 1.2s. Estimated remaining: 8m 18s. Rate: 159.5 symbols/min [2025-10-22T22:09:11.294119] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:11.589562] [DEBUG] [LOCAL ] GEV: Loaded 52992 existing records from primary storage. [2025-10-22T22:09:11.589940] [INFO ] [MAIN ] GEV: Loaded 52992 primary data records. [2025-10-22T22:09:11.675571] [DEBUG] [LOCAL ] GFF: Loaded 29398 existing records from primary storage. [2025-10-22T22:09:11.682693] [INFO ] [MAIN ] GFF: Loaded 29398 primary data records. [2025-10-22T22:09:12.242772] [DEBUG] [MAIN ] GF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:12.244346] [INFO ] [MAIN ] GF: Generated 1794 derivative records from 2623 primary records. [2025-10-22T22:09:12.244606] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-22T22:09:12.260894] [DEBUG] [LOCAL ] GF: Derivative data saved (1794 records). [2025-10-22T22:09:12.261027] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-10-22T22:09:12.263394] [INFO ] [MAIN ] Derivative Progress: 730/2052 symbols completed. GF took 1.0s. Estimated remaining: 8m 18s. Rate: 159.1 symbols/min [2025-10-22T22:09:12.263873] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:12.287774] [DEBUG] [MAIN ] GEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:12.289308] [INFO ] [MAIN ] GEV: Generated 1794 derivative records from 52992 primary records. [2025-10-22T22:09:12.297234] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-22T22:09:12.303379] [DEBUG] [MAIN ] GFF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:12.304782] [INFO ] [MAIN ] GFF: Generated 1794 derivative records from 29398 primary records. [2025-10-22T22:09:12.304881] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-22T22:09:12.329695] [DEBUG] [LOCAL ] GEV: Derivative data saved (1794 records). [2025-10-22T22:09:12.337864] [DEBUG] [LOCAL ] GFF: Derivative data saved (1794 records). [2025-10-22T22:09:12.338029] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-22T22:09:12.338230] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-22T22:09:12.340718] [INFO ] [MAIN ] Derivative Progress: 731/2052 symbols completed. GFF took 1.0s. Estimated remaining: 8m 18s. Rate: 159.3 symbols/min [2025-10-22T22:09:12.344539] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:12.345091] [INFO ] [MAIN ] Derivative Progress: 732/2052 symbols completed. GEV took 1.1s. Estimated remaining: 8m 17s. Rate: 159.5 symbols/min [2025-10-22T22:09:12.345424] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:12.369294] [DEBUG] [LOCAL ] GFR: Loaded 7332 existing records from primary storage. [2025-10-22T22:09:12.369492] [INFO ] [MAIN ] GFR: Loaded 7332 primary data records. [2025-10-22T22:09:12.497711] [DEBUG] [LOCAL ] GFI: Loaded 53116 existing records from primary storage. [2025-10-22T22:09:12.498404] [INFO ] [MAIN ] GFI: Loaded 53116 primary data records. [2025-10-22T22:09:12.908045] [DEBUG] [LOCAL ] GFL: Loaded 47496 existing records from primary storage. [2025-10-22T22:09:12.919458] [INFO ] [MAIN ] GFL: Loaded 47496 primary data records. [2025-10-22T22:09:13.415832] [DEBUG] [MAIN ] GFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:13.418204] [INFO ] [MAIN ] GFR: Generated 1794 derivative records from 7332 primary records. [2025-10-22T22:09:13.418559] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-22T22:09:13.446846] [DEBUG] [LOCAL ] GFR: Derivative data saved (1794 records). [2025-10-22T22:09:13.446944] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-10-22T22:09:13.446788] [DEBUG] [MAIN ] GFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:13.450455] [INFO ] [MAIN ] GFI: Generated 1794 derivative records from 53116 primary records. [2025-10-22T22:09:13.449462] [INFO ] [MAIN ] Derivative Progress: 733/2052 symbols completed. GFR took 1.1s. Estimated remaining: 8m 17s. Rate: 159.1 symbols/min [2025-10-22T22:09:13.450833] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-22T22:09:13.471730] [DEBUG] [LOCAL ] GFI: Derivative data saved (1794 records). [2025-10-22T22:09:13.471893] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-22T22:09:13.474296] [INFO ] [MAIN ] Derivative Progress: 734/2052 symbols completed. GFI took 1.2s. Estimated remaining: 8m 16s. Rate: 159.3 symbols/min [2025-10-22T22:09:13.486551] [DEBUG] [MAIN ] GFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:13.487205] [INFO ] [MAIN ] GFL: Generated 1794 derivative records from 47496 primary records. [2025-10-22T22:09:13.487267] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-22T22:09:13.502211] [DEBUG] [LOCAL ] GFL: Derivative data saved (1794 records). [2025-10-22T22:09:13.502267] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-22T22:09:13.504743] [INFO ] [MAIN ] Derivative Progress: 735/2052 symbols completed. GFL took 1.2s. Estimated remaining: 8m 15s. Rate: 159.5 symbols/min [2025-10-22T22:09:13.505065] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:13.505246] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:13.505513] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:13.510754] [DEBUG] [LOCAL ] GGZ: Loaded 2348 existing records from primary storage. [2025-10-22T22:09:13.510939] [INFO ] [MAIN ] GGZ: Loaded 2348 primary data records. [2025-10-22T22:09:13.617929] [DEBUG] [LOCAL ] GGT: Loaded 14455 existing records from primary storage. [2025-10-22T22:09:13.621269] [INFO ] [MAIN ] GGT: Loaded 14455 primary data records. [2025-10-22T22:09:13.936305] [DEBUG] [LOCAL ] GGG: Loaded 40560 existing records from primary storage. [2025-10-22T22:09:13.953035] [INFO ] [MAIN ] GGG: Loaded 40560 primary data records. [2025-10-22T22:09:14.459289] [DEBUG] [MAIN ] GGZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:14.461216] [INFO ] [MAIN ] GGZ: Generated 1794 derivative records from 2348 primary records. [2025-10-22T22:09:14.461667] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-22T22:09:14.477920] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1794 records). [2025-10-22T22:09:14.485724] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-10-22T22:09:14.492710] [INFO ] [MAIN ] Derivative Progress: 736/2052 symbols completed. GGZ took 1.0s. Estimated remaining: 8m 16s. Rate: 159.1 symbols/min [2025-10-22T22:09:14.493443] [DEBUG] [MAIN ] GGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:14.493141] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:14.494411] [INFO ] [MAIN ] GGT: Generated 1794 derivative records from 14455 primary records. [2025-10-22T22:09:14.495020] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-22T22:09:14.522997] [DEBUG] [LOCAL ] GHC: Loaded 2954 existing records from primary storage. [2025-10-22T22:09:14.522833] [DEBUG] [LOCAL ] GGT: Derivative data saved (1794 records). [2025-10-22T22:09:14.527812] [INFO ] [MAIN ] GHC: Loaded 2954 primary data records. [2025-10-22T22:09:14.527925] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-10-22T22:09:14.528206] [DEBUG] [MAIN ] GGG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:14.551579] [INFO ] [MAIN ] GGG: Generated 1794 derivative records from 40560 primary records. [2025-10-22T22:09:14.541561] [INFO ] [MAIN ] Derivative Progress: 737/2052 symbols completed. GGT took 1.0s. Estimated remaining: 8m 15s. Rate: 159.3 symbols/min [2025-10-22T22:09:14.551710] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-22T22:09:14.566903] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:14.647844] [DEBUG] [LOCAL ] GGG: Derivative data saved (1794 records). [2025-10-22T22:09:14.650097] [DEBUG] [LOCAL ] GHG: Loaded 3269 existing records from primary storage. [2025-10-22T22:09:14.650210] [INFO ] [MAIN ] GHG: Loaded 3269 primary data records. [2025-10-22T22:09:14.650372] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-22T22:09:14.770622] [INFO ] [MAIN ] Derivative Progress: 738/2052 symbols completed. GGG took 1.3s. Estimated remaining: 8m 15s. Rate: 159.4 symbols/min [2025-10-22T22:09:14.846745] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:15.050108] [DEBUG] [LOCAL ] GHI: Loaded 7763 existing records from primary storage. [2025-10-22T22:09:15.168434] [INFO ] [MAIN ] GHI: Loaded 7763 primary data records. [2025-10-22T22:09:15.488349] [DEBUG] [MAIN ] GHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:15.491012] [INFO ] [MAIN ] GHC: Generated 1794 derivative records from 2954 primary records. [2025-10-22T22:09:15.491107] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-22T22:09:15.524856] [DEBUG] [LOCAL ] GHC: Derivative data saved (1794 records). [2025-10-22T22:09:15.526502] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-10-22T22:09:15.528719] [INFO ] [MAIN ] Derivative Progress: 739/2052 symbols completed. GHC took 1.0s. Estimated remaining: 8m 15s. Rate: 159.2 symbols/min [2025-10-22T22:09:15.529668] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:15.529569] [DEBUG] [MAIN ] GHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:15.531021] [INFO ] [MAIN ] GHG: Generated 1794 derivative records from 3269 primary records. [2025-10-22T22:09:15.531223] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-22T22:09:15.554016] [DEBUG] [LOCAL ] GHLD: Loaded 4327 existing records from primary storage. [2025-10-22T22:09:15.555536] [INFO ] [MAIN ] GHLD: Loaded 4327 primary data records. [2025-10-22T22:09:15.572934] [DEBUG] [LOCAL ] GHG: Derivative data saved (1794 records). [2025-10-22T22:09:15.625554] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-22T22:09:15.642070] [INFO ] [MAIN ] Derivative Progress: 740/2052 symbols completed. GHG took 1.1s. Estimated remaining: 8m 14s. Rate: 159.3 symbols/min [2025-10-22T22:09:15.665428] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:15.695204] [DEBUG] [MAIN ] GHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:15.706431] [INFO ] [MAIN ] GHI: Generated 1794 derivative records from 7763 primary records. [2025-10-22T22:09:15.711725] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-22T22:09:15.897566] [DEBUG] [LOCAL ] GHM: Loaded 14307 existing records from primary storage. [2025-10-22T22:09:15.904285] [INFO ] [MAIN ] GHM: Loaded 14307 primary data records. [2025-10-22T22:09:15.911542] [DEBUG] [LOCAL ] GHI: Derivative data saved (1794 records). [2025-10-22T22:09:15.927733] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-22T22:09:15.945964] [INFO ] [MAIN ] Derivative Progress: 741/2052 symbols completed. GHI took 1.1s. Estimated remaining: 8m 14s. Rate: 159.4 symbols/min [2025-10-22T22:09:15.965457] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:16.224893] [DEBUG] [LOCAL ] GHY: Loaded 20840 existing records from primary storage. [2025-10-22T22:09:16.225278] [INFO ] [MAIN ] GHY: Loaded 20840 primary data records. [2025-10-22T22:09:16.423615] [DEBUG] [MAIN ] GHLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:16.505357] [INFO ] [MAIN ] GHLD: Generated 1794 derivative records from 4327 primary records. [2025-10-22T22:09:16.578445] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-22T22:09:16.595971] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1794 records). [2025-10-22T22:09:16.597666] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-22T22:09:16.600300] [INFO ] [MAIN ] Derivative Progress: 742/2052 symbols completed. GHLD took 1.1s. Estimated remaining: 8m 14s. Rate: 159.2 symbols/min [2025-10-22T22:09:16.600688] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:16.614572] [DEBUG] [MAIN ] GHM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:16.615419] [INFO ] [MAIN ] GHM: Generated 1794 derivative records from 14307 primary records. [2025-10-22T22:09:16.615515] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-22T22:09:16.632548] [DEBUG] [LOCAL ] GHM: Derivative data saved (1794 records). [2025-10-22T22:09:16.632904] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-22T22:09:16.635254] [INFO ] [MAIN ] Derivative Progress: 743/2052 symbols completed. GHM took 1.0s. Estimated remaining: 8m 13s. Rate: 159.4 symbols/min [2025-10-22T22:09:16.643085] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:16.669496] [DEBUG] [LOCAL ] GIB: Loaded 31346 existing records from primary storage. [2025-10-22T22:09:16.669820] [DEBUG] [MAIN ] GHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:16.673493] [INFO ] [MAIN ] GHY: Generated 1794 derivative records from 20840 primary records. [2025-10-22T22:09:16.673695] [INFO ] [MAIN ] GIB: Loaded 31346 primary data records. [2025-10-22T22:09:16.673615] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-22T22:09:16.755673] [DEBUG] [LOCAL ] GIC: Loaded 13184 existing records from primary storage. [2025-10-22T22:09:16.769258] [INFO ] [MAIN ] GIC: Loaded 13184 primary data records. [2025-10-22T22:09:16.769192] [DEBUG] [LOCAL ] GHY: Derivative data saved (1794 records). [2025-10-22T22:09:16.794777] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-22T22:09:16.817834] [INFO ] [MAIN ] Derivative Progress: 744/2052 symbols completed. GHY took 0.9s. Estimated remaining: 8m 12s. Rate: 159.5 symbols/min [2025-10-22T22:09:16.831115] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:17.312544] [DEBUG] [LOCAL ] GIL: Loaded 43951 existing records from primary storage. [2025-10-22T22:09:17.312964] [INFO ] [MAIN ] GIL: Loaded 43951 primary data records. [2025-10-22T22:09:17.624987] [DEBUG] [MAIN ] GIB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:17.625926] [INFO ] [MAIN ] GIB: Generated 1794 derivative records from 31346 primary records. [2025-10-22T22:09:17.638397] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-22T22:09:17.639229] [DEBUG] [MAIN ] GIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:17.647848] [INFO ] [MAIN ] GIC: Generated 1794 derivative records from 13184 primary records. [2025-10-22T22:09:17.648101] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-22T22:09:17.656309] [DEBUG] [LOCAL ] GIB: Derivative data saved (1794 records). [2025-10-22T22:09:17.656933] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-22T22:09:17.659265] [INFO ] [MAIN ] Derivative Progress: 745/2052 symbols completed. GIB took 1.1s. Estimated remaining: 8m 12s. Rate: 159.3 symbols/min [2025-10-22T22:09:17.666155] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:17.674541] [DEBUG] [LOCAL ] GIC: Derivative data saved (1794 records). [2025-10-22T22:09:17.674666] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-22T22:09:17.678124] [INFO ] [MAIN ] Derivative Progress: 746/2052 symbols completed. GIC took 1.0s. Estimated remaining: 8m 11s. Rate: 159.5 symbols/min [2025-10-22T22:09:17.678273] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:17.697218] [DEBUG] [MAIN ] GIL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:17.698767] [INFO ] [MAIN ] GIL: Generated 1794 derivative records from 43951 primary records. [2025-10-22T22:09:17.699011] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-22T22:09:17.715497] [DEBUG] [LOCAL ] GIL: Derivative data saved (1794 records). [2025-10-22T22:09:17.715765] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-22T22:09:17.718310] [INFO ] [MAIN ] Derivative Progress: 747/2052 symbols completed. GIL took 0.9s. Estimated remaining: 8m 10s. Rate: 159.7 symbols/min [2025-10-22T22:09:17.727624] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:17.758536] [DEBUG] [LOCAL ] GKOS: Loaded 42465 existing records from primary storage. [2025-10-22T22:09:17.758786] [INFO ] [MAIN ] GKOS: Loaded 42465 primary data records. [2025-10-22T22:09:17.884770] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-10-22T22:09:17.885017] [INFO ] [MAIN ] GIS: Loaded 53675 primary data records. [2025-10-22T22:09:18.176969] [DEBUG] [LOCAL ] GL: Loaded 37380 existing records from primary storage. [2025-10-22T22:09:18.190213] [INFO ] [MAIN ] GL: Loaded 37380 primary data records. [2025-10-22T22:09:18.752831] [DEBUG] [MAIN ] GKOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:18.754422] [INFO ] [MAIN ] GKOS: Generated 1794 derivative records from 42465 primary records. [2025-10-22T22:09:18.754532] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-22T22:09:18.776827] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1794 records). [2025-10-22T22:09:18.789413] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-22T22:09:18.792162] [INFO ] [MAIN ] Derivative Progress: 748/2052 symbols completed. GKOS took 1.1s. Estimated remaining: 8m 11s. Rate: 159.3 symbols/min [2025-10-22T22:09:18.790172] [DEBUG] [MAIN ] GIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:18.793356] [INFO ] [MAIN ] GIS: Generated 1794 derivative records from 53675 primary records. [2025-10-22T22:09:18.793730] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-22T22:09:18.812388] [DEBUG] [LOCAL ] GIS: Derivative data saved (1794 records). [2025-10-22T22:09:18.824385] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-22T22:09:18.824758] [DEBUG] [MAIN ] GL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:18.827346] [INFO ] [MAIN ] Derivative Progress: 749/2052 symbols completed. GIS took 1.2s. Estimated remaining: 8m 10s. Rate: 159.5 symbols/min [2025-10-22T22:09:18.831174] [INFO ] [MAIN ] GL: Generated 1794 derivative records from 37380 primary records. [2025-10-22T22:09:18.831289] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-22T22:09:18.847229] [DEBUG] [LOCAL ] GL: Derivative data saved (1794 records). [2025-10-22T22:09:18.847312] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-22T22:09:18.850457] [INFO ] [MAIN ] Derivative Progress: 750/2052 symbols completed. GL took 1.1s. Estimated remaining: 8m 9s. Rate: 159.7 symbols/min [2025-10-22T22:09:18.851007] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:18.851239] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:18.851137] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:18.868479] [DEBUG] [LOCAL ] GLP: Loaded 9234 existing records from primary storage. [2025-10-22T22:09:18.868738] [INFO ] [MAIN ] GLP: Loaded 9234 primary data records. [2025-10-22T22:09:19.204585] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-10-22T22:09:19.224997] [INFO ] [MAIN ] GLW: Loaded 53635 primary data records. [2025-10-22T22:09:19.226365] [DEBUG] [LOCAL ] GLOB: Loaded 48049 existing records from primary storage. [2025-10-22T22:09:19.226760] [INFO ] [MAIN ] GLOB: Loaded 48049 primary data records. [2025-10-22T22:09:19.829183] [DEBUG] [MAIN ] GLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:19.830689] [INFO ] [MAIN ] GLP: Generated 1794 derivative records from 9234 primary records. [2025-10-22T22:09:19.831373] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-22T22:09:19.850799] [DEBUG] [LOCAL ] GLP: Derivative data saved (1794 records). [2025-10-22T22:09:19.850981] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-10-22T22:09:19.853422] [INFO ] [MAIN ] Derivative Progress: 751/2052 symbols completed. GLP took 1.0s. Estimated remaining: 8m 10s. Rate: 159.3 symbols/min [2025-10-22T22:09:19.854765] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:19.876260] [DEBUG] [MAIN ] GLOB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:19.878801] [INFO ] [MAIN ] GLOB: Generated 1794 derivative records from 48049 primary records. [2025-10-22T22:09:19.879104] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-22T22:09:19.903750] [DEBUG] [MAIN ] GLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:19.904818] [INFO ] [MAIN ] GLW: Generated 1794 derivative records from 53635 primary records. [2025-10-22T22:09:19.905216] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-22T22:09:19.934442] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1794 records). [2025-10-22T22:09:19.935268] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-10-22T22:09:19.937940] [INFO ] [MAIN ] Derivative Progress: 752/2052 symbols completed. GLOB took 1.1s. Estimated remaining: 8m 9s. Rate: 159.5 symbols/min [2025-10-22T22:09:19.938384] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:19.944757] [DEBUG] [LOCAL ] GLW: Derivative data saved (1794 records). [2025-10-22T22:09:19.945583] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-22T22:09:19.947755] [INFO ] [MAIN ] Derivative Progress: 753/2052 symbols completed. GLW took 1.1s. Estimated remaining: 8m 8s. Rate: 159.7 symbols/min [2025-10-22T22:09:19.962202] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:19.963583] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-22T22:09:19.963746] [INFO ] [MAIN ] GM: Loaded 53729 primary data records. [2025-10-22T22:09:20.337906] [DEBUG] [LOCAL ] GME: Loaded 53781 existing records from primary storage. [2025-10-22T22:09:20.338086] [INFO ] [MAIN ] GME: Loaded 53781 primary data records. [2025-10-22T22:09:20.451212] [DEBUG] [LOCAL ] GMED: Loaded 48094 existing records from primary storage. [2025-10-22T22:09:20.455552] [INFO ] [MAIN ] GMED: Loaded 48094 primary data records. [2025-10-22T22:09:20.961793] [DEBUG] [MAIN ] GM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:20.963411] [INFO ] [MAIN ] GM: Generated 1794 derivative records from 53729 primary records. [2025-10-22T22:09:20.964190] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-22T22:09:20.984494] [DEBUG] [LOCAL ] GM: Derivative data saved (1794 records). [2025-10-22T22:09:20.986876] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-22T22:09:20.988882] [INFO ] [MAIN ] Derivative Progress: 754/2052 symbols completed. GM took 1.1s. Estimated remaining: 8m 9s. Rate: 159.3 symbols/min [2025-10-22T22:09:20.989153] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:21.004266] [DEBUG] [MAIN ] GME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:21.005207] [INFO ] [MAIN ] GME: Generated 1794 derivative records from 53781 primary records. [2025-10-22T22:09:21.005509] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-22T22:09:21.025158] [DEBUG] [LOCAL ] GME: Derivative data saved (1794 records). [2025-10-22T22:09:21.025307] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-22T22:09:21.027491] [INFO ] [MAIN ] Derivative Progress: 755/2052 symbols completed. GME took 1.1s. Estimated remaining: 8m 8s. Rate: 159.5 symbols/min [2025-10-22T22:09:21.027753] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:21.041127] [DEBUG] [MAIN ] GMED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:21.041982] [INFO ] [MAIN ] GMED: Generated 1794 derivative records from 48094 primary records. [2025-10-22T22:09:21.050842] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-22T22:09:21.082011] [DEBUG] [LOCAL ] GMRE: Loaded 36438 existing records from primary storage. [2025-10-22T22:09:21.088153] [INFO ] [MAIN ] GMRE: Loaded 36438 primary data records. [2025-10-22T22:09:21.088337] [DEBUG] [LOCAL ] GMED: Derivative data saved (1794 records). [2025-10-22T22:09:21.099864] [DEBUG] [LOCAL ] GNE: Loaded 18074 existing records from primary storage. [2025-10-22T22:09:21.124794] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-22T22:09:21.145684] [INFO ] [MAIN ] Derivative Progress: 756/2052 symbols completed. GMED took 1.2s. Estimated remaining: 8m 7s. Rate: 159.6 symbols/min [2025-10-22T22:09:21.145954] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:21.145831] [INFO ] [MAIN ] GNE: Loaded 18074 primary data records. [2025-10-22T22:09:21.721904] [DEBUG] [LOCAL ] GNK: Loaded 39524 existing records from primary storage. [2025-10-22T22:09:21.722533] [INFO ] [MAIN ] GNK: Loaded 39524 primary data records. [2025-10-22T22:09:22.050113] [DEBUG] [MAIN ] GMRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:22.053049] [INFO ] [MAIN ] GMRE: Generated 1794 derivative records from 36438 primary records. [2025-10-22T22:09:22.054788] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-22T22:09:22.079948] [DEBUG] [MAIN ] GNE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:22.083624] [INFO ] [MAIN ] GNE: Generated 1794 derivative records from 18074 primary records. [2025-10-22T22:09:22.083746] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-22T22:09:22.086181] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1794 records). [2025-10-22T22:09:22.086289] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-22T22:09:22.088285] [INFO ] [MAIN ] Derivative Progress: 757/2052 symbols completed. GMRE took 1.1s. Estimated remaining: 8m 8s. Rate: 159.3 symbols/min [2025-10-22T22:09:22.088757] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:22.105572] [DEBUG] [LOCAL ] GNE: Derivative data saved (1794 records). [2025-10-22T22:09:22.105824] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-22T22:09:22.108138] [INFO ] [MAIN ] Derivative Progress: 758/2052 symbols completed. GNE took 1.1s. Estimated remaining: 8m 7s. Rate: 159.5 symbols/min [2025-10-22T22:09:22.108622] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:22.128183] [DEBUG] [MAIN ] GNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:22.129081] [INFO ] [MAIN ] GNK: Generated 1794 derivative records from 39524 primary records. [2025-10-22T22:09:22.129237] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-22T22:09:22.145932] [DEBUG] [LOCAL ] GNK: Derivative data saved (1794 records). [2025-10-22T22:09:22.146180] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-22T22:09:22.148430] [INFO ] [MAIN ] Derivative Progress: 759/2052 symbols completed. GNK took 1.0s. Estimated remaining: 8m 6s. Rate: 159.7 symbols/min [2025-10-22T22:09:22.158871] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:22.187001] [DEBUG] [LOCAL ] GNL: Loaded 46512 existing records from primary storage. [2025-10-22T22:09:22.191389] [DEBUG] [LOCAL ] GNT: Loaded 8632 existing records from primary storage. [2025-10-22T22:09:22.191118] [INFO ] [MAIN ] GNL: Loaded 46512 primary data records. [2025-10-22T22:09:22.191543] [INFO ] [MAIN ] GNT: Loaded 8632 primary data records. [2025-10-22T22:09:22.355838] [DEBUG] [LOCAL ] GNRC: Loaded 45359 existing records from primary storage. [2025-10-22T22:09:22.380897] [INFO ] [MAIN ] GNRC: Loaded 45359 primary data records. [2025-10-22T22:09:23.158960] [DEBUG] [MAIN ] GNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:23.160724] [INFO ] [MAIN ] GNL: Generated 1794 derivative records from 46512 primary records. [2025-10-22T22:09:23.160820] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-22T22:09:23.181740] [DEBUG] [MAIN ] GNT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:09:23.190246] [DEBUG] [LOCAL ] GNL: Derivative data saved (1794 records). [2025-10-22T22:09:23.190339] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-22T22:09:23.191019] [INFO ] [MAIN ] GNT: Generated 1793 derivative records from 8632 primary records. [2025-10-22T22:09:23.191911] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-22T22:09:23.195184] [INFO ] [MAIN ] Derivative Progress: 760/2052 symbols completed. GNL took 1.1s. Estimated remaining: 8m 7s. Rate: 159.3 symbols/min [2025-10-22T22:09:23.195337] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:23.222947] [DEBUG] [LOCAL ] GNT: Derivative data saved (1793 records). [2025-10-22T22:09:23.223044] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-22T22:09:23.222189] [DEBUG] [MAIN ] GNRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:23.223780] [INFO ] [MAIN ] GNRC: Generated 1794 derivative records from 45359 primary records. [2025-10-22T22:09:23.226033] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-22T22:09:23.225962] [INFO ] [MAIN ] Derivative Progress: 761/2052 symbols completed. GNT took 1.1s. Estimated remaining: 8m 6s. Rate: 159.5 symbols/min [2025-10-22T22:09:23.226947] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:23.243454] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1794 records). [2025-10-22T22:09:23.243972] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-22T22:09:23.246492] [INFO ] [MAIN ] Derivative Progress: 762/2052 symbols completed. GNRC took 1.1s. Estimated remaining: 8m 5s. Rate: 159.7 symbols/min [2025-10-22T22:09:23.246781] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:23.297779] [DEBUG] [LOCAL ] GNW: Loaded 51369 existing records from primary storage. [2025-10-22T22:09:23.297974] [INFO ] [MAIN ] GNW: Loaded 51369 primary data records. [2025-10-22T22:09:23.406550] [DEBUG] [LOCAL ] GOLF: Loaded 30311 existing records from primary storage. [2025-10-22T22:09:23.424367] [INFO ] [MAIN ] GOLF: Loaded 30311 primary data records. [2025-10-22T22:09:23.424885] [DEBUG] [LOCAL ] GOF: Loaded 42713 existing records from primary storage. [2025-10-22T22:09:23.440830] [INFO ] [MAIN ] GOF: Loaded 42713 primary data records. [2025-10-22T22:09:24.298533] [DEBUG] [MAIN ] GNW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:24.299492] [INFO ] [MAIN ] GNW: Generated 1794 derivative records from 51369 primary records. [2025-10-22T22:09:24.299787] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-22T22:09:24.316192] [DEBUG] [LOCAL ] GNW: Derivative data saved (1794 records). [2025-10-22T22:09:24.316366] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-22T22:09:24.318671] [INFO ] [MAIN ] Derivative Progress: 763/2052 symbols completed. GNW took 1.1s. Estimated remaining: 8m 5s. Rate: 159.3 symbols/min [2025-10-22T22:09:24.346926] [DEBUG] [MAIN ] GOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:24.347264] [DEBUG] [MAIN ] GOLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:24.347942] [INFO ] [MAIN ] GOF: Generated 1794 derivative records from 42713 primary records. [2025-10-22T22:09:24.348514] [INFO ] [MAIN ] GOLF: Generated 1794 derivative records from 30311 primary records. [2025-10-22T22:09:24.348627] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-22T22:09:24.348691] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-22T22:09:24.379558] [DEBUG] [LOCAL ] GOF: Derivative data saved (1794 records). [2025-10-22T22:09:24.379079] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1794 records). [2025-10-22T22:09:24.379667] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-22T22:09:24.382041] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-22T22:09:24.381961] [INFO ] [MAIN ] Derivative Progress: 764/2052 symbols completed. GOF took 1.2s. Estimated remaining: 8m 4s. Rate: 159.5 symbols/min [2025-10-22T22:09:24.384542] [INFO ] [MAIN ] Derivative Progress: 765/2052 symbols completed. GOLF took 1.1s. Estimated remaining: 8m 3s. Rate: 159.7 symbols/min [2025-10-22T22:09:24.385004] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:24.384967] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:24.384896] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:24.458170] [DEBUG] [LOCAL ] GPC: Loaded 45916 existing records from primary storage. [2025-10-22T22:09:24.457028] [DEBUG] [LOCAL ] GOTU: Loaded 36876 existing records from primary storage. [2025-10-22T22:09:24.459920] [INFO ] [MAIN ] GPC: Loaded 45916 primary data records. [2025-10-22T22:09:24.471340] [INFO ] [MAIN ] GOTU: Loaded 36876 primary data records. [2025-10-22T22:09:24.549178] [DEBUG] [LOCAL ] GOOS: Loaded 44038 existing records from primary storage. [2025-10-22T22:09:24.578979] [INFO ] [MAIN ] GOOS: Loaded 44038 primary data records. [2025-10-22T22:09:25.437786] [DEBUG] [MAIN ] GPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:25.451236] [DEBUG] [MAIN ] GOTU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:25.452299] [INFO ] [MAIN ] GPC: Generated 1794 derivative records from 45916 primary records. [2025-10-22T22:09:25.460904] [INFO ] [MAIN ] GOTU: Generated 1794 derivative records from 36876 primary records. [2025-10-22T22:09:25.465677] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-10-22T22:09:25.466824] [DEBUG] [MAIN ] GOOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:25.467613] [INFO ] [MAIN ] GOOS: Generated 1794 derivative records from 44038 primary records. [2025-10-22T22:09:25.468348] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-22T22:09:25.468431] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-22T22:09:25.508840] [DEBUG] [LOCAL ] GPC: Derivative data saved (1794 records). [2025-10-22T22:09:25.516819] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-10-22T22:09:25.516604] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1794 records). [2025-10-22T22:09:25.517025] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-22T22:09:25.521308] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1794 records). [2025-10-22T22:09:25.519807] [INFO ] [MAIN ] Derivative Progress: 766/2052 symbols completed. GOOS took 1.1s. Estimated remaining: 8m 4s. Rate: 159.3 symbols/min [2025-10-22T22:09:25.521565] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-22T22:09:25.521746] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:25.523782] [INFO ] [MAIN ] Derivative Progress: 767/2052 symbols completed. GPC took 1.1s. Estimated remaining: 8m 3s. Rate: 159.5 symbols/min [2025-10-22T22:09:25.527517] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:25.527606] [INFO ] [MAIN ] Derivative Progress: 768/2052 symbols completed. GOTU took 1.1s. Estimated remaining: 8m 2s. Rate: 159.7 symbols/min [2025-10-22T22:09:25.528351] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:25.535714] [DEBUG] [LOCAL ] GPJA: Loaded 4108 existing records from primary storage. [2025-10-22T22:09:25.536090] [INFO ] [MAIN ] GPJA: Loaded 4108 primary data records. [2025-10-22T22:09:25.645932] [DEBUG] [LOCAL ] GPI: Loaded 14678 existing records from primary storage. [2025-10-22T22:09:25.649981] [INFO ] [MAIN ] GPI: Loaded 14678 primary data records. [2025-10-22T22:09:26.072959] [DEBUG] [LOCAL ] GPK: Loaded 52780 existing records from primary storage. [2025-10-22T22:09:26.242251] [INFO ] [MAIN ] GPK: Loaded 52780 primary data records. [2025-10-22T22:09:26.591254] [DEBUG] [MAIN ] GPJA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:26.594122] [INFO ] [MAIN ] GPJA: Generated 1794 derivative records from 4108 primary records. [2025-10-22T22:09:26.594462] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-22T22:09:26.615920] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1794 records). [2025-10-22T22:09:26.616384] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-22T22:09:26.619348] [INFO ] [MAIN ] Derivative Progress: 769/2052 symbols completed. GPJA took 1.1s. Estimated remaining: 8m 3s. Rate: 159.3 symbols/min [2025-10-22T22:09:26.619793] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:26.636255] [DEBUG] [MAIN ] GPI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:09:26.637851] [INFO ] [MAIN ] GPI: Generated 1793 derivative records from 14678 primary records. [2025-10-22T22:09:26.637981] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-22T22:09:26.657395] [DEBUG] [LOCAL ] GPI: Derivative data saved (1793 records). [2025-10-22T22:09:26.658081] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-22T22:09:26.660564] [INFO ] [MAIN ] Derivative Progress: 770/2052 symbols completed. GPI took 1.1s. Estimated remaining: 8m 2s. Rate: 159.5 symbols/min [2025-10-22T22:09:26.661122] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:26.688330] [DEBUG] [LOCAL ] GPMT: Loaded 25950 existing records from primary storage. [2025-10-22T22:09:26.701731] [DEBUG] [MAIN ] GPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:26.701944] [INFO ] [MAIN ] GPMT: Loaded 25950 primary data records. [2025-10-22T22:09:26.703340] [INFO ] [MAIN ] GPK: Generated 1794 derivative records from 52780 primary records. [2025-10-22T22:09:26.708661] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-22T22:09:26.843597] [DEBUG] [LOCAL ] GPK: Derivative data saved (1794 records). [2025-10-22T22:09:26.868585] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-22T22:09:26.906836] [INFO ] [MAIN ] Derivative Progress: 771/2052 symbols completed. GPK took 1.4s. Estimated remaining: 8m 2s. Rate: 159.6 symbols/min [2025-10-22T22:09:26.938009] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:27.078997] [DEBUG] [LOCAL ] GPN: Loaded 51867 existing records from primary storage. [2025-10-22T22:09:27.079327] [INFO ] [MAIN ] GPN: Loaded 51867 primary data records. [2025-10-22T22:09:27.266327] [DEBUG] [LOCAL ] GPOR: Loaded 23317 existing records from primary storage. [2025-10-22T22:09:27.287762] [INFO ] [MAIN ] GPOR: Loaded 23317 primary data records. [2025-10-22T22:09:27.551202] [DEBUG] [MAIN ] GPMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:27.609351] [INFO ] [MAIN ] GPMT: Generated 1794 derivative records from 25950 primary records. [2025-10-22T22:09:27.721425] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-22T22:09:27.751258] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1794 records). [2025-10-22T22:09:27.751719] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-22T22:09:27.754609] [INFO ] [MAIN ] Derivative Progress: 772/2052 symbols completed. GPMT took 1.1s. Estimated remaining: 8m 2s. Rate: 159.3 symbols/min [2025-10-22T22:09:27.756176] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:27.778290] [DEBUG] [MAIN ] GPN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:27.779130] [INFO ] [MAIN ] GPN: Generated 1794 derivative records from 51867 primary records. [2025-10-22T22:09:27.779338] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-22T22:09:27.799773] [DEBUG] [LOCAL ] GPN: Derivative data saved (1794 records). [2025-10-22T22:09:27.812011] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-22T22:09:27.827289] [INFO ] [MAIN ] Derivative Progress: 773/2052 symbols completed. GPN took 1.2s. Estimated remaining: 8m 1s. Rate: 159.5 symbols/min [2025-10-22T22:09:27.827984] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:27.827698] [DEBUG] [MAIN ] GPOR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:09:27.829399] [INFO ] [MAIN ] GPOR: Generated 1793 derivative records from 23317 primary records. [2025-10-22T22:09:27.829479] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-22T22:09:27.847371] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1793 records). [2025-10-22T22:09:27.847596] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-10-22T22:09:27.850844] [INFO ] [MAIN ] Derivative Progress: 774/2052 symbols completed. GPOR took 0.9s. Estimated remaining: 8m 0s. Rate: 159.7 symbols/min [2025-10-22T22:09:27.851281] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:27.866238] [DEBUG] [LOCAL ] GPRK: Loaded 39851 existing records from primary storage. [2025-10-22T22:09:27.866401] [INFO ] [MAIN ] GPRK: Loaded 39851 primary data records. [2025-10-22T22:09:27.948962] [DEBUG] [LOCAL ] GRC: Loaded 9268 existing records from primary storage. [2025-10-22T22:09:27.963293] [INFO ] [MAIN ] GRC: Loaded 9268 primary data records. [2025-10-22T22:09:28.085119] [DEBUG] [LOCAL ] GRBK: Loaded 26691 existing records from primary storage. [2025-10-22T22:09:28.101494] [INFO ] [MAIN ] GRBK: Loaded 26691 primary data records. [2025-10-22T22:09:28.939287] [DEBUG] [MAIN ] GPRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:28.939569] [DEBUG] [MAIN ] GRC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:09:28.941137] [INFO ] [MAIN ] GPRK: Generated 1794 derivative records from 39851 primary records. [2025-10-22T22:09:28.942378] [INFO ] [MAIN ] GRC: Generated 1793 derivative records from 9268 primary records. [2025-10-22T22:09:28.942928] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-22T22:09:28.943055] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-22T22:09:28.986877] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1794 records). [2025-10-22T22:09:28.992575] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-10-22T22:09:28.992846] [DEBUG] [MAIN ] GRBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:28.997208] [DEBUG] [LOCAL ] GRC: Derivative data saved (1793 records). [2025-10-22T22:09:28.998338] [INFO ] [MAIN ] GRBK: Generated 1794 derivative records from 26691 primary records. [2025-10-22T22:09:28.997337] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-22T22:09:28.997000] [INFO ] [MAIN ] Derivative Progress: 775/2052 symbols completed. GPRK took 1.2s. Estimated remaining: 8m 1s. Rate: 159.2 symbols/min [2025-10-22T22:09:29.002266] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:28.998487] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-22T22:09:29.002409] [INFO ] [MAIN ] Derivative Progress: 776/2052 symbols completed. GRC took 1.2s. Estimated remaining: 8m 0s. Rate: 159.4 symbols/min [2025-10-22T22:09:29.004387] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:29.020934] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1794 records). [2025-10-22T22:09:29.021217] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-22T22:09:29.025260] [INFO ] [MAIN ] Derivative Progress: 777/2052 symbols completed. GRBK took 1.2s. Estimated remaining: 7m 59s. Rate: 159.6 symbols/min [2025-10-22T22:09:29.025525] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:29.049951] [DEBUG] [LOCAL ] GRDN: Loaded 21258 existing records from primary storage. [2025-10-22T22:09:29.050140] [INFO ] [MAIN ] GRDN: Loaded 21258 primary data records. [2025-10-22T22:09:29.225238] [DEBUG] [LOCAL ] GRMN: Loaded 39812 existing records from primary storage. [2025-10-22T22:09:29.246776] [INFO ] [MAIN ] GRMN: Loaded 39812 primary data records. [2025-10-22T22:09:29.269818] [DEBUG] [LOCAL ] GRND: Loaded 50191 existing records from primary storage. [2025-10-22T22:09:29.279929] [INFO ] [MAIN ] GRND: Loaded 50191 primary data records. [2025-10-22T22:09:30.116321] [DEBUG] [MAIN ] GRDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:30.118296] [INFO ] [MAIN ] GRDN: Generated 1794 derivative records from 21258 primary records. [2025-10-22T22:09:30.118834] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-22T22:09:30.138553] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1794 records). [2025-10-22T22:09:30.139705] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-22T22:09:30.141740] [INFO ] [MAIN ] Derivative Progress: 778/2052 symbols completed. GRDN took 1.1s. Estimated remaining: 8m 0s. Rate: 159.2 symbols/min [2025-10-22T22:09:30.172582] [DEBUG] [MAIN ] GRND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:30.174039] [INFO ] [MAIN ] GRND: Generated 1794 derivative records from 50191 primary records. [2025-10-22T22:09:30.174123] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-22T22:09:30.173056] [DEBUG] [MAIN ] GRMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:30.175497] [INFO ] [MAIN ] GRMN: Generated 1794 derivative records from 39812 primary records. [2025-10-22T22:09:30.175895] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-22T22:09:30.208726] [DEBUG] [LOCAL ] GRND: Derivative data saved (1794 records). [2025-10-22T22:09:30.209765] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-22T22:09:30.214741] [INFO ] [MAIN ] Derivative Progress: 779/2052 symbols completed. GRND took 1.2s. Estimated remaining: 7m 59s. Rate: 159.4 symbols/min [2025-10-22T22:09:30.214913] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1794 records). [2025-10-22T22:09:30.215268] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-22T22:09:30.218100] [INFO ] [MAIN ] Derivative Progress: 780/2052 symbols completed. GRMN took 1.2s. Estimated remaining: 7m 58s. Rate: 159.6 symbols/min [2025-10-22T22:09:30.218857] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:30.218973] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:30.219436] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:30.232568] [DEBUG] [LOCAL ] GRX: Loaded 4839 existing records from primary storage. [2025-10-22T22:09:30.232810] [INFO ] [MAIN ] GRX: Loaded 4839 primary data records. [2025-10-22T22:09:30.292853] [DEBUG] [LOCAL ] GROV: Loaded 8616 existing records from primary storage. [2025-10-22T22:09:30.311723] [INFO ] [MAIN ] GROV: Loaded 8616 primary data records. [2025-10-22T22:09:30.466802] [DEBUG] [LOCAL ] GRNT: Loaded 33953 existing records from primary storage. [2025-10-22T22:09:30.501873] [INFO ] [MAIN ] GRNT: Loaded 33953 primary data records. [2025-10-22T22:09:31.300943] [DEBUG] [MAIN ] GRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:31.303090] [INFO ] [MAIN ] GRX: Generated 1794 derivative records from 4839 primary records. [2025-10-22T22:09:31.303486] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-22T22:09:31.320597] [DEBUG] [MAIN ] GROV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:31.333799] [INFO ] [MAIN ] GROV: Generated 1794 derivative records from 8616 primary records. [2025-10-22T22:09:31.340492] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-22T22:09:31.346183] [DEBUG] [LOCAL ] GRX: Derivative data saved (1794 records). [2025-10-22T22:09:31.346785] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-22T22:09:31.349441] [INFO ] [MAIN ] Derivative Progress: 781/2052 symbols completed. GRX took 1.1s. Estimated remaining: 7m 59s. Rate: 159.2 symbols/min [2025-10-22T22:09:31.356638] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:31.370457] [DEBUG] [LOCAL ] GROV: Derivative data saved (1794 records). [2025-10-22T22:09:31.379300] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-22T22:09:31.381930] [INFO ] [MAIN ] Derivative Progress: 782/2052 symbols completed. GROV took 1.2s. Estimated remaining: 7m 58s. Rate: 159.4 symbols/min [2025-10-22T22:09:31.387430] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:31.388679] [DEBUG] [MAIN ] GRNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:31.389750] [INFO ] [MAIN ] GRNT: Generated 1794 derivative records from 33953 primary records. [2025-10-22T22:09:31.390018] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-22T22:09:31.407862] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1794 records). [2025-10-22T22:09:31.408779] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-22T22:09:31.412434] [INFO ] [MAIN ] Derivative Progress: 783/2052 symbols completed. GRNT took 1.2s. Estimated remaining: 7m 57s. Rate: 159.6 symbols/min [2025-10-22T22:09:31.412837] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:31.474813] [DEBUG] [LOCAL ] GS: Loaded 51777 existing records from primary storage. [2025-10-22T22:09:31.475112] [INFO ] [MAIN ] GS: Loaded 51777 primary data records. [2025-10-22T22:09:31.475786] [DEBUG] [LOCAL ] GSBD: Loaded 39527 existing records from primary storage. [2025-10-22T22:09:31.508024] [INFO ] [MAIN ] GSBD: Loaded 39527 primary data records. [2025-10-22T22:09:31.908821] [DEBUG] [LOCAL ] GSK: Loaded 53511 existing records from primary storage. [2025-10-22T22:09:31.933495] [INFO ] [MAIN ] GSK: Loaded 53511 primary data records. [2025-10-22T22:09:32.555567] [DEBUG] [MAIN ] GSBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:32.563811] [INFO ] [MAIN ] GSBD: Generated 1794 derivative records from 39527 primary records. [2025-10-22T22:09:32.569297] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-22T22:09:32.570417] [DEBUG] [MAIN ] GS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:32.571779] [INFO ] [MAIN ] GS: Generated 1794 derivative records from 51777 primary records. [2025-10-22T22:09:32.571873] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-22T22:09:32.603496] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1794 records). [2025-10-22T22:09:32.602826] [DEBUG] [LOCAL ] GS: Derivative data saved (1794 records). [2025-10-22T22:09:32.603749] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-22T22:09:32.606224] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-22T22:09:32.606145] [INFO ] [MAIN ] Derivative Progress: 784/2052 symbols completed. GS took 1.2s. Estimated remaining: 7m 58s. Rate: 159.1 symbols/min [2025-10-22T22:09:32.608425] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:32.608942] [INFO ] [MAIN ] Derivative Progress: 785/2052 symbols completed. GSBD took 1.2s. Estimated remaining: 7m 57s. Rate: 159.3 symbols/min [2025-10-22T22:09:32.609249] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:32.625162] [DEBUG] [MAIN ] GSK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:32.625890] [INFO ] [MAIN ] GSK: Generated 1794 derivative records from 53511 primary records. [2025-10-22T22:09:32.626017] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-22T22:09:32.641775] [DEBUG] [LOCAL ] GSK: Derivative data saved (1794 records). [2025-10-22T22:09:32.641987] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-22T22:09:32.644505] [INFO ] [MAIN ] Derivative Progress: 786/2052 symbols completed. GSK took 1.2s. Estimated remaining: 7m 56s. Rate: 159.5 symbols/min [2025-10-22T22:09:32.644686] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:32.679208] [DEBUG] [LOCAL ] GSL: Loaded 32919 existing records from primary storage. [2025-10-22T22:09:32.679360] [INFO ] [MAIN ] GSL: Loaded 32919 primary data records. [2025-10-22T22:09:32.808007] [DEBUG] [LOCAL ] GTES: Loaded 50288 existing records from primary storage. [2025-10-22T22:09:32.814179] [INFO ] [MAIN ] GTES: Loaded 50288 primary data records. [2025-10-22T22:09:33.107766] [DEBUG] [LOCAL ] GTLS: Loaded 43141 existing records from primary storage. [2025-10-22T22:09:33.120473] [INFO ] [MAIN ] GTLS: Loaded 43141 primary data records. [2025-10-22T22:09:33.631923] [DEBUG] [MAIN ] GSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:33.634463] [INFO ] [MAIN ] GSL: Generated 1794 derivative records from 32919 primary records. [2025-10-22T22:09:33.634766] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-22T22:09:33.656991] [DEBUG] [LOCAL ] GSL: Derivative data saved (1794 records). [2025-10-22T22:09:33.657547] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-22T22:09:33.661355] [INFO ] [MAIN ] Derivative Progress: 787/2052 symbols completed. GSL took 1.1s. Estimated remaining: 7m 57s. Rate: 159.2 symbols/min [2025-10-22T22:09:33.661627] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:33.676736] [DEBUG] [MAIN ] GTES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:33.677904] [INFO ] [MAIN ] GTES: Generated 1794 derivative records from 50288 primary records. [2025-10-22T22:09:33.678274] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-22T22:09:33.695190] [DEBUG] [LOCAL ] GTES: Derivative data saved (1794 records). [2025-10-22T22:09:33.695400] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-22T22:09:33.697838] [INFO ] [MAIN ] Derivative Progress: 788/2052 symbols completed. GTES took 1.1s. Estimated remaining: 7m 56s. Rate: 159.4 symbols/min [2025-10-22T22:09:33.698954] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:33.715316] [DEBUG] [MAIN ] GTLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:33.716110] [INFO ] [MAIN ] GTLS: Generated 1794 derivative records from 43141 primary records. [2025-10-22T22:09:33.716222] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-22T22:09:33.733333] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1794 records). [2025-10-22T22:09:33.733453] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-10-22T22:09:33.736992] [INFO ] [MAIN ] Derivative Progress: 789/2052 symbols completed. GTLS took 1.1s. Estimated remaining: 7m 55s. Rate: 159.5 symbols/min [2025-10-22T22:09:33.737360] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:33.780773] [DEBUG] [LOCAL ] GTY: Loaded 30006 existing records from primary storage. [2025-10-22T22:09:33.781233] [DEBUG] [LOCAL ] GUG: Loaded 12168 existing records from primary storage. [2025-10-22T22:09:33.781813] [INFO ] [MAIN ] GTY: Loaded 30006 primary data records. [2025-10-22T22:09:33.781967] [INFO ] [MAIN ] GUG: Loaded 12168 primary data records. [2025-10-22T22:09:33.899152] [DEBUG] [LOCAL ] GTN: Loaded 44840 existing records from primary storage. [2025-10-22T22:09:33.923697] [INFO ] [MAIN ] GTN: Loaded 44840 primary data records. [2025-10-22T22:09:34.791333] [DEBUG] [MAIN ] GUG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:34.792495] [INFO ] [MAIN ] GUG: Generated 1794 derivative records from 12168 primary records. [2025-10-22T22:09:34.792591] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-22T22:09:34.805380] [DEBUG] [MAIN ] GTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:34.806503] [INFO ] [MAIN ] GTY: Generated 1794 derivative records from 30006 primary records. [2025-10-22T22:09:34.806812] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-22T22:09:34.824135] [DEBUG] [LOCAL ] GUG: Derivative data saved (1794 records). [2025-10-22T22:09:34.845236] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-10-22T22:09:34.848633] [INFO ] [MAIN ] Derivative Progress: 790/2052 symbols completed. GUG took 1.1s. Estimated remaining: 7m 56s. Rate: 159.1 symbols/min [2025-10-22T22:09:34.853052] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:34.855596] [DEBUG] [LOCAL ] GTY: Derivative data saved (1794 records). [2025-10-22T22:09:34.855814] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-22T22:09:34.859007] [INFO ] [MAIN ] Derivative Progress: 791/2052 symbols completed. GTY took 1.2s. Estimated remaining: 7m 55s. Rate: 159.3 symbols/min [2025-10-22T22:09:34.859446] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:34.872800] [DEBUG] [MAIN ] GTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:34.873942] [INFO ] [MAIN ] GTN: Generated 1794 derivative records from 44840 primary records. [2025-10-22T22:09:34.874145] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-22T22:09:34.898075] [DEBUG] [LOCAL ] GUT: Loaded 15487 existing records from primary storage. [2025-10-22T22:09:34.898802] [INFO ] [MAIN ] GUT: Loaded 15487 primary data records. [2025-10-22T22:09:34.944292] [DEBUG] [LOCAL ] GTN: Derivative data saved (1794 records). [2025-10-22T22:09:34.977326] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-22T22:09:35.014701] [INFO ] [MAIN ] Derivative Progress: 792/2052 symbols completed. GTN took 1.4s. Estimated remaining: 7m 54s. Rate: 159.5 symbols/min [2025-10-22T22:09:35.025746] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:35.201545] [DEBUG] [LOCAL ] GVA: Loaded 32580 existing records from primary storage. [2025-10-22T22:09:35.214560] [INFO ] [MAIN ] GVA: Loaded 32580 primary data records. [2025-10-22T22:09:35.330722] [DEBUG] [LOCAL ] GWH: Loaded 20115 existing records from primary storage. [2025-10-22T22:09:35.351865] [INFO ] [MAIN ] GWH: Loaded 20115 primary data records. [2025-10-22T22:09:35.842057] [DEBUG] [MAIN ] GUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:35.844342] [INFO ] [MAIN ] GUT: Generated 1794 derivative records from 15487 primary records. [2025-10-22T22:09:35.844602] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-22T22:09:35.861013] [DEBUG] [LOCAL ] GUT: Derivative data saved (1794 records). [2025-10-22T22:09:35.861161] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-22T22:09:35.863128] [INFO ] [MAIN ] Derivative Progress: 793/2052 symbols completed. GUT took 1.0s. Estimated remaining: 7m 54s. Rate: 159.2 symbols/min [2025-10-22T22:09:35.883245] [DEBUG] [MAIN ] GVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:35.884445] [INFO ] [MAIN ] GVA: Generated 1794 derivative records from 32580 primary records. [2025-10-22T22:09:35.884716] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-22T22:09:35.922759] [DEBUG] [LOCAL ] GVA: Derivative data saved (1794 records). [2025-10-22T22:09:35.923017] [DEBUG] [MAIN ] GWH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:35.923848] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-10-22T22:09:35.923782] [INFO ] [MAIN ] GWH: Generated 1794 derivative records from 20115 primary records. [2025-10-22T22:09:35.923941] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-22T22:09:35.926431] [INFO ] [MAIN ] Derivative Progress: 794/2052 symbols completed. GVA took 1.1s. Estimated remaining: 7m 54s. Rate: 159.4 symbols/min [2025-10-22T22:09:35.941559] [DEBUG] [LOCAL ] GWH: Derivative data saved (1794 records). [2025-10-22T22:09:35.941666] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-22T22:09:35.944193] [INFO ] [MAIN ] Derivative Progress: 795/2052 symbols completed. GWH took 0.9s. Estimated remaining: 7m 53s. Rate: 159.6 symbols/min [2025-10-22T22:09:35.944538] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:35.944588] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:35.944731] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:35.966167] [DEBUG] [LOCAL ] GWW: Loaded 19181 existing records from primary storage. [2025-10-22T22:09:35.966353] [INFO ] [MAIN ] GWW: Loaded 19181 primary data records. [2025-10-22T22:09:36.124494] [DEBUG] [LOCAL ] GWRE: Loaded 39608 existing records from primary storage. [2025-10-22T22:09:36.183358] [INFO ] [MAIN ] GWRE: Loaded 39608 primary data records. [2025-10-22T22:09:36.343715] [DEBUG] [LOCAL ] GXO: Loaded 46455 existing records from primary storage. [2025-10-22T22:09:36.355905] [INFO ] [MAIN ] GXO: Loaded 46455 primary data records. [2025-10-22T22:09:36.991088] [DEBUG] [MAIN ] GWW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:36.993974] [INFO ] [MAIN ] GWW: Generated 1794 derivative records from 19181 primary records. [2025-10-22T22:09:36.994927] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-22T22:09:37.016994] [DEBUG] [LOCAL ] GWW: Derivative data saved (1794 records). [2025-10-22T22:09:37.017422] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-10-22T22:09:37.019868] [INFO ] [MAIN ] Derivative Progress: 796/2052 symbols completed. GWW took 1.1s. Estimated remaining: 7m 53s. Rate: 159.2 symbols/min [2025-10-22T22:09:37.032801] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:37.033225] [DEBUG] [MAIN ] GWRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:37.034311] [INFO ] [MAIN ] GWRE: Generated 1794 derivative records from 39608 primary records. [2025-10-22T22:09:37.034425] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-10-22T22:09:37.049182] [DEBUG] [LOCAL ] GYLD: Loaded 1532 existing records from primary storage. [2025-10-22T22:09:37.051892] [INFO ] [MAIN ] GYLD: Loaded 1532 primary data records. [2025-10-22T22:09:37.090451] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1794 records). [2025-10-22T22:09:37.124311] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-10-22T22:09:37.124716] [DEBUG] [MAIN ] GXO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:37.147145] [INFO ] [MAIN ] Derivative Progress: 797/2052 symbols completed. GWRE took 1.2s. Estimated remaining: 7m 53s. Rate: 159.3 symbols/min [2025-10-22T22:09:37.157733] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:37.164368] [INFO ] [MAIN ] GXO: Generated 1794 derivative records from 46455 primary records. [2025-10-22T22:09:37.175356] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-10-22T22:09:37.247791] [DEBUG] [LOCAL ] GXO: Derivative data saved (1794 records). [2025-10-22T22:09:37.248017] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-10-22T22:09:37.250998] [INFO ] [MAIN ] Derivative Progress: 798/2052 symbols completed. GXO took 1.3s. Estimated remaining: 7m 52s. Rate: 159.5 symbols/min [2025-10-22T22:09:37.269275] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:37.445272] [DEBUG] [LOCAL ] H: Loaded 44372 existing records from primary storage. [2025-10-22T22:09:37.457253] [INFO ] [MAIN ] H: Loaded 44372 primary data records. [2025-10-22T22:09:37.444280] [DEBUG] [LOCAL ] HAE: Loaded 39324 existing records from primary storage. [2025-10-22T22:09:37.475115] [INFO ] [MAIN ] HAE: Loaded 39324 primary data records. [2025-10-22T22:09:37.475551] [DEBUG] [MAIN ] GYLD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:09:37.494304] [INFO ] [MAIN ] GYLD: Generated 1793 derivative records from 1532 primary records. [2025-10-22T22:09:37.499674] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-10-22T22:09:37.699835] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1793 records). [2025-10-22T22:09:37.700007] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-10-22T22:09:37.707815] [INFO ] [MAIN ] Derivative Progress: 799/2052 symbols completed. GYLD took 0.7s. Estimated remaining: 7m 52s. Rate: 159.4 symbols/min [2025-10-22T22:09:37.733884] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:38.142637] [DEBUG] [LOCAL ] HAFN: Loaded 42607 existing records from primary storage. [2025-10-22T22:09:38.143226] [INFO ] [MAIN ] HAFN: Loaded 42607 primary data records. [2025-10-22T22:09:38.293829] [DEBUG] [MAIN ] HAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:38.316859] [INFO ] [MAIN ] HAE: Generated 1794 derivative records from 39324 primary records. [2025-10-22T22:09:38.293451] [DEBUG] [MAIN ] H: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:38.317047] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-10-22T22:09:38.333082] [INFO ] [MAIN ] H: Generated 1794 derivative records from 44372 primary records. [2025-10-22T22:09:38.333243] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-10-22T22:09:38.544787] [DEBUG] [LOCAL ] HAE: Derivative data saved (1794 records). [2025-10-22T22:09:38.545883] [DEBUG] [LOCAL ] H: Derivative data saved (1794 records). [2025-10-22T22:09:38.545985] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-10-22T22:09:38.546072] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-10-22T22:09:38.548154] [INFO ] [MAIN ] Derivative Progress: 800/2052 symbols completed. HAE took 1.3s. Estimated remaining: 7m 52s. Rate: 159.2 symbols/min [2025-10-22T22:09:38.551350] [INFO ] [MAIN ] Derivative Progress: 801/2052 symbols completed. H took 1.4s. Estimated remaining: 7m 51s. Rate: 159.4 symbols/min [2025-10-22T22:09:38.551493] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:38.551187] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:38.577328] [DEBUG] [MAIN ] HAFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:38.578068] [INFO ] [MAIN ] HAFN: Generated 1794 derivative records from 42607 primary records. [2025-10-22T22:09:38.578185] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-10-22T22:09:38.603894] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1794 records). [2025-10-22T22:09:38.615704] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-10-22T22:09:38.618398] [INFO ] [MAIN ] Derivative Progress: 802/2052 symbols completed. HAFN took 0.9s. Estimated remaining: 7m 50s. Rate: 159.5 symbols/min [2025-10-22T22:09:38.618745] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:38.651031] [DEBUG] [LOCAL ] HASI: Loaded 47728 existing records from primary storage. [2025-10-22T22:09:38.652228] [INFO ] [MAIN ] HASI: Loaded 47728 primary data records. [2025-10-22T22:09:38.684011] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-22T22:09:38.716716] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-10-22T22:09:39.027792] [DEBUG] [LOCAL ] HAYW: Loaded 48803 existing records from primary storage. [2025-10-22T22:09:39.182694] [INFO ] [MAIN ] HAYW: Loaded 48803 primary data records. [2025-10-22T22:09:39.603167] [DEBUG] [MAIN ] HASI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:39.605304] [INFO ] [MAIN ] HASI: Generated 1794 derivative records from 47728 primary records. [2025-10-22T22:09:39.613840] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-10-22T22:09:39.619733] [DEBUG] [MAIN ] HAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:39.627632] [INFO ] [MAIN ] HAL: Generated 1794 derivative records from 53718 primary records. [2025-10-22T22:09:39.635309] [DEBUG] [LOCAL ] HASI: Derivative data saved (1794 records). [2025-10-22T22:09:39.634240] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-10-22T22:09:39.635449] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-10-22T22:09:39.638312] [INFO ] [MAIN ] Derivative Progress: 803/2052 symbols completed. HASI took 1.1s. Estimated remaining: 7m 51s. Rate: 159.2 symbols/min [2025-10-22T22:09:39.638560] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:39.655049] [DEBUG] [LOCAL ] HAL: Derivative data saved (1794 records). [2025-10-22T22:09:39.656389] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-10-22T22:09:39.658688] [INFO ] [MAIN ] Derivative Progress: 804/2052 symbols completed. HAL took 1.1s. Estimated remaining: 7m 50s. Rate: 159.4 symbols/min [2025-10-22T22:09:39.658927] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:39.664878] [DEBUG] [LOCAL ] HBB: Loaded 6298 existing records from primary storage. [2025-10-22T22:09:39.665172] [INFO ] [MAIN ] HBB: Loaded 6298 primary data records. [2025-10-22T22:09:39.732240] [DEBUG] [MAIN ] HAYW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:39.763457] [INFO ] [MAIN ] HAYW: Generated 1794 derivative records from 48803 primary records. [2025-10-22T22:09:39.779471] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-10-22T22:09:39.997208] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1794 records). [2025-10-22T22:09:39.997350] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-10-22T22:09:40.000026] [INFO ] [MAIN ] Derivative Progress: 805/2052 symbols completed. HAYW took 1.4s. Estimated remaining: 7m 49s. Rate: 159.4 symbols/min [2025-10-22T22:09:40.000390] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:40.027256] [DEBUG] [LOCAL ] HBI: Loaded 52906 existing records from primary storage. [2025-10-22T22:09:40.027987] [INFO ] [MAIN ] HBI: Loaded 52906 primary data records. [2025-10-22T22:09:40.419621] [DEBUG] [MAIN ] HBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:40.422299] [INFO ] [MAIN ] HBB: Generated 1794 derivative records from 6298 primary records. [2025-10-22T22:09:40.421094] [DEBUG] [LOCAL ] HBM: Loaded 52980 existing records from primary storage. [2025-10-22T22:09:40.422852] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-10-22T22:09:40.422913] [INFO ] [MAIN ] HBM: Loaded 52980 primary data records. [2025-10-22T22:09:40.546012] [DEBUG] [LOCAL ] HBB: Derivative data saved (1794 records). [2025-10-22T22:09:40.546158] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-10-22T22:09:40.548302] [INFO ] [MAIN ] Derivative Progress: 806/2052 symbols completed. HBB took 0.9s. Estimated remaining: 7m 49s. Rate: 159.3 symbols/min [2025-10-22T22:09:40.554513] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:40.765034] [DEBUG] [MAIN ] HBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:40.766238] [INFO ] [MAIN ] HBI: Generated 1794 derivative records from 52906 primary records. [2025-10-22T22:09:40.766468] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-10-22T22:09:40.792667] [DEBUG] [LOCAL ] HBI: Derivative data saved (1794 records). [2025-10-22T22:09:40.793070] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-10-22T22:09:40.795118] [INFO ] [MAIN ] Derivative Progress: 807/2052 symbols completed. HBI took 1.1s. Estimated remaining: 7m 49s. Rate: 159.4 symbols/min [2025-10-22T22:09:40.796305] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:40.810436] [DEBUG] [LOCAL ] HCA: Loaded 46893 existing records from primary storage. [2025-10-22T22:09:40.810842] [INFO ] [MAIN ] HCA: Loaded 46893 primary data records. [2025-10-22T22:09:40.948718] [DEBUG] [MAIN ] HBM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:40.965131] [INFO ] [MAIN ] HBM: Generated 1794 derivative records from 52980 primary records. [2025-10-22T22:09:41.009766] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-10-22T22:09:41.142419] [DEBUG] [LOCAL ] HCC: Loaded 44974 existing records from primary storage. [2025-10-22T22:09:41.151171] [INFO ] [MAIN ] HCC: Loaded 44974 primary data records. [2025-10-22T22:09:41.241212] [DEBUG] [LOCAL ] HBM: Derivative data saved (1794 records). [2025-10-22T22:09:41.262488] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-10-22T22:09:41.264607] [INFO ] [MAIN ] Derivative Progress: 808/2052 symbols completed. HBM took 1.3s. Estimated remaining: 7m 48s. Rate: 159.3 symbols/min [2025-10-22T22:09:41.473593] [DEBUG] [MAIN ] HCA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:41.474489] [INFO ] [MAIN ] HCA: Generated 1794 derivative records from 46893 primary records. [2025-10-22T22:09:41.474578] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-10-22T22:09:41.494153] [DEBUG] [LOCAL ] HCA: Derivative data saved (1794 records). [2025-10-22T22:09:41.495022] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-10-22T22:09:41.497291] [INFO ] [MAIN ] Derivative Progress: 809/2052 symbols completed. HCA took 0.9s. Estimated remaining: 7m 48s. Rate: 159.4 symbols/min [2025-10-22T22:09:41.515202] [DEBUG] [MAIN ] HCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:41.515851] [INFO ] [MAIN ] HCC: Generated 1794 derivative records from 44974 primary records. [2025-10-22T22:09:41.515912] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-10-22T22:09:41.531976] [DEBUG] [LOCAL ] HCC: Derivative data saved (1794 records). [2025-10-22T22:09:41.532058] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-10-22T22:09:41.534142] [INFO ] [MAIN ] Derivative Progress: 810/2052 symbols completed. HCC took 0.7s. Estimated remaining: 7m 47s. Rate: 159.6 symbols/min [2025-10-22T22:09:41.534680] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:41.534855] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:41.534778] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:41.552804] [DEBUG] [LOCAL ] HCI: Loaded 14079 existing records from primary storage. [2025-10-22T22:09:41.552971] [INFO ] [MAIN ] HCI: Loaded 14079 primary data records. [2025-10-22T22:09:41.997564] [DEBUG] [LOCAL ] HD: Loaded 53467 existing records from primary storage. [2025-10-22T22:09:41.997882] [INFO ] [MAIN ] HD: Loaded 53467 primary data records. [2025-10-22T22:09:42.012731] [DEBUG] [LOCAL ] HDB: Loaded 51909 existing records from primary storage. [2025-10-22T22:09:42.013110] [INFO ] [MAIN ] HDB: Loaded 51909 primary data records. [2025-10-22T22:09:42.798337] [DEBUG] [MAIN ] HCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:42.799410] [INFO ] [MAIN ] HCI: Generated 1794 derivative records from 14079 primary records. [2025-10-22T22:09:42.799799] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-10-22T22:09:42.819015] [DEBUG] [LOCAL ] HCI: Derivative data saved (1794 records). [2025-10-22T22:09:42.819475] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-10-22T22:09:42.821886] [INFO ] [MAIN ] Derivative Progress: 811/2052 symbols completed. HCI took 1.3s. Estimated remaining: 7m 48s. Rate: 159.1 symbols/min [2025-10-22T22:09:42.822157] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:42.853797] [DEBUG] [MAIN ] HD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:42.854994] [INFO ] [MAIN ] HD: Generated 1794 derivative records from 53467 primary records. [2025-10-22T22:09:42.855386] [DEBUG] [MAIN ] HDB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:42.855589] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-10-22T22:09:42.856527] [INFO ] [MAIN ] HDB: Generated 1794 derivative records from 51909 primary records. [2025-10-22T22:09:42.857136] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-10-22T22:09:42.890489] [DEBUG] [LOCAL ] HDB: Derivative data saved (1794 records). [2025-10-22T22:09:42.886674] [DEBUG] [LOCAL ] HD: Derivative data saved (1794 records). [2025-10-22T22:09:42.890779] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-10-22T22:09:42.893312] [INFO ] [MAIN ] Derivative Progress: 812/2052 symbols completed. HDB took 1.4s. Estimated remaining: 7m 47s. Rate: 159.3 symbols/min [2025-10-22T22:09:42.893407] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-10-22T22:09:42.903813] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:42.906108] [INFO ] [MAIN ] Derivative Progress: 813/2052 symbols completed. HD took 1.4s. Estimated remaining: 7m 46s. Rate: 159.5 symbols/min [2025-10-22T22:09:42.906429] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:42.915182] [DEBUG] [LOCAL ] HEQ: Loaded 6756 existing records from primary storage. [2025-10-22T22:09:42.916009] [INFO ] [MAIN ] HEQ: Loaded 6756 primary data records. [2025-10-22T22:09:42.991886] [DEBUG] [LOCAL ] HE: Loaded 48806 existing records from primary storage. [2025-10-22T22:09:43.012313] [INFO ] [MAIN ] HE: Loaded 48806 primary data records. [2025-10-22T22:09:43.119445] [DEBUG] [LOCAL ] HEI: Loaded 30521 existing records from primary storage. [2025-10-22T22:09:43.126185] [INFO ] [MAIN ] HEI: Loaded 30521 primary data records. [2025-10-22T22:09:43.903893] [DEBUG] [MAIN ] HEQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:43.904836] [INFO ] [MAIN ] HEQ: Generated 1794 derivative records from 6756 primary records. [2025-10-22T22:09:43.905131] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-10-22T22:09:43.922707] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1794 records). [2025-10-22T22:09:43.937319] [DEBUG] [MAIN ] HE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:43.938110] [INFO ] [MAIN ] HE: Generated 1794 derivative records from 48806 primary records. [2025-10-22T22:09:43.938303] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-10-22T22:09:43.936500] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-10-22T22:09:43.940254] [INFO ] [MAIN ] Derivative Progress: 814/2052 symbols completed. HEQ took 1.0s. Estimated remaining: 7m 47s. Rate: 159.1 symbols/min [2025-10-22T22:09:43.941250] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:43.968970] [DEBUG] [LOCAL ] HE: Derivative data saved (1794 records). [2025-10-22T22:09:43.968897] [DEBUG] [MAIN ] HEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:43.969177] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-10-22T22:09:43.969912] [INFO ] [MAIN ] HEI: Generated 1794 derivative records from 30521 primary records. [2025-10-22T22:09:43.972093] [INFO ] [MAIN ] Derivative Progress: 815/2052 symbols completed. HE took 1.1s. Estimated remaining: 7m 46s. Rate: 159.3 symbols/min [2025-10-22T22:09:43.972317] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:43.972665] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-10-22T22:09:43.989411] [DEBUG] [LOCAL ] HEI: Derivative data saved (1794 records). [2025-10-22T22:09:43.989617] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-10-22T22:09:43.992115] [INFO ] [MAIN ] Derivative Progress: 816/2052 symbols completed. HEI took 1.1s. Estimated remaining: 7m 45s. Rate: 159.5 symbols/min [2025-10-22T22:09:43.992482] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:44.004668] [DEBUG] [LOCAL ] HFRO: Loaded 16376 existing records from primary storage. [2025-10-22T22:09:44.004799] [INFO ] [MAIN ] HFRO: Loaded 16376 primary data records. [2025-10-22T22:09:44.128479] [DEBUG] [LOCAL ] HGER: Loaded 15543 existing records from primary storage. [2025-10-22T22:09:44.134324] [INFO ] [MAIN ] HGER: Loaded 15543 primary data records. [2025-10-22T22:09:44.234181] [DEBUG] [LOCAL ] HESM: Loaded 48607 existing records from primary storage. [2025-10-22T22:09:44.302795] [INFO ] [MAIN ] HESM: Loaded 48607 primary data records. [2025-10-22T22:09:44.995312] [DEBUG] [MAIN ] HFRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:44.997282] [INFO ] [MAIN ] HFRO: Generated 1794 derivative records from 16376 primary records. [2025-10-22T22:09:44.997511] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-10-22T22:09:45.010945] [DEBUG] [MAIN ] HGER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:45.011553] [INFO ] [MAIN ] HGER: Generated 1794 derivative records from 15543 primary records. [2025-10-22T22:09:45.011665] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-10-22T22:09:45.039582] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1794 records). [2025-10-22T22:09:45.042587] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-10-22T22:09:45.044763] [INFO ] [MAIN ] Derivative Progress: 817/2052 symbols completed. HFRO took 1.1s. Estimated remaining: 7m 46s. Rate: 159.1 symbols/min [2025-10-22T22:09:45.046820] [DEBUG] [LOCAL ] HGER: Derivative data saved (1794 records). [2025-10-22T22:09:45.047883] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:45.047610] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-10-22T22:09:45.063331] [INFO ] [MAIN ] Derivative Progress: 818/2052 symbols completed. HGER took 1.1s. Estimated remaining: 7m 45s. Rate: 159.3 symbols/min [2025-10-22T22:09:45.063761] [DEBUG] [MAIN ] HESM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:45.063997] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:45.064764] [INFO ] [MAIN ] HESM: Generated 1794 derivative records from 48607 primary records. [2025-10-22T22:09:45.065123] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-10-22T22:09:45.088056] [DEBUG] [LOCAL ] HESM: Derivative data saved (1794 records). [2025-10-22T22:09:45.088314] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-10-22T22:09:45.094883] [INFO ] [MAIN ] Derivative Progress: 819/2052 symbols completed. HESM took 1.2s. Estimated remaining: 7m 44s. Rate: 159.5 symbols/min [2025-10-22T22:09:45.095355] [DEBUG] [LOCAL ] HGLB: Loaded 9621 existing records from primary storage. [2025-10-22T22:09:45.095484] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:45.095808] [INFO ] [MAIN ] HGLB: Loaded 9621 primary data records. [2025-10-22T22:09:45.180148] [DEBUG] [LOCAL ] HGTY: Loaded 13361 existing records from primary storage. [2025-10-22T22:09:45.196481] [INFO ] [MAIN ] HGTY: Loaded 13361 primary data records. [2025-10-22T22:09:45.610879] [DEBUG] [LOCAL ] HGV: Loaded 46058 existing records from primary storage. [2025-10-22T22:09:45.725874] [INFO ] [MAIN ] HGV: Loaded 46058 primary data records. [2025-10-22T22:09:46.064171] [DEBUG] [MAIN ] HGLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:46.065317] [INFO ] [MAIN ] HGLB: Generated 1794 derivative records from 9621 primary records. [2025-10-22T22:09:46.065520] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-10-22T22:09:46.088552] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1794 records). [2025-10-22T22:09:46.102344] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-10-22T22:09:46.104507] [INFO ] [MAIN ] Derivative Progress: 820/2052 symbols completed. HGLB took 1.1s. Estimated remaining: 7m 44s. Rate: 159.2 symbols/min [2025-10-22T22:09:46.105092] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:46.106559] [DEBUG] [MAIN ] HGTY: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:09:46.109730] [INFO ] [MAIN ] HGTY: Generated 1793 derivative records from 13361 primary records. [2025-10-22T22:09:46.109879] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-10-22T22:09:46.127761] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1793 records). [2025-10-22T22:09:46.128058] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-10-22T22:09:46.131379] [INFO ] [MAIN ] Derivative Progress: 821/2052 symbols completed. HGTY took 1.1s. Estimated remaining: 7m 44s. Rate: 159.3 symbols/min [2025-10-22T22:09:46.131949] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:46.164187] [DEBUG] [MAIN ] HGV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:46.165308] [INFO ] [MAIN ] HGV: Generated 1794 derivative records from 46058 primary records. [2025-10-22T22:09:46.165556] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-10-22T22:09:46.194206] [DEBUG] [LOCAL ] HGV: Derivative data saved (1794 records). [2025-10-22T22:09:46.201752] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-10-22T22:09:46.205477] [INFO ] [MAIN ] Derivative Progress: 822/2052 symbols completed. HGV took 1.1s. Estimated remaining: 7m 43s. Rate: 159.5 symbols/min [2025-10-22T22:09:46.207788] [DEBUG] [LOCAL ] HHH: Loaded 33047 existing records from primary storage. [2025-10-22T22:09:46.205696] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:46.208371] [INFO ] [MAIN ] HHH: Loaded 33047 primary data records. [2025-10-22T22:09:46.289295] [DEBUG] [LOCAL ] HI: Loaded 36110 existing records from primary storage. [2025-10-22T22:09:46.312072] [INFO ] [MAIN ] HI: Loaded 36110 primary data records. [2025-10-22T22:09:46.927248] [DEBUG] [LOCAL ] HIG: Loaded 51135 existing records from primary storage. [2025-10-22T22:09:46.928182] [INFO ] [MAIN ] HIG: Loaded 51135 primary data records. [2025-10-22T22:09:47.245494] [DEBUG] [MAIN ] HHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:47.247262] [INFO ] [MAIN ] HHH: Generated 1794 derivative records from 33047 primary records. [2025-10-22T22:09:47.247538] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-10-22T22:09:47.267356] [DEBUG] [LOCAL ] HHH: Derivative data saved (1794 records). [2025-10-22T22:09:47.280772] [DEBUG] [MAIN ] HI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:47.280445] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-10-22T22:09:47.281507] [INFO ] [MAIN ] HI: Generated 1794 derivative records from 36110 primary records. [2025-10-22T22:09:47.283507] [INFO ] [MAIN ] Derivative Progress: 823/2052 symbols completed. HHH took 1.2s. Estimated remaining: 7m 43s. Rate: 159.1 symbols/min [2025-10-22T22:09:47.283940] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-10-22T22:09:47.300570] [DEBUG] [LOCAL ] HI: Derivative data saved (1794 records). [2025-10-22T22:09:47.300755] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-10-22T22:09:47.303204] [INFO ] [MAIN ] Derivative Progress: 824/2052 symbols completed. HI took 1.2s. Estimated remaining: 7m 42s. Rate: 159.3 symbols/min [2025-10-22T22:09:47.317991] [DEBUG] [MAIN ] HIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:47.318532] [INFO ] [MAIN ] HIG: Generated 1794 derivative records from 51135 primary records. [2025-10-22T22:09:47.318592] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-10-22T22:09:47.334492] [DEBUG] [LOCAL ] HIG: Derivative data saved (1794 records). [2025-10-22T22:09:47.334554] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-10-22T22:09:47.336882] [INFO ] [MAIN ] Derivative Progress: 825/2052 symbols completed. HIG took 1.1s. Estimated remaining: 7m 42s. Rate: 159.5 symbols/min [2025-10-22T22:09:47.337317] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:47.337698] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:47.337254] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:47.374260] [DEBUG] [LOCAL ] HIO: Loaded 23941 existing records from primary storage. [2025-10-22T22:09:47.385151] [INFO ] [MAIN ] HIO: Loaded 23941 primary data records. [2025-10-22T22:09:47.522094] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-22T22:09:47.532792] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-10-22T22:09:47.640150] [DEBUG] [LOCAL ] HII: Loaded 33319 existing records from primary storage. [2025-10-22T22:09:47.675041] [INFO ] [MAIN ] HII: Loaded 33319 primary data records. [2025-10-22T22:09:48.353139] [DEBUG] [MAIN ] HIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:48.354276] [INFO ] [MAIN ] HIO: Generated 1794 derivative records from 23941 primary records. [2025-10-22T22:09:48.354458] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-10-22T22:09:48.370395] [DEBUG] [LOCAL ] HIO: Derivative data saved (1794 records). [2025-10-22T22:09:48.372180] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-10-22T22:09:48.374963] [INFO ] [MAIN ] Derivative Progress: 826/2052 symbols completed. HIO took 1.0s. Estimated remaining: 7m 42s. Rate: 159.2 symbols/min [2025-10-22T22:09:48.375346] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:48.388851] [DEBUG] [MAIN ] HIMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:48.389518] [INFO ] [MAIN ] HIMS: Generated 1794 derivative records from 53817 primary records. [2025-10-22T22:09:48.389726] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-10-22T22:09:48.413475] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1794 records). [2025-10-22T22:09:48.413793] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-10-22T22:09:48.416262] [INFO ] [MAIN ] Derivative Progress: 827/2052 symbols completed. HIMS took 1.1s. Estimated remaining: 7m 41s. Rate: 159.3 symbols/min [2025-10-22T22:09:48.424269] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:48.429852] [DEBUG] [MAIN ] HII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:48.430496] [INFO ] [MAIN ] HII: Generated 1794 derivative records from 33319 primary records. [2025-10-22T22:09:48.430781] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-10-22T22:09:48.454243] [DEBUG] [LOCAL ] HII: Derivative data saved (1794 records). [2025-10-22T22:09:48.454487] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-10-22T22:09:48.457394] [INFO ] [MAIN ] Derivative Progress: 828/2052 symbols completed. HII took 1.1s. Estimated remaining: 7m 40s. Rate: 159.5 symbols/min [2025-10-22T22:09:48.457597] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:48.454894] [DEBUG] [LOCAL ] HIPO: Loaded 21379 existing records from primary storage. [2025-10-22T22:09:48.458245] [INFO ] [MAIN ] HIPO: Loaded 21379 primary data records. [2025-10-22T22:09:48.608319] [DEBUG] [LOCAL ] HIW: Loaded 44400 existing records from primary storage. [2025-10-22T22:09:48.671639] [INFO ] [MAIN ] HIW: Loaded 44400 primary data records. [2025-10-22T22:09:48.676707] [DEBUG] [LOCAL ] HIX: Loaded 20442 existing records from primary storage. [2025-10-22T22:09:48.688028] [INFO ] [MAIN ] HIX: Loaded 20442 primary data records. [2025-10-22T22:09:49.474132] [DEBUG] [MAIN ] HIPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:49.475735] [INFO ] [MAIN ] HIPO: Generated 1794 derivative records from 21379 primary records. [2025-10-22T22:09:49.476036] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-10-22T22:09:49.496561] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1794 records). [2025-10-22T22:09:49.497096] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-10-22T22:09:49.499267] [INFO ] [MAIN ] Derivative Progress: 829/2052 symbols completed. HIPO took 1.1s. Estimated remaining: 7m 41s. Rate: 159.2 symbols/min [2025-10-22T22:09:49.499694] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:49.517738] [DEBUG] [MAIN ] HIW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:49.518633] [INFO ] [MAIN ] HIW: Generated 1794 derivative records from 44400 primary records. [2025-10-22T22:09:49.518739] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-10-22T22:09:49.553921] [DEBUG] [LOCAL ] HIW: Derivative data saved (1794 records). [2025-10-22T22:09:49.554817] [DEBUG] [MAIN ] HIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:49.555012] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-10-22T22:09:49.557917] [INFO ] [MAIN ] Derivative Progress: 830/2052 symbols completed. HIW took 1.1s. Estimated remaining: 7m 40s. Rate: 159.3 symbols/min [2025-10-22T22:09:49.559218] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:49.558948] [INFO ] [MAIN ] HIX: Generated 1794 derivative records from 20442 primary records. [2025-10-22T22:09:49.559452] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-10-22T22:09:49.580778] [DEBUG] [LOCAL ] HKD: Loaded 18679 existing records from primary storage. [2025-10-22T22:09:49.586509] [DEBUG] [LOCAL ] HIX: Derivative data saved (1794 records). [2025-10-22T22:09:49.586716] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-10-22T22:09:49.586380] [INFO ] [MAIN ] HKD: Loaded 18679 primary data records. [2025-10-22T22:09:49.589727] [INFO ] [MAIN ] Derivative Progress: 831/2052 symbols completed. HIX took 1.1s. Estimated remaining: 7m 39s. Rate: 159.5 symbols/min [2025-10-22T22:09:49.602609] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:49.936148] [DEBUG] [LOCAL ] HL: Loaded 53676 existing records from primary storage. [2025-10-22T22:09:49.953307] [INFO ] [MAIN ] HL: Loaded 53676 primary data records. [2025-10-22T22:09:50.039462] [DEBUG] [LOCAL ] HLF: Loaded 48453 existing records from primary storage. [2025-10-22T22:09:50.064500] [INFO ] [MAIN ] HLF: Loaded 48453 primary data records. [2025-10-22T22:09:50.678202] [DEBUG] [MAIN ] HKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:50.680931] [INFO ] [MAIN ] HKD: Generated 1794 derivative records from 18679 primary records. [2025-10-22T22:09:50.681167] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-10-22T22:09:50.707725] [DEBUG] [LOCAL ] HKD: Derivative data saved (1794 records). [2025-10-22T22:09:50.710873] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-10-22T22:09:50.713313] [INFO ] [MAIN ] Derivative Progress: 832/2052 symbols completed. HKD took 1.2s. Estimated remaining: 7m 40s. Rate: 159.1 symbols/min [2025-10-22T22:09:50.713582] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:50.727186] [DEBUG] [MAIN ] HL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:50.727904] [INFO ] [MAIN ] HL: Generated 1794 derivative records from 53676 primary records. [2025-10-22T22:09:50.728125] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-10-22T22:09:50.747135] [DEBUG] [LOCAL ] HL: Derivative data saved (1794 records). [2025-10-22T22:09:50.747327] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-10-22T22:09:50.749478] [INFO ] [MAIN ] Derivative Progress: 833/2052 symbols completed. HL took 1.2s. Estimated remaining: 7m 39s. Rate: 159.3 symbols/min [2025-10-22T22:09:50.760474] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:50.768212] [DEBUG] [MAIN ] HLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:50.769228] [INFO ] [MAIN ] HLF: Generated 1794 derivative records from 48453 primary records. [2025-10-22T22:09:50.769500] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-10-22T22:09:50.811956] [DEBUG] [LOCAL ] HLI: Loaded 30581 existing records from primary storage. [2025-10-22T22:09:50.810900] [DEBUG] [LOCAL ] HLF: Derivative data saved (1794 records). [2025-10-22T22:09:50.812234] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-10-22T22:09:50.818593] [INFO ] [MAIN ] HLI: Loaded 30581 primary data records. [2025-10-22T22:09:50.821302] [INFO ] [MAIN ] Derivative Progress: 834/2052 symbols completed. HLF took 1.2s. Estimated remaining: 7m 38s. Rate: 159.5 symbols/min [2025-10-22T22:09:50.857770] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:50.931345] [DEBUG] [LOCAL ] HLIO: Loaded 28093 existing records from primary storage. [2025-10-22T22:09:50.937280] [INFO ] [MAIN ] HLIO: Loaded 28093 primary data records. [2025-10-22T22:09:51.439680] [DEBUG] [LOCAL ] HLLY: Loaded 33310 existing records from primary storage. [2025-10-22T22:09:51.440546] [INFO ] [MAIN ] HLLY: Loaded 33310 primary data records. [2025-10-22T22:09:51.768554] [DEBUG] [MAIN ] HLI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:51.769861] [INFO ] [MAIN ] HLI: Generated 1794 derivative records from 30581 primary records. [2025-10-22T22:09:51.770087] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-10-22T22:09:51.798775] [DEBUG] [LOCAL ] HLI: Derivative data saved (1794 records). [2025-10-22T22:09:51.803996] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-10-22T22:09:51.806985] [INFO ] [MAIN ] Derivative Progress: 835/2052 symbols completed. HLI took 1.1s. Estimated remaining: 7m 39s. Rate: 159.1 symbols/min [2025-10-22T22:09:51.804289] [DEBUG] [MAIN ] HLIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:51.808294] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:51.808169] [INFO ] [MAIN ] HLIO: Generated 1794 derivative records from 28093 primary records. [2025-10-22T22:09:51.808884] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-10-22T22:09:51.828630] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1794 records). [2025-10-22T22:09:51.829593] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-10-22T22:09:51.832378] [INFO ] [MAIN ] Derivative Progress: 836/2052 symbols completed. HLIO took 1.1s. Estimated remaining: 7m 38s. Rate: 159.3 symbols/min [2025-10-22T22:09:51.832696] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:51.845787] [DEBUG] [MAIN ] HLLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:51.846451] [INFO ] [MAIN ] HLLY: Generated 1794 derivative records from 33310 primary records. [2025-10-22T22:09:51.846548] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-10-22T22:09:51.862546] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1794 records). [2025-10-22T22:09:51.862778] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-10-22T22:09:51.865172] [INFO ] [MAIN ] Derivative Progress: 837/2052 symbols completed. HLLY took 1.0s. Estimated remaining: 7m 37s. Rate: 159.5 symbols/min [2025-10-22T22:09:51.867578] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:51.912984] [DEBUG] [LOCAL ] HLN: Loaded 53128 existing records from primary storage. [2025-10-22T22:09:51.913239] [INFO ] [MAIN ] HLN: Loaded 53128 primary data records. [2025-10-22T22:09:52.039318] [DEBUG] [LOCAL ] HLT: Loaded 50461 existing records from primary storage. [2025-10-22T22:09:52.056045] [INFO ] [MAIN ] HLT: Loaded 50461 primary data records. [2025-10-22T22:09:52.287627] [DEBUG] [LOCAL ] HLX: Loaded 47326 existing records from primary storage. [2025-10-22T22:09:52.309194] [INFO ] [MAIN ] HLX: Loaded 47326 primary data records. [2025-10-22T22:09:52.907019] [DEBUG] [MAIN ] HLN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:52.908235] [INFO ] [MAIN ] HLN: Generated 1794 derivative records from 53128 primary records. [2025-10-22T22:09:52.908444] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-10-22T22:09:52.928006] [DEBUG] [LOCAL ] HLN: Derivative data saved (1794 records). [2025-10-22T22:09:52.928370] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-10-22T22:09:52.930357] [INFO ] [MAIN ] Derivative Progress: 838/2052 symbols completed. HLN took 1.1s. Estimated remaining: 7m 38s. Rate: 159.1 symbols/min [2025-10-22T22:09:52.943819] [DEBUG] [MAIN ] HLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:52.945139] [INFO ] [MAIN ] HLT: Generated 1794 derivative records from 50461 primary records. [2025-10-22T22:09:52.945809] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-10-22T22:09:52.966794] [DEBUG] [MAIN ] HLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:52.969936] [INFO ] [MAIN ] HLX: Generated 1794 derivative records from 47326 primary records. [2025-10-22T22:09:52.970602] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-10-22T22:09:52.974558] [DEBUG] [LOCAL ] HLT: Derivative data saved (1794 records). [2025-10-22T22:09:52.974793] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-10-22T22:09:52.984916] [INFO ] [MAIN ] Derivative Progress: 839/2052 symbols completed. HLT took 1.2s. Estimated remaining: 7m 37s. Rate: 159.3 symbols/min [2025-10-22T22:09:52.991388] [DEBUG] [LOCAL ] HLX: Derivative data saved (1794 records). [2025-10-22T22:09:52.991448] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-10-22T22:09:52.993740] [INFO ] [MAIN ] Derivative Progress: 840/2052 symbols completed. HLX took 1.1s. Estimated remaining: 7m 36s. Rate: 159.5 symbols/min [2025-10-22T22:09:52.994158] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:52.994104] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:52.994276] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:53.019596] [DEBUG] [LOCAL ] HMN: Loaded 23255 existing records from primary storage. [2025-10-22T22:09:53.030755] [INFO ] [MAIN ] HMN: Loaded 23255 primary data records. [2025-10-22T22:09:53.206996] [DEBUG] [LOCAL ] HMC: Loaded 46285 existing records from primary storage. [2025-10-22T22:09:53.257243] [INFO ] [MAIN ] HMC: Loaded 46285 primary data records. [2025-10-22T22:09:53.225263] [DEBUG] [LOCAL ] HMY: Loaded 53166 existing records from primary storage. [2025-10-22T22:09:53.262204] [INFO ] [MAIN ] HMY: Loaded 53166 primary data records. [2025-10-22T22:09:54.064036] [DEBUG] [MAIN ] HMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:54.067954] [INFO ] [MAIN ] HMN: Generated 1794 derivative records from 23255 primary records. [2025-10-22T22:09:54.068127] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-10-22T22:09:54.092993] [DEBUG] [MAIN ] HMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:54.094601] [INFO ] [MAIN ] HMC: Generated 1794 derivative records from 46285 primary records. [2025-10-22T22:09:54.094759] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-10-22T22:09:54.097911] [DEBUG] [LOCAL ] HMN: Derivative data saved (1794 records). [2025-10-22T22:09:54.098984] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-10-22T22:09:54.100927] [INFO ] [MAIN ] Derivative Progress: 841/2052 symbols completed. HMN took 1.1s. Estimated remaining: 7m 37s. Rate: 159.1 symbols/min [2025-10-22T22:09:54.101218] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:54.117921] [DEBUG] [LOCAL ] HMC: Derivative data saved (1794 records). [2025-10-22T22:09:54.118060] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-10-22T22:09:54.121765] [INFO ] [MAIN ] Derivative Progress: 842/2052 symbols completed. HMC took 1.1s. Estimated remaining: 7m 36s. Rate: 159.3 symbols/min [2025-10-22T22:09:54.121978] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:54.138140] [DEBUG] [MAIN ] HMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:54.139041] [INFO ] [MAIN ] HMY: Generated 1794 derivative records from 53166 primary records. [2025-10-22T22:09:54.139118] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-10-22T22:09:54.163983] [DEBUG] [LOCAL ] HMY: Derivative data saved (1794 records). [2025-10-22T22:09:54.173045] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-10-22T22:09:54.175728] [INFO ] [MAIN ] Derivative Progress: 843/2052 symbols completed. HMY took 1.2s. Estimated remaining: 7m 35s. Rate: 159.5 symbols/min [2025-10-22T22:09:54.176126] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:54.177176] [DEBUG] [LOCAL ] HNI: Loaded 29772 existing records from primary storage. [2025-10-22T22:09:54.177657] [INFO ] [MAIN ] HNI: Loaded 29772 primary data records. [2025-10-22T22:09:54.501070] [DEBUG] [LOCAL ] HOG: Loaded 50639 existing records from primary storage. [2025-10-22T22:09:54.501312] [INFO ] [MAIN ] HOG: Loaded 50639 primary data records. [2025-10-22T22:09:54.618964] [DEBUG] [LOCAL ] HOMB: Loaded 43676 existing records from primary storage. [2025-10-22T22:09:54.645729] [INFO ] [MAIN ] HOMB: Loaded 43676 primary data records. [2025-10-22T22:09:55.178424] [DEBUG] [MAIN ] HNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:55.179175] [INFO ] [MAIN ] HNI: Generated 1794 derivative records from 29772 primary records. [2025-10-22T22:09:55.181054] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-10-22T22:09:55.199326] [DEBUG] [LOCAL ] HNI: Derivative data saved (1794 records). [2025-10-22T22:09:55.199544] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-10-22T22:09:55.201726] [INFO ] [MAIN ] Derivative Progress: 844/2052 symbols completed. HNI took 1.1s. Estimated remaining: 7m 35s. Rate: 159.1 symbols/min [2025-10-22T22:09:55.202291] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:55.224772] [DEBUG] [MAIN ] HOG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:55.225846] [INFO ] [MAIN ] HOG: Generated 1794 derivative records from 50639 primary records. [2025-10-22T22:09:55.226906] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-10-22T22:09:55.255807] [DEBUG] [LOCAL ] HOG: Derivative data saved (1794 records). [2025-10-22T22:09:55.268982] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-10-22T22:09:55.271288] [INFO ] [MAIN ] Derivative Progress: 845/2052 symbols completed. HOG took 1.1s. Estimated remaining: 7m 35s. Rate: 159.3 symbols/min [2025-10-22T22:09:55.271487] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:55.271796] [DEBUG] [MAIN ] HOMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:55.272814] [INFO ] [MAIN ] HOMB: Generated 1794 derivative records from 43676 primary records. [2025-10-22T22:09:55.273470] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-10-22T22:09:55.295172] [DEBUG] [LOCAL ] HOUS: Loaded 45734 existing records from primary storage. [2025-10-22T22:09:55.299496] [INFO ] [MAIN ] HOUS: Loaded 45734 primary data records. [2025-10-22T22:09:55.340136] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1794 records). [2025-10-22T22:09:55.352297] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-10-22T22:09:55.355158] [INFO ] [MAIN ] Derivative Progress: 846/2052 symbols completed. HOMB took 1.2s. Estimated remaining: 7m 34s. Rate: 159.4 symbols/min [2025-10-22T22:09:55.386799] [DEBUG] [LOCAL ] HOV: Loaded 13798 existing records from primary storage. [2025-10-22T22:09:55.386373] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:55.392160] [INFO ] [MAIN ] HOV: Loaded 13798 primary data records. [2025-10-22T22:09:55.943683] [DEBUG] [LOCAL ] HP: Loaded 51399 existing records from primary storage. [2025-10-22T22:09:55.946783] [INFO ] [MAIN ] HP: Loaded 51399 primary data records. [2025-10-22T22:09:56.262227] [DEBUG] [MAIN ] HOUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:56.263212] [INFO ] [MAIN ] HOUS: Generated 1794 derivative records from 45734 primary records. [2025-10-22T22:09:56.275939] [DEBUG] [MAIN ] HOV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:09:56.276874] [INFO ] [MAIN ] HOV: Generated 1793 derivative records from 13798 primary records. [2025-10-22T22:09:56.277039] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-10-22T22:09:56.276151] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-10-22T22:09:56.301278] [DEBUG] [LOCAL ] HOV: Derivative data saved (1793 records). [2025-10-22T22:09:56.303308] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-10-22T22:09:56.313371] [INFO ] [MAIN ] Derivative Progress: 847/2052 symbols completed. HOV took 1.0s. Estimated remaining: 7m 34s. Rate: 159.2 symbols/min [2025-10-22T22:09:56.313926] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1794 records). [2025-10-22T22:09:56.315088] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:56.314676] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-10-22T22:09:56.317896] [INFO ] [MAIN ] Derivative Progress: 848/2052 symbols completed. HOUS took 1.1s. Estimated remaining: 7m 33s. Rate: 159.3 symbols/min [2025-10-22T22:09:56.318169] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:56.327987] [DEBUG] [LOCAL ] HPF: Loaded 7482 existing records from primary storage. [2025-10-22T22:09:56.328433] [INFO ] [MAIN ] HPF: Loaded 7482 primary data records. [2025-10-22T22:09:56.522731] [DEBUG] [MAIN ] HP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:56.614710] [INFO ] [MAIN ] HP: Generated 1794 derivative records from 51399 primary records. [2025-10-22T22:09:56.614917] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-10-22T22:09:56.720785] [DEBUG] [LOCAL ] HP: Derivative data saved (1794 records). [2025-10-22T22:09:56.722099] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-22T22:09:56.723509] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-10-22T22:09:56.723069] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-10-22T22:09:56.725979] [INFO ] [MAIN ] Derivative Progress: 849/2052 symbols completed. HP took 1.3s. Estimated remaining: 7m 33s. Rate: 159.3 symbols/min [2025-10-22T22:09:56.726328] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:56.894811] [DEBUG] [LOCAL ] HPI: Loaded 10731 existing records from primary storage. [2025-10-22T22:09:56.916621] [INFO ] [MAIN ] HPI: Loaded 10731 primary data records. [2025-10-22T22:09:57.121458] [DEBUG] [MAIN ] HPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:57.132965] [INFO ] [MAIN ] HPF: Generated 1794 derivative records from 7482 primary records. [2025-10-22T22:09:57.149534] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-10-22T22:09:57.243754] [DEBUG] [LOCAL ] HPF: Derivative data saved (1794 records). [2025-10-22T22:09:57.347996] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-10-22T22:09:57.364820] [INFO ] [MAIN ] Derivative Progress: 850/2052 symbols completed. HPF took 1.0s. Estimated remaining: 7m 33s. Rate: 159.2 symbols/min [2025-10-22T22:09:57.365109] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:57.385610] [DEBUG] [MAIN ] HPE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:57.386382] [INFO ] [MAIN ] HPE: Generated 1794 derivative records from 53697 primary records. [2025-10-22T22:09:57.386662] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-10-22T22:09:57.404667] [DEBUG] [LOCAL ] HPE: Derivative data saved (1794 records). [2025-10-22T22:09:57.404876] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-10-22T22:09:57.407054] [INFO ] [MAIN ] Derivative Progress: 851/2052 symbols completed. HPE took 1.1s. Estimated remaining: 7m 32s. Rate: 159.4 symbols/min [2025-10-22T22:09:57.407308] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:57.440143] [DEBUG] [MAIN ] HPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:57.441019] [INFO ] [MAIN ] HPI: Generated 1794 derivative records from 10731 primary records. [2025-10-22T22:09:57.441174] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-10-22T22:09:57.473273] [DEBUG] [LOCAL ] HPI: Derivative data saved (1794 records). [2025-10-22T22:09:57.473432] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-10-22T22:09:57.477744] [DEBUG] [LOCAL ] HPP: Loaded 51224 existing records from primary storage. [2025-10-22T22:09:57.476261] [INFO ] [MAIN ] Derivative Progress: 852/2052 symbols completed. HPI took 0.7s. Estimated remaining: 7m 31s. Rate: 159.5 symbols/min [2025-10-22T22:09:57.478069] [INFO ] [MAIN ] HPP: Loaded 51224 primary data records. [2025-10-22T22:09:57.478355] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:57.609964] [DEBUG] [LOCAL ] HPS: Loaded 10322 existing records from primary storage. [2025-10-22T22:09:57.631207] [INFO ] [MAIN ] HPS: Loaded 10322 primary data records. [2025-10-22T22:09:57.668103] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-10-22T22:09:57.751412] [INFO ] [MAIN ] HPQ: Loaded 53669 primary data records. [2025-10-22T22:09:58.516925] [DEBUG] [MAIN ] HPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:58.518020] [INFO ] [MAIN ] HPP: Generated 1794 derivative records from 51224 primary records. [2025-10-22T22:09:58.518206] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-10-22T22:09:58.538166] [DEBUG] [LOCAL ] HPP: Derivative data saved (1794 records). [2025-10-22T22:09:58.539098] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-10-22T22:09:58.553181] [INFO ] [MAIN ] Derivative Progress: 853/2052 symbols completed. HPP took 1.2s. Estimated remaining: 7m 32s. Rate: 159.2 symbols/min [2025-10-22T22:09:58.554772] [DEBUG] [MAIN ] HPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:58.555530] [INFO ] [MAIN ] HPS: Generated 1794 derivative records from 10322 primary records. [2025-10-22T22:09:58.555745] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-10-22T22:09:58.569050] [DEBUG] [MAIN ] HPQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:58.580419] [INFO ] [MAIN ] HPQ: Generated 1794 derivative records from 53669 primary records. [2025-10-22T22:09:58.584535] [DEBUG] [LOCAL ] HPS: Derivative data saved (1794 records). [2025-10-22T22:09:58.584699] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-10-22T22:09:58.583615] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-10-22T22:09:58.587197] [INFO ] [MAIN ] Derivative Progress: 854/2052 symbols completed. HPS took 1.1s. Estimated remaining: 7m 31s. Rate: 159.3 symbols/min [2025-10-22T22:09:58.603176] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1794 records). [2025-10-22T22:09:58.603266] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-10-22T22:09:58.606128] [INFO ] [MAIN ] Derivative Progress: 855/2052 symbols completed. HPQ took 1.2s. Estimated remaining: 7m 30s. Rate: 159.5 symbols/min [2025-10-22T22:09:58.606559] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:58.606777] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:58.606850] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:58.634190] [DEBUG] [LOCAL ] HQL: Loaded 16898 existing records from primary storage. [2025-10-22T22:09:58.634514] [INFO ] [MAIN ] HQL: Loaded 16898 primary data records. [2025-10-22T22:09:58.714422] [DEBUG] [LOCAL ] HQH: Loaded 25772 existing records from primary storage. [2025-10-22T22:09:58.737771] [INFO ] [MAIN ] HQH: Loaded 25772 primary data records. [2025-10-22T22:09:59.091614] [DEBUG] [LOCAL ] HR: Loaded 52108 existing records from primary storage. [2025-10-22T22:09:59.102258] [INFO ] [MAIN ] HR: Loaded 52108 primary data records. [2025-10-22T22:09:59.618285] [DEBUG] [MAIN ] HQL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:59.619288] [INFO ] [MAIN ] HQL: Generated 1794 derivative records from 16898 primary records. [2025-10-22T22:09:59.619537] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-10-22T22:09:59.649065] [DEBUG] [MAIN ] HQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:59.649809] [INFO ] [MAIN ] HQH: Generated 1794 derivative records from 25772 primary records. [2025-10-22T22:09:59.650943] [DEBUG] [LOCAL ] HQL: Derivative data saved (1794 records). [2025-10-22T22:09:59.651049] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-10-22T22:09:59.651538] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-10-22T22:09:59.654495] [INFO ] [MAIN ] Derivative Progress: 856/2052 symbols completed. HQL took 1.0s. Estimated remaining: 7m 31s. Rate: 159.2 symbols/min [2025-10-22T22:09:59.665613] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:59.669902] [DEBUG] [LOCAL ] HQH: Derivative data saved (1794 records). [2025-10-22T22:09:59.670211] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-10-22T22:09:59.672788] [INFO ] [MAIN ] Derivative Progress: 857/2052 symbols completed. HQH took 1.1s. Estimated remaining: 7m 30s. Rate: 159.4 symbols/min [2025-10-22T22:09:59.673125] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:59.689926] [DEBUG] [MAIN ] HR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:09:59.690625] [INFO ] [MAIN ] HR: Generated 1794 derivative records from 52108 primary records. [2025-10-22T22:09:59.690937] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-10-22T22:09:59.708129] [DEBUG] [LOCAL ] HR: Derivative data saved (1794 records). [2025-10-22T22:09:59.708306] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-10-22T22:09:59.711205] [INFO ] [MAIN ] Derivative Progress: 858/2052 symbols completed. HR took 1.1s. Estimated remaining: 7m 29s. Rate: 159.5 symbols/min [2025-10-22T22:09:59.711451] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:09:59.744708] [DEBUG] [LOCAL ] HRI: Loaded 32142 existing records from primary storage. [2025-10-22T22:09:59.744870] [INFO ] [MAIN ] HRI: Loaded 32142 primary data records. [2025-10-22T22:09:59.868890] [DEBUG] [LOCAL ] HRB: Loaded 48219 existing records from primary storage. [2025-10-22T22:09:59.869516] [INFO ] [MAIN ] HRB: Loaded 48219 primary data records. [2025-10-22T22:10:00.233211] [DEBUG] [LOCAL ] HRL: Loaded 53125 existing records from primary storage. [2025-10-22T22:10:00.234242] [INFO ] [MAIN ] HRL: Loaded 53125 primary data records. [2025-10-22T22:10:00.835764] [DEBUG] [MAIN ] HRI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:10:00.837198] [INFO ] [MAIN ] HRI: Generated 1793 derivative records from 32142 primary records. [2025-10-22T22:10:00.837821] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-10-22T22:10:00.856707] [DEBUG] [LOCAL ] HRI: Derivative data saved (1793 records). [2025-10-22T22:10:00.858075] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-10-22T22:10:00.860639] [INFO ] [MAIN ] Derivative Progress: 859/2052 symbols completed. HRI took 1.2s. Estimated remaining: 7m 30s. Rate: 159.1 symbols/min [2025-10-22T22:10:00.873379] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:00.874070] [DEBUG] [MAIN ] HRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:00.875260] [INFO ] [MAIN ] HRB: Generated 1794 derivative records from 48219 primary records. [2025-10-22T22:10:00.875440] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-10-22T22:10:00.892791] [DEBUG] [LOCAL ] HRB: Derivative data saved (1794 records). [2025-10-22T22:10:00.893112] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-10-22T22:10:00.896702] [INFO ] [MAIN ] Derivative Progress: 860/2052 symbols completed. HRB took 1.2s. Estimated remaining: 7m 29s. Rate: 159.3 symbols/min [2025-10-22T22:10:00.896914] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:00.912501] [DEBUG] [MAIN ] HRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:00.913212] [INFO ] [MAIN ] HRL: Generated 1794 derivative records from 53125 primary records. [2025-10-22T22:10:00.913344] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-10-22T22:10:00.949162] [DEBUG] [LOCAL ] HRL: Derivative data saved (1794 records). [2025-10-22T22:10:00.949632] [DEBUG] [LOCAL ] HRTG: Loaded 34520 existing records from primary storage. [2025-10-22T22:10:00.949822] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-10-22T22:10:00.950037] [INFO ] [MAIN ] HRTG: Loaded 34520 primary data records. [2025-10-22T22:10:00.952480] [INFO ] [MAIN ] Derivative Progress: 861/2052 symbols completed. HRL took 1.2s. Estimated remaining: 7m 28s. Rate: 159.5 symbols/min [2025-10-22T22:10:00.958070] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:01.107106] [DEBUG] [LOCAL ] HSHP: Loaded 14457 existing records from primary storage. [2025-10-22T22:10:01.147129] [INFO ] [MAIN ] HSHP: Loaded 14457 primary data records. [2025-10-22T22:10:01.195869] [DEBUG] [LOCAL ] HSBC: Loaded 50990 existing records from primary storage. [2025-10-22T22:10:01.230363] [INFO ] [MAIN ] HSBC: Loaded 50990 primary data records. [2025-10-22T22:10:01.966214] [DEBUG] [MAIN ] HRTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:01.967264] [INFO ] [MAIN ] HRTG: Generated 1794 derivative records from 34520 primary records. [2025-10-22T22:10:01.968798] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-10-22T22:10:01.987679] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1794 records). [2025-10-22T22:10:01.988890] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-10-22T22:10:01.991438] [INFO ] [MAIN ] Derivative Progress: 862/2052 symbols completed. HRTG took 1.1s. Estimated remaining: 7m 29s. Rate: 159.1 symbols/min [2025-10-22T22:10:01.993725] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:02.007993] [DEBUG] [MAIN ] HSBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:02.008762] [INFO ] [MAIN ] HSBC: Generated 1794 derivative records from 50990 primary records. [2025-10-22T22:10:02.008917] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-10-22T22:10:02.027107] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1794 records). [2025-10-22T22:10:02.027373] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-10-22T22:10:02.042543] [INFO ] [MAIN ] Derivative Progress: 863/2052 symbols completed. HSBC took 1.1s. Estimated remaining: 7m 28s. Rate: 159.3 symbols/min [2025-10-22T22:10:02.043080] [DEBUG] [MAIN ] HSHP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:02.043990] [INFO ] [MAIN ] HSHP: Generated 1794 derivative records from 14457 primary records. [2025-10-22T22:10:02.044197] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-10-22T22:10:02.043285] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:02.074222] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1794 records). [2025-10-22T22:10:02.074405] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-10-22T22:10:02.076903] [INFO ] [MAIN ] Derivative Progress: 864/2052 symbols completed. HSHP took 1.1s. Estimated remaining: 7m 27s. Rate: 159.5 symbols/min [2025-10-22T22:10:02.077142] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:02.083260] [DEBUG] [LOCAL ] HTD: Loaded 14245 existing records from primary storage. [2025-10-22T22:10:02.083439] [INFO ] [MAIN ] HTD: Loaded 14245 primary data records. [2025-10-22T22:10:02.214330] [DEBUG] [LOCAL ] HSY: Loaded 50376 existing records from primary storage. [2025-10-22T22:10:02.220331] [INFO ] [MAIN ] HSY: Loaded 50376 primary data records. [2025-10-22T22:10:02.559335] [DEBUG] [LOCAL ] HTGC: Loaded 47694 existing records from primary storage. [2025-10-22T22:10:02.595625] [INFO ] [MAIN ] HTGC: Loaded 47694 primary data records. [2025-10-22T22:10:03.126695] [DEBUG] [MAIN ] HTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:03.128353] [INFO ] [MAIN ] HTD: Generated 1794 derivative records from 14245 primary records. [2025-10-22T22:10:03.128635] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-10-22T22:10:03.148740] [DEBUG] [LOCAL ] HTD: Derivative data saved (1794 records). [2025-10-22T22:10:03.149377] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-10-22T22:10:03.151708] [INFO ] [MAIN ] Derivative Progress: 865/2052 symbols completed. HTD took 1.1s. Estimated remaining: 7m 28s. Rate: 159.1 symbols/min [2025-10-22T22:10:03.151897] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:03.166497] [DEBUG] [MAIN ] HSY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:03.167322] [INFO ] [MAIN ] HSY: Generated 1794 derivative records from 50376 primary records. [2025-10-22T22:10:03.167759] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-10-22T22:10:03.186941] [DEBUG] [LOCAL ] HSY: Derivative data saved (1794 records). [2025-10-22T22:10:03.188572] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-10-22T22:10:03.191370] [INFO ] [MAIN ] Derivative Progress: 866/2052 symbols completed. HSY took 1.2s. Estimated remaining: 7m 27s. Rate: 159.3 symbols/min [2025-10-22T22:10:03.200357] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:03.214177] [DEBUG] [MAIN ] HTGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:03.214929] [INFO ] [MAIN ] HTGC: Generated 1794 derivative records from 47694 primary records. [2025-10-22T22:10:03.215088] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-10-22T22:10:03.241305] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1794 records). [2025-10-22T22:10:03.241971] [DEBUG] [LOCAL ] HTH: Loaded 32437 existing records from primary storage. [2025-10-22T22:10:03.242059] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-10-22T22:10:03.244870] [INFO ] [MAIN ] Derivative Progress: 867/2052 symbols completed. HTGC took 1.2s. Estimated remaining: 7m 26s. Rate: 159.4 symbols/min [2025-10-22T22:10:03.245068] [INFO ] [MAIN ] HTH: Loaded 32437 primary data records. [2025-10-22T22:10:03.256711] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:03.552904] [DEBUG] [LOCAL ] HUBB: Loaded 36083 existing records from primary storage. [2025-10-22T22:10:03.561024] [INFO ] [MAIN ] HUBB: Loaded 36083 primary data records. [2025-10-22T22:10:03.704792] [DEBUG] [LOCAL ] HUBS: Loaded 39936 existing records from primary storage. [2025-10-22T22:10:03.708504] [INFO ] [MAIN ] HUBS: Loaded 39936 primary data records. [2025-10-22T22:10:04.266145] [DEBUG] [MAIN ] HTH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:04.266993] [INFO ] [MAIN ] HTH: Generated 1794 derivative records from 32437 primary records. [2025-10-22T22:10:04.267422] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-10-22T22:10:04.287037] [DEBUG] [LOCAL ] HTH: Derivative data saved (1794 records). [2025-10-22T22:10:04.287679] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-10-22T22:10:04.290379] [INFO ] [MAIN ] Derivative Progress: 868/2052 symbols completed. HTH took 1.1s. Estimated remaining: 7m 26s. Rate: 159.1 symbols/min [2025-10-22T22:10:04.306616] [DEBUG] [MAIN ] HUBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:04.308536] [INFO ] [MAIN ] HUBB: Generated 1794 derivative records from 36083 primary records. [2025-10-22T22:10:04.308615] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-10-22T22:10:04.339220] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1794 records). [2025-10-22T22:10:04.336976] [DEBUG] [MAIN ] HUBS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:10:04.340244] [INFO ] [MAIN ] HUBS: Generated 1793 derivative records from 39936 primary records. [2025-10-22T22:10:04.340342] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-10-22T22:10:04.342852] [INFO ] [MAIN ] Derivative Progress: 869/2052 symbols completed. HUBB took 1.1s. Estimated remaining: 7m 26s. Rate: 159.3 symbols/min [2025-10-22T22:10:04.340440] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-10-22T22:10:04.360541] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1793 records). [2025-10-22T22:10:04.360717] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-10-22T22:10:04.363481] [INFO ] [MAIN ] Derivative Progress: 870/2052 symbols completed. HUBS took 1.1s. Estimated remaining: 7m 25s. Rate: 159.5 symbols/min [2025-10-22T22:10:04.364285] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:04.364362] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:04.364172] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:04.427299] [DEBUG] [LOCAL ] HUYA: Loaded 43617 existing records from primary storage. [2025-10-22T22:10:04.454845] [INFO ] [MAIN ] HUYA: Loaded 43617 primary data records. [2025-10-22T22:10:04.455499] [DEBUG] [LOCAL ] HUN: Loaded 53210 existing records from primary storage. [2025-10-22T22:10:04.456440] [DEBUG] [LOCAL ] HUM: Loaded 49274 existing records from primary storage. [2025-10-22T22:10:04.456541] [INFO ] [MAIN ] HUN: Loaded 53210 primary data records. [2025-10-22T22:10:04.469490] [INFO ] [MAIN ] HUM: Loaded 49274 primary data records. [2025-10-22T22:10:05.479880] [DEBUG] [MAIN ] HUM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:05.480995] [INFO ] [MAIN ] HUM: Generated 1794 derivative records from 49274 primary records. [2025-10-22T22:10:05.481242] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-10-22T22:10:05.516018] [DEBUG] [LOCAL ] HUM: Derivative data saved (1794 records). [2025-10-22T22:10:05.516626] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-10-22T22:10:05.518493] [INFO ] [MAIN ] Derivative Progress: 871/2052 symbols completed. HUM took 1.2s. Estimated remaining: 7m 25s. Rate: 159.1 symbols/min [2025-10-22T22:10:05.519124] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:05.518868] [DEBUG] [MAIN ] HUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:05.520483] [INFO ] [MAIN ] HUN: Generated 1794 derivative records from 53210 primary records. [2025-10-22T22:10:05.534713] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-10-22T22:10:05.535066] [DEBUG] [MAIN ] HUYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:05.536535] [INFO ] [MAIN ] HUYA: Generated 1794 derivative records from 43617 primary records. [2025-10-22T22:10:05.537039] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-10-22T22:10:05.561198] [DEBUG] [LOCAL ] HUN: Derivative data saved (1794 records). [2025-10-22T22:10:05.562905] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-10-22T22:10:05.572719] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1794 records). [2025-10-22T22:10:05.572562] [INFO ] [MAIN ] Derivative Progress: 872/2052 symbols completed. HUN took 1.2s. Estimated remaining: 7m 25s. Rate: 159.2 symbols/min [2025-10-22T22:10:05.576366] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-10-22T22:10:05.579224] [INFO ] [MAIN ] Derivative Progress: 873/2052 symbols completed. HUYA took 1.2s. Estimated remaining: 7m 24s. Rate: 159.4 symbols/min [2025-10-22T22:10:05.579462] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:05.579113] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:05.586633] [DEBUG] [LOCAL ] HVT: Loaded 14734 existing records from primary storage. [2025-10-22T22:10:05.586973] [INFO ] [MAIN ] HVT: Loaded 14734 primary data records. [2025-10-22T22:10:05.927519] [DEBUG] [LOCAL ] HXL: Loaded 45788 existing records from primary storage. [2025-10-22T22:10:05.928698] [INFO ] [MAIN ] HXL: Loaded 45788 primary data records. [2025-10-22T22:10:06.069532] [DEBUG] [LOCAL ] HWM: Loaded 52700 existing records from primary storage. [2025-10-22T22:10:06.085958] [INFO ] [MAIN ] HWM: Loaded 52700 primary data records. [2025-10-22T22:10:06.581609] [DEBUG] [MAIN ] HVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:06.591470] [INFO ] [MAIN ] HVT: Generated 1794 derivative records from 14734 primary records. [2025-10-22T22:10:06.591692] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-10-22T22:10:06.610556] [DEBUG] [LOCAL ] HVT: Derivative data saved (1794 records). [2025-10-22T22:10:06.611110] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-10-22T22:10:06.613799] [INFO ] [MAIN ] Derivative Progress: 874/2052 symbols completed. HVT took 1.1s. Estimated remaining: 7m 24s. Rate: 159.1 symbols/min [2025-10-22T22:10:06.614324] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:06.637327] [DEBUG] [MAIN ] HXL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:06.638443] [INFO ] [MAIN ] HXL: Generated 1794 derivative records from 45788 primary records. [2025-10-22T22:10:06.638779] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-10-22T22:10:06.645014] [DEBUG] [LOCAL ] HY: Loaded 9852 existing records from primary storage. [2025-10-22T22:10:06.657093] [INFO ] [MAIN ] HY: Loaded 9852 primary data records. [2025-10-22T22:10:06.698807] [DEBUG] [LOCAL ] HXL: Derivative data saved (1794 records). [2025-10-22T22:10:06.716891] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-10-22T22:10:06.719264] [INFO ] [MAIN ] Derivative Progress: 875/2052 symbols completed. HXL took 1.1s. Estimated remaining: 7m 24s. Rate: 159.2 symbols/min [2025-10-22T22:10:06.749979] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:06.795358] [DEBUG] [MAIN ] HWM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:06.841874] [INFO ] [MAIN ] HWM: Generated 1794 derivative records from 52700 primary records. [2025-10-22T22:10:06.858254] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-10-22T22:10:07.050585] [DEBUG] [LOCAL ] HWM: Derivative data saved (1794 records). [2025-10-22T22:10:07.054484] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-10-22T22:10:07.057421] [DEBUG] [LOCAL ] HYI: Loaded 9586 existing records from primary storage. [2025-10-22T22:10:07.057712] [INFO ] [MAIN ] HYI: Loaded 9586 primary data records. [2025-10-22T22:10:07.057139] [INFO ] [MAIN ] Derivative Progress: 876/2052 symbols completed. HWM took 1.5s. Estimated remaining: 7m 23s. Rate: 159.2 symbols/min [2025-10-22T22:10:07.057838] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:07.376296] [DEBUG] [LOCAL ] HYT: Loaded 33567 existing records from primary storage. [2025-10-22T22:10:07.377065] [INFO ] [MAIN ] HYT: Loaded 33567 primary data records. [2025-10-22T22:10:07.545988] [DEBUG] [MAIN ] HY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:07.575384] [INFO ] [MAIN ] HY: Generated 1794 derivative records from 9852 primary records. [2025-10-22T22:10:07.687213] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-10-22T22:10:07.704180] [DEBUG] [LOCAL ] HY: Derivative data saved (1794 records). [2025-10-22T22:10:07.705377] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-10-22T22:10:07.707543] [INFO ] [MAIN ] Derivative Progress: 877/2052 symbols completed. HY took 1.1s. Estimated remaining: 7m 23s. Rate: 159.1 symbols/min [2025-10-22T22:10:07.708312] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:07.729019] [DEBUG] [LOCAL ] HYTR: Loaded 3093 existing records from primary storage. [2025-10-22T22:10:07.729508] [DEBUG] [MAIN ] HYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:07.730249] [INFO ] [MAIN ] HYI: Generated 1794 derivative records from 9586 primary records. [2025-10-22T22:10:07.730345] [INFO ] [MAIN ] HYTR: Loaded 3093 primary data records. [2025-10-22T22:10:07.730449] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-10-22T22:10:07.927434] [DEBUG] [LOCAL ] HYI: Derivative data saved (1794 records). [2025-10-22T22:10:07.927623] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-10-22T22:10:07.931435] [INFO ] [MAIN ] Derivative Progress: 878/2052 symbols completed. HYI took 1.2s. Estimated remaining: 7m 23s. Rate: 159.2 symbols/min [2025-10-22T22:10:08.040095] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:08.061291] [DEBUG] [MAIN ] HYT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:08.061907] [INFO ] [MAIN ] HYT: Generated 1794 derivative records from 33567 primary records. [2025-10-22T22:10:08.061967] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-10-22T22:10:08.078538] [DEBUG] [LOCAL ] HYT: Derivative data saved (1794 records). [2025-10-22T22:10:08.079559] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-10-22T22:10:08.082775] [INFO ] [MAIN ] Derivative Progress: 879/2052 symbols completed. HYT took 1.0s. Estimated remaining: 7m 22s. Rate: 159.3 symbols/min [2025-10-22T22:10:08.083416] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:08.099598] [DEBUG] [LOCAL ] IAE: Loaded 6307 existing records from primary storage. [2025-10-22T22:10:08.100101] [INFO ] [MAIN ] IAE: Loaded 6307 primary data records. [2025-10-22T22:10:08.212247] [DEBUG] [LOCAL ] HZO: Loaded 28526 existing records from primary storage. [2025-10-22T22:10:08.222420] [INFO ] [MAIN ] HZO: Loaded 28526 primary data records. [2025-10-22T22:10:08.408254] [DEBUG] [MAIN ] HYTR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:10:08.526015] [INFO ] [MAIN ] HYTR: Generated 1793 derivative records from 3093 primary records. [2025-10-22T22:10:08.526698] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-10-22T22:10:08.699079] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1793 records). [2025-10-22T22:10:08.782315] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-10-22T22:10:08.784946] [INFO ] [MAIN ] Derivative Progress: 880/2052 symbols completed. HYTR took 1.1s. Estimated remaining: 7m 22s. Rate: 159.1 symbols/min [2025-10-22T22:10:08.786506] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:08.809667] [DEBUG] [MAIN ] IAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:08.810716] [INFO ] [MAIN ] IAE: Generated 1794 derivative records from 6307 primary records. [2025-10-22T22:10:08.810909] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-10-22T22:10:08.829491] [DEBUG] [LOCAL ] IAE: Derivative data saved (1794 records). [2025-10-22T22:10:08.842829] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-10-22T22:10:08.845472] [INFO ] [MAIN ] Derivative Progress: 881/2052 symbols completed. IAE took 0.8s. Estimated remaining: 7m 21s. Rate: 159.3 symbols/min [2025-10-22T22:10:08.845991] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:08.862594] [DEBUG] [MAIN ] HZO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:08.863588] [INFO ] [MAIN ] HZO: Generated 1794 derivative records from 28526 primary records. [2025-10-22T22:10:08.863773] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-10-22T22:10:08.880014] [DEBUG] [LOCAL ] IAG: Loaded 53492 existing records from primary storage. [2025-10-22T22:10:08.888007] [INFO ] [MAIN ] IAG: Loaded 53492 primary data records. [2025-10-22T22:10:09.030784] [DEBUG] [LOCAL ] HZO: Derivative data saved (1794 records). [2025-10-22T22:10:09.070744] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-10-22T22:10:09.097529] [INFO ] [MAIN ] Derivative Progress: 882/2052 symbols completed. HZO took 1.1s. Estimated remaining: 7m 21s. Rate: 159.3 symbols/min [2025-10-22T22:10:09.228094] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:09.230584] [DEBUG] [LOCAL ] IBM: Loaded 53628 existing records from primary storage. [2025-10-22T22:10:09.230964] [INFO ] [MAIN ] IBM: Loaded 53628 primary data records. [2025-10-22T22:10:09.600439] [DEBUG] [LOCAL ] IBN: Loaded 52834 existing records from primary storage. [2025-10-22T22:10:09.601217] [DEBUG] [MAIN ] IAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:09.602026] [INFO ] [MAIN ] IAG: Generated 1794 derivative records from 53492 primary records. [2025-10-22T22:10:09.600951] [INFO ] [MAIN ] IBN: Loaded 52834 primary data records. [2025-10-22T22:10:09.602216] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-22T22:10:09.726859] [DEBUG] [LOCAL ] IAG: Derivative data saved (1794 records). [2025-10-22T22:10:09.733836] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-10-22T22:10:09.741459] [INFO ] [MAIN ] Derivative Progress: 883/2052 symbols completed. IAG took 1.0s. Estimated remaining: 7m 21s. Rate: 159.2 symbols/min [2025-10-22T22:10:09.769351] [DEBUG] [MAIN ] IBM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:09.798899] [INFO ] [MAIN ] IBM: Generated 1794 derivative records from 53628 primary records. [2025-10-22T22:10:09.800179] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-22T22:10:09.953052] [DEBUG] [LOCAL ] IBM: Derivative data saved (1794 records). [2025-10-22T22:10:09.953782] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-10-22T22:10:09.956097] [INFO ] [MAIN ] Derivative Progress: 884/2052 symbols completed. IBM took 1.1s. Estimated remaining: 7m 20s. Rate: 159.3 symbols/min [2025-10-22T22:10:09.976008] [DEBUG] [MAIN ] IBN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:09.976565] [INFO ] [MAIN ] IBN: Generated 1794 derivative records from 52834 primary records. [2025-10-22T22:10:09.976624] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-22T22:10:09.993613] [DEBUG] [LOCAL ] IBN: Derivative data saved (1794 records). [2025-10-22T22:10:09.993762] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-10-22T22:10:09.996096] [INFO ] [MAIN ] Derivative Progress: 885/2052 symbols completed. IBN took 0.8s. Estimated remaining: 7m 19s. Rate: 159.5 symbols/min [2025-10-22T22:10:09.996494] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:09.996591] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:09.996699] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:10.057435] [DEBUG] [LOCAL ] IBP: Loaded 28663 existing records from primary storage. [2025-10-22T22:10:10.057726] [INFO ] [MAIN ] IBP: Loaded 28663 primary data records. [2025-10-22T22:10:10.058336] [DEBUG] [LOCAL ] IBTA: Loaded 36072 existing records from primary storage. [2025-10-22T22:10:10.069790] [INFO ] [MAIN ] IBTA: Loaded 36072 primary data records. [2025-10-22T22:10:10.276531] [DEBUG] [LOCAL ] ICE: Loaded 53009 existing records from primary storage. [2025-10-22T22:10:10.276636] [INFO ] [MAIN ] ICE: Loaded 53009 primary data records. [2025-10-22T22:10:11.047047] [DEBUG] [MAIN ] IBTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:11.048075] [DEBUG] [MAIN ] IBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:11.049741] [INFO ] [MAIN ] IBTA: Generated 1794 derivative records from 36072 primary records. [2025-10-22T22:10:11.049910] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-22T22:10:11.048946] [INFO ] [MAIN ] IBP: Generated 1794 derivative records from 28663 primary records. [2025-10-22T22:10:11.070818] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-10-22T22:10:11.074463] [DEBUG] [MAIN ] ICE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:11.086176] [INFO ] [MAIN ] ICE: Generated 1794 derivative records from 53009 primary records. [2025-10-22T22:10:11.087961] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-22T22:10:11.087877] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1794 records). [2025-10-22T22:10:11.094181] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-22T22:10:11.096844] [INFO ] [MAIN ] Derivative Progress: 886/2052 symbols completed. IBTA took 1.1s. Estimated remaining: 7m 20s. Rate: 159.1 symbols/min [2025-10-22T22:10:11.105398] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:11.105302] [DEBUG] [LOCAL ] IBP: Derivative data saved (1794 records). [2025-10-22T22:10:11.109685] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-10-22T22:10:11.114149] [INFO ] [MAIN ] Derivative Progress: 887/2052 symbols completed. IBP took 1.1s. Estimated remaining: 7m 19s. Rate: 159.3 symbols/min [2025-10-22T22:10:11.116157] [DEBUG] [LOCAL ] ICE: Derivative data saved (1794 records). [2025-10-22T22:10:11.114550] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:11.116385] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-22T22:10:11.119319] [INFO ] [MAIN ] Derivative Progress: 888/2052 symbols completed. ICE took 1.1s. Estimated remaining: 7m 18s. Rate: 159.5 symbols/min [2025-10-22T22:10:11.119709] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:11.141246] [DEBUG] [LOCAL ] IDE: Loaded 9050 existing records from primary storage. [2025-10-22T22:10:11.141482] [INFO ] [MAIN ] IDE: Loaded 9050 primary data records. [2025-10-22T22:10:11.306892] [DEBUG] [LOCAL ] IDA: Loaded 32728 existing records from primary storage. [2025-10-22T22:10:11.308619] [DEBUG] [LOCAL ] ICL: Loaded 38132 existing records from primary storage. [2025-10-22T22:10:11.323991] [INFO ] [MAIN ] IDA: Loaded 32728 primary data records. [2025-10-22T22:10:11.359744] [INFO ] [MAIN ] ICL: Loaded 38132 primary data records. [2025-10-22T22:10:12.116460] [DEBUG] [MAIN ] IDE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:12.117622] [INFO ] [MAIN ] IDE: Generated 1794 derivative records from 9050 primary records. [2025-10-22T22:10:12.118110] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-22T22:10:12.135392] [DEBUG] [LOCAL ] IDE: Derivative data saved (1794 records). [2025-10-22T22:10:12.135844] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-22T22:10:12.138630] [INFO ] [MAIN ] Derivative Progress: 889/2052 symbols completed. IDE took 1.0s. Estimated remaining: 7m 18s. Rate: 159.2 symbols/min [2025-10-22T22:10:12.139867] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:12.168804] [DEBUG] [MAIN ] ICL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:12.169855] [INFO ] [MAIN ] ICL: Generated 1794 derivative records from 38132 primary records. [2025-10-22T22:10:12.169187] [DEBUG] [MAIN ] IDA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:12.169943] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-22T22:10:12.171329] [INFO ] [MAIN ] IDA: Generated 1794 derivative records from 32728 primary records. [2025-10-22T22:10:12.171595] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-22T22:10:12.198444] [DEBUG] [LOCAL ] ICL: Derivative data saved (1794 records). [2025-10-22T22:10:12.198625] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-22T22:10:12.207062] [INFO ] [MAIN ] Derivative Progress: 890/2052 symbols completed. ICL took 1.1s. Estimated remaining: 7m 18s. Rate: 159.3 symbols/min [2025-10-22T22:10:12.208182] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:12.211843] [DEBUG] [LOCAL ] IDA: Derivative data saved (1794 records). [2025-10-22T22:10:12.212028] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-10-22T22:10:12.214506] [INFO ] [MAIN ] Derivative Progress: 891/2052 symbols completed. IDA took 1.1s. Estimated remaining: 7m 17s. Rate: 159.5 symbols/min [2025-10-22T22:10:12.221268] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:12.222216] [DEBUG] [LOCAL ] IDT: Loaded 18550 existing records from primary storage. [2025-10-22T22:10:12.222287] [INFO ] [MAIN ] IDT: Loaded 18550 primary data records. [2025-10-22T22:10:12.580234] [DEBUG] [LOCAL ] IEX: Loaded 38271 existing records from primary storage. [2025-10-22T22:10:12.580550] [INFO ] [MAIN ] IEX: Loaded 38271 primary data records. [2025-10-22T22:10:12.741760] [DEBUG] [LOCAL ] IFF: Loaded 51225 existing records from primary storage. [2025-10-22T22:10:12.777337] [INFO ] [MAIN ] IFF: Loaded 51225 primary data records. [2025-10-22T22:10:13.248074] [DEBUG] [MAIN ] IDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:13.248881] [INFO ] [MAIN ] IDT: Generated 1794 derivative records from 18550 primary records. [2025-10-22T22:10:13.249280] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-22T22:10:13.266225] [DEBUG] [LOCAL ] IDT: Derivative data saved (1794 records). [2025-10-22T22:10:13.266712] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-22T22:10:13.269177] [INFO ] [MAIN ] Derivative Progress: 892/2052 symbols completed. IDT took 1.1s. Estimated remaining: 7m 17s. Rate: 159.2 symbols/min [2025-10-22T22:10:13.269757] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:13.290635] [DEBUG] [MAIN ] IEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:13.297839] [INFO ] [MAIN ] IEX: Generated 1794 derivative records from 38271 primary records. [2025-10-22T22:10:13.299920] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-22T22:10:13.327097] [DEBUG] [LOCAL ] IFN: Loaded 18590 existing records from primary storage. [2025-10-22T22:10:13.327916] [INFO ] [MAIN ] IFN: Loaded 18590 primary data records. [2025-10-22T22:10:13.328021] [DEBUG] [LOCAL ] IEX: Derivative data saved (1794 records). [2025-10-22T22:10:13.335777] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-22T22:10:13.353746] [INFO ] [MAIN ] Derivative Progress: 893/2052 symbols completed. IEX took 1.1s. Estimated remaining: 7m 17s. Rate: 159.3 symbols/min [2025-10-22T22:10:13.379145] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:13.384624] [DEBUG] [MAIN ] IFF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:13.419828] [INFO ] [MAIN ] IFF: Generated 1794 derivative records from 51225 primary records. [2025-10-22T22:10:13.425377] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-22T22:10:13.545503] [DEBUG] [LOCAL ] IFF: Derivative data saved (1794 records). [2025-10-22T22:10:13.545824] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-22T22:10:13.661076] [INFO ] [MAIN ] Derivative Progress: 894/2052 symbols completed. IFF took 1.4s. Estimated remaining: 7m 16s. Rate: 159.3 symbols/min [2025-10-22T22:10:13.661893] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:13.672612] [DEBUG] [LOCAL ] IFS: Loaded 22165 existing records from primary storage. [2025-10-22T22:10:13.673244] [INFO ] [MAIN ] IFS: Loaded 22165 primary data records. [2025-10-22T22:10:13.773937] [DEBUG] [LOCAL ] IGA: Loaded 10128 existing records from primary storage. [2025-10-22T22:10:13.788198] [INFO ] [MAIN ] IGA: Loaded 10128 primary data records. [2025-10-22T22:10:14.298324] [DEBUG] [MAIN ] IFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:14.299813] [INFO ] [MAIN ] IFN: Generated 1794 derivative records from 18590 primary records. [2025-10-22T22:10:14.300041] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-22T22:10:14.318939] [DEBUG] [LOCAL ] IFN: Derivative data saved (1794 records). [2025-10-22T22:10:14.319121] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-22T22:10:14.321214] [INFO ] [MAIN ] Derivative Progress: 895/2052 symbols completed. IFN took 1.1s. Estimated remaining: 7m 16s. Rate: 159.2 symbols/min [2025-10-22T22:10:14.321681] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:14.339754] [DEBUG] [MAIN ] IFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:14.342375] [INFO ] [MAIN ] IFS: Generated 1794 derivative records from 22165 primary records. [2025-10-22T22:10:14.343388] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-22T22:10:14.375878] [DEBUG] [MAIN ] IGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:14.377207] [DEBUG] [LOCAL ] IFS: Derivative data saved (1794 records). [2025-10-22T22:10:14.378109] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-10-22T22:10:14.378032] [INFO ] [MAIN ] IGA: Generated 1794 derivative records from 10128 primary records. [2025-10-22T22:10:14.387356] [DEBUG] [LOCAL ] IGD: Loaded 19135 existing records from primary storage. [2025-10-22T22:10:14.386699] [INFO ] [MAIN ] Derivative Progress: 896/2052 symbols completed. IFS took 1.0s. Estimated remaining: 7m 15s. Rate: 159.3 symbols/min [2025-10-22T22:10:14.386893] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-22T22:10:14.387802] [INFO ] [MAIN ] IGD: Loaded 19135 primary data records. [2025-10-22T22:10:14.387615] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:14.469857] [DEBUG] [LOCAL ] IGA: Derivative data saved (1794 records). [2025-10-22T22:10:14.481720] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-22T22:10:14.484433] [INFO ] [MAIN ] Derivative Progress: 897/2052 symbols completed. IGA took 0.8s. Estimated remaining: 7m 15s. Rate: 159.5 symbols/min [2025-10-22T22:10:14.484605] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:14.487446] [DEBUG] [LOCAL ] IGI: Loaded 4050 existing records from primary storage. [2025-10-22T22:10:14.492789] [INFO ] [MAIN ] IGI: Loaded 4050 primary data records. [2025-10-22T22:10:14.922059] [DEBUG] [LOCAL ] IGR: Loaded 30409 existing records from primary storage. [2025-10-22T22:10:14.945242] [INFO ] [MAIN ] IGR: Loaded 30409 primary data records. [2025-10-22T22:10:15.434300] [DEBUG] [MAIN ] IGD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:15.438005] [INFO ] [MAIN ] IGD: Generated 1794 derivative records from 19135 primary records. [2025-10-22T22:10:15.438289] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-22T22:10:15.469506] [DEBUG] [MAIN ] IGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:15.471062] [DEBUG] [LOCAL ] IGD: Derivative data saved (1794 records). [2025-10-22T22:10:15.472222] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-22T22:10:15.474439] [INFO ] [MAIN ] Derivative Progress: 898/2052 symbols completed. IGD took 1.2s. Estimated remaining: 7m 15s. Rate: 159.2 symbols/min [2025-10-22T22:10:15.472144] [INFO ] [MAIN ] IGI: Generated 1794 derivative records from 4050 primary records. [2025-10-22T22:10:15.475051] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-22T22:10:15.494160] [DEBUG] [LOCAL ] IGI: Derivative data saved (1794 records). [2025-10-22T22:10:15.494624] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-22T22:10:15.498709] [INFO ] [MAIN ] Derivative Progress: 899/2052 symbols completed. IGI took 1.1s. Estimated remaining: 7m 14s. Rate: 159.3 symbols/min [2025-10-22T22:10:15.516088] [DEBUG] [MAIN ] IGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:15.516894] [INFO ] [MAIN ] IGR: Generated 1794 derivative records from 30409 primary records. [2025-10-22T22:10:15.516969] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-22T22:10:15.533053] [DEBUG] [LOCAL ] IGR: Derivative data saved (1794 records). [2025-10-22T22:10:15.533164] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-22T22:10:15.536128] [INFO ] [MAIN ] Derivative Progress: 900/2052 symbols completed. IGR took 1.1s. Estimated remaining: 7m 13s. Rate: 159.5 symbols/min [2025-10-22T22:10:15.536623] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:15.537347] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:15.537197] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:15.543755] [DEBUG] [LOCAL ] IH: Loaded 2722 existing records from primary storage. [2025-10-22T22:10:15.544056] [INFO ] [MAIN ] IH: Loaded 2722 primary data records. [2025-10-22T22:10:15.635369] [DEBUG] [LOCAL ] IHD: Loaded 7364 existing records from primary storage. [2025-10-22T22:10:15.679084] [INFO ] [MAIN ] IHD: Loaded 7364 primary data records. [2025-10-22T22:10:15.684597] [DEBUG] [LOCAL ] IHG: Loaded 23951 existing records from primary storage. [2025-10-22T22:10:15.699082] [INFO ] [MAIN ] IHG: Loaded 23951 primary data records. [2025-10-22T22:10:16.653078] [DEBUG] [MAIN ] IH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:16.654417] [INFO ] [MAIN ] IH: Generated 1794 derivative records from 2722 primary records. [2025-10-22T22:10:16.654523] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-22T22:10:16.673262] [DEBUG] [LOCAL ] IH: Derivative data saved (1794 records). [2025-10-22T22:10:16.673753] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-10-22T22:10:16.678140] [INFO ] [MAIN ] Derivative Progress: 901/2052 symbols completed. IH took 1.1s. Estimated remaining: 7m 14s. Rate: 159.1 symbols/min [2025-10-22T22:10:16.692569] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:16.693231] [DEBUG] [MAIN ] IHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:16.694886] [INFO ] [MAIN ] IHD: Generated 1794 derivative records from 7364 primary records. [2025-10-22T22:10:16.694974] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-22T22:10:16.723827] [DEBUG] [MAIN ] IHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:16.728268] [DEBUG] [LOCAL ] IHD: Derivative data saved (1794 records). [2025-10-22T22:10:16.729489] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-22T22:10:16.729242] [INFO ] [MAIN ] IHG: Generated 1794 derivative records from 23951 primary records. [2025-10-22T22:10:16.733409] [INFO ] [MAIN ] Derivative Progress: 902/2052 symbols completed. IHD took 1.2s. Estimated remaining: 7m 13s. Rate: 159.3 symbols/min [2025-10-22T22:10:16.733639] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:16.734470] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-22T22:10:16.765538] [DEBUG] [LOCAL ] IHG: Derivative data saved (1794 records). [2025-10-22T22:10:16.765853] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-22T22:10:16.768597] [INFO ] [MAIN ] Derivative Progress: 903/2052 symbols completed. IHG took 1.2s. Estimated remaining: 7m 12s. Rate: 159.5 symbols/min [2025-10-22T22:10:16.768946] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:16.773514] [DEBUG] [LOCAL ] IIF: Loaded 5278 existing records from primary storage. [2025-10-22T22:10:16.775056] [INFO ] [MAIN ] IIF: Loaded 5278 primary data records. [2025-10-22T22:10:16.863220] [DEBUG] [LOCAL ] IHS: Loaded 37211 existing records from primary storage. [2025-10-22T22:10:16.887179] [INFO ] [MAIN ] IHS: Loaded 37211 primary data records. [2025-10-22T22:10:17.097256] [DEBUG] [LOCAL ] IIIN: Loaded 16243 existing records from primary storage. [2025-10-22T22:10:17.225807] [INFO ] [MAIN ] IIIN: Loaded 16243 primary data records. [2025-10-22T22:10:17.788931] [DEBUG] [MAIN ] IIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:17.798968] [INFO ] [MAIN ] IIF: Generated 1794 derivative records from 5278 primary records. [2025-10-22T22:10:17.804317] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-22T22:10:17.804144] [DEBUG] [MAIN ] IHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:17.806225] [INFO ] [MAIN ] IHS: Generated 1794 derivative records from 37211 primary records. [2025-10-22T22:10:17.806544] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-22T22:10:17.839416] [DEBUG] [LOCAL ] IIF: Derivative data saved (1794 records). [2025-10-22T22:10:17.838554] [DEBUG] [LOCAL ] IHS: Derivative data saved (1794 records). [2025-10-22T22:10:17.839680] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-22T22:10:17.839601] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-10-22T22:10:17.842623] [INFO ] [MAIN ] Derivative Progress: 904/2052 symbols completed. IIF took 1.1s. Estimated remaining: 7m 13s. Rate: 159.1 symbols/min [2025-10-22T22:10:17.846954] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:17.847103] [INFO ] [MAIN ] Derivative Progress: 905/2052 symbols completed. IHS took 1.2s. Estimated remaining: 7m 12s. Rate: 159.3 symbols/min [2025-10-22T22:10:17.847542] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:17.866813] [DEBUG] [MAIN ] IIIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:17.867808] [INFO ] [MAIN ] IIIN: Generated 1794 derivative records from 16243 primary records. [2025-10-22T22:10:17.868035] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-22T22:10:17.891337] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1794 records). [2025-10-22T22:10:17.891579] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-10-22T22:10:17.895462] [INFO ] [MAIN ] Derivative Progress: 906/2052 symbols completed. IIIN took 1.1s. Estimated remaining: 7m 11s. Rate: 159.5 symbols/min [2025-10-22T22:10:17.895692] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:17.913091] [DEBUG] [LOCAL ] IIM: Loaded 15480 existing records from primary storage. [2025-10-22T22:10:17.913462] [INFO ] [MAIN ] IIM: Loaded 15480 primary data records. [2025-10-22T22:10:18.047244] [DEBUG] [LOCAL ] IIPR: Loaded 28846 existing records from primary storage. [2025-10-22T22:10:18.047689] [INFO ] [MAIN ] IIPR: Loaded 28846 primary data records. [2025-10-22T22:10:18.382505] [DEBUG] [LOCAL ] IMAX: Loaded 43444 existing records from primary storage. [2025-10-22T22:10:18.404788] [INFO ] [MAIN ] IMAX: Loaded 43444 primary data records. [2025-10-22T22:10:19.048939] [DEBUG] [MAIN ] IIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:19.051001] [INFO ] [MAIN ] IIM: Generated 1794 derivative records from 15480 primary records. [2025-10-22T22:10:19.051754] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-22T22:10:19.073058] [DEBUG] [LOCAL ] IIM: Derivative data saved (1794 records). [2025-10-22T22:10:19.073334] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-22T22:10:19.076609] [INFO ] [MAIN ] Derivative Progress: 907/2052 symbols completed. IIM took 1.2s. Estimated remaining: 7m 12s. Rate: 159.1 symbols/min [2025-10-22T22:10:19.077326] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:19.095280] [DEBUG] [MAIN ] IIPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:19.098163] [INFO ] [MAIN ] IIPR: Generated 1794 derivative records from 28846 primary records. [2025-10-22T22:10:19.098989] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-22T22:10:19.125490] [DEBUG] [MAIN ] IMAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:19.128017] [INFO ] [MAIN ] IMAX: Generated 1794 derivative records from 43444 primary records. [2025-10-22T22:10:19.130331] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-22T22:10:19.131889] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1794 records). [2025-10-22T22:10:19.133617] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-22T22:10:19.137953] [INFO ] [MAIN ] Derivative Progress: 908/2052 symbols completed. IIPR took 1.3s. Estimated remaining: 7m 11s. Rate: 159.2 symbols/min [2025-10-22T22:10:19.151721] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:19.157791] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1794 records). [2025-10-22T22:10:19.169690] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-10-22T22:10:19.173924] [INFO ] [MAIN ] Derivative Progress: 909/2052 symbols completed. IMAX took 1.3s. Estimated remaining: 7m 10s. Rate: 159.4 symbols/min [2025-10-22T22:10:19.174379] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:19.199025] [DEBUG] [LOCAL ] INFA: Loaded 48602 existing records from primary storage. [2025-10-22T22:10:19.199379] [INFO ] [MAIN ] INFA: Loaded 48602 primary data records. [2025-10-22T22:10:19.453277] [DEBUG] [LOCAL ] INFY: Loaded 53596 existing records from primary storage. [2025-10-22T22:10:19.578272] [INFO ] [MAIN ] INFY: Loaded 53596 primary data records. [2025-10-22T22:10:19.596773] [DEBUG] [LOCAL ] ING: Loaded 50701 existing records from primary storage. [2025-10-22T22:10:19.630853] [INFO ] [MAIN ] ING: Loaded 50701 primary data records. [2025-10-22T22:10:20.251815] [DEBUG] [MAIN ] INFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:20.253492] [INFO ] [MAIN ] INFA: Generated 1794 derivative records from 48602 primary records. [2025-10-22T22:10:20.253691] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-22T22:10:20.276295] [DEBUG] [LOCAL ] INFA: Derivative data saved (1794 records). [2025-10-22T22:10:20.277629] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-22T22:10:20.281357] [INFO ] [MAIN ] Derivative Progress: 910/2052 symbols completed. INFA took 1.2s. Estimated remaining: 7m 11s. Rate: 159.1 symbols/min [2025-10-22T22:10:20.282106] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:20.296328] [DEBUG] [MAIN ] INFY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:20.297946] [INFO ] [MAIN ] INFY: Generated 1794 derivative records from 53596 primary records. [2025-10-22T22:10:20.299871] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-22T22:10:20.331372] [DEBUG] [MAIN ] ING: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:20.332341] [INFO ] [MAIN ] ING: Generated 1794 derivative records from 50701 primary records. [2025-10-22T22:10:20.331459] [DEBUG] [LOCAL ] INFY: Derivative data saved (1794 records). [2025-10-22T22:10:20.343065] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-10-22T22:10:20.343358] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-22T22:10:20.346307] [INFO ] [MAIN ] Derivative Progress: 911/2052 symbols completed. INFY took 1.2s. Estimated remaining: 7m 10s. Rate: 159.2 symbols/min [2025-10-22T22:10:20.346859] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:20.363552] [DEBUG] [LOCAL ] ING: Derivative data saved (1794 records). [2025-10-22T22:10:20.363816] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-10-22T22:10:20.367288] [INFO ] [MAIN ] Derivative Progress: 912/2052 symbols completed. ING took 1.2s. Estimated remaining: 7m 9s. Rate: 159.4 symbols/min [2025-10-22T22:10:20.367531] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:20.380131] [DEBUG] [LOCAL ] INGM: Loaded 28088 existing records from primary storage. [2025-10-22T22:10:20.380411] [INFO ] [MAIN ] INGM: Loaded 28088 primary data records. [2025-10-22T22:10:20.530015] [DEBUG] [LOCAL ] INGR: Loaded 33764 existing records from primary storage. [2025-10-22T22:10:20.560772] [INFO ] [MAIN ] INGR: Loaded 33764 primary data records. [2025-10-22T22:10:20.850556] [DEBUG] [LOCAL ] INN: Loaded 41470 existing records from primary storage. [2025-10-22T22:10:20.851610] [INFO ] [MAIN ] INN: Loaded 41470 primary data records. [2025-10-22T22:10:21.461273] [DEBUG] [MAIN ] INGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:21.462735] [INFO ] [MAIN ] INGM: Generated 1794 derivative records from 28088 primary records. [2025-10-22T22:10:21.463036] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-22T22:10:21.482812] [DEBUG] [LOCAL ] INGM: Derivative data saved (1794 records). [2025-10-22T22:10:21.483539] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-22T22:10:21.486000] [INFO ] [MAIN ] Derivative Progress: 913/2052 symbols completed. INGM took 1.2s. Estimated remaining: 7m 10s. Rate: 159.0 symbols/min [2025-10-22T22:10:21.499328] [DEBUG] [MAIN ] INGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:21.500042] [INFO ] [MAIN ] INGR: Generated 1794 derivative records from 33764 primary records. [2025-10-22T22:10:21.500121] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-22T22:10:21.516714] [DEBUG] [LOCAL ] INGR: Derivative data saved (1794 records). [2025-10-22T22:10:21.516801] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-22T22:10:21.519304] [INFO ] [MAIN ] Derivative Progress: 914/2052 symbols completed. INGR took 1.2s. Estimated remaining: 7m 9s. Rate: 159.2 symbols/min [2025-10-22T22:10:21.535621] [DEBUG] [MAIN ] INN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:21.536311] [INFO ] [MAIN ] INN: Generated 1794 derivative records from 41470 primary records. [2025-10-22T22:10:21.536372] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-22T22:10:21.553858] [DEBUG] [LOCAL ] INN: Derivative data saved (1794 records). [2025-10-22T22:10:21.553943] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-22T22:10:21.556992] [INFO ] [MAIN ] Derivative Progress: 915/2052 symbols completed. INN took 1.2s. Estimated remaining: 7m 8s. Rate: 159.3 symbols/min [2025-10-22T22:10:21.557579] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:21.557733] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:21.557826] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:21.616902] [DEBUG] [LOCAL ] INSP: Loaded 38560 existing records from primary storage. [2025-10-22T22:10:21.629812] [INFO ] [MAIN ] INSP: Loaded 38560 primary data records. [2025-10-22T22:10:21.635632] [DEBUG] [LOCAL ] INSW: Loaded 39208 existing records from primary storage. [2025-10-22T22:10:21.653198] [INFO ] [MAIN ] INSW: Loaded 39208 primary data records. [2025-10-22T22:10:21.803296] [DEBUG] [LOCAL ] INVH: Loaded 53194 existing records from primary storage. [2025-10-22T22:10:21.865291] [INFO ] [MAIN ] INVH: Loaded 53194 primary data records. [2025-10-22T22:10:22.644445] [DEBUG] [MAIN ] INSP: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:10:22.645627] [INFO ] [MAIN ] INSP: Generated 1793 derivative records from 38560 primary records. [2025-10-22T22:10:22.645835] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-22T22:10:22.659708] [DEBUG] [MAIN ] INSW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:22.673491] [INFO ] [MAIN ] INSW: Generated 1794 derivative records from 39208 primary records. [2025-10-22T22:10:22.677047] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-22T22:10:22.679938] [DEBUG] [LOCAL ] INSP: Derivative data saved (1793 records). [2025-10-22T22:10:22.695275] [DEBUG] [LOCAL ] INSW: Derivative data saved (1794 records). [2025-10-22T22:10:22.703155] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-22T22:10:22.688556] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-22T22:10:22.705682] [INFO ] [MAIN ] Derivative Progress: 916/2052 symbols completed. INSW took 1.1s. Estimated remaining: 7m 9s. Rate: 159.0 symbols/min [2025-10-22T22:10:22.712672] [INFO ] [MAIN ] Derivative Progress: 917/2052 symbols completed. INSP took 1.2s. Estimated remaining: 7m 8s. Rate: 159.1 symbols/min [2025-10-22T22:10:22.713059] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:22.710824] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:22.713785] [DEBUG] [MAIN ] INVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:22.715143] [INFO ] [MAIN ] INVH: Generated 1794 derivative records from 53194 primary records. [2025-10-22T22:10:22.715211] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-22T22:10:22.731984] [DEBUG] [LOCAL ] INVH: Derivative data saved (1794 records). [2025-10-22T22:10:22.732157] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-22T22:10:22.734877] [INFO ] [MAIN ] Derivative Progress: 918/2052 symbols completed. INVH took 1.2s. Estimated remaining: 7m 7s. Rate: 159.3 symbols/min [2025-10-22T22:10:22.735203] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:22.757916] [DEBUG] [LOCAL ] INVX: Loaded 29045 existing records from primary storage. [2025-10-22T22:10:22.758119] [INFO ] [MAIN ] INVX: Loaded 29045 primary data records. [2025-10-22T22:10:22.958078] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-22T22:10:22.976734] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-10-22T22:10:23.214694] [DEBUG] [LOCAL ] IOT: Loaded 53475 existing records from primary storage. [2025-10-22T22:10:23.226397] [INFO ] [MAIN ] IOT: Loaded 53475 primary data records. [2025-10-22T22:10:23.782414] [DEBUG] [MAIN ] INVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:23.784101] [INFO ] [MAIN ] INVX: Generated 1794 derivative records from 29045 primary records. [2025-10-22T22:10:23.784690] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-22T22:10:23.805787] [DEBUG] [LOCAL ] INVX: Derivative data saved (1794 records). [2025-10-22T22:10:23.818706] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-10-22T22:10:23.821214] [INFO ] [MAIN ] Derivative Progress: 919/2052 symbols completed. INVX took 1.1s. Estimated remaining: 7m 8s. Rate: 159.0 symbols/min [2025-10-22T22:10:23.818995] [DEBUG] [MAIN ] IONQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:23.822298] [INFO ] [MAIN ] IONQ: Generated 1794 derivative records from 53788 primary records. [2025-10-22T22:10:23.822493] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-22T22:10:23.822822] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:23.840007] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1794 records). [2025-10-22T22:10:23.840532] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-22T22:10:23.842911] [INFO ] [MAIN ] Derivative Progress: 920/2052 symbols completed. IONQ took 1.1s. Estimated remaining: 7m 7s. Rate: 159.1 symbols/min [2025-10-22T22:10:23.845170] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:23.866625] [DEBUG] [MAIN ] IOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:23.867731] [INFO ] [MAIN ] IOT: Generated 1794 derivative records from 53475 primary records. [2025-10-22T22:10:23.867909] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-22T22:10:23.886910] [DEBUG] [LOCAL ] IOT: Derivative data saved (1794 records). [2025-10-22T22:10:23.887141] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-22T22:10:23.891136] [INFO ] [MAIN ] Derivative Progress: 921/2052 symbols completed. IOT took 1.2s. Estimated remaining: 7m 6s. Rate: 159.3 symbols/min [2025-10-22T22:10:23.891413] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:23.972997] [DEBUG] [LOCAL ] IP: Loaded 53300 existing records from primary storage. [2025-10-22T22:10:23.973743] [DEBUG] [LOCAL ] IPI: Loaded 21414 existing records from primary storage. [2025-10-22T22:10:23.973863] [INFO ] [MAIN ] IP: Loaded 53300 primary data records. [2025-10-22T22:10:23.974680] [INFO ] [MAIN ] IPI: Loaded 21414 primary data records. [2025-10-22T22:10:23.974526] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-22T22:10:23.975014] [INFO ] [MAIN ] IPG: Loaded 53330 primary data records. [2025-10-22T22:10:25.038437] [DEBUG] [MAIN ] IP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:25.041303] [INFO ] [MAIN ] IP: Generated 1794 derivative records from 53300 primary records. [2025-10-22T22:10:25.041399] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-22T22:10:25.070245] [DEBUG] [LOCAL ] IP: Derivative data saved (1794 records). [2025-10-22T22:10:25.071740] [DEBUG] [MAIN ] IPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:25.071424] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-22T22:10:25.075050] [INFO ] [MAIN ] Derivative Progress: 922/2052 symbols completed. IP took 1.3s. Estimated remaining: 7m 7s. Rate: 158.9 symbols/min [2025-10-22T22:10:25.073172] [INFO ] [MAIN ] IPI: Generated 1794 derivative records from 21414 primary records. [2025-10-22T22:10:25.075531] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:25.075613] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-22T22:10:25.098931] [DEBUG] [MAIN ] IPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:25.108122] [DEBUG] [LOCAL ] IPI: Derivative data saved (1794 records). [2025-10-22T22:10:25.113839] [INFO ] [MAIN ] IPG: Generated 1794 derivative records from 53330 primary records. [2025-10-22T22:10:25.114100] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-22T22:10:25.114209] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-22T22:10:25.118199] [INFO ] [MAIN ] Derivative Progress: 923/2052 symbols completed. IPI took 1.2s. Estimated remaining: 7m 6s. Rate: 159.1 symbols/min [2025-10-22T22:10:25.119045] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:25.144114] [DEBUG] [LOCAL ] IPG: Derivative data saved (1794 records). [2025-10-22T22:10:25.146336] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-22T22:10:25.148986] [INFO ] [MAIN ] Derivative Progress: 924/2052 symbols completed. IPG took 1.3s. Estimated remaining: 7m 5s. Rate: 159.2 symbols/min [2025-10-22T22:10:25.149260] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:25.150501] [DEBUG] [LOCAL ] IQI: Loaded 17764 existing records from primary storage. [2025-10-22T22:10:25.151364] [INFO ] [MAIN ] IQI: Loaded 17764 primary data records. [2025-10-22T22:10:25.490775] [DEBUG] [LOCAL ] IQV: Loaded 49962 existing records from primary storage. [2025-10-22T22:10:25.491874] [INFO ] [MAIN ] IQV: Loaded 49962 primary data records. [2025-10-22T22:10:25.615158] [DEBUG] [LOCAL ] IR: Loaded 52749 existing records from primary storage. [2025-10-22T22:10:25.642635] [INFO ] [MAIN ] IR: Loaded 52749 primary data records. [2025-10-22T22:10:25.959331] [DEBUG] [MAIN ] IQI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:25.985677] [INFO ] [MAIN ] IQI: Generated 1794 derivative records from 17764 primary records. [2025-10-22T22:10:26.144862] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-22T22:10:26.175401] [DEBUG] [LOCAL ] IQI: Derivative data saved (1794 records). [2025-10-22T22:10:26.176349] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-22T22:10:26.179752] [INFO ] [MAIN ] Derivative Progress: 925/2052 symbols completed. IQI took 1.1s. Estimated remaining: 7m 5s. Rate: 158.9 symbols/min [2025-10-22T22:10:26.180821] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:26.203261] [DEBUG] [MAIN ] IQV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:26.204412] [INFO ] [MAIN ] IQV: Generated 1794 derivative records from 49962 primary records. [2025-10-22T22:10:26.204726] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-22T22:10:26.225398] [DEBUG] [LOCAL ] IQV: Derivative data saved (1794 records). [2025-10-22T22:10:26.225830] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-10-22T22:10:26.227980] [INFO ] [MAIN ] Derivative Progress: 926/2052 symbols completed. IQV took 1.1s. Estimated remaining: 7m 5s. Rate: 159.1 symbols/min [2025-10-22T22:10:26.228412] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:26.246402] [DEBUG] [MAIN ] IR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:26.260174] [INFO ] [MAIN ] IR: Generated 1794 derivative records from 52749 primary records. [2025-10-22T22:10:26.260578] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-22T22:10:26.287908] [DEBUG] [LOCAL ] IR: Derivative data saved (1794 records). [2025-10-22T22:10:26.313057] [DEBUG] [LOCAL ] IRS: Loaded 23290 existing records from primary storage. [2025-10-22T22:10:26.313204] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-22T22:10:26.316171] [INFO ] [MAIN ] IRS: Loaded 23290 primary data records. [2025-10-22T22:10:26.316087] [INFO ] [MAIN ] Derivative Progress: 927/2052 symbols completed. IR took 1.2s. Estimated remaining: 7m 4s. Rate: 159.2 symbols/min [2025-10-22T22:10:26.316476] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:26.339946] [DEBUG] [LOCAL ] IRM: Loaded 48910 existing records from primary storage. [2025-10-22T22:10:26.374867] [INFO ] [MAIN ] IRM: Loaded 48910 primary data records. [2025-10-22T22:10:26.978328] [DEBUG] [LOCAL ] IRT: Loaded 50443 existing records from primary storage. [2025-10-22T22:10:26.979150] [INFO ] [MAIN ] IRT: Loaded 50443 primary data records. [2025-10-22T22:10:27.331410] [DEBUG] [MAIN ] IRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:27.333232] [INFO ] [MAIN ] IRS: Generated 1794 derivative records from 23290 primary records. [2025-10-22T22:10:27.333329] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-22T22:10:27.354520] [DEBUG] [LOCAL ] IRS: Derivative data saved (1794 records). [2025-10-22T22:10:27.354943] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-22T22:10:27.356859] [INFO ] [MAIN ] Derivative Progress: 928/2052 symbols completed. IRS took 1.1s. Estimated remaining: 7m 4s. Rate: 158.9 symbols/min [2025-10-22T22:10:27.369767] [DEBUG] [MAIN ] IRM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:27.370794] [INFO ] [MAIN ] IRM: Generated 1794 derivative records from 48910 primary records. [2025-10-22T22:10:27.371747] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-22T22:10:27.387818] [DEBUG] [LOCAL ] IRM: Derivative data saved (1794 records). [2025-10-22T22:10:27.387992] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-22T22:10:27.390454] [INFO ] [MAIN ] Derivative Progress: 929/2052 symbols completed. IRM took 1.2s. Estimated remaining: 7m 4s. Rate: 159.1 symbols/min [2025-10-22T22:10:27.406557] [DEBUG] [MAIN ] IRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:27.407151] [INFO ] [MAIN ] IRT: Generated 1794 derivative records from 50443 primary records. [2025-10-22T22:10:27.407210] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-22T22:10:27.422197] [DEBUG] [LOCAL ] IRT: Derivative data saved (1794 records). [2025-10-22T22:10:27.422259] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-22T22:10:27.424803] [INFO ] [MAIN ] Derivative Progress: 930/2052 symbols completed. IRT took 1.1s. Estimated remaining: 7m 3s. Rate: 159.2 symbols/min [2025-10-22T22:10:27.425343] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:27.425674] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:27.425235] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:27.444565] [DEBUG] [LOCAL ] ISD: Loaded 15648 existing records from primary storage. [2025-10-22T22:10:27.452279] [INFO ] [MAIN ] ISD: Loaded 15648 primary data records. [2025-10-22T22:10:27.582697] [DEBUG] [LOCAL ] ITGR: Loaded 30945 existing records from primary storage. [2025-10-22T22:10:27.588093] [INFO ] [MAIN ] ITGR: Loaded 30945 primary data records. [2025-10-22T22:10:27.672576] [DEBUG] [LOCAL ] IT: Loaded 42205 existing records from primary storage. [2025-10-22T22:10:27.694547] [INFO ] [MAIN ] IT: Loaded 42205 primary data records. [2025-10-22T22:10:28.506174] [DEBUG] [MAIN ] ISD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:28.509147] [INFO ] [MAIN ] ISD: Generated 1794 derivative records from 15648 primary records. [2025-10-22T22:10:28.517937] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-22T22:10:28.524866] [DEBUG] [MAIN ] ITGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:28.533559] [INFO ] [MAIN ] ITGR: Generated 1794 derivative records from 30945 primary records. [2025-10-22T22:10:28.550204] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-22T22:10:28.550721] [DEBUG] [MAIN ] IT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:10:28.552166] [INFO ] [MAIN ] IT: Generated 1793 derivative records from 42205 primary records. [2025-10-22T22:10:28.555696] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-22T22:10:28.556630] [DEBUG] [LOCAL ] ISD: Derivative data saved (1794 records). [2025-10-22T22:10:28.557837] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-22T22:10:28.577288] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1794 records). [2025-10-22T22:10:28.572911] [INFO ] [MAIN ] Derivative Progress: 931/2052 symbols completed. ISD took 1.1s. Estimated remaining: 7m 3s. Rate: 158.9 symbols/min [2025-10-22T22:10:28.584708] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-22T22:10:28.588149] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:28.588309] [INFO ] [MAIN ] Derivative Progress: 932/2052 symbols completed. ITGR took 1.2s. Estimated remaining: 7m 3s. Rate: 159.0 symbols/min [2025-10-22T22:10:28.591249] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:28.596066] [DEBUG] [LOCAL ] IT: Derivative data saved (1793 records). [2025-10-22T22:10:28.597087] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-22T22:10:28.599838] [INFO ] [MAIN ] Derivative Progress: 933/2052 symbols completed. IT took 1.2s. Estimated remaining: 7m 2s. Rate: 159.2 symbols/min [2025-10-22T22:10:28.600245] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:28.658968] [DEBUG] [LOCAL ] ITT: Loaded 32352 existing records from primary storage. [2025-10-22T22:10:28.659205] [INFO ] [MAIN ] ITT: Loaded 32352 primary data records. [2025-10-22T22:10:28.797616] [DEBUG] [LOCAL ] ITUB: Loaded 53318 existing records from primary storage. [2025-10-22T22:10:28.796906] [DEBUG] [LOCAL ] ITW: Loaded 45583 existing records from primary storage. [2025-10-22T22:10:28.797972] [INFO ] [MAIN ] ITW: Loaded 45583 primary data records. [2025-10-22T22:10:28.798469] [INFO ] [MAIN ] ITUB: Loaded 53318 primary data records. [2025-10-22T22:10:29.683277] [DEBUG] [MAIN ] ITT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:29.686286] [INFO ] [MAIN ] ITT: Generated 1794 derivative records from 32352 primary records. [2025-10-22T22:10:29.687437] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-22T22:10:29.710265] [DEBUG] [MAIN ] ITUB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:29.719803] [INFO ] [MAIN ] ITUB: Generated 1794 derivative records from 53318 primary records. [2025-10-22T22:10:29.721100] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-22T22:10:29.721030] [DEBUG] [LOCAL ] ITT: Derivative data saved (1794 records). [2025-10-22T22:10:29.722183] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-22T22:10:29.732222] [INFO ] [MAIN ] Derivative Progress: 934/2052 symbols completed. ITT took 1.1s. Estimated remaining: 7m 2s. Rate: 158.9 symbols/min [2025-10-22T22:10:29.750775] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:29.752542] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1794 records). [2025-10-22T22:10:29.752940] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-10-22T22:10:29.753276] [DEBUG] [MAIN ] ITW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:29.754784] [INFO ] [MAIN ] ITW: Generated 1794 derivative records from 45583 primary records. [2025-10-22T22:10:29.757334] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-22T22:10:29.757220] [INFO ] [MAIN ] Derivative Progress: 935/2052 symbols completed. ITUB took 1.2s. Estimated remaining: 7m 1s. Rate: 159.0 symbols/min [2025-10-22T22:10:29.757697] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:29.775088] [DEBUG] [LOCAL ] ITW: Derivative data saved (1794 records). [2025-10-22T22:10:29.775359] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-22T22:10:29.779461] [INFO ] [MAIN ] Derivative Progress: 936/2052 symbols completed. ITW took 1.2s. Estimated remaining: 7m 1s. Rate: 159.2 symbols/min [2025-10-22T22:10:29.780065] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:29.827870] [DEBUG] [LOCAL ] IVT: Loaded 31418 existing records from primary storage. [2025-10-22T22:10:29.828528] [INFO ] [MAIN ] IVT: Loaded 31418 primary data records. [2025-10-22T22:10:29.944992] [DEBUG] [LOCAL ] IVR: Loaded 47827 existing records from primary storage. [2025-10-22T22:10:29.968440] [INFO ] [MAIN ] IVR: Loaded 47827 primary data records. [2025-10-22T22:10:30.139555] [DEBUG] [LOCAL ] IVZ: Loaded 53130 existing records from primary storage. [2025-10-22T22:10:30.151604] [INFO ] [MAIN ] IVZ: Loaded 53130 primary data records. [2025-10-22T22:10:30.829455] [DEBUG] [MAIN ] IVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:30.830495] [INFO ] [MAIN ] IVT: Generated 1794 derivative records from 31418 primary records. [2025-10-22T22:10:30.830786] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-22T22:10:30.862379] [DEBUG] [LOCAL ] IVT: Derivative data saved (1794 records). [2025-10-22T22:10:30.862548] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-22T22:10:30.867983] [DEBUG] [MAIN ] IVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:30.868924] [INFO ] [MAIN ] IVR: Generated 1794 derivative records from 47827 primary records. [2025-10-22T22:10:30.870800] [INFO ] [MAIN ] Derivative Progress: 937/2052 symbols completed. IVT took 1.1s. Estimated remaining: 7m 1s. Rate: 158.9 symbols/min [2025-10-22T22:10:30.870944] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-22T22:10:30.871076] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:30.890583] [DEBUG] [LOCAL ] IVR: Derivative data saved (1794 records). [2025-10-22T22:10:30.898693] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-10-22T22:10:30.901322] [INFO ] [MAIN ] Derivative Progress: 938/2052 symbols completed. IVR took 1.2s. Estimated remaining: 7m 0s. Rate: 159.0 symbols/min [2025-10-22T22:10:30.901597] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:30.907846] [DEBUG] [MAIN ] IVZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:30.908708] [INFO ] [MAIN ] IVZ: Generated 1794 derivative records from 53130 primary records. [2025-10-22T22:10:30.908772] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-22T22:10:30.931386] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1794 records). [2025-10-22T22:10:30.931587] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-22T22:10:30.934287] [INFO ] [MAIN ] Derivative Progress: 939/2052 symbols completed. IVZ took 1.2s. Estimated remaining: 6m 60s. Rate: 159.2 symbols/min [2025-10-22T22:10:30.934685] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:30.947114] [DEBUG] [LOCAL ] IX: Loaded 22121 existing records from primary storage. [2025-10-22T22:10:30.947255] [INFO ] [MAIN ] IX: Loaded 22121 primary data records. [2025-10-22T22:10:31.107379] [DEBUG] [LOCAL ] J: Loaded 40527 existing records from primary storage. [2025-10-22T22:10:31.128794] [INFO ] [MAIN ] J: Loaded 40527 primary data records. [2025-10-22T22:10:31.308605] [DEBUG] [LOCAL ] JBGS: Loaded 41708 existing records from primary storage. [2025-10-22T22:10:31.456453] [INFO ] [MAIN ] JBGS: Loaded 41708 primary data records. [2025-10-22T22:10:32.026065] [DEBUG] [MAIN ] IX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:32.026885] [INFO ] [MAIN ] IX: Generated 1794 derivative records from 22121 primary records. [2025-10-22T22:10:32.027095] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-22T22:10:32.045854] [DEBUG] [LOCAL ] IX: Derivative data saved (1794 records). [2025-10-22T22:10:32.046127] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-22T22:10:32.048066] [INFO ] [MAIN ] Derivative Progress: 940/2052 symbols completed. IX took 1.2s. Estimated remaining: 7m 0s. Rate: 158.8 symbols/min [2025-10-22T22:10:32.048467] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:32.062114] [DEBUG] [MAIN ] J: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:32.062744] [INFO ] [MAIN ] J: Generated 1794 derivative records from 40527 primary records. [2025-10-22T22:10:32.062907] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-22T22:10:32.081068] [DEBUG] [LOCAL ] J: Derivative data saved (1794 records). [2025-10-22T22:10:32.082131] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-22T22:10:32.086313] [INFO ] [MAIN ] Derivative Progress: 941/2052 symbols completed. J took 1.2s. Estimated remaining: 6m 59s. Rate: 159.0 symbols/min [2025-10-22T22:10:32.086820] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:32.109904] [DEBUG] [MAIN ] JBGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:32.110698] [INFO ] [MAIN ] JBGS: Generated 1794 derivative records from 41708 primary records. [2025-10-22T22:10:32.110857] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-22T22:10:32.127132] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1794 records). [2025-10-22T22:10:32.127524] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-22T22:10:32.130066] [INFO ] [MAIN ] Derivative Progress: 942/2052 symbols completed. JBGS took 1.2s. Estimated remaining: 6m 58s. Rate: 159.2 symbols/min [2025-10-22T22:10:32.142468] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:32.143595] [DEBUG] [LOCAL ] JBI: Loaded 42579 existing records from primary storage. [2025-10-22T22:10:32.144148] [INFO ] [MAIN ] JBI: Loaded 42579 primary data records. [2025-10-22T22:10:32.488189] [DEBUG] [LOCAL ] JBND: Loaded 27369 existing records from primary storage. [2025-10-22T22:10:32.490250] [INFO ] [MAIN ] JBND: Loaded 27369 primary data records. [2025-10-22T22:10:32.490104] [DEBUG] [LOCAL ] JBL: Loaded 48330 existing records from primary storage. [2025-10-22T22:10:32.490475] [INFO ] [MAIN ] JBL: Loaded 48330 primary data records. [2025-10-22T22:10:33.111500] [DEBUG] [MAIN ] JBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:33.112721] [INFO ] [MAIN ] JBI: Generated 1794 derivative records from 42579 primary records. [2025-10-22T22:10:33.112887] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-22T22:10:33.130123] [DEBUG] [LOCAL ] JBI: Derivative data saved (1794 records). [2025-10-22T22:10:33.131129] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-22T22:10:33.133426] [INFO ] [MAIN ] Derivative Progress: 943/2052 symbols completed. JBI took 1.1s. Estimated remaining: 6m 59s. Rate: 158.9 symbols/min [2025-10-22T22:10:33.154031] [DEBUG] [MAIN ] JBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:33.166493] [INFO ] [MAIN ] JBL: Generated 1794 derivative records from 48330 primary records. [2025-10-22T22:10:33.166907] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-22T22:10:33.166845] [DEBUG] [MAIN ] JBND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:33.167892] [INFO ] [MAIN ] JBND: Generated 1794 derivative records from 27369 primary records. [2025-10-22T22:10:33.168170] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-22T22:10:33.196193] [DEBUG] [LOCAL ] JBND: Derivative data saved (1794 records). [2025-10-22T22:10:33.198206] [DEBUG] [LOCAL ] JBL: Derivative data saved (1794 records). [2025-10-22T22:10:33.197918] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-22T22:10:33.200948] [INFO ] [MAIN ] Derivative Progress: 944/2052 symbols completed. JBND took 1.1s. Estimated remaining: 6m 58s. Rate: 159.0 symbols/min [2025-10-22T22:10:33.201024] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-22T22:10:33.203285] [INFO ] [MAIN ] Derivative Progress: 945/2052 symbols completed. JBL took 1.1s. Estimated remaining: 6m 57s. Rate: 159.2 symbols/min [2025-10-22T22:10:33.203631] [INFO ] [MAIN ] JBTM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:33.204185] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:33.204269] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:33.214683] [DEBUG] [LOCAL ] JCE: Loaded 7251 existing records from primary storage. [2025-10-22T22:10:33.214877] [INFO ] [MAIN ] JCE: Loaded 7251 primary data records. [2025-10-22T22:10:33.554127] [DEBUG] [LOCAL ] JBTM: Loaded 33593 existing records from primary storage. [2025-10-22T22:10:33.562831] [INFO ] [MAIN ] JBTM: Loaded 33593 primary data records. [2025-10-22T22:10:33.652538] [DEBUG] [LOCAL ] JCI: Loaded 53518 existing records from primary storage. [2025-10-22T22:10:33.660192] [INFO ] [MAIN ] JCI: Loaded 53518 primary data records. [2025-10-22T22:10:34.210287] [DEBUG] [MAIN ] JCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:34.211525] [INFO ] [MAIN ] JCE: Generated 1794 derivative records from 7251 primary records. [2025-10-22T22:10:34.212046] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-22T22:10:34.230355] [DEBUG] [LOCAL ] JCE: Derivative data saved (1794 records). [2025-10-22T22:10:34.230793] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-10-22T22:10:34.233173] [INFO ] [MAIN ] Derivative Progress: 946/2052 symbols completed. JCE took 1.0s. Estimated remaining: 6m 58s. Rate: 158.9 symbols/min [2025-10-22T22:10:34.233437] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:34.253207] [DEBUG] [MAIN ] JBTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:34.254052] [INFO ] [MAIN ] JBTM: Generated 1794 derivative records from 33593 primary records. [2025-10-22T22:10:34.266070] [DEBUG] [LOCAL ] JBTM: Saving derivative data. [2025-10-22T22:10:34.266942] [DEBUG] [MAIN ] JCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:34.267978] [INFO ] [MAIN ] JCI: Generated 1794 derivative records from 53518 primary records. [2025-10-22T22:10:34.268107] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-22T22:10:34.296289] [DEBUG] [LOCAL ] JBTM: Derivative data saved (1794 records). [2025-10-22T22:10:34.299099] [DEBUG] [LOCAL ] JCI: Derivative data saved (1794 records). [2025-10-22T22:10:34.299250] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-22T22:10:34.302120] [INFO ] [MAIN ] JBTM: Successfully saved derivative data. [2025-10-22T22:10:34.302059] [INFO ] [MAIN ] Derivative Progress: 947/2052 symbols completed. JCI took 1.1s. Estimated remaining: 6m 57s. Rate: 159.0 symbols/min [2025-10-22T22:10:34.314597] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:34.314704] [INFO ] [MAIN ] Derivative Progress: 948/2052 symbols completed. JBTM took 1.1s. Estimated remaining: 6m 56s. Rate: 159.2 symbols/min [2025-10-22T22:10:34.314870] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:34.334903] [DEBUG] [LOCAL ] JEF: Loaded 50191 existing records from primary storage. [2025-10-22T22:10:34.335219] [INFO ] [MAIN ] JEF: Loaded 50191 primary data records. [2025-10-22T22:10:34.466996] [DEBUG] [LOCAL ] JFR: Loaded 30994 existing records from primary storage. [2025-10-22T22:10:34.483149] [INFO ] [MAIN ] JFR: Loaded 30994 primary data records. [2025-10-22T22:10:34.565089] [DEBUG] [LOCAL ] JELD: Loaded 45878 existing records from primary storage. [2025-10-22T22:10:34.629939] [INFO ] [MAIN ] JELD: Loaded 45878 primary data records. [2025-10-22T22:10:35.349440] [DEBUG] [MAIN ] JEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:35.350402] [INFO ] [MAIN ] JEF: Generated 1794 derivative records from 50191 primary records. [2025-10-22T22:10:35.350569] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-22T22:10:35.378678] [DEBUG] [LOCAL ] JEF: Derivative data saved (1794 records). [2025-10-22T22:10:35.383890] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-10-22T22:10:35.384266] [DEBUG] [MAIN ] JFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:35.386184] [INFO ] [MAIN ] Derivative Progress: 949/2052 symbols completed. JEF took 1.2s. Estimated remaining: 6m 57s. Rate: 158.9 symbols/min [2025-10-22T22:10:35.387313] [INFO ] [MAIN ] JFR: Generated 1794 derivative records from 30994 primary records. [2025-10-22T22:10:35.386486] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:35.388435] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-22T22:10:35.406820] [DEBUG] [LOCAL ] JFR: Derivative data saved (1794 records). [2025-10-22T22:10:35.407080] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-22T22:10:35.417210] [INFO ] [MAIN ] Derivative Progress: 950/2052 symbols completed. JFR took 1.1s. Estimated remaining: 6m 56s. Rate: 159.0 symbols/min [2025-10-22T22:10:35.426261] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:35.426091] [DEBUG] [MAIN ] JELD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:35.427492] [INFO ] [MAIN ] JELD: Generated 1794 derivative records from 45878 primary records. [2025-10-22T22:10:35.427631] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-22T22:10:35.445311] [DEBUG] [LOCAL ] JGH: Loaded 12537 existing records from primary storage. [2025-10-22T22:10:35.447394] [INFO ] [MAIN ] JGH: Loaded 12537 primary data records. [2025-10-22T22:10:35.462574] [DEBUG] [LOCAL ] JELD: Derivative data saved (1794 records). [2025-10-22T22:10:35.487751] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-22T22:10:35.509764] [INFO ] [MAIN ] Derivative Progress: 951/2052 symbols completed. JELD took 1.2s. Estimated remaining: 6m 55s. Rate: 159.2 symbols/min [2025-10-22T22:10:35.540202] [DEBUG] [LOCAL ] JHI: Loaded 4142 existing records from primary storage. [2025-10-22T22:10:35.532508] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:35.558823] [INFO ] [MAIN ] JHI: Loaded 4142 primary data records. [2025-10-22T22:10:35.751089] [DEBUG] [LOCAL ] JHS: Loaded 2984 existing records from primary storage. [2025-10-22T22:10:35.877744] [INFO ] [MAIN ] JHS: Loaded 2984 primary data records. [2025-10-22T22:10:36.407516] [DEBUG] [MAIN ] JGH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:36.420390] [INFO ] [MAIN ] JGH: Generated 1794 derivative records from 12537 primary records. [2025-10-22T22:10:36.421013] [DEBUG] [MAIN ] JHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:36.421626] [INFO ] [MAIN ] JHI: Generated 1794 derivative records from 4142 primary records. [2025-10-22T22:10:36.421922] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-22T22:10:36.421866] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-22T22:10:36.450846] [DEBUG] [LOCAL ] JHI: Derivative data saved (1794 records). [2025-10-22T22:10:36.455184] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-10-22T22:10:36.455105] [DEBUG] [LOCAL ] JGH: Derivative data saved (1794 records). [2025-10-22T22:10:36.457545] [INFO ] [MAIN ] Derivative Progress: 952/2052 symbols completed. JHI took 1.0s. Estimated remaining: 6m 55s. Rate: 158.9 symbols/min [2025-10-22T22:10:36.455297] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-22T22:10:36.459763] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:36.467946] [INFO ] [MAIN ] Derivative Progress: 953/2052 symbols completed. JGH took 1.1s. Estimated remaining: 6m 55s. Rate: 159.1 symbols/min [2025-10-22T22:10:36.474013] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:36.473915] [DEBUG] [MAIN ] JHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:36.475141] [INFO ] [MAIN ] JHS: Generated 1794 derivative records from 2984 primary records. [2025-10-22T22:10:36.475467] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-22T22:10:36.495840] [DEBUG] [LOCAL ] JHS: Derivative data saved (1794 records). [2025-10-22T22:10:36.496021] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-22T22:10:36.498668] [INFO ] [MAIN ] Derivative Progress: 954/2052 symbols completed. JHS took 1.0s. Estimated remaining: 6m 54s. Rate: 159.2 symbols/min [2025-10-22T22:10:36.498861] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:36.505838] [DEBUG] [LOCAL ] JILL: Loaded 15268 existing records from primary storage. [2025-10-22T22:10:36.505944] [INFO ] [MAIN ] JILL: Loaded 15268 primary data records. [2025-10-22T22:10:36.838083] [DEBUG] [LOCAL ] JHX: Loaded 53199 existing records from primary storage. [2025-10-22T22:10:36.846780] [INFO ] [MAIN ] JHX: Loaded 53199 primary data records. [2025-10-22T22:10:36.930874] [DEBUG] [LOCAL ] JKS: Loaded 39215 existing records from primary storage. [2025-10-22T22:10:36.938337] [INFO ] [MAIN ] JKS: Loaded 39215 primary data records. [2025-10-22T22:10:37.509349] [DEBUG] [MAIN ] JILL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:37.510450] [INFO ] [MAIN ] JILL: Generated 1794 derivative records from 15268 primary records. [2025-10-22T22:10:37.510618] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-22T22:10:37.528304] [DEBUG] [LOCAL ] JILL: Derivative data saved (1794 records). [2025-10-22T22:10:37.528902] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-22T22:10:37.531213] [INFO ] [MAIN ] Derivative Progress: 955/2052 symbols completed. JILL took 1.1s. Estimated remaining: 6m 54s. Rate: 158.9 symbols/min [2025-10-22T22:10:37.531466] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:37.548491] [DEBUG] [MAIN ] JHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:37.549315] [INFO ] [MAIN ] JHX: Generated 1794 derivative records from 53199 primary records. [2025-10-22T22:10:37.549434] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-22T22:10:37.566756] [DEBUG] [LOCAL ] JHX: Derivative data saved (1794 records). [2025-10-22T22:10:37.567582] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-22T22:10:37.569844] [INFO ] [MAIN ] Derivative Progress: 956/2052 symbols completed. JHX took 1.1s. Estimated remaining: 6m 53s. Rate: 159.1 symbols/min [2025-10-22T22:10:37.570281] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:37.583284] [DEBUG] [MAIN ] JKS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:37.591842] [INFO ] [MAIN ] JKS: Generated 1794 derivative records from 39215 primary records. [2025-10-22T22:10:37.592594] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-22T22:10:37.620129] [DEBUG] [LOCAL ] JLS: Loaded 4013 existing records from primary storage. [2025-10-22T22:10:37.616501] [DEBUG] [LOCAL ] JLL: Loaded 31450 existing records from primary storage. [2025-10-22T22:10:37.620963] [INFO ] [MAIN ] JLL: Loaded 31450 primary data records. [2025-10-22T22:10:37.621254] [DEBUG] [LOCAL ] JKS: Derivative data saved (1794 records). [2025-10-22T22:10:37.621346] [INFO ] [MAIN ] JLS: Loaded 4013 primary data records. [2025-10-22T22:10:37.621402] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-22T22:10:37.635896] [INFO ] [MAIN ] Derivative Progress: 957/2052 symbols completed. JKS took 1.1s. Estimated remaining: 6m 53s. Rate: 159.2 symbols/min [2025-10-22T22:10:37.636074] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:38.243249] [DEBUG] [LOCAL ] JMIA: Loaded 51205 existing records from primary storage. [2025-10-22T22:10:38.244551] [INFO ] [MAIN ] JMIA: Loaded 51205 primary data records. [2025-10-22T22:10:38.572953] [DEBUG] [MAIN ] JLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:38.574128] [INFO ] [MAIN ] JLS: Generated 1794 derivative records from 4013 primary records. [2025-10-22T22:10:38.574279] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-22T22:10:38.603281] [DEBUG] [LOCAL ] JLS: Derivative data saved (1794 records). [2025-10-22T22:10:38.603934] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-10-22T22:10:38.603757] [DEBUG] [MAIN ] JLL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:38.607791] [INFO ] [MAIN ] JLL: Generated 1794 derivative records from 31450 primary records. [2025-10-22T22:10:38.606785] [INFO ] [MAIN ] Derivative Progress: 958/2052 symbols completed. JLS took 1.0s. Estimated remaining: 6m 53s. Rate: 159.0 symbols/min [2025-10-22T22:10:38.608020] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-22T22:10:38.626800] [DEBUG] [LOCAL ] JLL: Derivative data saved (1794 records). [2025-10-22T22:10:38.626958] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-10-22T22:10:38.629138] [INFO ] [MAIN ] Derivative Progress: 959/2052 symbols completed. JLL took 1.1s. Estimated remaining: 6m 52s. Rate: 159.1 symbols/min [2025-10-22T22:10:38.641293] [DEBUG] [MAIN ] JMIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:38.641861] [INFO ] [MAIN ] JMIA: Generated 1794 derivative records from 51205 primary records. [2025-10-22T22:10:38.641921] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-22T22:10:38.656495] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1794 records). [2025-10-22T22:10:38.656554] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-10-22T22:10:38.659004] [INFO ] [MAIN ] Derivative Progress: 960/2052 symbols completed. JMIA took 1.0s. Estimated remaining: 6m 51s. Rate: 159.3 symbols/min [2025-10-22T22:10:38.659378] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:38.659477] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:38.659525] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:38.683033] [DEBUG] [LOCAL ] JOE: Loaded 23683 existing records from primary storage. [2025-10-22T22:10:38.683156] [INFO ] [MAIN ] JOE: Loaded 23683 primary data records. [2025-10-22T22:10:38.898894] [DEBUG] [LOCAL ] JOBY: Loaded 53809 existing records from primary storage. [2025-10-22T22:10:38.905068] [INFO ] [MAIN ] JOBY: Loaded 53809 primary data records. [2025-10-22T22:10:39.104075] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-22T22:10:39.114942] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-10-22T22:10:39.681257] [DEBUG] [MAIN ] JOE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:39.682451] [INFO ] [MAIN ] JOE: Generated 1794 derivative records from 23683 primary records. [2025-10-22T22:10:39.683503] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-22T22:10:39.700976] [DEBUG] [LOCAL ] JOE: Derivative data saved (1794 records). [2025-10-22T22:10:39.701267] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-22T22:10:39.703773] [INFO ] [MAIN ] Derivative Progress: 961/2052 symbols completed. JOE took 1.0s. Estimated remaining: 6m 52s. Rate: 159.0 symbols/min [2025-10-22T22:10:39.704233] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:39.737538] [DEBUG] [MAIN ] JOBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:39.740870] [DEBUG] [MAIN ] JNJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:39.741677] [INFO ] [MAIN ] JOBY: Generated 1794 derivative records from 53809 primary records. [2025-10-22T22:10:39.742283] [INFO ] [MAIN ] JNJ: Generated 1794 derivative records from 53753 primary records. [2025-10-22T22:10:39.742599] [DEBUG] [LOCAL ] JOF: Loaded 6920 existing records from primary storage. [2025-10-22T22:10:39.742386] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-22T22:10:39.742816] [INFO ] [MAIN ] JOF: Loaded 6920 primary data records. [2025-10-22T22:10:39.742741] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-22T22:10:39.838605] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1794 records). [2025-10-22T22:10:39.844081] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1794 records). [2025-10-22T22:10:39.861327] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-22T22:10:39.856130] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-22T22:10:39.869858] [INFO ] [MAIN ] Derivative Progress: 962/2052 symbols completed. JNJ took 1.2s. Estimated remaining: 6m 51s. Rate: 159.1 symbols/min [2025-10-22T22:10:39.883619] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:39.883815] [INFO ] [MAIN ] Derivative Progress: 963/2052 symbols completed. JOBY took 1.2s. Estimated remaining: 6m 50s. Rate: 159.2 symbols/min [2025-10-22T22:10:39.883998] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:40.110921] [DEBUG] [LOCAL ] JPC: Loaded 36948 existing records from primary storage. [2025-10-22T22:10:40.112248] [INFO ] [MAIN ] JPC: Loaded 36948 primary data records. [2025-10-22T22:10:40.319905] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-22T22:10:40.440334] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-10-22T22:10:40.527118] [DEBUG] [MAIN ] JOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:40.545504] [INFO ] [MAIN ] JOF: Generated 1794 derivative records from 6920 primary records. [2025-10-22T22:10:40.564181] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-22T22:10:40.630184] [DEBUG] [LOCAL ] JOF: Derivative data saved (1794 records). [2025-10-22T22:10:40.655761] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-22T22:10:40.661398] [INFO ] [MAIN ] Derivative Progress: 964/2052 symbols completed. JOF took 1.0s. Estimated remaining: 6m 50s. Rate: 159.0 symbols/min [2025-10-22T22:10:40.766615] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:40.796626] [DEBUG] [MAIN ] JPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:40.797419] [INFO ] [MAIN ] JPC: Generated 1794 derivative records from 36948 primary records. [2025-10-22T22:10:40.797816] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-10-22T22:10:40.814039] [DEBUG] [LOCAL ] JPC: Derivative data saved (1794 records). [2025-10-22T22:10:40.814299] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-10-22T22:10:40.816855] [INFO ] [MAIN ] Derivative Progress: 965/2052 symbols completed. JPC took 0.9s. Estimated remaining: 6m 50s. Rate: 159.1 symbols/min [2025-10-22T22:10:40.817231] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:40.850897] [DEBUG] [MAIN ] JPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:40.852813] [INFO ] [MAIN ] JPM: Generated 1794 derivative records from 53794 primary records. [2025-10-22T22:10:40.852892] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-22T22:10:40.854184] [DEBUG] [LOCAL ] JQC: Loaded 33868 existing records from primary storage. [2025-10-22T22:10:40.866095] [INFO ] [MAIN ] JQC: Loaded 33868 primary data records. [2025-10-22T22:10:40.884378] [DEBUG] [LOCAL ] JPM: Derivative data saved (1794 records). [2025-10-22T22:10:40.903835] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-22T22:10:40.964867] [INFO ] [MAIN ] Derivative Progress: 966/2052 symbols completed. JPM took 1.1s. Estimated remaining: 6m 49s. Rate: 159.2 symbols/min [2025-10-22T22:10:40.965060] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:40.962755] [DEBUG] [LOCAL ] JRI: Loaded 15306 existing records from primary storage. [2025-10-22T22:10:40.983618] [INFO ] [MAIN ] JRI: Loaded 15306 primary data records. [2025-10-22T22:10:41.312278] [DEBUG] [LOCAL ] JRS: Loaded 11529 existing records from primary storage. [2025-10-22T22:10:41.318780] [INFO ] [MAIN ] JRS: Loaded 11529 primary data records. [2025-10-22T22:10:41.852045] [DEBUG] [MAIN ] JQC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:41.854291] [INFO ] [MAIN ] JQC: Generated 1794 derivative records from 33868 primary records. [2025-10-22T22:10:41.854396] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-22T22:10:41.876400] [DEBUG] [LOCAL ] JQC: Derivative data saved (1794 records). [2025-10-22T22:10:41.884779] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-22T22:10:41.887044] [INFO ] [MAIN ] Derivative Progress: 967/2052 symbols completed. JQC took 1.1s. Estimated remaining: 6m 49s. Rate: 159.0 symbols/min [2025-10-22T22:10:41.893315] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:41.895872] [DEBUG] [MAIN ] JRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:41.896810] [INFO ] [MAIN ] JRI: Generated 1794 derivative records from 15306 primary records. [2025-10-22T22:10:41.905074] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-22T22:10:41.911803] [DEBUG] [MAIN ] JRS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:10:41.912936] [INFO ] [MAIN ] JRS: Generated 1793 derivative records from 11529 primary records. [2025-10-22T22:10:41.913175] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-22T22:10:41.929778] [DEBUG] [LOCAL ] JRI: Derivative data saved (1794 records). [2025-10-22T22:10:41.942784] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-22T22:10:41.944773] [DEBUG] [LOCAL ] JRS: Derivative data saved (1793 records). [2025-10-22T22:10:41.947410] [INFO ] [MAIN ] Derivative Progress: 968/2052 symbols completed. JRI took 1.1s. Estimated remaining: 6m 49s. Rate: 159.1 symbols/min [2025-10-22T22:10:41.947623] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-22T22:10:41.950422] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:41.950581] [INFO ] [MAIN ] Derivative Progress: 969/2052 symbols completed. JRS took 1.0s. Estimated remaining: 6m 48s. Rate: 159.3 symbols/min [2025-10-22T22:10:41.951218] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:41.976669] [DEBUG] [LOCAL ] KAI: Loaded 13405 existing records from primary storage. [2025-10-22T22:10:41.989568] [INFO ] [MAIN ] KAI: Loaded 13405 primary data records. [2025-10-22T22:10:41.991573] [DEBUG] [LOCAL ] JXN: Loaded 44322 existing records from primary storage. [2025-10-22T22:10:42.022903] [INFO ] [MAIN ] JXN: Loaded 44322 primary data records. [2025-10-22T22:10:42.271192] [DEBUG] [LOCAL ] K: Loaded 50378 existing records from primary storage. [2025-10-22T22:10:42.435614] [INFO ] [MAIN ] K: Loaded 50378 primary data records. [2025-10-22T22:10:43.017089] [DEBUG] [MAIN ] KAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:43.018144] [INFO ] [MAIN ] KAI: Generated 1794 derivative records from 13405 primary records. [2025-10-22T22:10:43.018354] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-22T22:10:43.038854] [DEBUG] [LOCAL ] KAI: Derivative data saved (1794 records). [2025-10-22T22:10:43.039727] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-22T22:10:43.049816] [INFO ] [MAIN ] Derivative Progress: 970/2052 symbols completed. KAI took 1.1s. Estimated remaining: 6m 48s. Rate: 159.0 symbols/min [2025-10-22T22:10:43.056336] [DEBUG] [MAIN ] JXN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:43.056459] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:43.057675] [INFO ] [MAIN ] JXN: Generated 1794 derivative records from 44322 primary records. [2025-10-22T22:10:43.058087] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-22T22:10:43.076626] [DEBUG] [LOCAL ] JXN: Derivative data saved (1794 records). [2025-10-22T22:10:43.077980] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-22T22:10:43.082252] [INFO ] [MAIN ] Derivative Progress: 971/2052 symbols completed. JXN took 1.2s. Estimated remaining: 6m 48s. Rate: 159.1 symbols/min [2025-10-22T22:10:43.082720] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:43.096891] [DEBUG] [MAIN ] K: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:43.097817] [INFO ] [MAIN ] K: Generated 1794 derivative records from 50378 primary records. [2025-10-22T22:10:43.097883] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-22T22:10:43.114780] [DEBUG] [LOCAL ] K: Derivative data saved (1794 records). [2025-10-22T22:10:43.114964] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-22T22:10:43.127693] [INFO ] [MAIN ] Derivative Progress: 972/2052 symbols completed. K took 1.2s. Estimated remaining: 6m 47s. Rate: 159.3 symbols/min [2025-10-22T22:10:43.128109] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:43.144068] [DEBUG] [LOCAL ] KB: Loaded 23045 existing records from primary storage. [2025-10-22T22:10:43.155267] [INFO ] [MAIN ] KB: Loaded 23045 primary data records. [2025-10-22T22:10:43.157579] [DEBUG] [LOCAL ] KAR: Loaded 39707 existing records from primary storage. [2025-10-22T22:10:43.175262] [INFO ] [MAIN ] KAR: Loaded 39707 primary data records. [2025-10-22T22:10:43.386274] [DEBUG] [LOCAL ] KBDC: Loaded 22661 existing records from primary storage. [2025-10-22T22:10:43.403254] [INFO ] [MAIN ] KBDC: Loaded 22661 primary data records. [2025-10-22T22:10:44.146909] [DEBUG] [MAIN ] KAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:44.146322] [DEBUG] [MAIN ] KB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:44.148011] [INFO ] [MAIN ] KB: Generated 1794 derivative records from 23045 primary records. [2025-10-22T22:10:44.148764] [INFO ] [MAIN ] KAR: Generated 1794 derivative records from 39707 primary records. [2025-10-22T22:10:44.148959] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-22T22:10:44.149981] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-22T22:10:44.178695] [DEBUG] [LOCAL ] KB: Derivative data saved (1794 records). [2025-10-22T22:10:44.183728] [DEBUG] [LOCAL ] KAR: Derivative data saved (1794 records). [2025-10-22T22:10:44.184735] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-22T22:10:44.187002] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-22T22:10:44.186897] [INFO ] [MAIN ] Derivative Progress: 973/2052 symbols completed. KAR took 1.1s. Estimated remaining: 6m 47s. Rate: 159.0 symbols/min [2025-10-22T22:10:44.190016] [INFO ] [MAIN ] Derivative Progress: 974/2052 symbols completed. KB took 1.1s. Estimated remaining: 6m 46s. Rate: 159.2 symbols/min [2025-10-22T22:10:44.209891] [DEBUG] [MAIN ] KBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:44.210528] [INFO ] [MAIN ] KBDC: Generated 1794 derivative records from 22661 primary records. [2025-10-22T22:10:44.210596] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-22T22:10:44.231144] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1794 records). [2025-10-22T22:10:44.231201] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-22T22:10:44.233706] [INFO ] [MAIN ] Derivative Progress: 975/2052 symbols completed. KBDC took 1.1s. Estimated remaining: 6m 46s. Rate: 159.3 symbols/min [2025-10-22T22:10:44.234111] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:44.234232] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:44.234056] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:44.300706] [DEBUG] [LOCAL ] KBH: Loaded 48710 existing records from primary storage. [2025-10-22T22:10:44.300979] [INFO ] [MAIN ] KBH: Loaded 48710 primary data records. [2025-10-22T22:10:44.418006] [DEBUG] [LOCAL ] KBR: Loaded 47970 existing records from primary storage. [2025-10-22T22:10:44.428715] [INFO ] [MAIN ] KBR: Loaded 47970 primary data records. [2025-10-22T22:10:44.429659] [DEBUG] [LOCAL ] KD: Loaded 52332 existing records from primary storage. [2025-10-22T22:10:44.429767] [INFO ] [MAIN ] KD: Loaded 52332 primary data records. [2025-10-22T22:10:45.271627] [DEBUG] [MAIN ] KBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:45.273770] [INFO ] [MAIN ] KBH: Generated 1794 derivative records from 48710 primary records. [2025-10-22T22:10:45.274739] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-22T22:10:45.292095] [DEBUG] [LOCAL ] KBH: Derivative data saved (1794 records). [2025-10-22T22:10:45.292327] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-22T22:10:45.295512] [INFO ] [MAIN ] Derivative Progress: 976/2052 symbols completed. KBH took 1.1s. Estimated remaining: 6m 46s. Rate: 159.0 symbols/min [2025-10-22T22:10:45.296932] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:45.311669] [DEBUG] [MAIN ] KD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:45.325916] [INFO ] [MAIN ] KD: Generated 1794 derivative records from 52332 primary records. [2025-10-22T22:10:45.327597] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-22T22:10:45.327978] [DEBUG] [MAIN ] KBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:45.337818] [INFO ] [MAIN ] KBR: Generated 1794 derivative records from 47970 primary records. [2025-10-22T22:10:45.349674] [DEBUG] [LOCAL ] KD: Derivative data saved (1794 records). [2025-10-22T22:10:45.349820] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-22T22:10:45.352443] [INFO ] [MAIN ] Derivative Progress: 977/2052 symbols completed. KD took 1.1s. Estimated remaining: 6m 45s. Rate: 159.1 symbols/min [2025-10-22T22:10:45.345234] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-22T22:10:45.347930] [DEBUG] [LOCAL ] KEN: Loaded 4612 existing records from primary storage. [2025-10-22T22:10:45.352953] [INFO ] [MAIN ] KEN: Loaded 4612 primary data records. [2025-10-22T22:10:45.352697] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:45.476485] [DEBUG] [LOCAL ] KBR: Derivative data saved (1794 records). [2025-10-22T22:10:45.476779] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-22T22:10:45.483864] [INFO ] [MAIN ] Derivative Progress: 978/2052 symbols completed. KBR took 1.2s. Estimated remaining: 6m 45s. Rate: 159.2 symbols/min [2025-10-22T22:10:45.493118] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:45.700114] [DEBUG] [LOCAL ] KEP: Loaded 32572 existing records from primary storage. [2025-10-22T22:10:45.700501] [INFO ] [MAIN ] KEP: Loaded 32572 primary data records. [2025-10-22T22:10:45.875444] [DEBUG] [LOCAL ] KEX: Loaded 38734 existing records from primary storage. [2025-10-22T22:10:45.905023] [INFO ] [MAIN ] KEX: Loaded 38734 primary data records. [2025-10-22T22:10:46.198738] [DEBUG] [MAIN ] KEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:46.235061] [INFO ] [MAIN ] KEN: Generated 1794 derivative records from 4612 primary records. [2025-10-22T22:10:46.335988] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-22T22:10:46.367167] [DEBUG] [LOCAL ] KEN: Derivative data saved (1794 records). [2025-10-22T22:10:46.367627] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-22T22:10:46.370128] [INFO ] [MAIN ] Derivative Progress: 979/2052 symbols completed. KEN took 1.1s. Estimated remaining: 6m 45s. Rate: 159.0 symbols/min [2025-10-22T22:10:46.370631] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:46.388401] [DEBUG] [MAIN ] KEP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:46.389126] [INFO ] [MAIN ] KEP: Generated 1794 derivative records from 32572 primary records. [2025-10-22T22:10:46.389342] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-22T22:10:46.407089] [DEBUG] [LOCAL ] KEP: Derivative data saved (1794 records). [2025-10-22T22:10:46.409113] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-22T22:10:46.412222] [INFO ] [MAIN ] Derivative Progress: 980/2052 symbols completed. KEP took 1.1s. Estimated remaining: 6m 44s. Rate: 159.2 symbols/min [2025-10-22T22:10:46.412443] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:46.435138] [DEBUG] [MAIN ] KEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:46.435974] [INFO ] [MAIN ] KEX: Generated 1794 derivative records from 38734 primary records. [2025-10-22T22:10:46.436685] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-22T22:10:46.439610] [DEBUG] [LOCAL ] KF: Loaded 2360 existing records from primary storage. [2025-10-22T22:10:46.446726] [INFO ] [MAIN ] KF: Loaded 2360 primary data records. [2025-10-22T22:10:46.551083] [DEBUG] [LOCAL ] KEYS: Loaded 43120 existing records from primary storage. [2025-10-22T22:10:46.551219] [INFO ] [MAIN ] KEYS: Loaded 43120 primary data records. [2025-10-22T22:10:46.545230] [DEBUG] [LOCAL ] KEX: Derivative data saved (1794 records). [2025-10-22T22:10:46.556781] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-22T22:10:46.570448] [INFO ] [MAIN ] Derivative Progress: 981/2052 symbols completed. KEX took 1.1s. Estimated remaining: 6m 43s. Rate: 159.3 symbols/min [2025-10-22T22:10:46.587138] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:46.926886] [DEBUG] [LOCAL ] KFRC: Loaded 20843 existing records from primary storage. [2025-10-22T22:10:47.002511] [INFO ] [MAIN ] KFRC: Loaded 20843 primary data records. [2025-10-22T22:10:47.408167] [DEBUG] [MAIN ] KF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:47.410030] [INFO ] [MAIN ] KF: Generated 1794 derivative records from 2360 primary records. [2025-10-22T22:10:47.410623] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-22T22:10:47.427362] [DEBUG] [LOCAL ] KF: Derivative data saved (1794 records). [2025-10-22T22:10:47.440163] [DEBUG] [MAIN ] KEYS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:47.440890] [INFO ] [MAIN ] KEYS: Generated 1794 derivative records from 43120 primary records. [2025-10-22T22:10:47.440998] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-10-22T22:10:47.441105] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-22T22:10:47.443176] [INFO ] [MAIN ] Derivative Progress: 982/2052 symbols completed. KF took 1.0s. Estimated remaining: 6m 44s. Rate: 159.1 symbols/min [2025-10-22T22:10:47.444756] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:47.461207] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1794 records). [2025-10-22T22:10:47.461698] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-10-22T22:10:47.464470] [INFO ] [MAIN ] Derivative Progress: 983/2052 symbols completed. KEYS took 1.1s. Estimated remaining: 6m 43s. Rate: 159.2 symbols/min [2025-10-22T22:10:47.464850] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:47.472963] [DEBUG] [LOCAL ] KFS: Loaded 8701 existing records from primary storage. [2025-10-22T22:10:47.473256] [INFO ] [MAIN ] KFS: Loaded 8701 primary data records. [2025-10-22T22:10:47.641333] [DEBUG] [MAIN ] KFRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:47.668123] [INFO ] [MAIN ] KFRC: Generated 1794 derivative records from 20843 primary records. [2025-10-22T22:10:47.669913] [DEBUG] [LOCAL ] KFY: Loaded 29511 existing records from primary storage. [2025-10-22T22:10:47.797189] [INFO ] [MAIN ] KFY: Loaded 29511 primary data records. [2025-10-22T22:10:47.797042] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-22T22:10:47.900704] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1794 records). [2025-10-22T22:10:47.917201] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-22T22:10:47.931414] [INFO ] [MAIN ] Derivative Progress: 984/2052 symbols completed. KFRC took 1.3s. Estimated remaining: 6m 43s. Rate: 159.2 symbols/min [2025-10-22T22:10:47.931910] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:48.164443] [DEBUG] [MAIN ] KFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:48.165521] [INFO ] [MAIN ] KFS: Generated 1794 derivative records from 8701 primary records. [2025-10-22T22:10:48.165840] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-22T22:10:48.183828] [DEBUG] [LOCAL ] KFS: Derivative data saved (1794 records). [2025-10-22T22:10:48.184038] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-22T22:10:48.200681] [INFO ] [MAIN ] Derivative Progress: 985/2052 symbols completed. KFS took 0.8s. Estimated remaining: 6m 42s. Rate: 159.2 symbols/min [2025-10-22T22:10:48.201853] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:48.206419] [DEBUG] [LOCAL ] KGC: Loaded 53700 existing records from primary storage. [2025-10-22T22:10:48.207074] [INFO ] [MAIN ] KGC: Loaded 53700 primary data records. [2025-10-22T22:10:48.234549] [DEBUG] [MAIN ] KFY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:48.261016] [INFO ] [MAIN ] KFY: Generated 1794 derivative records from 29511 primary records. [2025-10-22T22:10:48.261352] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-10-22T22:10:48.343779] [DEBUG] [LOCAL ] KFY: Derivative data saved (1794 records). [2025-10-22T22:10:48.349216] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-10-22T22:10:48.373262] [INFO ] [MAIN ] Derivative Progress: 986/2052 symbols completed. KFY took 0.9s. Estimated remaining: 6m 42s. Rate: 159.3 symbols/min [2025-10-22T22:10:48.394366] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:48.572326] [DEBUG] [LOCAL ] KGS: Loaded 46063 existing records from primary storage. [2025-10-22T22:10:48.572743] [INFO ] [MAIN ] KGS: Loaded 46063 primary data records. [2025-10-22T22:10:48.662243] [DEBUG] [LOCAL ] KIO: Loaded 21683 existing records from primary storage. [2025-10-22T22:10:48.684498] [INFO ] [MAIN ] KIO: Loaded 21683 primary data records. [2025-10-22T22:10:49.222857] [DEBUG] [MAIN ] KGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:49.231072] [INFO ] [MAIN ] KGC: Generated 1794 derivative records from 53700 primary records. [2025-10-22T22:10:49.274035] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-22T22:10:49.424971] [DEBUG] [LOCAL ] KGC: Derivative data saved (1794 records). [2025-10-22T22:10:49.426679] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-22T22:10:49.429911] [INFO ] [MAIN ] Derivative Progress: 987/2052 symbols completed. KGC took 1.5s. Estimated remaining: 6m 42s. Rate: 159.0 symbols/min [2025-10-22T22:10:49.431823] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:49.470014] [DEBUG] [MAIN ] KGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:49.471720] [INFO ] [MAIN ] KGS: Generated 1794 derivative records from 46063 primary records. [2025-10-22T22:10:49.472077] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-22T22:10:49.502728] [DEBUG] [LOCAL ] KGS: Derivative data saved (1794 records). [2025-10-22T22:10:49.518426] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-22T22:10:49.518110] [DEBUG] [MAIN ] KIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:49.519684] [INFO ] [MAIN ] KIO: Generated 1794 derivative records from 21683 primary records. [2025-10-22T22:10:49.523902] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-22T22:10:49.523474] [INFO ] [MAIN ] Derivative Progress: 988/2052 symbols completed. KGS took 1.3s. Estimated remaining: 6m 41s. Rate: 159.1 symbols/min [2025-10-22T22:10:49.566841] [DEBUG] [LOCAL ] KIO: Derivative data saved (1794 records). [2025-10-22T22:10:49.568338] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-22T22:10:49.574494] [INFO ] [MAIN ] Derivative Progress: 989/2052 symbols completed. KIO took 1.2s. Estimated remaining: 6m 40s. Rate: 159.3 symbols/min [2025-10-22T22:10:49.599253] [DEBUG] [LOCAL ] KKR: Loaded 53500 existing records from primary storage. [2025-10-22T22:10:49.599542] [INFO ] [MAIN ] KKR: Loaded 53500 primary data records. [2025-10-22T22:10:49.982901] [DEBUG] [MAIN ] KKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:49.983510] [INFO ] [MAIN ] KKR: Generated 1794 derivative records from 53500 primary records. [2025-10-22T22:10:49.983781] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-22T22:10:49.999148] [DEBUG] [LOCAL ] KKR: Derivative data saved (1794 records). [2025-10-22T22:10:49.999206] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-10-22T22:10:50.001262] [INFO ] [MAIN ] Derivative Progress: 990/2052 symbols completed. KKR took 0.6s. Estimated remaining: 6m 40s. Rate: 159.2 symbols/min [2025-10-22T22:10:50.002013] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:50.002267] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:50.002103] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:50.016045] [DEBUG] [LOCAL ] KKRS: Loaded 5547 existing records from primary storage. [2025-10-22T22:10:50.016430] [INFO ] [MAIN ] KKRS: Loaded 5547 primary data records. [2025-10-22T22:10:50.207355] [DEBUG] [LOCAL ] KLC: Loaded 36128 existing records from primary storage. [2025-10-22T22:10:50.272753] [INFO ] [MAIN ] KLC: Loaded 36128 primary data records. [2025-10-22T22:10:50.285625] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-22T22:10:50.411340] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-10-22T22:10:51.116158] [DEBUG] [MAIN ] KKRS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:10:51.117817] [INFO ] [MAIN ] KKRS: Generated 1793 derivative records from 5547 primary records. [2025-10-22T22:10:51.117951] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-22T22:10:51.134423] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1793 records). [2025-10-22T22:10:51.134681] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-22T22:10:51.136591] [INFO ] [MAIN ] Derivative Progress: 991/2052 symbols completed. KKRS took 1.1s. Estimated remaining: 6m 41s. Rate: 158.9 symbols/min [2025-10-22T22:10:51.137027] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:51.147409] [DEBUG] [LOCAL ] KMPB: Loaded 3484 existing records from primary storage. [2025-10-22T22:10:51.147851] [INFO ] [MAIN ] KMPB: Loaded 3484 primary data records. [2025-10-22T22:10:51.192700] [DEBUG] [MAIN ] KLC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:51.240708] [INFO ] [MAIN ] KLC: Generated 1794 derivative records from 36128 primary records. [2025-10-22T22:10:51.247773] [DEBUG] [MAIN ] KMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:51.271525] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-22T22:10:51.272953] [INFO ] [MAIN ] KMI: Generated 1794 derivative records from 53693 primary records. [2025-10-22T22:10:51.277214] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-22T22:10:51.319865] [DEBUG] [LOCAL ] KLC: Derivative data saved (1794 records). [2025-10-22T22:10:51.320588] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-22T22:10:51.335780] [INFO ] [MAIN ] Derivative Progress: 992/2052 symbols completed. KLC took 1.3s. Estimated remaining: 6m 40s. Rate: 159.0 symbols/min [2025-10-22T22:10:51.377999] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:51.508089] [DEBUG] [LOCAL ] KMI: Derivative data saved (1794 records). [2025-10-22T22:10:51.508916] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-10-22T22:10:51.512966] [INFO ] [MAIN ] Derivative Progress: 993/2052 symbols completed. KMI took 1.5s. Estimated remaining: 6m 39s. Rate: 159.1 symbols/min [2025-10-22T22:10:51.513409] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:51.553957] [DEBUG] [MAIN ] KMPB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:51.574273] [INFO ] [MAIN ] KMPB: Generated 1794 derivative records from 3484 primary records. [2025-10-22T22:10:51.574411] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-22T22:10:51.575399] [DEBUG] [LOCAL ] KMPR: Loaded 40496 existing records from primary storage. [2025-10-22T22:10:51.575985] [INFO ] [MAIN ] KMPR: Loaded 40496 primary data records. [2025-10-22T22:10:51.625243] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1794 records). [2025-10-22T22:10:51.671798] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-22T22:10:51.706032] [INFO ] [MAIN ] Derivative Progress: 994/2052 symbols completed. KMPB took 0.6s. Estimated remaining: 6m 39s. Rate: 159.2 symbols/min [2025-10-22T22:10:51.709730] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:51.702119] [DEBUG] [LOCAL ] KMT: Loaded 42861 existing records from primary storage. [2025-10-22T22:10:51.715881] [INFO ] [MAIN ] KMT: Loaded 42861 primary data records. [2025-10-22T22:10:52.314838] [DEBUG] [LOCAL ] KMX: Loaded 53286 existing records from primary storage. [2025-10-22T22:10:52.315315] [INFO ] [MAIN ] KMX: Loaded 53286 primary data records. [2025-10-22T22:10:52.387519] [DEBUG] [MAIN ] KMPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:52.397615] [INFO ] [MAIN ] KMPR: Generated 1794 derivative records from 40496 primary records. [2025-10-22T22:10:52.416115] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-22T22:10:52.477348] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1794 records). [2025-10-22T22:10:52.482693] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-22T22:10:52.505562] [INFO ] [MAIN ] Derivative Progress: 995/2052 symbols completed. KMPR took 1.1s. Estimated remaining: 6m 39s. Rate: 159.0 symbols/min [2025-10-22T22:10:52.541370] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:52.652851] [DEBUG] [MAIN ] KMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:52.664346] [INFO ] [MAIN ] KMT: Generated 1794 derivative records from 42861 primary records. [2025-10-22T22:10:52.664445] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-22T22:10:52.683095] [DEBUG] [LOCAL ] KMT: Derivative data saved (1794 records). [2025-10-22T22:10:52.683464] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-22T22:10:52.686195] [INFO ] [MAIN ] Derivative Progress: 996/2052 symbols completed. KMT took 1.2s. Estimated remaining: 6m 38s. Rate: 159.1 symbols/min [2025-10-22T22:10:52.687190] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:52.716026] [DEBUG] [LOCAL ] KN: Loaded 38389 existing records from primary storage. [2025-10-22T22:10:52.717156] [INFO ] [MAIN ] KN: Loaded 38389 primary data records. [2025-10-22T22:10:52.863694] [DEBUG] [LOCAL ] KNF: Loaded 36630 existing records from primary storage. [2025-10-22T22:10:52.925937] [INFO ] [MAIN ] KNF: Loaded 36630 primary data records. [2025-10-22T22:10:53.035210] [DEBUG] [MAIN ] KMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:53.065024] [INFO ] [MAIN ] KMX: Generated 1794 derivative records from 53286 primary records. [2025-10-22T22:10:53.081611] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-22T22:10:53.193595] [DEBUG] [LOCAL ] KMX: Derivative data saved (1794 records). [2025-10-22T22:10:53.246232] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-10-22T22:10:53.392294] [INFO ] [MAIN ] Derivative Progress: 997/2052 symbols completed. KMX took 1.7s. Estimated remaining: 6m 38s. Rate: 158.9 symbols/min [2025-10-22T22:10:53.406431] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:53.421113] [DEBUG] [LOCAL ] KNOP: Loaded 10075 existing records from primary storage. [2025-10-22T22:10:53.421772] [INFO ] [MAIN ] KNOP: Loaded 10075 primary data records. [2025-10-22T22:10:53.470274] [DEBUG] [MAIN ] KN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:53.510218] [INFO ] [MAIN ] KN: Generated 1794 derivative records from 38389 primary records. [2025-10-22T22:10:53.533687] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-22T22:10:53.573572] [DEBUG] [LOCAL ] KN: Derivative data saved (1794 records). [2025-10-22T22:10:53.591545] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-22T22:10:53.594103] [INFO ] [MAIN ] Derivative Progress: 998/2052 symbols completed. KN took 1.1s. Estimated remaining: 6m 38s. Rate: 159.0 symbols/min [2025-10-22T22:10:53.627973] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:53.768054] [DEBUG] [MAIN ] KNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:53.768846] [INFO ] [MAIN ] KNF: Generated 1794 derivative records from 36630 primary records. [2025-10-22T22:10:53.769605] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-22T22:10:53.791286] [DEBUG] [LOCAL ] KNF: Derivative data saved (1794 records). [2025-10-22T22:10:53.791510] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-22T22:10:53.794243] [INFO ] [MAIN ] Derivative Progress: 999/2052 symbols completed. KNF took 1.1s. Estimated remaining: 6m 37s. Rate: 159.1 symbols/min [2025-10-22T22:10:53.794539] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:53.804045] [DEBUG] [LOCAL ] KNSL: Loaded 18288 existing records from primary storage. [2025-10-22T22:10:53.804506] [INFO ] [MAIN ] KNSL: Loaded 18288 primary data records. [2025-10-22T22:10:54.013063] [DEBUG] [MAIN ] KNOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:54.017952] [INFO ] [MAIN ] KNOP: Generated 1794 derivative records from 10075 primary records. [2025-10-22T22:10:54.018203] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-10-22T22:10:54.153974] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1794 records). [2025-10-22T22:10:54.166791] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-10-22T22:10:54.170087] [INFO ] [MAIN ] Derivative Progress: 1000/2052 symbols completed. KNOP took 0.8s. Estimated remaining: 6m 37s. Rate: 159.1 symbols/min [2025-10-22T22:10:54.171942] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:54.173252] [DEBUG] [LOCAL ] KNTK: Loaded 47207 existing records from primary storage. [2025-10-22T22:10:54.173870] [INFO ] [MAIN ] KNTK: Loaded 47207 primary data records. [2025-10-22T22:10:54.508297] [DEBUG] [MAIN ] KNSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:54.510449] [INFO ] [MAIN ] KNSL: Generated 1794 derivative records from 18288 primary records. [2025-10-22T22:10:54.510786] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-22T22:10:54.536667] [DEBUG] [LOCAL ] KNX: Loaded 52645 existing records from primary storage. [2025-10-22T22:10:54.543750] [INFO ] [MAIN ] KNX: Loaded 52645 primary data records. [2025-10-22T22:10:54.543637] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1794 records). [2025-10-22T22:10:54.565064] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-22T22:10:54.589937] [INFO ] [MAIN ] Derivative Progress: 1001/2052 symbols completed. KNSL took 1.0s. Estimated remaining: 6m 36s. Rate: 159.1 symbols/min [2025-10-22T22:10:54.611051] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:54.870055] [DEBUG] [MAIN ] KNTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:54.871353] [INFO ] [MAIN ] KNTK: Generated 1794 derivative records from 47207 primary records. [2025-10-22T22:10:54.871794] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-22T22:10:54.889480] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1794 records). [2025-10-22T22:10:54.889941] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-22T22:10:54.903785] [INFO ] [MAIN ] Derivative Progress: 1002/2052 symbols completed. KNTK took 1.1s. Estimated remaining: 6m 36s. Rate: 159.1 symbols/min [2025-10-22T22:10:54.904451] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:54.906101] [DEBUG] [LOCAL ] KODK: Loaded 43711 existing records from primary storage. [2025-10-22T22:10:54.906396] [INFO ] [MAIN ] KODK: Loaded 43711 primary data records. [2025-10-22T22:10:55.052912] [DEBUG] [MAIN ] KNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:55.073349] [INFO ] [MAIN ] KNX: Generated 1794 derivative records from 52645 primary records. [2025-10-22T22:10:55.090701] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-22T22:10:55.141383] [DEBUG] [LOCAL ] KOF: Loaded 26529 existing records from primary storage. [2025-10-22T22:10:55.273787] [INFO ] [MAIN ] KOF: Loaded 26529 primary data records. [2025-10-22T22:10:55.280884] [DEBUG] [LOCAL ] KNX: Derivative data saved (1794 records). [2025-10-22T22:10:55.292679] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-22T22:10:55.315039] [INFO ] [MAIN ] Derivative Progress: 1003/2052 symbols completed. KNX took 1.1s. Estimated remaining: 6m 36s. Rate: 159.1 symbols/min [2025-10-22T22:10:55.598211] [DEBUG] [MAIN ] KODK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:55.599228] [INFO ] [MAIN ] KODK: Generated 1794 derivative records from 43711 primary records. [2025-10-22T22:10:55.599405] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-22T22:10:55.615363] [DEBUG] [LOCAL ] KODK: Derivative data saved (1794 records). [2025-10-22T22:10:55.615566] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-22T22:10:55.617686] [INFO ] [MAIN ] Derivative Progress: 1004/2052 symbols completed. KODK took 1.0s. Estimated remaining: 6m 35s. Rate: 159.1 symbols/min [2025-10-22T22:10:55.634124] [DEBUG] [MAIN ] KOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:55.634690] [INFO ] [MAIN ] KOF: Generated 1794 derivative records from 26529 primary records. [2025-10-22T22:10:55.634752] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-22T22:10:55.649413] [DEBUG] [LOCAL ] KOF: Derivative data saved (1794 records). [2025-10-22T22:10:55.649475] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-22T22:10:55.651958] [INFO ] [MAIN ] Derivative Progress: 1005/2052 symbols completed. KOF took 0.7s. Estimated remaining: 6m 34s. Rate: 159.2 symbols/min [2025-10-22T22:10:55.652328] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:55.652425] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:55.652489] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:55.657164] [DEBUG] [LOCAL ] KORE: Loaded 2179 existing records from primary storage. [2025-10-22T22:10:55.657337] [INFO ] [MAIN ] KORE: Loaded 2179 primary data records. [2025-10-22T22:10:55.786268] [DEBUG] [LOCAL ] KOP: Loaded 17332 existing records from primary storage. [2025-10-22T22:10:55.803266] [INFO ] [MAIN ] KOP: Loaded 17332 primary data records. [2025-10-22T22:10:56.094872] [DEBUG] [LOCAL ] KOS: Loaded 53093 existing records from primary storage. [2025-10-22T22:10:56.134779] [INFO ] [MAIN ] KOS: Loaded 53093 primary data records. [2025-10-22T22:10:56.647743] [DEBUG] [MAIN ] KORE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:56.649019] [INFO ] [MAIN ] KORE: Generated 1794 derivative records from 2179 primary records. [2025-10-22T22:10:56.649119] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-10-22T22:10:56.663949] [DEBUG] [LOCAL ] KORE: Derivative data saved (1794 records). [2025-10-22T22:10:56.664335] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-10-22T22:10:56.666432] [INFO ] [MAIN ] Derivative Progress: 1006/2052 symbols completed. KORE took 1.0s. Estimated remaining: 6m 35s. Rate: 159.0 symbols/min [2025-10-22T22:10:56.669085] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:56.683111] [DEBUG] [MAIN ] KOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:56.683899] [INFO ] [MAIN ] KOP: Generated 1794 derivative records from 17332 primary records. [2025-10-22T22:10:56.684078] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-22T22:10:56.702511] [DEBUG] [LOCAL ] KOP: Derivative data saved (1794 records). [2025-10-22T22:10:56.702839] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-22T22:10:56.705573] [INFO ] [MAIN ] Derivative Progress: 1007/2052 symbols completed. KOP took 1.1s. Estimated remaining: 6m 34s. Rate: 159.1 symbols/min [2025-10-22T22:10:56.706076] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:56.718935] [DEBUG] [MAIN ] KOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:56.719943] [INFO ] [MAIN ] KOS: Generated 1794 derivative records from 53093 primary records. [2025-10-22T22:10:56.720061] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-22T22:10:56.736297] [DEBUG] [LOCAL ] KOS: Derivative data saved (1794 records). [2025-10-22T22:10:56.752671] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-22T22:10:56.754990] [INFO ] [MAIN ] Derivative Progress: 1008/2052 symbols completed. KOS took 1.1s. Estimated remaining: 6m 33s. Rate: 159.3 symbols/min [2025-10-22T22:10:56.755377] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:56.784200] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-22T22:10:56.784499] [INFO ] [MAIN ] KR: Loaded 53681 primary data records. [2025-10-22T22:10:56.919062] [DEBUG] [LOCAL ] KRC: Loaded 48094 existing records from primary storage. [2025-10-22T22:10:56.946939] [INFO ] [MAIN ] KRC: Loaded 48094 primary data records. [2025-10-22T22:10:57.250559] [DEBUG] [LOCAL ] KREF: Loaded 38061 existing records from primary storage. [2025-10-22T22:10:57.261447] [INFO ] [MAIN ] KREF: Loaded 38061 primary data records. [2025-10-22T22:10:57.789321] [DEBUG] [MAIN ] KR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:57.791038] [INFO ] [MAIN ] KR: Generated 1794 derivative records from 53681 primary records. [2025-10-22T22:10:57.791263] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-22T22:10:57.809550] [DEBUG] [LOCAL ] KR: Derivative data saved (1794 records). [2025-10-22T22:10:57.810183] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-22T22:10:57.812500] [INFO ] [MAIN ] Derivative Progress: 1009/2052 symbols completed. KR took 1.1s. Estimated remaining: 6m 34s. Rate: 159.0 symbols/min [2025-10-22T22:10:57.812982] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:57.832344] [DEBUG] [MAIN ] KRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:57.833541] [INFO ] [MAIN ] KRC: Generated 1794 derivative records from 48094 primary records. [2025-10-22T22:10:57.833735] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-22T22:10:57.852790] [DEBUG] [LOCAL ] KRC: Derivative data saved (1794 records). [2025-10-22T22:10:57.853088] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-10-22T22:10:57.855637] [INFO ] [MAIN ] Derivative Progress: 1010/2052 symbols completed. KRC took 1.1s. Estimated remaining: 6m 33s. Rate: 159.1 symbols/min [2025-10-22T22:10:57.856073] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:57.869285] [DEBUG] [MAIN ] KREF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:57.870163] [INFO ] [MAIN ] KREF: Generated 1794 derivative records from 38061 primary records. [2025-10-22T22:10:57.870412] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-22T22:10:57.897360] [DEBUG] [LOCAL ] KREF: Derivative data saved (1794 records). [2025-10-22T22:10:57.897598] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-22T22:10:57.900133] [INFO ] [MAIN ] Derivative Progress: 1011/2052 symbols completed. KREF took 1.1s. Estimated remaining: 6m 32s. Rate: 159.3 symbols/min [2025-10-22T22:10:57.901182] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:57.915866] [DEBUG] [LOCAL ] KRG: Loaded 49271 existing records from primary storage. [2025-10-22T22:10:57.922444] [INFO ] [MAIN ] KRG: Loaded 49271 primary data records. [2025-10-22T22:10:58.038509] [DEBUG] [LOCAL ] KRO: Loaded 26553 existing records from primary storage. [2025-10-22T22:10:58.041999] [INFO ] [MAIN ] KRO: Loaded 26553 primary data records. [2025-10-22T22:10:58.216385] [DEBUG] [LOCAL ] KRP: Loaded 35928 existing records from primary storage. [2025-10-22T22:10:58.232771] [INFO ] [MAIN ] KRP: Loaded 35928 primary data records. [2025-10-22T22:10:58.858412] [DEBUG] [MAIN ] KRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:58.859615] [INFO ] [MAIN ] KRG: Generated 1794 derivative records from 49271 primary records. [2025-10-22T22:10:58.859871] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-22T22:10:58.891126] [DEBUG] [LOCAL ] KRG: Derivative data saved (1794 records). [2025-10-22T22:10:58.891444] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-22T22:10:58.891618] [DEBUG] [MAIN ] KRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:58.893616] [INFO ] [MAIN ] Derivative Progress: 1012/2052 symbols completed. KRG took 1.1s. Estimated remaining: 6m 32s. Rate: 159.0 symbols/min [2025-10-22T22:10:58.893902] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:58.894595] [INFO ] [MAIN ] KRO: Generated 1794 derivative records from 26553 primary records. [2025-10-22T22:10:58.894749] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-22T22:10:58.911477] [DEBUG] [LOCAL ] KRO: Derivative data saved (1794 records). [2025-10-22T22:10:58.911712] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-22T22:10:58.914760] [INFO ] [MAIN ] Derivative Progress: 1013/2052 symbols completed. KRO took 1.1s. Estimated remaining: 6m 32s. Rate: 159.1 symbols/min [2025-10-22T22:10:58.914911] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:58.930225] [DEBUG] [MAIN ] KRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:10:58.931190] [INFO ] [MAIN ] KRP: Generated 1794 derivative records from 35928 primary records. [2025-10-22T22:10:58.931273] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-22T22:10:58.947991] [DEBUG] [LOCAL ] KRP: Derivative data saved (1794 records). [2025-10-22T22:10:58.948154] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-22T22:10:58.951692] [INFO ] [MAIN ] Derivative Progress: 1014/2052 symbols completed. KRP took 1.1s. Estimated remaining: 6m 31s. Rate: 159.3 symbols/min [2025-10-22T22:10:58.964874] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:10:58.994736] [DEBUG] [LOCAL ] KSS: Loaded 53589 existing records from primary storage. [2025-10-22T22:10:58.996230] [INFO ] [MAIN ] KSS: Loaded 53589 primary data records. [2025-10-22T22:10:59.110680] [DEBUG] [LOCAL ] KT: Loaded 45383 existing records from primary storage. [2025-10-22T22:10:59.121886] [INFO ] [MAIN ] KT: Loaded 45383 primary data records. [2025-10-22T22:10:59.271436] [DEBUG] [LOCAL ] KTB: Loaded 40299 existing records from primary storage. [2025-10-22T22:10:59.463863] [INFO ] [MAIN ] KTB: Loaded 40299 primary data records. [2025-10-22T22:11:00.033715] [DEBUG] [MAIN ] KSS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:00.036438] [INFO ] [MAIN ] KSS: Generated 1794 derivative records from 53589 primary records. [2025-10-22T22:11:00.036920] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-22T22:11:00.060852] [DEBUG] [LOCAL ] KSS: Derivative data saved (1794 records). [2025-10-22T22:11:00.061876] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-22T22:11:00.064879] [INFO ] [MAIN ] Derivative Progress: 1015/2052 symbols completed. KSS took 1.2s. Estimated remaining: 6m 31s. Rate: 159.0 symbols/min [2025-10-22T22:11:00.065353] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:00.080441] [DEBUG] [MAIN ] KT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:00.081850] [INFO ] [MAIN ] KT: Generated 1794 derivative records from 45383 primary records. [2025-10-22T22:11:00.082251] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-22T22:11:00.124574] [DEBUG] [LOCAL ] KT: Derivative data saved (1794 records). [2025-10-22T22:11:00.124963] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-22T22:11:00.125588] [DEBUG] [LOCAL ] KTF: Loaded 11658 existing records from primary storage. [2025-10-22T22:11:00.129415] [INFO ] [MAIN ] Derivative Progress: 1016/2052 symbols completed. KT took 1.2s. Estimated remaining: 6m 31s. Rate: 159.1 symbols/min [2025-10-22T22:11:00.129855] [DEBUG] [MAIN ] KTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:00.130235] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:00.130526] [INFO ] [MAIN ] KTF: Loaded 11658 primary data records. [2025-10-22T22:11:00.132062] [INFO ] [MAIN ] KTB: Generated 1794 derivative records from 40299 primary records. [2025-10-22T22:11:00.132603] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-22T22:11:00.261811] [DEBUG] [LOCAL ] KTB: Derivative data saved (1794 records). [2025-10-22T22:11:00.267745] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-22T22:11:00.279639] [INFO ] [MAIN ] Derivative Progress: 1017/2052 symbols completed. KTB took 1.3s. Estimated remaining: 6m 30s. Rate: 159.2 symbols/min [2025-10-22T22:11:00.311481] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:00.515048] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-22T22:11:00.515504] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-10-22T22:11:00.664803] [DEBUG] [LOCAL ] KVYO: Loaded 50891 existing records from primary storage. [2025-10-22T22:11:00.670435] [INFO ] [MAIN ] KVYO: Loaded 50891 primary data records. [2025-10-22T22:11:00.818364] [DEBUG] [MAIN ] KTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:00.868072] [INFO ] [MAIN ] KTF: Generated 1794 derivative records from 11658 primary records. [2025-10-22T22:11:00.887776] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-22T22:11:01.139259] [DEBUG] [LOCAL ] KTF: Derivative data saved (1794 records). [2025-10-22T22:11:01.284843] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-22T22:11:01.300695] [INFO ] [MAIN ] Derivative Progress: 1018/2052 symbols completed. KTF took 1.2s. Estimated remaining: 6m 30s. Rate: 158.9 symbols/min [2025-10-22T22:11:01.326708] [DEBUG] [MAIN ] KVUE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:01.328213] [INFO ] [MAIN ] KVUE: Generated 1794 derivative records from 53667 primary records. [2025-10-22T22:11:01.328942] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-22T22:11:01.356535] [DEBUG] [MAIN ] KVYO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:01.358129] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1794 records). [2025-10-22T22:11:01.358854] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-22T22:11:01.361081] [INFO ] [MAIN ] Derivative Progress: 1019/2052 symbols completed. KVUE took 1.2s. Estimated remaining: 6m 30s. Rate: 159.1 symbols/min [2025-10-22T22:11:01.358797] [INFO ] [MAIN ] KVYO: Generated 1794 derivative records from 50891 primary records. [2025-10-22T22:11:01.361189] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-22T22:11:01.376262] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1794 records). [2025-10-22T22:11:01.376330] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-22T22:11:01.378734] [INFO ] [MAIN ] Derivative Progress: 1020/2052 symbols completed. KVYO took 1.1s. Estimated remaining: 6m 29s. Rate: 159.2 symbols/min [2025-10-22T22:11:01.379278] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:01.379404] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:01.379877] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:01.402124] [DEBUG] [LOCAL ] KWR: Loaded 15690 existing records from primary storage. [2025-10-22T22:11:01.409468] [INFO ] [MAIN ] KWR: Loaded 15690 primary data records. [2025-10-22T22:11:01.528095] [DEBUG] [LOCAL ] KYN: Loaded 30129 existing records from primary storage. [2025-10-22T22:11:01.556900] [INFO ] [MAIN ] KYN: Loaded 30129 primary data records. [2025-10-22T22:11:01.596358] [DEBUG] [LOCAL ] KW: Loaded 40330 existing records from primary storage. [2025-10-22T22:11:01.652136] [INFO ] [MAIN ] KW: Loaded 40330 primary data records. [2025-10-22T22:11:02.438712] [DEBUG] [MAIN ] KWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:02.442074] [INFO ] [MAIN ] KWR: Generated 1794 derivative records from 15690 primary records. [2025-10-22T22:11:02.442372] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-22T22:11:02.472066] [DEBUG] [MAIN ] KYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:02.483723] [INFO ] [MAIN ] KYN: Generated 1794 derivative records from 30129 primary records. [2025-10-22T22:11:02.482878] [DEBUG] [LOCAL ] KWR: Derivative data saved (1794 records). [2025-10-22T22:11:02.484084] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-22T22:11:02.496623] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-22T22:11:02.498093] [DEBUG] [MAIN ] KW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:02.500589] [INFO ] [MAIN ] Derivative Progress: 1021/2052 symbols completed. KWR took 1.1s. Estimated remaining: 6m 29s. Rate: 158.9 symbols/min [2025-10-22T22:11:02.501911] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:02.501471] [INFO ] [MAIN ] KW: Generated 1794 derivative records from 40330 primary records. [2025-10-22T22:11:02.502221] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-22T22:11:02.519506] [DEBUG] [LOCAL ] KYN: Derivative data saved (1794 records). [2025-10-22T22:11:02.520399] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-22T22:11:02.533803] [INFO ] [MAIN ] Derivative Progress: 1022/2052 symbols completed. KYN took 1.2s. Estimated remaining: 6m 29s. Rate: 159.1 symbols/min [2025-10-22T22:11:02.538331] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:02.538197] [DEBUG] [LOCAL ] KW: Derivative data saved (1794 records). [2025-10-22T22:11:02.539116] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-22T22:11:02.541519] [INFO ] [MAIN ] Derivative Progress: 1023/2052 symbols completed. KW took 1.2s. Estimated remaining: 6m 28s. Rate: 159.2 symbols/min [2025-10-22T22:11:02.541955] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:02.589568] [DEBUG] [LOCAL ] LAD: Loaded 23290 existing records from primary storage. [2025-10-22T22:11:02.590389] [INFO ] [MAIN ] LAD: Loaded 23290 primary data records. [2025-10-22T22:11:02.686261] [DEBUG] [LOCAL ] L: Loaded 41146 existing records from primary storage. [2025-10-22T22:11:02.704577] [INFO ] [MAIN ] L: Loaded 41146 primary data records. [2025-10-22T22:11:02.741560] [DEBUG] [LOCAL ] LAC: Loaded 52571 existing records from primary storage. [2025-10-22T22:11:02.775220] [INFO ] [MAIN ] LAC: Loaded 52571 primary data records. [2025-10-22T22:11:03.669184] [DEBUG] [MAIN ] LAD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:11:03.680343] [INFO ] [MAIN ] LAD: Generated 1793 derivative records from 23290 primary records. [2025-10-22T22:11:03.686300] [DEBUG] [MAIN ] L: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:03.686477] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-22T22:11:03.687176] [INFO ] [MAIN ] L: Generated 1794 derivative records from 41146 primary records. [2025-10-22T22:11:03.688064] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-10-22T22:11:03.725205] [DEBUG] [LOCAL ] LAD: Derivative data saved (1793 records). [2025-10-22T22:11:03.726115] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-10-22T22:11:03.726028] [DEBUG] [MAIN ] LAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:03.730801] [INFO ] [MAIN ] Derivative Progress: 1024/2052 symbols completed. LAD took 1.2s. Estimated remaining: 6m 28s. Rate: 158.9 symbols/min [2025-10-22T22:11:03.731205] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:03.735209] [INFO ] [MAIN ] LAC: Generated 1794 derivative records from 52571 primary records. [2025-10-22T22:11:03.736826] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-22T22:11:03.736896] [DEBUG] [LOCAL ] L: Derivative data saved (1794 records). [2025-10-22T22:11:03.738201] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-10-22T22:11:03.747844] [INFO ] [MAIN ] Derivative Progress: 1025/2052 symbols completed. L took 1.2s. Estimated remaining: 6m 28s. Rate: 159.0 symbols/min [2025-10-22T22:11:03.755851] [DEBUG] [LOCAL ] LAC: Derivative data saved (1794 records). [2025-10-22T22:11:03.755986] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:03.756091] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-22T22:11:03.758758] [INFO ] [MAIN ] Derivative Progress: 1026/2052 symbols completed. LAC took 1.2s. Estimated remaining: 6m 27s. Rate: 159.2 symbols/min [2025-10-22T22:11:03.759234] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:03.764827] [DEBUG] [LOCAL ] LANV: Loaded 2784 existing records from primary storage. [2025-10-22T22:11:03.765114] [INFO ] [MAIN ] LANV: Loaded 2784 primary data records. [2025-10-22T22:11:03.944690] [DEBUG] [LOCAL ] LAW: Loaded 14897 existing records from primary storage. [2025-10-22T22:11:04.090561] [DEBUG] [LOCAL ] LADR: Loaded 39334 existing records from primary storage. [2025-10-22T22:11:04.091156] [INFO ] [MAIN ] LAW: Loaded 14897 primary data records. [2025-10-22T22:11:04.103263] [INFO ] [MAIN ] LADR: Loaded 39334 primary data records. [2025-10-22T22:11:04.726236] [DEBUG] [MAIN ] LANV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:04.729133] [INFO ] [MAIN ] LANV: Generated 1794 derivative records from 2784 primary records. [2025-10-22T22:11:04.731946] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-22T22:11:04.748177] [DEBUG] [LOCAL ] LANV: Derivative data saved (1794 records). [2025-10-22T22:11:04.748589] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-22T22:11:04.752573] [INFO ] [MAIN ] Derivative Progress: 1027/2052 symbols completed. LANV took 1.0s. Estimated remaining: 6m 27s. Rate: 158.9 symbols/min [2025-10-22T22:11:04.754024] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:04.767287] [DEBUG] [MAIN ] LADR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:04.768264] [INFO ] [MAIN ] LADR: Generated 1794 derivative records from 39334 primary records. [2025-10-22T22:11:04.769197] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-22T22:11:04.803321] [DEBUG] [MAIN ] LAW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:04.802981] [DEBUG] [LOCAL ] LADR: Derivative data saved (1794 records). [2025-10-22T22:11:04.803480] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-22T22:11:04.804243] [INFO ] [MAIN ] LAW: Generated 1794 derivative records from 14897 primary records. [2025-10-22T22:11:04.806712] [INFO ] [MAIN ] Derivative Progress: 1028/2052 symbols completed. LADR took 1.1s. Estimated remaining: 6m 26s. Rate: 159.0 symbols/min [2025-10-22T22:11:04.804331] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-22T22:11:04.808061] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:04.824116] [DEBUG] [LOCAL ] LAW: Derivative data saved (1794 records). [2025-10-22T22:11:04.824241] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-22T22:11:04.826849] [INFO ] [MAIN ] Derivative Progress: 1029/2052 symbols completed. LAW took 1.1s. Estimated remaining: 6m 26s. Rate: 159.2 symbols/min [2025-10-22T22:11:04.827032] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:04.866809] [DEBUG] [LOCAL ] LAZ: Loaded 44442 existing records from primary storage. [2025-10-22T22:11:04.867670] [INFO ] [MAIN ] LAZ: Loaded 44442 primary data records. [2025-10-22T22:11:04.916591] [DEBUG] [LOCAL ] LB: Loaded 36982 existing records from primary storage. [2025-10-22T22:11:04.950774] [INFO ] [MAIN ] LB: Loaded 36982 primary data records. [2025-10-22T22:11:05.155778] [DEBUG] [LOCAL ] LC: Loaded 48255 existing records from primary storage. [2025-10-22T22:11:05.177718] [INFO ] [MAIN ] LC: Loaded 48255 primary data records. [2025-10-22T22:11:05.893755] [DEBUG] [MAIN ] LB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:05.893216] [DEBUG] [MAIN ] LAZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:05.895027] [INFO ] [MAIN ] LB: Generated 1794 derivative records from 36982 primary records. [2025-10-22T22:11:05.896155] [INFO ] [MAIN ] LAZ: Generated 1794 derivative records from 44442 primary records. [2025-10-22T22:11:05.895223] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-22T22:11:05.896492] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-22T22:11:05.927190] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1794 records). [2025-10-22T22:11:05.928483] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-22T22:11:05.933034] [INFO ] [MAIN ] Derivative Progress: 1030/2052 symbols completed. LAZ took 1.2s. Estimated remaining: 6m 26s. Rate: 158.9 symbols/min [2025-10-22T22:11:05.934116] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:05.935081] [DEBUG] [LOCAL ] LB: Derivative data saved (1794 records). [2025-10-22T22:11:05.935773] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-10-22T22:11:05.938768] [INFO ] [MAIN ] Derivative Progress: 1031/2052 symbols completed. LB took 1.1s. Estimated remaining: 6m 25s. Rate: 159.0 symbols/min [2025-10-22T22:11:05.939074] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:05.951951] [DEBUG] [MAIN ] LC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:05.952621] [INFO ] [MAIN ] LC: Generated 1794 derivative records from 48255 primary records. [2025-10-22T22:11:05.952780] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-22T22:11:05.970442] [DEBUG] [LOCAL ] LC: Derivative data saved (1794 records). [2025-10-22T22:11:05.970750] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-10-22T22:11:05.973335] [INFO ] [MAIN ] Derivative Progress: 1032/2052 symbols completed. LC took 1.1s. Estimated remaining: 6m 24s. Rate: 159.2 symbols/min [2025-10-22T22:11:05.973779] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:06.006457] [DEBUG] [LOCAL ] LCII: Loaded 26860 existing records from primary storage. [2025-10-22T22:11:06.006608] [INFO ] [MAIN ] LCII: Loaded 26860 primary data records. [2025-10-22T22:11:06.140315] [DEBUG] [LOCAL ] LDI: Loaded 45123 existing records from primary storage. [2025-10-22T22:11:06.146024] [INFO ] [MAIN ] LDI: Loaded 45123 primary data records. [2025-10-22T22:11:06.452344] [DEBUG] [LOCAL ] LDOS: Loaded 44631 existing records from primary storage. [2025-10-22T22:11:06.458875] [INFO ] [MAIN ] LDOS: Loaded 44631 primary data records. [2025-10-22T22:11:06.974743] [DEBUG] [MAIN ] LCII: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:11:06.975913] [INFO ] [MAIN ] LCII: Generated 1793 derivative records from 26860 primary records. [2025-10-22T22:11:06.976204] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-22T22:11:07.004104] [DEBUG] [LOCAL ] LCII: Derivative data saved (1793 records). [2025-10-22T22:11:07.009338] [DEBUG] [MAIN ] LDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:07.009618] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-10-22T22:11:07.010458] [INFO ] [MAIN ] LDI: Generated 1794 derivative records from 45123 primary records. [2025-10-22T22:11:07.012522] [INFO ] [MAIN ] Derivative Progress: 1033/2052 symbols completed. LCII took 1.1s. Estimated remaining: 6m 25s. Rate: 158.9 symbols/min [2025-10-22T22:11:07.012721] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-22T22:11:07.041856] [DEBUG] [MAIN ] LDOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:07.042925] [DEBUG] [LOCAL ] LDI: Derivative data saved (1794 records). [2025-10-22T22:11:07.043548] [INFO ] [MAIN ] LDOS: Generated 1794 derivative records from 44631 primary records. [2025-10-22T22:11:07.043625] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-22T22:11:07.046413] [INFO ] [MAIN ] Derivative Progress: 1034/2052 symbols completed. LDI took 1.1s. Estimated remaining: 6m 24s. Rate: 159.1 symbols/min [2025-10-22T22:11:07.043715] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-22T22:11:07.061475] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1794 records). [2025-10-22T22:11:07.061533] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-22T22:11:07.063923] [INFO ] [MAIN ] Derivative Progress: 1035/2052 symbols completed. LDOS took 1.1s. Estimated remaining: 6m 23s. Rate: 159.2 symbols/min [2025-10-22T22:11:07.064335] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:07.064279] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:07.064470] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:07.078477] [DEBUG] [LOCAL ] LDP: Loaded 12503 existing records from primary storage. [2025-10-22T22:11:07.078688] [INFO ] [MAIN ] LDP: Loaded 12503 primary data records. [2025-10-22T22:11:07.457201] [DEBUG] [LOCAL ] LEG: Loaded 49950 existing records from primary storage. [2025-10-22T22:11:07.458403] [DEBUG] [LOCAL ] LEA: Loaded 41127 existing records from primary storage. [2025-10-22T22:11:07.458877] [INFO ] [MAIN ] LEA: Loaded 41127 primary data records. [2025-10-22T22:11:07.458792] [INFO ] [MAIN ] LEG: Loaded 49950 primary data records. [2025-10-22T22:11:08.114498] [DEBUG] [MAIN ] LDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:08.115623] [INFO ] [MAIN ] LDP: Generated 1794 derivative records from 12503 primary records. [2025-10-22T22:11:08.116287] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-22T22:11:08.134866] [DEBUG] [LOCAL ] LDP: Derivative data saved (1794 records). [2025-10-22T22:11:08.135335] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-22T22:11:08.137869] [INFO ] [MAIN ] Derivative Progress: 1036/2052 symbols completed. LDP took 1.1s. Estimated remaining: 6m 24s. Rate: 158.9 symbols/min [2025-10-22T22:11:08.138262] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:08.160127] [DEBUG] [MAIN ] LEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:08.162239] [INFO ] [MAIN ] LEG: Generated 1794 derivative records from 49950 primary records. [2025-10-22T22:11:08.162407] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-22T22:11:08.187310] [DEBUG] [MAIN ] LEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:08.191321] [DEBUG] [LOCAL ] LEG: Derivative data saved (1794 records). [2025-10-22T22:11:08.192239] [INFO ] [MAIN ] LEA: Generated 1794 derivative records from 41127 primary records. [2025-10-22T22:11:08.192356] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-22T22:11:08.195293] [INFO ] [MAIN ] Derivative Progress: 1037/2052 symbols completed. LEG took 1.1s. Estimated remaining: 6m 23s. Rate: 159.0 symbols/min [2025-10-22T22:11:08.195498] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:08.195707] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-22T22:11:08.225817] [DEBUG] [LOCAL ] LEA: Derivative data saved (1794 records). [2025-10-22T22:11:08.225955] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-10-22T22:11:08.228121] [INFO ] [MAIN ] Derivative Progress: 1038/2052 symbols completed. LEA took 1.2s. Estimated remaining: 6m 22s. Rate: 159.2 symbols/min [2025-10-22T22:11:08.228346] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:08.243042] [DEBUG] [LOCAL ] LEO: Loaded 16855 existing records from primary storage. [2025-10-22T22:11:08.257764] [INFO ] [MAIN ] LEO: Loaded 16855 primary data records. [2025-10-22T22:11:08.258733] [DEBUG] [LOCAL ] LEN: Loaded 53196 existing records from primary storage. [2025-10-22T22:11:08.289594] [INFO ] [MAIN ] LEN: Loaded 53196 primary data records. [2025-10-22T22:11:08.878311] [DEBUG] [LOCAL ] LEVI: Loaded 51827 existing records from primary storage. [2025-10-22T22:11:08.879283] [INFO ] [MAIN ] LEVI: Loaded 51827 primary data records. [2025-10-22T22:11:09.248430] [DEBUG] [MAIN ] LEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:09.249951] [INFO ] [MAIN ] LEO: Generated 1794 derivative records from 16855 primary records. [2025-10-22T22:11:09.250158] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-22T22:11:09.275450] [DEBUG] [MAIN ] LEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:09.279441] [INFO ] [MAIN ] LEN: Generated 1794 derivative records from 53196 primary records. [2025-10-22T22:11:09.282056] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-22T22:11:09.284043] [DEBUG] [LOCAL ] LEO: Derivative data saved (1794 records). [2025-10-22T22:11:09.284361] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-10-22T22:11:09.301848] [DEBUG] [LOCAL ] LEN: Derivative data saved (1794 records). [2025-10-22T22:11:09.293877] [INFO ] [MAIN ] Derivative Progress: 1039/2052 symbols completed. LEO took 1.1s. Estimated remaining: 6m 22s. Rate: 158.9 symbols/min [2025-10-22T22:11:09.302692] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-22T22:11:09.305390] [INFO ] [MAIN ] Derivative Progress: 1040/2052 symbols completed. LEN took 1.2s. Estimated remaining: 6m 22s. Rate: 159.1 symbols/min [2025-10-22T22:11:09.305606] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:09.302591] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:09.336046] [DEBUG] [LOCAL ] LGI: Loaded 9951 existing records from primary storage. [2025-10-22T22:11:09.336559] [DEBUG] [MAIN ] LEVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:09.336621] [INFO ] [MAIN ] LGI: Loaded 9951 primary data records. [2025-10-22T22:11:09.337337] [INFO ] [MAIN ] LEVI: Generated 1794 derivative records from 51827 primary records. [2025-10-22T22:11:09.337433] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-22T22:11:09.407516] [DEBUG] [LOCAL ] LFT: Loaded 18119 existing records from primary storage. [2025-10-22T22:11:09.435957] [INFO ] [MAIN ] LFT: Loaded 18119 primary data records. [2025-10-22T22:11:09.482323] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1794 records). [2025-10-22T22:11:09.546936] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-22T22:11:09.600546] [INFO ] [MAIN ] Derivative Progress: 1041/2052 symbols completed. LEVI took 1.4s. Estimated remaining: 6m 21s. Rate: 159.1 symbols/min [2025-10-22T22:11:09.768380] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:09.996876] [DEBUG] [LOCAL ] LH: Loaded 37024 existing records from primary storage. [2025-10-22T22:11:10.009827] [INFO ] [MAIN ] LH: Loaded 37024 primary data records. [2025-10-22T22:11:10.010259] [DEBUG] [MAIN ] LGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:10.011088] [INFO ] [MAIN ] LGI: Generated 1794 derivative records from 9951 primary records. [2025-10-22T22:11:10.011182] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-22T22:11:10.132508] [DEBUG] [LOCAL ] LGI: Derivative data saved (1794 records). [2025-10-22T22:11:10.148682] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-10-22T22:11:10.168491] [DEBUG] [MAIN ] LFT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:10.168219] [INFO ] [MAIN ] Derivative Progress: 1042/2052 symbols completed. LGI took 0.9s. Estimated remaining: 6m 21s. Rate: 159.0 symbols/min [2025-10-22T22:11:10.194604] [INFO ] [MAIN ] LFT: Generated 1794 derivative records from 18119 primary records. [2025-10-22T22:11:10.229788] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-22T22:11:10.229723] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:10.364906] [DEBUG] [LOCAL ] LFT: Derivative data saved (1794 records). [2025-10-22T22:11:10.366136] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-22T22:11:10.369000] [INFO ] [MAIN ] Derivative Progress: 1043/2052 symbols completed. LFT took 1.1s. Estimated remaining: 6m 21s. Rate: 159.1 symbols/min [2025-10-22T22:11:10.369387] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:10.392047] [DEBUG] [MAIN ] LH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:10.400231] [INFO ] [MAIN ] LH: Generated 1794 derivative records from 37024 primary records. [2025-10-22T22:11:10.400520] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-22T22:11:10.434397] [DEBUG] [LOCAL ] LH: Derivative data saved (1794 records). [2025-10-22T22:11:10.434540] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-22T22:11:10.436629] [INFO ] [MAIN ] Derivative Progress: 1044/2052 symbols completed. LH took 0.7s. Estimated remaining: 6m 20s. Rate: 159.2 symbols/min [2025-10-22T22:11:10.436854] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:10.437824] [DEBUG] [LOCAL ] LII: Loaded 27810 existing records from primary storage. [2025-10-22T22:11:10.438046] [INFO ] [MAIN ] LII: Loaded 27810 primary data records. [2025-10-22T22:11:10.650049] [DEBUG] [LOCAL ] LHX: Loaded 48471 existing records from primary storage. [2025-10-22T22:11:10.650407] [INFO ] [MAIN ] LHX: Loaded 48471 primary data records. [2025-10-22T22:11:10.853576] [DEBUG] [LOCAL ] LION: Loaded 46933 existing records from primary storage. [2025-10-22T22:11:10.866671] [INFO ] [MAIN ] LION: Loaded 46933 primary data records. [2025-10-22T22:11:11.446489] [DEBUG] [MAIN ] LII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:11.448441] [INFO ] [MAIN ] LII: Generated 1794 derivative records from 27810 primary records. [2025-10-22T22:11:11.448817] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-22T22:11:11.465243] [DEBUG] [LOCAL ] LII: Derivative data saved (1794 records). [2025-10-22T22:11:11.465452] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-22T22:11:11.467355] [INFO ] [MAIN ] Derivative Progress: 1045/2052 symbols completed. LII took 1.1s. Estimated remaining: 6m 20s. Rate: 158.9 symbols/min [2025-10-22T22:11:11.467516] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:11.485824] [DEBUG] [MAIN ] LHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:11.486619] [INFO ] [MAIN ] LHX: Generated 1794 derivative records from 48471 primary records. [2025-10-22T22:11:11.486957] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-22T22:11:11.506011] [DEBUG] [LOCAL ] LHX: Derivative data saved (1794 records). [2025-10-22T22:11:11.506267] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-22T22:11:11.508696] [INFO ] [MAIN ] Derivative Progress: 1046/2052 symbols completed. LHX took 1.3s. Estimated remaining: 6m 19s. Rate: 159.1 symbols/min [2025-10-22T22:11:11.509003] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:11.522131] [DEBUG] [MAIN ] LION: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:11.522738] [INFO ] [MAIN ] LION: Generated 1794 derivative records from 46933 primary records. [2025-10-22T22:11:11.522884] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-22T22:11:11.552598] [DEBUG] [LOCAL ] LION: Derivative data saved (1794 records). [2025-10-22T22:11:11.552981] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-10-22T22:11:11.555508] [INFO ] [MAIN ] Derivative Progress: 1047/2052 symbols completed. LION took 1.1s. Estimated remaining: 6m 19s. Rate: 159.2 symbols/min [2025-10-22T22:11:11.555741] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:11.574688] [DEBUG] [LOCAL ] LLY: Loaded 53191 existing records from primary storage. [2025-10-22T22:11:11.575009] [INFO ] [MAIN ] LLY: Loaded 53191 primary data records. [2025-10-22T22:11:11.897875] [DEBUG] [LOCAL ] LMND: Loaded 52122 existing records from primary storage. [2025-10-22T22:11:11.911746] [INFO ] [MAIN ] LMND: Loaded 52122 primary data records. [2025-10-22T22:11:12.033676] [DEBUG] [LOCAL ] LMT: Loaded 49623 existing records from primary storage. [2025-10-22T22:11:12.055863] [INFO ] [MAIN ] LMT: Loaded 49623 primary data records. [2025-10-22T22:11:12.566086] [DEBUG] [MAIN ] LLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:12.567813] [INFO ] [MAIN ] LLY: Generated 1794 derivative records from 53191 primary records. [2025-10-22T22:11:12.568471] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-22T22:11:12.587669] [DEBUG] [LOCAL ] LLY: Derivative data saved (1794 records). [2025-10-22T22:11:12.588089] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-22T22:11:12.590853] [INFO ] [MAIN ] Derivative Progress: 1048/2052 symbols completed. LLY took 1.1s. Estimated remaining: 6m 19s. Rate: 159.0 symbols/min [2025-10-22T22:11:12.609927] [DEBUG] [MAIN ] LMND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:12.610882] [INFO ] [MAIN ] LMND: Generated 1794 derivative records from 52122 primary records. [2025-10-22T22:11:12.611197] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-22T22:11:12.628009] [DEBUG] [LOCAL ] LMND: Derivative data saved (1794 records). [2025-10-22T22:11:12.628104] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-10-22T22:11:12.630281] [INFO ] [MAIN ] Derivative Progress: 1049/2052 symbols completed. LMND took 1.1s. Estimated remaining: 6m 18s. Rate: 159.1 symbols/min [2025-10-22T22:11:12.645419] [DEBUG] [MAIN ] LMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:12.646052] [INFO ] [MAIN ] LMT: Generated 1794 derivative records from 49623 primary records. [2025-10-22T22:11:12.646114] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-10-22T22:11:12.661345] [DEBUG] [LOCAL ] LMT: Derivative data saved (1794 records). [2025-10-22T22:11:12.661402] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-10-22T22:11:12.663970] [INFO ] [MAIN ] Derivative Progress: 1050/2052 symbols completed. LMT took 1.1s. Estimated remaining: 6m 18s. Rate: 159.2 symbols/min [2025-10-22T22:11:12.664416] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:12.664559] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:12.664339] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:12.672266] [DEBUG] [LOCAL ] LND: Loaded 4960 existing records from primary storage. [2025-10-22T22:11:12.672482] [INFO ] [MAIN ] LND: Loaded 4960 primary data records. [2025-10-22T22:11:13.010868] [DEBUG] [LOCAL ] LNG: Loaded 51063 existing records from primary storage. [2025-10-22T22:11:13.012181] [INFO ] [MAIN ] LNG: Loaded 51063 primary data records. [2025-10-22T22:11:13.105285] [DEBUG] [LOCAL ] LNC: Loaded 51466 existing records from primary storage. [2025-10-22T22:11:13.129268] [INFO ] [MAIN ] LNC: Loaded 51466 primary data records. [2025-10-22T22:11:13.703491] [DEBUG] [MAIN ] LND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:13.704424] [INFO ] [MAIN ] LND: Generated 1794 derivative records from 4960 primary records. [2025-10-22T22:11:13.705380] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-22T22:11:13.728673] [DEBUG] [LOCAL ] LND: Derivative data saved (1794 records). [2025-10-22T22:11:13.729800] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-22T22:11:13.732555] [INFO ] [MAIN ] Derivative Progress: 1051/2052 symbols completed. LND took 1.1s. Estimated remaining: 6m 18s. Rate: 158.9 symbols/min [2025-10-22T22:11:13.732916] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:13.752515] [DEBUG] [MAIN ] LNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:13.757116] [INFO ] [MAIN ] LNG: Generated 1794 derivative records from 51063 primary records. [2025-10-22T22:11:13.757505] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-22T22:11:13.782416] [DEBUG] [LOCAL ] LNG: Derivative data saved (1794 records). [2025-10-22T22:11:13.782970] [DEBUG] [LOCAL ] LNN: Loaded 11504 existing records from primary storage. [2025-10-22T22:11:13.783200] [INFO ] [MAIN ] LNN: Loaded 11504 primary data records. [2025-10-22T22:11:13.783358] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-22T22:11:13.810998] [INFO ] [MAIN ] Derivative Progress: 1052/2052 symbols completed. LNG took 1.1s. Estimated remaining: 6m 17s. Rate: 159.1 symbols/min [2025-10-22T22:11:13.845321] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:13.886096] [DEBUG] [MAIN ] LNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:13.906141] [INFO ] [MAIN ] LNC: Generated 1794 derivative records from 51466 primary records. [2025-10-22T22:11:13.910403] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-22T22:11:13.943740] [DEBUG] [LOCAL ] LNC: Derivative data saved (1794 records). [2025-10-22T22:11:13.949076] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-22T22:11:13.957046] [INFO ] [MAIN ] Derivative Progress: 1053/2052 symbols completed. LNC took 1.3s. Estimated remaining: 6m 17s. Rate: 159.2 symbols/min [2025-10-22T22:11:14.004626] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:14.152412] [DEBUG] [LOCAL ] LOAR: Loaded 42026 existing records from primary storage. [2025-10-22T22:11:14.152694] [INFO ] [MAIN ] LOAR: Loaded 42026 primary data records. [2025-10-22T22:11:14.273680] [DEBUG] [LOCAL ] LOB: Loaded 26644 existing records from primary storage. [2025-10-22T22:11:14.284922] [INFO ] [MAIN ] LOB: Loaded 26644 primary data records. [2025-10-22T22:11:14.584728] [DEBUG] [MAIN ] LNN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:14.586723] [INFO ] [MAIN ] LNN: Generated 1794 derivative records from 11504 primary records. [2025-10-22T22:11:14.586830] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-22T22:11:14.643822] [DEBUG] [LOCAL ] LNN: Derivative data saved (1794 records). [2025-10-22T22:11:14.643967] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-10-22T22:11:14.667614] [INFO ] [MAIN ] Derivative Progress: 1054/2052 symbols completed. LNN took 0.9s. Estimated remaining: 6m 17s. Rate: 159.0 symbols/min [2025-10-22T22:11:14.690939] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:14.821623] [DEBUG] [LOCAL ] LOCL: Loaded 3504 existing records from primary storage. [2025-10-22T22:11:14.822218] [INFO ] [MAIN ] LOCL: Loaded 3504 primary data records. [2025-10-22T22:11:14.944139] [DEBUG] [MAIN ] LOAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:14.961507] [INFO ] [MAIN ] LOAR: Generated 1794 derivative records from 42026 primary records. [2025-10-22T22:11:14.986264] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-22T22:11:15.052807] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1794 records). [2025-10-22T22:11:15.223476] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-22T22:11:15.239341] [INFO ] [MAIN ] Derivative Progress: 1055/2052 symbols completed. LOAR took 1.4s. Estimated remaining: 6m 16s. Rate: 158.9 symbols/min [2025-10-22T22:11:15.239592] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:15.260145] [DEBUG] [MAIN ] LOB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:15.261326] [INFO ] [MAIN ] LOB: Generated 1794 derivative records from 26644 primary records. [2025-10-22T22:11:15.261668] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-22T22:11:15.279027] [DEBUG] [LOCAL ] LOB: Derivative data saved (1794 records). [2025-10-22T22:11:15.287023] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-22T22:11:15.289103] [INFO ] [MAIN ] Derivative Progress: 1056/2052 symbols completed. LOB took 1.3s. Estimated remaining: 6m 16s. Rate: 159.1 symbols/min [2025-10-22T22:11:15.289538] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:15.306440] [DEBUG] [LOCAL ] LOMA: Loaded 32716 existing records from primary storage. [2025-10-22T22:11:15.306808] [INFO ] [MAIN ] LOMA: Loaded 32716 primary data records. [2025-10-22T22:11:15.377741] [DEBUG] [MAIN ] LOCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:15.392956] [INFO ] [MAIN ] LOCL: Generated 1794 derivative records from 3504 primary records. [2025-10-22T22:11:15.404788] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-22T22:11:15.497309] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1794 records). [2025-10-22T22:11:15.513234] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-22T22:11:15.534826] [INFO ] [MAIN ] Derivative Progress: 1057/2052 symbols completed. LOCL took 0.8s. Estimated remaining: 6m 15s. Rate: 159.1 symbols/min [2025-10-22T22:11:15.539237] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:15.668372] [DEBUG] [LOCAL ] LOW: Loaded 52970 existing records from primary storage. [2025-10-22T22:11:15.668705] [INFO ] [MAIN ] LOW: Loaded 52970 primary data records. [2025-10-22T22:11:15.988280] [DEBUG] [LOCAL ] LPG: Loaded 39248 existing records from primary storage. [2025-10-22T22:11:15.996748] [INFO ] [MAIN ] LPG: Loaded 39248 primary data records. [2025-10-22T22:11:16.314204] [DEBUG] [MAIN ] LOMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:16.315075] [INFO ] [MAIN ] LOMA: Generated 1794 derivative records from 32716 primary records. [2025-10-22T22:11:16.315220] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-22T22:11:16.336211] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1794 records). [2025-10-22T22:11:16.336404] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-22T22:11:16.352022] [DEBUG] [MAIN ] LOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:16.338796] [INFO ] [MAIN ] Derivative Progress: 1058/2052 symbols completed. LOMA took 1.1s. Estimated remaining: 6m 15s. Rate: 159.0 symbols/min [2025-10-22T22:11:16.352210] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:16.353146] [INFO ] [MAIN ] LOW: Generated 1794 derivative records from 52970 primary records. [2025-10-22T22:11:16.354331] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-22T22:11:16.371351] [DEBUG] [LOCAL ] LOW: Derivative data saved (1794 records). [2025-10-22T22:11:16.371459] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-22T22:11:16.373440] [INFO ] [MAIN ] Derivative Progress: 1059/2052 symbols completed. LOW took 1.1s. Estimated remaining: 6m 14s. Rate: 159.1 symbols/min [2025-10-22T22:11:16.373679] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:16.397939] [DEBUG] [MAIN ] LPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:16.398724] [INFO ] [MAIN ] LPG: Generated 1794 derivative records from 39248 primary records. [2025-10-22T22:11:16.398845] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-22T22:11:16.428138] [DEBUG] [LOCAL ] LPG: Derivative data saved (1794 records). [2025-10-22T22:11:16.429018] [DEBUG] [LOCAL ] LPL: Loaded 28986 existing records from primary storage. [2025-10-22T22:11:16.429261] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-22T22:11:16.432030] [INFO ] [MAIN ] LPL: Loaded 28986 primary data records. [2025-10-22T22:11:16.431938] [INFO ] [MAIN ] Derivative Progress: 1060/2052 symbols completed. LPG took 0.9s. Estimated remaining: 6m 14s. Rate: 159.2 symbols/min [2025-10-22T22:11:16.457283] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:16.557683] [DEBUG] [LOCAL ] LPX: Loaded 40055 existing records from primary storage. [2025-10-22T22:11:16.563694] [INFO ] [MAIN ] LPX: Loaded 40055 primary data records. [2025-10-22T22:11:16.967582] [DEBUG] [LOCAL ] LRN: Loaded 39335 existing records from primary storage. [2025-10-22T22:11:17.094479] [INFO ] [MAIN ] LRN: Loaded 39335 primary data records. [2025-10-22T22:11:17.459494] [DEBUG] [MAIN ] LPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:17.460336] [INFO ] [MAIN ] LPL: Generated 1794 derivative records from 28986 primary records. [2025-10-22T22:11:17.461039] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-22T22:11:17.492699] [DEBUG] [LOCAL ] LPL: Derivative data saved (1794 records). [2025-10-22T22:11:17.492974] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-22T22:11:17.494995] [INFO ] [MAIN ] Derivative Progress: 1061/2052 symbols completed. LPL took 1.1s. Estimated remaining: 6m 14s. Rate: 159.0 symbols/min [2025-10-22T22:11:17.495134] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:17.495548] [DEBUG] [MAIN ] LPX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:17.496838] [INFO ] [MAIN ] LPX: Generated 1794 derivative records from 40055 primary records. [2025-10-22T22:11:17.497696] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-22T22:11:17.514801] [DEBUG] [LOCAL ] LPX: Derivative data saved (1794 records). [2025-10-22T22:11:17.515119] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-22T22:11:17.517394] [INFO ] [MAIN ] Derivative Progress: 1062/2052 symbols completed. LPX took 1.1s. Estimated remaining: 6m 13s. Rate: 159.1 symbols/min [2025-10-22T22:11:17.517793] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:17.544913] [DEBUG] [MAIN ] LRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:17.545632] [INFO ] [MAIN ] LRN: Generated 1794 derivative records from 39335 primary records. [2025-10-22T22:11:17.545809] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-22T22:11:17.562962] [DEBUG] [LOCAL ] LRN: Derivative data saved (1794 records). [2025-10-22T22:11:17.574830] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-22T22:11:17.584023] [INFO ] [MAIN ] Derivative Progress: 1063/2052 symbols completed. LRN took 1.1s. Estimated remaining: 6m 13s. Rate: 159.2 symbols/min [2025-10-22T22:11:17.585365] [DEBUG] [LOCAL ] LSPD: Loaded 42329 existing records from primary storage. [2025-10-22T22:11:17.585544] [INFO ] [MAIN ] LSPD: Loaded 42329 primary data records. [2025-10-22T22:11:17.696274] [DEBUG] [LOCAL ] LTC: Loaded 30631 existing records from primary storage. [2025-10-22T22:11:17.702228] [INFO ] [MAIN ] LTC: Loaded 30631 primary data records. [2025-10-22T22:11:18.208255] [DEBUG] [MAIN ] LSPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:18.209200] [INFO ] [MAIN ] LSPD: Generated 1794 derivative records from 42329 primary records. [2025-10-22T22:11:18.209488] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-22T22:11:18.226891] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1794 records). [2025-10-22T22:11:18.227595] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-22T22:11:18.229601] [INFO ] [MAIN ] Derivative Progress: 1064/2052 symbols completed. LSPD took 0.7s. Estimated remaining: 6m 13s. Rate: 159.1 symbols/min [2025-10-22T22:11:18.242121] [DEBUG] [MAIN ] LTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:18.242831] [INFO ] [MAIN ] LTC: Generated 1794 derivative records from 30631 primary records. [2025-10-22T22:11:18.242920] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-22T22:11:18.258796] [DEBUG] [LOCAL ] LTC: Derivative data saved (1794 records). [2025-10-22T22:11:18.258892] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-22T22:11:18.261087] [INFO ] [MAIN ] Derivative Progress: 1065/2052 symbols completed. LTC took 0.7s. Estimated remaining: 6m 12s. Rate: 159.2 symbols/min [2025-10-22T22:11:18.261765] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:18.261909] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:18.261701] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:18.318162] [DEBUG] [LOCAL ] LTM: Loaded 39222 existing records from primary storage. [2025-10-22T22:11:18.318323] [INFO ] [MAIN ] LTM: Loaded 39222 primary data records. [2025-10-22T22:11:18.452464] [DEBUG] [LOCAL ] LTH: Loaded 51635 existing records from primary storage. [2025-10-22T22:11:18.468729] [INFO ] [MAIN ] LTH: Loaded 51635 primary data records. [2025-10-22T22:11:18.463505] [DEBUG] [LOCAL ] LU: Loaded 49220 existing records from primary storage. [2025-10-22T22:11:18.515539] [INFO ] [MAIN ] LU: Loaded 49220 primary data records. [2025-10-22T22:11:19.300294] [DEBUG] [MAIN ] LTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:19.301322] [INFO ] [MAIN ] LTM: Generated 1794 derivative records from 39222 primary records. [2025-10-22T22:11:19.301447] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-22T22:11:19.320308] [DEBUG] [LOCAL ] LTM: Derivative data saved (1794 records). [2025-10-22T22:11:19.320816] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-22T22:11:19.322842] [INFO ] [MAIN ] Derivative Progress: 1066/2052 symbols completed. LTM took 1.1s. Estimated remaining: 6m 12s. Rate: 159.0 symbols/min [2025-10-22T22:11:19.335708] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:19.336238] [DEBUG] [MAIN ] LU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:19.337634] [INFO ] [MAIN ] LU: Generated 1794 derivative records from 49220 primary records. [2025-10-22T22:11:19.339511] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-22T22:11:19.369430] [DEBUG] [LOCAL ] LU: Derivative data saved (1794 records). [2025-10-22T22:11:19.369863] [DEBUG] [MAIN ] LTH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:19.370721] [INFO ] [MAIN ] LTH: Generated 1794 derivative records from 51635 primary records. [2025-10-22T22:11:19.370938] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-22T22:11:19.370873] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-22T22:11:19.373278] [INFO ] [MAIN ] Derivative Progress: 1067/2052 symbols completed. LU took 1.1s. Estimated remaining: 6m 11s. Rate: 159.1 symbols/min [2025-10-22T22:11:19.379239] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:19.404097] [DEBUG] [LOCAL ] LUCK: Loaded 23877 existing records from primary storage. [2025-10-22T22:11:19.405254] [DEBUG] [LOCAL ] LTH: Derivative data saved (1794 records). [2025-10-22T22:11:19.405434] [INFO ] [MAIN ] LUCK: Loaded 23877 primary data records. [2025-10-22T22:11:19.405525] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-22T22:11:19.408494] [INFO ] [MAIN ] Derivative Progress: 1068/2052 symbols completed. LTH took 1.1s. Estimated remaining: 6m 11s. Rate: 159.2 symbols/min [2025-10-22T22:11:19.439839] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:19.768924] [DEBUG] [LOCAL ] LUMN: Loaded 53645 existing records from primary storage. [2025-10-22T22:11:19.770079] [INFO ] [MAIN ] LUMN: Loaded 53645 primary data records. [2025-10-22T22:11:19.882330] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-22T22:11:19.895466] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-10-22T22:11:20.404406] [DEBUG] [MAIN ] LUCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:20.406040] [INFO ] [MAIN ] LUCK: Generated 1794 derivative records from 23877 primary records. [2025-10-22T22:11:20.406256] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-22T22:11:20.426448] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1794 records). [2025-10-22T22:11:20.427348] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-22T22:11:20.430016] [INFO ] [MAIN ] Derivative Progress: 1069/2052 symbols completed. LUCK took 1.1s. Estimated remaining: 6m 11s. Rate: 159.0 symbols/min [2025-10-22T22:11:20.430167] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:20.468447] [DEBUG] [MAIN ] LUMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:20.469314] [DEBUG] [MAIN ] LUV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:20.470305] [INFO ] [MAIN ] LUMN: Generated 1794 derivative records from 53645 primary records. [2025-10-22T22:11:20.471397] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-22T22:11:20.471189] [INFO ] [MAIN ] LUV: Generated 1794 derivative records from 53689 primary records. [2025-10-22T22:11:20.471516] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-22T22:11:20.504554] [DEBUG] [LOCAL ] LUV: Derivative data saved (1794 records). [2025-10-22T22:11:20.500119] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1794 records). [2025-10-22T22:11:20.517813] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-22T22:11:20.520275] [INFO ] [MAIN ] Derivative Progress: 1070/2052 symbols completed. LUV took 1.1s. Estimated remaining: 6m 10s. Rate: 159.1 symbols/min [2025-10-22T22:11:20.520433] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:20.520836] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-10-22T22:11:20.523252] [INFO ] [MAIN ] Derivative Progress: 1071/2052 symbols completed. LUMN took 1.1s. Estimated remaining: 6m 10s. Rate: 159.2 symbols/min [2025-10-22T22:11:20.523618] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:20.547810] [DEBUG] [LOCAL ] LVS: Loaded 53569 existing records from primary storage. [2025-10-22T22:11:20.548109] [INFO ] [MAIN ] LVS: Loaded 53569 primary data records. [2025-10-22T22:11:20.622828] [DEBUG] [LOCAL ] LVWR: Loaded 18636 existing records from primary storage. [2025-10-22T22:11:20.640089] [INFO ] [MAIN ] LVWR: Loaded 18636 primary data records. [2025-10-22T22:11:21.020734] [DEBUG] [LOCAL ] LW: Loaded 51164 existing records from primary storage. [2025-10-22T22:11:21.057882] [INFO ] [MAIN ] LW: Loaded 51164 primary data records. [2025-10-22T22:11:21.552244] [DEBUG] [MAIN ] LVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:21.553695] [INFO ] [MAIN ] LVS: Generated 1794 derivative records from 53569 primary records. [2025-10-22T22:11:21.554313] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-10-22T22:11:21.573330] [DEBUG] [LOCAL ] LVS: Derivative data saved (1794 records). [2025-10-22T22:11:21.573927] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-10-22T22:11:21.575895] [INFO ] [MAIN ] Derivative Progress: 1072/2052 symbols completed. LVS took 1.1s. Estimated remaining: 6m 10s. Rate: 159.0 symbols/min [2025-10-22T22:11:21.576166] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:21.594207] [DEBUG] [MAIN ] LVWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:21.595069] [INFO ] [MAIN ] LVWR: Generated 1794 derivative records from 18636 primary records. [2025-10-22T22:11:21.595317] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-22T22:11:21.628165] [DEBUG] [MAIN ] LW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:21.631261] [INFO ] [MAIN ] LW: Generated 1794 derivative records from 51164 primary records. [2025-10-22T22:11:21.633471] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-22T22:11:21.633370] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1794 records). [2025-10-22T22:11:21.639409] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-22T22:11:21.642435] [INFO ] [MAIN ] Derivative Progress: 1073/2052 symbols completed. LVWR took 1.1s. Estimated remaining: 6m 9s. Rate: 159.1 symbols/min [2025-10-22T22:11:21.642904] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:21.658890] [DEBUG] [LOCAL ] LW: Derivative data saved (1794 records). [2025-10-22T22:11:21.650950] [DEBUG] [LOCAL ] LXFR: Loaded 16413 existing records from primary storage. [2025-10-22T22:11:21.659097] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-22T22:11:21.661815] [INFO ] [MAIN ] LXFR: Loaded 16413 primary data records. [2025-10-22T22:11:21.661426] [INFO ] [MAIN ] Derivative Progress: 1074/2052 symbols completed. LW took 1.1s. Estimated remaining: 6m 8s. Rate: 159.2 symbols/min [2025-10-22T22:11:21.673911] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:21.990798] [DEBUG] [LOCAL ] LXU: Loaded 31461 existing records from primary storage. [2025-10-22T22:11:22.000242] [INFO ] [MAIN ] LXU: Loaded 31461 primary data records. [2025-10-22T22:11:22.124200] [DEBUG] [LOCAL ] LXP: Loaded 50756 existing records from primary storage. [2025-10-22T22:11:22.130278] [INFO ] [MAIN ] LXP: Loaded 50756 primary data records. [2025-10-22T22:11:22.654478] [DEBUG] [MAIN ] LXFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:22.657616] [INFO ] [MAIN ] LXFR: Generated 1794 derivative records from 16413 primary records. [2025-10-22T22:11:22.657891] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-22T22:11:22.675586] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1794 records). [2025-10-22T22:11:22.675874] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-22T22:11:22.678210] [INFO ] [MAIN ] Derivative Progress: 1075/2052 symbols completed. LXFR took 1.1s. Estimated remaining: 6m 9s. Rate: 159.0 symbols/min [2025-10-22T22:11:22.678802] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:22.701600] [DEBUG] [MAIN ] LXU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:22.702442] [INFO ] [MAIN ] LXU: Generated 1794 derivative records from 31461 primary records. [2025-10-22T22:11:22.702631] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-22T22:11:22.720087] [DEBUG] [LOCAL ] LXU: Derivative data saved (1794 records). [2025-10-22T22:11:22.720492] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-22T22:11:22.722618] [INFO ] [MAIN ] Derivative Progress: 1076/2052 symbols completed. LXU took 1.0s. Estimated remaining: 6m 8s. Rate: 159.1 symbols/min [2025-10-22T22:11:22.723032] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:22.757088] [DEBUG] [MAIN ] LXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:22.757898] [INFO ] [MAIN ] LXP: Generated 1794 derivative records from 50756 primary records. [2025-10-22T22:11:22.758125] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-22T22:11:22.774280] [DEBUG] [LOCAL ] LXP: Derivative data saved (1794 records). [2025-10-22T22:11:22.774531] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-22T22:11:22.777091] [INFO ] [MAIN ] Derivative Progress: 1077/2052 symbols completed. LXP took 1.1s. Estimated remaining: 6m 7s. Rate: 159.2 symbols/min [2025-10-22T22:11:22.790599] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:22.792914] [DEBUG] [LOCAL ] LYB: Loaded 53621 existing records from primary storage. [2025-10-22T22:11:22.793106] [INFO ] [MAIN ] LYB: Loaded 53621 primary data records. [2025-10-22T22:11:23.018902] [DEBUG] [LOCAL ] LYG: Loaded 52652 existing records from primary storage. [2025-10-22T22:11:23.019127] [INFO ] [MAIN ] LYG: Loaded 52652 primary data records. [2025-10-22T22:11:23.292729] [DEBUG] [LOCAL ] LYV: Loaded 51001 existing records from primary storage. [2025-10-22T22:11:23.325846] [INFO ] [MAIN ] LYV: Loaded 51001 primary data records. [2025-10-22T22:11:23.797444] [DEBUG] [MAIN ] LYB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:23.798548] [INFO ] [MAIN ] LYB: Generated 1794 derivative records from 53621 primary records. [2025-10-22T22:11:23.798948] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-22T22:11:23.818071] [DEBUG] [LOCAL ] LYB: Derivative data saved (1794 records). [2025-10-22T22:11:23.818676] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-22T22:11:23.821037] [INFO ] [MAIN ] Derivative Progress: 1078/2052 symbols completed. LYB took 1.1s. Estimated remaining: 6m 8s. Rate: 159.0 symbols/min [2025-10-22T22:11:23.838730] [DEBUG] [MAIN ] LYG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:23.839696] [INFO ] [MAIN ] LYG: Generated 1794 derivative records from 52652 primary records. [2025-10-22T22:11:23.839885] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-22T22:11:23.873072] [DEBUG] [LOCAL ] LYG: Derivative data saved (1794 records). [2025-10-22T22:11:23.872998] [DEBUG] [MAIN ] LYV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:23.873207] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-22T22:11:23.875237] [INFO ] [MAIN ] Derivative Progress: 1079/2052 symbols completed. LYG took 1.2s. Estimated remaining: 6m 7s. Rate: 159.1 symbols/min [2025-10-22T22:11:23.876144] [INFO ] [MAIN ] LYV: Generated 1794 derivative records from 51001 primary records. [2025-10-22T22:11:23.876321] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-22T22:11:23.891592] [DEBUG] [LOCAL ] LYV: Derivative data saved (1794 records). [2025-10-22T22:11:23.891695] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-22T22:11:23.894349] [INFO ] [MAIN ] Derivative Progress: 1080/2052 symbols completed. LYV took 1.1s. Estimated remaining: 6m 6s. Rate: 159.3 symbols/min [2025-10-22T22:11:23.895047] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:23.894985] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:23.895125] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:23.914508] [DEBUG] [LOCAL ] LZM: Loaded 14818 existing records from primary storage. [2025-10-22T22:11:23.914836] [INFO ] [MAIN ] LZM: Loaded 14818 primary data records. [2025-10-22T22:11:24.060053] [DEBUG] [LOCAL ] LZB: Loaded 35036 existing records from primary storage. [2025-10-22T22:11:24.110720] [INFO ] [MAIN ] LZB: Loaded 35036 primary data records. [2025-10-22T22:11:24.386510] [DEBUG] [LOCAL ] M: Loaded 53544 existing records from primary storage. [2025-10-22T22:11:24.392560] [INFO ] [MAIN ] M: Loaded 53544 primary data records. [2025-10-22T22:11:24.922405] [DEBUG] [MAIN ] LZM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:24.923279] [INFO ] [MAIN ] LZM: Generated 1794 derivative records from 14818 primary records. [2025-10-22T22:11:24.923835] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-22T22:11:24.939810] [DEBUG] [LOCAL ] LZM: Derivative data saved (1794 records). [2025-10-22T22:11:24.941067] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-22T22:11:24.943062] [INFO ] [MAIN ] Derivative Progress: 1081/2052 symbols completed. LZM took 1.0s. Estimated remaining: 6m 6s. Rate: 159.0 symbols/min [2025-10-22T22:11:24.943706] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:24.960949] [DEBUG] [MAIN ] LZB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:24.961794] [INFO ] [MAIN ] LZB: Generated 1794 derivative records from 35036 primary records. [2025-10-22T22:11:24.962018] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-22T22:11:24.979066] [DEBUG] [LOCAL ] LZB: Derivative data saved (1794 records). [2025-10-22T22:11:24.979232] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-22T22:11:24.981855] [INFO ] [MAIN ] Derivative Progress: 1082/2052 symbols completed. LZB took 1.1s. Estimated remaining: 6m 6s. Rate: 159.1 symbols/min [2025-10-22T22:11:24.983933] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:24.998368] [DEBUG] [MAIN ] M: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:24.999095] [INFO ] [MAIN ] M: Generated 1794 derivative records from 53544 primary records. [2025-10-22T22:11:24.999279] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-22T22:11:25.015502] [DEBUG] [LOCAL ] M: Derivative data saved (1794 records). [2025-10-22T22:11:25.015715] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-22T22:11:25.018122] [INFO ] [MAIN ] Derivative Progress: 1083/2052 symbols completed. M took 1.1s. Estimated remaining: 6m 5s. Rate: 159.3 symbols/min [2025-10-22T22:11:25.031766] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:25.061306] [DEBUG] [LOCAL ] MA: Loaded 52451 existing records from primary storage. [2025-10-22T22:11:25.061612] [INFO ] [MAIN ] MA: Loaded 52451 primary data records. [2025-10-22T22:11:25.179907] [DEBUG] [LOCAL ] MAA: Loaded 43002 existing records from primary storage. [2025-10-22T22:11:25.206743] [INFO ] [MAIN ] MAA: Loaded 43002 primary data records. [2025-10-22T22:11:25.499045] [DEBUG] [LOCAL ] MAC: Loaded 49610 existing records from primary storage. [2025-10-22T22:11:25.522573] [INFO ] [MAIN ] MAC: Loaded 49610 primary data records. [2025-10-22T22:11:26.059166] [DEBUG] [MAIN ] MA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:26.060464] [INFO ] [MAIN ] MA: Generated 1794 derivative records from 52451 primary records. [2025-10-22T22:11:26.061067] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-22T22:11:26.079996] [DEBUG] [LOCAL ] MA: Derivative data saved (1794 records). [2025-10-22T22:11:26.080243] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-22T22:11:26.082055] [INFO ] [MAIN ] Derivative Progress: 1084/2052 symbols completed. MA took 1.1s. Estimated remaining: 6m 5s. Rate: 159.0 symbols/min [2025-10-22T22:11:26.082455] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:26.101460] [DEBUG] [MAIN ] MAA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:26.102191] [INFO ] [MAIN ] MAA: Generated 1794 derivative records from 43002 primary records. [2025-10-22T22:11:26.102434] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-22T22:11:26.122134] [DEBUG] [LOCAL ] MAA: Derivative data saved (1794 records). [2025-10-22T22:11:26.138290] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-22T22:11:26.146029] [INFO ] [MAIN ] Derivative Progress: 1085/2052 symbols completed. MAA took 1.2s. Estimated remaining: 6m 5s. Rate: 159.1 symbols/min [2025-10-22T22:11:26.143516] [DEBUG] [MAIN ] MAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:26.146229] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:26.147293] [INFO ] [MAIN ] MAC: Generated 1794 derivative records from 49610 primary records. [2025-10-22T22:11:26.147443] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-10-22T22:11:26.174170] [DEBUG] [LOCAL ] MAC: Derivative data saved (1794 records). [2025-10-22T22:11:26.174306] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-10-22T22:11:26.176675] [INFO ] [MAIN ] Derivative Progress: 1086/2052 symbols completed. MAC took 1.1s. Estimated remaining: 6m 4s. Rate: 159.2 symbols/min [2025-10-22T22:11:26.178022] [DEBUG] [LOCAL ] MAGN: Loaded 36149 existing records from primary storage. [2025-10-22T22:11:26.178241] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:26.179279] [INFO ] [MAIN ] MAGN: Loaded 36149 primary data records. [2025-10-22T22:11:26.509783] [DEBUG] [LOCAL ] MAIN: Loaded 41940 existing records from primary storage. [2025-10-22T22:11:26.521631] [INFO ] [MAIN ] MAIN: Loaded 41940 primary data records. [2025-10-22T22:11:26.567520] [DEBUG] [LOCAL ] MAN: Loaded 44306 existing records from primary storage. [2025-10-22T22:11:26.612408] [INFO ] [MAIN ] MAN: Loaded 44306 primary data records. [2025-10-22T22:11:27.209512] [DEBUG] [MAIN ] MAGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:27.211911] [INFO ] [MAIN ] MAGN: Generated 1794 derivative records from 36149 primary records. [2025-10-22T22:11:27.212851] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-22T22:11:27.231132] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1794 records). [2025-10-22T22:11:27.232334] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-22T22:11:27.234469] [INFO ] [MAIN ] Derivative Progress: 1087/2052 symbols completed. MAGN took 1.2s. Estimated remaining: 6m 4s. Rate: 159.0 symbols/min [2025-10-22T22:11:27.234790] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:27.255047] [DEBUG] [MAIN ] MAIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:27.255674] [INFO ] [MAIN ] MAIN: Generated 1794 derivative records from 41940 primary records. [2025-10-22T22:11:27.255882] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-22T22:11:27.281631] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1794 records). [2025-10-22T22:11:27.281947] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-22T22:11:27.284058] [INFO ] [MAIN ] Derivative Progress: 1088/2052 symbols completed. MAIN took 1.1s. Estimated remaining: 6m 4s. Rate: 159.1 symbols/min [2025-10-22T22:11:27.284415] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:27.299129] [DEBUG] [MAIN ] MAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:27.300010] [INFO ] [MAIN ] MAN: Generated 1794 derivative records from 44306 primary records. [2025-10-22T22:11:27.300190] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-22T22:11:27.324845] [DEBUG] [LOCAL ] MANU: Loaded 27190 existing records from primary storage. [2025-10-22T22:11:27.326402] [DEBUG] [LOCAL ] MAN: Derivative data saved (1794 records). [2025-10-22T22:11:27.326681] [INFO ] [MAIN ] MANU: Loaded 27190 primary data records. [2025-10-22T22:11:27.326611] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-22T22:11:27.329515] [INFO ] [MAIN ] Derivative Progress: 1089/2052 symbols completed. MAN took 1.2s. Estimated remaining: 6m 3s. Rate: 159.2 symbols/min [2025-10-22T22:11:27.366488] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:27.674424] [DEBUG] [LOCAL ] MAS: Loaded 52226 existing records from primary storage. [2025-10-22T22:11:27.674772] [INFO ] [MAIN ] MAS: Loaded 52226 primary data records. [2025-10-22T22:11:27.759210] [DEBUG] [LOCAL ] MATV: Loaded 35045 existing records from primary storage. [2025-10-22T22:11:27.791806] [INFO ] [MAIN ] MATV: Loaded 35045 primary data records. [2025-10-22T22:11:28.325922] [DEBUG] [MAIN ] MANU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:28.327563] [INFO ] [MAIN ] MANU: Generated 1794 derivative records from 27190 primary records. [2025-10-22T22:11:28.328014] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-22T22:11:28.345484] [DEBUG] [LOCAL ] MANU: Derivative data saved (1794 records). [2025-10-22T22:11:28.345857] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-22T22:11:28.348257] [INFO ] [MAIN ] Derivative Progress: 1090/2052 symbols completed. MANU took 1.1s. Estimated remaining: 6m 3s. Rate: 159.0 symbols/min [2025-10-22T22:11:28.349070] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:28.370073] [DEBUG] [MAIN ] MAS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:28.370970] [INFO ] [MAIN ] MAS: Generated 1794 derivative records from 52226 primary records. [2025-10-22T22:11:28.371233] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-22T22:11:28.399082] [DEBUG] [LOCAL ] MAS: Derivative data saved (1794 records). [2025-10-22T22:11:28.407562] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-22T22:11:28.414917] [INFO ] [MAIN ] Derivative Progress: 1091/2052 symbols completed. MAS took 1.1s. Estimated remaining: 6m 2s. Rate: 159.1 symbols/min [2025-10-22T22:11:28.415130] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:28.412936] [DEBUG] [MAIN ] MATV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:28.416089] [INFO ] [MAIN ] MATV: Generated 1794 derivative records from 35045 primary records. [2025-10-22T22:11:28.416611] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-22T22:11:28.441618] [DEBUG] [LOCAL ] MATV: Derivative data saved (1794 records). [2025-10-22T22:11:28.442726] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-22T22:11:28.445274] [INFO ] [MAIN ] Derivative Progress: 1092/2052 symbols completed. MATV took 1.1s. Estimated remaining: 6m 2s. Rate: 159.2 symbols/min [2025-10-22T22:11:28.446162] [DEBUG] [LOCAL ] MATX: Loaded 31898 existing records from primary storage. [2025-10-22T22:11:28.446257] [INFO ] [MAIN ] MATX: Loaded 31898 primary data records. [2025-10-22T22:11:28.446376] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:28.664239] [DEBUG] [LOCAL ] MAX: Loaded 30725 existing records from primary storage. [2025-10-22T22:11:28.664576] [INFO ] [MAIN ] MAX: Loaded 30725 primary data records. [2025-10-22T22:11:28.912303] [DEBUG] [LOCAL ] MBC: Loaded 43879 existing records from primary storage. [2025-10-22T22:11:28.919669] [INFO ] [MAIN ] MBC: Loaded 43879 primary data records. [2025-10-22T22:11:29.488449] [DEBUG] [MAIN ] MATX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:29.489907] [INFO ] [MAIN ] MATX: Generated 1794 derivative records from 31898 primary records. [2025-10-22T22:11:29.490270] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-22T22:11:29.509184] [DEBUG] [LOCAL ] MATX: Derivative data saved (1794 records). [2025-10-22T22:11:29.509557] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-10-22T22:11:29.511777] [INFO ] [MAIN ] Derivative Progress: 1093/2052 symbols completed. MATX took 1.2s. Estimated remaining: 6m 2s. Rate: 159.0 symbols/min [2025-10-22T22:11:29.528912] [DEBUG] [MAIN ] MAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:29.531614] [INFO ] [MAIN ] MAX: Generated 1794 derivative records from 30725 primary records. [2025-10-22T22:11:29.531846] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-22T22:11:29.545979] [DEBUG] [MAIN ] MBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:29.546881] [INFO ] [MAIN ] MBC: Generated 1794 derivative records from 43879 primary records. [2025-10-22T22:11:29.553953] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-22T22:11:29.570664] [DEBUG] [LOCAL ] MAX: Derivative data saved (1794 records). [2025-10-22T22:11:29.575786] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-22T22:11:29.579516] [DEBUG] [LOCAL ] MBC: Derivative data saved (1794 records). [2025-10-22T22:11:29.579140] [INFO ] [MAIN ] Derivative Progress: 1094/2052 symbols completed. MAX took 1.2s. Estimated remaining: 6m 1s. Rate: 159.1 symbols/min [2025-10-22T22:11:29.579621] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-22T22:11:29.582334] [INFO ] [MAIN ] Derivative Progress: 1095/2052 symbols completed. MBC took 1.1s. Estimated remaining: 6m 1s. Rate: 159.2 symbols/min [2025-10-22T22:11:29.582771] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:29.582915] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:29.583458] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:29.602536] [DEBUG] [LOCAL ] MCB: Loaded 11254 existing records from primary storage. [2025-10-22T22:11:29.602762] [INFO ] [MAIN ] MCB: Loaded 11254 primary data records. [2025-10-22T22:11:29.728917] [DEBUG] [LOCAL ] MBI: Loaded 23968 existing records from primary storage. [2025-10-22T22:11:29.750475] [INFO ] [MAIN ] MBI: Loaded 23968 primary data records. [2025-10-22T22:11:29.878684] [DEBUG] [LOCAL ] MC: Loaded 43670 existing records from primary storage. [2025-10-22T22:11:30.034565] [INFO ] [MAIN ] MC: Loaded 43670 primary data records. [2025-10-22T22:11:30.589345] [DEBUG] [MAIN ] MCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:30.590443] [INFO ] [MAIN ] MCB: Generated 1794 derivative records from 11254 primary records. [2025-10-22T22:11:30.590755] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-22T22:11:30.609185] [DEBUG] [LOCAL ] MCB: Derivative data saved (1794 records). [2025-10-22T22:11:30.609889] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-22T22:11:30.612069] [INFO ] [MAIN ] Derivative Progress: 1096/2052 symbols completed. MCB took 1.0s. Estimated remaining: 6m 1s. Rate: 159.0 symbols/min [2025-10-22T22:11:30.612877] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:30.635233] [DEBUG] [MAIN ] MBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:30.639724] [DEBUG] [LOCAL ] MCI: Loaded 6182 existing records from primary storage. [2025-10-22T22:11:30.642330] [INFO ] [MAIN ] MBI: Generated 1794 derivative records from 23968 primary records. [2025-10-22T22:11:30.642446] [INFO ] [MAIN ] MCI: Loaded 6182 primary data records. [2025-10-22T22:11:30.642627] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-22T22:11:30.740928] [DEBUG] [MAIN ] MC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:30.771162] [INFO ] [MAIN ] MC: Generated 1794 derivative records from 43670 primary records. [2025-10-22T22:11:30.756149] [DEBUG] [LOCAL ] MBI: Derivative data saved (1794 records). [2025-10-22T22:11:30.771438] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-22T22:11:30.779104] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-22T22:11:30.786038] [INFO ] [MAIN ] Derivative Progress: 1097/2052 symbols completed. MBI took 1.2s. Estimated remaining: 6m 0s. Rate: 159.1 symbols/min [2025-10-22T22:11:30.786458] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:30.806933] [DEBUG] [LOCAL ] MC: Derivative data saved (1794 records). [2025-10-22T22:11:30.812755] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-22T22:11:30.820823] [INFO ] [MAIN ] Derivative Progress: 1098/2052 symbols completed. MC took 1.2s. Estimated remaining: 5m 60s. Rate: 159.2 symbols/min [2025-10-22T22:11:30.831488] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:31.006625] [DEBUG] [LOCAL ] MCN: Loaded 7984 existing records from primary storage. [2025-10-22T22:11:31.007853] [INFO ] [MAIN ] MCN: Loaded 7984 primary data records. [2025-10-22T22:11:31.178763] [DEBUG] [LOCAL ] MCK: Loaded 38009 existing records from primary storage. [2025-10-22T22:11:31.218257] [INFO ] [MAIN ] MCK: Loaded 38009 primary data records. [2025-10-22T22:11:31.647102] [DEBUG] [MAIN ] MCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:31.679384] [INFO ] [MAIN ] MCI: Generated 1794 derivative records from 6182 primary records. [2025-10-22T22:11:31.688353] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-22T22:11:31.706128] [DEBUG] [LOCAL ] MCI: Derivative data saved (1794 records). [2025-10-22T22:11:31.707011] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-22T22:11:31.710806] [INFO ] [MAIN ] Derivative Progress: 1099/2052 symbols completed. MCI took 1.1s. Estimated remaining: 5m 60s. Rate: 159.0 symbols/min [2025-10-22T22:11:31.712920] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:31.726769] [DEBUG] [MAIN ] MCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:31.727734] [INFO ] [MAIN ] MCN: Generated 1794 derivative records from 7984 primary records. [2025-10-22T22:11:31.727818] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-22T22:11:31.744752] [DEBUG] [LOCAL ] MCN: Derivative data saved (1794 records). [2025-10-22T22:11:31.744965] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-10-22T22:11:31.747598] [INFO ] [MAIN ] Derivative Progress: 1100/2052 symbols completed. MCN took 0.9s. Estimated remaining: 5m 59s. Rate: 159.1 symbols/min [2025-10-22T22:11:31.748020] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:31.772626] [DEBUG] [LOCAL ] MCR: Loaded 8866 existing records from primary storage. [2025-10-22T22:11:31.773160] [INFO ] [MAIN ] MCR: Loaded 8866 primary data records. [2025-10-22T22:11:31.773093] [DEBUG] [MAIN ] MCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:31.806239] [INFO ] [MAIN ] MCK: Generated 1794 derivative records from 38009 primary records. [2025-10-22T22:11:31.836508] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-22T22:11:31.938073] [DEBUG] [LOCAL ] MCO: Loaded 39425 existing records from primary storage. [2025-10-22T22:11:31.940027] [INFO ] [MAIN ] MCO: Loaded 39425 primary data records. [2025-10-22T22:11:31.942024] [DEBUG] [LOCAL ] MCK: Derivative data saved (1794 records). [2025-10-22T22:11:31.963677] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-22T22:11:31.997853] [INFO ] [MAIN ] Derivative Progress: 1101/2052 symbols completed. MCK took 1.2s. Estimated remaining: 5m 58s. Rate: 159.2 symbols/min [2025-10-22T22:11:32.062785] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:32.479170] [DEBUG] [LOCAL ] MCS: Loaded 21186 existing records from primary storage. [2025-10-22T22:11:32.481933] [INFO ] [MAIN ] MCS: Loaded 21186 primary data records. [2025-10-22T22:11:32.569998] [DEBUG] [MAIN ] MCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:32.601522] [INFO ] [MAIN ] MCR: Generated 1794 derivative records from 8866 primary records. [2025-10-22T22:11:32.605128] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-22T22:11:32.700708] [DEBUG] [LOCAL ] MCR: Derivative data saved (1794 records). [2025-10-22T22:11:32.700857] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-22T22:11:32.724877] [INFO ] [MAIN ] Derivative Progress: 1102/2052 symbols completed. MCR took 1.0s. Estimated remaining: 5m 58s. Rate: 159.0 symbols/min [2025-10-22T22:11:32.820107] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:32.840186] [DEBUG] [MAIN ] MCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:32.841710] [INFO ] [MAIN ] MCO: Generated 1794 derivative records from 39425 primary records. [2025-10-22T22:11:32.842245] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-22T22:11:32.868248] [DEBUG] [LOCAL ] MCO: Derivative data saved (1794 records). [2025-10-22T22:11:32.868593] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-22T22:11:32.871094] [INFO ] [MAIN ] Derivative Progress: 1103/2052 symbols completed. MCO took 1.2s. Estimated remaining: 5m 58s. Rate: 159.1 symbols/min [2025-10-22T22:11:32.871500] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:32.886256] [DEBUG] [LOCAL ] MCY: Loaded 23567 existing records from primary storage. [2025-10-22T22:11:32.888425] [INFO ] [MAIN ] MCY: Loaded 23567 primary data records. [2025-10-22T22:11:32.992315] [DEBUG] [MAIN ] MCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:33.019192] [INFO ] [MAIN ] MCS: Generated 1794 derivative records from 21186 primary records. [2025-10-22T22:11:33.019400] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-22T22:11:33.088910] [DEBUG] [LOCAL ] MCS: Derivative data saved (1794 records). [2025-10-22T22:11:33.122678] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-22T22:11:33.283927] [DEBUG] [LOCAL ] MD: Loaded 38572 existing records from primary storage. [2025-10-22T22:11:33.282876] [INFO ] [MAIN ] Derivative Progress: 1104/2052 symbols completed. MCS took 1.2s. Estimated remaining: 5m 57s. Rate: 159.1 symbols/min [2025-10-22T22:11:33.284248] [INFO ] [MAIN ] MD: Loaded 38572 primary data records. [2025-10-22T22:11:33.284201] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:33.396940] [DEBUG] [LOCAL ] MDST: Loaded 6110 existing records from primary storage. [2025-10-22T22:11:33.402975] [INFO ] [MAIN ] MDST: Loaded 6110 primary data records. [2025-10-22T22:11:33.912973] [DEBUG] [MAIN ] MCY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:33.913940] [INFO ] [MAIN ] MCY: Generated 1794 derivative records from 23567 primary records. [2025-10-22T22:11:33.914071] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-22T22:11:33.933280] [DEBUG] [LOCAL ] MCY: Derivative data saved (1794 records). [2025-10-22T22:11:33.933739] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-10-22T22:11:33.939634] [INFO ] [MAIN ] Derivative Progress: 1105/2052 symbols completed. MCY took 1.1s. Estimated remaining: 5m 57s. Rate: 159.0 symbols/min [2025-10-22T22:11:33.940264] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:33.953604] [DEBUG] [MAIN ] MD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:33.954345] [INFO ] [MAIN ] MD: Generated 1794 derivative records from 38572 primary records. [2025-10-22T22:11:33.954609] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-22T22:11:33.970815] [DEBUG] [LOCAL ] MD: Derivative data saved (1794 records). [2025-10-22T22:11:33.972692] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-22T22:11:33.975489] [INFO ] [MAIN ] Derivative Progress: 1106/2052 symbols completed. MD took 1.1s. Estimated remaining: 5m 57s. Rate: 159.1 symbols/min [2025-10-22T22:11:33.975775] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:33.989997] [DEBUG] [MAIN ] MDST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:33.990623] [INFO ] [MAIN ] MDST: Generated 1794 derivative records from 6110 primary records. [2025-10-22T22:11:33.990747] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-22T22:11:34.008306] [DEBUG] [LOCAL ] MDST: Derivative data saved (1794 records). [2025-10-22T22:11:34.022446] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-22T22:11:34.025684] [INFO ] [MAIN ] Derivative Progress: 1107/2052 symbols completed. MDST took 0.7s. Estimated remaining: 5m 56s. Rate: 159.3 symbols/min [2025-10-22T22:11:34.026010] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:34.060860] [DEBUG] [LOCAL ] MDV: Loaded 8298 existing records from primary storage. [2025-10-22T22:11:34.062244] [INFO ] [MAIN ] MDV: Loaded 8298 primary data records. [2025-10-22T22:11:34.062101] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-22T22:11:34.073748] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-10-22T22:11:34.249544] [DEBUG] [LOCAL ] MDU: Loaded 48009 existing records from primary storage. [2025-10-22T22:11:34.282798] [INFO ] [MAIN ] MDU: Loaded 48009 primary data records. [2025-10-22T22:11:35.063584] [DEBUG] [MAIN ] MDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:35.064942] [INFO ] [MAIN ] MDT: Generated 1794 derivative records from 53678 primary records. [2025-10-22T22:11:35.063942] [DEBUG] [MAIN ] MDV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:35.065312] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-22T22:11:35.066133] [INFO ] [MAIN ] MDV: Generated 1794 derivative records from 8298 primary records. [2025-10-22T22:11:35.066322] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-22T22:11:35.096533] [DEBUG] [LOCAL ] MDT: Derivative data saved (1794 records). [2025-10-22T22:11:35.101358] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-22T22:11:35.104247] [INFO ] [MAIN ] Derivative Progress: 1108/2052 symbols completed. MDT took 1.2s. Estimated remaining: 5m 56s. Rate: 159.0 symbols/min [2025-10-22T22:11:35.101442] [DEBUG] [LOCAL ] MDV: Derivative data saved (1794 records). [2025-10-22T22:11:35.104812] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-10-22T22:11:35.119621] [INFO ] [MAIN ] Derivative Progress: 1109/2052 symbols completed. MDV took 1.1s. Estimated remaining: 5m 56s. Rate: 159.1 symbols/min [2025-10-22T22:11:35.117775] [DEBUG] [MAIN ] MDU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:35.120614] [INFO ] [MAIN ] MDU: Generated 1794 derivative records from 48009 primary records. [2025-10-22T22:11:35.120767] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-22T22:11:35.135938] [DEBUG] [LOCAL ] MDU: Derivative data saved (1794 records). [2025-10-22T22:11:35.136000] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-22T22:11:35.138930] [INFO ] [MAIN ] Derivative Progress: 1110/2052 symbols completed. MDU took 1.2s. Estimated remaining: 5m 55s. Rate: 159.3 symbols/min [2025-10-22T22:11:35.139572] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:35.139473] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:35.140049] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:35.169250] [DEBUG] [LOCAL ] MEC: Loaded 16914 existing records from primary storage. [2025-10-22T22:11:35.176137] [INFO ] [MAIN ] MEC: Loaded 16914 primary data records. [2025-10-22T22:11:35.176513] [DEBUG] [LOCAL ] MED: Loaded 20919 existing records from primary storage. [2025-10-22T22:11:35.197124] [INFO ] [MAIN ] MED: Loaded 20919 primary data records. [2025-10-22T22:11:35.217034] [DEBUG] [LOCAL ] MEG: Loaded 31527 existing records from primary storage. [2025-10-22T22:11:35.222516] [INFO ] [MAIN ] MEG: Loaded 31527 primary data records. [2025-10-22T22:11:36.158136] [DEBUG] [MAIN ] MED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:36.157883] [DEBUG] [MAIN ] MEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:36.159569] [INFO ] [MAIN ] MEC: Generated 1794 derivative records from 16914 primary records. [2025-10-22T22:11:36.157277] [DEBUG] [MAIN ] MEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:36.159013] [INFO ] [MAIN ] MED: Generated 1794 derivative records from 20919 primary records. [2025-10-22T22:11:36.159781] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-22T22:11:36.160553] [INFO ] [MAIN ] MEG: Generated 1794 derivative records from 31527 primary records. [2025-10-22T22:11:36.161503] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-22T22:11:36.160631] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-22T22:11:36.205275] [DEBUG] [LOCAL ] MED: Derivative data saved (1794 records). [2025-10-22T22:11:36.208148] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-22T22:11:36.210876] [INFO ] [MAIN ] Derivative Progress: 1111/2052 symbols completed. MED took 1.1s. Estimated remaining: 5m 55s. Rate: 159.0 symbols/min [2025-10-22T22:11:36.204581] [DEBUG] [LOCAL ] MEC: Derivative data saved (1794 records). [2025-10-22T22:11:36.212286] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-22T22:11:36.212380] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:36.212100] [DEBUG] [LOCAL ] MEG: Derivative data saved (1794 records). [2025-10-22T22:11:36.214569] [INFO ] [MAIN ] Derivative Progress: 1112/2052 symbols completed. MEC took 1.1s. Estimated remaining: 5m 54s. Rate: 159.2 symbols/min [2025-10-22T22:11:36.214732] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-22T22:11:36.217820] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:36.218221] [INFO ] [MAIN ] Derivative Progress: 1113/2052 symbols completed. MEG took 1.1s. Estimated remaining: 5m 54s. Rate: 159.3 symbols/min [2025-10-22T22:11:36.218572] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:36.239559] [DEBUG] [LOCAL ] MEGI: Loaded 19699 existing records from primary storage. [2025-10-22T22:11:36.246779] [INFO ] [MAIN ] MEGI: Loaded 19699 primary data records. [2025-10-22T22:11:36.396322] [DEBUG] [LOCAL ] MEI: Loaded 31216 existing records from primary storage. [2025-10-22T22:11:36.436392] [INFO ] [MAIN ] MEI: Loaded 31216 primary data records. [2025-10-22T22:11:36.601411] [DEBUG] [LOCAL ] MET: Loaded 53300 existing records from primary storage. [2025-10-22T22:11:36.623665] [INFO ] [MAIN ] MET: Loaded 53300 primary data records. [2025-10-22T22:11:37.246612] [DEBUG] [MAIN ] MEGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:37.247629] [INFO ] [MAIN ] MEGI: Generated 1794 derivative records from 19699 primary records. [2025-10-22T22:11:37.248179] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-22T22:11:37.266858] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1794 records). [2025-10-22T22:11:37.267235] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-22T22:11:37.269613] [INFO ] [MAIN ] Derivative Progress: 1114/2052 symbols completed. MEGI took 1.1s. Estimated remaining: 5m 54s. Rate: 159.0 symbols/min [2025-10-22T22:11:37.270215] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:37.290893] [DEBUG] [MAIN ] MEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:37.303373] [INFO ] [MAIN ] MEI: Generated 1794 derivative records from 31216 primary records. [2025-10-22T22:11:37.304236] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-22T22:11:37.304529] [DEBUG] [MAIN ] MET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:37.305957] [INFO ] [MAIN ] MET: Generated 1794 derivative records from 53300 primary records. [2025-10-22T22:11:37.306315] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-22T22:11:37.330120] [DEBUG] [LOCAL ] MEI: Derivative data saved (1794 records). [2025-10-22T22:11:37.330275] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-22T22:11:37.332479] [INFO ] [MAIN ] Derivative Progress: 1115/2052 symbols completed. MEI took 1.1s. Estimated remaining: 5m 53s. Rate: 159.2 symbols/min [2025-10-22T22:11:37.335282] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:37.350126] [DEBUG] [LOCAL ] MET: Derivative data saved (1794 records). [2025-10-22T22:11:37.350423] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-22T22:11:37.353971] [INFO ] [MAIN ] Derivative Progress: 1116/2052 symbols completed. MET took 1.1s. Estimated remaining: 5m 53s. Rate: 159.3 symbols/min [2025-10-22T22:11:37.355294] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:37.359050] [DEBUG] [LOCAL ] MFAN: Loaded 4309 existing records from primary storage. [2025-10-22T22:11:37.372777] [INFO ] [MAIN ] MFAN: Loaded 4309 primary data records. [2025-10-22T22:11:37.385915] [DEBUG] [LOCAL ] MFA: Loaded 45582 existing records from primary storage. [2025-10-22T22:11:37.405760] [INFO ] [MAIN ] MFA: Loaded 45582 primary data records. [2025-10-22T22:11:37.480959] [DEBUG] [LOCAL ] MFAO: Loaded 3896 existing records from primary storage. [2025-10-22T22:11:37.513019] [INFO ] [MAIN ] MFAO: Loaded 3896 primary data records. [2025-10-22T22:11:38.352090] [DEBUG] [MAIN ] MFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:38.357478] [DEBUG] [MAIN ] MFAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:38.358927] [INFO ] [MAIN ] MFA: Generated 1794 derivative records from 45582 primary records. [2025-10-22T22:11:38.372490] [INFO ] [MAIN ] MFAN: Generated 1794 derivative records from 4309 primary records. [2025-10-22T22:11:38.372829] [DEBUG] [MAIN ] MFAO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:38.373450] [INFO ] [MAIN ] MFAO: Generated 1794 derivative records from 3896 primary records. [2025-10-22T22:11:38.373542] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-22T22:11:38.371554] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-22T22:11:38.373637] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-22T22:11:38.412501] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1794 records). [2025-10-22T22:11:38.412698] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-22T22:11:38.419952] [INFO ] [MAIN ] Derivative Progress: 1117/2052 symbols completed. MFAN took 1.1s. Estimated remaining: 5m 53s. Rate: 159.0 symbols/min [2025-10-22T22:11:38.417121] [DEBUG] [LOCAL ] MFA: Derivative data saved (1794 records). [2025-10-22T22:11:38.423955] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1794 records). [2025-10-22T22:11:38.424077] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-22T22:11:38.427072] [INFO ] [MAIN ] Derivative Progress: 1118/2052 symbols completed. MFAO took 1.1s. Estimated remaining: 5m 52s. Rate: 159.2 symbols/min [2025-10-22T22:11:38.427279] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:38.424185] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-22T22:11:38.424326] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:38.431142] [INFO ] [MAIN ] Derivative Progress: 1119/2052 symbols completed. MFA took 1.2s. Estimated remaining: 5m 51s. Rate: 159.3 symbols/min [2025-10-22T22:11:38.431485] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:38.450181] [DEBUG] [LOCAL ] MFM: Loaded 14090 existing records from primary storage. [2025-10-22T22:11:38.450355] [INFO ] [MAIN ] MFM: Loaded 14090 primary data records. [2025-10-22T22:11:38.633788] [DEBUG] [LOCAL ] MFG: Loaded 49552 existing records from primary storage. [2025-10-22T22:11:38.639240] [INFO ] [MAIN ] MFG: Loaded 49552 primary data records. [2025-10-22T22:11:38.782503] [DEBUG] [LOCAL ] MFC: Loaded 50997 existing records from primary storage. [2025-10-22T22:11:38.919691] [INFO ] [MAIN ] MFC: Loaded 50997 primary data records. [2025-10-22T22:11:39.530746] [DEBUG] [MAIN ] MFM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:39.534479] [INFO ] [MAIN ] MFM: Generated 1794 derivative records from 14090 primary records. [2025-10-22T22:11:39.535566] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-22T22:11:39.565880] [DEBUG] [LOCAL ] MFM: Derivative data saved (1794 records). [2025-10-22T22:11:39.566359] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-10-22T22:11:39.571372] [INFO ] [MAIN ] Derivative Progress: 1120/2052 symbols completed. MFM took 1.1s. Estimated remaining: 5m 52s. Rate: 159.0 symbols/min [2025-10-22T22:11:39.568516] [DEBUG] [MAIN ] MFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:39.571986] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:39.572971] [INFO ] [MAIN ] MFG: Generated 1794 derivative records from 49552 primary records. [2025-10-22T22:11:39.573137] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-22T22:11:39.596010] [DEBUG] [MAIN ] MFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:39.603393] [INFO ] [MAIN ] MFC: Generated 1794 derivative records from 50997 primary records. [2025-10-22T22:11:39.603890] [DEBUG] [LOCAL ] MFG: Derivative data saved (1794 records). [2025-10-22T22:11:39.603993] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-22T22:11:39.606790] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-10-22T22:11:39.609814] [INFO ] [MAIN ] Derivative Progress: 1121/2052 symbols completed. MFG took 1.2s. Estimated remaining: 5m 51s. Rate: 159.2 symbols/min [2025-10-22T22:11:39.609961] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:39.626408] [DEBUG] [LOCAL ] MFC: Derivative data saved (1794 records). [2025-10-22T22:11:39.630535] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-22T22:11:39.633509] [INFO ] [MAIN ] Derivative Progress: 1122/2052 symbols completed. MFC took 1.2s. Estimated remaining: 5m 50s. Rate: 159.3 symbols/min [2025-10-22T22:11:39.630436] [DEBUG] [LOCAL ] MFSG: Loaded 5956 existing records from primary storage. [2025-10-22T22:11:39.633929] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:39.633827] [INFO ] [MAIN ] MFSG: Loaded 5956 primary data records. [2025-10-22T22:11:39.710920] [DEBUG] [LOCAL ] MFSV: Loaded 2944 existing records from primary storage. [2025-10-22T22:11:39.715805] [INFO ] [MAIN ] MFSV: Loaded 2944 primary data records. [2025-10-22T22:11:39.740442] [DEBUG] [LOCAL ] MFSI: Loaded 12648 existing records from primary storage. [2025-10-22T22:11:39.755473] [INFO ] [MAIN ] MFSI: Loaded 12648 primary data records. [2025-10-22T22:11:40.633449] [DEBUG] [MAIN ] MFSG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:11:40.634509] [INFO ] [MAIN ] MFSG: Generated 1793 derivative records from 5956 primary records. [2025-10-22T22:11:40.634979] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-22T22:11:40.652505] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1793 records). [2025-10-22T22:11:40.653133] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-22T22:11:40.655383] [INFO ] [MAIN ] Derivative Progress: 1123/2052 symbols completed. MFSG took 1.1s. Estimated remaining: 5m 50s. Rate: 159.0 symbols/min [2025-10-22T22:11:40.690180] [DEBUG] [MAIN ] MFSI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:11:40.690714] [DEBUG] [MAIN ] MFSV: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-22T22:11:40.693378] [INFO ] [MAIN ] MFSV: Generated 1792 derivative records from 2944 primary records. [2025-10-22T22:11:40.693536] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-22T22:11:40.693206] [INFO ] [MAIN ] MFSI: Generated 1793 derivative records from 12648 primary records. [2025-10-22T22:11:40.694213] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-22T22:11:40.725347] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1792 records). [2025-10-22T22:11:40.729722] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1793 records). [2025-10-22T22:11:40.730065] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-22T22:11:40.730211] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-22T22:11:40.734327] [INFO ] [MAIN ] Derivative Progress: 1124/2052 symbols completed. MFSV took 1.1s. Estimated remaining: 5m 50s. Rate: 159.2 symbols/min [2025-10-22T22:11:40.739566] [INFO ] [MAIN ] Derivative Progress: 1125/2052 symbols completed. MFSI took 1.1s. Estimated remaining: 5m 49s. Rate: 159.3 symbols/min [2025-10-22T22:11:40.740403] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:40.740526] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:40.740226] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:40.750047] [DEBUG] [LOCAL ] MGF: Loaded 4133 existing records from primary storage. [2025-10-22T22:11:40.750520] [INFO ] [MAIN ] MGF: Loaded 4133 primary data records. [2025-10-22T22:11:40.852276] [DEBUG] [LOCAL ] MG: Loaded 15383 existing records from primary storage. [2025-10-22T22:11:40.879533] [INFO ] [MAIN ] MG: Loaded 15383 primary data records. [2025-10-22T22:11:41.278106] [DEBUG] [LOCAL ] MGA: Loaded 50391 existing records from primary storage. [2025-10-22T22:11:41.300089] [INFO ] [MAIN ] MGA: Loaded 50391 primary data records. [2025-10-22T22:11:41.834317] [DEBUG] [MAIN ] MGF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:42.006687] [INFO ] [MAIN ] MGF: Generated 1794 derivative records from 4133 primary records. [2025-10-22T22:11:42.033529] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-22T22:11:42.070460] [DEBUG] [MAIN ] MG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:42.074421] [DEBUG] [LOCAL ] MGF: Derivative data saved (1794 records). [2025-10-22T22:11:42.072425] [INFO ] [MAIN ] MG: Generated 1794 derivative records from 15383 primary records. [2025-10-22T22:11:42.074827] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-22T22:11:42.077109] [INFO ] [MAIN ] Derivative Progress: 1126/2052 symbols completed. MGF took 1.3s. Estimated remaining: 5m 50s. Rate: 158.9 symbols/min [2025-10-22T22:11:42.077583] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-22T22:11:42.079128] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:42.099075] [DEBUG] [LOCAL ] MG: Derivative data saved (1794 records). [2025-10-22T22:11:42.099727] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-22T22:11:42.102486] [INFO ] [MAIN ] Derivative Progress: 1127/2052 symbols completed. MG took 1.4s. Estimated remaining: 5m 49s. Rate: 159.1 symbols/min [2025-10-22T22:11:42.102894] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:42.115031] [DEBUG] [LOCAL ] MGR: Loaded 5536 existing records from primary storage. [2025-10-22T22:11:42.115457] [INFO ] [MAIN ] MGR: Loaded 5536 primary data records. [2025-10-22T22:11:42.238451] [DEBUG] [MAIN ] MGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:42.255777] [INFO ] [MAIN ] MGA: Generated 1794 derivative records from 50391 primary records. [2025-10-22T22:11:42.260362] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-22T22:11:42.386177] [DEBUG] [LOCAL ] MGM: Loaded 53605 existing records from primary storage. [2025-10-22T22:11:42.494542] [INFO ] [MAIN ] MGM: Loaded 53605 primary data records. [2025-10-22T22:11:42.514807] [DEBUG] [LOCAL ] MGA: Derivative data saved (1794 records). [2025-10-22T22:11:42.534622] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-22T22:11:42.562518] [INFO ] [MAIN ] Derivative Progress: 1128/2052 symbols completed. MGA took 1.8s. Estimated remaining: 5m 49s. Rate: 159.0 symbols/min [2025-10-22T22:11:42.600987] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:42.809628] [DEBUG] [LOCAL ] MGRB: Loaded 3994 existing records from primary storage. [2025-10-22T22:11:42.809852] [INFO ] [MAIN ] MGRB: Loaded 3994 primary data records. [2025-10-22T22:11:43.123162] [DEBUG] [MAIN ] MGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:43.132828] [INFO ] [MAIN ] MGR: Generated 1794 derivative records from 5536 primary records. [2025-10-22T22:11:43.133009] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-22T22:11:43.150345] [DEBUG] [LOCAL ] MGR: Derivative data saved (1794 records). [2025-10-22T22:11:43.151970] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-22T22:11:43.154345] [INFO ] [MAIN ] Derivative Progress: 1129/2052 symbols completed. MGR took 1.1s. Estimated remaining: 5m 48s. Rate: 159.0 symbols/min [2025-10-22T22:11:43.154915] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:43.163685] [DEBUG] [LOCAL ] MGRD: Loaded 2206 existing records from primary storage. [2025-10-22T22:11:43.177558] [INFO ] [MAIN ] MGRD: Loaded 2206 primary data records. [2025-10-22T22:11:43.177881] [DEBUG] [MAIN ] MGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:43.178718] [INFO ] [MAIN ] MGM: Generated 1794 derivative records from 53605 primary records. [2025-10-22T22:11:43.202698] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-22T22:11:43.295492] [DEBUG] [LOCAL ] MGM: Derivative data saved (1794 records). [2025-10-22T22:11:43.306507] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-22T22:11:43.325129] [INFO ] [MAIN ] Derivative Progress: 1130/2052 symbols completed. MGM took 1.2s. Estimated remaining: 5m 48s. Rate: 159.0 symbols/min [2025-10-22T22:11:43.348344] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:43.541737] [DEBUG] [MAIN ] MGRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:43.543372] [INFO ] [MAIN ] MGRB: Generated 1794 derivative records from 3994 primary records. [2025-10-22T22:11:43.544211] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-22T22:11:43.549109] [DEBUG] [LOCAL ] MGRE: Loaded 6420 existing records from primary storage. [2025-10-22T22:11:43.558550] [INFO ] [MAIN ] MGRE: Loaded 6420 primary data records. [2025-10-22T22:11:43.678857] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1794 records). [2025-10-22T22:11:43.699719] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-10-22T22:11:43.716526] [INFO ] [MAIN ] Derivative Progress: 1131/2052 symbols completed. MGRB took 1.1s. Estimated remaining: 5m 47s. Rate: 159.0 symbols/min [2025-10-22T22:11:43.748522] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:43.885211] [DEBUG] [MAIN ] MGRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:43.886500] [INFO ] [MAIN ] MGRD: Generated 1794 derivative records from 2206 primary records. [2025-10-22T22:11:43.886825] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-22T22:11:43.903374] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1794 records). [2025-10-22T22:11:43.903758] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-22T22:11:43.906132] [INFO ] [MAIN ] Derivative Progress: 1132/2052 symbols completed. MGRD took 0.8s. Estimated remaining: 5m 47s. Rate: 159.1 symbols/min [2025-10-22T22:11:43.906478] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:43.924101] [DEBUG] [MAIN ] MGRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:43.927713] [INFO ] [MAIN ] MGRE: Generated 1794 derivative records from 6420 primary records. [2025-10-22T22:11:43.927887] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-22T22:11:43.960567] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1794 records). [2025-10-22T22:11:43.960781] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-22T22:11:43.959852] [DEBUG] [LOCAL ] MHD: Loaded 11922 existing records from primary storage. [2025-10-22T22:11:43.960910] [INFO ] [MAIN ] MHD: Loaded 11922 primary data records. [2025-10-22T22:11:43.963459] [INFO ] [MAIN ] Derivative Progress: 1133/2052 symbols completed. MGRE took 0.6s. Estimated remaining: 5m 46s. Rate: 159.2 symbols/min [2025-10-22T22:11:43.964244] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:44.056252] [DEBUG] [LOCAL ] MGY: Loaded 52424 existing records from primary storage. [2025-10-22T22:11:44.071515] [INFO ] [MAIN ] MGY: Loaded 52424 primary data records. [2025-10-22T22:11:44.076897] [DEBUG] [LOCAL ] MHF: Loaded 9054 existing records from primary storage. [2025-10-22T22:11:44.093356] [INFO ] [MAIN ] MHF: Loaded 9054 primary data records. [2025-10-22T22:11:44.885113] [DEBUG] [MAIN ] MHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:44.899556] [INFO ] [MAIN ] MHD: Generated 1794 derivative records from 11922 primary records. [2025-10-22T22:11:44.899863] [DEBUG] [MAIN ] MHF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:44.900588] [INFO ] [MAIN ] MHF: Generated 1794 derivative records from 9054 primary records. [2025-10-22T22:11:44.900742] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-22T22:11:44.900794] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-22T22:11:44.928745] [DEBUG] [MAIN ] MGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:44.935249] [INFO ] [MAIN ] MGY: Generated 1794 derivative records from 52424 primary records. [2025-10-22T22:11:44.928279] [DEBUG] [LOCAL ] MHD: Derivative data saved (1794 records). [2025-10-22T22:11:44.936153] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-22T22:11:44.942864] [DEBUG] [LOCAL ] MHF: Derivative data saved (1794 records). [2025-10-22T22:11:44.942930] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-22T22:11:44.943224] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-22T22:11:44.945822] [INFO ] [MAIN ] Derivative Progress: 1134/2052 symbols completed. MHF took 1.0s. Estimated remaining: 5m 46s. Rate: 159.0 symbols/min [2025-10-22T22:11:44.946134] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:44.955238] [INFO ] [MAIN ] Derivative Progress: 1135/2052 symbols completed. MHD took 1.0s. Estimated remaining: 5m 46s. Rate: 159.1 symbols/min [2025-10-22T22:11:44.962557] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:44.964162] [DEBUG] [LOCAL ] MGY: Derivative data saved (1794 records). [2025-10-22T22:11:44.964227] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-10-22T22:11:44.967013] [INFO ] [MAIN ] Derivative Progress: 1136/2052 symbols completed. MGY took 1.2s. Estimated remaining: 5m 45s. Rate: 159.3 symbols/min [2025-10-22T22:11:44.967235] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:44.985689] [DEBUG] [LOCAL ] MHN: Loaded 7382 existing records from primary storage. [2025-10-22T22:11:44.985901] [INFO ] [MAIN ] MHN: Loaded 7382 primary data records. [2025-10-22T22:11:45.145218] [DEBUG] [LOCAL ] MHO: Loaded 23675 existing records from primary storage. [2025-10-22T22:11:45.156442] [INFO ] [MAIN ] MHO: Loaded 23675 primary data records. [2025-10-22T22:11:45.185550] [DEBUG] [LOCAL ] MHK: Loaded 41973 existing records from primary storage. [2025-10-22T22:11:45.185785] [INFO ] [MAIN ] MHK: Loaded 41973 primary data records. [2025-10-22T22:11:46.017074] [DEBUG] [MAIN ] MHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:46.017950] [INFO ] [MAIN ] MHN: Generated 1794 derivative records from 7382 primary records. [2025-10-22T22:11:46.018129] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-22T22:11:46.033824] [DEBUG] [LOCAL ] MHN: Derivative data saved (1794 records). [2025-10-22T22:11:46.033941] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-22T22:11:46.036076] [INFO ] [MAIN ] Derivative Progress: 1137/2052 symbols completed. MHN took 1.1s. Estimated remaining: 5m 45s. Rate: 159.0 symbols/min [2025-10-22T22:11:46.037260] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:46.054832] [DEBUG] [MAIN ] MHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:46.067539] [INFO ] [MAIN ] MHK: Generated 1794 derivative records from 41973 primary records. [2025-10-22T22:11:46.067888] [DEBUG] [MAIN ] MHO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:46.068014] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-22T22:11:46.068567] [INFO ] [MAIN ] MHO: Generated 1794 derivative records from 23675 primary records. [2025-10-22T22:11:46.069722] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-22T22:11:46.102544] [DEBUG] [LOCAL ] MHK: Derivative data saved (1794 records). [2025-10-22T22:11:46.103919] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-22T22:11:46.104803] [DEBUG] [LOCAL ] MHO: Derivative data saved (1794 records). [2025-10-22T22:11:46.107786] [INFO ] [MAIN ] Derivative Progress: 1138/2052 symbols completed. MHK took 1.2s. Estimated remaining: 5m 45s. Rate: 159.1 symbols/min [2025-10-22T22:11:46.104903] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-22T22:11:46.115880] [DEBUG] [LOCAL ] MIN: Loaded 13938 existing records from primary storage. [2025-10-22T22:11:46.115549] [INFO ] [MAIN ] Derivative Progress: 1139/2052 symbols completed. MHO took 1.1s. Estimated remaining: 5m 44s. Rate: 159.3 symbols/min [2025-10-22T22:11:46.116019] [INFO ] [MAIN ] MIN: Loaded 13938 primary data records. [2025-10-22T22:11:46.412368] [DEBUG] [MAIN ] MIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:46.413014] [INFO ] [MAIN ] MIN: Generated 1794 derivative records from 13938 primary records. [2025-10-22T22:11:46.413077] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-22T22:11:46.427074] [DEBUG] [LOCAL ] MIN: Derivative data saved (1794 records). [2025-10-22T22:11:46.427131] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-22T22:11:46.429083] [INFO ] [MAIN ] Derivative Progress: 1140/2052 symbols completed. MIN took 0.4s. Estimated remaining: 5m 44s. Rate: 159.3 symbols/min [2025-10-22T22:11:46.429492] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:46.429691] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:46.429589] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:46.439420] [DEBUG] [LOCAL ] MIY: Loaded 6216 existing records from primary storage. [2025-10-22T22:11:46.439614] [INFO ] [MAIN ] MIY: Loaded 6216 primary data records. [2025-10-22T22:11:46.553434] [DEBUG] [LOCAL ] MITT: Loaded 22283 existing records from primary storage. [2025-10-22T22:11:46.559760] [INFO ] [MAIN ] MITT: Loaded 22283 primary data records. [2025-10-22T22:11:47.059203] [DEBUG] [LOCAL ] MIR: Loaded 51402 existing records from primary storage. [2025-10-22T22:11:47.103305] [INFO ] [MAIN ] MIR: Loaded 51402 primary data records. [2025-10-22T22:11:47.439318] [DEBUG] [MAIN ] MIY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:47.440482] [INFO ] [MAIN ] MIY: Generated 1794 derivative records from 6216 primary records. [2025-10-22T22:11:47.440685] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-22T22:11:47.473667] [DEBUG] [LOCAL ] MIY: Derivative data saved (1794 records). [2025-10-22T22:11:47.474119] [DEBUG] [MAIN ] MITT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:47.474492] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-22T22:11:47.476935] [INFO ] [MAIN ] Derivative Progress: 1141/2052 symbols completed. MIY took 1.0s. Estimated remaining: 5m 44s. Rate: 159.0 symbols/min [2025-10-22T22:11:47.477892] [INFO ] [MAIN ] MITT: Generated 1794 derivative records from 22283 primary records. [2025-10-22T22:11:47.478337] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-22T22:11:47.478991] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:47.495546] [DEBUG] [LOCAL ] MITT: Derivative data saved (1794 records). [2025-10-22T22:11:47.496032] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-22T22:11:47.498528] [INFO ] [MAIN ] Derivative Progress: 1142/2052 symbols completed. MITT took 1.1s. Estimated remaining: 5m 43s. Rate: 159.2 symbols/min [2025-10-22T22:11:47.498820] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:47.518105] [DEBUG] [MAIN ] MIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:47.518882] [INFO ] [MAIN ] MIR: Generated 1794 derivative records from 51402 primary records. [2025-10-22T22:11:47.519063] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-22T22:11:47.557781] [DEBUG] [LOCAL ] MIR: Derivative data saved (1794 records). [2025-10-22T22:11:47.557985] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-10-22T22:11:47.560890] [INFO ] [MAIN ] Derivative Progress: 1143/2052 symbols completed. MIR took 1.1s. Estimated remaining: 5m 42s. Rate: 159.3 symbols/min [2025-10-22T22:11:47.561234] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:47.590864] [DEBUG] [LOCAL ] MKL: Loaded 33801 existing records from primary storage. [2025-10-22T22:11:47.591055] [INFO ] [MAIN ] MKL: Loaded 33801 primary data records. [2025-10-22T22:11:47.592325] [DEBUG] [LOCAL ] MKC: Loaded 52525 existing records from primary storage. [2025-10-22T22:11:47.612924] [INFO ] [MAIN ] MKC: Loaded 52525 primary data records. [2025-10-22T22:11:48.249049] [DEBUG] [LOCAL ] MLI: Loaded 43388 existing records from primary storage. [2025-10-22T22:11:48.249337] [INFO ] [MAIN ] MLI: Loaded 43388 primary data records. [2025-10-22T22:11:48.598330] [DEBUG] [MAIN ] MKL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:48.601166] [INFO ] [MAIN ] MKL: Generated 1794 derivative records from 33801 primary records. [2025-10-22T22:11:48.602098] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-22T22:11:48.631538] [DEBUG] [MAIN ] MKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:48.633726] [DEBUG] [LOCAL ] MKL: Derivative data saved (1794 records). [2025-10-22T22:11:48.634572] [INFO ] [MAIN ] MKC: Generated 1794 derivative records from 52525 primary records. [2025-10-22T22:11:48.633840] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-22T22:11:48.634742] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-22T22:11:48.636941] [INFO ] [MAIN ] Derivative Progress: 1144/2052 symbols completed. MKL took 1.1s. Estimated remaining: 5m 43s. Rate: 159.0 symbols/min [2025-10-22T22:11:48.637124] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:48.659855] [DEBUG] [LOCAL ] MKC: Derivative data saved (1794 records). [2025-10-22T22:11:48.660216] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-22T22:11:48.663120] [INFO ] [MAIN ] Derivative Progress: 1145/2052 symbols completed. MKC took 1.2s. Estimated remaining: 5m 42s. Rate: 159.2 symbols/min [2025-10-22T22:11:48.663450] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:48.689570] [DEBUG] [MAIN ] MLI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:48.690474] [INFO ] [MAIN ] MLI: Generated 1794 derivative records from 43388 primary records. [2025-10-22T22:11:48.690610] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-22T22:11:48.722979] [DEBUG] [LOCAL ] MLI: Derivative data saved (1794 records). [2025-10-22T22:11:48.723225] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-22T22:11:48.725943] [INFO ] [MAIN ] Derivative Progress: 1146/2052 symbols completed. MLI took 1.2s. Estimated remaining: 5m 41s. Rate: 159.3 symbols/min [2025-10-22T22:11:48.726990] [DEBUG] [LOCAL ] MLM: Loaded 28634 existing records from primary storage. [2025-10-22T22:11:48.727406] [INFO ] [MAIN ] MLM: Loaded 28634 primary data records. [2025-10-22T22:11:48.727228] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:48.818692] [DEBUG] [LOCAL ] MLP: Loaded 3004 existing records from primary storage. [2025-10-22T22:11:48.850779] [INFO ] [MAIN ] MLP: Loaded 3004 primary data records. [2025-10-22T22:11:48.843222] [DEBUG] [LOCAL ] MLNK: Loaded 27397 existing records from primary storage. [2025-10-22T22:11:48.878731] [INFO ] [MAIN ] MLNK: Loaded 27397 primary data records. [2025-10-22T22:11:49.760250] [DEBUG] [MAIN ] MLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:49.761575] [DEBUG] [MAIN ] MLM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:49.762737] [INFO ] [MAIN ] MLP: Generated 1794 derivative records from 3004 primary records. [2025-10-22T22:11:49.763756] [INFO ] [MAIN ] MLM: Generated 1794 derivative records from 28634 primary records. [2025-10-22T22:11:49.763928] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-22T22:11:49.764092] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-22T22:11:49.801167] [DEBUG] [LOCAL ] MLP: Derivative data saved (1794 records). [2025-10-22T22:11:49.805458] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-22T22:11:49.809173] [DEBUG] [MAIN ] MLNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:49.812757] [INFO ] [MAIN ] Derivative Progress: 1147/2052 symbols completed. MLP took 1.1s. Estimated remaining: 5m 41s. Rate: 159.0 symbols/min [2025-10-22T22:11:49.810132] [DEBUG] [LOCAL ] MLM: Derivative data saved (1794 records). [2025-10-22T22:11:49.813112] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-22T22:11:49.813939] [INFO ] [MAIN ] MLNK: Generated 1794 derivative records from 27397 primary records. [2025-10-22T22:11:49.814124] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:49.816675] [INFO ] [MAIN ] Derivative Progress: 1148/2052 symbols completed. MLM took 1.2s. Estimated remaining: 5m 41s. Rate: 159.1 symbols/min [2025-10-22T22:11:49.814298] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-10-22T22:11:49.817425] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:49.833857] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1794 records). [2025-10-22T22:11:49.834085] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-10-22T22:11:49.836688] [INFO ] [MAIN ] Derivative Progress: 1149/2052 symbols completed. MLNK took 1.2s. Estimated remaining: 5m 40s. Rate: 159.3 symbols/min [2025-10-22T22:11:49.837017] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:49.848106] [DEBUG] [LOCAL ] MLR: Loaded 12116 existing records from primary storage. [2025-10-22T22:11:49.848306] [INFO ] [MAIN ] MLR: Loaded 12116 primary data records. [2025-10-22T22:11:49.968778] [DEBUG] [LOCAL ] MMD: Loaded 10733 existing records from primary storage. [2025-10-22T22:11:49.986413] [INFO ] [MAIN ] MMD: Loaded 10733 primary data records. [2025-10-22T22:11:50.314500] [DEBUG] [LOCAL ] MMC: Loaded 51936 existing records from primary storage. [2025-10-22T22:11:50.330755] [INFO ] [MAIN ] MMC: Loaded 51936 primary data records. [2025-10-22T22:11:50.823720] [DEBUG] [MAIN ] MLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:50.824913] [INFO ] [MAIN ] MLR: Generated 1794 derivative records from 12116 primary records. [2025-10-22T22:11:50.825102] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-22T22:11:50.842369] [DEBUG] [LOCAL ] MLR: Derivative data saved (1794 records). [2025-10-22T22:11:50.843485] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-10-22T22:11:50.847625] [INFO ] [MAIN ] Derivative Progress: 1150/2052 symbols completed. MLR took 1.0s. Estimated remaining: 5m 40s. Rate: 159.0 symbols/min [2025-10-22T22:11:50.847972] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:50.862036] [DEBUG] [MAIN ] MMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:50.862803] [INFO ] [MAIN ] MMD: Generated 1794 derivative records from 10733 primary records. [2025-10-22T22:11:50.863119] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-22T22:11:50.883110] [DEBUG] [LOCAL ] MMD: Derivative data saved (1794 records). [2025-10-22T22:11:50.883332] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-22T22:11:50.886620] [INFO ] [MAIN ] Derivative Progress: 1151/2052 symbols completed. MMD took 1.0s. Estimated remaining: 5m 40s. Rate: 159.2 symbols/min [2025-10-22T22:11:50.893268] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:50.894677] [DEBUG] [LOCAL ] MMI: Loaded 15372 existing records from primary storage. [2025-10-22T22:11:50.895111] [INFO ] [MAIN ] MMI: Loaded 15372 primary data records. [2025-10-22T22:11:50.977367] [DEBUG] [MAIN ] MMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:50.991532] [INFO ] [MAIN ] MMC: Generated 1794 derivative records from 51936 primary records. [2025-10-22T22:11:51.016095] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-22T22:11:51.123826] [DEBUG] [LOCAL ] MMC: Derivative data saved (1794 records). [2025-10-22T22:11:51.332447] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-10-22T22:11:51.335312] [INFO ] [MAIN ] Derivative Progress: 1152/2052 symbols completed. MMC took 1.5s. Estimated remaining: 5m 39s. Rate: 159.1 symbols/min [2025-10-22T22:11:51.335566] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:51.361475] [DEBUG] [LOCAL ] MMM: Loaded 53112 existing records from primary storage. [2025-10-22T22:11:51.361804] [INFO ] [MAIN ] MMM: Loaded 53112 primary data records. [2025-10-22T22:11:51.492130] [DEBUG] [LOCAL ] MMS: Loaded 33396 existing records from primary storage. [2025-10-22T22:11:51.509038] [INFO ] [MAIN ] MMS: Loaded 33396 primary data records. [2025-10-22T22:11:51.880679] [DEBUG] [MAIN ] MMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:51.921227] [INFO ] [MAIN ] MMI: Generated 1794 derivative records from 15372 primary records. [2025-10-22T22:11:51.921769] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-22T22:11:52.060574] [DEBUG] [LOCAL ] MMI: Derivative data saved (1794 records). [2025-10-22T22:11:52.060786] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-22T22:11:52.063115] [INFO ] [MAIN ] Derivative Progress: 1153/2052 symbols completed. MMI took 1.2s. Estimated remaining: 5m 39s. Rate: 159.0 symbols/min [2025-10-22T22:11:52.087549] [DEBUG] [MAIN ] MMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:52.088464] [INFO ] [MAIN ] MMM: Generated 1794 derivative records from 53112 primary records. [2025-10-22T22:11:52.088544] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-22T22:11:52.107759] [DEBUG] [LOCAL ] MMM: Derivative data saved (1794 records). [2025-10-22T22:11:52.107955] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-22T22:11:52.110355] [INFO ] [MAIN ] Derivative Progress: 1154/2052 symbols completed. MMM took 1.2s. Estimated remaining: 5m 39s. Rate: 159.1 symbols/min [2025-10-22T22:11:52.123845] [DEBUG] [MAIN ] MMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:52.124626] [INFO ] [MAIN ] MMS: Generated 1794 derivative records from 33396 primary records. [2025-10-22T22:11:52.124715] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-22T22:11:52.141293] [DEBUG] [LOCAL ] MMS: Derivative data saved (1794 records). [2025-10-22T22:11:52.141375] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-10-22T22:11:52.144118] [INFO ] [MAIN ] Derivative Progress: 1155/2052 symbols completed. MMS took 0.8s. Estimated remaining: 5m 38s. Rate: 159.3 symbols/min [2025-10-22T22:11:52.144912] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:52.144986] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:52.145059] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:52.157782] [DEBUG] [LOCAL ] MMT: Loaded 10142 existing records from primary storage. [2025-10-22T22:11:52.158003] [INFO ] [MAIN ] MMT: Loaded 10142 primary data records. [2025-10-22T22:11:52.292076] [DEBUG] [LOCAL ] MMU: Loaded 16784 existing records from primary storage. [2025-10-22T22:11:52.303623] [INFO ] [MAIN ] MMU: Loaded 16784 primary data records. [2025-10-22T22:11:52.298258] [DEBUG] [LOCAL ] MNR: Loaded 24999 existing records from primary storage. [2025-10-22T22:11:52.319333] [INFO ] [MAIN ] MNR: Loaded 24999 primary data records. [2025-10-22T22:11:53.183436] [DEBUG] [MAIN ] MMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:53.184500] [INFO ] [MAIN ] MMT: Generated 1794 derivative records from 10142 primary records. [2025-10-22T22:11:53.185557] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-22T22:11:53.202408] [DEBUG] [LOCAL ] MMT: Derivative data saved (1794 records). [2025-10-22T22:11:53.203368] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-22T22:11:53.205510] [INFO ] [MAIN ] Derivative Progress: 1156/2052 symbols completed. MMT took 1.1s. Estimated remaining: 5m 38s. Rate: 159.0 symbols/min [2025-10-22T22:11:53.206504] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:53.222751] [DEBUG] [MAIN ] MMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:53.235910] [INFO ] [MAIN ] MMU: Generated 1794 derivative records from 16784 primary records. [2025-10-22T22:11:53.236561] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-22T22:11:53.237901] [DEBUG] [MAIN ] MNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:53.249896] [INFO ] [MAIN ] MNR: Generated 1794 derivative records from 24999 primary records. [2025-10-22T22:11:53.254158] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-22T22:11:53.254057] [DEBUG] [LOCAL ] MMU: Derivative data saved (1794 records). [2025-10-22T22:11:53.255028] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-22T22:11:53.257713] [INFO ] [MAIN ] Derivative Progress: 1157/2052 symbols completed. MMU took 1.1s. Estimated remaining: 5m 37s. Rate: 159.1 symbols/min [2025-10-22T22:11:53.265110] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:53.273790] [DEBUG] [LOCAL ] MNR: Derivative data saved (1794 records). [2025-10-22T22:11:53.273966] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-22T22:11:53.276531] [INFO ] [MAIN ] Derivative Progress: 1158/2052 symbols completed. MNR took 1.1s. Estimated remaining: 5m 37s. Rate: 159.3 symbols/min [2025-10-22T22:11:53.276914] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:53.314770] [DEBUG] [LOCAL ] MNSO: Loaded 44038 existing records from primary storage. [2025-10-22T22:11:53.314982] [INFO ] [MAIN ] MNSO: Loaded 44038 primary data records. [2025-10-22T22:11:53.471304] [DEBUG] [LOCAL ] MOD: Loaded 44505 existing records from primary storage. [2025-10-22T22:11:53.501055] [INFO ] [MAIN ] MOD: Loaded 44505 primary data records. [2025-10-22T22:11:53.715815] [DEBUG] [LOCAL ] MODG: Loaded 51534 existing records from primary storage. [2025-10-22T22:11:53.731690] [INFO ] [MAIN ] MODG: Loaded 51534 primary data records. [2025-10-22T22:11:54.298116] [DEBUG] [MAIN ] MNSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:54.299891] [INFO ] [MAIN ] MNSO: Generated 1794 derivative records from 44038 primary records. [2025-10-22T22:11:54.300395] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-22T22:11:54.319633] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1794 records). [2025-10-22T22:11:54.319815] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-22T22:11:54.322124] [INFO ] [MAIN ] Derivative Progress: 1159/2052 symbols completed. MNSO took 1.1s. Estimated remaining: 5m 37s. Rate: 159.0 symbols/min [2025-10-22T22:11:54.322381] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:54.336763] [DEBUG] [MAIN ] MOD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:54.337507] [INFO ] [MAIN ] MOD: Generated 1794 derivative records from 44505 primary records. [2025-10-22T22:11:54.337921] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-22T22:11:54.370767] [DEBUG] [MAIN ] MODG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:54.372807] [DEBUG] [LOCAL ] MOD: Derivative data saved (1794 records). [2025-10-22T22:11:54.373869] [INFO ] [MAIN ] MODG: Generated 1794 derivative records from 51534 primary records. [2025-10-22T22:11:54.374074] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-22T22:11:54.373981] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-22T22:11:54.376354] [INFO ] [MAIN ] Derivative Progress: 1160/2052 symbols completed. MOD took 1.1s. Estimated remaining: 5m 36s. Rate: 159.1 symbols/min [2025-10-22T22:11:54.376573] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:54.402320] [DEBUG] [LOCAL ] MODG: Derivative data saved (1794 records). [2025-10-22T22:11:54.402419] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-22T22:11:54.405055] [INFO ] [MAIN ] Derivative Progress: 1161/2052 symbols completed. MODG took 1.1s. Estimated remaining: 5m 36s. Rate: 159.3 symbols/min [2025-10-22T22:11:54.405199] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:54.428972] [DEBUG] [LOCAL ] MOH: Loaded 43041 existing records from primary storage. [2025-10-22T22:11:54.429318] [INFO ] [MAIN ] MOH: Loaded 43041 primary data records. [2025-10-22T22:11:54.523172] [DEBUG] [LOCAL ] MOV: Loaded 21161 existing records from primary storage. [2025-10-22T22:11:54.558417] [INFO ] [MAIN ] MOV: Loaded 21161 primary data records. [2025-10-22T22:11:54.833505] [DEBUG] [LOCAL ] MOS: Loaded 53511 existing records from primary storage. [2025-10-22T22:11:54.881851] [INFO ] [MAIN ] MOS: Loaded 53511 primary data records. [2025-10-22T22:11:55.462515] [DEBUG] [MAIN ] MOH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:55.467135] [INFO ] [MAIN ] MOH: Generated 1794 derivative records from 43041 primary records. [2025-10-22T22:11:55.467432] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-10-22T22:11:55.491280] [DEBUG] [MAIN ] MOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:55.496632] [INFO ] [MAIN ] MOV: Generated 1794 derivative records from 21161 primary records. [2025-10-22T22:11:55.497258] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-10-22T22:11:55.501076] [DEBUG] [LOCAL ] MOH: Derivative data saved (1794 records). [2025-10-22T22:11:55.508560] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-10-22T22:11:55.511980] [INFO ] [MAIN ] Derivative Progress: 1162/2052 symbols completed. MOH took 1.2s. Estimated remaining: 5m 36s. Rate: 159.0 symbols/min [2025-10-22T22:11:55.514038] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:55.523504] [DEBUG] [LOCAL ] MOV: Derivative data saved (1794 records). [2025-10-22T22:11:55.524519] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-10-22T22:11:55.527007] [INFO ] [MAIN ] Derivative Progress: 1163/2052 symbols completed. MOV took 1.1s. Estimated remaining: 5m 35s. Rate: 159.1 symbols/min [2025-10-22T22:11:55.527419] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:55.541870] [DEBUG] [MAIN ] MOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:55.542622] [INFO ] [MAIN ] MOS: Generated 1794 derivative records from 53511 primary records. [2025-10-22T22:11:55.542837] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-22T22:11:55.565362] [DEBUG] [LOCAL ] MOS: Derivative data saved (1794 records). [2025-10-22T22:11:55.565446] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-10-22T22:11:55.564886] [DEBUG] [LOCAL ] MPA: Loaded 5192 existing records from primary storage. [2025-10-22T22:11:55.568397] [INFO ] [MAIN ] Derivative Progress: 1164/2052 symbols completed. MOS took 1.2s. Estimated remaining: 5m 35s. Rate: 159.2 symbols/min [2025-10-22T22:11:55.569002] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:55.569513] [INFO ] [MAIN ] MPA: Loaded 5192 primary data records. [2025-10-22T22:11:55.919348] [DEBUG] [LOCAL ] MP: Loaded 53744 existing records from primary storage. [2025-10-22T22:11:55.919844] [INFO ] [MAIN ] MP: Loaded 53744 primary data records. [2025-10-22T22:11:56.055116] [DEBUG] [LOCAL ] MPC: Loaded 51893 existing records from primary storage. [2025-10-22T22:11:56.055415] [INFO ] [MAIN ] MPC: Loaded 51893 primary data records. [2025-10-22T22:11:56.604460] [DEBUG] [MAIN ] MPA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:56.620485] [INFO ] [MAIN ] MPA: Generated 1794 derivative records from 5192 primary records. [2025-10-22T22:11:56.621228] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-22T22:11:56.641169] [DEBUG] [LOCAL ] MPA: Derivative data saved (1794 records). [2025-10-22T22:11:56.642453] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-10-22T22:11:56.645233] [INFO ] [MAIN ] Derivative Progress: 1165/2052 symbols completed. MPA took 1.1s. Estimated remaining: 5m 35s. Rate: 159.0 symbols/min [2025-10-22T22:11:56.646183] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:56.669484] [DEBUG] [MAIN ] MP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:56.670423] [INFO ] [MAIN ] MP: Generated 1794 derivative records from 53744 primary records. [2025-10-22T22:11:56.678026] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-10-22T22:11:56.684702] [DEBUG] [MAIN ] MPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:56.685909] [INFO ] [MAIN ] MPC: Generated 1794 derivative records from 51893 primary records. [2025-10-22T22:11:56.693244] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-10-22T22:11:56.703988] [DEBUG] [LOCAL ] MP: Derivative data saved (1794 records). [2025-10-22T22:11:56.704682] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-10-22T22:11:56.707552] [INFO ] [MAIN ] Derivative Progress: 1166/2052 symbols completed. MP took 1.2s. Estimated remaining: 5m 34s. Rate: 159.1 symbols/min [2025-10-22T22:11:56.707762] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:56.726469] [DEBUG] [LOCAL ] MPC: Derivative data saved (1794 records). [2025-10-22T22:11:56.741332] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-10-22T22:11:56.744073] [INFO ] [MAIN ] Derivative Progress: 1167/2052 symbols completed. MPC took 1.2s. Estimated remaining: 5m 33s. Rate: 159.2 symbols/min [2025-10-22T22:11:56.744319] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:56.748209] [DEBUG] [LOCAL ] MPV: Loaded 4350 existing records from primary storage. [2025-10-22T22:11:56.748553] [INFO ] [MAIN ] MPV: Loaded 4350 primary data records. [2025-10-22T22:11:56.871592] [DEBUG] [LOCAL ] MPLX: Loaded 50774 existing records from primary storage. [2025-10-22T22:11:56.877483] [INFO ] [MAIN ] MPLX: Loaded 50774 primary data records. [2025-10-22T22:11:57.223423] [DEBUG] [LOCAL ] MPW: Loaded 53485 existing records from primary storage. [2025-10-22T22:11:57.234785] [INFO ] [MAIN ] MPW: Loaded 53485 primary data records. [2025-10-22T22:11:57.790633] [DEBUG] [MAIN ] MPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:57.791908] [INFO ] [MAIN ] MPV: Generated 1794 derivative records from 4350 primary records. [2025-10-22T22:11:57.792002] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-10-22T22:11:57.823415] [DEBUG] [LOCAL ] MPV: Derivative data saved (1794 records). [2025-10-22T22:11:57.823955] [DEBUG] [MAIN ] MPLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:57.824296] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-10-22T22:11:57.827314] [INFO ] [MAIN ] Derivative Progress: 1168/2052 symbols completed. MPV took 1.1s. Estimated remaining: 5m 34s. Rate: 159.0 symbols/min [2025-10-22T22:11:57.828237] [INFO ] [MAIN ] MPLX: Generated 1794 derivative records from 50774 primary records. [2025-10-22T22:11:57.828458] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-10-22T22:11:57.845748] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1794 records). [2025-10-22T22:11:57.845947] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-10-22T22:11:57.848499] [INFO ] [MAIN ] Derivative Progress: 1169/2052 symbols completed. MPLX took 1.2s. Estimated remaining: 5m 33s. Rate: 159.1 symbols/min [2025-10-22T22:11:57.862937] [DEBUG] [MAIN ] MPW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:57.863457] [INFO ] [MAIN ] MPW: Generated 1794 derivative records from 53485 primary records. [2025-10-22T22:11:57.863513] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-10-22T22:11:57.878013] [DEBUG] [LOCAL ] MPW: Derivative data saved (1794 records). [2025-10-22T22:11:57.878070] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-10-22T22:11:57.880434] [INFO ] [MAIN ] Derivative Progress: 1170/2052 symbols completed. MPW took 1.1s. Estimated remaining: 5m 32s. Rate: 159.2 symbols/min [2025-10-22T22:11:57.880883] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:57.880815] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:57.880986] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:57.890950] [DEBUG] [LOCAL ] MPX: Loaded 3955 existing records from primary storage. [2025-10-22T22:11:57.891219] [INFO ] [MAIN ] MPX: Loaded 3955 primary data records. [2025-10-22T22:11:57.964254] [DEBUG] [LOCAL ] MQT: Loaded 7975 existing records from primary storage. [2025-10-22T22:11:57.970156] [INFO ] [MAIN ] MQT: Loaded 7975 primary data records. [2025-10-22T22:11:58.053271] [DEBUG] [LOCAL ] MQY: Loaded 16545 existing records from primary storage. [2025-10-22T22:11:58.117269] [INFO ] [MAIN ] MQY: Loaded 16545 primary data records. [2025-10-22T22:11:58.829879] [DEBUG] [MAIN ] MQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:58.843274] [INFO ] [MAIN ] MQT: Generated 1794 derivative records from 7975 primary records. [2025-10-22T22:11:58.843855] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-10-22T22:11:58.843787] [DEBUG] [MAIN ] MPX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:58.845806] [INFO ] [MAIN ] MPX: Generated 1794 derivative records from 3955 primary records. [2025-10-22T22:11:58.852611] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-10-22T22:11:58.862045] [DEBUG] [LOCAL ] MQT: Derivative data saved (1794 records). [2025-10-22T22:11:58.862159] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-10-22T22:11:58.864737] [INFO ] [MAIN ] Derivative Progress: 1171/2052 symbols completed. MQT took 1.0s. Estimated remaining: 5m 32s. Rate: 159.0 symbols/min [2025-10-22T22:11:58.864891] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:58.880841] [DEBUG] [LOCAL ] MPX: Derivative data saved (1794 records). [2025-10-22T22:11:58.881076] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-10-22T22:11:58.883323] [INFO ] [MAIN ] Derivative Progress: 1172/2052 symbols completed. MPX took 1.0s. Estimated remaining: 5m 32s. Rate: 159.1 symbols/min [2025-10-22T22:11:58.896120] [DEBUG] [MAIN ] MQY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:58.896988] [INFO ] [MAIN ] MQY: Generated 1794 derivative records from 16545 primary records. [2025-10-22T22:11:58.897093] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-10-22T22:11:58.895822] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:58.913446] [DEBUG] [LOCAL ] MQY: Derivative data saved (1794 records). [2025-10-22T22:11:58.913678] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-10-22T22:11:58.916830] [INFO ] [MAIN ] Derivative Progress: 1173/2052 symbols completed. MQY took 1.0s. Estimated remaining: 5m 31s. Rate: 159.3 symbols/min [2025-10-22T22:11:58.917221] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:58.944364] [DEBUG] [LOCAL ] MRC: Loaded 37105 existing records from primary storage. [2025-10-22T22:11:58.945476] [INFO ] [MAIN ] MRC: Loaded 37105 primary data records. [2025-10-22T22:11:59.079875] [DEBUG] [LOCAL ] MRK: Loaded 53790 existing records from primary storage. [2025-10-22T22:11:59.096200] [INFO ] [MAIN ] MRK: Loaded 53790 primary data records. [2025-10-22T22:11:59.440268] [DEBUG] [LOCAL ] MS: Loaded 53688 existing records from primary storage. [2025-10-22T22:11:59.440538] [INFO ] [MAIN ] MS: Loaded 53688 primary data records. [2025-10-22T22:11:59.959315] [DEBUG] [MAIN ] MRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:59.960463] [INFO ] [MAIN ] MRC: Generated 1794 derivative records from 37105 primary records. [2025-10-22T22:11:59.961053] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-10-22T22:11:59.981331] [DEBUG] [LOCAL ] MRC: Derivative data saved (1794 records). [2025-10-22T22:11:59.981841] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-10-22T22:11:59.996113] [INFO ] [MAIN ] Derivative Progress: 1174/2052 symbols completed. MRC took 1.1s. Estimated remaining: 5m 31s. Rate: 159.0 symbols/min [2025-10-22T22:11:59.996543] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:11:59.996888] [DEBUG] [MAIN ] MRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:11:59.998007] [INFO ] [MAIN ] MRK: Generated 1794 derivative records from 53790 primary records. [2025-10-22T22:11:59.998272] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-10-22T22:12:00.017901] [DEBUG] [LOCAL ] MRK: Derivative data saved (1794 records). [2025-10-22T22:12:00.018251] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-10-22T22:12:00.020678] [INFO ] [MAIN ] Derivative Progress: 1175/2052 symbols completed. MRK took 1.1s. Estimated remaining: 5m 31s. Rate: 159.1 symbols/min [2025-10-22T22:12:00.021018] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:00.039054] [DEBUG] [MAIN ] MS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:00.040001] [INFO ] [MAIN ] MS: Generated 1794 derivative records from 53688 primary records. [2025-10-22T22:12:00.040128] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-10-22T22:12:00.065868] [DEBUG] [LOCAL ] MS: Derivative data saved (1794 records). [2025-10-22T22:12:00.064781] [DEBUG] [LOCAL ] MSA: Loaded 18830 existing records from primary storage. [2025-10-22T22:12:00.066102] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-10-22T22:12:00.068922] [INFO ] [MAIN ] Derivative Progress: 1176/2052 symbols completed. MS took 1.2s. Estimated remaining: 5m 30s. Rate: 159.3 symbols/min [2025-10-22T22:12:00.069086] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:00.069255] [INFO ] [MAIN ] MSA: Loaded 18830 primary data records. [2025-10-22T22:12:00.110071] [DEBUG] [LOCAL ] MSB: Loaded 7968 existing records from primary storage. [2025-10-22T22:12:00.149412] [INFO ] [MAIN ] MSB: Loaded 7968 primary data records. [2025-10-22T22:12:00.542131] [DEBUG] [LOCAL ] MSCI: Loaded 34183 existing records from primary storage. [2025-10-22T22:12:00.570267] [INFO ] [MAIN ] MSCI: Loaded 34183 primary data records. [2025-10-22T22:12:01.061592] [DEBUG] [MAIN ] MSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:01.062478] [INFO ] [MAIN ] MSA: Generated 1794 derivative records from 18830 primary records. [2025-10-22T22:12:01.062684] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-10-22T22:12:01.082393] [DEBUG] [LOCAL ] MSA: Derivative data saved (1794 records). [2025-10-22T22:12:01.090905] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-10-22T22:12:01.098249] [INFO ] [MAIN ] Derivative Progress: 1177/2052 symbols completed. MSA took 1.1s. Estimated remaining: 5m 30s. Rate: 159.0 symbols/min [2025-10-22T22:12:01.098959] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:01.098696] [DEBUG] [MAIN ] MSB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:01.100390] [INFO ] [MAIN ] MSB: Generated 1794 derivative records from 7968 primary records. [2025-10-22T22:12:01.100582] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-10-22T22:12:01.118993] [DEBUG] [LOCAL ] MSB: Derivative data saved (1794 records). [2025-10-22T22:12:01.119841] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-10-22T22:12:01.123871] [INFO ] [MAIN ] Derivative Progress: 1178/2052 symbols completed. MSB took 1.1s. Estimated remaining: 5m 30s. Rate: 159.1 symbols/min [2025-10-22T22:12:01.124749] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:01.142803] [DEBUG] [MAIN ] MSCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:01.143520] [INFO ] [MAIN ] MSCI: Generated 1794 derivative records from 34183 primary records. [2025-10-22T22:12:01.143676] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-10-22T22:12:01.158476] [DEBUG] [LOCAL ] MSD: Loaded 16543 existing records from primary storage. [2025-10-22T22:12:01.161422] [INFO ] [MAIN ] MSD: Loaded 16543 primary data records. [2025-10-22T22:12:01.165757] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1794 records). [2025-10-22T22:12:01.186209] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-10-22T22:12:01.198599] [INFO ] [MAIN ] Derivative Progress: 1179/2052 symbols completed. MSCI took 1.1s. Estimated remaining: 5m 29s. Rate: 159.3 symbols/min [2025-10-22T22:12:01.210512] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:01.372485] [DEBUG] [LOCAL ] MSDL: Loaded 38577 existing records from primary storage. [2025-10-22T22:12:01.475727] [INFO ] [MAIN ] MSDL: Loaded 38577 primary data records. [2025-10-22T22:12:01.593283] [DEBUG] [LOCAL ] MSGE: Loaded 27002 existing records from primary storage. [2025-10-22T22:12:01.605388] [INFO ] [MAIN ] MSGE: Loaded 27002 primary data records. [2025-10-22T22:12:02.181749] [DEBUG] [MAIN ] MSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:02.183135] [INFO ] [MAIN ] MSD: Generated 1794 derivative records from 16543 primary records. [2025-10-22T22:12:02.183304] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-10-22T22:12:02.202321] [DEBUG] [LOCAL ] MSD: Derivative data saved (1794 records). [2025-10-22T22:12:02.202739] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-10-22T22:12:02.204966] [INFO ] [MAIN ] Derivative Progress: 1180/2052 symbols completed. MSD took 1.1s. Estimated remaining: 5m 29s. Rate: 159.0 symbols/min [2025-10-22T22:12:02.205308] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:02.223949] [DEBUG] [MAIN ] MSDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:02.226530] [INFO ] [MAIN ] MSDL: Generated 1794 derivative records from 38577 primary records. [2025-10-22T22:12:02.227601] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-10-22T22:12:02.246115] [DEBUG] [MAIN ] MSGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:02.262255] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1794 records). [2025-10-22T22:12:02.262428] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-10-22T22:12:02.263234] [INFO ] [MAIN ] MSGE: Generated 1794 derivative records from 27002 primary records. [2025-10-22T22:12:02.265910] [INFO ] [MAIN ] Derivative Progress: 1181/2052 symbols completed. MSDL took 1.1s. Estimated remaining: 5m 28s. Rate: 159.1 symbols/min [2025-10-22T22:12:02.271737] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-10-22T22:12:02.271874] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:02.273587] [DEBUG] [LOCAL ] MSGS: Loaded 17199 existing records from primary storage. [2025-10-22T22:12:02.275071] [INFO ] [MAIN ] MSGS: Loaded 17199 primary data records. [2025-10-22T22:12:02.330423] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1794 records). [2025-10-22T22:12:02.352609] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-10-22T22:12:02.370194] [INFO ] [MAIN ] Derivative Progress: 1182/2052 symbols completed. MSGE took 1.2s. Estimated remaining: 5m 28s. Rate: 159.2 symbols/min [2025-10-22T22:12:02.383251] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:02.628570] [DEBUG] [LOCAL ] MSI: Loaded 39574 existing records from primary storage. [2025-10-22T22:12:02.628918] [INFO ] [MAIN ] MSI: Loaded 39574 primary data records. [2025-10-22T22:12:02.771606] [DEBUG] [LOCAL ] MSM: Loaded 35407 existing records from primary storage. [2025-10-22T22:12:02.782596] [INFO ] [MAIN ] MSM: Loaded 35407 primary data records. [2025-10-22T22:12:03.350977] [DEBUG] [MAIN ] MSGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:03.352442] [INFO ] [MAIN ] MSGS: Generated 1794 derivative records from 17199 primary records. [2025-10-22T22:12:03.352666] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-10-22T22:12:03.371352] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1794 records). [2025-10-22T22:12:03.372134] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-10-22T22:12:03.374718] [INFO ] [MAIN ] Derivative Progress: 1183/2052 symbols completed. MSGS took 1.2s. Estimated remaining: 5m 28s. Rate: 159.0 symbols/min [2025-10-22T22:12:03.393963] [DEBUG] [MAIN ] MSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:03.394867] [INFO ] [MAIN ] MSI: Generated 1794 derivative records from 39574 primary records. [2025-10-22T22:12:03.395045] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-10-22T22:12:03.413448] [DEBUG] [LOCAL ] MSI: Derivative data saved (1794 records). [2025-10-22T22:12:03.413714] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-10-22T22:12:03.416190] [INFO ] [MAIN ] Derivative Progress: 1184/2052 symbols completed. MSI took 1.1s. Estimated remaining: 5m 27s. Rate: 159.1 symbols/min [2025-10-22T22:12:03.429048] [DEBUG] [MAIN ] MSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:03.429629] [INFO ] [MAIN ] MSM: Generated 1794 derivative records from 35407 primary records. [2025-10-22T22:12:03.429714] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-10-22T22:12:03.445051] [DEBUG] [LOCAL ] MSM: Derivative data saved (1794 records). [2025-10-22T22:12:03.445188] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-10-22T22:12:03.448187] [INFO ] [MAIN ] Derivative Progress: 1185/2052 symbols completed. MSM took 1.1s. Estimated remaining: 5m 27s. Rate: 159.3 symbols/min [2025-10-22T22:12:03.448800] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:03.448940] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:03.449381] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:03.469616] [DEBUG] [LOCAL ] MTD: Loaded 15156 existing records from primary storage. [2025-10-22T22:12:03.470006] [INFO ] [MAIN ] MTD: Loaded 15156 primary data records. [2025-10-22T22:12:03.826883] [DEBUG] [LOCAL ] MTB: Loaded 46640 existing records from primary storage. [2025-10-22T22:12:03.827859] [INFO ] [MAIN ] MTB: Loaded 46640 primary data records. [2025-10-22T22:12:03.827757] [DEBUG] [LOCAL ] MT: Loaded 50419 existing records from primary storage. [2025-10-22T22:12:03.839876] [INFO ] [MAIN ] MT: Loaded 50419 primary data records. [2025-10-22T22:12:04.455343] [DEBUG] [MAIN ] MTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:04.456975] [INFO ] [MAIN ] MTD: Generated 1794 derivative records from 15156 primary records. [2025-10-22T22:12:04.457760] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-10-22T22:12:04.478846] [DEBUG] [LOCAL ] MTD: Derivative data saved (1794 records). [2025-10-22T22:12:04.479233] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-10-22T22:12:04.482536] [INFO ] [MAIN ] Derivative Progress: 1186/2052 symbols completed. MTD took 1.0s. Estimated remaining: 5m 27s. Rate: 159.0 symbols/min [2025-10-22T22:12:04.483236] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:04.503816] [DEBUG] [MAIN ] MTB: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:12:04.512297] [INFO ] [MAIN ] MTB: Generated 1793 derivative records from 46640 primary records. [2025-10-22T22:12:04.517069] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-10-22T22:12:04.518457] [DEBUG] [MAIN ] MT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:04.528352] [INFO ] [MAIN ] MT: Generated 1794 derivative records from 50419 primary records. [2025-10-22T22:12:04.535531] [DEBUG] [LOCAL ] MTB: Derivative data saved (1793 records). [2025-10-22T22:12:04.535709] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-10-22T22:12:04.535915] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-10-22T22:12:04.538063] [INFO ] [MAIN ] Derivative Progress: 1187/2052 symbols completed. MTB took 1.1s. Estimated remaining: 5m 26s. Rate: 159.1 symbols/min [2025-10-22T22:12:04.538463] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:04.556500] [DEBUG] [LOCAL ] MT: Derivative data saved (1794 records). [2025-10-22T22:12:04.570367] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-10-22T22:12:04.573202] [INFO ] [MAIN ] Derivative Progress: 1188/2052 symbols completed. MT took 1.1s. Estimated remaining: 5m 26s. Rate: 159.3 symbols/min [2025-10-22T22:12:04.573485] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:04.607845] [DEBUG] [LOCAL ] MTDR: Loaded 51762 existing records from primary storage. [2025-10-22T22:12:04.608202] [INFO ] [MAIN ] MTDR: Loaded 51762 primary data records. [2025-10-22T22:12:04.735000] [DEBUG] [LOCAL ] MTG: Loaded 51061 existing records from primary storage. [2025-10-22T22:12:04.753298] [INFO ] [MAIN ] MTG: Loaded 51061 primary data records. [2025-10-22T22:12:04.835196] [DEBUG] [LOCAL ] MTH: Loaded 43777 existing records from primary storage. [2025-10-22T22:12:05.008702] [INFO ] [MAIN ] MTH: Loaded 43777 primary data records. [2025-10-22T22:12:05.610696] [DEBUG] [MAIN ] MTDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:05.612207] [INFO ] [MAIN ] MTDR: Generated 1794 derivative records from 51762 primary records. [2025-10-22T22:12:05.612862] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-10-22T22:12:05.630194] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1794 records). [2025-10-22T22:12:05.630425] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-10-22T22:12:05.632373] [INFO ] [MAIN ] Derivative Progress: 1189/2052 symbols completed. MTDR took 1.1s. Estimated remaining: 5m 26s. Rate: 159.0 symbols/min [2025-10-22T22:12:05.632813] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:05.650936] [DEBUG] [MAIN ] MTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:05.651935] [INFO ] [MAIN ] MTG: Generated 1794 derivative records from 51061 primary records. [2025-10-22T22:12:05.653024] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-10-22T22:12:05.683935] [DEBUG] [LOCAL ] MTG: Derivative data saved (1794 records). [2025-10-22T22:12:05.684622] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-10-22T22:12:05.684398] [DEBUG] [MAIN ] MTH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:05.687252] [INFO ] [MAIN ] Derivative Progress: 1190/2052 symbols completed. MTG took 1.1s. Estimated remaining: 5m 25s. Rate: 159.1 symbols/min [2025-10-22T22:12:05.687638] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:05.688812] [INFO ] [MAIN ] MTH: Generated 1794 derivative records from 43777 primary records. [2025-10-22T22:12:05.688998] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-10-22T22:12:05.713662] [DEBUG] [LOCAL ] MTH: Derivative data saved (1794 records). [2025-10-22T22:12:05.713853] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-10-22T22:12:05.716631] [INFO ] [MAIN ] Derivative Progress: 1191/2052 symbols completed. MTH took 1.1s. Estimated remaining: 5m 24s. Rate: 159.3 symbols/min [2025-10-22T22:12:05.716979] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:05.734585] [DEBUG] [LOCAL ] MTN: Loaded 39380 existing records from primary storage. [2025-10-22T22:12:05.734825] [INFO ] [MAIN ] MTN: Loaded 39380 primary data records. [2025-10-22T22:12:05.838379] [DEBUG] [LOCAL ] MTRN: Loaded 18137 existing records from primary storage. [2025-10-22T22:12:05.849039] [INFO ] [MAIN ] MTRN: Loaded 18137 primary data records. [2025-10-22T22:12:05.902612] [DEBUG] [LOCAL ] MTUS: Loaded 27451 existing records from primary storage. [2025-10-22T22:12:05.936870] [INFO ] [MAIN ] MTUS: Loaded 27451 primary data records. [2025-10-22T22:12:06.727806] [DEBUG] [MAIN ] MTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:06.728864] [INFO ] [MAIN ] MTN: Generated 1794 derivative records from 39380 primary records. [2025-10-22T22:12:06.729078] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-10-22T22:12:06.749269] [DEBUG] [LOCAL ] MTN: Derivative data saved (1794 records). [2025-10-22T22:12:06.750599] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-10-22T22:12:06.753006] [INFO ] [MAIN ] Derivative Progress: 1192/2052 symbols completed. MTN took 1.1s. Estimated remaining: 5m 24s. Rate: 159.0 symbols/min [2025-10-22T22:12:06.753282] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:06.767122] [DEBUG] [MAIN ] MTRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:06.768150] [INFO ] [MAIN ] MTRN: Generated 1794 derivative records from 18137 primary records. [2025-10-22T22:12:06.768427] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-10-22T22:12:06.785714] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1794 records). [2025-10-22T22:12:06.793734] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-10-22T22:12:06.797208] [INFO ] [MAIN ] Derivative Progress: 1193/2052 symbols completed. MTRN took 1.1s. Estimated remaining: 5m 24s. Rate: 159.1 symbols/min [2025-10-22T22:12:06.798330] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:06.820068] [DEBUG] [MAIN ] MTUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:06.822170] [INFO ] [MAIN ] MTUS: Generated 1794 derivative records from 27451 primary records. [2025-10-22T22:12:06.822636] [DEBUG] [LOCAL ] MTW: Loaded 26422 existing records from primary storage. [2025-10-22T22:12:06.822929] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-10-22T22:12:06.823426] [INFO ] [MAIN ] MTW: Loaded 26422 primary data records. [2025-10-22T22:12:06.887269] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1794 records). [2025-10-22T22:12:06.936972] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-10-22T22:12:06.955429] [INFO ] [MAIN ] Derivative Progress: 1194/2052 symbols completed. MTUS took 1.2s. Estimated remaining: 5m 23s. Rate: 159.2 symbols/min [2025-10-22T22:12:06.956228] [DEBUG] [LOCAL ] MTX: Loaded 22589 existing records from primary storage. [2025-10-22T22:12:06.956980] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:06.956878] [INFO ] [MAIN ] MTX: Loaded 22589 primary data records. [2025-10-22T22:12:07.551770] [DEBUG] [LOCAL ] MTZ: Loaded 42746 existing records from primary storage. [2025-10-22T22:12:07.552421] [INFO ] [MAIN ] MTZ: Loaded 42746 primary data records. [2025-10-22T22:12:07.718262] [DEBUG] [MAIN ] MTW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:07.748494] [INFO ] [MAIN ] MTW: Generated 1794 derivative records from 26422 primary records. [2025-10-22T22:12:07.848141] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-10-22T22:12:07.895136] [DEBUG] [LOCAL ] MTW: Derivative data saved (1794 records). [2025-10-22T22:12:07.895269] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-10-22T22:12:07.890914] [DEBUG] [MAIN ] MTX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:07.898233] [INFO ] [MAIN ] Derivative Progress: 1195/2052 symbols completed. MTW took 1.1s. Estimated remaining: 5m 23s. Rate: 159.0 symbols/min [2025-10-22T22:12:07.899428] [INFO ] [MAIN ] MTX: Generated 1794 derivative records from 22589 primary records. [2025-10-22T22:12:07.900592] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-10-22T22:12:07.900362] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:07.918496] [DEBUG] [LOCAL ] MTX: Derivative data saved (1794 records). [2025-10-22T22:12:07.918670] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-10-22T22:12:07.921251] [INFO ] [MAIN ] Derivative Progress: 1196/2052 symbols completed. MTX took 1.1s. Estimated remaining: 5m 23s. Rate: 159.1 symbols/min [2025-10-22T22:12:07.921865] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:07.933400] [DEBUG] [LOCAL ] MUA: Loaded 11533 existing records from primary storage. [2025-10-22T22:12:07.933674] [INFO ] [MAIN ] MUA: Loaded 11533 primary data records. [2025-10-22T22:12:08.128819] [DEBUG] [LOCAL ] MUC: Loaded 20640 existing records from primary storage. [2025-10-22T22:12:08.129510] [DEBUG] [MAIN ] MTZ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:12:08.151206] [INFO ] [MAIN ] MTZ: Generated 1793 derivative records from 42746 primary records. [2025-10-22T22:12:08.158911] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-10-22T22:12:08.165960] [INFO ] [MAIN ] MUC: Loaded 20640 primary data records. [2025-10-22T22:12:08.381185] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1793 records). [2025-10-22T22:12:08.392427] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-10-22T22:12:08.401788] [INFO ] [MAIN ] Derivative Progress: 1197/2052 symbols completed. MTZ took 1.4s. Estimated remaining: 5m 22s. Rate: 159.1 symbols/min [2025-10-22T22:12:08.414707] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:08.628185] [DEBUG] [LOCAL ] MUE: Loaded 12225 existing records from primary storage. [2025-10-22T22:12:08.628514] [INFO ] [MAIN ] MUE: Loaded 12225 primary data records. [2025-10-22T22:12:08.842689] [DEBUG] [MAIN ] MUA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:08.855503] [INFO ] [MAIN ] MUA: Generated 1794 derivative records from 11533 primary records. [2025-10-22T22:12:08.966398] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-10-22T22:12:08.988102] [DEBUG] [LOCAL ] MUA: Derivative data saved (1794 records). [2025-10-22T22:12:08.989812] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-10-22T22:12:08.992476] [INFO ] [MAIN ] Derivative Progress: 1198/2052 symbols completed. MUA took 1.1s. Estimated remaining: 5m 22s. Rate: 159.0 symbols/min [2025-10-22T22:12:09.007021] [DEBUG] [MAIN ] MUC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:09.007974] [INFO ] [MAIN ] MUC: Generated 1794 derivative records from 20640 primary records. [2025-10-22T22:12:09.008179] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-10-22T22:12:09.024389] [DEBUG] [LOCAL ] MUC: Derivative data saved (1794 records). [2025-10-22T22:12:09.024590] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-10-22T22:12:09.027322] [INFO ] [MAIN ] Derivative Progress: 1199/2052 symbols completed. MUC took 1.1s. Estimated remaining: 5m 22s. Rate: 159.1 symbols/min [2025-10-22T22:12:09.043256] [DEBUG] [MAIN ] MUE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:09.043890] [INFO ] [MAIN ] MUE: Generated 1794 derivative records from 12225 primary records. [2025-10-22T22:12:09.043952] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-10-22T22:12:09.059946] [DEBUG] [LOCAL ] MUE: Derivative data saved (1794 records). [2025-10-22T22:12:09.060016] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-10-22T22:12:09.062530] [INFO ] [MAIN ] Derivative Progress: 1200/2052 symbols completed. MUE took 0.6s. Estimated remaining: 5m 21s. Rate: 159.3 symbols/min [2025-10-22T22:12:09.063294] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:09.063177] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:09.063409] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:09.080906] [DEBUG] [LOCAL ] MUJ: Loaded 13888 existing records from primary storage. [2025-10-22T22:12:09.081201] [INFO ] [MAIN ] MUJ: Loaded 13888 primary data records. [2025-10-22T22:12:09.482495] [DEBUG] [LOCAL ] MUR: Loaded 52861 existing records from primary storage. [2025-10-22T22:12:09.484088] [INFO ] [MAIN ] MUR: Loaded 52861 primary data records. [2025-10-22T22:12:09.483928] [DEBUG] [LOCAL ] MUFG: Loaded 52428 existing records from primary storage. [2025-10-22T22:12:09.495851] [INFO ] [MAIN ] MUFG: Loaded 52428 primary data records. [2025-10-22T22:12:10.123200] [DEBUG] [MAIN ] MUJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:10.124442] [INFO ] [MAIN ] MUJ: Generated 1794 derivative records from 13888 primary records. [2025-10-22T22:12:10.124911] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-10-22T22:12:10.144932] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1794 records). [2025-10-22T22:12:10.145483] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-10-22T22:12:10.151682] [INFO ] [MAIN ] Derivative Progress: 1201/2052 symbols completed. MUJ took 1.1s. Estimated remaining: 5m 21s. Rate: 159.0 symbols/min [2025-10-22T22:12:10.152390] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:10.173060] [DEBUG] [MAIN ] MUFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:10.173946] [INFO ] [MAIN ] MUFG: Generated 1794 derivative records from 52428 primary records. [2025-10-22T22:12:10.174125] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-10-22T22:12:10.187246] [DEBUG] [MAIN ] MUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:10.194719] [INFO ] [MAIN ] MUR: Generated 1794 derivative records from 52861 primary records. [2025-10-22T22:12:10.201883] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-10-22T22:12:10.217638] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1794 records). [2025-10-22T22:12:10.218524] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-10-22T22:12:10.236548] [INFO ] [MAIN ] Derivative Progress: 1202/2052 symbols completed. MUFG took 1.2s. Estimated remaining: 5m 21s. Rate: 159.1 symbols/min [2025-10-22T22:12:10.238595] [DEBUG] [LOCAL ] MUR: Derivative data saved (1794 records). [2025-10-22T22:12:10.239448] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-10-22T22:12:10.241539] [INFO ] [MAIN ] Derivative Progress: 1203/2052 symbols completed. MUR took 1.2s. Estimated remaining: 5m 20s. Rate: 159.3 symbols/min [2025-10-22T22:12:10.239142] [DEBUG] [LOCAL ] MUSA: Loaded 24600 existing records from primary storage. [2025-10-22T22:12:10.241876] [INFO ] [MAIN ] MUSA: Loaded 24600 primary data records. [2025-10-22T22:12:10.239308] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:10.241757] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:10.365073] [DEBUG] [LOCAL ] MVF: Loaded 12686 existing records from primary storage. [2025-10-22T22:12:10.377248] [INFO ] [MAIN ] MVF: Loaded 12686 primary data records. [2025-10-22T22:12:10.758015] [DEBUG] [LOCAL ] MUX: Loaded 43833 existing records from primary storage. [2025-10-22T22:12:10.873723] [INFO ] [MAIN ] MUX: Loaded 43833 primary data records. [2025-10-22T22:12:11.242802] [DEBUG] [MAIN ] MUSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:11.244545] [INFO ] [MAIN ] MUSA: Generated 1794 derivative records from 24600 primary records. [2025-10-22T22:12:11.248511] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-10-22T22:12:11.263434] [DEBUG] [MAIN ] MVF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:11.275217] [INFO ] [MAIN ] MVF: Generated 1794 derivative records from 12686 primary records. [2025-10-22T22:12:11.279461] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-10-22T22:12:11.279354] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1794 records). [2025-10-22T22:12:11.281522] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-10-22T22:12:11.291919] [INFO ] [MAIN ] Derivative Progress: 1204/2052 symbols completed. MUSA took 1.1s. Estimated remaining: 5m 20s. Rate: 159.0 symbols/min [2025-10-22T22:12:11.298944] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:11.298738] [DEBUG] [LOCAL ] MVF: Derivative data saved (1794 records). [2025-10-22T22:12:11.299577] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-10-22T22:12:11.302148] [INFO ] [MAIN ] Derivative Progress: 1205/2052 symbols completed. MVF took 1.1s. Estimated remaining: 5m 19s. Rate: 159.1 symbols/min [2025-10-22T22:12:11.302390] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:11.333011] [DEBUG] [MAIN ] MUX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:11.334356] [INFO ] [MAIN ] MUX: Generated 1794 derivative records from 43833 primary records. [2025-10-22T22:12:11.333587] [DEBUG] [LOCAL ] MVO: Loaded 8969 existing records from primary storage. [2025-10-22T22:12:11.338590] [DEBUG] [LOCAL ] MVT: Loaded 9790 existing records from primary storage. [2025-10-22T22:12:11.338758] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-10-22T22:12:11.339730] [INFO ] [MAIN ] MVO: Loaded 8969 primary data records. [2025-10-22T22:12:11.338886] [INFO ] [MAIN ] MVT: Loaded 9790 primary data records. [2025-10-22T22:12:11.512535] [DEBUG] [LOCAL ] MUX: Derivative data saved (1794 records). [2025-10-22T22:12:11.543325] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-10-22T22:12:11.549767] [INFO ] [MAIN ] Derivative Progress: 1206/2052 symbols completed. MUX took 1.3s. Estimated remaining: 5m 19s. Rate: 159.2 symbols/min [2025-10-22T22:12:11.549958] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:11.981570] [DEBUG] [LOCAL ] MWA: Loaded 45767 existing records from primary storage. [2025-10-22T22:12:11.981861] [INFO ] [MAIN ] MWA: Loaded 45767 primary data records. [2025-10-22T22:12:12.297903] [DEBUG] [MAIN ] MVO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:12:12.300235] [INFO ] [MAIN ] MVO: Generated 1793 derivative records from 8969 primary records. [2025-10-22T22:12:12.300496] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-10-22T22:12:12.326198] [DEBUG] [MAIN ] MVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:12.331213] [DEBUG] [LOCAL ] MVO: Derivative data saved (1793 records). [2025-10-22T22:12:12.332271] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-10-22T22:12:12.332198] [INFO ] [MAIN ] MVT: Generated 1794 derivative records from 9790 primary records. [2025-10-22T22:12:12.334705] [INFO ] [MAIN ] Derivative Progress: 1207/2052 symbols completed. MVO took 1.0s. Estimated remaining: 5m 19s. Rate: 159.0 symbols/min [2025-10-22T22:12:12.334949] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:12.335567] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-10-22T22:12:12.353751] [DEBUG] [LOCAL ] MVT: Derivative data saved (1794 records). [2025-10-22T22:12:12.354209] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-10-22T22:12:12.356895] [INFO ] [MAIN ] Derivative Progress: 1208/2052 symbols completed. MVT took 1.1s. Estimated remaining: 5m 18s. Rate: 159.2 symbols/min [2025-10-22T22:12:12.357348] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:12.393674] [DEBUG] [LOCAL ] MXF: Loaded 5491 existing records from primary storage. [2025-10-22T22:12:12.394077] [DEBUG] [LOCAL ] MX: Loaded 22229 existing records from primary storage. [2025-10-22T22:12:12.394381] [INFO ] [MAIN ] MX: Loaded 22229 primary data records. [2025-10-22T22:12:12.394960] [DEBUG] [MAIN ] MWA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:12.395104] [INFO ] [MAIN ] MXF: Loaded 5491 primary data records. [2025-10-22T22:12:12.427592] [INFO ] [MAIN ] MWA: Generated 1794 derivative records from 45767 primary records. [2025-10-22T22:12:12.507561] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-10-22T22:12:12.688448] [DEBUG] [LOCAL ] MWA: Derivative data saved (1794 records). [2025-10-22T22:12:12.752344] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-10-22T22:12:12.776697] [INFO ] [MAIN ] Derivative Progress: 1209/2052 symbols completed. MWA took 1.2s. Estimated remaining: 5m 18s. Rate: 159.2 symbols/min [2025-10-22T22:12:12.776942] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:13.061860] [DEBUG] [LOCAL ] MYD: Loaded 13143 existing records from primary storage. [2025-10-22T22:12:13.062277] [INFO ] [MAIN ] MYD: Loaded 13143 primary data records. [2025-10-22T22:12:13.371332] [DEBUG] [MAIN ] MXF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:13.379575] [INFO ] [MAIN ] MXF: Generated 1794 derivative records from 5491 primary records. [2025-10-22T22:12:13.385696] [DEBUG] [MAIN ] MX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:13.385421] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-10-22T22:12:13.387133] [INFO ] [MAIN ] MX: Generated 1794 derivative records from 22229 primary records. [2025-10-22T22:12:13.388077] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-10-22T22:12:13.411531] [DEBUG] [LOCAL ] MXF: Derivative data saved (1794 records). [2025-10-22T22:12:13.416753] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-10-22T22:12:13.419379] [INFO ] [MAIN ] Derivative Progress: 1210/2052 symbols completed. MXF took 1.1s. Estimated remaining: 5m 18s. Rate: 159.1 symbols/min [2025-10-22T22:12:13.419536] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:13.422040] [DEBUG] [LOCAL ] MX: Derivative data saved (1794 records). [2025-10-22T22:12:13.422620] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-10-22T22:12:13.424789] [INFO ] [MAIN ] Derivative Progress: 1211/2052 symbols completed. MX took 1.1s. Estimated remaining: 5m 17s. Rate: 159.2 symbols/min [2025-10-22T22:12:13.425018] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:13.455797] [DEBUG] [MAIN ] MYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:13.456566] [INFO ] [MAIN ] MYD: Generated 1794 derivative records from 13143 primary records. [2025-10-22T22:12:13.456986] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-10-22T22:12:13.471077] [DEBUG] [LOCAL ] MYE: Loaded 24003 existing records from primary storage. [2025-10-22T22:12:13.469851] [DEBUG] [LOCAL ] MYI: Loaded 19068 existing records from primary storage. [2025-10-22T22:12:13.471680] [INFO ] [MAIN ] MYE: Loaded 24003 primary data records. [2025-10-22T22:12:13.471204] [INFO ] [MAIN ] MYI: Loaded 19068 primary data records. [2025-10-22T22:12:13.618357] [DEBUG] [LOCAL ] MYD: Derivative data saved (1794 records). [2025-10-22T22:12:13.633172] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-10-22T22:12:13.713165] [INFO ] [MAIN ] Derivative Progress: 1212/2052 symbols completed. MYD took 0.9s. Estimated remaining: 5m 17s. Rate: 159.2 symbols/min [2025-10-22T22:12:13.734155] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:14.114807] [DEBUG] [LOCAL ] MYN: Loaded 9951 existing records from primary storage. [2025-10-22T22:12:14.114944] [INFO ] [MAIN ] MYN: Loaded 9951 primary data records. [2025-10-22T22:12:14.454247] [DEBUG] [MAIN ] MYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:14.453893] [DEBUG] [MAIN ] MYE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:14.455530] [INFO ] [MAIN ] MYE: Generated 1794 derivative records from 24003 primary records. [2025-10-22T22:12:14.455772] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-10-22T22:12:14.457249] [INFO ] [MAIN ] MYI: Generated 1794 derivative records from 19068 primary records. [2025-10-22T22:12:14.457715] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-10-22T22:12:14.481498] [DEBUG] [LOCAL ] MYE: Derivative data saved (1794 records). [2025-10-22T22:12:14.481671] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-10-22T22:12:14.490572] [DEBUG] [LOCAL ] MYI: Derivative data saved (1794 records). [2025-10-22T22:12:14.490950] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-10-22T22:12:14.493167] [INFO ] [MAIN ] Derivative Progress: 1213/2052 symbols completed. MYI took 1.1s. Estimated remaining: 5m 16s. Rate: 159.1 symbols/min [2025-10-22T22:12:14.496417] [INFO ] [MAIN ] Derivative Progress: 1214/2052 symbols completed. MYE took 1.1s. Estimated remaining: 5m 16s. Rate: 159.2 symbols/min [2025-10-22T22:12:14.514288] [DEBUG] [MAIN ] MYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:14.514934] [INFO ] [MAIN ] MYN: Generated 1794 derivative records from 9951 primary records. [2025-10-22T22:12:14.514996] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-10-22T22:12:14.529610] [DEBUG] [LOCAL ] MYN: Derivative data saved (1794 records). [2025-10-22T22:12:14.529731] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-10-22T22:12:14.532324] [INFO ] [MAIN ] Derivative Progress: 1215/2052 symbols completed. MYN took 0.8s. Estimated remaining: 5m 15s. Rate: 159.3 symbols/min [2025-10-22T22:12:14.533129] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:14.533336] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:14.533203] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:14.589324] [DEBUG] [LOCAL ] NAC: Loaded 24487 existing records from primary storage. [2025-10-22T22:12:14.590058] [DEBUG] [LOCAL ] NAD: Loaded 33581 existing records from primary storage. [2025-10-22T22:12:14.590258] [INFO ] [MAIN ] NAD: Loaded 33581 primary data records. [2025-10-22T22:12:14.590430] [INFO ] [MAIN ] NAC: Loaded 24487 primary data records. [2025-10-22T22:12:14.801599] [DEBUG] [LOCAL ] NABL: Loaded 38946 existing records from primary storage. [2025-10-22T22:12:14.834063] [INFO ] [MAIN ] NABL: Loaded 38946 primary data records. [2025-10-22T22:12:15.614913] [DEBUG] [MAIN ] NAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:15.617342] [INFO ] [MAIN ] NAD: Generated 1794 derivative records from 33581 primary records. [2025-10-22T22:12:15.617608] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-10-22T22:12:15.649558] [DEBUG] [LOCAL ] NAD: Derivative data saved (1794 records). [2025-10-22T22:12:15.650392] [DEBUG] [MAIN ] NAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:15.650680] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-10-22T22:12:15.654126] [INFO ] [MAIN ] NAC: Generated 1794 derivative records from 24487 primary records. [2025-10-22T22:12:15.654390] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-10-22T22:12:15.653085] [INFO ] [MAIN ] Derivative Progress: 1216/2052 symbols completed. NAD took 1.1s. Estimated remaining: 5m 15s. Rate: 159.1 symbols/min [2025-10-22T22:12:15.665126] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:15.687729] [DEBUG] [LOCAL ] NAC: Derivative data saved (1794 records). [2025-10-22T22:12:15.688294] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-10-22T22:12:15.688625] [DEBUG] [MAIN ] NABL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:15.693556] [INFO ] [MAIN ] Derivative Progress: 1217/2052 symbols completed. NAC took 1.2s. Estimated remaining: 5m 15s. Rate: 159.2 symbols/min [2025-10-22T22:12:15.694829] [INFO ] [MAIN ] NABL: Generated 1794 derivative records from 38946 primary records. [2025-10-22T22:12:15.694992] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-10-22T22:12:15.693937] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:15.708137] [DEBUG] [LOCAL ] NAN: Loaded 8427 existing records from primary storage. [2025-10-22T22:12:15.711006] [INFO ] [MAIN ] NAN: Loaded 8427 primary data records. [2025-10-22T22:12:15.726770] [DEBUG] [LOCAL ] NABL: Derivative data saved (1794 records). [2025-10-22T22:12:15.746261] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-10-22T22:12:15.754441] [INFO ] [MAIN ] Derivative Progress: 1218/2052 symbols completed. NABL took 1.2s. Estimated remaining: 5m 14s. Rate: 159.3 symbols/min [2025-10-22T22:12:15.782749] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:16.057072] [DEBUG] [LOCAL ] NATL: Loaded 32096 existing records from primary storage. [2025-10-22T22:12:16.059430] [INFO ] [MAIN ] NATL: Loaded 32096 primary data records. [2025-10-22T22:12:16.059145] [DEBUG] [LOCAL ] NAT: Loaded 49207 existing records from primary storage. [2025-10-22T22:12:16.080678] [INFO ] [MAIN ] NAT: Loaded 49207 primary data records. [2025-10-22T22:12:16.681845] [DEBUG] [MAIN ] NAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:16.683625] [INFO ] [MAIN ] NAN: Generated 1794 derivative records from 8427 primary records. [2025-10-22T22:12:16.684067] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-10-22T22:12:16.701811] [DEBUG] [LOCAL ] NAN: Derivative data saved (1794 records). [2025-10-22T22:12:16.702036] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-10-22T22:12:16.704521] [INFO ] [MAIN ] Derivative Progress: 1219/2052 symbols completed. NAN took 1.0s. Estimated remaining: 5m 14s. Rate: 159.1 symbols/min [2025-10-22T22:12:16.704720] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:16.710904] [DEBUG] [LOCAL ] NAZ: Loaded 2670 existing records from primary storage. [2025-10-22T22:12:16.711101] [INFO ] [MAIN ] NAZ: Loaded 2670 primary data records. [2025-10-22T22:12:16.826763] [DEBUG] [MAIN ] NAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:16.852145] [INFO ] [MAIN ] NAT: Generated 1794 derivative records from 49207 primary records. [2025-10-22T22:12:16.858622] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-10-22T22:12:16.852862] [DEBUG] [MAIN ] NATL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:16.875088] [INFO ] [MAIN ] NATL: Generated 1794 derivative records from 32096 primary records. [2025-10-22T22:12:16.881023] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-10-22T22:12:17.101966] [DEBUG] [LOCAL ] NATL: Derivative data saved (1794 records). [2025-10-22T22:12:17.118162] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-10-22T22:12:17.123455] [INFO ] [MAIN ] Derivative Progress: 1220/2052 symbols completed. NATL took 1.3s. Estimated remaining: 5m 14s. Rate: 159.1 symbols/min [2025-10-22T22:12:17.123631] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:17.126546] [DEBUG] [LOCAL ] NAT: Derivative data saved (1794 records). [2025-10-22T22:12:17.127447] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-10-22T22:12:17.130283] [INFO ] [MAIN ] Derivative Progress: 1221/2052 symbols completed. NAT took 1.4s. Estimated remaining: 5m 13s. Rate: 159.2 symbols/min [2025-10-22T22:12:17.130905] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:17.141171] [DEBUG] [LOCAL ] NBB: Loaded 9022 existing records from primary storage. [2025-10-22T22:12:17.141437] [INFO ] [MAIN ] NBB: Loaded 9022 primary data records. [2025-10-22T22:12:17.287773] [DEBUG] [LOCAL ] NBHC: Loaded 23669 existing records from primary storage. [2025-10-22T22:12:17.316402] [INFO ] [MAIN ] NBHC: Loaded 23669 primary data records. [2025-10-22T22:12:17.325817] [DEBUG] [MAIN ] NAZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:17.350628] [INFO ] [MAIN ] NAZ: Generated 1794 derivative records from 2670 primary records. [2025-10-22T22:12:17.367636] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-10-22T22:12:17.589569] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1794 records). [2025-10-22T22:12:17.601073] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-10-22T22:12:17.603468] [INFO ] [MAIN ] Derivative Progress: 1222/2052 symbols completed. NAZ took 0.9s. Estimated remaining: 5m 13s. Rate: 159.2 symbols/min [2025-10-22T22:12:17.603780] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:17.817365] [DEBUG] [MAIN ] NBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:17.828282] [INFO ] [MAIN ] NBB: Generated 1794 derivative records from 9022 primary records. [2025-10-22T22:12:17.829154] [DEBUG] [LOCAL ] NBR: Loaded 34369 existing records from primary storage. [2025-10-22T22:12:17.829572] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-10-22T22:12:17.830266] [INFO ] [MAIN ] NBR: Loaded 34369 primary data records. [2025-10-22T22:12:17.918825] [DEBUG] [LOCAL ] NBB: Derivative data saved (1794 records). [2025-10-22T22:12:17.950521] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-10-22T22:12:17.970203] [INFO ] [MAIN ] Derivative Progress: 1223/2052 symbols completed. NBB took 0.8s. Estimated remaining: 5m 12s. Rate: 159.2 symbols/min [2025-10-22T22:12:17.994170] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:18.056337] [DEBUG] [MAIN ] NBHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:18.166899] [INFO ] [MAIN ] NBHC: Generated 1794 derivative records from 23669 primary records. [2025-10-22T22:12:18.174422] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-10-22T22:12:18.197942] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1794 records). [2025-10-22T22:12:18.198538] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-10-22T22:12:18.200755] [INFO ] [MAIN ] Derivative Progress: 1224/2052 symbols completed. NBHC took 1.1s. Estimated remaining: 5m 12s. Rate: 159.2 symbols/min [2025-10-22T22:12:18.208963] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:18.208862] [DEBUG] [LOCAL ] NBXG: Loaded 21680 existing records from primary storage. [2025-10-22T22:12:18.209813] [INFO ] [MAIN ] NBXG: Loaded 21680 primary data records. [2025-10-22T22:12:18.302830] [DEBUG] [LOCAL ] NC: Loaded 1998 existing records from primary storage. [2025-10-22T22:12:18.320880] [INFO ] [MAIN ] NC: Loaded 1998 primary data records. [2025-10-22T22:12:18.636919] [DEBUG] [MAIN ] NBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:18.643246] [INFO ] [MAIN ] NBR: Generated 1794 derivative records from 34369 primary records. [2025-10-22T22:12:18.654487] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-10-22T22:12:18.897010] [DEBUG] [LOCAL ] NBR: Derivative data saved (1794 records). [2025-10-22T22:12:18.897230] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-10-22T22:12:18.899531] [INFO ] [MAIN ] Derivative Progress: 1225/2052 symbols completed. NBR took 1.3s. Estimated remaining: 5m 12s. Rate: 159.1 symbols/min [2025-10-22T22:12:18.899786] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:18.913092] [DEBUG] [LOCAL ] NCA: Loaded 9773 existing records from primary storage. [2025-10-22T22:12:18.913593] [INFO ] [MAIN ] NCA: Loaded 9773 primary data records. [2025-10-22T22:12:19.084715] [DEBUG] [MAIN ] NBXG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:19.099373] [INFO ] [MAIN ] NBXG: Generated 1794 derivative records from 21680 primary records. [2025-10-22T22:12:19.136048] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-10-22T22:12:19.085548] [DEBUG] [MAIN ] NC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:19.242698] [INFO ] [MAIN ] NC: Generated 1794 derivative records from 1998 primary records. [2025-10-22T22:12:19.251791] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-10-22T22:12:19.279684] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1794 records). [2025-10-22T22:12:19.282968] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-10-22T22:12:19.285295] [INFO ] [MAIN ] Derivative Progress: 1226/2052 symbols completed. NBXG took 1.3s. Estimated remaining: 5m 11s. Rate: 159.1 symbols/min [2025-10-22T22:12:19.285964] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:19.285873] [DEBUG] [LOCAL ] NC: Derivative data saved (1794 records). [2025-10-22T22:12:19.286172] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-10-22T22:12:19.289047] [INFO ] [MAIN ] Derivative Progress: 1227/2052 symbols completed. NC took 1.1s. Estimated remaining: 5m 11s. Rate: 159.2 symbols/min [2025-10-22T22:12:19.289997] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:19.315868] [DEBUG] [MAIN ] NCA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:19.317116] [INFO ] [MAIN ] NCA: Generated 1794 derivative records from 9773 primary records. [2025-10-22T22:12:19.323601] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-10-22T22:12:19.324736] [DEBUG] [LOCAL ] NCDL: Loaded 21597 existing records from primary storage. [2025-10-22T22:12:19.324975] [INFO ] [MAIN ] NCDL: Loaded 21597 primary data records. [2025-10-22T22:12:19.360188] [DEBUG] [LOCAL ] NCA: Derivative data saved (1794 records). [2025-10-22T22:12:19.371408] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-10-22T22:12:19.386259] [INFO ] [MAIN ] Derivative Progress: 1228/2052 symbols completed. NCA took 0.5s. Estimated remaining: 5m 10s. Rate: 159.3 symbols/min [2025-10-22T22:12:19.534597] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-10-22T22:12:19.535625] [INFO ] [MAIN ] NCLH: Loaded 53753 primary data records. [2025-10-22T22:12:19.989179] [DEBUG] [MAIN ] NCDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:19.989937] [INFO ] [MAIN ] NCDL: Generated 1794 derivative records from 21597 primary records. [2025-10-22T22:12:19.990279] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-10-22T22:12:20.007418] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1794 records). [2025-10-22T22:12:20.008303] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-10-22T22:12:20.010528] [INFO ] [MAIN ] Derivative Progress: 1229/2052 symbols completed. NCDL took 0.7s. Estimated remaining: 5m 10s. Rate: 159.3 symbols/min [2025-10-22T22:12:20.024904] [DEBUG] [MAIN ] NCLH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:20.025669] [INFO ] [MAIN ] NCLH: Generated 1794 derivative records from 53753 primary records. [2025-10-22T22:12:20.025737] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-10-22T22:12:20.042058] [DEBUG] [LOCAL ] NCLH: Derivative data saved (1794 records). [2025-10-22T22:12:20.042126] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-10-22T22:12:20.044553] [INFO ] [MAIN ] Derivative Progress: 1230/2052 symbols completed. NCLH took 0.8s. Estimated remaining: 5m 9s. Rate: 159.4 symbols/min [2025-10-22T22:12:20.045026] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:20.045138] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:20.044968] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:20.066270] [DEBUG] [LOCAL ] NCZ: Loaded 12268 existing records from primary storage. [2025-10-22T22:12:20.076606] [DEBUG] [LOCAL ] NCV: Loaded 13884 existing records from primary storage. [2025-10-22T22:12:20.076334] [INFO ] [MAIN ] NCZ: Loaded 12268 primary data records. [2025-10-22T22:12:20.076776] [INFO ] [MAIN ] NCV: Loaded 13884 primary data records. [2025-10-22T22:12:20.116630] [DEBUG] [LOCAL ] NDMO: Loaded 16956 existing records from primary storage. [2025-10-22T22:12:20.225599] [INFO ] [MAIN ] NDMO: Loaded 16956 primary data records. [2025-10-22T22:12:21.072920] [DEBUG] [MAIN ] NCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:21.075707] [INFO ] [MAIN ] NCV: Generated 1794 derivative records from 13884 primary records. [2025-10-22T22:12:21.075917] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-10-22T22:12:21.092553] [DEBUG] [MAIN ] NCZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:21.100624] [INFO ] [MAIN ] NCZ: Generated 1794 derivative records from 12268 primary records. [2025-10-22T22:12:21.104630] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-10-22T22:12:21.118197] [DEBUG] [MAIN ] NDMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:21.122994] [INFO ] [MAIN ] NDMO: Generated 1794 derivative records from 16956 primary records. [2025-10-22T22:12:21.130296] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-10-22T22:12:21.130423] [DEBUG] [LOCAL ] NCV: Derivative data saved (1794 records). [2025-10-22T22:12:21.132350] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-10-22T22:12:21.134470] [INFO ] [MAIN ] Derivative Progress: 1231/2052 symbols completed. NCV took 1.1s. Estimated remaining: 5m 10s. Rate: 159.1 symbols/min [2025-10-22T22:12:21.137989] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:21.153383] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1794 records). [2025-10-22T22:12:21.156202] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-10-22T22:12:21.158159] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1794 records). [2025-10-22T22:12:21.158258] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-10-22T22:12:21.160769] [INFO ] [MAIN ] Derivative Progress: 1232/2052 symbols completed. NDMO took 1.1s. Estimated remaining: 5m 9s. Rate: 159.3 symbols/min [2025-10-22T22:12:21.160969] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:21.164307] [INFO ] [MAIN ] Derivative Progress: 1233/2052 symbols completed. NCZ took 1.1s. Estimated remaining: 5m 8s. Rate: 159.4 symbols/min [2025-10-22T22:12:21.164619] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:21.222208] [DEBUG] [LOCAL ] NEA: Loaded 35122 existing records from primary storage. [2025-10-22T22:12:21.236167] [INFO ] [MAIN ] NEA: Loaded 35122 primary data records. [2025-10-22T22:12:21.258130] [DEBUG] [LOCAL ] NE: Loaded 52301 existing records from primary storage. [2025-10-22T22:12:21.281390] [INFO ] [MAIN ] NE: Loaded 52301 primary data records. [2025-10-22T22:12:21.368129] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-10-22T22:12:21.393069] [INFO ] [MAIN ] NEE: Loaded 53707 primary data records. [2025-10-22T22:12:22.225263] [DEBUG] [MAIN ] NEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:22.230620] [INFO ] [MAIN ] NEA: Generated 1794 derivative records from 35122 primary records. [2025-10-22T22:12:22.231062] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-10-22T22:12:22.233158] [DEBUG] [MAIN ] NE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:22.242625] [INFO ] [MAIN ] NE: Generated 1794 derivative records from 52301 primary records. [2025-10-22T22:12:22.243806] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-10-22T22:12:22.251376] [DEBUG] [LOCAL ] NEA: Derivative data saved (1794 records). [2025-10-22T22:12:22.271223] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-10-22T22:12:22.273783] [INFO ] [MAIN ] Derivative Progress: 1234/2052 symbols completed. NEA took 1.1s. Estimated remaining: 5m 8s. Rate: 159.1 symbols/min [2025-10-22T22:12:22.271541] [DEBUG] [MAIN ] NEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:22.275698] [INFO ] [MAIN ] NEE: Generated 1794 derivative records from 53707 primary records. [2025-10-22T22:12:22.279066] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-10-22T22:12:22.275811] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:22.282986] [DEBUG] [LOCAL ] NE: Derivative data saved (1794 records). [2025-10-22T22:12:22.283491] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-10-22T22:12:22.286874] [INFO ] [MAIN ] Derivative Progress: 1235/2052 symbols completed. NE took 1.1s. Estimated remaining: 5m 8s. Rate: 159.3 symbols/min [2025-10-22T22:12:22.287094] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:22.303435] [DEBUG] [LOCAL ] NEE: Derivative data saved (1794 records). [2025-10-22T22:12:22.303543] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-10-22T22:12:22.305924] [INFO ] [MAIN ] Derivative Progress: 1236/2052 symbols completed. NEE took 1.1s. Estimated remaining: 5m 7s. Rate: 159.4 symbols/min [2025-10-22T22:12:22.306136] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:22.322986] [DEBUG] [LOCAL ] NEU: Loaded 8614 existing records from primary storage. [2025-10-22T22:12:22.323205] [INFO ] [MAIN ] NEU: Loaded 8614 primary data records. [2025-10-22T22:12:22.656903] [DEBUG] [LOCAL ] NET: Loaded 52801 existing records from primary storage. [2025-10-22T22:12:22.670298] [INFO ] [MAIN ] NET: Loaded 52801 primary data records. [2025-10-22T22:12:22.670993] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-10-22T22:12:22.692210] [INFO ] [MAIN ] NEM: Loaded 53708 primary data records. [2025-10-22T22:12:23.335454] [DEBUG] [MAIN ] NEU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:23.337996] [INFO ] [MAIN ] NEU: Generated 1794 derivative records from 8614 primary records. [2025-10-22T22:12:23.338608] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-10-22T22:12:23.356081] [DEBUG] [LOCAL ] NEU: Derivative data saved (1794 records). [2025-10-22T22:12:23.356181] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-10-22T22:12:23.358583] [INFO ] [MAIN ] Derivative Progress: 1237/2052 symbols completed. NEU took 1.1s. Estimated remaining: 5m 7s. Rate: 159.1 symbols/min [2025-10-22T22:12:23.358988] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:23.371759] [DEBUG] [LOCAL ] NEXA: Loaded 5704 existing records from primary storage. [2025-10-22T22:12:23.371963] [INFO ] [MAIN ] NEXA: Loaded 5704 primary data records. [2025-10-22T22:12:23.412199] [DEBUG] [MAIN ] NET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:23.436848] [INFO ] [MAIN ] NET: Generated 1794 derivative records from 52801 primary records. [2025-10-22T22:12:23.479987] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-10-22T22:12:23.607715] [DEBUG] [LOCAL ] NET: Derivative data saved (1794 records). [2025-10-22T22:12:23.615310] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-10-22T22:12:23.738495] [DEBUG] [MAIN ] NEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:23.737423] [INFO ] [MAIN ] Derivative Progress: 1238/2052 symbols completed. NET took 1.5s. Estimated remaining: 5m 7s. Rate: 159.1 symbols/min [2025-10-22T22:12:23.738961] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:23.739918] [INFO ] [MAIN ] NEM: Generated 1794 derivative records from 53708 primary records. [2025-10-22T22:12:23.740906] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-10-22T22:12:23.759002] [DEBUG] [LOCAL ] NEM: Derivative data saved (1794 records). [2025-10-22T22:12:23.759246] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-10-22T22:12:23.762061] [INFO ] [MAIN ] Derivative Progress: 1239/2052 symbols completed. NEM took 1.5s. Estimated remaining: 5m 6s. Rate: 159.3 symbols/min [2025-10-22T22:12:23.762708] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:23.797545] [DEBUG] [MAIN ] NEXA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:23.798363] [INFO ] [MAIN ] NEXA: Generated 1794 derivative records from 5704 primary records. [2025-10-22T22:12:23.804194] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-10-22T22:12:23.805777] [DEBUG] [LOCAL ] NFJ: Loaded 19717 existing records from primary storage. [2025-10-22T22:12:23.806241] [INFO ] [MAIN ] NFJ: Loaded 19717 primary data records. [2025-10-22T22:12:23.863311] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1794 records). [2025-10-22T22:12:23.914596] [DEBUG] [LOCAL ] NFG: Loaded 38254 existing records from primary storage. [2025-10-22T22:12:23.896769] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-10-22T22:12:23.925703] [INFO ] [MAIN ] NFG: Loaded 38254 primary data records. [2025-10-22T22:12:23.935573] [INFO ] [MAIN ] Derivative Progress: 1240/2052 symbols completed. NEXA took 0.6s. Estimated remaining: 5m 6s. Rate: 159.3 symbols/min [2025-10-22T22:12:23.939290] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:24.484360] [DEBUG] [LOCAL ] NGG: Loaded 46767 existing records from primary storage. [2025-10-22T22:12:24.485700] [INFO ] [MAIN ] NGG: Loaded 46767 primary data records. [2025-10-22T22:12:24.606452] [DEBUG] [MAIN ] NFJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:24.611012] [INFO ] [MAIN ] NFJ: Generated 1794 derivative records from 19717 primary records. [2025-10-22T22:12:24.670194] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-10-22T22:12:24.881533] [DEBUG] [MAIN ] NFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:24.882746] [INFO ] [MAIN ] NFG: Generated 1794 derivative records from 38254 primary records. [2025-10-22T22:12:24.883576] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-10-22T22:12:24.881315] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1794 records). [2025-10-22T22:12:24.885279] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-10-22T22:12:24.895500] [INFO ] [MAIN ] Derivative Progress: 1241/2052 symbols completed. NFJ took 1.1s. Estimated remaining: 5m 6s. Rate: 159.1 symbols/min [2025-10-22T22:12:24.898634] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:24.902947] [DEBUG] [LOCAL ] NFG: Derivative data saved (1794 records). [2025-10-22T22:12:24.903906] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-10-22T22:12:24.906505] [INFO ] [MAIN ] Derivative Progress: 1242/2052 symbols completed. NFG took 1.2s. Estimated remaining: 5m 5s. Rate: 159.3 symbols/min [2025-10-22T22:12:24.906799] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:24.928281] [DEBUG] [LOCAL ] NGS: Loaded 10875 existing records from primary storage. [2025-10-22T22:12:24.929349] [INFO ] [MAIN ] NGS: Loaded 10875 primary data records. [2025-10-22T22:12:25.025031] [DEBUG] [LOCAL ] NGL: Loaded 29896 existing records from primary storage. [2025-10-22T22:12:25.051679] [INFO ] [MAIN ] NGL: Loaded 29896 primary data records. [2025-10-22T22:12:25.052097] [DEBUG] [MAIN ] NGG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:25.113711] [INFO ] [MAIN ] NGG: Generated 1794 derivative records from 46767 primary records. [2025-10-22T22:12:25.139367] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-10-22T22:12:25.468040] [DEBUG] [LOCAL ] NGG: Derivative data saved (1794 records). [2025-10-22T22:12:25.468209] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-10-22T22:12:25.470764] [INFO ] [MAIN ] Derivative Progress: 1243/2052 symbols completed. NGG took 1.5s. Estimated remaining: 5m 5s. Rate: 159.2 symbols/min [2025-10-22T22:12:25.610768] [DEBUG] [MAIN ] NGS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:12:25.611534] [INFO ] [MAIN ] NGS: Generated 1793 derivative records from 10875 primary records. [2025-10-22T22:12:25.611790] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-10-22T22:12:25.640916] [DEBUG] [LOCAL ] NGS: Derivative data saved (1793 records). [2025-10-22T22:12:25.641699] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-10-22T22:12:25.641558] [DEBUG] [MAIN ] NGL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:25.644314] [INFO ] [MAIN ] Derivative Progress: 1244/2052 symbols completed. NGS took 0.7s. Estimated remaining: 5m 4s. Rate: 159.3 symbols/min [2025-10-22T22:12:25.642419] [INFO ] [MAIN ] NGL: Generated 1794 derivative records from 29896 primary records. [2025-10-22T22:12:25.644572] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-10-22T22:12:25.659530] [DEBUG] [LOCAL ] NGL: Derivative data saved (1794 records). [2025-10-22T22:12:25.659684] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-10-22T22:12:25.662160] [INFO ] [MAIN ] Derivative Progress: 1245/2052 symbols completed. NGL took 0.8s. Estimated remaining: 5m 4s. Rate: 159.4 symbols/min [2025-10-22T22:12:25.662620] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:25.662805] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:25.662761] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:25.694908] [DEBUG] [LOCAL ] NHI: Loaded 21900 existing records from primary storage. [2025-10-22T22:12:25.695199] [INFO ] [MAIN ] NHI: Loaded 21900 primary data records. [2025-10-22T22:12:25.781340] [DEBUG] [LOCAL ] NGVC: Loaded 22759 existing records from primary storage. [2025-10-22T22:12:25.793498] [INFO ] [MAIN ] NGVC: Loaded 22759 primary data records. [2025-10-22T22:12:25.817051] [DEBUG] [LOCAL ] NGVT: Loaded 23771 existing records from primary storage. [2025-10-22T22:12:25.817239] [INFO ] [MAIN ] NGVT: Loaded 23771 primary data records. [2025-10-22T22:12:26.688485] [DEBUG] [MAIN ] NHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:26.689414] [INFO ] [MAIN ] NHI: Generated 1794 derivative records from 21900 primary records. [2025-10-22T22:12:26.690172] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-10-22T22:12:26.708392] [DEBUG] [LOCAL ] NHI: Derivative data saved (1794 records). [2025-10-22T22:12:26.708511] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-10-22T22:12:26.710668] [INFO ] [MAIN ] Derivative Progress: 1246/2052 symbols completed. NHI took 1.0s. Estimated remaining: 5m 4s. Rate: 159.2 symbols/min [2025-10-22T22:12:26.712453] [INFO ] [MAIN ] NI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:26.726993] [DEBUG] [MAIN ] NGVC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:26.727911] [INFO ] [MAIN ] NGVC: Generated 1794 derivative records from 22759 primary records. [2025-10-22T22:12:26.728253] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-10-22T22:12:26.762027] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1794 records). [2025-10-22T22:12:26.762496] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-10-22T22:12:26.765556] [INFO ] [MAIN ] Derivative Progress: 1247/2052 symbols completed. NGVC took 1.1s. Estimated remaining: 5m 3s. Rate: 159.3 symbols/min [2025-10-22T22:12:26.766438] [DEBUG] [MAIN ] NGVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:26.767629] [INFO ] [MAIN ] NGVT: Generated 1794 derivative records from 23771 primary records. [2025-10-22T22:12:26.766546] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:26.768259] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-10-22T22:12:26.811277] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1794 records). [2025-10-22T22:12:26.811498] [DEBUG] [LOCAL ] NIC: Loaded 8868 existing records from primary storage. [2025-10-22T22:12:26.811635] [INFO ] [MAIN ] NIC: Loaded 8868 primary data records. [2025-10-22T22:12:26.836968] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-10-22T22:12:26.862043] [INFO ] [MAIN ] Derivative Progress: 1248/2052 symbols completed. NGVT took 1.2s. Estimated remaining: 5m 3s. Rate: 159.4 symbols/min [2025-10-22T22:12:26.909121] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:26.915316] [DEBUG] [LOCAL ] NI: Loaded 53408 existing records from primary storage. [2025-10-22T22:12:26.937563] [INFO ] [MAIN ] NI: Loaded 53408 primary data records. [2025-10-22T22:12:27.125292] [DEBUG] [LOCAL ] NIE: Loaded 11724 existing records from primary storage. [2025-10-22T22:12:27.225245] [INFO ] [MAIN ] NIE: Loaded 11724 primary data records. [2025-10-22T22:12:27.765155] [DEBUG] [MAIN ] NIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:27.767019] [INFO ] [MAIN ] NIC: Generated 1794 derivative records from 8868 primary records. [2025-10-22T22:12:27.768110] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-10-22T22:12:27.796267] [DEBUG] [MAIN ] NI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:27.800684] [DEBUG] [LOCAL ] NIC: Derivative data saved (1794 records). [2025-10-22T22:12:27.801728] [INFO ] [MAIN ] NI: Generated 1794 derivative records from 53408 primary records. [2025-10-22T22:12:27.802078] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-10-22T22:12:27.801851] [DEBUG] [LOCAL ] NI: Saving derivative data. [2025-10-22T22:12:27.804255] [INFO ] [MAIN ] Derivative Progress: 1249/2052 symbols completed. NIC took 1.0s. Estimated remaining: 5m 3s. Rate: 159.2 symbols/min [2025-10-22T22:12:27.812929] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:27.821832] [DEBUG] [LOCAL ] NI: Derivative data saved (1794 records). [2025-10-22T22:12:27.822219] [INFO ] [MAIN ] NI: Successfully saved derivative data. [2025-10-22T22:12:27.824962] [INFO ] [MAIN ] Derivative Progress: 1250/2052 symbols completed. NI took 1.1s. Estimated remaining: 5m 2s. Rate: 159.3 symbols/min [2025-10-22T22:12:27.825218] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:27.829795] [DEBUG] [LOCAL ] NIM: Loaded 3526 existing records from primary storage. [2025-10-22T22:12:27.830155] [INFO ] [MAIN ] NIM: Loaded 3526 primary data records. [2025-10-22T22:12:27.972572] [DEBUG] [MAIN ] NIE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:27.984215] [INFO ] [MAIN ] NIE: Generated 1794 derivative records from 11724 primary records. [2025-10-22T22:12:28.021264] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-10-22T22:12:28.057069] [DEBUG] [LOCAL ] NINE: Loaded 28666 existing records from primary storage. [2025-10-22T22:12:28.061670] [INFO ] [MAIN ] NINE: Loaded 28666 primary data records. [2025-10-22T22:12:28.278617] [DEBUG] [LOCAL ] NIE: Derivative data saved (1794 records). [2025-10-22T22:12:28.290732] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-10-22T22:12:28.304628] [INFO ] [MAIN ] Derivative Progress: 1251/2052 symbols completed. NIE took 1.4s. Estimated remaining: 5m 2s. Rate: 159.3 symbols/min [2025-10-22T22:12:28.310867] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:28.523778] [DEBUG] [MAIN ] NIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:28.524687] [INFO ] [MAIN ] NIM: Generated 1794 derivative records from 3526 primary records. [2025-10-22T22:12:28.525083] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-10-22T22:12:28.539765] [DEBUG] [LOCAL ] NIM: Derivative data saved (1794 records). [2025-10-22T22:12:28.540077] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-10-22T22:12:28.542242] [INFO ] [MAIN ] Derivative Progress: 1252/2052 symbols completed. NIM took 0.7s. Estimated remaining: 5m 1s. Rate: 159.3 symbols/min [2025-10-22T22:12:28.555764] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:28.572281] [DEBUG] [MAIN ] NINE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:28.573048] [INFO ] [MAIN ] NINE: Generated 1794 derivative records from 28666 primary records. [2025-10-22T22:12:28.573116] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-10-22T22:12:28.604370] [DEBUG] [LOCAL ] NINE: Derivative data saved (1794 records). [2025-10-22T22:12:28.604679] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-10-22T22:12:28.606257] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-22T22:12:28.608892] [INFO ] [MAIN ] Derivative Progress: 1253/2052 symbols completed. NINE took 0.8s. Estimated remaining: 5m 1s. Rate: 159.4 symbols/min [2025-10-22T22:12:28.609186] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:28.609313] [INFO ] [MAIN ] NIO: Loaded 53802 primary data records. [2025-10-22T22:12:28.760304] [DEBUG] [LOCAL ] NJR: Loaded 37856 existing records from primary storage. [2025-10-22T22:12:28.765547] [INFO ] [MAIN ] NJR: Loaded 37856 primary data records. [2025-10-22T22:12:28.792672] [DEBUG] [LOCAL ] NKX: Loaded 13670 existing records from primary storage. [2025-10-22T22:12:28.820196] [INFO ] [MAIN ] NKX: Loaded 13670 primary data records. [2025-10-22T22:12:29.593301] [DEBUG] [MAIN ] NIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:29.595341] [INFO ] [MAIN ] NIO: Generated 1794 derivative records from 53802 primary records. [2025-10-22T22:12:29.595516] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-10-22T22:12:29.624334] [DEBUG] [LOCAL ] NIO: Derivative data saved (1794 records). [2025-10-22T22:12:29.624267] [DEBUG] [MAIN ] NJR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:29.625260] [INFO ] [MAIN ] NJR: Generated 1794 derivative records from 37856 primary records. [2025-10-22T22:12:29.625363] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-10-22T22:12:29.626198] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-10-22T22:12:29.628967] [INFO ] [MAIN ] Derivative Progress: 1254/2052 symbols completed. NIO took 1.3s. Estimated remaining: 5m 1s. Rate: 159.2 symbols/min [2025-10-22T22:12:29.630192] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:29.654765] [DEBUG] [MAIN ] NKX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:29.658936] [DEBUG] [LOCAL ] NJR: Derivative data saved (1794 records). [2025-10-22T22:12:29.659097] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-10-22T22:12:29.662495] [INFO ] [MAIN ] NKX: Generated 1794 derivative records from 13670 primary records. [2025-10-22T22:12:29.661724] [INFO ] [MAIN ] Derivative Progress: 1255/2052 symbols completed. NJR took 1.1s. Estimated remaining: 5m 0s. Rate: 159.3 symbols/min [2025-10-22T22:12:29.662801] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:29.665631] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-10-22T22:12:29.681179] [DEBUG] [LOCAL ] NKX: Derivative data saved (1794 records). [2025-10-22T22:12:29.681556] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-10-22T22:12:29.684113] [INFO ] [MAIN ] Derivative Progress: 1256/2052 symbols completed. NKX took 1.1s. Estimated remaining: 4m 60s. Rate: 159.4 symbols/min [2025-10-22T22:12:29.688683] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:29.689252] [DEBUG] [LOCAL ] NLOP: Loaded 11491 existing records from primary storage. [2025-10-22T22:12:29.689538] [INFO ] [MAIN ] NLOP: Loaded 11491 primary data records. [2025-10-22T22:12:29.868441] [DEBUG] [LOCAL ] NMAI: Loaded 12567 existing records from primary storage. [2025-10-22T22:12:29.891953] [INFO ] [MAIN ] NMAI: Loaded 12567 primary data records. [2025-10-22T22:12:30.130383] [DEBUG] [LOCAL ] NLY: Loaded 53564 existing records from primary storage. [2025-10-22T22:12:30.135119] [INFO ] [MAIN ] NLY: Loaded 53564 primary data records. [2025-10-22T22:12:30.765073] [DEBUG] [MAIN ] NLOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:30.766869] [INFO ] [MAIN ] NLOP: Generated 1794 derivative records from 11491 primary records. [2025-10-22T22:12:30.767545] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-10-22T22:12:30.788306] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1794 records). [2025-10-22T22:12:30.790304] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-10-22T22:12:30.793193] [INFO ] [MAIN ] Derivative Progress: 1257/2052 symbols completed. NLOP took 1.2s. Estimated remaining: 4m 60s. Rate: 159.2 symbols/min [2025-10-22T22:12:30.793416] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:30.808194] [DEBUG] [MAIN ] NMAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:30.809035] [INFO ] [MAIN ] NMAI: Generated 1794 derivative records from 12567 primary records. [2025-10-22T22:12:30.809294] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-10-22T22:12:30.825660] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1794 records). [2025-10-22T22:12:30.825913] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-10-22T22:12:30.833510] [INFO ] [MAIN ] Derivative Progress: 1258/2052 symbols completed. NMAI took 1.1s. Estimated remaining: 4m 59s. Rate: 159.3 symbols/min [2025-10-22T22:12:30.849272] [DEBUG] [MAIN ] NLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:30.855775] [INFO ] [MAIN ] NLY: Generated 1794 derivative records from 53564 primary records. [2025-10-22T22:12:30.856576] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-10-22T22:12:30.857078] [DEBUG] [LOCAL ] NMCO: Loaded 16631 existing records from primary storage. [2025-10-22T22:12:30.857934] [INFO ] [MAIN ] NMCO: Loaded 16631 primary data records. [2025-10-22T22:12:30.956839] [DEBUG] [LOCAL ] NLY: Derivative data saved (1794 records). [2025-10-22T22:12:30.976068] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-10-22T22:12:30.981277] [INFO ] [MAIN ] Derivative Progress: 1259/2052 symbols completed. NLY took 1.3s. Estimated remaining: 4m 59s. Rate: 159.4 symbols/min [2025-10-22T22:12:31.191396] [DEBUG] [MAIN ] NMCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:31.192057] [INFO ] [MAIN ] NMCO: Generated 1794 derivative records from 16631 primary records. [2025-10-22T22:12:31.192119] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-10-22T22:12:31.206846] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1794 records). [2025-10-22T22:12:31.206909] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-10-22T22:12:31.209216] [INFO ] [MAIN ] Derivative Progress: 1260/2052 symbols completed. NMCO took 0.4s. Estimated remaining: 4m 58s. Rate: 159.4 symbols/min [2025-10-22T22:12:31.209963] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:31.210258] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:31.209845] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:31.221069] [DEBUG] [LOCAL ] NMI: Loaded 4049 existing records from primary storage. [2025-10-22T22:12:31.225200] [INFO ] [MAIN ] NMI: Loaded 4049 primary data records. [2025-10-22T22:12:31.274554] [DEBUG] [LOCAL ] NMG: Loaded 12064 existing records from primary storage. [2025-10-22T22:12:31.300383] [INFO ] [MAIN ] NMG: Loaded 12064 primary data records. [2025-10-22T22:12:31.323064] [DEBUG] [LOCAL ] NMM: Loaded 14137 existing records from primary storage. [2025-10-22T22:12:31.396616] [INFO ] [MAIN ] NMM: Loaded 14137 primary data records. [2025-10-22T22:12:32.210035] [DEBUG] [MAIN ] NMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:32.229860] [DEBUG] [MAIN ] NMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:32.228890] [INFO ] [MAIN ] NMI: Generated 1794 derivative records from 4049 primary records. [2025-10-22T22:12:32.230345] [DEBUG] [MAIN ] NMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:32.231359] [INFO ] [MAIN ] NMG: Generated 1794 derivative records from 12064 primary records. [2025-10-22T22:12:32.232462] [INFO ] [MAIN ] NMM: Generated 1794 derivative records from 14137 primary records. [2025-10-22T22:12:32.232630] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-10-22T22:12:32.232803] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-10-22T22:12:32.232353] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-10-22T22:12:32.279874] [DEBUG] [LOCAL ] NMI: Derivative data saved (1794 records). [2025-10-22T22:12:32.277690] [DEBUG] [LOCAL ] NMG: Derivative data saved (1794 records). [2025-10-22T22:12:32.285163] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-10-22T22:12:32.280060] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-10-22T22:12:32.293846] [DEBUG] [LOCAL ] NMM: Derivative data saved (1794 records). [2025-10-22T22:12:32.297237] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-10-22T22:12:32.288196] [INFO ] [MAIN ] Derivative Progress: 1261/2052 symbols completed. NMI took 1.1s. Estimated remaining: 4m 58s. Rate: 159.2 symbols/min [2025-10-22T22:12:32.300605] [INFO ] [MAIN ] Derivative Progress: 1262/2052 symbols completed. NMG took 1.1s. Estimated remaining: 4m 58s. Rate: 159.3 symbols/min [2025-10-22T22:12:32.300418] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:32.301315] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:32.301948] [INFO ] [MAIN ] Derivative Progress: 1263/2052 symbols completed. NMM took 1.1s. Estimated remaining: 4m 57s. Rate: 159.4 symbols/min [2025-10-22T22:12:32.302095] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:32.309285] [DEBUG] [LOCAL ] NMS: Loaded 2889 existing records from primary storage. [2025-10-22T22:12:32.309788] [INFO ] [MAIN ] NMS: Loaded 2889 primary data records. [2025-10-22T22:12:32.377358] [DEBUG] [LOCAL ] NMT: Loaded 2811 existing records from primary storage. [2025-10-22T22:12:32.389299] [INFO ] [MAIN ] NMT: Loaded 2811 primary data records. [2025-10-22T22:12:32.636632] [DEBUG] [LOCAL ] NMR: Loaded 35454 existing records from primary storage. [2025-10-22T22:12:32.644072] [INFO ] [MAIN ] NMR: Loaded 35454 primary data records. [2025-10-22T22:12:33.310625] [DEBUG] [MAIN ] NMS: Filtered 6931 bins outside market hours, 7727 incomplete bins [2025-10-22T22:12:33.311813] [INFO ] [MAIN ] NMS: Generated 1791 derivative records from 2889 primary records. [2025-10-22T22:12:33.312103] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-10-22T22:12:33.327442] [DEBUG] [LOCAL ] NMS: Derivative data saved (1791 records). [2025-10-22T22:12:33.327545] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-10-22T22:12:33.330227] [INFO ] [MAIN ] Derivative Progress: 1264/2052 symbols completed. NMS took 1.0s. Estimated remaining: 4m 57s. Rate: 159.2 symbols/min [2025-10-22T22:12:33.330443] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:33.351092] [DEBUG] [MAIN ] NMT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:12:33.365780] [INFO ] [MAIN ] NMT: Generated 1793 derivative records from 2811 primary records. [2025-10-22T22:12:33.366292] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-10-22T22:12:33.366805] [DEBUG] [MAIN ] NMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:33.375065] [INFO ] [MAIN ] NMR: Generated 1794 derivative records from 35454 primary records. [2025-10-22T22:12:33.375395] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-10-22T22:12:33.410194] [DEBUG] [LOCAL ] NMZ: Loaded 21383 existing records from primary storage. [2025-10-22T22:12:33.410342] [DEBUG] [LOCAL ] NMT: Derivative data saved (1793 records). [2025-10-22T22:12:33.415571] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-10-22T22:12:33.423131] [INFO ] [MAIN ] NMZ: Loaded 21383 primary data records. [2025-10-22T22:12:33.422950] [INFO ] [MAIN ] Derivative Progress: 1265/2052 symbols completed. NMT took 1.1s. Estimated remaining: 4m 56s. Rate: 159.3 symbols/min [2025-10-22T22:12:33.429385] [DEBUG] [LOCAL ] NMR: Derivative data saved (1794 records). [2025-10-22T22:12:33.445911] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:33.476665] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-10-22T22:12:33.527700] [INFO ] [MAIN ] Derivative Progress: 1266/2052 symbols completed. NMR took 1.2s. Estimated remaining: 4m 56s. Rate: 159.4 symbols/min [2025-10-22T22:12:33.552107] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:33.624677] [DEBUG] [LOCAL ] NNI: Loaded 10508 existing records from primary storage. [2025-10-22T22:12:33.779184] [INFO ] [MAIN ] NNI: Loaded 10508 primary data records. [2025-10-22T22:12:34.042366] [DEBUG] [LOCAL ] NNN: Loaded 48165 existing records from primary storage. [2025-10-22T22:12:34.070006] [INFO ] [MAIN ] NNN: Loaded 48165 primary data records. [2025-10-22T22:12:34.644163] [DEBUG] [MAIN ] NMZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:34.660782] [INFO ] [MAIN ] NMZ: Generated 1794 derivative records from 21383 primary records. [2025-10-22T22:12:34.661085] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-10-22T22:12:34.680812] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1794 records). [2025-10-22T22:12:34.681395] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-10-22T22:12:34.683997] [INFO ] [MAIN ] Derivative Progress: 1267/2052 symbols completed. NMZ took 1.4s. Estimated remaining: 4m 56s. Rate: 159.1 symbols/min [2025-10-22T22:12:34.685510] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:34.698725] [DEBUG] [LOCAL ] NNY: Loaded 5674 existing records from primary storage. [2025-10-22T22:12:34.698908] [INFO ] [MAIN ] NNY: Loaded 5674 primary data records. [2025-10-22T22:12:34.754949] [DEBUG] [MAIN ] NNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:34.784136] [INFO ] [MAIN ] NNI: Generated 1794 derivative records from 10508 primary records. [2025-10-22T22:12:34.806750] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-10-22T22:12:34.856838] [DEBUG] [LOCAL ] NNI: Derivative data saved (1794 records). [2025-10-22T22:12:34.863194] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-10-22T22:12:34.894378] [INFO ] [MAIN ] Derivative Progress: 1268/2052 symbols completed. NNI took 1.4s. Estimated remaining: 4m 55s. Rate: 159.2 symbols/min [2025-10-22T22:12:34.920515] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:34.997083] [DEBUG] [MAIN ] NNN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:35.097242] [INFO ] [MAIN ] NNN: Generated 1794 derivative records from 48165 primary records. [2025-10-22T22:12:35.097517] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-10-22T22:12:35.119685] [DEBUG] [LOCAL ] NNN: Derivative data saved (1794 records). [2025-10-22T22:12:35.120259] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-10-22T22:12:35.124124] [INFO ] [MAIN ] Derivative Progress: 1269/2052 symbols completed. NNN took 1.6s. Estimated remaining: 4m 55s. Rate: 159.2 symbols/min [2025-10-22T22:12:35.124881] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:35.131716] [DEBUG] [LOCAL ] NOA: Loaded 15736 existing records from primary storage. [2025-10-22T22:12:35.132762] [INFO ] [MAIN ] NOA: Loaded 15736 primary data records. [2025-10-22T22:12:35.287205] [DEBUG] [LOCAL ] NOAH: Loaded 19844 existing records from primary storage. [2025-10-22T22:12:35.292598] [INFO ] [MAIN ] NOAH: Loaded 19844 primary data records. [2025-10-22T22:12:35.380393] [DEBUG] [MAIN ] NNY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:35.502968] [INFO ] [MAIN ] NNY: Generated 1794 derivative records from 5674 primary records. [2025-10-22T22:12:35.538895] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-10-22T22:12:35.621594] [DEBUG] [LOCAL ] NNY: Derivative data saved (1794 records). [2025-10-22T22:12:35.627059] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-10-22T22:12:35.651252] [INFO ] [MAIN ] Derivative Progress: 1270/2052 symbols completed. NNY took 1.0s. Estimated remaining: 4m 55s. Rate: 159.2 symbols/min [2025-10-22T22:12:35.680608] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:35.820920] [DEBUG] [MAIN ] NOA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:35.831691] [INFO ] [MAIN ] NOA: Generated 1794 derivative records from 15736 primary records. [2025-10-22T22:12:35.832028] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-10-22T22:12:35.847961] [DEBUG] [LOCAL ] NOA: Derivative data saved (1794 records). [2025-10-22T22:12:35.848833] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-10-22T22:12:35.852261] [INFO ] [MAIN ] Derivative Progress: 1271/2052 symbols completed. NOA took 0.9s. Estimated remaining: 4m 54s. Rate: 159.3 symbols/min [2025-10-22T22:12:35.864762] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:35.879208] [DEBUG] [LOCAL ] NOC: Loaded 41598 existing records from primary storage. [2025-10-22T22:12:35.879415] [INFO ] [MAIN ] NOC: Loaded 41598 primary data records. [2025-10-22T22:12:35.885568] [DEBUG] [MAIN ] NOAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:35.913608] [INFO ] [MAIN ] NOAH: Generated 1794 derivative records from 19844 primary records. [2025-10-22T22:12:35.931668] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-10-22T22:12:36.011115] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1794 records). [2025-10-22T22:12:36.022296] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-10-22T22:12:36.024556] [INFO ] [MAIN ] Derivative Progress: 1272/2052 symbols completed. NOAH took 0.9s. Estimated remaining: 4m 54s. Rate: 159.3 symbols/min [2025-10-22T22:12:36.035011] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:36.233191] [DEBUG] [LOCAL ] NOG: Loaded 51348 existing records from primary storage. [2025-10-22T22:12:36.233948] [INFO ] [MAIN ] NOG: Loaded 51348 primary data records. [2025-10-22T22:12:36.568346] [DEBUG] [LOCAL ] NOK: Loaded 53622 existing records from primary storage. [2025-10-22T22:12:36.570663] [INFO ] [MAIN ] NOK: Loaded 53622 primary data records. [2025-10-22T22:12:36.649843] [DEBUG] [MAIN ] NOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:36.665069] [INFO ] [MAIN ] NOC: Generated 1794 derivative records from 41598 primary records. [2025-10-22T22:12:36.665237] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-10-22T22:12:36.736329] [DEBUG] [LOCAL ] NOC: Derivative data saved (1794 records). [2025-10-22T22:12:36.741769] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-10-22T22:12:36.785319] [INFO ] [MAIN ] Derivative Progress: 1273/2052 symbols completed. NOC took 1.1s. Estimated remaining: 4m 54s. Rate: 159.2 symbols/min [2025-10-22T22:12:36.985316] [DEBUG] [MAIN ] NOG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:36.986499] [INFO ] [MAIN ] NOG: Generated 1794 derivative records from 51348 primary records. [2025-10-22T22:12:36.986593] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-10-22T22:12:37.006805] [DEBUG] [LOCAL ] NOG: Derivative data saved (1794 records). [2025-10-22T22:12:37.007106] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-10-22T22:12:37.011598] [INFO ] [MAIN ] Derivative Progress: 1274/2052 symbols completed. NOG took 1.1s. Estimated remaining: 4m 53s. Rate: 159.2 symbols/min [2025-10-22T22:12:37.031194] [DEBUG] [MAIN ] NOK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:37.031952] [INFO ] [MAIN ] NOK: Generated 1794 derivative records from 53622 primary records. [2025-10-22T22:12:37.032019] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-10-22T22:12:37.047903] [DEBUG] [LOCAL ] NOK: Derivative data saved (1794 records). [2025-10-22T22:12:37.047974] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-10-22T22:12:37.050304] [INFO ] [MAIN ] Derivative Progress: 1275/2052 symbols completed. NOK took 1.0s. Estimated remaining: 4m 53s. Rate: 159.4 symbols/min [2025-10-22T22:12:37.050871] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:37.051096] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:37.051767] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:37.128518] [DEBUG] [LOCAL ] NOTE: Loaded 39580 existing records from primary storage. [2025-10-22T22:12:37.129387] [DEBUG] [LOCAL ] NOMD: Loaded 43199 existing records from primary storage. [2025-10-22T22:12:37.129829] [INFO ] [MAIN ] NOTE: Loaded 39580 primary data records. [2025-10-22T22:12:37.130285] [INFO ] [MAIN ] NOMD: Loaded 43199 primary data records. [2025-10-22T22:12:37.216717] [DEBUG] [LOCAL ] NOV: Loaded 53163 existing records from primary storage. [2025-10-22T22:12:37.265499] [INFO ] [MAIN ] NOV: Loaded 53163 primary data records. [2025-10-22T22:12:38.184036] [DEBUG] [MAIN ] NOMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:38.184582] [DEBUG] [MAIN ] NOTE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:12:38.185784] [INFO ] [MAIN ] NOMD: Generated 1794 derivative records from 43199 primary records. [2025-10-22T22:12:38.186821] [INFO ] [MAIN ] NOTE: Generated 1793 derivative records from 39580 primary records. [2025-10-22T22:12:38.186924] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-10-22T22:12:38.187178] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-10-22T22:12:38.220589] [DEBUG] [MAIN ] NOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:38.231118] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1794 records). [2025-10-22T22:12:38.236779] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-10-22T22:12:38.235588] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1793 records). [2025-10-22T22:12:38.236525] [INFO ] [MAIN ] NOV: Generated 1794 derivative records from 53163 primary records. [2025-10-22T22:12:38.239567] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-10-22T22:12:38.239752] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-10-22T22:12:38.239356] [INFO ] [MAIN ] Derivative Progress: 1276/2052 symbols completed. NOMD took 1.2s. Estimated remaining: 4m 53s. Rate: 159.1 symbols/min [2025-10-22T22:12:38.253696] [INFO ] [MAIN ] Derivative Progress: 1277/2052 symbols completed. NOTE took 1.2s. Estimated remaining: 4m 52s. Rate: 159.2 symbols/min [2025-10-22T22:12:38.245739] [INFO ] [MAIN ] NOW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:38.258473] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:38.263173] [DEBUG] [LOCAL ] NOV: Derivative data saved (1794 records). [2025-10-22T22:12:38.263770] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-10-22T22:12:38.267007] [INFO ] [MAIN ] Derivative Progress: 1278/2052 symbols completed. NOV took 1.2s. Estimated remaining: 4m 51s. Rate: 159.3 symbols/min [2025-10-22T22:12:38.267930] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:38.288053] [DEBUG] [LOCAL ] NPFD: Loaded 9999 existing records from primary storage. [2025-10-22T22:12:38.288264] [INFO ] [MAIN ] NPFD: Loaded 9999 primary data records. [2025-10-22T22:12:38.349827] [DEBUG] [LOCAL ] NPCT: Loaded 16365 existing records from primary storage. [2025-10-22T22:12:38.359726] [INFO ] [MAIN ] NPCT: Loaded 16365 primary data records. [2025-10-22T22:12:38.582974] [DEBUG] [LOCAL ] NOW: Loaded 47850 existing records from primary storage. [2025-10-22T22:12:38.649442] [INFO ] [MAIN ] NOW: Loaded 47850 primary data records. [2025-10-22T22:12:39.483199] [DEBUG] [MAIN ] NPFD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:39.485284] [INFO ] [MAIN ] NPFD: Generated 1794 derivative records from 9999 primary records. [2025-10-22T22:12:39.485506] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-10-22T22:12:39.503560] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1794 records). [2025-10-22T22:12:39.505465] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-10-22T22:12:39.508215] [INFO ] [MAIN ] Derivative Progress: 1279/2052 symbols completed. NPFD took 1.2s. Estimated remaining: 4m 52s. Rate: 159.0 symbols/min [2025-10-22T22:12:39.508443] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:39.540561] [DEBUG] [MAIN ] NPCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:39.547315] [INFO ] [MAIN ] NPCT: Generated 1794 derivative records from 16365 primary records. [2025-10-22T22:12:39.548265] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-10-22T22:12:39.547808] [DEBUG] [MAIN ] NOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:39.552974] [DEBUG] [LOCAL ] NPK: Loaded 8371 existing records from primary storage. [2025-10-22T22:12:39.554336] [INFO ] [MAIN ] NOW: Generated 1794 derivative records from 47850 primary records. [2025-10-22T22:12:39.554939] [INFO ] [MAIN ] NPK: Loaded 8371 primary data records. [2025-10-22T22:12:39.555112] [DEBUG] [LOCAL ] NOW: Saving derivative data. [2025-10-22T22:12:39.605109] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1794 records). [2025-10-22T22:12:39.619146] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-10-22T22:12:39.622822] [INFO ] [MAIN ] Derivative Progress: 1280/2052 symbols completed. NPCT took 1.4s. Estimated remaining: 4m 51s. Rate: 159.1 symbols/min [2025-10-22T22:12:39.641488] [INFO ] [MAIN ] NPKI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:39.653251] [DEBUG] [LOCAL ] NOW: Derivative data saved (1794 records). [2025-10-22T22:12:39.683558] [INFO ] [MAIN ] NOW: Successfully saved derivative data. [2025-10-22T22:12:39.710292] [INFO ] [MAIN ] Derivative Progress: 1281/2052 symbols completed. NOW took 1.5s. Estimated remaining: 4m 51s. Rate: 159.2 symbols/min [2025-10-22T22:12:39.710905] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:39.922558] [DEBUG] [LOCAL ] NPO: Loaded 13496 existing records from primary storage. [2025-10-22T22:12:39.922750] [INFO ] [MAIN ] NPO: Loaded 13496 primary data records. [2025-10-22T22:12:40.099452] [DEBUG] [LOCAL ] NPKI: Loaded 40429 existing records from primary storage. [2025-10-22T22:12:40.121697] [INFO ] [MAIN ] NPKI: Loaded 40429 primary data records. [2025-10-22T22:12:40.613471] [DEBUG] [MAIN ] NPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:40.617210] [INFO ] [MAIN ] NPK: Generated 1794 derivative records from 8371 primary records. [2025-10-22T22:12:40.617819] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-10-22T22:12:40.643557] [DEBUG] [LOCAL ] NPK: Derivative data saved (1794 records). [2025-10-22T22:12:40.644820] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-10-22T22:12:40.647742] [INFO ] [MAIN ] Derivative Progress: 1282/2052 symbols completed. NPK took 1.1s. Estimated remaining: 4m 50s. Rate: 159.0 symbols/min [2025-10-22T22:12:40.648321] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:40.671792] [DEBUG] [LOCAL ] NPV: Loaded 5380 existing records from primary storage. [2025-10-22T22:12:40.672570] [DEBUG] [MAIN ] NPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:40.672842] [INFO ] [MAIN ] NPV: Loaded 5380 primary data records. [2025-10-22T22:12:40.673978] [INFO ] [MAIN ] NPO: Generated 1794 derivative records from 13496 primary records. [2025-10-22T22:12:40.697130] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-10-22T22:12:40.777999] [DEBUG] [MAIN ] NPKI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:40.799766] [INFO ] [MAIN ] NPKI: Generated 1794 derivative records from 40429 primary records. [2025-10-22T22:12:40.800154] [DEBUG] [LOCAL ] NPKI: Saving derivative data. [2025-10-22T22:12:40.851916] [DEBUG] [LOCAL ] NPO: Derivative data saved (1794 records). [2025-10-22T22:12:40.873092] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-10-22T22:12:40.883002] [DEBUG] [LOCAL ] NPKI: Derivative data saved (1794 records). [2025-10-22T22:12:40.896222] [INFO ] [MAIN ] Derivative Progress: 1283/2052 symbols completed. NPO took 1.2s. Estimated remaining: 4m 50s. Rate: 159.1 symbols/min [2025-10-22T22:12:40.911844] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:40.911706] [INFO ] [MAIN ] NPKI: Successfully saved derivative data. [2025-10-22T22:12:40.920189] [INFO ] [MAIN ] Derivative Progress: 1284/2052 symbols completed. NPKI took 1.3s. Estimated remaining: 4m 49s. Rate: 159.2 symbols/min [2025-10-22T22:12:40.920510] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:41.049436] [DEBUG] [LOCAL ] NQP: Loaded 9070 existing records from primary storage. [2025-10-22T22:12:41.051407] [INFO ] [MAIN ] NQP: Loaded 9070 primary data records. [2025-10-22T22:12:41.270102] [DEBUG] [LOCAL ] NPWR: Loaded 43444 existing records from primary storage. [2025-10-22T22:12:41.367888] [INFO ] [MAIN ] NPWR: Loaded 43444 primary data records. [2025-10-22T22:12:41.554354] [DEBUG] [MAIN ] NPV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:12:41.577173] [INFO ] [MAIN ] NPV: Generated 1793 derivative records from 5380 primary records. [2025-10-22T22:12:41.607303] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-10-22T22:12:41.782143] [DEBUG] [LOCAL ] NPV: Derivative data saved (1793 records). [2025-10-22T22:12:41.782713] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-10-22T22:12:41.784696] [INFO ] [MAIN ] Derivative Progress: 1285/2052 symbols completed. NPV took 1.1s. Estimated remaining: 4m 49s. Rate: 159.0 symbols/min [2025-10-22T22:12:41.784960] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:41.810377] [DEBUG] [MAIN ] NQP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:41.811438] [INFO ] [MAIN ] NQP: Generated 1794 derivative records from 9070 primary records. [2025-10-22T22:12:41.811912] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-10-22T22:12:41.842855] [DEBUG] [LOCAL ] NQP: Derivative data saved (1794 records). [2025-10-22T22:12:41.843375] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-10-22T22:12:41.845911] [INFO ] [MAIN ] Derivative Progress: 1286/2052 symbols completed. NQP took 0.9s. Estimated remaining: 4m 49s. Rate: 159.1 symbols/min [2025-10-22T22:12:41.846221] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:41.859904] [DEBUG] [MAIN ] NPWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:41.860728] [INFO ] [MAIN ] NPWR: Generated 1794 derivative records from 43444 primary records. [2025-10-22T22:12:41.861019] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-10-22T22:12:41.888558] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1794 records). [2025-10-22T22:12:41.888807] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-10-22T22:12:41.891546] [INFO ] [MAIN ] Derivative Progress: 1287/2052 symbols completed. NPWR took 1.0s. Estimated remaining: 4m 48s. Rate: 159.3 symbols/min [2025-10-22T22:12:41.892457] [INFO ] [MAIN ] NRG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:41.892277] [DEBUG] [LOCAL ] NRDY: Loaded 32164 existing records from primary storage. [2025-10-22T22:12:41.893098] [INFO ] [MAIN ] NRDY: Loaded 32164 primary data records. [2025-10-22T22:12:41.917885] [DEBUG] [LOCAL ] NREF: Loaded 7815 existing records from primary storage. [2025-10-22T22:12:41.952290] [INFO ] [MAIN ] NREF: Loaded 7815 primary data records. [2025-10-22T22:12:42.567130] [DEBUG] [LOCAL ] NRG: Loaded 52825 existing records from primary storage. [2025-10-22T22:12:42.567777] [INFO ] [MAIN ] NRG: Loaded 52825 primary data records. [2025-10-22T22:12:42.928808] [DEBUG] [MAIN ] NREF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:42.929984] [INFO ] [MAIN ] NREF: Generated 1794 derivative records from 7815 primary records. [2025-10-22T22:12:42.930281] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-10-22T22:12:42.944084] [DEBUG] [MAIN ] NRDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:42.952193] [INFO ] [MAIN ] NRDY: Generated 1794 derivative records from 32164 primary records. [2025-10-22T22:12:42.961325] [DEBUG] [LOCAL ] NREF: Derivative data saved (1794 records). [2025-10-22T22:12:42.957045] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-10-22T22:12:42.961857] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-10-22T22:12:42.964606] [INFO ] [MAIN ] Derivative Progress: 1288/2052 symbols completed. NREF took 1.1s. Estimated remaining: 4m 48s. Rate: 159.0 symbols/min [2025-10-22T22:12:42.981457] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1794 records). [2025-10-22T22:12:42.981597] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-10-22T22:12:42.984035] [INFO ] [MAIN ] Derivative Progress: 1289/2052 symbols completed. NRDY took 1.2s. Estimated remaining: 4m 48s. Rate: 159.1 symbols/min [2025-10-22T22:12:43.000410] [DEBUG] [MAIN ] NRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:43.000990] [INFO ] [MAIN ] NRG: Generated 1794 derivative records from 52825 primary records. [2025-10-22T22:12:43.001093] [DEBUG] [LOCAL ] NRG: Saving derivative data. [2025-10-22T22:12:43.016773] [DEBUG] [LOCAL ] NRG: Derivative data saved (1794 records). [2025-10-22T22:12:43.016846] [INFO ] [MAIN ] NRG: Successfully saved derivative data. [2025-10-22T22:12:43.019418] [INFO ] [MAIN ] Derivative Progress: 1290/2052 symbols completed. NRG took 1.1s. Estimated remaining: 4m 47s. Rate: 159.3 symbols/min [2025-10-22T22:12:43.019870] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:43.019993] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:43.020078] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:43.028400] [DEBUG] [LOCAL ] NRP: Loaded 4126 existing records from primary storage. [2025-10-22T22:12:43.028734] [INFO ] [MAIN ] NRP: Loaded 4126 primary data records. [2025-10-22T22:12:43.145126] [DEBUG] [LOCAL ] NRK: Loaded 20423 existing records from primary storage. [2025-10-22T22:12:43.145275] [INFO ] [MAIN ] NRK: Loaded 20423 primary data records. [2025-10-22T22:12:43.588598] [DEBUG] [LOCAL ] NRGV: Loaded 43940 existing records from primary storage. [2025-10-22T22:12:43.589019] [INFO ] [MAIN ] NRGV: Loaded 43940 primary data records. [2025-10-22T22:12:44.025224] [DEBUG] [MAIN ] NRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:44.026829] [INFO ] [MAIN ] NRP: Generated 1794 derivative records from 4126 primary records. [2025-10-22T22:12:44.027048] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-10-22T22:12:44.044745] [DEBUG] [LOCAL ] NRP: Derivative data saved (1794 records). [2025-10-22T22:12:44.045691] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-10-22T22:12:44.048044] [INFO ] [MAIN ] Derivative Progress: 1291/2052 symbols completed. NRP took 1.0s. Estimated remaining: 4m 47s. Rate: 159.0 symbols/min [2025-10-22T22:12:44.048326] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:44.062541] [DEBUG] [MAIN ] NRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:44.063351] [INFO ] [MAIN ] NRK: Generated 1794 derivative records from 20423 primary records. [2025-10-22T22:12:44.064798] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-10-22T22:12:44.081282] [DEBUG] [LOCAL ] NRK: Derivative data saved (1794 records). [2025-10-22T22:12:44.084456] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-10-22T22:12:44.084357] [DEBUG] [LOCAL ] NRT: Loaded 4872 existing records from primary storage. [2025-10-22T22:12:44.087327] [INFO ] [MAIN ] Derivative Progress: 1292/2052 symbols completed. NRK took 1.1s. Estimated remaining: 4m 47s. Rate: 159.1 symbols/min [2025-10-22T22:12:44.087939] [INFO ] [MAIN ] NRT: Loaded 4872 primary data records. [2025-10-22T22:12:44.087816] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:44.183045] [DEBUG] [LOCAL ] NRUC: Loaded 3098 existing records from primary storage. [2025-10-22T22:12:44.197811] [INFO ] [MAIN ] NRUC: Loaded 3098 primary data records. [2025-10-22T22:12:44.245365] [DEBUG] [MAIN ] NRGV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:44.251810] [INFO ] [MAIN ] NRGV: Generated 1794 derivative records from 43940 primary records. [2025-10-22T22:12:44.312509] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-10-22T22:12:44.546676] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1794 records). [2025-10-22T22:12:44.566220] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-10-22T22:12:44.603788] [INFO ] [MAIN ] Derivative Progress: 1293/2052 symbols completed. NRGV took 1.6s. Estimated remaining: 4m 46s. Rate: 159.1 symbols/min [2025-10-22T22:12:44.727819] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:44.755866] [DEBUG] [MAIN ] NRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:44.756833] [INFO ] [MAIN ] NRT: Generated 1794 derivative records from 4872 primary records. [2025-10-22T22:12:44.757897] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-10-22T22:12:44.796063] [DEBUG] [MAIN ] NRUC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:44.798828] [DEBUG] [LOCAL ] NRT: Derivative data saved (1794 records). [2025-10-22T22:12:44.798998] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-10-22T22:12:44.797947] [INFO ] [MAIN ] NRUC: Generated 1794 derivative records from 3098 primary records. [2025-10-22T22:12:44.801468] [INFO ] [MAIN ] Derivative Progress: 1294/2052 symbols completed. NRT took 0.8s. Estimated remaining: 4m 46s. Rate: 159.2 symbols/min [2025-10-22T22:12:44.801694] [INFO ] [MAIN ] NSC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:44.799187] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-10-22T22:12:44.815926] [DEBUG] [LOCAL ] NSA: Loaded 45071 existing records from primary storage. [2025-10-22T22:12:44.822239] [INFO ] [MAIN ] NSA: Loaded 45071 primary data records. [2025-10-22T22:12:44.934171] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1794 records). [2025-10-22T22:12:44.939739] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-10-22T22:12:44.952975] [INFO ] [MAIN ] Derivative Progress: 1295/2052 symbols completed. NRUC took 0.9s. Estimated remaining: 4m 45s. Rate: 159.2 symbols/min [2025-10-22T22:12:44.984249] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:45.190463] [DEBUG] [LOCAL ] NSC: Loaded 48653 existing records from primary storage. [2025-10-22T22:12:45.191132] [INFO ] [MAIN ] NSC: Loaded 48653 primary data records. [2025-10-22T22:12:45.337249] [DEBUG] [LOCAL ] NSP: Loaded 35753 existing records from primary storage. [2025-10-22T22:12:45.368897] [INFO ] [MAIN ] NSP: Loaded 35753 primary data records. [2025-10-22T22:12:45.712937] [DEBUG] [MAIN ] NSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:45.721253] [INFO ] [MAIN ] NSA: Generated 1794 derivative records from 45071 primary records. [2025-10-22T22:12:45.721528] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-10-22T22:12:45.855802] [DEBUG] [LOCAL ] NSA: Derivative data saved (1794 records). [2025-10-22T22:12:45.856696] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-10-22T22:12:45.860328] [INFO ] [MAIN ] Derivative Progress: 1296/2052 symbols completed. NSA took 1.1s. Estimated remaining: 4m 45s. Rate: 159.1 symbols/min [2025-10-22T22:12:45.860986] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:45.881009] [DEBUG] [MAIN ] NSC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:45.882519] [INFO ] [MAIN ] NSC: Generated 1794 derivative records from 48653 primary records. [2025-10-22T22:12:45.882623] [DEBUG] [LOCAL ] NSC: Saving derivative data. [2025-10-22T22:12:45.899068] [DEBUG] [LOCAL ] NSC: Derivative data saved (1794 records). [2025-10-22T22:12:45.905791] [INFO ] [MAIN ] NSC: Successfully saved derivative data. [2025-10-22T22:12:45.908303] [INFO ] [MAIN ] Derivative Progress: 1297/2052 symbols completed. NSC took 1.1s. Estimated remaining: 4m 45s. Rate: 159.2 symbols/min [2025-10-22T22:12:45.909765] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:45.922159] [DEBUG] [LOCAL ] NTB: Loaded 20182 existing records from primary storage. [2025-10-22T22:12:45.922632] [INFO ] [MAIN ] NTB: Loaded 20182 primary data records. [2025-10-22T22:12:46.094633] [DEBUG] [MAIN ] NSP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:46.116873] [INFO ] [MAIN ] NSP: Generated 1794 derivative records from 35753 primary records. [2025-10-22T22:12:46.123166] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-10-22T22:12:46.348685] [DEBUG] [LOCAL ] NSP: Derivative data saved (1794 records). [2025-10-22T22:12:46.363271] [DEBUG] [LOCAL ] NTR: Loaded 52631 existing records from primary storage. [2025-10-22T22:12:46.360310] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-10-22T22:12:46.363406] [INFO ] [MAIN ] NTR: Loaded 52631 primary data records. [2025-10-22T22:12:46.366345] [INFO ] [MAIN ] Derivative Progress: 1298/2052 symbols completed. NSP took 1.4s. Estimated remaining: 4m 44s. Rate: 159.1 symbols/min [2025-10-22T22:12:46.366913] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:46.698164] [DEBUG] [MAIN ] NTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:46.710773] [INFO ] [MAIN ] NTB: Generated 1794 derivative records from 20182 primary records. [2025-10-22T22:12:46.711576] [DEBUG] [LOCAL ] NTST: Loaded 44049 existing records from primary storage. [2025-10-22T22:12:46.712174] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-10-22T22:12:46.713898] [INFO ] [MAIN ] NTST: Loaded 44049 primary data records. [2025-10-22T22:12:46.810033] [DEBUG] [LOCAL ] NTB: Derivative data saved (1794 records). [2025-10-22T22:12:46.828096] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-10-22T22:12:46.830503] [INFO ] [MAIN ] Derivative Progress: 1299/2052 symbols completed. NTB took 1.0s. Estimated remaining: 4m 44s. Rate: 159.1 symbols/min [2025-10-22T22:12:46.830783] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:47.041946] [DEBUG] [MAIN ] NTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:47.043169] [INFO ] [MAIN ] NTR: Generated 1794 derivative records from 52631 primary records. [2025-10-22T22:12:47.043371] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-10-22T22:12:47.074185] [DEBUG] [LOCAL ] NTR: Derivative data saved (1794 records). [2025-10-22T22:12:47.074379] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-10-22T22:12:47.076680] [INFO ] [MAIN ] Derivative Progress: 1300/2052 symbols completed. NTR took 1.2s. Estimated remaining: 4m 43s. Rate: 159.2 symbols/min [2025-10-22T22:12:47.076938] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:47.100025] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-10-22T22:12:47.100683] [INFO ] [MAIN ] NU: Loaded 53746 primary data records. [2025-10-22T22:12:47.263767] [DEBUG] [MAIN ] NTST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:47.268279] [INFO ] [MAIN ] NTST: Generated 1794 derivative records from 44049 primary records. [2025-10-22T22:12:47.285360] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-10-22T22:12:47.363752] [DEBUG] [LOCAL ] NUS: Loaded 36083 existing records from primary storage. [2025-10-22T22:12:47.505918] [INFO ] [MAIN ] NUS: Loaded 36083 primary data records. [2025-10-22T22:12:47.556425] [DEBUG] [LOCAL ] NTST: Derivative data saved (1794 records). [2025-10-22T22:12:47.562446] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-10-22T22:12:47.571749] [INFO ] [MAIN ] Derivative Progress: 1301/2052 symbols completed. NTST took 1.2s. Estimated remaining: 4m 43s. Rate: 159.1 symbols/min [2025-10-22T22:12:47.584113] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:47.843932] [DEBUG] [LOCAL ] NUV: Loaded 23286 existing records from primary storage. [2025-10-22T22:12:47.844303] [INFO ] [MAIN ] NUV: Loaded 23286 primary data records. [2025-10-22T22:12:48.036206] [DEBUG] [MAIN ] NU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:48.146483] [INFO ] [MAIN ] NU: Generated 1794 derivative records from 53746 primary records. [2025-10-22T22:12:48.155176] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-10-22T22:12:48.173990] [DEBUG] [LOCAL ] NU: Derivative data saved (1794 records). [2025-10-22T22:12:48.176595] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-10-22T22:12:48.179626] [INFO ] [MAIN ] Derivative Progress: 1302/2052 symbols completed. NU took 1.3s. Estimated remaining: 4m 43s. Rate: 159.0 symbols/min [2025-10-22T22:12:48.181894] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:48.195863] [DEBUG] [MAIN ] NUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:48.196638] [INFO ] [MAIN ] NUS: Generated 1794 derivative records from 36083 primary records. [2025-10-22T22:12:48.196867] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-10-22T22:12:48.215273] [DEBUG] [LOCAL ] NUS: Derivative data saved (1794 records). [2025-10-22T22:12:48.215536] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-10-22T22:12:48.217955] [INFO ] [MAIN ] Derivative Progress: 1303/2052 symbols completed. NUS took 1.1s. Estimated remaining: 4m 42s. Rate: 159.2 symbols/min [2025-10-22T22:12:48.235781] [DEBUG] [MAIN ] NUV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:48.236466] [INFO ] [MAIN ] NUV: Generated 1794 derivative records from 23286 primary records. [2025-10-22T22:12:48.236668] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-10-22T22:12:48.268339] [DEBUG] [LOCAL ] NUV: Derivative data saved (1794 records). [2025-10-22T22:12:48.268463] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-10-22T22:12:48.271242] [INFO ] [MAIN ] Derivative Progress: 1304/2052 symbols completed. NUV took 0.7s. Estimated remaining: 4m 42s. Rate: 159.3 symbols/min [2025-10-22T22:12:48.291862] [DEBUG] [LOCAL ] NUVB: Loaded 51712 existing records from primary storage. [2025-10-22T22:12:48.292012] [INFO ] [MAIN ] NUVB: Loaded 51712 primary data records. [2025-10-22T22:12:48.602160] [DEBUG] [MAIN ] NUVB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:48.603056] [INFO ] [MAIN ] NUVB: Generated 1794 derivative records from 51712 primary records. [2025-10-22T22:12:48.603119] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-10-22T22:12:48.618299] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1794 records). [2025-10-22T22:12:48.618357] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-10-22T22:12:48.620429] [INFO ] [MAIN ] Derivative Progress: 1305/2052 symbols completed. NUVB took 0.4s. Estimated remaining: 4m 41s. Rate: 159.3 symbols/min [2025-10-22T22:12:48.621201] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:48.621129] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:48.621366] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:48.631536] [DEBUG] [LOCAL ] NUW: Loaded 6639 existing records from primary storage. [2025-10-22T22:12:48.631909] [INFO ] [MAIN ] NUW: Loaded 6639 primary data records. [2025-10-22T22:12:48.841828] [DEBUG] [LOCAL ] NVG: Loaded 27394 existing records from primary storage. [2025-10-22T22:12:48.842549] [DEBUG] [LOCAL ] NVGS: Loaded 29948 existing records from primary storage. [2025-10-22T22:12:48.842718] [INFO ] [MAIN ] NVG: Loaded 27394 primary data records. [2025-10-22T22:12:48.843005] [INFO ] [MAIN ] NVGS: Loaded 29948 primary data records. [2025-10-22T22:12:49.697353] [DEBUG] [MAIN ] NUW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:49.699335] [INFO ] [MAIN ] NUW: Generated 1794 derivative records from 6639 primary records. [2025-10-22T22:12:49.700291] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-10-22T22:12:49.720211] [DEBUG] [LOCAL ] NUW: Derivative data saved (1794 records). [2025-10-22T22:12:49.720585] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-10-22T22:12:49.724224] [INFO ] [MAIN ] Derivative Progress: 1306/2052 symbols completed. NUW took 1.1s. Estimated remaining: 4m 41s. Rate: 159.0 symbols/min [2025-10-22T22:12:49.726071] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:49.746268] [DEBUG] [MAIN ] NVGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:49.747078] [INFO ] [MAIN ] NVGS: Generated 1794 derivative records from 29948 primary records. [2025-10-22T22:12:49.747209] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-10-22T22:12:49.766594] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1794 records). [2025-10-22T22:12:49.766736] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-10-22T22:12:49.769619] [INFO ] [MAIN ] Derivative Progress: 1307/2052 symbols completed. NVGS took 1.1s. Estimated remaining: 4m 41s. Rate: 159.1 symbols/min [2025-10-22T22:12:49.782429] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:49.783098] [DEBUG] [MAIN ] NVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:49.783811] [INFO ] [MAIN ] NVG: Generated 1794 derivative records from 27394 primary records. [2025-10-22T22:12:49.783876] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-10-22T22:12:49.801291] [DEBUG] [LOCAL ] NVG: Derivative data saved (1794 records). [2025-10-22T22:12:49.801370] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-10-22T22:12:49.803919] [INFO ] [MAIN ] Derivative Progress: 1308/2052 symbols completed. NVG took 1.2s. Estimated remaining: 4m 40s. Rate: 159.3 symbols/min [2025-10-22T22:12:49.804101] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:49.844873] [DEBUG] [LOCAL ] NVRI: Loaded 38962 existing records from primary storage. [2025-10-22T22:12:49.858357] [INFO ] [MAIN ] NVRI: Loaded 38962 primary data records. [2025-10-22T22:12:49.896684] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-10-22T22:12:49.902883] [INFO ] [MAIN ] NVO: Loaded 53784 primary data records. [2025-10-22T22:12:50.145311] [DEBUG] [LOCAL ] NVS: Loaded 51301 existing records from primary storage. [2025-10-22T22:12:50.162682] [INFO ] [MAIN ] NVS: Loaded 51301 primary data records. [2025-10-22T22:12:50.866017] [DEBUG] [MAIN ] NVRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:50.871926] [DEBUG] [MAIN ] NVO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:50.874239] [INFO ] [MAIN ] NVO: Generated 1794 derivative records from 53784 primary records. [2025-10-22T22:12:50.873150] [INFO ] [MAIN ] NVRI: Generated 1794 derivative records from 38962 primary records. [2025-10-22T22:12:50.875664] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-10-22T22:12:50.874571] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-10-22T22:12:50.915612] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1794 records). [2025-10-22T22:12:50.923430] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-10-22T22:12:50.923340] [DEBUG] [LOCAL ] NVO: Derivative data saved (1794 records). [2025-10-22T22:12:50.926014] [INFO ] [MAIN ] Derivative Progress: 1309/2052 symbols completed. NVRI took 1.1s. Estimated remaining: 4m 40s. Rate: 159.0 symbols/min [2025-10-22T22:12:50.926183] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:50.926532] [DEBUG] [MAIN ] NVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:50.928104] [INFO ] [MAIN ] NVS: Generated 1794 derivative records from 51301 primary records. [2025-10-22T22:12:50.927207] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-10-22T22:12:50.928423] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-10-22T22:12:50.931354] [INFO ] [MAIN ] Derivative Progress: 1310/2052 symbols completed. NVO took 1.2s. Estimated remaining: 4m 40s. Rate: 159.1 symbols/min [2025-10-22T22:12:50.931587] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:50.947885] [DEBUG] [LOCAL ] NVS: Derivative data saved (1794 records). [2025-10-22T22:12:50.948052] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-10-22T22:12:50.950963] [INFO ] [MAIN ] Derivative Progress: 1311/2052 symbols completed. NVS took 1.1s. Estimated remaining: 4m 39s. Rate: 159.2 symbols/min [2025-10-22T22:12:50.951210] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:51.018206] [DEBUG] [LOCAL ] NVST: Loaded 51406 existing records from primary storage. [2025-10-22T22:12:51.018427] [INFO ] [MAIN ] NVST: Loaded 51406 primary data records. [2025-10-22T22:12:51.131517] [DEBUG] [LOCAL ] NVT: Loaded 51415 existing records from primary storage. [2025-10-22T22:12:51.134914] [INFO ] [MAIN ] NVT: Loaded 51415 primary data records. [2025-10-22T22:12:51.263035] [DEBUG] [LOCAL ] NWG: Loaded 51400 existing records from primary storage. [2025-10-22T22:12:51.320959] [INFO ] [MAIN ] NWG: Loaded 51400 primary data records. [2025-10-22T22:12:52.006038] [DEBUG] [MAIN ] NVST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:52.007022] [INFO ] [MAIN ] NVST: Generated 1794 derivative records from 51406 primary records. [2025-10-22T22:12:52.007224] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-10-22T22:12:52.025673] [DEBUG] [LOCAL ] NVST: Derivative data saved (1794 records). [2025-10-22T22:12:52.025784] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-10-22T22:12:52.028462] [INFO ] [MAIN ] Derivative Progress: 1312/2052 symbols completed. NVST took 1.1s. Estimated remaining: 4m 39s. Rate: 159.0 symbols/min [2025-10-22T22:12:52.029684] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:52.043525] [DEBUG] [MAIN ] NVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:52.044261] [INFO ] [MAIN ] NVT: Generated 1794 derivative records from 51415 primary records. [2025-10-22T22:12:52.044429] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-10-22T22:12:52.082404] [DEBUG] [MAIN ] NWG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:52.082109] [DEBUG] [LOCAL ] NVT: Derivative data saved (1794 records). [2025-10-22T22:12:52.083202] [INFO ] [MAIN ] NWG: Generated 1794 derivative records from 51400 primary records. [2025-10-22T22:12:52.083298] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-10-22T22:12:52.083383] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-10-22T22:12:52.086187] [INFO ] [MAIN ] Derivative Progress: 1313/2052 symbols completed. NVT took 1.2s. Estimated remaining: 4m 39s. Rate: 159.1 symbols/min [2025-10-22T22:12:52.086663] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:52.110996] [DEBUG] [LOCAL ] NWN: Loaded 26434 existing records from primary storage. [2025-10-22T22:12:52.110527] [DEBUG] [LOCAL ] NWG: Derivative data saved (1794 records). [2025-10-22T22:12:52.111221] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-10-22T22:12:52.113826] [INFO ] [MAIN ] Derivative Progress: 1314/2052 symbols completed. NWG took 1.2s. Estimated remaining: 4m 38s. Rate: 159.2 symbols/min [2025-10-22T22:12:52.113969] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:52.114335] [INFO ] [MAIN ] NWN: Loaded 26434 primary data records. [2025-10-22T22:12:52.216225] [DEBUG] [LOCAL ] NXC: Loaded 4057 existing records from primary storage. [2025-10-22T22:12:52.232696] [INFO ] [MAIN ] NXC: Loaded 4057 primary data records. [2025-10-22T22:12:52.420138] [DEBUG] [LOCAL ] NX: Loaded 33325 existing records from primary storage. [2025-10-22T22:12:52.545838] [INFO ] [MAIN ] NX: Loaded 33325 primary data records. [2025-10-22T22:12:53.104390] [DEBUG] [MAIN ] NWN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:53.107195] [INFO ] [MAIN ] NWN: Generated 1794 derivative records from 26434 primary records. [2025-10-22T22:12:53.107473] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-10-22T22:12:53.144327] [DEBUG] [LOCAL ] NWN: Derivative data saved (1794 records). [2025-10-22T22:12:53.144608] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-10-22T22:12:53.147871] [INFO ] [MAIN ] Derivative Progress: 1315/2052 symbols completed. NWN took 1.1s. Estimated remaining: 4m 38s. Rate: 159.0 symbols/min [2025-10-22T22:12:53.148124] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:53.145119] [DEBUG] [MAIN ] NXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:53.149590] [INFO ] [MAIN ] NXC: Generated 1794 derivative records from 4057 primary records. [2025-10-22T22:12:53.150428] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-10-22T22:12:53.168022] [DEBUG] [LOCAL ] NXC: Derivative data saved (1794 records). [2025-10-22T22:12:53.168110] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-10-22T22:12:53.170591] [INFO ] [MAIN ] Derivative Progress: 1316/2052 symbols completed. NXC took 1.1s. Estimated remaining: 4m 37s. Rate: 159.1 symbols/min [2025-10-22T22:12:53.171001] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:53.184158] [DEBUG] [MAIN ] NX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:53.190589] [INFO ] [MAIN ] NX: Generated 1794 derivative records from 33325 primary records. [2025-10-22T22:12:53.190716] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-10-22T22:12:53.207620] [DEBUG] [LOCAL ] NX: Derivative data saved (1794 records). [2025-10-22T22:12:53.214434] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-10-22T22:12:53.217890] [INFO ] [MAIN ] Derivative Progress: 1317/2052 symbols completed. NX took 1.1s. Estimated remaining: 4m 37s. Rate: 159.2 symbols/min [2025-10-22T22:12:53.214911] [DEBUG] [LOCAL ] NXDT: Loaded 14784 existing records from primary storage. [2025-10-22T22:12:53.218114] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:53.218475] [INFO ] [MAIN ] NXDT: Loaded 14784 primary data records. [2025-10-22T22:12:53.334029] [DEBUG] [LOCAL ] NXG: Loaded 10466 existing records from primary storage. [2025-10-22T22:12:53.364014] [INFO ] [MAIN ] NXG: Loaded 10466 primary data records. [2025-10-22T22:12:53.474957] [DEBUG] [LOCAL ] NXE: Loaded 53067 existing records from primary storage. [2025-10-22T22:12:53.498940] [INFO ] [MAIN ] NXE: Loaded 53067 primary data records. [2025-10-22T22:12:54.266439] [DEBUG] [MAIN ] NXDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:54.267844] [INFO ] [MAIN ] NXDT: Generated 1794 derivative records from 14784 primary records. [2025-10-22T22:12:54.268236] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-10-22T22:12:54.285667] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1794 records). [2025-10-22T22:12:54.286011] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-10-22T22:12:54.288099] [INFO ] [MAIN ] Derivative Progress: 1318/2052 symbols completed. NXDT took 1.1s. Estimated remaining: 4m 37s. Rate: 159.0 symbols/min [2025-10-22T22:12:54.306942] [DEBUG] [MAIN ] NXG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:54.320131] [INFO ] [MAIN ] NXG: Generated 1794 derivative records from 10466 primary records. [2025-10-22T22:12:54.320031] [DEBUG] [MAIN ] NXE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:54.320317] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-10-22T22:12:54.321499] [INFO ] [MAIN ] NXE: Generated 1794 derivative records from 53067 primary records. [2025-10-22T22:12:54.321869] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-10-22T22:12:54.354790] [DEBUG] [LOCAL ] NXG: Derivative data saved (1794 records). [2025-10-22T22:12:54.354854] [DEBUG] [LOCAL ] NXE: Derivative data saved (1794 records). [2025-10-22T22:12:54.355017] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-10-22T22:12:54.358355] [INFO ] [MAIN ] Derivative Progress: 1319/2052 symbols completed. NXE took 1.2s. Estimated remaining: 4m 36s. Rate: 159.1 symbols/min [2025-10-22T22:12:54.355109] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-10-22T22:12:54.361351] [INFO ] [MAIN ] Derivative Progress: 1320/2052 symbols completed. NXG took 1.1s. Estimated remaining: 4m 36s. Rate: 159.2 symbols/min [2025-10-22T22:12:54.361723] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:54.361912] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:54.361824] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:54.367728] [DEBUG] [LOCAL ] NXN: Loaded 2296 existing records from primary storage. [2025-10-22T22:12:54.367989] [INFO ] [MAIN ] NXN: Loaded 2296 primary data records. [2025-10-22T22:12:54.481903] [DEBUG] [LOCAL ] NXP: Loaded 12233 existing records from primary storage. [2025-10-22T22:12:54.492895] [INFO ] [MAIN ] NXP: Loaded 12233 primary data records. [2025-10-22T22:12:54.544866] [DEBUG] [LOCAL ] NXJ: Loaded 14830 existing records from primary storage. [2025-10-22T22:12:54.590538] [INFO ] [MAIN ] NXJ: Loaded 14830 primary data records. [2025-10-22T22:12:55.343716] [DEBUG] [MAIN ] NXN: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:12:55.345064] [INFO ] [MAIN ] NXN: Generated 1793 derivative records from 2296 primary records. [2025-10-22T22:12:55.346286] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-10-22T22:12:55.374308] [DEBUG] [MAIN ] NXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:55.376154] [DEBUG] [LOCAL ] NXN: Derivative data saved (1793 records). [2025-10-22T22:12:55.376474] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-10-22T22:12:55.379118] [INFO ] [MAIN ] Derivative Progress: 1321/2052 symbols completed. NXN took 1.0s. Estimated remaining: 4m 36s. Rate: 159.0 symbols/min [2025-10-22T22:12:55.377194] [INFO ] [MAIN ] NXP: Generated 1794 derivative records from 12233 primary records. [2025-10-22T22:12:55.379612] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:55.379524] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-10-22T22:12:55.398846] [DEBUG] [LOCAL ] NXP: Derivative data saved (1794 records). [2025-10-22T22:12:55.406682] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-10-22T22:12:55.409410] [INFO ] [MAIN ] Derivative Progress: 1322/2052 symbols completed. NXP took 1.0s. Estimated remaining: 4m 35s. Rate: 159.1 symbols/min [2025-10-22T22:12:55.409630] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:55.419461] [DEBUG] [MAIN ] NXJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:55.420306] [INFO ] [MAIN ] NXJ: Generated 1794 derivative records from 14830 primary records. [2025-10-22T22:12:55.420488] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-10-22T22:12:55.438981] [DEBUG] [LOCAL ] NXRT: Loaded 18929 existing records from primary storage. [2025-10-22T22:12:55.443337] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1794 records). [2025-10-22T22:12:55.443496] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-10-22T22:12:55.446220] [INFO ] [MAIN ] Derivative Progress: 1323/2052 symbols completed. NXJ took 1.1s. Estimated remaining: 4m 35s. Rate: 159.3 symbols/min [2025-10-22T22:12:55.446480] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:55.446955] [INFO ] [MAIN ] NXRT: Loaded 18929 primary data records. [2025-10-22T22:12:55.784571] [DEBUG] [LOCAL ] NZF: Loaded 28713 existing records from primary storage. [2025-10-22T22:12:55.784955] [INFO ] [MAIN ] NZF: Loaded 28713 primary data records. [2025-10-22T22:12:55.786039] [DEBUG] [LOCAL ] NYT: Loaded 49445 existing records from primary storage. [2025-10-22T22:12:55.806711] [INFO ] [MAIN ] NYT: Loaded 49445 primary data records. [2025-10-22T22:12:56.421085] [DEBUG] [MAIN ] NXRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:56.422495] [INFO ] [MAIN ] NXRT: Generated 1794 derivative records from 18929 primary records. [2025-10-22T22:12:56.422865] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-10-22T22:12:56.439931] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1794 records). [2025-10-22T22:12:56.440285] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-10-22T22:12:56.442762] [INFO ] [MAIN ] Derivative Progress: 1324/2052 symbols completed. NXRT took 1.1s. Estimated remaining: 4m 35s. Rate: 159.1 symbols/min [2025-10-22T22:12:56.443173] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:56.460572] [DEBUG] [MAIN ] NZF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:56.461362] [INFO ] [MAIN ] NZF: Generated 1794 derivative records from 28713 primary records. [2025-10-22T22:12:56.461748] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-10-22T22:12:56.484827] [DEBUG] [LOCAL ] NZF: Derivative data saved (1794 records). [2025-10-22T22:12:56.485377] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-10-22T22:12:56.487440] [INFO ] [MAIN ] Derivative Progress: 1325/2052 symbols completed. NZF took 1.0s. Estimated remaining: 4m 34s. Rate: 159.2 symbols/min [2025-10-22T22:12:56.487733] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:56.503211] [DEBUG] [MAIN ] NYT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:56.504329] [INFO ] [MAIN ] NYT: Generated 1794 derivative records from 49445 primary records. [2025-10-22T22:12:56.504600] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-10-22T22:12:56.527938] [DEBUG] [LOCAL ] NYT: Derivative data saved (1794 records). [2025-10-22T22:12:56.541420] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-10-22T22:12:56.553664] [INFO ] [MAIN ] Derivative Progress: 1326/2052 symbols completed. NYT took 1.1s. Estimated remaining: 4m 34s. Rate: 159.3 symbols/min [2025-10-22T22:12:56.554695] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:56.554501] [DEBUG] [LOCAL ] OBK: Loaded 16363 existing records from primary storage. [2025-10-22T22:12:56.555553] [INFO ] [MAIN ] OBK: Loaded 16363 primary data records. [2025-10-22T22:12:56.660806] [DEBUG] [LOCAL ] OBDC: Loaded 51730 existing records from primary storage. [2025-10-22T22:12:56.687511] [INFO ] [MAIN ] OBDC: Loaded 51730 primary data records. [2025-10-22T22:12:57.084558] [DEBUG] [LOCAL ] OC: Loaded 44899 existing records from primary storage. [2025-10-22T22:12:57.084942] [INFO ] [MAIN ] OC: Loaded 44899 primary data records. [2025-10-22T22:12:57.586850] [DEBUG] [MAIN ] OBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:57.590053] [INFO ] [MAIN ] OBK: Generated 1794 derivative records from 16363 primary records. [2025-10-22T22:12:57.591393] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-10-22T22:12:57.617392] [DEBUG] [MAIN ] OBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:57.621373] [INFO ] [MAIN ] OBDC: Generated 1794 derivative records from 51730 primary records. [2025-10-22T22:12:57.622510] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-10-22T22:12:57.622450] [DEBUG] [LOCAL ] OBK: Derivative data saved (1794 records). [2025-10-22T22:12:57.623259] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-10-22T22:12:57.625919] [INFO ] [MAIN ] Derivative Progress: 1327/2052 symbols completed. OBK took 1.1s. Estimated remaining: 4m 34s. Rate: 159.0 symbols/min [2025-10-22T22:12:57.626282] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:57.644862] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1794 records). [2025-10-22T22:12:57.646638] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-10-22T22:12:57.648990] [INFO ] [MAIN ] Derivative Progress: 1328/2052 symbols completed. OBDC took 1.2s. Estimated remaining: 4m 33s. Rate: 159.2 symbols/min [2025-10-22T22:12:57.649170] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:57.665576] [DEBUG] [MAIN ] OC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:12:57.666539] [DEBUG] [LOCAL ] OCFT: Loaded 7090 existing records from primary storage. [2025-10-22T22:12:57.666362] [INFO ] [MAIN ] OC: Generated 1793 derivative records from 44899 primary records. [2025-10-22T22:12:57.666838] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-10-22T22:12:57.666910] [INFO ] [MAIN ] OCFT: Loaded 7090 primary data records. [2025-10-22T22:12:57.766369] [DEBUG] [LOCAL ] ODC: Loaded 8681 existing records from primary storage. [2025-10-22T22:12:57.779715] [DEBUG] [LOCAL ] OC: Derivative data saved (1793 records). [2025-10-22T22:12:57.790122] [INFO ] [MAIN ] ODC: Loaded 8681 primary data records. [2025-10-22T22:12:57.790288] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-10-22T22:12:57.793505] [INFO ] [MAIN ] Derivative Progress: 1329/2052 symbols completed. OC took 1.2s. Estimated remaining: 4m 32s. Rate: 159.2 symbols/min [2025-10-22T22:12:57.805074] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:58.172998] [DEBUG] [LOCAL ] ODV: Loaded 30003 existing records from primary storage. [2025-10-22T22:12:58.195277] [INFO ] [MAIN ] ODV: Loaded 30003 primary data records. [2025-10-22T22:12:58.634127] [DEBUG] [MAIN ] OCFT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:58.635502] [INFO ] [MAIN ] OCFT: Generated 1794 derivative records from 7090 primary records. [2025-10-22T22:12:58.635588] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-10-22T22:12:58.652927] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1794 records). [2025-10-22T22:12:58.653085] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-10-22T22:12:58.656699] [INFO ] [MAIN ] Derivative Progress: 1330/2052 symbols completed. OCFT took 1.0s. Estimated remaining: 4m 32s. Rate: 159.1 symbols/min [2025-10-22T22:12:58.657408] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:58.672152] [DEBUG] [MAIN ] ODC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:58.673220] [INFO ] [MAIN ] ODC: Generated 1794 derivative records from 8681 primary records. [2025-10-22T22:12:58.673579] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-10-22T22:12:58.690917] [DEBUG] [LOCAL ] ODC: Derivative data saved (1794 records). [2025-10-22T22:12:58.692115] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-10-22T22:12:58.695551] [INFO ] [MAIN ] Derivative Progress: 1331/2052 symbols completed. ODC took 1.0s. Estimated remaining: 4m 32s. Rate: 159.2 symbols/min [2025-10-22T22:12:58.695770] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:58.716931] [DEBUG] [MAIN ] ODV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:58.717958] [INFO ] [MAIN ] ODV: Generated 1794 derivative records from 30003 primary records. [2025-10-22T22:12:58.718087] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-10-22T22:12:58.733850] [DEBUG] [LOCAL ] ODV: Derivative data saved (1794 records). [2025-10-22T22:12:58.734606] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-10-22T22:12:58.737370] [INFO ] [MAIN ] Derivative Progress: 1332/2052 symbols completed. ODV took 0.9s. Estimated remaining: 4m 31s. Rate: 159.3 symbols/min [2025-10-22T22:12:58.737668] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:58.749205] [DEBUG] [LOCAL ] OEC: Loaded 37142 existing records from primary storage. [2025-10-22T22:12:58.753469] [INFO ] [MAIN ] OEC: Loaded 37142 primary data records. [2025-10-22T22:12:58.824740] [DEBUG] [LOCAL ] OFG: Loaded 20595 existing records from primary storage. [2025-10-22T22:12:58.859196] [INFO ] [MAIN ] OFG: Loaded 20595 primary data records. [2025-10-22T22:12:59.254786] [DEBUG] [LOCAL ] OGE: Loaded 45782 existing records from primary storage. [2025-10-22T22:12:59.292707] [INFO ] [MAIN ] OGE: Loaded 45782 primary data records. [2025-10-22T22:12:59.749520] [DEBUG] [MAIN ] OEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:59.752448] [INFO ] [MAIN ] OEC: Generated 1794 derivative records from 37142 primary records. [2025-10-22T22:12:59.764573] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-10-22T22:12:59.767166] [DEBUG] [MAIN ] OFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:59.775421] [INFO ] [MAIN ] OFG: Generated 1794 derivative records from 20595 primary records. [2025-10-22T22:12:59.779530] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-10-22T22:12:59.784328] [DEBUG] [LOCAL ] OEC: Derivative data saved (1794 records). [2025-10-22T22:12:59.784682] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-10-22T22:12:59.787260] [INFO ] [MAIN ] Derivative Progress: 1333/2052 symbols completed. OEC took 1.1s. Estimated remaining: 4m 31s. Rate: 159.1 symbols/min [2025-10-22T22:12:59.805145] [DEBUG] [LOCAL ] OFG: Derivative data saved (1794 records). [2025-10-22T22:12:59.805263] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-10-22T22:12:59.807538] [INFO ] [MAIN ] Derivative Progress: 1334/2052 symbols completed. OFG took 1.1s. Estimated remaining: 4m 31s. Rate: 159.2 symbols/min [2025-10-22T22:12:59.824319] [DEBUG] [MAIN ] OGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:12:59.824920] [INFO ] [MAIN ] OGE: Generated 1794 derivative records from 45782 primary records. [2025-10-22T22:12:59.824981] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-10-22T22:12:59.839567] [DEBUG] [LOCAL ] OGE: Derivative data saved (1794 records). [2025-10-22T22:12:59.839623] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-10-22T22:12:59.842361] [INFO ] [MAIN ] Derivative Progress: 1335/2052 symbols completed. OGE took 1.1s. Estimated remaining: 4m 30s. Rate: 159.3 symbols/min [2025-10-22T22:12:59.842981] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:59.843153] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:59.843072] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:12:59.915399] [DEBUG] [LOCAL ] OI: Loaded 47048 existing records from primary storage. [2025-10-22T22:12:59.942873] [INFO ] [MAIN ] OI: Loaded 47048 primary data records. [2025-10-22T22:12:59.943638] [DEBUG] [LOCAL ] OGN: Loaded 53117 existing records from primary storage. [2025-10-22T22:12:59.943804] [INFO ] [MAIN ] OGN: Loaded 53117 primary data records. [2025-10-22T22:12:59.944554] [DEBUG] [LOCAL ] OHI: Loaded 51841 existing records from primary storage. [2025-10-22T22:13:00.059982] [INFO ] [MAIN ] OHI: Loaded 51841 primary data records. [2025-10-22T22:13:00.875164] [DEBUG] [MAIN ] OGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:00.876675] [INFO ] [MAIN ] OGN: Generated 1794 derivative records from 53117 primary records. [2025-10-22T22:13:00.879057] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-10-22T22:13:00.907999] [DEBUG] [MAIN ] OI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:00.912447] [INFO ] [MAIN ] OI: Generated 1794 derivative records from 47048 primary records. [2025-10-22T22:13:00.912997] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-10-22T22:13:00.936629] [DEBUG] [LOCAL ] OGN: Derivative data saved (1794 records). [2025-10-22T22:13:00.941104] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-10-22T22:13:00.940958] [DEBUG] [MAIN ] OHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:00.941951] [INFO ] [MAIN ] OHI: Generated 1794 derivative records from 51841 primary records. [2025-10-22T22:13:00.944871] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-10-22T22:13:00.947057] [INFO ] [MAIN ] Derivative Progress: 1336/2052 symbols completed. OGN took 1.1s. Estimated remaining: 4m 30s. Rate: 159.1 symbols/min [2025-10-22T22:13:00.949166] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:00.949663] [DEBUG] [LOCAL ] OI: Derivative data saved (1794 records). [2025-10-22T22:13:00.956870] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-10-22T22:13:00.961295] [INFO ] [MAIN ] Derivative Progress: 1337/2052 symbols completed. OI took 1.1s. Estimated remaining: 4m 30s. Rate: 159.2 symbols/min [2025-10-22T22:13:00.965798] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:00.968705] [DEBUG] [LOCAL ] OHI: Derivative data saved (1794 records). [2025-10-22T22:13:00.969104] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-10-22T22:13:00.971974] [INFO ] [MAIN ] Derivative Progress: 1338/2052 symbols completed. OHI took 1.1s. Estimated remaining: 4m 29s. Rate: 159.3 symbols/min [2025-10-22T22:13:00.972185] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:00.983746] [DEBUG] [LOCAL ] OIA: Loaded 13047 existing records from primary storage. [2025-10-22T22:13:00.983878] [INFO ] [MAIN ] OIA: Loaded 13047 primary data records. [2025-10-22T22:13:01.217694] [DEBUG] [LOCAL ] OIS: Loaded 39794 existing records from primary storage. [2025-10-22T22:13:01.272802] [INFO ] [MAIN ] OIS: Loaded 39794 primary data records. [2025-10-22T22:13:01.424534] [DEBUG] [LOCAL ] OII: Loaded 41819 existing records from primary storage. [2025-10-22T22:13:01.456612] [INFO ] [MAIN ] OII: Loaded 41819 primary data records. [2025-10-22T22:13:02.000924] [DEBUG] [MAIN ] OIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:02.002385] [INFO ] [MAIN ] OIA: Generated 1794 derivative records from 13047 primary records. [2025-10-22T22:13:02.002718] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-10-22T22:13:02.020080] [DEBUG] [LOCAL ] OIA: Derivative data saved (1794 records). [2025-10-22T22:13:02.020577] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-10-22T22:13:02.022855] [INFO ] [MAIN ] Derivative Progress: 1339/2052 symbols completed. OIA took 1.1s. Estimated remaining: 4m 29s. Rate: 159.1 symbols/min [2025-10-22T22:13:02.023031] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:02.042976] [DEBUG] [MAIN ] OIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:02.045442] [INFO ] [MAIN ] OIS: Generated 1794 derivative records from 39794 primary records. [2025-10-22T22:13:02.045707] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-10-22T22:13:02.067845] [DEBUG] [MAIN ] OII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:02.073185] [INFO ] [MAIN ] OII: Generated 1794 derivative records from 41819 primary records. [2025-10-22T22:13:02.075860] [DEBUG] [LOCAL ] OIS: Derivative data saved (1794 records). [2025-10-22T22:13:02.076101] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-10-22T22:13:02.076218] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-10-22T22:13:02.079015] [INFO ] [MAIN ] Derivative Progress: 1340/2052 symbols completed. OIS took 1.1s. Estimated remaining: 4m 28s. Rate: 159.2 symbols/min [2025-10-22T22:13:02.079478] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:02.096551] [DEBUG] [LOCAL ] OII: Derivative data saved (1794 records). [2025-10-22T22:13:02.096793] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-10-22T22:13:02.099904] [INFO ] [MAIN ] Derivative Progress: 1341/2052 symbols completed. OII took 1.1s. Estimated remaining: 4m 28s. Rate: 159.3 symbols/min [2025-10-22T22:13:02.100306] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:02.125427] [DEBUG] [LOCAL ] OLP: Loaded 10043 existing records from primary storage. [2025-10-22T22:13:02.125632] [INFO ] [MAIN ] OLP: Loaded 10043 primary data records. [2025-10-22T22:13:02.259502] [DEBUG] [LOCAL ] OKE: Loaded 53576 existing records from primary storage. [2025-10-22T22:13:02.259798] [INFO ] [MAIN ] OKE: Loaded 53576 primary data records. [2025-10-22T22:13:02.610427] [DEBUG] [LOCAL ] OLN: Loaded 52000 existing records from primary storage. [2025-10-22T22:13:02.626407] [INFO ] [MAIN ] OLN: Loaded 52000 primary data records. [2025-10-22T22:13:03.215562] [DEBUG] [MAIN ] OKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:03.223335] [INFO ] [MAIN ] OKE: Generated 1794 derivative records from 53576 primary records. [2025-10-22T22:13:03.222423] [DEBUG] [MAIN ] OLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:03.224827] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-10-22T22:13:03.224749] [INFO ] [MAIN ] OLP: Generated 1794 derivative records from 10043 primary records. [2025-10-22T22:13:03.225138] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-10-22T22:13:03.258869] [DEBUG] [LOCAL ] OKE: Derivative data saved (1794 records). [2025-10-22T22:13:03.261326] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-10-22T22:13:03.261426] [DEBUG] [LOCAL ] OLP: Derivative data saved (1794 records). [2025-10-22T22:13:03.272876] [INFO ] [MAIN ] Derivative Progress: 1342/2052 symbols completed. OKE took 1.2s. Estimated remaining: 4m 28s. Rate: 159.0 symbols/min [2025-10-22T22:13:03.278611] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-10-22T22:13:03.281852] [INFO ] [MAIN ] Derivative Progress: 1343/2052 symbols completed. OLP took 1.2s. Estimated remaining: 4m 27s. Rate: 159.2 symbols/min [2025-10-22T22:13:03.278911] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:03.282843] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:03.283310] [DEBUG] [MAIN ] OLN: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:13:03.284817] [INFO ] [MAIN ] OLN: Generated 1793 derivative records from 52000 primary records. [2025-10-22T22:13:03.284997] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-10-22T22:13:03.303404] [DEBUG] [LOCAL ] OLN: Derivative data saved (1793 records). [2025-10-22T22:13:03.303695] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-10-22T22:13:03.306559] [INFO ] [MAIN ] Derivative Progress: 1344/2052 symbols completed. OLN took 1.2s. Estimated remaining: 4m 27s. Rate: 159.3 symbols/min [2025-10-22T22:13:03.306925] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:03.382851] [DEBUG] [LOCAL ] OMF: Loaded 46434 existing records from primary storage. [2025-10-22T22:13:03.384032] [INFO ] [MAIN ] OMF: Loaded 46434 primary data records. [2025-10-22T22:13:03.383753] [DEBUG] [LOCAL ] OMC: Loaded 53292 existing records from primary storage. [2025-10-22T22:13:03.384260] [INFO ] [MAIN ] OMC: Loaded 53292 primary data records. [2025-10-22T22:13:03.608097] [DEBUG] [LOCAL ] OMI: Loaded 46218 existing records from primary storage. [2025-10-22T22:13:03.629143] [INFO ] [MAIN ] OMI: Loaded 46218 primary data records. [2025-10-22T22:13:04.352727] [DEBUG] [MAIN ] OMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:04.353257] [DEBUG] [MAIN ] OMF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:04.354012] [INFO ] [MAIN ] OMC: Generated 1794 derivative records from 53292 primary records. [2025-10-22T22:13:04.354770] [INFO ] [MAIN ] OMF: Generated 1794 derivative records from 46434 primary records. [2025-10-22T22:13:04.354196] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-10-22T22:13:04.355992] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-10-22T22:13:04.389100] [DEBUG] [LOCAL ] OMF: Derivative data saved (1794 records). [2025-10-22T22:13:04.387398] [DEBUG] [LOCAL ] OMC: Derivative data saved (1794 records). [2025-10-22T22:13:04.389362] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-10-22T22:13:04.391916] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-10-22T22:13:04.391805] [INFO ] [MAIN ] Derivative Progress: 1345/2052 symbols completed. OMF took 1.1s. Estimated remaining: 4m 27s. Rate: 159.0 symbols/min [2025-10-22T22:13:04.392166] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:04.394028] [INFO ] [MAIN ] Derivative Progress: 1346/2052 symbols completed. OMC took 1.1s. Estimated remaining: 4m 26s. Rate: 159.2 symbols/min [2025-10-22T22:13:04.402229] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:04.408202] [DEBUG] [MAIN ] OMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:04.410974] [INFO ] [MAIN ] OMI: Generated 1794 derivative records from 46218 primary records. [2025-10-22T22:13:04.411206] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-10-22T22:13:04.432090] [DEBUG] [LOCAL ] ONIT: Loaded 7526 existing records from primary storage. [2025-10-22T22:13:04.431827] [DEBUG] [LOCAL ] OMI: Derivative data saved (1794 records). [2025-10-22T22:13:04.432358] [INFO ] [MAIN ] ONIT: Loaded 7526 primary data records. [2025-10-22T22:13:04.453113] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-10-22T22:13:04.466265] [INFO ] [MAIN ] Derivative Progress: 1347/2052 symbols completed. OMI took 1.2s. Estimated remaining: 4m 26s. Rate: 159.3 symbols/min [2025-10-22T22:13:04.511937] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:04.603094] [DEBUG] [LOCAL ] ONL: Loaded 28911 existing records from primary storage. [2025-10-22T22:13:04.612143] [INFO ] [MAIN ] ONL: Loaded 28911 primary data records. [2025-10-22T22:13:05.141172] [DEBUG] [LOCAL ] ONON: Loaded 53613 existing records from primary storage. [2025-10-22T22:13:05.141670] [INFO ] [MAIN ] ONON: Loaded 53613 primary data records. [2025-10-22T22:13:05.462904] [DEBUG] [MAIN ] ONIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:05.464997] [INFO ] [MAIN ] ONIT: Generated 1794 derivative records from 7526 primary records. [2025-10-22T22:13:05.465178] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-10-22T22:13:05.488568] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1794 records). [2025-10-22T22:13:05.489201] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-10-22T22:13:05.491538] [INFO ] [MAIN ] Derivative Progress: 1348/2052 symbols completed. ONIT took 1.1s. Estimated remaining: 4m 26s. Rate: 159.1 symbols/min [2025-10-22T22:13:05.509344] [DEBUG] [MAIN ] ONL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:05.510187] [INFO ] [MAIN ] ONL: Generated 1794 derivative records from 28911 primary records. [2025-10-22T22:13:05.510389] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-10-22T22:13:05.528913] [DEBUG] [LOCAL ] ONL: Derivative data saved (1794 records). [2025-10-22T22:13:05.529003] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-10-22T22:13:05.531878] [INFO ] [MAIN ] Derivative Progress: 1349/2052 symbols completed. ONL took 1.1s. Estimated remaining: 4m 25s. Rate: 159.2 symbols/min [2025-10-22T22:13:05.548000] [DEBUG] [MAIN ] ONON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:05.548558] [INFO ] [MAIN ] ONON: Generated 1794 derivative records from 53613 primary records. [2025-10-22T22:13:05.548617] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-10-22T22:13:05.564046] [DEBUG] [LOCAL ] ONON: Derivative data saved (1794 records). [2025-10-22T22:13:05.564109] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-10-22T22:13:05.566689] [INFO ] [MAIN ] Derivative Progress: 1350/2052 symbols completed. ONON took 1.1s. Estimated remaining: 4m 24s. Rate: 159.3 symbols/min [2025-10-22T22:13:05.567418] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:05.567331] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:05.567219] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:05.609805] [DEBUG] [LOCAL ] ONTF: Loaded 22531 existing records from primary storage. [2025-10-22T22:13:05.616469] [DEBUG] [LOCAL ] OOMA: Loaded 18269 existing records from primary storage. [2025-10-22T22:13:05.616603] [INFO ] [MAIN ] OOMA: Loaded 18269 primary data records. [2025-10-22T22:13:05.616103] [INFO ] [MAIN ] ONTF: Loaded 22531 primary data records. [2025-10-22T22:13:05.830066] [DEBUG] [LOCAL ] ONTO: Loaded 47210 existing records from primary storage. [2025-10-22T22:13:05.847914] [INFO ] [MAIN ] ONTO: Loaded 47210 primary data records. [2025-10-22T22:13:06.590347] [DEBUG] [MAIN ] OOMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:06.603797] [INFO ] [MAIN ] OOMA: Generated 1794 derivative records from 18269 primary records. [2025-10-22T22:13:06.604220] [DEBUG] [MAIN ] ONTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:06.604594] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-10-22T22:13:06.605426] [INFO ] [MAIN ] ONTF: Generated 1794 derivative records from 22531 primary records. [2025-10-22T22:13:06.605531] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-10-22T22:13:06.631550] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1794 records). [2025-10-22T22:13:06.636761] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-10-22T22:13:06.639703] [INFO ] [MAIN ] Derivative Progress: 1351/2052 symbols completed. ONTF took 1.1s. Estimated remaining: 4m 24s. Rate: 159.1 symbols/min [2025-10-22T22:13:06.640765] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:06.641934] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1794 records). [2025-10-22T22:13:06.655751] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-10-22T22:13:06.655675] [DEBUG] [MAIN ] ONTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:06.656676] [INFO ] [MAIN ] ONTO: Generated 1794 derivative records from 47210 primary records. [2025-10-22T22:13:06.656877] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-10-22T22:13:06.660021] [INFO ] [MAIN ] Derivative Progress: 1352/2052 symbols completed. OOMA took 1.1s. Estimated remaining: 4m 24s. Rate: 159.2 symbols/min [2025-10-22T22:13:06.661022] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:06.677160] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1794 records). [2025-10-22T22:13:06.677371] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-10-22T22:13:06.679976] [INFO ] [MAIN ] Derivative Progress: 1353/2052 symbols completed. ONTO took 1.1s. Estimated remaining: 4m 23s. Rate: 159.3 symbols/min [2025-10-22T22:13:06.680288] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:06.717869] [DEBUG] [LOCAL ] OPP: Loaded 12339 existing records from primary storage. [2025-10-22T22:13:06.718775] [INFO ] [MAIN ] OPP: Loaded 12339 primary data records. [2025-10-22T22:13:06.718542] [DEBUG] [LOCAL ] OPAD: Loaded 26424 existing records from primary storage. [2025-10-22T22:13:06.718982] [INFO ] [MAIN ] OPAD: Loaded 26424 primary data records. [2025-10-22T22:13:06.906209] [DEBUG] [LOCAL ] OPFI: Loaded 46022 existing records from primary storage. [2025-10-22T22:13:06.947772] [INFO ] [MAIN ] OPFI: Loaded 46022 primary data records. [2025-10-22T22:13:07.708144] [DEBUG] [MAIN ] OPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:07.709696] [INFO ] [MAIN ] OPP: Generated 1794 derivative records from 12339 primary records. [2025-10-22T22:13:07.709985] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-10-22T22:13:07.741468] [DEBUG] [LOCAL ] OPP: Derivative data saved (1794 records). [2025-10-22T22:13:07.742356] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-10-22T22:13:07.742276] [DEBUG] [MAIN ] OPAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:07.744189] [INFO ] [MAIN ] Derivative Progress: 1354/2052 symbols completed. OPP took 1.1s. Estimated remaining: 4m 23s. Rate: 159.1 symbols/min [2025-10-22T22:13:07.745095] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:07.744979] [INFO ] [MAIN ] OPAD: Generated 1794 derivative records from 26424 primary records. [2025-10-22T22:13:07.746093] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-10-22T22:13:07.764102] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1794 records). [2025-10-22T22:13:07.764204] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-10-22T22:13:07.766947] [INFO ] [MAIN ] Derivative Progress: 1355/2052 symbols completed. OPAD took 1.1s. Estimated remaining: 4m 23s. Rate: 159.2 symbols/min [2025-10-22T22:13:07.767169] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:07.780492] [DEBUG] [MAIN ] OPFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:07.781384] [INFO ] [MAIN ] OPFI: Generated 1794 derivative records from 46022 primary records. [2025-10-22T22:13:07.781541] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-10-22T22:13:07.797611] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1794 records). [2025-10-22T22:13:07.797776] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-10-22T22:13:07.800456] [INFO ] [MAIN ] Derivative Progress: 1356/2052 symbols completed. OPFI took 1.1s. Estimated remaining: 4m 22s. Rate: 159.3 symbols/min [2025-10-22T22:13:07.800796] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:07.834740] [DEBUG] [LOCAL ] ORA: Loaded 33147 existing records from primary storage. [2025-10-22T22:13:07.846567] [INFO ] [MAIN ] ORA: Loaded 33147 primary data records. [2025-10-22T22:13:07.946608] [DEBUG] [LOCAL ] OR: Loaded 46846 existing records from primary storage. [2025-10-22T22:13:07.963168] [INFO ] [MAIN ] OR: Loaded 46846 primary data records. [2025-10-22T22:13:08.268708] [DEBUG] [LOCAL ] ORC: Loaded 52479 existing records from primary storage. [2025-10-22T22:13:08.288110] [INFO ] [MAIN ] ORC: Loaded 52479 primary data records. [2025-10-22T22:13:08.813002] [DEBUG] [MAIN ] ORA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:08.814753] [INFO ] [MAIN ] ORA: Generated 1794 derivative records from 33147 primary records. [2025-10-22T22:13:08.816141] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-10-22T22:13:08.841555] [DEBUG] [LOCAL ] ORA: Derivative data saved (1794 records). [2025-10-22T22:13:08.841892] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-10-22T22:13:08.849041] [INFO ] [MAIN ] Derivative Progress: 1357/2052 symbols completed. ORA took 1.1s. Estimated remaining: 4m 22s. Rate: 159.1 symbols/min [2025-10-22T22:13:08.847037] [DEBUG] [MAIN ] OR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:08.849298] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:08.850223] [INFO ] [MAIN ] OR: Generated 1794 derivative records from 46846 primary records. [2025-10-22T22:13:08.850453] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-10-22T22:13:08.867713] [DEBUG] [LOCAL ] OR: Derivative data saved (1794 records). [2025-10-22T22:13:08.868940] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-10-22T22:13:08.871147] [INFO ] [MAIN ] Derivative Progress: 1358/2052 symbols completed. OR took 1.1s. Estimated remaining: 4m 22s. Rate: 159.2 symbols/min [2025-10-22T22:13:08.871360] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:08.887389] [DEBUG] [MAIN ] ORC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:08.888370] [INFO ] [MAIN ] ORC: Generated 1794 derivative records from 52479 primary records. [2025-10-22T22:13:08.896533] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-10-22T22:13:08.912239] [DEBUG] [LOCAL ] ORC: Derivative data saved (1794 records). [2025-10-22T22:13:08.912537] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-10-22T22:13:08.915285] [INFO ] [MAIN ] Derivative Progress: 1359/2052 symbols completed. ORC took 1.1s. Estimated remaining: 4m 21s. Rate: 159.3 symbols/min [2025-10-22T22:13:08.915474] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:08.929446] [DEBUG] [LOCAL ] ORN: Loaded 30727 existing records from primary storage. [2025-10-22T22:13:08.929738] [INFO ] [MAIN ] ORN: Loaded 30727 primary data records. [2025-10-22T22:13:09.296859] [DEBUG] [LOCAL ] OSCR: Loaded 53769 existing records from primary storage. [2025-10-22T22:13:09.297093] [INFO ] [MAIN ] OSCR: Loaded 53769 primary data records. [2025-10-22T22:13:09.423805] [DEBUG] [LOCAL ] OTIS: Loaded 52700 existing records from primary storage. [2025-10-22T22:13:09.475230] [INFO ] [MAIN ] OTIS: Loaded 52700 primary data records. [2025-10-22T22:13:09.943552] [DEBUG] [MAIN ] ORN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:09.945193] [INFO ] [MAIN ] ORN: Generated 1794 derivative records from 30727 primary records. [2025-10-22T22:13:09.945493] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-10-22T22:13:09.962942] [DEBUG] [LOCAL ] ORN: Derivative data saved (1794 records). [2025-10-22T22:13:09.963437] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-10-22T22:13:09.966132] [INFO ] [MAIN ] Derivative Progress: 1360/2052 symbols completed. ORN took 1.1s. Estimated remaining: 4m 21s. Rate: 159.1 symbols/min [2025-10-22T22:13:09.966340] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:09.986259] [DEBUG] [MAIN ] OSCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:09.987286] [INFO ] [MAIN ] OSCR: Generated 1794 derivative records from 53769 primary records. [2025-10-22T22:13:09.987624] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-10-22T22:13:10.004563] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1794 records). [2025-10-22T22:13:10.004921] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-10-22T22:13:10.006984] [INFO ] [MAIN ] Derivative Progress: 1361/2052 symbols completed. OSCR took 1.1s. Estimated remaining: 4m 20s. Rate: 159.2 symbols/min [2025-10-22T22:13:10.007251] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:10.024360] [DEBUG] [MAIN ] OTIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:10.036257] [INFO ] [MAIN ] OTIS: Generated 1794 derivative records from 52700 primary records. [2025-10-22T22:13:10.036467] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-10-22T22:13:10.052459] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1794 records). [2025-10-22T22:13:10.052623] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-10-22T22:13:10.055435] [INFO ] [MAIN ] Derivative Progress: 1362/2052 symbols completed. OTIS took 1.1s. Estimated remaining: 4m 20s. Rate: 159.3 symbols/min [2025-10-22T22:13:10.056408] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:10.070919] [DEBUG] [LOCAL ] OUT: Loaded 47687 existing records from primary storage. [2025-10-22T22:13:10.071183] [INFO ] [MAIN ] OUT: Loaded 47687 primary data records. [2025-10-22T22:13:10.226484] [DEBUG] [LOCAL ] OVV: Loaded 53493 existing records from primary storage. [2025-10-22T22:13:10.248113] [INFO ] [MAIN ] OVV: Loaded 53493 primary data records. [2025-10-22T22:13:10.770818] [DEBUG] [LOCAL ] OWL: Loaded 53560 existing records from primary storage. [2025-10-22T22:13:10.771080] [INFO ] [MAIN ] OWL: Loaded 53560 primary data records. [2025-10-22T22:13:11.135791] [DEBUG] [MAIN ] OUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:11.150439] [INFO ] [MAIN ] OUT: Generated 1794 derivative records from 47687 primary records. [2025-10-22T22:13:11.150719] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-10-22T22:13:11.169094] [DEBUG] [LOCAL ] OUT: Derivative data saved (1794 records). [2025-10-22T22:13:11.169673] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-10-22T22:13:11.171681] [INFO ] [MAIN ] Derivative Progress: 1363/2052 symbols completed. OUT took 1.2s. Estimated remaining: 4m 20s. Rate: 159.1 symbols/min [2025-10-22T22:13:11.189118] [DEBUG] [MAIN ] OVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:11.189941] [INFO ] [MAIN ] OVV: Generated 1794 derivative records from 53493 primary records. [2025-10-22T22:13:11.190071] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-10-22T22:13:11.206673] [DEBUG] [LOCAL ] OVV: Derivative data saved (1794 records). [2025-10-22T22:13:11.206917] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-10-22T22:13:11.209377] [INFO ] [MAIN ] Derivative Progress: 1364/2052 symbols completed. OVV took 1.2s. Estimated remaining: 4m 19s. Rate: 159.2 symbols/min [2025-10-22T22:13:11.224609] [DEBUG] [MAIN ] OWL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:11.225171] [INFO ] [MAIN ] OWL: Generated 1794 derivative records from 53560 primary records. [2025-10-22T22:13:11.225232] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-10-22T22:13:11.240315] [DEBUG] [LOCAL ] OWL: Derivative data saved (1794 records). [2025-10-22T22:13:11.240374] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-10-22T22:13:11.242708] [INFO ] [MAIN ] Derivative Progress: 1365/2052 symbols completed. OWL took 1.2s. Estimated remaining: 4m 19s. Rate: 159.3 symbols/min [2025-10-22T22:13:11.243232] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:11.243148] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:11.243353] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:11.255501] [DEBUG] [LOCAL ] OWLT: Loaded 9777 existing records from primary storage. [2025-10-22T22:13:11.255626] [INFO ] [MAIN ] OWLT: Loaded 9777 primary data records. [2025-10-22T22:13:11.413207] [DEBUG] [LOCAL ] OXM: Loaded 33140 existing records from primary storage. [2025-10-22T22:13:11.458679] [INFO ] [MAIN ] OXM: Loaded 33140 primary data records. [2025-10-22T22:13:11.708092] [DEBUG] [LOCAL ] PAAS: Loaded 53625 existing records from primary storage. [2025-10-22T22:13:11.714853] [INFO ] [MAIN ] PAAS: Loaded 53625 primary data records. [2025-10-22T22:13:12.240193] [DEBUG] [MAIN ] OWLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:12.241842] [INFO ] [MAIN ] OWLT: Generated 1794 derivative records from 9777 primary records. [2025-10-22T22:13:12.242037] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-10-22T22:13:12.260702] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1794 records). [2025-10-22T22:13:12.261093] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-10-22T22:13:12.264276] [INFO ] [MAIN ] Derivative Progress: 1366/2052 symbols completed. OWLT took 1.0s. Estimated remaining: 4m 19s. Rate: 159.1 symbols/min [2025-10-22T22:13:12.264566] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:12.282477] [DEBUG] [MAIN ] OXM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:12.287400] [INFO ] [MAIN ] OXM: Generated 1794 derivative records from 33140 primary records. [2025-10-22T22:13:12.287609] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-10-22T22:13:12.323506] [DEBUG] [MAIN ] PAAS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:12.325017] [DEBUG] [LOCAL ] OXM: Derivative data saved (1794 records). [2025-10-22T22:13:12.325889] [INFO ] [MAIN ] PAAS: Generated 1794 derivative records from 53625 primary records. [2025-10-22T22:13:12.326009] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-10-22T22:13:12.323831] [DEBUG] [LOCAL ] PAC: Loaded 11566 existing records from primary storage. [2025-10-22T22:13:12.326230] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-10-22T22:13:12.329468] [INFO ] [MAIN ] Derivative Progress: 1367/2052 symbols completed. OXM took 1.1s. Estimated remaining: 4m 18s. Rate: 159.2 symbols/min [2025-10-22T22:13:12.329628] [INFO ] [MAIN ] PAC: Loaded 11566 primary data records. [2025-10-22T22:13:12.329840] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:12.415271] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1794 records). [2025-10-22T22:13:12.415405] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-10-22T22:13:12.418408] [INFO ] [MAIN ] Derivative Progress: 1368/2052 symbols completed. PAAS took 1.2s. Estimated remaining: 4m 18s. Rate: 159.2 symbols/min [2025-10-22T22:13:12.418561] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:12.558459] [DEBUG] [LOCAL ] PACK: Loaded 31862 existing records from primary storage. [2025-10-22T22:13:12.672277] [INFO ] [MAIN ] PACK: Loaded 31862 primary data records. [2025-10-22T22:13:12.743925] [DEBUG] [LOCAL ] PACS: Loaded 34769 existing records from primary storage. [2025-10-22T22:13:12.766420] [INFO ] [MAIN ] PACS: Loaded 34769 primary data records. [2025-10-22T22:13:13.351170] [DEBUG] [MAIN ] PAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:13.352117] [INFO ] [MAIN ] PAC: Generated 1794 derivative records from 11566 primary records. [2025-10-22T22:13:13.353039] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-10-22T22:13:13.373604] [DEBUG] [LOCAL ] PAC: Derivative data saved (1794 records). [2025-10-22T22:13:13.374139] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-10-22T22:13:13.376310] [INFO ] [MAIN ] Derivative Progress: 1369/2052 symbols completed. PAC took 1.1s. Estimated remaining: 4m 18s. Rate: 159.1 symbols/min [2025-10-22T22:13:13.376913] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:13.396404] [DEBUG] [MAIN ] PACK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:13.397102] [INFO ] [MAIN ] PACK: Generated 1794 derivative records from 31862 primary records. [2025-10-22T22:13:13.397230] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-10-22T22:13:13.420633] [DEBUG] [LOCAL ] PACK: Derivative data saved (1794 records). [2025-10-22T22:13:13.433221] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-10-22T22:13:13.435560] [INFO ] [MAIN ] Derivative Progress: 1370/2052 symbols completed. PACK took 1.1s. Estimated remaining: 4m 17s. Rate: 159.2 symbols/min [2025-10-22T22:13:13.436190] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:13.435983] [DEBUG] [MAIN ] PACS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:13.437493] [INFO ] [MAIN ] PACS: Generated 1794 derivative records from 34769 primary records. [2025-10-22T22:13:13.437569] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-10-22T22:13:13.458065] [DEBUG] [LOCAL ] PAG: Loaded 21200 existing records from primary storage. [2025-10-22T22:13:13.459151] [INFO ] [MAIN ] PAG: Loaded 21200 primary data records. [2025-10-22T22:13:13.506582] [DEBUG] [LOCAL ] PACS: Derivative data saved (1794 records). [2025-10-22T22:13:13.534101] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-10-22T22:13:13.561361] [INFO ] [MAIN ] Derivative Progress: 1371/2052 symbols completed. PACS took 1.1s. Estimated remaining: 4m 17s. Rate: 159.2 symbols/min [2025-10-22T22:13:13.573218] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:13.673032] [DEBUG] [LOCAL ] PAI: Loaded 2830 existing records from primary storage. [2025-10-22T22:13:13.783472] [INFO ] [MAIN ] PAI: Loaded 2830 primary data records. [2025-10-22T22:13:13.904362] [DEBUG] [LOCAL ] PAGS: Loaded 52806 existing records from primary storage. [2025-10-22T22:13:13.916427] [INFO ] [MAIN ] PAGS: Loaded 52806 primary data records. [2025-10-22T22:13:14.447997] [DEBUG] [MAIN ] PAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:14.450529] [INFO ] [MAIN ] PAG: Generated 1794 derivative records from 21200 primary records. [2025-10-22T22:13:14.451054] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-10-22T22:13:14.470052] [DEBUG] [LOCAL ] PAG: Derivative data saved (1794 records). [2025-10-22T22:13:14.470453] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-10-22T22:13:14.472698] [INFO ] [MAIN ] Derivative Progress: 1372/2052 symbols completed. PAG took 1.1s. Estimated remaining: 4m 16s. Rate: 159.1 symbols/min [2025-10-22T22:13:14.473245] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:14.493603] [DEBUG] [MAIN ] PAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:14.494762] [INFO ] [MAIN ] PAI: Generated 1794 derivative records from 2830 primary records. [2025-10-22T22:13:14.495061] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-10-22T22:13:14.509668] [DEBUG] [LOCAL ] PAI: Derivative data saved (1794 records). [2025-10-22T22:13:14.509819] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-10-22T22:13:14.512172] [INFO ] [MAIN ] Derivative Progress: 1373/2052 symbols completed. PAI took 0.9s. Estimated remaining: 4m 16s. Rate: 159.2 symbols/min [2025-10-22T22:13:14.521111] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:14.536615] [DEBUG] [MAIN ] PAGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:14.537426] [INFO ] [MAIN ] PAGS: Generated 1794 derivative records from 52806 primary records. [2025-10-22T22:13:14.538113] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-10-22T22:13:14.547132] [DEBUG] [LOCAL ] PAM: Loaded 29064 existing records from primary storage. [2025-10-22T22:13:14.547307] [INFO ] [MAIN ] PAM: Loaded 29064 primary data records. [2025-10-22T22:13:14.660344] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1794 records). [2025-10-22T22:13:14.666417] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-10-22T22:13:14.674999] [INFO ] [MAIN ] Derivative Progress: 1374/2052 symbols completed. PAGS took 1.2s. Estimated remaining: 4m 15s. Rate: 159.2 symbols/min [2025-10-22T22:13:14.686640] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:14.774107] [DEBUG] [LOCAL ] PAR: Loaded 34300 existing records from primary storage. [2025-10-22T22:13:14.780337] [INFO ] [MAIN ] PAR: Loaded 34300 primary data records. [2025-10-22T22:13:15.258810] [DEBUG] [LOCAL ] PARR: Loaded 47952 existing records from primary storage. [2025-10-22T22:13:15.259792] [INFO ] [MAIN ] PARR: Loaded 47952 primary data records. [2025-10-22T22:13:15.564800] [DEBUG] [MAIN ] PAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:15.574258] [INFO ] [MAIN ] PAM: Generated 1794 derivative records from 29064 primary records. [2025-10-22T22:13:15.574614] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-10-22T22:13:15.594768] [DEBUG] [LOCAL ] PAM: Derivative data saved (1794 records). [2025-10-22T22:13:15.596015] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-10-22T22:13:15.599079] [INFO ] [MAIN ] Derivative Progress: 1375/2052 symbols completed. PAM took 1.1s. Estimated remaining: 4m 15s. Rate: 159.1 symbols/min [2025-10-22T22:13:15.599460] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:15.613049] [DEBUG] [MAIN ] PAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:15.613942] [INFO ] [MAIN ] PAR: Generated 1794 derivative records from 34300 primary records. [2025-10-22T22:13:15.614045] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-10-22T22:13:15.631048] [DEBUG] [LOCAL ] PAR: Derivative data saved (1794 records). [2025-10-22T22:13:15.631309] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-10-22T22:13:15.634025] [INFO ] [MAIN ] Derivative Progress: 1376/2052 symbols completed. PAR took 1.1s. Estimated remaining: 4m 15s. Rate: 159.2 symbols/min [2025-10-22T22:13:15.634189] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:15.651897] [DEBUG] [MAIN ] PARR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:15.652524] [INFO ] [MAIN ] PARR: Generated 1794 derivative records from 47952 primary records. [2025-10-22T22:13:15.652727] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-10-22T22:13:15.692626] [DEBUG] [LOCAL ] PAXS: Loaded 20921 existing records from primary storage. [2025-10-22T22:13:15.692809] [INFO ] [MAIN ] PAXS: Loaded 20921 primary data records. [2025-10-22T22:13:15.692255] [DEBUG] [LOCAL ] PARR: Derivative data saved (1794 records). [2025-10-22T22:13:15.692897] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-10-22T22:13:15.695443] [INFO ] [MAIN ] Derivative Progress: 1377/2052 symbols completed. PARR took 1.0s. Estimated remaining: 4m 14s. Rate: 159.3 symbols/min [2025-10-22T22:13:15.695592] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:15.815872] [DEBUG] [LOCAL ] PATH: Loaded 53680 existing records from primary storage. [2025-10-22T22:13:15.816084] [INFO ] [MAIN ] PATH: Loaded 53680 primary data records. [2025-10-22T22:13:16.222061] [DEBUG] [LOCAL ] PAY: Loaded 38615 existing records from primary storage. [2025-10-22T22:13:16.229455] [INFO ] [MAIN ] PAY: Loaded 38615 primary data records. [2025-10-22T22:13:16.671628] [DEBUG] [MAIN ] PAXS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:16.673628] [INFO ] [MAIN ] PAXS: Generated 1794 derivative records from 20921 primary records. [2025-10-22T22:13:16.675130] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-10-22T22:13:16.708060] [DEBUG] [MAIN ] PATH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:16.709194] [INFO ] [MAIN ] PATH: Generated 1794 derivative records from 53680 primary records. [2025-10-22T22:13:16.707767] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1794 records). [2025-10-22T22:13:16.709412] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-10-22T22:13:16.711625] [INFO ] [MAIN ] Derivative Progress: 1378/2052 symbols completed. PAXS took 1.1s. Estimated remaining: 4m 14s. Rate: 159.1 symbols/min [2025-10-22T22:13:16.712233] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-10-22T22:13:16.728406] [DEBUG] [LOCAL ] PATH: Derivative data saved (1794 records). [2025-10-22T22:13:16.728581] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-10-22T22:13:16.730935] [INFO ] [MAIN ] Derivative Progress: 1379/2052 symbols completed. PATH took 1.1s. Estimated remaining: 4m 14s. Rate: 159.2 symbols/min [2025-10-22T22:13:16.745461] [DEBUG] [MAIN ] PAY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:16.746009] [INFO ] [MAIN ] PAY: Generated 1794 derivative records from 38615 primary records. [2025-10-22T22:13:16.746066] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-10-22T22:13:16.763885] [DEBUG] [LOCAL ] PAY: Derivative data saved (1794 records). [2025-10-22T22:13:16.763943] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-10-22T22:13:16.766374] [INFO ] [MAIN ] Derivative Progress: 1380/2052 symbols completed. PAY took 1.1s. Estimated remaining: 4m 13s. Rate: 159.3 symbols/min [2025-10-22T22:13:16.766803] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:16.766893] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:16.766983] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:16.821079] [DEBUG] [LOCAL ] PAYC: Loaded 36051 existing records from primary storage. [2025-10-22T22:13:16.831914] [INFO ] [MAIN ] PAYC: Loaded 36051 primary data records. [2025-10-22T22:13:16.927155] [DEBUG] [LOCAL ] PBA: Loaded 49189 existing records from primary storage. [2025-10-22T22:13:16.921228] [DEBUG] [LOCAL ] PB: Loaded 42332 existing records from primary storage. [2025-10-22T22:13:16.932609] [INFO ] [MAIN ] PB: Loaded 42332 primary data records. [2025-10-22T22:13:16.938242] [INFO ] [MAIN ] PBA: Loaded 49189 primary data records. [2025-10-22T22:13:17.801987] [DEBUG] [MAIN ] PAYC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:13:17.803030] [INFO ] [MAIN ] PAYC: Generated 1793 derivative records from 36051 primary records. [2025-10-22T22:13:17.810596] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-10-22T22:13:17.816590] [DEBUG] [MAIN ] PB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:17.824585] [INFO ] [MAIN ] PB: Generated 1794 derivative records from 42332 primary records. [2025-10-22T22:13:17.831636] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-10-22T22:13:17.838273] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1793 records). [2025-10-22T22:13:17.838397] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-10-22T22:13:17.840592] [INFO ] [MAIN ] Derivative Progress: 1381/2052 symbols completed. PAYC took 1.1s. Estimated remaining: 4m 13s. Rate: 159.1 symbols/min [2025-10-22T22:13:17.840798] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:17.853847] [DEBUG] [MAIN ] PBA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:17.854685] [INFO ] [MAIN ] PBA: Generated 1794 derivative records from 49189 primary records. [2025-10-22T22:13:17.861824] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-10-22T22:13:17.885483] [DEBUG] [LOCAL ] PB: Derivative data saved (1794 records). [2025-10-22T22:13:17.885694] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-10-22T22:13:17.886721] [DEBUG] [LOCAL ] PBA: Derivative data saved (1794 records). [2025-10-22T22:13:17.889292] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-10-22T22:13:17.889096] [INFO ] [MAIN ] Derivative Progress: 1382/2052 symbols completed. PB took 1.1s. Estimated remaining: 4m 13s. Rate: 159.2 symbols/min [2025-10-22T22:13:17.892002] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:17.892507] [INFO ] [MAIN ] Derivative Progress: 1383/2052 symbols completed. PBA took 1.1s. Estimated remaining: 4m 12s. Rate: 159.3 symbols/min [2025-10-22T22:13:17.892598] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:17.944708] [DEBUG] [LOCAL ] PBH: Loaded 32424 existing records from primary storage. [2025-10-22T22:13:17.959161] [INFO ] [MAIN ] PBH: Loaded 32424 primary data records. [2025-10-22T22:13:17.991261] [DEBUG] [LOCAL ] PBF: Loaded 53104 existing records from primary storage. [2025-10-22T22:13:18.036577] [INFO ] [MAIN ] PBF: Loaded 53104 primary data records. [2025-10-22T22:13:18.114968] [DEBUG] [LOCAL ] PBI: Loaded 49986 existing records from primary storage. [2025-10-22T22:13:18.155842] [INFO ] [MAIN ] PBI: Loaded 49986 primary data records. [2025-10-22T22:13:18.904354] [DEBUG] [MAIN ] PBF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:18.905088] [DEBUG] [MAIN ] PBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:18.905774] [INFO ] [MAIN ] PBF: Generated 1794 derivative records from 53104 primary records. [2025-10-22T22:13:18.905984] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-10-22T22:13:18.906620] [INFO ] [MAIN ] PBH: Generated 1794 derivative records from 32424 primary records. [2025-10-22T22:13:18.906874] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-10-22T22:13:18.939210] [DEBUG] [LOCAL ] PBH: Derivative data saved (1794 records). [2025-10-22T22:13:18.940321] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-10-22T22:13:18.942292] [INFO ] [MAIN ] Derivative Progress: 1384/2052 symbols completed. PBH took 1.1s. Estimated remaining: 4m 12s. Rate: 159.1 symbols/min [2025-10-22T22:13:18.940255] [DEBUG] [LOCAL ] PBF: Derivative data saved (1794 records). [2025-10-22T22:13:18.942502] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:18.955119] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-10-22T22:13:18.955620] [DEBUG] [MAIN ] PBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:18.958006] [INFO ] [MAIN ] Derivative Progress: 1385/2052 symbols completed. PBF took 1.1s. Estimated remaining: 4m 11s. Rate: 159.2 symbols/min [2025-10-22T22:13:18.958244] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:18.959119] [INFO ] [MAIN ] PBI: Generated 1794 derivative records from 49986 primary records. [2025-10-22T22:13:18.959254] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-10-22T22:13:18.976328] [DEBUG] [LOCAL ] PBI: Derivative data saved (1794 records). [2025-10-22T22:13:18.976540] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-10-22T22:13:18.979572] [INFO ] [MAIN ] Derivative Progress: 1386/2052 symbols completed. PBI took 1.1s. Estimated remaining: 4m 11s. Rate: 159.3 symbols/min [2025-10-22T22:13:18.983932] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:18.992591] [DEBUG] [LOCAL ] PBT: Loaded 17314 existing records from primary storage. [2025-10-22T22:13:18.992808] [INFO ] [MAIN ] PBT: Loaded 17314 primary data records. [2025-10-22T22:13:19.104368] [DEBUG] [LOCAL ] PCF: Loaded 9086 existing records from primary storage. [2025-10-22T22:13:19.115948] [INFO ] [MAIN ] PCF: Loaded 9086 primary data records. [2025-10-22T22:13:19.211986] [DEBUG] [LOCAL ] PBR: Loaded 53713 existing records from primary storage. [2025-10-22T22:13:19.233049] [INFO ] [MAIN ] PBR: Loaded 53713 primary data records. [2025-10-22T22:13:19.989592] [DEBUG] [MAIN ] PBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:19.991150] [INFO ] [MAIN ] PBT: Generated 1794 derivative records from 17314 primary records. [2025-10-22T22:13:19.991279] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-10-22T22:13:20.012411] [DEBUG] [LOCAL ] PBT: Derivative data saved (1794 records). [2025-10-22T22:13:20.012697] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-10-22T22:13:20.014598] [INFO ] [MAIN ] Derivative Progress: 1387/2052 symbols completed. PBT took 1.1s. Estimated remaining: 4m 11s. Rate: 159.1 symbols/min [2025-10-22T22:13:20.015089] [INFO ] [MAIN ] PCG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:20.036199] [DEBUG] [MAIN ] PBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:20.041328] [DEBUG] [MAIN ] PCF: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:13:20.042390] [INFO ] [MAIN ] PCF: Generated 1793 derivative records from 9086 primary records. [2025-10-22T22:13:20.042909] [INFO ] [MAIN ] PBR: Generated 1794 derivative records from 53713 primary records. [2025-10-22T22:13:20.042549] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-10-22T22:13:20.043929] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-10-22T22:13:20.076265] [DEBUG] [LOCAL ] PCF: Derivative data saved (1793 records). [2025-10-22T22:13:20.076478] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-10-22T22:13:20.074560] [DEBUG] [LOCAL ] PBR: Derivative data saved (1794 records). [2025-10-22T22:13:20.076719] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-10-22T22:13:20.079549] [INFO ] [MAIN ] Derivative Progress: 1388/2052 symbols completed. PBR took 1.1s. Estimated remaining: 4m 10s. Rate: 159.2 symbols/min [2025-10-22T22:13:20.082053] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:20.082150] [INFO ] [MAIN ] Derivative Progress: 1389/2052 symbols completed. PCF took 1.1s. Estimated remaining: 4m 10s. Rate: 159.3 symbols/min [2025-10-22T22:13:20.082627] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:20.091076] [DEBUG] [LOCAL ] PCM: Loaded 6875 existing records from primary storage. [2025-10-22T22:13:20.104307] [INFO ] [MAIN ] PCM: Loaded 6875 primary data records. [2025-10-22T22:13:20.225187] [DEBUG] [LOCAL ] PCN: Loaded 25332 existing records from primary storage. [2025-10-22T22:13:20.256288] [DEBUG] [LOCAL ] PCG: Loaded 53719 existing records from primary storage. [2025-10-22T22:13:20.239926] [INFO ] [MAIN ] PCN: Loaded 25332 primary data records. [2025-10-22T22:13:20.261562] [INFO ] [MAIN ] PCG: Loaded 53719 primary data records. [2025-10-22T22:13:21.094939] [DEBUG] [MAIN ] PCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:21.097113] [INFO ] [MAIN ] PCM: Generated 1794 derivative records from 6875 primary records. [2025-10-22T22:13:21.097390] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-10-22T22:13:21.114507] [DEBUG] [LOCAL ] PCM: Derivative data saved (1794 records). [2025-10-22T22:13:21.115413] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-10-22T22:13:21.129371] [INFO ] [MAIN ] Derivative Progress: 1390/2052 symbols completed. PCM took 1.0s. Estimated remaining: 4m 10s. Rate: 159.1 symbols/min [2025-10-22T22:13:21.131196] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:21.132362] [DEBUG] [MAIN ] PCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:21.145131] [INFO ] [MAIN ] PCN: Generated 1794 derivative records from 25332 primary records. [2025-10-22T22:13:21.145398] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-10-22T22:13:21.146288] [DEBUG] [MAIN ] PCG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:21.147045] [INFO ] [MAIN ] PCG: Generated 1794 derivative records from 53719 primary records. [2025-10-22T22:13:21.147584] [DEBUG] [LOCAL ] PCG: Saving derivative data. [2025-10-22T22:13:21.171780] [DEBUG] [LOCAL ] PCN: Derivative data saved (1794 records). [2025-10-22T22:13:21.171975] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-10-22T22:13:21.176723] [INFO ] [MAIN ] Derivative Progress: 1391/2052 symbols completed. PCN took 1.1s. Estimated remaining: 4m 9s. Rate: 159.2 symbols/min [2025-10-22T22:13:21.176901] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:21.181959] [DEBUG] [LOCAL ] PCG: Derivative data saved (1794 records). [2025-10-22T22:13:21.182118] [INFO ] [MAIN ] PCG: Successfully saved derivative data. [2025-10-22T22:13:21.184887] [INFO ] [MAIN ] Derivative Progress: 1392/2052 symbols completed. PCG took 1.2s. Estimated remaining: 4m 9s. Rate: 159.3 symbols/min [2025-10-22T22:13:21.185317] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:21.207821] [DEBUG] [LOCAL ] PCQ: Loaded 12114 existing records from primary storage. [2025-10-22T22:13:21.208003] [INFO ] [MAIN ] PCQ: Loaded 12114 primary data records. [2025-10-22T22:13:21.325716] [DEBUG] [LOCAL ] PCOR: Loaded 47461 existing records from primary storage. [2025-10-22T22:13:21.333938] [INFO ] [MAIN ] PCOR: Loaded 47461 primary data records. [2025-10-22T22:13:21.513530] [DEBUG] [LOCAL ] PD: Loaded 48330 existing records from primary storage. [2025-10-22T22:13:21.645042] [INFO ] [MAIN ] PD: Loaded 48330 primary data records. [2025-10-22T22:13:22.176164] [DEBUG] [MAIN ] PCQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:22.179217] [INFO ] [MAIN ] PCQ: Generated 1794 derivative records from 12114 primary records. [2025-10-22T22:13:22.179991] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-10-22T22:13:22.208484] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1794 records). [2025-10-22T22:13:22.208761] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-10-22T22:13:22.211038] [INFO ] [MAIN ] Derivative Progress: 1393/2052 symbols completed. PCQ took 1.0s. Estimated remaining: 4m 8s. Rate: 159.1 symbols/min [2025-10-22T22:13:22.211495] [DEBUG] [MAIN ] PCOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:22.212754] [INFO ] [MAIN ] PCOR: Generated 1794 derivative records from 47461 primary records. [2025-10-22T22:13:22.212974] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-10-22T22:13:22.244490] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1794 records). [2025-10-22T22:13:22.244840] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-10-22T22:13:22.247382] [INFO ] [MAIN ] Derivative Progress: 1394/2052 symbols completed. PCOR took 1.1s. Estimated remaining: 4m 8s. Rate: 159.2 symbols/min [2025-10-22T22:13:22.244762] [DEBUG] [MAIN ] PD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:22.249055] [INFO ] [MAIN ] PD: Generated 1794 derivative records from 48330 primary records. [2025-10-22T22:13:22.249174] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-10-22T22:13:22.265741] [DEBUG] [LOCAL ] PD: Derivative data saved (1794 records). [2025-10-22T22:13:22.265833] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-10-22T22:13:22.269302] [INFO ] [MAIN ] Derivative Progress: 1395/2052 symbols completed. PD took 1.1s. Estimated remaining: 4m 7s. Rate: 159.3 symbols/min [2025-10-22T22:13:22.269825] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:22.269901] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:22.270110] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:22.323328] [DEBUG] [LOCAL ] PDM: Loaded 39741 existing records from primary storage. [2025-10-22T22:13:22.323558] [INFO ] [MAIN ] PDM: Loaded 39741 primary data records. [2025-10-22T22:13:22.451233] [DEBUG] [LOCAL ] PDI: Loaded 50186 existing records from primary storage. [2025-10-22T22:13:22.452080] [DEBUG] [LOCAL ] PDO: Loaded 31375 existing records from primary storage. [2025-10-22T22:13:22.452548] [INFO ] [MAIN ] PDI: Loaded 50186 primary data records. [2025-10-22T22:13:22.453043] [INFO ] [MAIN ] PDO: Loaded 31375 primary data records. [2025-10-22T22:13:23.325305] [DEBUG] [MAIN ] PDM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:23.326581] [INFO ] [MAIN ] PDM: Generated 1794 derivative records from 39741 primary records. [2025-10-22T22:13:23.326835] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-10-22T22:13:23.344255] [DEBUG] [LOCAL ] PDM: Derivative data saved (1794 records). [2025-10-22T22:13:23.344534] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-10-22T22:13:23.346828] [INFO ] [MAIN ] Derivative Progress: 1396/2052 symbols completed. PDM took 1.1s. Estimated remaining: 4m 7s. Rate: 159.1 symbols/min [2025-10-22T22:13:23.347077] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:23.375134] [DEBUG] [MAIN ] PDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:23.380386] [DEBUG] [MAIN ] PDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:23.382551] [INFO ] [MAIN ] PDO: Generated 1794 derivative records from 31375 primary records. [2025-10-22T22:13:23.382712] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-10-22T22:13:23.381638] [INFO ] [MAIN ] PDI: Generated 1794 derivative records from 50186 primary records. [2025-10-22T22:13:23.388348] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-10-22T22:13:23.418515] [DEBUG] [LOCAL ] PDO: Derivative data saved (1794 records). [2025-10-22T22:13:23.423860] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-10-22T22:13:23.428021] [INFO ] [MAIN ] Derivative Progress: 1397/2052 symbols completed. PDO took 1.2s. Estimated remaining: 4m 7s. Rate: 159.2 symbols/min [2025-10-22T22:13:23.428616] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:23.428425] [DEBUG] [LOCAL ] PDS: Loaded 16604 existing records from primary storage. [2025-10-22T22:13:23.425513] [DEBUG] [LOCAL ] PDI: Derivative data saved (1794 records). [2025-10-22T22:13:23.429310] [INFO ] [MAIN ] PDS: Loaded 16604 primary data records. [2025-10-22T22:13:23.429370] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-10-22T22:13:23.443677] [INFO ] [MAIN ] Derivative Progress: 1398/2052 symbols completed. PDI took 1.2s. Estimated remaining: 4m 6s. Rate: 159.3 symbols/min [2025-10-22T22:13:23.443966] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:23.579391] [DEBUG] [LOCAL ] PDT: Loaded 17437 existing records from primary storage. [2025-10-22T22:13:23.590252] [DEBUG] [LOCAL ] PDX: Loaded 14138 existing records from primary storage. [2025-10-22T22:13:23.613170] [INFO ] [MAIN ] PDX: Loaded 14138 primary data records. [2025-10-22T22:13:23.618427] [INFO ] [MAIN ] PDT: Loaded 17437 primary data records. [2025-10-22T22:13:24.430835] [DEBUG] [MAIN ] PDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:24.432011] [INFO ] [MAIN ] PDS: Generated 1794 derivative records from 16604 primary records. [2025-10-22T22:13:24.433388] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-10-22T22:13:24.451980] [DEBUG] [LOCAL ] PDS: Derivative data saved (1794 records). [2025-10-22T22:13:24.452416] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-10-22T22:13:24.454780] [INFO ] [MAIN ] Derivative Progress: 1399/2052 symbols completed. PDS took 1.1s. Estimated remaining: 4m 6s. Rate: 159.1 symbols/min [2025-10-22T22:13:24.455056] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:24.473142] [DEBUG] [MAIN ] PDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:24.475163] [INFO ] [MAIN ] PDX: Generated 1794 derivative records from 14138 primary records. [2025-10-22T22:13:24.475293] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-10-22T22:13:24.509055] [DEBUG] [LOCAL ] PDX: Derivative data saved (1794 records). [2025-10-22T22:13:24.509546] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-10-22T22:13:24.512009] [INFO ] [MAIN ] Derivative Progress: 1400/2052 symbols completed. PDX took 1.1s. Estimated remaining: 4m 6s. Rate: 159.2 symbols/min [2025-10-22T22:13:24.512258] [INFO ] [MAIN ] PEG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:24.512815] [DEBUG] [MAIN ] PDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:24.514246] [INFO ] [MAIN ] PDT: Generated 1794 derivative records from 17437 primary records. [2025-10-22T22:13:24.514377] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-10-22T22:13:24.532357] [DEBUG] [LOCAL ] PDT: Derivative data saved (1794 records). [2025-10-22T22:13:24.532584] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-10-22T22:13:24.535332] [INFO ] [MAIN ] Derivative Progress: 1401/2052 symbols completed. PDT took 1.1s. Estimated remaining: 4m 5s. Rate: 159.3 symbols/min [2025-10-22T22:13:24.535569] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:24.586263] [DEBUG] [LOCAL ] PEB: Loaded 50732 existing records from primary storage. [2025-10-22T22:13:24.593048] [INFO ] [MAIN ] PEB: Loaded 50732 primary data records. [2025-10-22T22:13:24.691602] [DEBUG] [LOCAL ] PEG: Loaded 53124 existing records from primary storage. [2025-10-22T22:13:24.723203] [INFO ] [MAIN ] PEG: Loaded 53124 primary data records. [2025-10-22T22:13:24.735278] [DEBUG] [LOCAL ] PEN: Loaded 29554 existing records from primary storage. [2025-10-22T22:13:24.762090] [INFO ] [MAIN ] PEN: Loaded 29554 primary data records. [2025-10-22T22:13:25.640317] [DEBUG] [MAIN ] PEB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:25.642908] [INFO ] [MAIN ] PEB: Generated 1794 derivative records from 50732 primary records. [2025-10-22T22:13:25.643270] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-10-22T22:13:25.689443] [DEBUG] [LOCAL ] PEB: Derivative data saved (1794 records). [2025-10-22T22:13:25.684512] [DEBUG] [MAIN ] PEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:25.691187] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-10-22T22:13:25.693140] [INFO ] [MAIN ] Derivative Progress: 1402/2052 symbols completed. PEB took 1.2s. Estimated remaining: 4m 5s. Rate: 159.1 symbols/min [2025-10-22T22:13:25.691068] [INFO ] [MAIN ] PEG: Generated 1794 derivative records from 53124 primary records. [2025-10-22T22:13:25.693769] [DEBUG] [LOCAL ] PEG: Saving derivative data. [2025-10-22T22:13:25.693584] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:25.713059] [DEBUG] [MAIN ] PEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:25.714324] [INFO ] [MAIN ] PEN: Generated 1794 derivative records from 29554 primary records. [2025-10-22T22:13:25.714480] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-10-22T22:13:25.739680] [DEBUG] [LOCAL ] PEG: Derivative data saved (1794 records). [2025-10-22T22:13:25.740538] [INFO ] [MAIN ] PEG: Successfully saved derivative data. [2025-10-22T22:13:25.744507] [INFO ] [MAIN ] Derivative Progress: 1403/2052 symbols completed. PEG took 1.2s. Estimated remaining: 4m 5s. Rate: 159.2 symbols/min [2025-10-22T22:13:25.762252] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:25.761803] [DEBUG] [LOCAL ] PEO: Loaded 11042 existing records from primary storage. [2025-10-22T22:13:25.768237] [DEBUG] [LOCAL ] PEN: Derivative data saved (1794 records). [2025-10-22T22:13:25.768462] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-10-22T22:13:25.771150] [INFO ] [MAIN ] Derivative Progress: 1404/2052 symbols completed. PEN took 1.2s. Estimated remaining: 4m 4s. Rate: 159.3 symbols/min [2025-10-22T22:13:25.771406] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:25.766895] [INFO ] [MAIN ] PEO: Loaded 11042 primary data records. [2025-10-22T22:13:25.880202] [DEBUG] [LOCAL ] PERF: Loaded 14512 existing records from primary storage. [2025-10-22T22:13:25.912933] [DEBUG] [LOCAL ] PFD: Loaded 5349 existing records from primary storage. [2025-10-22T22:13:25.918890] [INFO ] [MAIN ] PFD: Loaded 5349 primary data records. [2025-10-22T22:13:25.919037] [INFO ] [MAIN ] PERF: Loaded 14512 primary data records. [2025-10-22T22:13:26.966113] [DEBUG] [MAIN ] PEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:26.967216] [INFO ] [MAIN ] PEO: Generated 1794 derivative records from 11042 primary records. [2025-10-22T22:13:26.967420] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-10-22T22:13:26.984255] [DEBUG] [LOCAL ] PEO: Derivative data saved (1794 records). [2025-10-22T22:13:26.984660] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-10-22T22:13:26.988348] [INFO ] [MAIN ] Derivative Progress: 1405/2052 symbols completed. PEO took 1.3s. Estimated remaining: 4m 4s. Rate: 159.1 symbols/min [2025-10-22T22:13:26.989342] [INFO ] [MAIN ] PFE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:27.004525] [DEBUG] [MAIN ] PFD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:27.006089] [INFO ] [MAIN ] PFD: Generated 1794 derivative records from 5349 primary records. [2025-10-22T22:13:27.006371] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-10-22T22:13:27.031917] [DEBUG] [MAIN ] PERF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:27.035127] [INFO ] [MAIN ] PERF: Generated 1794 derivative records from 14512 primary records. [2025-10-22T22:13:27.035888] [DEBUG] [LOCAL ] PFD: Derivative data saved (1794 records). [2025-10-22T22:13:27.036147] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-10-22T22:13:27.036083] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-10-22T22:13:27.039368] [INFO ] [MAIN ] Derivative Progress: 1406/2052 symbols completed. PFD took 1.3s. Estimated remaining: 4m 4s. Rate: 159.2 symbols/min [2025-10-22T22:13:27.039807] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:27.055357] [DEBUG] [LOCAL ] PERF: Derivative data saved (1794 records). [2025-10-22T22:13:27.055621] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-10-22T22:13:27.058196] [INFO ] [MAIN ] Derivative Progress: 1407/2052 symbols completed. PERF took 1.3s. Estimated remaining: 4m 3s. Rate: 159.3 symbols/min [2025-10-22T22:13:27.058495] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:27.079971] [DEBUG] [LOCAL ] PFH: Loaded 6414 existing records from primary storage. [2025-10-22T22:13:27.080234] [INFO ] [MAIN ] PFH: Loaded 6414 primary data records. [2025-10-22T22:13:27.217215] [DEBUG] [LOCAL ] PFE: Loaded 53813 existing records from primary storage. [2025-10-22T22:13:27.232989] [INFO ] [MAIN ] PFE: Loaded 53813 primary data records. [2025-10-22T22:13:27.539199] [DEBUG] [LOCAL ] PFGC: Loaded 46794 existing records from primary storage. [2025-10-22T22:13:27.546298] [INFO ] [MAIN ] PFGC: Loaded 46794 primary data records. [2025-10-22T22:13:28.054925] [DEBUG] [MAIN ] PFH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:28.056251] [INFO ] [MAIN ] PFH: Generated 1794 derivative records from 6414 primary records. [2025-10-22T22:13:28.056564] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-10-22T22:13:28.073521] [DEBUG] [LOCAL ] PFH: Derivative data saved (1794 records). [2025-10-22T22:13:28.074675] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-10-22T22:13:28.076829] [INFO ] [MAIN ] Derivative Progress: 1408/2052 symbols completed. PFH took 1.0s. Estimated remaining: 4m 3s. Rate: 159.1 symbols/min [2025-10-22T22:13:28.092729] [DEBUG] [MAIN ] PFE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:28.093564] [INFO ] [MAIN ] PFE: Generated 1794 derivative records from 53813 primary records. [2025-10-22T22:13:28.093783] [DEBUG] [LOCAL ] PFE: Saving derivative data. [2025-10-22T22:13:28.112795] [DEBUG] [LOCAL ] PFE: Derivative data saved (1794 records). [2025-10-22T22:13:28.113486] [INFO ] [MAIN ] PFE: Successfully saved derivative data. [2025-10-22T22:13:28.115880] [INFO ] [MAIN ] Derivative Progress: 1409/2052 symbols completed. PFE took 1.1s. Estimated remaining: 4m 2s. Rate: 159.2 symbols/min [2025-10-22T22:13:28.128485] [DEBUG] [MAIN ] PFGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:28.129106] [INFO ] [MAIN ] PFGC: Generated 1794 derivative records from 46794 primary records. [2025-10-22T22:13:28.129167] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-10-22T22:13:28.143878] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1794 records). [2025-10-22T22:13:28.143933] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-10-22T22:13:28.146264] [INFO ] [MAIN ] Derivative Progress: 1410/2052 symbols completed. PFGC took 1.1s. Estimated remaining: 4m 2s. Rate: 159.3 symbols/min [2025-10-22T22:13:28.146834] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:28.146781] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:28.147110] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:28.168057] [DEBUG] [LOCAL ] PFL: Loaded 14446 existing records from primary storage. [2025-10-22T22:13:28.168197] [INFO ] [MAIN ] PFL: Loaded 14446 primary data records. [2025-10-22T22:13:28.275618] [DEBUG] [LOCAL ] PFN: Loaded 22150 existing records from primary storage. [2025-10-22T22:13:28.286610] [INFO ] [MAIN ] PFN: Loaded 22150 primary data records. [2025-10-22T22:13:28.599569] [DEBUG] [LOCAL ] PFLT: Loaded 44240 existing records from primary storage. [2025-10-22T22:13:28.637379] [INFO ] [MAIN ] PFLT: Loaded 44240 primary data records. [2025-10-22T22:13:29.226753] [DEBUG] [MAIN ] PFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:29.228725] [INFO ] [MAIN ] PFL: Generated 1794 derivative records from 14446 primary records. [2025-10-22T22:13:29.229121] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-10-22T22:13:29.251192] [DEBUG] [LOCAL ] PFL: Derivative data saved (1794 records). [2025-10-22T22:13:29.251714] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-10-22T22:13:29.267077] [INFO ] [MAIN ] Derivative Progress: 1411/2052 symbols completed. PFL took 1.1s. Estimated remaining: 4m 2s. Rate: 159.1 symbols/min [2025-10-22T22:13:29.267285] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:29.268440] [DEBUG] [MAIN ] PFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:29.269766] [INFO ] [MAIN ] PFN: Generated 1794 derivative records from 22150 primary records. [2025-10-22T22:13:29.269852] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-10-22T22:13:29.287244] [DEBUG] [LOCAL ] PFN: Derivative data saved (1794 records). [2025-10-22T22:13:29.294093] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-10-22T22:13:29.296442] [INFO ] [MAIN ] Derivative Progress: 1412/2052 symbols completed. PFN took 1.1s. Estimated remaining: 4m 1s. Rate: 159.2 symbols/min [2025-10-22T22:13:29.296691] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:29.305004] [DEBUG] [LOCAL ] PFO: Loaded 6073 existing records from primary storage. [2025-10-22T22:13:29.305599] [INFO ] [MAIN ] PFO: Loaded 6073 primary data records. [2025-10-22T22:13:29.419051] [DEBUG] [MAIN ] PFLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:29.432733] [INFO ] [MAIN ] PFLT: Generated 1794 derivative records from 44240 primary records. [2025-10-22T22:13:29.443861] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-10-22T22:13:29.709539] [DEBUG] [LOCAL ] PFS: Loaded 35666 existing records from primary storage. [2025-10-22T22:13:29.710616] [INFO ] [MAIN ] PFS: Loaded 35666 primary data records. [2025-10-22T22:13:29.740923] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1794 records). [2025-10-22T22:13:29.763348] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-10-22T22:13:29.791508] [INFO ] [MAIN ] Derivative Progress: 1413/2052 symbols completed. PFLT took 1.6s. Estimated remaining: 4m 1s. Rate: 159.1 symbols/min [2025-10-22T22:13:29.818056] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:30.115683] [DEBUG] [MAIN ] PFO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:30.116667] [INFO ] [MAIN ] PFO: Generated 1794 derivative records from 6073 primary records. [2025-10-22T22:13:30.116870] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-10-22T22:13:30.119573] [DEBUG] [LOCAL ] PFSI: Loaded 29100 existing records from primary storage. [2025-10-22T22:13:30.120371] [INFO ] [MAIN ] PFSI: Loaded 29100 primary data records. [2025-10-22T22:13:30.233526] [DEBUG] [LOCAL ] PFO: Derivative data saved (1794 records). [2025-10-22T22:13:30.242100] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-10-22T22:13:30.249289] [INFO ] [MAIN ] Derivative Progress: 1414/2052 symbols completed. PFO took 1.0s. Estimated remaining: 4m 1s. Rate: 159.1 symbols/min [2025-10-22T22:13:30.249904] [INFO ] [MAIN ] PG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:30.476454] [DEBUG] [MAIN ] PFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:30.478446] [INFO ] [MAIN ] PFS: Generated 1794 derivative records from 35666 primary records. [2025-10-22T22:13:30.479291] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-10-22T22:13:30.499143] [DEBUG] [LOCAL ] PFS: Derivative data saved (1794 records). [2025-10-22T22:13:30.499573] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-10-22T22:13:30.503141] [INFO ] [MAIN ] Derivative Progress: 1415/2052 symbols completed. PFS took 1.2s. Estimated remaining: 4m 0s. Rate: 159.1 symbols/min [2025-10-22T22:13:30.503443] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:30.528678] [DEBUG] [LOCAL ] PGP: Loaded 5642 existing records from primary storage. [2025-10-22T22:13:30.529413] [INFO ] [MAIN ] PGP: Loaded 5642 primary data records. [2025-10-22T22:13:30.611765] [DEBUG] [MAIN ] PFSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:30.648174] [DEBUG] [LOCAL ] PG: Loaded 53753 existing records from primary storage. [2025-10-22T22:13:30.649460] [INFO ] [MAIN ] PFSI: Generated 1794 derivative records from 29100 primary records. [2025-10-22T22:13:30.665292] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-10-22T22:13:30.665439] [INFO ] [MAIN ] PG: Loaded 53753 primary data records. [2025-10-22T22:13:30.860772] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1794 records). [2025-10-22T22:13:30.873911] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-10-22T22:13:30.890901] [INFO ] [MAIN ] Derivative Progress: 1416/2052 symbols completed. PFSI took 1.1s. Estimated remaining: 3m 60s. Rate: 159.1 symbols/min [2025-10-22T22:13:30.909312] [INFO ] [MAIN ] PGR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:31.380600] [DEBUG] [MAIN ] PG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:31.381914] [DEBUG] [LOCAL ] PGR: Loaded 52867 existing records from primary storage. [2025-10-22T22:13:31.382880] [INFO ] [MAIN ] PG: Generated 1794 derivative records from 53753 primary records. [2025-10-22T22:13:31.382987] [DEBUG] [LOCAL ] PG: Saving derivative data. [2025-10-22T22:13:31.382050] [INFO ] [MAIN ] PGR: Loaded 52867 primary data records. [2025-10-22T22:13:31.432767] [DEBUG] [MAIN ] PGP: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:13:31.464583] [INFO ] [MAIN ] PGP: Generated 1793 derivative records from 5642 primary records. [2025-10-22T22:13:31.490799] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-10-22T22:13:31.490688] [DEBUG] [LOCAL ] PG: Derivative data saved (1794 records). [2025-10-22T22:13:31.549911] [INFO ] [MAIN ] PG: Successfully saved derivative data. [2025-10-22T22:13:31.550060] [DEBUG] [LOCAL ] PGP: Derivative data saved (1793 records). [2025-10-22T22:13:31.554050] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-10-22T22:13:31.553816] [INFO ] [MAIN ] Derivative Progress: 1417/2052 symbols completed. PG took 1.3s. Estimated remaining: 3m 60s. Rate: 159.0 symbols/min [2025-10-22T22:13:31.563883] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:31.574422] [INFO ] [MAIN ] Derivative Progress: 1418/2052 symbols completed. PGP took 1.1s. Estimated remaining: 3m 59s. Rate: 159.2 symbols/min [2025-10-22T22:13:31.611698] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:31.779380] [DEBUG] [LOCAL ] PGZ: Loaded 5498 existing records from primary storage. [2025-10-22T22:13:31.779852] [INFO ] [MAIN ] PGZ: Loaded 5498 primary data records. [2025-10-22T22:13:31.960348] [DEBUG] [LOCAL ] PGRE: Loaded 46946 existing records from primary storage. [2025-10-22T22:13:31.995584] [INFO ] [MAIN ] PGRE: Loaded 46946 primary data records. [2025-10-22T22:13:32.259321] [DEBUG] [MAIN ] PGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:32.266560] [INFO ] [MAIN ] PGR: Generated 1794 derivative records from 52867 primary records. [2025-10-22T22:13:32.272213] [DEBUG] [LOCAL ] PGR: Saving derivative data. [2025-10-22T22:13:32.466128] [DEBUG] [LOCAL ] PGR: Derivative data saved (1794 records). [2025-10-22T22:13:32.474747] [INFO ] [MAIN ] PGR: Successfully saved derivative data. [2025-10-22T22:13:32.477129] [INFO ] [MAIN ] Derivative Progress: 1419/2052 symbols completed. PGR took 1.6s. Estimated remaining: 3m 59s. Rate: 159.0 symbols/min [2025-10-22T22:13:32.477322] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:32.500370] [DEBUG] [MAIN ] PGZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:32.501453] [INFO ] [MAIN ] PGZ: Generated 1794 derivative records from 5498 primary records. [2025-10-22T22:13:32.501770] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-10-22T22:13:32.526897] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1794 records). [2025-10-22T22:13:32.527225] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-10-22T22:13:32.529554] [INFO ] [MAIN ] Derivative Progress: 1420/2052 symbols completed. PGZ took 0.9s. Estimated remaining: 3m 58s. Rate: 159.1 symbols/min [2025-10-22T22:13:32.530115] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:32.559046] [DEBUG] [LOCAL ] PH: Loaded 36514 existing records from primary storage. [2025-10-22T22:13:32.558458] [DEBUG] [MAIN ] PGRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:32.560141] [INFO ] [MAIN ] PGRE: Generated 1794 derivative records from 46946 primary records. [2025-10-22T22:13:32.560058] [INFO ] [MAIN ] PH: Loaded 36514 primary data records. [2025-10-22T22:13:32.560268] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-10-22T22:13:32.797516] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1794 records). [2025-10-22T22:13:32.870837] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-10-22T22:13:32.881816] [INFO ] [MAIN ] Derivative Progress: 1421/2052 symbols completed. PGRE took 1.3s. Estimated remaining: 3m 58s. Rate: 159.1 symbols/min [2025-10-22T22:13:32.882462] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:32.897245] [DEBUG] [LOCAL ] PHG: Loaded 45475 existing records from primary storage. [2025-10-22T22:13:32.898498] [INFO ] [MAIN ] PHG: Loaded 45475 primary data records. [2025-10-22T22:13:33.011466] [DEBUG] [LOCAL ] PHI: Loaded 15189 existing records from primary storage. [2025-10-22T22:13:33.022475] [INFO ] [MAIN ] PHI: Loaded 15189 primary data records. [2025-10-22T22:13:33.575775] [DEBUG] [MAIN ] PH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:33.576738] [INFO ] [MAIN ] PH: Generated 1794 derivative records from 36514 primary records. [2025-10-22T22:13:33.576964] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-10-22T22:13:33.597051] [DEBUG] [LOCAL ] PH: Derivative data saved (1794 records). [2025-10-22T22:13:33.597325] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-10-22T22:13:33.599922] [INFO ] [MAIN ] Derivative Progress: 1422/2052 symbols completed. PH took 1.1s. Estimated remaining: 3m 58s. Rate: 159.0 symbols/min [2025-10-22T22:13:33.600376] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:33.620424] [DEBUG] [MAIN ] PHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:33.621132] [INFO ] [MAIN ] PHG: Generated 1794 derivative records from 45475 primary records. [2025-10-22T22:13:33.621394] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-10-22T22:13:33.648262] [DEBUG] [LOCAL ] PHG: Derivative data saved (1794 records). [2025-10-22T22:13:33.648541] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-10-22T22:13:33.650752] [INFO ] [MAIN ] Derivative Progress: 1423/2052 symbols completed. PHG took 1.1s. Estimated remaining: 3m 57s. Rate: 159.1 symbols/min [2025-10-22T22:13:33.664340] [DEBUG] [MAIN ] PHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:33.665205] [INFO ] [MAIN ] PHI: Generated 1794 derivative records from 15189 primary records. [2025-10-22T22:13:33.665348] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-10-22T22:13:33.686694] [DEBUG] [LOCAL ] PHIN: Loaded 31408 existing records from primary storage. [2025-10-22T22:13:33.691205] [DEBUG] [LOCAL ] PHI: Derivative data saved (1794 records). [2025-10-22T22:13:33.691410] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-10-22T22:13:33.691322] [INFO ] [MAIN ] PHIN: Loaded 31408 primary data records. [2025-10-22T22:13:33.694084] [INFO ] [MAIN ] Derivative Progress: 1424/2052 symbols completed. PHI took 0.8s. Estimated remaining: 3m 57s. Rate: 159.2 symbols/min [2025-10-22T22:13:34.003792] [DEBUG] [MAIN ] PHIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:34.004438] [INFO ] [MAIN ] PHIN: Generated 1794 derivative records from 31408 primary records. [2025-10-22T22:13:34.004499] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-10-22T22:13:34.019432] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1794 records). [2025-10-22T22:13:34.019528] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-10-22T22:13:34.021698] [INFO ] [MAIN ] Derivative Progress: 1425/2052 symbols completed. PHIN took 0.4s. Estimated remaining: 3m 56s. Rate: 159.2 symbols/min [2025-10-22T22:13:34.022286] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:34.022218] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:34.022152] [INFO ] [MAIN ] PHM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:34.049009] [DEBUG] [LOCAL ] PHK: Loaded 26760 existing records from primary storage. [2025-10-22T22:13:34.049177] [INFO ] [MAIN ] PHK: Loaded 26760 primary data records. [2025-10-22T22:13:34.269759] [DEBUG] [LOCAL ] PHR: Loaded 37953 existing records from primary storage. [2025-10-22T22:13:34.389430] [INFO ] [MAIN ] PHR: Loaded 37953 primary data records. [2025-10-22T22:13:34.421480] [DEBUG] [LOCAL ] PHM: Loaded 51691 existing records from primary storage. [2025-10-22T22:13:34.457252] [INFO ] [MAIN ] PHM: Loaded 51691 primary data records. [2025-10-22T22:13:35.055175] [DEBUG] [MAIN ] PHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:35.057070] [INFO ] [MAIN ] PHK: Generated 1794 derivative records from 26760 primary records. [2025-10-22T22:13:35.058110] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-10-22T22:13:35.075749] [DEBUG] [LOCAL ] PHK: Derivative data saved (1794 records). [2025-10-22T22:13:35.075943] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-10-22T22:13:35.078466] [INFO ] [MAIN ] Derivative Progress: 1426/2052 symbols completed. PHK took 1.1s. Estimated remaining: 3m 56s. Rate: 159.0 symbols/min [2025-10-22T22:13:35.079170] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:35.099005] [DEBUG] [MAIN ] PHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:35.099794] [INFO ] [MAIN ] PHR: Generated 1794 derivative records from 37953 primary records. [2025-10-22T22:13:35.100148] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-10-22T22:13:35.119001] [DEBUG] [LOCAL ] PHR: Derivative data saved (1794 records). [2025-10-22T22:13:35.119125] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-10-22T22:13:35.121181] [INFO ] [MAIN ] Derivative Progress: 1427/2052 symbols completed. PHR took 1.1s. Estimated remaining: 3m 56s. Rate: 159.1 symbols/min [2025-10-22T22:13:35.121393] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:35.134553] [DEBUG] [MAIN ] PHM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:35.135171] [INFO ] [MAIN ] PHM: Generated 1794 derivative records from 51691 primary records. [2025-10-22T22:13:35.135274] [DEBUG] [LOCAL ] PHM: Saving derivative data. [2025-10-22T22:13:35.163726] [DEBUG] [LOCAL ] PHM: Derivative data saved (1794 records). [2025-10-22T22:13:35.167502] [INFO ] [MAIN ] PHM: Successfully saved derivative data. [2025-10-22T22:13:35.166779] [DEBUG] [LOCAL ] PIM: Loaded 4846 existing records from primary storage. [2025-10-22T22:13:35.170270] [INFO ] [MAIN ] PIM: Loaded 4846 primary data records. [2025-10-22T22:13:35.170049] [INFO ] [MAIN ] Derivative Progress: 1428/2052 symbols completed. PHM took 1.1s. Estimated remaining: 3m 55s. Rate: 159.2 symbols/min [2025-10-22T22:13:35.191116] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:35.266122] [DEBUG] [LOCAL ] PII: Loaded 48713 existing records from primary storage. [2025-10-22T22:13:35.287608] [INFO ] [MAIN ] PII: Loaded 48713 primary data records. [2025-10-22T22:13:35.480938] [DEBUG] [LOCAL ] PINE: Loaded 14383 existing records from primary storage. [2025-10-22T22:13:35.632713] [INFO ] [MAIN ] PINE: Loaded 14383 primary data records. [2025-10-22T22:13:36.136948] [DEBUG] [MAIN ] PIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:36.138895] [INFO ] [MAIN ] PIM: Generated 1794 derivative records from 4846 primary records. [2025-10-22T22:13:36.139481] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-10-22T22:13:36.161099] [DEBUG] [MAIN ] PII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:36.165333] [INFO ] [MAIN ] PII: Generated 1794 derivative records from 48713 primary records. [2025-10-22T22:13:36.165518] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-10-22T22:13:36.170446] [DEBUG] [LOCAL ] PIM: Derivative data saved (1794 records). [2025-10-22T22:13:36.177594] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-10-22T22:13:36.184275] [INFO ] [MAIN ] Derivative Progress: 1429/2052 symbols completed. PIM took 1.1s. Estimated remaining: 3m 55s. Rate: 159.0 symbols/min [2025-10-22T22:13:36.188749] [DEBUG] [LOCAL ] PII: Derivative data saved (1794 records). [2025-10-22T22:13:36.190133] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-10-22T22:13:36.193082] [INFO ] [MAIN ] Derivative Progress: 1430/2052 symbols completed. PII took 1.1s. Estimated remaining: 3m 55s. Rate: 159.1 symbols/min [2025-10-22T22:13:36.190353] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:36.193816] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:36.207709] [DEBUG] [MAIN ] PINE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:36.208388] [INFO ] [MAIN ] PINE: Generated 1794 derivative records from 14383 primary records. [2025-10-22T22:13:36.208476] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-10-22T22:13:36.224485] [DEBUG] [LOCAL ] PINE: Derivative data saved (1794 records). [2025-10-22T22:13:36.224679] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-10-22T22:13:36.230715] [INFO ] [MAIN ] Derivative Progress: 1431/2052 symbols completed. PINE took 1.0s. Estimated remaining: 3m 54s. Rate: 159.2 symbols/min [2025-10-22T22:13:36.231022] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:36.239029] [DEBUG] [LOCAL ] PIPR: Loaded 14992 existing records from primary storage. [2025-10-22T22:13:36.239216] [INFO ] [MAIN ] PIPR: Loaded 14992 primary data records. [2025-10-22T22:13:36.574738] [DEBUG] [LOCAL ] PJT: Loaded 21211 existing records from primary storage. [2025-10-22T22:13:36.576002] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-10-22T22:13:36.576742] [INFO ] [MAIN ] PJT: Loaded 21211 primary data records. [2025-10-22T22:13:36.576829] [INFO ] [MAIN ] PINS: Loaded 53693 primary data records. [2025-10-22T22:13:37.237497] [DEBUG] [MAIN ] PIPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:37.238347] [INFO ] [MAIN ] PIPR: Generated 1794 derivative records from 14992 primary records. [2025-10-22T22:13:37.238824] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-10-22T22:13:37.256564] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1794 records). [2025-10-22T22:13:37.256703] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-10-22T22:13:37.260077] [INFO ] [MAIN ] Derivative Progress: 1432/2052 symbols completed. PIPR took 1.1s. Estimated remaining: 3m 54s. Rate: 159.0 symbols/min [2025-10-22T22:13:37.262011] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:37.276283] [DEBUG] [MAIN ] PINS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:37.277101] [INFO ] [MAIN ] PINS: Generated 1794 derivative records from 53693 primary records. [2025-10-22T22:13:37.277261] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-10-22T22:13:37.305003] [DEBUG] [MAIN ] PJT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:13:37.307474] [INFO ] [MAIN ] PJT: Generated 1793 derivative records from 21211 primary records. [2025-10-22T22:13:37.309010] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-10-22T22:13:37.312432] [DEBUG] [LOCAL ] PINS: Derivative data saved (1794 records). [2025-10-22T22:13:37.320533] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-10-22T22:13:37.325381] [INFO ] [MAIN ] Derivative Progress: 1433/2052 symbols completed. PINS took 1.1s. Estimated remaining: 3m 53s. Rate: 159.1 symbols/min [2025-10-22T22:13:37.325624] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:37.330358] [DEBUG] [LOCAL ] PJT: Derivative data saved (1793 records). [2025-10-22T22:13:37.330508] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-10-22T22:13:37.332923] [INFO ] [MAIN ] Derivative Progress: 1434/2052 symbols completed. PJT took 1.1s. Estimated remaining: 3m 53s. Rate: 159.2 symbols/min [2025-10-22T22:13:37.333326] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:37.364006] [DEBUG] [LOCAL ] PKE: Loaded 14290 existing records from primary storage. [2025-10-22T22:13:37.364875] [INFO ] [MAIN ] PKE: Loaded 14290 primary data records. [2025-10-22T22:13:37.459912] [DEBUG] [LOCAL ] PK: Loaded 52755 existing records from primary storage. [2025-10-22T22:13:37.477152] [INFO ] [MAIN ] PK: Loaded 52755 primary data records. [2025-10-22T22:13:37.562472] [DEBUG] [LOCAL ] PKG: Loaded 38565 existing records from primary storage. [2025-10-22T22:13:37.587070] [INFO ] [MAIN ] PKG: Loaded 38565 primary data records. [2025-10-22T22:13:38.321086] [DEBUG] [MAIN ] PKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:38.322245] [INFO ] [MAIN ] PKE: Generated 1794 derivative records from 14290 primary records. [2025-10-22T22:13:38.322493] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-10-22T22:13:38.342119] [DEBUG] [LOCAL ] PKE: Derivative data saved (1794 records). [2025-10-22T22:13:38.342612] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-10-22T22:13:38.344780] [INFO ] [MAIN ] Derivative Progress: 1435/2052 symbols completed. PKE took 1.0s. Estimated remaining: 3m 53s. Rate: 159.0 symbols/min [2025-10-22T22:13:38.357136] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:38.358371] [DEBUG] [MAIN ] PKG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:13:38.359145] [INFO ] [MAIN ] PKG: Generated 1793 derivative records from 38565 primary records. [2025-10-22T22:13:38.361328] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-10-22T22:13:38.388513] [DEBUG] [MAIN ] PK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:38.392866] [INFO ] [MAIN ] PK: Generated 1794 derivative records from 52755 primary records. [2025-10-22T22:13:38.392113] [DEBUG] [LOCAL ] PKG: Derivative data saved (1793 records). [2025-10-22T22:13:38.392961] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-10-22T22:13:38.397865] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-10-22T22:13:38.400745] [INFO ] [MAIN ] Derivative Progress: 1436/2052 symbols completed. PKG took 1.1s. Estimated remaining: 3m 52s. Rate: 159.1 symbols/min [2025-10-22T22:13:38.401196] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:38.425026] [DEBUG] [LOCAL ] PK: Derivative data saved (1794 records). [2025-10-22T22:13:38.425133] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-10-22T22:13:38.428239] [INFO ] [MAIN ] Derivative Progress: 1437/2052 symbols completed. PK took 1.2s. Estimated remaining: 3m 52s. Rate: 159.2 symbols/min [2025-10-22T22:13:38.429885] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:38.430414] [DEBUG] [LOCAL ] PKST: Loaded 18133 existing records from primary storage. [2025-10-22T22:13:38.431168] [INFO ] [MAIN ] PKST: Loaded 18133 primary data records. [2025-10-22T22:13:38.579516] [DEBUG] [LOCAL ] PKX: Loaded 22626 existing records from primary storage. [2025-10-22T22:13:38.603048] [INFO ] [MAIN ] PKX: Loaded 22626 primary data records. [2025-10-22T22:13:38.840791] [DEBUG] [LOCAL ] PL: Loaded 53212 existing records from primary storage. [2025-10-22T22:13:38.920495] [INFO ] [MAIN ] PL: Loaded 53212 primary data records. [2025-10-22T22:13:39.492764] [DEBUG] [MAIN ] PKST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:39.494387] [INFO ] [MAIN ] PKST: Generated 1794 derivative records from 18133 primary records. [2025-10-22T22:13:39.494566] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-10-22T22:13:39.513679] [DEBUG] [LOCAL ] PKST: Derivative data saved (1794 records). [2025-10-22T22:13:39.514061] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-10-22T22:13:39.516095] [INFO ] [MAIN ] Derivative Progress: 1438/2052 symbols completed. PKST took 1.2s. Estimated remaining: 3m 52s. Rate: 159.0 symbols/min [2025-10-22T22:13:39.530416] [DEBUG] [MAIN ] PKX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:39.531166] [INFO ] [MAIN ] PKX: Generated 1794 derivative records from 22626 primary records. [2025-10-22T22:13:39.531337] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-10-22T22:13:39.547066] [DEBUG] [LOCAL ] PKX: Derivative data saved (1794 records). [2025-10-22T22:13:39.547286] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-10-22T22:13:39.550547] [INFO ] [MAIN ] Derivative Progress: 1439/2052 symbols completed. PKX took 1.1s. Estimated remaining: 3m 51s. Rate: 159.1 symbols/min [2025-10-22T22:13:39.564533] [DEBUG] [MAIN ] PL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:39.565107] [INFO ] [MAIN ] PL: Generated 1794 derivative records from 53212 primary records. [2025-10-22T22:13:39.565167] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-10-22T22:13:39.580280] [DEBUG] [LOCAL ] PL: Derivative data saved (1794 records). [2025-10-22T22:13:39.580343] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-10-22T22:13:39.582974] [INFO ] [MAIN ] Derivative Progress: 1440/2052 symbols completed. PL took 1.2s. Estimated remaining: 3m 51s. Rate: 159.2 symbols/min [2025-10-22T22:13:39.583494] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:39.583441] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:39.583616] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:39.639975] [DEBUG] [LOCAL ] PLYM: Loaded 34435 existing records from primary storage. [2025-10-22T22:13:39.640258] [INFO ] [MAIN ] PLYM: Loaded 34435 primary data records. [2025-10-22T22:13:39.785722] [DEBUG] [LOCAL ] PLNT: Loaded 48026 existing records from primary storage. [2025-10-22T22:13:39.791516] [DEBUG] [LOCAL ] PLD: Loaded 53416 existing records from primary storage. [2025-10-22T22:13:39.791688] [INFO ] [MAIN ] PLNT: Loaded 48026 primary data records. [2025-10-22T22:13:39.791745] [INFO ] [MAIN ] PLD: Loaded 53416 primary data records. [2025-10-22T22:13:40.608839] [DEBUG] [MAIN ] PLYM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:40.609636] [INFO ] [MAIN ] PLYM: Generated 1794 derivative records from 34435 primary records. [2025-10-22T22:13:40.609922] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-10-22T22:13:40.629849] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1794 records). [2025-10-22T22:13:40.631146] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-10-22T22:13:40.633057] [INFO ] [MAIN ] Derivative Progress: 1441/2052 symbols completed. PLYM took 1.0s. Estimated remaining: 3m 51s. Rate: 159.0 symbols/min [2025-10-22T22:13:40.633300] [INFO ] [MAIN ] PM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:40.653674] [DEBUG] [MAIN ] PLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:40.659240] [INFO ] [MAIN ] PLD: Generated 1794 derivative records from 53416 primary records. [2025-10-22T22:13:40.658581] [DEBUG] [MAIN ] PLNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:40.659388] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-10-22T22:13:40.660618] [INFO ] [MAIN ] PLNT: Generated 1794 derivative records from 48026 primary records. [2025-10-22T22:13:40.671633] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-10-22T22:13:40.676833] [DEBUG] [LOCAL ] PLD: Derivative data saved (1794 records). [2025-10-22T22:13:40.684900] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-10-22T22:13:40.690259] [INFO ] [MAIN ] Derivative Progress: 1442/2052 symbols completed. PLD took 1.1s. Estimated remaining: 3m 50s. Rate: 159.1 symbols/min [2025-10-22T22:13:40.690863] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:40.695879] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1794 records). [2025-10-22T22:13:40.695979] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-10-22T22:13:40.698237] [INFO ] [MAIN ] Derivative Progress: 1443/2052 symbols completed. PLNT took 1.1s. Estimated remaining: 3m 49s. Rate: 159.2 symbols/min [2025-10-22T22:13:40.698425] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:40.736116] [DEBUG] [LOCAL ] PMM: Loaded 10032 existing records from primary storage. [2025-10-22T22:13:40.735905] [DEBUG] [LOCAL ] PML: Loaded 21888 existing records from primary storage. [2025-10-22T22:13:40.736267] [INFO ] [MAIN ] PMM: Loaded 10032 primary data records. [2025-10-22T22:13:40.736323] [INFO ] [MAIN ] PML: Loaded 21888 primary data records. [2025-10-22T22:13:40.959926] [DEBUG] [LOCAL ] PM: Loaded 53674 existing records from primary storage. [2025-10-22T22:13:40.974056] [INFO ] [MAIN ] PM: Loaded 53674 primary data records. [2025-10-22T22:13:41.721191] [DEBUG] [MAIN ] PMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:41.721730] [DEBUG] [MAIN ] PML: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:41.723022] [INFO ] [MAIN ] PML: Generated 1794 derivative records from 21888 primary records. [2025-10-22T22:13:41.722437] [INFO ] [MAIN ] PMM: Generated 1794 derivative records from 10032 primary records. [2025-10-22T22:13:41.723365] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-10-22T22:13:41.723577] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-10-22T22:13:41.745931] [DEBUG] [LOCAL ] PMM: Derivative data saved (1794 records). [2025-10-22T22:13:41.752088] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-10-22T22:13:41.755667] [INFO ] [MAIN ] Derivative Progress: 1444/2052 symbols completed. PMM took 1.1s. Estimated remaining: 3m 49s. Rate: 159.0 symbols/min [2025-10-22T22:13:41.756828] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:41.758927] [DEBUG] [LOCAL ] PML: Derivative data saved (1794 records). [2025-10-22T22:13:41.766624] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-10-22T22:13:41.769058] [INFO ] [MAIN ] Derivative Progress: 1445/2052 symbols completed. PML took 1.1s. Estimated remaining: 3m 49s. Rate: 159.1 symbols/min [2025-10-22T22:13:41.769284] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:41.775082] [DEBUG] [MAIN ] PM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:41.775950] [INFO ] [MAIN ] PM: Generated 1794 derivative records from 53674 primary records. [2025-10-22T22:13:41.776015] [DEBUG] [LOCAL ] PM: Saving derivative data. [2025-10-22T22:13:41.787079] [DEBUG] [LOCAL ] PMO: Loaded 9459 existing records from primary storage. [2025-10-22T22:13:41.794476] [INFO ] [MAIN ] PMO: Loaded 9459 primary data records. [2025-10-22T22:13:41.815114] [DEBUG] [LOCAL ] PM: Derivative data saved (1794 records). [2025-10-22T22:13:41.835146] [INFO ] [MAIN ] PM: Successfully saved derivative data. [2025-10-22T22:13:41.838100] [INFO ] [MAIN ] Derivative Progress: 1446/2052 symbols completed. PM took 1.2s. Estimated remaining: 3m 48s. Rate: 159.2 symbols/min [2025-10-22T22:13:41.843473] [INFO ] [MAIN ] PNC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:42.122925] [DEBUG] [LOCAL ] PMT: Loaded 40705 existing records from primary storage. [2025-10-22T22:13:42.123270] [INFO ] [MAIN ] PMT: Loaded 40705 primary data records. [2025-10-22T22:13:42.262465] [DEBUG] [LOCAL ] PNC: Loaded 52065 existing records from primary storage. [2025-10-22T22:13:42.296239] [INFO ] [MAIN ] PNC: Loaded 52065 primary data records. [2025-10-22T22:13:42.770220] [DEBUG] [MAIN ] PMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:42.772000] [INFO ] [MAIN ] PMO: Generated 1794 derivative records from 9459 primary records. [2025-10-22T22:13:42.772141] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-10-22T22:13:42.790935] [DEBUG] [LOCAL ] PMO: Derivative data saved (1794 records). [2025-10-22T22:13:42.791212] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-10-22T22:13:42.794359] [INFO ] [MAIN ] Derivative Progress: 1447/2052 symbols completed. PMO took 1.0s. Estimated remaining: 3m 48s. Rate: 159.1 symbols/min [2025-10-22T22:13:42.795564] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:42.811744] [DEBUG] [MAIN ] PMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:42.812545] [INFO ] [MAIN ] PMT: Generated 1794 derivative records from 40705 primary records. [2025-10-22T22:13:42.812667] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-10-22T22:13:42.831956] [DEBUG] [LOCAL ] PMT: Derivative data saved (1794 records). [2025-10-22T22:13:42.832055] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-10-22T22:13:42.834344] [INFO ] [MAIN ] Derivative Progress: 1448/2052 symbols completed. PMT took 1.1s. Estimated remaining: 3m 48s. Rate: 159.2 symbols/min [2025-10-22T22:13:42.834718] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:42.839258] [DEBUG] [LOCAL ] PNI: Loaded 6901 existing records from primary storage. [2025-10-22T22:13:42.841158] [INFO ] [MAIN ] PNI: Loaded 6901 primary data records. [2025-10-22T22:13:42.938069] [DEBUG] [MAIN ] PNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:42.959950] [INFO ] [MAIN ] PNC: Generated 1794 derivative records from 52065 primary records. [2025-10-22T22:13:42.960122] [DEBUG] [LOCAL ] PNC: Saving derivative data. [2025-10-22T22:13:43.063042] [DEBUG] [LOCAL ] PNC: Derivative data saved (1794 records). [2025-10-22T22:13:43.223221] [INFO ] [MAIN ] PNC: Successfully saved derivative data. [2025-10-22T22:13:43.226003] [INFO ] [MAIN ] Derivative Progress: 1449/2052 symbols completed. PNC took 1.4s. Estimated remaining: 3m 47s. Rate: 159.2 symbols/min [2025-10-22T22:13:43.226549] [DEBUG] [LOCAL ] PNNT: Loaded 33331 existing records from primary storage. [2025-10-22T22:13:43.226985] [INFO ] [MAIN ] PNR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:43.226889] [INFO ] [MAIN ] PNNT: Loaded 33331 primary data records. [2025-10-22T22:13:43.580385] [DEBUG] [MAIN ] PNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:43.581511] [DEBUG] [LOCAL ] PNR: Loaded 47486 existing records from primary storage. [2025-10-22T22:13:43.582483] [INFO ] [MAIN ] PNI: Generated 1794 derivative records from 6901 primary records. [2025-10-22T22:13:43.582634] [INFO ] [MAIN ] PNR: Loaded 47486 primary data records. [2025-10-22T22:13:43.582767] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-10-22T22:13:43.684846] [DEBUG] [LOCAL ] PNI: Derivative data saved (1794 records). [2025-10-22T22:13:43.696534] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-10-22T22:13:43.707811] [INFO ] [MAIN ] Derivative Progress: 1450/2052 symbols completed. PNI took 0.9s. Estimated remaining: 3m 47s. Rate: 159.1 symbols/min [2025-10-22T22:13:43.708213] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:43.926572] [DEBUG] [MAIN ] PNNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:43.927600] [INFO ] [MAIN ] PNNT: Generated 1794 derivative records from 33331 primary records. [2025-10-22T22:13:43.927782] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-10-22T22:13:43.945263] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1794 records). [2025-10-22T22:13:43.955815] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-10-22T22:13:43.958276] [INFO ] [MAIN ] Derivative Progress: 1451/2052 symbols completed. PNNT took 1.1s. Estimated remaining: 3m 47s. Rate: 159.2 symbols/min [2025-10-22T22:13:43.958711] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:43.978097] [DEBUG] [LOCAL ] PNW: Loaded 45501 existing records from primary storage. [2025-10-22T22:13:43.979162] [INFO ] [MAIN ] PNW: Loaded 45501 primary data records. [2025-10-22T22:13:44.089626] [DEBUG] [MAIN ] PNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:44.111668] [INFO ] [MAIN ] PNR: Generated 1794 derivative records from 47486 primary records. [2025-10-22T22:13:44.133718] [DEBUG] [LOCAL ] PNR: Saving derivative data. [2025-10-22T22:13:44.234703] [DEBUG] [LOCAL ] POR: Loaded 46735 existing records from primary storage. [2025-10-22T22:13:44.320479] [INFO ] [MAIN ] POR: Loaded 46735 primary data records. [2025-10-22T22:13:44.340436] [DEBUG] [LOCAL ] PNR: Derivative data saved (1794 records). [2025-10-22T22:13:44.340538] [INFO ] [MAIN ] PNR: Successfully saved derivative data. [2025-10-22T22:13:44.373671] [INFO ] [MAIN ] Derivative Progress: 1452/2052 symbols completed. PNR took 1.1s. Estimated remaining: 3m 46s. Rate: 159.2 symbols/min [2025-10-22T22:13:44.373845] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:44.667991] [DEBUG] [MAIN ] PNW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:44.679184] [INFO ] [MAIN ] PNW: Generated 1794 derivative records from 45501 primary records. [2025-10-22T22:13:44.679605] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-10-22T22:13:44.680178] [DEBUG] [LOCAL ] POST: Loaded 38443 existing records from primary storage. [2025-10-22T22:13:44.680443] [INFO ] [MAIN ] POST: Loaded 38443 primary data records. [2025-10-22T22:13:44.777235] [DEBUG] [LOCAL ] PNW: Derivative data saved (1794 records). [2025-10-22T22:13:44.788476] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-10-22T22:13:44.791343] [INFO ] [MAIN ] Derivative Progress: 1453/2052 symbols completed. PNW took 1.1s. Estimated remaining: 3m 46s. Rate: 159.1 symbols/min [2025-10-22T22:13:44.896116] [DEBUG] [MAIN ] POR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:45.009718] [INFO ] [MAIN ] POR: Generated 1794 derivative records from 46735 primary records. [2025-10-22T22:13:45.009840] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-10-22T22:13:45.026919] [DEBUG] [LOCAL ] POR: Derivative data saved (1794 records). [2025-10-22T22:13:45.027222] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-10-22T22:13:45.029503] [INFO ] [MAIN ] Derivative Progress: 1454/2052 symbols completed. POR took 1.1s. Estimated remaining: 3m 45s. Rate: 159.2 symbols/min [2025-10-22T22:13:45.049201] [DEBUG] [MAIN ] POST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:45.049810] [INFO ] [MAIN ] POST: Generated 1794 derivative records from 38443 primary records. [2025-10-22T22:13:45.049871] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-10-22T22:13:45.064740] [DEBUG] [LOCAL ] POST: Derivative data saved (1794 records). [2025-10-22T22:13:45.064796] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-10-22T22:13:45.067027] [INFO ] [MAIN ] Derivative Progress: 1455/2052 symbols completed. POST took 0.7s. Estimated remaining: 3m 45s. Rate: 159.3 symbols/min [2025-10-22T22:13:45.067714] [INFO ] [MAIN ] PPL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:45.067622] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:45.067774] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:45.091408] [DEBUG] [LOCAL ] PPT: Loaded 19701 existing records from primary storage. [2025-10-22T22:13:45.091604] [INFO ] [MAIN ] PPT: Loaded 19701 primary data records. [2025-10-22T22:13:45.451312] [DEBUG] [LOCAL ] PPL: Loaded 53505 existing records from primary storage. [2025-10-22T22:13:45.464284] [INFO ] [MAIN ] PPL: Loaded 53505 primary data records. [2025-10-22T22:13:45.497430] [DEBUG] [LOCAL ] PPG: Loaded 50502 existing records from primary storage. [2025-10-22T22:13:45.510443] [INFO ] [MAIN ] PPG: Loaded 50502 primary data records. [2025-10-22T22:13:46.086251] [DEBUG] [MAIN ] PPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:46.087425] [INFO ] [MAIN ] PPT: Generated 1794 derivative records from 19701 primary records. [2025-10-22T22:13:46.087718] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-10-22T22:13:46.105789] [DEBUG] [LOCAL ] PPT: Derivative data saved (1794 records). [2025-10-22T22:13:46.106042] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-10-22T22:13:46.108376] [INFO ] [MAIN ] Derivative Progress: 1456/2052 symbols completed. PPT took 1.0s. Estimated remaining: 3m 45s. Rate: 159.1 symbols/min [2025-10-22T22:13:46.108735] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:46.132397] [DEBUG] [MAIN ] PPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:46.133258] [INFO ] [MAIN ] PPL: Generated 1794 derivative records from 53505 primary records. [2025-10-22T22:13:46.133425] [DEBUG] [LOCAL ] PPL: Saving derivative data. [2025-10-22T22:13:46.154219] [DEBUG] [MAIN ] PPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:46.161753] [INFO ] [MAIN ] PPG: Generated 1794 derivative records from 50502 primary records. [2025-10-22T22:13:46.162600] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-10-22T22:13:46.163627] [DEBUG] [LOCAL ] PPL: Derivative data saved (1794 records). [2025-10-22T22:13:46.164436] [INFO ] [MAIN ] PPL: Successfully saved derivative data. [2025-10-22T22:13:46.166671] [INFO ] [MAIN ] Derivative Progress: 1457/2052 symbols completed. PPL took 1.1s. Estimated remaining: 3m 44s. Rate: 159.2 symbols/min [2025-10-22T22:13:46.175157] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:46.196553] [DEBUG] [LOCAL ] PPG: Derivative data saved (1794 records). [2025-10-22T22:13:46.196782] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-10-22T22:13:46.199408] [INFO ] [MAIN ] Derivative Progress: 1458/2052 symbols completed. PPG took 1.1s. Estimated remaining: 3m 44s. Rate: 159.3 symbols/min [2025-10-22T22:13:46.199761] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:46.218747] [DEBUG] [LOCAL ] PR: Loaded 53611 existing records from primary storage. [2025-10-22T22:13:46.228775] [DEBUG] [LOCAL ] PRCS: Loaded 2782 existing records from primary storage. [2025-10-22T22:13:46.228947] [INFO ] [MAIN ] PRCS: Loaded 2782 primary data records. [2025-10-22T22:13:46.228571] [INFO ] [MAIN ] PR: Loaded 53611 primary data records. [2025-10-22T22:13:46.446445] [DEBUG] [LOCAL ] PRA: Loaded 34389 existing records from primary storage. [2025-10-22T22:13:46.468565] [INFO ] [MAIN ] PRA: Loaded 34389 primary data records. [2025-10-22T22:13:47.228224] [DEBUG] [MAIN ] PRCS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:13:47.227923] [DEBUG] [MAIN ] PR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:47.230300] [INFO ] [MAIN ] PR: Generated 1794 derivative records from 53611 primary records. [2025-10-22T22:13:47.229742] [INFO ] [MAIN ] PRCS: Generated 1793 derivative records from 2782 primary records. [2025-10-22T22:13:47.231068] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-10-22T22:13:47.231673] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-10-22T22:13:47.267931] [DEBUG] [MAIN ] PRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:47.266599] [DEBUG] [LOCAL ] PR: Derivative data saved (1794 records). [2025-10-22T22:13:47.274703] [DEBUG] [LOCAL ] PRCS: Derivative data saved (1793 records). [2025-10-22T22:13:47.274431] [INFO ] [MAIN ] PRA: Generated 1794 derivative records from 34389 primary records. [2025-10-22T22:13:47.270634] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-10-22T22:13:47.274873] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-10-22T22:13:47.274926] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-10-22T22:13:47.277190] [INFO ] [MAIN ] Derivative Progress: 1459/2052 symbols completed. PR took 1.2s. Estimated remaining: 3m 44s. Rate: 159.1 symbols/min [2025-10-22T22:13:47.279997] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:47.280384] [INFO ] [MAIN ] Derivative Progress: 1460/2052 symbols completed. PRCS took 1.1s. Estimated remaining: 3m 43s. Rate: 159.2 symbols/min [2025-10-22T22:13:47.288017] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:47.296507] [DEBUG] [LOCAL ] PRA: Derivative data saved (1794 records). [2025-10-22T22:13:47.296728] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-10-22T22:13:47.299328] [INFO ] [MAIN ] Derivative Progress: 1461/2052 symbols completed. PRA took 1.1s. Estimated remaining: 3m 43s. Rate: 159.3 symbols/min [2025-10-22T22:13:47.299538] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:47.309817] [DEBUG] [LOCAL ] PRH: Loaded 4687 existing records from primary storage. [2025-10-22T22:13:47.310062] [INFO ] [MAIN ] PRH: Loaded 4687 primary data records. [2025-10-22T22:13:47.430375] [DEBUG] [LOCAL ] PRG: Loaded 29701 existing records from primary storage. [2025-10-22T22:13:47.451914] [INFO ] [MAIN ] PRG: Loaded 29701 primary data records. [2025-10-22T22:13:47.728817] [DEBUG] [LOCAL ] PRGO: Loaded 47131 existing records from primary storage. [2025-10-22T22:13:47.750689] [INFO ] [MAIN ] PRGO: Loaded 47131 primary data records. [2025-10-22T22:13:48.272943] [DEBUG] [MAIN ] PRH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:48.274871] [INFO ] [MAIN ] PRH: Generated 1794 derivative records from 4687 primary records. [2025-10-22T22:13:48.274973] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-10-22T22:13:48.296124] [DEBUG] [LOCAL ] PRH: Derivative data saved (1794 records). [2025-10-22T22:13:48.304160] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-10-22T22:13:48.312041] [INFO ] [MAIN ] Derivative Progress: 1462/2052 symbols completed. PRH took 1.0s. Estimated remaining: 3m 42s. Rate: 159.1 symbols/min [2025-10-22T22:13:48.309830] [DEBUG] [MAIN ] PRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:48.312284] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:48.313678] [INFO ] [MAIN ] PRG: Generated 1794 derivative records from 29701 primary records. [2025-10-22T22:13:48.314044] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-10-22T22:13:48.333228] [DEBUG] [LOCAL ] PRG: Derivative data saved (1794 records). [2025-10-22T22:13:48.334114] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-10-22T22:13:48.336744] [INFO ] [MAIN ] Derivative Progress: 1463/2052 symbols completed. PRG took 1.1s. Estimated remaining: 3m 42s. Rate: 159.2 symbols/min [2025-10-22T22:13:48.337039] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:48.350937] [DEBUG] [MAIN ] PRGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:48.356064] [INFO ] [MAIN ] PRGO: Generated 1794 derivative records from 47131 primary records. [2025-10-22T22:13:48.356225] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-10-22T22:13:48.375916] [DEBUG] [LOCAL ] PRI: Loaded 17709 existing records from primary storage. [2025-10-22T22:13:48.376600] [INFO ] [MAIN ] PRI: Loaded 17709 primary data records. [2025-10-22T22:13:48.409748] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1794 records). [2025-10-22T22:13:48.409917] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-10-22T22:13:48.418095] [INFO ] [MAIN ] Derivative Progress: 1464/2052 symbols completed. PRGO took 1.1s. Estimated remaining: 3m 41s. Rate: 159.3 symbols/min [2025-10-22T22:13:48.418339] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:48.708467] [DEBUG] [LOCAL ] PRIM: Loaded 44097 existing records from primary storage. [2025-10-22T22:13:48.709888] [INFO ] [MAIN ] PRIM: Loaded 44097 primary data records. [2025-10-22T22:13:48.783426] [DEBUG] [LOCAL ] PRKS: Loaded 42224 existing records from primary storage. [2025-10-22T22:13:48.804045] [INFO ] [MAIN ] PRKS: Loaded 42224 primary data records. [2025-10-22T22:13:49.416988] [DEBUG] [MAIN ] PRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:49.418625] [INFO ] [MAIN ] PRI: Generated 1794 derivative records from 17709 primary records. [2025-10-22T22:13:49.419431] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-10-22T22:13:49.438787] [DEBUG] [LOCAL ] PRI: Derivative data saved (1794 records). [2025-10-22T22:13:49.439329] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-10-22T22:13:49.441449] [INFO ] [MAIN ] Derivative Progress: 1465/2052 symbols completed. PRI took 1.1s. Estimated remaining: 3m 41s. Rate: 159.1 symbols/min [2025-10-22T22:13:49.441982] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:49.467982] [DEBUG] [MAIN ] PRIM: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:13:49.469486] [INFO ] [MAIN ] PRIM: Generated 1793 derivative records from 44097 primary records. [2025-10-22T22:13:49.469578] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-10-22T22:13:49.503478] [DEBUG] [LOCAL ] PRLB: Loaded 20243 existing records from primary storage. [2025-10-22T22:13:49.505787] [DEBUG] [MAIN ] PRKS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:49.505893] [INFO ] [MAIN ] PRLB: Loaded 20243 primary data records. [2025-10-22T22:13:49.506686] [INFO ] [MAIN ] PRKS: Generated 1794 derivative records from 42224 primary records. [2025-10-22T22:13:49.507075] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1793 records). [2025-10-22T22:13:49.507174] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-10-22T22:13:49.507281] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-10-22T22:13:49.509365] [INFO ] [MAIN ] Derivative Progress: 1466/2052 symbols completed. PRIM took 1.2s. Estimated remaining: 3m 41s. Rate: 159.2 symbols/min [2025-10-22T22:13:49.521589] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:49.627337] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1794 records). [2025-10-22T22:13:49.630823] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-10-22T22:13:49.633348] [INFO ] [MAIN ] Derivative Progress: 1467/2052 symbols completed. PRKS took 1.2s. Estimated remaining: 3m 40s. Rate: 159.3 symbols/min [2025-10-22T22:13:49.633855] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:49.857799] [DEBUG] [LOCAL ] PRM: Loaded 44368 existing records from primary storage. [2025-10-22T22:13:49.858015] [INFO ] [MAIN ] PRM: Loaded 44368 primary data records. [2025-10-22T22:13:50.005573] [DEBUG] [LOCAL ] PRMB: Loaded 53101 existing records from primary storage. [2025-10-22T22:13:50.040016] [INFO ] [MAIN ] PRMB: Loaded 53101 primary data records. [2025-10-22T22:13:50.301832] [DEBUG] [MAIN ] PRLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:50.302830] [INFO ] [MAIN ] PRLB: Generated 1794 derivative records from 20243 primary records. [2025-10-22T22:13:50.303565] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-10-22T22:13:50.340920] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1794 records). [2025-10-22T22:13:50.376380] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-10-22T22:13:50.398893] [INFO ] [MAIN ] Derivative Progress: 1468/2052 symbols completed. PRLB took 1.0s. Estimated remaining: 3m 40s. Rate: 159.2 symbols/min [2025-10-22T22:13:50.533208] [DEBUG] [MAIN ] PRM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:50.534286] [INFO ] [MAIN ] PRM: Generated 1794 derivative records from 44368 primary records. [2025-10-22T22:13:50.534364] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-10-22T22:13:50.551176] [DEBUG] [LOCAL ] PRM: Derivative data saved (1794 records). [2025-10-22T22:13:50.551364] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-10-22T22:13:50.553365] [INFO ] [MAIN ] Derivative Progress: 1469/2052 symbols completed. PRM took 1.0s. Estimated remaining: 3m 40s. Rate: 159.2 symbols/min [2025-10-22T22:13:50.569947] [DEBUG] [MAIN ] PRMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:50.570445] [INFO ] [MAIN ] PRMB: Generated 1794 derivative records from 53101 primary records. [2025-10-22T22:13:50.570502] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-10-22T22:13:50.585395] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1794 records). [2025-10-22T22:13:50.585453] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-10-22T22:13:50.587532] [INFO ] [MAIN ] Derivative Progress: 1470/2052 symbols completed. PRMB took 1.0s. Estimated remaining: 3m 39s. Rate: 159.3 symbols/min [2025-10-22T22:13:50.588023] [INFO ] [MAIN ] PRSU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:50.587959] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:50.588863] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:50.596965] [DEBUG] [LOCAL ] PRT: Loaded 5061 existing records from primary storage. [2025-10-22T22:13:50.597260] [INFO ] [MAIN ] PRT: Loaded 5061 primary data records. [2025-10-22T22:13:50.721776] [DEBUG] [LOCAL ] PRSU: Loaded 23124 existing records from primary storage. [2025-10-22T22:13:50.737832] [INFO ] [MAIN ] PRSU: Loaded 23124 primary data records. [2025-10-22T22:13:50.857583] [DEBUG] [LOCAL ] PRO: Loaded 40143 existing records from primary storage. [2025-10-22T22:13:50.887809] [INFO ] [MAIN ] PRO: Loaded 40143 primary data records. [2025-10-22T22:13:51.580792] [DEBUG] [MAIN ] PRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:51.581527] [INFO ] [MAIN ] PRT: Generated 1794 derivative records from 5061 primary records. [2025-10-22T22:13:51.581810] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-10-22T22:13:51.597551] [DEBUG] [LOCAL ] PRT: Derivative data saved (1794 records). [2025-10-22T22:13:51.597818] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-10-22T22:13:51.600853] [INFO ] [MAIN ] Derivative Progress: 1471/2052 symbols completed. PRT took 1.0s. Estimated remaining: 3m 39s. Rate: 159.1 symbols/min [2025-10-22T22:13:51.601096] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:51.617742] [DEBUG] [MAIN ] PRSU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:51.619387] [INFO ] [MAIN ] PRSU: Generated 1794 derivative records from 23124 primary records. [2025-10-22T22:13:51.619501] [DEBUG] [LOCAL ] PRSU: Saving derivative data. [2025-10-22T22:13:51.647458] [DEBUG] [LOCAL ] PRSU: Derivative data saved (1794 records). [2025-10-22T22:13:51.647613] [INFO ] [MAIN ] PRSU: Successfully saved derivative data. [2025-10-22T22:13:51.650019] [INFO ] [MAIN ] Derivative Progress: 1472/2052 symbols completed. PRSU took 1.1s. Estimated remaining: 3m 39s. Rate: 159.2 symbols/min [2025-10-22T22:13:51.650428] [DEBUG] [MAIN ] PRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:51.651351] [INFO ] [MAIN ] PRO: Generated 1794 derivative records from 40143 primary records. [2025-10-22T22:13:51.651871] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:51.652329] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-10-22T22:13:51.671509] [DEBUG] [LOCAL ] PRO: Derivative data saved (1794 records). [2025-10-22T22:13:51.671830] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-10-22T22:13:51.674582] [INFO ] [MAIN ] Derivative Progress: 1473/2052 symbols completed. PRO took 1.1s. Estimated remaining: 3m 38s. Rate: 159.3 symbols/min [2025-10-22T22:13:51.688443] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:51.708255] [DEBUG] [LOCAL ] PSBD: Loaded 8246 existing records from primary storage. [2025-10-22T22:13:51.708802] [INFO ] [MAIN ] PSBD: Loaded 8246 primary data records. [2025-10-22T22:13:51.758280] [DEBUG] [LOCAL ] PSA: Loaded 42093 existing records from primary storage. [2025-10-22T22:13:51.784394] [INFO ] [MAIN ] PSA: Loaded 42093 primary data records. [2025-10-22T22:13:51.841676] [DEBUG] [LOCAL ] PRU: Loaded 51171 existing records from primary storage. [2025-10-22T22:13:51.872398] [INFO ] [MAIN ] PRU: Loaded 51171 primary data records. [2025-10-22T22:13:52.673552] [DEBUG] [MAIN ] PSBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:52.674507] [INFO ] [MAIN ] PSBD: Generated 1794 derivative records from 8246 primary records. [2025-10-22T22:13:52.676864] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-10-22T22:13:52.704827] [DEBUG] [MAIN ] PSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:52.707080] [INFO ] [MAIN ] PSA: Generated 1794 derivative records from 42093 primary records. [2025-10-22T22:13:52.705622] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1794 records). [2025-10-22T22:13:52.707201] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-10-22T22:13:52.708555] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-10-22T22:13:52.711398] [INFO ] [MAIN ] Derivative Progress: 1474/2052 symbols completed. PSBD took 1.0s. Estimated remaining: 3m 38s. Rate: 159.1 symbols/min [2025-10-22T22:13:52.718854] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:52.726993] [DEBUG] [LOCAL ] PSA: Derivative data saved (1794 records). [2025-10-22T22:13:52.727192] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-10-22T22:13:52.730807] [INFO ] [MAIN ] Derivative Progress: 1475/2052 symbols completed. PSA took 1.1s. Estimated remaining: 3m 37s. Rate: 159.2 symbols/min [2025-10-22T22:13:52.738498] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:52.744406] [DEBUG] [MAIN ] PRU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:52.745053] [INFO ] [MAIN ] PRU: Generated 1794 derivative records from 51171 primary records. [2025-10-22T22:13:52.745185] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-10-22T22:13:52.762881] [DEBUG] [LOCAL ] PSF: Loaded 6947 existing records from primary storage. [2025-10-22T22:13:52.763366] [INFO ] [MAIN ] PSF: Loaded 6947 primary data records. [2025-10-22T22:13:52.884006] [DEBUG] [LOCAL ] PSFE: Loaded 29574 existing records from primary storage. [2025-10-22T22:13:52.894941] [DEBUG] [LOCAL ] PRU: Derivative data saved (1794 records). [2025-10-22T22:13:52.894854] [INFO ] [MAIN ] PSFE: Loaded 29574 primary data records. [2025-10-22T22:13:52.921359] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-10-22T22:13:52.953717] [INFO ] [MAIN ] Derivative Progress: 1476/2052 symbols completed. PRU took 1.4s. Estimated remaining: 3m 37s. Rate: 159.3 symbols/min [2025-10-22T22:13:53.011798] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:53.436334] [DEBUG] [LOCAL ] PSN: Loaded 45180 existing records from primary storage. [2025-10-22T22:13:53.438724] [INFO ] [MAIN ] PSN: Loaded 45180 primary data records. [2025-10-22T22:13:53.509845] [DEBUG] [MAIN ] PSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:53.531799] [INFO ] [MAIN ] PSF: Generated 1794 derivative records from 6947 primary records. [2025-10-22T22:13:53.549834] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-10-22T22:13:53.609515] [DEBUG] [MAIN ] PSFE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:53.665129] [INFO ] [MAIN ] PSFE: Generated 1794 derivative records from 29574 primary records. [2025-10-22T22:13:53.670220] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-10-22T22:13:53.638168] [DEBUG] [LOCAL ] PSF: Derivative data saved (1794 records). [2025-10-22T22:13:53.787960] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-10-22T22:13:53.790983] [INFO ] [MAIN ] Derivative Progress: 1477/2052 symbols completed. PSF took 1.1s. Estimated remaining: 3m 37s. Rate: 159.2 symbols/min [2025-10-22T22:13:53.791279] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:53.812532] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1794 records). [2025-10-22T22:13:53.813186] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-10-22T22:13:53.815456] [INFO ] [MAIN ] Derivative Progress: 1478/2052 symbols completed. PSFE took 1.1s. Estimated remaining: 3m 36s. Rate: 159.3 symbols/min [2025-10-22T22:13:53.816129] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:53.864706] [DEBUG] [MAIN ] PSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:53.865493] [INFO ] [MAIN ] PSN: Generated 1794 derivative records from 45180 primary records. [2025-10-22T22:13:53.867222] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-10-22T22:13:53.887497] [DEBUG] [LOCAL ] PSO: Loaded 36655 existing records from primary storage. [2025-10-22T22:13:53.898599] [INFO ] [MAIN ] PSO: Loaded 36655 primary data records. [2025-10-22T22:13:53.933415] [DEBUG] [LOCAL ] PSN: Derivative data saved (1794 records). [2025-10-22T22:13:53.976047] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-10-22T22:13:54.005921] [DEBUG] [LOCAL ] PSQH: Loaded 35401 existing records from primary storage. [2025-10-22T22:13:54.000245] [INFO ] [MAIN ] Derivative Progress: 1479/2052 symbols completed. PSN took 1.0s. Estimated remaining: 3m 36s. Rate: 159.3 symbols/min [2025-10-22T22:13:54.013561] [INFO ] [MAIN ] PSQH: Loaded 35401 primary data records. [2025-10-22T22:13:54.016719] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:54.564207] [DEBUG] [LOCAL ] PSTG: Loaded 52833 existing records from primary storage. [2025-10-22T22:13:54.565536] [INFO ] [MAIN ] PSTG: Loaded 52833 primary data records. [2025-10-22T22:13:54.724396] [DEBUG] [MAIN ] PSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:54.759013] [INFO ] [MAIN ] PSO: Generated 1794 derivative records from 36655 primary records. [2025-10-22T22:13:54.916361] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-10-22T22:13:54.950865] [DEBUG] [LOCAL ] PSO: Derivative data saved (1794 records). [2025-10-22T22:13:54.951282] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-10-22T22:13:54.954046] [INFO ] [MAIN ] Derivative Progress: 1480/2052 symbols completed. PSO took 1.2s. Estimated remaining: 3m 36s. Rate: 159.2 symbols/min [2025-10-22T22:13:54.962237] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:54.968246] [DEBUG] [MAIN ] PSQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:54.969233] [INFO ] [MAIN ] PSQH: Generated 1794 derivative records from 35401 primary records. [2025-10-22T22:13:54.969845] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-10-22T22:13:54.987735] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1794 records). [2025-10-22T22:13:54.987918] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-10-22T22:13:54.990230] [INFO ] [MAIN ] Derivative Progress: 1481/2052 symbols completed. PSQH took 1.2s. Estimated remaining: 3m 35s. Rate: 159.2 symbols/min [2025-10-22T22:13:54.990511] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:55.008930] [DEBUG] [LOCAL ] PSTL: Loaded 19894 existing records from primary storage. [2025-10-22T22:13:55.009248] [INFO ] [MAIN ] PSTL: Loaded 19894 primary data records. [2025-10-22T22:13:55.052431] [DEBUG] [MAIN ] PSTG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:13:55.065134] [INFO ] [MAIN ] PSTG: Generated 1793 derivative records from 52833 primary records. [2025-10-22T22:13:55.077056] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-10-22T22:13:55.225542] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1793 records). [2025-10-22T22:13:55.230305] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-10-22T22:13:55.232914] [INFO ] [MAIN ] Derivative Progress: 1482/2052 symbols completed. PSTG took 1.2s. Estimated remaining: 3m 35s. Rate: 159.3 symbols/min [2025-10-22T22:13:55.345790] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:55.361414] [DEBUG] [LOCAL ] PSX: Loaded 53124 existing records from primary storage. [2025-10-22T22:13:55.361522] [INFO ] [MAIN ] PSX: Loaded 53124 primary data records. [2025-10-22T22:13:55.494296] [DEBUG] [LOCAL ] PTA: Loaded 15444 existing records from primary storage. [2025-10-22T22:13:55.554756] [INFO ] [MAIN ] PTA: Loaded 15444 primary data records. [2025-10-22T22:13:55.999507] [DEBUG] [MAIN ] PSTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:56.010362] [INFO ] [MAIN ] PSTL: Generated 1794 derivative records from 19894 primary records. [2025-10-22T22:13:56.010909] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-10-22T22:13:56.029550] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1794 records). [2025-10-22T22:13:56.029777] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-10-22T22:13:56.034784] [INFO ] [MAIN ] Derivative Progress: 1483/2052 symbols completed. PSTL took 1.1s. Estimated remaining: 3m 34s. Rate: 159.2 symbols/min [2025-10-22T22:13:56.053918] [DEBUG] [MAIN ] PSX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:56.055386] [INFO ] [MAIN ] PSX: Generated 1794 derivative records from 53124 primary records. [2025-10-22T22:13:56.055524] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-10-22T22:13:56.073219] [DEBUG] [LOCAL ] PSX: Derivative data saved (1794 records). [2025-10-22T22:13:56.073296] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-10-22T22:13:56.075485] [INFO ] [MAIN ] Derivative Progress: 1484/2052 symbols completed. PSX took 1.1s. Estimated remaining: 3m 34s. Rate: 159.3 symbols/min [2025-10-22T22:13:56.092253] [DEBUG] [MAIN ] PTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:56.092878] [INFO ] [MAIN ] PTA: Generated 1794 derivative records from 15444 primary records. [2025-10-22T22:13:56.092939] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-10-22T22:13:56.108162] [DEBUG] [LOCAL ] PTA: Derivative data saved (1794 records). [2025-10-22T22:13:56.108223] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-10-22T22:13:56.110597] [INFO ] [MAIN ] Derivative Progress: 1485/2052 symbols completed. PTA took 0.8s. Estimated remaining: 3m 33s. Rate: 159.4 symbols/min [2025-10-22T22:13:56.111197] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:56.111320] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:56.111386] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:56.172804] [DEBUG] [LOCAL ] PUK: Loaded 44333 existing records from primary storage. [2025-10-22T22:13:56.173083] [INFO ] [MAIN ] PUK: Loaded 44333 primary data records. [2025-10-22T22:13:56.296470] [DEBUG] [LOCAL ] PTY: Loaded 37908 existing records from primary storage. [2025-10-22T22:13:56.309099] [INFO ] [MAIN ] PTY: Loaded 37908 primary data records. [2025-10-22T22:13:56.326207] [DEBUG] [LOCAL ] PUMP: Loaded 49434 existing records from primary storage. [2025-10-22T22:13:56.356171] [INFO ] [MAIN ] PUMP: Loaded 49434 primary data records. [2025-10-22T22:13:57.216794] [DEBUG] [MAIN ] PUK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:57.217870] [INFO ] [MAIN ] PUK: Generated 1794 derivative records from 44333 primary records. [2025-10-22T22:13:57.218163] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-10-22T22:13:57.240595] [DEBUG] [LOCAL ] PUK: Derivative data saved (1794 records). [2025-10-22T22:13:57.241045] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-10-22T22:13:57.255241] [INFO ] [MAIN ] Derivative Progress: 1486/2052 symbols completed. PUK took 1.1s. Estimated remaining: 3m 33s. Rate: 159.1 symbols/min [2025-10-22T22:13:57.264071] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:57.269623] [DEBUG] [MAIN ] PTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:57.271176] [INFO ] [MAIN ] PTY: Generated 1794 derivative records from 37908 primary records. [2025-10-22T22:13:57.270372] [DEBUG] [MAIN ] PUMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:57.272095] [INFO ] [MAIN ] PUMP: Generated 1794 derivative records from 49434 primary records. [2025-10-22T22:13:57.271329] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-10-22T22:13:57.272974] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-10-22T22:13:57.303459] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1794 records). [2025-10-22T22:13:57.305923] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-10-22T22:13:57.309701] [INFO ] [MAIN ] Derivative Progress: 1487/2052 symbols completed. PUMP took 1.2s. Estimated remaining: 3m 33s. Rate: 159.2 symbols/min [2025-10-22T22:13:57.309832] [DEBUG] [LOCAL ] PTY: Derivative data saved (1794 records). [2025-10-22T22:13:57.310326] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-10-22T22:13:57.310058] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:57.313025] [INFO ] [MAIN ] Derivative Progress: 1488/2052 symbols completed. PTY took 1.2s. Estimated remaining: 3m 32s. Rate: 159.3 symbols/min [2025-10-22T22:13:57.313387] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:57.331639] [DEBUG] [LOCAL ] PVL: Loaded 4737 existing records from primary storage. [2025-10-22T22:13:57.331936] [INFO ] [MAIN ] PVL: Loaded 4737 primary data records. [2025-10-22T22:13:57.472147] [DEBUG] [LOCAL ] PVH: Loaded 49508 existing records from primary storage. [2025-10-22T22:13:57.490535] [INFO ] [MAIN ] PVH: Loaded 49508 primary data records. [2025-10-22T22:13:57.775684] [DEBUG] [LOCAL ] PWR: Loaded 46492 existing records from primary storage. [2025-10-22T22:13:57.776347] [INFO ] [MAIN ] PWR: Loaded 46492 primary data records. [2025-10-22T22:13:58.329260] [DEBUG] [MAIN ] PVL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:58.330296] [INFO ] [MAIN ] PVL: Generated 1794 derivative records from 4737 primary records. [2025-10-22T22:13:58.331157] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-10-22T22:13:58.348799] [DEBUG] [LOCAL ] PVL: Derivative data saved (1794 records). [2025-10-22T22:13:58.349394] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-10-22T22:13:58.351704] [INFO ] [MAIN ] Derivative Progress: 1489/2052 symbols completed. PVL took 1.0s. Estimated remaining: 3m 32s. Rate: 159.2 symbols/min [2025-10-22T22:13:58.351999] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:58.369273] [DEBUG] [MAIN ] PVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:58.369979] [INFO ] [MAIN ] PVH: Generated 1794 derivative records from 49508 primary records. [2025-10-22T22:13:58.370276] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-10-22T22:13:58.386610] [DEBUG] [LOCAL ] PVH: Derivative data saved (1794 records). [2025-10-22T22:13:58.386813] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-10-22T22:13:58.389077] [INFO ] [MAIN ] Derivative Progress: 1490/2052 symbols completed. PVH took 1.1s. Estimated remaining: 3m 32s. Rate: 159.2 symbols/min [2025-10-22T22:13:58.401480] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:58.417822] [DEBUG] [MAIN ] PWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:58.418446] [INFO ] [MAIN ] PWR: Generated 1794 derivative records from 46492 primary records. [2025-10-22T22:13:58.418579] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-10-22T22:13:58.435242] [DEBUG] [LOCAL ] PWR: Derivative data saved (1794 records). [2025-10-22T22:13:58.435330] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-10-22T22:13:58.447300] [INFO ] [MAIN ] Derivative Progress: 1491/2052 symbols completed. PWR took 1.1s. Estimated remaining: 3m 31s. Rate: 159.3 symbols/min [2025-10-22T22:13:58.449068] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:58.456838] [DEBUG] [LOCAL ] PX: Loaded 33950 existing records from primary storage. [2025-10-22T22:13:58.457056] [INFO ] [MAIN ] PX: Loaded 33950 primary data records. [2025-10-22T22:13:58.547785] [DEBUG] [LOCAL ] QD: Loaded 27517 existing records from primary storage. [2025-10-22T22:13:58.571876] [INFO ] [MAIN ] QD: Loaded 27517 primary data records. [2025-10-22T22:13:58.777812] [DEBUG] [LOCAL ] QGEN: Loaded 49044 existing records from primary storage. [2025-10-22T22:13:58.813307] [INFO ] [MAIN ] QGEN: Loaded 49044 primary data records. [2025-10-22T22:13:59.503214] [DEBUG] [MAIN ] PX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:59.506345] [INFO ] [MAIN ] PX: Generated 1794 derivative records from 33950 primary records. [2025-10-22T22:13:59.518746] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-10-22T22:13:59.520139] [DEBUG] [MAIN ] QD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:59.521319] [INFO ] [MAIN ] QD: Generated 1794 derivative records from 27517 primary records. [2025-10-22T22:13:59.531206] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-10-22T22:13:59.554388] [DEBUG] [LOCAL ] QD: Derivative data saved (1794 records). [2025-10-22T22:13:59.552827] [DEBUG] [LOCAL ] PX: Derivative data saved (1794 records). [2025-10-22T22:13:59.554759] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-10-22T22:13:59.557000] [INFO ] [MAIN ] Derivative Progress: 1492/2052 symbols completed. PX took 1.2s. Estimated remaining: 3m 31s. Rate: 159.1 symbols/min [2025-10-22T22:13:59.554678] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-10-22T22:13:59.561572] [INFO ] [MAIN ] Derivative Progress: 1493/2052 symbols completed. QD took 1.2s. Estimated remaining: 3m 31s. Rate: 159.2 symbols/min [2025-10-22T22:13:59.562474] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:59.561478] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:59.576702] [DEBUG] [MAIN ] QGEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:13:59.577306] [INFO ] [MAIN ] QGEN: Generated 1794 derivative records from 49044 primary records. [2025-10-22T22:13:59.577366] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-10-22T22:13:59.593259] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1794 records). [2025-10-22T22:13:59.593480] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-10-22T22:13:59.596094] [INFO ] [MAIN ] Derivative Progress: 1494/2052 symbols completed. QGEN took 1.1s. Estimated remaining: 3m 30s. Rate: 159.3 symbols/min [2025-10-22T22:13:59.596365] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:13:59.657791] [DEBUG] [LOCAL ] QTWO: Loaded 39446 existing records from primary storage. [2025-10-22T22:13:59.672494] [INFO ] [MAIN ] QTWO: Loaded 39446 primary data records. [2025-10-22T22:13:59.686534] [DEBUG] [LOCAL ] QSR: Loaded 52450 existing records from primary storage. [2025-10-22T22:13:59.720379] [INFO ] [MAIN ] QSR: Loaded 52450 primary data records. [2025-10-22T22:13:59.767058] [DEBUG] [LOCAL ] QS: Loaded 53760 existing records from primary storage. [2025-10-22T22:13:59.806152] [INFO ] [MAIN ] QS: Loaded 53760 primary data records. [2025-10-22T22:14:00.629392] [DEBUG] [MAIN ] QSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:00.630955] [INFO ] [MAIN ] QSR: Generated 1794 derivative records from 52450 primary records. [2025-10-22T22:14:00.631736] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-10-22T22:14:00.661280] [DEBUG] [MAIN ] QS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:00.673689] [DEBUG] [LOCAL ] QSR: Derivative data saved (1794 records). [2025-10-22T22:14:00.674348] [INFO ] [MAIN ] QS: Generated 1794 derivative records from 53760 primary records. [2025-10-22T22:14:00.674549] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-10-22T22:14:00.674864] [DEBUG] [MAIN ] QTWO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:00.675506] [INFO ] [MAIN ] QTWO: Generated 1794 derivative records from 39446 primary records. [2025-10-22T22:14:00.677204] [INFO ] [MAIN ] Derivative Progress: 1495/2052 symbols completed. QSR took 1.1s. Estimated remaining: 3m 30s. Rate: 159.1 symbols/min [2025-10-22T22:14:00.677311] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-10-22T22:14:00.677414] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-10-22T22:14:00.677900] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:00.708862] [DEBUG] [LOCAL ] QS: Derivative data saved (1794 records). [2025-10-22T22:14:00.708980] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-10-22T22:14:00.708792] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1794 records). [2025-10-22T22:14:00.709198] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-10-22T22:14:00.711806] [INFO ] [MAIN ] Derivative Progress: 1496/2052 symbols completed. QS took 1.2s. Estimated remaining: 3m 30s. Rate: 159.2 symbols/min [2025-10-22T22:14:00.714302] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:00.714444] [INFO ] [MAIN ] Derivative Progress: 1497/2052 symbols completed. QTWO took 1.1s. Estimated remaining: 3m 29s. Rate: 159.3 symbols/min [2025-10-22T22:14:00.714672] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:00.733312] [DEBUG] [LOCAL ] QUAD: Loaded 22988 existing records from primary storage. [2025-10-22T22:14:00.733515] [INFO ] [MAIN ] QUAD: Loaded 22988 primary data records. [2025-10-22T22:14:00.756522] [DEBUG] [LOCAL ] QVCD: Loaded 4565 existing records from primary storage. [2025-10-22T22:14:00.771880] [INFO ] [MAIN ] QVCD: Loaded 4565 primary data records. [2025-10-22T22:14:00.835876] [DEBUG] [LOCAL ] QVCC: Loaded 8694 existing records from primary storage. [2025-10-22T22:14:00.870605] [INFO ] [MAIN ] QVCC: Loaded 8694 primary data records. [2025-10-22T22:14:01.701324] [DEBUG] [MAIN ] QUAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:01.727227] [DEBUG] [MAIN ] QVCD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:01.705804] [INFO ] [MAIN ] QUAD: Generated 1794 derivative records from 22988 primary records. [2025-10-22T22:14:01.727399] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-10-22T22:14:01.733989] [INFO ] [MAIN ] QVCD: Generated 1794 derivative records from 4565 primary records. [2025-10-22T22:14:01.735026] [DEBUG] [MAIN ] QVCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:01.735107] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-10-22T22:14:01.743705] [INFO ] [MAIN ] QVCC: Generated 1794 derivative records from 8694 primary records. [2025-10-22T22:14:01.745163] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-10-22T22:14:01.764353] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1794 records). [2025-10-22T22:14:01.771484] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-10-22T22:14:01.780042] [INFO ] [MAIN ] Derivative Progress: 1498/2052 symbols completed. QVCD took 1.1s. Estimated remaining: 3m 29s. Rate: 159.1 symbols/min [2025-10-22T22:14:01.784069] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1794 records). [2025-10-22T22:14:01.777838] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1794 records). [2025-10-22T22:14:01.784449] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-10-22T22:14:01.784611] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-10-22T22:14:01.787792] [INFO ] [MAIN ] Derivative Progress: 1499/2052 symbols completed. QVCC took 1.1s. Estimated remaining: 3m 28s. Rate: 159.2 symbols/min [2025-10-22T22:14:01.790342] [INFO ] [MAIN ] Derivative Progress: 1500/2052 symbols completed. QUAD took 1.1s. Estimated remaining: 3m 28s. Rate: 159.3 symbols/min [2025-10-22T22:14:01.790737] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:01.790828] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:01.791314] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:01.822709] [DEBUG] [LOCAL ] RA: Loaded 21871 existing records from primary storage. [2025-10-22T22:14:01.822844] [INFO ] [MAIN ] RA: Loaded 21871 primary data records. [2025-10-22T22:14:01.875234] [DEBUG] [LOCAL ] R: Loaded 27881 existing records from primary storage. [2025-10-22T22:14:01.895762] [INFO ] [MAIN ] R: Loaded 27881 primary data records. [2025-10-22T22:14:02.256375] [DEBUG] [LOCAL ] QXO: Loaded 53475 existing records from primary storage. [2025-10-22T22:14:02.290841] [INFO ] [MAIN ] QXO: Loaded 53475 primary data records. [2025-10-22T22:14:02.784297] [DEBUG] [MAIN ] RA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:02.785339] [INFO ] [MAIN ] RA: Generated 1794 derivative records from 21871 primary records. [2025-10-22T22:14:02.786627] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-10-22T22:14:02.818031] [DEBUG] [LOCAL ] RA: Derivative data saved (1794 records). [2025-10-22T22:14:02.818165] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-10-22T22:14:02.817207] [DEBUG] [MAIN ] R: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:02.820044] [INFO ] [MAIN ] Derivative Progress: 1501/2052 symbols completed. RA took 1.0s. Estimated remaining: 3m 28s. Rate: 159.2 symbols/min [2025-10-22T22:14:02.820573] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:02.821467] [INFO ] [MAIN ] R: Generated 1794 derivative records from 27881 primary records. [2025-10-22T22:14:02.821671] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-10-22T22:14:02.838597] [DEBUG] [LOCAL ] R: Derivative data saved (1794 records). [2025-10-22T22:14:02.839711] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-10-22T22:14:02.842151] [INFO ] [MAIN ] Derivative Progress: 1502/2052 symbols completed. R took 1.1s. Estimated remaining: 3m 27s. Rate: 159.3 symbols/min [2025-10-22T22:14:02.843817] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:02.857672] [DEBUG] [MAIN ] QXO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:14:02.858501] [INFO ] [MAIN ] QXO: Generated 1793 derivative records from 53475 primary records. [2025-10-22T22:14:02.858680] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-10-22T22:14:02.882698] [DEBUG] [LOCAL ] QXO: Derivative data saved (1793 records). [2025-10-22T22:14:02.882892] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-10-22T22:14:02.886111] [INFO ] [MAIN ] Derivative Progress: 1503/2052 symbols completed. QXO took 1.1s. Estimated remaining: 3m 27s. Rate: 159.4 symbols/min [2025-10-22T22:14:02.896152] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:02.897243] [DEBUG] [LOCAL ] RACE: Loaded 32943 existing records from primary storage. [2025-10-22T22:14:02.897361] [INFO ] [MAIN ] RACE: Loaded 32943 primary data records. [2025-10-22T22:14:03.044005] [DEBUG] [LOCAL ] RAMP: Loaded 37664 existing records from primary storage. [2025-10-22T22:14:03.084718] [INFO ] [MAIN ] RAMP: Loaded 37664 primary data records. [2025-10-22T22:14:03.388579] [DEBUG] [LOCAL ] RBA: Loaded 46060 existing records from primary storage. [2025-10-22T22:14:03.406180] [INFO ] [MAIN ] RBA: Loaded 46060 primary data records. [2025-10-22T22:14:03.906508] [DEBUG] [MAIN ] RACE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:03.908090] [INFO ] [MAIN ] RACE: Generated 1794 derivative records from 32943 primary records. [2025-10-22T22:14:03.908528] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-10-22T22:14:03.926512] [DEBUG] [LOCAL ] RACE: Derivative data saved (1794 records). [2025-10-22T22:14:03.926810] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-10-22T22:14:03.929038] [INFO ] [MAIN ] Derivative Progress: 1504/2052 symbols completed. RACE took 1.1s. Estimated remaining: 3m 27s. Rate: 159.2 symbols/min [2025-10-22T22:14:03.929179] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:03.948568] [DEBUG] [MAIN ] RAMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:03.949563] [INFO ] [MAIN ] RAMP: Generated 1794 derivative records from 37664 primary records. [2025-10-22T22:14:03.949927] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-10-22T22:14:03.971747] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1794 records). [2025-10-22T22:14:03.971894] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-10-22T22:14:03.979454] [INFO ] [MAIN ] Derivative Progress: 1505/2052 symbols completed. RAMP took 1.1s. Estimated remaining: 3m 26s. Rate: 159.3 symbols/min [2025-10-22T22:14:03.980019] [DEBUG] [LOCAL ] RBC: Loaded 15288 existing records from primary storage. [2025-10-22T22:14:03.982828] [INFO ] [MAIN ] RBC: Loaded 15288 primary data records. [2025-10-22T22:14:03.982589] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:04.059931] [DEBUG] [MAIN ] RBA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:04.082965] [INFO ] [MAIN ] RBA: Generated 1794 derivative records from 46060 primary records. [2025-10-22T22:14:04.083122] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-10-22T22:14:04.128023] [DEBUG] [LOCAL ] RBA: Derivative data saved (1794 records). [2025-10-22T22:14:04.128271] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-10-22T22:14:04.141417] [INFO ] [MAIN ] Derivative Progress: 1506/2052 symbols completed. RBA took 1.2s. Estimated remaining: 3m 26s. Rate: 159.3 symbols/min [2025-10-22T22:14:04.146807] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:04.346939] [DEBUG] [LOCAL ] RBLX: Loaded 53718 existing records from primary storage. [2025-10-22T22:14:04.347903] [INFO ] [MAIN ] RBLX: Loaded 53718 primary data records. [2025-10-22T22:14:04.351893] [DEBUG] [LOCAL ] RBOT: Loaded 6236 existing records from primary storage. [2025-10-22T22:14:04.352422] [INFO ] [MAIN ] RBOT: Loaded 6236 primary data records. [2025-10-22T22:14:04.995356] [DEBUG] [MAIN ] RBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:04.997413] [INFO ] [MAIN ] RBC: Generated 1794 derivative records from 15288 primary records. [2025-10-22T22:14:04.997880] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-10-22T22:14:05.017256] [DEBUG] [LOCAL ] RBC: Derivative data saved (1794 records). [2025-10-22T22:14:05.017696] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-10-22T22:14:05.019995] [INFO ] [MAIN ] Derivative Progress: 1507/2052 symbols completed. RBC took 1.1s. Estimated remaining: 3m 25s. Rate: 159.2 symbols/min [2025-10-22T22:14:05.020318] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:05.038161] [DEBUG] [MAIN ] RBLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:05.039018] [INFO ] [MAIN ] RBLX: Generated 1794 derivative records from 53718 primary records. [2025-10-22T22:14:05.039384] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-10-22T22:14:05.059345] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1794 records). [2025-10-22T22:14:05.059561] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-10-22T22:14:05.062401] [INFO ] [MAIN ] Derivative Progress: 1508/2052 symbols completed. RBLX took 1.1s. Estimated remaining: 3m 25s. Rate: 159.3 symbols/min [2025-10-22T22:14:05.075405] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:05.075970] [DEBUG] [MAIN ] RBOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:05.076907] [INFO ] [MAIN ] RBOT: Generated 1794 derivative records from 6236 primary records. [2025-10-22T22:14:05.077207] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-10-22T22:14:05.091954] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1794 records). [2025-10-22T22:14:05.092064] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-10-22T22:14:05.094543] [INFO ] [MAIN ] Derivative Progress: 1509/2052 symbols completed. RBOT took 0.9s. Estimated remaining: 3m 24s. Rate: 159.4 symbols/min [2025-10-22T22:14:05.095040] [INFO ] [MAIN ] RCD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:05.114951] [DEBUG] [LOCAL ] RCD: Loaded 3332 existing records from primary storage. [2025-10-22T22:14:05.115242] [INFO ] [MAIN ] RCD: Loaded 3332 primary data records. [2025-10-22T22:14:05.243702] [DEBUG] [LOCAL ] RBRK: Loaded 53165 existing records from primary storage. [2025-10-22T22:14:05.249779] [INFO ] [MAIN ] RBRK: Loaded 53165 primary data records. [2025-10-22T22:14:05.496292] [DEBUG] [LOCAL ] RC: Loaded 48871 existing records from primary storage. [2025-10-22T22:14:05.536592] [INFO ] [MAIN ] RC: Loaded 48871 primary data records. [2025-10-22T22:14:06.100047] [DEBUG] [MAIN ] RCD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:06.100926] [INFO ] [MAIN ] RCD: Generated 1794 derivative records from 3332 primary records. [2025-10-22T22:14:06.101101] [DEBUG] [LOCAL ] RCD: Saving derivative data. [2025-10-22T22:14:06.117850] [DEBUG] [LOCAL ] RCD: Derivative data saved (1794 records). [2025-10-22T22:14:06.118020] [INFO ] [MAIN ] RCD: Successfully saved derivative data. [2025-10-22T22:14:06.120228] [INFO ] [MAIN ] Derivative Progress: 1510/2052 symbols completed. RCD took 1.0s. Estimated remaining: 3m 24s. Rate: 159.2 symbols/min [2025-10-22T22:14:06.132950] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:06.133258] [DEBUG] [MAIN ] RBRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:06.134103] [INFO ] [MAIN ] RBRK: Generated 1794 derivative records from 53165 primary records. [2025-10-22T22:14:06.134685] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-10-22T22:14:06.151961] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1794 records). [2025-10-22T22:14:06.152924] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-10-22T22:14:06.155146] [INFO ] [MAIN ] Derivative Progress: 1511/2052 symbols completed. RBRK took 1.1s. Estimated remaining: 3m 24s. Rate: 159.3 symbols/min [2025-10-22T22:14:06.155377] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:06.169197] [DEBUG] [MAIN ] RC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:06.169885] [INFO ] [MAIN ] RC: Generated 1794 derivative records from 48871 primary records. [2025-10-22T22:14:06.170070] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-10-22T22:14:06.188857] [DEBUG] [LOCAL ] RC: Derivative data saved (1794 records). [2025-10-22T22:14:06.189137] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-10-22T22:14:06.191764] [INFO ] [MAIN ] Derivative Progress: 1512/2052 symbols completed. RC took 1.1s. Estimated remaining: 3m 23s. Rate: 159.4 symbols/min [2025-10-22T22:14:06.192036] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:06.197971] [DEBUG] [LOCAL ] RCS: Loaded 12437 existing records from primary storage. [2025-10-22T22:14:06.208067] [INFO ] [MAIN ] RCS: Loaded 12437 primary data records. [2025-10-22T22:14:06.356821] [DEBUG] [LOCAL ] RCI: Loaded 48578 existing records from primary storage. [2025-10-22T22:14:06.411522] [INFO ] [MAIN ] RCI: Loaded 48578 primary data records. [2025-10-22T22:14:06.638437] [DEBUG] [LOCAL ] RCUS: Loaded 42963 existing records from primary storage. [2025-10-22T22:14:06.655962] [INFO ] [MAIN ] RCUS: Loaded 42963 primary data records. [2025-10-22T22:14:07.187136] [DEBUG] [MAIN ] RCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:07.188119] [INFO ] [MAIN ] RCS: Generated 1794 derivative records from 12437 primary records. [2025-10-22T22:14:07.188407] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-10-22T22:14:07.206716] [DEBUG] [LOCAL ] RCS: Derivative data saved (1794 records). [2025-10-22T22:14:07.207096] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-10-22T22:14:07.209255] [INFO ] [MAIN ] Derivative Progress: 1513/2052 symbols completed. RCS took 1.1s. Estimated remaining: 3m 23s. Rate: 159.2 symbols/min [2025-10-22T22:14:07.227243] [DEBUG] [MAIN ] RCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:07.228106] [INFO ] [MAIN ] RCI: Generated 1794 derivative records from 48578 primary records. [2025-10-22T22:14:07.228296] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-10-22T22:14:07.245360] [DEBUG] [LOCAL ] RCI: Derivative data saved (1794 records). [2025-10-22T22:14:07.245541] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-10-22T22:14:07.248559] [INFO ] [MAIN ] Derivative Progress: 1514/2052 symbols completed. RCI took 1.1s. Estimated remaining: 3m 23s. Rate: 159.3 symbols/min [2025-10-22T22:14:07.262489] [DEBUG] [MAIN ] RCUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:07.263047] [INFO ] [MAIN ] RCUS: Generated 1794 derivative records from 42963 primary records. [2025-10-22T22:14:07.263109] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-10-22T22:14:07.278154] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1794 records). [2025-10-22T22:14:07.278214] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-10-22T22:14:07.280758] [INFO ] [MAIN ] Derivative Progress: 1515/2052 symbols completed. RCUS took 1.1s. Estimated remaining: 3m 22s. Rate: 159.4 symbols/min [2025-10-22T22:14:07.281294] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:07.281391] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:07.281506] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:07.352360] [DEBUG] [LOCAL ] RDDT: Loaded 53772 existing records from primary storage. [2025-10-22T22:14:07.352624] [INFO ] [MAIN ] RDDT: Loaded 53772 primary data records. [2025-10-22T22:14:07.486577] [DEBUG] [LOCAL ] RDW: Loaded 52288 existing records from primary storage. [2025-10-22T22:14:07.486784] [INFO ] [MAIN ] RDW: Loaded 52288 primary data records. [2025-10-22T22:14:07.485991] [DEBUG] [LOCAL ] RDN: Loaded 44108 existing records from primary storage. [2025-10-22T22:14:07.503435] [INFO ] [MAIN ] RDN: Loaded 44108 primary data records. [2025-10-22T22:14:08.303122] [DEBUG] [MAIN ] RDDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:08.304731] [INFO ] [MAIN ] RDDT: Generated 1794 derivative records from 53772 primary records. [2025-10-22T22:14:08.304951] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-10-22T22:14:08.325871] [DEBUG] [MAIN ] RDW: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:14:08.330161] [INFO ] [MAIN ] RDW: Generated 1793 derivative records from 52288 primary records. [2025-10-22T22:14:08.331122] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-10-22T22:14:08.336281] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1794 records). [2025-10-22T22:14:08.337175] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-10-22T22:14:08.339327] [INFO ] [MAIN ] Derivative Progress: 1516/2052 symbols completed. RDDT took 1.1s. Estimated remaining: 3m 22s. Rate: 159.2 symbols/min [2025-10-22T22:14:08.347008] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:08.363959] [DEBUG] [MAIN ] RDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:08.368554] [INFO ] [MAIN ] RDN: Generated 1794 derivative records from 44108 primary records. [2025-10-22T22:14:08.368858] [DEBUG] [LOCAL ] RDW: Derivative data saved (1793 records). [2025-10-22T22:14:08.368999] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-10-22T22:14:08.369088] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-10-22T22:14:08.371358] [INFO ] [MAIN ] Derivative Progress: 1517/2052 symbols completed. RDW took 1.1s. Estimated remaining: 3m 22s. Rate: 159.3 symbols/min [2025-10-22T22:14:08.372059] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:08.388301] [DEBUG] [LOCAL ] RDN: Derivative data saved (1794 records). [2025-10-22T22:14:08.388488] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-10-22T22:14:08.391076] [INFO ] [MAIN ] Derivative Progress: 1518/2052 symbols completed. RDN took 1.1s. Estimated remaining: 3m 21s. Rate: 159.4 symbols/min [2025-10-22T22:14:08.391402] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:08.443626] [DEBUG] [LOCAL ] RDY: Loaded 46215 existing records from primary storage. [2025-10-22T22:14:08.452340] [INFO ] [MAIN ] RDY: Loaded 46215 primary data records. [2025-10-22T22:14:08.585232] [DEBUG] [LOCAL ] RELX: Loaded 48581 existing records from primary storage. [2025-10-22T22:14:08.585473] [INFO ] [MAIN ] RELX: Loaded 48581 primary data records. [2025-10-22T22:14:08.586543] [DEBUG] [LOCAL ] RERE: Loaded 41799 existing records from primary storage. [2025-10-22T22:14:08.643968] [INFO ] [MAIN ] RERE: Loaded 41799 primary data records. [2025-10-22T22:14:09.451194] [DEBUG] [MAIN ] RDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:09.452992] [INFO ] [MAIN ] RDY: Generated 1794 derivative records from 46215 primary records. [2025-10-22T22:14:09.453450] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-10-22T22:14:09.471341] [DEBUG] [LOCAL ] RDY: Derivative data saved (1794 records). [2025-10-22T22:14:09.474101] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-10-22T22:14:09.476852] [INFO ] [MAIN ] Derivative Progress: 1519/2052 symbols completed. RDY took 1.1s. Estimated remaining: 3m 21s. Rate: 159.2 symbols/min [2025-10-22T22:14:09.477035] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:09.501436] [DEBUG] [MAIN ] RELX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:09.507689] [DEBUG] [MAIN ] RERE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:09.507315] [INFO ] [MAIN ] RELX: Generated 1794 derivative records from 48581 primary records. [2025-10-22T22:14:09.507973] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-10-22T22:14:09.508706] [INFO ] [MAIN ] RERE: Generated 1794 derivative records from 41799 primary records. [2025-10-22T22:14:09.509720] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-10-22T22:14:09.525982] [DEBUG] [LOCAL ] RELX: Derivative data saved (1794 records). [2025-10-22T22:14:09.532811] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-10-22T22:14:09.534973] [INFO ] [MAIN ] Derivative Progress: 1520/2052 symbols completed. RELX took 1.2s. Estimated remaining: 3m 20s. Rate: 159.3 symbols/min [2025-10-22T22:14:09.535249] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:09.544298] [DEBUG] [LOCAL ] RERE: Derivative data saved (1794 records). [2025-10-22T22:14:09.544476] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-10-22T22:14:09.547118] [INFO ] [MAIN ] Derivative Progress: 1521/2052 symbols completed. RERE took 1.2s. Estimated remaining: 3m 20s. Rate: 159.4 symbols/min [2025-10-22T22:14:09.547339] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:09.579546] [DEBUG] [LOCAL ] RES: Loaded 46858 existing records from primary storage. [2025-10-22T22:14:09.579814] [INFO ] [MAIN ] RES: Loaded 46858 primary data records. [2025-10-22T22:14:09.657627] [DEBUG] [LOCAL ] REX: Loaded 14324 existing records from primary storage. [2025-10-22T22:14:09.670072] [INFO ] [MAIN ] REX: Loaded 14324 primary data records. [2025-10-22T22:14:09.785392] [DEBUG] [LOCAL ] REVG: Loaded 40157 existing records from primary storage. [2025-10-22T22:14:09.856255] [INFO ] [MAIN ] REVG: Loaded 40157 primary data records. [2025-10-22T22:14:10.530422] [DEBUG] [MAIN ] RES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:10.533291] [INFO ] [MAIN ] RES: Generated 1794 derivative records from 46858 primary records. [2025-10-22T22:14:10.533408] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-10-22T22:14:10.552947] [DEBUG] [LOCAL ] RES: Derivative data saved (1794 records). [2025-10-22T22:14:10.553073] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-10-22T22:14:10.555117] [INFO ] [MAIN ] Derivative Progress: 1522/2052 symbols completed. RES took 1.1s. Estimated remaining: 3m 20s. Rate: 159.2 symbols/min [2025-10-22T22:14:10.555633] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:10.600190] [DEBUG] [MAIN ] REX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:10.600930] [DEBUG] [MAIN ] REVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:10.602200] [INFO ] [MAIN ] REX: Generated 1794 derivative records from 14324 primary records. [2025-10-22T22:14:10.603585] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-10-22T22:14:10.603433] [INFO ] [MAIN ] REVG: Generated 1794 derivative records from 40157 primary records. [2025-10-22T22:14:10.604461] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-10-22T22:14:10.640265] [DEBUG] [LOCAL ] REVG: Derivative data saved (1794 records). [2025-10-22T22:14:10.644953] [DEBUG] [LOCAL ] REX: Derivative data saved (1794 records). [2025-10-22T22:14:10.658160] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-10-22T22:14:10.658020] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-10-22T22:14:10.660876] [INFO ] [MAIN ] Derivative Progress: 1523/2052 symbols completed. REX took 1.1s. Estimated remaining: 3m 19s. Rate: 159.3 symbols/min [2025-10-22T22:14:10.663585] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:10.663768] [INFO ] [MAIN ] Derivative Progress: 1524/2052 symbols completed. REVG took 1.1s. Estimated remaining: 3m 19s. Rate: 159.4 symbols/min [2025-10-22T22:14:10.664322] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:10.684020] [DEBUG] [LOCAL ] REXR: Loaded 52193 existing records from primary storage. [2025-10-22T22:14:10.684207] [INFO ] [MAIN ] REXR: Loaded 52193 primary data records. [2025-10-22T22:14:11.036450] [DEBUG] [LOCAL ] REZI: Loaded 47098 existing records from primary storage. [2025-10-22T22:14:11.045157] [INFO ] [MAIN ] REZI: Loaded 47098 primary data records. [2025-10-22T22:14:11.102250] [DEBUG] [LOCAL ] RF: Loaded 53633 existing records from primary storage. [2025-10-22T22:14:11.121469] [INFO ] [MAIN ] RF: Loaded 53633 primary data records. [2025-10-22T22:14:11.682722] [DEBUG] [MAIN ] REXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:11.684121] [INFO ] [MAIN ] REXR: Generated 1794 derivative records from 52193 primary records. [2025-10-22T22:14:11.685034] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-10-22T22:14:11.704805] [DEBUG] [LOCAL ] REXR: Derivative data saved (1794 records). [2025-10-22T22:14:11.706033] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-10-22T22:14:11.708915] [INFO ] [MAIN ] Derivative Progress: 1525/2052 symbols completed. REXR took 1.2s. Estimated remaining: 3m 19s. Rate: 159.2 symbols/min [2025-10-22T22:14:11.709458] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:11.755567] [DEBUG] [LOCAL ] RFI: Loaded 10230 existing records from primary storage. [2025-10-22T22:14:11.756218] [INFO ] [MAIN ] RFI: Loaded 10230 primary data records. [2025-10-22T22:14:11.757033] [DEBUG] [MAIN ] RF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:11.756606] [DEBUG] [MAIN ] REZI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:11.758326] [INFO ] [MAIN ] RF: Generated 1794 derivative records from 53633 primary records. [2025-10-22T22:14:11.771314] [INFO ] [MAIN ] REZI: Generated 1794 derivative records from 47098 primary records. [2025-10-22T22:14:11.806003] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-10-22T22:14:11.805909] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-10-22T22:14:11.860346] [DEBUG] [LOCAL ] REZI: Derivative data saved (1794 records). [2025-10-22T22:14:11.860460] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-10-22T22:14:11.873767] [INFO ] [MAIN ] Derivative Progress: 1526/2052 symbols completed. REZI took 1.2s. Estimated remaining: 3m 18s. Rate: 159.3 symbols/min [2025-10-22T22:14:11.912017] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:11.935099] [DEBUG] [LOCAL ] RF: Derivative data saved (1794 records). [2025-10-22T22:14:11.945750] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-10-22T22:14:11.962418] [INFO ] [MAIN ] Derivative Progress: 1527/2052 symbols completed. RF took 1.3s. Estimated remaining: 3m 18s. Rate: 159.3 symbols/min [2025-10-22T22:14:12.005903] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:12.125715] [DEBUG] [LOCAL ] RFL: Loaded 11419 existing records from primary storage. [2025-10-22T22:14:12.126567] [INFO ] [MAIN ] RFL: Loaded 11419 primary data records. [2025-10-22T22:14:12.214325] [DEBUG] [LOCAL ] RFM: Loaded 4209 existing records from primary storage. [2025-10-22T22:14:12.237056] [INFO ] [MAIN ] RFM: Loaded 4209 primary data records. [2025-10-22T22:14:12.811144] [DEBUG] [MAIN ] RFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:12.812301] [INFO ] [MAIN ] RFI: Generated 1794 derivative records from 10230 primary records. [2025-10-22T22:14:12.812664] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-10-22T22:14:12.829838] [DEBUG] [LOCAL ] RFI: Derivative data saved (1794 records). [2025-10-22T22:14:12.830260] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-10-22T22:14:12.832158] [INFO ] [MAIN ] Derivative Progress: 1528/2052 symbols completed. RFI took 1.1s. Estimated remaining: 3m 17s. Rate: 159.2 symbols/min [2025-10-22T22:14:12.850949] [DEBUG] [MAIN ] RFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:12.851603] [INFO ] [MAIN ] RFL: Generated 1794 derivative records from 11419 primary records. [2025-10-22T22:14:12.851908] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-10-22T22:14:12.869780] [DEBUG] [LOCAL ] RFL: Derivative data saved (1794 records). [2025-10-22T22:14:12.869977] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-10-22T22:14:12.872466] [INFO ] [MAIN ] Derivative Progress: 1529/2052 symbols completed. RFL took 1.0s. Estimated remaining: 3m 17s. Rate: 159.3 symbols/min [2025-10-22T22:14:12.885121] [DEBUG] [MAIN ] RFM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:12.885834] [INFO ] [MAIN ] RFM: Generated 1794 derivative records from 4209 primary records. [2025-10-22T22:14:12.885899] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-10-22T22:14:12.900045] [DEBUG] [LOCAL ] RFM: Derivative data saved (1794 records). [2025-10-22T22:14:12.900116] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-10-22T22:14:12.902728] [INFO ] [MAIN ] Derivative Progress: 1530/2052 symbols completed. RFM took 0.9s. Estimated remaining: 3m 16s. Rate: 159.4 symbols/min [2025-10-22T22:14:12.903325] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:12.903246] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:12.903387] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:12.915850] [DEBUG] [LOCAL ] RFMZ: Loaded 9010 existing records from primary storage. [2025-10-22T22:14:12.920996] [INFO ] [MAIN ] RFMZ: Loaded 9010 primary data records. [2025-10-22T22:14:13.047011] [DEBUG] [LOCAL ] RGR: Loaded 20982 existing records from primary storage. [2025-10-22T22:14:13.052741] [INFO ] [MAIN ] RGR: Loaded 20982 primary data records. [2025-10-22T22:14:13.053365] [DEBUG] [LOCAL ] RGA: Loaded 29198 existing records from primary storage. [2025-10-22T22:14:13.123324] [INFO ] [MAIN ] RGA: Loaded 29198 primary data records. [2025-10-22T22:14:13.858225] [DEBUG] [MAIN ] RFMZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:13.860893] [INFO ] [MAIN ] RFMZ: Generated 1794 derivative records from 9010 primary records. [2025-10-22T22:14:13.861612] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-10-22T22:14:13.890843] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1794 records). [2025-10-22T22:14:13.890982] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-10-22T22:14:13.889926] [DEBUG] [MAIN ] RGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:13.893097] [INFO ] [MAIN ] Derivative Progress: 1531/2052 symbols completed. RFMZ took 1.0s. Estimated remaining: 3m 16s. Rate: 159.2 symbols/min [2025-10-22T22:14:13.893375] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:13.894215] [INFO ] [MAIN ] RGR: Generated 1794 derivative records from 20982 primary records. [2025-10-22T22:14:13.894436] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-10-22T22:14:13.914083] [DEBUG] [LOCAL ] RGR: Derivative data saved (1794 records). [2025-10-22T22:14:13.933275] [DEBUG] [LOCAL ] RGT: Loaded 2685 existing records from primary storage. [2025-10-22T22:14:13.933607] [DEBUG] [MAIN ] RGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:13.930851] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-10-22T22:14:13.933813] [INFO ] [MAIN ] RGT: Loaded 2685 primary data records. [2025-10-22T22:14:13.948311] [INFO ] [MAIN ] Derivative Progress: 1532/2052 symbols completed. RGR took 1.0s. Estimated remaining: 3m 16s. Rate: 159.3 symbols/min [2025-10-22T22:14:13.945906] [INFO ] [MAIN ] RGA: Generated 1794 derivative records from 29198 primary records. [2025-10-22T22:14:13.973155] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:13.973028] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-10-22T22:14:14.128794] [DEBUG] [LOCAL ] RGA: Derivative data saved (1794 records). [2025-10-22T22:14:14.134095] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-10-22T22:14:14.238287] [INFO ] [MAIN ] Derivative Progress: 1533/2052 symbols completed. RGA took 1.3s. Estimated remaining: 3m 15s. Rate: 159.3 symbols/min [2025-10-22T22:14:14.251670] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:14.286155] [DEBUG] [LOCAL ] RH: Loaded 47133 existing records from primary storage. [2025-10-22T22:14:14.286715] [INFO ] [MAIN ] RH: Loaded 47133 primary data records. [2025-10-22T22:14:14.436853] [DEBUG] [MAIN ] RGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:14.465185] [INFO ] [MAIN ] RGT: Generated 1794 derivative records from 2685 primary records. [2025-10-22T22:14:14.508023] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-10-22T22:14:14.649700] [DEBUG] [LOCAL ] RHI: Loaded 49689 existing records from primary storage. [2025-10-22T22:14:14.661892] [INFO ] [MAIN ] RHI: Loaded 49689 primary data records. [2025-10-22T22:14:14.676965] [DEBUG] [LOCAL ] RGT: Derivative data saved (1794 records). [2025-10-22T22:14:14.713189] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-10-22T22:14:14.734685] [INFO ] [MAIN ] Derivative Progress: 1534/2052 symbols completed. RGT took 0.8s. Estimated remaining: 3m 15s. Rate: 159.3 symbols/min [2025-10-22T22:14:14.755393] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:15.029237] [DEBUG] [LOCAL ] RHP: Loaded 40303 existing records from primary storage. [2025-10-22T22:14:15.029861] [INFO ] [MAIN ] RHP: Loaded 40303 primary data records. [2025-10-22T22:14:15.030200] [DEBUG] [MAIN ] RH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:15.042780] [INFO ] [MAIN ] RH: Generated 1794 derivative records from 47133 primary records. [2025-10-22T22:14:15.069350] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-10-22T22:14:15.154319] [DEBUG] [LOCAL ] RH: Derivative data saved (1794 records). [2025-10-22T22:14:15.165100] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-10-22T22:14:15.206541] [INFO ] [MAIN ] Derivative Progress: 1535/2052 symbols completed. RH took 1.2s. Estimated remaining: 3m 15s. Rate: 159.3 symbols/min [2025-10-22T22:14:15.345755] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:15.367193] [DEBUG] [MAIN ] RHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:15.367836] [INFO ] [MAIN ] RHI: Generated 1794 derivative records from 49689 primary records. [2025-10-22T22:14:15.367898] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-10-22T22:14:15.386631] [DEBUG] [LOCAL ] RHI: Derivative data saved (1794 records). [2025-10-22T22:14:15.386946] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-10-22T22:14:15.389096] [INFO ] [MAIN ] Derivative Progress: 1536/2052 symbols completed. RHI took 1.1s. Estimated remaining: 3m 14s. Rate: 159.3 symbols/min [2025-10-22T22:14:15.389369] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:15.426414] [DEBUG] [MAIN ] RHP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:15.427201] [INFO ] [MAIN ] RHP: Generated 1794 derivative records from 40303 primary records. [2025-10-22T22:14:15.427413] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-10-22T22:14:15.443368] [DEBUG] [LOCAL ] RHP: Derivative data saved (1794 records). [2025-10-22T22:14:15.456061] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-10-22T22:14:15.474103] [INFO ] [MAIN ] Derivative Progress: 1537/2052 symbols completed. RHP took 0.7s. Estimated remaining: 3m 14s. Rate: 159.4 symbols/min [2025-10-22T22:14:15.475670] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:15.475481] [DEBUG] [LOCAL ] RIG: Loaded 53675 existing records from primary storage. [2025-10-22T22:14:15.475916] [INFO ] [MAIN ] RIG: Loaded 53675 primary data records. [2025-10-22T22:14:15.595853] [DEBUG] [LOCAL ] RIO: Loaded 53402 existing records from primary storage. [2025-10-22T22:14:15.607107] [INFO ] [MAIN ] RIO: Loaded 53402 primary data records. [2025-10-22T22:14:15.949448] [DEBUG] [LOCAL ] RITM: Loaded 52945 existing records from primary storage. [2025-10-22T22:14:15.960380] [INFO ] [MAIN ] RITM: Loaded 52945 primary data records. [2025-10-22T22:14:16.449156] [DEBUG] [MAIN ] RIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:16.450344] [INFO ] [MAIN ] RIG: Generated 1794 derivative records from 53675 primary records. [2025-10-22T22:14:16.450742] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-10-22T22:14:16.469531] [DEBUG] [LOCAL ] RIG: Derivative data saved (1794 records). [2025-10-22T22:14:16.469721] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-10-22T22:14:16.471720] [INFO ] [MAIN ] Derivative Progress: 1538/2052 symbols completed. RIG took 1.1s. Estimated remaining: 3m 14s. Rate: 159.2 symbols/min [2025-10-22T22:14:16.471982] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:16.486479] [DEBUG] [MAIN ] RIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:16.487242] [INFO ] [MAIN ] RIO: Generated 1794 derivative records from 53402 primary records. [2025-10-22T22:14:16.487586] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-10-22T22:14:16.513892] [DEBUG] [LOCAL ] RIV: Loaded 12627 existing records from primary storage. [2025-10-22T22:14:16.514183] [INFO ] [MAIN ] RIV: Loaded 12627 primary data records. [2025-10-22T22:14:16.513619] [DEBUG] [LOCAL ] RIO: Derivative data saved (1794 records). [2025-10-22T22:14:16.525614] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-10-22T22:14:16.528220] [INFO ] [MAIN ] Derivative Progress: 1539/2052 symbols completed. RIO took 1.1s. Estimated remaining: 3m 13s. Rate: 159.3 symbols/min [2025-10-22T22:14:16.574054] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:16.624148] [DEBUG] [MAIN ] RITM: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:14:16.635710] [INFO ] [MAIN ] RITM: Generated 1793 derivative records from 52945 primary records. [2025-10-22T22:14:16.636179] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-10-22T22:14:16.874627] [DEBUG] [LOCAL ] RITM: Derivative data saved (1793 records). [2025-10-22T22:14:16.887759] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-10-22T22:14:16.892079] [INFO ] [MAIN ] Derivative Progress: 1540/2052 symbols completed. RITM took 1.4s. Estimated remaining: 3m 13s. Rate: 159.3 symbols/min [2025-10-22T22:14:16.892432] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:16.925264] [DEBUG] [LOCAL ] RJF: Loaded 46546 existing records from primary storage. [2025-10-22T22:14:16.925612] [INFO ] [MAIN ] RJF: Loaded 46546 primary data records. [2025-10-22T22:14:17.045411] [DEBUG] [MAIN ] RIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:17.050024] [INFO ] [MAIN ] RIV: Generated 1794 derivative records from 12627 primary records. [2025-10-22T22:14:17.104582] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-10-22T22:14:17.301358] [DEBUG] [LOCAL ] RKT: Loaded 53729 existing records from primary storage. [2025-10-22T22:14:17.303798] [INFO ] [MAIN ] RKT: Loaded 53729 primary data records. [2025-10-22T22:14:17.302713] [DEBUG] [LOCAL ] RIV: Derivative data saved (1794 records). [2025-10-22T22:14:17.304054] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-10-22T22:14:17.342225] [INFO ] [MAIN ] Derivative Progress: 1541/2052 symbols completed. RIV took 0.9s. Estimated remaining: 3m 12s. Rate: 159.3 symbols/min [2025-10-22T22:14:17.372052] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:17.680985] [DEBUG] [MAIN ] RJF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:17.682172] [INFO ] [MAIN ] RJF: Generated 1794 derivative records from 46546 primary records. [2025-10-22T22:14:17.682332] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-10-22T22:14:17.711010] [DEBUG] [LOCAL ] RJF: Derivative data saved (1794 records). [2025-10-22T22:14:17.712404] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-10-22T22:14:17.715120] [INFO ] [MAIN ] Derivative Progress: 1542/2052 symbols completed. RJF took 1.1s. Estimated remaining: 3m 12s. Rate: 159.3 symbols/min [2025-10-22T22:14:17.715483] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:17.717117] [DEBUG] [LOCAL ] RL: Loaded 39350 existing records from primary storage. [2025-10-22T22:14:17.717491] [INFO ] [MAIN ] RL: Loaded 39350 primary data records. [2025-10-22T22:14:18.064145] [DEBUG] [MAIN ] RKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:18.078288] [INFO ] [MAIN ] RKT: Generated 1794 derivative records from 53729 primary records. [2025-10-22T22:14:18.081254] [DEBUG] [LOCAL ] RLI: Loaded 34703 existing records from primary storage. [2025-10-22T22:14:18.078548] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-10-22T22:14:18.082001] [INFO ] [MAIN ] RLI: Loaded 34703 primary data records. [2025-10-22T22:14:18.142961] [DEBUG] [LOCAL ] RKT: Derivative data saved (1794 records). [2025-10-22T22:14:18.150418] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-10-22T22:14:18.176971] [INFO ] [MAIN ] Derivative Progress: 1543/2052 symbols completed. RKT took 1.3s. Estimated remaining: 3m 12s. Rate: 159.3 symbols/min [2025-10-22T22:14:18.446506] [DEBUG] [MAIN ] RL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:18.447983] [INFO ] [MAIN ] RL: Generated 1794 derivative records from 39350 primary records. [2025-10-22T22:14:18.448543] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-10-22T22:14:18.468224] [DEBUG] [LOCAL ] RL: Derivative data saved (1794 records). [2025-10-22T22:14:18.468409] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-10-22T22:14:18.472072] [INFO ] [MAIN ] Derivative Progress: 1544/2052 symbols completed. RL took 1.1s. Estimated remaining: 3m 11s. Rate: 159.3 symbols/min [2025-10-22T22:14:18.490247] [DEBUG] [MAIN ] RLI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:18.490960] [INFO ] [MAIN ] RLI: Generated 1794 derivative records from 34703 primary records. [2025-10-22T22:14:18.491024] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-10-22T22:14:18.506369] [DEBUG] [LOCAL ] RLI: Derivative data saved (1794 records). [2025-10-22T22:14:18.506430] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-10-22T22:14:18.508790] [INFO ] [MAIN ] Derivative Progress: 1545/2052 symbols completed. RLI took 0.8s. Estimated remaining: 3m 11s. Rate: 159.4 symbols/min [2025-10-22T22:14:18.509436] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:18.509743] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:18.509564] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:18.530080] [DEBUG] [LOCAL ] RLTY: Loaded 10963 existing records from primary storage. [2025-10-22T22:14:18.530303] [INFO ] [MAIN ] RLTY: Loaded 10963 primary data records. [2025-10-22T22:14:18.686001] [DEBUG] [LOCAL ] RLJ: Loaded 47956 existing records from primary storage. [2025-10-22T22:14:18.686934] [INFO ] [MAIN ] RLJ: Loaded 47956 primary data records. [2025-10-22T22:14:18.826548] [DEBUG] [LOCAL ] RLX: Loaded 48165 existing records from primary storage. [2025-10-22T22:14:18.888239] [INFO ] [MAIN ] RLX: Loaded 48165 primary data records. [2025-10-22T22:14:19.672127] [DEBUG] [MAIN ] RLTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:19.675909] [INFO ] [MAIN ] RLTY: Generated 1794 derivative records from 10963 primary records. [2025-10-22T22:14:19.677306] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-10-22T22:14:19.703247] [DEBUG] [MAIN ] RLJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:19.712209] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1794 records). [2025-10-22T22:14:19.714265] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-10-22T22:14:19.713904] [INFO ] [MAIN ] RLJ: Generated 1794 derivative records from 47956 primary records. [2025-10-22T22:14:19.717332] [INFO ] [MAIN ] Derivative Progress: 1546/2052 symbols completed. RLTY took 1.2s. Estimated remaining: 3m 11s. Rate: 159.2 symbols/min [2025-10-22T22:14:19.717747] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:19.718736] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-10-22T22:14:19.741965] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1794 records). [2025-10-22T22:14:19.754785] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-10-22T22:14:19.758010] [INFO ] [MAIN ] Derivative Progress: 1547/2052 symbols completed. RLJ took 1.2s. Estimated remaining: 3m 10s. Rate: 159.3 symbols/min [2025-10-22T22:14:19.755065] [DEBUG] [MAIN ] RLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:19.758767] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:19.763859] [INFO ] [MAIN ] RLX: Generated 1794 derivative records from 48165 primary records. [2025-10-22T22:14:19.764281] [DEBUG] [LOCAL ] RM: Loaded 7508 existing records from primary storage. [2025-10-22T22:14:19.764869] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-10-22T22:14:19.765380] [INFO ] [MAIN ] RM: Loaded 7508 primary data records. [2025-10-22T22:14:19.862254] [DEBUG] [LOCAL ] RLX: Derivative data saved (1794 records). [2025-10-22T22:14:19.883436] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-10-22T22:14:19.896466] [INFO ] [MAIN ] Derivative Progress: 1548/2052 symbols completed. RLX took 1.4s. Estimated remaining: 3m 10s. Rate: 159.3 symbols/min [2025-10-22T22:14:19.896737] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:19.978407] [DEBUG] [LOCAL ] RMAX: Loaded 21614 existing records from primary storage. [2025-10-22T22:14:19.980445] [INFO ] [MAIN ] RMAX: Loaded 21614 primary data records. [2025-10-22T22:14:20.432531] [DEBUG] [LOCAL ] RMD: Loaded 41879 existing records from primary storage. [2025-10-22T22:14:20.432937] [INFO ] [MAIN ] RMD: Loaded 41879 primary data records. [2025-10-22T22:14:20.633964] [DEBUG] [MAIN ] RM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:20.651135] [INFO ] [MAIN ] RM: Generated 1794 derivative records from 7508 primary records. [2025-10-22T22:14:20.651496] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-10-22T22:14:20.838181] [DEBUG] [LOCAL ] RM: Derivative data saved (1794 records). [2025-10-22T22:14:20.838576] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-10-22T22:14:20.843933] [INFO ] [MAIN ] Derivative Progress: 1549/2052 symbols completed. RM took 1.1s. Estimated remaining: 3m 10s. Rate: 159.2 symbols/min [2025-10-22T22:14:20.844495] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:20.859668] [DEBUG] [MAIN ] RMAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:20.861231] [INFO ] [MAIN ] RMAX: Generated 1794 derivative records from 21614 primary records. [2025-10-22T22:14:20.861466] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-10-22T22:14:20.880098] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1794 records). [2025-10-22T22:14:20.883679] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-10-22T22:14:20.883435] [DEBUG] [LOCAL ] RMI: Loaded 4769 existing records from primary storage. [2025-10-22T22:14:20.886430] [INFO ] [MAIN ] Derivative Progress: 1550/2052 symbols completed. RMAX took 1.1s. Estimated remaining: 3m 9s. Rate: 159.3 symbols/min [2025-10-22T22:14:20.886528] [INFO ] [MAIN ] RMI: Loaded 4769 primary data records. [2025-10-22T22:14:20.886839] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:21.028201] [DEBUG] [LOCAL ] RMM: Loaded 10866 existing records from primary storage. [2025-10-22T22:14:21.039830] [INFO ] [MAIN ] RMM: Loaded 10866 primary data records. [2025-10-22T22:14:21.176350] [DEBUG] [MAIN ] RMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:21.244347] [INFO ] [MAIN ] RMD: Generated 1794 derivative records from 41879 primary records. [2025-10-22T22:14:21.347238] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-10-22T22:14:21.569171] [DEBUG] [LOCAL ] RMD: Derivative data saved (1794 records). [2025-10-22T22:14:21.569535] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-10-22T22:14:21.572830] [INFO ] [MAIN ] Derivative Progress: 1551/2052 symbols completed. RMD took 1.7s. Estimated remaining: 3m 9s. Rate: 159.2 symbols/min [2025-10-22T22:14:21.573244] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:21.584234] [DEBUG] [LOCAL ] RMMZ: Loaded 4798 existing records from primary storage. [2025-10-22T22:14:21.584819] [INFO ] [MAIN ] RMMZ: Loaded 4798 primary data records. [2025-10-22T22:14:21.786533] [DEBUG] [MAIN ] RMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:21.896063] [INFO ] [MAIN ] RMI: Generated 1794 derivative records from 4769 primary records. [2025-10-22T22:14:21.904322] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-10-22T22:14:21.926011] [DEBUG] [MAIN ] RMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:21.931766] [INFO ] [MAIN ] RMM: Generated 1794 derivative records from 10866 primary records. [2025-10-22T22:14:21.932552] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-10-22T22:14:21.939163] [DEBUG] [LOCAL ] RMI: Derivative data saved (1794 records). [2025-10-22T22:14:21.939288] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-10-22T22:14:21.941481] [INFO ] [MAIN ] Derivative Progress: 1552/2052 symbols completed. RMI took 1.1s. Estimated remaining: 3m 8s. Rate: 159.2 symbols/min [2025-10-22T22:14:21.941916] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:21.960431] [DEBUG] [LOCAL ] RMM: Derivative data saved (1794 records). [2025-10-22T22:14:21.960683] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-10-22T22:14:21.963179] [INFO ] [MAIN ] Derivative Progress: 1553/2052 symbols completed. RMM took 1.1s. Estimated remaining: 3m 8s. Rate: 159.3 symbols/min [2025-10-22T22:14:21.963954] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:21.978318] [DEBUG] [LOCAL ] RMT: Loaded 17151 existing records from primary storage. [2025-10-22T22:14:21.978575] [INFO ] [MAIN ] RMT: Loaded 17151 primary data records. [2025-10-22T22:14:22.200447] [DEBUG] [MAIN ] RMMZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:22.213415] [INFO ] [MAIN ] RMMZ: Generated 1794 derivative records from 4798 primary records. [2025-10-22T22:14:22.314472] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-10-22T22:14:22.329217] [DEBUG] [LOCAL ] RNG: Loaded 47979 existing records from primary storage. [2025-10-22T22:14:22.330406] [INFO ] [MAIN ] RNG: Loaded 47979 primary data records. [2025-10-22T22:14:22.450422] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1794 records). [2025-10-22T22:14:22.451387] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-10-22T22:14:22.530089] [INFO ] [MAIN ] Derivative Progress: 1554/2052 symbols completed. RMMZ took 1.0s. Estimated remaining: 3m 8s. Rate: 159.2 symbols/min [2025-10-22T22:14:22.643586] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:22.672002] [DEBUG] [MAIN ] RMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:22.672830] [INFO ] [MAIN ] RMT: Generated 1794 derivative records from 17151 primary records. [2025-10-22T22:14:22.673057] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-10-22T22:14:22.693491] [DEBUG] [LOCAL ] RNGR: Loaded 20718 existing records from primary storage. [2025-10-22T22:14:22.696212] [INFO ] [MAIN ] RNGR: Loaded 20718 primary data records. [2025-10-22T22:14:22.718911] [DEBUG] [LOCAL ] RMT: Derivative data saved (1794 records). [2025-10-22T22:14:22.734691] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-10-22T22:14:22.776363] [INFO ] [MAIN ] Derivative Progress: 1555/2052 symbols completed. RMT took 0.8s. Estimated remaining: 3m 7s. Rate: 159.3 symbols/min [2025-10-22T22:14:22.793685] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:22.818817] [DEBUG] [MAIN ] RNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:22.835885] [INFO ] [MAIN ] RNG: Generated 1794 derivative records from 47979 primary records. [2025-10-22T22:14:22.846403] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-10-22T22:14:23.082836] [DEBUG] [LOCAL ] RNP: Loaded 15933 existing records from primary storage. [2025-10-22T22:14:23.083043] [DEBUG] [LOCAL ] RNG: Derivative data saved (1794 records). [2025-10-22T22:14:23.083268] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-10-22T22:14:23.083440] [INFO ] [MAIN ] RNP: Loaded 15933 primary data records. [2025-10-22T22:14:23.098667] [INFO ] [MAIN ] Derivative Progress: 1556/2052 symbols completed. RNG took 1.1s. Estimated remaining: 3m 7s. Rate: 159.3 symbols/min [2025-10-22T22:14:23.108537] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:23.406131] [DEBUG] [LOCAL ] RNR: Loaded 33518 existing records from primary storage. [2025-10-22T22:14:23.418685] [INFO ] [MAIN ] RNR: Loaded 33518 primary data records. [2025-10-22T22:14:23.473552] [DEBUG] [MAIN ] RNGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:23.483325] [INFO ] [MAIN ] RNGR: Generated 1794 derivative records from 20718 primary records. [2025-10-22T22:14:23.501044] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-10-22T22:14:23.597638] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1794 records). [2025-10-22T22:14:23.612389] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-10-22T22:14:23.733354] [INFO ] [MAIN ] Derivative Progress: 1557/2052 symbols completed. RNGR took 1.1s. Estimated remaining: 3m 7s. Rate: 159.2 symbols/min [2025-10-22T22:14:23.736051] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:23.752239] [DEBUG] [MAIN ] RNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:23.753913] [INFO ] [MAIN ] RNP: Generated 1794 derivative records from 15933 primary records. [2025-10-22T22:14:23.754414] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-10-22T22:14:23.771340] [DEBUG] [LOCAL ] RNP: Derivative data saved (1794 records). [2025-10-22T22:14:23.772269] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-10-22T22:14:23.774907] [INFO ] [MAIN ] Derivative Progress: 1558/2052 symbols completed. RNP took 1.0s. Estimated remaining: 3m 6s. Rate: 159.3 symbols/min [2025-10-22T22:14:23.803294] [DEBUG] [MAIN ] RNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:23.803978] [INFO ] [MAIN ] RNR: Generated 1794 derivative records from 33518 primary records. [2025-10-22T22:14:23.804699] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-10-22T22:14:23.816103] [DEBUG] [LOCAL ] RNST: Loaded 35883 existing records from primary storage. [2025-10-22T22:14:23.816216] [INFO ] [MAIN ] RNST: Loaded 35883 primary data records. [2025-10-22T22:14:23.934397] [DEBUG] [LOCAL ] RNR: Derivative data saved (1794 records). [2025-10-22T22:14:23.940204] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-10-22T22:14:23.948280] [INFO ] [MAIN ] Derivative Progress: 1559/2052 symbols completed. RNR took 0.8s. Estimated remaining: 3m 6s. Rate: 159.4 symbols/min [2025-10-22T22:14:24.151959] [DEBUG] [MAIN ] RNST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:24.152552] [INFO ] [MAIN ] RNST: Generated 1794 derivative records from 35883 primary records. [2025-10-22T22:14:24.152619] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-10-22T22:14:24.168149] [DEBUG] [LOCAL ] RNST: Derivative data saved (1794 records). [2025-10-22T22:14:24.168283] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-10-22T22:14:24.170396] [INFO ] [MAIN ] Derivative Progress: 1560/2052 symbols completed. RNST took 0.4s. Estimated remaining: 3m 5s. Rate: 159.4 symbols/min [2025-10-22T22:14:24.170860] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:24.171008] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:24.170956] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:24.194635] [DEBUG] [LOCAL ] ROG: Loaded 21642 existing records from primary storage. [2025-10-22T22:14:24.194798] [INFO ] [MAIN ] ROG: Loaded 21642 primary data records. [2025-10-22T22:14:24.367085] [DEBUG] [LOCAL ] ROL: Loaded 50245 existing records from primary storage. [2025-10-22T22:14:24.383359] [DEBUG] [LOCAL ] ROK: Loaded 42806 existing records from primary storage. [2025-10-22T22:14:24.407873] [INFO ] [MAIN ] ROK: Loaded 42806 primary data records. [2025-10-22T22:14:24.398603] [INFO ] [MAIN ] ROL: Loaded 50245 primary data records. [2025-10-22T22:14:25.260823] [DEBUG] [MAIN ] ROG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:25.261584] [INFO ] [MAIN ] ROG: Generated 1794 derivative records from 21642 primary records. [2025-10-22T22:14:25.261897] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-10-22T22:14:25.279360] [DEBUG] [LOCAL ] ROG: Derivative data saved (1794 records). [2025-10-22T22:14:25.279830] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-10-22T22:14:25.281771] [INFO ] [MAIN ] Derivative Progress: 1561/2052 symbols completed. ROG took 1.1s. Estimated remaining: 3m 5s. Rate: 159.2 symbols/min [2025-10-22T22:14:25.282144] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:25.303534] [DEBUG] [MAIN ] ROK: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:14:25.319236] [INFO ] [MAIN ] ROK: Generated 1793 derivative records from 42806 primary records. [2025-10-22T22:14:25.319891] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-10-22T22:14:25.319809] [DEBUG] [MAIN ] ROL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:25.321983] [INFO ] [MAIN ] ROL: Generated 1794 derivative records from 50245 primary records. [2025-10-22T22:14:25.336571] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-10-22T22:14:25.337315] [DEBUG] [LOCAL ] ROK: Derivative data saved (1793 records). [2025-10-22T22:14:25.338234] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-10-22T22:14:25.341157] [INFO ] [MAIN ] Derivative Progress: 1562/2052 symbols completed. ROK took 1.2s. Estimated remaining: 3m 5s. Rate: 159.3 symbols/min [2025-10-22T22:14:25.341424] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:25.367103] [DEBUG] [LOCAL ] ROL: Derivative data saved (1794 records). [2025-10-22T22:14:25.367286] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-10-22T22:14:25.370087] [INFO ] [MAIN ] Derivative Progress: 1563/2052 symbols completed. ROL took 1.2s. Estimated remaining: 3m 4s. Rate: 159.4 symbols/min [2025-10-22T22:14:25.370475] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:25.395084] [DEBUG] [LOCAL ] RPT: Loaded 18982 existing records from primary storage. [2025-10-22T22:14:25.396210] [DEBUG] [LOCAL ] RPM: Loaded 42049 existing records from primary storage. [2025-10-22T22:14:25.396541] [INFO ] [MAIN ] RPT: Loaded 18982 primary data records. [2025-10-22T22:14:25.417024] [INFO ] [MAIN ] RPM: Loaded 42049 primary data records. [2025-10-22T22:14:25.642969] [DEBUG] [LOCAL ] RQI: Loaded 28772 existing records from primary storage. [2025-10-22T22:14:25.661347] [INFO ] [MAIN ] RQI: Loaded 28772 primary data records. [2025-10-22T22:14:26.344241] [DEBUG] [MAIN ] RPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:26.358561] [INFO ] [MAIN ] RPT: Generated 1794 derivative records from 18982 primary records. [2025-10-22T22:14:26.359341] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-10-22T22:14:26.358940] [DEBUG] [MAIN ] RPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:26.360783] [INFO ] [MAIN ] RPM: Generated 1794 derivative records from 42049 primary records. [2025-10-22T22:14:26.361505] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-10-22T22:14:26.390300] [DEBUG] [LOCAL ] RPT: Derivative data saved (1794 records). [2025-10-22T22:14:26.390628] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-10-22T22:14:26.395194] [INFO ] [MAIN ] Derivative Progress: 1564/2052 symbols completed. RPT took 1.1s. Estimated remaining: 3m 4s. Rate: 159.2 symbols/min [2025-10-22T22:14:26.395486] [DEBUG] [LOCAL ] RPM: Derivative data saved (1794 records). [2025-10-22T22:14:26.395604] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:26.397704] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-10-22T22:14:26.400718] [INFO ] [MAIN ] Derivative Progress: 1565/2052 symbols completed. RPM took 1.1s. Estimated remaining: 3m 3s. Rate: 159.3 symbols/min [2025-10-22T22:14:26.401738] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:26.415271] [DEBUG] [MAIN ] RQI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:26.416034] [INFO ] [MAIN ] RQI: Generated 1794 derivative records from 28772 primary records. [2025-10-22T22:14:26.416228] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-10-22T22:14:26.432548] [DEBUG] [LOCAL ] RQI: Derivative data saved (1794 records). [2025-10-22T22:14:26.432995] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-10-22T22:14:26.435518] [INFO ] [MAIN ] Derivative Progress: 1566/2052 symbols completed. RQI took 1.1s. Estimated remaining: 3m 3s. Rate: 159.4 symbols/min [2025-10-22T22:14:26.435774] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:26.485107] [DEBUG] [LOCAL ] RRC: Loaded 52917 existing records from primary storage. [2025-10-22T22:14:26.485703] [INFO ] [MAIN ] RRC: Loaded 52917 primary data records. [2025-10-22T22:14:26.573274] [DEBUG] [LOCAL ] RRX: Loaded 40772 existing records from primary storage. [2025-10-22T22:14:26.597296] [DEBUG] [LOCAL ] RS: Loaded 24518 existing records from primary storage. [2025-10-22T22:14:26.604851] [INFO ] [MAIN ] RRX: Loaded 40772 primary data records. [2025-10-22T22:14:26.608323] [INFO ] [MAIN ] RS: Loaded 24518 primary data records. [2025-10-22T22:14:27.498224] [DEBUG] [MAIN ] RRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:27.500036] [INFO ] [MAIN ] RRC: Generated 1794 derivative records from 52917 primary records. [2025-10-22T22:14:27.502390] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-10-22T22:14:27.548872] [DEBUG] [MAIN ] RS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:14:27.543173] [DEBUG] [LOCAL ] RRC: Derivative data saved (1794 records). [2025-10-22T22:14:27.549776] [INFO ] [MAIN ] RS: Generated 1793 derivative records from 24518 primary records. [2025-10-22T22:14:27.549833] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-10-22T22:14:27.551983] [INFO ] [MAIN ] Derivative Progress: 1567/2052 symbols completed. RRC took 1.2s. Estimated remaining: 3m 3s. Rate: 159.2 symbols/min [2025-10-22T22:14:27.548465] [DEBUG] [MAIN ] RRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:27.553091] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:27.552928] [INFO ] [MAIN ] RRX: Generated 1794 derivative records from 40772 primary records. [2025-10-22T22:14:27.549978] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-10-22T22:14:27.553311] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-10-22T22:14:27.583747] [DEBUG] [LOCAL ] RS: Derivative data saved (1793 records). [2025-10-22T22:14:27.587663] [DEBUG] [LOCAL ] RRX: Derivative data saved (1794 records). [2025-10-22T22:14:27.587827] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-10-22T22:14:27.593266] [DEBUG] [LOCAL ] RSF: Loaded 4258 existing records from primary storage. [2025-10-22T22:14:27.593043] [INFO ] [MAIN ] Derivative Progress: 1568/2052 symbols completed. RRX took 1.2s. Estimated remaining: 3m 2s. Rate: 159.3 symbols/min [2025-10-22T22:14:27.593483] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:27.593695] [INFO ] [MAIN ] RSF: Loaded 4258 primary data records. [2025-10-22T22:14:27.587929] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-10-22T22:14:27.619151] [INFO ] [MAIN ] Derivative Progress: 1569/2052 symbols completed. RS took 1.2s. Estimated remaining: 3m 2s. Rate: 159.4 symbols/min [2025-10-22T22:14:27.642150] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:27.934609] [DEBUG] [LOCAL ] RSG: Loaded 47300 existing records from primary storage. [2025-10-22T22:14:27.947107] [INFO ] [MAIN ] RSG: Loaded 47300 primary data records. [2025-10-22T22:14:27.972269] [DEBUG] [LOCAL ] RSI: Loaded 46976 existing records from primary storage. [2025-10-22T22:14:27.983383] [INFO ] [MAIN ] RSI: Loaded 46976 primary data records. [2025-10-22T22:14:28.178128] [DEBUG] [MAIN ] RSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:28.189412] [INFO ] [MAIN ] RSF: Generated 1794 derivative records from 4258 primary records. [2025-10-22T22:14:28.194916] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-10-22T22:14:28.584278] [DEBUG] [LOCAL ] RSF: Derivative data saved (1794 records). [2025-10-22T22:14:28.584536] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-10-22T22:14:28.586618] [INFO ] [MAIN ] Derivative Progress: 1570/2052 symbols completed. RSF took 1.0s. Estimated remaining: 3m 2s. Rate: 159.2 symbols/min [2025-10-22T22:14:28.586944] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:28.629428] [DEBUG] [MAIN ] RSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:28.643392] [INFO ] [MAIN ] RSI: Generated 1794 derivative records from 46976 primary records. [2025-10-22T22:14:28.644364] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-10-22T22:14:28.653754] [DEBUG] [MAIN ] RSG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:28.655836] [INFO ] [MAIN ] RSG: Generated 1794 derivative records from 47300 primary records. [2025-10-22T22:14:28.662971] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-10-22T22:14:28.665186] [DEBUG] [LOCAL ] RSKD: Loaded 33238 existing records from primary storage. [2025-10-22T22:14:28.665513] [INFO ] [MAIN ] RSKD: Loaded 33238 primary data records. [2025-10-22T22:14:28.710434] [DEBUG] [LOCAL ] RSI: Derivative data saved (1794 records). [2025-10-22T22:14:28.726000] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-10-22T22:14:28.742915] [INFO ] [MAIN ] Derivative Progress: 1571/2052 symbols completed. RSI took 1.1s. Estimated remaining: 3m 1s. Rate: 159.3 symbols/min [2025-10-22T22:14:28.757208] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:28.758870] [DEBUG] [LOCAL ] RSG: Derivative data saved (1794 records). [2025-10-22T22:14:28.787877] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-10-22T22:14:28.794154] [INFO ] [MAIN ] Derivative Progress: 1572/2052 symbols completed. RSG took 1.2s. Estimated remaining: 3m 1s. Rate: 159.4 symbols/min [2025-10-22T22:14:28.800356] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:29.036188] [DEBUG] [LOCAL ] RTO: Loaded 39724 existing records from primary storage. [2025-10-22T22:14:29.049061] [INFO ] [MAIN ] RTO: Loaded 39724 primary data records. [2025-10-22T22:14:29.181929] [DEBUG] [LOCAL ] RTX: Loaded 53706 existing records from primary storage. [2025-10-22T22:14:29.182600] [INFO ] [MAIN ] RTX: Loaded 53706 primary data records. [2025-10-22T22:14:29.469198] [DEBUG] [MAIN ] RSKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:29.490226] [INFO ] [MAIN ] RSKD: Generated 1794 derivative records from 33238 primary records. [2025-10-22T22:14:29.519208] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-10-22T22:14:29.692542] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1794 records). [2025-10-22T22:14:29.693389] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-10-22T22:14:29.695447] [INFO ] [MAIN ] Derivative Progress: 1573/2052 symbols completed. RSKD took 1.1s. Estimated remaining: 3m 0s. Rate: 159.2 symbols/min [2025-10-22T22:14:29.741787] [DEBUG] [MAIN ] RTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:29.742889] [INFO ] [MAIN ] RTO: Generated 1794 derivative records from 39724 primary records. [2025-10-22T22:14:29.742973] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-10-22T22:14:29.743228] [DEBUG] [MAIN ] RTX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:29.744768] [INFO ] [MAIN ] RTX: Generated 1794 derivative records from 53706 primary records. [2025-10-22T22:14:29.745037] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-10-22T22:14:29.776439] [DEBUG] [LOCAL ] RTX: Derivative data saved (1794 records). [2025-10-22T22:14:29.775882] [DEBUG] [LOCAL ] RTO: Derivative data saved (1794 records). [2025-10-22T22:14:29.776748] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-10-22T22:14:29.779515] [INFO ] [MAIN ] Derivative Progress: 1574/2052 symbols completed. RTX took 1.0s. Estimated remaining: 3m 0s. Rate: 159.3 symbols/min [2025-10-22T22:14:29.776671] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-10-22T22:14:29.782141] [INFO ] [MAIN ] Derivative Progress: 1575/2052 symbols completed. RTO took 1.0s. Estimated remaining: 2m 60s. Rate: 159.4 symbols/min [2025-10-22T22:14:29.782608] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:29.782556] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:29.783114] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:29.814850] [DEBUG] [LOCAL ] RVT: Loaded 26119 existing records from primary storage. [2025-10-22T22:14:29.814981] [INFO ] [MAIN ] RVT: Loaded 26119 primary data records. [2025-10-22T22:14:30.044512] [DEBUG] [LOCAL ] RVLV: Loaded 47368 existing records from primary storage. [2025-10-22T22:14:30.044723] [INFO ] [MAIN ] RVLV: Loaded 47368 primary data records. [2025-10-22T22:14:30.157264] [DEBUG] [LOCAL ] RVTY: Loaded 47785 existing records from primary storage. [2025-10-22T22:14:30.185952] [INFO ] [MAIN ] RVTY: Loaded 47785 primary data records. [2025-10-22T22:14:30.828790] [DEBUG] [MAIN ] RVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:30.830345] [INFO ] [MAIN ] RVT: Generated 1794 derivative records from 26119 primary records. [2025-10-22T22:14:30.831025] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-10-22T22:14:30.850372] [DEBUG] [LOCAL ] RVT: Derivative data saved (1794 records). [2025-10-22T22:14:30.852167] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-10-22T22:14:30.854496] [INFO ] [MAIN ] Derivative Progress: 1576/2052 symbols completed. RVT took 1.1s. Estimated remaining: 2m 59s. Rate: 159.2 symbols/min [2025-10-22T22:14:30.855076] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:30.870388] [DEBUG] [MAIN ] RVLV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:30.872875] [INFO ] [MAIN ] RVLV: Generated 1794 derivative records from 47368 primary records. [2025-10-22T22:14:30.873052] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-10-22T22:14:30.898280] [DEBUG] [MAIN ] RVTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:30.903966] [INFO ] [MAIN ] RVTY: Generated 1794 derivative records from 47785 primary records. [2025-10-22T22:14:30.903105] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1794 records). [2025-10-22T22:14:30.904289] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-10-22T22:14:30.904232] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-10-22T22:14:30.907143] [INFO ] [MAIN ] Derivative Progress: 1577/2052 symbols completed. RVLV took 1.1s. Estimated remaining: 2m 59s. Rate: 159.3 symbols/min [2025-10-22T22:14:30.907937] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:30.933095] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1794 records). [2025-10-22T22:14:30.933341] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-10-22T22:14:30.935623] [INFO ] [MAIN ] Derivative Progress: 1578/2052 symbols completed. RVTY took 1.2s. Estimated remaining: 2m 58s. Rate: 159.4 symbols/min [2025-10-22T22:14:30.935890] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:30.950620] [DEBUG] [LOCAL ] RWT: Loaded 40374 existing records from primary storage. [2025-10-22T22:14:30.950911] [INFO ] [MAIN ] RWT: Loaded 40374 primary data records. [2025-10-22T22:14:31.276782] [DEBUG] [LOCAL ] RXO: Loaded 48464 existing records from primary storage. [2025-10-22T22:14:31.277135] [INFO ] [MAIN ] RXO: Loaded 48464 primary data records. [2025-10-22T22:14:31.395855] [DEBUG] [LOCAL ] RY: Loaded 47473 existing records from primary storage. [2025-10-22T22:14:31.396450] [INFO ] [MAIN ] RY: Loaded 47473 primary data records. [2025-10-22T22:14:31.905636] [DEBUG] [MAIN ] RWT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:31.907324] [INFO ] [MAIN ] RWT: Generated 1794 derivative records from 40374 primary records. [2025-10-22T22:14:31.908033] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-10-22T22:14:31.924874] [DEBUG] [LOCAL ] RWT: Derivative data saved (1794 records). [2025-10-22T22:14:31.925179] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-10-22T22:14:31.927305] [INFO ] [MAIN ] Derivative Progress: 1579/2052 symbols completed. RWT took 1.1s. Estimated remaining: 2m 58s. Rate: 159.2 symbols/min [2025-10-22T22:14:31.927679] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:31.947266] [DEBUG] [MAIN ] RXO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:14:31.948111] [INFO ] [MAIN ] RXO: Generated 1793 derivative records from 48464 primary records. [2025-10-22T22:14:31.948493] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-10-22T22:14:31.988743] [DEBUG] [MAIN ] RY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:31.993026] [INFO ] [MAIN ] RY: Generated 1794 derivative records from 47473 primary records. [2025-10-22T22:14:31.992211] [DEBUG] [LOCAL ] RXO: Derivative data saved (1793 records). [2025-10-22T22:14:31.993232] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-10-22T22:14:31.993434] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-10-22T22:14:31.996394] [INFO ] [MAIN ] Derivative Progress: 1580/2052 symbols completed. RXO took 1.1s. Estimated remaining: 2m 58s. Rate: 159.3 symbols/min [2025-10-22T22:14:32.004133] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:32.020755] [DEBUG] [LOCAL ] RYAM: Loaded 35018 existing records from primary storage. [2025-10-22T22:14:32.024169] [DEBUG] [LOCAL ] RY: Derivative data saved (1794 records). [2025-10-22T22:14:32.024667] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-10-22T22:14:32.024554] [INFO ] [MAIN ] RYAM: Loaded 35018 primary data records. [2025-10-22T22:14:32.027333] [INFO ] [MAIN ] Derivative Progress: 1581/2052 symbols completed. RY took 1.1s. Estimated remaining: 2m 57s. Rate: 159.4 symbols/min [2025-10-22T22:14:32.038883] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:32.234068] [DEBUG] [LOCAL ] RYI: Loaded 21663 existing records from primary storage. [2025-10-22T22:14:32.341036] [INFO ] [MAIN ] RYI: Loaded 21663 primary data records. [2025-10-22T22:14:32.422986] [DEBUG] [LOCAL ] RYAN: Loaded 45003 existing records from primary storage. [2025-10-22T22:14:32.435978] [INFO ] [MAIN ] RYAN: Loaded 45003 primary data records. [2025-10-22T22:14:33.047855] [DEBUG] [MAIN ] RYAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:33.049592] [INFO ] [MAIN ] RYAM: Generated 1794 derivative records from 35018 primary records. [2025-10-22T22:14:33.050557] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-10-22T22:14:33.070399] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1794 records). [2025-10-22T22:14:33.072022] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-10-22T22:14:33.076291] [INFO ] [MAIN ] Derivative Progress: 1582/2052 symbols completed. RYAM took 1.1s. Estimated remaining: 2m 57s. Rate: 159.2 symbols/min [2025-10-22T22:14:33.076879] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:33.095697] [DEBUG] [MAIN ] RYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:33.098919] [INFO ] [MAIN ] RYI: Generated 1794 derivative records from 21663 primary records. [2025-10-22T22:14:33.099204] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-10-22T22:14:33.138450] [DEBUG] [MAIN ] RYAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:33.140271] [INFO ] [MAIN ] RYAN: Generated 1794 derivative records from 45003 primary records. [2025-10-22T22:14:33.143847] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-10-22T22:14:33.144015] [DEBUG] [LOCAL ] RYI: Derivative data saved (1794 records). [2025-10-22T22:14:33.145470] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-10-22T22:14:33.148394] [INFO ] [MAIN ] Derivative Progress: 1583/2052 symbols completed. RYI took 1.1s. Estimated remaining: 2m 57s. Rate: 159.3 symbols/min [2025-10-22T22:14:33.166750] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:33.173815] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1794 records). [2025-10-22T22:14:33.188477] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-10-22T22:14:33.192482] [INFO ] [MAIN ] Derivative Progress: 1584/2052 symbols completed. RYAN took 1.2s. Estimated remaining: 2m 56s. Rate: 159.4 symbols/min [2025-10-22T22:14:33.192736] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:33.224019] [DEBUG] [LOCAL ] RYN: Loaded 45740 existing records from primary storage. [2025-10-22T22:14:33.229161] [DEBUG] [LOCAL ] RZB: Loaded 5891 existing records from primary storage. [2025-10-22T22:14:33.232092] [INFO ] [MAIN ] RZB: Loaded 5891 primary data records. [2025-10-22T22:14:33.231953] [INFO ] [MAIN ] RYN: Loaded 45740 primary data records. [2025-10-22T22:14:33.315234] [DEBUG] [LOCAL ] RZC: Loaded 6485 existing records from primary storage. [2025-10-22T22:14:33.411143] [INFO ] [MAIN ] RZC: Loaded 6485 primary data records. [2025-10-22T22:14:34.318063] [DEBUG] [MAIN ] RYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:34.319058] [INFO ] [MAIN ] RYN: Generated 1794 derivative records from 45740 primary records. [2025-10-22T22:14:34.319224] [DEBUG] [MAIN ] RZB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:34.319486] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-10-22T22:14:34.320075] [INFO ] [MAIN ] RZB: Generated 1794 derivative records from 5891 primary records. [2025-10-22T22:14:34.331944] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-10-22T22:14:34.332497] [DEBUG] [MAIN ] RZC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:34.348613] [INFO ] [MAIN ] RZC: Generated 1794 derivative records from 6485 primary records. [2025-10-22T22:14:34.360710] [DEBUG] [LOCAL ] RYN: Derivative data saved (1794 records). [2025-10-22T22:14:34.359597] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-22T22:14:34.361046] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-10-22T22:14:34.363671] [INFO ] [MAIN ] Derivative Progress: 1585/2052 symbols completed. RYN took 1.3s. Estimated remaining: 2m 56s. Rate: 159.2 symbols/min [2025-10-22T22:14:34.364723] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:34.372518] [DEBUG] [LOCAL ] RZB: Derivative data saved (1794 records). [2025-10-22T22:14:34.376013] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-10-22T22:14:34.379639] [INFO ] [MAIN ] Derivative Progress: 1586/2052 symbols completed. RZB took 1.2s. Estimated remaining: 2m 56s. Rate: 159.3 symbols/min [2025-10-22T22:14:34.383025] [DEBUG] [LOCAL ] RZC: Derivative data saved (1794 records). [2025-10-22T22:14:34.383215] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-10-22T22:14:34.383150] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:34.385435] [INFO ] [MAIN ] Derivative Progress: 1587/2052 symbols completed. RZC took 1.2s. Estimated remaining: 2m 55s. Rate: 159.4 symbols/min [2025-10-22T22:14:34.385989] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:34.396917] [DEBUG] [LOCAL ] SABA: Loaded 9181 existing records from primary storage. [2025-10-22T22:14:34.397112] [INFO ] [MAIN ] SABA: Loaded 9181 primary data records. [2025-10-22T22:14:34.710856] [DEBUG] [LOCAL ] S: Loaded 53538 existing records from primary storage. [2025-10-22T22:14:34.735561] [INFO ] [MAIN ] S: Loaded 53538 primary data records. [2025-10-22T22:14:34.736228] [DEBUG] [LOCAL ] SA: Loaded 44669 existing records from primary storage. [2025-10-22T22:14:34.736424] [INFO ] [MAIN ] SA: Loaded 44669 primary data records. [2025-10-22T22:14:35.363178] [DEBUG] [MAIN ] SABA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:35.364688] [INFO ] [MAIN ] SABA: Generated 1794 derivative records from 9181 primary records. [2025-10-22T22:14:35.364986] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-22T22:14:35.381860] [DEBUG] [LOCAL ] SABA: Derivative data saved (1794 records). [2025-10-22T22:14:35.382753] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-22T22:14:35.385041] [INFO ] [MAIN ] Derivative Progress: 1588/2052 symbols completed. SABA took 1.0s. Estimated remaining: 2m 55s. Rate: 159.2 symbols/min [2025-10-22T22:14:35.405328] [DEBUG] [MAIN ] SA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:35.417763] [INFO ] [MAIN ] SA: Generated 1794 derivative records from 44669 primary records. [2025-10-22T22:14:35.418122] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-22T22:14:35.418075] [DEBUG] [MAIN ] S: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:35.419094] [INFO ] [MAIN ] S: Generated 1794 derivative records from 53538 primary records. [2025-10-22T22:14:35.419358] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-22T22:14:35.449384] [DEBUG] [LOCAL ] S: Derivative data saved (1794 records). [2025-10-22T22:14:35.449581] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-22T22:14:35.449454] [DEBUG] [LOCAL ] SA: Derivative data saved (1794 records). [2025-10-22T22:14:35.449711] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-22T22:14:35.452488] [INFO ] [MAIN ] Derivative Progress: 1589/2052 symbols completed. SA took 1.1s. Estimated remaining: 2m 54s. Rate: 159.3 symbols/min [2025-10-22T22:14:35.454744] [INFO ] [MAIN ] Derivative Progress: 1590/2052 symbols completed. S took 1.1s. Estimated remaining: 2m 54s. Rate: 159.4 symbols/min [2025-10-22T22:14:35.455104] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:35.455207] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:35.455603] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:35.493306] [DEBUG] [LOCAL ] SAM: Loaded 21215 existing records from primary storage. [2025-10-22T22:14:35.492759] [DEBUG] [LOCAL ] SAH: Loaded 20685 existing records from primary storage. [2025-10-22T22:14:35.493532] [INFO ] [MAIN ] SAH: Loaded 20685 primary data records. [2025-10-22T22:14:35.501431] [INFO ] [MAIN ] SAM: Loaded 21215 primary data records. [2025-10-22T22:14:35.502732] [DEBUG] [LOCAL ] SAFE: Loaded 29883 existing records from primary storage. [2025-10-22T22:14:35.502910] [INFO ] [MAIN ] SAFE: Loaded 29883 primary data records. [2025-10-22T22:14:36.414555] [DEBUG] [MAIN ] SAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:36.417059] [INFO ] [MAIN ] SAM: Generated 1794 derivative records from 21215 primary records. [2025-10-22T22:14:36.417363] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-22T22:14:36.443087] [DEBUG] [MAIN ] SAFE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:36.443864] [INFO ] [MAIN ] SAFE: Generated 1794 derivative records from 29883 primary records. [2025-10-22T22:14:36.444324] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-22T22:14:36.444245] [DEBUG] [MAIN ] SAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:36.445787] [INFO ] [MAIN ] SAH: Generated 1794 derivative records from 20685 primary records. [2025-10-22T22:14:36.446210] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-22T22:14:36.483448] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1794 records). [2025-10-22T22:14:36.484176] [DEBUG] [LOCAL ] SAM: Derivative data saved (1794 records). [2025-10-22T22:14:36.485031] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-10-22T22:14:36.487742] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-10-22T22:14:36.493493] [INFO ] [MAIN ] Derivative Progress: 1591/2052 symbols completed. SAFE took 1.0s. Estimated remaining: 2m 54s. Rate: 159.2 symbols/min [2025-10-22T22:14:36.495949] [INFO ] [MAIN ] Derivative Progress: 1592/2052 symbols completed. SAM took 1.0s. Estimated remaining: 2m 53s. Rate: 159.3 symbols/min [2025-10-22T22:14:36.495805] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:36.497344] [DEBUG] [LOCAL ] SAH: Derivative data saved (1794 records). [2025-10-22T22:14:36.497436] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:36.497622] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-10-22T22:14:36.499986] [INFO ] [MAIN ] Derivative Progress: 1593/2052 symbols completed. SAH took 1.0s. Estimated remaining: 2m 53s. Rate: 159.4 symbols/min [2025-10-22T22:14:36.500348] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:36.524407] [DEBUG] [LOCAL ] SAR: Loaded 17125 existing records from primary storage. [2025-10-22T22:14:36.524618] [INFO ] [MAIN ] SAR: Loaded 17125 primary data records. [2025-10-22T22:14:36.896334] [DEBUG] [LOCAL ] SAN: Loaded 52964 existing records from primary storage. [2025-10-22T22:14:36.895563] [DEBUG] [LOCAL ] SAP: Loaded 49878 existing records from primary storage. [2025-10-22T22:14:36.896493] [INFO ] [MAIN ] SAN: Loaded 52964 primary data records. [2025-10-22T22:14:36.896589] [INFO ] [MAIN ] SAP: Loaded 49878 primary data records. [2025-10-22T22:14:37.526764] [DEBUG] [MAIN ] SAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:37.528181] [INFO ] [MAIN ] SAR: Generated 1794 derivative records from 17125 primary records. [2025-10-22T22:14:37.528283] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-22T22:14:37.546014] [DEBUG] [LOCAL ] SAR: Derivative data saved (1794 records). [2025-10-22T22:14:37.546240] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-10-22T22:14:37.548809] [INFO ] [MAIN ] Derivative Progress: 1594/2052 symbols completed. SAR took 1.0s. Estimated remaining: 2m 53s. Rate: 159.3 symbols/min [2025-10-22T22:14:37.549141] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:37.582268] [DEBUG] [MAIN ] SAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:37.588017] [INFO ] [MAIN ] SAN: Generated 1794 derivative records from 52964 primary records. [2025-10-22T22:14:37.588251] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-22T22:14:37.588554] [DEBUG] [MAIN ] SAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:37.590276] [INFO ] [MAIN ] SAP: Generated 1794 derivative records from 49878 primary records. [2025-10-22T22:14:37.590668] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-22T22:14:37.618377] [DEBUG] [LOCAL ] SAN: Derivative data saved (1794 records). [2025-10-22T22:14:37.619731] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-22T22:14:37.623694] [INFO ] [MAIN ] Derivative Progress: 1595/2052 symbols completed. SAN took 1.1s. Estimated remaining: 2m 52s. Rate: 159.3 symbols/min [2025-10-22T22:14:37.626435] [DEBUG] [LOCAL ] SAP: Derivative data saved (1794 records). [2025-10-22T22:14:37.636798] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-22T22:14:37.624969] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:37.639462] [INFO ] [MAIN ] Derivative Progress: 1596/2052 symbols completed. SAP took 1.1s. Estimated remaining: 2m 52s. Rate: 159.4 symbols/min [2025-10-22T22:14:37.639688] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:37.659858] [DEBUG] [LOCAL ] SARO: Loaded 48231 existing records from primary storage. [2025-10-22T22:14:37.660004] [INFO ] [MAIN ] SARO: Loaded 48231 primary data records. [2025-10-22T22:14:37.880177] [DEBUG] [LOCAL ] SB: Loaded 32405 existing records from primary storage. [2025-10-22T22:14:37.984867] [INFO ] [MAIN ] SB: Loaded 32405 primary data records. [2025-10-22T22:14:38.048154] [DEBUG] [LOCAL ] SBH: Loaded 49854 existing records from primary storage. [2025-10-22T22:14:38.059745] [INFO ] [MAIN ] SBH: Loaded 49854 primary data records. [2025-10-22T22:14:38.677722] [DEBUG] [MAIN ] SARO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:38.678994] [INFO ] [MAIN ] SARO: Generated 1794 derivative records from 48231 primary records. [2025-10-22T22:14:38.679205] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-22T22:14:38.699343] [DEBUG] [LOCAL ] SARO: Derivative data saved (1794 records). [2025-10-22T22:14:38.711889] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-10-22T22:14:38.716109] [INFO ] [MAIN ] Derivative Progress: 1597/2052 symbols completed. SARO took 1.2s. Estimated remaining: 2m 51s. Rate: 159.2 symbols/min [2025-10-22T22:14:38.712798] [DEBUG] [MAIN ] SB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:38.716389] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:38.717192] [INFO ] [MAIN ] SB: Generated 1794 derivative records from 32405 primary records. [2025-10-22T22:14:38.718921] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-22T22:14:38.745079] [DEBUG] [MAIN ] SBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:38.748113] [INFO ] [MAIN ] SBH: Generated 1794 derivative records from 49854 primary records. [2025-10-22T22:14:38.750557] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-22T22:14:38.750950] [DEBUG] [LOCAL ] SB: Derivative data saved (1794 records). [2025-10-22T22:14:38.751091] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-22T22:14:38.753845] [INFO ] [MAIN ] Derivative Progress: 1598/2052 symbols completed. SB took 1.1s. Estimated remaining: 2m 51s. Rate: 159.3 symbols/min [2025-10-22T22:14:38.754220] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:38.772111] [DEBUG] [LOCAL ] SBI: Loaded 7748 existing records from primary storage. [2025-10-22T22:14:38.772855] [INFO ] [MAIN ] SBI: Loaded 7748 primary data records. [2025-10-22T22:14:38.773243] [DEBUG] [LOCAL ] SBH: Derivative data saved (1794 records). [2025-10-22T22:14:38.773327] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-10-22T22:14:38.807975] [INFO ] [MAIN ] Derivative Progress: 1599/2052 symbols completed. SBH took 1.2s. Estimated remaining: 2m 50s. Rate: 159.4 symbols/min [2025-10-22T22:14:38.832368] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:38.912493] [DEBUG] [LOCAL ] SBR: Loaded 7813 existing records from primary storage. [2025-10-22T22:14:38.961381] [INFO ] [MAIN ] SBR: Loaded 7813 primary data records. [2025-10-22T22:14:39.275906] [DEBUG] [LOCAL ] SBS: Loaded 49293 existing records from primary storage. [2025-10-22T22:14:39.299981] [INFO ] [MAIN ] SBS: Loaded 49293 primary data records. [2025-10-22T22:14:39.745465] [DEBUG] [MAIN ] SBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:39.747114] [INFO ] [MAIN ] SBI: Generated 1794 derivative records from 7748 primary records. [2025-10-22T22:14:39.747825] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-22T22:14:39.765752] [DEBUG] [LOCAL ] SBI: Derivative data saved (1794 records). [2025-10-22T22:14:39.766282] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-22T22:14:39.768575] [INFO ] [MAIN ] Derivative Progress: 1600/2052 symbols completed. SBI took 1.1s. Estimated remaining: 2m 50s. Rate: 159.3 symbols/min [2025-10-22T22:14:39.768996] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:39.782221] [DEBUG] [MAIN ] SBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:39.783848] [INFO ] [MAIN ] SBR: Generated 1794 derivative records from 7813 primary records. [2025-10-22T22:14:39.784007] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-22T22:14:39.800131] [DEBUG] [LOCAL ] SBR: Derivative data saved (1794 records). [2025-10-22T22:14:39.800250] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-22T22:14:39.802356] [INFO ] [MAIN ] Derivative Progress: 1601/2052 symbols completed. SBR took 1.0s. Estimated remaining: 2m 50s. Rate: 159.4 symbols/min [2025-10-22T22:14:39.802840] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:39.817465] [DEBUG] [LOCAL ] SBSI: Loaded 14802 existing records from primary storage. [2025-10-22T22:14:39.817974] [INFO ] [MAIN ] SBSI: Loaded 14802 primary data records. [2025-10-22T22:14:39.859909] [DEBUG] [MAIN ] SBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:39.883329] [INFO ] [MAIN ] SBS: Generated 1794 derivative records from 49293 primary records. [2025-10-22T22:14:39.889495] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-22T22:14:40.005038] [DEBUG] [LOCAL ] SBS: Derivative data saved (1794 records). [2025-10-22T22:14:40.029447] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-22T22:14:40.066597] [INFO ] [MAIN ] Derivative Progress: 1602/2052 symbols completed. SBS took 1.2s. Estimated remaining: 2m 49s. Rate: 159.4 symbols/min [2025-10-22T22:14:40.189581] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:40.207584] [DEBUG] [LOCAL ] SBSW: Loaded 53185 existing records from primary storage. [2025-10-22T22:14:40.208832] [INFO ] [MAIN ] SBSW: Loaded 53185 primary data records. [2025-10-22T22:14:40.578623] [DEBUG] [LOCAL ] SCCO: Loaded 49566 existing records from primary storage. [2025-10-22T22:14:40.579352] [INFO ] [MAIN ] SCCO: Loaded 49566 primary data records. [2025-10-22T22:14:40.684966] [DEBUG] [MAIN ] SBSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:40.702830] [INFO ] [MAIN ] SBSI: Generated 1794 derivative records from 14802 primary records. [2025-10-22T22:14:40.702993] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-22T22:14:40.796974] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1794 records). [2025-10-22T22:14:40.900736] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-10-22T22:14:40.916778] [INFO ] [MAIN ] Derivative Progress: 1603/2052 symbols completed. SBSI took 1.1s. Estimated remaining: 2m 49s. Rate: 159.3 symbols/min [2025-10-22T22:14:40.935486] [DEBUG] [MAIN ] SBSW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:40.936691] [INFO ] [MAIN ] SBSW: Generated 1794 derivative records from 53185 primary records. [2025-10-22T22:14:40.936933] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-22T22:14:40.954309] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1794 records). [2025-10-22T22:14:40.954636] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-22T22:14:40.957069] [INFO ] [MAIN ] Derivative Progress: 1604/2052 symbols completed. SBSW took 1.2s. Estimated remaining: 2m 49s. Rate: 159.3 symbols/min [2025-10-22T22:14:40.974528] [DEBUG] [MAIN ] SCCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:40.975134] [INFO ] [MAIN ] SCCO: Generated 1794 derivative records from 49566 primary records. [2025-10-22T22:14:40.975194] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-22T22:14:40.990083] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1794 records). [2025-10-22T22:14:40.990169] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-22T22:14:40.992577] [INFO ] [MAIN ] Derivative Progress: 1605/2052 symbols completed. SCCO took 0.8s. Estimated remaining: 2m 48s. Rate: 159.4 symbols/min [2025-10-22T22:14:40.992996] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:40.993158] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:40.992950] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:41.011391] [DEBUG] [LOCAL ] SCD: Loaded 13496 existing records from primary storage. [2025-10-22T22:14:41.011552] [INFO ] [MAIN ] SCD: Loaded 13496 primary data records. [2025-10-22T22:14:41.350093] [DEBUG] [LOCAL ] SCI: Loaded 46165 existing records from primary storage. [2025-10-22T22:14:41.358947] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-22T22:14:41.359169] [INFO ] [MAIN ] SCHW: Loaded 53685 primary data records. [2025-10-22T22:14:41.359331] [INFO ] [MAIN ] SCI: Loaded 46165 primary data records. [2025-10-22T22:14:41.989943] [DEBUG] [MAIN ] SCD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:41.991888] [INFO ] [MAIN ] SCD: Generated 1794 derivative records from 13496 primary records. [2025-10-22T22:14:41.993164] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-22T22:14:42.011632] [DEBUG] [LOCAL ] SCD: Derivative data saved (1794 records). [2025-10-22T22:14:42.013170] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-22T22:14:42.016529] [INFO ] [MAIN ] Derivative Progress: 1606/2052 symbols completed. SCD took 1.0s. Estimated remaining: 2m 48s. Rate: 159.3 symbols/min [2025-10-22T22:14:42.017856] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:42.033571] [DEBUG] [MAIN ] SCHW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:42.034841] [INFO ] [MAIN ] SCHW: Generated 1794 derivative records from 53685 primary records. [2025-10-22T22:14:42.042242] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-22T22:14:42.081391] [DEBUG] [MAIN ] SCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:42.082578] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1794 records). [2025-10-22T22:14:42.077999] [DEBUG] [LOCAL ] SCL: Loaded 15126 existing records from primary storage. [2025-10-22T22:14:42.083366] [INFO ] [MAIN ] SCI: Generated 1794 derivative records from 46165 primary records. [2025-10-22T22:14:42.083607] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-10-22T22:14:42.083750] [INFO ] [MAIN ] SCL: Loaded 15126 primary data records. [2025-10-22T22:14:42.085952] [INFO ] [MAIN ] Derivative Progress: 1607/2052 symbols completed. SCHW took 1.1s. Estimated remaining: 2m 48s. Rate: 159.3 symbols/min [2025-10-22T22:14:42.106697] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-22T22:14:42.117633] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:42.194368] [DEBUG] [LOCAL ] SCI: Derivative data saved (1794 records). [2025-10-22T22:14:42.202010] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-10-22T22:14:42.208547] [INFO ] [MAIN ] Derivative Progress: 1608/2052 symbols completed. SCI took 1.2s. Estimated remaining: 2m 47s. Rate: 159.4 symbols/min [2025-10-22T22:14:42.220756] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:42.415963] [DEBUG] [LOCAL ] SCM: Loaded 19989 existing records from primary storage. [2025-10-22T22:14:42.416298] [INFO ] [MAIN ] SCM: Loaded 19989 primary data records. [2025-10-22T22:14:42.783953] [DEBUG] [LOCAL ] SCS: Loaded 43227 existing records from primary storage. [2025-10-22T22:14:42.785629] [INFO ] [MAIN ] SCS: Loaded 43227 primary data records. [2025-10-22T22:14:42.956268] [DEBUG] [MAIN ] SCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:42.968043] [INFO ] [MAIN ] SCL: Generated 1794 derivative records from 15126 primary records. [2025-10-22T22:14:42.998008] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-22T22:14:43.201327] [DEBUG] [LOCAL ] SCL: Derivative data saved (1794 records). [2025-10-22T22:14:43.201888] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-10-22T22:14:43.204292] [INFO ] [MAIN ] Derivative Progress: 1609/2052 symbols completed. SCL took 1.2s. Estimated remaining: 2m 47s. Rate: 159.3 symbols/min [2025-10-22T22:14:43.204761] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:43.222841] [DEBUG] [MAIN ] SCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:43.224226] [INFO ] [MAIN ] SCM: Generated 1794 derivative records from 19989 primary records. [2025-10-22T22:14:43.224854] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-22T22:14:43.244712] [DEBUG] [LOCAL ] SCM: Derivative data saved (1794 records). [2025-10-22T22:14:43.245038] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-22T22:14:43.248033] [INFO ] [MAIN ] Derivative Progress: 1610/2052 symbols completed. SCM took 1.1s. Estimated remaining: 2m 46s. Rate: 159.3 symbols/min [2025-10-22T22:14:43.248546] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:43.284912] [DEBUG] [MAIN ] SCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:43.285835] [INFO ] [MAIN ] SCS: Generated 1794 derivative records from 43227 primary records. [2025-10-22T22:14:43.286146] [DEBUG] [LOCAL ] SDHC: Loaded 10378 existing records from primary storage. [2025-10-22T22:14:43.286419] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-22T22:14:43.294193] [INFO ] [MAIN ] SDHC: Loaded 10378 primary data records. [2025-10-22T22:14:43.296600] [DEBUG] [LOCAL ] SD: Loaded 28248 existing records from primary storage. [2025-10-22T22:14:43.352716] [INFO ] [MAIN ] SD: Loaded 28248 primary data records. [2025-10-22T22:14:43.362154] [DEBUG] [LOCAL ] SCS: Derivative data saved (1794 records). [2025-10-22T22:14:43.390097] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-22T22:14:43.428285] [INFO ] [MAIN ] Derivative Progress: 1611/2052 symbols completed. SCS took 1.2s. Estimated remaining: 2m 46s. Rate: 159.4 symbols/min [2025-10-22T22:14:43.452002] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:43.901094] [DEBUG] [LOCAL ] SDHY: Loaded 11210 existing records from primary storage. [2025-10-22T22:14:43.901341] [INFO ] [MAIN ] SDHY: Loaded 11210 primary data records. [2025-10-22T22:14:44.287207] [DEBUG] [MAIN ] SD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:44.287584] [DEBUG] [MAIN ] SDHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:44.290021] [INFO ] [MAIN ] SDHC: Generated 1794 derivative records from 10378 primary records. [2025-10-22T22:14:44.288881] [INFO ] [MAIN ] SD: Generated 1794 derivative records from 28248 primary records. [2025-10-22T22:14:44.290138] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-22T22:14:44.291161] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-22T22:14:44.307503] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1794 records). [2025-10-22T22:14:44.307835] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-22T22:14:44.310786] [INFO ] [MAIN ] Derivative Progress: 1612/2052 symbols completed. SDHC took 1.1s. Estimated remaining: 2m 46s. Rate: 159.3 symbols/min [2025-10-22T22:14:44.311070] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:44.327362] [DEBUG] [LOCAL ] SD: Derivative data saved (1794 records). [2025-10-22T22:14:44.327522] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-10-22T22:14:44.329595] [INFO ] [MAIN ] Derivative Progress: 1613/2052 symbols completed. SD took 1.1s. Estimated remaining: 2m 45s. Rate: 159.4 symbols/min [2025-10-22T22:14:44.329980] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:44.348456] [DEBUG] [MAIN ] SDHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:44.349335] [INFO ] [MAIN ] SDHY: Generated 1794 derivative records from 11210 primary records. [2025-10-22T22:14:44.349540] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-22T22:14:44.375035] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1794 records). [2025-10-22T22:14:44.375825] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-22T22:14:44.380629] [INFO ] [MAIN ] Derivative Progress: 1614/2052 symbols completed. SDHY took 0.9s. Estimated remaining: 2m 45s. Rate: 159.4 symbols/min [2025-10-22T22:14:44.380853] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:44.393956] [DEBUG] [LOCAL ] SDRL: Loaded 41106 existing records from primary storage. [2025-10-22T22:14:44.394156] [INFO ] [MAIN ] SDRL: Loaded 41106 primary data records. [2025-10-22T22:14:44.527576] [DEBUG] [LOCAL ] SEG: Loaded 12503 existing records from primary storage. [2025-10-22T22:14:44.554878] [DEBUG] [LOCAL ] SEE: Loaded 48091 existing records from primary storage. [2025-10-22T22:14:44.576428] [INFO ] [MAIN ] SEE: Loaded 48091 primary data records. [2025-10-22T22:14:44.533267] [INFO ] [MAIN ] SEG: Loaded 12503 primary data records. [2025-10-22T22:14:45.405515] [DEBUG] [MAIN ] SDRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:45.406483] [INFO ] [MAIN ] SDRL: Generated 1794 derivative records from 41106 primary records. [2025-10-22T22:14:45.407932] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-22T22:14:45.430135] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1794 records). [2025-10-22T22:14:45.430498] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-10-22T22:14:45.433604] [INFO ] [MAIN ] Derivative Progress: 1615/2052 symbols completed. SDRL took 1.1s. Estimated remaining: 2m 45s. Rate: 159.3 symbols/min [2025-10-22T22:14:45.434448] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:45.469341] [DEBUG] [MAIN ] SEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:45.471093] [INFO ] [MAIN ] SEE: Generated 1794 derivative records from 48091 primary records. [2025-10-22T22:14:45.471305] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-22T22:14:45.470022] [DEBUG] [MAIN ] SEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:45.472617] [INFO ] [MAIN ] SEG: Generated 1794 derivative records from 12503 primary records. [2025-10-22T22:14:45.473897] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-22T22:14:45.490787] [DEBUG] [LOCAL ] SEE: Derivative data saved (1794 records). [2025-10-22T22:14:45.498211] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-10-22T22:14:45.501033] [INFO ] [MAIN ] Derivative Progress: 1616/2052 symbols completed. SEE took 1.2s. Estimated remaining: 2m 44s. Rate: 159.3 symbols/min [2025-10-22T22:14:45.503294] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:45.511135] [DEBUG] [LOCAL ] SEG: Derivative data saved (1794 records). [2025-10-22T22:14:45.511559] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-22T22:14:45.515585] [INFO ] [MAIN ] Derivative Progress: 1617/2052 symbols completed. SEG took 1.1s. Estimated remaining: 2m 44s. Rate: 159.4 symbols/min [2025-10-22T22:14:45.515896] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:45.550464] [DEBUG] [LOCAL ] SEI: Loaded 50024 existing records from primary storage. [2025-10-22T22:14:45.550740] [INFO ] [MAIN ] SEI: Loaded 50024 primary data records. [2025-10-22T22:14:45.699006] [DEBUG] [LOCAL ] SEM: Loaded 43168 existing records from primary storage. [2025-10-22T22:14:45.715697] [INFO ] [MAIN ] SEM: Loaded 43168 primary data records. [2025-10-22T22:14:45.715557] [DEBUG] [LOCAL ] SEMR: Loaded 42068 existing records from primary storage. [2025-10-22T22:14:45.753826] [INFO ] [MAIN ] SEMR: Loaded 42068 primary data records. [2025-10-22T22:14:46.658423] [DEBUG] [MAIN ] SEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:46.659694] [INFO ] [MAIN ] SEI: Generated 1794 derivative records from 50024 primary records. [2025-10-22T22:14:46.659947] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-22T22:14:46.681116] [DEBUG] [LOCAL ] SEI: Derivative data saved (1794 records). [2025-10-22T22:14:46.681554] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-22T22:14:46.684114] [INFO ] [MAIN ] Derivative Progress: 1618/2052 symbols completed. SEI took 1.2s. Estimated remaining: 2m 44s. Rate: 159.2 symbols/min [2025-10-22T22:14:46.697953] [DEBUG] [MAIN ] SEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:46.698767] [INFO ] [MAIN ] SEM: Generated 1794 derivative records from 43168 primary records. [2025-10-22T22:14:46.699141] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-22T22:14:46.716286] [DEBUG] [LOCAL ] SEM: Derivative data saved (1794 records). [2025-10-22T22:14:46.716483] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-10-22T22:14:46.720389] [INFO ] [MAIN ] Derivative Progress: 1619/2052 symbols completed. SEM took 1.2s. Estimated remaining: 2m 43s. Rate: 159.3 symbols/min [2025-10-22T22:14:46.736982] [DEBUG] [MAIN ] SEMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:46.737929] [INFO ] [MAIN ] SEMR: Generated 1794 derivative records from 42068 primary records. [2025-10-22T22:14:46.738002] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-22T22:14:46.754714] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1794 records). [2025-10-22T22:14:46.754899] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-22T22:14:46.758961] [INFO ] [MAIN ] Derivative Progress: 1620/2052 symbols completed. SEMR took 1.2s. Estimated remaining: 2m 43s. Rate: 159.4 symbols/min [2025-10-22T22:14:46.759491] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:46.759579] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:46.760284] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:46.769116] [DEBUG] [LOCAL ] SFB: Loaded 3697 existing records from primary storage. [2025-10-22T22:14:46.769711] [INFO ] [MAIN ] SFB: Loaded 3697 primary data records. [2025-10-22T22:14:47.144173] [DEBUG] [LOCAL ] SF: Loaded 41355 existing records from primary storage. [2025-10-22T22:14:47.144824] [INFO ] [MAIN ] SF: Loaded 41355 primary data records. [2025-10-22T22:14:47.157615] [DEBUG] [LOCAL ] SES: Loaded 51614 existing records from primary storage. [2025-10-22T22:14:47.168125] [INFO ] [MAIN ] SES: Loaded 51614 primary data records. [2025-10-22T22:14:47.752049] [DEBUG] [MAIN ] SFB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:47.753356] [INFO ] [MAIN ] SFB: Generated 1794 derivative records from 3697 primary records. [2025-10-22T22:14:47.754501] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-22T22:14:47.770503] [DEBUG] [LOCAL ] SFB: Derivative data saved (1794 records). [2025-10-22T22:14:47.770637] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-22T22:14:47.772936] [INFO ] [MAIN ] Derivative Progress: 1621/2052 symbols completed. SFB took 1.0s. Estimated remaining: 2m 42s. Rate: 159.2 symbols/min [2025-10-22T22:14:47.773084] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:47.806027] [DEBUG] [MAIN ] SES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:47.811318] [DEBUG] [MAIN ] SF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:47.812059] [INFO ] [MAIN ] SES: Generated 1794 derivative records from 51614 primary records. [2025-10-22T22:14:47.812180] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-22T22:14:47.812768] [INFO ] [MAIN ] SF: Generated 1794 derivative records from 41355 primary records. [2025-10-22T22:14:47.813499] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-22T22:14:47.843303] [DEBUG] [LOCAL ] SF: Derivative data saved (1794 records). [2025-10-22T22:14:47.843407] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-10-22T22:14:47.835590] [DEBUG] [LOCAL ] SFBS: Loaded 21398 existing records from primary storage. [2025-10-22T22:14:47.843589] [INFO ] [MAIN ] SFBS: Loaded 21398 primary data records. [2025-10-22T22:14:47.846177] [INFO ] [MAIN ] Derivative Progress: 1622/2052 symbols completed. SF took 1.1s. Estimated remaining: 2m 42s. Rate: 159.3 symbols/min [2025-10-22T22:14:47.852984] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:47.854475] [DEBUG] [LOCAL ] SES: Derivative data saved (1794 records). [2025-10-22T22:14:47.854600] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-22T22:14:47.868975] [INFO ] [MAIN ] Derivative Progress: 1623/2052 symbols completed. SES took 1.1s. Estimated remaining: 2m 41s. Rate: 159.4 symbols/min [2025-10-22T22:14:47.913663] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:48.206502] [DEBUG] [LOCAL ] SFL: Loaded 45244 existing records from primary storage. [2025-10-22T22:14:48.207145] [INFO ] [MAIN ] SFL: Loaded 45244 primary data records. [2025-10-22T22:14:48.326493] [DEBUG] [LOCAL ] SG: Loaded 53505 existing records from primary storage. [2025-10-22T22:14:48.326977] [INFO ] [MAIN ] SG: Loaded 53505 primary data records. [2025-10-22T22:14:48.712020] [DEBUG] [MAIN ] SFBS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:14:48.864214] [INFO ] [MAIN ] SFBS: Generated 1793 derivative records from 21398 primary records. [2025-10-22T22:14:48.873189] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-22T22:14:48.893020] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1793 records). [2025-10-22T22:14:48.894194] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-10-22T22:14:48.897831] [INFO ] [MAIN ] Derivative Progress: 1624/2052 symbols completed. SFBS took 1.1s. Estimated remaining: 2m 41s. Rate: 159.2 symbols/min [2025-10-22T22:14:48.898607] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:48.918671] [DEBUG] [MAIN ] SFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:48.919452] [INFO ] [MAIN ] SFL: Generated 1794 derivative records from 45244 primary records. [2025-10-22T22:14:48.919749] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-10-22T22:14:48.937444] [DEBUG] [LOCAL ] SFL: Derivative data saved (1794 records). [2025-10-22T22:14:48.941567] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-10-22T22:14:48.943738] [INFO ] [MAIN ] Derivative Progress: 1625/2052 symbols completed. SFL took 1.1s. Estimated remaining: 2m 41s. Rate: 159.3 symbols/min [2025-10-22T22:14:48.943966] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:48.957670] [DEBUG] [MAIN ] SG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:48.958372] [INFO ] [MAIN ] SG: Generated 1794 derivative records from 53505 primary records. [2025-10-22T22:14:48.958517] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-22T22:14:48.987114] [DEBUG] [LOCAL ] SG: Derivative data saved (1794 records). [2025-10-22T22:14:48.987263] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-10-22T22:14:48.990276] [INFO ] [MAIN ] Derivative Progress: 1626/2052 symbols completed. SG took 1.1s. Estimated remaining: 2m 40s. Rate: 159.4 symbols/min [2025-10-22T22:14:48.992046] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:48.996422] [DEBUG] [LOCAL ] SGU: Loaded 6507 existing records from primary storage. [2025-10-22T22:14:48.996701] [INFO ] [MAIN ] SGU: Loaded 6507 primary data records. [2025-10-22T22:14:49.117002] [DEBUG] [LOCAL ] SGHC: Loaded 47310 existing records from primary storage. [2025-10-22T22:14:49.117929] [INFO ] [MAIN ] SGHC: Loaded 47310 primary data records. [2025-10-22T22:14:49.532903] [DEBUG] [LOCAL ] SHAK: Loaded 48652 existing records from primary storage. [2025-10-22T22:14:49.540298] [INFO ] [MAIN ] SHAK: Loaded 48652 primary data records. [2025-10-22T22:14:50.028407] [DEBUG] [MAIN ] SGU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:50.031051] [INFO ] [MAIN ] SGU: Generated 1794 derivative records from 6507 primary records. [2025-10-22T22:14:50.032041] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-22T22:14:50.064637] [DEBUG] [LOCAL ] SGU: Derivative data saved (1794 records). [2025-10-22T22:14:50.067003] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-22T22:14:50.066887] [DEBUG] [MAIN ] SGHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:50.071166] [INFO ] [MAIN ] Derivative Progress: 1627/2052 symbols completed. SGU took 1.1s. Estimated remaining: 2m 40s. Rate: 159.2 symbols/min [2025-10-22T22:14:50.071701] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:50.073074] [INFO ] [MAIN ] SGHC: Generated 1794 derivative records from 47310 primary records. [2025-10-22T22:14:50.073519] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-22T22:14:50.090981] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1794 records). [2025-10-22T22:14:50.091295] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-22T22:14:50.093850] [INFO ] [MAIN ] Derivative Progress: 1628/2052 symbols completed. SGHC took 1.2s. Estimated remaining: 2m 40s. Rate: 159.3 symbols/min [2025-10-22T22:14:50.094210] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:50.114009] [DEBUG] [MAIN ] SHAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:50.114973] [INFO ] [MAIN ] SHAK: Generated 1794 derivative records from 48652 primary records. [2025-10-22T22:14:50.115149] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-22T22:14:50.140264] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1794 records). [2025-10-22T22:14:50.140367] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-10-22T22:14:50.143444] [INFO ] [MAIN ] Derivative Progress: 1629/2052 symbols completed. SHAK took 1.2s. Estimated remaining: 2m 39s. Rate: 159.4 symbols/min [2025-10-22T22:14:50.143767] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:50.169742] [DEBUG] [LOCAL ] SHG: Loaded 26653 existing records from primary storage. [2025-10-22T22:14:50.169891] [INFO ] [MAIN ] SHG: Loaded 26653 primary data records. [2025-10-22T22:14:50.298065] [DEBUG] [LOCAL ] SHEL: Loaded 53675 existing records from primary storage. [2025-10-22T22:14:50.313979] [INFO ] [MAIN ] SHEL: Loaded 53675 primary data records. [2025-10-22T22:14:50.700893] [DEBUG] [LOCAL ] SHO: Loaded 49127 existing records from primary storage. [2025-10-22T22:14:50.727048] [INFO ] [MAIN ] SHO: Loaded 49127 primary data records. [2025-10-22T22:14:51.276099] [DEBUG] [MAIN ] SHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:51.277878] [INFO ] [MAIN ] SHG: Generated 1794 derivative records from 26653 primary records. [2025-10-22T22:14:51.278206] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-22T22:14:51.311181] [DEBUG] [LOCAL ] SHG: Derivative data saved (1794 records). [2025-10-22T22:14:51.316088] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-22T22:14:51.318296] [INFO ] [MAIN ] Derivative Progress: 1630/2052 symbols completed. SHG took 1.2s. Estimated remaining: 2m 39s. Rate: 159.2 symbols/min [2025-10-22T22:14:51.318425] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:51.320930] [DEBUG] [MAIN ] SHEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:51.322107] [INFO ] [MAIN ] SHEL: Generated 1794 derivative records from 53675 primary records. [2025-10-22T22:14:51.322233] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-22T22:14:51.344225] [DEBUG] [LOCAL ] SHOC: Loaded 3016 existing records from primary storage. [2025-10-22T22:14:51.350701] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1794 records). [2025-10-22T22:14:51.350946] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-22T22:14:51.354728] [INFO ] [MAIN ] Derivative Progress: 1631/2052 symbols completed. SHEL took 1.3s. Estimated remaining: 2m 39s. Rate: 159.3 symbols/min [2025-10-22T22:14:51.346969] [INFO ] [MAIN ] SHOC: Loaded 3016 primary data records. [2025-10-22T22:14:51.355069] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:51.580174] [DEBUG] [MAIN ] SHO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:51.588127] [INFO ] [MAIN ] SHO: Generated 1794 derivative records from 49127 primary records. [2025-10-22T22:14:51.588372] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-22T22:14:51.744787] [DEBUG] [LOCAL ] SHO: Derivative data saved (1794 records). [2025-10-22T22:14:51.747784] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-10-22T22:14:51.750982] [INFO ] [MAIN ] Derivative Progress: 1632/2052 symbols completed. SHO took 1.6s. Estimated remaining: 2m 38s. Rate: 159.3 symbols/min [2025-10-22T22:14:51.768361] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:51.775187] [DEBUG] [LOCAL ] SHW: Loaded 50382 existing records from primary storage. [2025-10-22T22:14:51.775599] [INFO ] [MAIN ] SHW: Loaded 50382 primary data records. [2025-10-22T22:14:52.113822] [DEBUG] [LOCAL ] SID: Loaded 42913 existing records from primary storage. [2025-10-22T22:14:52.114056] [INFO ] [MAIN ] SID: Loaded 42913 primary data records. [2025-10-22T22:14:52.233457] [DEBUG] [MAIN ] SHOC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:14:52.250282] [INFO ] [MAIN ] SHOC: Generated 1793 derivative records from 3016 primary records. [2025-10-22T22:14:52.261396] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-22T22:14:52.326375] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1793 records). [2025-10-22T22:14:52.438624] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-22T22:14:52.441022] [INFO ] [MAIN ] Derivative Progress: 1633/2052 symbols completed. SHOC took 1.1s. Estimated remaining: 2m 38s. Rate: 159.2 symbols/min [2025-10-22T22:14:52.460471] [DEBUG] [MAIN ] SHW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:52.461785] [INFO ] [MAIN ] SHW: Generated 1794 derivative records from 50382 primary records. [2025-10-22T22:14:52.461868] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-22T22:14:52.478560] [DEBUG] [LOCAL ] SHW: Derivative data saved (1794 records). [2025-10-22T22:14:52.478633] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-10-22T22:14:52.480744] [INFO ] [MAIN ] Derivative Progress: 1634/2052 symbols completed. SHW took 1.1s. Estimated remaining: 2m 37s. Rate: 159.3 symbols/min [2025-10-22T22:14:52.497987] [DEBUG] [MAIN ] SID: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:52.498537] [INFO ] [MAIN ] SID: Generated 1794 derivative records from 42913 primary records. [2025-10-22T22:14:52.498597] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-22T22:14:52.514247] [DEBUG] [LOCAL ] SID: Derivative data saved (1794 records). [2025-10-22T22:14:52.514303] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-22T22:14:52.516885] [INFO ] [MAIN ] Derivative Progress: 1635/2052 symbols completed. SID took 0.7s. Estimated remaining: 2m 37s. Rate: 159.4 symbols/min [2025-10-22T22:14:52.517527] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:52.517440] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:52.517673] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:52.542246] [DEBUG] [LOCAL ] SII: Loaded 24194 existing records from primary storage. [2025-10-22T22:14:52.550626] [INFO ] [MAIN ] SII: Loaded 24194 primary data records. [2025-10-22T22:14:52.652688] [DEBUG] [LOCAL ] SILA: Loaded 29955 existing records from primary storage. [2025-10-22T22:14:52.658090] [INFO ] [MAIN ] SILA: Loaded 29955 primary data records. [2025-10-22T22:14:52.835188] [DEBUG] [LOCAL ] SIG: Loaded 45345 existing records from primary storage. [2025-10-22T22:14:52.842766] [INFO ] [MAIN ] SIG: Loaded 45345 primary data records. [2025-10-22T22:14:53.520109] [DEBUG] [MAIN ] SII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:53.520901] [INFO ] [MAIN ] SII: Generated 1794 derivative records from 24194 primary records. [2025-10-22T22:14:53.520995] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-22T22:14:53.549274] [DEBUG] [LOCAL ] SII: Derivative data saved (1794 records). [2025-10-22T22:14:53.549188] [DEBUG] [MAIN ] SILA: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:14:53.549497] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-22T22:14:53.550250] [INFO ] [MAIN ] SILA: Generated 1793 derivative records from 29955 primary records. [2025-10-22T22:14:53.552483] [INFO ] [MAIN ] Derivative Progress: 1636/2052 symbols completed. SII took 1.0s. Estimated remaining: 2m 37s. Rate: 159.2 symbols/min [2025-10-22T22:14:53.552631] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:53.550471] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-22T22:14:53.584234] [DEBUG] [MAIN ] SIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:53.585378] [DEBUG] [LOCAL ] SILA: Derivative data saved (1793 records). [2025-10-22T22:14:53.586531] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-22T22:14:53.586092] [INFO ] [MAIN ] SIG: Generated 1794 derivative records from 45345 primary records. [2025-10-22T22:14:53.586905] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-22T22:14:53.590389] [INFO ] [MAIN ] Derivative Progress: 1637/2052 symbols completed. SILA took 1.1s. Estimated remaining: 2m 36s. Rate: 159.3 symbols/min [2025-10-22T22:14:53.591546] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:53.606826] [DEBUG] [LOCAL ] SIG: Derivative data saved (1794 records). [2025-10-22T22:14:53.607036] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-10-22T22:14:53.610091] [INFO ] [MAIN ] Derivative Progress: 1638/2052 symbols completed. SIG took 1.1s. Estimated remaining: 2m 36s. Rate: 159.4 symbols/min [2025-10-22T22:14:53.610270] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:53.639167] [DEBUG] [LOCAL ] SITC: Loaded 41703 existing records from primary storage. [2025-10-22T22:14:53.639455] [INFO ] [MAIN ] SITC: Loaded 41703 primary data records. [2025-10-22T22:14:53.792138] [DEBUG] [LOCAL ] SITE: Loaded 35501 existing records from primary storage. [2025-10-22T22:14:53.810482] [INFO ] [MAIN ] SITE: Loaded 35501 primary data records. [2025-10-22T22:14:54.072693] [DEBUG] [LOCAL ] SJM: Loaded 50093 existing records from primary storage. [2025-10-22T22:14:54.076075] [INFO ] [MAIN ] SJM: Loaded 50093 primary data records. [2025-10-22T22:14:54.580965] [DEBUG] [MAIN ] SITC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:54.581780] [INFO ] [MAIN ] SITC: Generated 1794 derivative records from 41703 primary records. [2025-10-22T22:14:54.581968] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-22T22:14:54.603979] [DEBUG] [LOCAL ] SITC: Derivative data saved (1794 records). [2025-10-22T22:14:54.605858] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-10-22T22:14:54.608431] [INFO ] [MAIN ] Derivative Progress: 1639/2052 symbols completed. SITC took 1.1s. Estimated remaining: 2m 36s. Rate: 159.2 symbols/min [2025-10-22T22:14:54.608788] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:54.622531] [DEBUG] [MAIN ] SITE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:54.623243] [INFO ] [MAIN ] SITE: Generated 1794 derivative records from 35501 primary records. [2025-10-22T22:14:54.623334] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-22T22:14:54.641517] [DEBUG] [LOCAL ] SITE: Derivative data saved (1794 records). [2025-10-22T22:14:54.658408] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-22T22:14:54.661029] [DEBUG] [MAIN ] SJM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:54.660770] [INFO ] [MAIN ] Derivative Progress: 1640/2052 symbols completed. SITE took 1.1s. Estimated remaining: 2m 35s. Rate: 159.3 symbols/min [2025-10-22T22:14:54.661875] [INFO ] [MAIN ] SJM: Generated 1794 derivative records from 50093 primary records. [2025-10-22T22:14:54.661999] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-22T22:14:54.662375] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:54.683196] [DEBUG] [LOCAL ] SJT: Loaded 22724 existing records from primary storage. [2025-10-22T22:14:54.685588] [DEBUG] [LOCAL ] SJM: Derivative data saved (1794 records). [2025-10-22T22:14:54.685779] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-10-22T22:14:54.685849] [INFO ] [MAIN ] SJT: Loaded 22724 primary data records. [2025-10-22T22:14:54.688338] [INFO ] [MAIN ] Derivative Progress: 1641/2052 symbols completed. SJM took 1.1s. Estimated remaining: 2m 35s. Rate: 159.4 symbols/min [2025-10-22T22:14:54.719135] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:54.846050] [DEBUG] [LOCAL ] SKIL: Loaded 6902 existing records from primary storage. [2025-10-22T22:14:54.885240] [INFO ] [MAIN ] SKIL: Loaded 6902 primary data records. [2025-10-22T22:14:55.117213] [DEBUG] [LOCAL ] SKE: Loaded 37318 existing records from primary storage. [2025-10-22T22:14:55.128565] [INFO ] [MAIN ] SKE: Loaded 37318 primary data records. [2025-10-22T22:14:55.690188] [DEBUG] [MAIN ] SJT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:55.691008] [INFO ] [MAIN ] SJT: Generated 1794 derivative records from 22724 primary records. [2025-10-22T22:14:55.691111] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-22T22:14:55.708955] [DEBUG] [LOCAL ] SJT: Derivative data saved (1794 records). [2025-10-22T22:14:55.709091] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-22T22:14:55.711678] [INFO ] [MAIN ] Derivative Progress: 1642/2052 symbols completed. SJT took 1.1s. Estimated remaining: 2m 34s. Rate: 159.2 symbols/min [2025-10-22T22:14:55.711978] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:55.733074] [DEBUG] [MAIN ] SKIL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:55.734002] [INFO ] [MAIN ] SKIL: Generated 1794 derivative records from 6902 primary records. [2025-10-22T22:14:55.734239] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-22T22:14:55.750786] [DEBUG] [LOCAL ] SKLZ: Loaded 11463 existing records from primary storage. [2025-10-22T22:14:55.751061] [INFO ] [MAIN ] SKLZ: Loaded 11463 primary data records. [2025-10-22T22:14:55.776962] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1794 records). [2025-10-22T22:14:55.801630] [DEBUG] [MAIN ] SKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:55.781377] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-22T22:14:55.814341] [INFO ] [MAIN ] SKE: Generated 1794 derivative records from 37318 primary records. [2025-10-22T22:14:55.816832] [INFO ] [MAIN ] Derivative Progress: 1643/2052 symbols completed. SKIL took 1.1s. Estimated remaining: 2m 34s. Rate: 159.3 symbols/min [2025-10-22T22:14:55.843134] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-22T22:14:55.849877] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:55.921146] [DEBUG] [LOCAL ] SKE: Derivative data saved (1794 records). [2025-10-22T22:14:55.933312] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-22T22:14:55.944422] [INFO ] [MAIN ] Derivative Progress: 1644/2052 symbols completed. SKE took 1.3s. Estimated remaining: 2m 34s. Rate: 159.4 symbols/min [2025-10-22T22:14:55.954380] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:56.113950] [DEBUG] [LOCAL ] SKM: Loaded 35160 existing records from primary storage. [2025-10-22T22:14:56.117874] [INFO ] [MAIN ] SKM: Loaded 35160 primary data records. [2025-10-22T22:14:56.433589] [DEBUG] [LOCAL ] SKT: Loaded 42303 existing records from primary storage. [2025-10-22T22:14:56.441677] [INFO ] [MAIN ] SKT: Loaded 42303 primary data records. [2025-10-22T22:14:56.465918] [DEBUG] [MAIN ] SKLZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:56.492049] [INFO ] [MAIN ] SKLZ: Generated 1794 derivative records from 11463 primary records. [2025-10-22T22:14:56.510689] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-22T22:14:56.599293] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1794 records). [2025-10-22T22:14:56.626180] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-22T22:14:56.640193] [INFO ] [MAIN ] Derivative Progress: 1645/2052 symbols completed. SKLZ took 0.9s. Estimated remaining: 2m 33s. Rate: 159.3 symbols/min [2025-10-22T22:14:56.654945] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:56.846770] [DEBUG] [MAIN ] SKM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:56.847772] [INFO ] [MAIN ] SKM: Generated 1794 derivative records from 35160 primary records. [2025-10-22T22:14:56.848160] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-10-22T22:14:56.865638] [DEBUG] [LOCAL ] SKM: Derivative data saved (1794 records). [2025-10-22T22:14:56.866136] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-10-22T22:14:56.868848] [INFO ] [MAIN ] Derivative Progress: 1646/2052 symbols completed. SKM took 1.0s. Estimated remaining: 2m 33s. Rate: 159.3 symbols/min [2025-10-22T22:14:56.869292] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:56.912032] [DEBUG] [LOCAL ] SKY: Loaded 38578 existing records from primary storage. [2025-10-22T22:14:56.917541] [INFO ] [MAIN ] SKY: Loaded 38578 primary data records. [2025-10-22T22:14:56.917253] [DEBUG] [MAIN ] SKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:56.918609] [INFO ] [MAIN ] SKT: Generated 1794 derivative records from 42303 primary records. [2025-10-22T22:14:56.960342] [DEBUG] [LOCAL ] SKYH: Loaded 15813 existing records from primary storage. [2025-10-22T22:14:56.960471] [INFO ] [MAIN ] SKYH: Loaded 15813 primary data records. [2025-10-22T22:14:56.960037] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-22T22:14:57.181863] [DEBUG] [LOCAL ] SKT: Derivative data saved (1794 records). [2025-10-22T22:14:57.219367] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-10-22T22:14:57.248889] [INFO ] [MAIN ] Derivative Progress: 1647/2052 symbols completed. SKT took 1.3s. Estimated remaining: 2m 33s. Rate: 159.3 symbols/min [2025-10-22T22:14:57.361626] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:57.585287] [DEBUG] [MAIN ] SKY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:57.586524] [INFO ] [MAIN ] SKY: Generated 1794 derivative records from 38578 primary records. [2025-10-22T22:14:57.600504] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-10-22T22:14:57.602918] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-10-22T22:14:57.603048] [INFO ] [MAIN ] SLB: Loaded 53697 primary data records. [2025-10-22T22:14:57.656443] [DEBUG] [LOCAL ] SKY: Derivative data saved (1794 records). [2025-10-22T22:14:57.677983] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-10-22T22:14:57.689289] [INFO ] [MAIN ] Derivative Progress: 1648/2052 symbols completed. SKY took 1.0s. Estimated remaining: 2m 32s. Rate: 159.3 symbols/min [2025-10-22T22:14:57.743033] [DEBUG] [MAIN ] SKYH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:57.760517] [INFO ] [MAIN ] SKYH: Generated 1794 derivative records from 15813 primary records. [2025-10-22T22:14:57.770953] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-22T22:14:57.959704] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1794 records). [2025-10-22T22:14:57.959886] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-22T22:14:57.964533] [INFO ] [MAIN ] Derivative Progress: 1649/2052 symbols completed. SKYH took 1.1s. Estimated remaining: 2m 32s. Rate: 159.3 symbols/min [2025-10-22T22:14:57.986233] [DEBUG] [MAIN ] SLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:57.986945] [INFO ] [MAIN ] SLB: Generated 1794 derivative records from 53697 primary records. [2025-10-22T22:14:57.987012] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-10-22T22:14:58.002736] [DEBUG] [LOCAL ] SLB: Derivative data saved (1794 records). [2025-10-22T22:14:58.002795] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-10-22T22:14:58.005607] [INFO ] [MAIN ] Derivative Progress: 1650/2052 symbols completed. SLB took 0.6s. Estimated remaining: 2m 31s. Rate: 159.4 symbols/min [2025-10-22T22:14:58.006194] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:58.006296] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:58.006819] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:58.072078] [DEBUG] [LOCAL ] SLF: Loaded 38364 existing records from primary storage. [2025-10-22T22:14:58.073367] [DEBUG] [LOCAL ] SLGN: Loaded 41015 existing records from primary storage. [2025-10-22T22:14:58.072806] [INFO ] [MAIN ] SLF: Loaded 38364 primary data records. [2025-10-22T22:14:58.096960] [INFO ] [MAIN ] SLGN: Loaded 41015 primary data records. [2025-10-22T22:14:58.143743] [DEBUG] [LOCAL ] SLG: Loaded 45790 existing records from primary storage. [2025-10-22T22:14:58.179695] [INFO ] [MAIN ] SLG: Loaded 45790 primary data records. [2025-10-22T22:14:59.068899] [DEBUG] [MAIN ] SLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:59.071033] [INFO ] [MAIN ] SLF: Generated 1794 derivative records from 38364 primary records. [2025-10-22T22:14:59.083374] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-22T22:14:59.095820] [DEBUG] [MAIN ] SLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:59.105594] [INFO ] [MAIN ] SLG: Generated 1794 derivative records from 45790 primary records. [2025-10-22T22:14:59.104671] [DEBUG] [MAIN ] SLGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:14:59.110488] [INFO ] [MAIN ] SLGN: Generated 1794 derivative records from 41015 primary records. [2025-10-22T22:14:59.110576] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-22T22:14:59.107101] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-22T22:14:59.115765] [DEBUG] [LOCAL ] SLF: Derivative data saved (1794 records). [2025-10-22T22:14:59.116915] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-22T22:14:59.119209] [INFO ] [MAIN ] Derivative Progress: 1651/2052 symbols completed. SLF took 1.1s. Estimated remaining: 2m 31s. Rate: 159.2 symbols/min [2025-10-22T22:14:59.142413] [DEBUG] [LOCAL ] SLG: Derivative data saved (1794 records). [2025-10-22T22:14:59.142572] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-10-22T22:14:59.137991] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:59.154130] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1794 records). [2025-10-22T22:14:59.149738] [INFO ] [MAIN ] Derivative Progress: 1652/2052 symbols completed. SLG took 1.1s. Estimated remaining: 2m 31s. Rate: 159.3 symbols/min [2025-10-22T22:14:59.154614] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:59.154971] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-10-22T22:14:59.158095] [INFO ] [MAIN ] Derivative Progress: 1653/2052 symbols completed. SLGN took 1.2s. Estimated remaining: 2m 30s. Rate: 159.4 symbols/min [2025-10-22T22:14:59.158261] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:14:59.213214] [DEBUG] [LOCAL ] SLVM: Loaded 27737 existing records from primary storage. [2025-10-22T22:14:59.213352] [INFO ] [MAIN ] SLVM: Loaded 27737 primary data records. [2025-10-22T22:14:59.341157] [DEBUG] [LOCAL ] SLQT: Loaded 43361 existing records from primary storage. [2025-10-22T22:14:59.342157] [INFO ] [MAIN ] SLQT: Loaded 43361 primary data records. [2025-10-22T22:14:59.342047] [DEBUG] [LOCAL ] SM: Loaded 52354 existing records from primary storage. [2025-10-22T22:14:59.348616] [INFO ] [MAIN ] SM: Loaded 52354 primary data records. [2025-10-22T22:15:00.210812] [DEBUG] [MAIN ] SLVM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:00.211882] [INFO ] [MAIN ] SLVM: Generated 1794 derivative records from 27737 primary records. [2025-10-22T22:15:00.214202] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-22T22:15:00.244814] [DEBUG] [MAIN ] SM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:00.248638] [INFO ] [MAIN ] SM: Generated 1794 derivative records from 52354 primary records. [2025-10-22T22:15:00.248784] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-22T22:15:00.250444] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1794 records). [2025-10-22T22:15:00.264579] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-10-22T22:15:00.274836] [INFO ] [MAIN ] Derivative Progress: 1654/2052 symbols completed. SLVM took 1.1s. Estimated remaining: 2m 30s. Rate: 159.2 symbols/min [2025-10-22T22:15:00.279992] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:00.265297] [DEBUG] [MAIN ] SLQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:00.284847] [DEBUG] [LOCAL ] SM: Derivative data saved (1794 records). [2025-10-22T22:15:00.285882] [INFO ] [MAIN ] SLQT: Generated 1794 derivative records from 43361 primary records. [2025-10-22T22:15:00.286348] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-10-22T22:15:00.286727] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-22T22:15:00.289382] [INFO ] [MAIN ] Derivative Progress: 1655/2052 symbols completed. SM took 1.1s. Estimated remaining: 2m 30s. Rate: 159.3 symbols/min [2025-10-22T22:15:00.290493] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:00.311607] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1794 records). [2025-10-22T22:15:00.311937] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-22T22:15:00.314681] [INFO ] [MAIN ] Derivative Progress: 1656/2052 symbols completed. SLQT took 1.2s. Estimated remaining: 2m 29s. Rate: 159.4 symbols/min [2025-10-22T22:15:00.314901] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:00.324325] [DEBUG] [LOCAL ] SMBK: Loaded 8269 existing records from primary storage. [2025-10-22T22:15:00.329593] [INFO ] [MAIN ] SMBK: Loaded 8269 primary data records. [2025-10-22T22:15:00.330182] [DEBUG] [LOCAL ] SMC: Loaded 10904 existing records from primary storage. [2025-10-22T22:15:00.355996] [INFO ] [MAIN ] SMC: Loaded 10904 primary data records. [2025-10-22T22:15:00.907331] [DEBUG] [LOCAL ] SMFG: Loaded 48307 existing records from primary storage. [2025-10-22T22:15:01.024105] [INFO ] [MAIN ] SMFG: Loaded 48307 primary data records. [2025-10-22T22:15:01.379869] [DEBUG] [MAIN ] SMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:01.387869] [INFO ] [MAIN ] SMC: Generated 1794 derivative records from 10904 primary records. [2025-10-22T22:15:01.403065] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-22T22:15:01.406822] [DEBUG] [MAIN ] SMBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:01.408771] [INFO ] [MAIN ] SMBK: Generated 1794 derivative records from 8269 primary records. [2025-10-22T22:15:01.424912] [DEBUG] [LOCAL ] SMC: Derivative data saved (1794 records). [2025-10-22T22:15:01.425084] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-22T22:15:01.427156] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-22T22:15:01.429788] [INFO ] [MAIN ] Derivative Progress: 1657/2052 symbols completed. SMC took 1.1s. Estimated remaining: 2m 29s. Rate: 159.2 symbols/min [2025-10-22T22:15:01.430026] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:01.448035] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1794 records). [2025-10-22T22:15:01.448389] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-10-22T22:15:01.450419] [INFO ] [MAIN ] Derivative Progress: 1658/2052 symbols completed. SMBK took 1.2s. Estimated remaining: 2m 28s. Rate: 159.3 symbols/min [2025-10-22T22:15:01.450583] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:01.466125] [DEBUG] [MAIN ] SMFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:01.466774] [INFO ] [MAIN ] SMFG: Generated 1794 derivative records from 48307 primary records. [2025-10-22T22:15:01.466837] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-22T22:15:01.482595] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1794 records). [2025-10-22T22:15:01.482702] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-22T22:15:01.485453] [INFO ] [MAIN ] Derivative Progress: 1659/2052 symbols completed. SMFG took 1.2s. Estimated remaining: 2m 28s. Rate: 159.4 symbols/min [2025-10-22T22:15:01.485610] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:01.538581] [DEBUG] [LOCAL ] SMHI: Loaded 12664 existing records from primary storage. [2025-10-22T22:15:01.539016] [INFO ] [MAIN ] SMHI: Loaded 12664 primary data records. [2025-10-22T22:15:01.576968] [DEBUG] [LOCAL ] SMP: Loaded 18640 existing records from primary storage. [2025-10-22T22:15:01.609741] [INFO ] [MAIN ] SMP: Loaded 18640 primary data records. [2025-10-22T22:15:02.001585] [DEBUG] [LOCAL ] SMG: Loaded 42743 existing records from primary storage. [2025-10-22T22:15:02.028371] [INFO ] [MAIN ] SMG: Loaded 42743 primary data records. [2025-10-22T22:15:02.532469] [DEBUG] [MAIN ] SMHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:02.534026] [INFO ] [MAIN ] SMHI: Generated 1794 derivative records from 12664 primary records. [2025-10-22T22:15:02.534991] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-22T22:15:02.566543] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1794 records). [2025-10-22T22:15:02.565576] [DEBUG] [MAIN ] SMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:02.567527] [INFO ] [MAIN ] SMP: Generated 1794 derivative records from 18640 primary records. [2025-10-22T22:15:02.567781] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-10-22T22:15:02.567945] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-10-22T22:15:02.570034] [INFO ] [MAIN ] Derivative Progress: 1660/2052 symbols completed. SMHI took 1.1s. Estimated remaining: 2m 28s. Rate: 159.2 symbols/min [2025-10-22T22:15:02.571359] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:02.589272] [DEBUG] [LOCAL ] SMP: Derivative data saved (1794 records). [2025-10-22T22:15:02.589628] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-10-22T22:15:02.592159] [INFO ] [MAIN ] Derivative Progress: 1661/2052 symbols completed. SMP took 1.1s. Estimated remaining: 2m 27s. Rate: 159.3 symbols/min [2025-10-22T22:15:02.605356] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:02.605237] [DEBUG] [MAIN ] SMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:02.606401] [INFO ] [MAIN ] SMG: Generated 1794 derivative records from 42743 primary records. [2025-10-22T22:15:02.606976] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-22T22:15:02.626059] [DEBUG] [LOCAL ] SMG: Derivative data saved (1794 records). [2025-10-22T22:15:02.626182] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-10-22T22:15:02.629003] [INFO ] [MAIN ] Derivative Progress: 1662/2052 symbols completed. SMG took 1.2s. Estimated remaining: 2m 27s. Rate: 159.4 symbols/min [2025-10-22T22:15:02.629327] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:02.690415] [DEBUG] [LOCAL ] SMWB: Loaded 31619 existing records from primary storage. [2025-10-22T22:15:02.691719] [INFO ] [MAIN ] SMWB: Loaded 31619 primary data records. [2025-10-22T22:15:02.692696] [DEBUG] [LOCAL ] SMRT: Loaded 43781 existing records from primary storage. [2025-10-22T22:15:02.693324] [INFO ] [MAIN ] SMRT: Loaded 43781 primary data records. [2025-10-22T22:15:02.877497] [DEBUG] [LOCAL ] SN: Loaded 49982 existing records from primary storage. [2025-10-22T22:15:02.911905] [INFO ] [MAIN ] SN: Loaded 49982 primary data records. [2025-10-22T22:15:03.651897] [DEBUG] [MAIN ] SMWB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:03.653806] [INFO ] [MAIN ] SMWB: Generated 1794 derivative records from 31619 primary records. [2025-10-22T22:15:03.666708] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-22T22:15:03.667161] [DEBUG] [MAIN ] SMRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:03.668145] [INFO ] [MAIN ] SMRT: Generated 1794 derivative records from 43781 primary records. [2025-10-22T22:15:03.668397] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-22T22:15:03.714386] [DEBUG] [MAIN ] SN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:03.705586] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1794 records). [2025-10-22T22:15:03.714553] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-10-22T22:15:03.716363] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1794 records). [2025-10-22T22:15:03.716475] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-22T22:15:03.716293] [INFO ] [MAIN ] Derivative Progress: 1663/2052 symbols completed. SMWB took 1.1s. Estimated remaining: 2m 27s. Rate: 159.2 symbols/min [2025-10-22T22:15:03.717258] [INFO ] [MAIN ] SN: Generated 1794 derivative records from 49982 primary records. [2025-10-22T22:15:03.717412] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-22T22:15:03.720063] [INFO ] [MAIN ] Derivative Progress: 1664/2052 symbols completed. SMRT took 1.1s. Estimated remaining: 2m 26s. Rate: 159.3 symbols/min [2025-10-22T22:15:03.735292] [DEBUG] [LOCAL ] SN: Derivative data saved (1794 records). [2025-10-22T22:15:03.735356] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-22T22:15:03.738120] [INFO ] [MAIN ] Derivative Progress: 1665/2052 symbols completed. SN took 1.1s. Estimated remaining: 2m 26s. Rate: 159.4 symbols/min [2025-10-22T22:15:03.738555] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:03.738500] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:03.738708] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:03.747381] [DEBUG] [LOCAL ] SNDA: Loaded 4475 existing records from primary storage. [2025-10-22T22:15:03.747726] [INFO ] [MAIN ] SNDA: Loaded 4475 primary data records. [2025-10-22T22:15:03.884499] [DEBUG] [LOCAL ] SNA: Loaded 25699 existing records from primary storage. [2025-10-22T22:15:03.895071] [INFO ] [MAIN ] SNA: Loaded 25699 primary data records. [2025-10-22T22:15:04.203168] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-22T22:15:04.224967] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-10-22T22:15:04.779591] [DEBUG] [MAIN ] SNDA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:04.780852] [INFO ] [MAIN ] SNDA: Generated 1794 derivative records from 4475 primary records. [2025-10-22T22:15:04.781057] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-22T22:15:04.799463] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1794 records). [2025-10-22T22:15:04.800133] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-22T22:15:04.813132] [DEBUG] [MAIN ] SNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:04.815124] [INFO ] [MAIN ] Derivative Progress: 1666/2052 symbols completed. SNDA took 1.1s. Estimated remaining: 2m 25s. Rate: 159.2 symbols/min [2025-10-22T22:15:04.815379] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:04.816373] [INFO ] [MAIN ] SNA: Generated 1794 derivative records from 25699 primary records. [2025-10-22T22:15:04.816634] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-10-22T22:15:04.833305] [DEBUG] [LOCAL ] SNA: Derivative data saved (1794 records). [2025-10-22T22:15:04.833520] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-10-22T22:15:04.837767] [INFO ] [MAIN ] Derivative Progress: 1667/2052 symbols completed. SNA took 1.1s. Estimated remaining: 2m 25s. Rate: 159.3 symbols/min [2025-10-22T22:15:04.838755] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:04.852441] [DEBUG] [MAIN ] SNAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:04.853306] [INFO ] [MAIN ] SNAP: Generated 1794 derivative records from 53796 primary records. [2025-10-22T22:15:04.853441] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-22T22:15:04.870878] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1794 records). [2025-10-22T22:15:04.871108] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-22T22:15:04.874014] [INFO ] [MAIN ] Derivative Progress: 1668/2052 symbols completed. SNAP took 1.1s. Estimated remaining: 2m 25s. Rate: 159.4 symbols/min [2025-10-22T22:15:04.874707] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:04.912955] [DEBUG] [LOCAL ] SNDR: Loaded 41601 existing records from primary storage. [2025-10-22T22:15:04.924866] [INFO ] [MAIN ] SNDR: Loaded 41601 primary data records. [2025-10-22T22:15:04.936719] [DEBUG] [LOCAL ] SNN: Loaded 44338 existing records from primary storage. [2025-10-22T22:15:04.956467] [INFO ] [MAIN ] SNN: Loaded 44338 primary data records. [2025-10-22T22:15:05.424460] [DEBUG] [LOCAL ] SNV: Loaded 49060 existing records from primary storage. [2025-10-22T22:15:05.549126] [INFO ] [MAIN ] SNV: Loaded 49060 primary data records. [2025-10-22T22:15:05.893880] [DEBUG] [MAIN ] SNDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:05.894716] [INFO ] [MAIN ] SNDR: Generated 1794 derivative records from 41601 primary records. [2025-10-22T22:15:05.907616] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-22T22:15:05.917659] [DEBUG] [MAIN ] SNN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:05.923192] [INFO ] [MAIN ] SNN: Generated 1794 derivative records from 44338 primary records. [2025-10-22T22:15:05.924334] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-22T22:15:05.926044] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1794 records). [2025-10-22T22:15:05.926420] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-10-22T22:15:05.928806] [INFO ] [MAIN ] Derivative Progress: 1669/2052 symbols completed. SNDR took 1.1s. Estimated remaining: 2m 24s. Rate: 159.2 symbols/min [2025-10-22T22:15:05.929046] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:05.945053] [DEBUG] [LOCAL ] SNN: Derivative data saved (1794 records). [2025-10-22T22:15:05.945376] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-22T22:15:05.947617] [INFO ] [MAIN ] Derivative Progress: 1670/2052 symbols completed. SNN took 1.1s. Estimated remaining: 2m 24s. Rate: 159.3 symbols/min [2025-10-22T22:15:05.948075] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:05.964480] [DEBUG] [MAIN ] SNV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:05.965394] [INFO ] [MAIN ] SNV: Generated 1794 derivative records from 49060 primary records. [2025-10-22T22:15:05.965609] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-10-22T22:15:05.981758] [DEBUG] [LOCAL ] SNV: Derivative data saved (1794 records). [2025-10-22T22:15:05.981950] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-10-22T22:15:05.994350] [INFO ] [MAIN ] Derivative Progress: 1671/2052 symbols completed. SNV took 1.1s. Estimated remaining: 2m 23s. Rate: 159.4 symbols/min [2025-10-22T22:15:05.994804] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:06.029874] [DEBUG] [LOCAL ] SNX: Loaded 38854 existing records from primary storage. [2025-10-22T22:15:06.038259] [INFO ] [MAIN ] SNX: Loaded 38854 primary data records. [2025-10-22T22:15:06.173165] [DEBUG] [LOCAL ] SOBO: Loaded 39390 existing records from primary storage. [2025-10-22T22:15:06.178965] [INFO ] [MAIN ] SOBO: Loaded 39390 primary data records. [2025-10-22T22:15:06.184733] [DEBUG] [LOCAL ] SO: Loaded 53615 existing records from primary storage. [2025-10-22T22:15:06.222360] [INFO ] [MAIN ] SO: Loaded 53615 primary data records. [2025-10-22T22:15:07.077835] [DEBUG] [MAIN ] SNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:07.078792] [INFO ] [MAIN ] SNX: Generated 1794 derivative records from 38854 primary records. [2025-10-22T22:15:07.078888] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-10-22T22:15:07.096244] [DEBUG] [LOCAL ] SNX: Derivative data saved (1794 records). [2025-10-22T22:15:07.096613] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-10-22T22:15:07.099621] [INFO ] [MAIN ] Derivative Progress: 1672/2052 symbols completed. SNX took 1.2s. Estimated remaining: 2m 23s. Rate: 159.2 symbols/min [2025-10-22T22:15:07.099928] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:07.118252] [DEBUG] [MAIN ] SOBO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:07.119196] [INFO ] [MAIN ] SOBO: Generated 1794 derivative records from 39390 primary records. [2025-10-22T22:15:07.119322] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-22T22:15:07.141597] [DEBUG] [MAIN ] SO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:07.148936] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1794 records). [2025-10-22T22:15:07.149100] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-22T22:15:07.151956] [INFO ] [MAIN ] Derivative Progress: 1673/2052 symbols completed. SOBO took 1.2s. Estimated remaining: 2m 23s. Rate: 159.3 symbols/min [2025-10-22T22:15:07.153279] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:07.153081] [INFO ] [MAIN ] SO: Generated 1794 derivative records from 53615 primary records. [2025-10-22T22:15:07.153715] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-22T22:15:07.170284] [DEBUG] [LOCAL ] SO: Derivative data saved (1794 records). [2025-10-22T22:15:07.171844] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-10-22T22:15:07.174601] [INFO ] [MAIN ] Derivative Progress: 1674/2052 symbols completed. SO took 1.2s. Estimated remaining: 2m 22s. Rate: 159.4 symbols/min [2025-10-22T22:15:07.174840] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:07.191704] [DEBUG] [LOCAL ] SOJC: Loaded 4574 existing records from primary storage. [2025-10-22T22:15:07.191833] [INFO ] [MAIN ] SOJC: Loaded 4574 primary data records. [2025-10-22T22:15:07.322099] [DEBUG] [LOCAL ] SOJD: Loaded 12581 existing records from primary storage. [2025-10-22T22:15:07.322997] [DEBUG] [LOCAL ] SOC: Loaded 51227 existing records from primary storage. [2025-10-22T22:15:07.323161] [INFO ] [MAIN ] SOJD: Loaded 12581 primary data records. [2025-10-22T22:15:07.326865] [INFO ] [MAIN ] SOC: Loaded 51227 primary data records. [2025-10-22T22:15:08.179184] [DEBUG] [MAIN ] SOJC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:08.180059] [INFO ] [MAIN ] SOJC: Generated 1794 derivative records from 4574 primary records. [2025-10-22T22:15:08.180486] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-22T22:15:08.201309] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1794 records). [2025-10-22T22:15:08.202067] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-22T22:15:08.204794] [INFO ] [MAIN ] Derivative Progress: 1675/2052 symbols completed. SOJC took 1.1s. Estimated remaining: 2m 22s. Rate: 159.2 symbols/min [2025-10-22T22:15:08.205334] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:08.219830] [DEBUG] [MAIN ] SOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:08.234483] [INFO ] [MAIN ] SOC: Generated 1794 derivative records from 51227 primary records. [2025-10-22T22:15:08.236931] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-22T22:15:08.238250] [DEBUG] [MAIN ] SOJD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:08.247174] [INFO ] [MAIN ] SOJD: Generated 1794 derivative records from 12581 primary records. [2025-10-22T22:15:08.255537] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-22T22:15:08.255377] [DEBUG] [LOCAL ] SOC: Derivative data saved (1794 records). [2025-10-22T22:15:08.255820] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-22T22:15:08.259097] [INFO ] [MAIN ] Derivative Progress: 1676/2052 symbols completed. SOC took 1.2s. Estimated remaining: 2m 22s. Rate: 159.3 symbols/min [2025-10-22T22:15:08.264526] [DEBUG] [LOCAL ] SOJE: Loaded 8697 existing records from primary storage. [2025-10-22T22:15:08.264678] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:08.273639] [INFO ] [MAIN ] SOJE: Loaded 8697 primary data records. [2025-10-22T22:15:08.294687] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1794 records). [2025-10-22T22:15:08.320758] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-22T22:15:08.330575] [INFO ] [MAIN ] Derivative Progress: 1677/2052 symbols completed. SOJD took 1.2s. Estimated remaining: 2m 21s. Rate: 159.4 symbols/min [2025-10-22T22:15:08.362102] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:08.403693] [DEBUG] [LOCAL ] SOL: Loaded 13561 existing records from primary storage. [2025-10-22T22:15:08.404300] [INFO ] [MAIN ] SOL: Loaded 13561 primary data records. [2025-10-22T22:15:08.962278] [DEBUG] [LOCAL ] SOLV: Loaded 43384 existing records from primary storage. [2025-10-22T22:15:08.962699] [INFO ] [MAIN ] SOLV: Loaded 43384 primary data records. [2025-10-22T22:15:09.291464] [DEBUG] [MAIN ] SOJE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:09.292499] [INFO ] [MAIN ] SOJE: Generated 1794 derivative records from 8697 primary records. [2025-10-22T22:15:09.292879] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-22T22:15:09.312364] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1794 records). [2025-10-22T22:15:09.313564] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-22T22:15:09.315698] [INFO ] [MAIN ] Derivative Progress: 1678/2052 symbols completed. SOJE took 1.1s. Estimated remaining: 2m 21s. Rate: 159.2 symbols/min [2025-10-22T22:15:09.329114] [DEBUG] [MAIN ] SOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:09.330001] [INFO ] [MAIN ] SOL: Generated 1794 derivative records from 13561 primary records. [2025-10-22T22:15:09.330109] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-22T22:15:09.346700] [DEBUG] [LOCAL ] SOL: Derivative data saved (1794 records). [2025-10-22T22:15:09.346964] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-22T22:15:09.349910] [INFO ] [MAIN ] Derivative Progress: 1679/2052 symbols completed. SOL took 1.1s. Estimated remaining: 2m 20s. Rate: 159.3 symbols/min [2025-10-22T22:15:09.365892] [DEBUG] [MAIN ] SOLV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:09.366422] [INFO ] [MAIN ] SOLV: Generated 1794 derivative records from 43384 primary records. [2025-10-22T22:15:09.366481] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-10-22T22:15:09.381389] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1794 records). [2025-10-22T22:15:09.381456] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-10-22T22:15:09.384016] [INFO ] [MAIN ] Derivative Progress: 1680/2052 symbols completed. SOLV took 1.0s. Estimated remaining: 2m 20s. Rate: 159.4 symbols/min [2025-10-22T22:15:09.384398] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:09.384512] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:09.384611] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:09.394587] [DEBUG] [LOCAL ] SOR: Loaded 2818 existing records from primary storage. [2025-10-22T22:15:09.394894] [INFO ] [MAIN ] SOR: Loaded 2818 primary data records. [2025-10-22T22:15:09.743034] [DEBUG] [LOCAL ] SON: Loaded 43544 existing records from primary storage. [2025-10-22T22:15:09.743352] [INFO ] [MAIN ] SON: Loaded 43544 primary data records. [2025-10-22T22:15:09.744003] [DEBUG] [LOCAL ] SONY: Loaded 53376 existing records from primary storage. [2025-10-22T22:15:09.788390] [INFO ] [MAIN ] SONY: Loaded 53376 primary data records. [2025-10-22T22:15:10.365709] [DEBUG] [MAIN ] SOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:10.368020] [INFO ] [MAIN ] SOR: Generated 1794 derivative records from 2818 primary records. [2025-10-22T22:15:10.368332] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-22T22:15:10.383585] [DEBUG] [LOCAL ] SOR: Derivative data saved (1794 records). [2025-10-22T22:15:10.384001] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-22T22:15:10.386664] [INFO ] [MAIN ] Derivative Progress: 1681/2052 symbols completed. SOR took 1.0s. Estimated remaining: 2m 20s. Rate: 159.2 symbols/min [2025-10-22T22:15:10.386836] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:10.403558] [DEBUG] [MAIN ] SON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:10.404437] [INFO ] [MAIN ] SON: Generated 1794 derivative records from 43544 primary records. [2025-10-22T22:15:10.406926] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-10-22T22:15:10.434454] [DEBUG] [LOCAL ] SOS: Loaded 9686 existing records from primary storage. [2025-10-22T22:15:10.442232] [DEBUG] [LOCAL ] SON: Derivative data saved (1794 records). [2025-10-22T22:15:10.442810] [INFO ] [MAIN ] SOS: Loaded 9686 primary data records. [2025-10-22T22:15:10.442714] [DEBUG] [MAIN ] SONY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:10.474481] [INFO ] [MAIN ] SONY: Generated 1794 derivative records from 53376 primary records. [2025-10-22T22:15:10.479755] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-22T22:15:10.486816] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-10-22T22:15:10.489596] [INFO ] [MAIN ] Derivative Progress: 1682/2052 symbols completed. SON took 1.1s. Estimated remaining: 2m 19s. Rate: 159.3 symbols/min [2025-10-22T22:15:10.510753] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:10.567218] [DEBUG] [LOCAL ] SONY: Derivative data saved (1794 records). [2025-10-22T22:15:10.578485] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-22T22:15:10.596735] [INFO ] [MAIN ] Derivative Progress: 1683/2052 symbols completed. SONY took 1.2s. Estimated remaining: 2m 19s. Rate: 159.4 symbols/min [2025-10-22T22:15:10.613071] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:10.817108] [DEBUG] [LOCAL ] SPB: Loaded 34013 existing records from primary storage. [2025-10-22T22:15:10.817674] [INFO ] [MAIN ] SPB: Loaded 34013 primary data records. [2025-10-22T22:15:11.145572] [DEBUG] [LOCAL ] SPCE: Loaded 50052 existing records from primary storage. [2025-10-22T22:15:11.145943] [INFO ] [MAIN ] SPCE: Loaded 50052 primary data records. [2025-10-22T22:15:11.252346] [DEBUG] [MAIN ] SOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:11.270912] [INFO ] [MAIN ] SOS: Generated 1794 derivative records from 9686 primary records. [2025-10-22T22:15:11.271411] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-22T22:15:11.309202] [DEBUG] [LOCAL ] SOS: Derivative data saved (1794 records). [2025-10-22T22:15:11.309366] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-22T22:15:11.330732] [INFO ] [MAIN ] Derivative Progress: 1684/2052 symbols completed. SOS took 0.9s. Estimated remaining: 2m 19s. Rate: 159.3 symbols/min [2025-10-22T22:15:11.348528] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:11.508756] [DEBUG] [MAIN ] SPB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:11.508447] [DEBUG] [LOCAL ] SPE: Loaded 6149 existing records from primary storage. [2025-10-22T22:15:11.509669] [INFO ] [MAIN ] SPE: Loaded 6149 primary data records. [2025-10-22T22:15:11.509575] [INFO ] [MAIN ] SPB: Generated 1794 derivative records from 34013 primary records. [2025-10-22T22:15:11.554116] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-22T22:15:11.619246] [DEBUG] [LOCAL ] SPB: Derivative data saved (1794 records). [2025-10-22T22:15:11.630928] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-22T22:15:11.633504] [INFO ] [MAIN ] Derivative Progress: 1685/2052 symbols completed. SPB took 1.1s. Estimated remaining: 2m 18s. Rate: 159.3 symbols/min [2025-10-22T22:15:11.633738] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:11.853217] [DEBUG] [MAIN ] SPCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:11.854805] [INFO ] [MAIN ] SPCE: Generated 1794 derivative records from 50052 primary records. [2025-10-22T22:15:11.855109] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-22T22:15:11.884930] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1794 records). [2025-10-22T22:15:11.885141] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-22T22:15:11.888154] [INFO ] [MAIN ] Derivative Progress: 1686/2052 symbols completed. SPCE took 1.3s. Estimated remaining: 2m 18s. Rate: 159.3 symbols/min [2025-10-22T22:15:11.888385] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:11.905892] [DEBUG] [LOCAL ] SPG: Loaded 49934 existing records from primary storage. [2025-10-22T22:15:11.906230] [INFO ] [MAIN ] SPG: Loaded 49934 primary data records. [2025-10-22T22:15:12.109998] [DEBUG] [MAIN ] SPE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:12.115441] [INFO ] [MAIN ] SPE: Generated 1794 derivative records from 6149 primary records. [2025-10-22T22:15:12.115590] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-22T22:15:12.259914] [DEBUG] [LOCAL ] SPE: Derivative data saved (1794 records). [2025-10-22T22:15:12.261105] [DEBUG] [LOCAL ] SPGI: Loaded 45897 existing records from primary storage. [2025-10-22T22:15:12.261226] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-22T22:15:12.261422] [INFO ] [MAIN ] SPGI: Loaded 45897 primary data records. [2025-10-22T22:15:12.264511] [INFO ] [MAIN ] Derivative Progress: 1687/2052 symbols completed. SPE took 0.9s. Estimated remaining: 2m 17s. Rate: 159.3 symbols/min [2025-10-22T22:15:12.271043] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:12.609093] [DEBUG] [LOCAL ] SPH: Loaded 16482 existing records from primary storage. [2025-10-22T22:15:12.619145] [INFO ] [MAIN ] SPH: Loaded 16482 primary data records. [2025-10-22T22:15:12.776624] [DEBUG] [MAIN ] SPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:12.804703] [INFO ] [MAIN ] SPG: Generated 1794 derivative records from 49934 primary records. [2025-10-22T22:15:12.944582] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-22T22:15:12.971826] [DEBUG] [LOCAL ] SPG: Derivative data saved (1794 records). [2025-10-22T22:15:12.972313] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-10-22T22:15:12.974440] [INFO ] [MAIN ] Derivative Progress: 1688/2052 symbols completed. SPG took 1.3s. Estimated remaining: 2m 17s. Rate: 159.3 symbols/min [2025-10-22T22:15:12.974934] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:12.996065] [DEBUG] [MAIN ] SPGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:12.997024] [INFO ] [MAIN ] SPGI: Generated 1794 derivative records from 45897 primary records. [2025-10-22T22:15:12.997293] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-22T22:15:13.025286] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1794 records). [2025-10-22T22:15:13.025430] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-10-22T22:15:13.027883] [INFO ] [MAIN ] Derivative Progress: 1689/2052 symbols completed. SPGI took 1.1s. Estimated remaining: 2m 17s. Rate: 159.3 symbols/min [2025-10-22T22:15:13.028062] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:13.056575] [DEBUG] [MAIN ] SPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:13.056327] [DEBUG] [LOCAL ] SPHR: Loaded 40681 existing records from primary storage. [2025-10-22T22:15:13.056811] [INFO ] [MAIN ] SPHR: Loaded 40681 primary data records. [2025-10-22T22:15:13.057721] [INFO ] [MAIN ] SPH: Generated 1794 derivative records from 16482 primary records. [2025-10-22T22:15:13.069034] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-22T22:15:13.162928] [DEBUG] [LOCAL ] SPH: Derivative data saved (1794 records). [2025-10-22T22:15:13.177474] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-22T22:15:13.180018] [INFO ] [MAIN ] Derivative Progress: 1690/2052 symbols completed. SPH took 0.9s. Estimated remaining: 2m 16s. Rate: 159.4 symbols/min [2025-10-22T22:15:13.188200] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:13.393078] [DEBUG] [LOCAL ] SPIR: Loaded 37535 existing records from primary storage. [2025-10-22T22:15:13.407066] [DEBUG] [LOCAL ] SPMC: Loaded 5246 existing records from primary storage. [2025-10-22T22:15:13.407220] [INFO ] [MAIN ] SPMC: Loaded 5246 primary data records. [2025-10-22T22:15:13.407288] [INFO ] [MAIN ] SPIR: Loaded 37535 primary data records. [2025-10-22T22:15:14.025156] [DEBUG] [MAIN ] SPHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:14.026554] [INFO ] [MAIN ] SPHR: Generated 1794 derivative records from 40681 primary records. [2025-10-22T22:15:14.027095] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-22T22:15:14.045638] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1794 records). [2025-10-22T22:15:14.046116] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-10-22T22:15:14.048555] [INFO ] [MAIN ] Derivative Progress: 1691/2052 symbols completed. SPHR took 1.1s. Estimated remaining: 2m 16s. Rate: 159.3 symbols/min [2025-10-22T22:15:14.048960] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:14.084239] [DEBUG] [MAIN ] SPIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:14.094409] [DEBUG] [MAIN ] SPMC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:15:14.095286] [INFO ] [MAIN ] SPIR: Generated 1794 derivative records from 37535 primary records. [2025-10-22T22:15:14.096188] [INFO ] [MAIN ] SPMC: Generated 1793 derivative records from 5246 primary records. [2025-10-22T22:15:14.096456] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-22T22:15:14.096302] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-22T22:15:14.120596] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1793 records). [2025-10-22T22:15:14.127958] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1794 records). [2025-10-22T22:15:14.136734] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-22T22:15:14.140435] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-22T22:15:14.140349] [INFO ] [MAIN ] Derivative Progress: 1692/2052 symbols completed. SPMC took 1.0s. Estimated remaining: 2m 16s. Rate: 159.3 symbols/min [2025-10-22T22:15:14.140685] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:14.141746] [DEBUG] [LOCAL ] SPNT: Loaded 34220 existing records from primary storage. [2025-10-22T22:15:14.144366] [INFO ] [MAIN ] Derivative Progress: 1693/2052 symbols completed. SPIR took 1.1s. Estimated remaining: 2m 15s. Rate: 159.4 symbols/min [2025-10-22T22:15:14.144715] [INFO ] [MAIN ] SPNT: Loaded 34220 primary data records. [2025-10-22T22:15:14.454599] [DEBUG] [LOCAL ] SPR: Loaded 40712 existing records from primary storage. [2025-10-22T22:15:14.454792] [INFO ] [MAIN ] SPR: Loaded 40712 primary data records. [2025-10-22T22:15:14.807363] [DEBUG] [MAIN ] SPNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:14.808376] [INFO ] [MAIN ] SPNT: Generated 1794 derivative records from 34220 primary records. [2025-10-22T22:15:14.808494] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-22T22:15:14.826315] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1794 records). [2025-10-22T22:15:14.826715] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-10-22T22:15:14.829075] [INFO ] [MAIN ] Derivative Progress: 1694/2052 symbols completed. SPNT took 0.8s. Estimated remaining: 2m 15s. Rate: 159.4 symbols/min [2025-10-22T22:15:14.845368] [DEBUG] [MAIN ] SPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:14.846053] [INFO ] [MAIN ] SPR: Generated 1794 derivative records from 40712 primary records. [2025-10-22T22:15:14.846113] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-22T22:15:14.861106] [DEBUG] [LOCAL ] SPR: Derivative data saved (1794 records). [2025-10-22T22:15:14.861171] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-10-22T22:15:14.863516] [INFO ] [MAIN ] Derivative Progress: 1695/2052 symbols completed. SPR took 0.7s. Estimated remaining: 2m 14s. Rate: 159.4 symbols/min [2025-10-22T22:15:14.863944] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:14.864466] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:14.864049] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:14.878360] [DEBUG] [LOCAL ] SPRU: Loaded 9997 existing records from primary storage. [2025-10-22T22:15:14.878689] [INFO ] [MAIN ] SPRU: Loaded 9997 primary data records. [2025-10-22T22:15:14.882579] [DEBUG] [LOCAL ] SPXX: Loaded 9114 existing records from primary storage. [2025-10-22T22:15:14.900440] [INFO ] [MAIN ] SPXX: Loaded 9114 primary data records. [2025-10-22T22:15:15.038619] [DEBUG] [LOCAL ] SPXC: Loaded 23163 existing records from primary storage. [2025-10-22T22:15:15.059748] [INFO ] [MAIN ] SPXC: Loaded 23163 primary data records. [2025-10-22T22:15:15.883598] [DEBUG] [MAIN ] SPXX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:15.884999] [INFO ] [MAIN ] SPXX: Generated 1794 derivative records from 9114 primary records. [2025-10-22T22:15:15.885207] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-22T22:15:15.884258] [DEBUG] [MAIN ] SPRU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:15.886455] [INFO ] [MAIN ] SPRU: Generated 1794 derivative records from 9997 primary records. [2025-10-22T22:15:15.886951] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-10-22T22:15:15.915753] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1794 records). [2025-10-22T22:15:15.918778] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-22T22:15:15.918630] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1794 records). [2025-10-22T22:15:15.921336] [INFO ] [MAIN ] Derivative Progress: 1696/2052 symbols completed. SPXX took 1.1s. Estimated remaining: 2m 14s. Rate: 159.3 symbols/min [2025-10-22T22:15:15.922314] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-10-22T22:15:15.923072] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:15.925506] [INFO ] [MAIN ] Derivative Progress: 1697/2052 symbols completed. SPRU took 1.1s. Estimated remaining: 2m 14s. Rate: 159.4 symbols/min [2025-10-22T22:15:15.925870] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:15.939845] [DEBUG] [MAIN ] SPXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:15.940619] [INFO ] [MAIN ] SPXC: Generated 1794 derivative records from 23163 primary records. [2025-10-22T22:15:15.940818] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-10-22T22:15:15.957129] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1794 records). [2025-10-22T22:15:15.957480] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-10-22T22:15:15.960145] [INFO ] [MAIN ] Derivative Progress: 1698/2052 symbols completed. SPXC took 1.1s. Estimated remaining: 2m 13s. Rate: 159.4 symbols/min [2025-10-22T22:15:15.968143] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:15.987243] [DEBUG] [LOCAL ] SQNS: Loaded 28139 existing records from primary storage. [2025-10-22T22:15:15.987538] [INFO ] [MAIN ] SQNS: Loaded 28139 primary data records. [2025-10-22T22:15:16.040532] [DEBUG] [LOCAL ] SR: Loaded 32257 existing records from primary storage. [2025-10-22T22:15:16.069394] [INFO ] [MAIN ] SR: Loaded 32257 primary data records. [2025-10-22T22:15:16.541418] [DEBUG] [LOCAL ] SRE: Loaded 53408 existing records from primary storage. [2025-10-22T22:15:16.545429] [INFO ] [MAIN ] SRE: Loaded 53408 primary data records. [2025-10-22T22:15:17.026168] [DEBUG] [MAIN ] SQNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:17.027790] [INFO ] [MAIN ] SQNS: Generated 1794 derivative records from 28139 primary records. [2025-10-22T22:15:17.028291] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-22T22:15:17.048287] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1794 records). [2025-10-22T22:15:17.052155] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-22T22:15:17.055004] [INFO ] [MAIN ] Derivative Progress: 1699/2052 symbols completed. SQNS took 1.1s. Estimated remaining: 2m 13s. Rate: 159.3 symbols/min [2025-10-22T22:15:17.055149] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:17.069773] [DEBUG] [MAIN ] SR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:17.070916] [INFO ] [MAIN ] SR: Generated 1794 derivative records from 32257 primary records. [2025-10-22T22:15:17.071284] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-22T22:15:17.091952] [DEBUG] [LOCAL ] SR: Derivative data saved (1794 records). [2025-10-22T22:15:17.092287] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-10-22T22:15:17.102929] [DEBUG] [LOCAL ] SREA: Loaded 9661 existing records from primary storage. [2025-10-22T22:15:17.098720] [INFO ] [MAIN ] Derivative Progress: 1700/2052 symbols completed. SR took 1.2s. Estimated remaining: 2m 13s. Rate: 159.3 symbols/min [2025-10-22T22:15:17.103302] [INFO ] [MAIN ] SREA: Loaded 9661 primary data records. [2025-10-22T22:15:17.103396] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:17.167582] [DEBUG] [MAIN ] SRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:17.196486] [INFO ] [MAIN ] SRE: Generated 1794 derivative records from 53408 primary records. [2025-10-22T22:15:17.219143] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-22T22:15:17.326449] [DEBUG] [LOCAL ] SRFM: Loaded 40036 existing records from primary storage. [2025-10-22T22:15:17.330513] [INFO ] [MAIN ] SRFM: Loaded 40036 primary data records. [2025-10-22T22:15:17.348685] [DEBUG] [LOCAL ] SRE: Derivative data saved (1794 records). [2025-10-22T22:15:17.348888] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-10-22T22:15:17.482045] [INFO ] [MAIN ] Derivative Progress: 1701/2052 symbols completed. SRE took 1.5s. Estimated remaining: 2m 12s. Rate: 159.3 symbols/min [2025-10-22T22:15:17.510756] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:17.805938] [DEBUG] [LOCAL ] SRG: Loaded 14642 existing records from primary storage. [2025-10-22T22:15:17.818028] [INFO ] [MAIN ] SRG: Loaded 14642 primary data records. [2025-10-22T22:15:18.163178] [DEBUG] [MAIN ] SREA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:18.165140] [INFO ] [MAIN ] SREA: Generated 1794 derivative records from 9661 primary records. [2025-10-22T22:15:18.165732] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-22T22:15:18.185507] [DEBUG] [LOCAL ] SREA: Derivative data saved (1794 records). [2025-10-22T22:15:18.185690] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-22T22:15:18.187917] [INFO ] [MAIN ] Derivative Progress: 1702/2052 symbols completed. SREA took 1.1s. Estimated remaining: 2m 12s. Rate: 159.3 symbols/min [2025-10-22T22:15:18.202357] [DEBUG] [MAIN ] SRFM: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:15:18.188151] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:18.203584] [INFO ] [MAIN ] SRFM: Generated 1793 derivative records from 40036 primary records. [2025-10-22T22:15:18.203830] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-22T22:15:18.220060] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1793 records). [2025-10-22T22:15:18.220268] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-22T22:15:18.222704] [INFO ] [MAIN ] Derivative Progress: 1703/2052 symbols completed. SRFM took 1.1s. Estimated remaining: 2m 11s. Rate: 159.4 symbols/min [2025-10-22T22:15:18.223029] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:18.255591] [DEBUG] [LOCAL ] SRV: Loaded 7379 existing records from primary storage. [2025-10-22T22:15:18.257394] [INFO ] [MAIN ] SRV: Loaded 7379 primary data records. [2025-10-22T22:15:18.257283] [DEBUG] [MAIN ] SRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:18.269612] [INFO ] [MAIN ] SRG: Generated 1794 derivative records from 14642 primary records. [2025-10-22T22:15:18.279107] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-22T22:15:18.335195] [DEBUG] [LOCAL ] SRI: Loaded 26227 existing records from primary storage. [2025-10-22T22:15:18.365262] [INFO ] [MAIN ] SRI: Loaded 26227 primary data records. [2025-10-22T22:15:18.519981] [DEBUG] [LOCAL ] SRG: Derivative data saved (1794 records). [2025-10-22T22:15:18.702264] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-22T22:15:18.731164] [INFO ] [MAIN ] Derivative Progress: 1704/2052 symbols completed. SRG took 1.2s. Estimated remaining: 2m 11s. Rate: 159.3 symbols/min [2025-10-22T22:15:18.731978] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:18.963010] [DEBUG] [MAIN ] SRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:18.963929] [INFO ] [MAIN ] SRV: Generated 1794 derivative records from 7379 primary records. [2025-10-22T22:15:18.964135] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-22T22:15:18.982149] [DEBUG] [LOCAL ] SRV: Derivative data saved (1794 records). [2025-10-22T22:15:18.982553] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-22T22:15:18.995331] [INFO ] [MAIN ] Derivative Progress: 1705/2052 symbols completed. SRV took 0.8s. Estimated remaining: 2m 11s. Rate: 159.3 symbols/min [2025-10-22T22:15:19.010059] [DEBUG] [LOCAL ] SSB: Loaded 42715 existing records from primary storage. [2025-10-22T22:15:19.010299] [INFO ] [MAIN ] SSB: Loaded 42715 primary data records. [2025-10-22T22:15:19.010798] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:19.010593] [DEBUG] [MAIN ] SRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:19.016886] [INFO ] [MAIN ] SRI: Generated 1794 derivative records from 26227 primary records. [2025-10-22T22:15:19.017240] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-22T22:15:19.154889] [DEBUG] [LOCAL ] SRI: Derivative data saved (1794 records). [2025-10-22T22:15:19.187623] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-22T22:15:19.328042] [DEBUG] [LOCAL ] SSD: Loaded 22377 existing records from primary storage. [2025-10-22T22:15:19.335622] [INFO ] [MAIN ] Derivative Progress: 1706/2052 symbols completed. SRI took 1.1s. Estimated remaining: 2m 10s. Rate: 159.4 symbols/min [2025-10-22T22:15:19.344528] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:19.344726] [INFO ] [MAIN ] SSD: Loaded 22377 primary data records. [2025-10-22T22:15:19.679470] [DEBUG] [LOCAL ] SSL: Loaded 41386 existing records from primary storage. [2025-10-22T22:15:19.681106] [INFO ] [MAIN ] SSL: Loaded 41386 primary data records. [2025-10-22T22:15:19.811179] [DEBUG] [MAIN ] SSB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:19.853705] [INFO ] [MAIN ] SSB: Generated 1794 derivative records from 42715 primary records. [2025-10-22T22:15:19.982637] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-22T22:15:20.021256] [DEBUG] [LOCAL ] SSB: Derivative data saved (1794 records). [2025-10-22T22:15:20.021562] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-10-22T22:15:20.023902] [INFO ] [MAIN ] Derivative Progress: 1707/2052 symbols completed. SSB took 1.3s. Estimated remaining: 2m 10s. Rate: 159.3 symbols/min [2025-10-22T22:15:20.024286] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:20.038320] [DEBUG] [MAIN ] SSD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:15:20.039724] [INFO ] [MAIN ] SSD: Generated 1793 derivative records from 22377 primary records. [2025-10-22T22:15:20.041101] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-10-22T22:15:20.064319] [DEBUG] [LOCAL ] SSD: Derivative data saved (1793 records). [2025-10-22T22:15:20.071735] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-10-22T22:15:20.073021] [DEBUG] [LOCAL ] SST: Loaded 11382 existing records from primary storage. [2025-10-22T22:15:20.077057] [INFO ] [MAIN ] Derivative Progress: 1708/2052 symbols completed. SSD took 1.1s. Estimated remaining: 2m 10s. Rate: 159.4 symbols/min [2025-10-22T22:15:20.077457] [INFO ] [MAIN ] SST: Loaded 11382 primary data records. [2025-10-22T22:15:20.212713] [DEBUG] [MAIN ] SSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:20.238732] [INFO ] [MAIN ] SSL: Generated 1794 derivative records from 41386 primary records. [2025-10-22T22:15:20.261776] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-22T22:15:20.394422] [DEBUG] [LOCAL ] SSL: Derivative data saved (1794 records). [2025-10-22T22:15:20.395181] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-22T22:15:20.397932] [INFO ] [MAIN ] Derivative Progress: 1709/2052 symbols completed. SSL took 1.1s. Estimated remaining: 2m 9s. Rate: 159.4 symbols/min [2025-10-22T22:15:20.418322] [DEBUG] [MAIN ] SST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:20.418945] [INFO ] [MAIN ] SST: Generated 1794 derivative records from 11382 primary records. [2025-10-22T22:15:20.419007] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-22T22:15:20.433048] [DEBUG] [LOCAL ] SST: Derivative data saved (1794 records). [2025-10-22T22:15:20.433107] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-10-22T22:15:20.435305] [INFO ] [MAIN ] Derivative Progress: 1710/2052 symbols completed. SST took 0.4s. Estimated remaining: 2m 9s. Rate: 159.5 symbols/min [2025-10-22T22:15:20.436108] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:20.436051] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:20.436252] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:20.465203] [DEBUG] [LOCAL ] SSTK: Loaded 25244 existing records from primary storage. [2025-10-22T22:15:20.465395] [INFO ] [MAIN ] SSTK: Loaded 25244 primary data records. [2025-10-22T22:15:20.620562] [DEBUG] [LOCAL ] ST: Loaded 49668 existing records from primary storage. [2025-10-22T22:15:20.631195] [INFO ] [MAIN ] ST: Loaded 49668 primary data records. [2025-10-22T22:15:20.787541] [DEBUG] [LOCAL ] STAG: Loaded 50046 existing records from primary storage. [2025-10-22T22:15:20.956324] [INFO ] [MAIN ] STAG: Loaded 50046 primary data records. [2025-10-22T22:15:21.504199] [DEBUG] [MAIN ] SSTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:21.506258] [INFO ] [MAIN ] SSTK: Generated 1794 derivative records from 25244 primary records. [2025-10-22T22:15:21.506796] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-22T22:15:21.525268] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1794 records). [2025-10-22T22:15:21.525468] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-10-22T22:15:21.528475] [INFO ] [MAIN ] Derivative Progress: 1711/2052 symbols completed. SSTK took 1.1s. Estimated remaining: 2m 8s. Rate: 159.3 symbols/min [2025-10-22T22:15:21.529035] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:21.550124] [DEBUG] [MAIN ] ST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:21.557388] [INFO ] [MAIN ] ST: Generated 1794 derivative records from 49668 primary records. [2025-10-22T22:15:21.557604] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-22T22:15:21.590029] [DEBUG] [LOCAL ] STC: Loaded 17391 existing records from primary storage. [2025-10-22T22:15:21.591758] [INFO ] [MAIN ] STC: Loaded 17391 primary data records. [2025-10-22T22:15:21.592158] [DEBUG] [MAIN ] STAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:21.593051] [DEBUG] [LOCAL ] ST: Derivative data saved (1794 records). [2025-10-22T22:15:21.600710] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-10-22T22:15:21.608471] [INFO ] [MAIN ] STAG: Generated 1794 derivative records from 50046 primary records. [2025-10-22T22:15:21.618060] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-22T22:15:21.636082] [INFO ] [MAIN ] Derivative Progress: 1712/2052 symbols completed. ST took 1.2s. Estimated remaining: 2m 8s. Rate: 159.3 symbols/min [2025-10-22T22:15:21.642854] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:21.718279] [DEBUG] [LOCAL ] STAG: Derivative data saved (1794 records). [2025-10-22T22:15:21.734759] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-10-22T22:15:21.774259] [INFO ] [MAIN ] Derivative Progress: 1713/2052 symbols completed. STAG took 1.3s. Estimated remaining: 2m 8s. Rate: 159.4 symbols/min [2025-10-22T22:15:21.909542] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:21.927731] [DEBUG] [LOCAL ] STEL: Loaded 22328 existing records from primary storage. [2025-10-22T22:15:21.928027] [INFO ] [MAIN ] STEL: Loaded 22328 primary data records. [2025-10-22T22:15:22.261883] [DEBUG] [LOCAL ] STEM: Loaded 38406 existing records from primary storage. [2025-10-22T22:15:22.262236] [INFO ] [MAIN ] STEM: Loaded 38406 primary data records. [2025-10-22T22:15:22.429148] [DEBUG] [MAIN ] STC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:22.458741] [INFO ] [MAIN ] STC: Generated 1794 derivative records from 17391 primary records. [2025-10-22T22:15:22.459184] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-22T22:15:22.640220] [DEBUG] [LOCAL ] STC: Derivative data saved (1794 records). [2025-10-22T22:15:22.640661] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-10-22T22:15:22.643162] [INFO ] [MAIN ] Derivative Progress: 1714/2052 symbols completed. STC took 1.1s. Estimated remaining: 2m 7s. Rate: 159.3 symbols/min [2025-10-22T22:15:22.645699] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:22.660805] [DEBUG] [MAIN ] STEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:22.661709] [INFO ] [MAIN ] STEL: Generated 1794 derivative records from 22328 primary records. [2025-10-22T22:15:22.661903] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-22T22:15:22.684664] [DEBUG] [LOCAL ] STEL: Derivative data saved (1794 records). [2025-10-22T22:15:22.684951] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-10-22T22:15:22.687736] [INFO ] [MAIN ] Derivative Progress: 1715/2052 symbols completed. STEL took 1.0s. Estimated remaining: 2m 7s. Rate: 159.4 symbols/min [2025-10-22T22:15:22.693972] [DEBUG] [LOCAL ] STEW: Loaded 15067 existing records from primary storage. [2025-10-22T22:15:22.693521] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:22.694097] [INFO ] [MAIN ] STEW: Loaded 15067 primary data records. [2025-10-22T22:15:22.832982] [DEBUG] [LOCAL ] STK: Loaded 9700 existing records from primary storage. [2025-10-22T22:15:22.842969] [INFO ] [MAIN ] STK: Loaded 9700 primary data records. [2025-10-22T22:15:22.848379] [DEBUG] [MAIN ] STEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:22.863607] [INFO ] [MAIN ] STEM: Generated 1794 derivative records from 38406 primary records. [2025-10-22T22:15:23.085490] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-22T22:15:23.164028] [DEBUG] [LOCAL ] STEM: Derivative data saved (1794 records). [2025-10-22T22:15:23.218155] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-22T22:15:23.327669] [INFO ] [MAIN ] Derivative Progress: 1716/2052 symbols completed. STEM took 1.4s. Estimated remaining: 2m 7s. Rate: 159.3 symbols/min [2025-10-22T22:15:23.342441] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:23.367132] [DEBUG] [MAIN ] STEW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:23.367908] [INFO ] [MAIN ] STEW: Generated 1794 derivative records from 15067 primary records. [2025-10-22T22:15:23.368126] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-22T22:15:23.384389] [DEBUG] [LOCAL ] STEW: Derivative data saved (1794 records). [2025-10-22T22:15:23.384594] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-22T22:15:23.387068] [INFO ] [MAIN ] Derivative Progress: 1717/2052 symbols completed. STEW took 0.7s. Estimated remaining: 2m 6s. Rate: 159.4 symbols/min [2025-10-22T22:15:23.400218] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:23.418136] [DEBUG] [MAIN ] STK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:23.419710] [INFO ] [MAIN ] STK: Generated 1794 derivative records from 9700 primary records. [2025-10-22T22:15:23.419949] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-22T22:15:23.444182] [DEBUG] [LOCAL ] STLA: Loaded 53557 existing records from primary storage. [2025-10-22T22:15:23.450820] [INFO ] [MAIN ] STLA: Loaded 53557 primary data records. [2025-10-22T22:15:23.451933] [DEBUG] [LOCAL ] STK: Derivative data saved (1794 records). [2025-10-22T22:15:23.483763] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-22T22:15:23.510015] [INFO ] [MAIN ] Derivative Progress: 1718/2052 symbols completed. STK took 0.8s. Estimated remaining: 2m 6s. Rate: 159.4 symbols/min [2025-10-22T22:15:23.531301] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:23.785908] [DEBUG] [LOCAL ] STM: Loaded 53573 existing records from primary storage. [2025-10-22T22:15:23.793189] [INFO ] [MAIN ] STM: Loaded 53573 primary data records. [2025-10-22T22:15:23.793704] [DEBUG] [LOCAL ] STN: Loaded 22576 existing records from primary storage. [2025-10-22T22:15:23.805810] [INFO ] [MAIN ] STN: Loaded 22576 primary data records. [2025-10-22T22:15:24.469837] [DEBUG] [MAIN ] STLA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:24.471260] [INFO ] [MAIN ] STLA: Generated 1794 derivative records from 53557 primary records. [2025-10-22T22:15:24.471528] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-22T22:15:24.498278] [DEBUG] [LOCAL ] STLA: Derivative data saved (1794 records). [2025-10-22T22:15:24.500189] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-22T22:15:24.503137] [INFO ] [MAIN ] Derivative Progress: 1719/2052 symbols completed. STLA took 1.2s. Estimated remaining: 2m 5s. Rate: 159.3 symbols/min [2025-10-22T22:15:24.503607] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:24.517048] [DEBUG] [MAIN ] STN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:24.517865] [INFO ] [MAIN ] STN: Generated 1794 derivative records from 22576 primary records. [2025-10-22T22:15:24.518095] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-22T22:15:24.545619] [DEBUG] [LOCAL ] STN: Derivative data saved (1794 records). [2025-10-22T22:15:24.551213] [DEBUG] [MAIN ] STM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:24.551898] [INFO ] [MAIN ] STM: Generated 1794 derivative records from 53573 primary records. [2025-10-22T22:15:24.552010] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-22T22:15:24.560722] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-22T22:15:24.563141] [INFO ] [MAIN ] Derivative Progress: 1720/2052 symbols completed. STN took 1.0s. Estimated remaining: 2m 5s. Rate: 159.4 symbols/min [2025-10-22T22:15:24.563354] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:24.581850] [DEBUG] [LOCAL ] STM: Derivative data saved (1794 records). [2025-10-22T22:15:24.582097] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-22T22:15:24.584670] [INFO ] [MAIN ] Derivative Progress: 1721/2052 symbols completed. STM took 1.2s. Estimated remaining: 2m 5s. Rate: 159.5 symbols/min [2025-10-22T22:15:24.584923] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:24.607516] [DEBUG] [LOCAL ] STRV: Loaded 10686 existing records from primary storage. [2025-10-22T22:15:24.607819] [INFO ] [MAIN ] STRV: Loaded 10686 primary data records. [2025-10-22T22:15:24.608460] [DEBUG] [LOCAL ] STNG: Loaded 43272 existing records from primary storage. [2025-10-22T22:15:24.629216] [INFO ] [MAIN ] STNG: Loaded 43272 primary data records. [2025-10-22T22:15:25.312569] [DEBUG] [LOCAL ] STVN: Loaded 26683 existing records from primary storage. [2025-10-22T22:15:25.329299] [INFO ] [MAIN ] STVN: Loaded 26683 primary data records. [2025-10-22T22:15:25.859847] [DEBUG] [MAIN ] STRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:25.868021] [INFO ] [MAIN ] STRV: Generated 1794 derivative records from 10686 primary records. [2025-10-22T22:15:25.870048] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-22T22:15:25.870747] [DEBUG] [MAIN ] STNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:25.872728] [INFO ] [MAIN ] STNG: Generated 1794 derivative records from 43272 primary records. [2025-10-22T22:15:25.873308] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-22T22:15:25.891944] [DEBUG] [LOCAL ] STRV: Derivative data saved (1794 records). [2025-10-22T22:15:25.914191] [DEBUG] [LOCAL ] STNG: Derivative data saved (1794 records). [2025-10-22T22:15:25.914418] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-22T22:15:25.916584] [INFO ] [MAIN ] Derivative Progress: 1722/2052 symbols completed. STNG took 1.4s. Estimated remaining: 2m 4s. Rate: 159.2 symbols/min [2025-10-22T22:15:25.912569] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-22T22:15:25.916986] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:25.920811] [INFO ] [MAIN ] Derivative Progress: 1723/2052 symbols completed. STRV took 1.4s. Estimated remaining: 2m 4s. Rate: 159.3 symbols/min [2025-10-22T22:15:25.947152] [DEBUG] [MAIN ] STVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:25.947989] [INFO ] [MAIN ] STVN: Generated 1794 derivative records from 26683 primary records. [2025-10-22T22:15:25.948058] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-22T22:15:25.986553] [DEBUG] [LOCAL ] STVN: Derivative data saved (1794 records). [2025-10-22T22:15:25.986849] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-22T22:15:25.990454] [INFO ] [MAIN ] Derivative Progress: 1724/2052 symbols completed. STVN took 1.4s. Estimated remaining: 2m 3s. Rate: 159.4 symbols/min [2025-10-22T22:15:26.010600] [DEBUG] [LOCAL ] STWD: Loaded 51960 existing records from primary storage. [2025-10-22T22:15:26.010782] [INFO ] [MAIN ] STWD: Loaded 51960 primary data records. [2025-10-22T22:15:26.343799] [DEBUG] [MAIN ] STWD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:26.344411] [INFO ] [MAIN ] STWD: Generated 1794 derivative records from 51960 primary records. [2025-10-22T22:15:26.344471] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-22T22:15:26.359823] [DEBUG] [LOCAL ] STWD: Derivative data saved (1794 records). [2025-10-22T22:15:26.359889] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-10-22T22:15:26.361904] [INFO ] [MAIN ] Derivative Progress: 1725/2052 symbols completed. STWD took 0.4s. Estimated remaining: 2m 3s. Rate: 159.4 symbols/min [2025-10-22T22:15:26.362274] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:26.362557] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:26.362405] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:26.370239] [DEBUG] [LOCAL ] STXE: Loaded 2051 existing records from primary storage. [2025-10-22T22:15:26.370577] [DEBUG] [LOCAL ] STXD: Loaded 1337 existing records from primary storage. [2025-10-22T22:15:26.372357] [DEBUG] [LOCAL ] STXG: Loaded 2290 existing records from primary storage. [2025-10-22T22:15:26.372622] [INFO ] [MAIN ] STXD: Loaded 1337 primary data records. [2025-10-22T22:15:26.372557] [INFO ] [MAIN ] STXG: Loaded 2290 primary data records. [2025-10-22T22:15:26.372783] [INFO ] [MAIN ] STXE: Loaded 2051 primary data records. [2025-10-22T22:15:27.366921] [DEBUG] [MAIN ] STXE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:15:27.380400] [DEBUG] [MAIN ] STXG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:15:27.381416] [INFO ] [MAIN ] STXE: Generated 1793 derivative records from 2051 primary records. [2025-10-22T22:15:27.382424] [INFO ] [MAIN ] STXG: Generated 1793 derivative records from 2290 primary records. [2025-10-22T22:15:27.382588] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-22T22:15:27.382717] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-22T22:15:27.403061] [DEBUG] [MAIN ] STXD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:15:27.409458] [INFO ] [MAIN ] STXD: Generated 1793 derivative records from 1337 primary records. [2025-10-22T22:15:27.409588] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-22T22:15:27.426904] [DEBUG] [LOCAL ] STXG: Derivative data saved (1793 records). [2025-10-22T22:15:27.433851] [DEBUG] [LOCAL ] STXE: Derivative data saved (1793 records). [2025-10-22T22:15:27.437734] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-22T22:15:27.437614] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-22T22:15:27.440512] [INFO ] [MAIN ] Derivative Progress: 1726/2052 symbols completed. STXE took 1.1s. Estimated remaining: 2m 3s. Rate: 159.2 symbols/min [2025-10-22T22:15:27.445231] [DEBUG] [LOCAL ] STXD: Derivative data saved (1793 records). [2025-10-22T22:15:27.445460] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:27.445772] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-22T22:15:27.445836] [INFO ] [MAIN ] Derivative Progress: 1727/2052 symbols completed. STXG took 1.1s. Estimated remaining: 2m 2s. Rate: 159.3 symbols/min [2025-10-22T22:15:27.446311] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:27.448743] [INFO ] [MAIN ] Derivative Progress: 1728/2052 symbols completed. STXD took 1.1s. Estimated remaining: 2m 2s. Rate: 159.4 symbols/min [2025-10-22T22:15:27.449563] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:27.453598] [DEBUG] [LOCAL ] STXK: Loaded 1477 existing records from primary storage. [2025-10-22T22:15:27.456549] [DEBUG] [LOCAL ] STXV: Loaded 1462 existing records from primary storage. [2025-10-22T22:15:27.454530] [INFO ] [MAIN ] STXK: Loaded 1477 primary data records. [2025-10-22T22:15:27.456840] [INFO ] [MAIN ] STXV: Loaded 1462 primary data records. [2025-10-22T22:15:27.469739] [DEBUG] [LOCAL ] STXT: Loaded 2509 existing records from primary storage. [2025-10-22T22:15:27.494172] [INFO ] [MAIN ] STXT: Loaded 2509 primary data records. [2025-10-22T22:15:28.443926] [DEBUG] [MAIN ] STXK: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:15:28.452334] [INFO ] [MAIN ] STXK: Generated 1793 derivative records from 1477 primary records. [2025-10-22T22:15:28.459890] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-22T22:15:28.459752] [DEBUG] [MAIN ] STXV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:15:28.461317] [INFO ] [MAIN ] STXV: Generated 1793 derivative records from 1462 primary records. [2025-10-22T22:15:28.461488] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-22T22:15:28.489541] [DEBUG] [MAIN ] STXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:28.496734] [DEBUG] [LOCAL ] STXK: Derivative data saved (1793 records). [2025-10-22T22:15:28.497746] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-10-22T22:15:28.498383] [INFO ] [MAIN ] STXT: Generated 1794 derivative records from 2509 primary records. [2025-10-22T22:15:28.501025] [DEBUG] [LOCAL ] STXV: Derivative data saved (1793 records). [2025-10-22T22:15:28.503531] [INFO ] [MAIN ] Derivative Progress: 1729/2052 symbols completed. STXK took 1.1s. Estimated remaining: 2m 2s. Rate: 159.2 symbols/min [2025-10-22T22:15:28.503627] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-22T22:15:28.503757] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-10-22T22:15:28.503877] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:28.506037] [INFO ] [MAIN ] Derivative Progress: 1730/2052 symbols completed. STXV took 1.1s. Estimated remaining: 2m 1s. Rate: 159.3 symbols/min [2025-10-22T22:15:28.507254] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:28.521462] [DEBUG] [LOCAL ] STXT: Derivative data saved (1794 records). [2025-10-22T22:15:28.521582] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-22T22:15:28.524088] [INFO ] [MAIN ] Derivative Progress: 1731/2052 symbols completed. STXT took 1.1s. Estimated remaining: 2m 1s. Rate: 159.4 symbols/min [2025-10-22T22:15:28.524266] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:28.607498] [DEBUG] [LOCAL ] SUI: Loaded 41833 existing records from primary storage. [2025-10-22T22:15:28.608122] [INFO ] [MAIN ] SUI: Loaded 41833 primary data records. [2025-10-22T22:15:28.606397] [DEBUG] [LOCAL ] SU: Loaded 53430 existing records from primary storage. [2025-10-22T22:15:28.608033] [DEBUG] [LOCAL ] SUN: Loaded 38757 existing records from primary storage. [2025-10-22T22:15:28.628784] [INFO ] [MAIN ] SU: Loaded 53430 primary data records. [2025-10-22T22:15:28.628854] [INFO ] [MAIN ] SUN: Loaded 38757 primary data records. [2025-10-22T22:15:29.536328] [DEBUG] [MAIN ] SUI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:29.539389] [INFO ] [MAIN ] SUI: Generated 1794 derivative records from 41833 primary records. [2025-10-22T22:15:29.539606] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-22T22:15:29.559968] [DEBUG] [MAIN ] SUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:29.575932] [INFO ] [MAIN ] SUN: Generated 1794 derivative records from 38757 primary records. [2025-10-22T22:15:29.579236] [DEBUG] [MAIN ] SU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:29.576527] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-22T22:15:29.580678] [INFO ] [MAIN ] SU: Generated 1794 derivative records from 53430 primary records. [2025-10-22T22:15:29.581467] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-22T22:15:29.583507] [DEBUG] [LOCAL ] SUI: Derivative data saved (1794 records). [2025-10-22T22:15:29.583965] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-22T22:15:29.600983] [INFO ] [MAIN ] Derivative Progress: 1732/2052 symbols completed. SUI took 1.1s. Estimated remaining: 2m 1s. Rate: 159.2 symbols/min [2025-10-22T22:15:29.606992] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:29.611738] [DEBUG] [LOCAL ] SU: Derivative data saved (1794 records). [2025-10-22T22:15:29.614888] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-22T22:15:29.619231] [INFO ] [MAIN ] Derivative Progress: 1733/2052 symbols completed. SU took 1.1s. Estimated remaining: 2m 0s. Rate: 159.3 symbols/min [2025-10-22T22:15:29.619462] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:29.616434] [DEBUG] [LOCAL ] SUN: Derivative data saved (1794 records). [2025-10-22T22:15:29.620094] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-22T22:15:29.622377] [INFO ] [MAIN ] Derivative Progress: 1734/2052 symbols completed. SUN took 1.1s. Estimated remaining: 1m 60s. Rate: 159.4 symbols/min [2025-10-22T22:15:29.622685] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:29.680021] [DEBUG] [LOCAL ] SUPV: Loaded 48048 existing records from primary storage. [2025-10-22T22:15:29.680209] [INFO ] [MAIN ] SUPV: Loaded 48048 primary data records. [2025-10-22T22:15:29.795071] [DEBUG] [LOCAL ] SUZ: Loaded 45524 existing records from primary storage. [2025-10-22T22:15:29.795305] [INFO ] [MAIN ] SUZ: Loaded 45524 primary data records. [2025-10-22T22:15:29.849805] [DEBUG] [LOCAL ] SVV: Loaded 40253 existing records from primary storage. [2025-10-22T22:15:29.965734] [INFO ] [MAIN ] SVV: Loaded 40253 primary data records. [2025-10-22T22:15:30.660486] [DEBUG] [MAIN ] SUPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:30.673196] [INFO ] [MAIN ] SUPV: Generated 1794 derivative records from 48048 primary records. [2025-10-22T22:15:30.673392] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-22T22:15:30.674009] [DEBUG] [MAIN ] SUZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:30.674613] [INFO ] [MAIN ] SUZ: Generated 1794 derivative records from 45524 primary records. [2025-10-22T22:15:30.675713] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-22T22:15:30.691006] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1794 records). [2025-10-22T22:15:30.698469] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-22T22:15:30.707117] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1794 records). [2025-10-22T22:15:30.707228] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-22T22:15:30.708994] [INFO ] [MAIN ] Derivative Progress: 1735/2052 symbols completed. SUPV took 1.1s. Estimated remaining: 1m 59s. Rate: 159.2 symbols/min [2025-10-22T22:15:30.709141] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:30.712471] [INFO ] [MAIN ] Derivative Progress: 1736/2052 symbols completed. SUZ took 1.1s. Estimated remaining: 1m 59s. Rate: 159.3 symbols/min [2025-10-22T22:15:30.713026] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:30.726460] [DEBUG] [MAIN ] SVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:30.727174] [INFO ] [MAIN ] SVV: Generated 1794 derivative records from 40253 primary records. [2025-10-22T22:15:30.727312] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-22T22:15:30.743968] [DEBUG] [LOCAL ] SVV: Derivative data saved (1794 records). [2025-10-22T22:15:30.744223] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-22T22:15:30.747844] [INFO ] [MAIN ] Derivative Progress: 1737/2052 symbols completed. SVV took 1.1s. Estimated remaining: 1m 59s. Rate: 159.4 symbols/min [2025-10-22T22:15:30.748528] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:30.831016] [DEBUG] [LOCAL ] SW: Loaded 53179 existing records from primary storage. [2025-10-22T22:15:30.829553] [DEBUG] [LOCAL ] SWK: Loaded 52397 existing records from primary storage. [2025-10-22T22:15:30.831200] [INFO ] [MAIN ] SW: Loaded 53179 primary data records. [2025-10-22T22:15:30.831306] [INFO ] [MAIN ] SWK: Loaded 52397 primary data records. [2025-10-22T22:15:30.843433] [DEBUG] [LOCAL ] SWX: Loaded 30595 existing records from primary storage. [2025-10-22T22:15:30.894047] [INFO ] [MAIN ] SWX: Loaded 30595 primary data records. [2025-10-22T22:15:31.762827] [DEBUG] [MAIN ] SW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:31.763387] [DEBUG] [MAIN ] SWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:31.764368] [INFO ] [MAIN ] SW: Generated 1794 derivative records from 53179 primary records. [2025-10-22T22:15:31.765369] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-22T22:15:31.765170] [INFO ] [MAIN ] SWK: Generated 1794 derivative records from 52397 primary records. [2025-10-22T22:15:31.766197] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-22T22:15:31.805112] [DEBUG] [MAIN ] SWX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:31.812198] [INFO ] [MAIN ] SWX: Generated 1794 derivative records from 30595 primary records. [2025-10-22T22:15:31.810887] [DEBUG] [LOCAL ] SWK: Derivative data saved (1794 records). [2025-10-22T22:15:31.812329] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-22T22:15:31.807788] [DEBUG] [LOCAL ] SW: Derivative data saved (1794 records). [2025-10-22T22:15:31.812508] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-22T22:15:31.815446] [INFO ] [MAIN ] Derivative Progress: 1738/2052 symbols completed. SWK took 1.1s. Estimated remaining: 1m 58s. Rate: 159.2 symbols/min [2025-10-22T22:15:31.815810] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-22T22:15:31.818589] [INFO ] [MAIN ] Derivative Progress: 1739/2052 symbols completed. SW took 1.1s. Estimated remaining: 1m 58s. Rate: 159.3 symbols/min [2025-10-22T22:15:31.840467] [DEBUG] [LOCAL ] SWX: Derivative data saved (1794 records). [2025-10-22T22:15:31.840604] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-22T22:15:31.844021] [INFO ] [MAIN ] Derivative Progress: 1740/2052 symbols completed. SWX took 1.1s. Estimated remaining: 1m 57s. Rate: 159.4 symbols/min [2025-10-22T22:15:31.844539] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:31.844773] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:31.844452] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:31.853931] [DEBUG] [LOCAL ] SWZ: Loaded 5997 existing records from primary storage. [2025-10-22T22:15:31.854062] [INFO ] [MAIN ] SWZ: Loaded 5997 primary data records. [2025-10-22T22:15:31.948734] [DEBUG] [LOCAL ] SXI: Loaded 12002 existing records from primary storage. [2025-10-22T22:15:31.963046] [INFO ] [MAIN ] SXI: Loaded 12002 primary data records. [2025-10-22T22:15:32.170271] [DEBUG] [LOCAL ] SXC: Loaded 41575 existing records from primary storage. [2025-10-22T22:15:32.173247] [INFO ] [MAIN ] SXC: Loaded 41575 primary data records. [2025-10-22T22:15:32.910795] [DEBUG] [MAIN ] SXI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:32.911278] [DEBUG] [MAIN ] SWZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:32.912050] [INFO ] [MAIN ] SXI: Generated 1794 derivative records from 12002 primary records. [2025-10-22T22:15:32.913100] [INFO ] [MAIN ] SWZ: Generated 1794 derivative records from 5997 primary records. [2025-10-22T22:15:32.912170] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-22T22:15:32.914213] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-22T22:15:32.948688] [DEBUG] [LOCAL ] SXI: Derivative data saved (1794 records). [2025-10-22T22:15:32.950724] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-22T22:15:32.952479] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1794 records). [2025-10-22T22:15:32.956072] [INFO ] [MAIN ] Derivative Progress: 1741/2052 symbols completed. SXI took 1.1s. Estimated remaining: 1m 57s. Rate: 159.2 symbols/min [2025-10-22T22:15:32.956335] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:32.956421] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-10-22T22:15:32.959877] [INFO ] [MAIN ] Derivative Progress: 1742/2052 symbols completed. SWZ took 1.1s. Estimated remaining: 1m 57s. Rate: 159.3 symbols/min [2025-10-22T22:15:32.961201] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:32.976243] [DEBUG] [MAIN ] SXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:32.977095] [INFO ] [MAIN ] SXC: Generated 1794 derivative records from 41575 primary records. [2025-10-22T22:15:32.977229] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-22T22:15:32.996287] [DEBUG] [LOCAL ] SXC: Derivative data saved (1794 records). [2025-10-22T22:15:32.996517] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-22T22:15:32.999368] [INFO ] [MAIN ] Derivative Progress: 1743/2052 symbols completed. SXC took 1.2s. Estimated remaining: 1m 56s. Rate: 159.4 symbols/min [2025-10-22T22:15:32.999674] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:33.022385] [DEBUG] [LOCAL ] SXT: Loaded 29654 existing records from primary storage. [2025-10-22T22:15:33.022589] [INFO ] [MAIN ] SXT: Loaded 29654 primary data records. [2025-10-22T22:15:33.192532] [DEBUG] [LOCAL ] SYF: Loaded 53451 existing records from primary storage. [2025-10-22T22:15:33.214051] [INFO ] [MAIN ] SYF: Loaded 53451 primary data records. [2025-10-22T22:15:33.315975] [DEBUG] [LOCAL ] SYK: Loaded 46804 existing records from primary storage. [2025-10-22T22:15:33.485202] [INFO ] [MAIN ] SYK: Loaded 46804 primary data records. [2025-10-22T22:15:34.039393] [DEBUG] [MAIN ] SXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:34.042697] [INFO ] [MAIN ] SXT: Generated 1794 derivative records from 29654 primary records. [2025-10-22T22:15:34.042845] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-22T22:15:34.061775] [DEBUG] [LOCAL ] SXT: Derivative data saved (1794 records). [2025-10-22T22:15:34.062113] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-22T22:15:34.064519] [INFO ] [MAIN ] Derivative Progress: 1744/2052 symbols completed. SXT took 1.1s. Estimated remaining: 1m 56s. Rate: 159.3 symbols/min [2025-10-22T22:15:34.065019] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:34.108974] [DEBUG] [MAIN ] SYK: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:15:34.110493] [INFO ] [MAIN ] SYK: Generated 1793 derivative records from 46804 primary records. [2025-10-22T22:15:34.109601] [DEBUG] [MAIN ] SYF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:34.111582] [INFO ] [MAIN ] SYF: Generated 1794 derivative records from 53451 primary records. [2025-10-22T22:15:34.110812] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-22T22:15:34.111750] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-10-22T22:15:34.144626] [DEBUG] [LOCAL ] SYK: Derivative data saved (1793 records). [2025-10-22T22:15:34.145266] [DEBUG] [LOCAL ] SYF: Derivative data saved (1794 records). [2025-10-22T22:15:34.145005] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-22T22:15:34.145414] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-10-22T22:15:34.148380] [INFO ] [MAIN ] Derivative Progress: 1745/2052 symbols completed. SYK took 1.1s. Estimated remaining: 1m 56s. Rate: 159.3 symbols/min [2025-10-22T22:15:34.151481] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:34.151562] [INFO ] [MAIN ] Derivative Progress: 1746/2052 symbols completed. SYF took 1.2s. Estimated remaining: 1m 55s. Rate: 159.4 symbols/min [2025-10-22T22:15:34.152415] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:34.187860] [DEBUG] [LOCAL ] SYY: Loaded 53204 existing records from primary storage. [2025-10-22T22:15:34.188050] [INFO ] [MAIN ] SYY: Loaded 53204 primary data records. [2025-10-22T22:15:34.505234] [DEBUG] [LOCAL ] TAC: Loaded 43411 existing records from primary storage. [2025-10-22T22:15:34.518762] [INFO ] [MAIN ] TAC: Loaded 43411 primary data records. [2025-10-22T22:15:34.642596] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-22T22:15:34.643606] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-10-22T22:15:35.194456] [DEBUG] [MAIN ] SYY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:35.196020] [INFO ] [MAIN ] SYY: Generated 1794 derivative records from 53204 primary records. [2025-10-22T22:15:35.196247] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-22T22:15:35.214950] [DEBUG] [LOCAL ] SYY: Derivative data saved (1794 records). [2025-10-22T22:15:35.215816] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-22T22:15:35.218138] [INFO ] [MAIN ] Derivative Progress: 1747/2052 symbols completed. SYY took 1.2s. Estimated remaining: 1m 55s. Rate: 159.2 symbols/min [2025-10-22T22:15:35.218935] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:35.245619] [DEBUG] [MAIN ] TAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:35.247407] [INFO ] [MAIN ] TAC: Generated 1794 derivative records from 43411 primary records. [2025-10-22T22:15:35.248258] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-22T22:15:35.273586] [DEBUG] [MAIN ] T: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:35.278636] [INFO ] [MAIN ] T: Generated 1794 derivative records from 53798 primary records. [2025-10-22T22:15:35.278868] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-22T22:15:35.277789] [DEBUG] [LOCAL ] TAC: Derivative data saved (1794 records). [2025-10-22T22:15:35.279461] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-22T22:15:35.282072] [INFO ] [MAIN ] Derivative Progress: 1748/2052 symbols completed. TAC took 1.1s. Estimated remaining: 1m 54s. Rate: 159.3 symbols/min [2025-10-22T22:15:35.282538] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:35.309964] [DEBUG] [LOCAL ] T: Derivative data saved (1794 records). [2025-10-22T22:15:35.310287] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-22T22:15:35.313014] [INFO ] [MAIN ] Derivative Progress: 1749/2052 symbols completed. T took 1.2s. Estimated remaining: 1m 54s. Rate: 159.4 symbols/min [2025-10-22T22:15:35.313323] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:35.331982] [DEBUG] [LOCAL ] TAK: Loaded 50230 existing records from primary storage. [2025-10-22T22:15:35.332350] [INFO ] [MAIN ] TAK: Loaded 50230 primary data records. [2025-10-22T22:15:35.677923] [DEBUG] [LOCAL ] TAL: Loaded 51715 existing records from primary storage. [2025-10-22T22:15:35.692444] [INFO ] [MAIN ] TAL: Loaded 51715 primary data records. [2025-10-22T22:15:35.737068] [DEBUG] [LOCAL ] TALO: Loaded 50988 existing records from primary storage. [2025-10-22T22:15:35.770833] [INFO ] [MAIN ] TALO: Loaded 50988 primary data records. [2025-10-22T22:15:36.317902] [DEBUG] [MAIN ] TAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:36.318769] [INFO ] [MAIN ] TAK: Generated 1794 derivative records from 50230 primary records. [2025-10-22T22:15:36.319050] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-22T22:15:36.341582] [DEBUG] [LOCAL ] TAK: Derivative data saved (1794 records). [2025-10-22T22:15:36.341772] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-22T22:15:36.344002] [INFO ] [MAIN ] Derivative Progress: 1750/2052 symbols completed. TAK took 1.1s. Estimated remaining: 1m 54s. Rate: 159.2 symbols/min [2025-10-22T22:15:36.344374] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:36.361618] [DEBUG] [MAIN ] TAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:36.362756] [INFO ] [MAIN ] TAL: Generated 1794 derivative records from 51715 primary records. [2025-10-22T22:15:36.362948] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-22T22:15:36.381895] [DEBUG] [LOCAL ] TAL: Derivative data saved (1794 records). [2025-10-22T22:15:36.383412] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-22T22:15:36.386440] [INFO ] [MAIN ] Derivative Progress: 1751/2052 symbols completed. TAL took 1.1s. Estimated remaining: 1m 53s. Rate: 159.3 symbols/min [2025-10-22T22:15:36.386826] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:36.400358] [DEBUG] [MAIN ] TALO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:36.401091] [INFO ] [MAIN ] TALO: Generated 1794 derivative records from 50988 primary records. [2025-10-22T22:15:36.401266] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-22T22:15:36.417059] [DEBUG] [LOCAL ] TALO: Derivative data saved (1794 records). [2025-10-22T22:15:36.417235] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-22T22:15:36.419937] [INFO ] [MAIN ] Derivative Progress: 1752/2052 symbols completed. TALO took 1.1s. Estimated remaining: 1m 53s. Rate: 159.4 symbols/min [2025-10-22T22:15:36.420361] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:36.484805] [DEBUG] [LOCAL ] TBBB: Loaded 35604 existing records from primary storage. [2025-10-22T22:15:36.495518] [DEBUG] [LOCAL ] TAP: Loaded 52959 existing records from primary storage. [2025-10-22T22:15:36.495734] [INFO ] [MAIN ] TBBB: Loaded 35604 primary data records. [2025-10-22T22:15:36.496147] [DEBUG] [LOCAL ] TBI: Loaded 22761 existing records from primary storage. [2025-10-22T22:15:36.496764] [INFO ] [MAIN ] TAP: Loaded 52959 primary data records. [2025-10-22T22:15:36.496697] [INFO ] [MAIN ] TBI: Loaded 22761 primary data records. [2025-10-22T22:15:37.484114] [DEBUG] [MAIN ] TBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:37.484464] [DEBUG] [MAIN ] TAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:37.485604] [INFO ] [MAIN ] TBI: Generated 1794 derivative records from 22761 primary records. [2025-10-22T22:15:37.497471] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-22T22:15:37.499346] [INFO ] [MAIN ] TAP: Generated 1794 derivative records from 52959 primary records. [2025-10-22T22:15:37.506419] [DEBUG] [MAIN ] TBBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:37.508278] [INFO ] [MAIN ] TBBB: Generated 1794 derivative records from 35604 primary records. [2025-10-22T22:15:37.506553] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-22T22:15:37.515619] [DEBUG] [LOCAL ] TBI: Derivative data saved (1794 records). [2025-10-22T22:15:37.515758] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-22T22:15:37.515907] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-10-22T22:15:37.518249] [INFO ] [MAIN ] Derivative Progress: 1753/2052 symbols completed. TBI took 1.1s. Estimated remaining: 1m 53s. Rate: 159.2 symbols/min [2025-10-22T22:15:37.542449] [DEBUG] [LOCAL ] TAP: Derivative data saved (1794 records). [2025-10-22T22:15:37.546725] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-22T22:15:37.549501] [INFO ] [MAIN ] Derivative Progress: 1754/2052 symbols completed. TAP took 1.2s. Estimated remaining: 1m 52s. Rate: 159.3 symbols/min [2025-10-22T22:15:37.551944] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1794 records). [2025-10-22T22:15:37.552008] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-22T22:15:37.554362] [INFO ] [MAIN ] Derivative Progress: 1755/2052 symbols completed. TBBB took 1.2s. Estimated remaining: 1m 52s. Rate: 159.4 symbols/min [2025-10-22T22:15:37.554999] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:37.554824] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:37.554937] [INFO ] [MAIN ] TCBX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:37.567278] [DEBUG] [LOCAL ] TBN: Loaded 4034 existing records from primary storage. [2025-10-22T22:15:37.567601] [INFO ] [MAIN ] TBN: Loaded 4034 primary data records. [2025-10-22T22:15:37.623172] [DEBUG] [LOCAL ] TCBX: Loaded 10195 existing records from primary storage. [2025-10-22T22:15:37.655753] [INFO ] [MAIN ] TCBX: Loaded 10195 primary data records. [2025-10-22T22:15:38.086720] [DEBUG] [LOCAL ] TD: Loaded 52240 existing records from primary storage. [2025-10-22T22:15:38.109843] [INFO ] [MAIN ] TD: Loaded 52240 primary data records. [2025-10-22T22:15:38.639551] [DEBUG] [MAIN ] TBN: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:15:38.641180] [INFO ] [MAIN ] TBN: Generated 1793 derivative records from 4034 primary records. [2025-10-22T22:15:38.642217] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-22T22:15:38.664243] [DEBUG] [LOCAL ] TBN: Derivative data saved (1793 records). [2025-10-22T22:15:38.664724] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-22T22:15:38.666965] [INFO ] [MAIN ] Derivative Progress: 1756/2052 symbols completed. TBN took 1.1s. Estimated remaining: 1m 52s. Rate: 159.2 symbols/min [2025-10-22T22:15:38.675636] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:38.682325] [DEBUG] [MAIN ] TCBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:38.686208] [INFO ] [MAIN ] TCBX: Generated 1794 derivative records from 10195 primary records. [2025-10-22T22:15:38.686767] [DEBUG] [LOCAL ] TCBX: Saving derivative data. [2025-10-22T22:15:38.701087] [DEBUG] [MAIN ] TD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:38.702123] [INFO ] [MAIN ] TD: Generated 1794 derivative records from 52240 primary records. [2025-10-22T22:15:38.702761] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-22T22:15:38.720111] [DEBUG] [LOCAL ] TCBX: Derivative data saved (1794 records). [2025-10-22T22:15:38.727724] [INFO ] [MAIN ] TCBX: Successfully saved derivative data. [2025-10-22T22:15:38.737107] [DEBUG] [LOCAL ] TD: Derivative data saved (1794 records). [2025-10-22T22:15:38.740477] [INFO ] [MAIN ] Derivative Progress: 1757/2052 symbols completed. TCBX took 1.2s. Estimated remaining: 1m 51s. Rate: 159.3 symbols/min [2025-10-22T22:15:38.741212] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-22T22:15:38.744421] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:38.756164] [INFO ] [MAIN ] Derivative Progress: 1758/2052 symbols completed. TD took 1.2s. Estimated remaining: 1m 51s. Rate: 159.4 symbols/min [2025-10-22T22:15:38.756858] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:38.778605] [DEBUG] [LOCAL ] TDC: Loaded 46401 existing records from primary storage. [2025-10-22T22:15:38.778788] [INFO ] [MAIN ] TDC: Loaded 46401 primary data records. [2025-10-22T22:15:38.813405] [DEBUG] [LOCAL ] TDF: Loaded 6197 existing records from primary storage. [2025-10-22T22:15:38.838745] [INFO ] [MAIN ] TDF: Loaded 6197 primary data records. [2025-10-22T22:15:38.915950] [DEBUG] [LOCAL ] TDG: Loaded 21943 existing records from primary storage. [2025-10-22T22:15:38.939968] [INFO ] [MAIN ] TDG: Loaded 21943 primary data records. [2025-10-22T22:15:39.843158] [DEBUG] [MAIN ] TDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:39.845324] [INFO ] [MAIN ] TDC: Generated 1794 derivative records from 46401 primary records. [2025-10-22T22:15:39.845572] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-22T22:15:39.864897] [DEBUG] [LOCAL ] TDC: Derivative data saved (1794 records). [2025-10-22T22:15:39.865683] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-22T22:15:39.867679] [INFO ] [MAIN ] Derivative Progress: 1759/2052 symbols completed. TDC took 1.2s. Estimated remaining: 1m 50s. Rate: 159.2 symbols/min [2025-10-22T22:15:39.880628] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:39.881152] [DEBUG] [MAIN ] TDF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:39.882514] [INFO ] [MAIN ] TDF: Generated 1794 derivative records from 6197 primary records. [2025-10-22T22:15:39.883035] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-22T22:15:39.909900] [DEBUG] [MAIN ] TDG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:39.914487] [INFO ] [MAIN ] TDG: Generated 1794 derivative records from 21943 primary records. [2025-10-22T22:15:39.915155] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-22T22:15:39.914966] [DEBUG] [LOCAL ] TDF: Derivative data saved (1794 records). [2025-10-22T22:15:39.916001] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-22T22:15:39.918413] [INFO ] [MAIN ] Derivative Progress: 1760/2052 symbols completed. TDF took 1.2s. Estimated remaining: 1m 50s. Rate: 159.3 symbols/min [2025-10-22T22:15:39.929846] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:39.933910] [DEBUG] [LOCAL ] TDG: Derivative data saved (1794 records). [2025-10-22T22:15:39.934170] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-22T22:15:39.939144] [INFO ] [MAIN ] Derivative Progress: 1761/2052 symbols completed. TDG took 1.2s. Estimated remaining: 1m 50s. Rate: 159.4 symbols/min [2025-10-22T22:15:39.939429] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:40.004600] [DEBUG] [LOCAL ] TDOC: Loaded 53369 existing records from primary storage. [2025-10-22T22:15:40.015033] [INFO ] [MAIN ] TDOC: Loaded 53369 primary data records. [2025-10-22T22:15:40.150873] [DEBUG] [LOCAL ] TDW: Loaded 44907 existing records from primary storage. [2025-10-22T22:15:40.151122] [INFO ] [MAIN ] TDW: Loaded 44907 primary data records. [2025-10-22T22:15:40.151903] [DEBUG] [LOCAL ] TDS: Loaded 42187 existing records from primary storage. [2025-10-22T22:15:40.163760] [INFO ] [MAIN ] TDS: Loaded 42187 primary data records. [2025-10-22T22:15:41.022243] [DEBUG] [MAIN ] TDOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:41.023902] [INFO ] [MAIN ] TDOC: Generated 1794 derivative records from 53369 primary records. [2025-10-22T22:15:41.024212] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-22T22:15:41.054102] [DEBUG] [MAIN ] TDW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:41.057316] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1794 records). [2025-10-22T22:15:41.065414] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-10-22T22:15:41.071436] [DEBUG] [MAIN ] TDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:41.071099] [INFO ] [MAIN ] TDW: Generated 1794 derivative records from 44907 primary records. [2025-10-22T22:15:41.072382] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-22T22:15:41.072296] [INFO ] [MAIN ] TDS: Generated 1794 derivative records from 42187 primary records. [2025-10-22T22:15:41.075139] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-22T22:15:41.074467] [INFO ] [MAIN ] Derivative Progress: 1762/2052 symbols completed. TDOC took 1.2s. Estimated remaining: 1m 49s. Rate: 159.2 symbols/min [2025-10-22T22:15:41.076331] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:41.103448] [DEBUG] [LOCAL ] TDS: Derivative data saved (1794 records). [2025-10-22T22:15:41.104755] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-22T22:15:41.110777] [INFO ] [MAIN ] Derivative Progress: 1763/2052 symbols completed. TDS took 1.2s. Estimated remaining: 1m 49s. Rate: 159.3 symbols/min [2025-10-22T22:15:41.107834] [DEBUG] [LOCAL ] TDW: Derivative data saved (1794 records). [2025-10-22T22:15:41.111250] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-22T22:15:41.111054] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:41.113771] [INFO ] [MAIN ] Derivative Progress: 1764/2052 symbols completed. TDW took 1.2s. Estimated remaining: 1m 48s. Rate: 159.4 symbols/min [2025-10-22T22:15:41.120415] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:41.132947] [DEBUG] [LOCAL ] TDY: Loaded 22146 existing records from primary storage. [2025-10-22T22:15:41.136863] [INFO ] [MAIN ] TDY: Loaded 22146 primary data records. [2025-10-22T22:15:41.136771] [DEBUG] [LOCAL ] TEAF: Loaded 7331 existing records from primary storage. [2025-10-22T22:15:41.137100] [INFO ] [MAIN ] TEAF: Loaded 7331 primary data records. [2025-10-22T22:15:41.775830] [DEBUG] [LOCAL ] TECK: Loaded 53435 existing records from primary storage. [2025-10-22T22:15:41.776206] [INFO ] [MAIN ] TECK: Loaded 53435 primary data records. [2025-10-22T22:15:42.109152] [DEBUG] [MAIN ] TEAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:42.111231] [INFO ] [MAIN ] TEAF: Generated 1794 derivative records from 7331 primary records. [2025-10-22T22:15:42.113199] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-22T22:15:42.143338] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1794 records). [2025-10-22T22:15:42.143488] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-22T22:15:42.143811] [DEBUG] [MAIN ] TDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:42.147225] [INFO ] [MAIN ] TDY: Generated 1794 derivative records from 22146 primary records. [2025-10-22T22:15:42.146352] [INFO ] [MAIN ] Derivative Progress: 1765/2052 symbols completed. TEAF took 1.0s. Estimated remaining: 1m 48s. Rate: 159.2 symbols/min [2025-10-22T22:15:42.147858] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-22T22:15:42.147928] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:42.166585] [DEBUG] [LOCAL ] TDY: Derivative data saved (1794 records). [2025-10-22T22:15:42.166853] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-22T22:15:42.170301] [INFO ] [MAIN ] Derivative Progress: 1766/2052 symbols completed. TDY took 1.1s. Estimated remaining: 1m 48s. Rate: 159.3 symbols/min [2025-10-22T22:15:42.171319] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:42.185601] [DEBUG] [MAIN ] TECK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:42.186411] [INFO ] [MAIN ] TECK: Generated 1794 derivative records from 53435 primary records. [2025-10-22T22:15:42.186573] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-22T22:15:42.211541] [DEBUG] [LOCAL ] TECK: Derivative data saved (1794 records). [2025-10-22T22:15:42.215801] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-22T22:15:42.218001] [INFO ] [MAIN ] Derivative Progress: 1767/2052 symbols completed. TECK took 1.1s. Estimated remaining: 1m 47s. Rate: 159.4 symbols/min [2025-10-22T22:15:42.218859] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:42.236929] [DEBUG] [LOCAL ] TEI: Loaded 21181 existing records from primary storage. [2025-10-22T22:15:42.238062] [DEBUG] [LOCAL ] TEF: Loaded 36800 existing records from primary storage. [2025-10-22T22:15:42.238184] [INFO ] [MAIN ] TEI: Loaded 21181 primary data records. [2025-10-22T22:15:42.238284] [INFO ] [MAIN ] TEF: Loaded 36800 primary data records. [2025-10-22T22:15:42.895692] [DEBUG] [LOCAL ] TEL: Loaded 51046 existing records from primary storage. [2025-10-22T22:15:42.896354] [INFO ] [MAIN ] TEL: Loaded 51046 primary data records. [2025-10-22T22:15:43.221129] [DEBUG] [MAIN ] TEI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:15:43.223760] [INFO ] [MAIN ] TEI: Generated 1793 derivative records from 21181 primary records. [2025-10-22T22:15:43.224629] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-22T22:15:43.255772] [DEBUG] [LOCAL ] TEI: Derivative data saved (1793 records). [2025-10-22T22:15:43.255100] [DEBUG] [MAIN ] TEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:43.257070] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-22T22:15:43.256914] [INFO ] [MAIN ] TEF: Generated 1794 derivative records from 36800 primary records. [2025-10-22T22:15:43.259620] [INFO ] [MAIN ] Derivative Progress: 1768/2052 symbols completed. TEI took 1.1s. Estimated remaining: 1m 47s. Rate: 159.2 symbols/min [2025-10-22T22:15:43.257295] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-22T22:15:43.276668] [DEBUG] [LOCAL ] TEF: Derivative data saved (1794 records). [2025-10-22T22:15:43.277463] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-22T22:15:43.280495] [INFO ] [MAIN ] Derivative Progress: 1769/2052 symbols completed. TEF took 1.1s. Estimated remaining: 1m 47s. Rate: 159.3 symbols/min [2025-10-22T22:15:43.293232] [DEBUG] [MAIN ] TEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:43.293818] [INFO ] [MAIN ] TEL: Generated 1794 derivative records from 51046 primary records. [2025-10-22T22:15:43.293881] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-22T22:15:43.309194] [DEBUG] [LOCAL ] TEL: Derivative data saved (1794 records). [2025-10-22T22:15:43.309254] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-22T22:15:43.311780] [INFO ] [MAIN ] Derivative Progress: 1770/2052 symbols completed. TEL took 1.1s. Estimated remaining: 1m 46s. Rate: 159.4 symbols/min [2025-10-22T22:15:43.312226] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:43.312676] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:43.312756] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:43.342172] [DEBUG] [LOCAL ] TEO: Loaded 22745 existing records from primary storage. [2025-10-22T22:15:43.342309] [INFO ] [MAIN ] TEO: Loaded 22745 primary data records. [2025-10-22T22:15:43.422429] [DEBUG] [LOCAL ] TEN: Loaded 30257 existing records from primary storage. [2025-10-22T22:15:43.429156] [INFO ] [MAIN ] TEN: Loaded 30257 primary data records. [2025-10-22T22:15:43.655603] [DEBUG] [LOCAL ] TEVA: Loaded 53622 existing records from primary storage. [2025-10-22T22:15:43.782144] [INFO ] [MAIN ] TEVA: Loaded 53622 primary data records. [2025-10-22T22:15:44.327895] [DEBUG] [MAIN ] TEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:44.329983] [INFO ] [MAIN ] TEO: Generated 1794 derivative records from 22745 primary records. [2025-10-22T22:15:44.330286] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-22T22:15:44.357319] [DEBUG] [LOCAL ] TEO: Derivative data saved (1794 records). [2025-10-22T22:15:44.357983] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-22T22:15:44.360159] [INFO ] [MAIN ] Derivative Progress: 1771/2052 symbols completed. TEO took 1.0s. Estimated remaining: 1m 46s. Rate: 159.2 symbols/min [2025-10-22T22:15:44.360511] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:44.374441] [DEBUG] [MAIN ] TEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:44.375382] [INFO ] [MAIN ] TEN: Generated 1794 derivative records from 30257 primary records. [2025-10-22T22:15:44.375747] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-22T22:15:44.395899] [DEBUG] [LOCAL ] TEN: Derivative data saved (1794 records). [2025-10-22T22:15:44.396191] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-22T22:15:44.398873] [INFO ] [MAIN ] Derivative Progress: 1772/2052 symbols completed. TEN took 1.1s. Estimated remaining: 1m 45s. Rate: 159.3 symbols/min [2025-10-22T22:15:44.399180] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:44.413242] [DEBUG] [MAIN ] TEVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:44.414229] [INFO ] [MAIN ] TEVA: Generated 1794 derivative records from 53622 primary records. [2025-10-22T22:15:44.414359] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-10-22T22:15:44.441072] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1794 records). [2025-10-22T22:15:44.441387] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-10-22T22:15:44.444594] [INFO ] [MAIN ] Derivative Progress: 1773/2052 symbols completed. TEVA took 1.1s. Estimated remaining: 1m 45s. Rate: 159.4 symbols/min [2025-10-22T22:15:44.445019] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:44.460511] [DEBUG] [LOCAL ] TEX: Loaded 43477 existing records from primary storage. [2025-10-22T22:15:44.460814] [INFO ] [MAIN ] TEX: Loaded 43477 primary data records. [2025-10-22T22:15:44.689218] [DEBUG] [LOCAL ] TFII: Loaded 32251 existing records from primary storage. [2025-10-22T22:15:44.710349] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-22T22:15:44.840723] [INFO ] [MAIN ] TFII: Loaded 32251 primary data records. [2025-10-22T22:15:44.846000] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-10-22T22:15:45.502429] [DEBUG] [MAIN ] TEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:45.504477] [INFO ] [MAIN ] TEX: Generated 1794 derivative records from 43477 primary records. [2025-10-22T22:15:45.504804] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-22T22:15:45.522508] [DEBUG] [LOCAL ] TEX: Derivative data saved (1794 records). [2025-10-22T22:15:45.522943] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-22T22:15:45.525124] [INFO ] [MAIN ] Derivative Progress: 1774/2052 symbols completed. TEX took 1.2s. Estimated remaining: 1m 45s. Rate: 159.2 symbols/min [2025-10-22T22:15:45.525789] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:45.544533] [DEBUG] [MAIN ] TFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:45.545468] [INFO ] [MAIN ] TFC: Generated 1794 derivative records from 53667 primary records. [2025-10-22T22:15:45.545607] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-22T22:15:45.566071] [DEBUG] [MAIN ] TFII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:45.570847] [INFO ] [MAIN ] TFII: Generated 1794 derivative records from 32251 primary records. [2025-10-22T22:15:45.575012] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-22T22:15:45.574962] [DEBUG] [LOCAL ] TFC: Derivative data saved (1794 records). [2025-10-22T22:15:45.580485] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-10-22T22:15:45.583839] [INFO ] [MAIN ] Derivative Progress: 1775/2052 symbols completed. TFC took 1.2s. Estimated remaining: 1m 44s. Rate: 159.3 symbols/min [2025-10-22T22:15:45.584019] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:45.599779] [DEBUG] [LOCAL ] TFII: Derivative data saved (1794 records). [2025-10-22T22:15:45.607169] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-22T22:15:45.609597] [INFO ] [MAIN ] Derivative Progress: 1776/2052 symbols completed. TFII took 1.2s. Estimated remaining: 1m 44s. Rate: 159.4 symbols/min [2025-10-22T22:15:45.609851] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:45.610462] [DEBUG] [LOCAL ] TFIN: Loaded 23665 existing records from primary storage. [2025-10-22T22:15:45.611061] [INFO ] [MAIN ] TFIN: Loaded 23665 primary data records. [2025-10-22T22:15:45.942945] [DEBUG] [LOCAL ] TFPM: Loaded 39860 existing records from primary storage. [2025-10-22T22:15:45.943208] [INFO ] [MAIN ] TFPM: Loaded 39860 primary data records. [2025-10-22T22:15:46.034453] [DEBUG] [LOCAL ] TFX: Loaded 35633 existing records from primary storage. [2025-10-22T22:15:46.040067] [INFO ] [MAIN ] TFX: Loaded 35633 primary data records. [2025-10-22T22:15:46.645248] [DEBUG] [MAIN ] TFIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:46.648151] [INFO ] [MAIN ] TFIN: Generated 1794 derivative records from 23665 primary records. [2025-10-22T22:15:46.648787] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-22T22:15:46.666866] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1794 records). [2025-10-22T22:15:46.667099] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-22T22:15:46.669533] [INFO ] [MAIN ] Derivative Progress: 1777/2052 symbols completed. TFIN took 1.1s. Estimated remaining: 1m 44s. Rate: 159.2 symbols/min [2025-10-22T22:15:46.669690] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:46.683616] [DEBUG] [LOCAL ] TG: Loaded 10631 existing records from primary storage. [2025-10-22T22:15:46.688500] [INFO ] [MAIN ] TG: Loaded 10631 primary data records. [2025-10-22T22:15:46.776489] [DEBUG] [MAIN ] TFPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:46.800140] [INFO ] [MAIN ] TFPM: Generated 1794 derivative records from 39860 primary records. [2025-10-22T22:15:46.815567] [DEBUG] [MAIN ] TFX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:46.812309] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-22T22:15:46.816270] [INFO ] [MAIN ] TFX: Generated 1794 derivative records from 35633 primary records. [2025-10-22T22:15:46.817091] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-22T22:15:46.918818] [DEBUG] [LOCAL ] TFX: Derivative data saved (1794 records). [2025-10-22T22:15:47.044285] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-22T22:15:47.049729] [INFO ] [MAIN ] Derivative Progress: 1778/2052 symbols completed. TFX took 1.4s. Estimated remaining: 1m 43s. Rate: 159.2 symbols/min [2025-10-22T22:15:47.050686] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:47.052065] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1794 records). [2025-10-22T22:15:47.053022] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-22T22:15:47.055866] [INFO ] [MAIN ] Derivative Progress: 1779/2052 symbols completed. TFPM took 1.5s. Estimated remaining: 1m 43s. Rate: 159.3 symbols/min [2025-10-22T22:15:47.056364] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:47.095148] [DEBUG] [MAIN ] TG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:47.096795] [INFO ] [MAIN ] TG: Generated 1794 derivative records from 10631 primary records. [2025-10-22T22:15:47.096923] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-22T22:15:47.097377] [DEBUG] [LOCAL ] TGLS: Loaded 27643 existing records from primary storage. [2025-10-22T22:15:47.098021] [INFO ] [MAIN ] TGLS: Loaded 27643 primary data records. [2025-10-22T22:15:47.245819] [DEBUG] [LOCAL ] TG: Derivative data saved (1794 records). [2025-10-22T22:15:47.246978] [DEBUG] [LOCAL ] TGNA: Loaded 48517 existing records from primary storage. [2025-10-22T22:15:47.246031] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-22T22:15:47.247422] [INFO ] [MAIN ] TGNA: Loaded 48517 primary data records. [2025-10-22T22:15:47.255118] [INFO ] [MAIN ] Derivative Progress: 1780/2052 symbols completed. TG took 0.6s. Estimated remaining: 1m 42s. Rate: 159.3 symbols/min [2025-10-22T22:15:47.271482] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:47.782536] [DEBUG] [LOCAL ] TGS: Loaded 33787 existing records from primary storage. [2025-10-22T22:15:47.784061] [INFO ] [MAIN ] TGS: Loaded 33787 primary data records. [2025-10-22T22:15:48.094514] [DEBUG] [MAIN ] TGLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:48.108524] [INFO ] [MAIN ] TGLS: Generated 1794 derivative records from 27643 primary records. [2025-10-22T22:15:48.108722] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-22T22:15:48.128519] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1794 records). [2025-10-22T22:15:48.129789] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-22T22:15:48.132300] [INFO ] [MAIN ] Derivative Progress: 1781/2052 symbols completed. TGLS took 1.1s. Estimated remaining: 1m 42s. Rate: 159.2 symbols/min [2025-10-22T22:15:48.132813] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:48.146905] [DEBUG] [MAIN ] TGNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:48.147882] [INFO ] [MAIN ] TGNA: Generated 1794 derivative records from 48517 primary records. [2025-10-22T22:15:48.148062] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-22T22:15:48.166575] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1794 records). [2025-10-22T22:15:48.166859] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-22T22:15:48.169824] [INFO ] [MAIN ] Derivative Progress: 1782/2052 symbols completed. TGNA took 1.1s. Estimated remaining: 1m 42s. Rate: 159.3 symbols/min [2025-10-22T22:15:48.170604] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:48.190329] [DEBUG] [MAIN ] TGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:48.191148] [INFO ] [MAIN ] TGS: Generated 1794 derivative records from 33787 primary records. [2025-10-22T22:15:48.204924] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-22T22:15:48.223885] [DEBUG] [LOCAL ] TGS: Derivative data saved (1794 records). [2025-10-22T22:15:48.224898] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-22T22:15:48.241734] [INFO ] [MAIN ] Derivative Progress: 1783/2052 symbols completed. TGS took 1.0s. Estimated remaining: 1m 41s. Rate: 159.4 symbols/min [2025-10-22T22:15:48.243289] [DEBUG] [LOCAL ] TGT: Loaded 53777 existing records from primary storage. [2025-10-22T22:15:48.252363] [INFO ] [MAIN ] TGT: Loaded 53777 primary data records. [2025-10-22T22:15:48.393966] [DEBUG] [LOCAL ] THC: Loaded 46634 existing records from primary storage. [2025-10-22T22:15:48.414790] [INFO ] [MAIN ] THC: Loaded 46634 primary data records. [2025-10-22T22:15:48.906990] [DEBUG] [MAIN ] TGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:48.907944] [INFO ] [MAIN ] TGT: Generated 1794 derivative records from 53777 primary records. [2025-10-22T22:15:48.908094] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-22T22:15:48.924242] [DEBUG] [LOCAL ] TGT: Derivative data saved (1794 records). [2025-10-22T22:15:48.924395] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-22T22:15:48.926560] [INFO ] [MAIN ] Derivative Progress: 1784/2052 symbols completed. TGT took 0.8s. Estimated remaining: 1m 41s. Rate: 159.3 symbols/min [2025-10-22T22:15:48.942256] [DEBUG] [MAIN ] THC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:48.942808] [INFO ] [MAIN ] THC: Generated 1794 derivative records from 46634 primary records. [2025-10-22T22:15:48.942867] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-22T22:15:48.957684] [DEBUG] [LOCAL ] THC: Derivative data saved (1794 records). [2025-10-22T22:15:48.957742] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-22T22:15:48.960544] [INFO ] [MAIN ] Derivative Progress: 1785/2052 symbols completed. THC took 0.8s. Estimated remaining: 1m 41s. Rate: 159.4 symbols/min [2025-10-22T22:15:48.961031] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:48.961087] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:48.961268] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:48.965950] [DEBUG] [LOCAL ] THLV: Loaded 1491 existing records from primary storage. [2025-10-22T22:15:48.966800] [INFO ] [MAIN ] THLV: Loaded 1491 primary data records. [2025-10-22T22:15:49.047485] [DEBUG] [LOCAL ] THIR: Loaded 2461 existing records from primary storage. [2025-10-22T22:15:49.070716] [INFO ] [MAIN ] THIR: Loaded 2461 primary data records. [2025-10-22T22:15:49.080670] [DEBUG] [LOCAL ] THG: Loaded 21455 existing records from primary storage. [2025-10-22T22:15:49.080802] [INFO ] [MAIN ] THG: Loaded 21455 primary data records. [2025-10-22T22:15:49.942039] [DEBUG] [MAIN ] THLV: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-22T22:15:49.943262] [INFO ] [MAIN ] THLV: Generated 1792 derivative records from 1491 primary records. [2025-10-22T22:15:49.943519] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-22T22:15:49.963254] [DEBUG] [LOCAL ] THLV: Derivative data saved (1792 records). [2025-10-22T22:15:49.964101] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-22T22:15:49.966449] [INFO ] [MAIN ] Derivative Progress: 1786/2052 symbols completed. THLV took 1.0s. Estimated remaining: 1m 40s. Rate: 159.2 symbols/min [2025-10-22T22:15:49.966812] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:49.981607] [DEBUG] [MAIN ] THIR: Filtered 6931 bins outside market hours, 7727 incomplete bins [2025-10-22T22:15:49.982484] [INFO ] [MAIN ] THIR: Generated 1791 derivative records from 2461 primary records. [2025-10-22T22:15:49.982580] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-22T22:15:49.998775] [DEBUG] [LOCAL ] THIR: Derivative data saved (1791 records). [2025-10-22T22:15:49.999241] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-22T22:15:50.004144] [INFO ] [MAIN ] Derivative Progress: 1787/2052 symbols completed. THIR took 1.0s. Estimated remaining: 1m 40s. Rate: 159.3 symbols/min [2025-10-22T22:15:50.005543] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:50.019942] [DEBUG] [MAIN ] THG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:50.020790] [INFO ] [MAIN ] THG: Generated 1794 derivative records from 21455 primary records. [2025-10-22T22:15:50.020943] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-22T22:15:50.046539] [DEBUG] [LOCAL ] THG: Derivative data saved (1794 records). [2025-10-22T22:15:50.046772] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-22T22:15:50.049131] [INFO ] [MAIN ] Derivative Progress: 1788/2052 symbols completed. THG took 1.1s. Estimated remaining: 1m 39s. Rate: 159.4 symbols/min [2025-10-22T22:15:50.055862] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:50.070333] [DEBUG] [LOCAL ] THO: Loaded 41016 existing records from primary storage. [2025-10-22T22:15:50.070686] [INFO ] [MAIN ] THO: Loaded 41016 primary data records. [2025-10-22T22:15:50.160324] [DEBUG] [LOCAL ] THQ: Loaded 25335 existing records from primary storage. [2025-10-22T22:15:50.188833] [INFO ] [MAIN ] THQ: Loaded 25335 primary data records. [2025-10-22T22:15:50.193276] [DEBUG] [LOCAL ] THR: Loaded 19563 existing records from primary storage. [2025-10-22T22:15:50.230446] [INFO ] [MAIN ] THR: Loaded 19563 primary data records. [2025-10-22T22:15:51.108908] [DEBUG] [MAIN ] THO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:51.111276] [INFO ] [MAIN ] THO: Generated 1794 derivative records from 41016 primary records. [2025-10-22T22:15:51.111512] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-22T22:15:51.139911] [DEBUG] [LOCAL ] THO: Derivative data saved (1794 records). [2025-10-22T22:15:51.140677] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-22T22:15:51.140994] [DEBUG] [MAIN ] THQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:51.144213] [INFO ] [MAIN ] Derivative Progress: 1789/2052 symbols completed. THO took 1.2s. Estimated remaining: 1m 39s. Rate: 159.2 symbols/min [2025-10-22T22:15:51.145323] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:51.145209] [INFO ] [MAIN ] THQ: Generated 1794 derivative records from 25335 primary records. [2025-10-22T22:15:51.147594] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-22T22:15:51.172719] [DEBUG] [MAIN ] THR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:51.177379] [INFO ] [MAIN ] THR: Generated 1794 derivative records from 19563 primary records. [2025-10-22T22:15:51.178050] [DEBUG] [LOCAL ] THQ: Derivative data saved (1794 records). [2025-10-22T22:15:51.178229] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-22T22:15:51.178164] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-22T22:15:51.181927] [INFO ] [MAIN ] Derivative Progress: 1790/2052 symbols completed. THQ took 1.2s. Estimated remaining: 1m 39s. Rate: 159.3 symbols/min [2025-10-22T22:15:51.189708] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:51.198913] [DEBUG] [LOCAL ] THR: Derivative data saved (1794 records). [2025-10-22T22:15:51.208253] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-10-22T22:15:51.210814] [INFO ] [MAIN ] Derivative Progress: 1791/2052 symbols completed. THR took 1.2s. Estimated remaining: 1m 38s. Rate: 159.4 symbols/min [2025-10-22T22:15:51.211127] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:51.238544] [DEBUG] [LOCAL ] THS: Loaded 38681 existing records from primary storage. [2025-10-22T22:15:51.239580] [INFO ] [MAIN ] THS: Loaded 38681 primary data records. [2025-10-22T22:15:51.238963] [DEBUG] [LOCAL ] THW: Loaded 19592 existing records from primary storage. [2025-10-22T22:15:51.251122] [INFO ] [MAIN ] THW: Loaded 19592 primary data records. [2025-10-22T22:15:51.469920] [DEBUG] [LOCAL ] TIMB: Loaded 34700 existing records from primary storage. [2025-10-22T22:15:51.476189] [INFO ] [MAIN ] TIMB: Loaded 34700 primary data records. [2025-10-22T22:15:52.239579] [DEBUG] [MAIN ] THS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:52.245408] [INFO ] [MAIN ] THS: Generated 1794 derivative records from 38681 primary records. [2025-10-22T22:15:52.245893] [DEBUG] [MAIN ] THW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:52.246971] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-22T22:15:52.246791] [INFO ] [MAIN ] THW: Generated 1794 derivative records from 19592 primary records. [2025-10-22T22:15:52.248032] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-22T22:15:52.272817] [DEBUG] [LOCAL ] THS: Derivative data saved (1794 records). [2025-10-22T22:15:52.275602] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-22T22:15:52.278738] [INFO ] [MAIN ] Derivative Progress: 1792/2052 symbols completed. THS took 1.1s. Estimated remaining: 1m 38s. Rate: 159.2 symbols/min [2025-10-22T22:15:52.281837] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:52.288009] [DEBUG] [LOCAL ] THW: Derivative data saved (1794 records). [2025-10-22T22:15:52.289895] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-22T22:15:52.292210] [DEBUG] [LOCAL ] TISI: Loaded 3153 existing records from primary storage. [2025-10-22T22:15:52.294488] [INFO ] [MAIN ] Derivative Progress: 1793/2052 symbols completed. THW took 1.1s. Estimated remaining: 1m 38s. Rate: 159.3 symbols/min [2025-10-22T22:15:52.294711] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:52.302527] [INFO ] [MAIN ] TISI: Loaded 3153 primary data records. [2025-10-22T22:15:52.328463] [DEBUG] [MAIN ] TIMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:52.377124] [INFO ] [MAIN ] TIMB: Generated 1794 derivative records from 34700 primary records. [2025-10-22T22:15:52.388818] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-22T22:15:52.651402] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1794 records). [2025-10-22T22:15:52.665827] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-22T22:15:52.679528] [INFO ] [MAIN ] Derivative Progress: 1794/2052 symbols completed. TIMB took 1.5s. Estimated remaining: 1m 37s. Rate: 159.3 symbols/min [2025-10-22T22:15:52.680438] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:52.681926] [DEBUG] [LOCAL ] TIXT: Loaded 32607 existing records from primary storage. [2025-10-22T22:15:52.683384] [INFO ] [MAIN ] TIXT: Loaded 32607 primary data records. [2025-10-22T22:15:53.022750] [DEBUG] [MAIN ] TISI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:53.024774] [INFO ] [MAIN ] TISI: Generated 1794 derivative records from 3153 primary records. [2025-10-22T22:15:53.025143] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-22T22:15:53.055999] [DEBUG] [LOCAL ] TISI: Derivative data saved (1794 records). [2025-10-22T22:15:53.056143] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-22T22:15:53.052336] [DEBUG] [LOCAL ] TJX: Loaded 53661 existing records from primary storage. [2025-10-22T22:15:53.058599] [INFO ] [MAIN ] Derivative Progress: 1795/2052 symbols completed. TISI took 0.8s. Estimated remaining: 1m 37s. Rate: 159.3 symbols/min [2025-10-22T22:15:53.060041] [INFO ] [MAIN ] TJX: Loaded 53661 primary data records. [2025-10-22T22:15:53.059128] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:53.410365] [DEBUG] [MAIN ] TIXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:53.411898] [INFO ] [MAIN ] TIXT: Generated 1794 derivative records from 32607 primary records. [2025-10-22T22:15:53.413846] [DEBUG] [LOCAL ] TKC: Loaded 40053 existing records from primary storage. [2025-10-22T22:15:53.414334] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-22T22:15:53.415375] [INFO ] [MAIN ] TKC: Loaded 40053 primary data records. [2025-10-22T22:15:53.431417] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1794 records). [2025-10-22T22:15:53.436729] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-22T22:15:53.447852] [INFO ] [MAIN ] Derivative Progress: 1796/2052 symbols completed. TIXT took 1.2s. Estimated remaining: 1m 36s. Rate: 159.3 symbols/min [2025-10-22T22:15:53.448069] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:53.775590] [DEBUG] [MAIN ] TJX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:53.777064] [INFO ] [MAIN ] TJX: Generated 1794 derivative records from 53661 primary records. [2025-10-22T22:15:53.777339] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-22T22:15:53.796536] [DEBUG] [LOCAL ] TJX: Derivative data saved (1794 records). [2025-10-22T22:15:53.809391] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-10-22T22:15:53.811945] [INFO ] [MAIN ] Derivative Progress: 1797/2052 symbols completed. TJX took 1.1s. Estimated remaining: 1m 36s. Rate: 159.3 symbols/min [2025-10-22T22:15:53.813275] [DEBUG] [LOCAL ] TKO: Loaded 43490 existing records from primary storage. [2025-10-22T22:15:53.813428] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:53.813625] [INFO ] [MAIN ] TKO: Loaded 43490 primary data records. [2025-10-22T22:15:54.140113] [DEBUG] [MAIN ] TKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:54.152843] [INFO ] [MAIN ] TKC: Generated 1794 derivative records from 40053 primary records. [2025-10-22T22:15:54.154239] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-22T22:15:54.156449] [DEBUG] [LOCAL ] TKR: Loaded 39247 existing records from primary storage. [2025-10-22T22:15:54.168044] [INFO ] [MAIN ] TKR: Loaded 39247 primary data records. [2025-10-22T22:15:54.172212] [DEBUG] [LOCAL ] TKC: Derivative data saved (1794 records). [2025-10-22T22:15:54.172460] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-22T22:15:54.205306] [INFO ] [MAIN ] Derivative Progress: 1798/2052 symbols completed. TKC took 1.1s. Estimated remaining: 1m 36s. Rate: 159.3 symbols/min [2025-10-22T22:15:54.490132] [DEBUG] [MAIN ] TKO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:54.490887] [INFO ] [MAIN ] TKO: Generated 1794 derivative records from 43490 primary records. [2025-10-22T22:15:54.491110] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-10-22T22:15:54.508197] [DEBUG] [LOCAL ] TKO: Derivative data saved (1794 records). [2025-10-22T22:15:54.508549] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-10-22T22:15:54.511108] [INFO ] [MAIN ] Derivative Progress: 1799/2052 symbols completed. TKO took 1.1s. Estimated remaining: 1m 35s. Rate: 159.3 symbols/min [2025-10-22T22:15:54.531945] [DEBUG] [MAIN ] TKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:54.532661] [INFO ] [MAIN ] TKR: Generated 1794 derivative records from 39247 primary records. [2025-10-22T22:15:54.532728] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-22T22:15:54.547755] [DEBUG] [LOCAL ] TKR: Derivative data saved (1794 records). [2025-10-22T22:15:54.547841] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-10-22T22:15:54.550893] [INFO ] [MAIN ] Derivative Progress: 1800/2052 symbols completed. TKR took 0.7s. Estimated remaining: 1m 35s. Rate: 159.4 symbols/min [2025-10-22T22:15:54.551314] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:54.551508] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:54.551665] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:54.581261] [DEBUG] [LOCAL ] TLYS: Loaded 16539 existing records from primary storage. [2025-10-22T22:15:54.581411] [INFO ] [MAIN ] TLYS: Loaded 16539 primary data records. [2025-10-22T22:15:54.721128] [DEBUG] [LOCAL ] TM: Loaded 36037 existing records from primary storage. [2025-10-22T22:15:54.723179] [DEBUG] [LOCAL ] TLK: Loaded 38709 existing records from primary storage. [2025-10-22T22:15:54.733728] [INFO ] [MAIN ] TLK: Loaded 38709 primary data records. [2025-10-22T22:15:54.749711] [INFO ] [MAIN ] TM: Loaded 36037 primary data records. [2025-10-22T22:15:55.573234] [DEBUG] [MAIN ] TLYS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:55.574374] [INFO ] [MAIN ] TLYS: Generated 1794 derivative records from 16539 primary records. [2025-10-22T22:15:55.575780] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-22T22:15:55.591512] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1794 records). [2025-10-22T22:15:55.591740] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-22T22:15:55.593835] [INFO ] [MAIN ] Derivative Progress: 1801/2052 symbols completed. TLYS took 1.0s. Estimated remaining: 1m 35s. Rate: 159.2 symbols/min [2025-10-22T22:15:55.594233] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:55.626742] [DEBUG] [MAIN ] TM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:55.627566] [INFO ] [MAIN ] TM: Generated 1794 derivative records from 36037 primary records. [2025-10-22T22:15:55.627746] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-22T22:15:55.626541] [DEBUG] [MAIN ] TLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:55.628309] [INFO ] [MAIN ] TLK: Generated 1794 derivative records from 38709 primary records. [2025-10-22T22:15:55.628682] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-22T22:15:55.656229] [DEBUG] [LOCAL ] TM: Derivative data saved (1794 records). [2025-10-22T22:15:55.658574] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-22T22:15:55.661936] [INFO ] [MAIN ] Derivative Progress: 1802/2052 symbols completed. TM took 1.1s. Estimated remaining: 1m 34s. Rate: 159.3 symbols/min [2025-10-22T22:15:55.662247] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:55.663721] [DEBUG] [LOCAL ] TLK: Derivative data saved (1794 records). [2025-10-22T22:15:55.664022] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-22T22:15:55.666733] [INFO ] [MAIN ] Derivative Progress: 1803/2052 symbols completed. TLK took 1.1s. Estimated remaining: 1m 34s. Rate: 159.4 symbols/min [2025-10-22T22:15:55.667130] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:55.718223] [DEBUG] [LOCAL ] TME: Loaded 53197 existing records from primary storage. [2025-10-22T22:15:55.718521] [INFO ] [MAIN ] TME: Loaded 53197 primary data records. [2025-10-22T22:15:55.850016] [DEBUG] [LOCAL ] TMHC: Loaded 45657 existing records from primary storage. [2025-10-22T22:15:55.855729] [INFO ] [MAIN ] TMHC: Loaded 45657 primary data records. [2025-10-22T22:15:56.156425] [DEBUG] [LOCAL ] TMO: Loaded 52400 existing records from primary storage. [2025-10-22T22:15:56.160589] [INFO ] [MAIN ] TMO: Loaded 52400 primary data records. [2025-10-22T22:15:56.757798] [DEBUG] [MAIN ] TME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:56.758867] [INFO ] [MAIN ] TME: Generated 1794 derivative records from 53197 primary records. [2025-10-22T22:15:56.760336] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-22T22:15:56.788940] [DEBUG] [MAIN ] TMHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:56.793252] [DEBUG] [LOCAL ] TME: Derivative data saved (1794 records). [2025-10-22T22:15:56.793679] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-22T22:15:56.794429] [INFO ] [MAIN ] TMHC: Generated 1794 derivative records from 45657 primary records. [2025-10-22T22:15:56.796812] [INFO ] [MAIN ] Derivative Progress: 1804/2052 symbols completed. TME took 1.2s. Estimated remaining: 1m 33s. Rate: 159.2 symbols/min [2025-10-22T22:15:56.797160] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:56.797913] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-22T22:15:56.814425] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1794 records). [2025-10-22T22:15:56.814752] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-22T22:15:56.817425] [INFO ] [MAIN ] Derivative Progress: 1805/2052 symbols completed. TMHC took 1.2s. Estimated remaining: 1m 33s. Rate: 159.3 symbols/min [2025-10-22T22:15:56.817744] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:56.838135] [DEBUG] [MAIN ] TMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:56.843559] [DEBUG] [LOCAL ] TNC: Loaded 14163 existing records from primary storage. [2025-10-22T22:15:56.844684] [INFO ] [MAIN ] TNC: Loaded 14163 primary data records. [2025-10-22T22:15:56.844420] [INFO ] [MAIN ] TMO: Generated 1794 derivative records from 52400 primary records. [2025-10-22T22:15:56.844803] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-22T22:15:56.990692] [DEBUG] [LOCAL ] TMO: Derivative data saved (1794 records). [2025-10-22T22:15:57.015260] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-22T22:15:57.059222] [INFO ] [MAIN ] Derivative Progress: 1806/2052 symbols completed. TMO took 1.4s. Estimated remaining: 1m 33s. Rate: 159.3 symbols/min [2025-10-22T22:15:57.166794] [DEBUG] [LOCAL ] TNET: Loaded 28176 existing records from primary storage. [2025-10-22T22:15:57.180915] [INFO ] [MAIN ] TNET: Loaded 28176 primary data records. [2025-10-22T22:15:57.172161] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:57.510548] [DEBUG] [LOCAL ] TNK: Loaded 35270 existing records from primary storage. [2025-10-22T22:15:57.512472] [INFO ] [MAIN ] TNK: Loaded 35270 primary data records. [2025-10-22T22:15:57.602298] [DEBUG] [MAIN ] TNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:57.627394] [INFO ] [MAIN ] TNC: Generated 1794 derivative records from 14163 primary records. [2025-10-22T22:15:57.630924] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-22T22:15:57.719026] [DEBUG] [LOCAL ] TNC: Derivative data saved (1794 records). [2025-10-22T22:15:57.724821] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-22T22:15:57.842593] [INFO ] [MAIN ] Derivative Progress: 1807/2052 symbols completed. TNC took 1.0s. Estimated remaining: 1m 32s. Rate: 159.2 symbols/min [2025-10-22T22:15:57.843727] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:57.859810] [DEBUG] [MAIN ] TNET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:57.861422] [INFO ] [MAIN ] TNET: Generated 1794 derivative records from 28176 primary records. [2025-10-22T22:15:57.861733] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-22T22:15:57.878473] [DEBUG] [LOCAL ] TNET: Derivative data saved (1794 records). [2025-10-22T22:15:57.878745] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-22T22:15:57.881221] [INFO ] [MAIN ] Derivative Progress: 1808/2052 symbols completed. TNET took 1.1s. Estimated remaining: 1m 32s. Rate: 159.3 symbols/min [2025-10-22T22:15:57.881932] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:57.912161] [DEBUG] [MAIN ] TNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:57.912899] [INFO ] [MAIN ] TNK: Generated 1794 derivative records from 35270 primary records. [2025-10-22T22:15:57.913001] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-22T22:15:57.928782] [DEBUG] [LOCAL ] TNK: Derivative data saved (1794 records). [2025-10-22T22:15:57.940374] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-22T22:15:57.944143] [INFO ] [MAIN ] Derivative Progress: 1809/2052 symbols completed. TNK took 0.8s. Estimated remaining: 1m 31s. Rate: 159.4 symbols/min [2025-10-22T22:15:57.944364] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:57.945508] [DEBUG] [LOCAL ] TNL: Loaded 41725 existing records from primary storage. [2025-10-22T22:15:57.946102] [INFO ] [MAIN ] TNL: Loaded 41725 primary data records. [2025-10-22T22:15:58.270528] [DEBUG] [LOCAL ] TOL: Loaded 50535 existing records from primary storage. [2025-10-22T22:15:58.293321] [INFO ] [MAIN ] TOL: Loaded 50535 primary data records. [2025-10-22T22:15:58.432441] [DEBUG] [LOCAL ] TOST: Loaded 53690 existing records from primary storage. [2025-10-22T22:15:58.443148] [INFO ] [MAIN ] TOST: Loaded 53690 primary data records. [2025-10-22T22:15:58.972943] [DEBUG] [MAIN ] TNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:58.974378] [INFO ] [MAIN ] TNL: Generated 1794 derivative records from 41725 primary records. [2025-10-22T22:15:58.974807] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-22T22:15:58.992364] [DEBUG] [LOCAL ] TNL: Derivative data saved (1794 records). [2025-10-22T22:15:58.992847] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-22T22:15:58.995015] [INFO ] [MAIN ] Derivative Progress: 1810/2052 symbols completed. TNL took 1.2s. Estimated remaining: 1m 31s. Rate: 159.2 symbols/min [2025-10-22T22:15:58.995355] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:59.012801] [DEBUG] [MAIN ] TOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:59.015078] [INFO ] [MAIN ] TOL: Generated 1794 derivative records from 50535 primary records. [2025-10-22T22:15:59.016016] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-22T22:15:59.037125] [DEBUG] [MAIN ] TOST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:15:59.052811] [INFO ] [MAIN ] TOST: Generated 1794 derivative records from 53690 primary records. [2025-10-22T22:15:59.052969] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-22T22:15:59.051971] [DEBUG] [LOCAL ] TOL: Derivative data saved (1794 records). [2025-10-22T22:15:59.060696] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-22T22:15:59.063136] [INFO ] [MAIN ] Derivative Progress: 1811/2052 symbols completed. TOL took 1.2s. Estimated remaining: 1m 31s. Rate: 159.3 symbols/min [2025-10-22T22:15:59.063507] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:59.079406] [DEBUG] [LOCAL ] TPB: Loaded 26309 existing records from primary storage. [2025-10-22T22:15:59.080695] [INFO ] [MAIN ] TPB: Loaded 26309 primary data records. [2025-10-22T22:15:59.080615] [DEBUG] [LOCAL ] TOST: Derivative data saved (1794 records). [2025-10-22T22:15:59.080900] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-10-22T22:15:59.089053] [INFO ] [MAIN ] Derivative Progress: 1812/2052 symbols completed. TOST took 1.1s. Estimated remaining: 1m 30s. Rate: 159.4 symbols/min [2025-10-22T22:15:59.095576] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:15:59.428839] [DEBUG] [LOCAL ] TPC: Loaded 39105 existing records from primary storage. [2025-10-22T22:15:59.442710] [INFO ] [MAIN ] TPC: Loaded 39105 primary data records. [2025-10-22T22:15:59.443687] [DEBUG] [LOCAL ] TPH: Loaded 44779 existing records from primary storage. [2025-10-22T22:15:59.475679] [INFO ] [MAIN ] TPH: Loaded 44779 primary data records. [2025-10-22T22:16:00.099540] [DEBUG] [MAIN ] TPB: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:16:00.101078] [INFO ] [MAIN ] TPB: Generated 1793 derivative records from 26309 primary records. [2025-10-22T22:16:00.101234] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-22T22:16:00.120182] [DEBUG] [LOCAL ] TPB: Derivative data saved (1793 records). [2025-10-22T22:16:00.121153] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-22T22:16:00.124020] [INFO ] [MAIN ] Derivative Progress: 1813/2052 symbols completed. TPB took 1.1s. Estimated remaining: 1m 30s. Rate: 159.2 symbols/min [2025-10-22T22:16:00.145630] [DEBUG] [MAIN ] TPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:00.146399] [INFO ] [MAIN ] TPH: Generated 1794 derivative records from 44779 primary records. [2025-10-22T22:16:00.158282] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-22T22:16:00.158963] [DEBUG] [MAIN ] TPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:00.159754] [INFO ] [MAIN ] TPC: Generated 1794 derivative records from 39105 primary records. [2025-10-22T22:16:00.159995] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-22T22:16:00.184008] [DEBUG] [LOCAL ] TPH: Derivative data saved (1794 records). [2025-10-22T22:16:00.188478] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-22T22:16:00.191756] [INFO ] [MAIN ] Derivative Progress: 1814/2052 symbols completed. TPH took 1.1s. Estimated remaining: 1m 30s. Rate: 159.3 symbols/min [2025-10-22T22:16:00.192861] [DEBUG] [LOCAL ] TPC: Derivative data saved (1794 records). [2025-10-22T22:16:00.192920] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-22T22:16:00.195529] [INFO ] [MAIN ] Derivative Progress: 1815/2052 symbols completed. TPC took 1.1s. Estimated remaining: 1m 29s. Rate: 159.4 symbols/min [2025-10-22T22:16:00.195883] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:00.195993] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:00.196070] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:00.213853] [DEBUG] [LOCAL ] TPL: Loaded 12262 existing records from primary storage. [2025-10-22T22:16:00.214060] [INFO ] [MAIN ] TPL: Loaded 12262 primary data records. [2025-10-22T22:16:00.362160] [DEBUG] [LOCAL ] TPVG: Loaded 27151 existing records from primary storage. [2025-10-22T22:16:00.419522] [INFO ] [MAIN ] TPVG: Loaded 27151 primary data records. [2025-10-22T22:16:00.597971] [DEBUG] [LOCAL ] TPR: Loaded 53368 existing records from primary storage. [2025-10-22T22:16:00.620112] [INFO ] [MAIN ] TPR: Loaded 53368 primary data records. [2025-10-22T22:16:01.220335] [DEBUG] [MAIN ] TPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:01.221534] [INFO ] [MAIN ] TPL: Generated 1794 derivative records from 12262 primary records. [2025-10-22T22:16:01.222068] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-22T22:16:01.239353] [DEBUG] [LOCAL ] TPL: Derivative data saved (1794 records). [2025-10-22T22:16:01.240535] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-10-22T22:16:01.243282] [INFO ] [MAIN ] Derivative Progress: 1816/2052 symbols completed. TPL took 1.0s. Estimated remaining: 1m 29s. Rate: 159.2 symbols/min [2025-10-22T22:16:01.243524] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:01.263127] [DEBUG] [MAIN ] TPVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:01.266540] [INFO ] [MAIN ] TPVG: Generated 1794 derivative records from 27151 primary records. [2025-10-22T22:16:01.266831] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-22T22:16:01.282699] [DEBUG] [LOCAL ] TPYP: Loaded 7866 existing records from primary storage. [2025-10-22T22:16:01.288710] [INFO ] [MAIN ] TPYP: Loaded 7866 primary data records. [2025-10-22T22:16:01.290415] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1794 records). [2025-10-22T22:16:01.344998] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-22T22:16:01.389996] [INFO ] [MAIN ] Derivative Progress: 1817/2052 symbols completed. TPVG took 1.2s. Estimated remaining: 1m 29s. Rate: 159.3 symbols/min [2025-10-22T22:16:01.408973] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:01.390388] [DEBUG] [MAIN ] TPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:01.409835] [INFO ] [MAIN ] TPR: Generated 1794 derivative records from 53368 primary records. [2025-10-22T22:16:01.410343] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-22T22:16:01.473786] [DEBUG] [LOCAL ] TPZ: Loaded 4600 existing records from primary storage. [2025-10-22T22:16:01.500963] [INFO ] [MAIN ] TPZ: Loaded 4600 primary data records. [2025-10-22T22:16:01.616247] [DEBUG] [LOCAL ] TPR: Derivative data saved (1794 records). [2025-10-22T22:16:01.642311] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-22T22:16:01.692219] [INFO ] [MAIN ] Derivative Progress: 1818/2052 symbols completed. TPR took 1.5s. Estimated remaining: 1m 28s. Rate: 159.3 symbols/min [2025-10-22T22:16:01.720637] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:01.968246] [DEBUG] [LOCAL ] TR: Loaded 19117 existing records from primary storage. [2025-10-22T22:16:01.968606] [INFO ] [MAIN ] TR: Loaded 19117 primary data records. [2025-10-22T22:16:02.143945] [DEBUG] [MAIN ] TPYP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:02.254867] [INFO ] [MAIN ] TPYP: Generated 1794 derivative records from 7866 primary records. [2025-10-22T22:16:02.298299] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-22T22:16:02.326927] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1794 records). [2025-10-22T22:16:02.327222] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-22T22:16:02.330296] [INFO ] [MAIN ] Derivative Progress: 1819/2052 symbols completed. TPYP took 1.1s. Estimated remaining: 1m 28s. Rate: 159.3 symbols/min [2025-10-22T22:16:02.330791] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:02.360457] [DEBUG] [LOCAL ] TRAK: Loaded 9585 existing records from primary storage. [2025-10-22T22:16:02.355923] [DEBUG] [MAIN ] TPZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:02.360849] [INFO ] [MAIN ] TRAK: Loaded 9585 primary data records. [2025-10-22T22:16:02.367387] [INFO ] [MAIN ] TPZ: Generated 1794 derivative records from 4600 primary records. [2025-10-22T22:16:02.418167] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-22T22:16:02.506636] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1794 records). [2025-10-22T22:16:02.528635] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-22T22:16:02.546150] [INFO ] [MAIN ] Derivative Progress: 1820/2052 symbols completed. TPZ took 1.1s. Estimated remaining: 1m 27s. Rate: 159.3 symbols/min [2025-10-22T22:16:02.565312] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:02.737907] [DEBUG] [MAIN ] TR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:02.738769] [INFO ] [MAIN ] TR: Generated 1794 derivative records from 19117 primary records. [2025-10-22T22:16:02.738834] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-22T22:16:02.755027] [DEBUG] [LOCAL ] TR: Derivative data saved (1794 records). [2025-10-22T22:16:02.759793] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-22T22:16:02.762905] [INFO ] [MAIN ] Derivative Progress: 1821/2052 symbols completed. TR took 1.0s. Estimated remaining: 1m 27s. Rate: 159.3 symbols/min [2025-10-22T22:16:02.763149] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:02.771376] [DEBUG] [LOCAL ] TRC: Loaded 15391 existing records from primary storage. [2025-10-22T22:16:02.771602] [INFO ] [MAIN ] TRC: Loaded 15391 primary data records. [2025-10-22T22:16:03.109468] [DEBUG] [LOCAL ] TREX: Loaded 49790 existing records from primary storage. [2025-10-22T22:16:03.114348] [INFO ] [MAIN ] TREX: Loaded 49790 primary data records. [2025-10-22T22:16:03.115971] [DEBUG] [MAIN ] TRAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:03.147279] [INFO ] [MAIN ] TRAK: Generated 1794 derivative records from 9585 primary records. [2025-10-22T22:16:03.180539] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-22T22:16:03.241032] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1794 records). [2025-10-22T22:16:03.275628] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-22T22:16:03.419413] [INFO ] [MAIN ] Derivative Progress: 1822/2052 symbols completed. TRAK took 1.1s. Estimated remaining: 1m 27s. Rate: 159.3 symbols/min [2025-10-22T22:16:03.433775] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:03.453176] [DEBUG] [MAIN ] TRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:03.454079] [INFO ] [MAIN ] TRC: Generated 1794 derivative records from 15391 primary records. [2025-10-22T22:16:03.454236] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-22T22:16:03.472229] [DEBUG] [LOCAL ] TRC: Derivative data saved (1794 records). [2025-10-22T22:16:03.472793] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-22T22:16:03.475385] [INFO ] [MAIN ] Derivative Progress: 1823/2052 symbols completed. TRC took 0.9s. Estimated remaining: 1m 26s. Rate: 159.3 symbols/min [2025-10-22T22:16:03.475543] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:03.509407] [DEBUG] [MAIN ] TREX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:03.510235] [INFO ] [MAIN ] TREX: Generated 1794 derivative records from 49790 primary records. [2025-10-22T22:16:03.510414] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-22T22:16:03.539085] [DEBUG] [LOCAL ] TREX: Derivative data saved (1794 records). [2025-10-22T22:16:03.539515] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-22T22:16:03.555369] [INFO ] [MAIN ] Derivative Progress: 1824/2052 symbols completed. TREX took 0.8s. Estimated remaining: 1m 26s. Rate: 159.4 symbols/min [2025-10-22T22:16:03.566605] [DEBUG] [LOCAL ] TRGP: Loaded 50729 existing records from primary storage. [2025-10-22T22:16:03.567735] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:03.568879] [DEBUG] [LOCAL ] TRN: Loaded 36276 existing records from primary storage. [2025-10-22T22:16:03.567957] [INFO ] [MAIN ] TRGP: Loaded 50729 primary data records. [2025-10-22T22:16:03.569059] [INFO ] [MAIN ] TRN: Loaded 36276 primary data records. [2025-10-22T22:16:04.174351] [DEBUG] [LOCAL ] TRNO: Loaded 43615 existing records from primary storage. [2025-10-22T22:16:04.175773] [INFO ] [MAIN ] TRNO: Loaded 43615 primary data records. [2025-10-22T22:16:04.555927] [DEBUG] [MAIN ] TRGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:04.556689] [INFO ] [MAIN ] TRGP: Generated 1794 derivative records from 50729 primary records. [2025-10-22T22:16:04.555620] [DEBUG] [MAIN ] TRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:04.557417] [INFO ] [MAIN ] TRN: Generated 1794 derivative records from 36276 primary records. [2025-10-22T22:16:04.557596] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-22T22:16:04.557498] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-22T22:16:04.591386] [DEBUG] [LOCAL ] TRN: Derivative data saved (1794 records). [2025-10-22T22:16:04.591704] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-22T22:16:04.594105] [INFO ] [MAIN ] Derivative Progress: 1825/2052 symbols completed. TRN took 1.1s. Estimated remaining: 1m 26s. Rate: 159.2 symbols/min [2025-10-22T22:16:04.594673] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:04.597087] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1794 records). [2025-10-22T22:16:04.597192] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-10-22T22:16:04.599562] [INFO ] [MAIN ] Derivative Progress: 1826/2052 symbols completed. TRGP took 1.2s. Estimated remaining: 1m 25s. Rate: 159.3 symbols/min [2025-10-22T22:16:04.600039] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:04.619060] [DEBUG] [MAIN ] TRNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:04.620101] [INFO ] [MAIN ] TRNO: Generated 1794 derivative records from 43615 primary records. [2025-10-22T22:16:04.620250] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-22T22:16:04.638367] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1794 records). [2025-10-22T22:16:04.638519] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-22T22:16:04.641018] [INFO ] [MAIN ] Derivative Progress: 1827/2052 symbols completed. TRNO took 1.1s. Estimated remaining: 1m 25s. Rate: 159.4 symbols/min [2025-10-22T22:16:04.641357] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:04.686736] [DEBUG] [LOCAL ] TROX: Loaded 52233 existing records from primary storage. [2025-10-22T22:16:04.686996] [INFO ] [MAIN ] TROX: Loaded 52233 primary data records. [2025-10-22T22:16:04.814203] [DEBUG] [LOCAL ] TRP: Loaded 52127 existing records from primary storage. [2025-10-22T22:16:04.829590] [INFO ] [MAIN ] TRP: Loaded 52127 primary data records. [2025-10-22T22:16:04.864150] [DEBUG] [LOCAL ] TRTX: Loaded 36901 existing records from primary storage. [2025-10-22T22:16:04.900804] [INFO ] [MAIN ] TRTX: Loaded 36901 primary data records. [2025-10-22T22:16:05.642274] [DEBUG] [MAIN ] TROX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:05.643093] [INFO ] [MAIN ] TROX: Generated 1794 derivative records from 52233 primary records. [2025-10-22T22:16:05.643204] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-22T22:16:05.661007] [DEBUG] [LOCAL ] TROX: Derivative data saved (1794 records). [2025-10-22T22:16:05.661417] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-22T22:16:05.663514] [INFO ] [MAIN ] Derivative Progress: 1828/2052 symbols completed. TROX took 1.1s. Estimated remaining: 1m 24s. Rate: 159.3 symbols/min [2025-10-22T22:16:05.684932] [DEBUG] [MAIN ] TRTX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:05.697990] [INFO ] [MAIN ] TRTX: Generated 1794 derivative records from 36901 primary records. [2025-10-22T22:16:05.698405] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-22T22:16:05.698327] [DEBUG] [MAIN ] TRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:05.699979] [INFO ] [MAIN ] TRP: Generated 1794 derivative records from 52127 primary records. [2025-10-22T22:16:05.700078] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-22T22:16:05.730790] [DEBUG] [LOCAL ] TRP: Derivative data saved (1794 records). [2025-10-22T22:16:05.731280] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1794 records). [2025-10-22T22:16:05.731379] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-10-22T22:16:05.731218] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-22T22:16:05.734152] [INFO ] [MAIN ] Derivative Progress: 1829/2052 symbols completed. TRTX took 1.1s. Estimated remaining: 1m 24s. Rate: 159.3 symbols/min [2025-10-22T22:16:05.737763] [INFO ] [MAIN ] Derivative Progress: 1830/2052 symbols completed. TRP took 1.1s. Estimated remaining: 1m 24s. Rate: 159.4 symbols/min [2025-10-22T22:16:05.738260] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:05.738794] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:05.738325] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:05.809507] [DEBUG] [LOCAL ] TRU: Loaded 51459 existing records from primary storage. [2025-10-22T22:16:05.809851] [INFO ] [MAIN ] TRU: Loaded 51459 primary data records. [2025-10-22T22:16:05.941407] [DEBUG] [LOCAL ] TRV: Loaded 47467 existing records from primary storage. [2025-10-22T22:16:05.942338] [INFO ] [MAIN ] TRV: Loaded 47467 primary data records. [2025-10-22T22:16:05.942229] [DEBUG] [LOCAL ] TS: Loaded 51646 existing records from primary storage. [2025-10-22T22:16:05.965547] [INFO ] [MAIN ] TS: Loaded 51646 primary data records. [2025-10-22T22:16:06.816376] [DEBUG] [MAIN ] TRU: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:16:06.818618] [INFO ] [MAIN ] TRU: Generated 1793 derivative records from 51459 primary records. [2025-10-22T22:16:06.832374] [DEBUG] [MAIN ] TRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:06.833049] [INFO ] [MAIN ] TRV: Generated 1794 derivative records from 47467 primary records. [2025-10-22T22:16:06.833185] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-22T22:16:06.831562] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-22T22:16:06.857602] [DEBUG] [LOCAL ] TRV: Derivative data saved (1794 records). [2025-10-22T22:16:06.862883] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-22T22:16:06.876534] [INFO ] [MAIN ] Derivative Progress: 1831/2052 symbols completed. TRV took 1.1s. Estimated remaining: 1m 23s. Rate: 159.2 symbols/min [2025-10-22T22:16:06.878022] [DEBUG] [MAIN ] TS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:06.881065] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:06.882126] [DEBUG] [LOCAL ] TRU: Derivative data saved (1793 records). [2025-10-22T22:16:06.878891] [INFO ] [MAIN ] TS: Generated 1794 derivative records from 51646 primary records. [2025-10-22T22:16:06.882693] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-22T22:16:06.882336] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-22T22:16:06.884570] [INFO ] [MAIN ] Derivative Progress: 1832/2052 symbols completed. TRU took 1.1s. Estimated remaining: 1m 23s. Rate: 159.3 symbols/min [2025-10-22T22:16:06.885125] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:06.902340] [DEBUG] [LOCAL ] TS: Derivative data saved (1794 records). [2025-10-22T22:16:06.902581] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-22T22:16:06.905195] [INFO ] [MAIN ] Derivative Progress: 1833/2052 symbols completed. TS took 1.2s. Estimated remaining: 1m 22s. Rate: 159.4 symbols/min [2025-10-22T22:16:06.905459] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:06.935138] [DEBUG] [LOCAL ] TSE: Loaded 27651 existing records from primary storage. [2025-10-22T22:16:06.935274] [INFO ] [MAIN ] TSE: Loaded 27651 primary data records. [2025-10-22T22:16:07.053853] [DEBUG] [LOCAL ] TSLX: Loaded 35762 existing records from primary storage. [2025-10-22T22:16:07.054175] [INFO ] [MAIN ] TSLX: Loaded 35762 primary data records. [2025-10-22T22:16:07.284178] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-22T22:16:07.438392] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-10-22T22:16:07.903339] [DEBUG] [MAIN ] TSE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:07.904394] [INFO ] [MAIN ] TSE: Generated 1794 derivative records from 27651 primary records. [2025-10-22T22:16:07.904481] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-22T22:16:07.924805] [DEBUG] [LOCAL ] TSE: Derivative data saved (1794 records). [2025-10-22T22:16:07.925330] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-22T22:16:07.933069] [INFO ] [MAIN ] Derivative Progress: 1834/2052 symbols completed. TSE took 1.1s. Estimated remaining: 1m 22s. Rate: 159.3 symbols/min [2025-10-22T22:16:07.939069] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:07.947084] [DEBUG] [MAIN ] TSLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:07.948333] [INFO ] [MAIN ] TSLX: Generated 1794 derivative records from 35762 primary records. [2025-10-22T22:16:07.948685] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-22T22:16:07.967604] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1794 records). [2025-10-22T22:16:07.968011] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-22T22:16:07.970753] [INFO ] [MAIN ] Derivative Progress: 1835/2052 symbols completed. TSLX took 1.1s. Estimated remaining: 1m 22s. Rate: 159.3 symbols/min [2025-10-22T22:16:07.971111] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:07.984051] [DEBUG] [MAIN ] TSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:07.984733] [INFO ] [MAIN ] TSM: Generated 1794 derivative records from 53819 primary records. [2025-10-22T22:16:07.984845] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-22T22:16:08.013668] [DEBUG] [LOCAL ] TSM: Derivative data saved (1794 records). [2025-10-22T22:16:08.013858] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-22T22:16:08.016428] [INFO ] [MAIN ] Derivative Progress: 1836/2052 symbols completed. TSM took 1.1s. Estimated remaining: 1m 21s. Rate: 159.4 symbols/min [2025-10-22T22:16:08.019579] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:08.025605] [DEBUG] [LOCAL ] TSQ: Loaded 11595 existing records from primary storage. [2025-10-22T22:16:08.025762] [INFO ] [MAIN ] TSQ: Loaded 11595 primary data records. [2025-10-22T22:16:08.166519] [DEBUG] [LOCAL ] TSN: Loaded 53088 existing records from primary storage. [2025-10-22T22:16:08.177353] [INFO ] [MAIN ] TSN: Loaded 53088 primary data records. [2025-10-22T22:16:08.542526] [DEBUG] [LOCAL ] TT: Loaded 47001 existing records from primary storage. [2025-10-22T22:16:08.566623] [INFO ] [MAIN ] TT: Loaded 47001 primary data records. [2025-10-22T22:16:09.076201] [DEBUG] [MAIN ] TSQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:09.077945] [INFO ] [MAIN ] TSQ: Generated 1794 derivative records from 11595 primary records. [2025-10-22T22:16:09.078146] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-22T22:16:09.094713] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1794 records). [2025-10-22T22:16:09.095388] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-22T22:16:09.097557] [INFO ] [MAIN ] Derivative Progress: 1837/2052 symbols completed. TSQ took 1.1s. Estimated remaining: 1m 21s. Rate: 159.3 symbols/min [2025-10-22T22:16:09.098971] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:09.116989] [DEBUG] [MAIN ] TSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:09.117957] [INFO ] [MAIN ] TSN: Generated 1794 derivative records from 53088 primary records. [2025-10-22T22:16:09.118215] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-22T22:16:09.134971] [DEBUG] [LOCAL ] TSN: Derivative data saved (1794 records). [2025-10-22T22:16:09.135335] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-22T22:16:09.138195] [INFO ] [MAIN ] Derivative Progress: 1838/2052 symbols completed. TSN took 1.2s. Estimated remaining: 1m 21s. Rate: 159.3 symbols/min [2025-10-22T22:16:09.138579] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:09.164692] [DEBUG] [MAIN ] TT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:09.165523] [INFO ] [MAIN ] TT: Generated 1794 derivative records from 47001 primary records. [2025-10-22T22:16:09.165735] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-22T22:16:09.181791] [DEBUG] [LOCAL ] TT: Derivative data saved (1794 records). [2025-10-22T22:16:09.182866] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-22T22:16:09.185739] [INFO ] [MAIN ] Derivative Progress: 1839/2052 symbols completed. TT took 1.2s. Estimated remaining: 1m 20s. Rate: 159.4 symbols/min [2025-10-22T22:16:09.196617] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:09.199225] [DEBUG] [LOCAL ] TTC: Loaded 41525 existing records from primary storage. [2025-10-22T22:16:09.199448] [INFO ] [MAIN ] TTC: Loaded 41525 primary data records. [2025-10-22T22:16:09.415790] [DEBUG] [LOCAL ] TTE: Loaded 51552 existing records from primary storage. [2025-10-22T22:16:09.421141] [INFO ] [MAIN ] TTE: Loaded 51552 primary data records. [2025-10-22T22:16:09.650464] [DEBUG] [LOCAL ] TTI: Loaded 46650 existing records from primary storage. [2025-10-22T22:16:09.654234] [INFO ] [MAIN ] TTI: Loaded 46650 primary data records. [2025-10-22T22:16:10.171723] [DEBUG] [MAIN ] TTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:10.173472] [INFO ] [MAIN ] TTC: Generated 1794 derivative records from 41525 primary records. [2025-10-22T22:16:10.174027] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-22T22:16:10.191880] [DEBUG] [LOCAL ] TTC: Derivative data saved (1794 records). [2025-10-22T22:16:10.192432] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-22T22:16:10.195012] [INFO ] [MAIN ] Derivative Progress: 1840/2052 symbols completed. TTC took 1.1s. Estimated remaining: 1m 20s. Rate: 159.3 symbols/min [2025-10-22T22:16:10.195298] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:10.218814] [DEBUG] [MAIN ] TTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:10.219676] [INFO ] [MAIN ] TTE: Generated 1794 derivative records from 51552 primary records. [2025-10-22T22:16:10.219939] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-22T22:16:10.239356] [DEBUG] [LOCAL ] TTE: Derivative data saved (1794 records). [2025-10-22T22:16:10.239551] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-22T22:16:10.241732] [INFO ] [MAIN ] Derivative Progress: 1841/2052 symbols completed. TTE took 1.1s. Estimated remaining: 1m 19s. Rate: 159.3 symbols/min [2025-10-22T22:16:10.241993] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:10.255713] [DEBUG] [MAIN ] TTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:10.256448] [INFO ] [MAIN ] TTI: Generated 1794 derivative records from 46650 primary records. [2025-10-22T22:16:10.256576] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-22T22:16:10.283190] [DEBUG] [LOCAL ] TTI: Derivative data saved (1794 records). [2025-10-22T22:16:10.283391] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-22T22:16:10.286014] [INFO ] [MAIN ] Derivative Progress: 1842/2052 symbols completed. TTI took 1.1s. Estimated remaining: 1m 19s. Rate: 159.4 symbols/min [2025-10-22T22:16:10.286191] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:10.315927] [DEBUG] [LOCAL ] TU: Loaded 49774 existing records from primary storage. [2025-10-22T22:16:10.316211] [INFO ] [MAIN ] TU: Loaded 49774 primary data records. [2025-10-22T22:16:10.444500] [DEBUG] [LOCAL ] TUYA: Loaded 45737 existing records from primary storage. [2025-10-22T22:16:10.444776] [INFO ] [MAIN ] TUYA: Loaded 45737 primary data records. [2025-10-22T22:16:10.644971] [DEBUG] [LOCAL ] TV: Loaded 41238 existing records from primary storage. [2025-10-22T22:16:10.742292] [INFO ] [MAIN ] TV: Loaded 41238 primary data records. [2025-10-22T22:16:11.314491] [DEBUG] [MAIN ] TU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:11.315488] [INFO ] [MAIN ] TU: Generated 1794 derivative records from 49774 primary records. [2025-10-22T22:16:11.315786] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-22T22:16:11.336660] [DEBUG] [LOCAL ] TU: Derivative data saved (1794 records). [2025-10-22T22:16:11.337098] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-22T22:16:11.339168] [INFO ] [MAIN ] Derivative Progress: 1843/2052 symbols completed. TU took 1.1s. Estimated remaining: 1m 19s. Rate: 159.3 symbols/min [2025-10-22T22:16:11.352520] [DEBUG] [MAIN ] TUYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:11.353593] [INFO ] [MAIN ] TUYA: Generated 1794 derivative records from 45737 primary records. [2025-10-22T22:16:11.353854] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-22T22:16:11.372778] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1794 records). [2025-10-22T22:16:11.373173] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-22T22:16:11.376448] [INFO ] [MAIN ] Derivative Progress: 1844/2052 symbols completed. TUYA took 1.1s. Estimated remaining: 1m 18s. Rate: 159.3 symbols/min [2025-10-22T22:16:11.389219] [DEBUG] [MAIN ] TV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:11.389894] [INFO ] [MAIN ] TV: Generated 1794 derivative records from 41238 primary records. [2025-10-22T22:16:11.389955] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-22T22:16:11.404745] [DEBUG] [LOCAL ] TV: Derivative data saved (1794 records). [2025-10-22T22:16:11.404825] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-22T22:16:11.407486] [INFO ] [MAIN ] Derivative Progress: 1845/2052 symbols completed. TV took 1.1s. Estimated remaining: 1m 18s. Rate: 159.4 symbols/min [2025-10-22T22:16:11.407932] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:11.408038] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:11.408152] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:11.418024] [DEBUG] [LOCAL ] TVC: Loaded 3118 existing records from primary storage. [2025-10-22T22:16:11.418393] [INFO ] [MAIN ] TVC: Loaded 3118 primary data records. [2025-10-22T22:16:11.417804] [DEBUG] [LOCAL ] TVE: Loaded 2547 existing records from primary storage. [2025-10-22T22:16:11.449038] [INFO ] [MAIN ] TVE: Loaded 2547 primary data records. [2025-10-22T22:16:11.747996] [DEBUG] [LOCAL ] TWI: Loaded 33814 existing records from primary storage. [2025-10-22T22:16:11.885036] [INFO ] [MAIN ] TWI: Loaded 33814 primary data records. [2025-10-22T22:16:12.412409] [DEBUG] [MAIN ] TVC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:12.413573] [INFO ] [MAIN ] TVC: Generated 1794 derivative records from 3118 primary records. [2025-10-22T22:16:12.414359] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-22T22:16:12.428215] [DEBUG] [MAIN ] TVE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:12.429671] [INFO ] [MAIN ] TVE: Generated 1794 derivative records from 2547 primary records. [2025-10-22T22:16:12.435538] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-22T22:16:12.459307] [DEBUG] [LOCAL ] TVE: Derivative data saved (1794 records). [2025-10-22T22:16:12.459558] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-10-22T22:16:12.458993] [DEBUG] [LOCAL ] TVC: Derivative data saved (1794 records). [2025-10-22T22:16:12.459893] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-22T22:16:12.462449] [INFO ] [MAIN ] Derivative Progress: 1846/2052 symbols completed. TVE took 1.1s. Estimated remaining: 1m 18s. Rate: 159.3 symbols/min [2025-10-22T22:16:12.465198] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:12.465352] [INFO ] [MAIN ] Derivative Progress: 1847/2052 symbols completed. TVC took 1.1s. Estimated remaining: 1m 17s. Rate: 159.3 symbols/min [2025-10-22T22:16:12.465959] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:12.487077] [DEBUG] [LOCAL ] TWN: Loaded 3211 existing records from primary storage. [2025-10-22T22:16:12.487344] [INFO ] [MAIN ] TWN: Loaded 3211 primary data records. [2025-10-22T22:16:12.486850] [DEBUG] [MAIN ] TWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:12.499706] [INFO ] [MAIN ] TWI: Generated 1794 derivative records from 33814 primary records. [2025-10-22T22:16:12.509743] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-22T22:16:12.609016] [DEBUG] [LOCAL ] TWI: Derivative data saved (1794 records). [2025-10-22T22:16:12.624790] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-10-22T22:16:12.633436] [INFO ] [MAIN ] Derivative Progress: 1848/2052 symbols completed. TWI took 1.2s. Estimated remaining: 1m 17s. Rate: 159.4 symbols/min [2025-10-22T22:16:12.633605] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:12.832339] [DEBUG] [LOCAL ] TWLO: Loaded 52813 existing records from primary storage. [2025-10-22T22:16:12.832696] [INFO ] [MAIN ] TWLO: Loaded 52813 primary data records. [2025-10-22T22:16:13.149117] [DEBUG] [LOCAL ] TWO: Loaded 48553 existing records from primary storage. [2025-10-22T22:16:13.162606] [INFO ] [MAIN ] TWO: Loaded 48553 primary data records. [2025-10-22T22:16:13.485778] [DEBUG] [MAIN ] TWN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:13.486797] [INFO ] [MAIN ] TWN: Generated 1794 derivative records from 3211 primary records. [2025-10-22T22:16:13.487074] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-22T22:16:13.504572] [DEBUG] [LOCAL ] TWN: Derivative data saved (1794 records). [2025-10-22T22:16:13.506280] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-22T22:16:13.509785] [INFO ] [MAIN ] Derivative Progress: 1849/2052 symbols completed. TWN took 1.0s. Estimated remaining: 1m 16s. Rate: 159.3 symbols/min [2025-10-22T22:16:13.510027] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:13.525312] [DEBUG] [MAIN ] TWLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:13.526416] [INFO ] [MAIN ] TWLO: Generated 1794 derivative records from 52813 primary records. [2025-10-22T22:16:13.526674] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-22T22:16:13.543833] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1794 records). [2025-10-22T22:16:13.544118] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-10-22T22:16:13.546799] [INFO ] [MAIN ] Derivative Progress: 1850/2052 symbols completed. TWLO took 1.1s. Estimated remaining: 1m 16s. Rate: 159.4 symbols/min [2025-10-22T22:16:13.552803] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:13.576631] [DEBUG] [MAIN ] TWO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:13.577105] [DEBUG] [LOCAL ] TX: Loaded 23146 existing records from primary storage. [2025-10-22T22:16:13.577922] [INFO ] [MAIN ] TWO: Generated 1794 derivative records from 48553 primary records. [2025-10-22T22:16:13.578007] [INFO ] [MAIN ] TX: Loaded 23146 primary data records. [2025-10-22T22:16:13.578245] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-22T22:16:13.672238] [DEBUG] [LOCAL ] TWO: Derivative data saved (1794 records). [2025-10-22T22:16:13.693425] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-22T22:16:13.696244] [INFO ] [MAIN ] Derivative Progress: 1851/2052 symbols completed. TWO took 1.1s. Estimated remaining: 1m 16s. Rate: 159.4 symbols/min [2025-10-22T22:16:13.712339] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:13.909997] [DEBUG] [LOCAL ] TXNM: Loaded 42857 existing records from primary storage. [2025-10-22T22:16:13.917861] [INFO ] [MAIN ] TXNM: Loaded 42857 primary data records. [2025-10-22T22:16:13.925407] [DEBUG] [LOCAL ] TXO: Loaded 20043 existing records from primary storage. [2025-10-22T22:16:13.969141] [INFO ] [MAIN ] TXO: Loaded 20043 primary data records. [2025-10-22T22:16:14.593727] [DEBUG] [MAIN ] TX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:14.594763] [INFO ] [MAIN ] TX: Generated 1794 derivative records from 23146 primary records. [2025-10-22T22:16:14.595135] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-22T22:16:14.613347] [DEBUG] [LOCAL ] TX: Derivative data saved (1794 records). [2025-10-22T22:16:14.614570] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-10-22T22:16:14.617722] [INFO ] [MAIN ] Derivative Progress: 1852/2052 symbols completed. TX took 1.1s. Estimated remaining: 1m 15s. Rate: 159.3 symbols/min [2025-10-22T22:16:14.618945] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:14.633279] [DEBUG] [MAIN ] TXNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:14.634145] [INFO ] [MAIN ] TXNM: Generated 1794 derivative records from 42857 primary records. [2025-10-22T22:16:14.634414] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-10-22T22:16:14.653366] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1794 records). [2025-10-22T22:16:14.653549] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-10-22T22:16:14.656325] [INFO ] [MAIN ] Derivative Progress: 1853/2052 symbols completed. TXNM took 1.1s. Estimated remaining: 1m 15s. Rate: 159.4 symbols/min [2025-10-22T22:16:14.668894] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:14.670271] [DEBUG] [MAIN ] TXO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:14.671059] [INFO ] [MAIN ] TXO: Generated 1794 derivative records from 20043 primary records. [2025-10-22T22:16:14.671122] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-22T22:16:14.699180] [DEBUG] [LOCAL ] TXO: Derivative data saved (1794 records). [2025-10-22T22:16:14.699326] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-22T22:16:14.701888] [INFO ] [MAIN ] Derivative Progress: 1854/2052 symbols completed. TXO took 1.0s. Estimated remaining: 1m 15s. Rate: 159.4 symbols/min [2025-10-22T22:16:14.702088] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:14.706568] [DEBUG] [LOCAL ] TY: Loaded 7524 existing records from primary storage. [2025-10-22T22:16:14.706831] [INFO ] [MAIN ] TY: Loaded 7524 primary data records. [2025-10-22T22:16:14.826877] [DEBUG] [LOCAL ] TXT: Loaded 49510 existing records from primary storage. [2025-10-22T22:16:14.838190] [DEBUG] [LOCAL ] TYG: Loaded 13892 existing records from primary storage. [2025-10-22T22:16:14.853926] [INFO ] [MAIN ] TYG: Loaded 13892 primary data records. [2025-10-22T22:16:14.853843] [INFO ] [MAIN ] TXT: Loaded 49510 primary data records. [2025-10-22T22:16:15.658571] [DEBUG] [MAIN ] TY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:15.660802] [INFO ] [MAIN ] TY: Generated 1794 derivative records from 7524 primary records. [2025-10-22T22:16:15.661030] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-22T22:16:15.678262] [DEBUG] [LOCAL ] TY: Derivative data saved (1794 records). [2025-10-22T22:16:15.678378] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-10-22T22:16:15.680773] [INFO ] [MAIN ] Derivative Progress: 1855/2052 symbols completed. TY took 1.0s. Estimated remaining: 1m 14s. Rate: 159.3 symbols/min [2025-10-22T22:16:15.681026] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:15.698614] [DEBUG] [MAIN ] TYG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:15.699733] [INFO ] [MAIN ] TYG: Generated 1794 derivative records from 13892 primary records. [2025-10-22T22:16:15.699912] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-22T22:16:15.717387] [DEBUG] [LOCAL ] TYG: Derivative data saved (1794 records). [2025-10-22T22:16:15.718234] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-22T22:16:15.721266] [INFO ] [MAIN ] Derivative Progress: 1856/2052 symbols completed. TYG took 1.0s. Estimated remaining: 1m 14s. Rate: 159.4 symbols/min [2025-10-22T22:16:15.735473] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:15.741136] [DEBUG] [MAIN ] TXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:15.741935] [INFO ] [MAIN ] TXT: Generated 1794 derivative records from 49510 primary records. [2025-10-22T22:16:15.742183] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-22T22:16:15.758914] [DEBUG] [LOCAL ] TYL: Loaded 21988 existing records from primary storage. [2025-10-22T22:16:15.765694] [INFO ] [MAIN ] TYL: Loaded 21988 primary data records. [2025-10-22T22:16:15.766537] [DEBUG] [LOCAL ] TXT: Derivative data saved (1794 records). [2025-10-22T22:16:15.766811] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-10-22T22:16:15.790678] [INFO ] [MAIN ] Derivative Progress: 1857/2052 symbols completed. TXT took 1.2s. Estimated remaining: 1m 13s. Rate: 159.4 symbols/min [2025-10-22T22:16:15.833706] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:16.119150] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-22T22:16:16.120554] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-10-22T22:16:16.241982] [DEBUG] [LOCAL ] UA: Loaded 50473 existing records from primary storage. [2025-10-22T22:16:16.242229] [INFO ] [MAIN ] UA: Loaded 50473 primary data records. [2025-10-22T22:16:16.799902] [DEBUG] [MAIN ] TYL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:16.801490] [INFO ] [MAIN ] TYL: Generated 1794 derivative records from 21988 primary records. [2025-10-22T22:16:16.801791] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-22T22:16:16.820667] [DEBUG] [LOCAL ] TYL: Derivative data saved (1794 records). [2025-10-22T22:16:16.821199] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-22T22:16:16.823481] [INFO ] [MAIN ] Derivative Progress: 1858/2052 symbols completed. TYL took 1.1s. Estimated remaining: 1m 13s. Rate: 159.3 symbols/min [2025-10-22T22:16:16.841126] [DEBUG] [MAIN ] U: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:16.841779] [INFO ] [MAIN ] U: Generated 1794 derivative records from 53799 primary records. [2025-10-22T22:16:16.841923] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-22T22:16:16.858558] [DEBUG] [LOCAL ] U: Derivative data saved (1794 records). [2025-10-22T22:16:16.858690] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-22T22:16:16.861557] [INFO ] [MAIN ] Derivative Progress: 1859/2052 symbols completed. U took 1.1s. Estimated remaining: 1m 13s. Rate: 159.4 symbols/min [2025-10-22T22:16:16.875273] [DEBUG] [MAIN ] UA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:16.875860] [INFO ] [MAIN ] UA: Generated 1794 derivative records from 50473 primary records. [2025-10-22T22:16:16.875921] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-22T22:16:16.891326] [DEBUG] [LOCAL ] UA: Derivative data saved (1794 records). [2025-10-22T22:16:16.891388] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-22T22:16:16.894153] [INFO ] [MAIN ] Derivative Progress: 1860/2052 symbols completed. UA took 1.1s. Estimated remaining: 1m 12s. Rate: 159.5 symbols/min [2025-10-22T22:16:16.894867] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:16.894999] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:16.894936] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:16.902662] [DEBUG] [LOCAL ] UAN: Loaded 5302 existing records from primary storage. [2025-10-22T22:16:16.903023] [INFO ] [MAIN ] UAN: Loaded 5302 primary data records. [2025-10-22T22:16:17.236360] [DEBUG] [LOCAL ] UAA: Loaded 53498 existing records from primary storage. [2025-10-22T22:16:17.252166] [INFO ] [MAIN ] UAA: Loaded 53498 primary data records. [2025-10-22T22:16:17.253808] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-22T22:16:17.285823] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-10-22T22:16:17.869048] [DEBUG] [MAIN ] UAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:17.870663] [INFO ] [MAIN ] UAN: Generated 1794 derivative records from 5302 primary records. [2025-10-22T22:16:17.871395] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-22T22:16:17.888480] [DEBUG] [LOCAL ] UAN: Derivative data saved (1794 records). [2025-10-22T22:16:17.888811] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-22T22:16:17.891825] [INFO ] [MAIN ] Derivative Progress: 1861/2052 symbols completed. UAN took 1.0s. Estimated remaining: 1m 12s. Rate: 159.3 symbols/min [2025-10-22T22:16:17.892532] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:17.931695] [DEBUG] [MAIN ] UAA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:17.931879] [DEBUG] [MAIN ] UBER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:17.933036] [INFO ] [MAIN ] UAA: Generated 1794 derivative records from 53498 primary records. [2025-10-22T22:16:17.933122] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-22T22:16:17.933741] [INFO ] [MAIN ] UBER: Generated 1794 derivative records from 53806 primary records. [2025-10-22T22:16:17.934555] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-22T22:16:17.959854] [DEBUG] [LOCAL ] UAA: Derivative data saved (1794 records). [2025-10-22T22:16:17.964725] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-22T22:16:17.966844] [INFO ] [MAIN ] Derivative Progress: 1862/2052 symbols completed. UAA took 1.1s. Estimated remaining: 1m 12s. Rate: 159.4 symbols/min [2025-10-22T22:16:17.967305] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:17.987812] [DEBUG] [LOCAL ] UBER: Derivative data saved (1794 records). [2025-10-22T22:16:17.988067] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-22T22:16:17.991776] [INFO ] [MAIN ] Derivative Progress: 1863/2052 symbols completed. UBER took 1.1s. Estimated remaining: 1m 11s. Rate: 159.5 symbols/min [2025-10-22T22:16:17.992234] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:18.013688] [DEBUG] [LOCAL ] UBS: Loaded 52286 existing records from primary storage. [2025-10-22T22:16:18.014074] [INFO ] [MAIN ] UBS: Loaded 52286 primary data records. [2025-10-22T22:16:18.524911] [DEBUG] [LOCAL ] UDR: Loaded 52105 existing records from primary storage. [2025-10-22T22:16:18.526517] [INFO ] [MAIN ] UDR: Loaded 52105 primary data records. [2025-10-22T22:16:18.544116] [DEBUG] [LOCAL ] UE: Loaded 42468 existing records from primary storage. [2025-10-22T22:16:18.551187] [INFO ] [MAIN ] UE: Loaded 42468 primary data records. [2025-10-22T22:16:19.284340] [DEBUG] [MAIN ] UBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:19.286175] [INFO ] [MAIN ] UBS: Generated 1794 derivative records from 52286 primary records. [2025-10-22T22:16:19.288562] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-22T22:16:19.308800] [DEBUG] [LOCAL ] UBS: Derivative data saved (1794 records). [2025-10-22T22:16:19.309074] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-22T22:16:19.311354] [INFO ] [MAIN ] Derivative Progress: 1864/2052 symbols completed. UBS took 1.4s. Estimated remaining: 1m 11s. Rate: 159.2 symbols/min [2025-10-22T22:16:19.311603] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:19.325934] [DEBUG] [LOCAL ] UFI: Loaded 8232 existing records from primary storage. [2025-10-22T22:16:19.326322] [INFO ] [MAIN ] UFI: Loaded 8232 primary data records. [2025-10-22T22:16:19.350172] [DEBUG] [MAIN ] UDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:19.388112] [INFO ] [MAIN ] UDR: Generated 1794 derivative records from 52105 primary records. [2025-10-22T22:16:19.407570] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-22T22:16:19.428755] [DEBUG] [MAIN ] UE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:19.452391] [INFO ] [MAIN ] UE: Generated 1794 derivative records from 42468 primary records. [2025-10-22T22:16:19.455745] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-22T22:16:19.504424] [DEBUG] [LOCAL ] UDR: Derivative data saved (1794 records). [2025-10-22T22:16:19.505349] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-22T22:16:19.520823] [INFO ] [MAIN ] Derivative Progress: 1865/2052 symbols completed. UDR took 1.6s. Estimated remaining: 1m 10s. Rate: 159.3 symbols/min [2025-10-22T22:16:19.541456] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:19.651302] [DEBUG] [LOCAL ] UE: Derivative data saved (1794 records). [2025-10-22T22:16:19.676904] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-10-22T22:16:19.698608] [INFO ] [MAIN ] Derivative Progress: 1866/2052 symbols completed. UE took 1.7s. Estimated remaining: 1m 10s. Rate: 159.3 symbols/min [2025-10-22T22:16:19.699185] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:19.752927] [DEBUG] [MAIN ] UFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:19.754412] [INFO ] [MAIN ] UFI: Generated 1794 derivative records from 8232 primary records. [2025-10-22T22:16:19.754600] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-22T22:16:19.795617] [DEBUG] [LOCAL ] UFI: Derivative data saved (1794 records). [2025-10-22T22:16:19.795947] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-10-22T22:16:19.812032] [DEBUG] [LOCAL ] UGI: Loaded 50495 existing records from primary storage. [2025-10-22T22:16:19.810225] [INFO ] [MAIN ] Derivative Progress: 1867/2052 symbols completed. UFI took 0.5s. Estimated remaining: 1m 10s. Rate: 159.4 symbols/min [2025-10-22T22:16:19.812222] [INFO ] [MAIN ] UGI: Loaded 50495 primary data records. [2025-10-22T22:16:19.812365] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:19.813264] [DEBUG] [LOCAL ] UGP: Loaded 42993 existing records from primary storage. [2025-10-22T22:16:19.813477] [INFO ] [MAIN ] UGP: Loaded 42993 primary data records. [2025-10-22T22:16:20.060932] [DEBUG] [LOCAL ] UHAL: Loaded 16849 existing records from primary storage. [2025-10-22T22:16:20.082185] [INFO ] [MAIN ] UHAL: Loaded 16849 primary data records. [2025-10-22T22:16:20.831114] [DEBUG] [MAIN ] UGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:20.845406] [INFO ] [MAIN ] UGI: Generated 1794 derivative records from 50495 primary records. [2025-10-22T22:16:20.845792] [DEBUG] [MAIN ] UGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:20.846018] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-22T22:16:20.847605] [INFO ] [MAIN ] UGP: Generated 1794 derivative records from 42993 primary records. [2025-10-22T22:16:20.847718] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-22T22:16:20.885355] [DEBUG] [LOCAL ] UGP: Derivative data saved (1794 records). [2025-10-22T22:16:20.896124] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-22T22:16:20.904755] [INFO ] [MAIN ] Derivative Progress: 1868/2052 symbols completed. UGP took 1.2s. Estimated remaining: 1m 9s. Rate: 159.2 symbols/min [2025-10-22T22:16:20.906383] [DEBUG] [LOCAL ] UGI: Derivative data saved (1794 records). [2025-10-22T22:16:20.905810] [DEBUG] [MAIN ] UHAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:20.906617] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-22T22:16:20.908909] [INFO ] [MAIN ] Derivative Progress: 1869/2052 symbols completed. UGI took 1.4s. Estimated remaining: 1m 9s. Rate: 159.3 symbols/min [2025-10-22T22:16:20.906548] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:20.910484] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:20.910010] [INFO ] [MAIN ] UHAL: Generated 1794 derivative records from 16849 primary records. [2025-10-22T22:16:20.910998] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-22T22:16:20.932869] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1794 records). [2025-10-22T22:16:20.933119] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-22T22:16:20.938639] [INFO ] [MAIN ] Derivative Progress: 1870/2052 symbols completed. UHAL took 1.1s. Estimated remaining: 1m 9s. Rate: 159.4 symbols/min [2025-10-22T22:16:20.939014] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:20.945762] [DEBUG] [LOCAL ] UHT: Loaded 10210 existing records from primary storage. [2025-10-22T22:16:20.945998] [INFO ] [MAIN ] UHT: Loaded 10210 primary data records. [2025-10-22T22:16:21.126576] [DEBUG] [LOCAL ] UI: Loaded 14196 existing records from primary storage. [2025-10-22T22:16:21.133671] [DEBUG] [LOCAL ] UHS: Loaded 39620 existing records from primary storage. [2025-10-22T22:16:21.133899] [INFO ] [MAIN ] UI: Loaded 14196 primary data records. [2025-10-22T22:16:21.154439] [INFO ] [MAIN ] UHS: Loaded 39620 primary data records. [2025-10-22T22:16:21.945244] [DEBUG] [MAIN ] UHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:21.946537] [INFO ] [MAIN ] UHT: Generated 1794 derivative records from 10210 primary records. [2025-10-22T22:16:21.951062] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-22T22:16:21.981388] [DEBUG] [MAIN ] UI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:21.984606] [DEBUG] [LOCAL ] UHT: Derivative data saved (1794 records). [2025-10-22T22:16:21.984751] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-10-22T22:16:21.986911] [INFO ] [MAIN ] Derivative Progress: 1871/2052 symbols completed. UHT took 1.1s. Estimated remaining: 1m 8s. Rate: 159.2 symbols/min [2025-10-22T22:16:21.983852] [INFO ] [MAIN ] UI: Generated 1794 derivative records from 14196 primary records. [2025-10-22T22:16:21.987132] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:21.994870] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-22T22:16:22.000381] [DEBUG] [MAIN ] UHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:22.001665] [INFO ] [MAIN ] UHS: Generated 1794 derivative records from 39620 primary records. [2025-10-22T22:16:22.001836] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-22T22:16:22.026169] [DEBUG] [LOCAL ] UI: Derivative data saved (1794 records). [2025-10-22T22:16:22.027869] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-22T22:16:22.033087] [INFO ] [MAIN ] Derivative Progress: 1872/2052 symbols completed. UI took 1.1s. Estimated remaining: 1m 8s. Rate: 159.3 symbols/min [2025-10-22T22:16:22.037660] [DEBUG] [LOCAL ] UHS: Derivative data saved (1794 records). [2025-10-22T22:16:22.037990] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-22T22:16:22.040817] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:22.041125] [INFO ] [MAIN ] Derivative Progress: 1873/2052 symbols completed. UHS took 1.1s. Estimated remaining: 1m 7s. Rate: 159.4 symbols/min [2025-10-22T22:16:22.071261] [DEBUG] [LOCAL ] UIS: Loaded 36623 existing records from primary storage. [2025-10-22T22:16:22.071472] [INFO ] [MAIN ] UIS: Loaded 36623 primary data records. [2025-10-22T22:16:22.387436] [DEBUG] [LOCAL ] UL: Loaded 53069 existing records from primary storage. [2025-10-22T22:16:22.387697] [INFO ] [MAIN ] UL: Loaded 53069 primary data records. [2025-10-22T22:16:22.744203] [DEBUG] [MAIN ] UIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:22.744968] [INFO ] [MAIN ] UIS: Generated 1794 derivative records from 36623 primary records. [2025-10-22T22:16:22.745884] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-22T22:16:22.761917] [DEBUG] [LOCAL ] UIS: Derivative data saved (1794 records). [2025-10-22T22:16:22.762132] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-22T22:16:22.764403] [INFO ] [MAIN ] Derivative Progress: 1874/2052 symbols completed. UIS took 0.8s. Estimated remaining: 1m 7s. Rate: 159.3 symbols/min [2025-10-22T22:16:22.780310] [DEBUG] [MAIN ] UL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:22.780942] [INFO ] [MAIN ] UL: Generated 1794 derivative records from 53069 primary records. [2025-10-22T22:16:22.781002] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-22T22:16:22.795957] [DEBUG] [LOCAL ] UL: Derivative data saved (1794 records). [2025-10-22T22:16:22.796017] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-10-22T22:16:22.798322] [INFO ] [MAIN ] Derivative Progress: 1875/2052 symbols completed. UL took 0.8s. Estimated remaining: 1m 7s. Rate: 159.4 symbols/min [2025-10-22T22:16:22.798781] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:22.798708] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:22.798863] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:22.857080] [DEBUG] [LOCAL ] UMH: Loaded 34213 existing records from primary storage. [2025-10-22T22:16:22.867297] [INFO ] [MAIN ] UMH: Loaded 34213 primary data records. [2025-10-22T22:16:22.898554] [DEBUG] [LOCAL ] ULS: Loaded 38524 existing records from primary storage. [2025-10-22T22:16:22.922980] [INFO ] [MAIN ] ULS: Loaded 38524 primary data records. [2025-10-22T22:16:23.067298] [DEBUG] [LOCAL ] UMC: Loaded 52671 existing records from primary storage. [2025-10-22T22:16:23.091533] [INFO ] [MAIN ] UMC: Loaded 52671 primary data records. [2025-10-22T22:16:23.833974] [DEBUG] [MAIN ] ULS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:23.835450] [INFO ] [MAIN ] ULS: Generated 1794 derivative records from 38524 primary records. [2025-10-22T22:16:23.834549] [DEBUG] [MAIN ] UMH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:23.835811] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-22T22:16:23.836528] [INFO ] [MAIN ] UMH: Generated 1794 derivative records from 34213 primary records. [2025-10-22T22:16:23.837437] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-22T22:16:23.863673] [DEBUG] [LOCAL ] ULS: Derivative data saved (1794 records). [2025-10-22T22:16:23.884589] [DEBUG] [LOCAL ] UMH: Derivative data saved (1794 records). [2025-10-22T22:16:23.885121] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-22T22:16:23.884944] [DEBUG] [MAIN ] UMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:23.887569] [INFO ] [MAIN ] Derivative Progress: 1876/2052 symbols completed. ULS took 1.1s. Estimated remaining: 1m 6s. Rate: 159.2 symbols/min [2025-10-22T22:16:23.888343] [INFO ] [MAIN ] UMC: Generated 1794 derivative records from 52671 primary records. [2025-10-22T22:16:23.888538] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-22T22:16:23.888799] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:23.891070] [INFO ] [MAIN ] Derivative Progress: 1877/2052 symbols completed. UMH took 1.1s. Estimated remaining: 1m 6s. Rate: 159.3 symbols/min [2025-10-22T22:16:23.888696] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-22T22:16:23.892057] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:23.908166] [DEBUG] [LOCAL ] UMC: Derivative data saved (1794 records). [2025-10-22T22:16:23.908401] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-22T22:16:23.911098] [INFO ] [MAIN ] Derivative Progress: 1878/2052 symbols completed. UMC took 1.1s. Estimated remaining: 1m 5s. Rate: 159.4 symbols/min [2025-10-22T22:16:23.914385] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:23.922031] [DEBUG] [LOCAL ] UNF: Loaded 11751 existing records from primary storage. [2025-10-22T22:16:23.922265] [INFO ] [MAIN ] UNF: Loaded 11751 primary data records. [2025-10-22T22:16:24.269207] [DEBUG] [LOCAL ] UNFI: Loaded 42609 existing records from primary storage. [2025-10-22T22:16:24.282783] [INFO ] [MAIN ] UNFI: Loaded 42609 primary data records. [2025-10-22T22:16:24.415709] [DEBUG] [LOCAL ] UNH: Loaded 53819 existing records from primary storage. [2025-10-22T22:16:24.458190] [INFO ] [MAIN ] UNH: Loaded 53819 primary data records. [2025-10-22T22:16:24.857350] [DEBUG] [MAIN ] UNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:24.970511] [INFO ] [MAIN ] UNF: Generated 1794 derivative records from 11751 primary records. [2025-10-22T22:16:24.980292] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-22T22:16:25.004860] [DEBUG] [LOCAL ] UNF: Derivative data saved (1794 records). [2025-10-22T22:16:25.005086] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-10-22T22:16:25.007622] [INFO ] [MAIN ] Derivative Progress: 1879/2052 symbols completed. UNF took 1.1s. Estimated remaining: 1m 5s. Rate: 159.2 symbols/min [2025-10-22T22:16:25.007919] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:25.022933] [DEBUG] [MAIN ] UNFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:25.024019] [INFO ] [MAIN ] UNFI: Generated 1794 derivative records from 42609 primary records. [2025-10-22T22:16:25.024152] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-22T22:16:25.040894] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1794 records). [2025-10-22T22:16:25.041269] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-22T22:16:25.043384] [INFO ] [MAIN ] Derivative Progress: 1880/2052 symbols completed. UNFI took 1.2s. Estimated remaining: 1m 5s. Rate: 159.3 symbols/min [2025-10-22T22:16:25.043664] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:25.064627] [DEBUG] [LOCAL ] UNMA: Loaded 3413 existing records from primary storage. [2025-10-22T22:16:25.070092] [INFO ] [MAIN ] UNMA: Loaded 3413 primary data records. [2025-10-22T22:16:25.070306] [DEBUG] [MAIN ] UNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:25.071279] [INFO ] [MAIN ] UNH: Generated 1794 derivative records from 53819 primary records. [2025-10-22T22:16:25.091879] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-22T22:16:25.226327] [DEBUG] [LOCAL ] UNH: Derivative data saved (1794 records). [2025-10-22T22:16:25.269049] [DEBUG] [LOCAL ] UNM: Loaded 47961 existing records from primary storage. [2025-10-22T22:16:25.263077] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-22T22:16:25.287173] [INFO ] [MAIN ] UNM: Loaded 47961 primary data records. [2025-10-22T22:16:25.293397] [INFO ] [MAIN ] Derivative Progress: 1881/2052 symbols completed. UNH took 1.4s. Estimated remaining: 1m 4s. Rate: 159.3 symbols/min [2025-10-22T22:16:25.293601] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:25.751969] [DEBUG] [MAIN ] UNMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:25.753272] [INFO ] [MAIN ] UNMA: Generated 1794 derivative records from 3413 primary records. [2025-10-22T22:16:25.754157] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-22T22:16:25.784892] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1794 records). [2025-10-22T22:16:25.785178] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-22T22:16:25.788789] [DEBUG] [LOCAL ] UNP: Loaded 53362 existing records from primary storage. [2025-10-22T22:16:25.787506] [INFO ] [MAIN ] Derivative Progress: 1882/2052 symbols completed. UNMA took 0.7s. Estimated remaining: 1m 4s. Rate: 159.3 symbols/min [2025-10-22T22:16:25.789108] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:25.789379] [INFO ] [MAIN ] UNP: Loaded 53362 primary data records. [2025-10-22T22:16:26.112930] [DEBUG] [MAIN ] UNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:26.114259] [INFO ] [MAIN ] UNM: Generated 1794 derivative records from 47961 primary records. [2025-10-22T22:16:26.114439] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-22T22:16:26.145292] [DEBUG] [LOCAL ] UNM: Derivative data saved (1794 records). [2025-10-22T22:16:26.146581] [DEBUG] [LOCAL ] UP: Loaded 44436 existing records from primary storage. [2025-10-22T22:16:26.146834] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-22T22:16:26.146760] [INFO ] [MAIN ] UP: Loaded 44436 primary data records. [2025-10-22T22:16:26.149309] [INFO ] [MAIN ] Derivative Progress: 1883/2052 symbols completed. UNM took 1.1s. Estimated remaining: 1m 4s. Rate: 159.3 symbols/min [2025-10-22T22:16:26.149593] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:26.492607] [DEBUG] [MAIN ] UNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:26.493534] [INFO ] [MAIN ] UNP: Generated 1794 derivative records from 53362 primary records. [2025-10-22T22:16:26.493821] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-22T22:16:26.516039] [DEBUG] [LOCAL ] UNP: Derivative data saved (1794 records). [2025-10-22T22:16:26.532540] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-22T22:16:26.534998] [INFO ] [MAIN ] Derivative Progress: 1884/2052 symbols completed. UNP took 1.2s. Estimated remaining: 1m 3s. Rate: 159.3 symbols/min [2025-10-22T22:16:26.537112] [DEBUG] [LOCAL ] UPS: Loaded 53721 existing records from primary storage. [2025-10-22T22:16:26.535547] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:26.537659] [INFO ] [MAIN ] UPS: Loaded 53721 primary data records. [2025-10-22T22:16:26.678884] [DEBUG] [MAIN ] UP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:26.715744] [INFO ] [MAIN ] UP: Generated 1794 derivative records from 44436 primary records. [2025-10-22T22:16:26.755798] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-22T22:16:26.930075] [DEBUG] [LOCAL ] UP: Derivative data saved (1794 records). [2025-10-22T22:16:26.930357] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-22T22:16:26.934049] [INFO ] [MAIN ] Derivative Progress: 1885/2052 symbols completed. UP took 1.1s. Estimated remaining: 1m 3s. Rate: 159.3 symbols/min [2025-10-22T22:16:26.931352] [DEBUG] [LOCAL ] URI: Loaded 34264 existing records from primary storage. [2025-10-22T22:16:26.934439] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:26.935153] [INFO ] [MAIN ] URI: Loaded 34264 primary data records. [2025-10-22T22:16:27.267022] [DEBUG] [LOCAL ] USA: Loaded 36378 existing records from primary storage. [2025-10-22T22:16:27.268477] [INFO ] [MAIN ] USA: Loaded 36378 primary data records. [2025-10-22T22:16:27.369704] [DEBUG] [MAIN ] UPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:27.393794] [INFO ] [MAIN ] UPS: Generated 1794 derivative records from 53721 primary records. [2025-10-22T22:16:27.394024] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-10-22T22:16:27.466702] [DEBUG] [LOCAL ] UPS: Derivative data saved (1794 records). [2025-10-22T22:16:27.499256] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-10-22T22:16:27.618204] [INFO ] [MAIN ] Derivative Progress: 1886/2052 symbols completed. UPS took 1.5s. Estimated remaining: 1m 3s. Rate: 159.2 symbols/min [2025-10-22T22:16:27.619808] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:27.639458] [DEBUG] [MAIN ] URI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:27.640831] [INFO ] [MAIN ] URI: Generated 1794 derivative records from 34264 primary records. [2025-10-22T22:16:27.641015] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-10-22T22:16:27.660093] [DEBUG] [LOCAL ] URI: Derivative data saved (1794 records). [2025-10-22T22:16:27.660520] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-10-22T22:16:27.663179] [INFO ] [MAIN ] Derivative Progress: 1887/2052 symbols completed. URI took 1.1s. Estimated remaining: 1m 2s. Rate: 159.3 symbols/min [2025-10-22T22:16:27.668465] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:27.680009] [DEBUG] [LOCAL ] USAC: Loaded 21590 existing records from primary storage. [2025-10-22T22:16:27.681818] [INFO ] [MAIN ] USAC: Loaded 21590 primary data records. [2025-10-22T22:16:27.751299] [DEBUG] [MAIN ] USA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:27.778041] [INFO ] [MAIN ] USA: Generated 1794 derivative records from 36378 primary records. [2025-10-22T22:16:27.793227] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-22T22:16:27.855287] [DEBUG] [LOCAL ] USA: Derivative data saved (1794 records). [2025-10-22T22:16:27.920159] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-22T22:16:28.025412] [INFO ] [MAIN ] Derivative Progress: 1888/2052 symbols completed. USA took 1.1s. Estimated remaining: 1m 2s. Rate: 159.3 symbols/min [2025-10-22T22:16:28.064129] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-22T22:16:28.065205] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-10-22T22:16:28.316283] [DEBUG] [MAIN ] USAC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:16:28.394272] [INFO ] [MAIN ] USAC: Generated 1793 derivative records from 21590 primary records. [2025-10-22T22:16:28.394419] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-22T22:16:28.412565] [DEBUG] [LOCAL ] USAC: Derivative data saved (1793 records). [2025-10-22T22:16:28.412872] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-22T22:16:28.415561] [INFO ] [MAIN ] Derivative Progress: 1889/2052 symbols completed. USAC took 0.8s. Estimated remaining: 1m 1s. Rate: 159.3 symbols/min [2025-10-22T22:16:28.436688] [DEBUG] [MAIN ] USB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:28.437331] [INFO ] [MAIN ] USB: Generated 1794 derivative records from 53688 primary records. [2025-10-22T22:16:28.437391] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-22T22:16:28.452333] [DEBUG] [LOCAL ] USB: Derivative data saved (1794 records). [2025-10-22T22:16:28.452391] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-22T22:16:28.455204] [INFO ] [MAIN ] Derivative Progress: 1890/2052 symbols completed. USB took 0.8s. Estimated remaining: 1m 1s. Rate: 159.4 symbols/min [2025-10-22T22:16:28.455672] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:28.455762] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:28.456225] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:28.481776] [DEBUG] [LOCAL ] USNA: Loaded 17995 existing records from primary storage. [2025-10-22T22:16:28.481958] [INFO ] [MAIN ] USNA: Loaded 17995 primary data records. [2025-10-22T22:16:28.536870] [DEBUG] [LOCAL ] USPH: Loaded 17006 existing records from primary storage. [2025-10-22T22:16:28.558820] [INFO ] [MAIN ] USPH: Loaded 17006 primary data records. [2025-10-22T22:16:28.972192] [DEBUG] [LOCAL ] USFD: Loaded 51132 existing records from primary storage. [2025-10-22T22:16:28.994703] [INFO ] [MAIN ] USFD: Loaded 51132 primary data records. [2025-10-22T22:16:29.471960] [DEBUG] [MAIN ] USNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:29.473592] [INFO ] [MAIN ] USNA: Generated 1794 derivative records from 17995 primary records. [2025-10-22T22:16:29.474485] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-22T22:16:29.506764] [DEBUG] [MAIN ] USPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:29.509369] [INFO ] [MAIN ] USPH: Generated 1794 derivative records from 17006 primary records. [2025-10-22T22:16:29.509702] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-22T22:16:29.511039] [DEBUG] [LOCAL ] USNA: Derivative data saved (1794 records). [2025-10-22T22:16:29.511187] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-22T22:16:29.513703] [INFO ] [MAIN ] Derivative Progress: 1891/2052 symbols completed. USNA took 1.1s. Estimated remaining: 1m 1s. Rate: 159.2 symbols/min [2025-10-22T22:16:29.527725] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:29.529835] [DEBUG] [LOCAL ] USPH: Derivative data saved (1794 records). [2025-10-22T22:16:29.531319] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-22T22:16:29.533925] [INFO ] [MAIN ] Derivative Progress: 1892/2052 symbols completed. USPH took 1.1s. Estimated remaining: 1m 0s. Rate: 159.3 symbols/min [2025-10-22T22:16:29.534229] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:29.547755] [DEBUG] [MAIN ] USFD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:29.548531] [INFO ] [MAIN ] USFD: Generated 1794 derivative records from 51132 primary records. [2025-10-22T22:16:29.548684] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-22T22:16:29.564423] [DEBUG] [LOCAL ] USFD: Derivative data saved (1794 records). [2025-10-22T22:16:29.564678] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-22T22:16:29.569742] [INFO ] [MAIN ] Derivative Progress: 1893/2052 symbols completed. USFD took 1.1s. Estimated remaining: 59.9s. Rate: 159.4 symbols/min [2025-10-22T22:16:29.570014] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:29.576486] [DEBUG] [LOCAL ] UTL: Loaded 11858 existing records from primary storage. [2025-10-22T22:16:29.576616] [INFO ] [MAIN ] UTL: Loaded 11858 primary data records. [2025-10-22T22:16:29.698981] [DEBUG] [LOCAL ] UTF: Loaded 30943 existing records from primary storage. [2025-10-22T22:16:29.699341] [INFO ] [MAIN ] UTF: Loaded 30943 primary data records. [2025-10-22T22:16:30.101050] [DEBUG] [LOCAL ] UTZ: Loaded 44265 existing records from primary storage. [2025-10-22T22:16:30.217853] [INFO ] [MAIN ] UTZ: Loaded 44265 primary data records. [2025-10-22T22:16:30.589615] [DEBUG] [MAIN ] UTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:30.595083] [INFO ] [MAIN ] UTL: Generated 1794 derivative records from 11858 primary records. [2025-10-22T22:16:30.595408] [DEBUG] [MAIN ] UTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:30.596014] [INFO ] [MAIN ] UTF: Generated 1794 derivative records from 30943 primary records. [2025-10-22T22:16:30.596096] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-22T22:16:30.606306] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-22T22:16:30.614412] [DEBUG] [LOCAL ] UTL: Derivative data saved (1794 records). [2025-10-22T22:16:30.622791] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-22T22:16:30.627889] [INFO ] [MAIN ] Derivative Progress: 1894/2052 symbols completed. UTL took 1.1s. Estimated remaining: 59.5s. Rate: 159.2 symbols/min [2025-10-22T22:16:30.628153] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:30.633138] [DEBUG] [LOCAL ] UTF: Derivative data saved (1794 records). [2025-10-22T22:16:30.633468] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-22T22:16:30.635701] [INFO ] [MAIN ] Derivative Progress: 1895/2052 symbols completed. UTF took 1.1s. Estimated remaining: 59.1s. Rate: 159.3 symbols/min [2025-10-22T22:16:30.635954] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:30.652058] [DEBUG] [MAIN ] UTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:30.652711] [INFO ] [MAIN ] UTZ: Generated 1794 derivative records from 44265 primary records. [2025-10-22T22:16:30.652822] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-22T22:16:30.673751] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1794 records). [2025-10-22T22:16:30.673863] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-22T22:16:30.676330] [INFO ] [MAIN ] Derivative Progress: 1896/2052 symbols completed. UTZ took 1.1s. Estimated remaining: 58.7s. Rate: 159.4 symbols/min [2025-10-22T22:16:30.676570] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:30.689903] [DEBUG] [LOCAL ] UVE: Loaded 21957 existing records from primary storage. [2025-10-22T22:16:30.690152] [INFO ] [MAIN ] UVE: Loaded 21957 primary data records. [2025-10-22T22:16:30.753907] [DEBUG] [LOCAL ] UVV: Loaded 22770 existing records from primary storage. [2025-10-22T22:16:30.790137] [INFO ] [MAIN ] UVV: Loaded 22770 primary data records. [2025-10-22T22:16:31.035306] [DEBUG] [LOCAL ] UWMC: Loaded 52960 existing records from primary storage. [2025-10-22T22:16:31.211623] [INFO ] [MAIN ] UWMC: Loaded 52960 primary data records. [2025-10-22T22:16:31.671050] [DEBUG] [MAIN ] UVE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:31.687083] [DEBUG] [MAIN ] UVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:31.686154] [INFO ] [MAIN ] UVE: Generated 1794 derivative records from 21957 primary records. [2025-10-22T22:16:31.688011] [INFO ] [MAIN ] UVV: Generated 1794 derivative records from 22770 primary records. [2025-10-22T22:16:31.688159] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-22T22:16:31.688683] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-22T22:16:31.714599] [DEBUG] [LOCAL ] UVV: Derivative data saved (1794 records). [2025-10-22T22:16:31.717732] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-22T22:16:31.723390] [DEBUG] [LOCAL ] UVE: Derivative data saved (1794 records). [2025-10-22T22:16:31.725993] [INFO ] [MAIN ] Derivative Progress: 1897/2052 symbols completed. UVV took 1.1s. Estimated remaining: 58.4s. Rate: 159.2 symbols/min [2025-10-22T22:16:31.726473] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:31.726942] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-10-22T22:16:31.729388] [INFO ] [MAIN ] Derivative Progress: 1898/2052 symbols completed. UVE took 1.1s. Estimated remaining: 58.0s. Rate: 159.3 symbols/min [2025-10-22T22:16:31.730953] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:31.747150] [DEBUG] [MAIN ] UWMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:31.749814] [INFO ] [MAIN ] UWMC: Generated 1794 derivative records from 52960 primary records. [2025-10-22T22:16:31.750078] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-22T22:16:31.767205] [DEBUG] [LOCAL ] UZE: Loaded 6947 existing records from primary storage. [2025-10-22T22:16:31.756772] [DEBUG] [LOCAL ] UZD: Loaded 5801 existing records from primary storage. [2025-10-22T22:16:31.771042] [INFO ] [MAIN ] UZD: Loaded 5801 primary data records. [2025-10-22T22:16:31.774167] [INFO ] [MAIN ] UZE: Loaded 6947 primary data records. [2025-10-22T22:16:31.818284] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1794 records). [2025-10-22T22:16:31.898416] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-22T22:16:31.954501] [INFO ] [MAIN ] Derivative Progress: 1899/2052 symbols completed. UWMC took 1.3s. Estimated remaining: 57.6s. Rate: 159.4 symbols/min [2025-10-22T22:16:31.988983] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:32.431311] [DEBUG] [LOCAL ] V: Loaded 53751 existing records from primary storage. [2025-10-22T22:16:32.432205] [INFO ] [MAIN ] V: Loaded 53751 primary data records. [2025-10-22T22:16:32.609894] [DEBUG] [MAIN ] UZD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:32.626376] [INFO ] [MAIN ] UZD: Generated 1794 derivative records from 5801 primary records. [2025-10-22T22:16:32.625672] [DEBUG] [MAIN ] UZE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:32.631667] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-22T22:16:32.644192] [INFO ] [MAIN ] UZE: Generated 1794 derivative records from 6947 primary records. [2025-10-22T22:16:32.644689] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-22T22:16:32.824432] [DEBUG] [LOCAL ] UZD: Derivative data saved (1794 records). [2025-10-22T22:16:32.825124] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-22T22:16:32.827749] [INFO ] [MAIN ] Derivative Progress: 1900/2052 symbols completed. UZD took 1.1s. Estimated remaining: 57.3s. Rate: 159.3 symbols/min [2025-10-22T22:16:32.828957] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:32.832293] [DEBUG] [LOCAL ] UZE: Derivative data saved (1794 records). [2025-10-22T22:16:32.833151] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-22T22:16:32.836192] [INFO ] [MAIN ] Derivative Progress: 1901/2052 symbols completed. UZE took 1.1s. Estimated remaining: 56.9s. Rate: 159.3 symbols/min [2025-10-22T22:16:32.836626] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:32.868894] [DEBUG] [MAIN ] V: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:32.869711] [INFO ] [MAIN ] V: Generated 1794 derivative records from 53751 primary records. [2025-10-22T22:16:32.869786] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-22T22:16:32.894878] [DEBUG] [LOCAL ] VAC: Loaded 33667 existing records from primary storage. [2025-10-22T22:16:32.898672] [INFO ] [MAIN ] VAC: Loaded 33667 primary data records. [2025-10-22T22:16:32.931581] [DEBUG] [LOCAL ] V: Derivative data saved (1794 records). [2025-10-22T22:16:32.975384] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-22T22:16:33.018861] [INFO ] [MAIN ] Derivative Progress: 1902/2052 symbols completed. V took 1.0s. Estimated remaining: 56.5s. Rate: 159.4 symbols/min [2025-10-22T22:16:33.032001] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:33.040061] [DEBUG] [LOCAL ] VAL: Loaded 49858 existing records from primary storage. [2025-10-22T22:16:33.050909] [INFO ] [MAIN ] VAL: Loaded 49858 primary data records. [2025-10-22T22:16:33.557515] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-22T22:16:33.558116] [INFO ] [MAIN ] VALE: Loaded 53693 primary data records. [2025-10-22T22:16:33.742798] [DEBUG] [MAIN ] VAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:33.774944] [INFO ] [MAIN ] VAC: Generated 1794 derivative records from 33667 primary records. [2025-10-22T22:16:33.790828] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-22T22:16:33.908557] [DEBUG] [LOCAL ] VAC: Derivative data saved (1794 records). [2025-10-22T22:16:33.908994] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-22T22:16:33.912535] [INFO ] [MAIN ] Derivative Progress: 1903/2052 symbols completed. VAC took 1.1s. Estimated remaining: 56.1s. Rate: 159.3 symbols/min [2025-10-22T22:16:33.928405] [DEBUG] [MAIN ] VAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:33.929150] [INFO ] [MAIN ] VAL: Generated 1794 derivative records from 49858 primary records. [2025-10-22T22:16:33.929313] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-22T22:16:33.945819] [DEBUG] [LOCAL ] VAL: Derivative data saved (1794 records). [2025-10-22T22:16:33.945930] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-22T22:16:33.948192] [INFO ] [MAIN ] Derivative Progress: 1904/2052 symbols completed. VAL took 1.1s. Estimated remaining: 55.7s. Rate: 159.3 symbols/min [2025-10-22T22:16:33.963100] [DEBUG] [MAIN ] VALE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:33.963769] [INFO ] [MAIN ] VALE: Generated 1794 derivative records from 53693 primary records. [2025-10-22T22:16:33.963832] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-22T22:16:33.979050] [DEBUG] [LOCAL ] VALE: Derivative data saved (1794 records). [2025-10-22T22:16:33.979147] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-22T22:16:33.981292] [INFO ] [MAIN ] Derivative Progress: 1905/2052 symbols completed. VALE took 0.9s. Estimated remaining: 55.3s. Rate: 159.4 symbols/min [2025-10-22T22:16:33.981777] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:33.981712] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:33.982117] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:33.993867] [DEBUG] [LOCAL ] VATE: Loaded 5039 existing records from primary storage. [2025-10-22T22:16:33.996963] [INFO ] [MAIN ] VATE: Loaded 5039 primary data records. [2025-10-22T22:16:34.019312] [DEBUG] [LOCAL ] VBF: Loaded 7200 existing records from primary storage. [2025-10-22T22:16:34.034131] [INFO ] [MAIN ] VBF: Loaded 7200 primary data records. [2025-10-22T22:16:34.194587] [DEBUG] [LOCAL ] VCV: Loaded 13198 existing records from primary storage. [2025-10-22T22:16:34.205192] [INFO ] [MAIN ] VCV: Loaded 13198 primary data records. [2025-10-22T22:16:35.009470] [DEBUG] [MAIN ] VATE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:35.011993] [INFO ] [MAIN ] VATE: Generated 1794 derivative records from 5039 primary records. [2025-10-22T22:16:35.012318] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-22T22:16:35.036955] [DEBUG] [MAIN ] VBF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:35.038390] [INFO ] [MAIN ] VBF: Generated 1794 derivative records from 7200 primary records. [2025-10-22T22:16:35.041674] [DEBUG] [LOCAL ] VATE: Derivative data saved (1794 records). [2025-10-22T22:16:35.041834] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-22T22:16:35.042792] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-22T22:16:35.045193] [INFO ] [MAIN ] Derivative Progress: 1906/2052 symbols completed. VATE took 1.1s. Estimated remaining: 55.0s. Rate: 159.3 symbols/min [2025-10-22T22:16:35.046623] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:35.063388] [DEBUG] [LOCAL ] VBF: Derivative data saved (1794 records). [2025-10-22T22:16:35.063700] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-22T22:16:35.066410] [INFO ] [MAIN ] Derivative Progress: 1907/2052 symbols completed. VBF took 1.1s. Estimated remaining: 54.6s. Rate: 159.3 symbols/min [2025-10-22T22:16:35.066766] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:35.080318] [DEBUG] [MAIN ] VCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:35.081124] [INFO ] [MAIN ] VCV: Generated 1794 derivative records from 13198 primary records. [2025-10-22T22:16:35.081299] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-22T22:16:35.097396] [DEBUG] [LOCAL ] VCV: Derivative data saved (1794 records). [2025-10-22T22:16:35.097846] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-10-22T22:16:35.100279] [INFO ] [MAIN ] Derivative Progress: 1908/2052 symbols completed. VCV took 1.1s. Estimated remaining: 54.2s. Rate: 159.4 symbols/min [2025-10-22T22:16:35.104348] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:35.113502] [DEBUG] [LOCAL ] VEL: Loaded 11927 existing records from primary storage. [2025-10-22T22:16:35.113804] [INFO ] [MAIN ] VEL: Loaded 11927 primary data records. [2025-10-22T22:16:35.462978] [DEBUG] [LOCAL ] VET: Loaded 44082 existing records from primary storage. [2025-10-22T22:16:35.462294] [DEBUG] [LOCAL ] VEEV: Loaded 47109 existing records from primary storage. [2025-10-22T22:16:35.463890] [INFO ] [MAIN ] VEEV: Loaded 47109 primary data records. [2025-10-22T22:16:35.463773] [INFO ] [MAIN ] VET: Loaded 44082 primary data records. [2025-10-22T22:16:36.103463] [DEBUG] [MAIN ] VEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:36.104464] [INFO ] [MAIN ] VEL: Generated 1794 derivative records from 11927 primary records. [2025-10-22T22:16:36.104803] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-22T22:16:36.125253] [DEBUG] [LOCAL ] VEL: Derivative data saved (1794 records). [2025-10-22T22:16:36.125773] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-22T22:16:36.129082] [INFO ] [MAIN ] Derivative Progress: 1909/2052 symbols completed. VEL took 1.1s. Estimated remaining: 53.9s. Rate: 159.3 symbols/min [2025-10-22T22:16:36.130023] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:36.151332] [DEBUG] [MAIN ] VET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:36.152677] [INFO ] [MAIN ] VET: Generated 1794 derivative records from 44082 primary records. [2025-10-22T22:16:36.154339] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-22T22:16:36.170699] [DEBUG] [MAIN ] VEEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:36.178416] [INFO ] [MAIN ] VEEV: Generated 1794 derivative records from 47109 primary records. [2025-10-22T22:16:36.182358] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-22T22:16:36.187222] [DEBUG] [LOCAL ] VET: Derivative data saved (1794 records). [2025-10-22T22:16:36.187460] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-22T22:16:36.189430] [INFO ] [MAIN ] Derivative Progress: 1910/2052 symbols completed. VET took 1.1s. Estimated remaining: 53.5s. Rate: 159.3 symbols/min [2025-10-22T22:16:36.197806] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:36.205062] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1794 records). [2025-10-22T22:16:36.205239] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-22T22:16:36.207930] [INFO ] [MAIN ] Derivative Progress: 1911/2052 symbols completed. VEEV took 1.2s. Estimated remaining: 53.1s. Rate: 159.4 symbols/min [2025-10-22T22:16:36.208338] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:36.232473] [DEBUG] [LOCAL ] VGI: Loaded 5213 existing records from primary storage. [2025-10-22T22:16:36.232702] [INFO ] [MAIN ] VGI: Loaded 5213 primary data records. [2025-10-22T22:16:36.354199] [DEBUG] [LOCAL ] VGM: Loaded 18643 existing records from primary storage. [2025-10-22T22:16:36.373758] [INFO ] [MAIN ] VGM: Loaded 18643 primary data records. [2025-10-22T22:16:36.392106] [DEBUG] [LOCAL ] VFC: Loaded 53607 existing records from primary storage. [2025-10-22T22:16:36.428975] [INFO ] [MAIN ] VFC: Loaded 53607 primary data records. [2025-10-22T22:16:37.224875] [DEBUG] [MAIN ] VGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:37.226031] [INFO ] [MAIN ] VGI: Generated 1794 derivative records from 5213 primary records. [2025-10-22T22:16:37.226425] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-22T22:16:37.241412] [DEBUG] [LOCAL ] VGI: Derivative data saved (1794 records). [2025-10-22T22:16:37.241848] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-22T22:16:37.243963] [INFO ] [MAIN ] Derivative Progress: 1912/2052 symbols completed. VGI took 1.0s. Estimated remaining: 52.7s. Rate: 159.3 symbols/min [2025-10-22T22:16:37.246010] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:37.260754] [DEBUG] [MAIN ] VGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:37.262320] [INFO ] [MAIN ] VGM: Generated 1794 derivative records from 18643 primary records. [2025-10-22T22:16:37.262598] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-22T22:16:37.265416] [DEBUG] [LOCAL ] VHI: Loaded 2673 existing records from primary storage. [2025-10-22T22:16:37.266706] [INFO ] [MAIN ] VHI: Loaded 2673 primary data records. [2025-10-22T22:16:37.346662] [DEBUG] [LOCAL ] VGM: Derivative data saved (1794 records). [2025-10-22T22:16:37.365105] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-22T22:16:37.390714] [INFO ] [MAIN ] Derivative Progress: 1913/2052 symbols completed. VGM took 1.2s. Estimated remaining: 52.3s. Rate: 159.3 symbols/min [2025-10-22T22:16:37.376996] [DEBUG] [MAIN ] VFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:37.390962] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:37.402451] [INFO ] [MAIN ] VFC: Generated 1794 derivative records from 53607 primary records. [2025-10-22T22:16:37.402858] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-22T22:16:37.608294] [DEBUG] [LOCAL ] VFC: Derivative data saved (1794 records). [2025-10-22T22:16:37.608748] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-22T22:16:37.611168] [INFO ] [MAIN ] Derivative Progress: 1914/2052 symbols completed. VFC took 1.5s. Estimated remaining: 52.0s. Rate: 159.4 symbols/min [2025-10-22T22:16:37.611361] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:37.650567] [DEBUG] [MAIN ] VHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:37.652191] [INFO ] [MAIN ] VHI: Generated 1794 derivative records from 2673 primary records. [2025-10-22T22:16:37.652423] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-22T22:16:37.669193] [DEBUG] [LOCAL ] VICI: Loaded 53653 existing records from primary storage. [2025-10-22T22:16:37.669452] [INFO ] [MAIN ] VICI: Loaded 53653 primary data records. [2025-10-22T22:16:37.713133] [DEBUG] [LOCAL ] VHI: Derivative data saved (1794 records). [2025-10-22T22:16:37.731000] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-22T22:16:37.739880] [INFO ] [MAIN ] Derivative Progress: 1915/2052 symbols completed. VHI took 0.5s. Estimated remaining: 51.6s. Rate: 159.4 symbols/min [2025-10-22T22:16:37.766242] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:37.862851] [DEBUG] [LOCAL ] VIK: Loaded 52371 existing records from primary storage. [2025-10-22T22:16:37.886689] [INFO ] [MAIN ] VIK: Loaded 52371 primary data records. [2025-10-22T22:16:38.360897] [DEBUG] [LOCAL ] VIPS: Loaded 51251 existing records from primary storage. [2025-10-22T22:16:38.362184] [INFO ] [MAIN ] VIPS: Loaded 51251 primary data records. [2025-10-22T22:16:38.682342] [DEBUG] [MAIN ] VICI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:38.684423] [INFO ] [MAIN ] VICI: Generated 1794 derivative records from 53653 primary records. [2025-10-22T22:16:38.684876] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-22T22:16:38.716659] [DEBUG] [LOCAL ] VICI: Derivative data saved (1794 records). [2025-10-22T22:16:38.716811] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-22T22:16:38.719350] [INFO ] [MAIN ] Derivative Progress: 1916/2052 symbols completed. VICI took 1.3s. Estimated remaining: 51.2s. Rate: 159.3 symbols/min [2025-10-22T22:16:38.719508] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:38.720243] [DEBUG] [MAIN ] VIK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:38.721952] [INFO ] [MAIN ] VIK: Generated 1794 derivative records from 52371 primary records. [2025-10-22T22:16:38.722145] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-22T22:16:38.740511] [DEBUG] [LOCAL ] VIK: Derivative data saved (1794 records). [2025-10-22T22:16:38.740974] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-22T22:16:38.743263] [INFO ] [MAIN ] Derivative Progress: 1917/2052 symbols completed. VIK took 1.1s. Estimated remaining: 50.8s. Rate: 159.4 symbols/min [2025-10-22T22:16:38.743636] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:38.762370] [DEBUG] [MAIN ] VIPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:38.763077] [INFO ] [MAIN ] VIPS: Generated 1794 derivative records from 51251 primary records. [2025-10-22T22:16:38.773717] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-22T22:16:38.790932] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1794 records). [2025-10-22T22:16:38.791295] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-10-22T22:16:38.793946] [INFO ] [MAIN ] Derivative Progress: 1918/2052 symbols completed. VIPS took 1.0s. Estimated remaining: 50.4s. Rate: 159.4 symbols/min [2025-10-22T22:16:38.817428] [DEBUG] [LOCAL ] VIRT: Loaded 46460 existing records from primary storage. [2025-10-22T22:16:38.817700] [INFO ] [MAIN ] VIRT: Loaded 46460 primary data records. [2025-10-22T22:16:38.951957] [DEBUG] [LOCAL ] VIST: Loaded 46640 existing records from primary storage. [2025-10-22T22:16:38.972696] [INFO ] [MAIN ] VIST: Loaded 46640 primary data records. [2025-10-22T22:16:39.506204] [DEBUG] [MAIN ] VIRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:39.506534] [DEBUG] [MAIN ] VIST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:39.507413] [INFO ] [MAIN ] VIRT: Generated 1794 derivative records from 46460 primary records. [2025-10-22T22:16:39.508343] [INFO ] [MAIN ] VIST: Generated 1794 derivative records from 46640 primary records. [2025-10-22T22:16:39.507626] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-22T22:16:39.509168] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-22T22:16:39.539171] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1794 records). [2025-10-22T22:16:39.539998] [DEBUG] [LOCAL ] VIST: Derivative data saved (1794 records). [2025-10-22T22:16:39.540221] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-10-22T22:16:39.542341] [INFO ] [MAIN ] Derivative Progress: 1919/2052 symbols completed. VIRT took 0.8s. Estimated remaining: 50.1s. Rate: 159.4 symbols/min [2025-10-22T22:16:39.540152] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-22T22:16:39.544801] [INFO ] [MAIN ] Derivative Progress: 1920/2052 symbols completed. VIST took 0.8s. Estimated remaining: 49.7s. Rate: 159.4 symbols/min [2025-10-22T22:16:39.545334] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:39.545272] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:39.546134] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:39.572151] [DEBUG] [LOCAL ] VKQ: Loaded 17853 existing records from primary storage. [2025-10-22T22:16:39.572405] [INFO ] [MAIN ] VKQ: Loaded 17853 primary data records. [2025-10-22T22:16:39.709355] [DEBUG] [LOCAL ] VLN: Loaded 31057 existing records from primary storage. [2025-10-22T22:16:39.720135] [INFO ] [MAIN ] VLN: Loaded 31057 primary data records. [2025-10-22T22:16:39.726042] [DEBUG] [LOCAL ] VIV: Loaded 44584 existing records from primary storage. [2025-10-22T22:16:39.803332] [INFO ] [MAIN ] VIV: Loaded 44584 primary data records. [2025-10-22T22:16:40.557183] [DEBUG] [MAIN ] VKQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:40.558039] [INFO ] [MAIN ] VKQ: Generated 1794 derivative records from 17853 primary records. [2025-10-22T22:16:40.558278] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-22T22:16:40.574543] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1794 records). [2025-10-22T22:16:40.574690] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-10-22T22:16:40.577080] [INFO ] [MAIN ] Derivative Progress: 1921/2052 symbols completed. VKQ took 1.0s. Estimated remaining: 49.3s. Rate: 159.3 symbols/min [2025-10-22T22:16:40.577232] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:40.608601] [DEBUG] [MAIN ] VLN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:40.608266] [DEBUG] [MAIN ] VIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:40.609418] [INFO ] [MAIN ] VLN: Generated 1794 derivative records from 31057 primary records. [2025-10-22T22:16:40.610080] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-22T22:16:40.609974] [INFO ] [MAIN ] VIV: Generated 1794 derivative records from 44584 primary records. [2025-10-22T22:16:40.610631] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-22T22:16:40.637321] [DEBUG] [LOCAL ] VLN: Derivative data saved (1794 records). [2025-10-22T22:16:40.639056] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-22T22:16:40.641866] [INFO ] [MAIN ] Derivative Progress: 1922/2052 symbols completed. VLN took 1.1s. Estimated remaining: 48.9s. Rate: 159.4 symbols/min [2025-10-22T22:16:40.642024] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:40.645579] [DEBUG] [LOCAL ] VIV: Derivative data saved (1794 records). [2025-10-22T22:16:40.645877] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-22T22:16:40.648741] [INFO ] [MAIN ] Derivative Progress: 1923/2052 symbols completed. VIV took 1.1s. Estimated remaining: 48.5s. Rate: 159.4 symbols/min [2025-10-22T22:16:40.649011] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:40.656034] [DEBUG] [LOCAL ] VLT: Loaded 4282 existing records from primary storage. [2025-10-22T22:16:40.656309] [INFO ] [MAIN ] VLT: Loaded 4282 primary data records. [2025-10-22T22:16:40.835562] [DEBUG] [LOCAL ] VLO: Loaded 52956 existing records from primary storage. [2025-10-22T22:16:40.867677] [INFO ] [MAIN ] VLO: Loaded 52956 primary data records. [2025-10-22T22:16:41.043776] [DEBUG] [LOCAL ] VLRS: Loaded 39240 existing records from primary storage. [2025-10-22T22:16:41.071566] [INFO ] [MAIN ] VLRS: Loaded 39240 primary data records. [2025-10-22T22:16:41.639096] [DEBUG] [MAIN ] VLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:41.641178] [INFO ] [MAIN ] VLT: Generated 1794 derivative records from 4282 primary records. [2025-10-22T22:16:41.641860] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-22T22:16:41.657941] [DEBUG] [LOCAL ] VLT: Derivative data saved (1794 records). [2025-10-22T22:16:41.658207] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-22T22:16:41.660863] [INFO ] [MAIN ] Derivative Progress: 1924/2052 symbols completed. VLT took 1.0s. Estimated remaining: 48.2s. Rate: 159.3 symbols/min [2025-10-22T22:16:41.662449] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:41.680834] [DEBUG] [MAIN ] VLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:41.681895] [INFO ] [MAIN ] VLO: Generated 1794 derivative records from 52956 primary records. [2025-10-22T22:16:41.682315] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-22T22:16:41.702263] [DEBUG] [LOCAL ] VLO: Derivative data saved (1794 records). [2025-10-22T22:16:41.703245] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-22T22:16:41.705331] [INFO ] [MAIN ] Derivative Progress: 1925/2052 symbols completed. VLO took 1.1s. Estimated remaining: 47.8s. Rate: 159.4 symbols/min [2025-10-22T22:16:41.705707] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:41.731868] [DEBUG] [MAIN ] VLRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:41.732724] [INFO ] [MAIN ] VLRS: Generated 1794 derivative records from 39240 primary records. [2025-10-22T22:16:41.732923] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-22T22:16:41.751095] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1794 records). [2025-10-22T22:16:41.751346] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-22T22:16:41.765512] [INFO ] [MAIN ] Derivative Progress: 1926/2052 symbols completed. VLRS took 1.1s. Estimated remaining: 47.4s. Rate: 159.4 symbols/min [2025-10-22T22:16:41.766921] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:41.768947] [DEBUG] [LOCAL ] VLTO: Loaded 46055 existing records from primary storage. [2025-10-22T22:16:41.769217] [INFO ] [MAIN ] VLTO: Loaded 46055 primary data records. [2025-10-22T22:16:41.927890] [DEBUG] [LOCAL ] VMI: Loaded 14939 existing records from primary storage. [2025-10-22T22:16:41.941820] [INFO ] [MAIN ] VMI: Loaded 14939 primary data records. [2025-10-22T22:16:42.128986] [DEBUG] [LOCAL ] VMC: Loaded 42153 existing records from primary storage. [2025-10-22T22:16:42.162580] [INFO ] [MAIN ] VMC: Loaded 42153 primary data records. [2025-10-22T22:16:42.770542] [DEBUG] [MAIN ] VLTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:42.771746] [INFO ] [MAIN ] VLTO: Generated 1794 derivative records from 46055 primary records. [2025-10-22T22:16:42.771950] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-22T22:16:42.789339] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1794 records). [2025-10-22T22:16:42.789492] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-22T22:16:42.791922] [INFO ] [MAIN ] Derivative Progress: 1927/2052 symbols completed. VLTO took 1.1s. Estimated remaining: 47.1s. Rate: 159.3 symbols/min [2025-10-22T22:16:42.792077] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:42.810104] [DEBUG] [MAIN ] VMI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:16:42.812399] [INFO ] [MAIN ] VMI: Generated 1793 derivative records from 14939 primary records. [2025-10-22T22:16:42.812563] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-22T22:16:42.846381] [DEBUG] [LOCAL ] VMI: Derivative data saved (1793 records). [2025-10-22T22:16:42.846797] [DEBUG] [MAIN ] VMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:42.847588] [INFO ] [MAIN ] VMC: Generated 1794 derivative records from 42153 primary records. [2025-10-22T22:16:42.846931] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-22T22:16:42.850120] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-22T22:16:42.850029] [INFO ] [MAIN ] Derivative Progress: 1928/2052 symbols completed. VMI took 1.1s. Estimated remaining: 46.7s. Rate: 159.4 symbols/min [2025-10-22T22:16:42.850365] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:42.858926] [DEBUG] [LOCAL ] VMO: Loaded 20692 existing records from primary storage. [2025-10-22T22:16:42.859255] [INFO ] [MAIN ] VMO: Loaded 20692 primary data records. [2025-10-22T22:16:42.905514] [DEBUG] [LOCAL ] VMC: Derivative data saved (1794 records). [2025-10-22T22:16:42.918023] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-22T22:16:42.932789] [INFO ] [MAIN ] Derivative Progress: 1929/2052 symbols completed. VMC took 1.2s. Estimated remaining: 46.3s. Rate: 159.4 symbols/min [2025-10-22T22:16:42.947909] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:43.222188] [DEBUG] [LOCAL ] VNO: Loaded 48826 existing records from primary storage. [2025-10-22T22:16:43.223575] [INFO ] [MAIN ] VNO: Loaded 48826 primary data records. [2025-10-22T22:16:43.306283] [DEBUG] [LOCAL ] VNT: Loaded 43884 existing records from primary storage. [2025-10-22T22:16:43.318062] [INFO ] [MAIN ] VNT: Loaded 43884 primary data records. [2025-10-22T22:16:43.686975] [DEBUG] [MAIN ] VMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:43.724495] [INFO ] [MAIN ] VMO: Generated 1794 derivative records from 20692 primary records. [2025-10-22T22:16:43.839845] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-22T22:16:43.860700] [DEBUG] [LOCAL ] VMO: Derivative data saved (1794 records). [2025-10-22T22:16:43.862068] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-10-22T22:16:43.864510] [INFO ] [MAIN ] Derivative Progress: 1930/2052 symbols completed. VMO took 1.1s. Estimated remaining: 45.9s. Rate: 159.3 symbols/min [2025-10-22T22:16:43.865048] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:43.879011] [DEBUG] [LOCAL ] VOC: Loaded 9041 existing records from primary storage. [2025-10-22T22:16:43.879255] [INFO ] [MAIN ] VOC: Loaded 9041 primary data records. [2025-10-22T22:16:43.933991] [DEBUG] [MAIN ] VNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:43.956133] [INFO ] [MAIN ] VNO: Generated 1794 derivative records from 48826 primary records. [2025-10-22T22:16:43.962042] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-22T22:16:44.033638] [DEBUG] [MAIN ] VNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:44.039484] [DEBUG] [LOCAL ] VNO: Derivative data saved (1794 records). [2025-10-22T22:16:44.050462] [INFO ] [MAIN ] VNT: Generated 1794 derivative records from 43884 primary records. [2025-10-22T22:16:44.099172] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-22T22:16:44.101151] [INFO ] [MAIN ] Derivative Progress: 1931/2052 symbols completed. VNO took 1.3s. Estimated remaining: 45.6s. Rate: 159.3 symbols/min [2025-10-22T22:16:44.256258] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:44.248058] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-22T22:16:44.273925] [DEBUG] [LOCAL ] VNT: Derivative data saved (1794 records). [2025-10-22T22:16:44.274460] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-22T22:16:44.277221] [INFO ] [MAIN ] Derivative Progress: 1932/2052 symbols completed. VNT took 1.3s. Estimated remaining: 45.2s. Rate: 159.4 symbols/min [2025-10-22T22:16:44.277845] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:44.320888] [DEBUG] [MAIN ] VOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:44.321395] [DEBUG] [LOCAL ] VPG: Loaded 16880 existing records from primary storage. [2025-10-22T22:16:44.322215] [INFO ] [MAIN ] VOC: Generated 1794 derivative records from 9041 primary records. [2025-10-22T22:16:44.321556] [INFO ] [MAIN ] VPG: Loaded 16880 primary data records. [2025-10-22T22:16:44.322323] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-22T22:16:44.436940] [DEBUG] [LOCAL ] VOYA: Loaded 41801 existing records from primary storage. [2025-10-22T22:16:44.451975] [DEBUG] [LOCAL ] VOC: Derivative data saved (1794 records). [2025-10-22T22:16:44.452071] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-22T22:16:44.454376] [INFO ] [MAIN ] Derivative Progress: 1933/2052 symbols completed. VOC took 0.6s. Estimated remaining: 44.8s. Rate: 159.4 symbols/min [2025-10-22T22:16:44.451015] [INFO ] [MAIN ] VOYA: Loaded 41801 primary data records. [2025-10-22T22:16:44.967293] [DEBUG] [MAIN ] VPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:44.968498] [INFO ] [MAIN ] VPG: Generated 1794 derivative records from 16880 primary records. [2025-10-22T22:16:44.968621] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-22T22:16:44.989791] [DEBUG] [LOCAL ] VPG: Derivative data saved (1794 records). [2025-10-22T22:16:44.991525] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-22T22:16:44.994934] [INFO ] [MAIN ] Derivative Progress: 1934/2052 symbols completed. VPG took 0.7s. Estimated remaining: 44.4s. Rate: 159.4 symbols/min [2025-10-22T22:16:45.007690] [DEBUG] [MAIN ] VOYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:45.008284] [INFO ] [MAIN ] VOYA: Generated 1794 derivative records from 41801 primary records. [2025-10-22T22:16:45.008343] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-22T22:16:45.023223] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1794 records). [2025-10-22T22:16:45.023281] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-22T22:16:45.025615] [INFO ] [MAIN ] Derivative Progress: 1935/2052 symbols completed. VOYA took 0.8s. Estimated remaining: 44.0s. Rate: 159.5 symbols/min [2025-10-22T22:16:45.026135] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:45.026089] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:45.026209] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:45.034329] [DEBUG] [LOCAL ] VPV: Loaded 5221 existing records from primary storage. [2025-10-22T22:16:45.034620] [INFO ] [MAIN ] VPV: Loaded 5221 primary data records. [2025-10-22T22:16:45.374432] [DEBUG] [LOCAL ] VRE: Loaded 35221 existing records from primary storage. [2025-10-22T22:16:45.374573] [INFO ] [MAIN ] VRE: Loaded 35221 primary data records. [2025-10-22T22:16:45.499099] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-22T22:16:45.510107] [INFO ] [MAIN ] VRT: Loaded 53753 primary data records. [2025-10-22T22:16:46.010175] [DEBUG] [MAIN ] VPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:46.011492] [INFO ] [MAIN ] VPV: Generated 1794 derivative records from 5221 primary records. [2025-10-22T22:16:46.011728] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-22T22:16:46.028480] [DEBUG] [LOCAL ] VPV: Derivative data saved (1794 records). [2025-10-22T22:16:46.030255] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-22T22:16:46.032484] [INFO ] [MAIN ] Derivative Progress: 1936/2052 symbols completed. VPV took 1.0s. Estimated remaining: 43.7s. Rate: 159.3 symbols/min [2025-10-22T22:16:46.033612] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:46.047987] [DEBUG] [MAIN ] VRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:46.048785] [INFO ] [MAIN ] VRE: Generated 1794 derivative records from 35221 primary records. [2025-10-22T22:16:46.049013] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-22T22:16:46.067634] [DEBUG] [LOCAL ] VRE: Derivative data saved (1794 records). [2025-10-22T22:16:46.068823] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-22T22:16:46.072311] [INFO ] [MAIN ] Derivative Progress: 1937/2052 symbols completed. VRE took 1.0s. Estimated remaining: 43.3s. Rate: 159.4 symbols/min [2025-10-22T22:16:46.072513] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:46.077878] [DEBUG] [LOCAL ] VRTS: Loaded 9371 existing records from primary storage. [2025-10-22T22:16:46.078196] [INFO ] [MAIN ] VRTS: Loaded 9371 primary data records. [2025-10-22T22:16:46.138509] [DEBUG] [MAIN ] VRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:46.174104] [INFO ] [MAIN ] VRT: Generated 1794 derivative records from 53753 primary records. [2025-10-22T22:16:46.191532] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-22T22:16:46.461632] [DEBUG] [LOCAL ] VRT: Derivative data saved (1794 records). [2025-10-22T22:16:46.462313] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-22T22:16:46.464758] [INFO ] [MAIN ] Derivative Progress: 1938/2052 symbols completed. VRT took 1.4s. Estimated remaining: 42.9s. Rate: 159.4 symbols/min [2025-10-22T22:16:46.464978] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:46.486449] [DEBUG] [LOCAL ] VSCO: Loaded 52694 existing records from primary storage. [2025-10-22T22:16:46.486881] [INFO ] [MAIN ] VSCO: Loaded 52694 primary data records. [2025-10-22T22:16:46.708859] [DEBUG] [LOCAL ] VSH: Loaded 48228 existing records from primary storage. [2025-10-22T22:16:46.716766] [INFO ] [MAIN ] VSH: Loaded 48228 primary data records. [2025-10-22T22:16:46.840980] [DEBUG] [MAIN ] VRTS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:16:46.853556] [INFO ] [MAIN ] VRTS: Generated 1793 derivative records from 9371 primary records. [2025-10-22T22:16:46.874704] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-22T22:16:46.947285] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1793 records). [2025-10-22T22:16:46.953716] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-22T22:16:46.966672] [INFO ] [MAIN ] Derivative Progress: 1939/2052 symbols completed. VRTS took 0.9s. Estimated remaining: 42.5s. Rate: 159.4 symbols/min [2025-10-22T22:16:46.966911] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:47.182986] [DEBUG] [MAIN ] VSCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:47.184219] [INFO ] [MAIN ] VSCO: Generated 1794 derivative records from 52694 primary records. [2025-10-22T22:16:47.184506] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-22T22:16:47.202674] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1794 records). [2025-10-22T22:16:47.203164] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-22T22:16:47.205261] [INFO ] [MAIN ] Derivative Progress: 1940/2052 symbols completed. VSCO took 1.1s. Estimated remaining: 42.2s. Rate: 159.4 symbols/min [2025-10-22T22:16:47.219145] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:47.239037] [DEBUG] [MAIN ] VSH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:47.253019] [INFO ] [MAIN ] VSH: Generated 1794 derivative records from 48228 primary records. [2025-10-22T22:16:47.254151] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-22T22:16:47.255353] [DEBUG] [LOCAL ] VST: Loaded 53709 existing records from primary storage. [2025-10-22T22:16:47.255817] [INFO ] [MAIN ] VST: Loaded 53709 primary data records. [2025-10-22T22:16:47.336332] [DEBUG] [LOCAL ] VSH: Derivative data saved (1794 records). [2025-10-22T22:16:47.361620] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-22T22:16:47.384582] [INFO ] [MAIN ] Derivative Progress: 1941/2052 symbols completed. VSH took 0.9s. Estimated remaining: 41.8s. Rate: 159.4 symbols/min [2025-10-22T22:16:47.385602] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:47.475810] [DEBUG] [LOCAL ] VSTS: Loaded 48857 existing records from primary storage. [2025-10-22T22:16:47.599210] [INFO ] [MAIN ] VSTS: Loaded 48857 primary data records. [2025-10-22T22:16:47.822573] [DEBUG] [LOCAL ] VTEX: Loaded 42874 existing records from primary storage. [2025-10-22T22:16:47.960612] [INFO ] [MAIN ] VTEX: Loaded 42874 primary data records. [2025-10-22T22:16:48.102674] [DEBUG] [MAIN ] VST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:48.119897] [INFO ] [MAIN ] VST: Generated 1794 derivative records from 53709 primary records. [2025-10-22T22:16:48.125244] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-22T22:16:48.406315] [DEBUG] [LOCAL ] VST: Derivative data saved (1794 records). [2025-10-22T22:16:48.406633] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-10-22T22:16:48.409062] [INFO ] [MAIN ] Derivative Progress: 1942/2052 symbols completed. VST took 1.4s. Estimated remaining: 41.4s. Rate: 159.3 symbols/min [2025-10-22T22:16:48.409217] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:48.429308] [DEBUG] [MAIN ] VSTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:48.431307] [INFO ] [MAIN ] VSTS: Generated 1794 derivative records from 48857 primary records. [2025-10-22T22:16:48.431729] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-22T22:16:48.448294] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1794 records). [2025-10-22T22:16:48.448552] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-10-22T22:16:48.450590] [INFO ] [MAIN ] Derivative Progress: 1943/2052 symbols completed. VSTS took 1.2s. Estimated remaining: 41.0s. Rate: 159.4 symbols/min [2025-10-22T22:16:48.451450] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:48.489262] [DEBUG] [MAIN ] VTEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:48.496508] [INFO ] [MAIN ] VTEX: Generated 1794 derivative records from 42874 primary records. [2025-10-22T22:16:48.510967] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-22T22:16:48.509689] [DEBUG] [LOCAL ] VTMX: Loaded 17525 existing records from primary storage. [2025-10-22T22:16:48.511282] [INFO ] [MAIN ] VTMX: Loaded 17525 primary data records. [2025-10-22T22:16:48.545443] [DEBUG] [LOCAL ] VTLE: Loaded 47548 existing records from primary storage. [2025-10-22T22:16:48.550839] [INFO ] [MAIN ] VTLE: Loaded 47548 primary data records. [2025-10-22T22:16:48.636980] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1794 records). [2025-10-22T22:16:48.659118] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-22T22:16:48.740923] [INFO ] [MAIN ] Derivative Progress: 1944/2052 symbols completed. VTEX took 1.4s. Estimated remaining: 40.7s. Rate: 159.4 symbols/min [2025-10-22T22:16:48.771272] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:49.138662] [DEBUG] [LOCAL ] VTN: Loaded 7114 existing records from primary storage. [2025-10-22T22:16:49.139825] [INFO ] [MAIN ] VTN: Loaded 7114 primary data records. [2025-10-22T22:16:49.480511] [DEBUG] [MAIN ] VTLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:49.481436] [INFO ] [MAIN ] VTLE: Generated 1794 derivative records from 47548 primary records. [2025-10-22T22:16:49.481613] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-22T22:16:49.497386] [DEBUG] [MAIN ] VTMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:49.509693] [INFO ] [MAIN ] VTMX: Generated 1794 derivative records from 17525 primary records. [2025-10-22T22:16:49.512924] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-22T22:16:49.518316] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1794 records). [2025-10-22T22:16:49.518936] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-22T22:16:49.522368] [INFO ] [MAIN ] Derivative Progress: 1945/2052 symbols completed. VTLE took 1.1s. Estimated remaining: 40.3s. Rate: 159.3 symbols/min [2025-10-22T22:16:49.531535] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:49.540550] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1794 records). [2025-10-22T22:16:49.540936] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-22T22:16:49.543490] [INFO ] [MAIN ] Derivative Progress: 1946/2052 symbols completed. VTMX took 1.1s. Estimated remaining: 39.9s. Rate: 159.4 symbols/min [2025-10-22T22:16:49.544811] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:49.566451] [DEBUG] [MAIN ] VTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:49.567269] [INFO ] [MAIN ] VTN: Generated 1794 derivative records from 7114 primary records. [2025-10-22T22:16:49.567471] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-22T22:16:49.590923] [DEBUG] [LOCAL ] VTN: Derivative data saved (1794 records). [2025-10-22T22:16:49.591032] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-22T22:16:49.594120] [INFO ] [MAIN ] Derivative Progress: 1947/2052 symbols completed. VTN took 0.8s. Estimated remaining: 39.5s. Rate: 159.5 symbols/min [2025-10-22T22:16:49.594363] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:49.595101] [DEBUG] [LOCAL ] VTOL: Loaded 19344 existing records from primary storage. [2025-10-22T22:16:49.595856] [INFO ] [MAIN ] VTOL: Loaded 19344 primary data records. [2025-10-22T22:16:49.926079] [DEBUG] [LOCAL ] VTS: Loaded 29835 existing records from primary storage. [2025-10-22T22:16:49.927851] [INFO ] [MAIN ] VTS: Loaded 29835 primary data records. [2025-10-22T22:16:49.994769] [DEBUG] [LOCAL ] VTR: Loaded 52678 existing records from primary storage. [2025-10-22T22:16:50.030714] [INFO ] [MAIN ] VTR: Loaded 52678 primary data records. [2025-10-22T22:16:50.618273] [DEBUG] [MAIN ] VTOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:50.619563] [INFO ] [MAIN ] VTOL: Generated 1794 derivative records from 19344 primary records. [2025-10-22T22:16:50.619756] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-22T22:16:50.635328] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1794 records). [2025-10-22T22:16:50.635534] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-22T22:16:50.638708] [INFO ] [MAIN ] Derivative Progress: 1948/2052 symbols completed. VTOL took 1.1s. Estimated remaining: 39.2s. Rate: 159.3 symbols/min [2025-10-22T22:16:50.656980] [DEBUG] [MAIN ] VTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:50.657867] [INFO ] [MAIN ] VTS: Generated 1794 derivative records from 29835 primary records. [2025-10-22T22:16:50.658104] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-22T22:16:50.675577] [DEBUG] [LOCAL ] VTS: Derivative data saved (1794 records). [2025-10-22T22:16:50.675738] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-22T22:16:50.689868] [INFO ] [MAIN ] Derivative Progress: 1949/2052 symbols completed. VTS took 1.1s. Estimated remaining: 38.8s. Rate: 159.4 symbols/min [2025-10-22T22:16:50.690213] [DEBUG] [MAIN ] VTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:50.690938] [INFO ] [MAIN ] VTR: Generated 1794 derivative records from 52678 primary records. [2025-10-22T22:16:50.691000] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-22T22:16:50.705573] [DEBUG] [LOCAL ] VTR: Derivative data saved (1794 records). [2025-10-22T22:16:50.705635] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-22T22:16:50.707918] [INFO ] [MAIN ] Derivative Progress: 1950/2052 symbols completed. VTR took 1.2s. Estimated remaining: 38.4s. Rate: 159.5 symbols/min [2025-10-22T22:16:50.708235] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:50.708287] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:50.708419] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:50.739313] [DEBUG] [LOCAL ] VVX: Loaded 23034 existing records from primary storage. [2025-10-22T22:16:50.747956] [INFO ] [MAIN ] VVX: Loaded 23034 primary data records. [2025-10-22T22:16:50.769180] [DEBUG] [LOCAL ] VVR: Loaded 31188 existing records from primary storage. [2025-10-22T22:16:50.769441] [INFO ] [MAIN ] VVR: Loaded 31188 primary data records. [2025-10-22T22:16:51.017827] [DEBUG] [LOCAL ] VVV: Loaded 50131 existing records from primary storage. [2025-10-22T22:16:51.038410] [INFO ] [MAIN ] VVV: Loaded 50131 primary data records. [2025-10-22T22:16:51.708335] [DEBUG] [MAIN ] VVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:51.709504] [INFO ] [MAIN ] VVR: Generated 1794 derivative records from 31188 primary records. [2025-10-22T22:16:51.722343] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-22T22:16:51.730728] [DEBUG] [MAIN ] VVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:51.732138] [INFO ] [MAIN ] VVX: Generated 1794 derivative records from 23034 primary records. [2025-10-22T22:16:51.732792] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-22T22:16:51.748599] [DEBUG] [LOCAL ] VVR: Derivative data saved (1794 records). [2025-10-22T22:16:51.765822] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-22T22:16:51.777704] [DEBUG] [LOCAL ] VVX: Derivative data saved (1794 records). [2025-10-22T22:16:51.776321] [INFO ] [MAIN ] Derivative Progress: 1951/2052 symbols completed. VVR took 1.1s. Estimated remaining: 38.0s. Rate: 159.3 symbols/min [2025-10-22T22:16:51.778091] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-22T22:16:51.778263] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:51.781193] [INFO ] [MAIN ] Derivative Progress: 1952/2052 symbols completed. VVX took 1.1s. Estimated remaining: 37.6s. Rate: 159.4 symbols/min [2025-10-22T22:16:51.781494] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:51.794906] [DEBUG] [MAIN ] VVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:51.795556] [INFO ] [MAIN ] VVV: Generated 1794 derivative records from 50131 primary records. [2025-10-22T22:16:51.795926] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-22T22:16:51.814775] [DEBUG] [LOCAL ] VVV: Derivative data saved (1794 records). [2025-10-22T22:16:51.814919] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-22T22:16:51.817673] [INFO ] [MAIN ] Derivative Progress: 1953/2052 symbols completed. VVV took 1.1s. Estimated remaining: 37.2s. Rate: 159.5 symbols/min [2025-10-22T22:16:51.817943] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:51.857081] [DEBUG] [LOCAL ] VYX: Loaded 48308 existing records from primary storage. [2025-10-22T22:16:51.857217] [INFO ] [MAIN ] VYX: Loaded 48308 primary data records. [2025-10-22T22:16:52.029581] [DEBUG] [LOCAL ] W: Loaded 53410 existing records from primary storage. [2025-10-22T22:16:52.068822] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-22T22:16:52.090977] [INFO ] [MAIN ] W: Loaded 53410 primary data records. [2025-10-22T22:16:52.178803] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-10-22T22:16:52.860990] [DEBUG] [MAIN ] VYX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:52.862138] [INFO ] [MAIN ] VYX: Generated 1794 derivative records from 48308 primary records. [2025-10-22T22:16:52.862422] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-22T22:16:52.881271] [DEBUG] [LOCAL ] VYX: Derivative data saved (1794 records). [2025-10-22T22:16:52.881505] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-22T22:16:52.884632] [INFO ] [MAIN ] Derivative Progress: 1954/2052 symbols completed. VYX took 1.1s. Estimated remaining: 36.9s. Rate: 159.3 symbols/min [2025-10-22T22:16:52.884843] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:52.910406] [DEBUG] [MAIN ] W: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:52.915311] [DEBUG] [MAIN ] VZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:52.916006] [INFO ] [MAIN ] VZ: Generated 1794 derivative records from 53791 primary records. [2025-10-22T22:16:52.916584] [INFO ] [MAIN ] W: Generated 1794 derivative records from 53410 primary records. [2025-10-22T22:16:52.916673] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-22T22:16:52.917350] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-22T22:16:52.946014] [DEBUG] [LOCAL ] W: Derivative data saved (1794 records). [2025-10-22T22:16:52.948944] [DEBUG] [LOCAL ] VZ: Derivative data saved (1794 records). [2025-10-22T22:16:52.949049] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-22T22:16:52.951464] [INFO ] [MAIN ] Derivative Progress: 1955/2052 symbols completed. W took 1.1s. Estimated remaining: 36.5s. Rate: 159.4 symbols/min [2025-10-22T22:16:52.951610] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:52.949105] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-22T22:16:52.964494] [INFO ] [MAIN ] Derivative Progress: 1956/2052 symbols completed. VZ took 1.2s. Estimated remaining: 36.1s. Rate: 159.5 symbols/min [2025-10-22T22:16:52.964900] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:52.984202] [DEBUG] [LOCAL ] WAB: Loaded 43796 existing records from primary storage. [2025-10-22T22:16:52.984563] [INFO ] [MAIN ] WAB: Loaded 43796 primary data records. [2025-10-22T22:16:53.189392] [DEBUG] [LOCAL ] WAL: Loaded 45667 existing records from primary storage. [2025-10-22T22:16:53.215143] [DEBUG] [LOCAL ] WAT: Loaded 35665 existing records from primary storage. [2025-10-22T22:16:53.323784] [INFO ] [MAIN ] WAL: Loaded 45667 primary data records. [2025-10-22T22:16:53.324064] [INFO ] [MAIN ] WAT: Loaded 35665 primary data records. [2025-10-22T22:16:53.948308] [DEBUG] [MAIN ] WAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:53.950004] [INFO ] [MAIN ] WAB: Generated 1794 derivative records from 43796 primary records. [2025-10-22T22:16:53.950631] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-22T22:16:53.971371] [DEBUG] [LOCAL ] WAB: Derivative data saved (1794 records). [2025-10-22T22:16:53.971563] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-22T22:16:53.973697] [INFO ] [MAIN ] Derivative Progress: 1957/2052 symbols completed. WAB took 1.1s. Estimated remaining: 35.8s. Rate: 159.3 symbols/min [2025-10-22T22:16:53.973974] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:53.992871] [DEBUG] [MAIN ] WAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:54.001364] [INFO ] [MAIN ] WAL: Generated 1794 derivative records from 45667 primary records. [2025-10-22T22:16:54.006287] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-22T22:16:54.007171] [DEBUG] [MAIN ] WAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:54.008553] [INFO ] [MAIN ] WAT: Generated 1794 derivative records from 35665 primary records. [2025-10-22T22:16:54.016801] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-22T22:16:54.024597] [DEBUG] [LOCAL ] WAL: Derivative data saved (1794 records). [2025-10-22T22:16:54.035820] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-22T22:16:54.041243] [INFO ] [MAIN ] Derivative Progress: 1958/2052 symbols completed. WAL took 1.1s. Estimated remaining: 35.4s. Rate: 159.4 symbols/min [2025-10-22T22:16:54.042333] [DEBUG] [LOCAL ] WAT: Derivative data saved (1794 records). [2025-10-22T22:16:54.042675] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:54.042553] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-22T22:16:54.045188] [INFO ] [MAIN ] Derivative Progress: 1959/2052 symbols completed. WAT took 1.1s. Estimated remaining: 35.0s. Rate: 159.5 symbols/min [2025-10-22T22:16:54.045556] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:54.067908] [DEBUG] [LOCAL ] WBX: Loaded 9953 existing records from primary storage. [2025-10-22T22:16:54.068204] [INFO ] [MAIN ] WBX: Loaded 9953 primary data records. [2025-10-22T22:16:54.157002] [DEBUG] [LOCAL ] WBS: Loaded 48843 existing records from primary storage. [2025-10-22T22:16:54.182380] [INFO ] [MAIN ] WBS: Loaded 48843 primary data records. [2025-10-22T22:16:54.295672] [DEBUG] [LOCAL ] WCC: Loaded 38478 existing records from primary storage. [2025-10-22T22:16:54.320859] [INFO ] [MAIN ] WCC: Loaded 38478 primary data records. [2025-10-22T22:16:55.040299] [DEBUG] [MAIN ] WBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:55.041292] [INFO ] [MAIN ] WBX: Generated 1794 derivative records from 9953 primary records. [2025-10-22T22:16:55.041580] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-22T22:16:55.065731] [DEBUG] [MAIN ] WBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:55.069115] [DEBUG] [LOCAL ] WBX: Derivative data saved (1794 records). [2025-10-22T22:16:55.070065] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-10-22T22:16:55.072065] [INFO ] [MAIN ] Derivative Progress: 1960/2052 symbols completed. WBX took 1.0s. Estimated remaining: 34.6s. Rate: 159.3 symbols/min [2025-10-22T22:16:55.072370] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:55.070000] [INFO ] [MAIN ] WBS: Generated 1794 derivative records from 48843 primary records. [2025-10-22T22:16:55.072943] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-22T22:16:55.099175] [DEBUG] [LOCAL ] WBS: Derivative data saved (1794 records). [2025-10-22T22:16:55.103782] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-22T22:16:55.106457] [INFO ] [MAIN ] Derivative Progress: 1961/2052 symbols completed. WBS took 1.1s. Estimated remaining: 34.3s. Rate: 159.4 symbols/min [2025-10-22T22:16:55.107099] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:55.106907] [DEBUG] [MAIN ] WCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:55.108276] [INFO ] [MAIN ] WCC: Generated 1794 derivative records from 38478 primary records. [2025-10-22T22:16:55.108378] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-22T22:16:55.124448] [DEBUG] [LOCAL ] WCC: Derivative data saved (1794 records). [2025-10-22T22:16:55.124687] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-22T22:16:55.127287] [INFO ] [MAIN ] Derivative Progress: 1962/2052 symbols completed. WCC took 1.1s. Estimated remaining: 33.9s. Rate: 159.5 symbols/min [2025-10-22T22:16:55.127581] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:55.153444] [DEBUG] [LOCAL ] WD: Loaded 22521 existing records from primary storage. [2025-10-22T22:16:55.153702] [INFO ] [MAIN ] WD: Loaded 22521 primary data records. [2025-10-22T22:16:55.265016] [DEBUG] [LOCAL ] WDH: Loaded 18039 existing records from primary storage. [2025-10-22T22:16:55.281860] [INFO ] [MAIN ] WDH: Loaded 18039 primary data records. [2025-10-22T22:16:55.303110] [DEBUG] [LOCAL ] WCN: Loaded 47886 existing records from primary storage. [2025-10-22T22:16:55.353739] [INFO ] [MAIN ] WCN: Loaded 47886 primary data records. [2025-10-22T22:16:56.139043] [DEBUG] [MAIN ] WD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:56.151694] [INFO ] [MAIN ] WD: Generated 1794 derivative records from 22521 primary records. [2025-10-22T22:16:56.151941] [DEBUG] [MAIN ] WDH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:56.152780] [INFO ] [MAIN ] WDH: Generated 1794 derivative records from 18039 primary records. [2025-10-22T22:16:56.152982] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-22T22:16:56.153062] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-22T22:16:56.185639] [DEBUG] [LOCAL ] WDH: Derivative data saved (1794 records). [2025-10-22T22:16:56.185877] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-22T22:16:56.188358] [INFO ] [MAIN ] Derivative Progress: 1963/2052 symbols completed. WDH took 1.1s. Estimated remaining: 33.5s. Rate: 159.3 symbols/min [2025-10-22T22:16:56.184852] [DEBUG] [LOCAL ] WD: Derivative data saved (1794 records). [2025-10-22T22:16:56.188508] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-22T22:16:56.203252] [DEBUG] [MAIN ] WCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:56.203018] [INFO ] [MAIN ] Derivative Progress: 1964/2052 symbols completed. WD took 1.1s. Estimated remaining: 33.1s. Rate: 159.4 symbols/min [2025-10-22T22:16:56.203996] [INFO ] [MAIN ] WCN: Generated 1794 derivative records from 47886 primary records. [2025-10-22T22:16:56.204264] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-22T22:16:56.219304] [DEBUG] [LOCAL ] WCN: Derivative data saved (1794 records). [2025-10-22T22:16:56.219364] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-22T22:16:56.221681] [INFO ] [MAIN ] Derivative Progress: 1965/2052 symbols completed. WCN took 1.1s. Estimated remaining: 32.7s. Rate: 159.5 symbols/min [2025-10-22T22:16:56.222049] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:56.222418] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:56.222468] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:56.233199] [DEBUG] [LOCAL ] WEA: Loaded 7893 existing records from primary storage. [2025-10-22T22:16:56.233441] [INFO ] [MAIN ] WEA: Loaded 7893 primary data records. [2025-10-22T22:16:56.346738] [DEBUG] [LOCAL ] WDI: Loaded 21235 existing records from primary storage. [2025-10-22T22:16:56.362208] [INFO ] [MAIN ] WDI: Loaded 21235 primary data records. [2025-10-22T22:16:56.626957] [DEBUG] [LOCAL ] WDS: Loaded 43018 existing records from primary storage. [2025-10-22T22:16:56.629221] [INFO ] [MAIN ] WDS: Loaded 43018 primary data records. [2025-10-22T22:16:57.178531] [DEBUG] [MAIN ] WEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:57.179512] [INFO ] [MAIN ] WEA: Generated 1794 derivative records from 7893 primary records. [2025-10-22T22:16:57.180683] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-22T22:16:57.198853] [DEBUG] [LOCAL ] WEA: Derivative data saved (1794 records). [2025-10-22T22:16:57.199234] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-22T22:16:57.213580] [INFO ] [MAIN ] Derivative Progress: 1966/2052 symbols completed. WEA took 1.0s. Estimated remaining: 32.4s. Rate: 159.4 symbols/min [2025-10-22T22:16:57.214572] [DEBUG] [MAIN ] WDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:57.214229] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:57.215943] [INFO ] [MAIN ] WDI: Generated 1794 derivative records from 21235 primary records. [2025-10-22T22:16:57.216313] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-22T22:16:57.232244] [DEBUG] [LOCAL ] WDI: Derivative data saved (1794 records). [2025-10-22T22:16:57.232430] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-22T22:16:57.234841] [INFO ] [MAIN ] Derivative Progress: 1967/2052 symbols completed. WDI took 1.0s. Estimated remaining: 32.0s. Rate: 159.4 symbols/min [2025-10-22T22:16:57.236990] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:57.250986] [DEBUG] [MAIN ] WDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:57.251670] [INFO ] [MAIN ] WDS: Generated 1794 derivative records from 43018 primary records. [2025-10-22T22:16:57.251785] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-22T22:16:57.267790] [DEBUG] [LOCAL ] WDS: Derivative data saved (1794 records). [2025-10-22T22:16:57.267861] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-10-22T22:16:57.270268] [INFO ] [MAIN ] Derivative Progress: 1968/2052 symbols completed. WDS took 1.0s. Estimated remaining: 31.6s. Rate: 159.5 symbols/min [2025-10-22T22:16:57.280361] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:57.298094] [DEBUG] [LOCAL ] WEAV: Loaded 42360 existing records from primary storage. [2025-10-22T22:16:57.310190] [INFO ] [MAIN ] WEAV: Loaded 42360 primary data records. [2025-10-22T22:16:57.426628] [DEBUG] [LOCAL ] WEC: Loaded 52169 existing records from primary storage. [2025-10-22T22:16:57.448348] [INFO ] [MAIN ] WEC: Loaded 52169 primary data records. [2025-10-22T22:16:57.740048] [DEBUG] [LOCAL ] WELL: Loaded 52296 existing records from primary storage. [2025-10-22T22:16:57.749111] [INFO ] [MAIN ] WELL: Loaded 52296 primary data records. [2025-10-22T22:16:58.374840] [DEBUG] [MAIN ] WEAV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:58.375978] [INFO ] [MAIN ] WEAV: Generated 1794 derivative records from 42360 primary records. [2025-10-22T22:16:58.376076] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-22T22:16:58.395780] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1794 records). [2025-10-22T22:16:58.396088] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-22T22:16:58.410520] [INFO ] [MAIN ] Derivative Progress: 1969/2052 symbols completed. WEAV took 1.2s. Estimated remaining: 31.3s. Rate: 159.3 symbols/min [2025-10-22T22:16:58.412042] [DEBUG] [MAIN ] WEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:58.411728] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:58.413193] [INFO ] [MAIN ] WEC: Generated 1794 derivative records from 52169 primary records. [2025-10-22T22:16:58.413371] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-22T22:16:58.443370] [DEBUG] [MAIN ] WELL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:58.446862] [INFO ] [MAIN ] WELL: Generated 1794 derivative records from 52296 primary records. [2025-10-22T22:16:58.448130] [DEBUG] [LOCAL ] WEC: Derivative data saved (1794 records). [2025-10-22T22:16:58.448224] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-22T22:16:58.448294] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-22T22:16:58.450783] [INFO ] [MAIN ] Derivative Progress: 1970/2052 symbols completed. WEC took 1.2s. Estimated remaining: 30.9s. Rate: 159.4 symbols/min [2025-10-22T22:16:58.452038] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:58.469737] [DEBUG] [LOCAL ] WELL: Derivative data saved (1794 records). [2025-10-22T22:16:58.470079] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-22T22:16:58.472725] [INFO ] [MAIN ] Derivative Progress: 1971/2052 symbols completed. WELL took 1.2s. Estimated remaining: 30.5s. Rate: 159.5 symbols/min [2025-10-22T22:16:58.473217] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:58.507434] [DEBUG] [LOCAL ] WF: Loaded 10726 existing records from primary storage. [2025-10-22T22:16:58.507598] [INFO ] [MAIN ] WF: Loaded 10726 primary data records. [2025-10-22T22:16:58.643420] [DEBUG] [LOCAL ] WES: Loaded 48723 existing records from primary storage. [2025-10-22T22:16:58.642064] [DEBUG] [LOCAL ] WEX: Loaded 32398 existing records from primary storage. [2025-10-22T22:16:58.643775] [INFO ] [MAIN ] WEX: Loaded 32398 primary data records. [2025-10-22T22:16:58.643714] [INFO ] [MAIN ] WES: Loaded 48723 primary data records. [2025-10-22T22:16:59.480580] [DEBUG] [MAIN ] WF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:59.481347] [INFO ] [MAIN ] WF: Generated 1794 derivative records from 10726 primary records. [2025-10-22T22:16:59.483690] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-22T22:16:59.502817] [DEBUG] [LOCAL ] WF: Derivative data saved (1794 records). [2025-10-22T22:16:59.503205] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-22T22:16:59.510958] [INFO ] [MAIN ] Derivative Progress: 1972/2052 symbols completed. WF took 1.0s. Estimated remaining: 30.1s. Rate: 159.4 symbols/min [2025-10-22T22:16:59.533199] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:59.533821] [DEBUG] [MAIN ] WES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:59.535086] [INFO ] [MAIN ] WES: Generated 1794 derivative records from 48723 primary records. [2025-10-22T22:16:59.534146] [DEBUG] [MAIN ] WEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:16:59.535197] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-22T22:16:59.535830] [INFO ] [MAIN ] WEX: Generated 1794 derivative records from 32398 primary records. [2025-10-22T22:16:59.536078] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-22T22:16:59.570907] [DEBUG] [LOCAL ] WES: Derivative data saved (1794 records). [2025-10-22T22:16:59.569621] [DEBUG] [LOCAL ] WEX: Derivative data saved (1794 records). [2025-10-22T22:16:59.571216] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-22T22:16:59.574206] [INFO ] [MAIN ] Derivative Progress: 1973/2052 symbols completed. WEX took 1.1s. Estimated remaining: 29.7s. Rate: 159.4 symbols/min [2025-10-22T22:16:59.574289] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-22T22:16:59.574522] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:59.577057] [INFO ] [MAIN ] Derivative Progress: 1974/2052 symbols completed. WES took 1.2s. Estimated remaining: 29.3s. Rate: 159.5 symbols/min [2025-10-22T22:16:59.581108] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:16:59.624489] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-22T22:16:59.624737] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-10-22T22:16:59.676084] [DEBUG] [LOCAL ] WFG: Loaded 24486 existing records from primary storage. [2025-10-22T22:16:59.719560] [INFO ] [MAIN ] WFG: Loaded 24486 primary data records. [2025-10-22T22:16:59.929214] [DEBUG] [LOCAL ] WGO: Loaded 37944 existing records from primary storage. [2025-10-22T22:16:59.934682] [INFO ] [MAIN ] WGO: Loaded 37944 primary data records. [2025-10-22T22:17:00.645545] [DEBUG] [MAIN ] WFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:00.659139] [INFO ] [MAIN ] WFC: Generated 1794 derivative records from 53748 primary records. [2025-10-22T22:17:00.659422] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-22T22:17:00.660872] [DEBUG] [MAIN ] WFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:00.669134] [INFO ] [MAIN ] WFG: Generated 1794 derivative records from 24486 primary records. [2025-10-22T22:17:00.678275] [DEBUG] [LOCAL ] WFC: Derivative data saved (1794 records). [2025-10-22T22:17:00.679705] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-22T22:17:00.679926] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-10-22T22:17:00.682247] [INFO ] [MAIN ] Derivative Progress: 1975/2052 symbols completed. WFC took 1.1s. Estimated remaining: 29.0s. Rate: 159.3 symbols/min [2025-10-22T22:17:00.683148] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:00.704231] [DEBUG] [MAIN ] WGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:00.713443] [INFO ] [MAIN ] WGO: Generated 1794 derivative records from 37944 primary records. [2025-10-22T22:17:00.712508] [DEBUG] [LOCAL ] WFG: Derivative data saved (1794 records). [2025-10-22T22:17:00.713601] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-22T22:17:00.713778] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-22T22:17:00.716526] [INFO ] [MAIN ] Derivative Progress: 1976/2052 symbols completed. WFG took 1.1s. Estimated remaining: 28.6s. Rate: 159.4 symbols/min [2025-10-22T22:17:00.717532] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:00.733363] [DEBUG] [LOCAL ] WGO: Derivative data saved (1794 records). [2025-10-22T22:17:00.733527] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-22T22:17:00.736075] [INFO ] [MAIN ] Derivative Progress: 1977/2052 symbols completed. WGO took 1.2s. Estimated remaining: 28.2s. Rate: 159.5 symbols/min [2025-10-22T22:17:00.736324] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:00.743026] [DEBUG] [LOCAL ] WHG: Loaded 3052 existing records from primary storage. [2025-10-22T22:17:00.744766] [INFO ] [MAIN ] WHG: Loaded 3052 primary data records. [2025-10-22T22:17:00.979201] [DEBUG] [LOCAL ] WH: Loaded 45260 existing records from primary storage. [2025-10-22T22:17:01.094691] [DEBUG] [LOCAL ] WHD: Loaded 39955 existing records from primary storage. [2025-10-22T22:17:01.094000] [INFO ] [MAIN ] WH: Loaded 45260 primary data records. [2025-10-22T22:17:01.095689] [INFO ] [MAIN ] WHD: Loaded 39955 primary data records. [2025-10-22T22:17:01.780118] [DEBUG] [MAIN ] WHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:01.781669] [INFO ] [MAIN ] WHG: Generated 1794 derivative records from 3052 primary records. [2025-10-22T22:17:01.782294] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-22T22:17:01.801182] [DEBUG] [LOCAL ] WHG: Derivative data saved (1794 records). [2025-10-22T22:17:01.801370] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-22T22:17:01.803986] [INFO ] [MAIN ] Derivative Progress: 1978/2052 symbols completed. WHG took 1.1s. Estimated remaining: 27.9s. Rate: 159.3 symbols/min [2025-10-22T22:17:01.825879] [DEBUG] [MAIN ] WHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:01.839717] [INFO ] [MAIN ] WHD: Generated 1794 derivative records from 39955 primary records. [2025-10-22T22:17:01.840204] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-22T22:17:01.840388] [DEBUG] [MAIN ] WH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:01.841323] [INFO ] [MAIN ] WH: Generated 1794 derivative records from 45260 primary records. [2025-10-22T22:17:01.841553] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-22T22:17:01.874280] [DEBUG] [LOCAL ] WHD: Derivative data saved (1794 records). [2025-10-22T22:17:01.872781] [DEBUG] [LOCAL ] WH: Derivative data saved (1794 records). [2025-10-22T22:17:01.874388] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-22T22:17:01.874499] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-22T22:17:01.877088] [INFO ] [MAIN ] Derivative Progress: 1979/2052 symbols completed. WH took 1.2s. Estimated remaining: 27.5s. Rate: 159.4 symbols/min [2025-10-22T22:17:01.880341] [INFO ] [MAIN ] Derivative Progress: 1980/2052 symbols completed. WHD took 1.2s. Estimated remaining: 27.1s. Rate: 159.5 symbols/min [2025-10-22T22:17:01.880851] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:01.881413] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:01.881315] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:01.889996] [DEBUG] [LOCAL ] WIA: Loaded 5029 existing records from primary storage. [2025-10-22T22:17:01.893296] [INFO ] [MAIN ] WIA: Loaded 5029 primary data records. [2025-10-22T22:17:01.999829] [DEBUG] [LOCAL ] WINN: Loaded 11207 existing records from primary storage. [2025-10-22T22:17:02.032774] [INFO ] [MAIN ] WINN: Loaded 11207 primary data records. [2025-10-22T22:17:02.251502] [DEBUG] [LOCAL ] WHR: Loaded 48900 existing records from primary storage. [2025-10-22T22:17:02.392517] [INFO ] [MAIN ] WHR: Loaded 48900 primary data records. [2025-10-22T22:17:02.970240] [DEBUG] [MAIN ] WIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:02.971748] [INFO ] [MAIN ] WIA: Generated 1794 derivative records from 5029 primary records. [2025-10-22T22:17:02.973107] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-22T22:17:02.990779] [DEBUG] [LOCAL ] WIA: Derivative data saved (1794 records). [2025-10-22T22:17:02.990988] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-22T22:17:02.993244] [INFO ] [MAIN ] Derivative Progress: 1981/2052 symbols completed. WIA took 1.1s. Estimated remaining: 26.7s. Rate: 159.3 symbols/min [2025-10-22T22:17:03.006713] [DEBUG] [MAIN ] WINN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:03.006496] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:03.008315] [INFO ] [MAIN ] WINN: Generated 1794 derivative records from 11207 primary records. [2025-10-22T22:17:03.008538] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-22T22:17:03.025157] [DEBUG] [LOCAL ] WINN: Derivative data saved (1794 records). [2025-10-22T22:17:03.025484] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-22T22:17:03.028288] [INFO ] [MAIN ] Derivative Progress: 1982/2052 symbols completed. WINN took 1.1s. Estimated remaining: 26.3s. Rate: 159.4 symbols/min [2025-10-22T22:17:03.028698] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:03.045862] [DEBUG] [MAIN ] WHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:03.046627] [INFO ] [MAIN ] WHR: Generated 1794 derivative records from 48900 primary records. [2025-10-22T22:17:03.046839] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-22T22:17:03.068048] [DEBUG] [LOCAL ] WHR: Derivative data saved (1794 records). [2025-10-22T22:17:03.068369] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-22T22:17:03.070978] [INFO ] [MAIN ] Derivative Progress: 1983/2052 symbols completed. WHR took 1.2s. Estimated remaining: 26.0s. Rate: 159.5 symbols/min [2025-10-22T22:17:03.071262] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:03.096450] [DEBUG] [LOCAL ] WIW: Loaded 20236 existing records from primary storage. [2025-10-22T22:17:03.096747] [INFO ] [MAIN ] WIW: Loaded 20236 primary data records. [2025-10-22T22:17:03.223940] [DEBUG] [LOCAL ] WIT: Loaded 52537 existing records from primary storage. [2025-10-22T22:17:03.229845] [INFO ] [MAIN ] WIT: Loaded 52537 primary data records. [2025-10-22T22:17:03.348101] [DEBUG] [LOCAL ] WK: Loaded 37058 existing records from primary storage. [2025-10-22T22:17:03.507849] [INFO ] [MAIN ] WK: Loaded 37058 primary data records. [2025-10-22T22:17:04.088405] [DEBUG] [MAIN ] WIW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:04.089747] [INFO ] [MAIN ] WIW: Generated 1794 derivative records from 20236 primary records. [2025-10-22T22:17:04.089851] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-22T22:17:04.109237] [DEBUG] [LOCAL ] WIW: Derivative data saved (1794 records). [2025-10-22T22:17:04.109560] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-22T22:17:04.111859] [INFO ] [MAIN ] Derivative Progress: 1984/2052 symbols completed. WIW took 1.1s. Estimated remaining: 25.6s. Rate: 159.3 symbols/min [2025-10-22T22:17:04.112167] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:04.139691] [DEBUG] [MAIN ] WIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:04.140902] [INFO ] [MAIN ] WIT: Generated 1794 derivative records from 52537 primary records. [2025-10-22T22:17:04.141166] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-22T22:17:04.156221] [DEBUG] [MAIN ] WK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:04.170349] [INFO ] [MAIN ] WK: Generated 1794 derivative records from 37058 primary records. [2025-10-22T22:17:04.174931] [DEBUG] [LOCAL ] WIT: Derivative data saved (1794 records). [2025-10-22T22:17:04.183157] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-22T22:17:04.183233] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-22T22:17:04.185945] [INFO ] [MAIN ] Derivative Progress: 1985/2052 symbols completed. WIT took 1.2s. Estimated remaining: 25.2s. Rate: 159.4 symbols/min [2025-10-22T22:17:04.187155] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:04.204799] [DEBUG] [LOCAL ] WK: Derivative data saved (1794 records). [2025-10-22T22:17:04.205043] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-22T22:17:04.216570] [INFO ] [MAIN ] Derivative Progress: 1986/2052 symbols completed. WK took 1.1s. Estimated remaining: 24.8s. Rate: 159.5 symbols/min [2025-10-22T22:17:04.217950] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:04.219148] [DEBUG] [LOCAL ] WKC: Loaded 34432 existing records from primary storage. [2025-10-22T22:17:04.219237] [INFO ] [MAIN ] WKC: Loaded 34432 primary data records. [2025-10-22T22:17:04.353010] [DEBUG] [LOCAL ] WLKP: Loaded 7193 existing records from primary storage. [2025-10-22T22:17:04.363516] [INFO ] [MAIN ] WLKP: Loaded 7193 primary data records. [2025-10-22T22:17:04.598884] [DEBUG] [LOCAL ] WLK: Loaded 45827 existing records from primary storage. [2025-10-22T22:17:04.630621] [INFO ] [MAIN ] WLK: Loaded 45827 primary data records. [2025-10-22T22:17:05.195033] [DEBUG] [MAIN ] WKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:05.196304] [INFO ] [MAIN ] WKC: Generated 1794 derivative records from 34432 primary records. [2025-10-22T22:17:05.196458] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-22T22:17:05.222978] [DEBUG] [LOCAL ] WKC: Derivative data saved (1794 records). [2025-10-22T22:17:05.223298] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-22T22:17:05.225607] [INFO ] [MAIN ] Derivative Progress: 1987/2052 symbols completed. WKC took 1.1s. Estimated remaining: 24.5s. Rate: 159.3 symbols/min [2025-10-22T22:17:05.233591] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:05.239435] [DEBUG] [MAIN ] WLKP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:05.240188] [INFO ] [MAIN ] WLKP: Generated 1794 derivative records from 7193 primary records. [2025-10-22T22:17:05.240429] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-22T22:17:05.257246] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1794 records). [2025-10-22T22:17:05.258887] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-22T22:17:05.261341] [INFO ] [MAIN ] Derivative Progress: 1988/2052 symbols completed. WLKP took 1.0s. Estimated remaining: 24.1s. Rate: 159.4 symbols/min [2025-10-22T22:17:05.261558] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:05.275290] [DEBUG] [MAIN ] WLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:05.283685] [INFO ] [MAIN ] WLK: Generated 1794 derivative records from 45827 primary records. [2025-10-22T22:17:05.283915] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-22T22:17:05.308850] [DEBUG] [LOCAL ] WLK: Derivative data saved (1794 records). [2025-10-22T22:17:05.309530] [DEBUG] [LOCAL ] WLY: Loaded 29776 existing records from primary storage. [2025-10-22T22:17:05.309613] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-22T22:17:05.309729] [INFO ] [MAIN ] WLY: Loaded 29776 primary data records. [2025-10-22T22:17:05.312352] [INFO ] [MAIN ] Derivative Progress: 1989/2052 symbols completed. WLK took 1.1s. Estimated remaining: 23.7s. Rate: 159.5 symbols/min [2025-10-22T22:17:05.312573] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:05.654686] [DEBUG] [LOCAL ] WM: Loaded 50847 existing records from primary storage. [2025-10-22T22:17:05.654926] [INFO ] [MAIN ] WM: Loaded 50847 primary data records. [2025-10-22T22:17:05.780857] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-22T22:17:05.819759] [INFO ] [MAIN ] WMB: Loaded 53672 primary data records. [2025-10-22T22:17:06.333215] [DEBUG] [MAIN ] WLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:06.334563] [INFO ] [MAIN ] WLY: Generated 1794 derivative records from 29776 primary records. [2025-10-22T22:17:06.335314] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-22T22:17:06.352482] [DEBUG] [LOCAL ] WLY: Derivative data saved (1794 records). [2025-10-22T22:17:06.352738] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-22T22:17:06.355450] [INFO ] [MAIN ] Derivative Progress: 1990/2052 symbols completed. WLY took 1.1s. Estimated remaining: 23.3s. Rate: 159.3 symbols/min [2025-10-22T22:17:06.355882] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:06.374478] [DEBUG] [MAIN ] WM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:06.375341] [INFO ] [MAIN ] WM: Generated 1794 derivative records from 50847 primary records. [2025-10-22T22:17:06.375436] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-22T22:17:06.407076] [DEBUG] [LOCAL ] WMK: Loaded 14666 existing records from primary storage. [2025-10-22T22:17:06.415177] [DEBUG] [MAIN ] WMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:06.416736] [INFO ] [MAIN ] WMB: Generated 1794 derivative records from 53672 primary records. [2025-10-22T22:17:06.417508] [DEBUG] [LOCAL ] WM: Derivative data saved (1794 records). [2025-10-22T22:17:06.417577] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-22T22:17:06.417750] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-22T22:17:06.417377] [INFO ] [MAIN ] WMK: Loaded 14666 primary data records. [2025-10-22T22:17:06.419819] [INFO ] [MAIN ] Derivative Progress: 1991/2052 symbols completed. WM took 1.2s. Estimated remaining: 23.0s. Rate: 159.4 symbols/min [2025-10-22T22:17:06.420842] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:06.478536] [DEBUG] [LOCAL ] WMB: Derivative data saved (1794 records). [2025-10-22T22:17:06.499362] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-22T22:17:06.529179] [INFO ] [MAIN ] Derivative Progress: 1992/2052 symbols completed. WMB took 1.2s. Estimated remaining: 22.6s. Rate: 159.5 symbols/min [2025-10-22T22:17:06.539840] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:06.767630] [DEBUG] [LOCAL ] WMS: Loaded 39517 existing records from primary storage. [2025-10-22T22:17:06.768332] [INFO ] [MAIN ] WMS: Loaded 39517 primary data records. [2025-10-22T22:17:06.893281] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-22T22:17:06.909099] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-10-22T22:17:07.221116] [DEBUG] [MAIN ] WMK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:07.248638] [INFO ] [MAIN ] WMK: Generated 1794 derivative records from 14666 primary records. [2025-10-22T22:17:07.256714] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-22T22:17:07.416263] [DEBUG] [LOCAL ] WMK: Derivative data saved (1794 records). [2025-10-22T22:17:07.416756] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-22T22:17:07.419116] [INFO ] [MAIN ] Derivative Progress: 1993/2052 symbols completed. WMK took 1.1s. Estimated remaining: 22.2s. Rate: 159.4 symbols/min [2025-10-22T22:17:07.439485] [DEBUG] [MAIN ] WMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:07.440366] [INFO ] [MAIN ] WMS: Generated 1794 derivative records from 39517 primary records. [2025-10-22T22:17:07.440560] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-22T22:17:07.457286] [DEBUG] [LOCAL ] WMS: Derivative data saved (1794 records). [2025-10-22T22:17:07.457500] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-22T22:17:07.459664] [INFO ] [MAIN ] Derivative Progress: 1994/2052 symbols completed. WMS took 1.0s. Estimated remaining: 21.8s. Rate: 159.4 symbols/min [2025-10-22T22:17:07.474446] [DEBUG] [MAIN ] WMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:07.475040] [INFO ] [MAIN ] WMT: Generated 1794 derivative records from 53800 primary records. [2025-10-22T22:17:07.475102] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-22T22:17:07.490210] [DEBUG] [LOCAL ] WMT: Derivative data saved (1794 records). [2025-10-22T22:17:07.490290] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-22T22:17:07.493413] [INFO ] [MAIN ] Derivative Progress: 1995/2052 symbols completed. WMT took 1.0s. Estimated remaining: 21.4s. Rate: 159.5 symbols/min [2025-10-22T22:17:07.493825] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:07.494041] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:07.493912] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:07.554404] [DEBUG] [LOCAL ] WOR: Loaded 23551 existing records from primary storage. [2025-10-22T22:17:07.554608] [INFO ] [MAIN ] WOR: Loaded 23551 primary data records. [2025-10-22T22:17:07.569098] [DEBUG] [LOCAL ] WNC: Loaded 38118 existing records from primary storage. [2025-10-22T22:17:07.569321] [INFO ] [MAIN ] WNC: Loaded 38118 primary data records. [2025-10-22T22:17:07.751403] [DEBUG] [LOCAL ] WOLF: Loaded 53071 existing records from primary storage. [2025-10-22T22:17:07.791135] [INFO ] [MAIN ] WOLF: Loaded 53071 primary data records. [2025-10-22T22:17:08.569083] [DEBUG] [MAIN ] WNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:08.568913] [DEBUG] [MAIN ] WOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:08.570747] [INFO ] [MAIN ] WOR: Generated 1794 derivative records from 23551 primary records. [2025-10-22T22:17:08.570115] [INFO ] [MAIN ] WNC: Generated 1794 derivative records from 38118 primary records. [2025-10-22T22:17:08.571052] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-22T22:17:08.571124] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-22T22:17:08.596929] [DEBUG] [LOCAL ] WOR: Derivative data saved (1794 records). [2025-10-22T22:17:08.603559] [DEBUG] [LOCAL ] WNC: Derivative data saved (1794 records). [2025-10-22T22:17:08.603735] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-22T22:17:08.608846] [INFO ] [MAIN ] Derivative Progress: 1996/2052 symbols completed. WOR took 1.1s. Estimated remaining: 21.1s. Rate: 159.3 symbols/min [2025-10-22T22:17:08.609108] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-22T22:17:08.611287] [INFO ] [MAIN ] Derivative Progress: 1997/2052 symbols completed. WNC took 1.1s. Estimated remaining: 20.7s. Rate: 159.4 symbols/min [2025-10-22T22:17:08.611550] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:08.611234] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:08.626104] [DEBUG] [MAIN ] WOLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:08.626984] [INFO ] [MAIN ] WOLF: Generated 1794 derivative records from 53071 primary records. [2025-10-22T22:17:08.627118] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-22T22:17:08.643285] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1794 records). [2025-10-22T22:17:08.643504] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-10-22T22:17:08.646216] [INFO ] [MAIN ] Derivative Progress: 1998/2052 symbols completed. WOLF took 1.2s. Estimated remaining: 20.3s. Rate: 159.5 symbols/min [2025-10-22T22:17:08.646466] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:08.679217] [DEBUG] [LOCAL ] WOW: Loaded 31103 existing records from primary storage. [2025-10-22T22:17:08.679510] [INFO ] [MAIN ] WOW: Loaded 31103 primary data records. [2025-10-22T22:17:08.805364] [DEBUG] [LOCAL ] WPC: Loaded 48154 existing records from primary storage. [2025-10-22T22:17:08.838818] [INFO ] [MAIN ] WPC: Loaded 48154 primary data records. [2025-10-22T22:17:09.166702] [DEBUG] [LOCAL ] WPM: Loaded 52787 existing records from primary storage. [2025-10-22T22:17:09.194798] [INFO ] [MAIN ] WPM: Loaded 52787 primary data records. [2025-10-22T22:17:09.677798] [DEBUG] [MAIN ] WOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:09.678915] [INFO ] [MAIN ] WOW: Generated 1794 derivative records from 31103 primary records. [2025-10-22T22:17:09.679176] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-22T22:17:09.695753] [DEBUG] [LOCAL ] WOW: Derivative data saved (1794 records). [2025-10-22T22:17:09.695940] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-22T22:17:09.697838] [INFO ] [MAIN ] Derivative Progress: 1999/2052 symbols completed. WOW took 1.1s. Estimated remaining: 20.0s. Rate: 159.3 symbols/min [2025-10-22T22:17:09.697980] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:09.715006] [DEBUG] [MAIN ] WPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:09.715732] [INFO ] [MAIN ] WPC: Generated 1794 derivative records from 48154 primary records. [2025-10-22T22:17:09.716073] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-22T22:17:09.732954] [DEBUG] [LOCAL ] WPC: Derivative data saved (1794 records). [2025-10-22T22:17:09.734067] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-22T22:17:09.738292] [INFO ] [MAIN ] Derivative Progress: 2000/2052 symbols completed. WPC took 1.1s. Estimated remaining: 19.6s. Rate: 159.4 symbols/min [2025-10-22T22:17:09.738733] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:09.752615] [DEBUG] [MAIN ] WPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:09.761717] [INFO ] [MAIN ] WPM: Generated 1794 derivative records from 52787 primary records. [2025-10-22T22:17:09.761885] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-22T22:17:09.789371] [DEBUG] [LOCAL ] WPM: Derivative data saved (1794 records). [2025-10-22T22:17:09.789588] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-22T22:17:09.789235] [DEBUG] [LOCAL ] WPP: Loaded 34340 existing records from primary storage. [2025-10-22T22:17:09.792288] [INFO ] [MAIN ] Derivative Progress: 2001/2052 symbols completed. WPM took 1.1s. Estimated remaining: 19.2s. Rate: 159.5 symbols/min [2025-10-22T22:17:09.792550] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:09.792444] [INFO ] [MAIN ] WPP: Loaded 34340 primary data records. [2025-10-22T22:17:10.151452] [DEBUG] [LOCAL ] WRB: Loaded 50788 existing records from primary storage. [2025-10-22T22:17:10.175375] [INFO ] [MAIN ] WRB: Loaded 50788 primary data records. [2025-10-22T22:17:10.299097] [DEBUG] [LOCAL ] WRBY: Loaded 50685 existing records from primary storage. [2025-10-22T22:17:10.326270] [INFO ] [MAIN ] WRBY: Loaded 50685 primary data records. [2025-10-22T22:17:10.931125] [DEBUG] [MAIN ] WPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:10.933851] [INFO ] [MAIN ] WPP: Generated 1794 derivative records from 34340 primary records. [2025-10-22T22:17:10.934391] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-22T22:17:10.962066] [DEBUG] [LOCAL ] WPP: Derivative data saved (1794 records). [2025-10-22T22:17:10.962380] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-10-22T22:17:10.964938] [INFO ] [MAIN ] Derivative Progress: 2002/2052 symbols completed. WPP took 1.3s. Estimated remaining: 18.8s. Rate: 159.3 symbols/min [2025-10-22T22:17:10.968516] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:10.998603] [DEBUG] [MAIN ] WRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:10.999873] [INFO ] [MAIN ] WRB: Generated 1794 derivative records from 50788 primary records. [2025-10-22T22:17:11.000733] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-22T22:17:11.042410] [DEBUG] [LOCAL ] WRB: Derivative data saved (1794 records). [2025-10-22T22:17:11.042795] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-22T22:17:11.061203] [INFO ] [MAIN ] Derivative Progress: 2003/2052 symbols completed. WRB took 1.3s. Estimated remaining: 18.4s. Rate: 159.4 symbols/min [2025-10-22T22:17:11.058253] [DEBUG] [MAIN ] WRBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:11.063087] [INFO ] [MAIN ] WRBY: Generated 1794 derivative records from 50685 primary records. [2025-10-22T22:17:11.061817] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:11.063274] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-22T22:17:11.075789] [DEBUG] [LOCAL ] WS: Loaded 23459 existing records from primary storage. [2025-10-22T22:17:11.076584] [INFO ] [MAIN ] WS: Loaded 23459 primary data records. [2025-10-22T22:17:11.105074] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1794 records). [2025-10-22T22:17:11.128344] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-22T22:17:11.162616] [INFO ] [MAIN ] Derivative Progress: 2004/2052 symbols completed. WRBY took 1.4s. Estimated remaining: 18.1s. Rate: 159.4 symbols/min [2025-10-22T22:17:11.182580] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:11.514182] [DEBUG] [LOCAL ] WSO: Loaded 25878 existing records from primary storage. [2025-10-22T22:17:11.530956] [INFO ] [MAIN ] WSO: Loaded 25878 primary data records. [2025-10-22T22:17:11.549603] [DEBUG] [LOCAL ] WSM: Loaded 48709 existing records from primary storage. [2025-10-22T22:17:11.581210] [INFO ] [MAIN ] WSM: Loaded 48709 primary data records. [2025-10-22T22:17:12.171082] [DEBUG] [MAIN ] WS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:12.172747] [INFO ] [MAIN ] WS: Generated 1794 derivative records from 23459 primary records. [2025-10-22T22:17:12.172919] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-22T22:17:12.190769] [DEBUG] [LOCAL ] WS: Derivative data saved (1794 records). [2025-10-22T22:17:12.191341] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-22T22:17:12.193836] [INFO ] [MAIN ] Derivative Progress: 2005/2052 symbols completed. WS took 1.2s. Estimated remaining: 17.7s. Rate: 159.3 symbols/min [2025-10-22T22:17:12.193992] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:12.245544] [DEBUG] [MAIN ] WSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:12.240549] [DEBUG] [LOCAL ] WSR: Loaded 22566 existing records from primary storage. [2025-10-22T22:17:12.246952] [INFO ] [MAIN ] WSO: Generated 1794 derivative records from 25878 primary records. [2025-10-22T22:17:12.247104] [INFO ] [MAIN ] WSR: Loaded 22566 primary data records. [2025-10-22T22:17:12.246202] [DEBUG] [MAIN ] WSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:12.248042] [INFO ] [MAIN ] WSM: Generated 1794 derivative records from 48709 primary records. [2025-10-22T22:17:12.259371] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-22T22:17:12.247048] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-22T22:17:12.364878] [DEBUG] [LOCAL ] WSM: Derivative data saved (1794 records). [2025-10-22T22:17:12.370487] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-22T22:17:12.370600] [DEBUG] [LOCAL ] WSO: Derivative data saved (1794 records). [2025-10-22T22:17:12.373260] [INFO ] [MAIN ] Derivative Progress: 2006/2052 symbols completed. WSM took 1.3s. Estimated remaining: 17.3s. Rate: 159.3 symbols/min [2025-10-22T22:17:12.384436] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-22T22:17:12.386796] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:12.386975] [INFO ] [MAIN ] Derivative Progress: 2007/2052 symbols completed. WSO took 1.2s. Estimated remaining: 16.9s. Rate: 159.4 symbols/min [2025-10-22T22:17:12.387567] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:12.639179] [DEBUG] [LOCAL ] WST: Loaded 36684 existing records from primary storage. [2025-10-22T22:17:12.639520] [INFO ] [MAIN ] WST: Loaded 36684 primary data records. [2025-10-22T22:17:12.759444] [DEBUG] [MAIN ] WSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:12.771028] [DEBUG] [LOCAL ] WT: Loaded 48178 existing records from primary storage. [2025-10-22T22:17:12.782614] [INFO ] [MAIN ] WSR: Generated 1794 derivative records from 22566 primary records. [2025-10-22T22:17:12.782682] [INFO ] [MAIN ] WT: Loaded 48178 primary data records. [2025-10-22T22:17:12.798303] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-22T22:17:13.078286] [DEBUG] [LOCAL ] WSR: Derivative data saved (1794 records). [2025-10-22T22:17:13.088073] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-22T22:17:13.095445] [INFO ] [MAIN ] Derivative Progress: 2008/2052 symbols completed. WSR took 0.9s. Estimated remaining: 16.6s. Rate: 159.3 symbols/min [2025-10-22T22:17:13.297260] [DEBUG] [MAIN ] WST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:13.298041] [INFO ] [MAIN ] WST: Generated 1794 derivative records from 36684 primary records. [2025-10-22T22:17:13.298147] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-22T22:17:13.314911] [DEBUG] [LOCAL ] WST: Derivative data saved (1794 records). [2025-10-22T22:17:13.315161] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-22T22:17:13.317495] [INFO ] [MAIN ] Derivative Progress: 2009/2052 symbols completed. WST took 0.9s. Estimated remaining: 16.2s. Rate: 159.4 symbols/min [2025-10-22T22:17:13.334273] [DEBUG] [MAIN ] WT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:13.334987] [INFO ] [MAIN ] WT: Generated 1794 derivative records from 48178 primary records. [2025-10-22T22:17:13.335048] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-22T22:17:13.350781] [DEBUG] [LOCAL ] WT: Derivative data saved (1794 records). [2025-10-22T22:17:13.350840] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-22T22:17:13.353068] [INFO ] [MAIN ] Derivative Progress: 2010/2052 symbols completed. WT took 1.0s. Estimated remaining: 15.8s. Rate: 159.4 symbols/min [2025-10-22T22:17:13.353525] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:13.353663] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:13.353772] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:13.373257] [DEBUG] [LOCAL ] WTS: Loaded 17226 existing records from primary storage. [2025-10-22T22:17:13.373383] [INFO ] [MAIN ] WTS: Loaded 17226 primary data records. [2025-10-22T22:17:13.530180] [DEBUG] [LOCAL ] WTI: Loaded 44731 existing records from primary storage. [2025-10-22T22:17:13.530322] [INFO ] [MAIN ] WTI: Loaded 44731 primary data records. [2025-10-22T22:17:13.785826] [DEBUG] [LOCAL ] WTRG: Loaded 50940 existing records from primary storage. [2025-10-22T22:17:13.822433] [INFO ] [MAIN ] WTRG: Loaded 50940 primary data records. [2025-10-22T22:17:14.394713] [DEBUG] [MAIN ] WTS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:17:14.395877] [INFO ] [MAIN ] WTS: Generated 1793 derivative records from 17226 primary records. [2025-10-22T22:17:14.398143] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-22T22:17:14.428413] [DEBUG] [LOCAL ] WTS: Derivative data saved (1793 records). [2025-10-22T22:17:14.429476] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-22T22:17:14.429410] [DEBUG] [MAIN ] WTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:14.431879] [INFO ] [MAIN ] Derivative Progress: 2011/2052 symbols completed. WTS took 1.1s. Estimated remaining: 15.4s. Rate: 159.3 symbols/min [2025-10-22T22:17:14.433171] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:14.433005] [INFO ] [MAIN ] WTI: Generated 1794 derivative records from 44731 primary records. [2025-10-22T22:17:14.433583] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-22T22:17:14.464711] [DEBUG] [MAIN ] WTRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:14.466728] [INFO ] [MAIN ] WTRG: Generated 1794 derivative records from 50940 primary records. [2025-10-22T22:17:14.467951] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-22T22:17:14.468509] [DEBUG] [LOCAL ] WTI: Derivative data saved (1794 records). [2025-10-22T22:17:14.469075] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-22T22:17:14.471611] [INFO ] [MAIN ] Derivative Progress: 2012/2052 symbols completed. WTI took 1.1s. Estimated remaining: 15.1s. Rate: 159.4 symbols/min [2025-10-22T22:17:14.483849] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:14.489166] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1794 records). [2025-10-22T22:17:14.489402] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-22T22:17:14.492142] [INFO ] [MAIN ] Derivative Progress: 2013/2052 symbols completed. WTRG took 1.1s. Estimated remaining: 14.7s. Rate: 159.4 symbols/min [2025-10-22T22:17:14.492605] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:14.529677] [DEBUG] [LOCAL ] WTTR: Loaded 44535 existing records from primary storage. [2025-10-22T22:17:14.529924] [INFO ] [MAIN ] WTTR: Loaded 44535 primary data records. [2025-10-22T22:17:14.750158] [DEBUG] [LOCAL ] WWW: Loaded 49243 existing records from primary storage. [2025-10-22T22:17:14.860486] [INFO ] [MAIN ] WWW: Loaded 49243 primary data records. [2025-10-22T22:17:14.933071] [DEBUG] [LOCAL ] WU: Loaded 53487 existing records from primary storage. [2025-10-22T22:17:14.971609] [INFO ] [MAIN ] WU: Loaded 53487 primary data records. [2025-10-22T22:17:15.521901] [DEBUG] [MAIN ] WTTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:15.523715] [INFO ] [MAIN ] WTTR: Generated 1794 derivative records from 44535 primary records. [2025-10-22T22:17:15.523822] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-22T22:17:15.541312] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1794 records). [2025-10-22T22:17:15.542365] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-22T22:17:15.544494] [INFO ] [MAIN ] Derivative Progress: 2014/2052 symbols completed. WTTR took 1.1s. Estimated remaining: 14.3s. Rate: 159.3 symbols/min [2025-10-22T22:17:15.546686] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:15.561510] [DEBUG] [MAIN ] WWW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:15.562353] [INFO ] [MAIN ] WWW: Generated 1794 derivative records from 49243 primary records. [2025-10-22T22:17:15.562615] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-22T22:17:15.580438] [DEBUG] [LOCAL ] WWW: Derivative data saved (1794 records). [2025-10-22T22:17:15.580759] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-22T22:17:15.583588] [INFO ] [MAIN ] Derivative Progress: 2015/2052 symbols completed. WWW took 1.1s. Estimated remaining: 13.9s. Rate: 159.4 symbols/min [2025-10-22T22:17:15.585536] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:15.599098] [DEBUG] [MAIN ] WU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:15.599858] [INFO ] [MAIN ] WU: Generated 1794 derivative records from 53487 primary records. [2025-10-22T22:17:15.600052] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-22T22:17:15.629416] [DEBUG] [LOCAL ] WU: Derivative data saved (1794 records). [2025-10-22T22:17:15.629595] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-22T22:17:15.633682] [INFO ] [MAIN ] Derivative Progress: 2016/2052 symbols completed. WU took 1.1s. Estimated remaining: 13.5s. Rate: 159.4 symbols/min [2025-10-22T22:17:15.634085] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:15.661780] [DEBUG] [LOCAL ] WY: Loaded 53213 existing records from primary storage. [2025-10-22T22:17:15.662101] [INFO ] [MAIN ] WY: Loaded 53213 primary data records. [2025-10-22T22:17:15.759206] [DEBUG] [LOCAL ] XFLT: Loaded 29930 existing records from primary storage. [2025-10-22T22:17:15.785308] [INFO ] [MAIN ] XFLT: Loaded 29930 primary data records. [2025-10-22T22:17:16.100856] [DEBUG] [LOCAL ] XHR: Loaded 43369 existing records from primary storage. [2025-10-22T22:17:16.101073] [INFO ] [MAIN ] XHR: Loaded 43369 primary data records. [2025-10-22T22:17:16.653865] [DEBUG] [MAIN ] WY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:16.654735] [INFO ] [MAIN ] WY: Generated 1794 derivative records from 53213 primary records. [2025-10-22T22:17:16.655288] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-22T22:17:16.673663] [DEBUG] [LOCAL ] WY: Derivative data saved (1794 records). [2025-10-22T22:17:16.674512] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-22T22:17:16.676685] [INFO ] [MAIN ] Derivative Progress: 2017/2052 symbols completed. WY took 1.1s. Estimated remaining: 13.2s. Rate: 159.3 symbols/min [2025-10-22T22:17:16.677027] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:16.690759] [DEBUG] [MAIN ] XFLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:16.691477] [INFO ] [MAIN ] XFLT: Generated 1794 derivative records from 29930 primary records. [2025-10-22T22:17:16.691768] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-22T22:17:16.722358] [DEBUG] [MAIN ] XHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:16.722064] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1794 records). [2025-10-22T22:17:16.722564] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-22T22:17:16.725440] [INFO ] [MAIN ] Derivative Progress: 2018/2052 symbols completed. XFLT took 1.1s. Estimated remaining: 12.8s. Rate: 159.4 symbols/min [2025-10-22T22:17:16.725667] [INFO ] [MAIN ] XHR: Generated 1794 derivative records from 43369 primary records. [2025-10-22T22:17:16.725787] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:16.725943] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-22T22:17:16.742754] [DEBUG] [LOCAL ] XHR: Derivative data saved (1794 records). [2025-10-22T22:17:16.743147] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-22T22:17:16.745791] [INFO ] [MAIN ] Derivative Progress: 2019/2052 symbols completed. XHR took 1.1s. Estimated remaining: 12.4s. Rate: 159.4 symbols/min [2025-10-22T22:17:16.745988] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:16.781629] [DEBUG] [LOCAL ] XPER: Loaded 30694 existing records from primary storage. [2025-10-22T22:17:16.781846] [INFO ] [MAIN ] XPER: Loaded 30694 primary data records. [2025-10-22T22:17:16.900166] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-22T22:17:16.951865] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-10-22T22:17:17.212770] [DEBUG] [LOCAL ] XPEV: Loaded 53619 existing records from primary storage. [2025-10-22T22:17:17.225901] [INFO ] [MAIN ] XPEV: Loaded 53619 primary data records. [2025-10-22T22:17:17.747040] [DEBUG] [MAIN ] XPER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:17.749188] [INFO ] [MAIN ] XPER: Generated 1794 derivative records from 30694 primary records. [2025-10-22T22:17:17.751010] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-22T22:17:17.780737] [DEBUG] [LOCAL ] XPER: Derivative data saved (1794 records). [2025-10-22T22:17:17.781063] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-22T22:17:17.783255] [INFO ] [MAIN ] Derivative Progress: 2020/2052 symbols completed. XPER took 1.1s. Estimated remaining: 12.1s. Rate: 159.3 symbols/min [2025-10-22T22:17:17.783570] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:17.779623] [DEBUG] [MAIN ] XOM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:17.785142] [INFO ] [MAIN ] XOM: Generated 1794 derivative records from 53793 primary records. [2025-10-22T22:17:17.785408] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-22T22:17:17.802346] [DEBUG] [LOCAL ] XOM: Derivative data saved (1794 records). [2025-10-22T22:17:17.802737] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-22T22:17:17.804996] [INFO ] [MAIN ] Derivative Progress: 2021/2052 symbols completed. XOM took 1.1s. Estimated remaining: 11.7s. Rate: 159.4 symbols/min [2025-10-22T22:17:17.805279] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:17.822038] [DEBUG] [MAIN ] XPEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:17.822908] [INFO ] [MAIN ] XPEV: Generated 1794 derivative records from 53619 primary records. [2025-10-22T22:17:17.823009] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-22T22:17:17.852426] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1794 records). [2025-10-22T22:17:17.852767] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-22T22:17:17.855369] [INFO ] [MAIN ] Derivative Progress: 2022/2052 symbols completed. XPEV took 1.1s. Estimated remaining: 11.3s. Rate: 159.5 symbols/min [2025-10-22T22:17:17.863536] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:17.880589] [DEBUG] [LOCAL ] XPO: Loaded 47458 existing records from primary storage. [2025-10-22T22:17:17.881234] [INFO ] [MAIN ] XPO: Loaded 47458 primary data records. [2025-10-22T22:17:17.962123] [DEBUG] [LOCAL ] XPOF: Loaded 36943 existing records from primary storage. [2025-10-22T22:17:17.996345] [INFO ] [MAIN ] XPOF: Loaded 36943 primary data records. [2025-10-22T22:17:18.349873] [DEBUG] [LOCAL ] XPRO: Loaded 45796 existing records from primary storage. [2025-10-22T22:17:18.378559] [INFO ] [MAIN ] XPRO: Loaded 45796 primary data records. [2025-10-22T22:17:18.881748] [DEBUG] [MAIN ] XPO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:17:18.882797] [INFO ] [MAIN ] XPO: Generated 1793 derivative records from 47458 primary records. [2025-10-22T22:17:18.882948] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-22T22:17:18.900817] [DEBUG] [LOCAL ] XPO: Derivative data saved (1793 records). [2025-10-22T22:17:18.901138] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-22T22:17:18.903597] [INFO ] [MAIN ] Derivative Progress: 2023/2052 symbols completed. XPO took 1.1s. Estimated remaining: 10.9s. Rate: 159.3 symbols/min [2025-10-22T22:17:18.919560] [DEBUG] [MAIN ] XPOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:18.920471] [INFO ] [MAIN ] XPOF: Generated 1794 derivative records from 36943 primary records. [2025-10-22T22:17:18.920617] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-22T22:17:18.951314] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1794 records). [2025-10-22T22:17:18.951701] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-22T22:17:18.951529] [DEBUG] [MAIN ] XPRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:18.954245] [INFO ] [MAIN ] Derivative Progress: 2024/2052 symbols completed. XPOF took 1.1s. Estimated remaining: 10.5s. Rate: 159.4 symbols/min [2025-10-22T22:17:18.955007] [INFO ] [MAIN ] XPRO: Generated 1794 derivative records from 45796 primary records. [2025-10-22T22:17:18.955146] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-22T22:17:18.970306] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1794 records). [2025-10-22T22:17:18.970369] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-22T22:17:18.972753] [INFO ] [MAIN ] Derivative Progress: 2025/2052 symbols completed. XPRO took 1.1s. Estimated remaining: 10.2s. Rate: 159.5 symbols/min [2025-10-22T22:17:18.973397] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:18.973328] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:18.973214] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:19.011237] [DEBUG] [LOCAL ] XYF: Loaded 27365 existing records from primary storage. [2025-10-22T22:17:19.025749] [INFO ] [MAIN ] XYF: Loaded 27365 primary data records. [2025-10-22T22:17:19.107193] [DEBUG] [LOCAL ] YALA: Loaded 36411 existing records from primary storage. [2025-10-22T22:17:19.119542] [INFO ] [MAIN ] YALA: Loaded 36411 primary data records. [2025-10-22T22:17:19.162515] [DEBUG] [LOCAL ] XYL: Loaded 47551 existing records from primary storage. [2025-10-22T22:17:19.227162] [INFO ] [MAIN ] XYL: Loaded 47551 primary data records. [2025-10-22T22:17:20.027031] [DEBUG] [MAIN ] XYF: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:17:20.027328] [DEBUG] [MAIN ] YALA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:20.030521] [INFO ] [MAIN ] XYF: Generated 1793 derivative records from 27365 primary records. [2025-10-22T22:17:20.029326] [INFO ] [MAIN ] YALA: Generated 1794 derivative records from 36411 primary records. [2025-10-22T22:17:20.030791] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-22T22:17:20.030724] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-22T22:17:20.076928] [DEBUG] [LOCAL ] YALA: Derivative data saved (1794 records). [2025-10-22T22:17:20.077325] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-22T22:17:20.080040] [INFO ] [MAIN ] Derivative Progress: 2026/2052 symbols completed. YALA took 1.1s. Estimated remaining: 9.8s. Rate: 159.3 symbols/min [2025-10-22T22:17:20.081160] [DEBUG] [LOCAL ] XYF: Derivative data saved (1793 records). [2025-10-22T22:17:20.081386] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-22T22:17:20.081309] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:20.083888] [INFO ] [MAIN ] Derivative Progress: 2027/2052 symbols completed. XYF took 1.1s. Estimated remaining: 9.4s. Rate: 159.4 symbols/min [2025-10-22T22:17:20.074019] [DEBUG] [MAIN ] XYL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:20.085164] [INFO ] [MAIN ] XYL: Generated 1794 derivative records from 47551 primary records. [2025-10-22T22:17:20.084117] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:20.085330] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-22T22:17:20.102155] [DEBUG] [LOCAL ] XYL: Derivative data saved (1794 records). [2025-10-22T22:17:20.102364] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-22T22:17:20.104782] [INFO ] [MAIN ] Derivative Progress: 2028/2052 symbols completed. XYL took 1.1s. Estimated remaining: 9.0s. Rate: 159.5 symbols/min [2025-10-22T22:17:20.104978] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:20.151971] [DEBUG] [LOCAL ] YELP: Loaded 45182 existing records from primary storage. [2025-10-22T22:17:20.162681] [INFO ] [MAIN ] YELP: Loaded 45182 primary data records. [2025-10-22T22:17:20.305769] [DEBUG] [LOCAL ] YEXT: Loaded 43044 existing records from primary storage. [2025-10-22T22:17:20.312260] [INFO ] [MAIN ] YEXT: Loaded 43044 primary data records. [2025-10-22T22:17:20.312147] [DEBUG] [LOCAL ] YETI: Loaded 52517 existing records from primary storage. [2025-10-22T22:17:20.436870] [INFO ] [MAIN ] YETI: Loaded 52517 primary data records. [2025-10-22T22:17:21.167900] [DEBUG] [MAIN ] YELP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:21.169227] [INFO ] [MAIN ] YELP: Generated 1794 derivative records from 45182 primary records. [2025-10-22T22:17:21.169503] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-22T22:17:21.187584] [DEBUG] [LOCAL ] YELP: Derivative data saved (1794 records). [2025-10-22T22:17:21.188874] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-22T22:17:21.190857] [INFO ] [MAIN ] Derivative Progress: 2029/2052 symbols completed. YELP took 1.1s. Estimated remaining: 8.7s. Rate: 159.3 symbols/min [2025-10-22T22:17:21.191297] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:21.209766] [DEBUG] [MAIN ] YETI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:21.223271] [INFO ] [MAIN ] YETI: Generated 1794 derivative records from 52517 primary records. [2025-10-22T22:17:21.223718] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-22T22:17:21.224912] [DEBUG] [MAIN ] YEXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:21.233339] [INFO ] [MAIN ] YEXT: Generated 1794 derivative records from 43044 primary records. [2025-10-22T22:17:21.237669] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-22T22:17:21.242444] [DEBUG] [LOCAL ] YETI: Derivative data saved (1794 records). [2025-10-22T22:17:21.242969] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-22T22:17:21.245614] [INFO ] [MAIN ] Derivative Progress: 2030/2052 symbols completed. YETI took 1.2s. Estimated remaining: 8.3s. Rate: 159.4 symbols/min [2025-10-22T22:17:21.246255] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:21.266372] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1794 records). [2025-10-22T22:17:21.266819] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-22T22:17:21.269560] [INFO ] [MAIN ] Derivative Progress: 2031/2052 symbols completed. YEXT took 1.2s. Estimated remaining: 7.9s. Rate: 159.4 symbols/min [2025-10-22T22:17:21.269994] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:21.324395] [DEBUG] [LOCAL ] YMM: Loaded 52576 existing records from primary storage. [2025-10-22T22:17:21.338297] [INFO ] [MAIN ] YMM: Loaded 52576 primary data records. [2025-10-22T22:17:21.478206] [DEBUG] [LOCAL ] YPF: Loaded 50750 existing records from primary storage. [2025-10-22T22:17:21.478885] [DEBUG] [LOCAL ] YOU: Loaded 49536 existing records from primary storage. [2025-10-22T22:17:21.484753] [INFO ] [MAIN ] YOU: Loaded 49536 primary data records. [2025-10-22T22:17:21.495061] [INFO ] [MAIN ] YPF: Loaded 50750 primary data records. [2025-10-22T22:17:22.336282] [DEBUG] [MAIN ] YMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:22.348812] [INFO ] [MAIN ] YMM: Generated 1794 derivative records from 52576 primary records. [2025-10-22T22:17:22.348991] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-22T22:17:22.349602] [DEBUG] [MAIN ] YOU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:22.351018] [INFO ] [MAIN ] YOU: Generated 1794 derivative records from 49536 primary records. [2025-10-22T22:17:22.361920] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-22T22:17:22.367049] [DEBUG] [LOCAL ] YMM: Derivative data saved (1794 records). [2025-10-22T22:17:22.368583] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-22T22:17:22.370796] [INFO ] [MAIN ] Derivative Progress: 2032/2052 symbols completed. YMM took 1.2s. Estimated remaining: 7.5s. Rate: 159.3 symbols/min [2025-10-22T22:17:22.377959] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:22.398009] [DEBUG] [LOCAL ] YOU: Derivative data saved (1794 records). [2025-10-22T22:17:22.398698] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-10-22T22:17:22.398621] [DEBUG] [MAIN ] YPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:22.402210] [INFO ] [MAIN ] YPF: Generated 1794 derivative records from 50750 primary records. [2025-10-22T22:17:22.401298] [INFO ] [MAIN ] Derivative Progress: 2033/2052 symbols completed. YOU took 1.2s. Estimated remaining: 7.2s. Rate: 159.4 symbols/min [2025-10-22T22:17:22.402375] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-22T22:17:22.402472] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:22.421411] [DEBUG] [LOCAL ] YPF: Derivative data saved (1794 records). [2025-10-22T22:17:22.421666] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-22T22:17:22.424095] [INFO ] [MAIN ] Derivative Progress: 2034/2052 symbols completed. YPF took 1.2s. Estimated remaining: 6.8s. Rate: 159.4 symbols/min [2025-10-22T22:17:22.424286] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:22.429389] [DEBUG] [LOCAL ] YRD: Loaded 11169 existing records from primary storage. [2025-10-22T22:17:22.429575] [INFO ] [MAIN ] YRD: Loaded 11169 primary data records. [2025-10-22T22:17:22.664385] [DEBUG] [LOCAL ] YSG: Loaded 25642 existing records from primary storage. [2025-10-22T22:17:22.664550] [INFO ] [MAIN ] YSG: Loaded 25642 primary data records. [2025-10-22T22:17:22.911089] [DEBUG] [LOCAL ] YUM: Loaded 51147 existing records from primary storage. [2025-10-22T22:17:22.945092] [INFO ] [MAIN ] YUM: Loaded 51147 primary data records. [2025-10-22T22:17:23.375454] [DEBUG] [MAIN ] YRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:23.376877] [INFO ] [MAIN ] YRD: Generated 1794 derivative records from 11169 primary records. [2025-10-22T22:17:23.376970] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-22T22:17:23.394398] [DEBUG] [LOCAL ] YRD: Derivative data saved (1794 records). [2025-10-22T22:17:23.395540] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-22T22:17:23.398779] [INFO ] [MAIN ] Derivative Progress: 2035/2052 symbols completed. YRD took 1.0s. Estimated remaining: 6.4s. Rate: 159.3 symbols/min [2025-10-22T22:17:23.399488] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:23.413179] [DEBUG] [MAIN ] YSG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:23.414217] [INFO ] [MAIN ] YSG: Generated 1794 derivative records from 25642 primary records. [2025-10-22T22:17:23.414395] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-22T22:17:23.430784] [DEBUG] [LOCAL ] YSG: Derivative data saved (1794 records). [2025-10-22T22:17:23.431030] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-10-22T22:17:23.433348] [INFO ] [MAIN ] Derivative Progress: 2036/2052 symbols completed. YSG took 1.0s. Estimated remaining: 6.0s. Rate: 159.4 symbols/min [2025-10-22T22:17:23.433563] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:23.450047] [DEBUG] [MAIN ] YUM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:23.450738] [INFO ] [MAIN ] YUM: Generated 1794 derivative records from 51147 primary records. [2025-10-22T22:17:23.450918] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-22T22:17:23.480904] [DEBUG] [LOCAL ] YUM: Derivative data saved (1794 records). [2025-10-22T22:17:23.481042] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-22T22:17:23.483796] [INFO ] [MAIN ] Derivative Progress: 2037/2052 symbols completed. YUM took 1.1s. Estimated remaining: 5.6s. Rate: 159.5 symbols/min [2025-10-22T22:17:23.484090] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:23.513710] [DEBUG] [LOCAL ] YUMC: Loaded 52576 existing records from primary storage. [2025-10-22T22:17:23.513849] [INFO ] [MAIN ] YUMC: Loaded 52576 primary data records. [2025-10-22T22:17:23.621165] [DEBUG] [LOCAL ] ZEPP: Loaded 19612 existing records from primary storage. [2025-10-22T22:17:23.639963] [INFO ] [MAIN ] ZEPP: Loaded 19612 primary data records. [2025-10-22T22:17:23.644454] [DEBUG] [LOCAL ] ZBH: Loaded 50705 existing records from primary storage. [2025-10-22T22:17:23.670345] [INFO ] [MAIN ] ZBH: Loaded 50705 primary data records. [2025-10-22T22:17:24.543868] [DEBUG] [MAIN ] YUMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:24.544636] [INFO ] [MAIN ] YUMC: Generated 1794 derivative records from 52576 primary records. [2025-10-22T22:17:24.545263] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-22T22:17:24.562871] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1794 records). [2025-10-22T22:17:24.563044] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-22T22:17:24.565741] [INFO ] [MAIN ] Derivative Progress: 2038/2052 symbols completed. YUMC took 1.2s. Estimated remaining: 5.3s. Rate: 159.3 symbols/min [2025-10-22T22:17:24.594294] [DEBUG] [MAIN ] ZEPP: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T22:17:24.595389] [INFO ] [MAIN ] ZEPP: Generated 1793 derivative records from 19612 primary records. [2025-10-22T22:17:24.594703] [DEBUG] [MAIN ] ZBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:24.595469] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-22T22:17:24.596410] [INFO ] [MAIN ] ZBH: Generated 1794 derivative records from 50705 primary records. [2025-10-22T22:17:24.596719] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-22T22:17:24.625549] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1794 records). [2025-10-22T22:17:24.625863] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1793 records). [2025-10-22T22:17:24.625959] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-10-22T22:17:24.626037] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-22T22:17:24.628849] [INFO ] [MAIN ] Derivative Progress: 2039/2052 symbols completed. ZEPP took 1.1s. Estimated remaining: 4.9s. Rate: 159.4 symbols/min [2025-10-22T22:17:24.631723] [INFO ] [MAIN ] Derivative Progress: 2040/2052 symbols completed. ZBH took 1.2s. Estimated remaining: 4.5s. Rate: 159.5 symbols/min [2025-10-22T22:17:24.632131] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:24.632080] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:24.632178] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:24.668909] [DEBUG] [LOCAL ] ZH: Loaded 24633 existing records from primary storage. [2025-10-22T22:17:24.669064] [INFO ] [MAIN ] ZH: Loaded 24633 primary data records. [2025-10-22T22:17:24.799689] [DEBUG] [LOCAL ] ZGN: Loaded 40896 existing records from primary storage. [2025-10-22T22:17:24.811377] [INFO ] [MAIN ] ZGN: Loaded 40896 primary data records. [2025-10-22T22:17:25.101312] [DEBUG] [LOCAL ] ZETA: Loaded 53618 existing records from primary storage. [2025-10-22T22:17:25.136412] [INFO ] [MAIN ] ZETA: Loaded 53618 primary data records. [2025-10-22T22:17:25.642448] [DEBUG] [MAIN ] ZH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:25.645363] [INFO ] [MAIN ] ZH: Generated 1794 derivative records from 24633 primary records. [2025-10-22T22:17:25.645615] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-22T22:17:25.671791] [DEBUG] [MAIN ] ZGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:25.673266] [INFO ] [MAIN ] ZGN: Generated 1794 derivative records from 40896 primary records. [2025-10-22T22:17:25.673360] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-22T22:17:25.677722] [DEBUG] [LOCAL ] ZH: Derivative data saved (1794 records). [2025-10-22T22:17:25.684940] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-22T22:17:25.687830] [INFO ] [MAIN ] Derivative Progress: 2041/2052 symbols completed. ZH took 1.1s. Estimated remaining: 4.1s. Rate: 159.3 symbols/min [2025-10-22T22:17:25.687985] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:25.698216] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1794 records). [2025-10-22T22:17:25.698497] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-22T22:17:25.713570] [INFO ] [MAIN ] Derivative Progress: 2042/2052 symbols completed. ZGN took 1.1s. Estimated remaining: 3.8s. Rate: 159.4 symbols/min [2025-10-22T22:17:25.714225] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:25.714925] [DEBUG] [MAIN ] ZETA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:25.716192] [INFO ] [MAIN ] ZETA: Generated 1794 derivative records from 53618 primary records. [2025-10-22T22:17:25.716411] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-22T22:17:25.734847] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1794 records). [2025-10-22T22:17:25.735151] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-22T22:17:25.737959] [INFO ] [MAIN ] Derivative Progress: 2043/2052 symbols completed. ZETA took 1.1s. Estimated remaining: 3.4s. Rate: 159.5 symbols/min [2025-10-22T22:17:25.738176] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:25.785607] [DEBUG] [LOCAL ] ZIM: Loaded 53462 existing records from primary storage. [2025-10-22T22:17:25.785859] [INFO ] [MAIN ] ZIM: Loaded 53462 primary data records. [2025-10-22T22:17:25.909619] [DEBUG] [LOCAL ] ZIP: Loaded 43466 existing records from primary storage. [2025-10-22T22:17:25.920519] [INFO ] [MAIN ] ZIP: Loaded 43466 primary data records. [2025-10-22T22:17:25.959054] [DEBUG] [LOCAL ] ZK: Loaded 38961 existing records from primary storage. [2025-10-22T22:17:26.006003] [INFO ] [MAIN ] ZK: Loaded 38961 primary data records. [2025-10-22T22:17:26.753838] [DEBUG] [MAIN ] ZIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:26.754972] [INFO ] [MAIN ] ZIM: Generated 1794 derivative records from 53462 primary records. [2025-10-22T22:17:26.755071] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-22T22:17:26.774295] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1794 records). [2025-10-22T22:17:26.774826] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-10-22T22:17:26.776843] [INFO ] [MAIN ] Derivative Progress: 2044/2052 symbols completed. ZIM took 1.1s. Estimated remaining: 3.0s. Rate: 159.3 symbols/min [2025-10-22T22:17:26.777481] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:26.811335] [DEBUG] [MAIN ] ZIP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:26.816108] [DEBUG] [MAIN ] ZK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:26.817785] [INFO ] [MAIN ] ZIP: Generated 1794 derivative records from 43466 primary records. [2025-10-22T22:17:26.815403] [DEBUG] [LOCAL ] ZKH: Loaded 7323 existing records from primary storage. [2025-10-22T22:17:26.817046] [INFO ] [MAIN ] ZK: Generated 1794 derivative records from 38961 primary records. [2025-10-22T22:17:26.818002] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-22T22:17:26.818095] [INFO ] [MAIN ] ZKH: Loaded 7323 primary data records. [2025-10-22T22:17:26.818232] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-22T22:17:26.931039] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1794 records). [2025-10-22T22:17:26.955553] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-22T22:17:26.942436] [DEBUG] [LOCAL ] ZK: Derivative data saved (1794 records). [2025-10-22T22:17:26.961454] [INFO ] [MAIN ] Derivative Progress: 2045/2052 symbols completed. ZIP took 1.2s. Estimated remaining: 2.6s. Rate: 159.4 symbols/min [2025-10-22T22:17:26.962053] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:26.973469] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-22T22:17:26.991891] [INFO ] [MAIN ] Derivative Progress: 2046/2052 symbols completed. ZK took 1.3s. Estimated remaining: 2.3s. Rate: 159.4 symbols/min [2025-10-22T22:17:27.004348] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:27.170287] [DEBUG] [LOCAL ] ZTR: Loaded 16504 existing records from primary storage. [2025-10-22T22:17:27.170828] [INFO ] [MAIN ] ZTR: Loaded 16504 primary data records. [2025-10-22T22:17:27.339575] [DEBUG] [LOCAL ] ZTO: Loaded 49371 existing records from primary storage. [2025-10-22T22:17:27.355742] [INFO ] [MAIN ] ZTO: Loaded 49371 primary data records. [2025-10-22T22:17:27.618634] [DEBUG] [MAIN ] ZKH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:27.619714] [INFO ] [MAIN ] ZKH: Generated 1794 derivative records from 7323 primary records. [2025-10-22T22:17:27.631068] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-22T22:17:27.714930] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1794 records). [2025-10-22T22:17:27.830866] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-22T22:17:27.833269] [INFO ] [MAIN ] Derivative Progress: 2047/2052 symbols completed. ZKH took 1.1s. Estimated remaining: 1.9s. Rate: 159.3 symbols/min [2025-10-22T22:17:27.833680] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:27.856099] [DEBUG] [MAIN ] ZTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:27.857040] [INFO ] [MAIN ] ZTR: Generated 1794 derivative records from 16504 primary records. [2025-10-22T22:17:27.857208] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-22T22:17:27.874033] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1794 records). [2025-10-22T22:17:27.874276] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-22T22:17:27.876721] [INFO ] [MAIN ] Derivative Progress: 2048/2052 symbols completed. ZTR took 0.9s. Estimated remaining: 1.5s. Rate: 159.4 symbols/min [2025-10-22T22:17:27.877135] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:27.907085] [DEBUG] [MAIN ] ZTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:27.907949] [INFO ] [MAIN ] ZTO: Generated 1794 derivative records from 49371 primary records. [2025-10-22T22:17:27.908092] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-22T22:17:27.923743] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1794 records). [2025-10-22T22:17:27.923834] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-22T22:17:27.926363] [INFO ] [MAIN ] Derivative Progress: 2049/2052 symbols completed. ZTO took 1.0s. Estimated remaining: 1.1s. Rate: 159.5 symbols/min [2025-10-22T22:17:27.926570] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-22T22:17:27.950259] [DEBUG] [LOCAL ] ZTS: Loaded 53128 existing records from primary storage. [2025-10-22T22:17:27.950560] [INFO ] [MAIN ] ZTS: Loaded 53128 primary data records. [2025-10-22T22:17:28.063671] [DEBUG] [LOCAL ] ZVIA: Loaded 35832 existing records from primary storage. [2025-10-22T22:17:28.069419] [INFO ] [MAIN ] ZVIA: Loaded 35832 primary data records. [2025-10-22T22:17:28.423002] [DEBUG] [LOCAL ] ZWS: Loaded 42136 existing records from primary storage. [2025-10-22T22:17:28.445182] [INFO ] [MAIN ] ZWS: Loaded 42136 primary data records. [2025-10-22T22:17:28.954917] [DEBUG] [MAIN ] ZTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:28.956293] [INFO ] [MAIN ] ZTS: Generated 1794 derivative records from 53128 primary records. [2025-10-22T22:17:28.956534] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-22T22:17:28.975290] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1794 records). [2025-10-22T22:17:28.976491] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-22T22:17:28.978736] [INFO ] [MAIN ] Derivative Progress: 2050/2052 symbols completed. ZTS took 1.1s. Estimated remaining: 0.8s. Rate: 159.3 symbols/min [2025-10-22T22:17:28.993704] [DEBUG] [MAIN ] ZVIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:28.994424] [INFO ] [MAIN ] ZVIA: Generated 1794 derivative records from 35832 primary records. [2025-10-22T22:17:28.994573] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-22T22:17:29.013387] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1794 records). [2025-10-22T22:17:29.013541] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-10-22T22:17:29.016349] [INFO ] [MAIN ] Derivative Progress: 2051/2052 symbols completed. ZVIA took 1.1s. Estimated remaining: 0.4s. Rate: 159.4 symbols/min [2025-10-22T22:17:29.032261] [DEBUG] [MAIN ] ZWS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T22:17:29.032957] [INFO ] [MAIN ] ZWS: Generated 1794 derivative records from 42136 primary records. [2025-10-22T22:17:29.033018] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-22T22:17:29.047947] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1794 records). [2025-10-22T22:17:29.048015] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-22T22:17:29.050569] [INFO ] [MAIN ] Derivative Progress: 2052/2052 symbols completed. ZWS took 1.1s. Estimated remaining: 0.0s. Rate: 159.5 symbols/min [2025-10-22T22:17:29.051791] [INFO ] [MAIN ] Parallel derivative generation completed in 12m 52s [2025-10-22T22:17:29.051866] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2052/2052 symbols) [2025-10-22T22:17:30.138364] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2052/2052 @ 100.00%)' [2025-10-22T22:17:30.138914] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-22T22:17:30.140011] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-22T22:17:30.140181] [INFO ] [STATE ] Last completion updated: 2025-10-22T22:17:30.140086 [2025-10-22T23:20:26.415089] [INFO ] [MAIN ] Using last completed trading day: 2025-10-22 [2025-10-22T23:20:26.415247] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-22T23:20:26.415323] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-22T23:20:26.415394] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-22T23:20:26.415434] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-22T23:20:27.947379] [DEBUG] [SYMBOL ] Found 2419 valid NYSE symbols. [2025-10-22T23:20:27.947740] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-22T23:20:27.947995] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-22T23:20:27.948686] [INFO ] [LOCAL ] Symbols cache updated with 2367 symbols. [2025-10-22T23:20:27.948767] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-22T23:20:27.948842] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-22T23:20:27.948977] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-22T23:20:27.949050] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-22T23:20:27.949095] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-22T23:20:27.949491] [DEBUG] [LOCAL ] Found 2367 symbols in cached list. [2025-10-22T23:20:27.949566] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-22T23:20:27.949810] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-22T23:20:27.949898] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2367 valid symbols. [2025-10-22T23:20:27.949987] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-22T23:20:27.950063] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-22T23:20:27.977944] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-22T23:20:28.009086] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-22T23:20:28.009429] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-22T23:20:28.009518] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-22T23:20:28.009595] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-22T23:20:28.009732] [INFO ] [MAIN ] Running derivative generation in single-threaded mode [2025-10-22T23:20:28.009812] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-22T23:20:28.009895] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-22T23:20:28.011437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-10-22T23:20:28.011737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-22T23:20:28.011887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-22T23:20:28.012113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-22T23:20:28.012292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-22T23:20:28.012424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-10-22T23:20:28.012707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-10-22T23:20:28.012847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-10-22T23:20:28.013015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-10-22T23:20:28.013250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-22T23:20:28.013383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-22T23:20:28.013503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-10-22T23:20:28.013685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-10-22T23:20:28.013833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-10-22T23:20:28.013967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-10-22T23:20:28.014104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-10-22T23:20:28.014257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-10-22T23:20:28.014490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-10-22T23:20:28.014622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-22T23:20:28.014776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-22T23:20:28.014908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-22T23:20:28.015087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-10-22T23:20:28.015221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-10-22T23:20:28.015362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-10-22T23:20:28.015541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-10-22T23:20:28.015693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-10-22T23:20:28.015812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-10-22T23:20:28.015927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-10-22T23:20:28.016056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-22T23:20:28.016207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-10-22T23:20:28.016337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-10-22T23:20:28.016466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-10-22T23:20:28.016603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-22T23:20:28.016780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-10-22T23:20:28.016931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-10-22T23:20:28.017055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-10-22T23:20:28.017172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-22T23:20:28.017372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-22T23:20:28.017509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-10-22T23:20:28.017676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-10-22T23:20:28.017807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-10-22T23:20:28.017924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-10-22T23:20:28.018037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-10-22T23:20:28.018163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRK.csv [2025-10-22T23:20:28.018291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-22T23:20:28.018467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-22T23:20:28.018679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-22T23:20:28.018798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-10-22T23:20:28.018916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-10-22T23:20:28.019031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-10-22T23:20:28.019187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-22T23:20:28.019323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-22T23:20:28.019495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-10-22T23:20:28.019667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-22T23:20:28.019787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-10-22T23:20:28.019911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-22T23:20:28.020067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-22T23:20:28.020202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-22T23:20:28.020320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-22T23:20:28.020432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-22T23:20:28.020546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-10-22T23:20:28.020689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-10-22T23:20:28.020851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-22T23:20:28.020968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-10-22T23:20:28.021083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-10-22T23:20:28.021195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-22T23:20:28.021309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-10-22T23:20:28.021448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-10-22T23:20:28.021561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-22T23:20:28.021725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-22T23:20:28.021853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-10-22T23:20:28.022045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-22T23:20:28.022312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-22T23:20:28.022508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-10-22T23:20:28.022688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-22T23:20:28.022835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-10-22T23:20:28.022981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-22T23:20:28.023132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-10-22T23:20:28.023263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-10-22T23:20:28.023379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-10-22T23:20:28.023502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-10-22T23:20:28.023635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-10-22T23:20:28.023789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-22T23:20:28.023904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-22T23:20:28.024018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-10-22T23:20:28.024133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-10-22T23:20:28.024251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-10-22T23:20:28.024369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-10-22T23:20:28.024497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-10-22T23:20:28.024778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-10-22T23:20:28.024900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-22T23:20:28.025020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-10-22T23:20:28.025134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-10-22T23:20:28.025252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-10-22T23:20:28.025379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-22T23:20:28.025495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-10-22T23:20:28.025673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-22T23:20:28.025802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-22T23:20:28.025966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-22T23:20:28.026118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-22T23:20:28.026239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-10-22T23:20:28.026364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-22T23:20:28.026520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-22T23:20:28.026634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-22T23:20:28.027103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-10-22T23:20:28.027247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-10-22T23:20:28.027393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-10-22T23:20:28.027536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-22T23:20:28.027698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-22T23:20:28.027899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-10-22T23:20:28.028015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-10-22T23:20:28.028162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-22T23:20:28.028282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-10-22T23:20:28.028397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-22T23:20:28.028522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-22T23:20:28.028701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-22T23:20:28.028820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-22T23:20:28.028952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-22T23:20:28.029081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-10-22T23:20:28.029215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-10-22T23:20:28.029397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-10-22T23:20:28.029534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-22T23:20:28.029726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-10-22T23:20:28.029872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-10-22T23:20:28.029988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-10-22T23:20:28.030146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-22T23:20:28.030312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-22T23:20:28.030507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-22T23:20:28.030628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-10-22T23:20:28.030819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-10-22T23:20:28.030945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-22T23:20:28.031062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-10-22T23:20:28.031173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-10-22T23:20:28.031328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-22T23:20:28.031444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-22T23:20:28.031622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-10-22T23:20:28.031763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-22T23:20:28.031877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-10-22T23:20:28.032002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PG.csv [2025-10-22T23:20:28.032348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-22T23:20:28.032478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-10-22T23:20:28.032594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-22T23:20:28.032735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-22T23:20:28.032850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-22T23:20:28.033041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-22T23:20:28.033162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-10-22T23:20:28.033317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-22T23:20:28.033434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-10-22T23:20:28.033548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-10-22T23:20:28.033713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-22T23:20:28.033876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-22T23:20:28.034005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-22T23:20:28.034143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-10-22T23:20:28.034257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-22T23:20:28.034375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-22T23:20:28.034491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-10-22T23:20:28.034603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-10-22T23:20:28.034790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-22T23:20:28.034912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-10-22T23:20:28.035043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-10-22T23:20:28.035160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-22T23:20:28.035311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-10-22T23:20:28.035496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-10-22T23:20:28.035626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-10-22T23:20:28.035838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-10-22T23:20:28.035974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-10-22T23:20:28.036095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-10-22T23:20:28.036265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-22T23:20:28.036387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-22T23:20:28.036500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-10-22T23:20:28.036628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-22T23:20:28.036815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-22T23:20:28.036944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-10-22T23:20:28.037094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-22T23:20:28.037220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-10-22T23:20:28.037405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-10-22T23:20:28.037537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-22T23:20:28.037680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-10-22T23:20:28.037799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-22T23:20:28.037917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-22T23:20:28.038086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-10-22T23:20:28.038199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-10-22T23:20:28.038388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-22T23:20:28.038508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-22T23:20:28.038680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-22T23:20:28.038812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-22T23:20:28.038985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-22T23:20:28.039105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-10-22T23:20:28.039219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-22T23:20:28.039334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-22T23:20:28.039446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-10-22T23:20:28.039586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-10-22T23:20:28.039788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-22T23:20:28.039906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-22T23:20:28.040020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-10-22T23:20:28.040146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-10-22T23:20:28.040301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-22T23:20:28.040418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-10-22T23:20:28.040531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-10-22T23:20:28.040671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-10-22T23:20:28.040787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-10-22T23:20:28.040913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-10-22T23:20:28.041098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-22T23:20:28.041245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-10-22T23:20:28.041367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-10-22T23:20:28.041503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-10-22T23:20:28.041680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-10-22T23:20:28.041797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-22T23:20:28.041910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-10-22T23:20:28.042023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-22T23:20:28.042137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-10-22T23:20:28.042250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-22T23:20:28.042362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-10-22T23:20:28.042476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-22T23:20:28.042602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-10-22T23:20:28.042742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-10-22T23:20:28.042853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-10-22T23:20:28.042965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-22T23:20:28.043077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBTM.csv [2025-10-22T23:20:28.043233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-10-22T23:20:28.043370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-10-22T23:20:28.043499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-10-22T23:20:28.043615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-22T23:20:28.043759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-10-22T23:20:28.043894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-10-22T23:20:28.044014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-10-22T23:20:28.044127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-10-22T23:20:28.044254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-10-22T23:20:28.044507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-10-22T23:20:28.044875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-10-22T23:20:28.045037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-22T23:20:28.045166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-10-22T23:20:28.045293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-10-22T23:20:28.045409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-10-22T23:20:28.045526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-22T23:20:28.045670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-22T23:20:28.045888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-22T23:20:28.046086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-22T23:20:28.047114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-10-22T23:20:28.047260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-10-22T23:20:28.047400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-10-22T23:20:28.047534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-22T23:20:28.047691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-10-22T23:20:28.047812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-10-22T23:20:28.047931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-10-22T23:20:28.048058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-10-22T23:20:28.048172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-10-22T23:20:28.048288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-22T23:20:28.048409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-10-22T23:20:28.048528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-10-22T23:20:28.048667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-10-22T23:20:28.048797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-10-22T23:20:28.048920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-10-22T23:20:28.049085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-22T23:20:28.049202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-10-22T23:20:28.049321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-10-22T23:20:28.049442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-10-22T23:20:28.049558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-22T23:20:28.049869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-10-22T23:20:28.050054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-22T23:20:28.050177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-10-22T23:20:28.050310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-22T23:20:28.050434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-10-22T23:20:28.050547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-10-22T23:20:28.050683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-10-22T23:20:28.050816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-10-22T23:20:28.050947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-10-22T23:20:28.051174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-22T23:20:28.051297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-10-22T23:20:28.051421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-22T23:20:28.051610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-22T23:20:28.051793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-22T23:20:28.051910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-10-22T23:20:28.052029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-10-22T23:20:28.052141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-22T23:20:28.052257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-22T23:20:28.052434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-10-22T23:20:28.052569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-10-22T23:20:28.052710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-10-22T23:20:28.052925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-22T23:20:28.053046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-22T23:20:28.053177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-22T23:20:28.053349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-22T23:20:28.053471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-10-22T23:20:28.053632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-22T23:20:28.053777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-10-22T23:20:28.053896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-10-22T23:20:28.054015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-10-22T23:20:28.054127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-10-22T23:20:28.054426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-22T23:20:28.054599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-22T23:20:28.054984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-10-22T23:20:28.055144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-22T23:20:28.055264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-22T23:20:28.055423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-22T23:20:28.055557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-22T23:20:28.055735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-10-22T23:20:28.055899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-22T23:20:28.056018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-22T23:20:28.056181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-22T23:20:28.056300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCG.csv [2025-10-22T23:20:28.056416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-22T23:20:28.056535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-10-22T23:20:28.056756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-22T23:20:28.056895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-10-22T23:20:28.057014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-22T23:20:28.057131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-10-22T23:20:28.057250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-22T23:20:28.057412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-22T23:20:28.057575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-22T23:20:28.057749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-10-22T23:20:28.057868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-10-22T23:20:28.058008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-22T23:20:28.058128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-22T23:20:28.058245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-10-22T23:20:28.058358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-10-22T23:20:28.058471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-22T23:20:28.058587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-10-22T23:20:28.058762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-22T23:20:28.058885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-10-22T23:20:28.059001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-10-22T23:20:28.059159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-22T23:20:28.059314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-22T23:20:28.059429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-22T23:20:28.059544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-10-22T23:20:28.059722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-22T23:20:28.059841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-10-22T23:20:28.060010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-22T23:20:28.060134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-10-22T23:20:28.060317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-10-22T23:20:28.060436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-22T23:20:28.060605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-22T23:20:28.060747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-10-22T23:20:28.060867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-22T23:20:28.061023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-10-22T23:20:28.061150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-22T23:20:28.061291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-10-22T23:20:28.061426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-22T23:20:28.061544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-10-22T23:20:28.061689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-10-22T23:20:28.061805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-10-22T23:20:28.061922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-10-22T23:20:28.062040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-22T23:20:28.062154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-10-22T23:20:28.062269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-22T23:20:28.062385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-22T23:20:28.062498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-10-22T23:20:28.062616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-10-22T23:20:28.062781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-10-22T23:20:28.062901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-10-22T23:20:28.063016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-22T23:20:28.063131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-22T23:20:28.063413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-22T23:20:28.063536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-10-22T23:20:28.063758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-22T23:20:28.063880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-22T23:20:28.064000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-10-22T23:20:28.064126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-10-22T23:20:28.064250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-10-22T23:20:28.064399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-22T23:20:28.064520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-10-22T23:20:28.064632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-10-22T23:20:28.064773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-22T23:20:28.064887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-22T23:20:28.065002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-10-22T23:20:28.065124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-10-22T23:20:28.065239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-10-22T23:20:28.065353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-10-22T23:20:28.065467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-10-22T23:20:28.065581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-10-22T23:20:28.065780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-22T23:20:28.065901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-10-22T23:20:28.066012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-10-22T23:20:28.066138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-22T23:20:28.066254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-10-22T23:20:28.066368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-22T23:20:28.066483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-10-22T23:20:28.066592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-22T23:20:28.066735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-10-22T23:20:28.066848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-22T23:20:28.066962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-22T23:20:28.067076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-10-22T23:20:28.067191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-10-22T23:20:28.067503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-10-22T23:20:28.068040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNC.csv [2025-10-22T23:20:28.068168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-10-22T23:20:28.068292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-10-22T23:20:28.068456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-10-22T23:20:28.068612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-22T23:20:28.068753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-10-22T23:20:28.068874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-10-22T23:20:28.068991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-22T23:20:28.069153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-10-22T23:20:28.069269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETSY.csv [2025-10-22T23:20:28.069383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-10-22T23:20:28.069499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-10-22T23:20:28.069612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-10-22T23:20:28.069755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-22T23:20:28.069869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-22T23:20:28.069982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-22T23:20:28.070099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-10-22T23:20:28.070252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-22T23:20:28.070438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-22T23:20:28.070555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-10-22T23:20:28.070697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-10-22T23:20:28.070814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-10-22T23:20:28.070931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-22T23:20:28.071044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-10-22T23:20:28.071155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-22T23:20:28.071278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-10-22T23:20:28.071408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-10-22T23:20:28.071592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-22T23:20:28.071854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-22T23:20:28.071977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-10-22T23:20:28.072092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-22T23:20:28.072326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-22T23:20:28.072445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-22T23:20:28.072559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-10-22T23:20:28.072695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-10-22T23:20:28.072939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-22T23:20:28.073055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-10-22T23:20:28.073171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRSU.csv [2025-10-22T23:20:28.073284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-22T23:20:28.073458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-22T23:20:28.073575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-10-22T23:20:28.073760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-10-22T23:20:28.073881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-10-22T23:20:28.073994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-10-22T23:20:28.074158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-22T23:20:28.074313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-10-22T23:20:28.074426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-10-22T23:20:28.074546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-22T23:20:28.074965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-22T23:20:28.075135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-22T23:20:28.075252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-22T23:20:28.075365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-10-22T23:20:28.075481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-22T23:20:28.075596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-10-22T23:20:28.075750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-10-22T23:20:28.075873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-10-22T23:20:28.075985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-22T23:20:28.076128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-22T23:20:28.076253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-22T23:20:28.076365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-22T23:20:28.076486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-10-22T23:20:28.076597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-22T23:20:28.076730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-22T23:20:28.076840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-22T23:20:28.076949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-10-22T23:20:28.077066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-22T23:20:28.077177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-22T23:20:28.077353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-22T23:20:28.077497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-22T23:20:28.077611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-22T23:20:28.077744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-10-22T23:20:28.077854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-22T23:20:28.077965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-10-22T23:20:28.078078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-22T23:20:28.078193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-10-22T23:20:28.078349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-10-22T23:20:28.078480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-10-22T23:20:28.078595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-10-22T23:20:28.078858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-22T23:20:28.078993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-10-22T23:20:28.079115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-10-22T23:20:28.079372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-22T23:20:28.079477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-10-22T23:20:28.079553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-10-22T23:20:28.079627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-22T23:20:28.081828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-22T23:20:28.081945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-10-22T23:20:28.082087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-22T23:20:28.082185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-10-22T23:20:28.082356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-22T23:20:28.082465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-10-22T23:20:28.082541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-22T23:20:28.082611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-22T23:20:28.082927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-22T23:20:28.083072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-10-22T23:20:28.083199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-22T23:20:28.083272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-22T23:20:28.083346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-10-22T23:20:28.083414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-10-22T23:20:28.083486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-22T23:20:28.083556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-22T23:20:28.083628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-10-22T23:20:28.083793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-22T23:20:28.083896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-10-22T23:20:28.083970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-22T23:20:28.084050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-10-22T23:20:28.084353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-22T23:20:28.084514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-22T23:20:28.084608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-10-22T23:20:28.084730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-10-22T23:20:28.084829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-10-22T23:20:28.084902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-10-22T23:20:28.084972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-10-22T23:20:28.085041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-10-22T23:20:28.085140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-10-22T23:20:28.085247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-10-22T23:20:28.085324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-10-22T23:20:28.085446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-10-22T23:20:28.085543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-10-22T23:20:28.085627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-10-22T23:20:28.086777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-10-22T23:20:28.086946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-22T23:20:28.087046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-22T23:20:28.087122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-10-22T23:20:28.087197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-22T23:20:28.087275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-22T23:20:28.087413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-10-22T23:20:28.087509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-10-22T23:20:28.087586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-22T23:20:28.087753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-22T23:20:28.087871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-22T23:20:28.087952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-10-22T23:20:28.088026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-10-22T23:20:28.088134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-10-22T23:20:28.088222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-10-22T23:20:28.088307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-22T23:20:28.088386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-22T23:20:28.088463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-10-22T23:20:28.088548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-10-22T23:20:28.090674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-22T23:20:28.090789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-10-22T23:20:28.090877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-10-22T23:20:28.090957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-22T23:20:28.091028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-10-22T23:20:28.091139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-10-22T23:20:28.091209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-10-22T23:20:28.091286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-22T23:20:28.091369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-10-22T23:20:28.091454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-22T23:20:28.091548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-10-22T23:20:28.091705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-22T23:20:28.091818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-10-22T23:20:28.091897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-22T23:20:28.091970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-22T23:20:28.092043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-10-22T23:20:28.092113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-10-22T23:20:28.092225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-22T23:20:28.092354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-10-22T23:20:28.092436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-10-22T23:20:28.092508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-22T23:20:28.092639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-22T23:20:28.092805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-10-22T23:20:28.092878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-10-22T23:20:28.092953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-10-22T23:20:28.093028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-22T23:20:28.093158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-22T23:20:28.093301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-22T23:20:28.093393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-10-22T23:20:28.093482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-10-22T23:20:28.093603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-22T23:20:28.093723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-10-22T23:20:28.093828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-10-22T23:20:28.093940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-10-22T23:20:28.094054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-22T23:20:28.094170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-22T23:20:28.094265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-22T23:20:28.094338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-22T23:20:28.094468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-22T23:20:28.094574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-22T23:20:28.094786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-22T23:20:28.094904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-10-22T23:20:28.095042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-22T23:20:28.095174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-22T23:20:28.095274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-10-22T23:20:28.095348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-22T23:20:28.095418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-22T23:20:28.095488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-10-22T23:20:28.095619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-10-22T23:20:28.095837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-10-22T23:20:28.095943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-10-22T23:20:28.096016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-10-22T23:20:28.096116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-10-22T23:20:28.096192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-10-22T23:20:28.096264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-22T23:20:28.096336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-10-22T23:20:28.096457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-10-22T23:20:28.096543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-22T23:20:28.097672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-10-22T23:20:28.097787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-22T23:20:28.097860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-22T23:20:28.097945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-22T23:20:28.098085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-22T23:20:28.098163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-10-22T23:20:28.098235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-22T23:20:28.098355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-22T23:20:28.098483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-22T23:20:28.098601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-22T23:20:28.098778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-22T23:20:28.098912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-22T23:20:28.099009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-10-22T23:20:28.099122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-22T23:20:28.099196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-22T23:20:28.099271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-10-22T23:20:28.099344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-10-22T23:20:28.099469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-22T23:20:28.099574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEM.csv [2025-10-22T23:20:28.101672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-22T23:20:28.101791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-22T23:20:28.101890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-10-22T23:20:28.101979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-22T23:20:28.102093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-22T23:20:28.102229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-22T23:20:28.102372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-22T23:20:28.102459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPL.csv [2025-10-22T23:20:28.102540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-22T23:20:28.102615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-10-22T23:20:28.102729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-22T23:20:28.102832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-22T23:20:28.102932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-10-22T23:20:28.103029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-22T23:20:28.103107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-22T23:20:28.103225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-22T23:20:28.103317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-10-22T23:20:28.103415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-22T23:20:28.103489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-22T23:20:28.103580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-10-22T23:20:28.103758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-10-22T23:20:28.104014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-22T23:20:28.104135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-10-22T23:20:28.104227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-22T23:20:28.104322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRCS.csv [2025-10-22T23:20:28.104422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-10-22T23:20:28.104502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-22T23:20:28.104629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-22T23:20:28.104780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-10-22T23:20:28.104863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-22T23:20:28.104937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-10-22T23:20:28.105044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-22T23:20:28.105143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-10-22T23:20:28.105220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-10-22T23:20:28.105296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-10-22T23:20:28.105408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-22T23:20:28.105541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-10-22T23:20:28.106729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-22T23:20:28.106875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-10-22T23:20:28.107069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-22T23:20:28.107275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-10-22T23:20:28.107481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-10-22T23:20:28.107563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-22T23:20:28.107636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-10-22T23:20:28.107797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-22T23:20:28.107887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-10-22T23:20:28.107966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-22T23:20:28.108055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-22T23:20:28.108179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-10-22T23:20:28.108322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-22T23:20:28.108528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-22T23:20:28.108630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-10-22T23:20:28.108857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-22T23:20:28.108958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-10-22T23:20:28.109041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-10-22T23:20:28.109129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-10-22T23:20:28.109244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-22T23:20:28.109320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-10-22T23:20:28.109395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-22T23:20:28.109466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-22T23:20:28.111697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-10-22T23:20:28.111819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-10-22T23:20:28.111965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-22T23:20:28.112073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-22T23:20:28.112767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-22T23:20:28.113153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-10-22T23:20:28.113361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-22T23:20:28.113461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-22T23:20:28.113576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-10-22T23:20:28.113715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-10-22T23:20:28.113832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-10-22T23:20:28.113928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-10-22T23:20:28.114008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-10-22T23:20:28.114094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-22T23:20:28.114177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-22T23:20:28.114262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-10-22T23:20:28.114360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-10-22T23:20:28.114460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-10-22T23:20:28.114553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-22T23:20:28.114668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-10-22T23:20:28.114781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NI.csv [2025-10-22T23:20:28.114897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-10-22T23:20:28.114972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-22T23:20:28.115100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-22T23:20:28.115216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-10-22T23:20:28.115377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-22T23:20:28.115492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-22T23:20:28.115638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-22T23:20:28.115781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-22T23:20:28.115857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-22T23:20:28.116006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-10-22T23:20:28.116112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-10-22T23:20:28.116196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-22T23:20:28.116313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-22T23:20:28.116429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-22T23:20:28.116543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-22T23:20:28.116616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-22T23:20:28.116771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-10-22T23:20:28.116881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-10-22T23:20:28.116973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-22T23:20:28.117105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-22T23:20:28.117186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-10-22T23:20:28.117263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-22T23:20:28.117382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-22T23:20:28.117505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-22T23:20:28.117581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-10-22T23:20:28.117712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-22T23:20:28.117819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-10-22T23:20:28.117902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-10-22T23:20:28.117988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-22T23:20:28.118071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-10-22T23:20:28.118153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-22T23:20:28.118238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGR.csv [2025-10-22T23:20:28.118316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-22T23:20:28.118396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-22T23:20:28.118478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-22T23:20:28.118548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-22T23:20:28.118626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-10-22T23:20:28.118780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-10-22T23:20:28.118887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-22T23:20:28.118966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-10-22T23:20:28.119040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-10-22T23:20:28.119114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-22T23:20:28.119194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-22T23:20:28.119302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-10-22T23:20:28.119374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-10-22T23:20:28.119559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-22T23:20:28.120701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-10-22T23:20:28.120814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-22T23:20:28.120928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-22T23:20:28.121001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-22T23:20:28.121074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-10-22T23:20:28.121201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-22T23:20:28.121302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-10-22T23:20:28.121387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-10-22T23:20:28.121458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-10-22T23:20:28.121538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-10-22T23:20:28.121708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-22T23:20:28.121828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-22T23:20:28.121905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-22T23:20:28.121984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-22T23:20:28.122118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-22T23:20:28.122228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-22T23:20:28.122312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-10-22T23:20:28.122388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-10-22T23:20:28.122465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-10-22T23:20:28.122537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-10-22T23:20:28.122610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-10-22T23:20:28.122857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-10-22T23:20:28.123004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-22T23:20:28.123116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-10-22T23:20:28.123213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-10-22T23:20:28.123349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-22T23:20:28.123457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-10-22T23:20:28.123535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-10-22T23:20:28.123619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-10-22T23:20:28.125792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-10-22T23:20:28.125905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-10-22T23:20:28.126018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-10-22T23:20:28.126150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-22T23:20:28.126246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAMI.csv [2025-10-22T23:20:28.126360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-22T23:20:28.126481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-22T23:20:28.126557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-22T23:20:28.126702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-22T23:20:28.126813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-10-22T23:20:28.126902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-10-22T23:20:28.127006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHM.csv [2025-10-22T23:20:28.127127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-22T23:20:28.127222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-10-22T23:20:28.127370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-10-22T23:20:28.127480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-22T23:20:28.127579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-10-22T23:20:28.127706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-22T23:20:28.127822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-10-22T23:20:28.127898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-22T23:20:28.127991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-10-22T23:20:28.128149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-22T23:20:28.128287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-10-22T23:20:28.128405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-10-22T23:20:28.128577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-22T23:20:28.128717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-10-22T23:20:28.128821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-10-22T23:20:28.128988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-22T23:20:28.129100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-22T23:20:28.129183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-10-22T23:20:28.129269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-10-22T23:20:28.129477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-22T23:20:28.129558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-10-22T23:20:28.129708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-22T23:20:28.129855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-22T23:20:28.129940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-22T23:20:28.130026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-10-22T23:20:28.130112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-22T23:20:28.130185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-10-22T23:20:28.130260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-22T23:20:28.130341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-10-22T23:20:28.130418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-10-22T23:20:28.130576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-22T23:20:28.130720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-10-22T23:20:28.130828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-10-22T23:20:28.130904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-22T23:20:28.131018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-22T23:20:28.131097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-10-22T23:20:28.131307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-10-22T23:20:28.131499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-10-22T23:20:28.131606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-22T23:20:28.131734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-22T23:20:28.131829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-10-22T23:20:28.131906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-10-22T23:20:28.132083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-10-22T23:20:28.132193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-22T23:20:28.132350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-10-22T23:20:28.132464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-10-22T23:20:28.132545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-10-22T23:20:28.132622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-10-22T23:20:28.132819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-10-22T23:20:28.132951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-22T23:20:28.133093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-10-22T23:20:28.133218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-10-22T23:20:28.133364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-10-22T23:20:28.133462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-22T23:20:28.133554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-22T23:20:28.133680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-10-22T23:20:28.133835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-22T23:20:28.133937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-22T23:20:28.134091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-22T23:20:28.134190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-10-22T23:20:28.134269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-22T23:20:28.134346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-22T23:20:28.134422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-10-22T23:20:28.134514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-10-22T23:20:28.134595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-10-22T23:20:28.135702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-22T23:20:28.135834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-10-22T23:20:28.135993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-10-22T23:20:28.136108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-10-22T23:20:28.136191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-10-22T23:20:28.136270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-10-22T23:20:28.136342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-10-22T23:20:28.136412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-10-22T23:20:28.136521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-22T23:20:28.136593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-10-22T23:20:28.136698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-22T23:20:28.136839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-22T23:20:28.137024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-10-22T23:20:28.137134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-10-22T23:20:28.137211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-10-22T23:20:28.137308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-22T23:20:28.137458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-10-22T23:20:28.137543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-22T23:20:28.137762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-22T23:20:28.137984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-22T23:20:28.138126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-22T23:20:28.138293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-22T23:20:28.138418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-10-22T23:20:28.138533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECCU.csv [2025-10-22T23:20:28.138634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-10-22T23:20:28.140785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-10-22T23:20:28.140907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-10-22T23:20:28.141000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-22T23:20:28.141090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-10-22T23:20:28.141243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-22T23:20:28.141355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-10-22T23:20:28.141445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-10-22T23:20:28.141535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-22T23:20:28.141626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-10-22T23:20:28.141767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-10-22T23:20:28.141931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-22T23:20:28.142095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-22T23:20:28.142218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-10-22T23:20:28.142316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-22T23:20:28.142435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-10-22T23:20:28.142530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-10-22T23:20:28.142702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-22T23:20:28.142828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-10-22T23:20:28.142917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-10-22T23:20:28.143049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-22T23:20:28.143136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-10-22T23:20:28.143228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-10-22T23:20:28.143314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-22T23:20:28.143415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-22T23:20:28.143522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-10-22T23:20:28.143628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-22T23:20:28.143824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-22T23:20:28.143916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-10-22T23:20:28.144066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-22T23:20:28.144181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-10-22T23:20:28.144309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-22T23:20:28.144509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-22T23:20:28.144698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-22T23:20:28.144827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-10-22T23:20:28.144948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-10-22T23:20:28.145068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-22T23:20:28.145205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-10-22T23:20:28.145354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-22T23:20:28.145631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-10-22T23:20:28.145807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-10-22T23:20:28.145935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-10-22T23:20:28.146022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-22T23:20:28.146151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-22T23:20:28.146278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-22T23:20:28.146368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-22T23:20:28.146468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-10-22T23:20:28.146552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-10-22T23:20:28.146639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-10-22T23:20:28.146926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-10-22T23:20:28.147033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-10-22T23:20:28.147140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-22T23:20:28.147238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-10-22T23:20:28.147382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-10-22T23:20:28.147480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-10-22T23:20:28.147582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-10-22T23:20:28.147843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-10-22T23:20:28.147977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-22T23:20:28.148069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-22T23:20:28.148156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-10-22T23:20:28.148240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-10-22T23:20:28.148385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-10-22T23:20:28.148498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-22T23:20:28.148587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-10-22T23:20:28.148710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-10-22T23:20:28.148877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-22T23:20:28.149015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-22T23:20:28.149103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-22T23:20:28.149231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-22T23:20:28.149320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-10-22T23:20:28.149404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-10-22T23:20:28.149535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-22T23:20:28.149636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-22T23:20:28.149863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-22T23:20:28.149987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-22T23:20:28.150076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-10-22T23:20:28.150163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-10-22T23:20:28.150260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-22T23:20:28.150430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-22T23:20:28.150546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-10-22T23:20:28.150636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-10-22T23:20:28.150786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-10-22T23:20:28.150976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-10-22T23:20:28.151130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-22T23:20:28.151288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-22T23:20:28.151403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-10-22T23:20:28.151490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-22T23:20:28.151574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-22T23:20:28.151713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-10-22T23:20:28.151961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-22T23:20:28.152105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-10-22T23:20:28.152198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-10-22T23:20:28.152299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-22T23:20:28.152525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-22T23:20:28.152725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-10-22T23:20:28.152849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-22T23:20:28.152935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-22T23:20:28.153020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-10-22T23:20:28.153103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-22T23:20:28.153184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-22T23:20:28.153266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-22T23:20:28.153355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-10-22T23:20:28.153454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-10-22T23:20:28.153545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-10-22T23:20:28.153630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-22T23:20:28.153785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-10-22T23:20:28.153909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-10-22T23:20:28.153986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-22T23:20:28.154199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-22T23:20:28.154328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-22T23:20:28.154428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-10-22T23:20:28.154504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-22T23:20:28.154581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-10-22T23:20:28.154708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-10-22T23:20:28.154867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-22T23:20:28.154945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-10-22T23:20:28.155019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-10-22T23:20:28.155090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-22T23:20:28.155160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-10-22T23:20:28.155230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-10-22T23:20:28.155316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-10-22T23:20:28.155386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-10-22T23:20:28.155455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-10-22T23:20:28.155562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-22T23:20:28.155724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-22T23:20:28.155831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-22T23:20:28.155913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-10-22T23:20:28.156018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-22T23:20:28.156105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-10-22T23:20:28.156189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-10-22T23:20:28.156272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-10-22T23:20:28.156416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-22T23:20:28.156517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-22T23:20:28.156593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-10-22T23:20:28.156728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-10-22T23:20:28.156837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-10-22T23:20:28.156952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-10-22T23:20:28.157054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-22T23:20:28.157154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-10-22T23:20:28.157434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-10-22T23:20:28.157542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-22T23:20:28.157620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-10-22T23:20:28.157910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-10-22T23:20:28.158034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-22T23:20:28.158161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-10-22T23:20:28.158261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-22T23:20:28.158336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-22T23:20:28.158561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-22T23:20:28.158689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-10-22T23:20:28.158860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-22T23:20:28.158967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-10-22T23:20:28.159108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-22T23:20:28.159209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-10-22T23:20:28.159326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-22T23:20:28.159439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-22T23:20:28.159517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-10-22T23:20:28.159589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-10-22T23:20:28.159736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-10-22T23:20:28.159876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-10-22T23:20:28.159977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-10-22T23:20:28.160054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-22T23:20:28.160128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-10-22T23:20:28.160203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-10-22T23:20:28.160275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-10-22T23:20:28.160351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-22T23:20:28.160433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-22T23:20:28.160510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-22T23:20:28.160583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-10-22T23:20:28.160722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-10-22T23:20:28.160829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-10-22T23:20:28.160903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-10-22T23:20:28.161025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-22T23:20:28.161104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-10-22T23:20:28.161178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-22T23:20:28.161290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-10-22T23:20:28.161405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-10-22T23:20:28.161481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-10-22T23:20:28.161597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-22T23:20:28.161702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-10-22T23:20:28.161855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-10-22T23:20:28.162001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-22T23:20:28.162114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-22T23:20:28.162190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-22T23:20:28.162266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-10-22T23:20:28.162340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-22T23:20:28.162419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-10-22T23:20:28.162492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-10-22T23:20:28.162564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-22T23:20:28.162636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-22T23:20:28.162776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-10-22T23:20:28.162892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-10-22T23:20:28.162975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-22T23:20:28.163048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-10-22T23:20:28.163121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-10-22T23:20:28.163192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-10-22T23:20:28.163325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-10-22T23:20:28.163461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-22T23:20:28.163540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-10-22T23:20:28.163618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-10-22T23:20:28.163896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-22T23:20:28.163992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-10-22T23:20:28.164066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-22T23:20:28.164139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-22T23:20:28.164223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-10-22T23:20:28.164299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-22T23:20:28.164442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-22T23:20:28.164568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-10-22T23:20:28.164703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-22T23:20:28.164814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-10-22T23:20:28.164957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-10-22T23:20:28.165086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-10-22T23:20:28.165209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-22T23:20:28.165357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-22T23:20:28.165465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-10-22T23:20:28.165585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-22T23:20:28.165755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-22T23:20:28.165857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-22T23:20:28.165932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-10-22T23:20:28.166006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-22T23:20:28.166080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-10-22T23:20:28.166169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-22T23:20:28.166245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-10-22T23:20:28.166317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-22T23:20:28.166390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-22T23:20:28.166462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-10-22T23:20:28.166589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-22T23:20:28.166768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-22T23:20:28.166871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-22T23:20:28.166957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-22T23:20:28.167082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-22T23:20:28.167206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-22T23:20:28.167281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-10-22T23:20:28.167401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-10-22T23:20:28.167528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-10-22T23:20:28.167610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-22T23:20:28.167754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-10-22T23:20:28.167865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-10-22T23:20:28.167951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-10-22T23:20:28.168031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-10-22T23:20:28.168207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-10-22T23:20:28.168882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-22T23:20:28.168997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-10-22T23:20:28.169081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-22T23:20:28.169194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-22T23:20:28.169306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-22T23:20:28.169380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-10-22T23:20:28.169492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-22T23:20:28.169592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-22T23:20:28.169737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-10-22T23:20:28.169834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-10-22T23:20:28.169906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-22T23:20:28.169982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-10-22T23:20:28.170113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-10-22T23:20:28.170211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-22T23:20:28.170285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-22T23:20:28.170358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-10-22T23:20:28.170431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-10-22T23:20:28.170503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-22T23:20:28.170574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-10-22T23:20:28.170698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-22T23:20:28.170809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-10-22T23:20:28.170882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-22T23:20:28.171012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-22T23:20:28.171111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-10-22T23:20:28.171191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-22T23:20:28.171265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-10-22T23:20:28.171353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-10-22T23:20:28.171423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-22T23:20:28.171501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-10-22T23:20:28.171578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-22T23:20:28.171683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-10-22T23:20:28.171794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-22T23:20:28.171877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-22T23:20:28.171955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-10-22T23:20:28.172038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-10-22T23:20:28.172223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-22T23:20:28.172300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-10-22T23:20:28.172427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-10-22T23:20:28.172508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-10-22T23:20:28.172594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-10-22T23:20:28.172768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-10-22T23:20:28.172882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-22T23:20:28.173020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-22T23:20:28.173124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-10-22T23:20:28.173205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-10-22T23:20:28.173289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-10-22T23:20:28.173416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-22T23:20:28.173494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-10-22T23:20:28.173569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-22T23:20:28.173766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-10-22T23:20:28.173935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-22T23:20:28.174042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-10-22T23:20:28.174154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-22T23:20:28.174232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-10-22T23:20:28.174342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-22T23:20:28.174439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-10-22T23:20:28.174542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-10-22T23:20:28.174627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-10-22T23:20:28.174816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-22T23:20:28.174908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-10-22T23:20:28.174985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-22T23:20:28.175114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-22T23:20:28.175227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-10-22T23:20:28.175300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-22T23:20:28.175371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-10-22T23:20:28.175449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-22T23:20:28.175562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-22T23:20:28.175639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-10-22T23:20:28.175847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-10-22T23:20:28.175924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-10-22T23:20:28.176020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-22T23:20:28.176101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-10-22T23:20:28.176237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-22T23:20:28.176315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-10-22T23:20:28.176388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-10-22T23:20:28.176462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-22T23:20:28.176533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-22T23:20:28.176604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-22T23:20:28.176772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-22T23:20:28.176881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-10-22T23:20:28.176958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-10-22T23:20:28.177028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-10-22T23:20:28.177107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-10-22T23:20:28.177181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-22T23:20:28.177252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-10-22T23:20:28.177357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-10-22T23:20:28.177450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-10-22T23:20:28.177564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-22T23:20:28.177637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-22T23:20:28.177794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEE.csv [2025-10-22T23:20:28.177913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-22T23:20:28.178160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-22T23:20:28.178302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-22T23:20:28.178434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-10-22T23:20:28.178532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-22T23:20:28.178674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-22T23:20:28.178785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-10-22T23:20:28.178860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-22T23:20:28.178974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-22T23:20:28.179047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-10-22T23:20:28.179119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-22T23:20:28.179189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-10-22T23:20:28.179260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-10-22T23:20:28.179330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-10-22T23:20:28.179479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-10-22T23:20:28.179590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-10-22T23:20:28.179879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-22T23:20:28.180052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-22T23:20:28.180151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-10-22T23:20:28.180223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-22T23:20:28.180309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-22T23:20:28.180439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-22T23:20:28.180556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-10-22T23:20:28.180685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-10-22T23:20:28.180794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSC.csv [2025-10-22T23:20:28.180928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-10-22T23:20:28.181033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-22T23:20:28.181117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-22T23:20:28.181197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-10-22T23:20:28.181305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-10-22T23:20:28.181401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-10-22T23:20:28.181548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFE.csv [2025-10-22T23:20:28.181672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-22T23:20:28.181779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-10-22T23:20:28.181872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEG.csv [2025-10-22T23:20:28.181947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-10-22T23:20:28.182018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-10-22T23:20:28.182087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-10-22T23:20:28.182215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-22T23:20:28.182350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-22T23:20:28.182426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-22T23:20:28.182496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-22T23:20:28.182608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-22T23:20:28.182754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-10-22T23:20:28.182843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-22T23:20:28.182914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-10-22T23:20:28.183041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLNT.csv [2025-10-22T23:20:28.183119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-10-22T23:20:28.183227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-22T23:20:28.183299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-22T23:20:28.183409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-22T23:20:28.183537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-22T23:20:28.183634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-10-22T23:20:28.183840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-10-22T23:20:28.183919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-10-22T23:20:28.183990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-10-22T23:20:28.184063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-10-22T23:20:28.184140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-22T23:20:28.184272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-10-22T23:20:28.184349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-22T23:20:28.184424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-10-22T23:20:28.184498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-22T23:20:28.184569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-22T23:20:28.184634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-22T23:20:28.184782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-22T23:20:28.184910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-10-22T23:20:28.185008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-10-22T23:20:28.185082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-10-22T23:20:28.185159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-10-22T23:20:28.185231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOW.csv [2025-10-22T23:20:28.185301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-22T23:20:28.185409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-10-22T23:20:28.185505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-10-22T23:20:28.185583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-10-22T23:20:28.185688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-22T23:20:28.185796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-22T23:20:28.185872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-22T23:20:28.185943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-22T23:20:28.186013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-10-22T23:20:28.186089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRC.csv [2025-10-22T23:20:28.186160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-22T23:20:28.186261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-22T23:20:28.186425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-22T23:20:28.186529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-10-22T23:20:28.186603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-10-22T23:20:28.186776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-10-22T23:20:28.187027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-22T23:20:28.187126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-22T23:20:28.187203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-22T23:20:28.187279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-22T23:20:28.187405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-10-22T23:20:28.187484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-10-22T23:20:28.187559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-22T23:20:28.187631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-22T23:20:28.187797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-22T23:20:28.187888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-10-22T23:20:28.188007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-10-22T23:20:28.188096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-10-22T23:20:28.188170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-22T23:20:28.188245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-10-22T23:20:28.188316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-22T23:20:28.188395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-22T23:20:28.188484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-22T23:20:28.188601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-22T23:20:28.188754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-22T23:20:28.188862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-10-22T23:20:28.188942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-10-22T23:20:28.189019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-10-22T23:20:28.189149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-22T23:20:28.189331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-10-22T23:20:28.189443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-22T23:20:28.189581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-22T23:20:28.189769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-22T23:20:28.189921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-10-22T23:20:28.190019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-10-22T23:20:28.190094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-22T23:20:28.190166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-22T23:20:28.190236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-10-22T23:20:28.190310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-22T23:20:28.190396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-10-22T23:20:28.190480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-22T23:20:28.190599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-10-22T23:20:28.190733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-10-22T23:20:28.190834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-22T23:20:28.190951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-22T23:20:28.191025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-10-22T23:20:28.191139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-22T23:20:28.191254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-22T23:20:28.191410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-10-22T23:20:28.191550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-10-22T23:20:28.191631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-22T23:20:28.191827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-22T23:20:28.191970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-10-22T23:20:28.192070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-10-22T23:20:28.192144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-10-22T23:20:28.192396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-10-22T23:20:28.192627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-22T23:20:28.192747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-10-22T23:20:28.192838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCD.csv [2025-10-22T23:20:28.192922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-22T23:20:28.193034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-10-22T23:20:28.193154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-22T23:20:28.193229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-10-22T23:20:28.193300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-22T23:20:28.193370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-10-22T23:20:28.193473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-22T23:20:28.193588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-22T23:20:28.193722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-22T23:20:28.193867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-10-22T23:20:28.193986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-10-22T23:20:28.194090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-22T23:20:28.194204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-22T23:20:28.194299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-10-22T23:20:28.194441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-22T23:20:28.194549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-22T23:20:28.194630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-10-22T23:20:28.194755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-22T23:20:28.194849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-22T23:20:28.194950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-10-22T23:20:28.195027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-10-22T23:20:28.195151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-22T23:20:28.195257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-10-22T23:20:28.195434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-22T23:20:28.195546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-10-22T23:20:28.195737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-22T23:20:28.195845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-10-22T23:20:28.195970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-22T23:20:28.196069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-10-22T23:20:28.196152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-22T23:20:28.196236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-10-22T23:20:28.196319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-10-22T23:20:28.196439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-10-22T23:20:28.196620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-22T23:20:28.196820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-22T23:20:28.196914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-10-22T23:20:28.197099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-10-22T23:20:28.197208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-10-22T23:20:28.197393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-10-22T23:20:28.197492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-22T23:20:28.197575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-10-22T23:20:28.197680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-10-22T23:20:28.197800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-22T23:20:28.197898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-10-22T23:20:28.197970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-10-22T23:20:28.198102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-10-22T23:20:28.198279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-22T23:20:28.198396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-10-22T23:20:28.198484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-10-22T23:20:28.198593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-10-22T23:20:28.198858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-10-22T23:20:28.199001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-22T23:20:28.199083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-10-22T23:20:28.199191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-10-22T23:20:28.199299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-22T23:20:28.199377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-10-22T23:20:28.199452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-10-22T23:20:28.199523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-10-22T23:20:28.199707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-22T23:20:28.199855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-22T23:20:28.199953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-10-22T23:20:28.200194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-10-22T23:20:28.200298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-10-22T23:20:28.200386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-10-22T23:20:28.200461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-22T23:20:28.200530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-10-22T23:20:28.200601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-10-22T23:20:28.200757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-22T23:20:28.200898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-10-22T23:20:28.201078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-22T23:20:28.201213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-22T23:20:28.201289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-10-22T23:20:28.201361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-10-22T23:20:28.201441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-10-22T23:20:28.201514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-22T23:20:28.201608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-22T23:20:28.201796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-22T23:20:28.201971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-22T23:20:28.202099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-10-22T23:20:28.202206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-10-22T23:20:28.202335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-10-22T23:20:28.202482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-10-22T23:20:28.202582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-10-22T23:20:28.202746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-10-22T23:20:28.202925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-22T23:20:28.203030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-10-22T23:20:28.203153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-22T23:20:28.203298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-22T23:20:28.203408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-22T23:20:28.203498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-10-22T23:20:28.203581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-22T23:20:28.203731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-10-22T23:20:28.203838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-10-22T23:20:28.203919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-10-22T23:20:28.204013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-10-22T23:20:28.204130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-22T23:20:28.204230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-10-22T23:20:28.204307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-10-22T23:20:28.204476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-10-22T23:20:28.204618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-22T23:20:28.204749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-22T23:20:28.204844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-10-22T23:20:28.204918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-10-22T23:20:28.205043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-22T23:20:28.205185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-22T23:20:28.205321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-22T23:20:28.205457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-10-22T23:20:28.205538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-22T23:20:28.205610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-22T23:20:28.205747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-22T23:20:28.205848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-22T23:20:28.205961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-22T23:20:28.206177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-22T23:20:28.206303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-10-22T23:20:28.206402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-10-22T23:20:28.206479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-10-22T23:20:28.206566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-22T23:20:28.206664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-22T23:20:28.206777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-10-22T23:20:28.206873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-22T23:20:28.206962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-22T23:20:28.207102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-22T23:20:28.207254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-22T23:20:28.207387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-10-22T23:20:28.207480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-10-22T23:20:28.207572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-22T23:20:28.207743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-22T23:20:28.207859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-10-22T23:20:28.207962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-10-22T23:20:28.208057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-10-22T23:20:28.208150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-10-22T23:20:28.208290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-22T23:20:28.208376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-10-22T23:20:28.208454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-10-22T23:20:28.208572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-22T23:20:28.208722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-10-22T23:20:28.208828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-10-22T23:20:28.208905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-10-22T23:20:28.209041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-10-22T23:20:28.209134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-22T23:20:28.209209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-22T23:20:28.209280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-10-22T23:20:28.209350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-10-22T23:20:28.209442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-22T23:20:28.209546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-10-22T23:20:28.209632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGE.csv [2025-10-22T23:20:28.209808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-22T23:20:28.209910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-10-22T23:20:28.210039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-10-22T23:20:28.210147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-10-22T23:20:28.210249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-10-22T23:20:28.210323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-10-22T23:20:28.210398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-22T23:20:28.210483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-10-22T23:20:28.210622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-22T23:20:28.210757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-10-22T23:20:28.210917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-22T23:20:28.211149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PM.csv [2025-10-22T23:20:28.211354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-22T23:20:28.211508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-10-22T23:20:28.211720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TCBX.csv [2025-10-22T23:20:28.211828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-10-22T23:20:28.211901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-10-22T23:20:28.211986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-10-22T23:20:28.212066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-10-22T23:20:28.212141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-10-22T23:20:28.212223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-10-22T23:20:28.212357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-10-22T23:20:28.212465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-22T23:20:28.212539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-10-22T23:20:28.212687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-22T23:20:28.212800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-10-22T23:20:28.212880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-22T23:20:28.212995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-22T23:20:28.213074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-10-22T23:20:28.213153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-10-22T23:20:28.213239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-22T23:20:28.213314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-10-22T23:20:28.213446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-10-22T23:20:28.213548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-10-22T23:20:28.213792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-22T23:20:28.213892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-22T23:20:28.213966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-22T23:20:28.214042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-22T23:20:28.214114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-22T23:20:28.214185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-22T23:20:28.214255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-10-22T23:20:28.214325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-10-22T23:20:28.214448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-22T23:20:28.214568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-22T23:20:28.214733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-22T23:20:28.214840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-22T23:20:28.214914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-10-22T23:20:28.214997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-10-22T23:20:28.215071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-22T23:20:28.215186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-22T23:20:28.215264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-22T23:20:28.215339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-10-22T23:20:28.215419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-10-22T23:20:28.215501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-10-22T23:20:28.215620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-22T23:20:28.215785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNR.csv [2025-10-22T23:20:28.215876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-10-22T23:20:28.215951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-10-22T23:20:28.216059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-22T23:20:28.216155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-22T23:20:28.216226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-22T23:20:28.216344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-22T23:20:28.216420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-10-22T23:20:28.216494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-10-22T23:20:28.216604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-22T23:20:28.216774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-10-22T23:20:28.216881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-10-22T23:20:28.216987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-22T23:20:28.217079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-10-22T23:20:28.217432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-22T23:20:28.217539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-10-22T23:20:28.217720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPKI.csv [2025-10-22T23:20:28.217884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-22T23:20:28.218155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-10-22T23:20:28.218314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-22T23:20:28.218394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-10-22T23:20:28.218512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-22T23:20:28.218618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-22T23:20:28.218759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-10-22T23:20:28.218860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-22T23:20:28.218941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-10-22T23:20:28.219022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-10-22T23:20:28.219101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-10-22T23:20:28.219176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-10-22T23:20:28.219263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-10-22T23:20:28.219402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-22T23:20:28.219487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-10-22T23:20:28.219561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-10-22T23:20:28.219634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-22T23:20:28.219813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-22T23:20:28.219894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-10-22T23:20:28.220035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-10-22T23:20:28.220151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-10-22T23:20:28.220229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-10-22T23:20:28.220370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-10-22T23:20:28.220492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-10-22T23:20:28.220596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-22T23:20:28.220711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-10-22T23:20:28.220863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-10-22T23:20:28.220954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-22T23:20:28.221029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-10-22T23:20:28.221103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-10-22T23:20:28.221175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-22T23:20:28.221249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-10-22T23:20:28.221320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-10-22T23:20:28.221390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-22T23:20:28.221465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-22T23:20:28.221557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-10-22T23:20:28.221708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-10-22T23:20:28.221812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-10-22T23:20:28.221893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-10-22T23:20:28.221966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-10-22T23:20:28.222039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-10-22T23:20:28.222112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-10-22T23:20:28.222187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-10-22T23:20:28.222276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-22T23:20:28.222374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-10-22T23:20:28.222459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-10-22T23:20:28.222533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-10-22T23:20:28.222609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-10-22T23:20:28.222727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-22T23:20:28.222864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-22T23:20:28.222939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-10-22T23:20:28.223047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-10-22T23:20:28.223174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-10-22T23:20:28.223281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-10-22T23:20:28.223400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-22T23:20:28.223499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-22T23:20:28.223579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-22T23:20:28.223727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-10-22T23:20:28.223837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-10-22T23:20:28.223986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-22T23:20:28.224092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-10-22T23:20:28.224185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-10-22T23:20:28.224270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-22T23:20:28.224385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-22T23:20:28.224508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-10-22T23:20:28.224767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-10-22T23:20:28.224877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-10-22T23:20:28.224994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-22T23:20:28.225111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-22T23:20:28.225236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-22T23:20:28.225380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-10-22T23:20:28.225521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-10-22T23:20:28.225629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-10-22T23:20:28.226919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-10-22T23:20:28.227055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-22T23:20:28.227134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-10-22T23:20:28.227205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-22T23:20:28.227282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-10-22T23:20:28.227419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-22T23:20:28.227500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-22T23:20:28.227573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-22T23:20:28.227687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-10-22T23:20:28.227827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-22T23:20:28.227963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-22T23:20:28.228096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-22T23:20:28.228205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-10-22T23:20:28.228352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-10-22T23:20:28.228512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-10-22T23:20:28.228730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-10-22T23:20:28.228852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-22T23:20:28.228958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-10-22T23:20:28.229080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-10-22T23:20:28.229155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-10-22T23:20:28.229228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-10-22T23:20:28.229373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-22T23:20:28.229488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-22T23:20:28.229571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-10-22T23:20:28.229677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-10-22T23:20:28.229783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-10-22T23:20:28.229860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-22T23:20:28.229932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-22T23:20:28.230002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-10-22T23:20:28.230071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-10-22T23:20:28.230141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-10-22T23:20:28.230339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-10-22T23:20:28.230499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-22T23:20:28.230598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-10-22T23:20:28.230758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-22T23:20:28.230854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-10-22T23:20:28.230926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-10-22T23:20:28.231001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-10-22T23:20:28.231073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-10-22T23:20:28.231144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-22T23:20:28.231216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-10-22T23:20:28.231290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-10-22T23:20:28.231471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-22T23:20:28.232819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-22T23:20:28.232939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-10-22T23:20:28.233029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-22T23:20:28.233127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-10-22T23:20:28.233200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-10-22T23:20:28.233295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-22T23:20:28.233393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-10-22T23:20:28.233471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-10-22T23:20:28.233548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-22T23:20:28.233633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-10-22T23:20:28.233778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-10-22T23:20:28.233895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-22T23:20:28.233979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-10-22T23:20:28.234058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-10-22T23:20:28.234133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-10-22T23:20:28.234250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-10-22T23:20:28.234326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-10-22T23:20:28.234399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-10-22T23:20:28.234499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-10-22T23:20:28.234637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-22T23:20:28.234777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-10-22T23:20:28.234855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-10-22T23:20:28.234928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-10-22T23:20:28.235036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-22T23:20:28.235176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-22T23:20:28.235291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-10-22T23:20:28.235415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-22T23:20:28.235505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-10-22T23:20:28.235581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-10-22T23:20:28.236109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-10-22T23:20:28.236228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-22T23:20:28.236311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-10-22T23:20:28.236412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-10-22T23:20:28.236510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-22T23:20:28.236587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-22T23:20:28.236719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-22T23:20:28.236882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-22T23:20:28.237030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-22T23:20:28.237113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-10-22T23:20:28.237194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-22T23:20:28.237271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-10-22T23:20:28.237398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-10-22T23:20:28.237514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-10-22T23:20:28.237631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-10-22T23:20:28.237769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-10-22T23:20:28.237880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-10-22T23:20:28.237980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-22T23:20:28.238172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-22T23:20:28.238272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-10-22T23:20:28.238393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-22T23:20:28.238521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-22T23:20:28.238600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-22T23:20:28.238705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-22T23:20:28.238810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-10-22T23:20:28.238885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-22T23:20:28.239019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-22T23:20:28.239119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-10-22T23:20:28.239229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-22T23:20:28.239307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-10-22T23:20:28.239380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-22T23:20:28.239510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-22T23:20:28.239609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-10-22T23:20:28.239739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-10-22T23:20:28.239835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-10-22T23:20:28.239943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-10-22T23:20:28.240037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-10-22T23:20:28.240182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-22T23:20:28.240256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-10-22T23:20:28.240379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRG.csv [2025-10-22T23:20:28.240462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-10-22T23:20:28.240567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-10-22T23:20:28.240705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-10-22T23:20:28.240848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-22T23:20:28.241000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-22T23:20:28.241252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-10-22T23:20:28.241378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-10-22T23:20:28.241477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-10-22T23:20:28.241553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-10-22T23:20:28.241634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-10-22T23:20:28.241767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-22T23:20:28.241971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-22T23:20:28.242096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-10-22T23:20:28.242205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-22T23:20:28.242343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-10-22T23:20:28.242444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-22T23:20:28.242519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-10-22T23:20:28.242589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-10-22T23:20:28.242851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-10-22T23:20:28.243018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-22T23:20:28.243117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-10-22T23:20:28.243196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-10-22T23:20:28.243323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-10-22T23:20:28.243448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-22T23:20:28.243562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-22T23:20:28.243688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-10-22T23:20:28.243874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-22T23:20:28.243953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-10-22T23:20:28.244025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-10-22T23:20:28.244138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-22T23:20:28.244209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-10-22T23:20:28.244352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-22T23:20:28.244450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-22T23:20:28.244565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-10-22T23:20:28.244718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-22T23:20:28.244827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-22T23:20:28.244905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-10-22T23:20:28.245031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-22T23:20:28.245143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-22T23:20:28.245255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-22T23:20:28.245328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-22T23:20:28.245436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-22T23:20:28.245517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-22T23:20:28.245690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-10-22T23:20:28.245795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-22T23:20:28.245868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-10-22T23:20:28.245939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-22T23:20:28.246009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-10-22T23:20:28.246132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-10-22T23:20:28.246227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-22T23:20:28.246300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-10-22T23:20:28.246372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-22T23:20:28.246495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-22T23:20:28.246593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-22T23:20:28.246777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-10-22T23:20:28.246867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-10-22T23:20:28.246940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-10-22T23:20:28.247019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-10-22T23:20:28.247089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-10-22T23:20:28.247191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-10-22T23:20:28.247345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-10-22T23:20:28.247481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-22T23:20:28.247612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-10-22T23:20:28.247763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-22T23:20:28.247885] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-22T23:20:28.247979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-10-22T23:20:28.248126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-10-22T23:20:28.248216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-10-22T23:20:28.248343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-10-22T23:20:28.248437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-22T23:20:28.248523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-10-22T23:20:28.248618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-10-22T23:20:28.248732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-10-22T23:20:28.248946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-22T23:20:28.249077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-22T23:20:28.249151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-10-22T23:20:28.249233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-10-22T23:20:28.249349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-22T23:20:28.249425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-10-22T23:20:28.249584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-22T23:20:28.249754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-22T23:20:28.249862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-22T23:20:28.249938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-10-22T23:20:28.250088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-10-22T23:20:28.250219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-22T23:20:28.250328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-10-22T23:20:28.250420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-22T23:20:28.250550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-10-22T23:20:28.250695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-10-22T23:20:28.250806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-10-22T23:20:28.250882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-10-22T23:20:28.250955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-10-22T23:20:28.251086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-22T23:20:28.251186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-10-22T23:20:28.251299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-10-22T23:20:28.251379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-10-22T23:20:28.251560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-10-22T23:20:28.251684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-10-22T23:20:28.251790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-10-22T23:20:28.251866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-10-22T23:20:28.251936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-22T23:20:28.252008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-10-22T23:20:28.252081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-10-22T23:20:28.252154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-22T23:20:28.252224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-10-22T23:20:28.252298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-22T23:20:28.252369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-22T23:20:28.252439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-10-22T23:20:28.252510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-22T23:20:28.252579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-10-22T23:20:28.252712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-10-22T23:20:28.252852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-10-22T23:20:28.252950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-22T23:20:28.253023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-22T23:20:28.253095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-10-22T23:20:28.253170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-22T23:20:28.253242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-10-22T23:20:28.253322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-10-22T23:20:28.253400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-10-22T23:20:28.253471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-10-22T23:20:28.253541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-22T23:20:28.253612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-10-22T23:20:28.253729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-10-22T23:20:28.253830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-22T23:20:28.253987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-22T23:20:28.254093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-10-22T23:20:28.254168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-22T23:20:28.254241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-22T23:20:28.254350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-22T23:20:28.254422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-22T23:20:28.254490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-10-22T23:20:28.254564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-22T23:20:28.254636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-10-22T23:20:28.254828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-10-22T23:20:28.254952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-10-22T23:20:28.255049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-22T23:20:28.255125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-10-22T23:20:28.255199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-10-22T23:20:28.255270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-10-22T23:20:28.255340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-10-22T23:20:28.255410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-22T23:20:28.255479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-10-22T23:20:28.255606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-10-22T23:20:28.255772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-22T23:20:28.255884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-10-22T23:20:28.255982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-22T23:20:28.256109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-10-22T23:20:28.256181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-10-22T23:20:28.256259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-22T23:20:28.256425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-22T23:20:28.256502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-10-22T23:20:28.256572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-22T23:20:28.256666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-22T23:20:28.256774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-10-22T23:20:28.256867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-22T23:20:28.256940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-10-22T23:20:28.257012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-22T23:20:28.257122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-22T23:20:28.257232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-22T23:20:28.257337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-10-22T23:20:28.257434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-10-22T23:20:28.257507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-10-22T23:20:28.257578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-22T23:20:28.257707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-22T23:20:28.257856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-22T23:20:28.257932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-10-22T23:20:28.258003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-10-22T23:20:28.258075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-10-22T23:20:28.258146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-22T23:20:28.258216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-10-22T23:20:28.258289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-10-22T23:20:28.258363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-22T23:20:28.258448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-10-22T23:20:28.258522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-10-22T23:20:28.258632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-10-22T23:20:28.258817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-22T23:20:28.258969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-22T23:20:28.259122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-22T23:20:28.259252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-10-22T23:20:28.259421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-22T23:20:28.259497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-10-22T23:20:28.259565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-10-22T23:20:28.259721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-22T23:20:28.259819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-10-22T23:20:28.259893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-22T23:20:28.260021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-22T23:20:28.260142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-22T23:20:28.260234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-22T23:20:28.260371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-22T23:20:28.260469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-22T23:20:28.260579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-22T23:20:28.260676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-22T23:20:28.260781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-22T23:20:28.260852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-10-22T23:20:28.260961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-22T23:20:28.261084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-10-22T23:20:28.261200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-10-22T23:20:28.261325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-22T23:20:28.261459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-22T23:20:28.261599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-10-22T23:20:28.261791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-22T23:20:28.261907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-10-22T23:20:28.262029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-10-22T23:20:28.262151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-10-22T23:20:28.262257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-10-22T23:20:28.262357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-22T23:20:28.262474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-10-22T23:20:28.262707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-22T23:20:28.262808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-22T23:20:28.262904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-10-22T23:20:28.263074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-22T23:20:28.263169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-10-22T23:20:28.263244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-22T23:20:28.263324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-10-22T23:20:28.263408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-10-22T23:20:28.263539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-10-22T23:20:28.263693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-10-22T23:20:28.263800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-22T23:20:28.263873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-22T23:20:28.263946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-10-22T23:20:28.264018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-10-22T23:20:28.264087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-10-22T23:20:28.264161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-10-22T23:20:28.264231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-22T23:20:28.264302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-10-22T23:20:28.264374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-10-22T23:20:28.264446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCLH.csv [2025-10-22T23:20:28.264557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-22T23:20:28.264630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-22T23:20:28.264770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-22T23:20:28.264853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-10-22T23:20:28.264931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-10-22T23:20:28.265002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-10-22T23:20:28.265071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-22T23:20:28.265143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-10-22T23:20:28.265213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-22T23:20:28.265296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-10-22T23:20:28.265369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-10-22T23:20:28.265442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-22T23:20:28.265567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-10-22T23:20:28.265746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-22T23:20:28.265916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-10-22T23:20:28.266018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-10-22T23:20:28.266090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-22T23:20:28.266206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-10-22T23:20:28.266351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-10-22T23:20:28.266487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-22T23:20:28.266564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-10-22T23:20:28.266692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-10-22T23:20:28.266858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-22T23:20:28.266996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-22T23:20:28.267105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-10-22T23:20:28.267190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-10-22T23:20:28.267262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-22T23:20:28.267380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-22T23:20:28.267464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-10-22T23:20:28.267537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-22T23:20:28.267610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-10-22T23:20:28.267716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-10-22T23:20:28.267857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-22T23:20:28.267934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-22T23:20:28.268004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-10-22T23:20:28.268072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-10-22T23:20:28.268141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-10-22T23:20:28.268250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-22T23:20:28.268386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-22T23:20:28.268538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-22T23:20:28.268722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-22T23:20:28.268864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-10-22T23:20:28.268947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-22T23:20:28.269017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-10-22T23:20:28.269088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-10-22T23:20:28.269157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-10-22T23:20:28.269233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-22T23:20:28.269303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-22T23:20:28.269416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-22T23:20:28.269489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-22T23:20:28.269590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-22T23:20:28.269744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-10-22T23:20:28.269848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-10-22T23:20:28.269924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-10-22T23:20:28.270036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-22T23:20:28.270144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-10-22T23:20:28.270216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-10-22T23:20:28.270305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-10-22T23:20:28.270399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-10-22T23:20:28.270475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-10-22T23:20:28.270596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-22T23:20:28.270698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-10-22T23:20:28.270801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-10-22T23:20:28.271625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-22T23:20:28.271760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-22T23:20:28.271845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-10-22T23:20:28.271916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-10-22T23:20:28.271984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-22T23:20:28.272059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-10-22T23:20:28.272130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-10-22T23:20:28.272197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-10-22T23:20:28.272267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-22T23:20:28.272336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-10-22T23:20:28.272404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-10-22T23:20:28.272473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-22T23:20:28.272541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-22T23:20:28.272716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-22T23:20:28.272822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-22T23:20:28.272901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-10-22T23:20:28.273054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-22T23:20:28.273190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-22T23:20:28.273312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-10-22T23:20:28.273403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMD.csv [2025-10-22T23:20:28.273484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-10-22T23:20:28.273554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-22T23:20:28.273706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-22T23:20:28.273814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-10-22T23:20:28.273887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-10-22T23:20:28.273957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-10-22T23:20:28.274074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-22T23:20:28.274155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-10-22T23:20:28.274264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-22T23:20:28.274335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-10-22T23:20:28.274459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-22T23:20:28.274557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-10-22T23:20:28.274629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-22T23:20:28.274795] [INFO ] [LOCAL ] Deleted 2052 derivative data files. [2025-10-22T23:20:28.274851] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-22T23:20:28.277035] [INFO ] [LOCAL ] Found 2052 symbols with primary data. [2025-10-22T23:20:28.277106] [INFO ] [MAIN ] Starting derivative generation for 2052 symbols. [2025-10-22T23:20:28.277170] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:28.345897] [DEBUG] [LOCAL ] A: Loaded 50664 existing records from primary storage. [2025-10-22T23:20:28.346144] [INFO ] [MAIN ] A: Loaded 50664 primary data records. [2025-10-22T23:20:28.706126] [DEBUG] [MAIN ] A: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:28.737519] [INFO ] [MAIN ] A: Generated 138 derivative records from 50664 primary records. [2025-10-22T23:20:28.737727] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-22T23:20:28.755769] [DEBUG] [LOCAL ] A: Derivative data saved (1794 records). [2025-10-22T23:20:28.755872] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-10-22T23:20:28.759268] [INFO ] [MAIN ] Derivative Progress: 1/2052 symbols. A took 0.5s. Estimated remaining time: 16m 29s [2025-10-22T23:20:28.759394] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:28.813233] [DEBUG] [LOCAL ] AA: Loaded 53622 existing records from primary storage. [2025-10-22T23:20:28.813468] [INFO ] [MAIN ] AA: Loaded 53622 primary data records. [2025-10-22T23:20:29.167340] [DEBUG] [MAIN ] AA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:29.197733] [INFO ] [MAIN ] AA: Generated 138 derivative records from 53622 primary records. [2025-10-22T23:20:29.197967] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-22T23:20:29.214914] [DEBUG] [LOCAL ] AA: Derivative data saved (1794 records). [2025-10-22T23:20:29.215086] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-10-22T23:20:29.218381] [INFO ] [MAIN ] Derivative Progress: 2/2052 symbols. AA took 0.5s. Estimated remaining time: 16m 5s [2025-10-22T23:20:29.218529] [INFO ] [MAIN ] AAMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:29.244525] [DEBUG] [LOCAL ] AAMI: Loaded 24441 existing records from primary storage. [2025-10-22T23:20:29.244778] [INFO ] [MAIN ] AAMI: Loaded 24441 primary data records. [2025-10-22T23:20:29.656355] [DEBUG] [MAIN ] AAMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:29.686872] [INFO ] [MAIN ] AAMI: Generated 138 derivative records from 24441 primary records. [2025-10-22T23:20:29.687139] [DEBUG] [LOCAL ] AAMI: Saving derivative data. [2025-10-22T23:20:29.702737] [DEBUG] [LOCAL ] AAMI: Derivative data saved (1794 records). [2025-10-22T23:20:29.702924] [INFO ] [MAIN ] AAMI: Successfully saved derivative data. [2025-10-22T23:20:29.705983] [INFO ] [MAIN ] Derivative Progress: 3/2052 symbols. AAMI took 0.5s. Estimated remaining time: 16m 16s [2025-10-22T23:20:29.706148] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:29.762148] [DEBUG] [LOCAL ] AAP: Loaded 51734 existing records from primary storage. [2025-10-22T23:20:29.762383] [INFO ] [MAIN ] AAP: Loaded 51734 primary data records. [2025-10-22T23:20:30.109076] [DEBUG] [MAIN ] AAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:30.135423] [INFO ] [MAIN ] AAP: Generated 138 derivative records from 51734 primary records. [2025-10-22T23:20:30.135663] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-22T23:20:30.151021] [DEBUG] [LOCAL ] AAP: Derivative data saved (1794 records). [2025-10-22T23:20:30.151125] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-22T23:20:30.154579] [INFO ] [MAIN ] Derivative Progress: 4/2052 symbols. AAP took 0.4s. Estimated remaining time: 16m 1s [2025-10-22T23:20:30.154746] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:30.196565] [DEBUG] [LOCAL ] AAT: Loaded 30227 existing records from primary storage. [2025-10-22T23:20:30.199772] [INFO ] [MAIN ] AAT: Loaded 30227 primary data records. [2025-10-22T23:20:30.503981] [DEBUG] [MAIN ] AAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:30.528942] [INFO ] [MAIN ] AAT: Generated 138 derivative records from 30227 primary records. [2025-10-22T23:20:30.529047] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-22T23:20:30.543593] [DEBUG] [LOCAL ] AAT: Derivative data saved (1794 records). [2025-10-22T23:20:30.543691] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-10-22T23:20:30.546126] [INFO ] [MAIN ] Derivative Progress: 5/2052 symbols. AAT took 0.4s. Estimated remaining time: 15m 29s [2025-10-22T23:20:30.546238] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:30.569322] [DEBUG] [LOCAL ] AB: Loaded 24673 existing records from primary storage. [2025-10-22T23:20:30.569486] [INFO ] [MAIN ] AB: Loaded 24673 primary data records. [2025-10-22T23:20:30.890932] [DEBUG] [MAIN ] AB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:30.916619] [INFO ] [MAIN ] AB: Generated 138 derivative records from 24673 primary records. [2025-10-22T23:20:30.916831] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-10-22T23:20:30.931637] [DEBUG] [LOCAL ] AB: Derivative data saved (1794 records). [2025-10-22T23:20:30.931809] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-10-22T23:20:30.934158] [INFO ] [MAIN ] Derivative Progress: 6/2052 symbols. AB took 0.4s. Estimated remaining time: 15m 6s [2025-10-22T23:20:30.934270] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:30.963405] [DEBUG] [LOCAL ] ABCB: Loaded 30308 existing records from primary storage. [2025-10-22T23:20:30.963586] [INFO ] [MAIN ] ABCB: Loaded 30308 primary data records. [2025-10-22T23:20:31.274375] [DEBUG] [MAIN ] ABCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:31.300760] [INFO ] [MAIN ] ABCB: Generated 138 derivative records from 30308 primary records. [2025-10-22T23:20:31.300905] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-10-22T23:20:31.315768] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1794 records). [2025-10-22T23:20:31.315843] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-10-22T23:20:31.318361] [INFO ] [MAIN ] Derivative Progress: 7/2052 symbols. ABCB took 0.4s. Estimated remaining time: 14m 48s [2025-10-22T23:20:31.318455] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:31.367004] [DEBUG] [LOCAL ] ABEV: Loaded 53284 existing records from primary storage. [2025-10-22T23:20:31.367169] [INFO ] [MAIN ] ABEV: Loaded 53284 primary data records. [2025-10-22T23:20:31.720172] [DEBUG] [MAIN ] ABEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:31.748098] [INFO ] [MAIN ] ABEV: Generated 138 derivative records from 53284 primary records. [2025-10-22T23:20:31.748206] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-22T23:20:31.763372] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1794 records). [2025-10-22T23:20:31.763448] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-22T23:20:31.766176] [INFO ] [MAIN ] Derivative Progress: 8/2052 symbols. ABEV took 0.4s. Estimated remaining time: 14m 51s [2025-10-22T23:20:31.766269] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:31.785383] [DEBUG] [LOCAL ] ABG: Loaded 17859 existing records from primary storage. [2025-10-22T23:20:31.785522] [INFO ] [MAIN ] ABG: Loaded 17859 primary data records. [2025-10-22T23:20:32.107164] [DEBUG] [MAIN ] ABG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:32.133797] [INFO ] [MAIN ] ABG: Generated 138 derivative records from 17859 primary records. [2025-10-22T23:20:32.133947] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-10-22T23:20:32.149322] [DEBUG] [LOCAL ] ABG: Derivative data saved (1794 records). [2025-10-22T23:20:32.149443] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-10-22T23:20:32.151368] [INFO ] [MAIN ] Derivative Progress: 9/2052 symbols. ABG took 0.4s. Estimated remaining time: 14m 39s [2025-10-22T23:20:32.151470] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:32.205440] [DEBUG] [LOCAL ] ABT: Loaded 53624 existing records from primary storage. [2025-10-22T23:20:32.205615] [INFO ] [MAIN ] ABT: Loaded 53624 primary data records. [2025-10-22T23:20:32.538800] [DEBUG] [MAIN ] ABT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:20:32.565229] [INFO ] [MAIN ] ABT: Generated 138 derivative records from 53624 primary records. [2025-10-22T23:20:32.565336] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-10-22T23:20:32.580391] [DEBUG] [LOCAL ] ABT: Derivative data saved (1793 records). [2025-10-22T23:20:32.580464] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-10-22T23:20:32.583282] [INFO ] [MAIN ] Derivative Progress: 10/2052 symbols. ABT took 0.4s. Estimated remaining time: 14m 39s [2025-10-22T23:20:32.583381] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:32.613770] [DEBUG] [LOCAL ] ACEL: Loaded 26346 existing records from primary storage. [2025-10-22T23:20:32.613914] [INFO ] [MAIN ] ACEL: Loaded 26346 primary data records. [2025-10-22T23:20:32.924378] [DEBUG] [MAIN ] ACEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:32.953783] [INFO ] [MAIN ] ACEL: Generated 138 derivative records from 26346 primary records. [2025-10-22T23:20:32.953902] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-10-22T23:20:32.968876] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1794 records). [2025-10-22T23:20:32.968965] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-10-22T23:20:32.971432] [INFO ] [MAIN ] Derivative Progress: 11/2052 symbols. ACEL took 0.4s. Estimated remaining time: 14m 31s [2025-10-22T23:20:32.971539] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:33.022216] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-22T23:20:33.022386] [INFO ] [MAIN ] ACHR: Loaded 53818 primary data records. [2025-10-22T23:20:33.333540] [DEBUG] [MAIN ] ACHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:33.358916] [INFO ] [MAIN ] ACHR: Generated 138 derivative records from 53818 primary records. [2025-10-22T23:20:33.359033] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-10-22T23:20:33.373913] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1794 records). [2025-10-22T23:20:33.373997] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-10-22T23:20:33.376524] [INFO ] [MAIN ] Derivative Progress: 12/2052 symbols. ACHR took 0.4s. Estimated remaining time: 14m 27s [2025-10-22T23:20:33.376625] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:33.427054] [DEBUG] [LOCAL ] ACI: Loaded 53286 existing records from primary storage. [2025-10-22T23:20:33.427224] [INFO ] [MAIN ] ACI: Loaded 53286 primary data records. [2025-10-22T23:20:33.759178] [DEBUG] [MAIN ] ACI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:33.784320] [INFO ] [MAIN ] ACI: Generated 138 derivative records from 53286 primary records. [2025-10-22T23:20:33.784427] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-22T23:20:33.799603] [DEBUG] [LOCAL ] ACI: Derivative data saved (1794 records). [2025-10-22T23:20:33.799717] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-10-22T23:20:33.802428] [INFO ] [MAIN ] Derivative Progress: 13/2052 symbols. ACI took 0.4s. Estimated remaining time: 14m 26s [2025-10-22T23:20:33.802526] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:33.811963] [DEBUG] [LOCAL ] ACR: Loaded 5310 existing records from primary storage. [2025-10-22T23:20:33.812067] [INFO ] [MAIN ] ACR: Loaded 5310 primary data records. [2025-10-22T23:20:34.134480] [DEBUG] [MAIN ] ACR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:34.159637] [INFO ] [MAIN ] ACR: Generated 138 derivative records from 5310 primary records. [2025-10-22T23:20:34.159766] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-22T23:20:34.173512] [DEBUG] [LOCAL ] ACR: Derivative data saved (1794 records). [2025-10-22T23:20:34.173591] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-10-22T23:20:34.175462] [INFO ] [MAIN ] Derivative Progress: 14/2052 symbols. ACR took 0.4s. Estimated remaining time: 14m 18s [2025-10-22T23:20:34.175564] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:34.207315] [DEBUG] [LOCAL ] ACRE: Loaded 33223 existing records from primary storage. [2025-10-22T23:20:34.207488] [INFO ] [MAIN ] ACRE: Loaded 33223 primary data records. [2025-10-22T23:20:34.516581] [DEBUG] [MAIN ] ACRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:34.541843] [INFO ] [MAIN ] ACRE: Generated 138 derivative records from 33223 primary records. [2025-10-22T23:20:34.541949] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-22T23:20:34.556818] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1794 records). [2025-10-22T23:20:34.556900] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-10-22T23:20:34.559451] [INFO ] [MAIN ] Derivative Progress: 15/2052 symbols. ACRE took 0.4s. Estimated remaining time: 14m 13s [2025-10-22T23:20:34.559565] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:34.592739] [DEBUG] [LOCAL ] ADCT: Loaded 35462 existing records from primary storage. [2025-10-22T23:20:34.592923] [INFO ] [MAIN ] ADCT: Loaded 35462 primary data records. [2025-10-22T23:20:34.897749] [DEBUG] [MAIN ] ADCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:34.922710] [INFO ] [MAIN ] ADCT: Generated 138 derivative records from 35462 primary records. [2025-10-22T23:20:34.922817] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-10-22T23:20:34.937275] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1794 records). [2025-10-22T23:20:34.937533] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-10-22T23:20:34.940043] [INFO ] [MAIN ] Derivative Progress: 16/2052 symbols. ADCT took 0.4s. Estimated remaining time: 14m 8s [2025-10-22T23:20:34.940148] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:34.989934] [DEBUG] [LOCAL ] ADM: Loaded 53394 existing records from primary storage. [2025-10-22T23:20:34.990106] [INFO ] [MAIN ] ADM: Loaded 53394 primary data records. [2025-10-22T23:20:35.299011] [DEBUG] [MAIN ] ADM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:35.325434] [INFO ] [MAIN ] ADM: Generated 138 derivative records from 53394 primary records. [2025-10-22T23:20:35.325583] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-22T23:20:35.340908] [DEBUG] [LOCAL ] ADM: Derivative data saved (1794 records). [2025-10-22T23:20:35.341009] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-22T23:20:35.343713] [INFO ] [MAIN ] Derivative Progress: 17/2052 symbols. ADM took 0.4s. Estimated remaining time: 14m 6s [2025-10-22T23:20:35.343823] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:35.393598] [DEBUG] [LOCAL ] ADT: Loaded 53435 existing records from primary storage. [2025-10-22T23:20:35.393781] [INFO ] [MAIN ] ADT: Loaded 53435 primary data records. [2025-10-22T23:20:35.701935] [DEBUG] [MAIN ] ADT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:35.727774] [INFO ] [MAIN ] ADT: Generated 138 derivative records from 53435 primary records. [2025-10-22T23:20:35.727887] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-22T23:20:35.742983] [DEBUG] [LOCAL ] ADT: Derivative data saved (1794 records). [2025-10-22T23:20:35.743072] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-10-22T23:20:35.745764] [INFO ] [MAIN ] Derivative Progress: 18/2052 symbols. ADT took 0.4s. Estimated remaining time: 14m 4s [2025-10-22T23:20:35.745894] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:35.773140] [DEBUG] [LOCAL ] ADX: Loaded 27644 existing records from primary storage. [2025-10-22T23:20:35.773270] [INFO ] [MAIN ] ADX: Loaded 27644 primary data records. [2025-10-22T23:20:36.116700] [DEBUG] [MAIN ] ADX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:36.143272] [INFO ] [MAIN ] ADX: Generated 138 derivative records from 27644 primary records. [2025-10-22T23:20:36.143383] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-22T23:20:36.158378] [DEBUG] [LOCAL ] ADX: Derivative data saved (1794 records). [2025-10-22T23:20:36.158463] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-22T23:20:36.161224] [INFO ] [MAIN ] Derivative Progress: 19/2052 symbols. ADX took 0.4s. Estimated remaining time: 14m 3s [2025-10-22T23:20:36.161332] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:36.207516] [DEBUG] [LOCAL ] AEE: Loaded 50072 existing records from primary storage. [2025-10-22T23:20:36.207719] [INFO ] [MAIN ] AEE: Loaded 50072 primary data records. [2025-10-22T23:20:36.525283] [DEBUG] [MAIN ] AEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:36.551184] [INFO ] [MAIN ] AEE: Generated 138 derivative records from 50072 primary records. [2025-10-22T23:20:36.551293] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-10-22T23:20:36.566256] [DEBUG] [LOCAL ] AEE: Derivative data saved (1794 records). [2025-10-22T23:20:36.566338] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-10-22T23:20:36.569220] [INFO ] [MAIN ] Derivative Progress: 20/2052 symbols. AEE took 0.4s. Estimated remaining time: 14m 2s [2025-10-22T23:20:36.569325] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:36.580024] [DEBUG] [LOCAL ] AEFC: Loaded 7650 existing records from primary storage. [2025-10-22T23:20:36.580133] [INFO ] [MAIN ] AEFC: Loaded 7650 primary data records. [2025-10-22T23:20:36.906344] [DEBUG] [MAIN ] AEFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:36.932177] [INFO ] [MAIN ] AEFC: Generated 138 derivative records from 7650 primary records. [2025-10-22T23:20:36.932276] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-10-22T23:20:36.946453] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1794 records). [2025-10-22T23:20:36.946532] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-10-22T23:20:36.948418] [INFO ] [MAIN ] Derivative Progress: 21/2052 symbols. AEFC took 0.4s. Estimated remaining time: 13m 58s [2025-10-22T23:20:36.948517] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:36.992461] [DEBUG] [LOCAL ] AEG: Loaded 49558 existing records from primary storage. [2025-10-22T23:20:36.992634] [INFO ] [MAIN ] AEG: Loaded 49558 primary data records. [2025-10-22T23:20:37.308159] [DEBUG] [MAIN ] AEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:37.333404] [INFO ] [MAIN ] AEG: Generated 138 derivative records from 49558 primary records. [2025-10-22T23:20:37.333515] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-10-22T23:20:37.348457] [DEBUG] [LOCAL ] AEG: Derivative data saved (1794 records). [2025-10-22T23:20:37.348539] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-10-22T23:20:37.351201] [INFO ] [MAIN ] Derivative Progress: 22/2052 symbols. AEG took 0.4s. Estimated remaining time: 13m 57s [2025-10-22T23:20:37.351300] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:37.403791] [DEBUG] [LOCAL ] AEM: Loaded 53477 existing records from primary storage. [2025-10-22T23:20:37.403962] [INFO ] [MAIN ] AEM: Loaded 53477 primary data records. [2025-10-22T23:20:37.710985] [DEBUG] [MAIN ] AEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:37.736218] [INFO ] [MAIN ] AEM: Generated 138 derivative records from 53477 primary records. [2025-10-22T23:20:37.736318] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-22T23:20:37.751293] [DEBUG] [LOCAL ] AEM: Derivative data saved (1794 records). [2025-10-22T23:20:37.751376] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-22T23:20:37.754190] [INFO ] [MAIN ] Derivative Progress: 23/2052 symbols. AEM took 0.4s. Estimated remaining time: 13m 56s [2025-10-22T23:20:37.754304] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:37.806186] [DEBUG] [LOCAL ] AEO: Loaded 53564 existing records from primary storage. [2025-10-22T23:20:37.806398] [INFO ] [MAIN ] AEO: Loaded 53564 primary data records. [2025-10-22T23:20:38.141559] [DEBUG] [MAIN ] AEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:38.167739] [INFO ] [MAIN ] AEO: Generated 138 derivative records from 53564 primary records. [2025-10-22T23:20:38.167864] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-22T23:20:38.182844] [DEBUG] [LOCAL ] AEO: Derivative data saved (1794 records). [2025-10-22T23:20:38.182924] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-10-22T23:20:38.185496] [INFO ] [MAIN ] Derivative Progress: 24/2052 symbols. AEO took 0.4s. Estimated remaining time: 13m 57s [2025-10-22T23:20:38.185602] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:38.229545] [DEBUG] [LOCAL ] AER: Loaded 47899 existing records from primary storage. [2025-10-22T23:20:38.229736] [INFO ] [MAIN ] AER: Loaded 47899 primary data records. [2025-10-22T23:20:38.537979] [DEBUG] [MAIN ] AER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:38.563328] [INFO ] [MAIN ] AER: Generated 138 derivative records from 47899 primary records. [2025-10-22T23:20:38.563463] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-22T23:20:38.578665] [DEBUG] [LOCAL ] AER: Derivative data saved (1794 records). [2025-10-22T23:20:38.578748] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-22T23:20:38.581321] [INFO ] [MAIN ] Derivative Progress: 25/2052 symbols. AER took 0.4s. Estimated remaining time: 13m 55s [2025-10-22T23:20:38.581423] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:38.633327] [DEBUG] [LOCAL ] AES: Loaded 53665 existing records from primary storage. [2025-10-22T23:20:38.633500] [INFO ] [MAIN ] AES: Loaded 53665 primary data records. [2025-10-22T23:20:38.943924] [DEBUG] [MAIN ] AES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:38.969015] [INFO ] [MAIN ] AES: Generated 138 derivative records from 53665 primary records. [2025-10-22T23:20:38.969146] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-22T23:20:38.984235] [DEBUG] [LOCAL ] AES: Derivative data saved (1794 records). [2025-10-22T23:20:38.984339] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-22T23:20:38.986909] [INFO ] [MAIN ] Derivative Progress: 26/2052 symbols. AES took 0.4s. Estimated remaining time: 13m 54s [2025-10-22T23:20:38.987031] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:39.034083] [DEBUG] [LOCAL ] AESI: Loaded 49817 existing records from primary storage. [2025-10-22T23:20:39.034265] [INFO ] [MAIN ] AESI: Loaded 49817 primary data records. [2025-10-22T23:20:39.338588] [DEBUG] [MAIN ] AESI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:39.363587] [INFO ] [MAIN ] AESI: Generated 138 derivative records from 49817 primary records. [2025-10-22T23:20:39.363729] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-22T23:20:39.378533] [DEBUG] [LOCAL ] AESI: Derivative data saved (1794 records). [2025-10-22T23:20:39.378613] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-22T23:20:39.381189] [INFO ] [MAIN ] Derivative Progress: 27/2052 symbols. AESI took 0.4s. Estimated remaining time: 13m 53s [2025-10-22T23:20:39.381289] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:39.397721] [DEBUG] [LOCAL ] AFB: Loaded 11018 existing records from primary storage. [2025-10-22T23:20:39.397849] [INFO ] [MAIN ] AFB: Loaded 11018 primary data records. [2025-10-22T23:20:39.700696] [DEBUG] [MAIN ] AFB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:39.726043] [INFO ] [MAIN ] AFB: Generated 138 derivative records from 11018 primary records. [2025-10-22T23:20:39.726150] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-22T23:20:39.740378] [DEBUG] [LOCAL ] AFB: Derivative data saved (1794 records). [2025-10-22T23:20:39.740459] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-22T23:20:39.742372] [INFO ] [MAIN ] Derivative Progress: 28/2052 symbols. AFB took 0.4s. Estimated remaining time: 13m 49s [2025-10-22T23:20:39.742477] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:39.775373] [DEBUG] [LOCAL ] AFG: Loaded 31910 existing records from primary storage. [2025-10-22T23:20:39.775539] [INFO ] [MAIN ] AFG: Loaded 31910 primary data records. [2025-10-22T23:20:40.112889] [DEBUG] [MAIN ] AFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:40.140772] [INFO ] [MAIN ] AFG: Generated 138 derivative records from 31910 primary records. [2025-10-22T23:20:40.140986] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-22T23:20:40.156632] [DEBUG] [LOCAL ] AFG: Derivative data saved (1794 records). [2025-10-22T23:20:40.156782] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-10-22T23:20:40.159615] [INFO ] [MAIN ] Derivative Progress: 29/2052 symbols. AFG took 0.4s. Estimated remaining time: 13m 49s [2025-10-22T23:20:40.159756] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:40.164892] [DEBUG] [LOCAL ] AFGB: Loaded 2210 existing records from primary storage. [2025-10-22T23:20:40.164992] [INFO ] [MAIN ] AFGB: Loaded 2210 primary data records. [2025-10-22T23:20:40.478221] [DEBUG] [MAIN ] AFGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:40.504275] [INFO ] [MAIN ] AFGB: Generated 138 derivative records from 2210 primary records. [2025-10-22T23:20:40.504436] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-10-22T23:20:40.517858] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1794 records). [2025-10-22T23:20:40.517956] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-10-22T23:20:40.519943] [INFO ] [MAIN ] Derivative Progress: 30/2052 symbols. AFGB took 0.4s. Estimated remaining time: 13m 45s [2025-10-22T23:20:40.520054] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:40.523998] [DEBUG] [LOCAL ] AFGC: Loaded 2540 existing records from primary storage. [2025-10-22T23:20:40.524088] [INFO ] [MAIN ] AFGC: Loaded 2540 primary data records. [2025-10-22T23:20:40.841844] [DEBUG] [MAIN ] AFGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:40.867845] [INFO ] [MAIN ] AFGC: Generated 138 derivative records from 2540 primary records. [2025-10-22T23:20:40.868018] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-22T23:20:40.881864] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1794 records). [2025-10-22T23:20:40.881967] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-22T23:20:40.884173] [INFO ] [MAIN ] Derivative Progress: 31/2052 symbols. AFGC took 0.4s. Estimated remaining time: 13m 42s [2025-10-22T23:20:40.884274] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:40.888231] [DEBUG] [LOCAL ] AFGE: Loaded 2245 existing records from primary storage. [2025-10-22T23:20:40.888330] [INFO ] [MAIN ] AFGE: Loaded 2245 primary data records. [2025-10-22T23:20:41.205227] [DEBUG] [MAIN ] AFGE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:20:41.231308] [INFO ] [MAIN ] AFGE: Generated 138 derivative records from 2245 primary records. [2025-10-22T23:20:41.231503] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-22T23:20:41.244402] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1793 records). [2025-10-22T23:20:41.244499] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-22T23:20:41.246533] [INFO ] [MAIN ] Derivative Progress: 32/2052 symbols. AFGE took 0.4s. Estimated remaining time: 13m 38s [2025-10-22T23:20:41.246663] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:41.299055] [DEBUG] [LOCAL ] AFL: Loaded 53174 existing records from primary storage. [2025-10-22T23:20:41.299238] [INFO ] [MAIN ] AFL: Loaded 53174 primary data records. [2025-10-22T23:20:41.618500] [DEBUG] [MAIN ] AFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:41.643453] [INFO ] [MAIN ] AFL: Generated 138 derivative records from 53174 primary records. [2025-10-22T23:20:41.643551] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-22T23:20:41.658668] [DEBUG] [LOCAL ] AFL: Derivative data saved (1794 records). [2025-10-22T23:20:41.658750] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-10-22T23:20:41.662076] [INFO ] [MAIN ] Derivative Progress: 33/2052 symbols. AFL took 0.4s. Estimated remaining time: 13m 39s [2025-10-22T23:20:41.662182] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:41.711597] [DEBUG] [LOCAL ] AG: Loaded 53644 existing records from primary storage. [2025-10-22T23:20:41.711799] [INFO ] [MAIN ] AG: Loaded 53644 primary data records. [2025-10-22T23:20:42.016256] [DEBUG] [MAIN ] AG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:42.041550] [INFO ] [MAIN ] AG: Generated 138 derivative records from 53644 primary records. [2025-10-22T23:20:42.041681] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-22T23:20:42.056334] [DEBUG] [LOCAL ] AG: Derivative data saved (1794 records). [2025-10-22T23:20:42.056415] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-10-22T23:20:42.059052] [INFO ] [MAIN ] Derivative Progress: 34/2052 symbols. AG took 0.4s. Estimated remaining time: 13m 38s [2025-10-22T23:20:42.059151] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:42.099082] [DEBUG] [LOCAL ] AGCO: Loaded 42149 existing records from primary storage. [2025-10-22T23:20:42.099246] [INFO ] [MAIN ] AGCO: Loaded 42149 primary data records. [2025-10-22T23:20:42.430249] [DEBUG] [MAIN ] AGCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:42.455967] [INFO ] [MAIN ] AGCO: Generated 138 derivative records from 42149 primary records. [2025-10-22T23:20:42.456074] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-22T23:20:42.470913] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1794 records). [2025-10-22T23:20:42.470992] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-10-22T23:20:42.473526] [INFO ] [MAIN ] Derivative Progress: 35/2052 symbols. AGCO took 0.4s. Estimated remaining time: 13m 38s [2025-10-22T23:20:42.473625] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:42.494287] [DEBUG] [LOCAL ] AGD: Loaded 19283 existing records from primary storage. [2025-10-22T23:20:42.494422] [INFO ] [MAIN ] AGD: Loaded 19283 primary data records. [2025-10-22T23:20:42.801422] [DEBUG] [MAIN ] AGD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:42.826587] [INFO ] [MAIN ] AGD: Generated 138 derivative records from 19283 primary records. [2025-10-22T23:20:42.826722] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-22T23:20:42.841503] [DEBUG] [LOCAL ] AGD: Derivative data saved (1794 records). [2025-10-22T23:20:42.841586] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-10-22T23:20:42.844070] [INFO ] [MAIN ] Derivative Progress: 36/2052 symbols. AGD took 0.4s. Estimated remaining time: 13m 35s [2025-10-22T23:20:42.844172] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:42.893823] [DEBUG] [LOCAL ] AGI: Loaded 53423 existing records from primary storage. [2025-10-22T23:20:42.894001] [INFO ] [MAIN ] AGI: Loaded 53423 primary data records. [2025-10-22T23:20:43.202758] [DEBUG] [MAIN ] AGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:43.228193] [INFO ] [MAIN ] AGI: Generated 138 derivative records from 53423 primary records. [2025-10-22T23:20:43.228331] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-10-22T23:20:43.243257] [DEBUG] [LOCAL ] AGI: Derivative data saved (1794 records). [2025-10-22T23:20:43.243342] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-10-22T23:20:43.245969] [INFO ] [MAIN ] Derivative Progress: 37/2052 symbols. AGI took 0.4s. Estimated remaining time: 13m 35s [2025-10-22T23:20:43.246081] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:43.296730] [DEBUG] [LOCAL ] AGL: Loaded 52595 existing records from primary storage. [2025-10-22T23:20:43.296900] [INFO ] [MAIN ] AGL: Loaded 52595 primary data records. [2025-10-22T23:20:43.607201] [DEBUG] [MAIN ] AGL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:43.632291] [INFO ] [MAIN ] AGL: Generated 138 derivative records from 52595 primary records. [2025-10-22T23:20:43.632435] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-22T23:20:43.647452] [DEBUG] [LOCAL ] AGL: Derivative data saved (1794 records). [2025-10-22T23:20:43.647545] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-22T23:20:43.650664] [INFO ] [MAIN ] Derivative Progress: 38/2052 symbols. AGL took 0.4s. Estimated remaining time: 13m 35s [2025-10-22T23:20:43.650782] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:43.663971] [DEBUG] [LOCAL ] AGM: Loaded 10617 existing records from primary storage. [2025-10-22T23:20:43.664112] [INFO ] [MAIN ] AGM: Loaded 10617 primary data records. [2025-10-22T23:20:43.997694] [DEBUG] [MAIN ] AGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:44.028951] [INFO ] [MAIN ] AGM: Generated 138 derivative records from 10617 primary records. [2025-10-22T23:20:44.029148] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-22T23:20:44.046454] [DEBUG] [LOCAL ] AGM: Derivative data saved (1794 records). [2025-10-22T23:20:44.046561] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-22T23:20:44.048754] [INFO ] [MAIN ] Derivative Progress: 39/2052 symbols. AGM took 0.4s. Estimated remaining time: 13m 34s [2025-10-22T23:20:44.048903] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:44.076261] [DEBUG] [LOCAL ] AGO: Loaded 27710 existing records from primary storage. [2025-10-22T23:20:44.076419] [INFO ] [MAIN ] AGO: Loaded 27710 primary data records. [2025-10-22T23:20:44.405171] [DEBUG] [MAIN ] AGO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:20:44.430767] [INFO ] [MAIN ] AGO: Generated 138 derivative records from 27710 primary records. [2025-10-22T23:20:44.430897] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-22T23:20:44.445833] [DEBUG] [LOCAL ] AGO: Derivative data saved (1793 records). [2025-10-22T23:20:44.445930] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-10-22T23:20:44.448678] [INFO ] [MAIN ] Derivative Progress: 40/2052 symbols. AGO took 0.4s. Estimated remaining time: 13m 33s [2025-10-22T23:20:44.448806] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:44.480957] [DEBUG] [LOCAL ] AGRO: Loaded 32457 existing records from primary storage. [2025-10-22T23:20:44.481128] [INFO ] [MAIN ] AGRO: Loaded 32457 primary data records. [2025-10-22T23:20:44.791815] [DEBUG] [MAIN ] AGRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:44.817125] [INFO ] [MAIN ] AGRO: Generated 138 derivative records from 32457 primary records. [2025-10-22T23:20:44.817342] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-22T23:20:44.833619] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1794 records). [2025-10-22T23:20:44.833743] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-10-22T23:20:44.836509] [INFO ] [MAIN ] Derivative Progress: 41/2052 symbols. AGRO took 0.4s. Estimated remaining time: 13m 32s [2025-10-22T23:20:44.836613] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:44.868935] [DEBUG] [LOCAL ] AGX: Loaded 32652 existing records from primary storage. [2025-10-22T23:20:44.869114] [INFO ] [MAIN ] AGX: Loaded 32652 primary data records. [2025-10-22T23:20:45.181504] [DEBUG] [MAIN ] AGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:45.206919] [INFO ] [MAIN ] AGX: Generated 138 derivative records from 32652 primary records. [2025-10-22T23:20:45.207043] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-22T23:20:45.222246] [DEBUG] [LOCAL ] AGX: Derivative data saved (1794 records). [2025-10-22T23:20:45.222361] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-22T23:20:45.225112] [INFO ] [MAIN ] Derivative Progress: 42/2052 symbols. AGX took 0.4s. Estimated remaining time: 13m 31s [2025-10-22T23:20:45.225206] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:45.261701] [DEBUG] [LOCAL ] AHH: Loaded 40160 existing records from primary storage. [2025-10-22T23:20:45.261875] [INFO ] [MAIN ] AHH: Loaded 40160 primary data records. [2025-10-22T23:20:45.573483] [DEBUG] [MAIN ] AHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:45.599207] [INFO ] [MAIN ] AHH: Generated 138 derivative records from 40160 primary records. [2025-10-22T23:20:45.599355] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-22T23:20:45.614045] [DEBUG] [LOCAL ] AHH: Derivative data saved (1794 records). [2025-10-22T23:20:45.614146] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-22T23:20:45.616785] [INFO ] [MAIN ] Derivative Progress: 43/2052 symbols. AHH took 0.4s. Estimated remaining time: 13m 30s [2025-10-22T23:20:45.616897] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:45.626285] [DEBUG] [LOCAL ] AHT: Loaded 6358 existing records from primary storage. [2025-10-22T23:20:45.626399] [INFO ] [MAIN ] AHT: Loaded 6358 primary data records. [2025-10-22T23:20:45.930562] [DEBUG] [MAIN ] AHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:45.955595] [INFO ] [MAIN ] AHT: Generated 138 derivative records from 6358 primary records. [2025-10-22T23:20:45.955750] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-22T23:20:45.969539] [DEBUG] [LOCAL ] AHT: Derivative data saved (1794 records). [2025-10-22T23:20:45.969637] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-22T23:20:45.971723] [INFO ] [MAIN ] Derivative Progress: 44/2052 symbols. AHT took 0.4s. Estimated remaining time: 13m 27s [2025-10-22T23:20:45.971825] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:46.023261] [DEBUG] [LOCAL ] AI: Loaded 53765 existing records from primary storage. [2025-10-22T23:20:46.023434] [INFO ] [MAIN ] AI: Loaded 53765 primary data records. [2025-10-22T23:20:46.354574] [DEBUG] [MAIN ] AI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:46.380481] [INFO ] [MAIN ] AI: Generated 138 derivative records from 53765 primary records. [2025-10-22T23:20:46.380710] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-22T23:20:46.395798] [DEBUG] [LOCAL ] AI: Derivative data saved (1794 records). [2025-10-22T23:20:46.395887] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-10-22T23:20:46.400874] [INFO ] [MAIN ] Derivative Progress: 45/2052 symbols. AI took 0.4s. Estimated remaining time: 13m 28s [2025-10-22T23:20:46.400996] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:46.450222] [DEBUG] [LOCAL ] AIG: Loaded 53459 existing records from primary storage. [2025-10-22T23:20:46.450401] [INFO ] [MAIN ] AIG: Loaded 53459 primary data records. [2025-10-22T23:20:46.766544] [DEBUG] [MAIN ] AIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:46.791985] [INFO ] [MAIN ] AIG: Generated 138 derivative records from 53459 primary records. [2025-10-22T23:20:46.792117] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-22T23:20:46.807126] [DEBUG] [LOCAL ] AIG: Derivative data saved (1794 records). [2025-10-22T23:20:46.807224] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-22T23:20:46.810070] [INFO ] [MAIN ] Derivative Progress: 46/2052 symbols. AIG took 0.4s. Estimated remaining time: 13m 28s [2025-10-22T23:20:46.810192] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:46.833231] [DEBUG] [LOCAL ] AIN: Loaded 24301 existing records from primary storage. [2025-10-22T23:20:46.833402] [INFO ] [MAIN ] AIN: Loaded 24301 primary data records. [2025-10-22T23:20:47.138046] [DEBUG] [MAIN ] AIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:47.163121] [INFO ] [MAIN ] AIN: Generated 138 derivative records from 24301 primary records. [2025-10-22T23:20:47.163255] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-22T23:20:47.178087] [DEBUG] [LOCAL ] AIN: Derivative data saved (1794 records). [2025-10-22T23:20:47.178187] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-22T23:20:47.180753] [INFO ] [MAIN ] Derivative Progress: 47/2052 symbols. AIN took 0.4s. Estimated remaining time: 13m 26s [2025-10-22T23:20:47.180878] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:47.195712] [DEBUG] [LOCAL ] AIO: Loaded 12916 existing records from primary storage. [2025-10-22T23:20:47.195864] [INFO ] [MAIN ] AIO: Loaded 12916 primary data records. [2025-10-22T23:20:47.500348] [DEBUG] [MAIN ] AIO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:20:47.525962] [INFO ] [MAIN ] AIO: Generated 138 derivative records from 12916 primary records. [2025-10-22T23:20:47.526157] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-10-22T23:20:47.541795] [DEBUG] [LOCAL ] AIO: Derivative data saved (1793 records). [2025-10-22T23:20:47.541892] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-10-22T23:20:47.543944] [INFO ] [MAIN ] Derivative Progress: 48/2052 symbols. AIO took 0.4s. Estimated remaining time: 13m 24s [2025-10-22T23:20:47.544058] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:47.570628] [DEBUG] [LOCAL ] AIT: Loaded 26566 existing records from primary storage. [2025-10-22T23:20:47.570816] [INFO ] [MAIN ] AIT: Loaded 26566 primary data records. [2025-10-22T23:20:47.882415] [DEBUG] [MAIN ] AIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:47.908535] [INFO ] [MAIN ] AIT: Generated 138 derivative records from 26566 primary records. [2025-10-22T23:20:47.908705] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-22T23:20:47.923841] [DEBUG] [LOCAL ] AIT: Derivative data saved (1794 records). [2025-10-22T23:20:47.923935] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-22T23:20:47.926617] [INFO ] [MAIN ] Derivative Progress: 49/2052 symbols. AIT took 0.4s. Estimated remaining time: 13m 23s [2025-10-22T23:20:47.926754] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:47.964359] [DEBUG] [LOCAL ] AIV: Loaded 41857 existing records from primary storage. [2025-10-22T23:20:47.964503] [INFO ] [MAIN ] AIV: Loaded 41857 primary data records. [2025-10-22T23:20:48.268039] [DEBUG] [MAIN ] AIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:48.293533] [INFO ] [MAIN ] AIV: Generated 138 derivative records from 41857 primary records. [2025-10-22T23:20:48.293682] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-22T23:20:48.308336] [DEBUG] [LOCAL ] AIV: Derivative data saved (1794 records). [2025-10-22T23:20:48.308455] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-22T23:20:48.311141] [INFO ] [MAIN ] Derivative Progress: 50/2052 symbols. AIV took 0.4s. Estimated remaining time: 13m 22s [2025-10-22T23:20:48.311253] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:48.340828] [DEBUG] [LOCAL ] AIZ: Loaded 29244 existing records from primary storage. [2025-10-22T23:20:48.341002] [INFO ] [MAIN ] AIZ: Loaded 29244 primary data records. [2025-10-22T23:20:48.682864] [DEBUG] [MAIN ] AIZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:48.708206] [INFO ] [MAIN ] AIZ: Generated 138 derivative records from 29244 primary records. [2025-10-22T23:20:48.708364] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-22T23:20:48.723418] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1794 records). [2025-10-22T23:20:48.723518] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-22T23:20:48.726148] [INFO ] [MAIN ] Derivative Progress: 51/2052 symbols. AIZ took 0.4s. Estimated remaining time: 13m 22s [2025-10-22T23:20:48.726256] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:48.768012] [DEBUG] [LOCAL ] AJG: Loaded 46386 existing records from primary storage. [2025-10-22T23:20:48.768193] [INFO ] [MAIN ] AJG: Loaded 46386 primary data records. [2025-10-22T23:20:49.086173] [DEBUG] [MAIN ] AJG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:20:49.112895] [INFO ] [MAIN ] AJG: Generated 138 derivative records from 46386 primary records. [2025-10-22T23:20:49.113123] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-22T23:20:49.128418] [DEBUG] [LOCAL ] AJG: Derivative data saved (1793 records). [2025-10-22T23:20:49.128583] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-22T23:20:49.131263] [INFO ] [MAIN ] Derivative Progress: 52/2052 symbols. AJG took 0.4s. Estimated remaining time: 13m 22s [2025-10-22T23:20:49.131442] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:49.175994] [DEBUG] [LOCAL ] AKR: Loaded 46103 existing records from primary storage. [2025-10-22T23:20:49.176192] [INFO ] [MAIN ] AKR: Loaded 46103 primary data records. [2025-10-22T23:20:49.494155] [DEBUG] [MAIN ] AKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:49.521050] [INFO ] [MAIN ] AKR: Generated 138 derivative records from 46103 primary records. [2025-10-22T23:20:49.521263] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-22T23:20:49.537224] [DEBUG] [LOCAL ] AKR: Derivative data saved (1794 records). [2025-10-22T23:20:49.537413] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-22T23:20:49.540257] [INFO ] [MAIN ] Derivative Progress: 53/2052 symbols. AKR took 0.4s. Estimated remaining time: 13m 22s [2025-10-22T23:20:49.540424] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:49.581982] [DEBUG] [LOCAL ] AL: Loaded 44805 existing records from primary storage. [2025-10-22T23:20:49.582171] [INFO ] [MAIN ] AL: Loaded 44805 primary data records. [2025-10-22T23:20:49.893121] [DEBUG] [MAIN ] AL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:49.919791] [INFO ] [MAIN ] AL: Generated 138 derivative records from 44805 primary records. [2025-10-22T23:20:49.919996] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-22T23:20:49.935051] [DEBUG] [LOCAL ] AL: Derivative data saved (1794 records). [2025-10-22T23:20:49.935164] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-22T23:20:49.938016] [INFO ] [MAIN ] Derivative Progress: 54/2052 symbols. AL took 0.4s. Estimated remaining time: 13m 21s [2025-10-22T23:20:49.938160] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:49.988130] [DEBUG] [LOCAL ] ALB: Loaded 53362 existing records from primary storage. [2025-10-22T23:20:49.988308] [INFO ] [MAIN ] ALB: Loaded 53362 primary data records. [2025-10-22T23:20:50.301377] [DEBUG] [MAIN ] ALB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:50.327052] [INFO ] [MAIN ] ALB: Generated 138 derivative records from 53362 primary records. [2025-10-22T23:20:50.327198] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-22T23:20:50.342173] [DEBUG] [LOCAL ] ALB: Derivative data saved (1794 records). [2025-10-22T23:20:50.342257] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-22T23:20:50.344830] [INFO ] [MAIN ] Derivative Progress: 55/2052 symbols. ALB took 0.4s. Estimated remaining time: 13m 21s [2025-10-22T23:20:50.344942] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:50.394099] [DEBUG] [LOCAL ] ALC: Loaded 51212 existing records from primary storage. [2025-10-22T23:20:50.394269] [INFO ] [MAIN ] ALC: Loaded 51212 primary data records. [2025-10-22T23:20:50.744929] [DEBUG] [MAIN ] ALC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:50.771983] [INFO ] [MAIN ] ALC: Generated 138 derivative records from 51212 primary records. [2025-10-22T23:20:50.772120] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-10-22T23:20:50.788428] [DEBUG] [LOCAL ] ALC: Derivative data saved (1794 records). [2025-10-22T23:20:50.788523] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-10-22T23:20:50.791328] [INFO ] [MAIN ] Derivative Progress: 56/2052 symbols. ALC took 0.4s. Estimated remaining time: 13m 22s [2025-10-22T23:20:50.791449] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:50.822756] [DEBUG] [LOCAL ] ALE: Loaded 32075 existing records from primary storage. [2025-10-22T23:20:50.822921] [INFO ] [MAIN ] ALE: Loaded 32075 primary data records. [2025-10-22T23:20:51.142323] [DEBUG] [MAIN ] ALE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:51.168219] [INFO ] [MAIN ] ALE: Generated 138 derivative records from 32075 primary records. [2025-10-22T23:20:51.168411] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-22T23:20:51.183907] [DEBUG] [LOCAL ] ALE: Derivative data saved (1794 records). [2025-10-22T23:20:51.183999] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-22T23:20:51.186816] [INFO ] [MAIN ] Derivative Progress: 57/2052 symbols. ALE took 0.4s. Estimated remaining time: 13m 22s [2025-10-22T23:20:51.186940] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:51.218745] [DEBUG] [LOCAL ] ALEX: Loaded 30810 existing records from primary storage. [2025-10-22T23:20:51.218907] [INFO ] [MAIN ] ALEX: Loaded 30810 primary data records. [2025-10-22T23:20:51.536988] [DEBUG] [MAIN ] ALEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:51.563437] [INFO ] [MAIN ] ALEX: Generated 138 derivative records from 30810 primary records. [2025-10-22T23:20:51.563621] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-22T23:20:51.579184] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1794 records). [2025-10-22T23:20:51.579324] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-22T23:20:51.582147] [INFO ] [MAIN ] Derivative Progress: 58/2052 symbols. ALEX took 0.4s. Estimated remaining time: 13m 21s [2025-10-22T23:20:51.582273] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:51.594925] [DEBUG] [LOCAL ] ALG: Loaded 9714 existing records from primary storage. [2025-10-22T23:20:51.595071] [INFO ] [MAIN ] ALG: Loaded 9714 primary data records. [2025-10-22T23:20:51.905226] [DEBUG] [MAIN ] ALG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:51.930425] [INFO ] [MAIN ] ALG: Generated 138 derivative records from 9714 primary records. [2025-10-22T23:20:51.930552] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-22T23:20:51.945303] [DEBUG] [LOCAL ] ALG: Derivative data saved (1794 records). [2025-10-22T23:20:51.945388] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-22T23:20:51.947305] [INFO ] [MAIN ] Derivative Progress: 59/2052 symbols. ALG took 0.4s. Estimated remaining time: 13m 19s [2025-10-22T23:20:51.947408] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:51.996762] [DEBUG] [LOCAL ] ALIT: Loaded 52781 existing records from primary storage. [2025-10-22T23:20:51.996934] [INFO ] [MAIN ] ALIT: Loaded 52781 primary data records. [2025-10-22T23:20:52.304761] [DEBUG] [MAIN ] ALIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:52.330886] [INFO ] [MAIN ] ALIT: Generated 138 derivative records from 52781 primary records. [2025-10-22T23:20:52.331109] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-22T23:20:52.346356] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1794 records). [2025-10-22T23:20:52.346507] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-22T23:20:52.349545] [INFO ] [MAIN ] Derivative Progress: 60/2052 symbols. ALIT took 0.4s. Estimated remaining time: 13m 19s [2025-10-22T23:20:52.349683] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:52.401315] [DEBUG] [LOCAL ] ALK: Loaded 53087 existing records from primary storage. [2025-10-22T23:20:52.401498] [INFO ] [MAIN ] ALK: Loaded 53087 primary data records. [2025-10-22T23:20:52.739669] [DEBUG] [MAIN ] ALK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:52.765206] [INFO ] [MAIN ] ALK: Generated 138 derivative records from 53087 primary records. [2025-10-22T23:20:52.765393] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-22T23:20:52.780447] [DEBUG] [LOCAL ] ALK: Derivative data saved (1794 records). [2025-10-22T23:20:52.780560] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-22T23:20:52.783527] [INFO ] [MAIN ] Derivative Progress: 61/2052 symbols. ALK took 0.4s. Estimated remaining time: 13m 20s [2025-10-22T23:20:52.783674] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:52.832938] [DEBUG] [LOCAL ] ALL: Loaded 49604 existing records from primary storage. [2025-10-22T23:20:52.833119] [INFO ] [MAIN ] ALL: Loaded 49604 primary data records. [2025-10-22T23:20:53.139670] [DEBUG] [MAIN ] ALL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:53.165454] [INFO ] [MAIN ] ALL: Generated 138 derivative records from 49604 primary records. [2025-10-22T23:20:53.165621] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-22T23:20:53.181197] [DEBUG] [LOCAL ] ALL: Derivative data saved (1794 records). [2025-10-22T23:20:53.181320] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-22T23:20:53.183944] [INFO ] [MAIN ] Derivative Progress: 62/2052 symbols. ALL took 0.4s. Estimated remaining time: 13m 19s [2025-10-22T23:20:53.184043] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:53.225775] [DEBUG] [LOCAL ] ALLE: Loaded 43945 existing records from primary storage. [2025-10-22T23:20:53.225927] [INFO ] [MAIN ] ALLE: Loaded 43945 primary data records. [2025-10-22T23:20:53.533595] [DEBUG] [MAIN ] ALLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:53.560263] [INFO ] [MAIN ] ALLE: Generated 138 derivative records from 43945 primary records. [2025-10-22T23:20:53.560426] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-10-22T23:20:53.576691] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1794 records). [2025-10-22T23:20:53.576789] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-10-22T23:20:53.579573] [INFO ] [MAIN ] Derivative Progress: 63/2052 symbols. ALLE took 0.4s. Estimated remaining time: 13m 19s [2025-10-22T23:20:53.579714] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:53.631213] [DEBUG] [LOCAL ] ALLY: Loaded 53222 existing records from primary storage. [2025-10-22T23:20:53.631394] [INFO ] [MAIN ] ALLY: Loaded 53222 primary data records. [2025-10-22T23:20:54.010701] [DEBUG] [MAIN ] ALLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:54.051281] [INFO ] [MAIN ] ALLY: Generated 138 derivative records from 53222 primary records. [2025-10-22T23:20:54.051530] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-22T23:20:54.076277] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1794 records). [2025-10-22T23:20:54.076487] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-22T23:20:54.080547] [INFO ] [MAIN ] Derivative Progress: 64/2052 symbols. ALLY took 0.5s. Estimated remaining time: 13m 21s [2025-10-22T23:20:54.081086] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:54.116396] [DEBUG] [LOCAL ] ALTG: Loaded 23079 existing records from primary storage. [2025-10-22T23:20:54.116620] [INFO ] [MAIN ] ALTG: Loaded 23079 primary data records. [2025-10-22T23:20:54.570579] [DEBUG] [MAIN ] ALTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:54.598607] [INFO ] [MAIN ] ALTG: Generated 138 derivative records from 23079 primary records. [2025-10-22T23:20:54.598901] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-22T23:20:54.614591] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1794 records). [2025-10-22T23:20:54.614808] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-22T23:20:54.617499] [INFO ] [MAIN ] Derivative Progress: 65/2052 symbols. ALTG took 0.5s. Estimated remaining time: 13m 25s [2025-10-22T23:20:54.617619] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:54.629881] [DEBUG] [LOCAL ] ALUR: Loaded 9277 existing records from primary storage. [2025-10-22T23:20:54.630046] [INFO ] [MAIN ] ALUR: Loaded 9277 primary data records. [2025-10-22T23:20:55.010764] [DEBUG] [MAIN ] ALUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:55.037091] [INFO ] [MAIN ] ALUR: Generated 138 derivative records from 9277 primary records. [2025-10-22T23:20:55.037324] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-22T23:20:55.052177] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1794 records). [2025-10-22T23:20:55.052331] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-22T23:20:55.054423] [INFO ] [MAIN ] Derivative Progress: 66/2052 symbols. ALUR took 0.4s. Estimated remaining time: 13m 25s [2025-10-22T23:20:55.054547] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:55.095537] [DEBUG] [LOCAL ] ALV: Loaded 42191 existing records from primary storage. [2025-10-22T23:20:55.095741] [INFO ] [MAIN ] ALV: Loaded 42191 primary data records. [2025-10-22T23:20:55.404468] [DEBUG] [MAIN ] ALV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:55.432051] [INFO ] [MAIN ] ALV: Generated 138 derivative records from 42191 primary records. [2025-10-22T23:20:55.432180] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-22T23:20:55.447553] [DEBUG] [LOCAL ] ALV: Derivative data saved (1794 records). [2025-10-22T23:20:55.447659] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-22T23:20:55.450495] [INFO ] [MAIN ] Derivative Progress: 67/2052 symbols. ALV took 0.4s. Estimated remaining time: 13m 25s [2025-10-22T23:20:55.450601] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:55.460901] [DEBUG] [LOCAL ] ALX: Loaded 7271 existing records from primary storage. [2025-10-22T23:20:55.461043] [INFO ] [MAIN ] ALX: Loaded 7271 primary data records. [2025-10-22T23:20:55.763449] [DEBUG] [MAIN ] ALX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:55.788615] [INFO ] [MAIN ] ALX: Generated 138 derivative records from 7271 primary records. [2025-10-22T23:20:55.788754] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-22T23:20:55.802231] [DEBUG] [LOCAL ] ALX: Derivative data saved (1794 records). [2025-10-22T23:20:55.802314] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-22T23:20:55.804319] [INFO ] [MAIN ] Derivative Progress: 68/2052 symbols. ALX took 0.4s. Estimated remaining time: 13m 23s [2025-10-22T23:20:55.804429] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:55.853589] [DEBUG] [LOCAL ] AM: Loaded 51849 existing records from primary storage. [2025-10-22T23:20:55.853780] [INFO ] [MAIN ] AM: Loaded 51849 primary data records. [2025-10-22T23:20:56.158482] [DEBUG] [MAIN ] AM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:56.183674] [INFO ] [MAIN ] AM: Generated 138 derivative records from 51849 primary records. [2025-10-22T23:20:56.183812] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-22T23:20:56.198866] [DEBUG] [LOCAL ] AM: Derivative data saved (1794 records). [2025-10-22T23:20:56.198950] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-22T23:20:56.201845] [INFO ] [MAIN ] Derivative Progress: 69/2052 symbols. AM took 0.4s. Estimated remaining time: 13m 22s [2025-10-22T23:20:56.201961] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:56.233974] [DEBUG] [LOCAL ] AMBC: Loaded 35885 existing records from primary storage. [2025-10-22T23:20:56.234127] [INFO ] [MAIN ] AMBC: Loaded 35885 primary data records. [2025-10-22T23:20:56.541321] [DEBUG] [MAIN ] AMBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:56.566790] [INFO ] [MAIN ] AMBC: Generated 138 derivative records from 35885 primary records. [2025-10-22T23:20:56.566907] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-22T23:20:56.581581] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1794 records). [2025-10-22T23:20:56.581689] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-22T23:20:56.584363] [INFO ] [MAIN ] Derivative Progress: 70/2052 symbols. AMBC took 0.4s. Estimated remaining time: 13m 21s [2025-10-22T23:20:56.584465] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:56.622816] [DEBUG] [LOCAL ] AMBP: Loaded 44318 existing records from primary storage. [2025-10-22T23:20:56.622984] [INFO ] [MAIN ] AMBP: Loaded 44318 primary data records. [2025-10-22T23:20:56.930879] [DEBUG] [MAIN ] AMBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:56.956208] [INFO ] [MAIN ] AMBP: Generated 138 derivative records from 44318 primary records. [2025-10-22T23:20:56.956325] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-22T23:20:56.971012] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1794 records). [2025-10-22T23:20:56.971096] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-22T23:20:56.973877] [INFO ] [MAIN ] Derivative Progress: 71/2052 symbols. AMBP took 0.4s. Estimated remaining time: 13m 20s [2025-10-22T23:20:56.973978] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:57.024075] [DEBUG] [LOCAL ] AMC: Loaded 53766 existing records from primary storage. [2025-10-22T23:20:57.024238] [INFO ] [MAIN ] AMC: Loaded 53766 primary data records. [2025-10-22T23:20:57.349876] [DEBUG] [MAIN ] AMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:57.375299] [INFO ] [MAIN ] AMC: Generated 138 derivative records from 53766 primary records. [2025-10-22T23:20:57.375436] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-22T23:20:57.390169] [DEBUG] [LOCAL ] AMC: Derivative data saved (1794 records). [2025-10-22T23:20:57.390262] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-22T23:20:57.393052] [INFO ] [MAIN ] Derivative Progress: 72/2052 symbols. AMC took 0.4s. Estimated remaining time: 13m 20s [2025-10-22T23:20:57.393166] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:57.442022] [DEBUG] [LOCAL ] AMCR: Loaded 53670 existing records from primary storage. [2025-10-22T23:20:57.442196] [INFO ] [MAIN ] AMCR: Loaded 53670 primary data records. [2025-10-22T23:20:57.788261] [DEBUG] [MAIN ] AMCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:57.814394] [INFO ] [MAIN ] AMCR: Generated 138 derivative records from 53670 primary records. [2025-10-22T23:20:57.814563] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-22T23:20:57.829436] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1794 records). [2025-10-22T23:20:57.829524] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-22T23:20:57.833126] [INFO ] [MAIN ] Derivative Progress: 73/2052 symbols. AMCR took 0.4s. Estimated remaining time: 13m 21s [2025-10-22T23:20:57.833252] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:57.879087] [DEBUG] [LOCAL ] AME: Loaded 48418 existing records from primary storage. [2025-10-22T23:20:57.879273] [INFO ] [MAIN ] AME: Loaded 48418 primary data records. [2025-10-22T23:20:58.187026] [DEBUG] [MAIN ] AME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:58.212291] [INFO ] [MAIN ] AME: Generated 138 derivative records from 48418 primary records. [2025-10-22T23:20:58.212410] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-22T23:20:58.227468] [DEBUG] [LOCAL ] AME: Derivative data saved (1794 records). [2025-10-22T23:20:58.227554] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-22T23:20:58.230344] [INFO ] [MAIN ] Derivative Progress: 74/2052 symbols. AME took 0.4s. Estimated remaining time: 13m 20s [2025-10-22T23:20:58.230446] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:58.251438] [DEBUG] [LOCAL ] AMG: Loaded 20036 existing records from primary storage. [2025-10-22T23:20:58.251578] [INFO ] [MAIN ] AMG: Loaded 20036 primary data records. [2025-10-22T23:20:58.561520] [DEBUG] [MAIN ] AMG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:20:58.587589] [INFO ] [MAIN ] AMG: Generated 138 derivative records from 20036 primary records. [2025-10-22T23:20:58.587742] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-22T23:20:58.602599] [DEBUG] [LOCAL ] AMG: Derivative data saved (1793 records). [2025-10-22T23:20:58.602705] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-22T23:20:58.605307] [INFO ] [MAIN ] Derivative Progress: 75/2052 symbols. AMG took 0.4s. Estimated remaining time: 13m 19s [2025-10-22T23:20:58.605406] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:58.653897] [DEBUG] [LOCAL ] AMH: Loaded 51830 existing records from primary storage. [2025-10-22T23:20:58.654060] [INFO ] [MAIN ] AMH: Loaded 51830 primary data records. [2025-10-22T23:20:58.964132] [DEBUG] [MAIN ] AMH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:58.989361] [INFO ] [MAIN ] AMH: Generated 138 derivative records from 51830 primary records. [2025-10-22T23:20:58.989510] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-22T23:20:59.004259] [DEBUG] [LOCAL ] AMH: Derivative data saved (1794 records). [2025-10-22T23:20:59.004345] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-22T23:20:59.007314] [INFO ] [MAIN ] Derivative Progress: 76/2052 symbols. AMH took 0.4s. Estimated remaining time: 13m 19s [2025-10-22T23:20:59.007420] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:59.045100] [DEBUG] [LOCAL ] AMN: Loaded 41641 existing records from primary storage. [2025-10-22T23:20:59.045263] [INFO ] [MAIN ] AMN: Loaded 41641 primary data records. [2025-10-22T23:20:59.378680] [DEBUG] [MAIN ] AMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:59.404218] [INFO ] [MAIN ] AMN: Generated 138 derivative records from 41641 primary records. [2025-10-22T23:20:59.404338] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-10-22T23:20:59.419412] [DEBUG] [LOCAL ] AMN: Derivative data saved (1794 records). [2025-10-22T23:20:59.419494] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-10-22T23:20:59.422255] [INFO ] [MAIN ] Derivative Progress: 77/2052 symbols. AMN took 0.4s. Estimated remaining time: 13m 19s [2025-10-22T23:20:59.422359] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:59.452787] [DEBUG] [LOCAL ] AMP: Loaded 31807 existing records from primary storage. [2025-10-22T23:20:59.452948] [INFO ] [MAIN ] AMP: Loaded 31807 primary data records. [2025-10-22T23:20:59.767667] [DEBUG] [MAIN ] AMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:20:59.793686] [INFO ] [MAIN ] AMP: Generated 138 derivative records from 31807 primary records. [2025-10-22T23:20:59.793883] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-22T23:20:59.808774] [DEBUG] [LOCAL ] AMP: Derivative data saved (1794 records). [2025-10-22T23:20:59.808864] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-22T23:20:59.811601] [INFO ] [MAIN ] Derivative Progress: 78/2052 symbols. AMP took 0.4s. Estimated remaining time: 13m 18s [2025-10-22T23:20:59.811739] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:20:59.847612] [DEBUG] [LOCAL ] AMPY: Loaded 39376 existing records from primary storage. [2025-10-22T23:20:59.847806] [INFO ] [MAIN ] AMPY: Loaded 39376 primary data records. [2025-10-22T23:21:00.172771] [DEBUG] [MAIN ] AMPY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:00.198445] [INFO ] [MAIN ] AMPY: Generated 138 derivative records from 39376 primary records. [2025-10-22T23:21:00.198607] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-22T23:21:00.213234] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1794 records). [2025-10-22T23:21:00.213324] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-10-22T23:21:00.215958] [INFO ] [MAIN ] Derivative Progress: 79/2052 symbols. AMPY took 0.4s. Estimated remaining time: 13m 17s [2025-10-22T23:21:00.216083] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:00.245204] [DEBUG] [LOCAL ] AMR: Loaded 28786 existing records from primary storage. [2025-10-22T23:21:00.245370] [INFO ] [MAIN ] AMR: Loaded 28786 primary data records. [2025-10-22T23:21:00.559297] [DEBUG] [MAIN ] AMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:00.584539] [INFO ] [MAIN ] AMR: Generated 138 derivative records from 28786 primary records. [2025-10-22T23:21:00.584738] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-22T23:21:00.600025] [DEBUG] [LOCAL ] AMR: Derivative data saved (1794 records). [2025-10-22T23:21:00.600120] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-22T23:21:00.602916] [INFO ] [MAIN ] Derivative Progress: 80/2052 symbols. AMR took 0.4s. Estimated remaining time: 13m 17s [2025-10-22T23:21:00.603019] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:00.638899] [DEBUG] [LOCAL ] AMRC: Loaded 38551 existing records from primary storage. [2025-10-22T23:21:00.639067] [INFO ] [MAIN ] AMRC: Loaded 38551 primary data records. [2025-10-22T23:21:00.952396] [DEBUG] [MAIN ] AMRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:00.978126] [INFO ] [MAIN ] AMRC: Generated 138 derivative records from 38551 primary records. [2025-10-22T23:21:00.978267] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-22T23:21:00.993546] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1794 records). [2025-10-22T23:21:00.993686] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-22T23:21:00.996350] [INFO ] [MAIN ] Derivative Progress: 81/2052 symbols. AMRC took 0.4s. Estimated remaining time: 13m 16s [2025-10-22T23:21:00.996452] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:01.047327] [DEBUG] [LOCAL ] AMT: Loaded 52430 existing records from primary storage. [2025-10-22T23:21:01.047503] [INFO ] [MAIN ] AMT: Loaded 52430 primary data records. [2025-10-22T23:21:01.385378] [DEBUG] [MAIN ] AMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:01.410954] [INFO ] [MAIN ] AMT: Generated 138 derivative records from 52430 primary records. [2025-10-22T23:21:01.411094] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-22T23:21:01.426378] [DEBUG] [LOCAL ] AMT: Derivative data saved (1794 records). [2025-10-22T23:21:01.426475] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-22T23:21:01.429442] [INFO ] [MAIN ] Derivative Progress: 82/2052 symbols. AMT took 0.4s. Estimated remaining time: 13m 16s [2025-10-22T23:21:01.429551] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:01.450771] [DEBUG] [LOCAL ] AMTB: Loaded 20336 existing records from primary storage. [2025-10-22T23:21:01.450936] [INFO ] [MAIN ] AMTB: Loaded 20336 primary data records. [2025-10-22T23:21:01.754974] [DEBUG] [MAIN ] AMTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:01.780146] [INFO ] [MAIN ] AMTB: Generated 138 derivative records from 20336 primary records. [2025-10-22T23:21:01.780317] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-22T23:21:01.795311] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1794 records). [2025-10-22T23:21:01.795431] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-22T23:21:01.798038] [INFO ] [MAIN ] Derivative Progress: 83/2052 symbols. AMTB took 0.4s. Estimated remaining time: 13m 15s [2025-10-22T23:21:01.798144] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:01.803771] [DEBUG] [LOCAL ] AMTD: Loaded 3812 existing records from primary storage. [2025-10-22T23:21:01.803871] [INFO ] [MAIN ] AMTD: Loaded 3812 primary data records. [2025-10-22T23:21:02.109222] [DEBUG] [MAIN ] AMTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:02.134307] [INFO ] [MAIN ] AMTD: Generated 138 derivative records from 3812 primary records. [2025-10-22T23:21:02.134477] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-22T23:21:02.148379] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1794 records). [2025-10-22T23:21:02.148486] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-22T23:21:02.150669] [INFO ] [MAIN ] Derivative Progress: 84/2052 symbols. AMTD took 0.4s. Estimated remaining time: 13m 13s [2025-10-22T23:21:02.150829] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:02.200742] [DEBUG] [LOCAL ] AMTM: Loaded 50253 existing records from primary storage. [2025-10-22T23:21:02.200928] [INFO ] [MAIN ] AMTM: Loaded 50253 primary data records. [2025-10-22T23:21:02.521090] [DEBUG] [MAIN ] AMTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:02.551416] [INFO ] [MAIN ] AMTM: Generated 138 derivative records from 50253 primary records. [2025-10-22T23:21:02.551580] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-22T23:21:02.569041] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1794 records). [2025-10-22T23:21:02.569150] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-10-22T23:21:02.572798] [INFO ] [MAIN ] Derivative Progress: 85/2052 symbols. AMTM took 0.4s. Estimated remaining time: 13m 13s [2025-10-22T23:21:02.572918] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:02.587157] [DEBUG] [LOCAL ] AMWL: Loaded 9814 existing records from primary storage. [2025-10-22T23:21:02.587328] [INFO ] [MAIN ] AMWL: Loaded 9814 primary data records. [2025-10-22T23:21:02.900023] [DEBUG] [MAIN ] AMWL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:02.928773] [INFO ] [MAIN ] AMWL: Generated 138 derivative records from 9814 primary records. [2025-10-22T23:21:02.928973] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-22T23:21:02.943827] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1794 records). [2025-10-22T23:21:02.944000] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-22T23:21:02.946239] [INFO ] [MAIN ] Derivative Progress: 86/2052 symbols. AMWL took 0.4s. Estimated remaining time: 13m 12s [2025-10-22T23:21:02.946367] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:02.994528] [DEBUG] [LOCAL ] AMX: Loaded 49176 existing records from primary storage. [2025-10-22T23:21:02.994737] [INFO ] [MAIN ] AMX: Loaded 49176 primary data records. [2025-10-22T23:21:03.309509] [DEBUG] [MAIN ] AMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:03.341486] [INFO ] [MAIN ] AMX: Generated 138 derivative records from 49176 primary records. [2025-10-22T23:21:03.341761] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-10-22T23:21:03.363218] [DEBUG] [LOCAL ] AMX: Derivative data saved (1794 records). [2025-10-22T23:21:03.363396] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-10-22T23:21:03.366319] [INFO ] [MAIN ] Derivative Progress: 87/2052 symbols. AMX took 0.4s. Estimated remaining time: 13m 12s [2025-10-22T23:21:03.366432] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:03.397716] [DEBUG] [LOCAL ] AN: Loaded 31030 existing records from primary storage. [2025-10-22T23:21:03.397879] [INFO ] [MAIN ] AN: Loaded 31030 primary data records. [2025-10-22T23:21:03.723635] [DEBUG] [MAIN ] AN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:03.748869] [INFO ] [MAIN ] AN: Generated 138 derivative records from 31030 primary records. [2025-10-22T23:21:03.749008] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-10-22T23:21:03.763885] [DEBUG] [LOCAL ] AN: Derivative data saved (1794 records). [2025-10-22T23:21:03.763966] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-10-22T23:21:03.766711] [INFO ] [MAIN ] Derivative Progress: 88/2052 symbols. AN took 0.4s. Estimated remaining time: 13m 12s [2025-10-22T23:21:03.766810] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:03.818805] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-22T23:21:03.818978] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-10-22T23:21:04.122199] [DEBUG] [MAIN ] ANET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:04.148387] [INFO ] [MAIN ] ANET: Generated 138 derivative records from 53766 primary records. [2025-10-22T23:21:04.148539] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-22T23:21:04.164412] [DEBUG] [LOCAL ] ANET: Derivative data saved (1794 records). [2025-10-22T23:21:04.164496] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-22T23:21:04.167324] [INFO ] [MAIN ] Derivative Progress: 89/2052 symbols. ANET took 0.4s. Estimated remaining time: 13m 11s [2025-10-22T23:21:04.167428] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:04.216850] [DEBUG] [LOCAL ] ANF: Loaded 52040 existing records from primary storage. [2025-10-22T23:21:04.217024] [INFO ] [MAIN ] ANF: Loaded 52040 primary data records. [2025-10-22T23:21:04.525613] [DEBUG] [MAIN ] ANF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:04.551430] [INFO ] [MAIN ] ANF: Generated 138 derivative records from 52040 primary records. [2025-10-22T23:21:04.551615] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-22T23:21:04.567623] [DEBUG] [LOCAL ] ANF: Derivative data saved (1794 records). [2025-10-22T23:21:04.567775] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-10-22T23:21:04.571108] [INFO ] [MAIN ] Derivative Progress: 90/2052 symbols. ANF took 0.4s. Estimated remaining time: 13m 11s [2025-10-22T23:21:04.571241] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:04.593073] [DEBUG] [LOCAL ] ANRO: Loaded 19715 existing records from primary storage. [2025-10-22T23:21:04.593242] [INFO ] [MAIN ] ANRO: Loaded 19715 primary data records. [2025-10-22T23:21:04.907496] [DEBUG] [MAIN ] ANRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:04.933134] [INFO ] [MAIN ] ANRO: Generated 138 derivative records from 19715 primary records. [2025-10-22T23:21:04.933322] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-10-22T23:21:04.948123] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1794 records). [2025-10-22T23:21:04.948264] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-10-22T23:21:04.950923] [INFO ] [MAIN ] Derivative Progress: 91/2052 symbols. ANRO took 0.4s. Estimated remaining time: 13m 10s [2025-10-22T23:21:04.951046] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:04.974564] [DEBUG] [LOCAL ] ANVS: Loaded 23982 existing records from primary storage. [2025-10-22T23:21:04.974771] [INFO ] [MAIN ] ANVS: Loaded 23982 primary data records. [2025-10-22T23:21:05.284224] [DEBUG] [MAIN ] ANVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:05.309567] [INFO ] [MAIN ] ANVS: Generated 138 derivative records from 23982 primary records. [2025-10-22T23:21:05.309765] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-22T23:21:05.324698] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1794 records). [2025-10-22T23:21:05.324849] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-10-22T23:21:05.327532] [INFO ] [MAIN ] Derivative Progress: 92/2052 symbols. ANVS took 0.4s. Estimated remaining time: 13m 9s [2025-10-22T23:21:05.327710] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:05.357361] [DEBUG] [LOCAL ] AOD: Loaded 30865 existing records from primary storage. [2025-10-22T23:21:05.357536] [INFO ] [MAIN ] AOD: Loaded 30865 primary data records. [2025-10-22T23:21:05.694371] [DEBUG] [MAIN ] AOD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:05.719695] [INFO ] [MAIN ] AOD: Generated 138 derivative records from 30865 primary records. [2025-10-22T23:21:05.719883] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-10-22T23:21:05.734665] [DEBUG] [LOCAL ] AOD: Derivative data saved (1794 records). [2025-10-22T23:21:05.734777] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-10-22T23:21:05.737757] [INFO ] [MAIN ] Derivative Progress: 93/2052 symbols. AOD took 0.4s. Estimated remaining time: 13m 9s [2025-10-22T23:21:05.737874] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:05.755905] [DEBUG] [LOCAL ] AOMR: Loaded 16310 existing records from primary storage. [2025-10-22T23:21:05.756065] [INFO ] [MAIN ] AOMR: Loaded 16310 primary data records. [2025-10-22T23:21:06.078930] [DEBUG] [MAIN ] AOMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:06.105821] [INFO ] [MAIN ] AOMR: Generated 138 derivative records from 16310 primary records. [2025-10-22T23:21:06.105985] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-10-22T23:21:06.121243] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1794 records). [2025-10-22T23:21:06.121364] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-10-22T23:21:06.123502] [INFO ] [MAIN ] Derivative Progress: 94/2052 symbols. AOMR took 0.4s. Estimated remaining time: 13m 8s [2025-10-22T23:21:06.123609] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:06.168526] [DEBUG] [LOCAL ] AON: Loaded 45033 existing records from primary storage. [2025-10-22T23:21:06.168735] [INFO ] [MAIN ] AON: Loaded 45033 primary data records. [2025-10-22T23:21:06.484971] [DEBUG] [MAIN ] AON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:06.511114] [INFO ] [MAIN ] AON: Generated 138 derivative records from 45033 primary records. [2025-10-22T23:21:06.511251] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-22T23:21:06.526434] [DEBUG] [LOCAL ] AON: Derivative data saved (1794 records). [2025-10-22T23:21:06.526537] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-10-22T23:21:06.529387] [INFO ] [MAIN ] Derivative Progress: 95/2052 symbols. AON took 0.4s. Estimated remaining time: 13m 8s [2025-10-22T23:21:06.529498] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:06.557495] [DEBUG] [LOCAL ] AORT: Loaded 28916 existing records from primary storage. [2025-10-22T23:21:06.557689] [INFO ] [MAIN ] AORT: Loaded 28916 primary data records. [2025-10-22T23:21:06.860429] [DEBUG] [MAIN ] AORT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:06.885318] [INFO ] [MAIN ] AORT: Generated 138 derivative records from 28916 primary records. [2025-10-22T23:21:06.885426] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-10-22T23:21:06.900202] [DEBUG] [LOCAL ] AORT: Derivative data saved (1794 records). [2025-10-22T23:21:06.900287] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-10-22T23:21:06.902970] [INFO ] [MAIN ] Derivative Progress: 96/2052 symbols. AORT took 0.4s. Estimated remaining time: 13m 7s [2025-10-22T23:21:06.903072] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:06.946038] [DEBUG] [LOCAL ] AOS: Loaded 48646 existing records from primary storage. [2025-10-22T23:21:06.946197] [INFO ] [MAIN ] AOS: Loaded 48646 primary data records. [2025-10-22T23:21:07.267426] [DEBUG] [MAIN ] AOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:07.295250] [INFO ] [MAIN ] AOS: Generated 138 derivative records from 48646 primary records. [2025-10-22T23:21:07.295433] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-10-22T23:21:07.311486] [DEBUG] [LOCAL ] AOS: Derivative data saved (1794 records). [2025-10-22T23:21:07.311613] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-10-22T23:21:07.314525] [INFO ] [MAIN ] Derivative Progress: 97/2052 symbols. AOS took 0.4s. Estimated remaining time: 13m 7s [2025-10-22T23:21:07.314683] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:07.326192] [DEBUG] [LOCAL ] AP: Loaded 7414 existing records from primary storage. [2025-10-22T23:21:07.326337] [INFO ] [MAIN ] AP: Loaded 7414 primary data records. [2025-10-22T23:21:07.685622] [DEBUG] [MAIN ] AP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:07.711630] [INFO ] [MAIN ] AP: Generated 138 derivative records from 7414 primary records. [2025-10-22T23:21:07.711876] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-10-22T23:21:07.728015] [DEBUG] [LOCAL ] AP: Derivative data saved (1794 records). [2025-10-22T23:21:07.728188] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-10-22T23:21:07.730314] [INFO ] [MAIN ] Derivative Progress: 98/2052 symbols. AP took 0.4s. Estimated remaining time: 13m 6s [2025-10-22T23:21:07.730415] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:07.775682] [DEBUG] [LOCAL ] APD: Loaded 45416 existing records from primary storage. [2025-10-22T23:21:07.775859] [INFO ] [MAIN ] APD: Loaded 45416 primary data records. [2025-10-22T23:21:08.099361] [DEBUG] [MAIN ] APD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:08.126855] [INFO ] [MAIN ] APD: Generated 138 derivative records from 45416 primary records. [2025-10-22T23:21:08.127078] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-22T23:21:08.142844] [DEBUG] [LOCAL ] APD: Derivative data saved (1794 records). [2025-10-22T23:21:08.143010] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-10-22T23:21:08.145877] [INFO ] [MAIN ] Derivative Progress: 99/2052 symbols. APD took 0.4s. Estimated remaining time: 13m 6s [2025-10-22T23:21:08.146000] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:08.194971] [DEBUG] [LOCAL ] APG: Loaded 50617 existing records from primary storage. [2025-10-22T23:21:08.195143] [INFO ] [MAIN ] APG: Loaded 50617 primary data records. [2025-10-22T23:21:08.510495] [DEBUG] [MAIN ] APG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:08.536165] [INFO ] [MAIN ] APG: Generated 138 derivative records from 50617 primary records. [2025-10-22T23:21:08.536371] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-10-22T23:21:08.552000] [DEBUG] [LOCAL ] APG: Derivative data saved (1794 records). [2025-10-22T23:21:08.552095] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-10-22T23:21:08.555116] [INFO ] [MAIN ] Derivative Progress: 100/2052 symbols. APG took 0.4s. Estimated remaining time: 13m 6s [2025-10-22T23:21:08.555224] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:08.610187] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-22T23:21:08.610376] [INFO ] [MAIN ] APH: Loaded 53691 primary data records. [2025-10-22T23:21:08.927248] [DEBUG] [MAIN ] APH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:08.953409] [INFO ] [MAIN ] APH: Generated 138 derivative records from 53691 primary records. [2025-10-22T23:21:08.953536] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-10-22T23:21:08.971733] [DEBUG] [LOCAL ] APH: Derivative data saved (1794 records). [2025-10-22T23:21:08.971843] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-10-22T23:21:08.974982] [INFO ] [MAIN ] Derivative Progress: 101/2052 symbols. APH took 0.4s. Estimated remaining time: 13m 6s [2025-10-22T23:21:08.975151] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:09.031228] [DEBUG] [LOCAL ] APLE: Loaded 51958 existing records from primary storage. [2025-10-22T23:21:09.031396] [INFO ] [MAIN ] APLE: Loaded 51958 primary data records. [2025-10-22T23:21:09.352049] [DEBUG] [MAIN ] APLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:09.377629] [INFO ] [MAIN ] APLE: Generated 138 derivative records from 51958 primary records. [2025-10-22T23:21:09.377839] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-10-22T23:21:09.393518] [DEBUG] [LOCAL ] APLE: Derivative data saved (1794 records). [2025-10-22T23:21:09.393686] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-10-22T23:21:09.396810] [INFO ] [MAIN ] Derivative Progress: 102/2052 symbols. APLE took 0.4s. Estimated remaining time: 13m 6s [2025-10-22T23:21:09.396980] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:09.455575] [DEBUG] [LOCAL ] APO: Loaded 53388 existing records from primary storage. [2025-10-22T23:21:09.455795] [INFO ] [MAIN ] APO: Loaded 53388 primary data records. [2025-10-22T23:21:09.794627] [DEBUG] [MAIN ] APO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:09.819987] [INFO ] [MAIN ] APO: Generated 138 derivative records from 53388 primary records. [2025-10-22T23:21:09.820092] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-10-22T23:21:09.834952] [DEBUG] [LOCAL ] APO: Derivative data saved (1794 records). [2025-10-22T23:21:09.835032] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-10-22T23:21:09.837757] [INFO ] [MAIN ] Derivative Progress: 103/2052 symbols. APO took 0.4s. Estimated remaining time: 13m 6s [2025-10-22T23:21:09.837861] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:09.847627] [DEBUG] [LOCAL ] APOS: Loaded 7058 existing records from primary storage. [2025-10-22T23:21:09.847749] [INFO ] [MAIN ] APOS: Loaded 7058 primary data records. [2025-10-22T23:21:10.149027] [DEBUG] [MAIN ] APOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:10.174180] [INFO ] [MAIN ] APOS: Generated 138 derivative records from 7058 primary records. [2025-10-22T23:21:10.174293] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-10-22T23:21:10.188574] [DEBUG] [LOCAL ] APOS: Derivative data saved (1794 records). [2025-10-22T23:21:10.188688] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-10-22T23:21:10.190733] [INFO ] [MAIN ] Derivative Progress: 104/2052 symbols. APOS took 0.4s. Estimated remaining time: 13m 5s [2025-10-22T23:21:10.190831] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:10.239398] [DEBUG] [LOCAL ] APTV: Loaded 51849 existing records from primary storage. [2025-10-22T23:21:10.239566] [INFO ] [MAIN ] APTV: Loaded 51849 primary data records. [2025-10-22T23:21:10.546697] [DEBUG] [MAIN ] APTV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:10.571950] [INFO ] [MAIN ] APTV: Generated 138 derivative records from 51849 primary records. [2025-10-22T23:21:10.572076] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-10-22T23:21:10.586871] [DEBUG] [LOCAL ] APTV: Derivative data saved (1794 records). [2025-10-22T23:21:10.586961] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-10-22T23:21:10.590214] [INFO ] [MAIN ] Derivative Progress: 105/2052 symbols. APTV took 0.4s. Estimated remaining time: 13m 4s [2025-10-22T23:21:10.590328] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:10.597888] [DEBUG] [LOCAL ] AQNB: Loaded 3886 existing records from primary storage. [2025-10-22T23:21:10.598005] [INFO ] [MAIN ] AQNB: Loaded 3886 primary data records. [2025-10-22T23:21:10.900464] [DEBUG] [MAIN ] AQNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:10.925573] [INFO ] [MAIN ] AQNB: Generated 138 derivative records from 3886 primary records. [2025-10-22T23:21:10.925766] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-22T23:21:10.939346] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1794 records). [2025-10-22T23:21:10.939454] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-22T23:21:10.941476] [INFO ] [MAIN ] Derivative Progress: 106/2052 symbols. AQNB took 0.4s. Estimated remaining time: 13m 3s [2025-10-22T23:21:10.941592] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:10.968066] [DEBUG] [LOCAL ] ARDT: Loaded 27391 existing records from primary storage. [2025-10-22T23:21:10.968226] [INFO ] [MAIN ] ARDT: Loaded 27391 primary data records. [2025-10-22T23:21:11.269987] [DEBUG] [MAIN ] ARDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:11.294888] [INFO ] [MAIN ] ARDT: Generated 138 derivative records from 27391 primary records. [2025-10-22T23:21:11.295022] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-22T23:21:11.310413] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1794 records). [2025-10-22T23:21:11.310497] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-22T23:21:11.313172] [INFO ] [MAIN ] Derivative Progress: 107/2052 symbols. ARDT took 0.4s. Estimated remaining time: 13m 2s [2025-10-22T23:21:11.313276] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:11.361294] [DEBUG] [LOCAL ] ARE: Loaded 50927 existing records from primary storage. [2025-10-22T23:21:11.361465] [INFO ] [MAIN ] ARE: Loaded 50927 primary data records. [2025-10-22T23:21:11.677117] [DEBUG] [MAIN ] ARE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:11.708153] [INFO ] [MAIN ] ARE: Generated 138 derivative records from 50927 primary records. [2025-10-22T23:21:11.708346] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-10-22T23:21:11.724339] [DEBUG] [LOCAL ] ARE: Derivative data saved (1794 records). [2025-10-22T23:21:11.724471] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-10-22T23:21:11.727449] [INFO ] [MAIN ] Derivative Progress: 108/2052 symbols. ARE took 0.4s. Estimated remaining time: 13m 2s [2025-10-22T23:21:11.727548] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:11.777454] [DEBUG] [LOCAL ] ARES: Loaded 49676 existing records from primary storage. [2025-10-22T23:21:11.777624] [INFO ] [MAIN ] ARES: Loaded 49676 primary data records. [2025-10-22T23:21:12.123074] [DEBUG] [MAIN ] ARES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:12.149256] [INFO ] [MAIN ] ARES: Generated 138 derivative records from 49676 primary records. [2025-10-22T23:21:12.149427] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-10-22T23:21:12.164961] [DEBUG] [LOCAL ] ARES: Derivative data saved (1794 records). [2025-10-22T23:21:12.165065] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-10-22T23:21:12.168004] [INFO ] [MAIN ] Derivative Progress: 109/2052 symbols. ARES took 0.4s. Estimated remaining time: 13m 2s [2025-10-22T23:21:12.168113] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:12.209147] [DEBUG] [LOCAL ] ARLO: Loaded 43510 existing records from primary storage. [2025-10-22T23:21:12.209321] [INFO ] [MAIN ] ARLO: Loaded 43510 primary data records. [2025-10-22T23:21:12.519835] [DEBUG] [MAIN ] ARLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:12.545411] [INFO ] [MAIN ] ARLO: Generated 138 derivative records from 43510 primary records. [2025-10-22T23:21:12.545557] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-10-22T23:21:12.560665] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1794 records). [2025-10-22T23:21:12.560782] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-10-22T23:21:12.563441] [INFO ] [MAIN ] Derivative Progress: 110/2052 symbols. ARLO took 0.4s. Estimated remaining time: 13m 2s [2025-10-22T23:21:12.563538] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:12.610093] [DEBUG] [LOCAL ] ARMK: Loaded 50369 existing records from primary storage. [2025-10-22T23:21:12.610287] [INFO ] [MAIN ] ARMK: Loaded 50369 primary data records. [2025-10-22T23:21:12.918140] [DEBUG] [MAIN ] ARMK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:12.944311] [INFO ] [MAIN ] ARMK: Generated 138 derivative records from 50369 primary records. [2025-10-22T23:21:12.944469] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-22T23:21:12.959593] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1794 records). [2025-10-22T23:21:12.959716] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-10-22T23:21:12.962522] [INFO ] [MAIN ] Derivative Progress: 111/2052 symbols. ARMK took 0.4s. Estimated remaining time: 13m 1s [2025-10-22T23:21:12.962636] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:13.014166] [DEBUG] [LOCAL ] ARR: Loaded 52091 existing records from primary storage. [2025-10-22T23:21:13.014340] [INFO ] [MAIN ] ARR: Loaded 52091 primary data records. [2025-10-22T23:21:13.332996] [DEBUG] [MAIN ] ARR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:13.360592] [INFO ] [MAIN ] ARR: Generated 138 derivative records from 52091 primary records. [2025-10-22T23:21:13.360733] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-10-22T23:21:13.375894] [DEBUG] [LOCAL ] ARR: Derivative data saved (1794 records). [2025-10-22T23:21:13.375980] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-10-22T23:21:13.378904] [INFO ] [MAIN ] Derivative Progress: 112/2052 symbols. ARR took 0.4s. Estimated remaining time: 13m 1s [2025-10-22T23:21:13.379048] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:13.413795] [DEBUG] [LOCAL ] ARW: Loaded 33141 existing records from primary storage. [2025-10-22T23:21:13.413955] [INFO ] [MAIN ] ARW: Loaded 33141 primary data records. [2025-10-22T23:21:13.717834] [DEBUG] [MAIN ] ARW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:13.743025] [INFO ] [MAIN ] ARW: Generated 138 derivative records from 33141 primary records. [2025-10-22T23:21:13.743183] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-22T23:21:13.758138] [DEBUG] [LOCAL ] ARW: Derivative data saved (1794 records). [2025-10-22T23:21:13.758224] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-10-22T23:21:13.760918] [INFO ] [MAIN ] Derivative Progress: 113/2052 symbols. ARW took 0.4s. Estimated remaining time: 13m 0s [2025-10-22T23:21:13.761022] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:13.810331] [DEBUG] [LOCAL ] AS: Loaded 53198 existing records from primary storage. [2025-10-22T23:21:13.810507] [INFO ] [MAIN ] AS: Loaded 53198 primary data records. [2025-10-22T23:21:14.159106] [DEBUG] [MAIN ] AS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:14.185531] [INFO ] [MAIN ] AS: Generated 138 derivative records from 53198 primary records. [2025-10-22T23:21:14.185714] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-22T23:21:14.200714] [DEBUG] [LOCAL ] AS: Derivative data saved (1794 records). [2025-10-22T23:21:14.200793] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-22T23:21:14.203853] [INFO ] [MAIN ] Derivative Progress: 114/2052 symbols. AS took 0.4s. Estimated remaining time: 13m 0s [2025-10-22T23:21:14.203952] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:14.221166] [DEBUG] [LOCAL ] ASA: Loaded 15680 existing records from primary storage. [2025-10-22T23:21:14.221311] [INFO ] [MAIN ] ASA: Loaded 15680 primary data records. [2025-10-22T23:21:14.540376] [DEBUG] [MAIN ] ASA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:14.566339] [INFO ] [MAIN ] ASA: Generated 138 derivative records from 15680 primary records. [2025-10-22T23:21:14.566476] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-22T23:21:14.581619] [DEBUG] [LOCAL ] ASA: Derivative data saved (1794 records). [2025-10-22T23:21:14.581730] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-10-22T23:21:14.583794] [INFO ] [MAIN ] Derivative Progress: 115/2052 symbols. ASA took 0.4s. Estimated remaining time: 12m 60s [2025-10-22T23:21:14.583892] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:14.634611] [DEBUG] [LOCAL ] ASAN: Loaded 52732 existing records from primary storage. [2025-10-22T23:21:14.634813] [INFO ] [MAIN ] ASAN: Loaded 52732 primary data records. [2025-10-22T23:21:14.951611] [DEBUG] [MAIN ] ASAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:14.980224] [INFO ] [MAIN ] ASAN: Generated 138 derivative records from 52732 primary records. [2025-10-22T23:21:14.980394] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-22T23:21:14.995632] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1794 records). [2025-10-22T23:21:14.995748] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-10-22T23:21:14.999114] [INFO ] [MAIN ] Derivative Progress: 116/2052 symbols. ASAN took 0.4s. Estimated remaining time: 12m 60s [2025-10-22T23:21:14.999215] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:15.045134] [DEBUG] [LOCAL ] ASB: Loaded 49696 existing records from primary storage. [2025-10-22T23:21:15.045296] [INFO ] [MAIN ] ASB: Loaded 49696 primary data records. [2025-10-22T23:21:15.369949] [DEBUG] [MAIN ] ASB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:15.395046] [INFO ] [MAIN ] ASB: Generated 138 derivative records from 49696 primary records. [2025-10-22T23:21:15.395191] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-22T23:21:15.410498] [DEBUG] [LOCAL ] ASB: Derivative data saved (1794 records). [2025-10-22T23:21:15.410596] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-10-22T23:21:15.414891] [INFO ] [MAIN ] Derivative Progress: 117/2052 symbols. ASB took 0.4s. Estimated remaining time: 12m 59s [2025-10-22T23:21:15.414987] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:15.420234] [DEBUG] [LOCAL ] ASBA: Loaded 3475 existing records from primary storage. [2025-10-22T23:21:15.420321] [INFO ] [MAIN ] ASBA: Loaded 3475 primary data records. [2025-10-22T23:21:15.733051] [DEBUG] [MAIN ] ASBA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:15.759277] [INFO ] [MAIN ] ASBA: Generated 138 derivative records from 3475 primary records. [2025-10-22T23:21:15.759405] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-22T23:21:15.773095] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1794 records). [2025-10-22T23:21:15.773178] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-22T23:21:15.775256] [INFO ] [MAIN ] Derivative Progress: 118/2052 symbols. ASBA took 0.4s. Estimated remaining time: 12m 58s [2025-10-22T23:21:15.775351] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:15.811616] [DEBUG] [LOCAL ] ASC: Loaded 37184 existing records from primary storage. [2025-10-22T23:21:15.811808] [INFO ] [MAIN ] ASC: Loaded 37184 primary data records. [2025-10-22T23:21:16.162377] [DEBUG] [MAIN ] ASC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:16.188090] [INFO ] [MAIN ] ASC: Generated 138 derivative records from 37184 primary records. [2025-10-22T23:21:16.188244] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-22T23:21:16.203107] [DEBUG] [LOCAL ] ASC: Derivative data saved (1794 records). [2025-10-22T23:21:16.203213] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-10-22T23:21:16.206289] [INFO ] [MAIN ] Derivative Progress: 119/2052 symbols. ASC took 0.4s. Estimated remaining time: 12m 58s [2025-10-22T23:21:16.206400] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:16.240070] [DEBUG] [LOCAL ] ASGN: Loaded 36689 existing records from primary storage. [2025-10-22T23:21:16.240239] [INFO ] [MAIN ] ASGN: Loaded 36689 primary data records. [2025-10-22T23:21:16.590623] [DEBUG] [MAIN ] ASGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:16.616986] [INFO ] [MAIN ] ASGN: Generated 138 derivative records from 36689 primary records. [2025-10-22T23:21:16.617179] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-22T23:21:16.632115] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1794 records). [2025-10-22T23:21:16.632243] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-22T23:21:16.635062] [INFO ] [MAIN ] Derivative Progress: 120/2052 symbols. ASGN took 0.4s. Estimated remaining time: 12m 58s [2025-10-22T23:21:16.635196] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:16.672882] [DEBUG] [LOCAL ] ASH: Loaded 37383 existing records from primary storage. [2025-10-22T23:21:16.673074] [INFO ] [MAIN ] ASH: Loaded 37383 primary data records. [2025-10-22T23:21:16.983115] [DEBUG] [MAIN ] ASH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:17.008342] [INFO ] [MAIN ] ASH: Generated 138 derivative records from 37383 primary records. [2025-10-22T23:21:17.008460] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-22T23:21:17.023272] [DEBUG] [LOCAL ] ASH: Derivative data saved (1794 records). [2025-10-22T23:21:17.023355] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-22T23:21:17.026164] [INFO ] [MAIN ] Derivative Progress: 121/2052 symbols. ASH took 0.4s. Estimated remaining time: 12m 58s [2025-10-22T23:21:17.026262] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:17.049114] [DEBUG] [LOCAL ] ASIX: Loaded 22992 existing records from primary storage. [2025-10-22T23:21:17.049257] [INFO ] [MAIN ] ASIX: Loaded 22992 primary data records. [2025-10-22T23:21:17.356004] [DEBUG] [MAIN ] ASIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:17.381191] [INFO ] [MAIN ] ASIX: Generated 138 derivative records from 22992 primary records. [2025-10-22T23:21:17.381313] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-22T23:21:17.396334] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1794 records). [2025-10-22T23:21:17.396417] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-10-22T23:21:17.399135] [INFO ] [MAIN ] Derivative Progress: 122/2052 symbols. ASIX took 0.4s. Estimated remaining time: 12m 57s [2025-10-22T23:21:17.399239] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:17.444173] [DEBUG] [LOCAL ] ASPN: Loaded 49875 existing records from primary storage. [2025-10-22T23:21:17.444336] [INFO ] [MAIN ] ASPN: Loaded 49875 primary data records. [2025-10-22T23:21:17.757754] [DEBUG] [MAIN ] ASPN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:17.783758] [INFO ] [MAIN ] ASPN: Generated 138 derivative records from 49875 primary records. [2025-10-22T23:21:17.783875] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-22T23:21:17.798479] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1794 records). [2025-10-22T23:21:17.798564] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-22T23:21:17.801446] [INFO ] [MAIN ] Derivative Progress: 123/2052 symbols. ASPN took 0.4s. Estimated remaining time: 12m 56s [2025-10-22T23:21:17.801544] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:17.854210] [DEBUG] [LOCAL ] ASX: Loaded 52880 existing records from primary storage. [2025-10-22T23:21:17.854386] [INFO ] [MAIN ] ASX: Loaded 52880 primary data records. [2025-10-22T23:21:18.192814] [DEBUG] [MAIN ] ASX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:18.218541] [INFO ] [MAIN ] ASX: Generated 138 derivative records from 52880 primary records. [2025-10-22T23:21:18.218700] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-22T23:21:18.233992] [DEBUG] [LOCAL ] ASX: Derivative data saved (1794 records). [2025-10-22T23:21:18.234073] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-10-22T23:21:18.237187] [INFO ] [MAIN ] Derivative Progress: 124/2052 symbols. ASX took 0.4s. Estimated remaining time: 12m 57s [2025-10-22T23:21:18.237352] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:18.274258] [DEBUG] [LOCAL ] ATEN: Loaded 37731 existing records from primary storage. [2025-10-22T23:21:18.274418] [INFO ] [MAIN ] ATEN: Loaded 37731 primary data records. [2025-10-22T23:21:18.599569] [DEBUG] [MAIN ] ATEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:18.624397] [INFO ] [MAIN ] ATEN: Generated 138 derivative records from 37731 primary records. [2025-10-22T23:21:18.624523] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-22T23:21:18.639257] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1794 records). [2025-10-22T23:21:18.639337] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-22T23:21:18.642218] [INFO ] [MAIN ] Derivative Progress: 125/2052 symbols. ATEN took 0.4s. Estimated remaining time: 12m 56s [2025-10-22T23:21:18.642329] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:18.672128] [DEBUG] [LOCAL ] ATGE: Loaded 30426 existing records from primary storage. [2025-10-22T23:21:18.672280] [INFO ] [MAIN ] ATGE: Loaded 30426 primary data records. [2025-10-22T23:21:18.980803] [DEBUG] [MAIN ] ATGE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:21:19.007050] [INFO ] [MAIN ] ATGE: Generated 138 derivative records from 30426 primary records. [2025-10-22T23:21:19.007156] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-22T23:21:19.022716] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1793 records). [2025-10-22T23:21:19.022798] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-22T23:21:19.025671] [INFO ] [MAIN ] Derivative Progress: 126/2052 symbols. ATGE took 0.4s. Estimated remaining time: 12m 55s [2025-10-22T23:21:19.025771] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:19.055185] [DEBUG] [LOCAL ] ATHM: Loaded 31208 existing records from primary storage. [2025-10-22T23:21:19.055333] [INFO ] [MAIN ] ATHM: Loaded 31208 primary data records. [2025-10-22T23:21:19.363076] [DEBUG] [MAIN ] ATHM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:19.388112] [INFO ] [MAIN ] ATHM: Generated 138 derivative records from 31208 primary records. [2025-10-22T23:21:19.388220] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-10-22T23:21:19.403049] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1794 records). [2025-10-22T23:21:19.403130] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-10-22T23:21:19.405931] [INFO ] [MAIN ] Derivative Progress: 127/2052 symbols. ATHM took 0.4s. Estimated remaining time: 12m 55s [2025-10-22T23:21:19.406029] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:19.415385] [DEBUG] [LOCAL ] ATHS: Loaded 6496 existing records from primary storage. [2025-10-22T23:21:19.415492] [INFO ] [MAIN ] ATHS: Loaded 6496 primary data records. [2025-10-22T23:21:19.720799] [DEBUG] [MAIN ] ATHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:19.745687] [INFO ] [MAIN ] ATHS: Generated 138 derivative records from 6496 primary records. [2025-10-22T23:21:19.745792] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-22T23:21:19.760037] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1794 records). [2025-10-22T23:21:19.760119] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-22T23:21:19.762315] [INFO ] [MAIN ] Derivative Progress: 128/2052 symbols. ATHS took 0.4s. Estimated remaining time: 12m 54s [2025-10-22T23:21:19.762436] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:19.810568] [DEBUG] [LOCAL ] ATI: Loaded 51283 existing records from primary storage. [2025-10-22T23:21:19.810761] [INFO ] [MAIN ] ATI: Loaded 51283 primary data records. [2025-10-22T23:21:20.113410] [DEBUG] [MAIN ] ATI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:20.138765] [INFO ] [MAIN ] ATI: Generated 138 derivative records from 51283 primary records. [2025-10-22T23:21:20.138902] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-10-22T23:21:20.153581] [DEBUG] [LOCAL ] ATI: Derivative data saved (1794 records). [2025-10-22T23:21:20.153691] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-10-22T23:21:20.156879] [INFO ] [MAIN ] Derivative Progress: 129/2052 symbols. ATI took 0.4s. Estimated remaining time: 12m 53s [2025-10-22T23:21:20.156990] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:20.189440] [DEBUG] [LOCAL ] ATKR: Loaded 34853 existing records from primary storage. [2025-10-22T23:21:20.189637] [INFO ] [MAIN ] ATKR: Loaded 34853 primary data records. [2025-10-22T23:21:20.520666] [DEBUG] [MAIN ] ATKR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:21:20.546092] [INFO ] [MAIN ] ATKR: Generated 138 derivative records from 34853 primary records. [2025-10-22T23:21:20.546220] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-22T23:21:20.561152] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1793 records). [2025-10-22T23:21:20.561237] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-10-22T23:21:20.564019] [INFO ] [MAIN ] Derivative Progress: 130/2052 symbols. ATKR took 0.4s. Estimated remaining time: 12m 53s [2025-10-22T23:21:20.564123] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:20.598968] [DEBUG] [LOCAL ] ATMU: Loaded 38718 existing records from primary storage. [2025-10-22T23:21:20.599130] [INFO ] [MAIN ] ATMU: Loaded 38718 primary data records. [2025-10-22T23:21:20.905461] [DEBUG] [MAIN ] ATMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:20.931805] [INFO ] [MAIN ] ATMU: Generated 138 derivative records from 38718 primary records. [2025-10-22T23:21:20.931943] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-10-22T23:21:20.946979] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1794 records). [2025-10-22T23:21:20.947075] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-10-22T23:21:20.949907] [INFO ] [MAIN ] Derivative Progress: 131/2052 symbols. ATMU took 0.4s. Estimated remaining time: 12m 52s [2025-10-22T23:21:20.950008] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:20.992191] [DEBUG] [LOCAL ] ATO: Loaded 41529 existing records from primary storage. [2025-10-22T23:21:20.992359] [INFO ] [MAIN ] ATO: Loaded 41529 primary data records. [2025-10-22T23:21:21.298507] [DEBUG] [MAIN ] ATO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:21.324977] [INFO ] [MAIN ] ATO: Generated 138 derivative records from 41529 primary records. [2025-10-22T23:21:21.325196] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-10-22T23:21:21.340453] [DEBUG] [LOCAL ] ATO: Derivative data saved (1794 records). [2025-10-22T23:21:21.340576] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-10-22T23:21:21.343389] [INFO ] [MAIN ] Derivative Progress: 132/2052 symbols. ATO took 0.4s. Estimated remaining time: 12m 52s [2025-10-22T23:21:21.343493] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:21.374067] [DEBUG] [LOCAL ] ATR: Loaded 30392 existing records from primary storage. [2025-10-22T23:21:21.374247] [INFO ] [MAIN ] ATR: Loaded 30392 primary data records. [2025-10-22T23:21:21.680990] [DEBUG] [MAIN ] ATR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:21.709144] [INFO ] [MAIN ] ATR: Generated 138 derivative records from 30392 primary records. [2025-10-22T23:21:21.709319] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-10-22T23:21:21.724377] [DEBUG] [LOCAL ] ATR: Derivative data saved (1794 records). [2025-10-22T23:21:21.724491] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-10-22T23:21:21.727452] [INFO ] [MAIN ] Derivative Progress: 133/2052 symbols. ATR took 0.4s. Estimated remaining time: 12m 51s [2025-10-22T23:21:21.727569] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:21.746716] [DEBUG] [LOCAL ] ATS: Loaded 17012 existing records from primary storage. [2025-10-22T23:21:21.746871] [INFO ] [MAIN ] ATS: Loaded 17012 primary data records. [2025-10-22T23:21:22.053606] [DEBUG] [MAIN ] ATS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:22.078780] [INFO ] [MAIN ] ATS: Generated 138 derivative records from 17012 primary records. [2025-10-22T23:21:22.078993] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-10-22T23:21:22.093730] [DEBUG] [LOCAL ] ATS: Derivative data saved (1794 records). [2025-10-22T23:21:22.093826] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-10-22T23:21:22.096549] [INFO ] [MAIN ] Derivative Progress: 134/2052 symbols. ATS took 0.4s. Estimated remaining time: 12m 50s [2025-10-22T23:21:22.096694] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:22.140903] [DEBUG] [LOCAL ] ATUS: Loaded 49957 existing records from primary storage. [2025-10-22T23:21:22.141086] [INFO ] [MAIN ] ATUS: Loaded 49957 primary data records. [2025-10-22T23:21:22.470762] [DEBUG] [MAIN ] ATUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:22.495807] [INFO ] [MAIN ] ATUS: Generated 138 derivative records from 49957 primary records. [2025-10-22T23:21:22.495954] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-22T23:21:22.510674] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1794 records). [2025-10-22T23:21:22.510763] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-22T23:21:22.513873] [INFO ] [MAIN ] Derivative Progress: 135/2052 symbols. ATUS took 0.4s. Estimated remaining time: 12m 50s [2025-10-22T23:21:22.513971] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:22.562862] [DEBUG] [LOCAL ] AU: Loaded 53089 existing records from primary storage. [2025-10-22T23:21:22.563031] [INFO ] [MAIN ] AU: Loaded 53089 primary data records. [2025-10-22T23:21:22.864310] [DEBUG] [MAIN ] AU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:22.889470] [INFO ] [MAIN ] AU: Generated 138 derivative records from 53089 primary records. [2025-10-22T23:21:22.889626] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-10-22T23:21:22.904372] [DEBUG] [LOCAL ] AU: Derivative data saved (1794 records). [2025-10-22T23:21:22.904467] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-10-22T23:21:22.907560] [INFO ] [MAIN ] Derivative Progress: 136/2052 symbols. AU took 0.4s. Estimated remaining time: 12m 49s [2025-10-22T23:21:22.907688] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:22.948771] [DEBUG] [LOCAL ] AUB: Loaded 45843 existing records from primary storage. [2025-10-22T23:21:22.948937] [INFO ] [MAIN ] AUB: Loaded 45843 primary data records. [2025-10-22T23:21:23.257184] [DEBUG] [MAIN ] AUB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:23.282362] [INFO ] [MAIN ] AUB: Generated 138 derivative records from 45843 primary records. [2025-10-22T23:21:23.282521] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-22T23:21:23.297533] [DEBUG] [LOCAL ] AUB: Derivative data saved (1794 records). [2025-10-22T23:21:23.297624] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-22T23:21:23.300498] [INFO ] [MAIN ] Derivative Progress: 137/2052 symbols. AUB took 0.4s. Estimated remaining time: 12m 49s [2025-10-22T23:21:23.300639] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:23.308956] [DEBUG] [LOCAL ] AUNA: Loaded 5250 existing records from primary storage. [2025-10-22T23:21:23.309077] [INFO ] [MAIN ] AUNA: Loaded 5250 primary data records. [2025-10-22T23:21:23.612002] [DEBUG] [MAIN ] AUNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:23.637266] [INFO ] [MAIN ] AUNA: Generated 138 derivative records from 5250 primary records. [2025-10-22T23:21:23.637418] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-22T23:21:23.650679] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1794 records). [2025-10-22T23:21:23.650764] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-10-22T23:21:23.652888] [INFO ] [MAIN ] Derivative Progress: 138/2052 symbols. AUNA took 0.4s. Estimated remaining time: 12m 48s [2025-10-22T23:21:23.652999] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:23.688973] [DEBUG] [LOCAL ] AVA: Loaded 38305 existing records from primary storage. [2025-10-22T23:21:23.689142] [INFO ] [MAIN ] AVA: Loaded 38305 primary data records. [2025-10-22T23:21:23.993168] [DEBUG] [MAIN ] AVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:24.018278] [INFO ] [MAIN ] AVA: Generated 138 derivative records from 38305 primary records. [2025-10-22T23:21:24.018378] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-22T23:21:24.033057] [DEBUG] [LOCAL ] AVA: Derivative data saved (1794 records). [2025-10-22T23:21:24.033138] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-22T23:21:24.036088] [INFO ] [MAIN ] Derivative Progress: 139/2052 symbols. AVA took 0.4s. Estimated remaining time: 12m 47s [2025-10-22T23:21:24.036382] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:24.047699] [DEBUG] [LOCAL ] AVAL: Loaded 8482 existing records from primary storage. [2025-10-22T23:21:24.047806] [INFO ] [MAIN ] AVAL: Loaded 8482 primary data records. [2025-10-22T23:21:24.387376] [DEBUG] [MAIN ] AVAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:24.413026] [INFO ] [MAIN ] AVAL: Generated 138 derivative records from 8482 primary records. [2025-10-22T23:21:24.413217] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-10-22T23:21:24.427617] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1794 records). [2025-10-22T23:21:24.427754] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-10-22T23:21:24.430010] [INFO ] [MAIN ] Derivative Progress: 140/2052 symbols. AVAL took 0.4s. Estimated remaining time: 12m 47s [2025-10-22T23:21:24.430113] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:24.471742] [DEBUG] [LOCAL ] AVB: Loaded 42169 existing records from primary storage. [2025-10-22T23:21:24.471909] [INFO ] [MAIN ] AVB: Loaded 42169 primary data records. [2025-10-22T23:21:24.792578] [DEBUG] [MAIN ] AVB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:24.818637] [INFO ] [MAIN ] AVB: Generated 138 derivative records from 42169 primary records. [2025-10-22T23:21:24.818802] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-22T23:21:24.834435] [DEBUG] [LOCAL ] AVB: Derivative data saved (1794 records). [2025-10-22T23:21:24.834571] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-10-22T23:21:24.837704] [INFO ] [MAIN ] Derivative Progress: 141/2052 symbols. AVB took 0.4s. Estimated remaining time: 12m 46s [2025-10-22T23:21:24.837808] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:24.858781] [DEBUG] [LOCAL ] AVD: Loaded 21323 existing records from primary storage. [2025-10-22T23:21:24.858937] [INFO ] [MAIN ] AVD: Loaded 21323 primary data records. [2025-10-22T23:21:25.176801] [DEBUG] [MAIN ] AVD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:25.202875] [INFO ] [MAIN ] AVD: Generated 138 derivative records from 21323 primary records. [2025-10-22T23:21:25.203041] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-22T23:21:25.223397] [DEBUG] [LOCAL ] AVD: Derivative data saved (1794 records). [2025-10-22T23:21:25.223622] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-22T23:21:25.227365] [INFO ] [MAIN ] Derivative Progress: 142/2052 symbols. AVD took 0.4s. Estimated remaining time: 12m 46s [2025-10-22T23:21:25.227544] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:25.254819] [DEBUG] [LOCAL ] AVK: Loaded 18618 existing records from primary storage. [2025-10-22T23:21:25.255070] [INFO ] [MAIN ] AVK: Loaded 18618 primary data records. [2025-10-22T23:21:25.605711] [DEBUG] [MAIN ] AVK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:25.633340] [INFO ] [MAIN ] AVK: Generated 138 derivative records from 18618 primary records. [2025-10-22T23:21:25.633506] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-22T23:21:25.648867] [DEBUG] [LOCAL ] AVK: Derivative data saved (1794 records). [2025-10-22T23:21:25.648996] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-22T23:21:25.652107] [INFO ] [MAIN ] Derivative Progress: 143/2052 symbols. AVK took 0.4s. Estimated remaining time: 12m 46s [2025-10-22T23:21:25.652230] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:25.687139] [DEBUG] [LOCAL ] AVNS: Loaded 33534 existing records from primary storage. [2025-10-22T23:21:25.687337] [INFO ] [MAIN ] AVNS: Loaded 33534 primary data records. [2025-10-22T23:21:26.004778] [DEBUG] [MAIN ] AVNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:26.032000] [INFO ] [MAIN ] AVNS: Generated 138 derivative records from 33534 primary records. [2025-10-22T23:21:26.032126] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-22T23:21:26.047323] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1794 records). [2025-10-22T23:21:26.047430] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-22T23:21:26.050599] [INFO ] [MAIN ] Derivative Progress: 144/2052 symbols. AVNS took 0.4s. Estimated remaining time: 12m 45s [2025-10-22T23:21:26.050735] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:26.090177] [DEBUG] [LOCAL ] AVNT: Loaded 38618 existing records from primary storage. [2025-10-22T23:21:26.090342] [INFO ] [MAIN ] AVNT: Loaded 38618 primary data records. [2025-10-22T23:21:26.407204] [DEBUG] [MAIN ] AVNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:26.435607] [INFO ] [MAIN ] AVNT: Generated 138 derivative records from 38618 primary records. [2025-10-22T23:21:26.435850] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-10-22T23:21:26.452260] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1794 records). [2025-10-22T23:21:26.452458] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-10-22T23:21:26.455503] [INFO ] [MAIN ] Derivative Progress: 145/2052 symbols. AVNT took 0.4s. Estimated remaining time: 12m 45s [2025-10-22T23:21:26.455609] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:26.507863] [DEBUG] [LOCAL ] AVTR: Loaded 53571 existing records from primary storage. [2025-10-22T23:21:26.508063] [INFO ] [MAIN ] AVTR: Loaded 53571 primary data records. [2025-10-22T23:21:26.837627] [DEBUG] [MAIN ] AVTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:26.863569] [INFO ] [MAIN ] AVTR: Generated 138 derivative records from 53571 primary records. [2025-10-22T23:21:26.863776] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-10-22T23:21:26.879024] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1794 records). [2025-10-22T23:21:26.879135] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-10-22T23:21:26.881914] [INFO ] [MAIN ] Derivative Progress: 146/2052 symbols. AVTR took 0.4s. Estimated remaining time: 12m 45s [2025-10-22T23:21:26.882026] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:26.919246] [DEBUG] [LOCAL ] AVY: Loaded 38119 existing records from primary storage. [2025-10-22T23:21:26.919414] [INFO ] [MAIN ] AVY: Loaded 38119 primary data records. [2025-10-22T23:21:27.224691] [DEBUG] [MAIN ] AVY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:27.249914] [INFO ] [MAIN ] AVY: Generated 138 derivative records from 38119 primary records. [2025-10-22T23:21:27.250048] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-10-22T23:21:27.265053] [DEBUG] [LOCAL ] AVY: Derivative data saved (1794 records). [2025-10-22T23:21:27.265134] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-10-22T23:21:27.268222] [INFO ] [MAIN ] Derivative Progress: 147/2052 symbols. AVY took 0.4s. Estimated remaining time: 12m 44s [2025-10-22T23:21:27.268485] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:27.294748] [DEBUG] [LOCAL ] AWF: Loaded 24048 existing records from primary storage. [2025-10-22T23:21:27.294881] [INFO ] [MAIN ] AWF: Loaded 24048 primary data records. [2025-10-22T23:21:27.611614] [DEBUG] [MAIN ] AWF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:27.638267] [INFO ] [MAIN ] AWF: Generated 138 derivative records from 24048 primary records. [2025-10-22T23:21:27.638394] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-22T23:21:27.653458] [DEBUG] [LOCAL ] AWF: Derivative data saved (1794 records). [2025-10-22T23:21:27.653539] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-22T23:21:27.656288] [INFO ] [MAIN ] Derivative Progress: 148/2052 symbols. AWF took 0.4s. Estimated remaining time: 12m 44s [2025-10-22T23:21:27.656388] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:27.681790] [DEBUG] [LOCAL ] AWI: Loaded 25139 existing records from primary storage. [2025-10-22T23:21:27.681934] [INFO ] [MAIN ] AWI: Loaded 25139 primary data records. [2025-10-22T23:21:27.991548] [DEBUG] [MAIN ] AWI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:21:28.016955] [INFO ] [MAIN ] AWI: Generated 138 derivative records from 25139 primary records. [2025-10-22T23:21:28.017060] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-22T23:21:28.032219] [DEBUG] [LOCAL ] AWI: Derivative data saved (1793 records). [2025-10-22T23:21:28.032302] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-10-22T23:21:28.035076] [INFO ] [MAIN ] Derivative Progress: 149/2052 symbols. AWI took 0.4s. Estimated remaining time: 12m 43s [2025-10-22T23:21:28.035189] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:28.080142] [DEBUG] [LOCAL ] AWK: Loaded 48388 existing records from primary storage. [2025-10-22T23:21:28.080311] [INFO ] [MAIN ] AWK: Loaded 48388 primary data records. [2025-10-22T23:21:28.388301] [DEBUG] [MAIN ] AWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:28.413610] [INFO ] [MAIN ] AWK: Generated 138 derivative records from 48388 primary records. [2025-10-22T23:21:28.413736] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-22T23:21:28.429096] [DEBUG] [LOCAL ] AWK: Derivative data saved (1794 records). [2025-10-22T23:21:28.429179] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-22T23:21:28.432287] [INFO ] [MAIN ] Derivative Progress: 150/2052 symbols. AWK took 0.4s. Estimated remaining time: 12m 43s [2025-10-22T23:21:28.432386] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:28.453278] [DEBUG] [LOCAL ] AWP: Loaded 21587 existing records from primary storage. [2025-10-22T23:21:28.453415] [INFO ] [MAIN ] AWP: Loaded 21587 primary data records. [2025-10-22T23:21:28.789840] [DEBUG] [MAIN ] AWP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:28.815537] [INFO ] [MAIN ] AWP: Generated 138 derivative records from 21587 primary records. [2025-10-22T23:21:28.815694] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-22T23:21:28.830884] [DEBUG] [LOCAL ] AWP: Derivative data saved (1794 records). [2025-10-22T23:21:28.830983] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-10-22T23:21:28.834062] [INFO ] [MAIN ] Derivative Progress: 151/2052 symbols. AWP took 0.4s. Estimated remaining time: 12m 42s [2025-10-22T23:21:28.834159] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:28.857138] [DEBUG] [LOCAL ] AWR: Loaded 22661 existing records from primary storage. [2025-10-22T23:21:28.857271] [INFO ] [MAIN ] AWR: Loaded 22661 primary data records. [2025-10-22T23:21:29.167061] [DEBUG] [MAIN ] AWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:29.192680] [INFO ] [MAIN ] AWR: Generated 138 derivative records from 22661 primary records. [2025-10-22T23:21:29.192786] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-22T23:21:29.207487] [DEBUG] [LOCAL ] AWR: Derivative data saved (1794 records). [2025-10-22T23:21:29.207573] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-22T23:21:29.210381] [INFO ] [MAIN ] Derivative Progress: 152/2052 symbols. AWR took 0.4s. Estimated remaining time: 12m 41s [2025-10-22T23:21:29.210487] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:29.237592] [DEBUG] [LOCAL ] AX: Loaded 27804 existing records from primary storage. [2025-10-22T23:21:29.237771] [INFO ] [MAIN ] AX: Loaded 27804 primary data records. [2025-10-22T23:21:29.545193] [DEBUG] [MAIN ] AX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:29.570536] [INFO ] [MAIN ] AX: Generated 138 derivative records from 27804 primary records. [2025-10-22T23:21:29.570637] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-22T23:21:29.585779] [DEBUG] [LOCAL ] AX: Derivative data saved (1794 records). [2025-10-22T23:21:29.585864] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-10-22T23:21:29.588750] [INFO ] [MAIN ] Derivative Progress: 153/2052 symbols. AX took 0.4s. Estimated remaining time: 12m 41s [2025-10-22T23:21:29.588852] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:29.635933] [DEBUG] [LOCAL ] AXL: Loaded 50533 existing records from primary storage. [2025-10-22T23:21:29.636098] [INFO ] [MAIN ] AXL: Loaded 50533 primary data records. [2025-10-22T23:21:29.943773] [DEBUG] [MAIN ] AXL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:29.969307] [INFO ] [MAIN ] AXL: Generated 138 derivative records from 50533 primary records. [2025-10-22T23:21:29.969408] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-22T23:21:29.984205] [DEBUG] [LOCAL ] AXL: Derivative data saved (1794 records). [2025-10-22T23:21:29.984286] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-10-22T23:21:29.987545] [INFO ] [MAIN ] Derivative Progress: 154/2052 symbols. AXL took 0.4s. Estimated remaining time: 12m 40s [2025-10-22T23:21:29.987672] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:30.038169] [DEBUG] [LOCAL ] AXP: Loaded 53162 existing records from primary storage. [2025-10-22T23:21:30.038332] [INFO ] [MAIN ] AXP: Loaded 53162 primary data records. [2025-10-22T23:21:30.347246] [DEBUG] [MAIN ] AXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:30.372526] [INFO ] [MAIN ] AXP: Generated 138 derivative records from 53162 primary records. [2025-10-22T23:21:30.372675] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-22T23:21:30.387538] [DEBUG] [LOCAL ] AXP: Derivative data saved (1794 records). [2025-10-22T23:21:30.387619] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-10-22T23:21:30.390826] [INFO ] [MAIN ] Derivative Progress: 155/2052 symbols. AXP took 0.4s. Estimated remaining time: 12m 40s [2025-10-22T23:21:30.390930] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:30.395493] [DEBUG] [LOCAL ] AXR: Loaded 2907 existing records from primary storage. [2025-10-22T23:21:30.395581] [INFO ] [MAIN ] AXR: Loaded 2907 primary data records. [2025-10-22T23:21:30.722381] [DEBUG] [MAIN ] AXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:30.747490] [INFO ] [MAIN ] AXR: Generated 138 derivative records from 2907 primary records. [2025-10-22T23:21:30.747591] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-10-22T23:21:30.760106] [DEBUG] [LOCAL ] AXR: Derivative data saved (1794 records). [2025-10-22T23:21:30.760187] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-10-22T23:21:30.762361] [INFO ] [MAIN ] Derivative Progress: 156/2052 symbols. AXR took 0.4s. Estimated remaining time: 12m 39s [2025-10-22T23:21:30.762462] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:30.812160] [DEBUG] [LOCAL ] AXTA: Loaded 52290 existing records from primary storage. [2025-10-22T23:21:30.812325] [INFO ] [MAIN ] AXTA: Loaded 52290 primary data records. [2025-10-22T23:21:31.114203] [DEBUG] [MAIN ] AXTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:31.139385] [INFO ] [MAIN ] AXTA: Generated 138 derivative records from 52290 primary records. [2025-10-22T23:21:31.139486] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-22T23:21:31.154718] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1794 records). [2025-10-22T23:21:31.154802] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-10-22T23:21:31.157865] [INFO ] [MAIN ] Derivative Progress: 157/2052 symbols. AXTA took 0.4s. Estimated remaining time: 12m 39s [2025-10-22T23:21:31.157964] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:31.170677] [DEBUG] [LOCAL ] AZO: Loaded 10731 existing records from primary storage. [2025-10-22T23:21:31.170785] [INFO ] [MAIN ] AZO: Loaded 10731 primary data records. [2025-10-22T23:21:31.471107] [DEBUG] [MAIN ] AZO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:31.496061] [INFO ] [MAIN ] AZO: Generated 138 derivative records from 10731 primary records. [2025-10-22T23:21:31.496170] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-22T23:21:31.510888] [DEBUG] [LOCAL ] AZO: Derivative data saved (1794 records). [2025-10-22T23:21:31.510969] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-10-22T23:21:31.513112] [INFO ] [MAIN ] Derivative Progress: 158/2052 symbols. AZO took 0.4s. Estimated remaining time: 12m 38s [2025-10-22T23:21:31.513234] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:31.534614] [DEBUG] [LOCAL ] AZZ: Loaded 22928 existing records from primary storage. [2025-10-22T23:21:31.534760] [INFO ] [MAIN ] AZZ: Loaded 22928 primary data records. [2025-10-22T23:21:31.843429] [DEBUG] [MAIN ] AZZ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:21:31.868703] [INFO ] [MAIN ] AZZ: Generated 138 derivative records from 22928 primary records. [2025-10-22T23:21:31.868806] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-22T23:21:31.883458] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1793 records). [2025-10-22T23:21:31.883538] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-22T23:21:31.886129] [INFO ] [MAIN ] Derivative Progress: 159/2052 symbols. AZZ took 0.4s. Estimated remaining time: 12m 37s [2025-10-22T23:21:31.886227] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:31.937313] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-22T23:21:31.937472] [INFO ] [MAIN ] BA: Loaded 53790 primary data records. [2025-10-22T23:21:32.238704] [DEBUG] [MAIN ] BA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:32.263817] [INFO ] [MAIN ] BA: Generated 138 derivative records from 53790 primary records. [2025-10-22T23:21:32.263943] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-22T23:21:32.279137] [DEBUG] [LOCAL ] BA: Derivative data saved (1794 records). [2025-10-22T23:21:32.279231] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-10-22T23:21:32.281990] [INFO ] [MAIN ] Derivative Progress: 160/2052 symbols. BA took 0.4s. Estimated remaining time: 12m 37s [2025-10-22T23:21:32.282084] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:32.334261] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-22T23:21:32.334421] [INFO ] [MAIN ] BABA: Loaded 53820 primary data records. [2025-10-22T23:21:32.643514] [DEBUG] [MAIN ] BABA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:32.668215] [INFO ] [MAIN ] BABA: Generated 138 derivative records from 53820 primary records. [2025-10-22T23:21:32.668337] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-22T23:21:32.683629] [DEBUG] [LOCAL ] BABA: Derivative data saved (1794 records). [2025-10-22T23:21:32.683731] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-10-22T23:21:32.686449] [INFO ] [MAIN ] Derivative Progress: 161/2052 symbols. BABA took 0.4s. Estimated remaining time: 12m 36s [2025-10-22T23:21:32.686543] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:32.720984] [DEBUG] [LOCAL ] BAK: Loaded 39419 existing records from primary storage. [2025-10-22T23:21:32.721147] [INFO ] [MAIN ] BAK: Loaded 39419 primary data records. [2025-10-22T23:21:33.047075] [DEBUG] [MAIN ] BAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:33.072343] [INFO ] [MAIN ] BAK: Generated 138 derivative records from 39419 primary records. [2025-10-22T23:21:33.072442] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-22T23:21:33.087050] [DEBUG] [LOCAL ] BAK: Derivative data saved (1794 records). [2025-10-22T23:21:33.087130] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-22T23:21:33.090074] [INFO ] [MAIN ] Derivative Progress: 162/2052 symbols. BAK took 0.4s. Estimated remaining time: 12m 36s [2025-10-22T23:21:33.090177] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:33.138271] [DEBUG] [LOCAL ] BALL: Loaded 51932 existing records from primary storage. [2025-10-22T23:21:33.138438] [INFO ] [MAIN ] BALL: Loaded 51932 primary data records. [2025-10-22T23:21:33.442203] [DEBUG] [MAIN ] BALL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:33.467067] [INFO ] [MAIN ] BALL: Generated 138 derivative records from 51932 primary records. [2025-10-22T23:21:33.467176] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-22T23:21:33.482003] [DEBUG] [LOCAL ] BALL: Derivative data saved (1794 records). [2025-10-22T23:21:33.482084] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-22T23:21:33.485183] [INFO ] [MAIN ] Derivative Progress: 163/2052 symbols. BALL took 0.4s. Estimated remaining time: 12m 35s [2025-10-22T23:21:33.485283] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:33.533804] [DEBUG] [LOCAL ] BAM: Loaded 52081 existing records from primary storage. [2025-10-22T23:21:33.533979] [INFO ] [MAIN ] BAM: Loaded 52081 primary data records. [2025-10-22T23:21:33.895622] [DEBUG] [MAIN ] BAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:33.923957] [INFO ] [MAIN ] BAM: Generated 138 derivative records from 52081 primary records. [2025-10-22T23:21:33.924131] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-22T23:21:33.940687] [DEBUG] [LOCAL ] BAM: Derivative data saved (1794 records). [2025-10-22T23:21:33.940786] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-10-22T23:21:33.944010] [INFO ] [MAIN ] Derivative Progress: 164/2052 symbols. BAM took 0.5s. Estimated remaining time: 12m 36s [2025-10-22T23:21:33.944132] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:33.996036] [DEBUG] [LOCAL ] BANC: Loaded 51385 existing records from primary storage. [2025-10-22T23:21:33.996207] [INFO ] [MAIN ] BANC: Loaded 51385 primary data records. [2025-10-22T23:21:34.329796] [DEBUG] [MAIN ] BANC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:34.354993] [INFO ] [MAIN ] BANC: Generated 138 derivative records from 51385 primary records. [2025-10-22T23:21:34.355096] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-22T23:21:34.370356] [DEBUG] [LOCAL ] BANC: Derivative data saved (1794 records). [2025-10-22T23:21:34.370441] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-10-22T23:21:34.373683] [INFO ] [MAIN ] Derivative Progress: 165/2052 symbols. BANC took 0.4s. Estimated remaining time: 12m 36s [2025-10-22T23:21:34.373789] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:34.399474] [DEBUG] [LOCAL ] BAP: Loaded 25563 existing records from primary storage. [2025-10-22T23:21:34.399628] [INFO ] [MAIN ] BAP: Loaded 25563 primary data records. [2025-10-22T23:21:34.707774] [DEBUG] [MAIN ] BAP: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:21:34.733014] [INFO ] [MAIN ] BAP: Generated 138 derivative records from 25563 primary records. [2025-10-22T23:21:34.733118] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-22T23:21:34.748018] [DEBUG] [LOCAL ] BAP: Derivative data saved (1793 records). [2025-10-22T23:21:34.748098] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-22T23:21:34.751038] [INFO ] [MAIN ] Derivative Progress: 166/2052 symbols. BAP took 0.4s. Estimated remaining time: 12m 35s [2025-10-22T23:21:34.751138] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:34.785384] [DEBUG] [LOCAL ] BARK: Loaded 38227 existing records from primary storage. [2025-10-22T23:21:34.785540] [INFO ] [MAIN ] BARK: Loaded 38227 primary data records. [2025-10-22T23:21:35.113262] [DEBUG] [MAIN ] BARK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:35.138679] [INFO ] [MAIN ] BARK: Generated 138 derivative records from 38227 primary records. [2025-10-22T23:21:35.138795] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-22T23:21:35.154034] [DEBUG] [LOCAL ] BARK: Derivative data saved (1794 records). [2025-10-22T23:21:35.154115] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-22T23:21:35.157079] [INFO ] [MAIN ] Derivative Progress: 167/2052 symbols. BARK took 0.4s. Estimated remaining time: 12m 35s [2025-10-22T23:21:35.157177] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:35.206518] [DEBUG] [LOCAL ] BAX: Loaded 53537 existing records from primary storage. [2025-10-22T23:21:35.206708] [INFO ] [MAIN ] BAX: Loaded 53537 primary data records. [2025-10-22T23:21:35.513000] [DEBUG] [MAIN ] BAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:35.538194] [INFO ] [MAIN ] BAX: Generated 138 derivative records from 53537 primary records. [2025-10-22T23:21:35.538312] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-22T23:21:35.553467] [DEBUG] [LOCAL ] BAX: Derivative data saved (1794 records). [2025-10-22T23:21:35.553550] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-10-22T23:21:35.556341] [INFO ] [MAIN ] Derivative Progress: 168/2052 symbols. BAX took 0.4s. Estimated remaining time: 12m 34s [2025-10-22T23:21:35.556450] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:35.605899] [DEBUG] [LOCAL ] BB: Loaded 52882 existing records from primary storage. [2025-10-22T23:21:35.606077] [INFO ] [MAIN ] BB: Loaded 52882 primary data records. [2025-10-22T23:21:35.967510] [DEBUG] [MAIN ] BB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:35.993842] [INFO ] [MAIN ] BB: Generated 138 derivative records from 52882 primary records. [2025-10-22T23:21:35.994016] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-22T23:21:36.009329] [DEBUG] [LOCAL ] BB: Derivative data saved (1794 records). [2025-10-22T23:21:36.009458] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-22T23:21:36.012746] [INFO ] [MAIN ] Derivative Progress: 169/2052 symbols. BB took 0.5s. Estimated remaining time: 12m 34s [2025-10-22T23:21:36.012879] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:36.064189] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-22T23:21:36.064359] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-10-22T23:21:36.397120] [DEBUG] [MAIN ] BBAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:36.424929] [INFO ] [MAIN ] BBAI: Generated 138 derivative records from 53820 primary records. [2025-10-22T23:21:36.425119] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-22T23:21:36.441354] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1794 records). [2025-10-22T23:21:36.441457] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-22T23:21:36.444340] [INFO ] [MAIN ] Derivative Progress: 170/2052 symbols. BBAI took 0.4s. Estimated remaining time: 12m 34s [2025-10-22T23:21:36.444458] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:36.485593] [DEBUG] [LOCAL ] BBAR: Loaded 42605 existing records from primary storage. [2025-10-22T23:21:36.485794] [INFO ] [MAIN ] BBAR: Loaded 42605 primary data records. [2025-10-22T23:21:36.800211] [DEBUG] [MAIN ] BBAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:36.825156] [INFO ] [MAIN ] BBAR: Generated 138 derivative records from 42605 primary records. [2025-10-22T23:21:36.825298] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-22T23:21:36.840431] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1794 records). [2025-10-22T23:21:36.840511] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-22T23:21:36.843494] [INFO ] [MAIN ] Derivative Progress: 171/2052 symbols. BBAR took 0.4s. Estimated remaining time: 12m 34s [2025-10-22T23:21:36.843609] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:36.873864] [DEBUG] [LOCAL ] BBDC: Loaded 32835 existing records from primary storage. [2025-10-22T23:21:36.874041] [INFO ] [MAIN ] BBDC: Loaded 32835 primary data records. [2025-10-22T23:21:37.213128] [DEBUG] [MAIN ] BBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:37.238896] [INFO ] [MAIN ] BBDC: Generated 138 derivative records from 32835 primary records. [2025-10-22T23:21:37.239011] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-22T23:21:37.254084] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1794 records). [2025-10-22T23:21:37.254168] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-10-22T23:21:37.257146] [INFO ] [MAIN ] Derivative Progress: 172/2052 symbols. BBDC took 0.4s. Estimated remaining time: 12m 34s [2025-10-22T23:21:37.257313] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:37.265491] [DEBUG] [LOCAL ] BBDO: Loaded 4953 existing records from primary storage. [2025-10-22T23:21:37.265616] [INFO ] [MAIN ] BBDO: Loaded 4953 primary data records. [2025-10-22T23:21:37.581421] [DEBUG] [MAIN ] BBDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:37.607054] [INFO ] [MAIN ] BBDO: Generated 138 derivative records from 4953 primary records. [2025-10-22T23:21:37.607172] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-10-22T23:21:37.620920] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1794 records). [2025-10-22T23:21:37.621003] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-10-22T23:21:37.623108] [INFO ] [MAIN ] Derivative Progress: 173/2052 symbols. BBDO took 0.4s. Estimated remaining time: 12m 33s [2025-10-22T23:21:37.623209] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:37.640981] [DEBUG] [LOCAL ] BBN: Loaded 17840 existing records from primary storage. [2025-10-22T23:21:37.641121] [INFO ] [MAIN ] BBN: Loaded 17840 primary data records. [2025-10-22T23:21:37.958843] [DEBUG] [MAIN ] BBN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:37.984396] [INFO ] [MAIN ] BBN: Generated 138 derivative records from 17840 primary records. [2025-10-22T23:21:37.984581] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-10-22T23:21:37.999716] [DEBUG] [LOCAL ] BBN: Derivative data saved (1794 records). [2025-10-22T23:21:37.999806] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-10-22T23:21:38.003157] [INFO ] [MAIN ] Derivative Progress: 174/2052 symbols. BBN took 0.4s. Estimated remaining time: 12m 32s [2025-10-22T23:21:38.003312] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:38.013719] [DEBUG] [LOCAL ] BBU: Loaded 5773 existing records from primary storage. [2025-10-22T23:21:38.013857] [INFO ] [MAIN ] BBU: Loaded 5773 primary data records. [2025-10-22T23:21:38.348925] [DEBUG] [MAIN ] BBU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:38.375285] [INFO ] [MAIN ] BBU: Generated 138 derivative records from 5773 primary records. [2025-10-22T23:21:38.375472] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-10-22T23:21:38.389812] [DEBUG] [LOCAL ] BBU: Derivative data saved (1794 records). [2025-10-22T23:21:38.389963] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-10-22T23:21:38.392229] [INFO ] [MAIN ] Derivative Progress: 175/2052 symbols. BBU took 0.4s. Estimated remaining time: 12m 32s [2025-10-22T23:21:38.392341] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:38.407594] [DEBUG] [LOCAL ] BBUC: Loaded 13946 existing records from primary storage. [2025-10-22T23:21:38.407771] [INFO ] [MAIN ] BBUC: Loaded 13946 primary data records. [2025-10-22T23:21:38.720394] [DEBUG] [MAIN ] BBUC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:38.747244] [INFO ] [MAIN ] BBUC: Generated 138 derivative records from 13946 primary records. [2025-10-22T23:21:38.747461] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-10-22T23:21:38.762674] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1794 records). [2025-10-22T23:21:38.762821] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-10-22T23:21:38.765857] [INFO ] [MAIN ] Derivative Progress: 176/2052 symbols. BBUC took 0.4s. Estimated remaining time: 12m 31s [2025-10-22T23:21:38.766031] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:38.815881] [DEBUG] [LOCAL ] BBVA: Loaded 49107 existing records from primary storage. [2025-10-22T23:21:38.816071] [INFO ] [MAIN ] BBVA: Loaded 49107 primary data records. [2025-10-22T23:21:39.170241] [DEBUG] [MAIN ] BBVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:39.195333] [INFO ] [MAIN ] BBVA: Generated 138 derivative records from 49107 primary records. [2025-10-22T23:21:39.195466] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-22T23:21:39.210451] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1794 records). [2025-10-22T23:21:39.210534] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-10-22T23:21:39.213668] [INFO ] [MAIN ] Derivative Progress: 177/2052 symbols. BBVA took 0.4s. Estimated remaining time: 12m 31s [2025-10-22T23:21:39.213765] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:39.239826] [DEBUG] [LOCAL ] BBW: Loaded 27233 existing records from primary storage. [2025-10-22T23:21:39.239977] [INFO ] [MAIN ] BBW: Loaded 27233 primary data records. [2025-10-22T23:21:39.542105] [DEBUG] [MAIN ] BBW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:39.567240] [INFO ] [MAIN ] BBW: Generated 138 derivative records from 27233 primary records. [2025-10-22T23:21:39.567381] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-22T23:21:39.581992] [DEBUG] [LOCAL ] BBW: Derivative data saved (1794 records). [2025-10-22T23:21:39.582073] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-10-22T23:21:39.584877] [INFO ] [MAIN ] Derivative Progress: 178/2052 symbols. BBW took 0.4s. Estimated remaining time: 12m 30s [2025-10-22T23:21:39.584991] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:39.634167] [DEBUG] [LOCAL ] BBWI: Loaded 53591 existing records from primary storage. [2025-10-22T23:21:39.634325] [INFO ] [MAIN ] BBWI: Loaded 53591 primary data records. [2025-10-22T23:21:39.941679] [DEBUG] [MAIN ] BBWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:39.966349] [INFO ] [MAIN ] BBWI: Generated 138 derivative records from 53591 primary records. [2025-10-22T23:21:39.966462] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-22T23:21:39.981392] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1794 records). [2025-10-22T23:21:39.981477] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-22T23:21:39.984230] [INFO ] [MAIN ] Derivative Progress: 179/2052 symbols. BBWI took 0.4s. Estimated remaining time: 12m 30s [2025-10-22T23:21:39.984329] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:40.033576] [DEBUG] [LOCAL ] BBY: Loaded 53437 existing records from primary storage. [2025-10-22T23:21:40.033766] [INFO ] [MAIN ] BBY: Loaded 53437 primary data records. [2025-10-22T23:21:40.335535] [DEBUG] [MAIN ] BBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:40.360661] [INFO ] [MAIN ] BBY: Generated 138 derivative records from 53437 primary records. [2025-10-22T23:21:40.360812] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-22T23:21:40.375480] [DEBUG] [LOCAL ] BBY: Derivative data saved (1794 records). [2025-10-22T23:21:40.375562] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-10-22T23:21:40.378824] [INFO ] [MAIN ] Derivative Progress: 180/2052 symbols. BBY took 0.4s. Estimated remaining time: 12m 30s [2025-10-22T23:21:40.378928] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:40.418493] [DEBUG] [LOCAL ] BC: Loaded 43892 existing records from primary storage. [2025-10-22T23:21:40.418674] [INFO ] [MAIN ] BC: Loaded 43892 primary data records. [2025-10-22T23:21:40.730660] [DEBUG] [MAIN ] BC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:40.756694] [INFO ] [MAIN ] BC: Generated 138 derivative records from 43892 primary records. [2025-10-22T23:21:40.756848] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-22T23:21:40.772070] [DEBUG] [LOCAL ] BC: Derivative data saved (1794 records). [2025-10-22T23:21:40.772200] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-10-22T23:21:40.775290] [INFO ] [MAIN ] Derivative Progress: 181/2052 symbols. BC took 0.4s. Estimated remaining time: 12m 29s [2025-10-22T23:21:40.775418] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:40.808769] [DEBUG] [LOCAL ] BCAT: Loaded 34203 existing records from primary storage. [2025-10-22T23:21:40.808934] [INFO ] [MAIN ] BCAT: Loaded 34203 primary data records. [2025-10-22T23:21:41.114670] [DEBUG] [MAIN ] BCAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:41.139894] [INFO ] [MAIN ] BCAT: Generated 138 derivative records from 34203 primary records. [2025-10-22T23:21:41.140062] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-22T23:21:41.155235] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1794 records). [2025-10-22T23:21:41.155339] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-10-22T23:21:41.158227] [INFO ] [MAIN ] Derivative Progress: 182/2052 symbols. BCAT took 0.4s. Estimated remaining time: 12m 29s [2025-10-22T23:21:41.158338] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:41.190782] [DEBUG] [LOCAL ] BCC: Loaded 28624 existing records from primary storage. [2025-10-22T23:21:41.190971] [INFO ] [MAIN ] BCC: Loaded 28624 primary data records. [2025-10-22T23:21:41.580292] [DEBUG] [MAIN ] BCC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:21:41.605565] [INFO ] [MAIN ] BCC: Generated 138 derivative records from 28624 primary records. [2025-10-22T23:21:41.605747] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-10-22T23:21:41.620550] [DEBUG] [LOCAL ] BCC: Derivative data saved (1793 records). [2025-10-22T23:21:41.620682] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-10-22T23:21:41.623483] [INFO ] [MAIN ] Derivative Progress: 183/2052 symbols. BCC took 0.5s. Estimated remaining time: 12m 29s [2025-10-22T23:21:41.623599] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:41.673731] [DEBUG] [LOCAL ] BCE: Loaded 52266 existing records from primary storage. [2025-10-22T23:21:41.674027] [INFO ] [MAIN ] BCE: Loaded 52266 primary data records. [2025-10-22T23:21:41.992600] [DEBUG] [MAIN ] BCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:42.018865] [INFO ] [MAIN ] BCE: Generated 138 derivative records from 52266 primary records. [2025-10-22T23:21:42.018988] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-22T23:21:42.034109] [DEBUG] [LOCAL ] BCE: Derivative data saved (1794 records). [2025-10-22T23:21:42.034192] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-10-22T23:21:42.037724] [INFO ] [MAIN ] Derivative Progress: 184/2052 symbols. BCE took 0.4s. Estimated remaining time: 12m 29s [2025-10-22T23:21:42.037825] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:42.067385] [DEBUG] [LOCAL ] BCH: Loaded 30088 existing records from primary storage. [2025-10-22T23:21:42.067535] [INFO ] [MAIN ] BCH: Loaded 30088 primary data records. [2025-10-22T23:21:42.374139] [DEBUG] [MAIN ] BCH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:42.399054] [INFO ] [MAIN ] BCH: Generated 138 derivative records from 30088 primary records. [2025-10-22T23:21:42.399162] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-10-22T23:21:42.413876] [DEBUG] [LOCAL ] BCH: Derivative data saved (1794 records). [2025-10-22T23:21:42.413960] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-10-22T23:21:42.416878] [INFO ] [MAIN ] Derivative Progress: 185/2052 symbols. BCH took 0.4s. Estimated remaining time: 12m 28s [2025-10-22T23:21:42.416979] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:42.440720] [DEBUG] [LOCAL ] BCO: Loaded 24959 existing records from primary storage. [2025-10-22T23:21:42.440899] [INFO ] [MAIN ] BCO: Loaded 24959 primary data records. [2025-10-22T23:21:42.754324] [DEBUG] [MAIN ] BCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:42.783635] [INFO ] [MAIN ] BCO: Generated 138 derivative records from 24959 primary records. [2025-10-22T23:21:42.783833] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-22T23:21:42.800337] [DEBUG] [LOCAL ] BCO: Derivative data saved (1794 records). [2025-10-22T23:21:42.800441] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-10-22T23:21:42.803164] [INFO ] [MAIN ] Derivative Progress: 186/2052 symbols. BCO took 0.4s. Estimated remaining time: 12m 27s [2025-10-22T23:21:42.803254] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:42.854684] [DEBUG] [LOCAL ] BCS: Loaded 53441 existing records from primary storage. [2025-10-22T23:21:42.854887] [INFO ] [MAIN ] BCS: Loaded 53441 primary data records. [2025-10-22T23:21:43.173806] [DEBUG] [MAIN ] BCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:43.199529] [INFO ] [MAIN ] BCS: Generated 138 derivative records from 53441 primary records. [2025-10-22T23:21:43.199669] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-10-22T23:21:43.214741] [DEBUG] [LOCAL ] BCS: Derivative data saved (1794 records). [2025-10-22T23:21:43.214826] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-10-22T23:21:43.217828] [INFO ] [MAIN ] Derivative Progress: 187/2052 symbols. BCS took 0.4s. Estimated remaining time: 12m 27s [2025-10-22T23:21:43.217927] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:43.246365] [DEBUG] [LOCAL ] BCSF: Loaded 28115 existing records from primary storage. [2025-10-22T23:21:43.246505] [INFO ] [MAIN ] BCSF: Loaded 28115 primary data records. [2025-10-22T23:21:43.579264] [DEBUG] [MAIN ] BCSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:43.604552] [INFO ] [MAIN ] BCSF: Generated 138 derivative records from 28115 primary records. [2025-10-22T23:21:43.604690] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-22T23:21:43.619506] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1794 records). [2025-10-22T23:21:43.619588] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-22T23:21:43.622403] [INFO ] [MAIN ] Derivative Progress: 188/2052 symbols. BCSF took 0.4s. Estimated remaining time: 12m 27s [2025-10-22T23:21:43.622508] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:43.644038] [DEBUG] [LOCAL ] BCX: Loaded 22044 existing records from primary storage. [2025-10-22T23:21:43.644184] [INFO ] [MAIN ] BCX: Loaded 22044 primary data records. [2025-10-22T23:21:43.953371] [DEBUG] [MAIN ] BCX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:43.978510] [INFO ] [MAIN ] BCX: Generated 138 derivative records from 22044 primary records. [2025-10-22T23:21:43.978624] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-10-22T23:21:43.993298] [DEBUG] [LOCAL ] BCX: Derivative data saved (1794 records). [2025-10-22T23:21:43.993378] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-10-22T23:21:43.996171] [INFO ] [MAIN ] Derivative Progress: 189/2052 symbols. BCX took 0.4s. Estimated remaining time: 12m 26s [2025-10-22T23:21:43.996270] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:44.020086] [DEBUG] [LOCAL ] BDC: Loaded 24000 existing records from primary storage. [2025-10-22T23:21:44.020226] [INFO ] [MAIN ] BDC: Loaded 24000 primary data records. [2025-10-22T23:21:44.324575] [DEBUG] [MAIN ] BDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:44.349382] [INFO ] [MAIN ] BDC: Generated 138 derivative records from 24000 primary records. [2025-10-22T23:21:44.349518] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-22T23:21:44.364172] [DEBUG] [LOCAL ] BDC: Derivative data saved (1794 records). [2025-10-22T23:21:44.364251] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-10-22T23:21:44.366951] [INFO ] [MAIN ] Derivative Progress: 190/2052 symbols. BDC took 0.4s. Estimated remaining time: 12m 25s [2025-10-22T23:21:44.367047] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:44.395469] [DEBUG] [LOCAL ] BDJ: Loaded 29333 existing records from primary storage. [2025-10-22T23:21:44.395623] [INFO ] [MAIN ] BDJ: Loaded 29333 primary data records. [2025-10-22T23:21:44.698148] [DEBUG] [MAIN ] BDJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:44.722895] [INFO ] [MAIN ] BDJ: Generated 138 derivative records from 29333 primary records. [2025-10-22T23:21:44.723079] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-22T23:21:44.737975] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1794 records). [2025-10-22T23:21:44.738061] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-22T23:21:44.740983] [INFO ] [MAIN ] Derivative Progress: 191/2052 symbols. BDJ took 0.4s. Estimated remaining time: 12m 25s [2025-10-22T23:21:44.741081] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:44.792881] [DEBUG] [LOCAL ] BDX: Loaded 52141 existing records from primary storage. [2025-10-22T23:21:44.793039] [INFO ] [MAIN ] BDX: Loaded 52141 primary data records. [2025-10-22T23:21:45.095993] [DEBUG] [MAIN ] BDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:45.120947] [INFO ] [MAIN ] BDX: Generated 138 derivative records from 52141 primary records. [2025-10-22T23:21:45.121063] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-22T23:21:45.136172] [DEBUG] [LOCAL ] BDX: Derivative data saved (1794 records). [2025-10-22T23:21:45.136254] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-22T23:21:45.139366] [INFO ] [MAIN ] Derivative Progress: 192/2052 symbols. BDX took 0.4s. Estimated remaining time: 12m 24s [2025-10-22T23:21:45.139464] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:45.189394] [DEBUG] [LOCAL ] BE: Loaded 53661 existing records from primary storage. [2025-10-22T23:21:45.189556] [INFO ] [MAIN ] BE: Loaded 53661 primary data records. [2025-10-22T23:21:45.515018] [DEBUG] [MAIN ] BE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:45.540044] [INFO ] [MAIN ] BE: Generated 138 derivative records from 53661 primary records. [2025-10-22T23:21:45.540158] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-10-22T23:21:45.555047] [DEBUG] [LOCAL ] BE: Derivative data saved (1794 records). [2025-10-22T23:21:45.555135] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-10-22T23:21:45.558179] [INFO ] [MAIN ] Derivative Progress: 193/2052 symbols. BE took 0.4s. Estimated remaining time: 12m 24s [2025-10-22T23:21:45.558277] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:45.610210] [DEBUG] [LOCAL ] BEKE: Loaded 53197 existing records from primary storage. [2025-10-22T23:21:45.610369] [INFO ] [MAIN ] BEKE: Loaded 53197 primary data records. [2025-10-22T23:21:45.922199] [DEBUG] [MAIN ] BEKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:45.947892] [INFO ] [MAIN ] BEKE: Generated 138 derivative records from 53197 primary records. [2025-10-22T23:21:45.948036] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-22T23:21:45.963447] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1794 records). [2025-10-22T23:21:45.963575] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-22T23:21:45.966587] [INFO ] [MAIN ] Derivative Progress: 194/2052 symbols. BEKE took 0.4s. Estimated remaining time: 12m 24s [2025-10-22T23:21:45.966710] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:46.019844] [DEBUG] [LOCAL ] BEN: Loaded 53114 existing records from primary storage. [2025-10-22T23:21:46.020009] [INFO ] [MAIN ] BEN: Loaded 53114 primary data records. [2025-10-22T23:21:46.325458] [DEBUG] [MAIN ] BEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:46.350414] [INFO ] [MAIN ] BEN: Generated 138 derivative records from 53114 primary records. [2025-10-22T23:21:46.350531] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-22T23:21:46.365451] [DEBUG] [LOCAL ] BEN: Derivative data saved (1794 records). [2025-10-22T23:21:46.365533] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-22T23:21:46.368378] [INFO ] [MAIN ] Derivative Progress: 195/2052 symbols. BEN took 0.4s. Estimated remaining time: 12m 23s [2025-10-22T23:21:46.368475] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:46.404599] [DEBUG] [LOCAL ] BEP: Loaded 38937 existing records from primary storage. [2025-10-22T23:21:46.404788] [INFO ] [MAIN ] BEP: Loaded 38937 primary data records. [2025-10-22T23:21:46.709221] [DEBUG] [MAIN ] BEP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:46.734109] [INFO ] [MAIN ] BEP: Generated 138 derivative records from 38937 primary records. [2025-10-22T23:21:46.734219] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-22T23:21:46.749847] [DEBUG] [LOCAL ] BEP: Derivative data saved (1794 records). [2025-10-22T23:21:46.749931] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-10-22T23:21:46.752579] [INFO ] [MAIN ] Derivative Progress: 196/2052 symbols. BEP took 0.4s. Estimated remaining time: 12m 23s [2025-10-22T23:21:46.752719] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:46.794534] [DEBUG] [LOCAL ] BEPC: Loaded 46357 existing records from primary storage. [2025-10-22T23:21:46.794731] [INFO ] [MAIN ] BEPC: Loaded 46357 primary data records. [2025-10-22T23:21:47.102469] [DEBUG] [MAIN ] BEPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:47.127448] [INFO ] [MAIN ] BEPC: Generated 138 derivative records from 46357 primary records. [2025-10-22T23:21:47.127614] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-10-22T23:21:47.142470] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1794 records). [2025-10-22T23:21:47.142553] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-10-22T23:21:47.145310] [INFO ] [MAIN ] Derivative Progress: 197/2052 symbols. BEPC took 0.4s. Estimated remaining time: 12m 22s [2025-10-22T23:21:47.145409] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:47.153528] [DEBUG] [LOCAL ] BEPI: Loaded 3563 existing records from primary storage. [2025-10-22T23:21:47.153637] [INFO ] [MAIN ] BEPI: Loaded 3563 primary data records. [2025-10-22T23:21:47.460631] [DEBUG] [MAIN ] BEPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:47.486033] [INFO ] [MAIN ] BEPI: Generated 138 derivative records from 3563 primary records. [2025-10-22T23:21:47.486160] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-22T23:21:47.499794] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1794 records). [2025-10-22T23:21:47.499878] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-22T23:21:47.503743] [INFO ] [MAIN ] Derivative Progress: 198/2052 symbols. BEPI took 0.4s. Estimated remaining time: 12m 22s [2025-10-22T23:21:47.503833] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:47.508229] [DEBUG] [LOCAL ] BEPJ: Loaded 3041 existing records from primary storage. [2025-10-22T23:21:47.508336] [INFO ] [MAIN ] BEPJ: Loaded 3041 primary data records. [2025-10-22T23:21:47.841821] [DEBUG] [MAIN ] BEPJ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:21:47.866804] [INFO ] [MAIN ] BEPJ: Generated 138 derivative records from 3041 primary records. [2025-10-22T23:21:47.866918] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-22T23:21:47.879927] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1793 records). [2025-10-22T23:21:47.880007] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-10-22T23:21:47.882073] [INFO ] [MAIN ] Derivative Progress: 199/2052 symbols. BEPJ took 0.4s. Estimated remaining time: 12m 21s [2025-10-22T23:21:47.882169] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:47.916607] [DEBUG] [LOCAL ] BFAM: Loaded 33784 existing records from primary storage. [2025-10-22T23:21:47.916791] [INFO ] [MAIN ] BFAM: Loaded 33784 primary data records. [2025-10-22T23:21:48.223189] [DEBUG] [MAIN ] BFAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:48.248375] [INFO ] [MAIN ] BFAM: Generated 138 derivative records from 33784 primary records. [2025-10-22T23:21:48.248486] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-22T23:21:48.263926] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1794 records). [2025-10-22T23:21:48.264007] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-10-22T23:21:48.266790] [INFO ] [MAIN ] Derivative Progress: 200/2052 symbols. BFAM took 0.4s. Estimated remaining time: 12m 20s [2025-10-22T23:21:48.266882] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:48.282585] [DEBUG] [LOCAL ] BFK: Loaded 13872 existing records from primary storage. [2025-10-22T23:21:48.282754] [INFO ] [MAIN ] BFK: Loaded 13872 primary data records. [2025-10-22T23:21:48.590004] [DEBUG] [MAIN ] BFK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:48.614824] [INFO ] [MAIN ] BFK: Generated 138 derivative records from 13872 primary records. [2025-10-22T23:21:48.614937] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-10-22T23:21:48.629964] [DEBUG] [LOCAL ] BFK: Derivative data saved (1794 records). [2025-10-22T23:21:48.630044] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-10-22T23:21:48.632683] [INFO ] [MAIN ] Derivative Progress: 201/2052 symbols. BFK took 0.4s. Estimated remaining time: 12m 20s [2025-10-22T23:21:48.632778] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:48.681108] [DEBUG] [LOCAL ] BFLY: Loaded 51865 existing records from primary storage. [2025-10-22T23:21:48.681271] [INFO ] [MAIN ] BFLY: Loaded 51865 primary data records. [2025-10-22T23:21:48.984420] [DEBUG] [MAIN ] BFLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:49.009592] [INFO ] [MAIN ] BFLY: Generated 138 derivative records from 51865 primary records. [2025-10-22T23:21:49.009732] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-22T23:21:49.024541] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1794 records). [2025-10-22T23:21:49.024623] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-10-22T23:21:49.027605] [INFO ] [MAIN ] Derivative Progress: 202/2052 symbols. BFLY took 0.4s. Estimated remaining time: 12m 19s [2025-10-22T23:21:49.027725] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:49.039331] [DEBUG] [LOCAL ] BFS: Loaded 9560 existing records from primary storage. [2025-10-22T23:21:49.039446] [INFO ] [MAIN ] BFS: Loaded 9560 primary data records. [2025-10-22T23:21:49.342616] [DEBUG] [MAIN ] BFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:49.367227] [INFO ] [MAIN ] BFS: Generated 138 derivative records from 9560 primary records. [2025-10-22T23:21:49.367359] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-10-22T23:21:49.381845] [DEBUG] [LOCAL ] BFS: Derivative data saved (1794 records). [2025-10-22T23:21:49.381925] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-10-22T23:21:49.383983] [INFO ] [MAIN ] Derivative Progress: 203/2052 symbols. BFS took 0.4s. Estimated remaining time: 12m 19s [2025-10-22T23:21:49.384062] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:49.396735] [DEBUG] [LOCAL ] BFZ: Loaded 12049 existing records from primary storage. [2025-10-22T23:21:49.396858] [INFO ] [MAIN ] BFZ: Loaded 12049 primary data records. [2025-10-22T23:21:49.718050] [DEBUG] [MAIN ] BFZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:49.743205] [INFO ] [MAIN ] BFZ: Generated 138 derivative records from 12049 primary records. [2025-10-22T23:21:49.743311] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-22T23:21:49.757707] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1794 records). [2025-10-22T23:21:49.757800] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-10-22T23:21:49.759913] [INFO ] [MAIN ] Derivative Progress: 204/2052 symbols. BFZ took 0.4s. Estimated remaining time: 12m 18s [2025-10-22T23:21:49.760004] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:49.809403] [DEBUG] [LOCAL ] BG: Loaded 50547 existing records from primary storage. [2025-10-22T23:21:49.809576] [INFO ] [MAIN ] BG: Loaded 50547 primary data records. [2025-10-22T23:21:50.115174] [DEBUG] [MAIN ] BG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:50.140732] [INFO ] [MAIN ] BG: Generated 138 derivative records from 50547 primary records. [2025-10-22T23:21:50.140839] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-22T23:21:50.155730] [DEBUG] [LOCAL ] BG: Derivative data saved (1794 records). [2025-10-22T23:21:50.155811] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-10-22T23:21:50.158762] [INFO ] [MAIN ] Derivative Progress: 205/2052 symbols. BG took 0.4s. Estimated remaining time: 12m 17s [2025-10-22T23:21:50.158864] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:50.178933] [DEBUG] [LOCAL ] BGB: Loaded 17618 existing records from primary storage. [2025-10-22T23:21:50.179077] [INFO ] [MAIN ] BGB: Loaded 17618 primary data records. [2025-10-22T23:21:50.484024] [DEBUG] [MAIN ] BGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:50.510041] [INFO ] [MAIN ] BGB: Generated 138 derivative records from 17618 primary records. [2025-10-22T23:21:50.510155] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-22T23:21:50.525229] [DEBUG] [LOCAL ] BGB: Derivative data saved (1794 records). [2025-10-22T23:21:50.525309] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-10-22T23:21:50.527924] [INFO ] [MAIN ] Derivative Progress: 206/2052 symbols. BGB took 0.4s. Estimated remaining time: 12m 17s [2025-10-22T23:21:50.528022] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:50.546694] [DEBUG] [LOCAL ] BGH: Loaded 17133 existing records from primary storage. [2025-10-22T23:21:50.546834] [INFO ] [MAIN ] BGH: Loaded 17133 primary data records. [2025-10-22T23:21:50.849952] [DEBUG] [MAIN ] BGH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:50.874798] [INFO ] [MAIN ] BGH: Generated 138 derivative records from 17133 primary records. [2025-10-22T23:21:50.874932] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-10-22T23:21:50.890118] [DEBUG] [LOCAL ] BGH: Derivative data saved (1794 records). [2025-10-22T23:21:50.890198] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-10-22T23:21:50.892233] [INFO ] [MAIN ] Derivative Progress: 207/2052 symbols. BGH took 0.4s. Estimated remaining time: 12m 16s [2025-10-22T23:21:50.892320] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:50.908069] [DEBUG] [LOCAL ] BGR: Loaded 13405 existing records from primary storage. [2025-10-22T23:21:50.908193] [INFO ] [MAIN ] BGR: Loaded 13405 primary data records. [2025-10-22T23:21:51.210384] [DEBUG] [MAIN ] BGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:51.235592] [INFO ] [MAIN ] BGR: Generated 138 derivative records from 13405 primary records. [2025-10-22T23:21:51.235787] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-22T23:21:51.251264] [DEBUG] [LOCAL ] BGR: Derivative data saved (1794 records). [2025-10-22T23:21:51.251374] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-10-22T23:21:51.253498] [INFO ] [MAIN ] Derivative Progress: 208/2052 symbols. BGR took 0.4s. Estimated remaining time: 12m 15s [2025-10-22T23:21:51.253595] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:51.300924] [DEBUG] [LOCAL ] BGS: Loaded 50530 existing records from primary storage. [2025-10-22T23:21:51.301098] [INFO ] [MAIN ] BGS: Loaded 50530 primary data records. [2025-10-22T23:21:51.631519] [DEBUG] [MAIN ] BGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:51.656881] [INFO ] [MAIN ] BGS: Generated 138 derivative records from 50530 primary records. [2025-10-22T23:21:51.657004] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-22T23:21:51.671480] [DEBUG] [LOCAL ] BGS: Derivative data saved (1794 records). [2025-10-22T23:21:51.671563] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-22T23:21:51.674796] [INFO ] [MAIN ] Derivative Progress: 209/2052 symbols. BGS took 0.4s. Estimated remaining time: 12m 15s [2025-10-22T23:21:51.674892] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:51.685886] [DEBUG] [LOCAL ] BGSF: Loaded 8227 existing records from primary storage. [2025-10-22T23:21:51.686006] [INFO ] [MAIN ] BGSF: Loaded 8227 primary data records. [2025-10-22T23:21:51.989346] [DEBUG] [MAIN ] BGSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:52.014058] [INFO ] [MAIN ] BGSF: Generated 138 derivative records from 8227 primary records. [2025-10-22T23:21:52.014248] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-22T23:21:52.027723] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1794 records). [2025-10-22T23:21:52.027815] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-10-22T23:21:52.029878] [INFO ] [MAIN ] Derivative Progress: 210/2052 symbols. BGSF took 0.4s. Estimated remaining time: 12m 14s [2025-10-22T23:21:52.029981] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:52.047144] [DEBUG] [LOCAL ] BGT: Loaded 16184 existing records from primary storage. [2025-10-22T23:21:52.047320] [INFO ] [MAIN ] BGT: Loaded 16184 primary data records. [2025-10-22T23:21:52.350336] [DEBUG] [MAIN ] BGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:52.376691] [INFO ] [MAIN ] BGT: Generated 138 derivative records from 16184 primary records. [2025-10-22T23:21:52.376877] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-22T23:21:52.392758] [DEBUG] [LOCAL ] BGT: Derivative data saved (1794 records). [2025-10-22T23:21:52.392905] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-22T23:21:52.395097] [INFO ] [MAIN ] Derivative Progress: 211/2052 symbols. BGT took 0.4s. Estimated remaining time: 12m 14s [2025-10-22T23:21:52.395200] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:52.409169] [DEBUG] [LOCAL ] BGX: Loaded 11188 existing records from primary storage. [2025-10-22T23:21:52.409327] [INFO ] [MAIN ] BGX: Loaded 11188 primary data records. [2025-10-22T23:21:52.710986] [DEBUG] [MAIN ] BGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:52.735677] [INFO ] [MAIN ] BGX: Generated 138 derivative records from 11188 primary records. [2025-10-22T23:21:52.735804] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-22T23:21:52.750238] [DEBUG] [LOCAL ] BGX: Derivative data saved (1794 records). [2025-10-22T23:21:52.750317] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-22T23:21:52.752458] [INFO ] [MAIN ] Derivative Progress: 212/2052 symbols. BGX took 0.4s. Estimated remaining time: 12m 13s [2025-10-22T23:21:52.752548] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:52.773629] [DEBUG] [LOCAL ] BGY: Loaded 21389 existing records from primary storage. [2025-10-22T23:21:52.773803] [INFO ] [MAIN ] BGY: Loaded 21389 primary data records. [2025-10-22T23:21:53.076101] [DEBUG] [MAIN ] BGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:53.100912] [INFO ] [MAIN ] BGY: Generated 138 derivative records from 21389 primary records. [2025-10-22T23:21:53.101014] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-22T23:21:53.115304] [DEBUG] [LOCAL ] BGY: Derivative data saved (1794 records). [2025-10-22T23:21:53.115385] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-22T23:21:53.118186] [INFO ] [MAIN ] Derivative Progress: 213/2052 symbols. BGY took 0.4s. Estimated remaining time: 12m 12s [2025-10-22T23:21:53.118281] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:53.161024] [DEBUG] [LOCAL ] BHC: Loaded 46589 existing records from primary storage. [2025-10-22T23:21:53.161189] [INFO ] [MAIN ] BHC: Loaded 46589 primary data records. [2025-10-22T23:21:53.498550] [DEBUG] [MAIN ] BHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:53.524000] [INFO ] [MAIN ] BHC: Generated 138 derivative records from 46589 primary records. [2025-10-22T23:21:53.524107] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-22T23:21:53.538548] [DEBUG] [LOCAL ] BHC: Derivative data saved (1794 records). [2025-10-22T23:21:53.538628] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-22T23:21:53.541683] [INFO ] [MAIN ] Derivative Progress: 214/2052 symbols. BHC took 0.4s. Estimated remaining time: 12m 12s [2025-10-22T23:21:53.541777] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:53.565584] [DEBUG] [LOCAL ] BHE: Loaded 23698 existing records from primary storage. [2025-10-22T23:21:53.565756] [INFO ] [MAIN ] BHE: Loaded 23698 primary data records. [2025-10-22T23:21:53.876312] [DEBUG] [MAIN ] BHE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:53.901392] [INFO ] [MAIN ] BHE: Generated 138 derivative records from 23698 primary records. [2025-10-22T23:21:53.901509] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-22T23:21:53.916063] [DEBUG] [LOCAL ] BHE: Derivative data saved (1794 records). [2025-10-22T23:21:53.916146] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-22T23:21:53.918872] [INFO ] [MAIN ] Derivative Progress: 215/2052 symbols. BHE took 0.4s. Estimated remaining time: 12m 11s [2025-10-22T23:21:53.918962] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:53.942418] [DEBUG] [LOCAL ] BHK: Loaded 23957 existing records from primary storage. [2025-10-22T23:21:53.942574] [INFO ] [MAIN ] BHK: Loaded 23957 primary data records. [2025-10-22T23:21:54.255510] [DEBUG] [MAIN ] BHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:54.280433] [INFO ] [MAIN ] BHK: Generated 138 derivative records from 23957 primary records. [2025-10-22T23:21:54.280559] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-10-22T23:21:54.295109] [DEBUG] [LOCAL ] BHK: Derivative data saved (1794 records). [2025-10-22T23:21:54.295196] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-10-22T23:21:54.297909] [INFO ] [MAIN ] Derivative Progress: 216/2052 symbols. BHK took 0.4s. Estimated remaining time: 12m 11s [2025-10-22T23:21:54.298005] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:54.320237] [DEBUG] [LOCAL ] BHR: Loaded 21979 existing records from primary storage. [2025-10-22T23:21:54.320387] [INFO ] [MAIN ] BHR: Loaded 21979 primary data records. [2025-10-22T23:21:54.629508] [DEBUG] [MAIN ] BHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:54.655205] [INFO ] [MAIN ] BHR: Generated 138 derivative records from 21979 primary records. [2025-10-22T23:21:54.655331] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-22T23:21:54.669878] [DEBUG] [LOCAL ] BHR: Derivative data saved (1794 records). [2025-10-22T23:21:54.669962] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-10-22T23:21:54.672722] [INFO ] [MAIN ] Derivative Progress: 217/2052 symbols. BHR took 0.4s. Estimated remaining time: 12m 10s [2025-10-22T23:21:54.672815] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:54.721300] [DEBUG] [LOCAL ] BHVN: Loaded 50633 existing records from primary storage. [2025-10-22T23:21:54.721471] [INFO ] [MAIN ] BHVN: Loaded 50633 primary data records. [2025-10-22T23:21:55.024898] [DEBUG] [MAIN ] BHVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:55.049895] [INFO ] [MAIN ] BHVN: Generated 138 derivative records from 50633 primary records. [2025-10-22T23:21:55.050033] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-22T23:21:55.065178] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1794 records). [2025-10-22T23:21:55.065268] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-22T23:21:55.068291] [INFO ] [MAIN ] Derivative Progress: 218/2052 symbols. BHVN took 0.4s. Estimated remaining time: 12m 10s [2025-10-22T23:21:55.068389] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:55.116848] [DEBUG] [LOCAL ] BILL: Loaded 52500 existing records from primary storage. [2025-10-22T23:21:55.117015] [INFO ] [MAIN ] BILL: Loaded 52500 primary data records. [2025-10-22T23:21:55.419412] [DEBUG] [MAIN ] BILL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:55.444379] [INFO ] [MAIN ] BILL: Generated 138 derivative records from 52500 primary records. [2025-10-22T23:21:55.444550] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-22T23:21:55.459823] [DEBUG] [LOCAL ] BILL: Derivative data saved (1794 records). [2025-10-22T23:21:55.460103] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-22T23:21:55.463219] [INFO ] [MAIN ] Derivative Progress: 219/2052 symbols. BILL took 0.4s. Estimated remaining time: 12m 9s [2025-10-22T23:21:55.463313] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:55.488605] [DEBUG] [LOCAL ] BIO: Loaded 23819 existing records from primary storage. [2025-10-22T23:21:55.488789] [INFO ] [MAIN ] BIO: Loaded 23819 primary data records. [2025-10-22T23:21:55.815137] [DEBUG] [MAIN ] BIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:55.839986] [INFO ] [MAIN ] BIO: Generated 138 derivative records from 23819 primary records. [2025-10-22T23:21:55.840128] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-10-22T23:21:55.858620] [DEBUG] [LOCAL ] BIO: Derivative data saved (1794 records). [2025-10-22T23:21:55.858751] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-10-22T23:21:55.861389] [INFO ] [MAIN ] Derivative Progress: 220/2052 symbols. BIO took 0.4s. Estimated remaining time: 12m 9s [2025-10-22T23:21:55.861481] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:55.899112] [DEBUG] [LOCAL ] BIP: Loaded 38919 existing records from primary storage. [2025-10-22T23:21:55.899277] [INFO ] [MAIN ] BIP: Loaded 38919 primary data records. [2025-10-22T23:21:56.216411] [DEBUG] [MAIN ] BIP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:56.246790] [INFO ] [MAIN ] BIP: Generated 138 derivative records from 38919 primary records. [2025-10-22T23:21:56.246957] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-22T23:21:56.263715] [DEBUG] [LOCAL ] BIP: Derivative data saved (1794 records). [2025-10-22T23:21:56.263803] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-22T23:21:56.266874] [INFO ] [MAIN ] Derivative Progress: 221/2052 symbols. BIP took 0.4s. Estimated remaining time: 12m 9s [2025-10-22T23:21:56.266984] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:56.308303] [DEBUG] [LOCAL ] BIPC: Loaded 41113 existing records from primary storage. [2025-10-22T23:21:56.308475] [INFO ] [MAIN ] BIPC: Loaded 41113 primary data records. [2025-10-22T23:21:56.659747] [DEBUG] [MAIN ] BIPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:56.687926] [INFO ] [MAIN ] BIPC: Generated 138 derivative records from 41113 primary records. [2025-10-22T23:21:56.688071] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-10-22T23:21:56.705741] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1794 records). [2025-10-22T23:21:56.705828] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-10-22T23:21:56.709070] [INFO ] [MAIN ] Derivative Progress: 222/2052 symbols. BIPC took 0.4s. Estimated remaining time: 12m 9s [2025-10-22T23:21:56.709168] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:56.713831] [DEBUG] [LOCAL ] BIPH: Loaded 2352 existing records from primary storage. [2025-10-22T23:21:56.713930] [INFO ] [MAIN ] BIPH: Loaded 2352 primary data records. [2025-10-22T23:21:57.065794] [DEBUG] [MAIN ] BIPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:57.096549] [INFO ] [MAIN ] BIPH: Generated 138 derivative records from 2352 primary records. [2025-10-22T23:21:57.096791] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-22T23:21:57.112176] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1794 records). [2025-10-22T23:21:57.112260] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-22T23:21:57.114491] [INFO ] [MAIN ] Derivative Progress: 223/2052 symbols. BIPH took 0.4s. Estimated remaining time: 12m 8s [2025-10-22T23:21:57.114587] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:57.119217] [DEBUG] [LOCAL ] BIPI: Loaded 2816 existing records from primary storage. [2025-10-22T23:21:57.119307] [INFO ] [MAIN ] BIPI: Loaded 2816 primary data records. [2025-10-22T23:21:57.452449] [DEBUG] [MAIN ] BIPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:57.478960] [INFO ] [MAIN ] BIPI: Generated 138 derivative records from 2816 primary records. [2025-10-22T23:21:57.479105] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-22T23:21:57.493677] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1794 records). [2025-10-22T23:21:57.493760] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-22T23:21:57.496213] [INFO ] [MAIN ] Derivative Progress: 224/2052 symbols. BIPI took 0.4s. Estimated remaining time: 12m 8s [2025-10-22T23:21:57.496305] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:57.501226] [DEBUG] [LOCAL ] BIPJ: Loaded 3106 existing records from primary storage. [2025-10-22T23:21:57.501316] [INFO ] [MAIN ] BIPJ: Loaded 3106 primary data records. [2025-10-22T23:21:57.847199] [DEBUG] [MAIN ] BIPJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:57.875134] [INFO ] [MAIN ] BIPJ: Generated 138 derivative records from 3106 primary records. [2025-10-22T23:21:57.875311] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-22T23:21:57.889668] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1794 records). [2025-10-22T23:21:57.889768] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-22T23:21:57.892147] [INFO ] [MAIN ] Derivative Progress: 225/2052 symbols. BIPJ took 0.4s. Estimated remaining time: 12m 7s [2025-10-22T23:21:57.892236] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:57.946731] [DEBUG] [LOCAL ] BIRK: Loaded 51188 existing records from primary storage. [2025-10-22T23:21:57.946903] [INFO ] [MAIN ] BIRK: Loaded 51188 primary data records. [2025-10-22T23:21:58.277618] [DEBUG] [MAIN ] BIRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:58.303318] [INFO ] [MAIN ] BIRK: Generated 138 derivative records from 51188 primary records. [2025-10-22T23:21:58.303450] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-22T23:21:58.318325] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1794 records). [2025-10-22T23:21:58.318415] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-22T23:21:58.321376] [INFO ] [MAIN ] Derivative Progress: 226/2052 symbols. BIRK took 0.4s. Estimated remaining time: 12m 7s [2025-10-22T23:21:58.321469] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:58.344977] [DEBUG] [LOCAL ] BIT: Loaded 23774 existing records from primary storage. [2025-10-22T23:21:58.345126] [INFO ] [MAIN ] BIT: Loaded 23774 primary data records. [2025-10-22T23:21:58.653139] [DEBUG] [MAIN ] BIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:58.677829] [INFO ] [MAIN ] BIT: Generated 138 derivative records from 23774 primary records. [2025-10-22T23:21:58.677953] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-22T23:21:58.692730] [DEBUG] [LOCAL ] BIT: Derivative data saved (1794 records). [2025-10-22T23:21:58.692817] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-22T23:21:58.695466] [INFO ] [MAIN ] Derivative Progress: 227/2052 symbols. BIT took 0.4s. Estimated remaining time: 12m 7s [2025-10-22T23:21:58.695565] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:58.744680] [DEBUG] [LOCAL ] BJ: Loaded 51505 existing records from primary storage. [2025-10-22T23:21:58.744848] [INFO ] [MAIN ] BJ: Loaded 51505 primary data records. [2025-10-22T23:21:59.050961] [DEBUG] [MAIN ] BJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:59.075672] [INFO ] [MAIN ] BJ: Generated 138 derivative records from 51505 primary records. [2025-10-22T23:21:59.075822] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-22T23:21:59.090758] [DEBUG] [LOCAL ] BJ: Derivative data saved (1794 records). [2025-10-22T23:21:59.090841] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-22T23:21:59.093761] [INFO ] [MAIN ] Derivative Progress: 228/2052 symbols. BJ took 0.4s. Estimated remaining time: 12m 6s [2025-10-22T23:21:59.093856] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:59.145676] [DEBUG] [LOCAL ] BK: Loaded 53546 existing records from primary storage. [2025-10-22T23:21:59.145855] [INFO ] [MAIN ] BK: Loaded 53546 primary data records. [2025-10-22T23:21:59.445397] [DEBUG] [MAIN ] BK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:59.470631] [INFO ] [MAIN ] BK: Generated 138 derivative records from 53546 primary records. [2025-10-22T23:21:59.470836] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-22T23:21:59.485686] [DEBUG] [LOCAL ] BK: Derivative data saved (1794 records). [2025-10-22T23:21:59.485790] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-22T23:21:59.488581] [INFO ] [MAIN ] Derivative Progress: 229/2052 symbols. BK took 0.4s. Estimated remaining time: 12m 6s [2025-10-22T23:21:59.488717] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:59.533596] [DEBUG] [LOCAL ] BKD: Loaded 50408 existing records from primary storage. [2025-10-22T23:21:59.533807] [INFO ] [MAIN ] BKD: Loaded 50408 primary data records. [2025-10-22T23:21:59.904962] [DEBUG] [MAIN ] BKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:21:59.930029] [INFO ] [MAIN ] BKD: Generated 138 derivative records from 50408 primary records. [2025-10-22T23:21:59.930135] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-22T23:21:59.944542] [DEBUG] [LOCAL ] BKD: Derivative data saved (1794 records). [2025-10-22T23:21:59.944625] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-22T23:21:59.947584] [INFO ] [MAIN ] Derivative Progress: 230/2052 symbols. BKD took 0.5s. Estimated remaining time: 12m 6s [2025-10-22T23:21:59.947707] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:21:59.983871] [DEBUG] [LOCAL ] BKKT: Loaded 37391 existing records from primary storage. [2025-10-22T23:21:59.984033] [INFO ] [MAIN ] BKKT: Loaded 37391 primary data records. [2025-10-22T23:22:00.300443] [DEBUG] [MAIN ] BKKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:00.325255] [INFO ] [MAIN ] BKKT: Generated 138 derivative records from 37391 primary records. [2025-10-22T23:22:00.325359] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-22T23:22:00.340588] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1794 records). [2025-10-22T23:22:00.340691] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-22T23:22:00.343411] [INFO ] [MAIN ] Derivative Progress: 231/2052 symbols. BKKT took 0.4s. Estimated remaining time: 12m 6s [2025-10-22T23:22:00.343509] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:00.353966] [DEBUG] [LOCAL ] BKN: Loaded 7279 existing records from primary storage. [2025-10-22T23:22:00.354088] [INFO ] [MAIN ] BKN: Loaded 7279 primary data records. [2025-10-22T23:22:00.659824] [DEBUG] [MAIN ] BKN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:00.685311] [INFO ] [MAIN ] BKN: Generated 138 derivative records from 7279 primary records. [2025-10-22T23:22:00.685417] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-22T23:22:00.699528] [DEBUG] [LOCAL ] BKN: Derivative data saved (1794 records). [2025-10-22T23:22:00.699610] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-22T23:22:00.701735] [INFO ] [MAIN ] Derivative Progress: 232/2052 symbols. BKN took 0.4s. Estimated remaining time: 12m 5s [2025-10-22T23:22:00.701830] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:00.748918] [DEBUG] [LOCAL ] BKSY: Loaded 48912 existing records from primary storage. [2025-10-22T23:22:00.749088] [INFO ] [MAIN ] BKSY: Loaded 48912 primary data records. [2025-10-22T23:22:01.050825] [DEBUG] [MAIN ] BKSY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:01.076083] [INFO ] [MAIN ] BKSY: Generated 138 derivative records from 48912 primary records. [2025-10-22T23:22:01.076199] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-22T23:22:01.091761] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1794 records). [2025-10-22T23:22:01.091872] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-22T23:22:01.094754] [INFO ] [MAIN ] Derivative Progress: 233/2052 symbols. BKSY took 0.4s. Estimated remaining time: 12m 4s [2025-10-22T23:22:01.094850] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:01.111108] [DEBUG] [LOCAL ] BKT: Loaded 12833 existing records from primary storage. [2025-10-22T23:22:01.111234] [INFO ] [MAIN ] BKT: Loaded 12833 primary data records. [2025-10-22T23:22:01.421079] [DEBUG] [MAIN ] BKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:01.447414] [INFO ] [MAIN ] BKT: Generated 138 derivative records from 12833 primary records. [2025-10-22T23:22:01.447525] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-22T23:22:01.462412] [DEBUG] [LOCAL ] BKT: Derivative data saved (1794 records). [2025-10-22T23:22:01.462500] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-22T23:22:01.465149] [INFO ] [MAIN ] Derivative Progress: 234/2052 symbols. BKT took 0.4s. Estimated remaining time: 12m 4s [2025-10-22T23:22:01.465265] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:01.504244] [DEBUG] [LOCAL ] BKU: Loaded 42169 existing records from primary storage. [2025-10-22T23:22:01.504407] [INFO ] [MAIN ] BKU: Loaded 42169 primary data records. [2025-10-22T23:22:01.830806] [DEBUG] [MAIN ] BKU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:01.856258] [INFO ] [MAIN ] BKU: Generated 138 derivative records from 42169 primary records. [2025-10-22T23:22:01.856382] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-22T23:22:01.871700] [DEBUG] [LOCAL ] BKU: Derivative data saved (1794 records). [2025-10-22T23:22:01.871783] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-22T23:22:01.874878] [INFO ] [MAIN ] Derivative Progress: 235/2052 symbols. BKU took 0.4s. Estimated remaining time: 12m 3s [2025-10-22T23:22:01.875173] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:01.904224] [DEBUG] [LOCAL ] BKV: Loaded 29342 existing records from primary storage. [2025-10-22T23:22:01.904385] [INFO ] [MAIN ] BKV: Loaded 29342 primary data records. [2025-10-22T23:22:02.242605] [DEBUG] [MAIN ] BKV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:02.268184] [INFO ] [MAIN ] BKV: Generated 138 derivative records from 29342 primary records. [2025-10-22T23:22:02.268331] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-22T23:22:02.284560] [DEBUG] [LOCAL ] BKV: Derivative data saved (1794 records). [2025-10-22T23:22:02.284675] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-10-22T23:22:02.287558] [INFO ] [MAIN ] Derivative Progress: 236/2052 symbols. BKV took 0.4s. Estimated remaining time: 12m 3s [2025-10-22T23:22:02.287702] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:02.323922] [DEBUG] [LOCAL ] BLCO: Loaded 34928 existing records from primary storage. [2025-10-22T23:22:02.324091] [INFO ] [MAIN ] BLCO: Loaded 34928 primary data records. [2025-10-22T23:22:02.676517] [DEBUG] [MAIN ] BLCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:02.703428] [INFO ] [MAIN ] BLCO: Generated 138 derivative records from 34928 primary records. [2025-10-22T23:22:02.703681] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-22T23:22:02.720143] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1794 records). [2025-10-22T23:22:02.720345] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-22T23:22:02.723517] [INFO ] [MAIN ] Derivative Progress: 237/2052 symbols. BLCO took 0.4s. Estimated remaining time: 12m 3s [2025-10-22T23:22:02.723762] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:02.754353] [DEBUG] [LOCAL ] BLD: Loaded 27046 existing records from primary storage. [2025-10-22T23:22:02.754544] [INFO ] [MAIN ] BLD: Loaded 27046 primary data records. [2025-10-22T23:22:03.246058] [DEBUG] [MAIN ] BLD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:22:03.285995] [INFO ] [MAIN ] BLD: Generated 138 derivative records from 27046 primary records. [2025-10-22T23:22:03.286225] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-10-22T23:22:03.308203] [DEBUG] [LOCAL ] BLD: Derivative data saved (1793 records). [2025-10-22T23:22:03.308407] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-10-22T23:22:03.312020] [INFO ] [MAIN ] Derivative Progress: 238/2052 symbols. BLD took 0.6s. Estimated remaining time: 12m 4s [2025-10-22T23:22:03.312250] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:03.387924] [DEBUG] [LOCAL ] BLDR: Loaded 51855 existing records from primary storage. [2025-10-22T23:22:03.388142] [INFO ] [MAIN ] BLDR: Loaded 51855 primary data records. [2025-10-22T23:22:03.744402] [DEBUG] [MAIN ] BLDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:03.772240] [INFO ] [MAIN ] BLDR: Generated 138 derivative records from 51855 primary records. [2025-10-22T23:22:03.772418] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-22T23:22:03.789094] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1794 records). [2025-10-22T23:22:03.789212] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-22T23:22:03.792950] [INFO ] [MAIN ] Derivative Progress: 239/2052 symbols. BLDR took 0.5s. Estimated remaining time: 12m 4s [2025-10-22T23:22:03.793089] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:03.811416] [DEBUG] [LOCAL ] BLE: Loaded 13616 existing records from primary storage. [2025-10-22T23:22:03.811578] [INFO ] [MAIN ] BLE: Loaded 13616 primary data records. [2025-10-22T23:22:04.162635] [DEBUG] [MAIN ] BLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:04.192296] [INFO ] [MAIN ] BLE: Generated 138 derivative records from 13616 primary records. [2025-10-22T23:22:04.192498] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-22T23:22:04.210379] [DEBUG] [LOCAL ] BLE: Derivative data saved (1794 records). [2025-10-22T23:22:04.210549] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-22T23:22:04.213364] [INFO ] [MAIN ] Derivative Progress: 240/2052 symbols. BLE took 0.4s. Estimated remaining time: 12m 4s [2025-10-22T23:22:04.213488] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:04.251129] [DEBUG] [LOCAL ] BLK: Loaded 34184 existing records from primary storage. [2025-10-22T23:22:04.251312] [INFO ] [MAIN ] BLK: Loaded 34184 primary data records. [2025-10-22T23:22:04.613515] [DEBUG] [MAIN ] BLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:04.642546] [INFO ] [MAIN ] BLK: Generated 138 derivative records from 34184 primary records. [2025-10-22T23:22:04.642718] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-22T23:22:04.658979] [DEBUG] [LOCAL ] BLK: Derivative data saved (1794 records). [2025-10-22T23:22:04.659071] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-22T23:22:04.662320] [INFO ] [MAIN ] Derivative Progress: 241/2052 symbols. BLK took 0.4s. Estimated remaining time: 12m 4s [2025-10-22T23:22:04.662426] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:04.709252] [DEBUG] [LOCAL ] BLND: Loaded 49215 existing records from primary storage. [2025-10-22T23:22:04.709424] [INFO ] [MAIN ] BLND: Loaded 49215 primary data records. [2025-10-22T23:22:05.036823] [DEBUG] [MAIN ] BLND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:05.061592] [INFO ] [MAIN ] BLND: Generated 138 derivative records from 49215 primary records. [2025-10-22T23:22:05.061715] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-22T23:22:05.076565] [DEBUG] [LOCAL ] BLND: Derivative data saved (1794 records). [2025-10-22T23:22:05.076673] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-22T23:22:05.079632] [INFO ] [MAIN ] Derivative Progress: 242/2052 symbols. BLND took 0.4s. Estimated remaining time: 12m 4s [2025-10-22T23:22:05.079762] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:05.097304] [DEBUG] [LOCAL ] BLX: Loaded 15410 existing records from primary storage. [2025-10-22T23:22:05.097490] [INFO ] [MAIN ] BLX: Loaded 15410 primary data records. [2025-10-22T23:22:05.403841] [DEBUG] [MAIN ] BLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:05.428775] [INFO ] [MAIN ] BLX: Generated 138 derivative records from 15410 primary records. [2025-10-22T23:22:05.428886] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-22T23:22:05.444052] [DEBUG] [LOCAL ] BLX: Derivative data saved (1794 records). [2025-10-22T23:22:05.444136] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-22T23:22:05.446222] [INFO ] [MAIN ] Derivative Progress: 243/2052 symbols. BLX took 0.4s. Estimated remaining time: 12m 3s [2025-10-22T23:22:05.446310] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:05.480930] [DEBUG] [LOCAL ] BMA: Loaded 36532 existing records from primary storage. [2025-10-22T23:22:05.481093] [INFO ] [MAIN ] BMA: Loaded 36532 primary data records. [2025-10-22T23:22:05.790425] [DEBUG] [MAIN ] BMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:05.815316] [INFO ] [MAIN ] BMA: Generated 138 derivative records from 36532 primary records. [2025-10-22T23:22:05.815467] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-22T23:22:05.830659] [DEBUG] [LOCAL ] BMA: Derivative data saved (1794 records). [2025-10-22T23:22:05.830744] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-22T23:22:05.833703] [INFO ] [MAIN ] Derivative Progress: 244/2052 symbols. BMA took 0.4s. Estimated remaining time: 12m 3s [2025-10-22T23:22:05.833798] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:05.846992] [DEBUG] [LOCAL ] BME: Loaded 11221 existing records from primary storage. [2025-10-22T23:22:05.847112] [INFO ] [MAIN ] BME: Loaded 11221 primary data records. [2025-10-22T23:22:06.161030] [DEBUG] [MAIN ] BME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:06.186010] [INFO ] [MAIN ] BME: Generated 138 derivative records from 11221 primary records. [2025-10-22T23:22:06.186162] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-22T23:22:06.201214] [DEBUG] [LOCAL ] BME: Derivative data saved (1794 records). [2025-10-22T23:22:06.201295] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-22T23:22:06.203409] [INFO ] [MAIN ] Derivative Progress: 245/2052 symbols. BME took 0.4s. Estimated remaining time: 12m 2s [2025-10-22T23:22:06.203496] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:06.227770] [DEBUG] [LOCAL ] BMEZ: Loaded 25062 existing records from primary storage. [2025-10-22T23:22:06.227922] [INFO ] [MAIN ] BMEZ: Loaded 25062 primary data records. [2025-10-22T23:22:06.559049] [DEBUG] [MAIN ] BMEZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:06.584636] [INFO ] [MAIN ] BMEZ: Generated 138 derivative records from 25062 primary records. [2025-10-22T23:22:06.584784] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-10-22T23:22:06.600017] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1794 records). [2025-10-22T23:22:06.600093] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-10-22T23:22:06.603425] [INFO ] [MAIN ] Derivative Progress: 246/2052 symbols. BMEZ took 0.4s. Estimated remaining time: 12m 2s [2025-10-22T23:22:06.603534] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:06.630071] [DEBUG] [LOCAL ] BMI: Loaded 24901 existing records from primary storage. [2025-10-22T23:22:06.630229] [INFO ] [MAIN ] BMI: Loaded 24901 primary data records. [2025-10-22T23:22:06.940724] [DEBUG] [MAIN ] BMI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:22:06.966007] [INFO ] [MAIN ] BMI: Generated 138 derivative records from 24901 primary records. [2025-10-22T23:22:06.966121] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-22T23:22:06.981126] [DEBUG] [LOCAL ] BMI: Derivative data saved (1793 records). [2025-10-22T23:22:06.981210] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-22T23:22:06.984137] [INFO ] [MAIN ] Derivative Progress: 247/2052 symbols. BMI took 0.4s. Estimated remaining time: 12m 1s [2025-10-22T23:22:06.984244] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:06.988719] [DEBUG] [LOCAL ] BMN: Loaded 2644 existing records from primary storage. [2025-10-22T23:22:06.988808] [INFO ] [MAIN ] BMN: Loaded 2644 primary data records. [2025-10-22T23:22:07.297976] [DEBUG] [MAIN ] BMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:07.322848] [INFO ] [MAIN ] BMN: Generated 138 derivative records from 2644 primary records. [2025-10-22T23:22:07.322971] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-22T23:22:07.335791] [DEBUG] [LOCAL ] BMN: Derivative data saved (1794 records). [2025-10-22T23:22:07.335878] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-10-22T23:22:07.338094] [INFO ] [MAIN ] Derivative Progress: 248/2052 symbols. BMN took 0.4s. Estimated remaining time: 12m 0s [2025-10-22T23:22:07.338181] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:07.377139] [DEBUG] [LOCAL ] BMO: Loaded 40992 existing records from primary storage. [2025-10-22T23:22:07.377329] [INFO ] [MAIN ] BMO: Loaded 40992 primary data records. [2025-10-22T23:22:07.692251] [DEBUG] [MAIN ] BMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:07.718631] [INFO ] [MAIN ] BMO: Generated 138 derivative records from 40992 primary records. [2025-10-22T23:22:07.718890] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-22T23:22:07.734852] [DEBUG] [LOCAL ] BMO: Derivative data saved (1794 records). [2025-10-22T23:22:07.734938] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-22T23:22:07.738441] [INFO ] [MAIN ] Derivative Progress: 249/2052 symbols. BMO took 0.4s. Estimated remaining time: 11m 60s [2025-10-22T23:22:07.738548] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:07.788725] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-22T23:22:07.788884] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-10-22T23:22:08.097237] [DEBUG] [MAIN ] BMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:08.122169] [INFO ] [MAIN ] BMY: Generated 138 derivative records from 53757 primary records. [2025-10-22T23:22:08.122309] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-22T23:22:08.137187] [DEBUG] [LOCAL ] BMY: Derivative data saved (1794 records). [2025-10-22T23:22:08.137303] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-10-22T23:22:08.140308] [INFO ] [MAIN ] Derivative Progress: 250/2052 symbols. BMY took 0.4s. Estimated remaining time: 11m 60s [2025-10-22T23:22:08.140415] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:08.191353] [DEBUG] [LOCAL ] BN: Loaded 52983 existing records from primary storage. [2025-10-22T23:22:08.191515] [INFO ] [MAIN ] BN: Loaded 52983 primary data records. [2025-10-22T23:22:08.539722] [DEBUG] [MAIN ] BN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:08.565310] [INFO ] [MAIN ] BN: Generated 138 derivative records from 52983 primary records. [2025-10-22T23:22:08.565495] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-22T23:22:08.580678] [DEBUG] [LOCAL ] BN: Derivative data saved (1794 records). [2025-10-22T23:22:08.580826] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-10-22T23:22:08.583870] [INFO ] [MAIN ] Derivative Progress: 251/2052 symbols. BN took 0.4s. Estimated remaining time: 11m 59s [2025-10-22T23:22:08.583969] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:08.613072] [DEBUG] [LOCAL ] BNED: Loaded 28217 existing records from primary storage. [2025-10-22T23:22:08.613432] [INFO ] [MAIN ] BNED: Loaded 28217 primary data records. [2025-10-22T23:22:08.934485] [DEBUG] [MAIN ] BNED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:08.960742] [INFO ] [MAIN ] BNED: Generated 138 derivative records from 28217 primary records. [2025-10-22T23:22:08.960905] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-22T23:22:08.975666] [DEBUG] [LOCAL ] BNED: Derivative data saved (1794 records). [2025-10-22T23:22:08.975806] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-22T23:22:08.979052] [INFO ] [MAIN ] Derivative Progress: 252/2052 symbols. BNED took 0.4s. Estimated remaining time: 11m 59s [2025-10-22T23:22:08.979219] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:08.987534] [DEBUG] [LOCAL ] BNH: Loaded 4701 existing records from primary storage. [2025-10-22T23:22:08.987730] [INFO ] [MAIN ] BNH: Loaded 4701 primary data records. [2025-10-22T23:22:09.303570] [DEBUG] [MAIN ] BNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:09.329506] [INFO ] [MAIN ] BNH: Generated 138 derivative records from 4701 primary records. [2025-10-22T23:22:09.329631] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-22T23:22:09.343532] [DEBUG] [LOCAL ] BNH: Derivative data saved (1794 records). [2025-10-22T23:22:09.343623] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-22T23:22:09.345910] [INFO ] [MAIN ] Derivative Progress: 253/2052 symbols. BNH took 0.4s. Estimated remaining time: 11m 58s [2025-10-22T23:22:09.346004] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:09.349984] [DEBUG] [LOCAL ] BNJ: Loaded 2500 existing records from primary storage. [2025-10-22T23:22:09.350072] [INFO ] [MAIN ] BNJ: Loaded 2500 primary data records. [2025-10-22T23:22:09.668867] [DEBUG] [MAIN ] BNJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:09.695708] [INFO ] [MAIN ] BNJ: Generated 138 derivative records from 2500 primary records. [2025-10-22T23:22:09.695887] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-22T23:22:09.709962] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1794 records). [2025-10-22T23:22:09.710071] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-22T23:22:09.712357] [INFO ] [MAIN ] Derivative Progress: 254/2052 symbols. BNJ took 0.4s. Estimated remaining time: 11m 58s [2025-10-22T23:22:09.712463] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:09.759867] [DEBUG] [LOCAL ] BNL: Loaded 47073 existing records from primary storage. [2025-10-22T23:22:09.760045] [INFO ] [MAIN ] BNL: Loaded 47073 primary data records. [2025-10-22T23:22:10.103549] [DEBUG] [MAIN ] BNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:10.130853] [INFO ] [MAIN ] BNL: Generated 138 derivative records from 47073 primary records. [2025-10-22T23:22:10.131034] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-22T23:22:10.146265] [DEBUG] [LOCAL ] BNL: Derivative data saved (1794 records). [2025-10-22T23:22:10.146362] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-22T23:22:10.149457] [INFO ] [MAIN ] Derivative Progress: 255/2052 symbols. BNL took 0.4s. Estimated remaining time: 11m 58s [2025-10-22T23:22:10.149561] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:10.201440] [DEBUG] [LOCAL ] BNS: Loaded 51416 existing records from primary storage. [2025-10-22T23:22:10.201624] [INFO ] [MAIN ] BNS: Loaded 51416 primary data records. [2025-10-22T23:22:10.544950] [DEBUG] [MAIN ] BNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:10.573963] [INFO ] [MAIN ] BNS: Generated 138 derivative records from 51416 primary records. [2025-10-22T23:22:10.574152] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-22T23:22:10.590469] [DEBUG] [LOCAL ] BNS: Derivative data saved (1794 records). [2025-10-22T23:22:10.590567] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-22T23:22:10.594597] [INFO ] [MAIN ] Derivative Progress: 256/2052 symbols. BNS took 0.4s. Estimated remaining time: 11m 58s [2025-10-22T23:22:10.594746] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:10.602390] [DEBUG] [LOCAL ] BNT: Loaded 3527 existing records from primary storage. [2025-10-22T23:22:10.602531] [INFO ] [MAIN ] BNT: Loaded 3527 primary data records. [2025-10-22T23:22:10.950792] [DEBUG] [MAIN ] BNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:10.977941] [INFO ] [MAIN ] BNT: Generated 138 derivative records from 3527 primary records. [2025-10-22T23:22:10.978108] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-22T23:22:10.992591] [DEBUG] [LOCAL ] BNT: Derivative data saved (1794 records). [2025-10-22T23:22:10.992723] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-22T23:22:10.995363] [INFO ] [MAIN ] Derivative Progress: 257/2052 symbols. BNT took 0.4s. Estimated remaining time: 11m 57s [2025-10-22T23:22:10.995488] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:11.005901] [DEBUG] [LOCAL ] BNY: Loaded 7253 existing records from primary storage. [2025-10-22T23:22:11.006083] [INFO ] [MAIN ] BNY: Loaded 7253 primary data records. [2025-10-22T23:22:11.320975] [DEBUG] [MAIN ] BNY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:11.346088] [INFO ] [MAIN ] BNY: Generated 138 derivative records from 7253 primary records. [2025-10-22T23:22:11.346294] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-22T23:22:11.361916] [DEBUG] [LOCAL ] BNY: Derivative data saved (1794 records). [2025-10-22T23:22:11.362086] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-10-22T23:22:11.364295] [INFO ] [MAIN ] Derivative Progress: 258/2052 symbols. BNY took 0.4s. Estimated remaining time: 11m 57s [2025-10-22T23:22:11.364413] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:11.392199] [DEBUG] [LOCAL ] BOC: Loaded 18186 existing records from primary storage. [2025-10-22T23:22:11.392358] [INFO ] [MAIN ] BOC: Loaded 18186 primary data records. [2025-10-22T23:22:11.709229] [DEBUG] [MAIN ] BOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:11.735223] [INFO ] [MAIN ] BOC: Generated 138 derivative records from 18186 primary records. [2025-10-22T23:22:11.735417] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-22T23:22:11.752574] [DEBUG] [LOCAL ] BOC: Derivative data saved (1794 records). [2025-10-22T23:22:11.752758] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-22T23:22:11.755854] [INFO ] [MAIN ] Derivative Progress: 259/2052 symbols. BOC took 0.4s. Estimated remaining time: 11m 56s [2025-10-22T23:22:11.755997] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:11.776412] [DEBUG] [LOCAL ] BOE: Loaded 18068 existing records from primary storage. [2025-10-22T23:22:11.776578] [INFO ] [MAIN ] BOE: Loaded 18068 primary data records. [2025-10-22T23:22:12.098348] [DEBUG] [MAIN ] BOE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:12.124999] [INFO ] [MAIN ] BOE: Generated 138 derivative records from 18068 primary records. [2025-10-22T23:22:12.125179] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-10-22T23:22:12.140575] [DEBUG] [LOCAL ] BOE: Derivative data saved (1794 records). [2025-10-22T23:22:12.140744] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-10-22T23:22:12.143584] [INFO ] [MAIN ] Derivative Progress: 260/2052 symbols. BOE took 0.4s. Estimated remaining time: 11m 56s [2025-10-22T23:22:12.143727] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:12.176605] [DEBUG] [LOCAL ] BOH: Loaded 30638 existing records from primary storage. [2025-10-22T23:22:12.176795] [INFO ] [MAIN ] BOH: Loaded 30638 primary data records. [2025-10-22T23:22:12.492120] [DEBUG] [MAIN ] BOH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:12.518882] [INFO ] [MAIN ] BOH: Generated 138 derivative records from 30638 primary records. [2025-10-22T23:22:12.519075] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-22T23:22:12.534251] [DEBUG] [LOCAL ] BOH: Derivative data saved (1794 records). [2025-10-22T23:22:12.534401] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-22T23:22:12.537526] [INFO ] [MAIN ] Derivative Progress: 261/2052 symbols. BOH took 0.4s. Estimated remaining time: 11m 55s [2025-10-22T23:22:12.537771] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:12.571860] [DEBUG] [LOCAL ] BOND: Loaded 32409 existing records from primary storage. [2025-10-22T23:22:12.572024] [INFO ] [MAIN ] BOND: Loaded 32409 primary data records. [2025-10-22T23:22:12.937176] [DEBUG] [MAIN ] BOND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:12.965395] [INFO ] [MAIN ] BOND: Generated 138 derivative records from 32409 primary records. [2025-10-22T23:22:12.965581] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-22T23:22:12.981023] [DEBUG] [LOCAL ] BOND: Derivative data saved (1794 records). [2025-10-22T23:22:12.981183] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-22T23:22:12.984448] [INFO ] [MAIN ] Derivative Progress: 262/2052 symbols. BOND took 0.4s. Estimated remaining time: 11m 55s [2025-10-22T23:22:12.984581] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:13.024792] [DEBUG] [LOCAL ] BOOT: Loaded 39419 existing records from primary storage. [2025-10-22T23:22:13.024956] [INFO ] [MAIN ] BOOT: Loaded 39419 primary data records. [2025-10-22T23:22:13.362697] [DEBUG] [MAIN ] BOOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:13.388112] [INFO ] [MAIN ] BOOT: Generated 138 derivative records from 39419 primary records. [2025-10-22T23:22:13.388254] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-22T23:22:13.403300] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1794 records). [2025-10-22T23:22:13.403409] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-22T23:22:13.406429] [INFO ] [MAIN ] Derivative Progress: 263/2052 symbols. BOOT took 0.4s. Estimated remaining time: 11m 55s [2025-10-22T23:22:13.406544] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:13.431959] [DEBUG] [LOCAL ] BOW: Loaded 22829 existing records from primary storage. [2025-10-22T23:22:13.432140] [INFO ] [MAIN ] BOW: Loaded 22829 primary data records. [2025-10-22T23:22:13.751555] [DEBUG] [MAIN ] BOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:13.786047] [INFO ] [MAIN ] BOW: Generated 138 derivative records from 22829 primary records. [2025-10-22T23:22:13.786236] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-22T23:22:13.801235] [DEBUG] [LOCAL ] BOW: Derivative data saved (1794 records). [2025-10-22T23:22:13.801328] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-22T23:22:13.804358] [INFO ] [MAIN ] Derivative Progress: 264/2052 symbols. BOW took 0.4s. Estimated remaining time: 11m 54s [2025-10-22T23:22:13.804506] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:13.854585] [DEBUG] [LOCAL ] BOX: Loaded 50125 existing records from primary storage. [2025-10-22T23:22:13.854810] [INFO ] [MAIN ] BOX: Loaded 50125 primary data records. [2025-10-22T23:22:14.179578] [DEBUG] [MAIN ] BOX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:14.205421] [INFO ] [MAIN ] BOX: Generated 138 derivative records from 50125 primary records. [2025-10-22T23:22:14.205559] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-10-22T23:22:14.220474] [DEBUG] [LOCAL ] BOX: Derivative data saved (1794 records). [2025-10-22T23:22:14.220560] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-10-22T23:22:14.223549] [INFO ] [MAIN ] Derivative Progress: 265/2052 symbols. BOX took 0.4s. Estimated remaining time: 11m 54s [2025-10-22T23:22:14.223680] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:14.277274] [DEBUG] [LOCAL ] BP: Loaded 53706 existing records from primary storage. [2025-10-22T23:22:14.277491] [INFO ] [MAIN ] BP: Loaded 53706 primary data records. [2025-10-22T23:22:14.582378] [DEBUG] [MAIN ] BP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:14.607550] [INFO ] [MAIN ] BP: Generated 138 derivative records from 53706 primary records. [2025-10-22T23:22:14.607679] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-10-22T23:22:14.622562] [DEBUG] [LOCAL ] BP: Derivative data saved (1794 records). [2025-10-22T23:22:14.622664] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-10-22T23:22:14.625748] [INFO ] [MAIN ] Derivative Progress: 266/2052 symbols. BP took 0.4s. Estimated remaining time: 11m 54s [2025-10-22T23:22:14.625842] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:14.658995] [DEBUG] [LOCAL ] BR: Loaded 34554 existing records from primary storage. [2025-10-22T23:22:14.659155] [INFO ] [MAIN ] BR: Loaded 34554 primary data records. [2025-10-22T23:22:15.003235] [DEBUG] [MAIN ] BR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:15.029715] [INFO ] [MAIN ] BR: Generated 138 derivative records from 34554 primary records. [2025-10-22T23:22:15.029911] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-22T23:22:15.044951] [DEBUG] [LOCAL ] BR: Derivative data saved (1794 records). [2025-10-22T23:22:15.045039] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-22T23:22:15.048025] [INFO ] [MAIN ] Derivative Progress: 267/2052 symbols. BR took 0.4s. Estimated remaining time: 11m 54s [2025-10-22T23:22:15.048125] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:15.098965] [DEBUG] [LOCAL ] BRBR: Loaded 51828 existing records from primary storage. [2025-10-22T23:22:15.099157] [INFO ] [MAIN ] BRBR: Loaded 51828 primary data records. [2025-10-22T23:22:15.414483] [DEBUG] [MAIN ] BRBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:15.441437] [INFO ] [MAIN ] BRBR: Generated 138 derivative records from 51828 primary records. [2025-10-22T23:22:15.441602] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-10-22T23:22:15.457063] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1794 records). [2025-10-22T23:22:15.457168] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-10-22T23:22:15.460431] [INFO ] [MAIN ] Derivative Progress: 268/2052 symbols. BRBR took 0.4s. Estimated remaining time: 11m 53s [2025-10-22T23:22:15.460544] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:15.482331] [DEBUG] [LOCAL ] BRC: Loaded 18341 existing records from primary storage. [2025-10-22T23:22:15.482483] [INFO ] [MAIN ] BRC: Loaded 18341 primary data records. [2025-10-22T23:22:15.813728] [DEBUG] [MAIN ] BRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:15.839779] [INFO ] [MAIN ] BRC: Generated 138 derivative records from 18341 primary records. [2025-10-22T23:22:15.839919] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-22T23:22:15.855399] [DEBUG] [LOCAL ] BRC: Derivative data saved (1794 records). [2025-10-22T23:22:15.855485] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-10-22T23:22:15.858301] [INFO ] [MAIN ] Derivative Progress: 269/2052 symbols. BRC took 0.4s. Estimated remaining time: 11m 53s [2025-10-22T23:22:15.858590] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:15.898700] [DEBUG] [LOCAL ] BRCC: Loaded 40024 existing records from primary storage. [2025-10-22T23:22:15.898858] [INFO ] [MAIN ] BRCC: Loaded 40024 primary data records. [2025-10-22T23:22:16.233753] [DEBUG] [MAIN ] BRCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:16.259026] [INFO ] [MAIN ] BRCC: Generated 138 derivative records from 40024 primary records. [2025-10-22T23:22:16.259169] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-10-22T23:22:16.273830] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1794 records). [2025-10-22T23:22:16.273920] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-10-22T23:22:16.276809] [INFO ] [MAIN ] Derivative Progress: 270/2052 symbols. BRCC took 0.4s. Estimated remaining time: 11m 53s [2025-10-22T23:22:16.276909] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:16.327470] [DEBUG] [LOCAL ] BRO: Loaded 52096 existing records from primary storage. [2025-10-22T23:22:16.327677] [INFO ] [MAIN ] BRO: Loaded 52096 primary data records. [2025-10-22T23:22:16.636353] [DEBUG] [MAIN ] BRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:16.661727] [INFO ] [MAIN ] BRO: Generated 138 derivative records from 52096 primary records. [2025-10-22T23:22:16.661878] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-10-22T23:22:16.677590] [DEBUG] [LOCAL ] BRO: Derivative data saved (1794 records). [2025-10-22T23:22:16.677737] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-10-22T23:22:16.680888] [INFO ] [MAIN ] Derivative Progress: 271/2052 symbols. BRO took 0.4s. Estimated remaining time: 11m 52s [2025-10-22T23:22:16.680978] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:16.731142] [DEBUG] [LOCAL ] BROS: Loaded 53301 existing records from primary storage. [2025-10-22T23:22:16.731303] [INFO ] [MAIN ] BROS: Loaded 53301 primary data records. [2025-10-22T23:22:17.039984] [DEBUG] [MAIN ] BROS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:17.067059] [INFO ] [MAIN ] BROS: Generated 138 derivative records from 53301 primary records. [2025-10-22T23:22:17.067268] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-22T23:22:17.082616] [DEBUG] [LOCAL ] BROS: Derivative data saved (1794 records). [2025-10-22T23:22:17.082734] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-22T23:22:17.085823] [INFO ] [MAIN ] Derivative Progress: 272/2052 symbols. BROS took 0.4s. Estimated remaining time: 11m 52s [2025-10-22T23:22:17.085971] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:17.121131] [DEBUG] [LOCAL ] BRSP: Loaded 36477 existing records from primary storage. [2025-10-22T23:22:17.121305] [INFO ] [MAIN ] BRSP: Loaded 36477 primary data records. [2025-10-22T23:22:17.471384] [DEBUG] [MAIN ] BRSP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:17.496610] [INFO ] [MAIN ] BRSP: Generated 138 derivative records from 36477 primary records. [2025-10-22T23:22:17.496827] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-10-22T23:22:17.511434] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1794 records). [2025-10-22T23:22:17.511557] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-10-22T23:22:17.514470] [INFO ] [MAIN ] Derivative Progress: 273/2052 symbols. BRSP took 0.4s. Estimated remaining time: 11m 52s [2025-10-22T23:22:17.514571] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:17.523147] [DEBUG] [LOCAL ] BRT: Loaded 5261 existing records from primary storage. [2025-10-22T23:22:17.523291] [INFO ] [MAIN ] BRT: Loaded 5261 primary data records. [2025-10-22T23:22:17.830583] [DEBUG] [MAIN ] BRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:17.857767] [INFO ] [MAIN ] BRT: Generated 138 derivative records from 5261 primary records. [2025-10-22T23:22:17.857914] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-10-22T23:22:17.872553] [DEBUG] [LOCAL ] BRT: Derivative data saved (1794 records). [2025-10-22T23:22:17.872664] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-10-22T23:22:17.874919] [INFO ] [MAIN ] Derivative Progress: 274/2052 symbols. BRT took 0.4s. Estimated remaining time: 11m 51s [2025-10-22T23:22:17.875012] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:17.925703] [DEBUG] [LOCAL ] BRX: Loaded 51818 existing records from primary storage. [2025-10-22T23:22:17.925873] [INFO ] [MAIN ] BRX: Loaded 51818 primary data records. [2025-10-22T23:22:18.235505] [DEBUG] [MAIN ] BRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:18.260851] [INFO ] [MAIN ] BRX: Generated 138 derivative records from 51818 primary records. [2025-10-22T23:22:18.260991] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-22T23:22:18.276279] [DEBUG] [LOCAL ] BRX: Derivative data saved (1794 records). [2025-10-22T23:22:18.276362] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-10-22T23:22:18.279409] [INFO ] [MAIN ] Derivative Progress: 275/2052 symbols. BRX took 0.4s. Estimated remaining time: 11m 51s [2025-10-22T23:22:18.279520] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:18.312871] [DEBUG] [LOCAL ] BSBR: Loaded 35877 existing records from primary storage. [2025-10-22T23:22:18.313028] [INFO ] [MAIN ] BSBR: Loaded 35877 primary data records. [2025-10-22T23:22:18.626693] [DEBUG] [MAIN ] BSBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:18.656942] [INFO ] [MAIN ] BSBR: Generated 138 derivative records from 35877 primary records. [2025-10-22T23:22:18.657121] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-10-22T23:22:18.673759] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1794 records). [2025-10-22T23:22:18.673900] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-10-22T23:22:18.676789] [INFO ] [MAIN ] Derivative Progress: 276/2052 symbols. BSBR took 0.4s. Estimated remaining time: 11m 50s [2025-10-22T23:22:18.676911] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:18.688851] [DEBUG] [LOCAL ] BSL: Loaded 7898 existing records from primary storage. [2025-10-22T23:22:18.689012] [INFO ] [MAIN ] BSL: Loaded 7898 primary data records. [2025-10-22T23:22:19.011384] [DEBUG] [MAIN ] BSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:19.037908] [INFO ] [MAIN ] BSL: Generated 138 derivative records from 7898 primary records. [2025-10-22T23:22:19.038034] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-10-22T23:22:19.052950] [DEBUG] [LOCAL ] BSL: Derivative data saved (1794 records). [2025-10-22T23:22:19.053044] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-10-22T23:22:19.055154] [INFO ] [MAIN ] Derivative Progress: 277/2052 symbols. BSL took 0.4s. Estimated remaining time: 11m 50s [2025-10-22T23:22:19.055240] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:19.087442] [DEBUG] [LOCAL ] BSM: Loaded 32282 existing records from primary storage. [2025-10-22T23:22:19.087596] [INFO ] [MAIN ] BSM: Loaded 32282 primary data records. [2025-10-22T23:22:19.426499] [DEBUG] [MAIN ] BSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:19.452216] [INFO ] [MAIN ] BSM: Generated 138 derivative records from 32282 primary records. [2025-10-22T23:22:19.452335] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-10-22T23:22:19.467836] [DEBUG] [LOCAL ] BSM: Derivative data saved (1794 records). [2025-10-22T23:22:19.467922] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-10-22T23:22:19.471581] [INFO ] [MAIN ] Derivative Progress: 278/2052 symbols. BSM took 0.4s. Estimated remaining time: 11m 49s [2025-10-22T23:22:19.471693] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:19.492885] [DEBUG] [LOCAL ] BST: Loaded 18388 existing records from primary storage. [2025-10-22T23:22:19.493030] [INFO ] [MAIN ] BST: Loaded 18388 primary data records. [2025-10-22T23:22:19.798338] [DEBUG] [MAIN ] BST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:19.823155] [INFO ] [MAIN ] BST: Generated 138 derivative records from 18388 primary records. [2025-10-22T23:22:19.823338] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-10-22T23:22:19.839450] [DEBUG] [LOCAL ] BST: Derivative data saved (1794 records). [2025-10-22T23:22:19.839574] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-10-22T23:22:19.842395] [INFO ] [MAIN ] Derivative Progress: 279/2052 symbols. BST took 0.4s. Estimated remaining time: 11m 49s [2025-10-22T23:22:19.842501] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:19.867768] [DEBUG] [LOCAL ] BSTZ: Loaded 24418 existing records from primary storage. [2025-10-22T23:22:19.867916] [INFO ] [MAIN ] BSTZ: Loaded 24418 primary data records. [2025-10-22T23:22:20.173070] [DEBUG] [MAIN ] BSTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:20.197850] [INFO ] [MAIN ] BSTZ: Generated 138 derivative records from 24418 primary records. [2025-10-22T23:22:20.197980] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-10-22T23:22:20.212910] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1794 records). [2025-10-22T23:22:20.212990] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-10-22T23:22:20.215856] [INFO ] [MAIN ] Derivative Progress: 280/2052 symbols. BSTZ took 0.4s. Estimated remaining time: 11m 48s [2025-10-22T23:22:20.215949] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:20.268133] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-22T23:22:20.268312] [INFO ] [MAIN ] BSX: Loaded 53688 primary data records. [2025-10-22T23:22:20.571351] [DEBUG] [MAIN ] BSX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:20.596385] [INFO ] [MAIN ] BSX: Generated 138 derivative records from 53688 primary records. [2025-10-22T23:22:20.596566] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-10-22T23:22:20.611801] [DEBUG] [LOCAL ] BSX: Derivative data saved (1794 records). [2025-10-22T23:22:20.611894] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-10-22T23:22:20.615202] [INFO ] [MAIN ] Derivative Progress: 281/2052 symbols. BSX took 0.4s. Estimated remaining time: 11m 48s [2025-10-22T23:22:20.615296] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:20.624477] [DEBUG] [LOCAL ] BTA: Loaded 5760 existing records from primary storage. [2025-10-22T23:22:20.624598] [INFO ] [MAIN ] BTA: Loaded 5760 primary data records. [2025-10-22T23:22:20.936192] [DEBUG] [MAIN ] BTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:20.961615] [INFO ] [MAIN ] BTA: Generated 138 derivative records from 5760 primary records. [2025-10-22T23:22:20.961752] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-22T23:22:20.975836] [DEBUG] [LOCAL ] BTA: Derivative data saved (1794 records). [2025-10-22T23:22:20.975915] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-10-22T23:22:20.979794] [INFO ] [MAIN ] Derivative Progress: 282/2052 symbols. BTA took 0.4s. Estimated remaining time: 11m 47s [2025-10-22T23:22:20.979885] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:21.030008] [DEBUG] [LOCAL ] BTE: Loaded 52696 existing records from primary storage. [2025-10-22T23:22:21.030168] [INFO ] [MAIN ] BTE: Loaded 52696 primary data records. [2025-10-22T23:22:21.360350] [DEBUG] [MAIN ] BTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:21.385247] [INFO ] [MAIN ] BTE: Generated 138 derivative records from 52696 primary records. [2025-10-22T23:22:21.385391] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-10-22T23:22:21.400197] [DEBUG] [LOCAL ] BTE: Derivative data saved (1794 records). [2025-10-22T23:22:21.400278] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-10-22T23:22:21.403475] [INFO ] [MAIN ] Derivative Progress: 283/2052 symbols. BTE took 0.4s. Estimated remaining time: 11m 47s [2025-10-22T23:22:21.403572] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:21.453358] [DEBUG] [LOCAL ] BTI: Loaded 53592 existing records from primary storage. [2025-10-22T23:22:21.453520] [INFO ] [MAIN ] BTI: Loaded 53592 primary data records. [2025-10-22T23:22:21.760755] [DEBUG] [MAIN ] BTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:21.785445] [INFO ] [MAIN ] BTI: Generated 138 derivative records from 53592 primary records. [2025-10-22T23:22:21.785558] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-10-22T23:22:21.800389] [DEBUG] [LOCAL ] BTI: Derivative data saved (1794 records). [2025-10-22T23:22:21.800469] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-10-22T23:22:21.803537] [INFO ] [MAIN ] Derivative Progress: 284/2052 symbols. BTI took 0.4s. Estimated remaining time: 11m 47s [2025-10-22T23:22:21.803695] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:21.817749] [DEBUG] [LOCAL ] BTO: Loaded 8703 existing records from primary storage. [2025-10-22T23:22:21.817904] [INFO ] [MAIN ] BTO: Loaded 8703 primary data records. [2025-10-22T23:22:22.132147] [DEBUG] [MAIN ] BTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:22.157595] [INFO ] [MAIN ] BTO: Generated 138 derivative records from 8703 primary records. [2025-10-22T23:22:22.157779] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-22T23:22:22.173201] [DEBUG] [LOCAL ] BTO: Derivative data saved (1794 records). [2025-10-22T23:22:22.173282] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-22T23:22:22.175378] [INFO ] [MAIN ] Derivative Progress: 285/2052 symbols. BTO took 0.4s. Estimated remaining time: 11m 46s [2025-10-22T23:22:22.175466] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:22.192337] [DEBUG] [LOCAL ] BTT: Loaded 15359 existing records from primary storage. [2025-10-22T23:22:22.192470] [INFO ] [MAIN ] BTT: Loaded 15359 primary data records. [2025-10-22T23:22:22.504930] [DEBUG] [MAIN ] BTT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:22.530268] [INFO ] [MAIN ] BTT: Generated 138 derivative records from 15359 primary records. [2025-10-22T23:22:22.530391] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-10-22T23:22:22.545935] [DEBUG] [LOCAL ] BTT: Derivative data saved (1794 records). [2025-10-22T23:22:22.546020] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-10-22T23:22:22.550785] [INFO ] [MAIN ] Derivative Progress: 286/2052 symbols. BTT took 0.4s. Estimated remaining time: 11m 45s [2025-10-22T23:22:22.550886] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:22.602389] [DEBUG] [LOCAL ] BTU: Loaded 53337 existing records from primary storage. [2025-10-22T23:22:22.602563] [INFO ] [MAIN ] BTU: Loaded 53337 primary data records. [2025-10-22T23:22:22.910827] [DEBUG] [MAIN ] BTU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:22.935698] [INFO ] [MAIN ] BTU: Generated 138 derivative records from 53337 primary records. [2025-10-22T23:22:22.935808] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-10-22T23:22:22.950894] [DEBUG] [LOCAL ] BTU: Derivative data saved (1794 records). [2025-10-22T23:22:22.950974] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-10-22T23:22:22.954630] [INFO ] [MAIN ] Derivative Progress: 287/2052 symbols. BTU took 0.4s. Estimated remaining time: 11m 45s [2025-10-22T23:22:22.954747] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:22.976718] [DEBUG] [LOCAL ] BTZ: Loaded 22396 existing records from primary storage. [2025-10-22T23:22:22.976888] [INFO ] [MAIN ] BTZ: Loaded 22396 primary data records. [2025-10-22T23:22:23.314068] [DEBUG] [MAIN ] BTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:23.340513] [INFO ] [MAIN ] BTZ: Generated 138 derivative records from 22396 primary records. [2025-10-22T23:22:23.340632] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-22T23:22:23.355701] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1794 records). [2025-10-22T23:22:23.355787] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-22T23:22:23.358795] [INFO ] [MAIN ] Derivative Progress: 288/2052 symbols. BTZ took 0.4s. Estimated remaining time: 11m 45s [2025-10-22T23:22:23.358887] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:23.412958] [DEBUG] [LOCAL ] BUD: Loaded 52597 existing records from primary storage. [2025-10-22T23:22:23.413119] [INFO ] [MAIN ] BUD: Loaded 52597 primary data records. [2025-10-22T23:22:23.723296] [DEBUG] [MAIN ] BUD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:23.749051] [INFO ] [MAIN ] BUD: Generated 138 derivative records from 52597 primary records. [2025-10-22T23:22:23.749188] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-22T23:22:23.771583] [DEBUG] [LOCAL ] BUD: Derivative data saved (1794 records). [2025-10-22T23:22:23.771771] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-22T23:22:23.775078] [INFO ] [MAIN ] Derivative Progress: 289/2052 symbols. BUD took 0.4s. Estimated remaining time: 11m 44s [2025-10-22T23:22:23.775179] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:23.790493] [DEBUG] [LOCAL ] BUI: Loaded 11824 existing records from primary storage. [2025-10-22T23:22:23.790628] [INFO ] [MAIN ] BUI: Loaded 11824 primary data records. [2025-10-22T23:22:24.123018] [DEBUG] [MAIN ] BUI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:24.153026] [INFO ] [MAIN ] BUI: Generated 138 derivative records from 11824 primary records. [2025-10-22T23:22:24.153239] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-10-22T23:22:24.171082] [DEBUG] [LOCAL ] BUI: Derivative data saved (1794 records). [2025-10-22T23:22:24.171183] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-10-22T23:22:24.173567] [INFO ] [MAIN ] Derivative Progress: 290/2052 symbols. BUI took 0.4s. Estimated remaining time: 11m 44s [2025-10-22T23:22:24.173707] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:24.220410] [DEBUG] [LOCAL ] BUR: Loaded 45446 existing records from primary storage. [2025-10-22T23:22:24.220582] [INFO ] [MAIN ] BUR: Loaded 45446 primary data records. [2025-10-22T23:22:24.546594] [DEBUG] [MAIN ] BUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:24.573350] [INFO ] [MAIN ] BUR: Generated 138 derivative records from 45446 primary records. [2025-10-22T23:22:24.573520] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-22T23:22:24.588977] [DEBUG] [LOCAL ] BUR: Derivative data saved (1794 records). [2025-10-22T23:22:24.589074] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-10-22T23:22:24.592498] [INFO ] [MAIN ] Derivative Progress: 291/2052 symbols. BUR took 0.4s. Estimated remaining time: 11m 44s [2025-10-22T23:22:24.592606] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:24.637272] [DEBUG] [LOCAL ] BURL: Loaded 45416 existing records from primary storage. [2025-10-22T23:22:24.637454] [INFO ] [MAIN ] BURL: Loaded 45416 primary data records. [2025-10-22T23:22:24.952186] [DEBUG] [MAIN ] BURL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:24.978070] [INFO ] [MAIN ] BURL: Generated 138 derivative records from 45416 primary records. [2025-10-22T23:22:24.978239] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-22T23:22:24.994168] [DEBUG] [LOCAL ] BURL: Derivative data saved (1794 records). [2025-10-22T23:22:24.994254] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-22T23:22:24.997852] [INFO ] [MAIN ] Derivative Progress: 292/2052 symbols. BURL took 0.4s. Estimated remaining time: 11m 43s [2025-10-22T23:22:24.997954] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:25.015524] [DEBUG] [LOCAL ] BUXX: Loaded 15332 existing records from primary storage. [2025-10-22T23:22:25.015698] [INFO ] [MAIN ] BUXX: Loaded 15332 primary data records. [2025-10-22T23:22:25.329305] [DEBUG] [MAIN ] BUXX: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:22:25.354435] [INFO ] [MAIN ] BUXX: Generated 138 derivative records from 15332 primary records. [2025-10-22T23:22:25.354566] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-10-22T23:22:25.370311] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1793 records). [2025-10-22T23:22:25.370399] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-10-22T23:22:25.372577] [INFO ] [MAIN ] Derivative Progress: 293/2052 symbols. BUXX took 0.4s. Estimated remaining time: 11m 43s [2025-10-22T23:22:25.372691] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:25.418009] [DEBUG] [LOCAL ] BVN: Loaded 44515 existing records from primary storage. [2025-10-22T23:22:25.418175] [INFO ] [MAIN ] BVN: Loaded 44515 primary data records. [2025-10-22T23:22:25.753476] [DEBUG] [MAIN ] BVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:25.778529] [INFO ] [MAIN ] BVN: Generated 138 derivative records from 44515 primary records. [2025-10-22T23:22:25.778852] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-10-22T23:22:25.794231] [DEBUG] [LOCAL ] BVN: Derivative data saved (1794 records). [2025-10-22T23:22:25.794313] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-10-22T23:22:25.797429] [INFO ] [MAIN ] Derivative Progress: 294/2052 symbols. BVN took 0.4s. Estimated remaining time: 11m 42s [2025-10-22T23:22:25.797528] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:25.848261] [DEBUG] [LOCAL ] BWA: Loaded 52078 existing records from primary storage. [2025-10-22T23:22:25.848426] [INFO ] [MAIN ] BWA: Loaded 52078 primary data records. [2025-10-22T23:22:26.154744] [DEBUG] [MAIN ] BWA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:26.180956] [INFO ] [MAIN ] BWA: Generated 138 derivative records from 52078 primary records. [2025-10-22T23:22:26.181087] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-22T23:22:26.197228] [DEBUG] [LOCAL ] BWA: Derivative data saved (1794 records). [2025-10-22T23:22:26.197335] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-22T23:22:26.200815] [INFO ] [MAIN ] Derivative Progress: 295/2052 symbols. BWA took 0.4s. Estimated remaining time: 11m 42s [2025-10-22T23:22:26.200914] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:26.217415] [DEBUG] [LOCAL ] BWG: Loaded 12559 existing records from primary storage. [2025-10-22T23:22:26.217550] [INFO ] [MAIN ] BWG: Loaded 12559 primary data records. [2025-10-22T23:22:26.523930] [DEBUG] [MAIN ] BWG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:26.549052] [INFO ] [MAIN ] BWG: Generated 138 derivative records from 12559 primary records. [2025-10-22T23:22:26.549166] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-22T23:22:26.564141] [DEBUG] [LOCAL ] BWG: Derivative data saved (1794 records). [2025-10-22T23:22:26.564234] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-10-22T23:22:26.567154] [INFO ] [MAIN ] Derivative Progress: 296/2052 symbols. BWG took 0.4s. Estimated remaining time: 11m 42s [2025-10-22T23:22:26.567250] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:26.597826] [DEBUG] [LOCAL ] BWLP: Loaded 32092 existing records from primary storage. [2025-10-22T23:22:26.597981] [INFO ] [MAIN ] BWLP: Loaded 32092 primary data records. [2025-10-22T23:22:26.916391] [DEBUG] [MAIN ] BWLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:26.941505] [INFO ] [MAIN ] BWLP: Generated 138 derivative records from 32092 primary records. [2025-10-22T23:22:26.941817] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-22T23:22:26.958074] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1794 records). [2025-10-22T23:22:26.958152] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-10-22T23:22:26.961340] [INFO ] [MAIN ] Derivative Progress: 297/2052 symbols. BWLP took 0.4s. Estimated remaining time: 11m 41s [2025-10-22T23:22:26.961437] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:26.969788] [DEBUG] [LOCAL ] BWNB: Loaded 4051 existing records from primary storage. [2025-10-22T23:22:26.969920] [INFO ] [MAIN ] BWNB: Loaded 4051 primary data records. [2025-10-22T23:22:27.274076] [DEBUG] [MAIN ] BWNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:27.299600] [INFO ] [MAIN ] BWNB: Generated 138 derivative records from 4051 primary records. [2025-10-22T23:22:27.299753] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-22T23:22:27.313027] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1794 records). [2025-10-22T23:22:27.313124] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-22T23:22:27.315440] [INFO ] [MAIN ] Derivative Progress: 298/2052 symbols. BWNB took 0.4s. Estimated remaining time: 11m 40s [2025-10-22T23:22:27.315549] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:27.322662] [DEBUG] [LOCAL ] BWSN: Loaded 5048 existing records from primary storage. [2025-10-22T23:22:27.322794] [INFO ] [MAIN ] BWSN: Loaded 5048 primary data records. [2025-10-22T23:22:27.647894] [DEBUG] [MAIN ] BWSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:27.674192] [INFO ] [MAIN ] BWSN: Generated 138 derivative records from 5048 primary records. [2025-10-22T23:22:27.674333] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-22T23:22:27.687765] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1794 records). [2025-10-22T23:22:27.687866] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-10-22T23:22:27.690284] [INFO ] [MAIN ] Derivative Progress: 299/2052 symbols. BWSN took 0.4s. Estimated remaining time: 11m 40s [2025-10-22T23:22:27.690397] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:27.735043] [DEBUG] [LOCAL ] BWXT: Loaded 47260 existing records from primary storage. [2025-10-22T23:22:27.735221] [INFO ] [MAIN ] BWXT: Loaded 47260 primary data records. [2025-10-22T23:22:28.053361] [DEBUG] [MAIN ] BWXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:28.078114] [INFO ] [MAIN ] BWXT: Generated 138 derivative records from 47260 primary records. [2025-10-22T23:22:28.078235] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-22T23:22:28.093250] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1794 records). [2025-10-22T23:22:28.093347] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-10-22T23:22:28.096311] [INFO ] [MAIN ] Derivative Progress: 300/2052 symbols. BWXT took 0.4s. Estimated remaining time: 11m 40s [2025-10-22T23:22:28.096427] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:28.147706] [DEBUG] [LOCAL ] BXP: Loaded 49849 existing records from primary storage. [2025-10-22T23:22:28.147879] [INFO ] [MAIN ] BXP: Loaded 49849 primary data records. [2025-10-22T23:22:28.461156] [DEBUG] [MAIN ] BXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:28.486017] [INFO ] [MAIN ] BXP: Generated 138 derivative records from 49849 primary records. [2025-10-22T23:22:28.486139] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-10-22T23:22:28.501559] [DEBUG] [LOCAL ] BXP: Derivative data saved (1794 records). [2025-10-22T23:22:28.501845] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-10-22T23:22:28.504687] [INFO ] [MAIN ] Derivative Progress: 301/2052 symbols. BXP took 0.4s. Estimated remaining time: 11m 39s [2025-10-22T23:22:28.504772] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:28.527636] [DEBUG] [LOCAL ] BY: Loaded 21636 existing records from primary storage. [2025-10-22T23:22:28.527798] [INFO ] [MAIN ] BY: Loaded 21636 primary data records. [2025-10-22T23:22:28.835360] [DEBUG] [MAIN ] BY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:28.862492] [INFO ] [MAIN ] BY: Generated 138 derivative records from 21636 primary records. [2025-10-22T23:22:28.862694] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-10-22T23:22:28.877978] [DEBUG] [LOCAL ] BY: Derivative data saved (1794 records). [2025-10-22T23:22:28.878073] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-10-22T23:22:28.880868] [INFO ] [MAIN ] Derivative Progress: 302/2052 symbols. BY took 0.4s. Estimated remaining time: 11m 39s [2025-10-22T23:22:28.880960] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:28.920100] [DEBUG] [LOCAL ] BYD: Loaded 44941 existing records from primary storage. [2025-10-22T23:22:28.920260] [INFO ] [MAIN ] BYD: Loaded 44941 primary data records. [2025-10-22T23:22:29.229807] [DEBUG] [MAIN ] BYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:29.254899] [INFO ] [MAIN ] BYD: Generated 138 derivative records from 44941 primary records. [2025-10-22T23:22:29.255014] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-22T23:22:29.270025] [DEBUG] [LOCAL ] BYD: Derivative data saved (1794 records). [2025-10-22T23:22:29.270112] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-10-22T23:22:29.272999] [INFO ] [MAIN ] Derivative Progress: 303/2052 symbols. BYD took 0.4s. Estimated remaining time: 11m 38s [2025-10-22T23:22:29.273087] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:29.288277] [DEBUG] [LOCAL ] BYM: Loaded 11369 existing records from primary storage. [2025-10-22T23:22:29.288403] [INFO ] [MAIN ] BYM: Loaded 11369 primary data records. [2025-10-22T23:22:29.637120] [DEBUG] [MAIN ] BYM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:29.662776] [INFO ] [MAIN ] BYM: Generated 138 derivative records from 11369 primary records. [2025-10-22T23:22:29.662931] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-22T23:22:29.679196] [DEBUG] [LOCAL ] BYM: Derivative data saved (1794 records). [2025-10-22T23:22:29.679308] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-10-22T23:22:29.681892] [INFO ] [MAIN ] Derivative Progress: 304/2052 symbols. BYM took 0.4s. Estimated remaining time: 11m 38s [2025-10-22T23:22:29.681997] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:29.714440] [DEBUG] [LOCAL ] BZH: Loaded 32065 existing records from primary storage. [2025-10-22T23:22:29.714601] [INFO ] [MAIN ] BZH: Loaded 32065 primary data records. [2025-10-22T23:22:30.027450] [DEBUG] [MAIN ] BZH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:30.052226] [INFO ] [MAIN ] BZH: Generated 138 derivative records from 32065 primary records. [2025-10-22T23:22:30.052331] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-22T23:22:30.067230] [DEBUG] [LOCAL ] BZH: Derivative data saved (1794 records). [2025-10-22T23:22:30.067328] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-22T23:22:30.070106] [INFO ] [MAIN ] Derivative Progress: 305/2052 symbols. BZH took 0.4s. Estimated remaining time: 11m 37s [2025-10-22T23:22:30.070204] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:30.090804] [DEBUG] [LOCAL ] CAAP: Loaded 19805 existing records from primary storage. [2025-10-22T23:22:30.090959] [INFO ] [MAIN ] CAAP: Loaded 19805 primary data records. [2025-10-22T23:22:30.404678] [DEBUG] [MAIN ] CAAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:30.431250] [INFO ] [MAIN ] CAAP: Generated 138 derivative records from 19805 primary records. [2025-10-22T23:22:30.431372] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-22T23:22:30.446441] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1794 records). [2025-10-22T23:22:30.446521] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-22T23:22:30.449800] [INFO ] [MAIN ] Derivative Progress: 306/2052 symbols. CAAP took 0.4s. Estimated remaining time: 11m 37s [2025-10-22T23:22:30.449896] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:30.470451] [DEBUG] [LOCAL ] CABO: Loaded 16659 existing records from primary storage. [2025-10-22T23:22:30.470595] [INFO ] [MAIN ] CABO: Loaded 16659 primary data records. [2025-10-22T23:22:30.781199] [DEBUG] [MAIN ] CABO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:30.807160] [INFO ] [MAIN ] CABO: Generated 138 derivative records from 16659 primary records. [2025-10-22T23:22:30.807354] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-22T23:22:30.822195] [DEBUG] [LOCAL ] CABO: Derivative data saved (1794 records). [2025-10-22T23:22:30.822279] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-22T23:22:30.825125] [INFO ] [MAIN ] Derivative Progress: 307/2052 symbols. CABO took 0.4s. Estimated remaining time: 11m 36s [2025-10-22T23:22:30.825234] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:30.848820] [DEBUG] [LOCAL ] CACI: Loaded 22378 existing records from primary storage. [2025-10-22T23:22:30.848977] [INFO ] [MAIN ] CACI: Loaded 22378 primary data records. [2025-10-22T23:22:31.162429] [DEBUG] [MAIN ] CACI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:22:31.189140] [INFO ] [MAIN ] CACI: Generated 138 derivative records from 22378 primary records. [2025-10-22T23:22:31.189262] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-22T23:22:31.204515] [DEBUG] [LOCAL ] CACI: Derivative data saved (1793 records). [2025-10-22T23:22:31.204804] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-22T23:22:31.207638] [INFO ] [MAIN ] Derivative Progress: 308/2052 symbols. CACI took 0.4s. Estimated remaining time: 11m 36s [2025-10-22T23:22:31.207784] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:31.256837] [DEBUG] [LOCAL ] CADE: Loaded 49685 existing records from primary storage. [2025-10-22T23:22:31.256991] [INFO ] [MAIN ] CADE: Loaded 49685 primary data records. [2025-10-22T23:22:31.566045] [DEBUG] [MAIN ] CADE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:31.591533] [INFO ] [MAIN ] CADE: Generated 138 derivative records from 49685 primary records. [2025-10-22T23:22:31.591861] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-22T23:22:31.607921] [DEBUG] [LOCAL ] CADE: Derivative data saved (1794 records). [2025-10-22T23:22:31.608003] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-22T23:22:31.610922] [INFO ] [MAIN ] Derivative Progress: 309/2052 symbols. CADE took 0.4s. Estimated remaining time: 11m 35s [2025-10-22T23:22:31.611020] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:31.646595] [DEBUG] [LOCAL ] CAE: Loaded 39045 existing records from primary storage. [2025-10-22T23:22:31.646789] [INFO ] [MAIN ] CAE: Loaded 39045 primary data records. [2025-10-22T23:22:31.975910] [DEBUG] [MAIN ] CAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:32.002514] [INFO ] [MAIN ] CAE: Generated 138 derivative records from 39045 primary records. [2025-10-22T23:22:32.002729] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-22T23:22:32.017819] [DEBUG] [LOCAL ] CAE: Derivative data saved (1794 records). [2025-10-22T23:22:32.017902] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-22T23:22:32.020713] [INFO ] [MAIN ] Derivative Progress: 310/2052 symbols. CAE took 0.4s. Estimated remaining time: 11m 35s [2025-10-22T23:22:32.020805] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:32.073212] [DEBUG] [LOCAL ] CAG: Loaded 53666 existing records from primary storage. [2025-10-22T23:22:32.073377] [INFO ] [MAIN ] CAG: Loaded 53666 primary data records. [2025-10-22T23:22:32.397104] [DEBUG] [MAIN ] CAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:32.424221] [INFO ] [MAIN ] CAG: Generated 138 derivative records from 53666 primary records. [2025-10-22T23:22:32.424364] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-22T23:22:32.440181] [DEBUG] [LOCAL ] CAG: Derivative data saved (1794 records). [2025-10-22T23:22:32.440296] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-10-22T23:22:32.443738] [INFO ] [MAIN ] Derivative Progress: 311/2052 symbols. CAG took 0.4s. Estimated remaining time: 11m 35s [2025-10-22T23:22:32.443826] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:32.495191] [DEBUG] [LOCAL ] CAH: Loaded 51420 existing records from primary storage. [2025-10-22T23:22:32.495355] [INFO ] [MAIN ] CAH: Loaded 51420 primary data records. [2025-10-22T23:22:32.821797] [DEBUG] [MAIN ] CAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:32.847569] [INFO ] [MAIN ] CAH: Generated 138 derivative records from 51420 primary records. [2025-10-22T23:22:32.847746] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-22T23:22:32.863283] [DEBUG] [LOCAL ] CAH: Derivative data saved (1794 records). [2025-10-22T23:22:32.863370] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-22T23:22:32.867101] [INFO ] [MAIN ] Derivative Progress: 312/2052 symbols. CAH took 0.4s. Estimated remaining time: 11m 35s [2025-10-22T23:22:32.867195] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:32.908183] [DEBUG] [LOCAL ] CAL: Loaded 42762 existing records from primary storage. [2025-10-22T23:22:32.908346] [INFO ] [MAIN ] CAL: Loaded 42762 primary data records. [2025-10-22T23:22:33.225441] [DEBUG] [MAIN ] CAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:33.251824] [INFO ] [MAIN ] CAL: Generated 138 derivative records from 42762 primary records. [2025-10-22T23:22:33.252009] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-22T23:22:33.267506] [DEBUG] [LOCAL ] CAL: Derivative data saved (1794 records). [2025-10-22T23:22:33.267594] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-22T23:22:33.270545] [INFO ] [MAIN ] Derivative Progress: 313/2052 symbols. CAL took 0.4s. Estimated remaining time: 11m 34s [2025-10-22T23:22:33.270635] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:33.306437] [DEBUG] [LOCAL ] CALX: Loaded 37238 existing records from primary storage. [2025-10-22T23:22:33.306599] [INFO ] [MAIN ] CALX: Loaded 37238 primary data records. [2025-10-22T23:22:33.612849] [DEBUG] [MAIN ] CALX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:33.641992] [INFO ] [MAIN ] CALX: Generated 138 derivative records from 37238 primary records. [2025-10-22T23:22:33.642180] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-22T23:22:33.657230] [DEBUG] [LOCAL ] CALX: Derivative data saved (1794 records). [2025-10-22T23:22:33.657342] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-22T23:22:33.660360] [INFO ] [MAIN ] Derivative Progress: 314/2052 symbols. CALX took 0.4s. Estimated remaining time: 11m 34s [2025-10-22T23:22:33.660471] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:33.686230] [DEBUG] [LOCAL ] CANG: Loaded 27031 existing records from primary storage. [2025-10-22T23:22:33.686389] [INFO ] [MAIN ] CANG: Loaded 27031 primary data records. [2025-10-22T23:22:34.038544] [DEBUG] [MAIN ] CANG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:34.064995] [INFO ] [MAIN ] CANG: Generated 138 derivative records from 27031 primary records. [2025-10-22T23:22:34.065116] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-10-22T23:22:34.080063] [DEBUG] [LOCAL ] CANG: Derivative data saved (1794 records). [2025-10-22T23:22:34.080149] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-10-22T23:22:34.083227] [INFO ] [MAIN ] Derivative Progress: 315/2052 symbols. CANG took 0.4s. Estimated remaining time: 11m 33s [2025-10-22T23:22:34.083339] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:34.091879] [DEBUG] [LOCAL ] CAPL: Loaded 5383 existing records from primary storage. [2025-10-22T23:22:34.091982] [INFO ] [MAIN ] CAPL: Loaded 5383 primary data records. [2025-10-22T23:22:34.407490] [DEBUG] [MAIN ] CAPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:34.432587] [INFO ] [MAIN ] CAPL: Generated 138 derivative records from 5383 primary records. [2025-10-22T23:22:34.432988] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-22T23:22:34.447138] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1794 records). [2025-10-22T23:22:34.447221] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-22T23:22:34.449434] [INFO ] [MAIN ] Derivative Progress: 316/2052 symbols. CAPL took 0.4s. Estimated remaining time: 11m 33s [2025-10-22T23:22:34.449524] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:34.499019] [DEBUG] [LOCAL ] CARR: Loaded 53603 existing records from primary storage. [2025-10-22T23:22:34.499180] [INFO ] [MAIN ] CARR: Loaded 53603 primary data records. [2025-10-22T23:22:34.802748] [DEBUG] [MAIN ] CARR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:34.827886] [INFO ] [MAIN ] CARR: Generated 138 derivative records from 53603 primary records. [2025-10-22T23:22:34.827998] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-22T23:22:34.842814] [DEBUG] [LOCAL ] CARR: Derivative data saved (1794 records). [2025-10-22T23:22:34.842898] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-22T23:22:34.845941] [INFO ] [MAIN ] Derivative Progress: 317/2052 symbols. CARR took 0.4s. Estimated remaining time: 11m 32s [2025-10-22T23:22:34.846044] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:34.882955] [DEBUG] [LOCAL ] CARS: Loaded 39772 existing records from primary storage. [2025-10-22T23:22:34.883113] [INFO ] [MAIN ] CARS: Loaded 39772 primary data records. [2025-10-22T23:22:35.187327] [DEBUG] [MAIN ] CARS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:35.212138] [INFO ] [MAIN ] CARS: Generated 138 derivative records from 39772 primary records. [2025-10-22T23:22:35.212289] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-22T23:22:35.227297] [DEBUG] [LOCAL ] CARS: Derivative data saved (1794 records). [2025-10-22T23:22:35.227401] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-10-22T23:22:35.230353] [INFO ] [MAIN ] Derivative Progress: 318/2052 symbols. CARS took 0.4s. Estimated remaining time: 11m 32s [2025-10-22T23:22:35.230467] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:35.281703] [DEBUG] [LOCAL ] CAT: Loaded 52953 existing records from primary storage. [2025-10-22T23:22:35.281873] [INFO ] [MAIN ] CAT: Loaded 52953 primary data records. [2025-10-22T23:22:35.588138] [DEBUG] [MAIN ] CAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:35.613168] [INFO ] [MAIN ] CAT: Generated 138 derivative records from 52953 primary records. [2025-10-22T23:22:35.613345] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-22T23:22:35.629098] [DEBUG] [LOCAL ] CAT: Derivative data saved (1794 records). [2025-10-22T23:22:35.629262] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-22T23:22:35.632439] [INFO ] [MAIN ] Derivative Progress: 319/2052 symbols. CAT took 0.4s. Estimated remaining time: 11m 32s [2025-10-22T23:22:35.632569] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:35.643158] [DEBUG] [LOCAL ] CATO: Loaded 6647 existing records from primary storage. [2025-10-22T23:22:35.643298] [INFO ] [MAIN ] CATO: Loaded 6647 primary data records. [2025-10-22T23:22:35.972582] [DEBUG] [MAIN ] CATO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:35.998952] [INFO ] [MAIN ] CATO: Generated 138 derivative records from 6647 primary records. [2025-10-22T23:22:35.999133] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-22T23:22:36.013306] [DEBUG] [LOCAL ] CATO: Derivative data saved (1794 records). [2025-10-22T23:22:36.013391] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-22T23:22:36.015667] [INFO ] [MAIN ] Derivative Progress: 320/2052 symbols. CATO took 0.4s. Estimated remaining time: 11m 31s [2025-10-22T23:22:36.015769] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:36.065872] [DEBUG] [LOCAL ] CAVA: Loaded 53551 existing records from primary storage. [2025-10-22T23:22:36.066039] [INFO ] [MAIN ] CAVA: Loaded 53551 primary data records. [2025-10-22T23:22:36.371060] [DEBUG] [MAIN ] CAVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:36.395801] [INFO ] [MAIN ] CAVA: Generated 138 derivative records from 53551 primary records. [2025-10-22T23:22:36.395914] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-10-22T23:22:36.410868] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1794 records). [2025-10-22T23:22:36.410953] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-10-22T23:22:36.413958] [INFO ] [MAIN ] Derivative Progress: 321/2052 symbols. CAVA took 0.4s. Estimated remaining time: 11m 31s [2025-10-22T23:22:36.414051] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:36.459419] [DEBUG] [LOCAL ] CB: Loaded 49964 existing records from primary storage. [2025-10-22T23:22:36.459584] [INFO ] [MAIN ] CB: Loaded 49964 primary data records. [2025-10-22T23:22:36.777783] [DEBUG] [MAIN ] CB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:36.808934] [INFO ] [MAIN ] CB: Generated 138 derivative records from 49964 primary records. [2025-10-22T23:22:36.809117] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-22T23:22:36.824206] [DEBUG] [LOCAL ] CB: Derivative data saved (1794 records). [2025-10-22T23:22:36.824325] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-22T23:22:36.827442] [INFO ] [MAIN ] Derivative Progress: 322/2052 symbols. CB took 0.4s. Estimated remaining time: 11m 30s [2025-10-22T23:22:36.827538] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:36.841042] [DEBUG] [LOCAL ] CBAN: Loaded 10154 existing records from primary storage. [2025-10-22T23:22:36.841166] [INFO ] [MAIN ] CBAN: Loaded 10154 primary data records. [2025-10-22T23:22:37.149544] [DEBUG] [MAIN ] CBAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:37.174502] [INFO ] [MAIN ] CBAN: Generated 138 derivative records from 10154 primary records. [2025-10-22T23:22:37.174684] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-22T23:22:37.189859] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1794 records). [2025-10-22T23:22:37.189958] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-10-22T23:22:37.192020] [INFO ] [MAIN ] Derivative Progress: 323/2052 symbols. CBAN took 0.4s. Estimated remaining time: 11m 30s [2025-10-22T23:22:37.192108] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:37.210348] [DEBUG] [LOCAL ] CBL: Loaded 16048 existing records from primary storage. [2025-10-22T23:22:37.210501] [INFO ] [MAIN ] CBL: Loaded 16048 primary data records. [2025-10-22T23:22:37.517539] [DEBUG] [MAIN ] CBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:37.542432] [INFO ] [MAIN ] CBL: Generated 138 derivative records from 16048 primary records. [2025-10-22T23:22:37.542558] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-22T23:22:37.557445] [DEBUG] [LOCAL ] CBL: Derivative data saved (1794 records). [2025-10-22T23:22:37.557533] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-22T23:22:37.561864] [INFO ] [MAIN ] Derivative Progress: 324/2052 symbols. CBL took 0.4s. Estimated remaining time: 11m 29s [2025-10-22T23:22:37.561962] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:37.566709] [DEBUG] [LOCAL ] CBNA: Loaded 2864 existing records from primary storage. [2025-10-22T23:22:37.566800] [INFO ] [MAIN ] CBNA: Loaded 2864 primary data records. [2025-10-22T23:22:37.897227] [DEBUG] [MAIN ] CBNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:37.925380] [INFO ] [MAIN ] CBNA: Generated 138 derivative records from 2864 primary records. [2025-10-22T23:22:37.925576] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-22T23:22:37.938364] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1794 records). [2025-10-22T23:22:37.938453] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-22T23:22:37.940639] [INFO ] [MAIN ] Derivative Progress: 325/2052 symbols. CBNA took 0.4s. Estimated remaining time: 11m 29s [2025-10-22T23:22:37.940772] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:37.989004] [DEBUG] [LOCAL ] CBRE: Loaded 50278 existing records from primary storage. [2025-10-22T23:22:37.989179] [INFO ] [MAIN ] CBRE: Loaded 50278 primary data records. [2025-10-22T23:22:38.295696] [DEBUG] [MAIN ] CBRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:38.322263] [INFO ] [MAIN ] CBRE: Generated 138 derivative records from 50278 primary records. [2025-10-22T23:22:38.322426] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-22T23:22:38.338050] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1794 records). [2025-10-22T23:22:38.338152] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-22T23:22:38.341137] [INFO ] [MAIN ] Derivative Progress: 326/2052 symbols. CBRE took 0.4s. Estimated remaining time: 11m 28s [2025-10-22T23:22:38.341231] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:38.370755] [DEBUG] [LOCAL ] CBT: Loaded 30925 existing records from primary storage. [2025-10-22T23:22:38.370908] [INFO ] [MAIN ] CBT: Loaded 30925 primary data records. [2025-10-22T23:22:38.685115] [DEBUG] [MAIN ] CBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:38.710410] [INFO ] [MAIN ] CBT: Generated 138 derivative records from 30925 primary records. [2025-10-22T23:22:38.710539] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-22T23:22:38.725411] [DEBUG] [LOCAL ] CBT: Derivative data saved (1794 records). [2025-10-22T23:22:38.725493] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-22T23:22:38.728298] [INFO ] [MAIN ] Derivative Progress: 327/2052 symbols. CBT took 0.4s. Estimated remaining time: 11m 28s [2025-10-22T23:22:38.728390] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:38.751252] [DEBUG] [LOCAL ] CBU: Loaded 22633 existing records from primary storage. [2025-10-22T23:22:38.751402] [INFO ] [MAIN ] CBU: Loaded 22633 primary data records. [2025-10-22T23:22:39.061397] [DEBUG] [MAIN ] CBU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:39.088046] [INFO ] [MAIN ] CBU: Generated 138 derivative records from 22633 primary records. [2025-10-22T23:22:39.088261] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-22T23:22:39.103092] [DEBUG] [LOCAL ] CBU: Derivative data saved (1794 records). [2025-10-22T23:22:39.103192] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-22T23:22:39.106016] [INFO ] [MAIN ] Derivative Progress: 328/2052 symbols. CBU took 0.4s. Estimated remaining time: 11m 27s [2025-10-22T23:22:39.106115] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:39.139100] [DEBUG] [LOCAL ] CBZ: Loaded 34267 existing records from primary storage. [2025-10-22T23:22:39.139265] [INFO ] [MAIN ] CBZ: Loaded 34267 primary data records. [2025-10-22T23:22:39.455781] [DEBUG] [MAIN ] CBZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:39.481240] [INFO ] [MAIN ] CBZ: Generated 138 derivative records from 34267 primary records. [2025-10-22T23:22:39.481359] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-22T23:22:39.495995] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1794 records). [2025-10-22T23:22:39.496076] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-10-22T23:22:39.498936] [INFO ] [MAIN ] Derivative Progress: 329/2052 symbols. CBZ took 0.4s. Estimated remaining time: 11m 27s [2025-10-22T23:22:39.499027] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:39.549772] [DEBUG] [LOCAL ] CC: Loaded 53015 existing records from primary storage. [2025-10-22T23:22:39.549934] [INFO ] [MAIN ] CC: Loaded 53015 primary data records. [2025-10-22T23:22:39.863247] [DEBUG] [MAIN ] CC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:39.888331] [INFO ] [MAIN ] CC: Generated 138 derivative records from 53015 primary records. [2025-10-22T23:22:39.888444] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-22T23:22:39.903362] [DEBUG] [LOCAL ] CC: Derivative data saved (1794 records). [2025-10-22T23:22:39.903444] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-22T23:22:39.906786] [INFO ] [MAIN ] Derivative Progress: 330/2052 symbols. CC took 0.4s. Estimated remaining time: 11m 27s [2025-10-22T23:22:39.906892] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:39.958212] [DEBUG] [LOCAL ] CCI: Loaded 53109 existing records from primary storage. [2025-10-22T23:22:39.958372] [INFO ] [MAIN ] CCI: Loaded 53109 primary data records. [2025-10-22T23:22:40.284025] [DEBUG] [MAIN ] CCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:40.309340] [INFO ] [MAIN ] CCI: Generated 138 derivative records from 53109 primary records. [2025-10-22T23:22:40.309470] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-22T23:22:40.324286] [DEBUG] [LOCAL ] CCI: Derivative data saved (1794 records). [2025-10-22T23:22:40.324379] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-22T23:22:40.327520] [INFO ] [MAIN ] Derivative Progress: 331/2052 symbols. CCI took 0.4s. Estimated remaining time: 11m 26s [2025-10-22T23:22:40.327621] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:40.344292] [DEBUG] [LOCAL ] CCIF: Loaded 15143 existing records from primary storage. [2025-10-22T23:22:40.344432] [INFO ] [MAIN ] CCIF: Loaded 15143 primary data records. [2025-10-22T23:22:40.652174] [DEBUG] [MAIN ] CCIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:40.677248] [INFO ] [MAIN ] CCIF: Generated 138 derivative records from 15143 primary records. [2025-10-22T23:22:40.677455] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-22T23:22:40.692335] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1794 records). [2025-10-22T23:22:40.692421] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-22T23:22:40.694609] [INFO ] [MAIN ] Derivative Progress: 332/2052 symbols. CCIF took 0.4s. Estimated remaining time: 11m 26s [2025-10-22T23:22:40.694733] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:40.744560] [DEBUG] [LOCAL ] CCJ: Loaded 53690 existing records from primary storage. [2025-10-22T23:22:40.744788] [INFO ] [MAIN ] CCJ: Loaded 53690 primary data records. [2025-10-22T23:22:41.062101] [DEBUG] [MAIN ] CCJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:41.088590] [INFO ] [MAIN ] CCJ: Generated 138 derivative records from 53690 primary records. [2025-10-22T23:22:41.088825] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-22T23:22:41.103781] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1794 records). [2025-10-22T23:22:41.103867] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-22T23:22:41.107029] [INFO ] [MAIN ] Derivative Progress: 333/2052 symbols. CCJ took 0.4s. Estimated remaining time: 11m 25s [2025-10-22T23:22:41.107121] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:41.153825] [DEBUG] [LOCAL ] CCK: Loaded 46505 existing records from primary storage. [2025-10-22T23:22:41.153989] [INFO ] [MAIN ] CCK: Loaded 46505 primary data records. [2025-10-22T23:22:41.501544] [DEBUG] [MAIN ] CCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:41.526488] [INFO ] [MAIN ] CCK: Generated 138 derivative records from 46505 primary records. [2025-10-22T23:22:41.526580] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-22T23:22:41.541458] [DEBUG] [LOCAL ] CCK: Derivative data saved (1794 records). [2025-10-22T23:22:41.541537] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-10-22T23:22:41.544546] [INFO ] [MAIN ] Derivative Progress: 334/2052 symbols. CCK took 0.4s. Estimated remaining time: 11m 25s [2025-10-22T23:22:41.544636] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:41.596135] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-22T23:22:41.596296] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-10-22T23:22:41.905305] [DEBUG] [MAIN ] CCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:41.929910] [INFO ] [MAIN ] CCL: Generated 138 derivative records from 53800 primary records. [2025-10-22T23:22:41.930066] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-22T23:22:41.945532] [DEBUG] [LOCAL ] CCL: Derivative data saved (1794 records). [2025-10-22T23:22:41.945615] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-22T23:22:41.949268] [INFO ] [MAIN ] Derivative Progress: 335/2052 symbols. CCL took 0.4s. Estimated remaining time: 11m 25s [2025-10-22T23:22:41.949363] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:41.994063] [DEBUG] [LOCAL ] CCO: Loaded 48537 existing records from primary storage. [2025-10-22T23:22:41.994226] [INFO ] [MAIN ] CCO: Loaded 48537 primary data records. [2025-10-22T23:22:42.323815] [DEBUG] [MAIN ] CCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:42.350408] [INFO ] [MAIN ] CCO: Generated 138 derivative records from 48537 primary records. [2025-10-22T23:22:42.350561] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-22T23:22:42.365884] [DEBUG] [LOCAL ] CCO: Derivative data saved (1794 records). [2025-10-22T23:22:42.365978] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-22T23:22:42.369097] [INFO ] [MAIN ] Derivative Progress: 336/2052 symbols. CCO took 0.4s. Estimated remaining time: 11m 25s [2025-10-22T23:22:42.369186] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:42.380774] [DEBUG] [LOCAL ] CCRD: Loaded 9562 existing records from primary storage. [2025-10-22T23:22:42.380899] [INFO ] [MAIN ] CCRD: Loaded 9562 primary data records. [2025-10-22T23:22:42.684717] [DEBUG] [MAIN ] CCRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:42.709768] [INFO ] [MAIN ] CCRD: Generated 138 derivative records from 9562 primary records. [2025-10-22T23:22:42.709883] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-22T23:22:42.724453] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1794 records). [2025-10-22T23:22:42.724533] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-22T23:22:42.726777] [INFO ] [MAIN ] Derivative Progress: 337/2052 symbols. CCRD took 0.4s. Estimated remaining time: 11m 24s [2025-10-22T23:22:42.726865] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:42.755203] [DEBUG] [LOCAL ] CCS: Loaded 29903 existing records from primary storage. [2025-10-22T23:22:42.755348] [INFO ] [MAIN ] CCS: Loaded 29903 primary data records. [2025-10-22T23:22:43.059960] [DEBUG] [MAIN ] CCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:43.084902] [INFO ] [MAIN ] CCS: Generated 138 derivative records from 29903 primary records. [2025-10-22T23:22:43.085078] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-22T23:22:43.099841] [DEBUG] [LOCAL ] CCS: Derivative data saved (1794 records). [2025-10-22T23:22:43.099925] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-10-22T23:22:43.102804] [INFO ] [MAIN ] Derivative Progress: 338/2052 symbols. CCS took 0.4s. Estimated remaining time: 11m 23s [2025-10-22T23:22:43.102892] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:43.124031] [DEBUG] [LOCAL ] CCU: Loaded 21640 existing records from primary storage. [2025-10-22T23:22:43.124168] [INFO ] [MAIN ] CCU: Loaded 21640 primary data records. [2025-10-22T23:22:43.426319] [DEBUG] [MAIN ] CCU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:43.451000] [INFO ] [MAIN ] CCU: Generated 138 derivative records from 21640 primary records. [2025-10-22T23:22:43.451103] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-22T23:22:43.465771] [DEBUG] [LOCAL ] CCU: Derivative data saved (1794 records). [2025-10-22T23:22:43.465850] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-10-22T23:22:43.468751] [INFO ] [MAIN ] Derivative Progress: 339/2052 symbols. CCU took 0.4s. Estimated remaining time: 11m 23s [2025-10-22T23:22:43.468844] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:43.518623] [DEBUG] [LOCAL ] CDE: Loaded 53644 existing records from primary storage. [2025-10-22T23:22:43.518813] [INFO ] [MAIN ] CDE: Loaded 53644 primary data records. [2025-10-22T23:22:43.820361] [DEBUG] [MAIN ] CDE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:43.845026] [INFO ] [MAIN ] CDE: Generated 138 derivative records from 53644 primary records. [2025-10-22T23:22:43.845129] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-22T23:22:43.860136] [DEBUG] [LOCAL ] CDE: Derivative data saved (1794 records). [2025-10-22T23:22:43.860218] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-22T23:22:43.863328] [INFO ] [MAIN ] Derivative Progress: 340/2052 symbols. CDE took 0.4s. Estimated remaining time: 11m 22s [2025-10-22T23:22:43.863422] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:43.875510] [DEBUG] [LOCAL ] CDLR: Loaded 10195 existing records from primary storage. [2025-10-22T23:22:43.875629] [INFO ] [MAIN ] CDLR: Loaded 10195 primary data records. [2025-10-22T23:22:44.202066] [DEBUG] [MAIN ] CDLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:44.226737] [INFO ] [MAIN ] CDLR: Generated 138 derivative records from 10195 primary records. [2025-10-22T23:22:44.226870] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-22T23:22:44.241547] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1794 records). [2025-10-22T23:22:44.241627] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-22T23:22:44.243756] [INFO ] [MAIN ] Derivative Progress: 341/2052 symbols. CDLR took 0.4s. Estimated remaining time: 11m 22s [2025-10-22T23:22:44.243845] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:44.280810] [DEBUG] [LOCAL ] CDP: Loaded 42262 existing records from primary storage. [2025-10-22T23:22:44.280967] [INFO ] [MAIN ] CDP: Loaded 42262 primary data records. [2025-10-22T23:22:44.591002] [DEBUG] [MAIN ] CDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:44.616079] [INFO ] [MAIN ] CDP: Generated 138 derivative records from 42262 primary records. [2025-10-22T23:22:44.616204] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-22T23:22:44.632521] [DEBUG] [LOCAL ] CDP: Derivative data saved (1794 records). [2025-10-22T23:22:44.632720] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-22T23:22:44.635761] [INFO ] [MAIN ] Derivative Progress: 342/2052 symbols. CDP took 0.4s. Estimated remaining time: 11m 22s [2025-10-22T23:22:44.635948] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:44.660092] [DEBUG] [LOCAL ] CDRE: Loaded 24728 existing records from primary storage. [2025-10-22T23:22:44.660251] [INFO ] [MAIN ] CDRE: Loaded 24728 primary data records. [2025-10-22T23:22:44.962205] [DEBUG] [MAIN ] CDRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:44.986852] [INFO ] [MAIN ] CDRE: Generated 138 derivative records from 24728 primary records. [2025-10-22T23:22:44.986967] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-22T23:22:45.001720] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1794 records). [2025-10-22T23:22:45.001820] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-22T23:22:45.004610] [INFO ] [MAIN ] Derivative Progress: 343/2052 symbols. CDRE took 0.4s. Estimated remaining time: 11m 21s [2025-10-22T23:22:45.004740] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:45.052568] [DEBUG] [LOCAL ] CE: Loaded 51253 existing records from primary storage. [2025-10-22T23:22:45.052756] [INFO ] [MAIN ] CE: Loaded 51253 primary data records. [2025-10-22T23:22:45.354792] [DEBUG] [MAIN ] CE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:45.379611] [INFO ] [MAIN ] CE: Generated 138 derivative records from 51253 primary records. [2025-10-22T23:22:45.379741] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-22T23:22:45.394399] [DEBUG] [LOCAL ] CE: Derivative data saved (1794 records). [2025-10-22T23:22:45.394479] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-22T23:22:45.397585] [INFO ] [MAIN ] Derivative Progress: 344/2052 symbols. CE took 0.4s. Estimated remaining time: 11m 21s [2025-10-22T23:22:45.397712] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:45.423692] [DEBUG] [LOCAL ] CEPU: Loaded 27008 existing records from primary storage. [2025-10-22T23:22:45.423832] [INFO ] [MAIN ] CEPU: Loaded 27008 primary data records. [2025-10-22T23:22:45.729081] [DEBUG] [MAIN ] CEPU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:45.753808] [INFO ] [MAIN ] CEPU: Generated 138 derivative records from 27008 primary records. [2025-10-22T23:22:45.753940] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-22T23:22:45.768907] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1794 records). [2025-10-22T23:22:45.768992] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-22T23:22:45.771889] [INFO ] [MAIN ] Derivative Progress: 345/2052 symbols. CEPU took 0.4s. Estimated remaining time: 11m 20s [2025-10-22T23:22:45.771979] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:45.820993] [DEBUG] [LOCAL ] CFG: Loaded 53623 existing records from primary storage. [2025-10-22T23:22:45.821157] [INFO ] [MAIN ] CFG: Loaded 53623 primary data records. [2025-10-22T23:22:46.126235] [DEBUG] [MAIN ] CFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:46.151080] [INFO ] [MAIN ] CFG: Generated 138 derivative records from 53623 primary records. [2025-10-22T23:22:46.151239] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-22T23:22:46.166303] [DEBUG] [LOCAL ] CFG: Derivative data saved (1794 records). [2025-10-22T23:22:46.166443] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-22T23:22:46.169778] [INFO ] [MAIN ] Derivative Progress: 346/2052 symbols. CFG took 0.4s. Estimated remaining time: 11m 20s [2025-10-22T23:22:46.170005] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:46.209272] [DEBUG] [LOCAL ] CGAU: Loaded 43921 existing records from primary storage. [2025-10-22T23:22:46.209437] [INFO ] [MAIN ] CGAU: Loaded 43921 primary data records. [2025-10-22T23:22:46.544849] [DEBUG] [MAIN ] CGAU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:46.570164] [INFO ] [MAIN ] CGAU: Generated 138 derivative records from 43921 primary records. [2025-10-22T23:22:46.570295] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-22T23:22:46.585001] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1794 records). [2025-10-22T23:22:46.585115] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-10-22T23:22:46.588370] [INFO ] [MAIN ] Derivative Progress: 347/2052 symbols. CGAU took 0.4s. Estimated remaining time: 11m 19s [2025-10-22T23:22:46.588474] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:46.591460] [DEBUG] [LOCAL ] CGV: Loaded 1359 existing records from primary storage. [2025-10-22T23:22:46.591548] [INFO ] [MAIN ] CGV: Loaded 1359 primary data records. [2025-10-22T23:22:46.908747] [DEBUG] [MAIN ] CGV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:22:46.934254] [INFO ] [MAIN ] CGV: Generated 138 derivative records from 1359 primary records. [2025-10-22T23:22:46.934404] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-22T23:22:46.947697] [DEBUG] [LOCAL ] CGV: Derivative data saved (1793 records). [2025-10-22T23:22:46.947791] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-22T23:22:46.950047] [INFO ] [MAIN ] Derivative Progress: 348/2052 symbols. CGV took 0.4s. Estimated remaining time: 11m 19s [2025-10-22T23:22:46.950140] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:46.973457] [DEBUG] [LOCAL ] CHCT: Loaded 24266 existing records from primary storage. [2025-10-22T23:22:46.973623] [INFO ] [MAIN ] CHCT: Loaded 24266 primary data records. [2025-10-22T23:22:47.297195] [DEBUG] [MAIN ] CHCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:47.323152] [INFO ] [MAIN ] CHCT: Generated 138 derivative records from 24266 primary records. [2025-10-22T23:22:47.323303] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-10-22T23:22:47.339027] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1794 records). [2025-10-22T23:22:47.339118] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-10-22T23:22:47.341949] [INFO ] [MAIN ] Derivative Progress: 349/2052 symbols. CHCT took 0.4s. Estimated remaining time: 11m 18s [2025-10-22T23:22:47.342044] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:47.392097] [DEBUG] [LOCAL ] CHD: Loaded 52320 existing records from primary storage. [2025-10-22T23:22:47.392275] [INFO ] [MAIN ] CHD: Loaded 52320 primary data records. [2025-10-22T23:22:47.698987] [DEBUG] [MAIN ] CHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:47.724480] [INFO ] [MAIN ] CHD: Generated 138 derivative records from 52320 primary records. [2025-10-22T23:22:47.724608] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-22T23:22:47.740390] [DEBUG] [LOCAL ] CHD: Derivative data saved (1794 records). [2025-10-22T23:22:47.740480] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-10-22T23:22:47.743904] [INFO ] [MAIN ] Derivative Progress: 350/2052 symbols. CHD took 0.4s. Estimated remaining time: 11m 18s [2025-10-22T23:22:47.744007] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:47.763090] [DEBUG] [LOCAL ] CHE: Loaded 15327 existing records from primary storage. [2025-10-22T23:22:47.763230] [INFO ] [MAIN ] CHE: Loaded 15327 primary data records. [2025-10-22T23:22:48.080562] [DEBUG] [MAIN ] CHE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:48.107256] [INFO ] [MAIN ] CHE: Generated 138 derivative records from 15327 primary records. [2025-10-22T23:22:48.107428] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-22T23:22:48.123055] [DEBUG] [LOCAL ] CHE: Derivative data saved (1794 records). [2025-10-22T23:22:48.123137] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-22T23:22:48.125363] [INFO ] [MAIN ] Derivative Progress: 351/2052 symbols. CHE took 0.4s. Estimated remaining time: 11m 17s [2025-10-22T23:22:48.125451] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:48.171680] [DEBUG] [LOCAL ] CHGG: Loaded 47586 existing records from primary storage. [2025-10-22T23:22:48.171844] [INFO ] [MAIN ] CHGG: Loaded 47586 primary data records. [2025-10-22T23:22:48.515241] [DEBUG] [MAIN ] CHGG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:48.540780] [INFO ] [MAIN ] CHGG: Generated 138 derivative records from 47586 primary records. [2025-10-22T23:22:48.540924] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-10-22T23:22:48.556044] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1794 records). [2025-10-22T23:22:48.556130] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-10-22T23:22:48.559370] [INFO ] [MAIN ] Derivative Progress: 352/2052 symbols. CHGG took 0.4s. Estimated remaining time: 11m 17s [2025-10-22T23:22:48.559475] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:48.593187] [DEBUG] [LOCAL ] CHH: Loaded 32225 existing records from primary storage. [2025-10-22T23:22:48.593350] [INFO ] [MAIN ] CHH: Loaded 32225 primary data records. [2025-10-22T23:22:48.905438] [DEBUG] [MAIN ] CHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:48.931170] [INFO ] [MAIN ] CHH: Generated 138 derivative records from 32225 primary records. [2025-10-22T23:22:48.931311] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-22T23:22:48.946483] [DEBUG] [LOCAL ] CHH: Derivative data saved (1794 records). [2025-10-22T23:22:48.946568] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-10-22T23:22:48.949504] [INFO ] [MAIN ] Derivative Progress: 353/2052 symbols. CHH took 0.4s. Estimated remaining time: 11m 17s [2025-10-22T23:22:48.949595] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:48.972407] [DEBUG] [LOCAL ] CHMI: Loaded 21188 existing records from primary storage. [2025-10-22T23:22:48.972557] [INFO ] [MAIN ] CHMI: Loaded 21188 primary data records. [2025-10-22T23:22:49.291254] [DEBUG] [MAIN ] CHMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:49.316066] [INFO ] [MAIN ] CHMI: Generated 138 derivative records from 21188 primary records. [2025-10-22T23:22:49.316172] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-10-22T23:22:49.330533] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1794 records). [2025-10-22T23:22:49.330614] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-10-22T23:22:49.333460] [INFO ] [MAIN ] Derivative Progress: 354/2052 symbols. CHMI took 0.4s. Estimated remaining time: 11m 16s [2025-10-22T23:22:49.333552] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:49.342709] [DEBUG] [LOCAL ] CHN: Loaded 4983 existing records from primary storage. [2025-10-22T23:22:49.342828] [INFO ] [MAIN ] CHN: Loaded 4983 primary data records. [2025-10-22T23:22:49.647837] [DEBUG] [MAIN ] CHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:49.673144] [INFO ] [MAIN ] CHN: Generated 138 derivative records from 4983 primary records. [2025-10-22T23:22:49.673266] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-10-22T23:22:49.686739] [DEBUG] [LOCAL ] CHN: Derivative data saved (1794 records). [2025-10-22T23:22:49.686817] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-10-22T23:22:49.689081] [INFO ] [MAIN ] Derivative Progress: 355/2052 symbols. CHN took 0.4s. Estimated remaining time: 11m 16s [2025-10-22T23:22:49.689170] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:49.734538] [DEBUG] [LOCAL ] CHPT: Loaded 47004 existing records from primary storage. [2025-10-22T23:22:49.734719] [INFO ] [MAIN ] CHPT: Loaded 47004 primary data records. [2025-10-22T23:22:50.039194] [DEBUG] [MAIN ] CHPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:50.064211] [INFO ] [MAIN ] CHPT: Generated 138 derivative records from 47004 primary records. [2025-10-22T23:22:50.064351] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-10-22T23:22:50.079288] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1794 records). [2025-10-22T23:22:50.079369] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-10-22T23:22:50.084912] [INFO ] [MAIN ] Derivative Progress: 356/2052 symbols. CHPT took 0.4s. Estimated remaining time: 11m 15s [2025-10-22T23:22:50.085012] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:50.103310] [DEBUG] [LOCAL ] CIA: Loaded 16492 existing records from primary storage. [2025-10-22T23:22:50.103452] [INFO ] [MAIN ] CIA: Loaded 16492 primary data records. [2025-10-22T23:22:50.434831] [DEBUG] [MAIN ] CIA: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:22:50.460561] [INFO ] [MAIN ] CIA: Generated 138 derivative records from 16492 primary records. [2025-10-22T23:22:50.460773] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-22T23:22:50.475059] [DEBUG] [LOCAL ] CIA: Derivative data saved (1793 records). [2025-10-22T23:22:50.475144] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-10-22T23:22:50.478032] [INFO ] [MAIN ] Derivative Progress: 357/2052 symbols. CIA took 0.4s. Estimated remaining time: 11m 15s [2025-10-22T23:22:50.478121] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:50.512189] [DEBUG] [LOCAL ] CIB: Loaded 30292 existing records from primary storage. [2025-10-22T23:22:50.512348] [INFO ] [MAIN ] CIB: Loaded 30292 primary data records. [2025-10-22T23:22:50.814090] [DEBUG] [MAIN ] CIB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:50.839276] [INFO ] [MAIN ] CIB: Generated 138 derivative records from 30292 primary records. [2025-10-22T23:22:50.839375] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-10-22T23:22:50.853833] [DEBUG] [LOCAL ] CIB: Derivative data saved (1794 records). [2025-10-22T23:22:50.853922] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-10-22T23:22:50.856836] [INFO ] [MAIN ] Derivative Progress: 358/2052 symbols. CIB took 0.4s. Estimated remaining time: 11m 14s [2025-10-22T23:22:50.856931] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:50.909139] [DEBUG] [LOCAL ] CIEN: Loaded 52121 existing records from primary storage. [2025-10-22T23:22:50.909296] [INFO ] [MAIN ] CIEN: Loaded 52121 primary data records. [2025-10-22T23:22:51.209141] [DEBUG] [MAIN ] CIEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:51.233572] [INFO ] [MAIN ] CIEN: Generated 138 derivative records from 52121 primary records. [2025-10-22T23:22:51.233692] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-10-22T23:22:51.248247] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1794 records). [2025-10-22T23:22:51.248325] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-10-22T23:22:51.251400] [INFO ] [MAIN ] Derivative Progress: 359/2052 symbols. CIEN took 0.4s. Estimated remaining time: 11m 14s [2025-10-22T23:22:51.251496] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:51.258908] [DEBUG] [LOCAL ] CIF: Loaded 3978 existing records from primary storage. [2025-10-22T23:22:51.259006] [INFO ] [MAIN ] CIF: Loaded 3978 primary data records. [2025-10-22T23:22:51.557847] [DEBUG] [MAIN ] CIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:51.582407] [INFO ] [MAIN ] CIF: Generated 138 derivative records from 3978 primary records. [2025-10-22T23:22:51.582504] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-22T23:22:51.595574] [DEBUG] [LOCAL ] CIF: Derivative data saved (1794 records). [2025-10-22T23:22:51.595681] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-10-22T23:22:51.597878] [INFO ] [MAIN ] Derivative Progress: 360/2052 symbols. CIF took 0.3s. Estimated remaining time: 11m 13s [2025-10-22T23:22:51.597974] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:51.640429] [DEBUG] [LOCAL ] CIG: Loaded 44526 existing records from primary storage. [2025-10-22T23:22:51.640584] [INFO ] [MAIN ] CIG: Loaded 44526 primary data records. [2025-10-22T23:22:51.945325] [DEBUG] [MAIN ] CIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:51.970330] [INFO ] [MAIN ] CIG: Generated 138 derivative records from 44526 primary records. [2025-10-22T23:22:51.970484] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-10-22T23:22:51.985113] [DEBUG] [LOCAL ] CIG: Derivative data saved (1794 records). [2025-10-22T23:22:51.985217] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-10-22T23:22:51.988282] [INFO ] [MAIN ] Derivative Progress: 361/2052 symbols. CIG took 0.4s. Estimated remaining time: 11m 13s [2025-10-22T23:22:51.988384] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:52.006322] [DEBUG] [LOCAL ] CII: Loaded 15134 existing records from primary storage. [2025-10-22T23:22:52.006477] [INFO ] [MAIN ] CII: Loaded 15134 primary data records. [2025-10-22T23:22:52.339288] [DEBUG] [MAIN ] CII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:52.364377] [INFO ] [MAIN ] CII: Generated 138 derivative records from 15134 primary records. [2025-10-22T23:22:52.364493] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-10-22T23:22:52.379667] [DEBUG] [LOCAL ] CII: Derivative data saved (1794 records). [2025-10-22T23:22:52.379757] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-10-22T23:22:52.381992] [INFO ] [MAIN ] Derivative Progress: 362/2052 symbols. CII took 0.4s. Estimated remaining time: 11m 13s [2025-10-22T23:22:52.382090] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:52.419756] [DEBUG] [LOCAL ] CIM: Loaded 37394 existing records from primary storage. [2025-10-22T23:22:52.419923] [INFO ] [MAIN ] CIM: Loaded 37394 primary data records. [2025-10-22T23:22:52.723624] [DEBUG] [MAIN ] CIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:52.748115] [INFO ] [MAIN ] CIM: Generated 138 derivative records from 37394 primary records. [2025-10-22T23:22:52.748245] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-10-22T23:22:52.763497] [DEBUG] [LOCAL ] CIM: Derivative data saved (1794 records). [2025-10-22T23:22:52.763578] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-10-22T23:22:52.766579] [INFO ] [MAIN ] Derivative Progress: 363/2052 symbols. CIM took 0.4s. Estimated remaining time: 11m 12s [2025-10-22T23:22:52.766709] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:52.771788] [DEBUG] [LOCAL ] CIMN: Loaded 2705 existing records from primary storage. [2025-10-22T23:22:52.771875] [INFO ] [MAIN ] CIMN: Loaded 2705 primary data records. [2025-10-22T23:22:53.087815] [DEBUG] [MAIN ] CIMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:53.112382] [INFO ] [MAIN ] CIMN: Generated 138 derivative records from 2705 primary records. [2025-10-22T23:22:53.112526] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-10-22T23:22:53.125306] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1794 records). [2025-10-22T23:22:53.125390] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-10-22T23:22:53.127681] [INFO ] [MAIN ] Derivative Progress: 364/2052 symbols. CIMN took 0.4s. Estimated remaining time: 11m 11s [2025-10-22T23:22:53.127773] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:53.147813] [DEBUG] [LOCAL ] CINT: Loaded 20384 existing records from primary storage. [2025-10-22T23:22:53.147946] [INFO ] [MAIN ] CINT: Loaded 20384 primary data records. [2025-10-22T23:22:53.447803] [DEBUG] [MAIN ] CINT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:53.472703] [INFO ] [MAIN ] CINT: Generated 138 derivative records from 20384 primary records. [2025-10-22T23:22:53.472831] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-10-22T23:22:53.487081] [DEBUG] [LOCAL ] CINT: Derivative data saved (1794 records). [2025-10-22T23:22:53.487158] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-10-22T23:22:53.490171] [INFO ] [MAIN ] Derivative Progress: 365/2052 symbols. CINT took 0.4s. Estimated remaining time: 11m 11s [2025-10-22T23:22:53.490265] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:53.511579] [DEBUG] [LOCAL ] CIO: Loaded 21207 existing records from primary storage. [2025-10-22T23:22:53.511734] [INFO ] [MAIN ] CIO: Loaded 21207 primary data records. [2025-10-22T23:22:53.813978] [DEBUG] [MAIN ] CIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:53.839303] [INFO ] [MAIN ] CIO: Generated 138 derivative records from 21207 primary records. [2025-10-22T23:22:53.839491] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-22T23:22:53.854109] [DEBUG] [LOCAL ] CIO: Derivative data saved (1794 records). [2025-10-22T23:22:53.854247] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-10-22T23:22:53.857226] [INFO ] [MAIN ] Derivative Progress: 366/2052 symbols. CIO took 0.4s. Estimated remaining time: 11m 10s [2025-10-22T23:22:53.857337] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:53.885634] [DEBUG] [LOCAL ] CION: Loaded 28073 existing records from primary storage. [2025-10-22T23:22:53.885830] [INFO ] [MAIN ] CION: Loaded 28073 primary data records. [2025-10-22T23:22:54.215543] [DEBUG] [MAIN ] CION: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:54.242213] [INFO ] [MAIN ] CION: Generated 138 derivative records from 28073 primary records. [2025-10-22T23:22:54.242407] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-10-22T23:22:54.257729] [DEBUG] [LOCAL ] CION: Derivative data saved (1794 records). [2025-10-22T23:22:54.257818] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-10-22T23:22:54.260957] [INFO ] [MAIN ] Derivative Progress: 367/2052 symbols. CION took 0.4s. Estimated remaining time: 11m 10s [2025-10-22T23:22:54.261061] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:54.312933] [DEBUG] [LOCAL ] CIVI: Loaded 52730 existing records from primary storage. [2025-10-22T23:22:54.313093] [INFO ] [MAIN ] CIVI: Loaded 52730 primary data records. [2025-10-22T23:22:54.651777] [DEBUG] [MAIN ] CIVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:54.677129] [INFO ] [MAIN ] CIVI: Generated 138 derivative records from 52730 primary records. [2025-10-22T23:22:54.677257] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-22T23:22:54.693144] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1794 records). [2025-10-22T23:22:54.693246] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-22T23:22:54.696587] [INFO ] [MAIN ] Derivative Progress: 368/2052 symbols. CIVI took 0.4s. Estimated remaining time: 11m 10s [2025-10-22T23:22:54.696740] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:54.747911] [DEBUG] [LOCAL ] CL: Loaded 53649 existing records from primary storage. [2025-10-22T23:22:54.748092] [INFO ] [MAIN ] CL: Loaded 53649 primary data records. [2025-10-22T23:22:55.162845] [DEBUG] [MAIN ] CL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:55.205304] [INFO ] [MAIN ] CL: Generated 138 derivative records from 53649 primary records. [2025-10-22T23:22:55.205551] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-10-22T23:22:55.226351] [DEBUG] [LOCAL ] CL: Derivative data saved (1794 records). [2025-10-22T23:22:55.226565] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-10-22T23:22:55.231581] [INFO ] [MAIN ] Derivative Progress: 369/2052 symbols. CL took 0.5s. Estimated remaining time: 11m 10s [2025-10-22T23:22:55.231873] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:55.283785] [DEBUG] [LOCAL ] CLB: Loaded 33453 existing records from primary storage. [2025-10-22T23:22:55.284008] [INFO ] [MAIN ] CLB: Loaded 33453 primary data records. [2025-10-22T23:22:55.690841] [DEBUG] [MAIN ] CLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:55.716673] [INFO ] [MAIN ] CLB: Generated 138 derivative records from 33453 primary records. [2025-10-22T23:22:55.716852] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-10-22T23:22:55.732102] [DEBUG] [LOCAL ] CLB: Derivative data saved (1794 records). [2025-10-22T23:22:55.732234] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-10-22T23:22:55.735332] [INFO ] [MAIN ] Derivative Progress: 370/2052 symbols. CLB took 0.5s. Estimated remaining time: 11m 10s [2025-10-22T23:22:55.735433] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:55.761604] [DEBUG] [LOCAL ] CLDT: Loaded 25165 existing records from primary storage. [2025-10-22T23:22:55.761803] [INFO ] [MAIN ] CLDT: Loaded 25165 primary data records. [2025-10-22T23:22:56.071141] [DEBUG] [MAIN ] CLDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:56.098987] [INFO ] [MAIN ] CLDT: Generated 138 derivative records from 25165 primary records. [2025-10-22T23:22:56.099187] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-22T23:22:56.117129] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1794 records). [2025-10-22T23:22:56.117324] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-10-22T23:22:56.121498] [INFO ] [MAIN ] Derivative Progress: 371/2052 symbols. CLDT took 0.4s. Estimated remaining time: 11m 10s [2025-10-22T23:22:56.121670] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:56.175579] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-22T23:22:56.175779] [INFO ] [MAIN ] CLF: Loaded 53741 primary data records. [2025-10-22T23:22:56.537625] [DEBUG] [MAIN ] CLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:56.562495] [INFO ] [MAIN ] CLF: Generated 138 derivative records from 53741 primary records. [2025-10-22T23:22:56.562620] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-10-22T23:22:56.577479] [DEBUG] [LOCAL ] CLF: Derivative data saved (1794 records). [2025-10-22T23:22:56.577558] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-10-22T23:22:56.580763] [INFO ] [MAIN ] Derivative Progress: 372/2052 symbols. CLF took 0.5s. Estimated remaining time: 11m 10s [2025-10-22T23:22:56.580855] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:56.608597] [DEBUG] [LOCAL ] CLH: Loaded 27584 existing records from primary storage. [2025-10-22T23:22:56.608919] [INFO ] [MAIN ] CLH: Loaded 27584 primary data records. [2025-10-22T23:22:56.934367] [DEBUG] [MAIN ] CLH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:56.962276] [INFO ] [MAIN ] CLH: Generated 138 derivative records from 27584 primary records. [2025-10-22T23:22:56.962475] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-22T23:22:56.979477] [DEBUG] [LOCAL ] CLH: Derivative data saved (1794 records). [2025-10-22T23:22:56.979592] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-10-22T23:22:56.982743] [INFO ] [MAIN ] Derivative Progress: 373/2052 symbols. CLH took 0.4s. Estimated remaining time: 11m 9s [2025-10-22T23:22:56.982857] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:56.996911] [DEBUG] [LOCAL ] CLPR: Loaded 9996 existing records from primary storage. [2025-10-22T23:22:56.997069] [INFO ] [MAIN ] CLPR: Loaded 9996 primary data records. [2025-10-22T23:22:57.317756] [DEBUG] [MAIN ] CLPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:57.342519] [INFO ] [MAIN ] CLPR: Generated 138 derivative records from 9996 primary records. [2025-10-22T23:22:57.342672] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-10-22T23:22:57.357362] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1794 records). [2025-10-22T23:22:57.357447] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-10-22T23:22:57.359872] [INFO ] [MAIN ] Derivative Progress: 374/2052 symbols. CLPR took 0.4s. Estimated remaining time: 11m 9s [2025-10-22T23:22:57.359966] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:57.412083] [DEBUG] [LOCAL ] CLS: Loaded 53563 existing records from primary storage. [2025-10-22T23:22:57.412247] [INFO ] [MAIN ] CLS: Loaded 53563 primary data records. [2025-10-22T23:22:57.714690] [DEBUG] [MAIN ] CLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:57.740076] [INFO ] [MAIN ] CLS: Generated 138 derivative records from 53563 primary records. [2025-10-22T23:22:57.740289] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-10-22T23:22:57.755746] [DEBUG] [LOCAL ] CLS: Derivative data saved (1794 records). [2025-10-22T23:22:57.755898] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-10-22T23:22:57.759028] [INFO ] [MAIN ] Derivative Progress: 375/2052 symbols. CLS took 0.4s. Estimated remaining time: 11m 8s [2025-10-22T23:22:57.759146] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:57.808781] [DEBUG] [LOCAL ] CLVT: Loaded 51912 existing records from primary storage. [2025-10-22T23:22:57.808944] [INFO ] [MAIN ] CLVT: Loaded 51912 primary data records. [2025-10-22T23:22:58.118636] [DEBUG] [MAIN ] CLVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:58.144055] [INFO ] [MAIN ] CLVT: Generated 138 derivative records from 51912 primary records. [2025-10-22T23:22:58.144179] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-10-22T23:22:58.158833] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1794 records). [2025-10-22T23:22:58.158923] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-10-22T23:22:58.162052] [INFO ] [MAIN ] Derivative Progress: 376/2052 symbols. CLVT took 0.4s. Estimated remaining time: 11m 8s [2025-10-22T23:22:58.162145] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:58.186138] [DEBUG] [LOCAL ] CLW: Loaded 21127 existing records from primary storage. [2025-10-22T23:22:58.186286] [INFO ] [MAIN ] CLW: Loaded 21127 primary data records. [2025-10-22T23:22:58.504403] [DEBUG] [MAIN ] CLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:58.529205] [INFO ] [MAIN ] CLW: Generated 138 derivative records from 21127 primary records. [2025-10-22T23:22:58.529318] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-22T23:22:58.544028] [DEBUG] [LOCAL ] CLW: Derivative data saved (1794 records). [2025-10-22T23:22:58.544111] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-22T23:22:58.546953] [INFO ] [MAIN ] Derivative Progress: 377/2052 symbols. CLW took 0.4s. Estimated remaining time: 11m 7s [2025-10-22T23:22:58.547049] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:58.598782] [DEBUG] [LOCAL ] CLX: Loaded 51814 existing records from primary storage. [2025-10-22T23:22:58.598941] [INFO ] [MAIN ] CLX: Loaded 51814 primary data records. [2025-10-22T23:22:58.931398] [DEBUG] [MAIN ] CLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:58.956435] [INFO ] [MAIN ] CLX: Generated 138 derivative records from 51814 primary records. [2025-10-22T23:22:58.956551] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-22T23:22:58.971476] [DEBUG] [LOCAL ] CLX: Derivative data saved (1794 records). [2025-10-22T23:22:58.971561] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-10-22T23:22:58.974689] [INFO ] [MAIN ] Derivative Progress: 378/2052 symbols. CLX took 0.4s. Estimated remaining time: 11m 7s [2025-10-22T23:22:58.974788] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:59.018133] [DEBUG] [LOCAL ] CM: Loaded 48431 existing records from primary storage. [2025-10-22T23:22:59.018288] [INFO ] [MAIN ] CM: Loaded 48431 primary data records. [2025-10-22T23:22:59.323460] [DEBUG] [MAIN ] CM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:59.349123] [INFO ] [MAIN ] CM: Generated 138 derivative records from 48431 primary records. [2025-10-22T23:22:59.349249] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-22T23:22:59.363986] [DEBUG] [LOCAL ] CM: Derivative data saved (1794 records). [2025-10-22T23:22:59.364077] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-22T23:22:59.366948] [INFO ] [MAIN ] Derivative Progress: 379/2052 symbols. CM took 0.4s. Estimated remaining time: 11m 7s [2025-10-22T23:22:59.367042] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:59.415407] [DEBUG] [LOCAL ] CMA: Loaded 50170 existing records from primary storage. [2025-10-22T23:22:59.415576] [INFO ] [MAIN ] CMA: Loaded 50170 primary data records. [2025-10-22T23:22:59.727054] [DEBUG] [MAIN ] CMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:22:59.752395] [INFO ] [MAIN ] CMA: Generated 138 derivative records from 50170 primary records. [2025-10-22T23:22:59.752510] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-10-22T23:22:59.767463] [DEBUG] [LOCAL ] CMA: Derivative data saved (1794 records). [2025-10-22T23:22:59.767555] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-10-22T23:22:59.770454] [INFO ] [MAIN ] Derivative Progress: 380/2052 symbols. CMA took 0.4s. Estimated remaining time: 11m 6s [2025-10-22T23:22:59.770544] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:22:59.797350] [DEBUG] [LOCAL ] CMBT: Loaded 27509 existing records from primary storage. [2025-10-22T23:22:59.797503] [INFO ] [MAIN ] CMBT: Loaded 27509 primary data records. [2025-10-22T23:23:00.113312] [DEBUG] [MAIN ] CMBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:00.139251] [INFO ] [MAIN ] CMBT: Generated 138 derivative records from 27509 primary records. [2025-10-22T23:23:00.139393] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-22T23:23:00.154147] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1794 records). [2025-10-22T23:23:00.154238] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-22T23:23:00.156951] [INFO ] [MAIN ] Derivative Progress: 381/2052 symbols. CMBT took 0.4s. Estimated remaining time: 11m 6s [2025-10-22T23:23:00.157043] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:00.199283] [DEBUG] [LOCAL ] CMC: Loaded 45548 existing records from primary storage. [2025-10-22T23:23:00.199441] [INFO ] [MAIN ] CMC: Loaded 45548 primary data records. [2025-10-22T23:23:00.511426] [DEBUG] [MAIN ] CMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:00.537187] [INFO ] [MAIN ] CMC: Generated 138 derivative records from 45548 primary records. [2025-10-22T23:23:00.537367] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-22T23:23:00.552189] [DEBUG] [LOCAL ] CMC: Derivative data saved (1794 records). [2025-10-22T23:23:00.552278] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-10-22T23:23:00.555171] [INFO ] [MAIN ] Derivative Progress: 382/2052 symbols. CMC took 0.4s. Estimated remaining time: 11m 5s [2025-10-22T23:23:00.555260] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:00.564018] [DEBUG] [LOCAL ] CMCM: Loaded 4828 existing records from primary storage. [2025-10-22T23:23:00.564141] [INFO ] [MAIN ] CMCM: Loaded 4828 primary data records. [2025-10-22T23:23:00.875861] [DEBUG] [MAIN ] CMCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:00.901590] [INFO ] [MAIN ] CMCM: Generated 138 derivative records from 4828 primary records. [2025-10-22T23:23:00.901753] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-22T23:23:00.914696] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1794 records). [2025-10-22T23:23:00.914788] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-22T23:23:00.916911] [INFO ] [MAIN ] Derivative Progress: 383/2052 symbols. CMCM took 0.4s. Estimated remaining time: 11m 5s [2025-10-22T23:23:00.917000] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:00.960339] [DEBUG] [LOCAL ] CMI: Loaded 41637 existing records from primary storage. [2025-10-22T23:23:00.960504] [INFO ] [MAIN ] CMI: Loaded 41637 primary data records. [2025-10-22T23:23:01.322366] [DEBUG] [MAIN ] CMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:01.348369] [INFO ] [MAIN ] CMI: Generated 138 derivative records from 41637 primary records. [2025-10-22T23:23:01.348583] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-22T23:23:01.364555] [DEBUG] [LOCAL ] CMI: Derivative data saved (1794 records). [2025-10-22T23:23:01.364746] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-22T23:23:01.367715] [INFO ] [MAIN ] Derivative Progress: 384/2052 symbols. CMI took 0.5s. Estimated remaining time: 11m 5s [2025-10-22T23:23:01.367811] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:01.404216] [DEBUG] [LOCAL ] CMP: Loaded 35683 existing records from primary storage. [2025-10-22T23:23:01.404422] [INFO ] [MAIN ] CMP: Loaded 35683 primary data records. [2025-10-22T23:23:01.725818] [DEBUG] [MAIN ] CMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:01.752444] [INFO ] [MAIN ] CMP: Generated 138 derivative records from 35683 primary records. [2025-10-22T23:23:01.752630] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-22T23:23:01.767980] [DEBUG] [LOCAL ] CMP: Derivative data saved (1794 records). [2025-10-22T23:23:01.768147] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-22T23:23:01.771213] [INFO ] [MAIN ] Derivative Progress: 385/2052 symbols. CMP took 0.4s. Estimated remaining time: 11m 4s [2025-10-22T23:23:01.771341] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:01.809787] [DEBUG] [LOCAL ] CMPO: Loaded 38424 existing records from primary storage. [2025-10-22T23:23:01.809975] [INFO ] [MAIN ] CMPO: Loaded 38424 primary data records. [2025-10-22T23:23:02.128126] [DEBUG] [MAIN ] CMPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:02.153229] [INFO ] [MAIN ] CMPO: Generated 138 derivative records from 38424 primary records. [2025-10-22T23:23:02.153338] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-22T23:23:02.168520] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1794 records). [2025-10-22T23:23:02.168606] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-22T23:23:02.171588] [INFO ] [MAIN ] Derivative Progress: 386/2052 symbols. CMPO took 0.4s. Estimated remaining time: 11m 4s [2025-10-22T23:23:02.171715] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:02.206680] [DEBUG] [LOCAL ] CMRE: Loaded 35651 existing records from primary storage. [2025-10-22T23:23:02.206829] [INFO ] [MAIN ] CMRE: Loaded 35651 primary data records. [2025-10-22T23:23:02.515552] [DEBUG] [MAIN ] CMRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:02.540734] [INFO ] [MAIN ] CMRE: Generated 138 derivative records from 35651 primary records. [2025-10-22T23:23:02.540898] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-22T23:23:02.555599] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1794 records). [2025-10-22T23:23:02.555701] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-10-22T23:23:02.558887] [INFO ] [MAIN ] Derivative Progress: 387/2052 symbols. CMRE took 0.4s. Estimated remaining time: 11m 4s [2025-10-22T23:23:02.558998] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:02.607114] [DEBUG] [LOCAL ] CMS: Loaded 52551 existing records from primary storage. [2025-10-22T23:23:02.607300] [INFO ] [MAIN ] CMS: Loaded 52551 primary data records. [2025-10-22T23:23:02.913493] [DEBUG] [MAIN ] CMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:02.939212] [INFO ] [MAIN ] CMS: Generated 138 derivative records from 52551 primary records. [2025-10-22T23:23:02.939403] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-10-22T23:23:02.954456] [DEBUG] [LOCAL ] CMS: Derivative data saved (1794 records). [2025-10-22T23:23:02.954544] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-10-22T23:23:02.957681] [INFO ] [MAIN ] Derivative Progress: 388/2052 symbols. CMS took 0.4s. Estimated remaining time: 11m 3s [2025-10-22T23:23:02.957797] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:02.963778] [DEBUG] [LOCAL ] CMSA: Loaded 3471 existing records from primary storage. [2025-10-22T23:23:02.963870] [INFO ] [MAIN ] CMSA: Loaded 3471 primary data records. [2025-10-22T23:23:03.287601] [DEBUG] [MAIN ] CMSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:03.312598] [INFO ] [MAIN ] CMSA: Generated 138 derivative records from 3471 primary records. [2025-10-22T23:23:03.312745] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-10-22T23:23:03.325991] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1794 records). [2025-10-22T23:23:03.326073] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-10-22T23:23:03.328339] [INFO ] [MAIN ] Derivative Progress: 389/2052 symbols. CMSA took 0.4s. Estimated remaining time: 11m 3s [2025-10-22T23:23:03.328434] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:03.335517] [DEBUG] [LOCAL ] CMSC: Loaded 4809 existing records from primary storage. [2025-10-22T23:23:03.335665] [INFO ] [MAIN ] CMSC: Loaded 4809 primary data records. [2025-10-22T23:23:03.635052] [DEBUG] [MAIN ] CMSC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:03.660429] [INFO ] [MAIN ] CMSC: Generated 138 derivative records from 4809 primary records. [2025-10-22T23:23:03.660591] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-22T23:23:03.674308] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1794 records). [2025-10-22T23:23:03.674389] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-10-22T23:23:03.676557] [INFO ] [MAIN ] Derivative Progress: 390/2052 symbols. CMSC took 0.3s. Estimated remaining time: 11m 2s [2025-10-22T23:23:03.676665] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:03.685813] [DEBUG] [LOCAL ] CMSD: Loaded 7603 existing records from primary storage. [2025-10-22T23:23:03.685930] [INFO ] [MAIN ] CMSD: Loaded 7603 primary data records. [2025-10-22T23:23:03.989577] [DEBUG] [MAIN ] CMSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:04.015510] [INFO ] [MAIN ] CMSD: Generated 138 derivative records from 7603 primary records. [2025-10-22T23:23:04.015718] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-22T23:23:04.031018] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1794 records). [2025-10-22T23:23:04.031107] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-22T23:23:04.033391] [INFO ] [MAIN ] Derivative Progress: 391/2052 symbols. CMSD took 0.4s. Estimated remaining time: 11m 1s [2025-10-22T23:23:04.033482] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:04.066152] [DEBUG] [LOCAL ] CMTG: Loaded 35217 existing records from primary storage. [2025-10-22T23:23:04.066314] [INFO ] [MAIN ] CMTG: Loaded 35217 primary data records. [2025-10-22T23:23:04.374576] [DEBUG] [MAIN ] CMTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:04.399674] [INFO ] [MAIN ] CMTG: Generated 138 derivative records from 35217 primary records. [2025-10-22T23:23:04.399831] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-22T23:23:04.414584] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1794 records). [2025-10-22T23:23:04.414689] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-10-22T23:23:04.417694] [INFO ] [MAIN ] Derivative Progress: 392/2052 symbols. CMTG took 0.4s. Estimated remaining time: 11m 1s [2025-10-22T23:23:04.417788] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:04.428385] [DEBUG] [LOCAL ] CMU: Loaded 6348 existing records from primary storage. [2025-10-22T23:23:04.428536] [INFO ] [MAIN ] CMU: Loaded 6348 primary data records. [2025-10-22T23:23:04.746589] [DEBUG] [MAIN ] CMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:04.771807] [INFO ] [MAIN ] CMU: Generated 138 derivative records from 6348 primary records. [2025-10-22T23:23:04.771935] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-10-22T23:23:04.785017] [DEBUG] [LOCAL ] CMU: Derivative data saved (1794 records). [2025-10-22T23:23:04.785099] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-10-22T23:23:04.787269] [INFO ] [MAIN ] Derivative Progress: 393/2052 symbols. CMU took 0.4s. Estimated remaining time: 11m 0s [2025-10-22T23:23:04.787395] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:04.819524] [DEBUG] [LOCAL ] CNA: Loaded 32534 existing records from primary storage. [2025-10-22T23:23:04.819714] [INFO ] [MAIN ] CNA: Loaded 32534 primary data records. [2025-10-22T23:23:05.155245] [DEBUG] [MAIN ] CNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:05.183123] [INFO ] [MAIN ] CNA: Generated 138 derivative records from 32534 primary records. [2025-10-22T23:23:05.183313] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-10-22T23:23:05.199073] [DEBUG] [LOCAL ] CNA: Derivative data saved (1794 records). [2025-10-22T23:23:05.199240] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-10-22T23:23:05.202923] [INFO ] [MAIN ] Derivative Progress: 394/2052 symbols. CNA took 0.4s. Estimated remaining time: 11m 0s [2025-10-22T23:23:05.203127] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:05.257510] [DEBUG] [LOCAL ] CNC: Loaded 53779 existing records from primary storage. [2025-10-22T23:23:05.257717] [INFO ] [MAIN ] CNC: Loaded 53779 primary data records. [2025-10-22T23:23:05.589245] [DEBUG] [MAIN ] CNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:05.617127] [INFO ] [MAIN ] CNC: Generated 138 derivative records from 53779 primary records. [2025-10-22T23:23:05.617348] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-22T23:23:05.633834] [DEBUG] [LOCAL ] CNC: Derivative data saved (1794 records). [2025-10-22T23:23:05.633973] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-22T23:23:05.637059] [INFO ] [MAIN ] Derivative Progress: 395/2052 symbols. CNC took 0.4s. Estimated remaining time: 10m 60s [2025-10-22T23:23:05.637166] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:05.689124] [DEBUG] [LOCAL ] CNI: Loaded 51658 existing records from primary storage. [2025-10-22T23:23:05.689294] [INFO ] [MAIN ] CNI: Loaded 51658 primary data records. [2025-10-22T23:23:06.052135] [DEBUG] [MAIN ] CNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:06.076980] [INFO ] [MAIN ] CNI: Generated 138 derivative records from 51658 primary records. [2025-10-22T23:23:06.077114] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-22T23:23:06.092167] [DEBUG] [LOCAL ] CNI: Derivative data saved (1794 records). [2025-10-22T23:23:06.092252] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-10-22T23:23:06.095212] [INFO ] [MAIN ] Derivative Progress: 396/2052 symbols. CNI took 0.5s. Estimated remaining time: 10m 60s [2025-10-22T23:23:06.095311] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:06.146248] [DEBUG] [LOCAL ] CNK: Loaded 52908 existing records from primary storage. [2025-10-22T23:23:06.146427] [INFO ] [MAIN ] CNK: Loaded 52908 primary data records. [2025-10-22T23:23:06.454971] [DEBUG] [MAIN ] CNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:06.479923] [INFO ] [MAIN ] CNK: Generated 138 derivative records from 52908 primary records. [2025-10-22T23:23:06.480080] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-10-22T23:23:06.495364] [DEBUG] [LOCAL ] CNK: Derivative data saved (1794 records). [2025-10-22T23:23:06.495449] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-10-22T23:23:06.498474] [INFO ] [MAIN ] Derivative Progress: 397/2052 symbols. CNK took 0.4s. Estimated remaining time: 10m 59s [2025-10-22T23:23:06.498571] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:06.529478] [DEBUG] [LOCAL ] CNMD: Loaded 32058 existing records from primary storage. [2025-10-22T23:23:06.529638] [INFO ] [MAIN ] CNMD: Loaded 32058 primary data records. [2025-10-22T23:23:06.834494] [DEBUG] [MAIN ] CNMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:06.860260] [INFO ] [MAIN ] CNMD: Generated 138 derivative records from 32058 primary records. [2025-10-22T23:23:06.860358] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-10-22T23:23:06.875150] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1794 records). [2025-10-22T23:23:06.875235] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-10-22T23:23:06.878183] [INFO ] [MAIN ] Derivative Progress: 398/2052 symbols. CNMD took 0.4s. Estimated remaining time: 10m 59s [2025-10-22T23:23:06.878272] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:06.915347] [DEBUG] [LOCAL ] CNO: Loaded 40344 existing records from primary storage. [2025-10-22T23:23:06.915523] [INFO ] [MAIN ] CNO: Loaded 40344 primary data records. [2025-10-22T23:23:07.253877] [DEBUG] [MAIN ] CNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:07.279138] [INFO ] [MAIN ] CNO: Generated 138 derivative records from 40344 primary records. [2025-10-22T23:23:07.279326] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-22T23:23:07.294112] [DEBUG] [LOCAL ] CNO: Derivative data saved (1794 records). [2025-10-22T23:23:07.294230] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-10-22T23:23:07.297126] [INFO ] [MAIN ] Derivative Progress: 399/2052 symbols. CNO took 0.4s. Estimated remaining time: 10m 59s [2025-10-22T23:23:07.297253] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:07.350567] [DEBUG] [LOCAL ] CNP: Loaded 53475 existing records from primary storage. [2025-10-22T23:23:07.350767] [INFO ] [MAIN ] CNP: Loaded 53475 primary data records. [2025-10-22T23:23:07.657787] [DEBUG] [MAIN ] CNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:07.682751] [INFO ] [MAIN ] CNP: Generated 138 derivative records from 53475 primary records. [2025-10-22T23:23:07.682911] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-22T23:23:07.697952] [DEBUG] [LOCAL ] CNP: Derivative data saved (1794 records). [2025-10-22T23:23:07.698048] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-22T23:23:07.701035] [INFO ] [MAIN ] Derivative Progress: 400/2052 symbols. CNP took 0.4s. Estimated remaining time: 10m 58s [2025-10-22T23:23:07.701145] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:07.753575] [DEBUG] [LOCAL ] CNQ: Loaded 53582 existing records from primary storage. [2025-10-22T23:23:07.753793] [INFO ] [MAIN ] CNQ: Loaded 53582 primary data records. [2025-10-22T23:23:08.057817] [DEBUG] [MAIN ] CNQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:08.082907] [INFO ] [MAIN ] CNQ: Generated 138 derivative records from 53582 primary records. [2025-10-22T23:23:08.083072] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-22T23:23:08.098292] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1794 records). [2025-10-22T23:23:08.098391] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-22T23:23:08.101417] [INFO ] [MAIN ] Derivative Progress: 401/2052 symbols. CNQ took 0.4s. Estimated remaining time: 10m 58s [2025-10-22T23:23:08.101537] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:08.140470] [DEBUG] [LOCAL ] CODI: Loaded 41954 existing records from primary storage. [2025-10-22T23:23:08.140637] [INFO ] [MAIN ] CODI: Loaded 41954 primary data records. [2025-10-22T23:23:08.470866] [DEBUG] [MAIN ] CODI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:08.496850] [INFO ] [MAIN ] CODI: Generated 138 derivative records from 41954 primary records. [2025-10-22T23:23:08.497036] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-10-22T23:23:08.511759] [DEBUG] [LOCAL ] CODI: Derivative data saved (1794 records). [2025-10-22T23:23:08.511899] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-10-22T23:23:08.514855] [INFO ] [MAIN ] Derivative Progress: 402/2052 symbols. CODI took 0.4s. Estimated remaining time: 10m 57s [2025-10-22T23:23:08.514998] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:08.572044] [DEBUG] [LOCAL ] COF: Loaded 53625 existing records from primary storage. [2025-10-22T23:23:08.572214] [INFO ] [MAIN ] COF: Loaded 53625 primary data records. [2025-10-22T23:23:08.884951] [DEBUG] [MAIN ] COF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:08.909710] [INFO ] [MAIN ] COF: Generated 138 derivative records from 53625 primary records. [2025-10-22T23:23:08.909839] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-22T23:23:08.924857] [DEBUG] [LOCAL ] COF: Derivative data saved (1794 records). [2025-10-22T23:23:08.924944] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-22T23:23:08.927924] [INFO ] [MAIN ] Derivative Progress: 403/2052 symbols. COF took 0.4s. Estimated remaining time: 10m 57s [2025-10-22T23:23:08.928029] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:08.979348] [DEBUG] [LOCAL ] COLD: Loaded 52485 existing records from primary storage. [2025-10-22T23:23:08.979513] [INFO ] [MAIN ] COLD: Loaded 52485 primary data records. [2025-10-22T23:23:09.282305] [DEBUG] [MAIN ] COLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:09.307271] [INFO ] [MAIN ] COLD: Generated 138 derivative records from 52485 primary records. [2025-10-22T23:23:09.307404] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-10-22T23:23:09.322220] [DEBUG] [LOCAL ] COLD: Derivative data saved (1794 records). [2025-10-22T23:23:09.322299] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-10-22T23:23:09.325216] [INFO ] [MAIN ] Derivative Progress: 404/2052 symbols. COLD took 0.4s. Estimated remaining time: 10m 57s [2025-10-22T23:23:09.325309] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:09.375088] [DEBUG] [LOCAL ] COMP: Loaded 53404 existing records from primary storage. [2025-10-22T23:23:09.375247] [INFO ] [MAIN ] COMP: Loaded 53404 primary data records. [2025-10-22T23:23:09.699405] [DEBUG] [MAIN ] COMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:09.724493] [INFO ] [MAIN ] COMP: Generated 138 derivative records from 53404 primary records. [2025-10-22T23:23:09.724608] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-10-22T23:23:09.739183] [DEBUG] [LOCAL ] COMP: Derivative data saved (1794 records). [2025-10-22T23:23:09.739264] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-10-22T23:23:09.742236] [INFO ] [MAIN ] Derivative Progress: 405/2052 symbols. COMP took 0.4s. Estimated remaining time: 10m 56s [2025-10-22T23:23:09.742328] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:09.767120] [DEBUG] [LOCAL ] COOK: Loaded 24851 existing records from primary storage. [2025-10-22T23:23:09.767259] [INFO ] [MAIN ] COOK: Loaded 24851 primary data records. [2025-10-22T23:23:10.073241] [DEBUG] [MAIN ] COOK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:10.098363] [INFO ] [MAIN ] COOK: Generated 138 derivative records from 24851 primary records. [2025-10-22T23:23:10.098537] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-22T23:23:10.113201] [DEBUG] [LOCAL ] COOK: Derivative data saved (1794 records). [2025-10-22T23:23:10.113302] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-10-22T23:23:10.116038] [INFO ] [MAIN ] Derivative Progress: 406/2052 symbols. COOK took 0.4s. Estimated remaining time: 10m 56s [2025-10-22T23:23:10.116134] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:10.168010] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-22T23:23:10.168172] [INFO ] [MAIN ] COP: Loaded 53727 primary data records. [2025-10-22T23:23:10.476287] [DEBUG] [MAIN ] COP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:10.501275] [INFO ] [MAIN ] COP: Generated 138 derivative records from 53727 primary records. [2025-10-22T23:23:10.501409] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-10-22T23:23:10.516417] [DEBUG] [LOCAL ] COP: Derivative data saved (1794 records). [2025-10-22T23:23:10.516498] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-10-22T23:23:10.519601] [INFO ] [MAIN ] Derivative Progress: 407/2052 symbols. COP took 0.4s. Estimated remaining time: 10m 56s [2025-10-22T23:23:10.519719] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:10.564022] [DEBUG] [LOCAL ] COR: Loaded 46258 existing records from primary storage. [2025-10-22T23:23:10.564185] [INFO ] [MAIN ] COR: Loaded 46258 primary data records. [2025-10-22T23:23:10.867096] [DEBUG] [MAIN ] COR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:10.892051] [INFO ] [MAIN ] COR: Generated 138 derivative records from 46258 primary records. [2025-10-22T23:23:10.892166] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-10-22T23:23:10.906978] [DEBUG] [LOCAL ] COR: Derivative data saved (1794 records). [2025-10-22T23:23:10.907059] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-10-22T23:23:10.910039] [INFO ] [MAIN ] Derivative Progress: 408/2052 symbols. COR took 0.4s. Estimated remaining time: 10m 55s [2025-10-22T23:23:10.910132] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:10.957220] [DEBUG] [LOCAL ] COUR: Loaded 49401 existing records from primary storage. [2025-10-22T23:23:10.957407] [INFO ] [MAIN ] COUR: Loaded 49401 primary data records. [2025-10-22T23:23:11.261366] [DEBUG] [MAIN ] COUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:11.286239] [INFO ] [MAIN ] COUR: Generated 138 derivative records from 49401 primary records. [2025-10-22T23:23:11.286369] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-10-22T23:23:11.301406] [DEBUG] [LOCAL ] COUR: Derivative data saved (1794 records). [2025-10-22T23:23:11.301498] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-10-22T23:23:11.304483] [INFO ] [MAIN ] Derivative Progress: 409/2052 symbols. COUR took 0.4s. Estimated remaining time: 10m 55s [2025-10-22T23:23:11.304582] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:11.355533] [DEBUG] [LOCAL ] CP: Loaded 53228 existing records from primary storage. [2025-10-22T23:23:11.355718] [INFO ] [MAIN ] CP: Loaded 53228 primary data records. [2025-10-22T23:23:11.683261] [DEBUG] [MAIN ] CP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:11.708427] [INFO ] [MAIN ] CP: Generated 138 derivative records from 53228 primary records. [2025-10-22T23:23:11.708572] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-10-22T23:23:11.723401] [DEBUG] [LOCAL ] CP: Derivative data saved (1794 records). [2025-10-22T23:23:11.723493] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-10-22T23:23:11.726849] [INFO ] [MAIN ] Derivative Progress: 410/2052 symbols. CP took 0.4s. Estimated remaining time: 10m 54s [2025-10-22T23:23:11.726961] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:11.756086] [DEBUG] [LOCAL ] CPA: Loaded 27769 existing records from primary storage. [2025-10-22T23:23:11.756239] [INFO ] [MAIN ] CPA: Loaded 27769 primary data records. [2025-10-22T23:23:12.058980] [DEBUG] [MAIN ] CPA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:12.083612] [INFO ] [MAIN ] CPA: Generated 138 derivative records from 27769 primary records. [2025-10-22T23:23:12.083779] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-10-22T23:23:12.098597] [DEBUG] [LOCAL ] CPA: Derivative data saved (1794 records). [2025-10-22T23:23:12.098701] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-10-22T23:23:12.101422] [INFO ] [MAIN ] Derivative Progress: 411/2052 symbols. CPA took 0.4s. Estimated remaining time: 10m 54s [2025-10-22T23:23:12.101522] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:12.130526] [DEBUG] [LOCAL ] CPAY: Loaded 30086 existing records from primary storage. [2025-10-22T23:23:12.130713] [INFO ] [MAIN ] CPAY: Loaded 30086 primary data records. [2025-10-22T23:23:12.436409] [DEBUG] [MAIN ] CPAY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:12.461409] [INFO ] [MAIN ] CPAY: Generated 138 derivative records from 30086 primary records. [2025-10-22T23:23:12.461532] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-22T23:23:12.476453] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1794 records). [2025-10-22T23:23:12.476532] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-22T23:23:12.480057] [INFO ] [MAIN ] Derivative Progress: 412/2052 symbols. CPAY took 0.4s. Estimated remaining time: 10m 53s [2025-10-22T23:23:12.480148] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:12.497902] [DEBUG] [LOCAL ] CPF: Loaded 15178 existing records from primary storage. [2025-10-22T23:23:12.498036] [INFO ] [MAIN ] CPF: Loaded 15178 primary data records. [2025-10-22T23:23:12.798302] [DEBUG] [MAIN ] CPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:12.823190] [INFO ] [MAIN ] CPF: Generated 138 derivative records from 15178 primary records. [2025-10-22T23:23:12.823306] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-10-22T23:23:12.838140] [DEBUG] [LOCAL ] CPF: Derivative data saved (1794 records). [2025-10-22T23:23:12.838222] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-10-22T23:23:12.840852] [INFO ] [MAIN ] Derivative Progress: 413/2052 symbols. CPF took 0.4s. Estimated remaining time: 10m 53s [2025-10-22T23:23:12.840945] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:12.858756] [DEBUG] [LOCAL ] CPK: Loaded 13889 existing records from primary storage. [2025-10-22T23:23:12.858894] [INFO ] [MAIN ] CPK: Loaded 13889 primary data records. [2025-10-22T23:23:13.216295] [DEBUG] [MAIN ] CPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:13.243761] [INFO ] [MAIN ] CPK: Generated 138 derivative records from 13889 primary records. [2025-10-22T23:23:13.243906] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-22T23:23:13.261277] [DEBUG] [LOCAL ] CPK: Derivative data saved (1794 records). [2025-10-22T23:23:13.261402] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-10-22T23:23:13.264296] [INFO ] [MAIN ] Derivative Progress: 414/2052 symbols. CPK took 0.4s. Estimated remaining time: 10m 53s [2025-10-22T23:23:13.264404] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:13.322358] [DEBUG] [LOCAL ] CPRI: Loaded 52430 existing records from primary storage. [2025-10-22T23:23:13.322558] [INFO ] [MAIN ] CPRI: Loaded 52430 primary data records. [2025-10-22T23:23:13.698693] [DEBUG] [MAIN ] CPRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:13.725051] [INFO ] [MAIN ] CPRI: Generated 138 derivative records from 52430 primary records. [2025-10-22T23:23:13.725171] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-22T23:23:13.740396] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1794 records). [2025-10-22T23:23:13.740479] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-10-22T23:23:13.743615] [INFO ] [MAIN ] Derivative Progress: 415/2052 symbols. CPRI took 0.5s. Estimated remaining time: 10m 52s [2025-10-22T23:23:13.743738] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:13.769915] [DEBUG] [LOCAL ] CPS: Loaded 24879 existing records from primary storage. [2025-10-22T23:23:13.770071] [INFO ] [MAIN ] CPS: Loaded 24879 primary data records. [2025-10-22T23:23:14.084131] [DEBUG] [MAIN ] CPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:14.109569] [INFO ] [MAIN ] CPS: Generated 138 derivative records from 24879 primary records. [2025-10-22T23:23:14.109702] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-10-22T23:23:14.124270] [DEBUG] [LOCAL ] CPS: Derivative data saved (1794 records). [2025-10-22T23:23:14.124353] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-10-22T23:23:14.126960] [INFO ] [MAIN ] Derivative Progress: 416/2052 symbols. CPS took 0.4s. Estimated remaining time: 10m 52s [2025-10-22T23:23:14.127055] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:14.169522] [DEBUG] [LOCAL ] CPT: Loaded 44485 existing records from primary storage. [2025-10-22T23:23:14.169718] [INFO ] [MAIN ] CPT: Loaded 44485 primary data records. [2025-10-22T23:23:14.472140] [DEBUG] [MAIN ] CPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:14.497211] [INFO ] [MAIN ] CPT: Generated 138 derivative records from 44485 primary records. [2025-10-22T23:23:14.497338] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-22T23:23:14.512076] [DEBUG] [LOCAL ] CPT: Derivative data saved (1794 records). [2025-10-22T23:23:14.512156] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-22T23:23:14.515012] [INFO ] [MAIN ] Derivative Progress: 417/2052 symbols. CPT took 0.4s. Estimated remaining time: 10m 52s [2025-10-22T23:23:14.515106] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:14.534871] [DEBUG] [LOCAL ] CQP: Loaded 18676 existing records from primary storage. [2025-10-22T23:23:14.535008] [INFO ] [MAIN ] CQP: Loaded 18676 primary data records. [2025-10-22T23:23:14.839676] [DEBUG] [MAIN ] CQP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:14.864431] [INFO ] [MAIN ] CQP: Generated 138 derivative records from 18676 primary records. [2025-10-22T23:23:14.864554] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-10-22T23:23:14.879166] [DEBUG] [LOCAL ] CQP: Derivative data saved (1794 records). [2025-10-22T23:23:14.879246] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-10-22T23:23:14.881948] [INFO ] [MAIN ] Derivative Progress: 418/2052 symbols. CQP took 0.4s. Estimated remaining time: 10m 51s [2025-10-22T23:23:14.882048] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:14.907921] [DEBUG] [LOCAL ] CR: Loaded 23949 existing records from primary storage. [2025-10-22T23:23:14.908078] [INFO ] [MAIN ] CR: Loaded 23949 primary data records. [2025-10-22T23:23:15.213172] [DEBUG] [MAIN ] CR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:23:15.238260] [INFO ] [MAIN ] CR: Generated 138 derivative records from 23949 primary records. [2025-10-22T23:23:15.238365] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-22T23:23:15.253323] [DEBUG] [LOCAL ] CR: Derivative data saved (1793 records). [2025-10-22T23:23:15.253405] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-22T23:23:15.256204] [INFO ] [MAIN ] Derivative Progress: 419/2052 symbols. CR took 0.4s. Estimated remaining time: 10m 51s [2025-10-22T23:23:15.256305] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:15.268513] [DEBUG] [LOCAL ] CRBD: Loaded 8761 existing records from primary storage. [2025-10-22T23:23:15.268633] [INFO ] [MAIN ] CRBD: Loaded 8761 primary data records. [2025-10-22T23:23:15.571603] [DEBUG] [MAIN ] CRBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:15.596330] [INFO ] [MAIN ] CRBD: Generated 138 derivative records from 8761 primary records. [2025-10-22T23:23:15.596435] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-22T23:23:15.611756] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1794 records). [2025-10-22T23:23:15.611836] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-10-22T23:23:15.613973] [INFO ] [MAIN ] Derivative Progress: 420/2052 symbols. CRBD took 0.4s. Estimated remaining time: 10m 50s [2025-10-22T23:23:15.614063] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:15.664378] [DEBUG] [LOCAL ] CRBG: Loaded 52600 existing records from primary storage. [2025-10-22T23:23:15.664548] [INFO ] [MAIN ] CRBG: Loaded 52600 primary data records. [2025-10-22T23:23:15.987878] [DEBUG] [MAIN ] CRBG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:16.012548] [INFO ] [MAIN ] CRBG: Generated 138 derivative records from 52600 primary records. [2025-10-22T23:23:16.012677] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-22T23:23:16.027358] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1794 records). [2025-10-22T23:23:16.027441] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-22T23:23:16.030671] [INFO ] [MAIN ] Derivative Progress: 421/2052 symbols. CRBG took 0.4s. Estimated remaining time: 10m 50s [2025-10-22T23:23:16.030770] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:16.071952] [DEBUG] [LOCAL ] CRC: Loaded 44118 existing records from primary storage. [2025-10-22T23:23:16.072108] [INFO ] [MAIN ] CRC: Loaded 44118 primary data records. [2025-10-22T23:23:16.376889] [DEBUG] [MAIN ] CRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:16.401718] [INFO ] [MAIN ] CRC: Generated 138 derivative records from 44118 primary records. [2025-10-22T23:23:16.401815] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-22T23:23:16.416265] [DEBUG] [LOCAL ] CRC: Derivative data saved (1794 records). [2025-10-22T23:23:16.416344] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-10-22T23:23:16.419459] [INFO ] [MAIN ] Derivative Progress: 422/2052 symbols. CRC took 0.4s. Estimated remaining time: 10m 49s [2025-10-22T23:23:16.419573] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:16.469322] [DEBUG] [LOCAL ] CRGY: Loaded 52497 existing records from primary storage. [2025-10-22T23:23:16.469486] [INFO ] [MAIN ] CRGY: Loaded 52497 primary data records. [2025-10-22T23:23:16.771477] [DEBUG] [MAIN ] CRGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:16.796309] [INFO ] [MAIN ] CRGY: Generated 138 derivative records from 52497 primary records. [2025-10-22T23:23:16.796408] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-22T23:23:16.811335] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1794 records). [2025-10-22T23:23:16.811423] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-22T23:23:16.814494] [INFO ] [MAIN ] Derivative Progress: 423/2052 symbols. CRGY took 0.4s. Estimated remaining time: 10m 49s [2025-10-22T23:23:16.814585] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:16.865984] [DEBUG] [LOCAL ] CRH: Loaded 53422 existing records from primary storage. [2025-10-22T23:23:16.866145] [INFO ] [MAIN ] CRH: Loaded 53422 primary data records. [2025-10-22T23:23:17.167785] [DEBUG] [MAIN ] CRH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:17.192935] [INFO ] [MAIN ] CRH: Generated 138 derivative records from 53422 primary records. [2025-10-22T23:23:17.193029] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-10-22T23:23:17.207945] [DEBUG] [LOCAL ] CRH: Derivative data saved (1794 records). [2025-10-22T23:23:17.208025] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-10-22T23:23:17.211140] [INFO ] [MAIN ] Derivative Progress: 424/2052 symbols. CRH took 0.4s. Estimated remaining time: 10m 48s [2025-10-22T23:23:17.211232] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:17.257377] [DEBUG] [LOCAL ] CRI: Loaded 49486 existing records from primary storage. [2025-10-22T23:23:17.257547] [INFO ] [MAIN ] CRI: Loaded 49486 primary data records. [2025-10-22T23:23:17.574154] [DEBUG] [MAIN ] CRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:17.599532] [INFO ] [MAIN ] CRI: Generated 138 derivative records from 49486 primary records. [2025-10-22T23:23:17.599623] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-22T23:23:17.614369] [DEBUG] [LOCAL ] CRI: Derivative data saved (1794 records). [2025-10-22T23:23:17.614453] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-10-22T23:23:17.617836] [INFO ] [MAIN ] Derivative Progress: 425/2052 symbols. CRI took 0.4s. Estimated remaining time: 10m 48s [2025-10-22T23:23:17.617934] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:17.668593] [DEBUG] [LOCAL ] CRK: Loaded 52226 existing records from primary storage. [2025-10-22T23:23:17.668783] [INFO ] [MAIN ] CRK: Loaded 52226 primary data records. [2025-10-22T23:23:17.997472] [DEBUG] [MAIN ] CRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:18.022452] [INFO ] [MAIN ] CRK: Generated 138 derivative records from 52226 primary records. [2025-10-22T23:23:18.022588] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-10-22T23:23:18.037459] [DEBUG] [LOCAL ] CRK: Derivative data saved (1794 records). [2025-10-22T23:23:18.037540] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-10-22T23:23:18.040667] [INFO ] [MAIN ] Derivative Progress: 426/2052 symbols. CRK took 0.4s. Estimated remaining time: 10m 48s [2025-10-22T23:23:18.040762] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:18.081511] [DEBUG] [LOCAL ] CRL: Loaded 42624 existing records from primary storage. [2025-10-22T23:23:18.081703] [INFO ] [MAIN ] CRL: Loaded 42624 primary data records. [2025-10-22T23:23:18.385368] [DEBUG] [MAIN ] CRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:18.410059] [INFO ] [MAIN ] CRL: Generated 138 derivative records from 42624 primary records. [2025-10-22T23:23:18.410161] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-22T23:23:18.424930] [DEBUG] [LOCAL ] CRL: Derivative data saved (1794 records). [2025-10-22T23:23:18.425013] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-22T23:23:18.427728] [INFO ] [MAIN ] Derivative Progress: 427/2052 symbols. CRL took 0.4s. Estimated remaining time: 10m 47s [2025-10-22T23:23:18.427822] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:18.479299] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-22T23:23:18.479456] [INFO ] [MAIN ] CRM: Loaded 53770 primary data records. [2025-10-22T23:23:18.780952] [DEBUG] [MAIN ] CRM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:18.805747] [INFO ] [MAIN ] CRM: Generated 138 derivative records from 53770 primary records. [2025-10-22T23:23:18.805848] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-22T23:23:18.820636] [DEBUG] [LOCAL ] CRM: Derivative data saved (1794 records). [2025-10-22T23:23:18.820741] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-10-22T23:23:18.823569] [INFO ] [MAIN ] Derivative Progress: 428/2052 symbols. CRM took 0.4s. Estimated remaining time: 10m 47s [2025-10-22T23:23:18.823687] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:18.865768] [DEBUG] [LOCAL ] CRS: Loaded 43101 existing records from primary storage. [2025-10-22T23:23:18.865922] [INFO ] [MAIN ] CRS: Loaded 43101 primary data records. [2025-10-22T23:23:19.169187] [DEBUG] [MAIN ] CRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:19.196988] [INFO ] [MAIN ] CRS: Generated 138 derivative records from 43101 primary records. [2025-10-22T23:23:19.197125] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-10-22T23:23:19.211924] [DEBUG] [LOCAL ] CRS: Derivative data saved (1794 records). [2025-10-22T23:23:19.212005] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-10-22T23:23:19.214832] [INFO ] [MAIN ] Derivative Progress: 429/2052 symbols. CRS took 0.4s. Estimated remaining time: 10m 46s [2025-10-22T23:23:19.214923] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:19.223627] [DEBUG] [LOCAL ] CRT: Loaded 4763 existing records from primary storage. [2025-10-22T23:23:19.223780] [INFO ] [MAIN ] CRT: Loaded 4763 primary data records. [2025-10-22T23:23:19.521109] [DEBUG] [MAIN ] CRT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:23:19.545780] [INFO ] [MAIN ] CRT: Generated 138 derivative records from 4763 primary records. [2025-10-22T23:23:19.545894] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-22T23:23:19.559527] [DEBUG] [LOCAL ] CRT: Derivative data saved (1793 records). [2025-10-22T23:23:19.559608] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-10-22T23:23:19.561615] [INFO ] [MAIN ] Derivative Progress: 430/2052 symbols. CRT took 0.3s. Estimated remaining time: 10m 46s [2025-10-22T23:23:19.561735] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:19.603633] [DEBUG] [LOCAL ] CSAN: Loaded 42220 existing records from primary storage. [2025-10-22T23:23:19.603834] [INFO ] [MAIN ] CSAN: Loaded 42220 primary data records. [2025-10-22T23:23:19.930468] [DEBUG] [MAIN ] CSAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:19.956351] [INFO ] [MAIN ] CSAN: Generated 138 derivative records from 42220 primary records. [2025-10-22T23:23:19.956546] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-22T23:23:19.971104] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1794 records). [2025-10-22T23:23:19.971210] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-22T23:23:19.974338] [INFO ] [MAIN ] Derivative Progress: 431/2052 symbols. CSAN took 0.4s. Estimated remaining time: 10m 46s [2025-10-22T23:23:19.974453] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:20.006496] [DEBUG] [LOCAL ] CSL: Loaded 31148 existing records from primary storage. [2025-10-22T23:23:20.006697] [INFO ] [MAIN ] CSL: Loaded 31148 primary data records. [2025-10-22T23:23:20.311186] [DEBUG] [MAIN ] CSL: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:23:20.336544] [INFO ] [MAIN ] CSL: Generated 138 derivative records from 31148 primary records. [2025-10-22T23:23:20.336688] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-22T23:23:20.351615] [DEBUG] [LOCAL ] CSL: Derivative data saved (1793 records). [2025-10-22T23:23:20.351716] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-22T23:23:20.354421] [INFO ] [MAIN ] Derivative Progress: 432/2052 symbols. CSL took 0.4s. Estimated remaining time: 10m 45s [2025-10-22T23:23:20.354516] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:20.371394] [DEBUG] [LOCAL ] CSR: Loaded 13395 existing records from primary storage. [2025-10-22T23:23:20.371514] [INFO ] [MAIN ] CSR: Loaded 13395 primary data records. [2025-10-22T23:23:20.676337] [DEBUG] [MAIN ] CSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:20.701530] [INFO ] [MAIN ] CSR: Generated 138 derivative records from 13395 primary records. [2025-10-22T23:23:20.701638] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-22T23:23:20.716202] [DEBUG] [LOCAL ] CSR: Derivative data saved (1794 records). [2025-10-22T23:23:20.716281] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-10-22T23:23:20.719003] [INFO ] [MAIN ] Derivative Progress: 433/2052 symbols. CSR took 0.4s. Estimated remaining time: 10m 45s [2025-10-22T23:23:20.719099] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:20.734520] [DEBUG] [LOCAL ] CSV: Loaded 12427 existing records from primary storage. [2025-10-22T23:23:20.734676] [INFO ] [MAIN ] CSV: Loaded 12427 primary data records. [2025-10-22T23:23:21.039863] [DEBUG] [MAIN ] CSV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:21.065201] [INFO ] [MAIN ] CSV: Generated 138 derivative records from 12427 primary records. [2025-10-22T23:23:21.065330] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-22T23:23:21.079996] [DEBUG] [LOCAL ] CSV: Derivative data saved (1794 records). [2025-10-22T23:23:21.080077] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-22T23:23:21.082751] [INFO ] [MAIN ] Derivative Progress: 434/2052 symbols. CSV took 0.4s. Estimated remaining time: 10m 44s [2025-10-22T23:23:21.082843] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:21.092414] [DEBUG] [LOCAL ] CTBB: Loaded 6394 existing records from primary storage. [2025-10-22T23:23:21.092521] [INFO ] [MAIN ] CTBB: Loaded 6394 primary data records. [2025-10-22T23:23:21.395946] [DEBUG] [MAIN ] CTBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:21.421031] [INFO ] [MAIN ] CTBB: Generated 138 derivative records from 6394 primary records. [2025-10-22T23:23:21.421134] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-10-22T23:23:21.435103] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1794 records). [2025-10-22T23:23:21.435185] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-10-22T23:23:21.437398] [INFO ] [MAIN ] Derivative Progress: 435/2052 symbols. CTBB took 0.4s. Estimated remaining time: 10m 43s [2025-10-22T23:23:21.437490] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:21.445994] [DEBUG] [LOCAL ] CTDD: Loaded 5135 existing records from primary storage. [2025-10-22T23:23:21.446104] [INFO ] [MAIN ] CTDD: Loaded 5135 primary data records. [2025-10-22T23:23:21.772941] [DEBUG] [MAIN ] CTDD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:23:21.798024] [INFO ] [MAIN ] CTDD: Generated 138 derivative records from 5135 primary records. [2025-10-22T23:23:21.798138] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-10-22T23:23:21.811885] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1793 records). [2025-10-22T23:23:21.811966] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-10-22T23:23:21.814114] [INFO ] [MAIN ] Derivative Progress: 436/2052 symbols. CTDD took 0.4s. Estimated remaining time: 10m 43s [2025-10-22T23:23:21.814209] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:21.849976] [DEBUG] [LOCAL ] CTOS: Loaded 37221 existing records from primary storage. [2025-10-22T23:23:21.850138] [INFO ] [MAIN ] CTOS: Loaded 37221 primary data records. [2025-10-22T23:23:22.157619] [DEBUG] [MAIN ] CTOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:22.183096] [INFO ] [MAIN ] CTOS: Generated 138 derivative records from 37221 primary records. [2025-10-22T23:23:22.183192] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-10-22T23:23:22.198345] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1794 records). [2025-10-22T23:23:22.198427] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-10-22T23:23:22.201578] [INFO ] [MAIN ] Derivative Progress: 437/2052 symbols. CTOS took 0.4s. Estimated remaining time: 10m 43s [2025-10-22T23:23:22.201700] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:22.253425] [DEBUG] [LOCAL ] CTRA: Loaded 53647 existing records from primary storage. [2025-10-22T23:23:22.253589] [INFO ] [MAIN ] CTRA: Loaded 53647 primary data records. [2025-10-22T23:23:22.556401] [DEBUG] [MAIN ] CTRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:22.581517] [INFO ] [MAIN ] CTRA: Generated 138 derivative records from 53647 primary records. [2025-10-22T23:23:22.581626] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-22T23:23:22.596758] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1794 records). [2025-10-22T23:23:22.596839] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-10-22T23:23:22.599876] [INFO ] [MAIN ] Derivative Progress: 438/2052 symbols. CTRA took 0.4s. Estimated remaining time: 10m 42s [2025-10-22T23:23:22.599970] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:22.645784] [DEBUG] [LOCAL ] CTRE: Loaded 49425 existing records from primary storage. [2025-10-22T23:23:22.645949] [INFO ] [MAIN ] CTRE: Loaded 49425 primary data records. [2025-10-22T23:23:22.949156] [DEBUG] [MAIN ] CTRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:22.974287] [INFO ] [MAIN ] CTRE: Generated 138 derivative records from 49425 primary records. [2025-10-22T23:23:22.974383] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-10-22T23:23:22.989357] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1794 records). [2025-10-22T23:23:22.989437] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-10-22T23:23:22.992289] [INFO ] [MAIN ] Derivative Progress: 439/2052 symbols. CTRE took 0.4s. Estimated remaining time: 10m 42s [2025-10-22T23:23:22.992385] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:23.013817] [DEBUG] [LOCAL ] CTS: Loaded 19510 existing records from primary storage. [2025-10-22T23:23:23.013958] [INFO ] [MAIN ] CTS: Loaded 19510 primary data records. [2025-10-22T23:23:23.317097] [DEBUG] [MAIN ] CTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:23.341797] [INFO ] [MAIN ] CTS: Generated 138 derivative records from 19510 primary records. [2025-10-22T23:23:23.341923] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-22T23:23:23.356342] [DEBUG] [LOCAL ] CTS: Derivative data saved (1794 records). [2025-10-22T23:23:23.356422] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-10-22T23:23:23.359101] [INFO ] [MAIN ] Derivative Progress: 440/2052 symbols. CTS took 0.4s. Estimated remaining time: 10m 41s [2025-10-22T23:23:23.359196] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:23.408995] [DEBUG] [LOCAL ] CTVA: Loaded 53308 existing records from primary storage. [2025-10-22T23:23:23.409154] [INFO ] [MAIN ] CTVA: Loaded 53308 primary data records. [2025-10-22T23:23:23.709872] [DEBUG] [MAIN ] CTVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:23.734631] [INFO ] [MAIN ] CTVA: Generated 138 derivative records from 53308 primary records. [2025-10-22T23:23:23.734764] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-10-22T23:23:23.749323] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1794 records). [2025-10-22T23:23:23.749406] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-10-22T23:23:23.752403] [INFO ] [MAIN ] Derivative Progress: 441/2052 symbols. CTVA took 0.4s. Estimated remaining time: 10m 41s [2025-10-22T23:23:23.752494] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:23.800375] [DEBUG] [LOCAL ] CUBE: Loaded 50871 existing records from primary storage. [2025-10-22T23:23:23.800536] [INFO ] [MAIN ] CUBE: Loaded 50871 primary data records. [2025-10-22T23:23:24.122691] [DEBUG] [MAIN ] CUBE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:24.147639] [INFO ] [MAIN ] CUBE: Generated 138 derivative records from 50871 primary records. [2025-10-22T23:23:24.147776] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-10-22T23:23:24.162847] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1794 records). [2025-10-22T23:23:24.163014] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-10-22T23:23:24.166067] [INFO ] [MAIN ] Derivative Progress: 442/2052 symbols. CUBE took 0.4s. Estimated remaining time: 10m 40s [2025-10-22T23:23:24.166215] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:24.193754] [DEBUG] [LOCAL ] CUBI: Loaded 26998 existing records from primary storage. [2025-10-22T23:23:24.193923] [INFO ] [MAIN ] CUBI: Loaded 26998 primary data records. [2025-10-22T23:23:24.512904] [DEBUG] [MAIN ] CUBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:24.537588] [INFO ] [MAIN ] CUBI: Generated 138 derivative records from 26998 primary records. [2025-10-22T23:23:24.537704] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-10-22T23:23:24.552177] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1794 records). [2025-10-22T23:23:24.552264] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-10-22T23:23:24.555073] [INFO ] [MAIN ] Derivative Progress: 443/2052 symbols. CUBI took 0.4s. Estimated remaining time: 10m 40s [2025-10-22T23:23:24.555168] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:24.604075] [DEBUG] [LOCAL ] CUK: Loaded 51064 existing records from primary storage. [2025-10-22T23:23:24.604246] [INFO ] [MAIN ] CUK: Loaded 51064 primary data records. [2025-10-22T23:23:24.906252] [DEBUG] [MAIN ] CUK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:24.931712] [INFO ] [MAIN ] CUK: Generated 138 derivative records from 51064 primary records. [2025-10-22T23:23:24.931906] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-22T23:23:24.947141] [DEBUG] [LOCAL ] CUK: Derivative data saved (1794 records). [2025-10-22T23:23:24.947312] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-22T23:23:24.950403] [INFO ] [MAIN ] Derivative Progress: 444/2052 symbols. CUK took 0.4s. Estimated remaining time: 10m 40s [2025-10-22T23:23:24.950514] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:24.955985] [DEBUG] [LOCAL ] CULP: Loaded 2843 existing records from primary storage. [2025-10-22T23:23:24.956083] [INFO ] [MAIN ] CULP: Loaded 2843 primary data records. [2025-10-22T23:23:25.264855] [DEBUG] [MAIN ] CULP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:25.291576] [INFO ] [MAIN ] CULP: Generated 138 derivative records from 2843 primary records. [2025-10-22T23:23:25.291810] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-10-22T23:23:25.304326] [DEBUG] [LOCAL ] CULP: Derivative data saved (1794 records). [2025-10-22T23:23:25.304467] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-10-22T23:23:25.306632] [INFO ] [MAIN ] Derivative Progress: 445/2052 symbols. CULP took 0.4s. Estimated remaining time: 10m 39s [2025-10-22T23:23:25.306747] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:25.339218] [DEBUG] [LOCAL ] CURB: Loaded 32786 existing records from primary storage. [2025-10-22T23:23:25.339384] [INFO ] [MAIN ] CURB: Loaded 32786 primary data records. [2025-10-22T23:23:25.642301] [DEBUG] [MAIN ] CURB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:25.666915] [INFO ] [MAIN ] CURB: Generated 138 derivative records from 32786 primary records. [2025-10-22T23:23:25.667026] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-10-22T23:23:25.681853] [DEBUG] [LOCAL ] CURB: Derivative data saved (1794 records). [2025-10-22T23:23:25.681950] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-10-22T23:23:25.684841] [INFO ] [MAIN ] Derivative Progress: 446/2052 symbols. CURB took 0.4s. Estimated remaining time: 10m 39s [2025-10-22T23:23:25.684937] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:25.710321] [DEBUG] [LOCAL ] CURV: Loaded 27192 existing records from primary storage. [2025-10-22T23:23:25.710459] [INFO ] [MAIN ] CURV: Loaded 27192 primary data records. [2025-10-22T23:23:26.035586] [DEBUG] [MAIN ] CURV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:26.060342] [INFO ] [MAIN ] CURV: Generated 138 derivative records from 27192 primary records. [2025-10-22T23:23:26.060453] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-10-22T23:23:26.074698] [DEBUG] [LOCAL ] CURV: Derivative data saved (1794 records). [2025-10-22T23:23:26.074780] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-10-22T23:23:26.077639] [INFO ] [MAIN ] Derivative Progress: 447/2052 symbols. CURV took 0.4s. Estimated remaining time: 10m 38s [2025-10-22T23:23:26.077777] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:26.123264] [DEBUG] [LOCAL ] CUZ: Loaded 49436 existing records from primary storage. [2025-10-22T23:23:26.123418] [INFO ] [MAIN ] CUZ: Loaded 49436 primary data records. [2025-10-22T23:23:26.444713] [DEBUG] [MAIN ] CUZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:26.469743] [INFO ] [MAIN ] CUZ: Generated 138 derivative records from 49436 primary records. [2025-10-22T23:23:26.469854] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-22T23:23:26.485007] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1794 records). [2025-10-22T23:23:26.485090] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-22T23:23:26.488103] [INFO ] [MAIN ] Derivative Progress: 448/2052 symbols. CUZ took 0.4s. Estimated remaining time: 10m 38s [2025-10-22T23:23:26.488200] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:26.540080] [DEBUG] [LOCAL ] CVE: Loaded 53567 existing records from primary storage. [2025-10-22T23:23:26.540284] [INFO ] [MAIN ] CVE: Loaded 53567 primary data records. [2025-10-22T23:23:26.845164] [DEBUG] [MAIN ] CVE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:26.870027] [INFO ] [MAIN ] CVE: Generated 138 derivative records from 53567 primary records. [2025-10-22T23:23:26.870159] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-10-22T23:23:26.885282] [DEBUG] [LOCAL ] CVE: Derivative data saved (1794 records). [2025-10-22T23:23:26.885396] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-10-22T23:23:26.888507] [INFO ] [MAIN ] Derivative Progress: 449/2052 symbols. CVE took 0.4s. Estimated remaining time: 10m 37s [2025-10-22T23:23:26.888604] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:26.908855] [DEBUG] [LOCAL ] CVLG: Loaded 15231 existing records from primary storage. [2025-10-22T23:23:26.909005] [INFO ] [MAIN ] CVLG: Loaded 15231 primary data records. [2025-10-22T23:23:27.222199] [DEBUG] [MAIN ] CVLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:27.247157] [INFO ] [MAIN ] CVLG: Generated 138 derivative records from 15231 primary records. [2025-10-22T23:23:27.247255] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-10-22T23:23:27.262463] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1794 records). [2025-10-22T23:23:27.262548] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-10-22T23:23:27.265306] [INFO ] [MAIN ] Derivative Progress: 450/2052 symbols. CVLG took 0.4s. Estimated remaining time: 10m 37s [2025-10-22T23:23:27.265426] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:27.319050] [DEBUG] [LOCAL ] CVNA: Loaded 52837 existing records from primary storage. [2025-10-22T23:23:27.319209] [INFO ] [MAIN ] CVNA: Loaded 52837 primary data records. [2025-10-22T23:23:27.624585] [DEBUG] [MAIN ] CVNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:27.649537] [INFO ] [MAIN ] CVNA: Generated 138 derivative records from 52837 primary records. [2025-10-22T23:23:27.649662] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-10-22T23:23:27.664631] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1794 records). [2025-10-22T23:23:27.664749] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-10-22T23:23:27.667800] [INFO ] [MAIN ] Derivative Progress: 451/2052 symbols. CVNA took 0.4s. Estimated remaining time: 10m 37s [2025-10-22T23:23:27.667911] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:27.720896] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-22T23:23:27.721057] [INFO ] [MAIN ] CVS: Loaded 53694 primary data records. [2025-10-22T23:23:28.053145] [DEBUG] [MAIN ] CVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:28.078086] [INFO ] [MAIN ] CVS: Generated 138 derivative records from 53694 primary records. [2025-10-22T23:23:28.078192] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-22T23:23:28.092859] [DEBUG] [LOCAL ] CVS: Derivative data saved (1794 records). [2025-10-22T23:23:28.092939] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-22T23:23:28.095913] [INFO ] [MAIN ] Derivative Progress: 452/2052 symbols. CVS took 0.4s. Estimated remaining time: 10m 36s [2025-10-22T23:23:28.096010] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:28.149183] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-22T23:23:28.149365] [INFO ] [MAIN ] CVX: Loaded 53760 primary data records. [2025-10-22T23:23:28.455320] [DEBUG] [MAIN ] CVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:28.480461] [INFO ] [MAIN ] CVX: Generated 138 derivative records from 53760 primary records. [2025-10-22T23:23:28.480609] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-10-22T23:23:28.495477] [DEBUG] [LOCAL ] CVX: Derivative data saved (1794 records). [2025-10-22T23:23:28.495558] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-10-22T23:23:28.498544] [INFO ] [MAIN ] Derivative Progress: 453/2052 symbols. CVX took 0.4s. Estimated remaining time: 10m 36s [2025-10-22T23:23:28.498663] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:28.521545] [DEBUG] [LOCAL ] CW: Loaded 21935 existing records from primary storage. [2025-10-22T23:23:28.521712] [INFO ] [MAIN ] CW: Loaded 21935 primary data records. [2025-10-22T23:23:28.825083] [DEBUG] [MAIN ] CW: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:23:28.850465] [INFO ] [MAIN ] CW: Generated 138 derivative records from 21935 primary records. [2025-10-22T23:23:28.850592] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-10-22T23:23:28.865306] [DEBUG] [LOCAL ] CW: Derivative data saved (1793 records). [2025-10-22T23:23:28.865388] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-10-22T23:23:28.868023] [INFO ] [MAIN ] Derivative Progress: 454/2052 symbols. CW took 0.4s. Estimated remaining time: 10m 35s [2025-10-22T23:23:28.868116] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:28.919256] [DEBUG] [LOCAL ] CWAN: Loaded 52687 existing records from primary storage. [2025-10-22T23:23:28.919421] [INFO ] [MAIN ] CWAN: Loaded 52687 primary data records. [2025-10-22T23:23:29.223939] [DEBUG] [MAIN ] CWAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:29.249191] [INFO ] [MAIN ] CWAN: Generated 138 derivative records from 52687 primary records. [2025-10-22T23:23:29.249327] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-10-22T23:23:29.264337] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1794 records). [2025-10-22T23:23:29.264418] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-10-22T23:23:29.267663] [INFO ] [MAIN ] Derivative Progress: 455/2052 symbols. CWAN took 0.4s. Estimated remaining time: 10m 35s [2025-10-22T23:23:29.267764] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:29.310426] [DEBUG] [LOCAL ] CWEN: Loaded 45287 existing records from primary storage. [2025-10-22T23:23:29.310587] [INFO ] [MAIN ] CWEN: Loaded 45287 primary data records. [2025-10-22T23:23:29.619742] [DEBUG] [MAIN ] CWEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:29.644481] [INFO ] [MAIN ] CWEN: Generated 138 derivative records from 45287 primary records. [2025-10-22T23:23:29.644589] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-10-22T23:23:29.659399] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1794 records). [2025-10-22T23:23:29.659482] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-10-22T23:23:29.662373] [INFO ] [MAIN ] Derivative Progress: 456/2052 symbols. CWEN took 0.4s. Estimated remaining time: 10m 35s [2025-10-22T23:23:29.662470] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:29.711802] [DEBUG] [LOCAL ] CWH: Loaded 51271 existing records from primary storage. [2025-10-22T23:23:29.711969] [INFO ] [MAIN ] CWH: Loaded 51271 primary data records. [2025-10-22T23:23:30.017153] [DEBUG] [MAIN ] CWH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:30.042369] [INFO ] [MAIN ] CWH: Generated 138 derivative records from 51271 primary records. [2025-10-22T23:23:30.042477] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-10-22T23:23:30.057410] [DEBUG] [LOCAL ] CWH: Derivative data saved (1794 records). [2025-10-22T23:23:30.057498] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-10-22T23:23:30.060618] [INFO ] [MAIN ] Derivative Progress: 457/2052 symbols. CWH took 0.4s. Estimated remaining time: 10m 34s [2025-10-22T23:23:30.060743] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:30.107136] [DEBUG] [LOCAL ] CWK: Loaded 49638 existing records from primary storage. [2025-10-22T23:23:30.107339] [INFO ] [MAIN ] CWK: Loaded 49638 primary data records. [2025-10-22T23:23:30.442308] [DEBUG] [MAIN ] CWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:30.467181] [INFO ] [MAIN ] CWK: Generated 138 derivative records from 49638 primary records. [2025-10-22T23:23:30.467318] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-22T23:23:30.482459] [DEBUG] [LOCAL ] CWK: Derivative data saved (1794 records). [2025-10-22T23:23:30.482547] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-10-22T23:23:30.485610] [INFO ] [MAIN ] Derivative Progress: 458/2052 symbols. CWK took 0.4s. Estimated remaining time: 10m 34s [2025-10-22T23:23:30.485751] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:30.515335] [DEBUG] [LOCAL ] CWT: Loaded 28062 existing records from primary storage. [2025-10-22T23:23:30.515496] [INFO ] [MAIN ] CWT: Loaded 28062 primary data records. [2025-10-22T23:23:30.823493] [DEBUG] [MAIN ] CWT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:30.848374] [INFO ] [MAIN ] CWT: Generated 138 derivative records from 28062 primary records. [2025-10-22T23:23:30.848504] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-10-22T23:23:30.863115] [DEBUG] [LOCAL ] CWT: Derivative data saved (1794 records). [2025-10-22T23:23:30.863208] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-10-22T23:23:30.866044] [INFO ] [MAIN ] Derivative Progress: 459/2052 symbols. CWT took 0.4s. Estimated remaining time: 10m 33s [2025-10-22T23:23:30.866150] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:30.919221] [DEBUG] [LOCAL ] CX: Loaded 52826 existing records from primary storage. [2025-10-22T23:23:30.919386] [INFO ] [MAIN ] CX: Loaded 52826 primary data records. [2025-10-22T23:23:31.227359] [DEBUG] [MAIN ] CX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:31.253929] [INFO ] [MAIN ] CX: Generated 138 derivative records from 52826 primary records. [2025-10-22T23:23:31.254105] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-22T23:23:31.269044] [DEBUG] [LOCAL ] CX: Derivative data saved (1794 records). [2025-10-22T23:23:31.269141] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-10-22T23:23:31.272436] [INFO ] [MAIN ] Derivative Progress: 460/2052 symbols. CX took 0.4s. Estimated remaining time: 10m 33s [2025-10-22T23:23:31.272535] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:31.283605] [DEBUG] [LOCAL ] CXE: Loaded 6414 existing records from primary storage. [2025-10-22T23:23:31.283776] [INFO ] [MAIN ] CXE: Loaded 6414 primary data records. [2025-10-22T23:23:31.587193] [DEBUG] [MAIN ] CXE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:31.611899] [INFO ] [MAIN ] CXE: Generated 138 derivative records from 6414 primary records. [2025-10-22T23:23:31.612007] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-22T23:23:31.625494] [DEBUG] [LOCAL ] CXE: Derivative data saved (1794 records). [2025-10-22T23:23:31.625580] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-22T23:23:31.627863] [INFO ] [MAIN ] Derivative Progress: 461/2052 symbols. CXE took 0.4s. Estimated remaining time: 10m 33s [2025-10-22T23:23:31.627956] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:31.635709] [DEBUG] [LOCAL ] CXH: Loaded 4392 existing records from primary storage. [2025-10-22T23:23:31.635842] [INFO ] [MAIN ] CXH: Loaded 4392 primary data records. [2025-10-22T23:23:31.937077] [DEBUG] [MAIN ] CXH: Filtered 6931 bins outside market hours, 7727 incomplete bins [2025-10-22T23:23:31.963545] [INFO ] [MAIN ] CXH: Generated 138 derivative records from 4392 primary records. [2025-10-22T23:23:31.963742] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-22T23:23:31.976715] [DEBUG] [LOCAL ] CXH: Derivative data saved (1791 records). [2025-10-22T23:23:31.976798] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-10-22T23:23:31.979211] [INFO ] [MAIN ] Derivative Progress: 462/2052 symbols. CXH took 0.4s. Estimated remaining time: 10m 32s [2025-10-22T23:23:31.979313] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:32.023699] [DEBUG] [LOCAL ] CXM: Loaded 47404 existing records from primary storage. [2025-10-22T23:23:32.023860] [INFO ] [MAIN ] CXM: Loaded 47404 primary data records. [2025-10-22T23:23:32.346570] [DEBUG] [MAIN ] CXM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:32.371810] [INFO ] [MAIN ] CXM: Generated 138 derivative records from 47404 primary records. [2025-10-22T23:23:32.371982] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-22T23:23:32.386871] [DEBUG] [LOCAL ] CXM: Derivative data saved (1794 records). [2025-10-22T23:23:32.386966] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-22T23:23:32.390089] [INFO ] [MAIN ] Derivative Progress: 463/2052 symbols. CXM took 0.4s. Estimated remaining time: 10m 32s [2025-10-22T23:23:32.390186] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:32.420155] [DEBUG] [LOCAL ] CXT: Loaded 30698 existing records from primary storage. [2025-10-22T23:23:32.420302] [INFO ] [MAIN ] CXT: Loaded 30698 primary data records. [2025-10-22T23:23:32.731280] [DEBUG] [MAIN ] CXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:32.756610] [INFO ] [MAIN ] CXT: Generated 138 derivative records from 30698 primary records. [2025-10-22T23:23:32.756741] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-22T23:23:32.771967] [DEBUG] [LOCAL ] CXT: Derivative data saved (1794 records). [2025-10-22T23:23:32.772121] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-22T23:23:32.775058] [INFO ] [MAIN ] Derivative Progress: 464/2052 symbols. CXT took 0.4s. Estimated remaining time: 10m 31s [2025-10-22T23:23:32.775154] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:32.817080] [DEBUG] [LOCAL ] CXW: Loaded 43639 existing records from primary storage. [2025-10-22T23:23:32.817264] [INFO ] [MAIN ] CXW: Loaded 43639 primary data records. [2025-10-22T23:23:33.121024] [DEBUG] [MAIN ] CXW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:33.146049] [INFO ] [MAIN ] CXW: Generated 138 derivative records from 43639 primary records. [2025-10-22T23:23:33.146173] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-22T23:23:33.161007] [DEBUG] [LOCAL ] CXW: Derivative data saved (1794 records). [2025-10-22T23:23:33.161087] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-22T23:23:33.163952] [INFO ] [MAIN ] Derivative Progress: 465/2052 symbols. CXW took 0.4s. Estimated remaining time: 10m 31s [2025-10-22T23:23:33.164047] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:33.191547] [DEBUG] [LOCAL ] CYD: Loaded 27277 existing records from primary storage. [2025-10-22T23:23:33.191725] [INFO ] [MAIN ] CYD: Loaded 27277 primary data records. [2025-10-22T23:23:33.496207] [DEBUG] [MAIN ] CYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:33.521011] [INFO ] [MAIN ] CYD: Generated 138 derivative records from 27277 primary records. [2025-10-22T23:23:33.521120] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-10-22T23:23:33.535710] [DEBUG] [LOCAL ] CYD: Derivative data saved (1794 records). [2025-10-22T23:23:33.535790] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-10-22T23:23:33.538600] [INFO ] [MAIN ] Derivative Progress: 466/2052 symbols. CYD took 0.4s. Estimated remaining time: 10m 30s [2025-10-22T23:23:33.538735] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:33.581626] [DEBUG] [LOCAL ] CYH: Loaded 47658 existing records from primary storage. [2025-10-22T23:23:33.581813] [INFO ] [MAIN ] CYH: Loaded 47658 primary data records. [2025-10-22T23:23:33.889316] [DEBUG] [MAIN ] CYH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:33.914262] [INFO ] [MAIN ] CYH: Generated 138 derivative records from 47658 primary records. [2025-10-22T23:23:33.914400] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-22T23:23:33.929232] [DEBUG] [LOCAL ] CYH: Derivative data saved (1794 records). [2025-10-22T23:23:33.929316] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-22T23:23:33.932275] [INFO ] [MAIN ] Derivative Progress: 467/2052 symbols. CYH took 0.4s. Estimated remaining time: 10m 30s [2025-10-22T23:23:33.932366] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:33.983400] [DEBUG] [LOCAL ] D: Loaded 53649 existing records from primary storage. [2025-10-22T23:23:33.983556] [INFO ] [MAIN ] D: Loaded 53649 primary data records. [2025-10-22T23:23:34.315172] [DEBUG] [MAIN ] D: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:34.341743] [INFO ] [MAIN ] D: Generated 138 derivative records from 53649 primary records. [2025-10-22T23:23:34.341921] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-10-22T23:23:34.356944] [DEBUG] [LOCAL ] D: Derivative data saved (1794 records). [2025-10-22T23:23:34.357055] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-10-22T23:23:34.360286] [INFO ] [MAIN ] Derivative Progress: 468/2052 symbols. D took 0.4s. Estimated remaining time: 10m 30s [2025-10-22T23:23:34.360392] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:34.376616] [DEBUG] [LOCAL ] DAC: Loaded 12381 existing records from primary storage. [2025-10-22T23:23:34.376817] [INFO ] [MAIN ] DAC: Loaded 12381 primary data records. [2025-10-22T23:23:34.690026] [DEBUG] [MAIN ] DAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:34.715016] [INFO ] [MAIN ] DAC: Generated 138 derivative records from 12381 primary records. [2025-10-22T23:23:34.715129] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-10-22T23:23:34.729573] [DEBUG] [LOCAL ] DAC: Derivative data saved (1794 records). [2025-10-22T23:23:34.729683] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-10-22T23:23:34.732321] [INFO ] [MAIN ] Derivative Progress: 469/2052 symbols. DAC took 0.4s. Estimated remaining time: 10m 29s [2025-10-22T23:23:34.732414] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:34.785517] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-22T23:23:34.785721] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-10-22T23:23:35.107623] [DEBUG] [MAIN ] DAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:35.134215] [INFO ] [MAIN ] DAL: Generated 138 derivative records from 53753 primary records. [2025-10-22T23:23:35.134391] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-10-22T23:23:35.149434] [DEBUG] [LOCAL ] DAL: Derivative data saved (1794 records). [2025-10-22T23:23:35.149525] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-10-22T23:23:35.152974] [INFO ] [MAIN ] Derivative Progress: 470/2052 symbols. DAL took 0.4s. Estimated remaining time: 10m 29s [2025-10-22T23:23:35.153077] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:35.201754] [DEBUG] [LOCAL ] DAN: Loaded 49384 existing records from primary storage. [2025-10-22T23:23:35.201916] [INFO ] [MAIN ] DAN: Loaded 49384 primary data records. [2025-10-22T23:23:35.519690] [DEBUG] [MAIN ] DAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:35.545524] [INFO ] [MAIN ] DAN: Generated 138 derivative records from 49384 primary records. [2025-10-22T23:23:35.545721] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-10-22T23:23:35.560961] [DEBUG] [LOCAL ] DAN: Derivative data saved (1794 records). [2025-10-22T23:23:35.561082] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-10-22T23:23:35.564056] [INFO ] [MAIN ] Derivative Progress: 471/2052 symbols. DAN took 0.4s. Estimated remaining time: 10m 28s [2025-10-22T23:23:35.564176] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:35.586520] [DEBUG] [LOCAL ] DAO: Loaded 19714 existing records from primary storage. [2025-10-22T23:23:35.586700] [INFO ] [MAIN ] DAO: Loaded 19714 primary data records. [2025-10-22T23:23:35.898175] [DEBUG] [MAIN ] DAO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:35.924970] [INFO ] [MAIN ] DAO: Generated 138 derivative records from 19714 primary records. [2025-10-22T23:23:35.925121] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-10-22T23:23:35.939729] [DEBUG] [LOCAL ] DAO: Derivative data saved (1794 records). [2025-10-22T23:23:35.939814] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-10-22T23:23:35.942793] [INFO ] [MAIN ] Derivative Progress: 472/2052 symbols. DAO took 0.4s. Estimated remaining time: 10m 28s [2025-10-22T23:23:35.942881] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:36.001389] [DEBUG] [LOCAL ] DAR: Loaded 51998 existing records from primary storage. [2025-10-22T23:23:36.001558] [INFO ] [MAIN ] DAR: Loaded 51998 primary data records. [2025-10-22T23:23:36.357809] [DEBUG] [MAIN ] DAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:36.389010] [INFO ] [MAIN ] DAR: Generated 138 derivative records from 51998 primary records. [2025-10-22T23:23:36.389142] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-22T23:23:36.408137] [DEBUG] [LOCAL ] DAR: Derivative data saved (1794 records). [2025-10-22T23:23:36.408269] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-22T23:23:36.411571] [INFO ] [MAIN ] Derivative Progress: 473/2052 symbols. DAR took 0.5s. Estimated remaining time: 10m 28s [2025-10-22T23:23:36.411703] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:36.455366] [DEBUG] [LOCAL ] DAVA: Loaded 41943 existing records from primary storage. [2025-10-22T23:23:36.455560] [INFO ] [MAIN ] DAVA: Loaded 41943 primary data records. [2025-10-22T23:23:36.789804] [DEBUG] [MAIN ] DAVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:36.815057] [INFO ] [MAIN ] DAVA: Generated 138 derivative records from 41943 primary records. [2025-10-22T23:23:36.815253] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-22T23:23:36.830661] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1794 records). [2025-10-22T23:23:36.830803] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-10-22T23:23:36.834382] [INFO ] [MAIN ] Derivative Progress: 474/2052 symbols. DAVA took 0.4s. Estimated remaining time: 10m 28s [2025-10-22T23:23:36.834536] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:36.881248] [DEBUG] [LOCAL ] DAY: Loaded 49122 existing records from primary storage. [2025-10-22T23:23:36.881442] [INFO ] [MAIN ] DAY: Loaded 49122 primary data records. [2025-10-22T23:23:37.195546] [DEBUG] [MAIN ] DAY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:37.221073] [INFO ] [MAIN ] DAY: Generated 138 derivative records from 49122 primary records. [2025-10-22T23:23:37.221220] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-10-22T23:23:37.236120] [DEBUG] [LOCAL ] DAY: Derivative data saved (1794 records). [2025-10-22T23:23:37.236201] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-10-22T23:23:37.239264] [INFO ] [MAIN ] Derivative Progress: 475/2052 symbols. DAY took 0.4s. Estimated remaining time: 10m 27s [2025-10-22T23:23:37.239357] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:37.290382] [DEBUG] [LOCAL ] DB: Loaded 52466 existing records from primary storage. [2025-10-22T23:23:37.290551] [INFO ] [MAIN ] DB: Loaded 52466 primary data records. [2025-10-22T23:23:37.602201] [DEBUG] [MAIN ] DB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:37.628106] [INFO ] [MAIN ] DB: Generated 138 derivative records from 52466 primary records. [2025-10-22T23:23:37.628238] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-22T23:23:37.643389] [DEBUG] [LOCAL ] DB: Derivative data saved (1794 records). [2025-10-22T23:23:37.643474] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-10-22T23:23:37.646800] [INFO ] [MAIN ] Derivative Progress: 476/2052 symbols. DB took 0.4s. Estimated remaining time: 10m 27s [2025-10-22T23:23:37.646895] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:37.686758] [DEBUG] [LOCAL ] DBI: Loaded 43370 existing records from primary storage. [2025-10-22T23:23:37.686917] [INFO ] [MAIN ] DBI: Loaded 43370 primary data records. [2025-10-22T23:23:38.008355] [DEBUG] [MAIN ] DBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:38.033917] [INFO ] [MAIN ] DBI: Generated 138 derivative records from 43370 primary records. [2025-10-22T23:23:38.034051] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-22T23:23:38.049296] [DEBUG] [LOCAL ] DBI: Derivative data saved (1794 records). [2025-10-22T23:23:38.049384] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-10-22T23:23:38.052393] [INFO ] [MAIN ] Derivative Progress: 477/2052 symbols. DBI took 0.4s. Estimated remaining time: 10m 26s [2025-10-22T23:23:38.052489] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:38.064668] [DEBUG] [LOCAL ] DBL: Loaded 9247 existing records from primary storage. [2025-10-22T23:23:38.064794] [INFO ] [MAIN ] DBL: Loaded 9247 primary data records. [2025-10-22T23:23:38.382841] [DEBUG] [MAIN ] DBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:38.407665] [INFO ] [MAIN ] DBL: Generated 138 derivative records from 9247 primary records. [2025-10-22T23:23:38.407798] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-10-22T23:23:38.422849] [DEBUG] [LOCAL ] DBL: Derivative data saved (1794 records). [2025-10-22T23:23:38.422936] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-10-22T23:23:38.425059] [INFO ] [MAIN ] Derivative Progress: 478/2052 symbols. DBL took 0.4s. Estimated remaining time: 10m 26s [2025-10-22T23:23:38.425178] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:38.472016] [DEBUG] [LOCAL ] DBRG: Loaded 49979 existing records from primary storage. [2025-10-22T23:23:38.472178] [INFO ] [MAIN ] DBRG: Loaded 49979 primary data records. [2025-10-22T23:23:38.807150] [DEBUG] [MAIN ] DBRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:38.833308] [INFO ] [MAIN ] DBRG: Generated 138 derivative records from 49979 primary records. [2025-10-22T23:23:38.833469] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-10-22T23:23:38.849222] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1794 records). [2025-10-22T23:23:38.849320] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-10-22T23:23:38.852395] [INFO ] [MAIN ] Derivative Progress: 479/2052 symbols. DBRG took 0.4s. Estimated remaining time: 10m 26s [2025-10-22T23:23:38.852497] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:38.888266] [DEBUG] [LOCAL ] DCI: Loaded 36843 existing records from primary storage. [2025-10-22T23:23:38.888429] [INFO ] [MAIN ] DCI: Loaded 36843 primary data records. [2025-10-22T23:23:39.198246] [DEBUG] [MAIN ] DCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:39.223707] [INFO ] [MAIN ] DCI: Generated 138 derivative records from 36843 primary records. [2025-10-22T23:23:39.223910] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-10-22T23:23:39.238937] [DEBUG] [LOCAL ] DCI: Derivative data saved (1794 records). [2025-10-22T23:23:39.239070] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-10-22T23:23:39.242199] [INFO ] [MAIN ] Derivative Progress: 480/2052 symbols. DCI took 0.4s. Estimated remaining time: 10m 25s [2025-10-22T23:23:39.242304] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:39.260412] [DEBUG] [LOCAL ] DCO: Loaded 14967 existing records from primary storage. [2025-10-22T23:23:39.260553] [INFO ] [MAIN ] DCO: Loaded 14967 primary data records. [2025-10-22T23:23:39.577151] [DEBUG] [MAIN ] DCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:39.602882] [INFO ] [MAIN ] DCO: Generated 138 derivative records from 14967 primary records. [2025-10-22T23:23:39.603010] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-10-22T23:23:39.618247] [DEBUG] [LOCAL ] DCO: Derivative data saved (1794 records). [2025-10-22T23:23:39.618328] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-10-22T23:23:39.621177] [INFO ] [MAIN ] Derivative Progress: 481/2052 symbols. DCO took 0.4s. Estimated remaining time: 10m 25s [2025-10-22T23:23:39.621279] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:39.677245] [DEBUG] [LOCAL ] DDD: Loaded 50948 existing records from primary storage. [2025-10-22T23:23:39.677448] [INFO ] [MAIN ] DDD: Loaded 50948 primary data records. [2025-10-22T23:23:39.993232] [DEBUG] [MAIN ] DDD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:40.019079] [INFO ] [MAIN ] DDD: Generated 138 derivative records from 50948 primary records. [2025-10-22T23:23:40.019251] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-10-22T23:23:40.034596] [DEBUG] [LOCAL ] DDD: Derivative data saved (1794 records). [2025-10-22T23:23:40.034777] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-10-22T23:23:40.038138] [INFO ] [MAIN ] Derivative Progress: 482/2052 symbols. DDD took 0.4s. Estimated remaining time: 10m 24s [2025-10-22T23:23:40.038243] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:40.072008] [DEBUG] [LOCAL ] DDL: Loaded 37179 existing records from primary storage. [2025-10-22T23:23:40.072156] [INFO ] [MAIN ] DDL: Loaded 37179 primary data records. [2025-10-22T23:23:40.256419] [WARN ] [STATE ] Received SIGINT signal. Initiating graceful shutdown... [2025-10-22T23:23:40.392990] [DEBUG] [MAIN ] DDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:40.422273] [INFO ] [MAIN ] DDL: Generated 138 derivative records from 37179 primary records. [2025-10-22T23:23:40.422473] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-10-22T23:23:40.437578] [DEBUG] [LOCAL ] DDL: Derivative data saved (1794 records). [2025-10-22T23:23:40.437751] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-10-22T23:23:40.440912] [INFO ] [MAIN ] Derivative Progress: 483/2052 symbols. DDL took 0.4s. Estimated remaining time: 10m 24s [2025-10-22T23:23:40.441022] [WARN ] [MAIN ] Shutdown requested, stopping derivative generation at symbol 484/2052. [2025-10-22T23:23:40.441103] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (483/2052 symbols) [2025-10-22T23:23:43.519963] [INFO ] [MAIN ] Using last completed trading day: 2025-10-22 [2025-10-22T23:23:43.520100] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-22T23:23:43.520177] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-22T23:23:43.520274] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-22T23:23:43.520341] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-22T23:23:45.012545] [DEBUG] [SYMBOL ] Found 2419 valid NYSE symbols. [2025-10-22T23:23:45.012774] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-22T23:23:45.013008] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-22T23:23:45.013672] [INFO ] [LOCAL ] Symbols cache updated with 2367 symbols. [2025-10-22T23:23:45.013749] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-22T23:23:45.013819] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-22T23:23:45.013918] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-22T23:23:45.014009] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-22T23:23:45.014078] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-22T23:23:45.014465] [DEBUG] [LOCAL ] Found 2367 symbols in cached list. [2025-10-22T23:23:45.014534] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-22T23:23:45.014771] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-22T23:23:45.014849] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2367 valid symbols. [2025-10-22T23:23:45.014919] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-22T23:23:45.014991] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-22T23:23:45.041703] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-22T23:23:45.043404] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-22T23:23:45.043478] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-22T23:23:45.043547] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-22T23:23:45.043613] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-22T23:23:45.043726] [INFO ] [MAIN ] Running derivative generation in single-threaded mode [2025-10-22T23:23:45.043796] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-22T23:23:45.043868] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-22T23:23:45.044286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-10-22T23:23:45.044457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-10-22T23:23:45.044633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-10-22T23:23:45.044801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-22T23:23:45.044973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-10-22T23:23:45.045124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-22T23:23:45.045272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-10-22T23:23:45.045423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-10-22T23:23:45.045580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-10-22T23:23:45.045760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-22T23:23:45.045901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-22T23:23:45.046015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-10-22T23:23:45.046184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-10-22T23:23:45.046329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-22T23:23:45.046468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-10-22T23:23:45.046614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-10-22T23:23:45.046806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-10-22T23:23:45.046961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-10-22T23:23:45.047116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-10-22T23:23:45.047261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-22T23:23:45.047431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-10-22T23:23:45.047574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-22T23:23:45.047748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-22T23:23:45.047903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-10-22T23:23:45.048061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-22T23:23:45.048211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-10-22T23:23:45.048351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-22T23:23:45.048493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-10-22T23:23:45.048633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-10-22T23:23:45.048833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-22T23:23:45.048987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-10-22T23:23:45.049142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-22T23:23:45.049277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-10-22T23:23:45.049489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-10-22T23:23:45.049662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-10-22T23:23:45.049819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-10-22T23:23:45.049960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-10-22T23:23:45.050130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-22T23:23:45.050266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-10-22T23:23:45.050403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-22T23:23:45.050541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-10-22T23:23:45.050706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-22T23:23:45.050861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-10-22T23:23:45.051004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-10-22T23:23:45.051144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-10-22T23:23:45.051281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-10-22T23:23:45.051420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-10-22T23:23:45.051567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-10-22T23:23:45.051725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-22T23:23:45.051884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-10-22T23:23:45.052083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-10-22T23:23:45.052224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-22T23:23:45.052369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-10-22T23:23:45.052509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-10-22T23:23:45.052679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-10-22T23:23:45.052818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-10-22T23:23:45.052957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-22T23:23:45.053100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-10-22T23:23:45.053241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-10-22T23:23:45.053394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-22T23:23:45.053505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-10-22T23:23:45.053669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-10-22T23:23:45.053810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-22T23:23:45.053921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-10-22T23:23:45.054057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-10-22T23:23:45.054353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-10-22T23:23:45.054496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-10-22T23:23:45.054637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-22T23:23:45.054827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-22T23:23:45.054977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-10-22T23:23:45.055139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-10-22T23:23:45.055284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-10-22T23:23:45.055420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-22T23:23:45.055557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-10-22T23:23:45.055714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-10-22T23:23:45.055872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-10-22T23:23:45.056017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-22T23:23:45.056206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-10-22T23:23:45.056348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-22T23:23:45.056483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-22T23:23:45.056619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-22T23:23:45.056776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-10-22T23:23:45.056934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-10-22T23:23:45.057074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-10-22T23:23:45.057236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-22T23:23:45.057403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-10-22T23:23:45.057541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-10-22T23:23:45.057708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-22T23:23:45.057854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-10-22T23:23:45.057997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-10-22T23:23:45.058138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-10-22T23:23:45.058294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-10-22T23:23:45.058435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-10-22T23:23:45.058594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-22T23:23:45.058750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-22T23:23:45.058886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-10-22T23:23:45.059065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-22T23:23:45.059222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-10-22T23:23:45.059384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-10-22T23:23:45.059546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-10-22T23:23:45.059754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-22T23:23:45.059887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-10-22T23:23:45.060157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-10-22T23:23:45.060297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-10-22T23:23:45.060439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-10-22T23:23:45.060580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-22T23:23:45.060796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-10-22T23:23:45.060941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-22T23:23:45.061084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-10-22T23:23:45.061229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-10-22T23:23:45.061408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-22T23:23:45.061550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-22T23:23:45.061712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-10-22T23:23:45.061854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-10-22T23:23:45.061992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-22T23:23:45.062125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-22T23:23:45.062263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-10-22T23:23:45.062440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-10-22T23:23:45.062585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-10-22T23:23:45.062760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-10-22T23:23:45.062913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-10-22T23:23:45.063058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-10-22T23:23:45.063207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-10-22T23:23:45.063354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-10-22T23:23:45.063511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-22T23:23:45.063689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-22T23:23:45.063869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-10-22T23:23:45.064040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-10-22T23:23:45.064185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-10-22T23:23:45.064313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-10-22T23:23:45.064454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-10-22T23:23:45.064591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-10-22T23:23:45.064785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-10-22T23:23:45.064925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-10-22T23:23:45.065071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-10-22T23:23:45.065224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-22T23:23:45.065363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-10-22T23:23:45.065503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-22T23:23:45.065673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-22T23:23:45.065817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-10-22T23:23:45.065976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-10-22T23:23:45.066310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-22T23:23:45.066455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-22T23:23:45.066616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-10-22T23:23:45.066793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-22T23:23:45.066938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-10-22T23:23:45.067082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-22T23:23:45.067229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-22T23:23:45.067388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-22T23:23:45.067528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-10-22T23:23:45.067704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-10-22T23:23:45.067847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-22T23:23:45.068160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-22T23:23:45.068302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-10-22T23:23:45.068446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-10-22T23:23:45.068589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-10-22T23:23:45.068773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-22T23:23:45.068919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-22T23:23:45.069090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-10-22T23:23:45.069231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-10-22T23:23:45.069373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-10-22T23:23:45.069533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-22T23:23:45.069697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-22T23:23:45.069837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-22T23:23:45.069974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-10-22T23:23:45.070112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-22T23:23:45.070250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-22T23:23:45.070409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-22T23:23:45.070560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-22T23:23:45.070762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-22T23:23:45.070903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-10-22T23:23:45.071053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-10-22T23:23:45.071195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-10-22T23:23:45.071345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-10-22T23:23:45.071525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-10-22T23:23:45.071739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-22T23:23:45.071881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-10-22T23:23:45.072012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-10-22T23:23:45.072152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-10-22T23:23:45.072288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-22T23:23:45.072410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAMI.csv [2025-10-22T23:23:45.072546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-22T23:23:45.072842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-10-22T23:23:45.072986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-10-22T23:23:45.073168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-10-22T23:23:45.073315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-10-22T23:23:45.073462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-10-22T23:23:45.073599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-22T23:23:45.073764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-22T23:23:45.073902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-10-22T23:23:45.074006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-10-22T23:23:45.074147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-10-22T23:23:45.074286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-10-22T23:23:45.074424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-10-22T23:23:45.074557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-22T23:23:45.074716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-22T23:23:45.074857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-10-22T23:23:45.074996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-10-22T23:23:45.075143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-10-22T23:23:45.075404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-22T23:23:45.075544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-10-22T23:23:45.075761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-22T23:23:45.075906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-10-22T23:23:45.076046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-10-22T23:23:45.076186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-10-22T23:23:45.076323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-22T23:23:45.076460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-10-22T23:23:45.076598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-10-22T23:23:45.076825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-22T23:23:45.076965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-22T23:23:45.077119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-22T23:23:45.077271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-10-22T23:23:45.077443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-22T23:23:45.077580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-22T23:23:45.077743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-10-22T23:23:45.077884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-10-22T23:23:45.078020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-10-22T23:23:45.078156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-10-22T23:23:45.078293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-10-22T23:23:45.078442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-10-22T23:23:45.078609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-10-22T23:23:45.078772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-22T23:23:45.078914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-10-22T23:23:45.079055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-22T23:23:45.079195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-10-22T23:23:45.079334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-10-22T23:23:45.079473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-10-22T23:23:45.079578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-10-22T23:23:45.079754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-22T23:23:45.079904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-22T23:23:45.080060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-10-22T23:23:45.080206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-10-22T23:23:45.080347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-10-22T23:23:45.080487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-22T23:23:45.080626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-22T23:23:45.080790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-10-22T23:23:45.081181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-10-22T23:23:45.081325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-10-22T23:23:45.081491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-10-22T23:23:45.081633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-10-22T23:23:45.081858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-22T23:23:45.081995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-10-22T23:23:45.082134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-10-22T23:23:45.082271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-22T23:23:45.082407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-10-22T23:23:45.082542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-10-22T23:23:45.082704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-22T23:23:45.082842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-10-22T23:23:45.082979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-22T23:23:45.083116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-22T23:23:45.083266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-22T23:23:45.083420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-10-22T23:23:45.083562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-22T23:23:45.083720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-22T23:23:45.083863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-22T23:23:45.084013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-10-22T23:23:45.084146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-10-22T23:23:45.084283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-22T23:23:45.084419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-22T23:23:45.084554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-10-22T23:23:45.084705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-22T23:23:45.084842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-10-22T23:23:45.084973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-22T23:23:45.085139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-10-22T23:23:45.085279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-10-22T23:23:45.085415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-22T23:23:45.085553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-10-22T23:23:45.085717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-10-22T23:23:45.085858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-22T23:23:45.085998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-10-22T23:23:45.086137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-10-22T23:23:45.086276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-10-22T23:23:45.086457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-22T23:23:45.086601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-10-22T23:23:45.086790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-10-22T23:23:45.086932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-22T23:23:45.087082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-22T23:23:45.087223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-22T23:23:45.087405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-10-22T23:23:45.087547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-10-22T23:23:45.087712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-10-22T23:23:45.087869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-10-22T23:23:45.088010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-22T23:23:45.088150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-22T23:23:45.088304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-10-22T23:23:45.088447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-10-22T23:23:45.088578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-10-22T23:23:45.088773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-22T23:23:45.089087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-10-22T23:23:45.089247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-10-22T23:23:45.089393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-10-22T23:23:45.089529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-10-22T23:23:45.089735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-22T23:23:45.089874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-10-22T23:23:45.090006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-22T23:23:45.090144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-10-22T23:23:45.090277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-10-22T23:23:45.090414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-22T23:23:45.090551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-10-22T23:23:45.090719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-22T23:23:45.090855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-10-22T23:23:45.091011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-10-22T23:23:45.091175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-10-22T23:23:45.091329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-22T23:23:45.091498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-10-22T23:23:45.091713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-10-22T23:23:45.091886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-10-22T23:23:45.092067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-22T23:23:45.092242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-10-22T23:23:45.092422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-10-22T23:23:45.092565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-10-22T23:23:45.092775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-10-22T23:23:45.092958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-10-22T23:23:45.093116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-22T23:23:45.093300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-10-22T23:23:45.093476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-10-22T23:23:45.093734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-10-22T23:23:45.093918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-22T23:23:45.094104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-10-22T23:23:45.094288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-22T23:23:45.094466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-10-22T23:23:45.094684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-10-22T23:23:45.094865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-10-22T23:23:45.095045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-10-22T23:23:45.095240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-22T23:23:45.095434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-10-22T23:23:45.095616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-22T23:23:45.095820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-10-22T23:23:45.096015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-10-22T23:23:45.096202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-22T23:23:45.096378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-22T23:23:45.096558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-22T23:23:45.096765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-10-22T23:23:45.096944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-10-22T23:23:45.097130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-10-22T23:23:45.097603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-22T23:23:45.097822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-10-22T23:23:45.097996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-10-22T23:23:45.098175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-10-22T23:23:45.098351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-10-22T23:23:45.098522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-10-22T23:23:45.098717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-10-22T23:23:45.098890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-22T23:23:45.099076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-10-22T23:23:45.099251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-10-22T23:23:45.099430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-22T23:23:45.099602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-10-22T23:23:45.099984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-10-22T23:23:45.100172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-10-22T23:23:45.100346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-22T23:23:45.100542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-10-22T23:23:45.100796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-22T23:23:45.100987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-10-22T23:23:45.101180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-10-22T23:23:45.101360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-10-22T23:23:45.101542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-10-22T23:23:45.101895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-22T23:23:45.102099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-10-22T23:23:45.102286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-10-22T23:23:45.102466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-22T23:23:45.102638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-10-22T23:23:45.102877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-10-22T23:23:45.103058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-10-22T23:23:45.103236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-10-22T23:23:45.103413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-22T23:23:45.103594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-10-22T23:23:45.103792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-10-22T23:23:45.103964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-10-22T23:23:45.104145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-10-22T23:23:45.104327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-10-22T23:23:45.104463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-10-22T23:23:45.104681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-22T23:23:45.104853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-10-22T23:23:45.105036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-10-22T23:23:45.105219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-10-22T23:23:45.105398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-22T23:23:45.105578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-10-22T23:23:45.105787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-22T23:23:45.105926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-22T23:23:45.106092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-22T23:23:45.106257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-10-22T23:23:45.106449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-10-22T23:23:45.106618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-10-22T23:23:45.106823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-22T23:23:45.107002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-10-22T23:23:45.107177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-10-22T23:23:45.107334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-10-22T23:23:45.107623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-10-22T23:23:45.107823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-10-22T23:23:45.108018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-10-22T23:23:45.108175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-10-22T23:23:45.108315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-10-22T23:23:45.108453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-10-22T23:23:45.108740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-10-22T23:23:45.108881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-10-22T23:23:45.109017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-10-22T23:23:45.109154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-22T23:23:45.109286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-22T23:23:45.109419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-22T23:23:45.109549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-22T23:23:45.109715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-10-22T23:23:45.109855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-10-22T23:23:45.109994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-22T23:23:45.110128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-10-22T23:23:45.110264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-22T23:23:45.110420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-10-22T23:23:45.110554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-10-22T23:23:45.110710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-10-22T23:23:45.110850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-10-22T23:23:45.110987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-10-22T23:23:45.111139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-10-22T23:23:45.111282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-22T23:23:45.111419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-10-22T23:23:45.111558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-10-22T23:23:45.111721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-10-22T23:23:45.111862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-10-22T23:23:45.112000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-10-22T23:23:45.112137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-10-22T23:23:45.112286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-10-22T23:23:45.112393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-10-22T23:23:45.112529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-10-22T23:23:45.112689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-22T23:23:45.112827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-10-22T23:23:45.112966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-10-22T23:23:45.113070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-10-22T23:23:45.113212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-22T23:23:45.113374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-22T23:23:45.113515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-10-22T23:23:45.113734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-10-22T23:23:45.113882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-10-22T23:23:45.114019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-22T23:23:45.114157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-10-22T23:23:45.114296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-10-22T23:23:45.114434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-10-22T23:23:45.114573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-22T23:23:45.114754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-10-22T23:23:45.114913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-22T23:23:45.115221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-22T23:23:45.115368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-22T23:23:45.115511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-22T23:23:45.115706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-10-22T23:23:45.115889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-10-22T23:23:45.116031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-22T23:23:45.116169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-10-22T23:23:45.116307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-22T23:23:45.116445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-22T23:23:45.116582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-22T23:23:45.116747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-10-22T23:23:45.116886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-10-22T23:23:45.117025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-10-22T23:23:45.117136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-10-22T23:23:45.117352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-10-22T23:23:45.117500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-10-22T23:23:45.117637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-10-22T23:23:45.117839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-22T23:23:45.117972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-22T23:23:45.118104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-22T23:23:45.118246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-10-22T23:23:45.118386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-22T23:23:45.118526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-10-22T23:23:45.118686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-10-22T23:23:45.118826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-10-22T23:23:45.119146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-22T23:23:45.119292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-10-22T23:23:45.119403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-10-22T23:23:45.119541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-22T23:23:45.119712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-10-22T23:23:45.119863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-10-22T23:23:45.120002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-10-22T23:23:45.120154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-10-22T23:23:45.120296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-10-22T23:23:45.120434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-22T23:23:45.120583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-22T23:23:45.120761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-10-22T23:23:45.120901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-10-22T23:23:45.121038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-10-22T23:23:45.121183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-22T23:23:45.121308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-10-22T23:23:45.121483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-10-22T23:23:45.121760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-10-22T23:23:45.121905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-10-22T23:23:45.122043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-10-22T23:23:45.122182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-22T23:23:45.122264] [INFO ] [LOCAL ] Deleted 483 derivative data files. [2025-10-22T23:23:45.122333] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-22T23:23:45.124513] [INFO ] [LOCAL ] Found 2052 symbols with primary data. [2025-10-22T23:23:45.124593] [INFO ] [MAIN ] Starting derivative generation for 2052 symbols. [2025-10-22T23:23:45.124708] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:45.185173] [DEBUG] [LOCAL ] A: Loaded 50664 existing records from primary storage. [2025-10-22T23:23:45.185346] [INFO ] [MAIN ] A: Loaded 50664 primary data records. [2025-10-22T23:23:45.532818] [DEBUG] [MAIN ] A: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:45.560757] [INFO ] [MAIN ] A: Generated 138 derivative records from 50664 primary records. [2025-10-22T23:23:45.560906] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-22T23:23:45.561203] [FATAL] [LOCAL ] A: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-22T23:23:45.561296] [FATAL] [MAIN ] A: Failed to save derivative data. [2025-10-22T23:23:45.564018] [WARN ] [MAIN ] A: Failed to generate derivative data. [2025-10-22T23:23:45.564151] [INFO ] [MAIN ] Derivative Progress: 1/2052 symbols. A took 0.4s. Estimated remaining time: 15m 1s [2025-10-22T23:23:45.564254] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:45.618237] [DEBUG] [LOCAL ] AA: Loaded 53622 existing records from primary storage. [2025-10-22T23:23:45.618431] [INFO ] [MAIN ] AA: Loaded 53622 primary data records. [2025-10-22T23:23:45.928100] [DEBUG] [MAIN ] AA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:45.953532] [INFO ] [MAIN ] AA: Generated 138 derivative records from 53622 primary records. [2025-10-22T23:23:45.953700] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-22T23:23:45.953949] [FATAL] [LOCAL ] AA: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-22T23:23:45.954036] [FATAL] [MAIN ] AA: Failed to save derivative data. [2025-10-22T23:23:45.957202] [WARN ] [MAIN ] AA: Failed to generate derivative data. [2025-10-22T23:23:45.957365] [INFO ] [MAIN ] Derivative Progress: 2/2052 symbols. AA took 0.4s. Estimated remaining time: 14m 13s [2025-10-22T23:23:45.957465] [INFO ] [MAIN ] AAMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:45.980428] [DEBUG] [LOCAL ] AAMI: Loaded 24441 existing records from primary storage. [2025-10-22T23:23:45.980601] [INFO ] [MAIN ] AAMI: Loaded 24441 primary data records. [2025-10-22T23:23:46.319306] [DEBUG] [MAIN ] AAMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:46.345491] [INFO ] [MAIN ] AAMI: Generated 138 derivative records from 24441 primary records. [2025-10-22T23:23:46.345714] [DEBUG] [LOCAL ] AAMI: Saving derivative data. [2025-10-22T23:23:46.345996] [FATAL] [LOCAL ] AAMI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-22T23:23:46.346084] [FATAL] [MAIN ] AAMI: Failed to save derivative data. [2025-10-22T23:23:46.348892] [WARN ] [MAIN ] AAMI: Failed to generate derivative data. [2025-10-22T23:23:46.349023] [INFO ] [MAIN ] Derivative Progress: 3/2052 symbols. AAMI took 0.4s. Estimated remaining time: 13m 56s [2025-10-22T23:23:46.349123] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:46.397535] [DEBUG] [LOCAL ] AAP: Loaded 51734 existing records from primary storage. [2025-10-22T23:23:46.397760] [INFO ] [MAIN ] AAP: Loaded 51734 primary data records. [2025-10-22T23:23:46.703782] [DEBUG] [MAIN ] AAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:46.729238] [INFO ] [MAIN ] AAP: Generated 138 derivative records from 51734 primary records. [2025-10-22T23:23:46.729384] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-22T23:23:46.729631] [FATAL] [LOCAL ] AAP: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-22T23:23:46.729732] [FATAL] [MAIN ] AAP: Failed to save derivative data. [2025-10-22T23:23:46.732528] [WARN ] [MAIN ] AAP: Failed to generate derivative data. [2025-10-22T23:23:46.732670] [INFO ] [MAIN ] Derivative Progress: 4/2052 symbols. AAP took 0.4s. Estimated remaining time: 13m 43s [2025-10-22T23:23:46.732773] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:46.762910] [DEBUG] [LOCAL ] AAT: Loaded 30227 existing records from primary storage. [2025-10-22T23:23:46.763064] [INFO ] [MAIN ] AAT: Loaded 30227 primary data records. [2025-10-22T23:23:47.102458] [DEBUG] [MAIN ] AAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:47.134668] [INFO ] [MAIN ] AAT: Generated 138 derivative records from 30227 primary records. [2025-10-22T23:23:47.134921] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-22T23:23:47.135194] [FATAL] [LOCAL ] AAT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-22T23:23:47.135287] [FATAL] [MAIN ] AAT: Failed to save derivative data. [2025-10-22T23:23:47.138828] [WARN ] [MAIN ] AAT: Failed to generate derivative data. [2025-10-22T23:23:47.139000] [INFO ] [MAIN ] Derivative Progress: 5/2052 symbols. AAT took 0.4s. Estimated remaining time: 13m 44s [2025-10-22T23:23:47.139083] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:47.165980] [DEBUG] [LOCAL ] AB: Loaded 24673 existing records from primary storage. [2025-10-22T23:23:47.166153] [INFO ] [MAIN ] AB: Loaded 24673 primary data records. [2025-10-22T23:23:47.593324] [DEBUG] [MAIN ] AB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:47.629391] [INFO ] [MAIN ] AB: Generated 138 derivative records from 24673 primary records. [2025-10-22T23:23:47.629731] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-10-22T23:23:47.630021] [FATAL] [LOCAL ] AB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-22T23:23:47.630122] [FATAL] [MAIN ] AB: Failed to save derivative data. [2025-10-22T23:23:47.633402] [WARN ] [MAIN ] AB: Failed to generate derivative data. [2025-10-22T23:23:47.633634] [INFO ] [MAIN ] Derivative Progress: 6/2052 symbols. AB took 0.5s. Estimated remaining time: 14m 15s [2025-10-22T23:23:47.633769] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:47.672814] [DEBUG] [LOCAL ] ABCB: Loaded 30308 existing records from primary storage. [2025-10-22T23:23:47.673034] [INFO ] [MAIN ] ABCB: Loaded 30308 primary data records. [2025-10-22T23:23:48.065475] [DEBUG] [MAIN ] ABCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:48.100276] [INFO ] [MAIN ] ABCB: Generated 138 derivative records from 30308 primary records. [2025-10-22T23:23:48.100496] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-10-22T23:23:48.100780] [FATAL] [LOCAL ] ABCB: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-22T23:23:48.100875] [FATAL] [MAIN ] ABCB: Failed to save derivative data. [2025-10-22T23:23:48.104670] [WARN ] [MAIN ] ABCB: Failed to generate derivative data. [2025-10-22T23:23:48.104812] [INFO ] [MAIN ] Derivative Progress: 7/2052 symbols. ABCB took 0.5s. Estimated remaining time: 14m 30s [2025-10-22T23:23:48.104910] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:48.160475] [DEBUG] [LOCAL ] ABEV: Loaded 53284 existing records from primary storage. [2025-10-22T23:23:48.160718] [INFO ] [MAIN ] ABEV: Loaded 53284 primary data records. [2025-10-22T23:23:48.516120] [DEBUG] [MAIN ] ABEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:48.542040] [INFO ] [MAIN ] ABEV: Generated 138 derivative records from 53284 primary records. [2025-10-22T23:23:48.542148] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-22T23:23:48.542366] [FATAL] [LOCAL ] ABEV: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-22T23:23:48.542453] [FATAL] [MAIN ] ABEV: Failed to save derivative data. [2025-10-22T23:23:48.546151] [WARN ] [MAIN ] ABEV: Failed to generate derivative data. [2025-10-22T23:23:48.546264] [INFO ] [MAIN ] Derivative Progress: 8/2052 symbols. ABEV took 0.4s. Estimated remaining time: 14m 34s [2025-10-22T23:23:48.546342] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:48.565182] [DEBUG] [LOCAL ] ABG: Loaded 17859 existing records from primary storage. [2025-10-22T23:23:48.565338] [INFO ] [MAIN ] ABG: Loaded 17859 primary data records. [2025-10-22T23:23:48.881125] [DEBUG] [MAIN ] ABG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:48.906782] [INFO ] [MAIN ] ABG: Generated 138 derivative records from 17859 primary records. [2025-10-22T23:23:48.906939] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-10-22T23:23:48.907130] [FATAL] [LOCAL ] ABG: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-22T23:23:48.907206] [FATAL] [MAIN ] ABG: Failed to save derivative data. [2025-10-22T23:23:48.909923] [WARN ] [MAIN ] ABG: Failed to generate derivative data. [2025-10-22T23:23:48.910035] [INFO ] [MAIN ] Derivative Progress: 9/2052 symbols. ABG took 0.4s. Estimated remaining time: 14m 19s [2025-10-22T23:23:48.910109] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:48.964219] [DEBUG] [LOCAL ] ABT: Loaded 53624 existing records from primary storage. [2025-10-22T23:23:48.964400] [INFO ] [MAIN ] ABT: Loaded 53624 primary data records. [2025-10-22T23:23:49.272187] [DEBUG] [MAIN ] ABT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:23:49.297850] [INFO ] [MAIN ] ABT: Generated 138 derivative records from 53624 primary records. [2025-10-22T23:23:49.297973] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-10-22T23:23:49.298163] [FATAL] [LOCAL ] ABT: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-22T23:23:49.298240] [FATAL] [MAIN ] ABT: Failed to save derivative data. [2025-10-22T23:23:49.301012] [WARN ] [MAIN ] ABT: Failed to generate derivative data. [2025-10-22T23:23:49.301122] [INFO ] [MAIN ] Derivative Progress: 10/2052 symbols. ABT took 0.4s. Estimated remaining time: 14m 12s [2025-10-22T23:23:49.301193] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:49.328032] [DEBUG] [LOCAL ] ACEL: Loaded 26346 existing records from primary storage. [2025-10-22T23:23:49.328178] [INFO ] [MAIN ] ACEL: Loaded 26346 primary data records. [2025-10-22T23:23:49.662583] [DEBUG] [MAIN ] ACEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:49.693940] [INFO ] [MAIN ] ACEL: Generated 138 derivative records from 26346 primary records. [2025-10-22T23:23:49.694165] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-10-22T23:23:49.694401] [FATAL] [LOCAL ] ACEL: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-22T23:23:49.694505] [FATAL] [MAIN ] ACEL: Failed to save derivative data. [2025-10-22T23:23:49.697957] [WARN ] [MAIN ] ACEL: Failed to generate derivative data. [2025-10-22T23:23:49.698129] [INFO ] [MAIN ] Derivative Progress: 11/2052 symbols. ACEL took 0.4s. Estimated remaining time: 14m 8s [2025-10-22T23:23:49.698236] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:49.755610] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-22T23:23:49.755837] [INFO ] [MAIN ] ACHR: Loaded 53818 primary data records. [2025-10-22T23:23:50.083899] [DEBUG] [MAIN ] ACHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:50.109380] [INFO ] [MAIN ] ACHR: Generated 138 derivative records from 53818 primary records. [2025-10-22T23:23:50.109520] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-10-22T23:23:50.109755] [FATAL] [LOCAL ] ACHR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-22T23:23:50.109834] [FATAL] [MAIN ] ACHR: Failed to save derivative data. [2025-10-22T23:23:50.112710] [WARN ] [MAIN ] ACHR: Failed to generate derivative data. [2025-10-22T23:23:50.112835] [INFO ] [MAIN ] Derivative Progress: 12/2052 symbols. ACHR took 0.4s. Estimated remaining time: 14m 8s [2025-10-22T23:23:50.112911] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:50.167418] [DEBUG] [LOCAL ] ACI: Loaded 53286 existing records from primary storage. [2025-10-22T23:23:50.167592] [INFO ] [MAIN ] ACI: Loaded 53286 primary data records. [2025-10-22T23:23:50.484196] [DEBUG] [MAIN ] ACI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:50.510148] [INFO ] [MAIN ] ACI: Generated 138 derivative records from 53286 primary records. [2025-10-22T23:23:50.510299] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-22T23:23:50.510495] [FATAL] [LOCAL ] ACI: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-22T23:23:50.510575] [FATAL] [MAIN ] ACI: Failed to save derivative data. [2025-10-22T23:23:50.513542] [WARN ] [MAIN ] ACI: Failed to generate derivative data. [2025-10-22T23:23:50.513715] [INFO ] [MAIN ] Derivative Progress: 13/2052 symbols. ACI took 0.4s. Estimated remaining time: 14m 5s [2025-10-22T23:23:50.513797] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:50.522344] [DEBUG] [LOCAL ] ACR: Loaded 5310 existing records from primary storage. [2025-10-22T23:23:50.522486] [INFO ] [MAIN ] ACR: Loaded 5310 primary data records. [2025-10-22T23:23:50.860516] [DEBUG] [MAIN ] ACR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:50.885903] [INFO ] [MAIN ] ACR: Generated 138 derivative records from 5310 primary records. [2025-10-22T23:23:50.886076] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-22T23:23:50.886276] [FATAL] [LOCAL ] ACR: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-22T23:23:50.886354] [FATAL] [MAIN ] ACR: Failed to save derivative data. [2025-10-22T23:23:50.889040] [WARN ] [MAIN ] ACR: Failed to generate derivative data. [2025-10-22T23:23:50.889160] [INFO ] [MAIN ] Derivative Progress: 14/2052 symbols. ACR took 0.4s. Estimated remaining time: 13m 59s [2025-10-22T23:23:50.889214] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:23:50.919361] [DEBUG] [LOCAL ] ACRE: Loaded 33223 existing records from primary storage. [2025-10-22T23:23:50.919528] [INFO ] [MAIN ] ACRE: Loaded 33223 primary data records. [2025-10-22T23:23:51.138668] [WARN ] [STATE ] Received SIGINT signal. Initiating graceful shutdown... [2025-10-22T23:23:51.244798] [DEBUG] [MAIN ] ACRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:23:51.282192] [INFO ] [MAIN ] ACRE: Generated 138 derivative records from 33223 primary records. [2025-10-22T23:23:51.282419] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-22T23:23:51.282753] [FATAL] [LOCAL ] ACRE: Error saving derivative data: '>=' not supported between instances of 'datetime.date' and 'datetime.datetime' [2025-10-22T23:23:51.282856] [FATAL] [MAIN ] ACRE: Failed to save derivative data. [2025-10-22T23:23:51.287149] [WARN ] [MAIN ] ACRE: Failed to generate derivative data. [2025-10-22T23:23:51.287384] [INFO ] [MAIN ] Derivative Progress: 15/2052 symbols. ACRE took 0.4s. Estimated remaining time: 13m 56s [2025-10-22T23:23:51.287484] [WARN ] [MAIN ] Shutdown requested, stopping derivative generation at symbol 16/2052. [2025-10-22T23:23:51.287576] [WARN ] [MAIN ] Failed symbols (15): A, AA, AAMI, AAP, AAT, AB, ABCB, ABEV, ABG, ABT... [2025-10-22T23:23:51.287693] [INFO ] [MAIN ] Derivative generation success rate: 99.3% (0/2052 symbols) [2025-10-22T23:23:51.917054] [WARN ] [STATE ] Already shutting down, please wait... [2025-10-22T23:26:47.074495] [INFO ] [MAIN ] Using last completed trading day: 2025-10-22 [2025-10-22T23:26:47.074672] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-22T23:26:47.074751] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-22T23:26:47.074847] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-22T23:26:47.074914] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-22T23:26:48.264831] [DEBUG] [SYMBOL ] Found 2419 valid NYSE symbols. [2025-10-22T23:26:48.264985] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-22T23:26:48.265276] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-22T23:26:48.265876] [INFO ] [LOCAL ] Symbols cache updated with 2367 symbols. [2025-10-22T23:26:48.265969] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-22T23:26:48.266061] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-22T23:26:48.266187] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-22T23:26:48.266302] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-22T23:26:48.266392] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-22T23:26:48.266871] [DEBUG] [LOCAL ] Found 2367 symbols in cached list. [2025-10-22T23:26:48.266945] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-22T23:26:48.267198] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-22T23:26:48.267298] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2367 valid symbols. [2025-10-22T23:26:48.267391] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-22T23:26:48.267491] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-22T23:26:48.293175] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-22T23:26:48.293330] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-22T23:26:48.293425] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-22T23:26:48.293522] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-22T23:26:48.293614] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-22T23:26:48.293760] [INFO ] [MAIN ] Running derivative generation in single-threaded mode [2025-10-22T23:26:48.293844] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-22T23:26:48.293952] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-22T23:26:48.294090] [INFO ] [LOCAL ] Deleted 0 derivative data files. [2025-10-22T23:26:48.294180] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-22T23:26:48.296291] [INFO ] [LOCAL ] Found 2052 symbols with primary data. [2025-10-22T23:26:48.296371] [INFO ] [MAIN ] Starting derivative generation for 2052 symbols. [2025-10-22T23:26:48.296475] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:48.354825] [DEBUG] [LOCAL ] A: Loaded 50664 existing records from primary storage. [2025-10-22T23:26:48.355001] [INFO ] [MAIN ] A: Loaded 50664 primary data records. [2025-10-22T23:26:48.680326] [DEBUG] [MAIN ] A: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:48.708545] [INFO ] [MAIN ] A: Generated 138 derivative records from 50664 primary records. [2025-10-22T23:26:48.708700] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-10-22T23:26:48.721373] [DEBUG] [LOCAL ] A: Derivative data saved (138 records). [2025-10-22T23:26:48.721459] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-10-22T23:26:48.723827] [INFO ] [MAIN ] Derivative Progress: 1/2052 symbols. A took 0.4s. Estimated remaining time: 14m 36s [2025-10-22T23:26:48.723926] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:48.773095] [DEBUG] [LOCAL ] AA: Loaded 53622 existing records from primary storage. [2025-10-22T23:26:48.773271] [INFO ] [MAIN ] AA: Loaded 53622 primary data records. [2025-10-22T23:26:49.110248] [DEBUG] [MAIN ] AA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:49.136422] [INFO ] [MAIN ] AA: Generated 138 derivative records from 53622 primary records. [2025-10-22T23:26:49.136576] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-22T23:26:49.148381] [DEBUG] [LOCAL ] AA: Derivative data saved (138 records). [2025-10-22T23:26:49.148475] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-10-22T23:26:49.151178] [INFO ] [MAIN ] Derivative Progress: 2/2052 symbols. AA took 0.4s. Estimated remaining time: 14m 36s [2025-10-22T23:26:49.151286] [INFO ] [MAIN ] AAMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:49.174219] [DEBUG] [LOCAL ] AAMI: Loaded 24441 existing records from primary storage. [2025-10-22T23:26:49.174372] [INFO ] [MAIN ] AAMI: Loaded 24441 primary data records. [2025-10-22T23:26:49.526362] [DEBUG] [MAIN ] AAMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:49.552688] [INFO ] [MAIN ] AAMI: Generated 138 derivative records from 24441 primary records. [2025-10-22T23:26:49.552859] [DEBUG] [LOCAL ] AAMI: Saving derivative data. [2025-10-22T23:26:49.564559] [DEBUG] [LOCAL ] AAMI: Derivative data saved (138 records). [2025-10-22T23:26:49.564733] [INFO ] [MAIN ] AAMI: Successfully saved derivative data. [2025-10-22T23:26:49.566978] [INFO ] [MAIN ] Derivative Progress: 3/2052 symbols. AAMI took 0.4s. Estimated remaining time: 14m 28s [2025-10-22T23:26:49.567112] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:49.616471] [DEBUG] [LOCAL ] AAP: Loaded 51734 existing records from primary storage. [2025-10-22T23:26:49.616671] [INFO ] [MAIN ] AAP: Loaded 51734 primary data records. [2025-10-22T23:26:49.936093] [DEBUG] [MAIN ] AAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:49.963813] [INFO ] [MAIN ] AAP: Generated 138 derivative records from 51734 primary records. [2025-10-22T23:26:49.964038] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-22T23:26:49.975937] [DEBUG] [LOCAL ] AAP: Derivative data saved (138 records). [2025-10-22T23:26:49.976071] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-22T23:26:49.978691] [INFO ] [MAIN ] Derivative Progress: 4/2052 symbols. AAP took 0.4s. Estimated remaining time: 14m 21s [2025-10-22T23:26:49.978829] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:50.008473] [DEBUG] [LOCAL ] AAT: Loaded 30227 existing records from primary storage. [2025-10-22T23:26:50.008681] [INFO ] [MAIN ] AAT: Loaded 30227 primary data records. [2025-10-22T23:26:50.323804] [DEBUG] [MAIN ] AAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:50.349717] [INFO ] [MAIN ] AAT: Generated 138 derivative records from 30227 primary records. [2025-10-22T23:26:50.349889] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-10-22T23:26:50.361264] [DEBUG] [LOCAL ] AAT: Derivative data saved (138 records). [2025-10-22T23:26:50.361352] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-10-22T23:26:50.363729] [INFO ] [MAIN ] Derivative Progress: 5/2052 symbols. AAT took 0.4s. Estimated remaining time: 14m 6s [2025-10-22T23:26:50.363842] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:50.390904] [DEBUG] [LOCAL ] AB: Loaded 24673 existing records from primary storage. [2025-10-22T23:26:50.391071] [INFO ] [MAIN ] AB: Loaded 24673 primary data records. [2025-10-22T23:26:50.701183] [DEBUG] [MAIN ] AB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:50.727312] [INFO ] [MAIN ] AB: Generated 138 derivative records from 24673 primary records. [2025-10-22T23:26:50.727428] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-10-22T23:26:50.738980] [DEBUG] [LOCAL ] AB: Derivative data saved (138 records). [2025-10-22T23:26:50.739062] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-10-22T23:26:50.741348] [INFO ] [MAIN ] Derivative Progress: 6/2052 symbols. AB took 0.4s. Estimated remaining time: 13m 53s [2025-10-22T23:26:50.741451] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:50.768973] [DEBUG] [LOCAL ] ABCB: Loaded 30308 existing records from primary storage. [2025-10-22T23:26:50.769121] [INFO ] [MAIN ] ABCB: Loaded 30308 primary data records. [2025-10-22T23:26:51.085635] [DEBUG] [MAIN ] ABCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:51.111681] [INFO ] [MAIN ] ABCB: Generated 138 derivative records from 30308 primary records. [2025-10-22T23:26:51.111815] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-10-22T23:26:51.122937] [DEBUG] [LOCAL ] ABCB: Derivative data saved (138 records). [2025-10-22T23:26:51.123031] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-10-22T23:26:51.125432] [INFO ] [MAIN ] Derivative Progress: 7/2052 symbols. ABCB took 0.4s. Estimated remaining time: 13m 46s [2025-10-22T23:26:51.125535] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:51.174338] [DEBUG] [LOCAL ] ABEV: Loaded 53284 existing records from primary storage. [2025-10-22T23:26:51.174500] [INFO ] [MAIN ] ABEV: Loaded 53284 primary data records. [2025-10-22T23:26:51.514951] [DEBUG] [MAIN ] ABEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:51.541505] [INFO ] [MAIN ] ABEV: Generated 138 derivative records from 53284 primary records. [2025-10-22T23:26:51.541659] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-22T23:26:51.553005] [DEBUG] [LOCAL ] ABEV: Derivative data saved (138 records). [2025-10-22T23:26:51.553089] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-22T23:26:51.555780] [INFO ] [MAIN ] Derivative Progress: 8/2052 symbols. ABEV took 0.4s. Estimated remaining time: 13m 53s [2025-10-22T23:26:51.555887] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:51.573898] [DEBUG] [LOCAL ] ABG: Loaded 17859 existing records from primary storage. [2025-10-22T23:26:51.574032] [INFO ] [MAIN ] ABG: Loaded 17859 primary data records. [2025-10-22T23:26:51.891976] [DEBUG] [MAIN ] ABG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:51.917511] [INFO ] [MAIN ] ABG: Generated 138 derivative records from 17859 primary records. [2025-10-22T23:26:51.917621] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-10-22T23:26:51.929983] [DEBUG] [LOCAL ] ABG: Derivative data saved (138 records). [2025-10-22T23:26:51.930074] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-10-22T23:26:51.931898] [INFO ] [MAIN ] Derivative Progress: 9/2052 symbols. ABG took 0.4s. Estimated remaining time: 13m 45s [2025-10-22T23:26:51.931995] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:51.983394] [DEBUG] [LOCAL ] ABT: Loaded 53624 existing records from primary storage. [2025-10-22T23:26:51.983550] [INFO ] [MAIN ] ABT: Loaded 53624 primary data records. [2025-10-22T23:26:52.296077] [DEBUG] [MAIN ] ABT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:26:52.321761] [INFO ] [MAIN ] ABT: Generated 138 derivative records from 53624 primary records. [2025-10-22T23:26:52.321868] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-10-22T23:26:52.333246] [DEBUG] [LOCAL ] ABT: Derivative data saved (138 records). [2025-10-22T23:26:52.333325] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-10-22T23:26:52.335971] [INFO ] [MAIN ] Derivative Progress: 10/2052 symbols. ABT took 0.4s. Estimated remaining time: 13m 45s [2025-10-22T23:26:52.336089] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:52.361353] [DEBUG] [LOCAL ] ACEL: Loaded 26346 existing records from primary storage. [2025-10-22T23:26:52.361496] [INFO ] [MAIN ] ACEL: Loaded 26346 primary data records. [2025-10-22T23:26:52.681919] [DEBUG] [MAIN ] ACEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:52.708122] [INFO ] [MAIN ] ACEL: Generated 138 derivative records from 26346 primary records. [2025-10-22T23:26:52.708270] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-10-22T23:26:52.719966] [DEBUG] [LOCAL ] ACEL: Derivative data saved (138 records). [2025-10-22T23:26:52.720059] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-10-22T23:26:52.722427] [INFO ] [MAIN ] Derivative Progress: 11/2052 symbols. ACEL took 0.4s. Estimated remaining time: 13m 41s [2025-10-22T23:26:52.722541] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:52.774356] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-22T23:26:52.774523] [INFO ] [MAIN ] ACHR: Loaded 53818 primary data records. [2025-10-22T23:26:53.082251] [DEBUG] [MAIN ] ACHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:53.111191] [INFO ] [MAIN ] ACHR: Generated 138 derivative records from 53818 primary records. [2025-10-22T23:26:53.111374] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-10-22T23:26:53.125187] [DEBUG] [LOCAL ] ACHR: Derivative data saved (138 records). [2025-10-22T23:26:53.125273] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-10-22T23:26:53.128365] [INFO ] [MAIN ] Derivative Progress: 12/2052 symbols. ACHR took 0.4s. Estimated remaining time: 13m 41s [2025-10-22T23:26:53.128499] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:53.183748] [DEBUG] [LOCAL ] ACI: Loaded 53286 existing records from primary storage. [2025-10-22T23:26:53.183920] [INFO ] [MAIN ] ACI: Loaded 53286 primary data records. [2025-10-22T23:26:53.523125] [DEBUG] [MAIN ] ACI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:53.548610] [INFO ] [MAIN ] ACI: Generated 138 derivative records from 53286 primary records. [2025-10-22T23:26:53.548764] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-22T23:26:53.560524] [DEBUG] [LOCAL ] ACI: Derivative data saved (138 records). [2025-10-22T23:26:53.560613] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-10-22T23:26:53.565389] [INFO ] [MAIN ] Derivative Progress: 13/2052 symbols. ACI took 0.4s. Estimated remaining time: 13m 46s [2025-10-22T23:26:53.565499] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:53.574833] [DEBUG] [LOCAL ] ACR: Loaded 5310 existing records from primary storage. [2025-10-22T23:26:53.574971] [INFO ] [MAIN ] ACR: Loaded 5310 primary data records. [2025-10-22T23:26:53.918546] [DEBUG] [MAIN ] ACR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:53.944770] [INFO ] [MAIN ] ACR: Generated 138 derivative records from 5310 primary records. [2025-10-22T23:26:53.944919] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-10-22T23:26:53.955443] [DEBUG] [LOCAL ] ACR: Derivative data saved (138 records). [2025-10-22T23:26:53.955532] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-10-22T23:26:53.957366] [INFO ] [MAIN ] Derivative Progress: 14/2052 symbols. ACR took 0.4s. Estimated remaining time: 13m 44s [2025-10-22T23:26:53.957471] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:53.988001] [DEBUG] [LOCAL ] ACRE: Loaded 33223 existing records from primary storage. [2025-10-22T23:26:53.988166] [INFO ] [MAIN ] ACRE: Loaded 33223 primary data records. [2025-10-22T23:26:54.310411] [DEBUG] [MAIN ] ACRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:54.342230] [INFO ] [MAIN ] ACRE: Generated 138 derivative records from 33223 primary records. [2025-10-22T23:26:54.342406] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-10-22T23:26:54.354673] [DEBUG] [LOCAL ] ACRE: Derivative data saved (138 records). [2025-10-22T23:26:54.354761] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-10-22T23:26:54.357542] [INFO ] [MAIN ] Derivative Progress: 15/2052 symbols. ACRE took 0.4s. Estimated remaining time: 13m 43s [2025-10-22T23:26:54.357695] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:54.393077] [DEBUG] [LOCAL ] ADCT: Loaded 35462 existing records from primary storage. [2025-10-22T23:26:54.393252] [INFO ] [MAIN ] ADCT: Loaded 35462 primary data records. [2025-10-22T23:26:54.743425] [DEBUG] [MAIN ] ADCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:54.772738] [INFO ] [MAIN ] ADCT: Generated 138 derivative records from 35462 primary records. [2025-10-22T23:26:54.772879] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-10-22T23:26:54.785069] [DEBUG] [LOCAL ] ADCT: Derivative data saved (138 records). [2025-10-22T23:26:54.785154] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-10-22T23:26:54.787771] [INFO ] [MAIN ] Derivative Progress: 16/2052 symbols. ADCT took 0.4s. Estimated remaining time: 13m 46s [2025-10-22T23:26:54.787877] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:54.840184] [DEBUG] [LOCAL ] ADM: Loaded 53394 existing records from primary storage. [2025-10-22T23:26:54.840352] [INFO ] [MAIN ] ADM: Loaded 53394 primary data records. [2025-10-22T23:26:55.173744] [DEBUG] [MAIN ] ADM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:55.199567] [INFO ] [MAIN ] ADM: Generated 138 derivative records from 53394 primary records. [2025-10-22T23:26:55.199725] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-22T23:26:55.212746] [DEBUG] [LOCAL ] ADM: Derivative data saved (138 records). [2025-10-22T23:26:55.212916] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-22T23:26:55.215713] [INFO ] [MAIN ] Derivative Progress: 17/2052 symbols. ADM took 0.4s. Estimated remaining time: 13m 48s [2025-10-22T23:26:55.215868] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:55.268026] [DEBUG] [LOCAL ] ADT: Loaded 53435 existing records from primary storage. [2025-10-22T23:26:55.268230] [INFO ] [MAIN ] ADT: Loaded 53435 primary data records. [2025-10-22T23:26:55.582463] [DEBUG] [MAIN ] ADT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:55.608329] [INFO ] [MAIN ] ADT: Generated 138 derivative records from 53435 primary records. [2025-10-22T23:26:55.608522] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-22T23:26:55.621639] [DEBUG] [LOCAL ] ADT: Derivative data saved (138 records). [2025-10-22T23:26:55.621837] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-10-22T23:26:55.624852] [INFO ] [MAIN ] Derivative Progress: 18/2052 symbols. ADT took 0.4s. Estimated remaining time: 13m 48s [2025-10-22T23:26:55.624959] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:55.651594] [DEBUG] [LOCAL ] ADX: Loaded 27644 existing records from primary storage. [2025-10-22T23:26:55.651774] [INFO ] [MAIN ] ADX: Loaded 27644 primary data records. [2025-10-22T23:26:55.992932] [DEBUG] [MAIN ] ADX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:56.019479] [INFO ] [MAIN ] ADX: Generated 138 derivative records from 27644 primary records. [2025-10-22T23:26:56.019601] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-22T23:26:56.031484] [DEBUG] [LOCAL ] ADX: Derivative data saved (138 records). [2025-10-22T23:26:56.031570] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-22T23:26:56.034088] [INFO ] [MAIN ] Derivative Progress: 19/2052 symbols. ADX took 0.4s. Estimated remaining time: 13m 48s [2025-10-22T23:26:56.034186] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:56.080779] [DEBUG] [LOCAL ] AEE: Loaded 50072 existing records from primary storage. [2025-10-22T23:26:56.080947] [INFO ] [MAIN ] AEE: Loaded 50072 primary data records. [2025-10-22T23:26:56.393170] [DEBUG] [MAIN ] AEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:56.418862] [INFO ] [MAIN ] AEE: Generated 138 derivative records from 50072 primary records. [2025-10-22T23:26:56.419006] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-10-22T23:26:56.432264] [DEBUG] [LOCAL ] AEE: Derivative data saved (138 records). [2025-10-22T23:26:56.432445] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-10-22T23:26:56.435347] [INFO ] [MAIN ] Derivative Progress: 20/2052 symbols. AEE took 0.4s. Estimated remaining time: 13m 47s [2025-10-22T23:26:56.435456] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:56.447973] [DEBUG] [LOCAL ] AEFC: Loaded 7650 existing records from primary storage. [2025-10-22T23:26:56.448141] [INFO ] [MAIN ] AEFC: Loaded 7650 primary data records. [2025-10-22T23:26:56.773778] [DEBUG] [MAIN ] AEFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:56.802359] [INFO ] [MAIN ] AEFC: Generated 138 derivative records from 7650 primary records. [2025-10-22T23:26:56.802526] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-10-22T23:26:56.815260] [DEBUG] [LOCAL ] AEFC: Derivative data saved (138 records). [2025-10-22T23:26:56.815354] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-10-22T23:26:56.817324] [INFO ] [MAIN ] Derivative Progress: 21/2052 symbols. AEFC took 0.4s. Estimated remaining time: 13m 44s [2025-10-22T23:26:56.817442] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:56.865920] [DEBUG] [LOCAL ] AEG: Loaded 49558 existing records from primary storage. [2025-10-22T23:26:56.866095] [INFO ] [MAIN ] AEG: Loaded 49558 primary data records. [2025-10-22T23:26:57.196258] [DEBUG] [MAIN ] AEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:57.222725] [INFO ] [MAIN ] AEG: Generated 138 derivative records from 49558 primary records. [2025-10-22T23:26:57.222912] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-10-22T23:26:57.234395] [DEBUG] [LOCAL ] AEG: Derivative data saved (138 records). [2025-10-22T23:26:57.234492] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-10-22T23:26:57.237086] [INFO ] [MAIN ] Derivative Progress: 22/2052 symbols. AEG took 0.4s. Estimated remaining time: 13m 45s [2025-10-22T23:26:57.237198] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:57.288954] [DEBUG] [LOCAL ] AEM: Loaded 53477 existing records from primary storage. [2025-10-22T23:26:57.289127] [INFO ] [MAIN ] AEM: Loaded 53477 primary data records. [2025-10-22T23:26:57.602281] [DEBUG] [MAIN ] AEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:57.627678] [INFO ] [MAIN ] AEM: Generated 138 derivative records from 53477 primary records. [2025-10-22T23:26:57.627790] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-22T23:26:57.639412] [DEBUG] [LOCAL ] AEM: Derivative data saved (138 records). [2025-10-22T23:26:57.639500] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-22T23:26:57.642279] [INFO ] [MAIN ] Derivative Progress: 23/2052 symbols. AEM took 0.4s. Estimated remaining time: 13m 44s [2025-10-22T23:26:57.642379] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:57.696065] [DEBUG] [LOCAL ] AEO: Loaded 53564 existing records from primary storage. [2025-10-22T23:26:57.696228] [INFO ] [MAIN ] AEO: Loaded 53564 primary data records. [2025-10-22T23:26:58.026841] [DEBUG] [MAIN ] AEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:58.056304] [INFO ] [MAIN ] AEO: Generated 138 derivative records from 53564 primary records. [2025-10-22T23:26:58.056462] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-22T23:26:58.068427] [DEBUG] [LOCAL ] AEO: Derivative data saved (138 records). [2025-10-22T23:26:58.068508] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-10-22T23:26:58.071347] [INFO ] [MAIN ] Derivative Progress: 24/2052 symbols. AEO took 0.4s. Estimated remaining time: 13m 46s [2025-10-22T23:26:58.071447] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:58.116591] [DEBUG] [LOCAL ] AER: Loaded 47899 existing records from primary storage. [2025-10-22T23:26:58.116800] [INFO ] [MAIN ] AER: Loaded 47899 primary data records. [2025-10-22T23:26:58.420329] [DEBUG] [MAIN ] AER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:58.445949] [INFO ] [MAIN ] AER: Generated 138 derivative records from 47899 primary records. [2025-10-22T23:26:58.446061] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-10-22T23:26:58.457673] [DEBUG] [LOCAL ] AER: Derivative data saved (138 records). [2025-10-22T23:26:58.457755] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-10-22T23:26:58.460308] [INFO ] [MAIN ] Derivative Progress: 25/2052 symbols. AER took 0.4s. Estimated remaining time: 13m 44s [2025-10-22T23:26:58.460406] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:58.511195] [DEBUG] [LOCAL ] AES: Loaded 53665 existing records from primary storage. [2025-10-22T23:26:58.511357] [INFO ] [MAIN ] AES: Loaded 53665 primary data records. [2025-10-22T23:26:58.819971] [DEBUG] [MAIN ] AES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:58.845407] [INFO ] [MAIN ] AES: Generated 138 derivative records from 53665 primary records. [2025-10-22T23:26:58.845516] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-22T23:26:58.857324] [DEBUG] [LOCAL ] AES: Derivative data saved (138 records). [2025-10-22T23:26:58.857408] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-22T23:26:58.860352] [INFO ] [MAIN ] Derivative Progress: 26/2052 symbols. AES took 0.4s. Estimated remaining time: 13m 43s [2025-10-22T23:26:58.860456] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:58.906085] [DEBUG] [LOCAL ] AESI: Loaded 49817 existing records from primary storage. [2025-10-22T23:26:58.906241] [INFO ] [MAIN ] AESI: Loaded 49817 primary data records. [2025-10-22T23:26:59.208528] [DEBUG] [MAIN ] AESI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:59.233996] [INFO ] [MAIN ] AESI: Generated 138 derivative records from 49817 primary records. [2025-10-22T23:26:59.234098] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-22T23:26:59.245574] [DEBUG] [LOCAL ] AESI: Derivative data saved (138 records). [2025-10-22T23:26:59.245673] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-22T23:26:59.248239] [INFO ] [MAIN ] Derivative Progress: 27/2052 symbols. AESI took 0.4s. Estimated remaining time: 13m 41s [2025-10-22T23:26:59.248342] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:59.261212] [DEBUG] [LOCAL ] AFB: Loaded 11018 existing records from primary storage. [2025-10-22T23:26:59.261335] [INFO ] [MAIN ] AFB: Loaded 11018 primary data records. [2025-10-22T23:26:59.568473] [DEBUG] [MAIN ] AFB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:59.593809] [INFO ] [MAIN ] AFB: Generated 138 derivative records from 11018 primary records. [2025-10-22T23:26:59.593912] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-22T23:26:59.605037] [DEBUG] [LOCAL ] AFB: Derivative data saved (138 records). [2025-10-22T23:26:59.605117] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-22T23:26:59.606987] [INFO ] [MAIN ] Derivative Progress: 28/2052 symbols. AFB took 0.4s. Estimated remaining time: 13m 37s [2025-10-22T23:26:59.607085] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:26:59.638439] [DEBUG] [LOCAL ] AFG: Loaded 31910 existing records from primary storage. [2025-10-22T23:26:59.638590] [INFO ] [MAIN ] AFG: Loaded 31910 primary data records. [2025-10-22T23:26:59.972086] [DEBUG] [MAIN ] AFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:26:59.997592] [INFO ] [MAIN ] AFG: Generated 138 derivative records from 31910 primary records. [2025-10-22T23:26:59.997716] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-22T23:27:00.009285] [DEBUG] [LOCAL ] AFG: Derivative data saved (138 records). [2025-10-22T23:27:00.009363] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-10-22T23:27:00.011858] [INFO ] [MAIN ] Derivative Progress: 29/2052 symbols. AFG took 0.4s. Estimated remaining time: 13m 37s [2025-10-22T23:27:00.011960] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:00.016088] [DEBUG] [LOCAL ] AFGB: Loaded 2210 existing records from primary storage. [2025-10-22T23:27:00.016175] [INFO ] [MAIN ] AFGB: Loaded 2210 primary data records. [2025-10-22T23:27:00.318829] [DEBUG] [MAIN ] AFGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:00.344142] [INFO ] [MAIN ] AFGB: Generated 138 derivative records from 2210 primary records. [2025-10-22T23:27:00.344264] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-10-22T23:27:00.353892] [DEBUG] [LOCAL ] AFGB: Derivative data saved (138 records). [2025-10-22T23:27:00.353970] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-10-22T23:27:00.355954] [INFO ] [MAIN ] Derivative Progress: 30/2052 symbols. AFGB took 0.3s. Estimated remaining time: 13m 33s [2025-10-22T23:27:00.356055] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:00.360080] [DEBUG] [LOCAL ] AFGC: Loaded 2540 existing records from primary storage. [2025-10-22T23:27:00.360167] [INFO ] [MAIN ] AFGC: Loaded 2540 primary data records. [2025-10-22T23:27:00.666891] [DEBUG] [MAIN ] AFGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:00.692602] [INFO ] [MAIN ] AFGC: Generated 138 derivative records from 2540 primary records. [2025-10-22T23:27:00.692759] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-10-22T23:27:00.702451] [DEBUG] [LOCAL ] AFGC: Derivative data saved (138 records). [2025-10-22T23:27:00.702528] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-10-22T23:27:00.704575] [INFO ] [MAIN ] Derivative Progress: 31/2052 symbols. AFGC took 0.3s. Estimated remaining time: 13m 29s [2025-10-22T23:27:00.704696] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:00.708518] [DEBUG] [LOCAL ] AFGE: Loaded 2245 existing records from primary storage. [2025-10-22T23:27:00.708608] [INFO ] [MAIN ] AFGE: Loaded 2245 primary data records. [2025-10-22T23:27:01.011313] [DEBUG] [MAIN ] AFGE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:27:01.036776] [INFO ] [MAIN ] AFGE: Generated 138 derivative records from 2245 primary records. [2025-10-22T23:27:01.036885] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-22T23:27:01.046307] [DEBUG] [LOCAL ] AFGE: Derivative data saved (138 records). [2025-10-22T23:27:01.046385] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-22T23:27:01.048414] [INFO ] [MAIN ] Derivative Progress: 32/2052 symbols. AFGE took 0.3s. Estimated remaining time: 13m 25s [2025-10-22T23:27:01.048514] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:01.098948] [DEBUG] [LOCAL ] AFL: Loaded 53174 existing records from primary storage. [2025-10-22T23:27:01.099102] [INFO ] [MAIN ] AFL: Loaded 53174 primary data records. [2025-10-22T23:27:01.406875] [DEBUG] [MAIN ] AFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:01.432498] [INFO ] [MAIN ] AFL: Generated 138 derivative records from 53174 primary records. [2025-10-22T23:27:01.432608] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-22T23:27:01.444199] [DEBUG] [LOCAL ] AFL: Derivative data saved (138 records). [2025-10-22T23:27:01.444277] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-10-22T23:27:01.447101] [INFO ] [MAIN ] Derivative Progress: 33/2052 symbols. AFL took 0.4s. Estimated remaining time: 13m 24s [2025-10-22T23:27:01.447203] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:01.495951] [DEBUG] [LOCAL ] AG: Loaded 53644 existing records from primary storage. [2025-10-22T23:27:01.496108] [INFO ] [MAIN ] AG: Loaded 53644 primary data records. [2025-10-22T23:27:01.803042] [DEBUG] [MAIN ] AG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:01.830078] [INFO ] [MAIN ] AG: Generated 138 derivative records from 53644 primary records. [2025-10-22T23:27:01.830192] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-10-22T23:27:01.842069] [DEBUG] [LOCAL ] AG: Derivative data saved (138 records). [2025-10-22T23:27:01.842151] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-10-22T23:27:01.844974] [INFO ] [MAIN ] Derivative Progress: 34/2052 symbols. AG took 0.4s. Estimated remaining time: 13m 24s [2025-10-22T23:27:01.845077] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:01.883303] [DEBUG] [LOCAL ] AGCO: Loaded 42149 existing records from primary storage. [2025-10-22T23:27:01.883465] [INFO ] [MAIN ] AGCO: Loaded 42149 primary data records. [2025-10-22T23:27:02.219192] [DEBUG] [MAIN ] AGCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:02.244908] [INFO ] [MAIN ] AGCO: Generated 138 derivative records from 42149 primary records. [2025-10-22T23:27:02.245055] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-22T23:27:02.256863] [DEBUG] [LOCAL ] AGCO: Derivative data saved (138 records). [2025-10-22T23:27:02.256947] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-10-22T23:27:02.259490] [INFO ] [MAIN ] Derivative Progress: 35/2052 symbols. AGCO took 0.4s. Estimated remaining time: 13m 24s [2025-10-22T23:27:02.259596] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:02.278999] [DEBUG] [LOCAL ] AGD: Loaded 19283 existing records from primary storage. [2025-10-22T23:27:02.279140] [INFO ] [MAIN ] AGD: Loaded 19283 primary data records. [2025-10-22T23:27:02.583873] [DEBUG] [MAIN ] AGD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:02.609474] [INFO ] [MAIN ] AGD: Generated 138 derivative records from 19283 primary records. [2025-10-22T23:27:02.609593] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-22T23:27:02.621634] [DEBUG] [LOCAL ] AGD: Derivative data saved (138 records). [2025-10-22T23:27:02.621736] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-10-22T23:27:02.623667] [INFO ] [MAIN ] Derivative Progress: 36/2052 symbols. AGD took 0.4s. Estimated remaining time: 13m 22s [2025-10-22T23:27:02.623767] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:02.672962] [DEBUG] [LOCAL ] AGI: Loaded 53423 existing records from primary storage. [2025-10-22T23:27:02.673137] [INFO ] [MAIN ] AGI: Loaded 53423 primary data records. [2025-10-22T23:27:02.981716] [DEBUG] [MAIN ] AGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:03.007370] [INFO ] [MAIN ] AGI: Generated 138 derivative records from 53423 primary records. [2025-10-22T23:27:03.007506] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-10-22T23:27:03.019166] [DEBUG] [LOCAL ] AGI: Derivative data saved (138 records). [2025-10-22T23:27:03.019257] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-10-22T23:27:03.022229] [INFO ] [MAIN ] Derivative Progress: 37/2052 symbols. AGI took 0.4s. Estimated remaining time: 13m 22s [2025-10-22T23:27:03.022372] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:03.071788] [DEBUG] [LOCAL ] AGL: Loaded 52595 existing records from primary storage. [2025-10-22T23:27:03.071955] [INFO ] [MAIN ] AGL: Loaded 52595 primary data records. [2025-10-22T23:27:03.391097] [DEBUG] [MAIN ] AGL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:03.418384] [INFO ] [MAIN ] AGL: Generated 138 derivative records from 52595 primary records. [2025-10-22T23:27:03.418594] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-22T23:27:03.430434] [DEBUG] [LOCAL ] AGL: Derivative data saved (138 records). [2025-10-22T23:27:03.430562] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-22T23:27:03.433477] [INFO ] [MAIN ] Derivative Progress: 38/2052 symbols. AGL took 0.4s. Estimated remaining time: 13m 22s [2025-10-22T23:27:03.433608] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:03.447366] [DEBUG] [LOCAL ] AGM: Loaded 10617 existing records from primary storage. [2025-10-22T23:27:03.447547] [INFO ] [MAIN ] AGM: Loaded 10617 primary data records. [2025-10-22T23:27:03.771049] [DEBUG] [MAIN ] AGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:03.796824] [INFO ] [MAIN ] AGM: Generated 138 derivative records from 10617 primary records. [2025-10-22T23:27:03.797019] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-22T23:27:03.808416] [DEBUG] [LOCAL ] AGM: Derivative data saved (138 records). [2025-10-22T23:27:03.808506] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-22T23:27:03.811141] [INFO ] [MAIN ] Derivative Progress: 39/2052 symbols. AGM took 0.4s. Estimated remaining time: 13m 21s [2025-10-22T23:27:03.811244] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:03.837634] [DEBUG] [LOCAL ] AGO: Loaded 27710 existing records from primary storage. [2025-10-22T23:27:03.837830] [INFO ] [MAIN ] AGO: Loaded 27710 primary data records. [2025-10-22T23:27:04.185275] [DEBUG] [MAIN ] AGO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:27:04.211332] [INFO ] [MAIN ] AGO: Generated 138 derivative records from 27710 primary records. [2025-10-22T23:27:04.211477] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-22T23:27:04.222997] [DEBUG] [LOCAL ] AGO: Derivative data saved (138 records). [2025-10-22T23:27:04.223087] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-10-22T23:27:04.225902] [INFO ] [MAIN ] Derivative Progress: 40/2052 symbols. AGO took 0.4s. Estimated remaining time: 13m 21s [2025-10-22T23:27:04.226018] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:04.255238] [DEBUG] [LOCAL ] AGRO: Loaded 32457 existing records from primary storage. [2025-10-22T23:27:04.255396] [INFO ] [MAIN ] AGRO: Loaded 32457 primary data records. [2025-10-22T23:27:04.570027] [DEBUG] [MAIN ] AGRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:04.595801] [INFO ] [MAIN ] AGRO: Generated 138 derivative records from 32457 primary records. [2025-10-22T23:27:04.595966] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-22T23:27:04.607380] [DEBUG] [LOCAL ] AGRO: Derivative data saved (138 records). [2025-10-22T23:27:04.607474] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-10-22T23:27:04.610027] [INFO ] [MAIN ] Derivative Progress: 41/2052 symbols. AGRO took 0.4s. Estimated remaining time: 13m 20s [2025-10-22T23:27:04.610127] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:04.641184] [DEBUG] [LOCAL ] AGX: Loaded 32652 existing records from primary storage. [2025-10-22T23:27:04.641347] [INFO ] [MAIN ] AGX: Loaded 32652 primary data records. [2025-10-22T23:27:04.958303] [DEBUG] [MAIN ] AGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:04.984320] [INFO ] [MAIN ] AGX: Generated 138 derivative records from 32652 primary records. [2025-10-22T23:27:04.984481] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-22T23:27:04.996247] [DEBUG] [LOCAL ] AGX: Derivative data saved (138 records). [2025-10-22T23:27:04.996331] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-22T23:27:04.998874] [INFO ] [MAIN ] Derivative Progress: 42/2052 symbols. AGX took 0.4s. Estimated remaining time: 13m 19s [2025-10-22T23:27:04.998993] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:05.034755] [DEBUG] [LOCAL ] AHH: Loaded 40160 existing records from primary storage. [2025-10-22T23:27:05.034929] [INFO ] [MAIN ] AHH: Loaded 40160 primary data records. [2025-10-22T23:27:05.345310] [DEBUG] [MAIN ] AHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:05.370809] [INFO ] [MAIN ] AHH: Generated 138 derivative records from 40160 primary records. [2025-10-22T23:27:05.370956] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-22T23:27:05.381908] [DEBUG] [LOCAL ] AHH: Derivative data saved (138 records). [2025-10-22T23:27:05.381994] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-22T23:27:05.384617] [INFO ] [MAIN ] Derivative Progress: 43/2052 symbols. AHH took 0.4s. Estimated remaining time: 13m 18s [2025-10-22T23:27:05.384783] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:05.394272] [DEBUG] [LOCAL ] AHT: Loaded 6358 existing records from primary storage. [2025-10-22T23:27:05.394398] [INFO ] [MAIN ] AHT: Loaded 6358 primary data records. [2025-10-22T23:27:05.704038] [DEBUG] [MAIN ] AHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:05.729697] [INFO ] [MAIN ] AHT: Generated 138 derivative records from 6358 primary records. [2025-10-22T23:27:05.729870] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-22T23:27:05.740400] [DEBUG] [LOCAL ] AHT: Derivative data saved (138 records). [2025-10-22T23:27:05.740555] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-22T23:27:05.742554] [INFO ] [MAIN ] Derivative Progress: 44/2052 symbols. AHT took 0.4s. Estimated remaining time: 13m 16s [2025-10-22T23:27:05.742717] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:05.796000] [DEBUG] [LOCAL ] AI: Loaded 53765 existing records from primary storage. [2025-10-22T23:27:05.796176] [INFO ] [MAIN ] AI: Loaded 53765 primary data records. [2025-10-22T23:27:06.128170] [DEBUG] [MAIN ] AI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:06.154967] [INFO ] [MAIN ] AI: Generated 138 derivative records from 53765 primary records. [2025-10-22T23:27:06.155126] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-22T23:27:06.167038] [DEBUG] [LOCAL ] AI: Derivative data saved (138 records). [2025-10-22T23:27:06.167120] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-10-22T23:27:06.170268] [INFO ] [MAIN ] Derivative Progress: 45/2052 symbols. AI took 0.4s. Estimated remaining time: 13m 17s [2025-10-22T23:27:06.170371] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:06.219852] [DEBUG] [LOCAL ] AIG: Loaded 53459 existing records from primary storage. [2025-10-22T23:27:06.220017] [INFO ] [MAIN ] AIG: Loaded 53459 primary data records. [2025-10-22T23:27:06.533152] [DEBUG] [MAIN ] AIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:06.558890] [INFO ] [MAIN ] AIG: Generated 138 derivative records from 53459 primary records. [2025-10-22T23:27:06.559030] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-22T23:27:06.570847] [DEBUG] [LOCAL ] AIG: Derivative data saved (138 records). [2025-10-22T23:27:06.570932] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-22T23:27:06.573808] [INFO ] [MAIN ] Derivative Progress: 46/2052 symbols. AIG took 0.4s. Estimated remaining time: 13m 17s [2025-10-22T23:27:06.573915] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:06.596979] [DEBUG] [LOCAL ] AIN: Loaded 24301 existing records from primary storage. [2025-10-22T23:27:06.597148] [INFO ] [MAIN ] AIN: Loaded 24301 primary data records. [2025-10-22T23:27:06.908457] [DEBUG] [MAIN ] AIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:06.934701] [INFO ] [MAIN ] AIN: Generated 138 derivative records from 24301 primary records. [2025-10-22T23:27:06.934878] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-22T23:27:06.946555] [DEBUG] [LOCAL ] AIN: Derivative data saved (138 records). [2025-10-22T23:27:06.946637] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-22T23:27:06.949218] [INFO ] [MAIN ] Derivative Progress: 47/2052 symbols. AIN took 0.4s. Estimated remaining time: 13m 15s [2025-10-22T23:27:06.949339] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:06.964710] [DEBUG] [LOCAL ] AIO: Loaded 12916 existing records from primary storage. [2025-10-22T23:27:06.964898] [INFO ] [MAIN ] AIO: Loaded 12916 primary data records. [2025-10-22T23:27:07.290604] [DEBUG] [MAIN ] AIO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:27:07.316969] [INFO ] [MAIN ] AIO: Generated 138 derivative records from 12916 primary records. [2025-10-22T23:27:07.317104] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-10-22T23:27:07.329915] [DEBUG] [LOCAL ] AIO: Derivative data saved (138 records). [2025-10-22T23:27:07.330020] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-10-22T23:27:07.331982] [INFO ] [MAIN ] Derivative Progress: 48/2052 symbols. AIO took 0.4s. Estimated remaining time: 13m 14s [2025-10-22T23:27:07.332083] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:07.357836] [DEBUG] [LOCAL ] AIT: Loaded 26566 existing records from primary storage. [2025-10-22T23:27:07.357994] [INFO ] [MAIN ] AIT: Loaded 26566 primary data records. [2025-10-22T23:27:07.668772] [DEBUG] [MAIN ] AIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:07.698859] [INFO ] [MAIN ] AIT: Generated 138 derivative records from 26566 primary records. [2025-10-22T23:27:07.699073] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-10-22T23:27:07.710942] [DEBUG] [LOCAL ] AIT: Derivative data saved (138 records). [2025-10-22T23:27:07.711099] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-10-22T23:27:07.714070] [INFO ] [MAIN ] Derivative Progress: 49/2052 symbols. AIT took 0.4s. Estimated remaining time: 13m 13s [2025-10-22T23:27:07.714217] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:07.752694] [DEBUG] [LOCAL ] AIV: Loaded 41857 existing records from primary storage. [2025-10-22T23:27:07.752863] [INFO ] [MAIN ] AIV: Loaded 41857 primary data records. [2025-10-22T23:27:08.079563] [DEBUG] [MAIN ] AIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:08.107256] [INFO ] [MAIN ] AIV: Generated 138 derivative records from 41857 primary records. [2025-10-22T23:27:08.107410] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-22T23:27:08.119451] [DEBUG] [LOCAL ] AIV: Derivative data saved (138 records). [2025-10-22T23:27:08.119538] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-22T23:27:08.122465] [INFO ] [MAIN ] Derivative Progress: 50/2052 symbols. AIV took 0.4s. Estimated remaining time: 13m 14s [2025-10-22T23:27:08.122619] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:08.152772] [DEBUG] [LOCAL ] AIZ: Loaded 29244 existing records from primary storage. [2025-10-22T23:27:08.152952] [INFO ] [MAIN ] AIZ: Loaded 29244 primary data records. [2025-10-22T23:27:08.545859] [DEBUG] [MAIN ] AIZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:08.587925] [INFO ] [MAIN ] AIZ: Generated 138 derivative records from 29244 primary records. [2025-10-22T23:27:08.588146] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-22T23:27:08.602587] [DEBUG] [LOCAL ] AIZ: Derivative data saved (138 records). [2025-10-22T23:27:08.602708] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-22T23:27:08.605385] [INFO ] [MAIN ] Derivative Progress: 51/2052 symbols. AIZ took 0.5s. Estimated remaining time: 13m 17s [2025-10-22T23:27:08.605510] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:08.650073] [DEBUG] [LOCAL ] AJG: Loaded 46386 existing records from primary storage. [2025-10-22T23:27:08.650265] [INFO ] [MAIN ] AJG: Loaded 46386 primary data records. [2025-10-22T23:27:08.958386] [DEBUG] [MAIN ] AJG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:27:08.985202] [INFO ] [MAIN ] AJG: Generated 138 derivative records from 46386 primary records. [2025-10-22T23:27:08.985328] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-22T23:27:08.997137] [DEBUG] [LOCAL ] AJG: Derivative data saved (138 records). [2025-10-22T23:27:08.997261] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-22T23:27:08.999889] [INFO ] [MAIN ] Derivative Progress: 52/2052 symbols. AJG took 0.4s. Estimated remaining time: 13m 16s [2025-10-22T23:27:08.999990] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:09.042135] [DEBUG] [LOCAL ] AKR: Loaded 46103 existing records from primary storage. [2025-10-22T23:27:09.042299] [INFO ] [MAIN ] AKR: Loaded 46103 primary data records. [2025-10-22T23:27:09.355474] [DEBUG] [MAIN ] AKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:09.380840] [INFO ] [MAIN ] AKR: Generated 138 derivative records from 46103 primary records. [2025-10-22T23:27:09.380956] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-22T23:27:09.392466] [DEBUG] [LOCAL ] AKR: Derivative data saved (138 records). [2025-10-22T23:27:09.392552] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-22T23:27:09.394968] [INFO ] [MAIN ] Derivative Progress: 53/2052 symbols. AKR took 0.4s. Estimated remaining time: 13m 16s [2025-10-22T23:27:09.395067] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:09.434925] [DEBUG] [LOCAL ] AL: Loaded 44805 existing records from primary storage. [2025-10-22T23:27:09.435095] [INFO ] [MAIN ] AL: Loaded 44805 primary data records. [2025-10-22T23:27:09.743018] [DEBUG] [MAIN ] AL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:09.768586] [INFO ] [MAIN ] AL: Generated 138 derivative records from 44805 primary records. [2025-10-22T23:27:09.768708] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-22T23:27:09.779970] [DEBUG] [LOCAL ] AL: Derivative data saved (138 records). [2025-10-22T23:27:09.780052] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-22T23:27:09.782470] [INFO ] [MAIN ] Derivative Progress: 54/2052 symbols. AL took 0.4s. Estimated remaining time: 13m 15s [2025-10-22T23:27:09.782572] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:09.835634] [DEBUG] [LOCAL ] ALB: Loaded 53362 existing records from primary storage. [2025-10-22T23:27:09.835842] [INFO ] [MAIN ] ALB: Loaded 53362 primary data records. [2025-10-22T23:27:10.144045] [DEBUG] [MAIN ] ALB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:10.169781] [INFO ] [MAIN ] ALB: Generated 138 derivative records from 53362 primary records. [2025-10-22T23:27:10.169896] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-22T23:27:10.181825] [DEBUG] [LOCAL ] ALB: Derivative data saved (138 records). [2025-10-22T23:27:10.181907] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-22T23:27:10.184516] [INFO ] [MAIN ] Derivative Progress: 55/2052 symbols. ALB took 0.4s. Estimated remaining time: 13m 14s [2025-10-22T23:27:10.184618] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:10.232895] [DEBUG] [LOCAL ] ALC: Loaded 51212 existing records from primary storage. [2025-10-22T23:27:10.233074] [INFO ] [MAIN ] ALC: Loaded 51212 primary data records. [2025-10-22T23:27:10.569143] [DEBUG] [MAIN ] ALC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:10.594836] [INFO ] [MAIN ] ALC: Generated 138 derivative records from 51212 primary records. [2025-10-22T23:27:10.594967] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-10-22T23:27:10.606578] [DEBUG] [LOCAL ] ALC: Derivative data saved (138 records). [2025-10-22T23:27:10.606695] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-10-22T23:27:10.609457] [INFO ] [MAIN ] Derivative Progress: 56/2052 symbols. ALC took 0.4s. Estimated remaining time: 13m 15s [2025-10-22T23:27:10.609565] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:10.639304] [DEBUG] [LOCAL ] ALE: Loaded 32075 existing records from primary storage. [2025-10-22T23:27:10.639463] [INFO ] [MAIN ] ALE: Loaded 32075 primary data records. [2025-10-22T23:27:10.946848] [DEBUG] [MAIN ] ALE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:10.972434] [INFO ] [MAIN ] ALE: Generated 138 derivative records from 32075 primary records. [2025-10-22T23:27:10.972584] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-22T23:27:10.984099] [DEBUG] [LOCAL ] ALE: Derivative data saved (138 records). [2025-10-22T23:27:10.984179] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-22T23:27:10.986596] [INFO ] [MAIN ] Derivative Progress: 57/2052 symbols. ALE took 0.4s. Estimated remaining time: 13m 14s [2025-10-22T23:27:10.986727] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:11.015606] [DEBUG] [LOCAL ] ALEX: Loaded 30810 existing records from primary storage. [2025-10-22T23:27:11.015796] [INFO ] [MAIN ] ALEX: Loaded 30810 primary data records. [2025-10-22T23:27:11.326160] [DEBUG] [MAIN ] ALEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:11.351817] [INFO ] [MAIN ] ALEX: Generated 138 derivative records from 30810 primary records. [2025-10-22T23:27:11.351927] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-22T23:27:11.363589] [DEBUG] [LOCAL ] ALEX: Derivative data saved (138 records). [2025-10-22T23:27:11.363692] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-22T23:27:11.366099] [INFO ] [MAIN ] Derivative Progress: 58/2052 symbols. ALEX took 0.4s. Estimated remaining time: 13m 13s [2025-10-22T23:27:11.366197] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:11.378426] [DEBUG] [LOCAL ] ALG: Loaded 9714 existing records from primary storage. [2025-10-22T23:27:11.378546] [INFO ] [MAIN ] ALG: Loaded 9714 primary data records. [2025-10-22T23:27:11.684962] [DEBUG] [MAIN ] ALG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:11.711573] [INFO ] [MAIN ] ALG: Generated 138 derivative records from 9714 primary records. [2025-10-22T23:27:11.711767] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-22T23:27:11.723453] [DEBUG] [LOCAL ] ALG: Derivative data saved (138 records). [2025-10-22T23:27:11.723539] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-22T23:27:11.725431] [INFO ] [MAIN ] Derivative Progress: 59/2052 symbols. ALG took 0.4s. Estimated remaining time: 13m 11s [2025-10-22T23:27:11.725528] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:11.773772] [DEBUG] [LOCAL ] ALIT: Loaded 52781 existing records from primary storage. [2025-10-22T23:27:11.773936] [INFO ] [MAIN ] ALIT: Loaded 52781 primary data records. [2025-10-22T23:27:12.086101] [DEBUG] [MAIN ] ALIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:12.111463] [INFO ] [MAIN ] ALIT: Generated 138 derivative records from 52781 primary records. [2025-10-22T23:27:12.111582] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-22T23:27:12.123462] [DEBUG] [LOCAL ] ALIT: Derivative data saved (138 records). [2025-10-22T23:27:12.123542] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-22T23:27:12.126328] [INFO ] [MAIN ] Derivative Progress: 60/2052 symbols. ALIT took 0.4s. Estimated remaining time: 13m 11s [2025-10-22T23:27:12.126429] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:12.175581] [DEBUG] [LOCAL ] ALK: Loaded 53087 existing records from primary storage. [2025-10-22T23:27:12.175775] [INFO ] [MAIN ] ALK: Loaded 53087 primary data records. [2025-10-22T23:27:12.513788] [DEBUG] [MAIN ] ALK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:12.539474] [INFO ] [MAIN ] ALK: Generated 138 derivative records from 53087 primary records. [2025-10-22T23:27:12.539664] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-22T23:27:12.551358] [DEBUG] [LOCAL ] ALK: Derivative data saved (138 records). [2025-10-22T23:27:12.551436] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-22T23:27:12.554269] [INFO ] [MAIN ] Derivative Progress: 61/2052 symbols. ALK took 0.4s. Estimated remaining time: 13m 12s [2025-10-22T23:27:12.554368] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:12.600291] [DEBUG] [LOCAL ] ALL: Loaded 49604 existing records from primary storage. [2025-10-22T23:27:12.600457] [INFO ] [MAIN ] ALL: Loaded 49604 primary data records. [2025-10-22T23:27:12.907462] [DEBUG] [MAIN ] ALL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:12.932404] [INFO ] [MAIN ] ALL: Generated 138 derivative records from 49604 primary records. [2025-10-22T23:27:12.932523] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-22T23:27:12.944293] [DEBUG] [LOCAL ] ALL: Derivative data saved (138 records). [2025-10-22T23:27:12.944377] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-22T23:27:12.947126] [INFO ] [MAIN ] Derivative Progress: 62/2052 symbols. ALL took 0.4s. Estimated remaining time: 13m 11s [2025-10-22T23:27:12.947248] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:12.988780] [DEBUG] [LOCAL ] ALLE: Loaded 43945 existing records from primary storage. [2025-10-22T23:27:12.988941] [INFO ] [MAIN ] ALLE: Loaded 43945 primary data records. [2025-10-22T23:27:13.296155] [DEBUG] [MAIN ] ALLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:13.322000] [INFO ] [MAIN ] ALLE: Generated 138 derivative records from 43945 primary records. [2025-10-22T23:27:13.322181] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-10-22T23:27:13.333918] [DEBUG] [LOCAL ] ALLE: Derivative data saved (138 records). [2025-10-22T23:27:13.333998] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-10-22T23:27:13.336561] [INFO ] [MAIN ] Derivative Progress: 63/2052 symbols. ALLE took 0.4s. Estimated remaining time: 13m 10s [2025-10-22T23:27:13.336711] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:13.386323] [DEBUG] [LOCAL ] ALLY: Loaded 53222 existing records from primary storage. [2025-10-22T23:27:13.386486] [INFO ] [MAIN ] ALLY: Loaded 53222 primary data records. [2025-10-22T23:27:13.694917] [DEBUG] [MAIN ] ALLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:13.720478] [INFO ] [MAIN ] ALLY: Generated 138 derivative records from 53222 primary records. [2025-10-22T23:27:13.720605] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-22T23:27:13.734669] [DEBUG] [LOCAL ] ALLY: Derivative data saved (138 records). [2025-10-22T23:27:13.734866] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-22T23:27:13.738076] [INFO ] [MAIN ] Derivative Progress: 64/2052 symbols. ALLY took 0.4s. Estimated remaining time: 13m 10s [2025-10-22T23:27:13.738196] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:13.763032] [DEBUG] [LOCAL ] ALTG: Loaded 23079 existing records from primary storage. [2025-10-22T23:27:13.763241] [INFO ] [MAIN ] ALTG: Loaded 23079 primary data records. [2025-10-22T23:27:14.103994] [DEBUG] [MAIN ] ALTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:14.130265] [INFO ] [MAIN ] ALTG: Generated 138 derivative records from 23079 primary records. [2025-10-22T23:27:14.130412] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-22T23:27:14.141582] [DEBUG] [LOCAL ] ALTG: Derivative data saved (138 records). [2025-10-22T23:27:14.141692] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-22T23:27:14.144489] [INFO ] [MAIN ] Derivative Progress: 65/2052 symbols. ALTG took 0.4s. Estimated remaining time: 13m 10s [2025-10-22T23:27:14.144592] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:14.157154] [DEBUG] [LOCAL ] ALUR: Loaded 9277 existing records from primary storage. [2025-10-22T23:27:14.157313] [INFO ] [MAIN ] ALUR: Loaded 9277 primary data records. [2025-10-22T23:27:14.492236] [DEBUG] [MAIN ] ALUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:14.517797] [INFO ] [MAIN ] ALUR: Generated 138 derivative records from 9277 primary records. [2025-10-22T23:27:14.517961] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-22T23:27:14.529301] [DEBUG] [LOCAL ] ALUR: Derivative data saved (138 records). [2025-10-22T23:27:14.529387] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-22T23:27:14.531342] [INFO ] [MAIN ] Derivative Progress: 66/2052 symbols. ALUR took 0.4s. Estimated remaining time: 13m 9s [2025-10-22T23:27:14.531443] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:14.570779] [DEBUG] [LOCAL ] ALV: Loaded 42191 existing records from primary storage. [2025-10-22T23:27:14.570941] [INFO ] [MAIN ] ALV: Loaded 42191 primary data records. [2025-10-22T23:27:14.882404] [DEBUG] [MAIN ] ALV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:14.907769] [INFO ] [MAIN ] ALV: Generated 138 derivative records from 42191 primary records. [2025-10-22T23:27:14.907906] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-22T23:27:14.919519] [DEBUG] [LOCAL ] ALV: Derivative data saved (138 records). [2025-10-22T23:27:14.919608] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-22T23:27:14.922332] [INFO ] [MAIN ] Derivative Progress: 67/2052 symbols. ALV took 0.4s. Estimated remaining time: 13m 9s [2025-10-22T23:27:14.922493] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:14.933023] [DEBUG] [LOCAL ] ALX: Loaded 7271 existing records from primary storage. [2025-10-22T23:27:14.933163] [INFO ] [MAIN ] ALX: Loaded 7271 primary data records. [2025-10-22T23:27:15.250537] [DEBUG] [MAIN ] ALX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:15.276505] [INFO ] [MAIN ] ALX: Generated 138 derivative records from 7271 primary records. [2025-10-22T23:27:15.276633] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-22T23:27:15.287262] [DEBUG] [LOCAL ] ALX: Derivative data saved (138 records). [2025-10-22T23:27:15.287372] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-22T23:27:15.289714] [INFO ] [MAIN ] Derivative Progress: 68/2052 symbols. ALX took 0.4s. Estimated remaining time: 13m 7s [2025-10-22T23:27:15.289819] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:15.340358] [DEBUG] [LOCAL ] AM: Loaded 51849 existing records from primary storage. [2025-10-22T23:27:15.340533] [INFO ] [MAIN ] AM: Loaded 51849 primary data records. [2025-10-22T23:27:15.654213] [DEBUG] [MAIN ] AM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:15.679704] [INFO ] [MAIN ] AM: Generated 138 derivative records from 51849 primary records. [2025-10-22T23:27:15.679863] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-22T23:27:15.691530] [DEBUG] [LOCAL ] AM: Derivative data saved (138 records). [2025-10-22T23:27:15.691616] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-22T23:27:15.694599] [INFO ] [MAIN ] Derivative Progress: 69/2052 symbols. AM took 0.4s. Estimated remaining time: 13m 7s [2025-10-22T23:27:15.694744] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:15.727018] [DEBUG] [LOCAL ] AMBC: Loaded 35885 existing records from primary storage. [2025-10-22T23:27:15.727190] [INFO ] [MAIN ] AMBC: Loaded 35885 primary data records. [2025-10-22T23:27:16.037017] [DEBUG] [MAIN ] AMBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:16.066186] [INFO ] [MAIN ] AMBC: Generated 138 derivative records from 35885 primary records. [2025-10-22T23:27:16.066396] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-22T23:27:16.077622] [DEBUG] [LOCAL ] AMBC: Derivative data saved (138 records). [2025-10-22T23:27:16.077725] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-22T23:27:16.080294] [INFO ] [MAIN ] Derivative Progress: 70/2052 symbols. AMBC took 0.4s. Estimated remaining time: 13m 6s [2025-10-22T23:27:16.080394] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:16.118152] [DEBUG] [LOCAL ] AMBP: Loaded 44318 existing records from primary storage. [2025-10-22T23:27:16.118324] [INFO ] [MAIN ] AMBP: Loaded 44318 primary data records. [2025-10-22T23:27:16.429694] [DEBUG] [MAIN ] AMBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:16.457247] [INFO ] [MAIN ] AMBP: Generated 138 derivative records from 44318 primary records. [2025-10-22T23:27:16.457486] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-22T23:27:16.469204] [DEBUG] [LOCAL ] AMBP: Derivative data saved (138 records). [2025-10-22T23:27:16.469286] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-22T23:27:16.471984] [INFO ] [MAIN ] Derivative Progress: 71/2052 symbols. AMBP took 0.4s. Estimated remaining time: 13m 6s [2025-10-22T23:27:16.472083] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:16.522768] [DEBUG] [LOCAL ] AMC: Loaded 53766 existing records from primary storage. [2025-10-22T23:27:16.522973] [INFO ] [MAIN ] AMC: Loaded 53766 primary data records. [2025-10-22T23:27:16.855388] [DEBUG] [MAIN ] AMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:16.881262] [INFO ] [MAIN ] AMC: Generated 138 derivative records from 53766 primary records. [2025-10-22T23:27:16.881423] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-22T23:27:16.893101] [DEBUG] [LOCAL ] AMC: Derivative data saved (138 records). [2025-10-22T23:27:16.893198] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-22T23:27:16.896092] [INFO ] [MAIN ] Derivative Progress: 72/2052 symbols. AMC took 0.4s. Estimated remaining time: 13m 6s [2025-10-22T23:27:16.896199] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:16.945711] [DEBUG] [LOCAL ] AMCR: Loaded 53670 existing records from primary storage. [2025-10-22T23:27:16.945876] [INFO ] [MAIN ] AMCR: Loaded 53670 primary data records. [2025-10-22T23:27:17.254151] [DEBUG] [MAIN ] AMCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:17.279813] [INFO ] [MAIN ] AMCR: Generated 138 derivative records from 53670 primary records. [2025-10-22T23:27:17.279927] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-22T23:27:17.291506] [DEBUG] [LOCAL ] AMCR: Derivative data saved (138 records). [2025-10-22T23:27:17.291587] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-22T23:27:17.294574] [INFO ] [MAIN ] Derivative Progress: 73/2052 symbols. AMCR took 0.4s. Estimated remaining time: 13m 6s [2025-10-22T23:27:17.294700] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:17.341893] [DEBUG] [LOCAL ] AME: Loaded 48418 existing records from primary storage. [2025-10-22T23:27:17.342065] [INFO ] [MAIN ] AME: Loaded 48418 primary data records. [2025-10-22T23:27:17.653940] [DEBUG] [MAIN ] AME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:17.679225] [INFO ] [MAIN ] AME: Generated 138 derivative records from 48418 primary records. [2025-10-22T23:27:17.679350] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-22T23:27:17.691194] [DEBUG] [LOCAL ] AME: Derivative data saved (138 records). [2025-10-22T23:27:17.691279] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-22T23:27:17.694100] [INFO ] [MAIN ] Derivative Progress: 74/2052 symbols. AME took 0.4s. Estimated remaining time: 13m 6s [2025-10-22T23:27:17.694217] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:17.715175] [DEBUG] [LOCAL ] AMG: Loaded 20036 existing records from primary storage. [2025-10-22T23:27:17.715329] [INFO ] [MAIN ] AMG: Loaded 20036 primary data records. [2025-10-22T23:27:18.020491] [DEBUG] [MAIN ] AMG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:27:18.045764] [INFO ] [MAIN ] AMG: Generated 138 derivative records from 20036 primary records. [2025-10-22T23:27:18.045939] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-22T23:27:18.057831] [DEBUG] [LOCAL ] AMG: Derivative data saved (138 records). [2025-10-22T23:27:18.057916] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-22T23:27:18.060434] [INFO ] [MAIN ] Derivative Progress: 75/2052 symbols. AMG took 0.4s. Estimated remaining time: 13m 4s [2025-10-22T23:27:18.060541] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:18.109547] [DEBUG] [LOCAL ] AMH: Loaded 51830 existing records from primary storage. [2025-10-22T23:27:18.109752] [INFO ] [MAIN ] AMH: Loaded 51830 primary data records. [2025-10-22T23:27:18.420110] [DEBUG] [MAIN ] AMH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:18.446377] [INFO ] [MAIN ] AMH: Generated 138 derivative records from 51830 primary records. [2025-10-22T23:27:18.446521] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-10-22T23:27:18.458447] [DEBUG] [LOCAL ] AMH: Derivative data saved (138 records). [2025-10-22T23:27:18.458538] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-10-22T23:27:18.462319] [INFO ] [MAIN ] Derivative Progress: 76/2052 symbols. AMH took 0.4s. Estimated remaining time: 13m 4s [2025-10-22T23:27:18.462440] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:18.501312] [DEBUG] [LOCAL ] AMN: Loaded 41641 existing records from primary storage. [2025-10-22T23:27:18.501487] [INFO ] [MAIN ] AMN: Loaded 41641 primary data records. [2025-10-22T23:27:18.852324] [DEBUG] [MAIN ] AMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:18.879083] [INFO ] [MAIN ] AMN: Generated 138 derivative records from 41641 primary records. [2025-10-22T23:27:18.879282] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-10-22T23:27:18.891474] [DEBUG] [LOCAL ] AMN: Derivative data saved (138 records). [2025-10-22T23:27:18.891570] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-10-22T23:27:18.894455] [INFO ] [MAIN ] Derivative Progress: 77/2052 symbols. AMN took 0.4s. Estimated remaining time: 13m 5s [2025-10-22T23:27:18.894556] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:18.927007] [DEBUG] [LOCAL ] AMP: Loaded 31807 existing records from primary storage. [2025-10-22T23:27:18.927175] [INFO ] [MAIN ] AMP: Loaded 31807 primary data records. [2025-10-22T23:27:19.235035] [DEBUG] [MAIN ] AMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:19.262082] [INFO ] [MAIN ] AMP: Generated 138 derivative records from 31807 primary records. [2025-10-22T23:27:19.262243] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-22T23:27:19.273940] [DEBUG] [LOCAL ] AMP: Derivative data saved (138 records). [2025-10-22T23:27:19.274021] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-22T23:27:19.276615] [INFO ] [MAIN ] Derivative Progress: 78/2052 symbols. AMP took 0.4s. Estimated remaining time: 13m 4s [2025-10-22T23:27:19.276753] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:19.312863] [DEBUG] [LOCAL ] AMPY: Loaded 39376 existing records from primary storage. [2025-10-22T23:27:19.313029] [INFO ] [MAIN ] AMPY: Loaded 39376 primary data records. [2025-10-22T23:27:19.619605] [DEBUG] [MAIN ] AMPY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:19.644555] [INFO ] [MAIN ] AMPY: Generated 138 derivative records from 39376 primary records. [2025-10-22T23:27:19.644697] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-22T23:27:19.655923] [DEBUG] [LOCAL ] AMPY: Derivative data saved (138 records). [2025-10-22T23:27:19.656003] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-10-22T23:27:19.658700] [INFO ] [MAIN ] Derivative Progress: 79/2052 symbols. AMPY took 0.4s. Estimated remaining time: 13m 3s [2025-10-22T23:27:19.658806] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:19.687929] [DEBUG] [LOCAL ] AMR: Loaded 28786 existing records from primary storage. [2025-10-22T23:27:19.688090] [INFO ] [MAIN ] AMR: Loaded 28786 primary data records. [2025-10-22T23:27:20.000824] [DEBUG] [MAIN ] AMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:20.026178] [INFO ] [MAIN ] AMR: Generated 138 derivative records from 28786 primary records. [2025-10-22T23:27:20.026327] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-22T23:27:20.038118] [DEBUG] [LOCAL ] AMR: Derivative data saved (138 records). [2025-10-22T23:27:20.038210] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-22T23:27:20.041415] [INFO ] [MAIN ] Derivative Progress: 80/2052 symbols. AMR took 0.4s. Estimated remaining time: 13m 2s [2025-10-22T23:27:20.041525] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:20.078130] [DEBUG] [LOCAL ] AMRC: Loaded 38551 existing records from primary storage. [2025-10-22T23:27:20.078351] [INFO ] [MAIN ] AMRC: Loaded 38551 primary data records. [2025-10-22T23:27:20.398343] [DEBUG] [MAIN ] AMRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:20.424744] [INFO ] [MAIN ] AMRC: Generated 138 derivative records from 38551 primary records. [2025-10-22T23:27:20.424914] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-22T23:27:20.436752] [DEBUG] [LOCAL ] AMRC: Derivative data saved (138 records). [2025-10-22T23:27:20.436850] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-22T23:27:20.439630] [INFO ] [MAIN ] Derivative Progress: 81/2052 symbols. AMRC took 0.4s. Estimated remaining time: 13m 2s [2025-10-22T23:27:20.439765] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:20.491810] [DEBUG] [LOCAL ] AMT: Loaded 52430 existing records from primary storage. [2025-10-22T23:27:20.491984] [INFO ] [MAIN ] AMT: Loaded 52430 primary data records. [2025-10-22T23:27:20.842865] [DEBUG] [MAIN ] AMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:20.869519] [INFO ] [MAIN ] AMT: Generated 138 derivative records from 52430 primary records. [2025-10-22T23:27:20.869719] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-22T23:27:20.881581] [DEBUG] [LOCAL ] AMT: Derivative data saved (138 records). [2025-10-22T23:27:20.881694] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-22T23:27:20.884639] [INFO ] [MAIN ] Derivative Progress: 82/2052 symbols. AMT took 0.4s. Estimated remaining time: 13m 3s [2025-10-22T23:27:20.884796] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:20.905556] [DEBUG] [LOCAL ] AMTB: Loaded 20336 existing records from primary storage. [2025-10-22T23:27:20.905727] [INFO ] [MAIN ] AMTB: Loaded 20336 primary data records. [2025-10-22T23:27:21.226176] [DEBUG] [MAIN ] AMTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:21.251984] [INFO ] [MAIN ] AMTB: Generated 138 derivative records from 20336 primary records. [2025-10-22T23:27:21.252127] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-22T23:27:21.263787] [DEBUG] [LOCAL ] AMTB: Derivative data saved (138 records). [2025-10-22T23:27:21.263889] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-22T23:27:21.266473] [INFO ] [MAIN ] Derivative Progress: 83/2052 symbols. AMTB took 0.4s. Estimated remaining time: 13m 2s [2025-10-22T23:27:21.266588] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:21.272461] [DEBUG] [LOCAL ] AMTD: Loaded 3812 existing records from primary storage. [2025-10-22T23:27:21.272567] [INFO ] [MAIN ] AMTD: Loaded 3812 primary data records. [2025-10-22T23:27:21.581475] [DEBUG] [MAIN ] AMTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:21.610319] [INFO ] [MAIN ] AMTD: Generated 138 derivative records from 3812 primary records. [2025-10-22T23:27:21.610499] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-22T23:27:21.620589] [DEBUG] [LOCAL ] AMTD: Derivative data saved (138 records). [2025-10-22T23:27:21.620811] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-22T23:27:21.622925] [INFO ] [MAIN ] Derivative Progress: 84/2052 symbols. AMTD took 0.4s. Estimated remaining time: 13m 1s [2025-10-22T23:27:21.623078] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:21.669142] [DEBUG] [LOCAL ] AMTM: Loaded 50253 existing records from primary storage. [2025-10-22T23:27:21.669319] [INFO ] [MAIN ] AMTM: Loaded 50253 primary data records. [2025-10-22T23:27:21.984678] [DEBUG] [MAIN ] AMTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:22.012000] [INFO ] [MAIN ] AMTM: Generated 138 derivative records from 50253 primary records. [2025-10-22T23:27:22.012237] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-22T23:27:22.024334] [DEBUG] [LOCAL ] AMTM: Derivative data saved (138 records). [2025-10-22T23:27:22.024433] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-10-22T23:27:22.027326] [INFO ] [MAIN ] Derivative Progress: 85/2052 symbols. AMTM took 0.4s. Estimated remaining time: 13m 0s [2025-10-22T23:27:22.027431] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:22.039439] [DEBUG] [LOCAL ] AMWL: Loaded 9814 existing records from primary storage. [2025-10-22T23:27:22.039577] [INFO ] [MAIN ] AMWL: Loaded 9814 primary data records. [2025-10-22T23:27:22.360574] [DEBUG] [MAIN ] AMWL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:22.386709] [INFO ] [MAIN ] AMWL: Generated 138 derivative records from 9814 primary records. [2025-10-22T23:27:22.386863] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-22T23:27:22.397901] [DEBUG] [LOCAL ] AMWL: Derivative data saved (138 records). [2025-10-22T23:27:22.397990] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-22T23:27:22.400039] [INFO ] [MAIN ] Derivative Progress: 86/2052 symbols. AMWL took 0.4s. Estimated remaining time: 12m 59s [2025-10-22T23:27:22.400144] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:22.446359] [DEBUG] [LOCAL ] AMX: Loaded 49176 existing records from primary storage. [2025-10-22T23:27:22.446523] [INFO ] [MAIN ] AMX: Loaded 49176 primary data records. [2025-10-22T23:27:22.770610] [DEBUG] [MAIN ] AMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:22.795975] [INFO ] [MAIN ] AMX: Generated 138 derivative records from 49176 primary records. [2025-10-22T23:27:22.796130] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-10-22T23:27:22.807813] [DEBUG] [LOCAL ] AMX: Derivative data saved (138 records). [2025-10-22T23:27:22.807898] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-10-22T23:27:22.810737] [INFO ] [MAIN ] Derivative Progress: 87/2052 symbols. AMX took 0.4s. Estimated remaining time: 12m 59s [2025-10-22T23:27:22.810838] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:22.839888] [DEBUG] [LOCAL ] AN: Loaded 31030 existing records from primary storage. [2025-10-22T23:27:22.840047] [INFO ] [MAIN ] AN: Loaded 31030 primary data records. [2025-10-22T23:27:23.173557] [DEBUG] [MAIN ] AN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:23.200870] [INFO ] [MAIN ] AN: Generated 138 derivative records from 31030 primary records. [2025-10-22T23:27:23.201072] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-10-22T23:27:23.213085] [DEBUG] [LOCAL ] AN: Derivative data saved (138 records). [2025-10-22T23:27:23.213177] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-10-22T23:27:23.215898] [INFO ] [MAIN ] Derivative Progress: 88/2052 symbols. AN took 0.4s. Estimated remaining time: 12m 59s [2025-10-22T23:27:23.216004] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:23.270087] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-22T23:27:23.270262] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-10-22T23:27:23.581157] [DEBUG] [MAIN ] ANET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:23.607250] [INFO ] [MAIN ] ANET: Generated 138 derivative records from 53766 primary records. [2025-10-22T23:27:23.607470] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-22T23:27:23.619351] [DEBUG] [LOCAL ] ANET: Derivative data saved (138 records). [2025-10-22T23:27:23.619437] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-22T23:27:23.622554] [INFO ] [MAIN ] Derivative Progress: 89/2052 symbols. ANET took 0.4s. Estimated remaining time: 12m 59s [2025-10-22T23:27:23.622704] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:23.671978] [DEBUG] [LOCAL ] ANF: Loaded 52040 existing records from primary storage. [2025-10-22T23:27:23.672155] [INFO ] [MAIN ] ANF: Loaded 52040 primary data records. [2025-10-22T23:27:23.983550] [DEBUG] [MAIN ] ANF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:24.009205] [INFO ] [MAIN ] ANF: Generated 138 derivative records from 52040 primary records. [2025-10-22T23:27:24.009392] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-22T23:27:24.021084] [DEBUG] [LOCAL ] ANF: Derivative data saved (138 records). [2025-10-22T23:27:24.021179] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-10-22T23:27:24.024206] [INFO ] [MAIN ] Derivative Progress: 90/2052 symbols. ANF took 0.4s. Estimated remaining time: 12m 59s [2025-10-22T23:27:24.024370] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:24.044397] [DEBUG] [LOCAL ] ANRO: Loaded 19715 existing records from primary storage. [2025-10-22T23:27:24.044559] [INFO ] [MAIN ] ANRO: Loaded 19715 primary data records. [2025-10-22T23:27:24.353355] [DEBUG] [MAIN ] ANRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:24.383691] [INFO ] [MAIN ] ANRO: Generated 138 derivative records from 19715 primary records. [2025-10-22T23:27:24.384215] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-10-22T23:27:24.396229] [DEBUG] [LOCAL ] ANRO: Derivative data saved (138 records). [2025-10-22T23:27:24.396316] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-10-22T23:27:24.398908] [INFO ] [MAIN ] Derivative Progress: 91/2052 symbols. ANRO took 0.4s. Estimated remaining time: 12m 58s [2025-10-22T23:27:24.399007] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:24.423361] [DEBUG] [LOCAL ] ANVS: Loaded 23982 existing records from primary storage. [2025-10-22T23:27:24.423523] [INFO ] [MAIN ] ANVS: Loaded 23982 primary data records. [2025-10-22T23:27:24.734705] [DEBUG] [MAIN ] ANVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:24.760153] [INFO ] [MAIN ] ANVS: Generated 138 derivative records from 23982 primary records. [2025-10-22T23:27:24.760290] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-22T23:27:24.771785] [DEBUG] [LOCAL ] ANVS: Derivative data saved (138 records). [2025-10-22T23:27:24.771873] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-10-22T23:27:24.774455] [INFO ] [MAIN ] Derivative Progress: 92/2052 symbols. ANVS took 0.4s. Estimated remaining time: 12m 57s [2025-10-22T23:27:24.774561] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:24.803014] [DEBUG] [LOCAL ] AOD: Loaded 30865 existing records from primary storage. [2025-10-22T23:27:24.803169] [INFO ] [MAIN ] AOD: Loaded 30865 primary data records. [2025-10-22T23:27:25.136517] [DEBUG] [MAIN ] AOD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:25.162375] [INFO ] [MAIN ] AOD: Generated 138 derivative records from 30865 primary records. [2025-10-22T23:27:25.162523] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-10-22T23:27:25.173981] [DEBUG] [LOCAL ] AOD: Derivative data saved (138 records). [2025-10-22T23:27:25.174072] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-10-22T23:27:25.176925] [INFO ] [MAIN ] Derivative Progress: 93/2052 symbols. AOD took 0.4s. Estimated remaining time: 12m 57s [2025-10-22T23:27:25.177030] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:25.194677] [DEBUG] [LOCAL ] AOMR: Loaded 16310 existing records from primary storage. [2025-10-22T23:27:25.194876] [INFO ] [MAIN ] AOMR: Loaded 16310 primary data records. [2025-10-22T23:27:25.521245] [DEBUG] [MAIN ] AOMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:25.548864] [INFO ] [MAIN ] AOMR: Generated 138 derivative records from 16310 primary records. [2025-10-22T23:27:25.549050] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-10-22T23:27:25.561838] [DEBUG] [LOCAL ] AOMR: Derivative data saved (138 records). [2025-10-22T23:27:25.561937] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-10-22T23:27:25.564188] [INFO ] [MAIN ] Derivative Progress: 94/2052 symbols. AOMR took 0.4s. Estimated remaining time: 12m 56s [2025-10-22T23:27:25.564295] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:25.606794] [DEBUG] [LOCAL ] AON: Loaded 45033 existing records from primary storage. [2025-10-22T23:27:25.606965] [INFO ] [MAIN ] AON: Loaded 45033 primary data records. [2025-10-22T23:27:25.930775] [DEBUG] [MAIN ] AON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:25.956233] [INFO ] [MAIN ] AON: Generated 138 derivative records from 45033 primary records. [2025-10-22T23:27:25.956403] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-22T23:27:25.968502] [DEBUG] [LOCAL ] AON: Derivative data saved (138 records). [2025-10-22T23:27:25.968589] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-10-22T23:27:25.971576] [INFO ] [MAIN ] Derivative Progress: 95/2052 symbols. AON took 0.4s. Estimated remaining time: 12m 56s [2025-10-22T23:27:25.971728] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:25.999301] [DEBUG] [LOCAL ] AORT: Loaded 28916 existing records from primary storage. [2025-10-22T23:27:25.999464] [INFO ] [MAIN ] AORT: Loaded 28916 primary data records. [2025-10-22T23:27:26.327065] [DEBUG] [MAIN ] AORT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:26.352582] [INFO ] [MAIN ] AORT: Generated 138 derivative records from 28916 primary records. [2025-10-22T23:27:26.352763] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-10-22T23:27:26.364629] [DEBUG] [LOCAL ] AORT: Derivative data saved (138 records). [2025-10-22T23:27:26.364738] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-10-22T23:27:26.367831] [INFO ] [MAIN ] Derivative Progress: 96/2052 symbols. AORT took 0.4s. Estimated remaining time: 12m 55s [2025-10-22T23:27:26.368113] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:26.413851] [DEBUG] [LOCAL ] AOS: Loaded 48646 existing records from primary storage. [2025-10-22T23:27:26.414029] [INFO ] [MAIN ] AOS: Loaded 48646 primary data records. [2025-10-22T23:27:26.732097] [DEBUG] [MAIN ] AOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:26.757561] [INFO ] [MAIN ] AOS: Generated 138 derivative records from 48646 primary records. [2025-10-22T23:27:26.757725] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-10-22T23:27:26.769356] [DEBUG] [LOCAL ] AOS: Derivative data saved (138 records). [2025-10-22T23:27:26.769442] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-10-22T23:27:26.772297] [INFO ] [MAIN ] Derivative Progress: 97/2052 symbols. AOS took 0.4s. Estimated remaining time: 12m 55s [2025-10-22T23:27:26.772405] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:26.783577] [DEBUG] [LOCAL ] AP: Loaded 7414 existing records from primary storage. [2025-10-22T23:27:26.783749] [INFO ] [MAIN ] AP: Loaded 7414 primary data records. [2025-10-22T23:27:27.115552] [DEBUG] [MAIN ] AP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:27.145200] [INFO ] [MAIN ] AP: Generated 138 derivative records from 7414 primary records. [2025-10-22T23:27:27.145461] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-10-22T23:27:27.156295] [DEBUG] [LOCAL ] AP: Derivative data saved (138 records). [2025-10-22T23:27:27.156422] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-10-22T23:27:27.158676] [INFO ] [MAIN ] Derivative Progress: 98/2052 symbols. AP took 0.4s. Estimated remaining time: 12m 55s [2025-10-22T23:27:27.158787] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:27.202831] [DEBUG] [LOCAL ] APD: Loaded 45416 existing records from primary storage. [2025-10-22T23:27:27.202996] [INFO ] [MAIN ] APD: Loaded 45416 primary data records. [2025-10-22T23:27:27.509128] [DEBUG] [MAIN ] APD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:27.534608] [INFO ] [MAIN ] APD: Generated 138 derivative records from 45416 primary records. [2025-10-22T23:27:27.534806] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-22T23:27:27.546479] [DEBUG] [LOCAL ] APD: Derivative data saved (138 records). [2025-10-22T23:27:27.546572] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-10-22T23:27:27.549435] [INFO ] [MAIN ] Derivative Progress: 99/2052 symbols. APD took 0.4s. Estimated remaining time: 12m 54s [2025-10-22T23:27:27.549540] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:27.596590] [DEBUG] [LOCAL ] APG: Loaded 50617 existing records from primary storage. [2025-10-22T23:27:27.596802] [INFO ] [MAIN ] APG: Loaded 50617 primary data records. [2025-10-22T23:27:27.904428] [DEBUG] [MAIN ] APG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:27.929940] [INFO ] [MAIN ] APG: Generated 138 derivative records from 50617 primary records. [2025-10-22T23:27:27.930077] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-10-22T23:27:27.941612] [DEBUG] [LOCAL ] APG: Derivative data saved (138 records). [2025-10-22T23:27:27.941712] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-10-22T23:27:27.944774] [INFO ] [MAIN ] Derivative Progress: 100/2052 symbols. APG took 0.4s. Estimated remaining time: 12m 54s [2025-10-22T23:27:27.944877] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:27.996479] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-22T23:27:27.996639] [INFO ] [MAIN ] APH: Loaded 53691 primary data records. [2025-10-22T23:27:28.302785] [DEBUG] [MAIN ] APH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:28.328246] [INFO ] [MAIN ] APH: Generated 138 derivative records from 53691 primary records. [2025-10-22T23:27:28.328369] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-10-22T23:27:28.340258] [DEBUG] [LOCAL ] APH: Derivative data saved (138 records). [2025-10-22T23:27:28.340343] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-10-22T23:27:28.343438] [INFO ] [MAIN ] Derivative Progress: 101/2052 symbols. APH took 0.4s. Estimated remaining time: 12m 53s [2025-10-22T23:27:28.343537] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:28.393977] [DEBUG] [LOCAL ] APLE: Loaded 51958 existing records from primary storage. [2025-10-22T23:27:28.394144] [INFO ] [MAIN ] APLE: Loaded 51958 primary data records. [2025-10-22T23:27:28.699975] [DEBUG] [MAIN ] APLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:28.725431] [INFO ] [MAIN ] APLE: Generated 138 derivative records from 51958 primary records. [2025-10-22T23:27:28.725545] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-10-22T23:27:28.737386] [DEBUG] [LOCAL ] APLE: Derivative data saved (138 records). [2025-10-22T23:27:28.737484] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-10-22T23:27:28.740439] [INFO ] [MAIN ] Derivative Progress: 102/2052 symbols. APLE took 0.4s. Estimated remaining time: 12m 53s [2025-10-22T23:27:28.740547] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:28.793372] [DEBUG] [LOCAL ] APO: Loaded 53388 existing records from primary storage. [2025-10-22T23:27:28.793541] [INFO ] [MAIN ] APO: Loaded 53388 primary data records. [2025-10-22T23:27:29.142541] [DEBUG] [MAIN ] APO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:29.169453] [INFO ] [MAIN ] APO: Generated 138 derivative records from 53388 primary records. [2025-10-22T23:27:29.169615] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-10-22T23:27:29.181966] [DEBUG] [LOCAL ] APO: Derivative data saved (138 records). [2025-10-22T23:27:29.182062] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-10-22T23:27:29.186312] [INFO ] [MAIN ] Derivative Progress: 103/2052 symbols. APO took 0.4s. Estimated remaining time: 12m 53s [2025-10-22T23:27:29.186448] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:29.197431] [DEBUG] [LOCAL ] APOS: Loaded 7058 existing records from primary storage. [2025-10-22T23:27:29.197620] [INFO ] [MAIN ] APOS: Loaded 7058 primary data records. [2025-10-22T23:27:29.511394] [DEBUG] [MAIN ] APOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:29.536985] [INFO ] [MAIN ] APOS: Generated 138 derivative records from 7058 primary records. [2025-10-22T23:27:29.537137] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-10-22T23:27:29.548473] [DEBUG] [LOCAL ] APOS: Derivative data saved (138 records). [2025-10-22T23:27:29.548595] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-10-22T23:27:29.550758] [INFO ] [MAIN ] Derivative Progress: 104/2052 symbols. APOS took 0.4s. Estimated remaining time: 12m 52s [2025-10-22T23:27:29.550880] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:29.602378] [DEBUG] [LOCAL ] APTV: Loaded 51849 existing records from primary storage. [2025-10-22T23:27:29.602567] [INFO ] [MAIN ] APTV: Loaded 51849 primary data records. [2025-10-22T23:27:29.915533] [DEBUG] [MAIN ] APTV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:29.941269] [INFO ] [MAIN ] APTV: Generated 138 derivative records from 51849 primary records. [2025-10-22T23:27:29.941429] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-10-22T23:27:29.953035] [DEBUG] [LOCAL ] APTV: Derivative data saved (138 records). [2025-10-22T23:27:29.953124] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-10-22T23:27:29.956144] [INFO ] [MAIN ] Derivative Progress: 105/2052 symbols. APTV took 0.4s. Estimated remaining time: 12m 52s [2025-10-22T23:27:29.956269] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:29.963539] [DEBUG] [LOCAL ] AQNB: Loaded 3886 existing records from primary storage. [2025-10-22T23:27:29.963694] [INFO ] [MAIN ] AQNB: Loaded 3886 primary data records. [2025-10-22T23:27:30.268923] [DEBUG] [MAIN ] AQNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:30.294381] [INFO ] [MAIN ] AQNB: Generated 138 derivative records from 3886 primary records. [2025-10-22T23:27:30.294528] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-22T23:27:30.304928] [DEBUG] [LOCAL ] AQNB: Derivative data saved (138 records). [2025-10-22T23:27:30.305015] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-22T23:27:30.307116] [INFO ] [MAIN ] Derivative Progress: 106/2052 symbols. AQNB took 0.4s. Estimated remaining time: 12m 51s [2025-10-22T23:27:30.307221] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:30.333041] [DEBUG] [LOCAL ] ARDT: Loaded 27391 existing records from primary storage. [2025-10-22T23:27:30.333195] [INFO ] [MAIN ] ARDT: Loaded 27391 primary data records. [2025-10-22T23:27:30.638912] [DEBUG] [MAIN ] ARDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:30.664367] [INFO ] [MAIN ] ARDT: Generated 138 derivative records from 27391 primary records. [2025-10-22T23:27:30.664514] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-22T23:27:30.676124] [DEBUG] [LOCAL ] ARDT: Derivative data saved (138 records). [2025-10-22T23:27:30.676219] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-22T23:27:30.679088] [INFO ] [MAIN ] Derivative Progress: 107/2052 symbols. ARDT took 0.4s. Estimated remaining time: 12m 50s [2025-10-22T23:27:30.679189] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:30.726687] [DEBUG] [LOCAL ] ARE: Loaded 50927 existing records from primary storage. [2025-10-22T23:27:30.726850] [INFO ] [MAIN ] ARE: Loaded 50927 primary data records. [2025-10-22T23:27:31.033773] [DEBUG] [MAIN ] ARE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:31.059180] [INFO ] [MAIN ] ARE: Generated 138 derivative records from 50927 primary records. [2025-10-22T23:27:31.059314] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-10-22T23:27:31.070972] [DEBUG] [LOCAL ] ARE: Derivative data saved (138 records). [2025-10-22T23:27:31.071054] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-10-22T23:27:31.073933] [INFO ] [MAIN ] Derivative Progress: 108/2052 symbols. ARE took 0.4s. Estimated remaining time: 12m 50s [2025-10-22T23:27:31.074034] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:31.121418] [DEBUG] [LOCAL ] ARES: Loaded 49676 existing records from primary storage. [2025-10-22T23:27:31.121581] [INFO ] [MAIN ] ARES: Loaded 49676 primary data records. [2025-10-22T23:27:31.459362] [DEBUG] [MAIN ] ARES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:31.485535] [INFO ] [MAIN ] ARES: Generated 138 derivative records from 49676 primary records. [2025-10-22T23:27:31.485699] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-10-22T23:27:31.498333] [DEBUG] [LOCAL ] ARES: Derivative data saved (138 records). [2025-10-22T23:27:31.498487] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-10-22T23:27:31.501367] [INFO ] [MAIN ] Derivative Progress: 109/2052 symbols. ARES took 0.4s. Estimated remaining time: 12m 50s [2025-10-22T23:27:31.501478] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:31.541924] [DEBUG] [LOCAL ] ARLO: Loaded 43510 existing records from primary storage. [2025-10-22T23:27:31.542086] [INFO ] [MAIN ] ARLO: Loaded 43510 primary data records. [2025-10-22T23:27:31.849408] [DEBUG] [MAIN ] ARLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:31.874820] [INFO ] [MAIN ] ARLO: Generated 138 derivative records from 43510 primary records. [2025-10-22T23:27:31.874962] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-10-22T23:27:31.886671] [DEBUG] [LOCAL ] ARLO: Derivative data saved (138 records). [2025-10-22T23:27:31.886756] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-10-22T23:27:31.889550] [INFO ] [MAIN ] Derivative Progress: 110/2052 symbols. ARLO took 0.4s. Estimated remaining time: 12m 49s [2025-10-22T23:27:31.889695] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:31.935018] [DEBUG] [LOCAL ] ARMK: Loaded 50369 existing records from primary storage. [2025-10-22T23:27:31.935187] [INFO ] [MAIN ] ARMK: Loaded 50369 primary data records. [2025-10-22T23:27:32.243936] [DEBUG] [MAIN ] ARMK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:32.270753] [INFO ] [MAIN ] ARMK: Generated 138 derivative records from 50369 primary records. [2025-10-22T23:27:32.270947] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-10-22T23:27:32.283233] [DEBUG] [LOCAL ] ARMK: Derivative data saved (138 records). [2025-10-22T23:27:32.283378] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-10-22T23:27:32.286400] [INFO ] [MAIN ] Derivative Progress: 111/2052 symbols. ARMK took 0.4s. Estimated remaining time: 12m 49s [2025-10-22T23:27:32.286566] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:32.337439] [DEBUG] [LOCAL ] ARR: Loaded 52091 existing records from primary storage. [2025-10-22T23:27:32.337610] [INFO ] [MAIN ] ARR: Loaded 52091 primary data records. [2025-10-22T23:27:32.714918] [DEBUG] [MAIN ] ARR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:32.744913] [INFO ] [MAIN ] ARR: Generated 138 derivative records from 52091 primary records. [2025-10-22T23:27:32.745131] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-10-22T23:27:32.759146] [DEBUG] [LOCAL ] ARR: Derivative data saved (138 records). [2025-10-22T23:27:32.759330] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-10-22T23:27:32.763968] [INFO ] [MAIN ] Derivative Progress: 112/2052 symbols. ARR took 0.5s. Estimated remaining time: 12m 50s [2025-10-22T23:27:32.764197] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:32.799433] [DEBUG] [LOCAL ] ARW: Loaded 33141 existing records from primary storage. [2025-10-22T23:27:32.799621] [INFO ] [MAIN ] ARW: Loaded 33141 primary data records. [2025-10-22T23:27:33.218257] [DEBUG] [MAIN ] ARW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:33.249823] [INFO ] [MAIN ] ARW: Generated 138 derivative records from 33141 primary records. [2025-10-22T23:27:33.250034] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-10-22T23:27:33.263819] [DEBUG] [LOCAL ] ARW: Derivative data saved (138 records). [2025-10-22T23:27:33.264016] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-10-22T23:27:33.267089] [INFO ] [MAIN ] Derivative Progress: 113/2052 symbols. ARW took 0.5s. Estimated remaining time: 12m 51s [2025-10-22T23:27:33.267330] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:33.322892] [DEBUG] [LOCAL ] AS: Loaded 53198 existing records from primary storage. [2025-10-22T23:27:33.323087] [INFO ] [MAIN ] AS: Loaded 53198 primary data records. [2025-10-22T23:27:33.727095] [DEBUG] [MAIN ] AS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:33.757119] [INFO ] [MAIN ] AS: Generated 138 derivative records from 53198 primary records. [2025-10-22T23:27:33.757375] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-22T23:27:33.769935] [DEBUG] [LOCAL ] AS: Derivative data saved (138 records). [2025-10-22T23:27:33.770030] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-22T23:27:33.773326] [INFO ] [MAIN ] Derivative Progress: 114/2052 symbols. AS took 0.5s. Estimated remaining time: 12m 53s [2025-10-22T23:27:33.773477] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:33.791758] [DEBUG] [LOCAL ] ASA: Loaded 15680 existing records from primary storage. [2025-10-22T23:27:33.791919] [INFO ] [MAIN ] ASA: Loaded 15680 primary data records. [2025-10-22T23:27:34.119170] [DEBUG] [MAIN ] ASA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:34.144800] [INFO ] [MAIN ] ASA: Generated 138 derivative records from 15680 primary records. [2025-10-22T23:27:34.144899] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-22T23:27:34.156186] [DEBUG] [LOCAL ] ASA: Derivative data saved (138 records). [2025-10-22T23:27:34.156285] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-10-22T23:27:34.158997] [INFO ] [MAIN ] Derivative Progress: 115/2052 symbols. ASA took 0.4s. Estimated remaining time: 12m 52s [2025-10-22T23:27:34.159098] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:34.209995] [DEBUG] [LOCAL ] ASAN: Loaded 52732 existing records from primary storage. [2025-10-22T23:27:34.210161] [INFO ] [MAIN ] ASAN: Loaded 52732 primary data records. [2025-10-22T23:27:34.520214] [DEBUG] [MAIN ] ASAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:34.545528] [INFO ] [MAIN ] ASAN: Generated 138 derivative records from 52732 primary records. [2025-10-22T23:27:34.545675] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-22T23:27:34.557429] [DEBUG] [LOCAL ] ASAN: Derivative data saved (138 records). [2025-10-22T23:27:34.557523] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-10-22T23:27:34.560389] [INFO ] [MAIN ] Derivative Progress: 116/2052 symbols. ASAN took 0.4s. Estimated remaining time: 12m 52s [2025-10-22T23:27:34.560490] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:34.605306] [DEBUG] [LOCAL ] ASB: Loaded 49696 existing records from primary storage. [2025-10-22T23:27:34.605478] [INFO ] [MAIN ] ASB: Loaded 49696 primary data records. [2025-10-22T23:27:34.913332] [DEBUG] [MAIN ] ASB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:34.938705] [INFO ] [MAIN ] ASB: Generated 138 derivative records from 49696 primary records. [2025-10-22T23:27:34.938823] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-22T23:27:34.950356] [DEBUG] [LOCAL ] ASB: Derivative data saved (138 records). [2025-10-22T23:27:34.950444] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-10-22T23:27:34.953188] [INFO ] [MAIN ] Derivative Progress: 117/2052 symbols. ASB took 0.4s. Estimated remaining time: 12m 51s [2025-10-22T23:27:34.953293] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:34.958436] [DEBUG] [LOCAL ] ASBA: Loaded 3475 existing records from primary storage. [2025-10-22T23:27:34.958541] [INFO ] [MAIN ] ASBA: Loaded 3475 primary data records. [2025-10-22T23:27:35.263799] [DEBUG] [MAIN ] ASBA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:35.289770] [INFO ] [MAIN ] ASBA: Generated 138 derivative records from 3475 primary records. [2025-10-22T23:27:35.289942] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-22T23:27:35.300182] [DEBUG] [LOCAL ] ASBA: Derivative data saved (138 records). [2025-10-22T23:27:35.300267] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-22T23:27:35.302279] [INFO ] [MAIN ] Derivative Progress: 118/2052 symbols. ASBA took 0.3s. Estimated remaining time: 12m 50s [2025-10-22T23:27:35.302377] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:35.339002] [DEBUG] [LOCAL ] ASC: Loaded 37184 existing records from primary storage. [2025-10-22T23:27:35.339165] [INFO ] [MAIN ] ASC: Loaded 37184 primary data records. [2025-10-22T23:27:35.677081] [DEBUG] [MAIN ] ASC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:35.703150] [INFO ] [MAIN ] ASC: Generated 138 derivative records from 37184 primary records. [2025-10-22T23:27:35.703277] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-10-22T23:27:35.715057] [DEBUG] [LOCAL ] ASC: Derivative data saved (138 records). [2025-10-22T23:27:35.715140] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-10-22T23:27:35.718154] [INFO ] [MAIN ] Derivative Progress: 119/2052 symbols. ASC took 0.4s. Estimated remaining time: 12m 50s [2025-10-22T23:27:35.718257] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:35.752190] [DEBUG] [LOCAL ] ASGN: Loaded 36689 existing records from primary storage. [2025-10-22T23:27:35.752362] [INFO ] [MAIN ] ASGN: Loaded 36689 primary data records. [2025-10-22T23:27:36.062405] [DEBUG] [MAIN ] ASGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:36.088423] [INFO ] [MAIN ] ASGN: Generated 138 derivative records from 36689 primary records. [2025-10-22T23:27:36.088567] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-22T23:27:36.100059] [DEBUG] [LOCAL ] ASGN: Derivative data saved (138 records). [2025-10-22T23:27:36.100141] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-22T23:27:36.102823] [INFO ] [MAIN ] Derivative Progress: 120/2052 symbols. ASGN took 0.4s. Estimated remaining time: 12m 49s [2025-10-22T23:27:36.102944] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:36.136501] [DEBUG] [LOCAL ] ASH: Loaded 37383 existing records from primary storage. [2025-10-22T23:27:36.136717] [INFO ] [MAIN ] ASH: Loaded 37383 primary data records. [2025-10-22T23:27:36.451282] [DEBUG] [MAIN ] ASH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:36.478488] [INFO ] [MAIN ] ASH: Generated 138 derivative records from 37383 primary records. [2025-10-22T23:27:36.478694] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-10-22T23:27:36.492240] [DEBUG] [LOCAL ] ASH: Derivative data saved (138 records). [2025-10-22T23:27:36.492382] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-10-22T23:27:36.498485] [INFO ] [MAIN ] Derivative Progress: 121/2052 symbols. ASH took 0.4s. Estimated remaining time: 12m 49s [2025-10-22T23:27:36.498682] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:36.527039] [DEBUG] [LOCAL ] ASIX: Loaded 22992 existing records from primary storage. [2025-10-22T23:27:36.527227] [INFO ] [MAIN ] ASIX: Loaded 22992 primary data records. [2025-10-22T23:27:36.851827] [DEBUG] [MAIN ] ASIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:36.879305] [INFO ] [MAIN ] ASIX: Generated 138 derivative records from 22992 primary records. [2025-10-22T23:27:36.879458] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-22T23:27:36.891337] [DEBUG] [LOCAL ] ASIX: Derivative data saved (138 records). [2025-10-22T23:27:36.891427] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-10-22T23:27:36.894179] [INFO ] [MAIN ] Derivative Progress: 122/2052 symbols. ASIX took 0.4s. Estimated remaining time: 12m 49s [2025-10-22T23:27:36.894282] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:36.938337] [DEBUG] [LOCAL ] ASPN: Loaded 49875 existing records from primary storage. [2025-10-22T23:27:36.938509] [INFO ] [MAIN ] ASPN: Loaded 49875 primary data records. [2025-10-22T23:27:37.245328] [DEBUG] [MAIN ] ASPN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:37.270917] [INFO ] [MAIN ] ASPN: Generated 138 derivative records from 49875 primary records. [2025-10-22T23:27:37.271045] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-22T23:27:37.282637] [DEBUG] [LOCAL ] ASPN: Derivative data saved (138 records). [2025-10-22T23:27:37.282759] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-22T23:27:37.285559] [INFO ] [MAIN ] Derivative Progress: 123/2052 symbols. ASPN took 0.4s. Estimated remaining time: 12m 48s [2025-10-22T23:27:37.285698] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:37.335948] [DEBUG] [LOCAL ] ASX: Loaded 52880 existing records from primary storage. [2025-10-22T23:27:37.336114] [INFO ] [MAIN ] ASX: Loaded 52880 primary data records. [2025-10-22T23:27:37.642779] [DEBUG] [MAIN ] ASX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:37.668194] [INFO ] [MAIN ] ASX: Generated 138 derivative records from 52880 primary records. [2025-10-22T23:27:37.668384] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-22T23:27:37.680355] [DEBUG] [LOCAL ] ASX: Derivative data saved (138 records). [2025-10-22T23:27:37.680495] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-10-22T23:27:37.683659] [INFO ] [MAIN ] Derivative Progress: 124/2052 symbols. ASX took 0.4s. Estimated remaining time: 12m 48s [2025-10-22T23:27:37.683761] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:37.718858] [DEBUG] [LOCAL ] ATEN: Loaded 37731 existing records from primary storage. [2025-10-22T23:27:37.719032] [INFO ] [MAIN ] ATEN: Loaded 37731 primary data records. [2025-10-22T23:27:38.053538] [DEBUG] [MAIN ] ATEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:38.080028] [INFO ] [MAIN ] ATEN: Generated 138 derivative records from 37731 primary records. [2025-10-22T23:27:38.080211] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-22T23:27:38.091936] [DEBUG] [LOCAL ] ATEN: Derivative data saved (138 records). [2025-10-22T23:27:38.092031] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-22T23:27:38.094901] [INFO ] [MAIN ] Derivative Progress: 125/2052 symbols. ATEN took 0.4s. Estimated remaining time: 12m 47s [2025-10-22T23:27:38.095016] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:38.125487] [DEBUG] [LOCAL ] ATGE: Loaded 30426 existing records from primary storage. [2025-10-22T23:27:38.125674] [INFO ] [MAIN ] ATGE: Loaded 30426 primary data records. [2025-10-22T23:27:38.463916] [DEBUG] [MAIN ] ATGE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:27:38.490870] [INFO ] [MAIN ] ATGE: Generated 138 derivative records from 30426 primary records. [2025-10-22T23:27:38.491024] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-22T23:27:38.502625] [DEBUG] [LOCAL ] ATGE: Derivative data saved (138 records). [2025-10-22T23:27:38.502726] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-22T23:27:38.505433] [INFO ] [MAIN ] Derivative Progress: 126/2052 symbols. ATGE took 0.4s. Estimated remaining time: 12m 47s [2025-10-22T23:27:38.505543] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:38.534362] [DEBUG] [LOCAL ] ATHM: Loaded 31208 existing records from primary storage. [2025-10-22T23:27:38.534523] [INFO ] [MAIN ] ATHM: Loaded 31208 primary data records. [2025-10-22T23:27:38.842104] [DEBUG] [MAIN ] ATHM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:38.867867] [INFO ] [MAIN ] ATHM: Generated 138 derivative records from 31208 primary records. [2025-10-22T23:27:38.868002] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-10-22T23:27:38.879591] [DEBUG] [LOCAL ] ATHM: Derivative data saved (138 records). [2025-10-22T23:27:38.879695] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-10-22T23:27:38.882409] [INFO ] [MAIN ] Derivative Progress: 127/2052 symbols. ATHM took 0.4s. Estimated remaining time: 12m 46s [2025-10-22T23:27:38.882509] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:38.892476] [DEBUG] [LOCAL ] ATHS: Loaded 6496 existing records from primary storage. [2025-10-22T23:27:38.892616] [INFO ] [MAIN ] ATHS: Loaded 6496 primary data records. [2025-10-22T23:27:39.196459] [DEBUG] [MAIN ] ATHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:39.222054] [INFO ] [MAIN ] ATHS: Generated 138 derivative records from 6496 primary records. [2025-10-22T23:27:39.222176] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-22T23:27:39.232906] [DEBUG] [LOCAL ] ATHS: Derivative data saved (138 records). [2025-10-22T23:27:39.232986] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-22T23:27:39.235031] [INFO ] [MAIN ] Derivative Progress: 128/2052 symbols. ATHS took 0.4s. Estimated remaining time: 12m 45s [2025-10-22T23:27:39.235128] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:39.283843] [DEBUG] [LOCAL ] ATI: Loaded 51283 existing records from primary storage. [2025-10-22T23:27:39.284008] [INFO ] [MAIN ] ATI: Loaded 51283 primary data records. [2025-10-22T23:27:39.590912] [DEBUG] [MAIN ] ATI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:39.616362] [INFO ] [MAIN ] ATI: Generated 138 derivative records from 51283 primary records. [2025-10-22T23:27:39.616469] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-10-22T23:27:39.627824] [DEBUG] [LOCAL ] ATI: Derivative data saved (138 records). [2025-10-22T23:27:39.627905] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-10-22T23:27:39.630960] [INFO ] [MAIN ] Derivative Progress: 129/2052 symbols. ATI took 0.4s. Estimated remaining time: 12m 45s [2025-10-22T23:27:39.631066] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:39.662726] [DEBUG] [LOCAL ] ATKR: Loaded 34853 existing records from primary storage. [2025-10-22T23:27:39.662885] [INFO ] [MAIN ] ATKR: Loaded 34853 primary data records. [2025-10-22T23:27:39.995902] [DEBUG] [MAIN ] ATKR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:27:40.023058] [INFO ] [MAIN ] ATKR: Generated 138 derivative records from 34853 primary records. [2025-10-22T23:27:40.023258] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-22T23:27:40.034972] [DEBUG] [LOCAL ] ATKR: Derivative data saved (138 records). [2025-10-22T23:27:40.035056] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-10-22T23:27:40.038097] [INFO ] [MAIN ] Derivative Progress: 130/2052 symbols. ATKR took 0.4s. Estimated remaining time: 12m 45s [2025-10-22T23:27:40.038199] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:40.074487] [DEBUG] [LOCAL ] ATMU: Loaded 38718 existing records from primary storage. [2025-10-22T23:27:40.074686] [INFO ] [MAIN ] ATMU: Loaded 38718 primary data records. [2025-10-22T23:27:40.389992] [DEBUG] [MAIN ] ATMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:40.415787] [INFO ] [MAIN ] ATMU: Generated 138 derivative records from 38718 primary records. [2025-10-22T23:27:40.415973] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-10-22T23:27:40.427628] [DEBUG] [LOCAL ] ATMU: Derivative data saved (138 records). [2025-10-22T23:27:40.427735] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-10-22T23:27:40.430567] [INFO ] [MAIN ] Derivative Progress: 131/2052 symbols. ATMU took 0.4s. Estimated remaining time: 12m 44s [2025-10-22T23:27:40.430703] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:40.472320] [DEBUG] [LOCAL ] ATO: Loaded 41529 existing records from primary storage. [2025-10-22T23:27:40.472502] [INFO ] [MAIN ] ATO: Loaded 41529 primary data records. [2025-10-22T23:27:40.794698] [DEBUG] [MAIN ] ATO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:40.821080] [INFO ] [MAIN ] ATO: Generated 138 derivative records from 41529 primary records. [2025-10-22T23:27:40.821273] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-10-22T23:27:40.833266] [DEBUG] [LOCAL ] ATO: Derivative data saved (138 records). [2025-10-22T23:27:40.833354] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-10-22T23:27:40.836240] [INFO ] [MAIN ] Derivative Progress: 132/2052 symbols. ATO took 0.4s. Estimated remaining time: 12m 44s [2025-10-22T23:27:40.836372] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:40.866878] [DEBUG] [LOCAL ] ATR: Loaded 30392 existing records from primary storage. [2025-10-22T23:27:40.867035] [INFO ] [MAIN ] ATR: Loaded 30392 primary data records. [2025-10-22T23:27:41.192307] [DEBUG] [MAIN ] ATR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:41.219406] [INFO ] [MAIN ] ATR: Generated 138 derivative records from 30392 primary records. [2025-10-22T23:27:41.219572] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-10-22T23:27:41.231549] [DEBUG] [LOCAL ] ATR: Derivative data saved (138 records). [2025-10-22T23:27:41.231672] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-10-22T23:27:41.234464] [INFO ] [MAIN ] Derivative Progress: 133/2052 symbols. ATR took 0.4s. Estimated remaining time: 12m 44s [2025-10-22T23:27:41.234577] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:41.252851] [DEBUG] [LOCAL ] ATS: Loaded 17012 existing records from primary storage. [2025-10-22T23:27:41.253000] [INFO ] [MAIN ] ATS: Loaded 17012 primary data records. [2025-10-22T23:27:41.570427] [DEBUG] [MAIN ] ATS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:41.595738] [INFO ] [MAIN ] ATS: Generated 138 derivative records from 17012 primary records. [2025-10-22T23:27:41.595918] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-10-22T23:27:41.608036] [DEBUG] [LOCAL ] ATS: Derivative data saved (138 records). [2025-10-22T23:27:41.608120] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-10-22T23:27:41.610638] [INFO ] [MAIN ] Derivative Progress: 134/2052 symbols. ATS took 0.4s. Estimated remaining time: 12m 43s [2025-10-22T23:27:41.610792] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:41.654858] [DEBUG] [LOCAL ] ATUS: Loaded 49957 existing records from primary storage. [2025-10-22T23:27:41.655018] [INFO ] [MAIN ] ATUS: Loaded 49957 primary data records. [2025-10-22T23:27:41.992117] [DEBUG] [MAIN ] ATUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:42.018124] [INFO ] [MAIN ] ATUS: Generated 138 derivative records from 49957 primary records. [2025-10-22T23:27:42.018243] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-22T23:27:42.029782] [DEBUG] [LOCAL ] ATUS: Derivative data saved (138 records). [2025-10-22T23:27:42.029863] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-22T23:27:42.032803] [INFO ] [MAIN ] Derivative Progress: 135/2052 symbols. ATUS took 0.4s. Estimated remaining time: 12m 43s [2025-10-22T23:27:42.032898] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:42.082620] [DEBUG] [LOCAL ] AU: Loaded 53089 existing records from primary storage. [2025-10-22T23:27:42.082817] [INFO ] [MAIN ] AU: Loaded 53089 primary data records. [2025-10-22T23:27:42.399579] [DEBUG] [MAIN ] AU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:42.425542] [INFO ] [MAIN ] AU: Generated 138 derivative records from 53089 primary records. [2025-10-22T23:27:42.425707] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-10-22T23:27:42.437344] [DEBUG] [LOCAL ] AU: Derivative data saved (138 records). [2025-10-22T23:27:42.437431] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-10-22T23:27:42.440344] [INFO ] [MAIN ] Derivative Progress: 136/2052 symbols. AU took 0.4s. Estimated remaining time: 12m 43s [2025-10-22T23:27:42.440446] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:42.482669] [DEBUG] [LOCAL ] AUB: Loaded 45843 existing records from primary storage. [2025-10-22T23:27:42.482841] [INFO ] [MAIN ] AUB: Loaded 45843 primary data records. [2025-10-22T23:27:42.797203] [DEBUG] [MAIN ] AUB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:42.823397] [INFO ] [MAIN ] AUB: Generated 138 derivative records from 45843 primary records. [2025-10-22T23:27:42.823526] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-22T23:27:42.835316] [DEBUG] [LOCAL ] AUB: Derivative data saved (138 records). [2025-10-22T23:27:42.835402] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-22T23:27:42.837977] [INFO ] [MAIN ] Derivative Progress: 137/2052 symbols. AUB took 0.4s. Estimated remaining time: 12m 42s [2025-10-22T23:27:42.838084] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:42.846525] [DEBUG] [LOCAL ] AUNA: Loaded 5250 existing records from primary storage. [2025-10-22T23:27:42.846682] [INFO ] [MAIN ] AUNA: Loaded 5250 primary data records. [2025-10-22T23:27:43.160079] [DEBUG] [MAIN ] AUNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:43.186022] [INFO ] [MAIN ] AUNA: Generated 138 derivative records from 5250 primary records. [2025-10-22T23:27:43.186153] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-22T23:27:43.195952] [DEBUG] [LOCAL ] AUNA: Derivative data saved (138 records). [2025-10-22T23:27:43.196034] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-10-22T23:27:43.198027] [INFO ] [MAIN ] Derivative Progress: 138/2052 symbols. AUNA took 0.4s. Estimated remaining time: 12m 41s [2025-10-22T23:27:43.198127] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:43.234899] [DEBUG] [LOCAL ] AVA: Loaded 38305 existing records from primary storage. [2025-10-22T23:27:43.235059] [INFO ] [MAIN ] AVA: Loaded 38305 primary data records. [2025-10-22T23:27:43.551148] [DEBUG] [MAIN ] AVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:43.577114] [INFO ] [MAIN ] AVA: Generated 138 derivative records from 38305 primary records. [2025-10-22T23:27:43.577262] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-22T23:27:43.589004] [DEBUG] [LOCAL ] AVA: Derivative data saved (138 records). [2025-10-22T23:27:43.589085] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-22T23:27:43.592014] [INFO ] [MAIN ] Derivative Progress: 139/2052 symbols. AVA took 0.4s. Estimated remaining time: 12m 41s [2025-10-22T23:27:43.592120] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:43.603143] [DEBUG] [LOCAL ] AVAL: Loaded 8482 existing records from primary storage. [2025-10-22T23:27:43.603273] [INFO ] [MAIN ] AVAL: Loaded 8482 primary data records. [2025-10-22T23:27:43.956681] [DEBUG] [MAIN ] AVAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:43.983260] [INFO ] [MAIN ] AVAL: Generated 138 derivative records from 8482 primary records. [2025-10-22T23:27:43.983427] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-10-22T23:27:43.994778] [DEBUG] [LOCAL ] AVAL: Derivative data saved (138 records). [2025-10-22T23:27:43.994867] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-10-22T23:27:43.996897] [INFO ] [MAIN ] Derivative Progress: 140/2052 symbols. AVAL took 0.4s. Estimated remaining time: 12m 40s [2025-10-22T23:27:43.996999] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:44.038058] [DEBUG] [LOCAL ] AVB: Loaded 42169 existing records from primary storage. [2025-10-22T23:27:44.038223] [INFO ] [MAIN ] AVB: Loaded 42169 primary data records. [2025-10-22T23:27:44.353478] [DEBUG] [MAIN ] AVB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:44.378930] [INFO ] [MAIN ] AVB: Generated 138 derivative records from 42169 primary records. [2025-10-22T23:27:44.379110] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-22T23:27:44.390970] [DEBUG] [LOCAL ] AVB: Derivative data saved (138 records). [2025-10-22T23:27:44.391067] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-10-22T23:27:44.393889] [INFO ] [MAIN ] Derivative Progress: 141/2052 symbols. AVB took 0.4s. Estimated remaining time: 12m 40s [2025-10-22T23:27:44.393986] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:44.414996] [DEBUG] [LOCAL ] AVD: Loaded 21323 existing records from primary storage. [2025-10-22T23:27:44.415154] [INFO ] [MAIN ] AVD: Loaded 21323 primary data records. [2025-10-22T23:27:44.723865] [DEBUG] [MAIN ] AVD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:44.749772] [INFO ] [MAIN ] AVD: Generated 138 derivative records from 21323 primary records. [2025-10-22T23:27:44.749927] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-22T23:27:44.761109] [DEBUG] [LOCAL ] AVD: Derivative data saved (138 records). [2025-10-22T23:27:44.761191] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-22T23:27:44.763735] [INFO ] [MAIN ] Derivative Progress: 142/2052 symbols. AVD took 0.4s. Estimated remaining time: 12m 39s [2025-10-22T23:27:44.763851] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:44.783230] [DEBUG] [LOCAL ] AVK: Loaded 18618 existing records from primary storage. [2025-10-22T23:27:44.783379] [INFO ] [MAIN ] AVK: Loaded 18618 primary data records. [2025-10-22T23:27:45.091331] [DEBUG] [MAIN ] AVK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:45.120349] [INFO ] [MAIN ] AVK: Generated 138 derivative records from 18618 primary records. [2025-10-22T23:27:45.120556] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-22T23:27:45.132227] [DEBUG] [LOCAL ] AVK: Derivative data saved (138 records). [2025-10-22T23:27:45.132309] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-22T23:27:45.134991] [INFO ] [MAIN ] Derivative Progress: 143/2052 symbols. AVK took 0.4s. Estimated remaining time: 12m 39s [2025-10-22T23:27:45.135093] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:45.166627] [DEBUG] [LOCAL ] AVNS: Loaded 33534 existing records from primary storage. [2025-10-22T23:27:45.166809] [INFO ] [MAIN ] AVNS: Loaded 33534 primary data records. [2025-10-22T23:27:45.480535] [DEBUG] [MAIN ] AVNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:45.505991] [INFO ] [MAIN ] AVNS: Generated 138 derivative records from 33534 primary records. [2025-10-22T23:27:45.506143] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-22T23:27:45.517988] [DEBUG] [LOCAL ] AVNS: Derivative data saved (138 records). [2025-10-22T23:27:45.518075] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-22T23:27:45.521579] [INFO ] [MAIN ] Derivative Progress: 144/2052 symbols. AVNS took 0.4s. Estimated remaining time: 12m 38s [2025-10-22T23:27:45.521721] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:45.557568] [DEBUG] [LOCAL ] AVNT: Loaded 38618 existing records from primary storage. [2025-10-22T23:27:45.557761] [INFO ] [MAIN ] AVNT: Loaded 38618 primary data records. [2025-10-22T23:27:45.864066] [DEBUG] [MAIN ] AVNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:45.889337] [INFO ] [MAIN ] AVNT: Generated 138 derivative records from 38618 primary records. [2025-10-22T23:27:45.889464] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-10-22T23:27:45.900847] [DEBUG] [LOCAL ] AVNT: Derivative data saved (138 records). [2025-10-22T23:27:45.900930] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-10-22T23:27:45.903615] [INFO ] [MAIN ] Derivative Progress: 145/2052 symbols. AVNT took 0.4s. Estimated remaining time: 12m 37s [2025-10-22T23:27:45.903813] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:45.955804] [DEBUG] [LOCAL ] AVTR: Loaded 53571 existing records from primary storage. [2025-10-22T23:27:45.955972] [INFO ] [MAIN ] AVTR: Loaded 53571 primary data records. [2025-10-22T23:27:46.282798] [DEBUG] [MAIN ] AVTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:46.308084] [INFO ] [MAIN ] AVTR: Generated 138 derivative records from 53571 primary records. [2025-10-22T23:27:46.308214] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-10-22T23:27:46.319986] [DEBUG] [LOCAL ] AVTR: Derivative data saved (138 records). [2025-10-22T23:27:46.320070] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-10-22T23:27:46.323043] [INFO ] [MAIN ] Derivative Progress: 146/2052 symbols. AVTR took 0.4s. Estimated remaining time: 12m 37s [2025-10-22T23:27:46.323145] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:46.360340] [DEBUG] [LOCAL ] AVY: Loaded 38119 existing records from primary storage. [2025-10-22T23:27:46.360502] [INFO ] [MAIN ] AVY: Loaded 38119 primary data records. [2025-10-22T23:27:46.669482] [DEBUG] [MAIN ] AVY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:46.694807] [INFO ] [MAIN ] AVY: Generated 138 derivative records from 38119 primary records. [2025-10-22T23:27:46.694960] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-10-22T23:27:46.706804] [DEBUG] [LOCAL ] AVY: Derivative data saved (138 records). [2025-10-22T23:27:46.706891] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-10-22T23:27:46.709607] [INFO ] [MAIN ] Derivative Progress: 147/2052 symbols. AVY took 0.4s. Estimated remaining time: 12m 37s [2025-10-22T23:27:46.709747] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:46.733465] [DEBUG] [LOCAL ] AWF: Loaded 24048 existing records from primary storage. [2025-10-22T23:27:46.733619] [INFO ] [MAIN ] AWF: Loaded 24048 primary data records. [2025-10-22T23:27:47.041199] [DEBUG] [MAIN ] AWF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:47.066482] [INFO ] [MAIN ] AWF: Generated 138 derivative records from 24048 primary records. [2025-10-22T23:27:47.066668] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-22T23:27:47.078302] [DEBUG] [LOCAL ] AWF: Derivative data saved (138 records). [2025-10-22T23:27:47.078384] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-22T23:27:47.081002] [INFO ] [MAIN ] Derivative Progress: 148/2052 symbols. AWF took 0.4s. Estimated remaining time: 12m 36s [2025-10-22T23:27:47.081106] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:47.105923] [DEBUG] [LOCAL ] AWI: Loaded 25139 existing records from primary storage. [2025-10-22T23:27:47.106081] [INFO ] [MAIN ] AWI: Loaded 25139 primary data records. [2025-10-22T23:27:47.413262] [DEBUG] [MAIN ] AWI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:27:47.439131] [INFO ] [MAIN ] AWI: Generated 138 derivative records from 25139 primary records. [2025-10-22T23:27:47.439281] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-22T23:27:47.451208] [DEBUG] [LOCAL ] AWI: Derivative data saved (138 records). [2025-10-22T23:27:47.451300] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-10-22T23:27:47.453978] [INFO ] [MAIN ] Derivative Progress: 149/2052 symbols. AWI took 0.4s. Estimated remaining time: 12m 35s [2025-10-22T23:27:47.454085] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:47.499912] [DEBUG] [LOCAL ] AWK: Loaded 48388 existing records from primary storage. [2025-10-22T23:27:47.500121] [INFO ] [MAIN ] AWK: Loaded 48388 primary data records. [2025-10-22T23:27:47.807768] [DEBUG] [MAIN ] AWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:47.833257] [INFO ] [MAIN ] AWK: Generated 138 derivative records from 48388 primary records. [2025-10-22T23:27:47.833384] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-22T23:27:47.845013] [DEBUG] [LOCAL ] AWK: Derivative data saved (138 records). [2025-10-22T23:27:47.845097] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-22T23:27:47.847922] [INFO ] [MAIN ] Derivative Progress: 150/2052 symbols. AWK took 0.4s. Estimated remaining time: 12m 35s [2025-10-22T23:27:47.848018] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:47.868674] [DEBUG] [LOCAL ] AWP: Loaded 21587 existing records from primary storage. [2025-10-22T23:27:47.868827] [INFO ] [MAIN ] AWP: Loaded 21587 primary data records. [2025-10-22T23:27:48.203221] [DEBUG] [MAIN ] AWP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:48.228996] [INFO ] [MAIN ] AWP: Generated 138 derivative records from 21587 primary records. [2025-10-22T23:27:48.229154] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-22T23:27:48.240519] [DEBUG] [LOCAL ] AWP: Derivative data saved (138 records). [2025-10-22T23:27:48.240608] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-10-22T23:27:48.243370] [INFO ] [MAIN ] Derivative Progress: 151/2052 symbols. AWP took 0.4s. Estimated remaining time: 12m 34s [2025-10-22T23:27:48.243481] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:48.265378] [DEBUG] [LOCAL ] AWR: Loaded 22661 existing records from primary storage. [2025-10-22T23:27:48.265524] [INFO ] [MAIN ] AWR: Loaded 22661 primary data records. [2025-10-22T23:27:48.582499] [DEBUG] [MAIN ] AWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:48.608155] [INFO ] [MAIN ] AWR: Generated 138 derivative records from 22661 primary records. [2025-10-22T23:27:48.608275] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-22T23:27:48.619943] [DEBUG] [LOCAL ] AWR: Derivative data saved (138 records). [2025-10-22T23:27:48.620028] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-22T23:27:48.622682] [INFO ] [MAIN ] Derivative Progress: 152/2052 symbols. AWR took 0.4s. Estimated remaining time: 12m 34s [2025-10-22T23:27:48.622776] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:48.649405] [DEBUG] [LOCAL ] AX: Loaded 27804 existing records from primary storage. [2025-10-22T23:27:48.649553] [INFO ] [MAIN ] AX: Loaded 27804 primary data records. [2025-10-22T23:27:48.961368] [DEBUG] [MAIN ] AX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:48.987030] [INFO ] [MAIN ] AX: Generated 138 derivative records from 27804 primary records. [2025-10-22T23:27:48.987139] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-22T23:27:48.998766] [DEBUG] [LOCAL ] AX: Derivative data saved (138 records). [2025-10-22T23:27:48.998855] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-10-22T23:27:49.001515] [INFO ] [MAIN ] Derivative Progress: 153/2052 symbols. AX took 0.4s. Estimated remaining time: 12m 33s [2025-10-22T23:27:49.001628] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:49.048613] [DEBUG] [LOCAL ] AXL: Loaded 50533 existing records from primary storage. [2025-10-22T23:27:49.048820] [INFO ] [MAIN ] AXL: Loaded 50533 primary data records. [2025-10-22T23:27:49.364079] [DEBUG] [MAIN ] AXL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:49.389372] [INFO ] [MAIN ] AXL: Generated 138 derivative records from 50533 primary records. [2025-10-22T23:27:49.389530] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-10-22T23:27:49.400982] [DEBUG] [LOCAL ] AXL: Derivative data saved (138 records). [2025-10-22T23:27:49.401080] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-10-22T23:27:49.403905] [INFO ] [MAIN ] Derivative Progress: 154/2052 symbols. AXL took 0.4s. Estimated remaining time: 12m 33s [2025-10-22T23:27:49.404020] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:49.453855] [DEBUG] [LOCAL ] AXP: Loaded 53162 existing records from primary storage. [2025-10-22T23:27:49.454030] [INFO ] [MAIN ] AXP: Loaded 53162 primary data records. [2025-10-22T23:27:49.764901] [DEBUG] [MAIN ] AXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:49.790279] [INFO ] [MAIN ] AXP: Generated 138 derivative records from 53162 primary records. [2025-10-22T23:27:49.790398] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-22T23:27:49.802047] [DEBUG] [LOCAL ] AXP: Derivative data saved (138 records). [2025-10-22T23:27:49.802133] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-10-22T23:27:49.804911] [INFO ] [MAIN ] Derivative Progress: 155/2052 symbols. AXP took 0.4s. Estimated remaining time: 12m 33s [2025-10-22T23:27:49.805008] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:49.809697] [DEBUG] [LOCAL ] AXR: Loaded 2907 existing records from primary storage. [2025-10-22T23:27:49.809786] [INFO ] [MAIN ] AXR: Loaded 2907 primary data records. [2025-10-22T23:27:50.151554] [DEBUG] [MAIN ] AXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:50.177846] [INFO ] [MAIN ] AXR: Generated 138 derivative records from 2907 primary records. [2025-10-22T23:27:50.178006] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-10-22T23:27:50.187657] [DEBUG] [LOCAL ] AXR: Derivative data saved (138 records). [2025-10-22T23:27:50.187744] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-10-22T23:27:50.190756] [INFO ] [MAIN ] Derivative Progress: 156/2052 symbols. AXR took 0.4s. Estimated remaining time: 12m 32s [2025-10-22T23:27:50.190868] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:50.241088] [DEBUG] [LOCAL ] AXTA: Loaded 52290 existing records from primary storage. [2025-10-22T23:27:50.241258] [INFO ] [MAIN ] AXTA: Loaded 52290 primary data records. [2025-10-22T23:27:50.554103] [DEBUG] [MAIN ] AXTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:50.580052] [INFO ] [MAIN ] AXTA: Generated 138 derivative records from 52290 primary records. [2025-10-22T23:27:50.580167] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-22T23:27:50.592024] [DEBUG] [LOCAL ] AXTA: Derivative data saved (138 records). [2025-10-22T23:27:50.592109] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-10-22T23:27:50.595077] [INFO ] [MAIN ] Derivative Progress: 157/2052 symbols. AXTA took 0.4s. Estimated remaining time: 12m 32s [2025-10-22T23:27:50.595211] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:50.608762] [DEBUG] [LOCAL ] AZO: Loaded 10731 existing records from primary storage. [2025-10-22T23:27:50.608929] [INFO ] [MAIN ] AZO: Loaded 10731 primary data records. [2025-10-22T23:27:50.919171] [DEBUG] [MAIN ] AZO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:50.945036] [INFO ] [MAIN ] AZO: Generated 138 derivative records from 10731 primary records. [2025-10-22T23:27:50.945185] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-10-22T23:27:50.957228] [DEBUG] [LOCAL ] AZO: Derivative data saved (138 records). [2025-10-22T23:27:50.957350] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-10-22T23:27:50.959381] [INFO ] [MAIN ] Derivative Progress: 158/2052 symbols. AZO took 0.4s. Estimated remaining time: 12m 31s [2025-10-22T23:27:50.959485] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:50.982297] [DEBUG] [LOCAL ] AZZ: Loaded 22928 existing records from primary storage. [2025-10-22T23:27:50.982458] [INFO ] [MAIN ] AZZ: Loaded 22928 primary data records. [2025-10-22T23:27:51.293470] [DEBUG] [MAIN ] AZZ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:27:51.323360] [INFO ] [MAIN ] AZZ: Generated 138 derivative records from 22928 primary records. [2025-10-22T23:27:51.323589] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-22T23:27:51.335400] [DEBUG] [LOCAL ] AZZ: Derivative data saved (138 records). [2025-10-22T23:27:51.335488] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-22T23:27:51.338257] [INFO ] [MAIN ] Derivative Progress: 159/2052 symbols. AZZ took 0.4s. Estimated remaining time: 12m 30s [2025-10-22T23:27:51.338363] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:51.389789] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-22T23:27:51.389968] [INFO ] [MAIN ] BA: Loaded 53790 primary data records. [2025-10-22T23:27:51.699561] [DEBUG] [MAIN ] BA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:51.726696] [INFO ] [MAIN ] BA: Generated 138 derivative records from 53790 primary records. [2025-10-22T23:27:51.726830] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-22T23:27:51.738840] [DEBUG] [LOCAL ] BA: Derivative data saved (138 records). [2025-10-22T23:27:51.738934] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-10-22T23:27:51.741842] [INFO ] [MAIN ] Derivative Progress: 160/2052 symbols. BA took 0.4s. Estimated remaining time: 12m 30s [2025-10-22T23:27:51.741985] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:51.794477] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-22T23:27:51.794692] [INFO ] [MAIN ] BABA: Loaded 53820 primary data records. [2025-10-22T23:27:52.115213] [DEBUG] [MAIN ] BABA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:52.141535] [INFO ] [MAIN ] BABA: Generated 138 derivative records from 53820 primary records. [2025-10-22T23:27:52.141727] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-22T23:27:52.153889] [DEBUG] [LOCAL ] BABA: Derivative data saved (138 records). [2025-10-22T23:27:52.153982] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-10-22T23:27:52.156903] [INFO ] [MAIN ] Derivative Progress: 161/2052 symbols. BABA took 0.4s. Estimated remaining time: 12m 30s [2025-10-22T23:27:52.157022] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:52.192785] [DEBUG] [LOCAL ] BAK: Loaded 39419 existing records from primary storage. [2025-10-22T23:27:52.192965] [INFO ] [MAIN ] BAK: Loaded 39419 primary data records. [2025-10-22T23:27:52.529304] [DEBUG] [MAIN ] BAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:52.554931] [INFO ] [MAIN ] BAK: Generated 138 derivative records from 39419 primary records. [2025-10-22T23:27:52.555063] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-22T23:27:52.566616] [DEBUG] [LOCAL ] BAK: Derivative data saved (138 records). [2025-10-22T23:27:52.566715] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-22T23:27:52.569488] [INFO ] [MAIN ] Derivative Progress: 162/2052 symbols. BAK took 0.4s. Estimated remaining time: 12m 30s [2025-10-22T23:27:52.569589] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:52.617905] [DEBUG] [LOCAL ] BALL: Loaded 51932 existing records from primary storage. [2025-10-22T23:27:52.618107] [INFO ] [MAIN ] BALL: Loaded 51932 primary data records. [2025-10-22T23:27:52.927743] [DEBUG] [MAIN ] BALL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:52.953418] [INFO ] [MAIN ] BALL: Generated 138 derivative records from 51932 primary records. [2025-10-22T23:27:52.953546] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-22T23:27:52.965197] [DEBUG] [LOCAL ] BALL: Derivative data saved (138 records). [2025-10-22T23:27:52.965281] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-22T23:27:52.968202] [INFO ] [MAIN ] Derivative Progress: 163/2052 symbols. BALL took 0.4s. Estimated remaining time: 12m 29s [2025-10-22T23:27:52.968304] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:53.016115] [DEBUG] [LOCAL ] BAM: Loaded 52081 existing records from primary storage. [2025-10-22T23:27:53.016295] [INFO ] [MAIN ] BAM: Loaded 52081 primary data records. [2025-10-22T23:27:53.331725] [DEBUG] [MAIN ] BAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:53.357076] [INFO ] [MAIN ] BAM: Generated 138 derivative records from 52081 primary records. [2025-10-22T23:27:53.357205] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-22T23:27:53.368604] [DEBUG] [LOCAL ] BAM: Derivative data saved (138 records). [2025-10-22T23:27:53.368704] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-10-22T23:27:53.371529] [INFO ] [MAIN ] Derivative Progress: 164/2052 symbols. BAM took 0.4s. Estimated remaining time: 12m 29s [2025-10-22T23:27:53.371633] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:53.420591] [DEBUG] [LOCAL ] BANC: Loaded 51385 existing records from primary storage. [2025-10-22T23:27:53.420774] [INFO ] [MAIN ] BANC: Loaded 51385 primary data records. [2025-10-22T23:27:53.735501] [DEBUG] [MAIN ] BANC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:53.761954] [INFO ] [MAIN ] BANC: Generated 138 derivative records from 51385 primary records. [2025-10-22T23:27:53.762094] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-22T23:27:53.773802] [DEBUG] [LOCAL ] BANC: Derivative data saved (138 records). [2025-10-22T23:27:53.773885] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-10-22T23:27:53.776843] [INFO ] [MAIN ] Derivative Progress: 165/2052 symbols. BANC took 0.4s. Estimated remaining time: 12m 29s [2025-10-22T23:27:53.776943] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:53.802234] [DEBUG] [LOCAL ] BAP: Loaded 25563 existing records from primary storage. [2025-10-22T23:27:53.802378] [INFO ] [MAIN ] BAP: Loaded 25563 primary data records. [2025-10-22T23:27:54.116612] [DEBUG] [MAIN ] BAP: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:27:54.143347] [INFO ] [MAIN ] BAP: Generated 138 derivative records from 25563 primary records. [2025-10-22T23:27:54.143539] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-22T23:27:54.155315] [DEBUG] [LOCAL ] BAP: Derivative data saved (138 records). [2025-10-22T23:27:54.155401] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-22T23:27:54.158111] [INFO ] [MAIN ] Derivative Progress: 166/2052 symbols. BAP took 0.4s. Estimated remaining time: 12m 28s [2025-10-22T23:27:54.158224] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:54.193577] [DEBUG] [LOCAL ] BARK: Loaded 38227 existing records from primary storage. [2025-10-22T23:27:54.193772] [INFO ] [MAIN ] BARK: Loaded 38227 primary data records. [2025-10-22T23:27:54.553620] [DEBUG] [MAIN ] BARK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:54.582009] [INFO ] [MAIN ] BARK: Generated 138 derivative records from 38227 primary records. [2025-10-22T23:27:54.582180] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-22T23:27:54.594833] [DEBUG] [LOCAL ] BARK: Derivative data saved (138 records). [2025-10-22T23:27:54.594932] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-22T23:27:54.597733] [INFO ] [MAIN ] Derivative Progress: 167/2052 symbols. BARK took 0.4s. Estimated remaining time: 12m 28s [2025-10-22T23:27:54.597845] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:54.650557] [DEBUG] [LOCAL ] BAX: Loaded 53537 existing records from primary storage. [2025-10-22T23:27:54.650751] [INFO ] [MAIN ] BAX: Loaded 53537 primary data records. [2025-10-22T23:27:54.979164] [DEBUG] [MAIN ] BAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:55.004975] [INFO ] [MAIN ] BAX: Generated 138 derivative records from 53537 primary records. [2025-10-22T23:27:55.005123] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-22T23:27:55.017031] [DEBUG] [LOCAL ] BAX: Derivative data saved (138 records). [2025-10-22T23:27:55.017111] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-10-22T23:27:55.019861] [INFO ] [MAIN ] Derivative Progress: 168/2052 symbols. BAX took 0.4s. Estimated remaining time: 12m 28s [2025-10-22T23:27:55.019959] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:55.069236] [DEBUG] [LOCAL ] BB: Loaded 52882 existing records from primary storage. [2025-10-22T23:27:55.069405] [INFO ] [MAIN ] BB: Loaded 52882 primary data records. [2025-10-22T23:27:55.373762] [DEBUG] [MAIN ] BB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:55.399054] [INFO ] [MAIN ] BB: Generated 138 derivative records from 52882 primary records. [2025-10-22T23:27:55.399208] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-22T23:27:55.410736] [DEBUG] [LOCAL ] BB: Derivative data saved (138 records). [2025-10-22T23:27:55.410833] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-22T23:27:55.413682] [INFO ] [MAIN ] Derivative Progress: 169/2052 symbols. BB took 0.4s. Estimated remaining time: 12m 28s [2025-10-22T23:27:55.413778] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:55.462678] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-22T23:27:55.462838] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-10-22T23:27:55.767957] [DEBUG] [MAIN ] BBAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:55.793457] [INFO ] [MAIN ] BBAI: Generated 138 derivative records from 53820 primary records. [2025-10-22T23:27:55.793617] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-22T23:27:55.804968] [DEBUG] [LOCAL ] BBAI: Derivative data saved (138 records). [2025-10-22T23:27:55.805050] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-22T23:27:55.807862] [INFO ] [MAIN ] Derivative Progress: 170/2052 symbols. BBAI took 0.4s. Estimated remaining time: 12m 27s [2025-10-22T23:27:55.807957] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:55.846476] [DEBUG] [LOCAL ] BBAR: Loaded 42605 existing records from primary storage. [2025-10-22T23:27:55.846640] [INFO ] [MAIN ] BBAR: Loaded 42605 primary data records. [2025-10-22T23:27:56.184076] [DEBUG] [MAIN ] BBAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:56.209508] [INFO ] [MAIN ] BBAR: Generated 138 derivative records from 42605 primary records. [2025-10-22T23:27:56.209713] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-22T23:27:56.221283] [DEBUG] [LOCAL ] BBAR: Derivative data saved (138 records). [2025-10-22T23:27:56.221368] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-22T23:27:56.224013] [INFO ] [MAIN ] Derivative Progress: 171/2052 symbols. BBAR took 0.4s. Estimated remaining time: 12m 27s [2025-10-22T23:27:56.224107] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:56.253470] [DEBUG] [LOCAL ] BBDC: Loaded 32835 existing records from primary storage. [2025-10-22T23:27:56.253631] [INFO ] [MAIN ] BBDC: Loaded 32835 primary data records. [2025-10-22T23:27:56.588971] [DEBUG] [MAIN ] BBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:56.614679] [INFO ] [MAIN ] BBDC: Generated 138 derivative records from 32835 primary records. [2025-10-22T23:27:56.614784] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-22T23:27:56.626041] [DEBUG] [LOCAL ] BBDC: Derivative data saved (138 records). [2025-10-22T23:27:56.626119] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-10-22T23:27:56.628772] [INFO ] [MAIN ] Derivative Progress: 172/2052 symbols. BBDC took 0.4s. Estimated remaining time: 12m 27s [2025-10-22T23:27:56.628872] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:56.637122] [DEBUG] [LOCAL ] BBDO: Loaded 4953 existing records from primary storage. [2025-10-22T23:27:56.637240] [INFO ] [MAIN ] BBDO: Loaded 4953 primary data records. [2025-10-22T23:27:56.946006] [DEBUG] [MAIN ] BBDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:56.973730] [INFO ] [MAIN ] BBDO: Generated 138 derivative records from 4953 primary records. [2025-10-22T23:27:56.973894] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-10-22T23:27:56.983884] [DEBUG] [LOCAL ] BBDO: Derivative data saved (138 records). [2025-10-22T23:27:56.983986] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-10-22T23:27:56.986139] [INFO ] [MAIN ] Derivative Progress: 173/2052 symbols. BBDO took 0.4s. Estimated remaining time: 12m 26s [2025-10-22T23:27:56.986260] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:57.003732] [DEBUG] [LOCAL ] BBN: Loaded 17840 existing records from primary storage. [2025-10-22T23:27:57.003877] [INFO ] [MAIN ] BBN: Loaded 17840 primary data records. [2025-10-22T23:27:57.308875] [DEBUG] [MAIN ] BBN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:57.334453] [INFO ] [MAIN ] BBN: Generated 138 derivative records from 17840 primary records. [2025-10-22T23:27:57.334608] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-10-22T23:27:57.346121] [DEBUG] [LOCAL ] BBN: Derivative data saved (138 records). [2025-10-22T23:27:57.346202] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-10-22T23:27:57.348817] [INFO ] [MAIN ] Derivative Progress: 174/2052 symbols. BBN took 0.4s. Estimated remaining time: 12m 25s [2025-10-22T23:27:57.348931] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:57.358297] [DEBUG] [LOCAL ] BBU: Loaded 5773 existing records from primary storage. [2025-10-22T23:27:57.358443] [INFO ] [MAIN ] BBU: Loaded 5773 primary data records. [2025-10-22T23:27:57.664149] [DEBUG] [MAIN ] BBU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:57.689494] [INFO ] [MAIN ] BBU: Generated 138 derivative records from 5773 primary records. [2025-10-22T23:27:57.689678] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-10-22T23:27:57.700121] [DEBUG] [LOCAL ] BBU: Derivative data saved (138 records). [2025-10-22T23:27:57.700201] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-10-22T23:27:57.702336] [INFO ] [MAIN ] Derivative Progress: 175/2052 symbols. BBU took 0.4s. Estimated remaining time: 12m 24s [2025-10-22T23:27:57.702434] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:57.716231] [DEBUG] [LOCAL ] BBUC: Loaded 13946 existing records from primary storage. [2025-10-22T23:27:57.716360] [INFO ] [MAIN ] BBUC: Loaded 13946 primary data records. [2025-10-22T23:27:58.037887] [DEBUG] [MAIN ] BBUC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:58.063105] [INFO ] [MAIN ] BBUC: Generated 138 derivative records from 13946 primary records. [2025-10-22T23:27:58.063237] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-10-22T23:27:58.075289] [DEBUG] [LOCAL ] BBUC: Derivative data saved (138 records). [2025-10-22T23:27:58.075381] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-10-22T23:27:58.077677] [INFO ] [MAIN ] Derivative Progress: 176/2052 symbols. BBUC took 0.4s. Estimated remaining time: 12m 24s [2025-10-22T23:27:58.077785] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:58.124996] [DEBUG] [LOCAL ] BBVA: Loaded 49107 existing records from primary storage. [2025-10-22T23:27:58.125169] [INFO ] [MAIN ] BBVA: Loaded 49107 primary data records. [2025-10-22T23:27:58.457746] [DEBUG] [MAIN ] BBVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:58.483273] [INFO ] [MAIN ] BBVA: Generated 138 derivative records from 49107 primary records. [2025-10-22T23:27:58.483401] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-22T23:27:58.495064] [DEBUG] [LOCAL ] BBVA: Derivative data saved (138 records). [2025-10-22T23:27:58.495151] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-10-22T23:27:58.497822] [INFO ] [MAIN ] Derivative Progress: 177/2052 symbols. BBVA took 0.4s. Estimated remaining time: 12m 23s [2025-10-22T23:27:58.497933] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:58.523415] [DEBUG] [LOCAL ] BBW: Loaded 27233 existing records from primary storage. [2025-10-22T23:27:58.523562] [INFO ] [MAIN ] BBW: Loaded 27233 primary data records. [2025-10-22T23:27:58.830634] [DEBUG] [MAIN ] BBW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:58.856336] [INFO ] [MAIN ] BBW: Generated 138 derivative records from 27233 primary records. [2025-10-22T23:27:58.856478] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-22T23:27:58.867905] [DEBUG] [LOCAL ] BBW: Derivative data saved (138 records). [2025-10-22T23:27:58.867989] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-10-22T23:27:58.870874] [INFO ] [MAIN ] Derivative Progress: 178/2052 symbols. BBW took 0.4s. Estimated remaining time: 12m 23s [2025-10-22T23:27:58.870979] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:58.920123] [DEBUG] [LOCAL ] BBWI: Loaded 53591 existing records from primary storage. [2025-10-22T23:27:58.920282] [INFO ] [MAIN ] BBWI: Loaded 53591 primary data records. [2025-10-22T23:27:59.229800] [DEBUG] [MAIN ] BBWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:59.255230] [INFO ] [MAIN ] BBWI: Generated 138 derivative records from 53591 primary records. [2025-10-22T23:27:59.255349] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-22T23:27:59.267039] [DEBUG] [LOCAL ] BBWI: Derivative data saved (138 records). [2025-10-22T23:27:59.267122] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-22T23:27:59.270058] [INFO ] [MAIN ] Derivative Progress: 179/2052 symbols. BBWI took 0.4s. Estimated remaining time: 12m 22s [2025-10-22T23:27:59.270154] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:59.319094] [DEBUG] [LOCAL ] BBY: Loaded 53437 existing records from primary storage. [2025-10-22T23:27:59.319261] [INFO ] [MAIN ] BBY: Loaded 53437 primary data records. [2025-10-22T23:27:59.624080] [DEBUG] [MAIN ] BBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:27:59.649805] [INFO ] [MAIN ] BBY: Generated 138 derivative records from 53437 primary records. [2025-10-22T23:27:59.650048] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-10-22T23:27:59.661540] [DEBUG] [LOCAL ] BBY: Derivative data saved (138 records). [2025-10-22T23:27:59.661634] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-10-22T23:27:59.664639] [INFO ] [MAIN ] Derivative Progress: 180/2052 symbols. BBY took 0.4s. Estimated remaining time: 12m 22s [2025-10-22T23:27:59.664937] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:27:59.703874] [DEBUG] [LOCAL ] BC: Loaded 43892 existing records from primary storage. [2025-10-22T23:27:59.704041] [INFO ] [MAIN ] BC: Loaded 43892 primary data records. [2025-10-22T23:28:00.011185] [DEBUG] [MAIN ] BC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:00.037431] [INFO ] [MAIN ] BC: Generated 138 derivative records from 43892 primary records. [2025-10-22T23:28:00.037570] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-22T23:28:00.049271] [DEBUG] [LOCAL ] BC: Derivative data saved (138 records). [2025-10-22T23:28:00.049352] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-10-22T23:28:00.052179] [INFO ] [MAIN ] Derivative Progress: 181/2052 symbols. BC took 0.4s. Estimated remaining time: 12m 21s [2025-10-22T23:28:00.052279] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:00.084909] [DEBUG] [LOCAL ] BCAT: Loaded 34203 existing records from primary storage. [2025-10-22T23:28:00.085071] [INFO ] [MAIN ] BCAT: Loaded 34203 primary data records. [2025-10-22T23:28:00.423208] [DEBUG] [MAIN ] BCAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:00.452544] [INFO ] [MAIN ] BCAT: Generated 138 derivative records from 34203 primary records. [2025-10-22T23:28:00.452724] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-22T23:28:00.464824] [DEBUG] [LOCAL ] BCAT: Derivative data saved (138 records). [2025-10-22T23:28:00.464908] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-10-22T23:28:00.467775] [INFO ] [MAIN ] Derivative Progress: 182/2052 symbols. BCAT took 0.4s. Estimated remaining time: 12m 21s [2025-10-22T23:28:00.467887] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:00.495056] [DEBUG] [LOCAL ] BCC: Loaded 28624 existing records from primary storage. [2025-10-22T23:28:00.495211] [INFO ] [MAIN ] BCC: Loaded 28624 primary data records. [2025-10-22T23:28:00.824161] [DEBUG] [MAIN ] BCC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:28:00.849666] [INFO ] [MAIN ] BCC: Generated 138 derivative records from 28624 primary records. [2025-10-22T23:28:00.849799] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-10-22T23:28:00.861106] [DEBUG] [LOCAL ] BCC: Derivative data saved (138 records). [2025-10-22T23:28:00.861187] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-10-22T23:28:00.864033] [INFO ] [MAIN ] Derivative Progress: 183/2052 symbols. BCC took 0.4s. Estimated remaining time: 12m 21s [2025-10-22T23:28:00.864136] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:00.912589] [DEBUG] [LOCAL ] BCE: Loaded 52266 existing records from primary storage. [2025-10-22T23:28:00.912927] [INFO ] [MAIN ] BCE: Loaded 52266 primary data records. [2025-10-22T23:28:01.218337] [DEBUG] [MAIN ] BCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:01.243393] [INFO ] [MAIN ] BCE: Generated 138 derivative records from 52266 primary records. [2025-10-22T23:28:01.243524] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-22T23:28:01.255455] [DEBUG] [LOCAL ] BCE: Derivative data saved (138 records). [2025-10-22T23:28:01.255551] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-10-22T23:28:01.258605] [INFO ] [MAIN ] Derivative Progress: 184/2052 symbols. BCE took 0.4s. Estimated remaining time: 12m 20s [2025-10-22T23:28:01.258737] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:01.286418] [DEBUG] [LOCAL ] BCH: Loaded 30088 existing records from primary storage. [2025-10-22T23:28:01.286567] [INFO ] [MAIN ] BCH: Loaded 30088 primary data records. [2025-10-22T23:28:01.598416] [DEBUG] [MAIN ] BCH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:01.623712] [INFO ] [MAIN ] BCH: Generated 138 derivative records from 30088 primary records. [2025-10-22T23:28:01.623841] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-10-22T23:28:01.635268] [DEBUG] [LOCAL ] BCH: Derivative data saved (138 records). [2025-10-22T23:28:01.635347] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-10-22T23:28:01.638153] [INFO ] [MAIN ] Derivative Progress: 185/2052 symbols. BCH took 0.4s. Estimated remaining time: 12m 20s [2025-10-22T23:28:01.638251] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:01.662509] [DEBUG] [LOCAL ] BCO: Loaded 24959 existing records from primary storage. [2025-10-22T23:28:01.662699] [INFO ] [MAIN ] BCO: Loaded 24959 primary data records. [2025-10-22T23:28:01.973928] [DEBUG] [MAIN ] BCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:01.999245] [INFO ] [MAIN ] BCO: Generated 138 derivative records from 24959 primary records. [2025-10-22T23:28:01.999364] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-22T23:28:02.010776] [DEBUG] [LOCAL ] BCO: Derivative data saved (138 records). [2025-10-22T23:28:02.010863] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-10-22T23:28:02.013631] [INFO ] [MAIN ] Derivative Progress: 186/2052 symbols. BCO took 0.4s. Estimated remaining time: 12m 19s [2025-10-22T23:28:02.013778] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:02.065155] [DEBUG] [LOCAL ] BCS: Loaded 53441 existing records from primary storage. [2025-10-22T23:28:02.065335] [INFO ] [MAIN ] BCS: Loaded 53441 primary data records. [2025-10-22T23:28:02.371602] [DEBUG] [MAIN ] BCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:02.397139] [INFO ] [MAIN ] BCS: Generated 138 derivative records from 53441 primary records. [2025-10-22T23:28:02.397356] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-10-22T23:28:02.409343] [DEBUG] [LOCAL ] BCS: Derivative data saved (138 records). [2025-10-22T23:28:02.409466] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-10-22T23:28:02.412604] [INFO ] [MAIN ] Derivative Progress: 187/2052 symbols. BCS took 0.4s. Estimated remaining time: 12m 19s [2025-10-22T23:28:02.412738] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:02.440418] [DEBUG] [LOCAL ] BCSF: Loaded 28115 existing records from primary storage. [2025-10-22T23:28:02.440580] [INFO ] [MAIN ] BCSF: Loaded 28115 primary data records. [2025-10-22T23:28:02.775621] [DEBUG] [MAIN ] BCSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:02.801473] [INFO ] [MAIN ] BCSF: Generated 138 derivative records from 28115 primary records. [2025-10-22T23:28:02.801619] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-22T23:28:02.813547] [DEBUG] [LOCAL ] BCSF: Derivative data saved (138 records). [2025-10-22T23:28:02.813626] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-22T23:28:02.816593] [INFO ] [MAIN ] Derivative Progress: 188/2052 symbols. BCSF took 0.4s. Estimated remaining time: 12m 19s [2025-10-22T23:28:02.816714] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:02.838237] [DEBUG] [LOCAL ] BCX: Loaded 22044 existing records from primary storage. [2025-10-22T23:28:02.838383] [INFO ] [MAIN ] BCX: Loaded 22044 primary data records. [2025-10-22T23:28:03.149664] [DEBUG] [MAIN ] BCX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:03.175475] [INFO ] [MAIN ] BCX: Generated 138 derivative records from 22044 primary records. [2025-10-22T23:28:03.175615] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-10-22T23:28:03.187194] [DEBUG] [LOCAL ] BCX: Derivative data saved (138 records). [2025-10-22T23:28:03.187308] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-10-22T23:28:03.190081] [INFO ] [MAIN ] Derivative Progress: 189/2052 symbols. BCX took 0.4s. Estimated remaining time: 12m 18s [2025-10-22T23:28:03.190202] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:03.214270] [DEBUG] [LOCAL ] BDC: Loaded 24000 existing records from primary storage. [2025-10-22T23:28:03.214428] [INFO ] [MAIN ] BDC: Loaded 24000 primary data records. [2025-10-22T23:28:03.524783] [DEBUG] [MAIN ] BDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:03.550055] [INFO ] [MAIN ] BDC: Generated 138 derivative records from 24000 primary records. [2025-10-22T23:28:03.550180] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-22T23:28:03.561849] [DEBUG] [LOCAL ] BDC: Derivative data saved (138 records). [2025-10-22T23:28:03.561928] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-10-22T23:28:03.564572] [INFO ] [MAIN ] Derivative Progress: 190/2052 symbols. BDC took 0.4s. Estimated remaining time: 12m 17s [2025-10-22T23:28:03.564708] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:03.594167] [DEBUG] [LOCAL ] BDJ: Loaded 29333 existing records from primary storage. [2025-10-22T23:28:03.594359] [INFO ] [MAIN ] BDJ: Loaded 29333 primary data records. [2025-10-22T23:28:03.906899] [DEBUG] [MAIN ] BDJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:03.932432] [INFO ] [MAIN ] BDJ: Generated 138 derivative records from 29333 primary records. [2025-10-22T23:28:03.932565] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-22T23:28:03.943761] [DEBUG] [LOCAL ] BDJ: Derivative data saved (138 records). [2025-10-22T23:28:03.943842] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-22T23:28:03.946701] [INFO ] [MAIN ] Derivative Progress: 191/2052 symbols. BDJ took 0.4s. Estimated remaining time: 12m 17s [2025-10-22T23:28:03.946800] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:03.996895] [DEBUG] [LOCAL ] BDX: Loaded 52141 existing records from primary storage. [2025-10-22T23:28:03.997055] [INFO ] [MAIN ] BDX: Loaded 52141 primary data records. [2025-10-22T23:28:04.308356] [DEBUG] [MAIN ] BDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:04.333613] [INFO ] [MAIN ] BDX: Generated 138 derivative records from 52141 primary records. [2025-10-22T23:28:04.333759] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-22T23:28:04.345712] [DEBUG] [LOCAL ] BDX: Derivative data saved (138 records). [2025-10-22T23:28:04.345794] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-22T23:28:04.348901] [INFO ] [MAIN ] Derivative Progress: 192/2052 symbols. BDX took 0.4s. Estimated remaining time: 12m 17s [2025-10-22T23:28:04.349003] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:04.399543] [DEBUG] [LOCAL ] BE: Loaded 53661 existing records from primary storage. [2025-10-22T23:28:04.399732] [INFO ] [MAIN ] BE: Loaded 53661 primary data records. [2025-10-22T23:28:04.737295] [DEBUG] [MAIN ] BE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:04.762767] [INFO ] [MAIN ] BE: Generated 138 derivative records from 53661 primary records. [2025-10-22T23:28:04.762904] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-10-22T23:28:04.774579] [DEBUG] [LOCAL ] BE: Derivative data saved (138 records). [2025-10-22T23:28:04.774683] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-10-22T23:28:04.778393] [INFO ] [MAIN ] Derivative Progress: 193/2052 symbols. BE took 0.4s. Estimated remaining time: 12m 16s [2025-10-22T23:28:04.778494] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:04.829140] [DEBUG] [LOCAL ] BEKE: Loaded 53197 existing records from primary storage. [2025-10-22T23:28:04.829308] [INFO ] [MAIN ] BEKE: Loaded 53197 primary data records. [2025-10-22T23:28:05.149233] [DEBUG] [MAIN ] BEKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:05.175226] [INFO ] [MAIN ] BEKE: Generated 138 derivative records from 53197 primary records. [2025-10-22T23:28:05.175384] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-22T23:28:05.187591] [DEBUG] [LOCAL ] BEKE: Derivative data saved (138 records). [2025-10-22T23:28:05.187695] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-22T23:28:05.190761] [INFO ] [MAIN ] Derivative Progress: 194/2052 symbols. BEKE took 0.4s. Estimated remaining time: 12m 16s [2025-10-22T23:28:05.190865] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:05.240849] [DEBUG] [LOCAL ] BEN: Loaded 53114 existing records from primary storage. [2025-10-22T23:28:05.241019] [INFO ] [MAIN ] BEN: Loaded 53114 primary data records. [2025-10-22T23:28:05.548349] [DEBUG] [MAIN ] BEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:05.573960] [INFO ] [MAIN ] BEN: Generated 138 derivative records from 53114 primary records. [2025-10-22T23:28:05.574111] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-22T23:28:05.586030] [DEBUG] [LOCAL ] BEN: Derivative data saved (138 records). [2025-10-22T23:28:05.586113] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-22T23:28:05.589081] [INFO ] [MAIN ] Derivative Progress: 195/2052 symbols. BEN took 0.4s. Estimated remaining time: 12m 16s [2025-10-22T23:28:05.589179] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:05.623572] [DEBUG] [LOCAL ] BEP: Loaded 38937 existing records from primary storage. [2025-10-22T23:28:05.623760] [INFO ] [MAIN ] BEP: Loaded 38937 primary data records. [2025-10-22T23:28:05.931484] [DEBUG] [MAIN ] BEP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:05.956530] [INFO ] [MAIN ] BEP: Generated 138 derivative records from 38937 primary records. [2025-10-22T23:28:05.956685] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-22T23:28:05.968311] [DEBUG] [LOCAL ] BEP: Derivative data saved (138 records). [2025-10-22T23:28:05.968399] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-10-22T23:28:05.971284] [INFO ] [MAIN ] Derivative Progress: 196/2052 symbols. BEP took 0.4s. Estimated remaining time: 12m 15s [2025-10-22T23:28:05.971406] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:06.012730] [DEBUG] [LOCAL ] BEPC: Loaded 46357 existing records from primary storage. [2025-10-22T23:28:06.012908] [INFO ] [MAIN ] BEPC: Loaded 46357 primary data records. [2025-10-22T23:28:06.328491] [DEBUG] [MAIN ] BEPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:06.354711] [INFO ] [MAIN ] BEPC: Generated 138 derivative records from 46357 primary records. [2025-10-22T23:28:06.354883] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-10-22T23:28:06.366837] [DEBUG] [LOCAL ] BEPC: Derivative data saved (138 records). [2025-10-22T23:28:06.366962] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-10-22T23:28:06.369981] [INFO ] [MAIN ] Derivative Progress: 197/2052 symbols. BEPC took 0.4s. Estimated remaining time: 12m 15s [2025-10-22T23:28:06.370086] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:06.377591] [DEBUG] [LOCAL ] BEPI: Loaded 3563 existing records from primary storage. [2025-10-22T23:28:06.377727] [INFO ] [MAIN ] BEPI: Loaded 3563 primary data records. [2025-10-22T23:28:06.693079] [DEBUG] [MAIN ] BEPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:06.719043] [INFO ] [MAIN ] BEPI: Generated 138 derivative records from 3563 primary records. [2025-10-22T23:28:06.719215] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-22T23:28:06.729805] [DEBUG] [LOCAL ] BEPI: Derivative data saved (138 records). [2025-10-22T23:28:06.729889] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-22T23:28:06.732097] [INFO ] [MAIN ] Derivative Progress: 198/2052 symbols. BEPI took 0.4s. Estimated remaining time: 12m 14s [2025-10-22T23:28:06.732197] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:06.736815] [DEBUG] [LOCAL ] BEPJ: Loaded 3041 existing records from primary storage. [2025-10-22T23:28:06.736907] [INFO ] [MAIN ] BEPJ: Loaded 3041 primary data records. [2025-10-22T23:28:07.072491] [DEBUG] [MAIN ] BEPJ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:28:07.099078] [INFO ] [MAIN ] BEPJ: Generated 138 derivative records from 3041 primary records. [2025-10-22T23:28:07.099240] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-22T23:28:07.109208] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (138 records). [2025-10-22T23:28:07.109298] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-10-22T23:28:07.111618] [INFO ] [MAIN ] Derivative Progress: 199/2052 symbols. BEPJ took 0.4s. Estimated remaining time: 12m 14s [2025-10-22T23:28:07.111788] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:07.147119] [DEBUG] [LOCAL ] BFAM: Loaded 33784 existing records from primary storage. [2025-10-22T23:28:07.147304] [INFO ] [MAIN ] BFAM: Loaded 33784 primary data records. [2025-10-22T23:28:07.463230] [DEBUG] [MAIN ] BFAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:07.489701] [INFO ] [MAIN ] BFAM: Generated 138 derivative records from 33784 primary records. [2025-10-22T23:28:07.489880] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-22T23:28:07.501920] [DEBUG] [LOCAL ] BFAM: Derivative data saved (138 records). [2025-10-22T23:28:07.502004] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-10-22T23:28:07.504855] [INFO ] [MAIN ] Derivative Progress: 200/2052 symbols. BFAM took 0.4s. Estimated remaining time: 12m 13s [2025-10-22T23:28:07.504953] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:07.520615] [DEBUG] [LOCAL ] BFK: Loaded 13872 existing records from primary storage. [2025-10-22T23:28:07.520780] [INFO ] [MAIN ] BFK: Loaded 13872 primary data records. [2025-10-22T23:28:07.825698] [DEBUG] [MAIN ] BFK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:07.850969] [INFO ] [MAIN ] BFK: Generated 138 derivative records from 13872 primary records. [2025-10-22T23:28:07.851075] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-10-22T23:28:07.862572] [DEBUG] [LOCAL ] BFK: Derivative data saved (138 records). [2025-10-22T23:28:07.862675] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-10-22T23:28:07.864912] [INFO ] [MAIN ] Derivative Progress: 201/2052 symbols. BFK took 0.4s. Estimated remaining time: 12m 12s [2025-10-22T23:28:07.865016] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:07.913309] [DEBUG] [LOCAL ] BFLY: Loaded 51865 existing records from primary storage. [2025-10-22T23:28:07.913468] [INFO ] [MAIN ] BFLY: Loaded 51865 primary data records. [2025-10-22T23:28:08.219352] [DEBUG] [MAIN ] BFLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:08.244709] [INFO ] [MAIN ] BFLY: Generated 138 derivative records from 51865 primary records. [2025-10-22T23:28:08.244860] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-22T23:28:08.256133] [DEBUG] [LOCAL ] BFLY: Derivative data saved (138 records). [2025-10-22T23:28:08.256213] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-10-22T23:28:08.259363] [INFO ] [MAIN ] Derivative Progress: 202/2052 symbols. BFLY took 0.4s. Estimated remaining time: 12m 12s [2025-10-22T23:28:08.259461] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:08.271529] [DEBUG] [LOCAL ] BFS: Loaded 9560 existing records from primary storage. [2025-10-22T23:28:08.271694] [INFO ] [MAIN ] BFS: Loaded 9560 primary data records. [2025-10-22T23:28:08.601175] [DEBUG] [MAIN ] BFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:08.628413] [INFO ] [MAIN ] BFS: Generated 138 derivative records from 9560 primary records. [2025-10-22T23:28:08.628623] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-10-22T23:28:08.640230] [DEBUG] [LOCAL ] BFS: Derivative data saved (138 records). [2025-10-22T23:28:08.640328] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-10-22T23:28:08.642726] [INFO ] [MAIN ] Derivative Progress: 203/2052 symbols. BFS took 0.4s. Estimated remaining time: 12m 12s [2025-10-22T23:28:08.642833] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:08.655809] [DEBUG] [LOCAL ] BFZ: Loaded 12049 existing records from primary storage. [2025-10-22T23:28:08.655976] [INFO ] [MAIN ] BFZ: Loaded 12049 primary data records. [2025-10-22T23:28:08.983929] [DEBUG] [MAIN ] BFZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:09.009581] [INFO ] [MAIN ] BFZ: Generated 138 derivative records from 12049 primary records. [2025-10-22T23:28:09.009779] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-10-22T23:28:09.021420] [DEBUG] [LOCAL ] BFZ: Derivative data saved (138 records). [2025-10-22T23:28:09.021503] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-10-22T23:28:09.023865] [INFO ] [MAIN ] Derivative Progress: 204/2052 symbols. BFZ took 0.4s. Estimated remaining time: 12m 11s [2025-10-22T23:28:09.023963] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:09.070182] [DEBUG] [LOCAL ] BG: Loaded 50547 existing records from primary storage. [2025-10-22T23:28:09.070346] [INFO ] [MAIN ] BG: Loaded 50547 primary data records. [2025-10-22T23:28:09.375330] [DEBUG] [MAIN ] BG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:09.401976] [INFO ] [MAIN ] BG: Generated 138 derivative records from 50547 primary records. [2025-10-22T23:28:09.402114] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-22T23:28:09.413664] [DEBUG] [LOCAL ] BG: Derivative data saved (138 records). [2025-10-22T23:28:09.413754] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-10-22T23:28:09.416837] [INFO ] [MAIN ] Derivative Progress: 205/2052 symbols. BG took 0.4s. Estimated remaining time: 12m 11s [2025-10-22T23:28:09.416967] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:09.436024] [DEBUG] [LOCAL ] BGB: Loaded 17618 existing records from primary storage. [2025-10-22T23:28:09.436184] [INFO ] [MAIN ] BGB: Loaded 17618 primary data records. [2025-10-22T23:28:09.743617] [DEBUG] [MAIN ] BGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:09.769264] [INFO ] [MAIN ] BGB: Generated 138 derivative records from 17618 primary records. [2025-10-22T23:28:09.769439] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-22T23:28:09.780842] [DEBUG] [LOCAL ] BGB: Derivative data saved (138 records). [2025-10-22T23:28:09.780924] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-10-22T23:28:09.783489] [INFO ] [MAIN ] Derivative Progress: 206/2052 symbols. BGB took 0.4s. Estimated remaining time: 12m 10s [2025-10-22T23:28:09.783588] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:09.802003] [DEBUG] [LOCAL ] BGH: Loaded 17133 existing records from primary storage. [2025-10-22T23:28:09.802142] [INFO ] [MAIN ] BGH: Loaded 17133 primary data records. [2025-10-22T23:28:10.106211] [DEBUG] [MAIN ] BGH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:10.132020] [INFO ] [MAIN ] BGH: Generated 138 derivative records from 17133 primary records. [2025-10-22T23:28:10.132203] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-10-22T23:28:10.143686] [DEBUG] [LOCAL ] BGH: Derivative data saved (138 records). [2025-10-22T23:28:10.143784] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-10-22T23:28:10.146464] [INFO ] [MAIN ] Derivative Progress: 207/2052 symbols. BGH took 0.4s. Estimated remaining time: 12m 9s [2025-10-22T23:28:10.146566] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:10.161943] [DEBUG] [LOCAL ] BGR: Loaded 13405 existing records from primary storage. [2025-10-22T23:28:10.162082] [INFO ] [MAIN ] BGR: Loaded 13405 primary data records. [2025-10-22T23:28:10.465285] [DEBUG] [MAIN ] BGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:10.490809] [INFO ] [MAIN ] BGR: Generated 138 derivative records from 13405 primary records. [2025-10-22T23:28:10.490925] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-22T23:28:10.502778] [DEBUG] [LOCAL ] BGR: Derivative data saved (138 records). [2025-10-22T23:28:10.502861] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-10-22T23:28:10.505082] [INFO ] [MAIN ] Derivative Progress: 208/2052 symbols. BGR took 0.4s. Estimated remaining time: 12m 9s [2025-10-22T23:28:10.505177] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:10.550734] [DEBUG] [LOCAL ] BGS: Loaded 50530 existing records from primary storage. [2025-10-22T23:28:10.550894] [INFO ] [MAIN ] BGS: Loaded 50530 primary data records. [2025-10-22T23:28:10.884748] [DEBUG] [MAIN ] BGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:10.910198] [INFO ] [MAIN ] BGS: Generated 138 derivative records from 50530 primary records. [2025-10-22T23:28:10.910327] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-22T23:28:10.921394] [DEBUG] [LOCAL ] BGS: Derivative data saved (138 records). [2025-10-22T23:28:10.921477] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-22T23:28:10.924527] [INFO ] [MAIN ] Derivative Progress: 209/2052 symbols. BGS took 0.4s. Estimated remaining time: 12m 8s [2025-10-22T23:28:10.924627] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:10.935520] [DEBUG] [LOCAL ] BGSF: Loaded 8227 existing records from primary storage. [2025-10-22T23:28:10.935678] [INFO ] [MAIN ] BGSF: Loaded 8227 primary data records. [2025-10-22T23:28:11.239735] [DEBUG] [MAIN ] BGSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:11.264922] [INFO ] [MAIN ] BGSF: Generated 138 derivative records from 8227 primary records. [2025-10-22T23:28:11.265039] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-10-22T23:28:11.275331] [DEBUG] [LOCAL ] BGSF: Derivative data saved (138 records). [2025-10-22T23:28:11.275412] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-10-22T23:28:11.277559] [INFO ] [MAIN ] Derivative Progress: 210/2052 symbols. BGSF took 0.4s. Estimated remaining time: 12m 8s [2025-10-22T23:28:11.277688] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:11.295206] [DEBUG] [LOCAL ] BGT: Loaded 16184 existing records from primary storage. [2025-10-22T23:28:11.295335] [INFO ] [MAIN ] BGT: Loaded 16184 primary data records. [2025-10-22T23:28:11.599414] [DEBUG] [MAIN ] BGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:11.624438] [INFO ] [MAIN ] BGT: Generated 138 derivative records from 16184 primary records. [2025-10-22T23:28:11.624567] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-22T23:28:11.635940] [DEBUG] [LOCAL ] BGT: Derivative data saved (138 records). [2025-10-22T23:28:11.636022] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-22T23:28:11.638812] [INFO ] [MAIN ] Derivative Progress: 211/2052 symbols. BGT took 0.4s. Estimated remaining time: 12m 7s [2025-10-22T23:28:11.638913] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:11.652510] [DEBUG] [LOCAL ] BGX: Loaded 11188 existing records from primary storage. [2025-10-22T23:28:11.652662] [INFO ] [MAIN ] BGX: Loaded 11188 primary data records. [2025-10-22T23:28:11.957818] [DEBUG] [MAIN ] BGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:11.983271] [INFO ] [MAIN ] BGX: Generated 138 derivative records from 11188 primary records. [2025-10-22T23:28:11.983421] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-22T23:28:11.995080] [DEBUG] [LOCAL ] BGX: Derivative data saved (138 records). [2025-10-22T23:28:11.995175] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-22T23:28:12.000495] [INFO ] [MAIN ] Derivative Progress: 212/2052 symbols. BGX took 0.4s. Estimated remaining time: 12m 6s [2025-10-22T23:28:12.000631] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:12.021583] [DEBUG] [LOCAL ] BGY: Loaded 21389 existing records from primary storage. [2025-10-22T23:28:12.021763] [INFO ] [MAIN ] BGY: Loaded 21389 primary data records. [2025-10-22T23:28:12.327019] [DEBUG] [MAIN ] BGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:12.352356] [INFO ] [MAIN ] BGY: Generated 138 derivative records from 21389 primary records. [2025-10-22T23:28:12.352494] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-22T23:28:12.363411] [DEBUG] [LOCAL ] BGY: Derivative data saved (138 records). [2025-10-22T23:28:12.363490] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-22T23:28:12.366351] [INFO ] [MAIN ] Derivative Progress: 213/2052 symbols. BGY took 0.4s. Estimated remaining time: 12m 6s [2025-10-22T23:28:12.366455] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:12.408327] [DEBUG] [LOCAL ] BHC: Loaded 46589 existing records from primary storage. [2025-10-22T23:28:12.408496] [INFO ] [MAIN ] BHC: Loaded 46589 primary data records. [2025-10-22T23:28:12.744178] [DEBUG] [MAIN ] BHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:12.769616] [INFO ] [MAIN ] BHC: Generated 138 derivative records from 46589 primary records. [2025-10-22T23:28:12.769755] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-22T23:28:12.780623] [DEBUG] [LOCAL ] BHC: Derivative data saved (138 records). [2025-10-22T23:28:12.780722] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-22T23:28:12.783308] [INFO ] [MAIN ] Derivative Progress: 214/2052 symbols. BHC took 0.4s. Estimated remaining time: 12m 5s [2025-10-22T23:28:12.783436] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:12.805481] [DEBUG] [LOCAL ] BHE: Loaded 23698 existing records from primary storage. [2025-10-22T23:28:12.805624] [INFO ] [MAIN ] BHE: Loaded 23698 primary data records. [2025-10-22T23:28:13.111340] [DEBUG] [MAIN ] BHE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:13.136596] [INFO ] [MAIN ] BHE: Generated 138 derivative records from 23698 primary records. [2025-10-22T23:28:13.136731] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-22T23:28:13.147892] [DEBUG] [LOCAL ] BHE: Derivative data saved (138 records). [2025-10-22T23:28:13.147969] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-22T23:28:13.150737] [INFO ] [MAIN ] Derivative Progress: 215/2052 symbols. BHE took 0.4s. Estimated remaining time: 12m 5s [2025-10-22T23:28:13.150844] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:13.172881] [DEBUG] [LOCAL ] BHK: Loaded 23957 existing records from primary storage. [2025-10-22T23:28:13.173028] [INFO ] [MAIN ] BHK: Loaded 23957 primary data records. [2025-10-22T23:28:13.484145] [DEBUG] [MAIN ] BHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:13.510036] [INFO ] [MAIN ] BHK: Generated 138 derivative records from 23957 primary records. [2025-10-22T23:28:13.510160] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-10-22T23:28:13.521799] [DEBUG] [LOCAL ] BHK: Derivative data saved (138 records). [2025-10-22T23:28:13.521880] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-10-22T23:28:13.524727] [INFO ] [MAIN ] Derivative Progress: 216/2052 symbols. BHK took 0.4s. Estimated remaining time: 12m 4s [2025-10-22T23:28:13.524828] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:13.545880] [DEBUG] [LOCAL ] BHR: Loaded 21979 existing records from primary storage. [2025-10-22T23:28:13.546030] [INFO ] [MAIN ] BHR: Loaded 21979 primary data records. [2025-10-22T23:28:13.855817] [DEBUG] [MAIN ] BHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:13.881302] [INFO ] [MAIN ] BHR: Generated 138 derivative records from 21979 primary records. [2025-10-22T23:28:13.881458] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-10-22T23:28:13.892835] [DEBUG] [LOCAL ] BHR: Derivative data saved (138 records). [2025-10-22T23:28:13.892931] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-10-22T23:28:13.895799] [INFO ] [MAIN ] Derivative Progress: 217/2052 symbols. BHR took 0.4s. Estimated remaining time: 12m 4s [2025-10-22T23:28:13.895898] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:13.944932] [DEBUG] [LOCAL ] BHVN: Loaded 50633 existing records from primary storage. [2025-10-22T23:28:13.945103] [INFO ] [MAIN ] BHVN: Loaded 50633 primary data records. [2025-10-22T23:28:14.251847] [DEBUG] [MAIN ] BHVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:14.277505] [INFO ] [MAIN ] BHVN: Generated 138 derivative records from 50633 primary records. [2025-10-22T23:28:14.277631] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-22T23:28:14.289599] [DEBUG] [LOCAL ] BHVN: Derivative data saved (138 records). [2025-10-22T23:28:14.289741] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-22T23:28:14.292918] [INFO ] [MAIN ] Derivative Progress: 218/2052 symbols. BHVN took 0.4s. Estimated remaining time: 12m 3s [2025-10-22T23:28:14.293020] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:14.341832] [DEBUG] [LOCAL ] BILL: Loaded 52500 existing records from primary storage. [2025-10-22T23:28:14.341999] [INFO ] [MAIN ] BILL: Loaded 52500 primary data records. [2025-10-22T23:28:14.652793] [DEBUG] [MAIN ] BILL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:14.678172] [INFO ] [MAIN ] BILL: Generated 138 derivative records from 52500 primary records. [2025-10-22T23:28:14.678297] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-22T23:28:14.689879] [DEBUG] [LOCAL ] BILL: Derivative data saved (138 records). [2025-10-22T23:28:14.689962] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-22T23:28:14.693219] [INFO ] [MAIN ] Derivative Progress: 219/2052 symbols. BILL took 0.4s. Estimated remaining time: 12m 3s [2025-10-22T23:28:14.693323] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:14.715983] [DEBUG] [LOCAL ] BIO: Loaded 23819 existing records from primary storage. [2025-10-22T23:28:14.716133] [INFO ] [MAIN ] BIO: Loaded 23819 primary data records. [2025-10-22T23:28:15.054004] [DEBUG] [MAIN ] BIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:15.081121] [INFO ] [MAIN ] BIO: Generated 138 derivative records from 23819 primary records. [2025-10-22T23:28:15.081256] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-10-22T23:28:15.093326] [DEBUG] [LOCAL ] BIO: Derivative data saved (138 records). [2025-10-22T23:28:15.093410] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-10-22T23:28:15.096297] [INFO ] [MAIN ] Derivative Progress: 220/2052 symbols. BIO took 0.4s. Estimated remaining time: 12m 3s [2025-10-22T23:28:15.096401] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:15.135065] [DEBUG] [LOCAL ] BIP: Loaded 38919 existing records from primary storage. [2025-10-22T23:28:15.135236] [INFO ] [MAIN ] BIP: Loaded 38919 primary data records. [2025-10-22T23:28:15.452935] [DEBUG] [MAIN ] BIP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:15.479213] [INFO ] [MAIN ] BIP: Generated 138 derivative records from 38919 primary records. [2025-10-22T23:28:15.479346] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-22T23:28:15.491423] [DEBUG] [LOCAL ] BIP: Derivative data saved (138 records). [2025-10-22T23:28:15.491507] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-22T23:28:15.494571] [INFO ] [MAIN ] Derivative Progress: 221/2052 symbols. BIP took 0.4s. Estimated remaining time: 12m 2s [2025-10-22T23:28:15.494711] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:15.532211] [DEBUG] [LOCAL ] BIPC: Loaded 41113 existing records from primary storage. [2025-10-22T23:28:15.532379] [INFO ] [MAIN ] BIPC: Loaded 41113 primary data records. [2025-10-22T23:28:15.861908] [DEBUG] [MAIN ] BIPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:15.887351] [INFO ] [MAIN ] BIPC: Generated 138 derivative records from 41113 primary records. [2025-10-22T23:28:15.887477] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-10-22T23:28:15.899027] [DEBUG] [LOCAL ] BIPC: Derivative data saved (138 records). [2025-10-22T23:28:15.899108] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-10-22T23:28:15.902180] [INFO ] [MAIN ] Derivative Progress: 222/2052 symbols. BIPC took 0.4s. Estimated remaining time: 12m 2s [2025-10-22T23:28:15.902279] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:15.906620] [DEBUG] [LOCAL ] BIPH: Loaded 2352 existing records from primary storage. [2025-10-22T23:28:15.906732] [INFO ] [MAIN ] BIPH: Loaded 2352 primary data records. [2025-10-22T23:28:16.213467] [DEBUG] [MAIN ] BIPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:16.239006] [INFO ] [MAIN ] BIPH: Generated 138 derivative records from 2352 primary records. [2025-10-22T23:28:16.239126] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-22T23:28:16.248852] [DEBUG] [LOCAL ] BIPH: Derivative data saved (138 records). [2025-10-22T23:28:16.248931] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-22T23:28:16.251253] [INFO ] [MAIN ] Derivative Progress: 223/2052 symbols. BIPH took 0.3s. Estimated remaining time: 12m 1s [2025-10-22T23:28:16.251351] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:16.255601] [DEBUG] [LOCAL ] BIPI: Loaded 2816 existing records from primary storage. [2025-10-22T23:28:16.255720] [INFO ] [MAIN ] BIPI: Loaded 2816 primary data records. [2025-10-22T23:28:16.561300] [DEBUG] [MAIN ] BIPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:16.586933] [INFO ] [MAIN ] BIPI: Generated 138 derivative records from 2816 primary records. [2025-10-22T23:28:16.587103] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-22T23:28:16.597104] [DEBUG] [LOCAL ] BIPI: Derivative data saved (138 records). [2025-10-22T23:28:16.597197] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-22T23:28:16.599720] [INFO ] [MAIN ] Derivative Progress: 224/2052 symbols. BIPI took 0.3s. Estimated remaining time: 12m 0s [2025-10-22T23:28:16.599820] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:16.604237] [DEBUG] [LOCAL ] BIPJ: Loaded 3106 existing records from primary storage. [2025-10-22T23:28:16.604332] [INFO ] [MAIN ] BIPJ: Loaded 3106 primary data records. [2025-10-22T23:28:16.950672] [DEBUG] [MAIN ] BIPJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:16.977568] [INFO ] [MAIN ] BIPJ: Generated 138 derivative records from 3106 primary records. [2025-10-22T23:28:16.977779] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-22T23:28:16.988035] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (138 records). [2025-10-22T23:28:16.988163] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-22T23:28:16.990699] [INFO ] [MAIN ] Derivative Progress: 225/2052 symbols. BIPJ took 0.4s. Estimated remaining time: 11m 60s [2025-10-22T23:28:16.990810] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:17.039526] [DEBUG] [LOCAL ] BIRK: Loaded 51188 existing records from primary storage. [2025-10-22T23:28:17.039716] [INFO ] [MAIN ] BIRK: Loaded 51188 primary data records. [2025-10-22T23:28:17.350725] [DEBUG] [MAIN ] BIRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:17.379068] [INFO ] [MAIN ] BIRK: Generated 138 derivative records from 51188 primary records. [2025-10-22T23:28:17.379261] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-22T23:28:17.391281] [DEBUG] [LOCAL ] BIRK: Derivative data saved (138 records). [2025-10-22T23:28:17.391367] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-22T23:28:17.394488] [INFO ] [MAIN ] Derivative Progress: 226/2052 symbols. BIRK took 0.4s. Estimated remaining time: 11m 60s [2025-10-22T23:28:17.394613] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:17.418911] [DEBUG] [LOCAL ] BIT: Loaded 23774 existing records from primary storage. [2025-10-22T23:28:17.419067] [INFO ] [MAIN ] BIT: Loaded 23774 primary data records. [2025-10-22T23:28:17.736703] [DEBUG] [MAIN ] BIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:17.763795] [INFO ] [MAIN ] BIT: Generated 138 derivative records from 23774 primary records. [2025-10-22T23:28:17.763980] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-22T23:28:17.775625] [DEBUG] [LOCAL ] BIT: Derivative data saved (138 records). [2025-10-22T23:28:17.775775] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-22T23:28:17.778476] [INFO ] [MAIN ] Derivative Progress: 227/2052 symbols. BIT took 0.4s. Estimated remaining time: 11m 59s [2025-10-22T23:28:17.778592] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:17.830417] [DEBUG] [LOCAL ] BJ: Loaded 51505 existing records from primary storage. [2025-10-22T23:28:17.830590] [INFO ] [MAIN ] BJ: Loaded 51505 primary data records. [2025-10-22T23:28:18.158798] [DEBUG] [MAIN ] BJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:18.189400] [INFO ] [MAIN ] BJ: Generated 138 derivative records from 51505 primary records. [2025-10-22T23:28:18.189541] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-22T23:28:18.202893] [DEBUG] [LOCAL ] BJ: Derivative data saved (138 records). [2025-10-22T23:28:18.202991] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-22T23:28:18.206370] [INFO ] [MAIN ] Derivative Progress: 228/2052 symbols. BJ took 0.4s. Estimated remaining time: 11m 59s [2025-10-22T23:28:18.206490] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:18.258630] [DEBUG] [LOCAL ] BK: Loaded 53546 existing records from primary storage. [2025-10-22T23:28:18.258830] [INFO ] [MAIN ] BK: Loaded 53546 primary data records. [2025-10-22T23:28:18.595956] [DEBUG] [MAIN ] BK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:18.624997] [INFO ] [MAIN ] BK: Generated 138 derivative records from 53546 primary records. [2025-10-22T23:28:18.625140] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-22T23:28:18.637680] [DEBUG] [LOCAL ] BK: Derivative data saved (138 records). [2025-10-22T23:28:18.637765] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-22T23:28:18.640830] [INFO ] [MAIN ] Derivative Progress: 229/2052 symbols. BK took 0.4s. Estimated remaining time: 11m 59s [2025-10-22T23:28:18.640954] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:18.690790] [DEBUG] [LOCAL ] BKD: Loaded 50408 existing records from primary storage. [2025-10-22T23:28:18.690965] [INFO ] [MAIN ] BKD: Loaded 50408 primary data records. [2025-10-22T23:28:19.037061] [DEBUG] [MAIN ] BKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:19.062571] [INFO ] [MAIN ] BKD: Generated 138 derivative records from 50408 primary records. [2025-10-22T23:28:19.062714] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-22T23:28:19.073882] [DEBUG] [LOCAL ] BKD: Derivative data saved (138 records). [2025-10-22T23:28:19.073961] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-22T23:28:19.076545] [INFO ] [MAIN ] Derivative Progress: 230/2052 symbols. BKD took 0.4s. Estimated remaining time: 11m 59s [2025-10-22T23:28:19.076679] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:19.114541] [DEBUG] [LOCAL ] BKKT: Loaded 37391 existing records from primary storage. [2025-10-22T23:28:19.114731] [INFO ] [MAIN ] BKKT: Loaded 37391 primary data records. [2025-10-22T23:28:19.419990] [DEBUG] [MAIN ] BKKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:19.445365] [INFO ] [MAIN ] BKKT: Generated 138 derivative records from 37391 primary records. [2025-10-22T23:28:19.445480] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-22T23:28:19.456962] [DEBUG] [LOCAL ] BKKT: Derivative data saved (138 records). [2025-10-22T23:28:19.457042] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-22T23:28:19.459760] [INFO ] [MAIN ] Derivative Progress: 231/2052 symbols. BKKT took 0.4s. Estimated remaining time: 11m 58s [2025-10-22T23:28:19.459859] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:19.470044] [DEBUG] [LOCAL ] BKN: Loaded 7279 existing records from primary storage. [2025-10-22T23:28:19.470170] [INFO ] [MAIN ] BKN: Loaded 7279 primary data records. [2025-10-22T23:28:19.774443] [DEBUG] [MAIN ] BKN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:19.799759] [INFO ] [MAIN ] BKN: Generated 138 derivative records from 7279 primary records. [2025-10-22T23:28:19.799873] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-22T23:28:19.810675] [DEBUG] [LOCAL ] BKN: Derivative data saved (138 records). [2025-10-22T23:28:19.810763] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-22T23:28:19.812876] [INFO ] [MAIN ] Derivative Progress: 232/2052 symbols. BKN took 0.4s. Estimated remaining time: 11m 58s [2025-10-22T23:28:19.812978] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:19.858705] [DEBUG] [LOCAL ] BKSY: Loaded 48912 existing records from primary storage. [2025-10-22T23:28:19.858864] [INFO ] [MAIN ] BKSY: Loaded 48912 primary data records. [2025-10-22T23:28:20.164632] [DEBUG] [MAIN ] BKSY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:20.190202] [INFO ] [MAIN ] BKSY: Generated 138 derivative records from 48912 primary records. [2025-10-22T23:28:20.190316] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-22T23:28:20.201878] [DEBUG] [LOCAL ] BKSY: Derivative data saved (138 records). [2025-10-22T23:28:20.201960] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-22T23:28:20.204568] [INFO ] [MAIN ] Derivative Progress: 233/2052 symbols. BKSY took 0.4s. Estimated remaining time: 11m 57s [2025-10-22T23:28:20.204707] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:20.219886] [DEBUG] [LOCAL ] BKT: Loaded 12833 existing records from primary storage. [2025-10-22T23:28:20.220015] [INFO ] [MAIN ] BKT: Loaded 12833 primary data records. [2025-10-22T23:28:20.532697] [DEBUG] [MAIN ] BKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:20.558448] [INFO ] [MAIN ] BKT: Generated 138 derivative records from 12833 primary records. [2025-10-22T23:28:20.558592] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-22T23:28:20.570185] [DEBUG] [LOCAL ] BKT: Derivative data saved (138 records). [2025-10-22T23:28:20.570266] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-22T23:28:20.572403] [INFO ] [MAIN ] Derivative Progress: 234/2052 symbols. BKT took 0.4s. Estimated remaining time: 11m 57s [2025-10-22T23:28:20.572503] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:20.610143] [DEBUG] [LOCAL ] BKU: Loaded 42169 existing records from primary storage. [2025-10-22T23:28:20.610296] [INFO ] [MAIN ] BKU: Loaded 42169 primary data records. [2025-10-22T23:28:20.919600] [DEBUG] [MAIN ] BKU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:20.945136] [INFO ] [MAIN ] BKU: Generated 138 derivative records from 42169 primary records. [2025-10-22T23:28:20.945252] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-22T23:28:20.956787] [DEBUG] [LOCAL ] BKU: Derivative data saved (138 records). [2025-10-22T23:28:20.956871] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-22T23:28:20.959796] [INFO ] [MAIN ] Derivative Progress: 235/2052 symbols. BKU took 0.4s. Estimated remaining time: 11m 56s [2025-10-22T23:28:20.959900] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:20.987140] [DEBUG] [LOCAL ] BKV: Loaded 29342 existing records from primary storage. [2025-10-22T23:28:20.987306] [INFO ] [MAIN ] BKV: Loaded 29342 primary data records. [2025-10-22T23:28:21.317087] [DEBUG] [MAIN ] BKV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:21.342703] [INFO ] [MAIN ] BKV: Generated 138 derivative records from 29342 primary records. [2025-10-22T23:28:21.342862] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-22T23:28:21.354315] [DEBUG] [LOCAL ] BKV: Derivative data saved (138 records). [2025-10-22T23:28:21.354393] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-10-22T23:28:21.357291] [INFO ] [MAIN ] Derivative Progress: 236/2052 symbols. BKV took 0.4s. Estimated remaining time: 11m 56s [2025-10-22T23:28:21.357396] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:21.389385] [DEBUG] [LOCAL ] BLCO: Loaded 34928 existing records from primary storage. [2025-10-22T23:28:21.389532] [INFO ] [MAIN ] BLCO: Loaded 34928 primary data records. [2025-10-22T23:28:21.700491] [DEBUG] [MAIN ] BLCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:21.727876] [INFO ] [MAIN ] BLCO: Generated 138 derivative records from 34928 primary records. [2025-10-22T23:28:21.728011] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-22T23:28:21.739922] [DEBUG] [LOCAL ] BLCO: Derivative data saved (138 records). [2025-10-22T23:28:21.740002] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-22T23:28:21.742873] [INFO ] [MAIN ] Derivative Progress: 237/2052 symbols. BLCO took 0.4s. Estimated remaining time: 11m 55s [2025-10-22T23:28:21.742973] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:21.768969] [DEBUG] [LOCAL ] BLD: Loaded 27046 existing records from primary storage. [2025-10-22T23:28:21.769114] [INFO ] [MAIN ] BLD: Loaded 27046 primary data records. [2025-10-22T23:28:22.075418] [DEBUG] [MAIN ] BLD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:28:22.101007] [INFO ] [MAIN ] BLD: Generated 138 derivative records from 27046 primary records. [2025-10-22T23:28:22.101134] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-10-22T23:28:22.112840] [DEBUG] [LOCAL ] BLD: Derivative data saved (138 records). [2025-10-22T23:28:22.112929] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-10-22T23:28:22.115832] [INFO ] [MAIN ] Derivative Progress: 238/2052 symbols. BLD took 0.4s. Estimated remaining time: 11m 55s [2025-10-22T23:28:22.115932] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:22.166970] [DEBUG] [LOCAL ] BLDR: Loaded 51855 existing records from primary storage. [2025-10-22T23:28:22.167134] [INFO ] [MAIN ] BLDR: Loaded 51855 primary data records. [2025-10-22T23:28:22.477075] [DEBUG] [MAIN ] BLDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:22.502789] [INFO ] [MAIN ] BLDR: Generated 138 derivative records from 51855 primary records. [2025-10-22T23:28:22.502953] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-22T23:28:22.514855] [DEBUG] [LOCAL ] BLDR: Derivative data saved (138 records). [2025-10-22T23:28:22.514953] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-22T23:28:22.518096] [INFO ] [MAIN ] Derivative Progress: 239/2052 symbols. BLDR took 0.4s. Estimated remaining time: 11m 55s [2025-10-22T23:28:22.518228] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:22.533874] [DEBUG] [LOCAL ] BLE: Loaded 13616 existing records from primary storage. [2025-10-22T23:28:22.534018] [INFO ] [MAIN ] BLE: Loaded 13616 primary data records. [2025-10-22T23:28:22.851803] [DEBUG] [MAIN ] BLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:22.877311] [INFO ] [MAIN ] BLE: Generated 138 derivative records from 13616 primary records. [2025-10-22T23:28:22.877429] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-22T23:28:22.888954] [DEBUG] [LOCAL ] BLE: Derivative data saved (138 records). [2025-10-22T23:28:22.889041] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-22T23:28:22.891308] [INFO ] [MAIN ] Derivative Progress: 240/2052 symbols. BLE took 0.4s. Estimated remaining time: 11m 54s [2025-10-22T23:28:22.891408] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:22.924441] [DEBUG] [LOCAL ] BLK: Loaded 34184 existing records from primary storage. [2025-10-22T23:28:22.924595] [INFO ] [MAIN ] BLK: Loaded 34184 primary data records. [2025-10-22T23:28:23.261502] [DEBUG] [MAIN ] BLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:23.287222] [INFO ] [MAIN ] BLK: Generated 138 derivative records from 34184 primary records. [2025-10-22T23:28:23.287361] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-22T23:28:23.299090] [DEBUG] [LOCAL ] BLK: Derivative data saved (138 records). [2025-10-22T23:28:23.299171] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-22T23:28:23.302141] [INFO ] [MAIN ] Derivative Progress: 241/2052 symbols. BLK took 0.4s. Estimated remaining time: 11m 54s [2025-10-22T23:28:23.302245] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:23.345838] [DEBUG] [LOCAL ] BLND: Loaded 49215 existing records from primary storage. [2025-10-22T23:28:23.345999] [INFO ] [MAIN ] BLND: Loaded 49215 primary data records. [2025-10-22T23:28:23.653594] [DEBUG] [MAIN ] BLND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:23.679396] [INFO ] [MAIN ] BLND: Generated 138 derivative records from 49215 primary records. [2025-10-22T23:28:23.679576] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-22T23:28:23.691147] [DEBUG] [LOCAL ] BLND: Derivative data saved (138 records). [2025-10-22T23:28:23.691258] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-22T23:28:23.693849] [INFO ] [MAIN ] Derivative Progress: 242/2052 symbols. BLND took 0.4s. Estimated remaining time: 11m 53s [2025-10-22T23:28:23.693973] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:23.711348] [DEBUG] [LOCAL ] BLX: Loaded 15410 existing records from primary storage. [2025-10-22T23:28:23.711514] [INFO ] [MAIN ] BLX: Loaded 15410 primary data records. [2025-10-22T23:28:24.028883] [DEBUG] [MAIN ] BLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:24.059177] [INFO ] [MAIN ] BLX: Generated 138 derivative records from 15410 primary records. [2025-10-22T23:28:24.059369] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-22T23:28:24.071820] [DEBUG] [LOCAL ] BLX: Derivative data saved (138 records). [2025-10-22T23:28:24.071913] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-22T23:28:24.074080] [INFO ] [MAIN ] Derivative Progress: 243/2052 symbols. BLX took 0.4s. Estimated remaining time: 11m 53s [2025-10-22T23:28:24.074186] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:24.108613] [DEBUG] [LOCAL ] BMA: Loaded 36532 existing records from primary storage. [2025-10-22T23:28:24.108812] [INFO ] [MAIN ] BMA: Loaded 36532 primary data records. [2025-10-22T23:28:24.430357] [DEBUG] [MAIN ] BMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:24.456891] [INFO ] [MAIN ] BMA: Generated 138 derivative records from 36532 primary records. [2025-10-22T23:28:24.457083] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-22T23:28:24.468997] [DEBUG] [LOCAL ] BMA: Derivative data saved (138 records). [2025-10-22T23:28:24.469133] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-22T23:28:24.471927] [INFO ] [MAIN ] Derivative Progress: 244/2052 symbols. BMA took 0.4s. Estimated remaining time: 11m 52s [2025-10-22T23:28:24.472045] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:24.485337] [DEBUG] [LOCAL ] BME: Loaded 11221 existing records from primary storage. [2025-10-22T23:28:24.485536] [INFO ] [MAIN ] BME: Loaded 11221 primary data records. [2025-10-22T23:28:24.828925] [DEBUG] [MAIN ] BME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:24.861131] [INFO ] [MAIN ] BME: Generated 138 derivative records from 11221 primary records. [2025-10-22T23:28:24.861332] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-22T23:28:24.874569] [DEBUG] [LOCAL ] BME: Derivative data saved (138 records). [2025-10-22T23:28:24.874783] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-22T23:28:24.877780] [INFO ] [MAIN ] Derivative Progress: 245/2052 symbols. BME took 0.4s. Estimated remaining time: 11m 52s [2025-10-22T23:28:24.878014] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:24.914711] [DEBUG] [LOCAL ] BMEZ: Loaded 25062 existing records from primary storage. [2025-10-22T23:28:24.914918] [INFO ] [MAIN ] BMEZ: Loaded 25062 primary data records. [2025-10-22T23:28:25.428397] [DEBUG] [MAIN ] BMEZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:25.460030] [INFO ] [MAIN ] BMEZ: Generated 138 derivative records from 25062 primary records. [2025-10-22T23:28:25.460233] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-10-22T23:28:25.473315] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (138 records). [2025-10-22T23:28:25.473485] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-10-22T23:28:25.476597] [INFO ] [MAIN ] Derivative Progress: 246/2052 symbols. BMEZ took 0.6s. Estimated remaining time: 11m 53s [2025-10-22T23:28:25.476821] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:25.506899] [DEBUG] [LOCAL ] BMI: Loaded 24901 existing records from primary storage. [2025-10-22T23:28:25.507100] [INFO ] [MAIN ] BMI: Loaded 24901 primary data records. [2025-10-22T23:28:25.878095] [DEBUG] [MAIN ] BMI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:28:25.907217] [INFO ] [MAIN ] BMI: Generated 138 derivative records from 24901 primary records. [2025-10-22T23:28:25.907438] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-22T23:28:25.920097] [DEBUG] [LOCAL ] BMI: Derivative data saved (138 records). [2025-10-22T23:28:25.920198] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-22T23:28:25.923198] [INFO ] [MAIN ] Derivative Progress: 247/2052 symbols. BMI took 0.4s. Estimated remaining time: 11m 53s [2025-10-22T23:28:25.923320] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:25.928146] [DEBUG] [LOCAL ] BMN: Loaded 2644 existing records from primary storage. [2025-10-22T23:28:25.928277] [INFO ] [MAIN ] BMN: Loaded 2644 primary data records. [2025-10-22T23:28:26.282491] [DEBUG] [MAIN ] BMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:26.310300] [INFO ] [MAIN ] BMN: Generated 138 derivative records from 2644 primary records. [2025-10-22T23:28:26.310499] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-22T23:28:26.320339] [DEBUG] [LOCAL ] BMN: Derivative data saved (138 records). [2025-10-22T23:28:26.320455] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-10-22T23:28:26.322635] [INFO ] [MAIN ] Derivative Progress: 248/2052 symbols. BMN took 0.4s. Estimated remaining time: 11m 53s [2025-10-22T23:28:26.322788] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:26.362905] [DEBUG] [LOCAL ] BMO: Loaded 40992 existing records from primary storage. [2025-10-22T23:28:26.363070] [INFO ] [MAIN ] BMO: Loaded 40992 primary data records. [2025-10-22T23:28:26.678421] [DEBUG] [MAIN ] BMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:26.706237] [INFO ] [MAIN ] BMO: Generated 138 derivative records from 40992 primary records. [2025-10-22T23:28:26.706476] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-10-22T23:28:26.718400] [DEBUG] [LOCAL ] BMO: Derivative data saved (138 records). [2025-10-22T23:28:26.718554] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-10-22T23:28:26.721507] [INFO ] [MAIN ] Derivative Progress: 249/2052 symbols. BMO took 0.4s. Estimated remaining time: 11m 52s [2025-10-22T23:28:26.721701] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:26.774082] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-22T23:28:26.774259] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-10-22T23:28:27.080421] [DEBUG] [MAIN ] BMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:27.105540] [INFO ] [MAIN ] BMY: Generated 138 derivative records from 53757 primary records. [2025-10-22T23:28:27.105694] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-22T23:28:27.117063] [DEBUG] [LOCAL ] BMY: Derivative data saved (138 records). [2025-10-22T23:28:27.117141] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-10-22T23:28:27.120025] [INFO ] [MAIN ] Derivative Progress: 250/2052 symbols. BMY took 0.4s. Estimated remaining time: 11m 52s [2025-10-22T23:28:27.120124] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:27.168851] [DEBUG] [LOCAL ] BN: Loaded 52983 existing records from primary storage. [2025-10-22T23:28:27.169010] [INFO ] [MAIN ] BN: Loaded 52983 primary data records. [2025-10-22T23:28:27.508052] [DEBUG] [MAIN ] BN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:27.533459] [INFO ] [MAIN ] BN: Generated 138 derivative records from 52983 primary records. [2025-10-22T23:28:27.533602] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-22T23:28:27.545276] [DEBUG] [LOCAL ] BN: Derivative data saved (138 records). [2025-10-22T23:28:27.545358] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-10-22T23:28:27.548241] [INFO ] [MAIN ] Derivative Progress: 251/2052 symbols. BN took 0.4s. Estimated remaining time: 11m 52s [2025-10-22T23:28:27.548342] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:27.574897] [DEBUG] [LOCAL ] BNED: Loaded 28217 existing records from primary storage. [2025-10-22T23:28:27.575047] [INFO ] [MAIN ] BNED: Loaded 28217 primary data records. [2025-10-22T23:28:27.885020] [DEBUG] [MAIN ] BNED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:27.912389] [INFO ] [MAIN ] BNED: Generated 138 derivative records from 28217 primary records. [2025-10-22T23:28:27.912550] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-22T23:28:27.924452] [DEBUG] [LOCAL ] BNED: Derivative data saved (138 records). [2025-10-22T23:28:27.924547] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-22T23:28:27.927396] [INFO ] [MAIN ] Derivative Progress: 252/2052 symbols. BNED took 0.4s. Estimated remaining time: 11m 51s [2025-10-22T23:28:27.927508] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:27.936169] [DEBUG] [LOCAL ] BNH: Loaded 4701 existing records from primary storage. [2025-10-22T23:28:27.936307] [INFO ] [MAIN ] BNH: Loaded 4701 primary data records. [2025-10-22T23:28:28.254893] [DEBUG] [MAIN ] BNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:28.282063] [INFO ] [MAIN ] BNH: Generated 138 derivative records from 4701 primary records. [2025-10-22T23:28:28.282212] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-22T23:28:28.292914] [DEBUG] [LOCAL ] BNH: Derivative data saved (138 records). [2025-10-22T23:28:28.293000] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-22T23:28:28.295212] [INFO ] [MAIN ] Derivative Progress: 253/2052 symbols. BNH took 0.4s. Estimated remaining time: 11m 51s [2025-10-22T23:28:28.295319] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:28.299454] [DEBUG] [LOCAL ] BNJ: Loaded 2500 existing records from primary storage. [2025-10-22T23:28:28.299551] [INFO ] [MAIN ] BNJ: Loaded 2500 primary data records. [2025-10-22T23:28:28.610966] [DEBUG] [MAIN ] BNJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:28.636779] [INFO ] [MAIN ] BNJ: Generated 138 derivative records from 2500 primary records. [2025-10-22T23:28:28.636913] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-22T23:28:28.646721] [DEBUG] [LOCAL ] BNJ: Derivative data saved (138 records). [2025-10-22T23:28:28.646809] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-22T23:28:28.648986] [INFO ] [MAIN ] Derivative Progress: 254/2052 symbols. BNJ took 0.4s. Estimated remaining time: 11m 50s [2025-10-22T23:28:28.649093] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:28.693623] [DEBUG] [LOCAL ] BNL: Loaded 47073 existing records from primary storage. [2025-10-22T23:28:28.693812] [INFO ] [MAIN ] BNL: Loaded 47073 primary data records. [2025-10-22T23:28:29.008952] [DEBUG] [MAIN ] BNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:29.034586] [INFO ] [MAIN ] BNL: Generated 138 derivative records from 47073 primary records. [2025-10-22T23:28:29.034756] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-22T23:28:29.046323] [DEBUG] [LOCAL ] BNL: Derivative data saved (138 records). [2025-10-22T23:28:29.046408] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-22T23:28:29.049074] [INFO ] [MAIN ] Derivative Progress: 255/2052 symbols. BNL took 0.4s. Estimated remaining time: 11m 50s [2025-10-22T23:28:29.049185] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:29.095627] [DEBUG] [LOCAL ] BNS: Loaded 51416 existing records from primary storage. [2025-10-22T23:28:29.095819] [INFO ] [MAIN ] BNS: Loaded 51416 primary data records. [2025-10-22T23:28:29.403910] [DEBUG] [MAIN ] BNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:29.430799] [INFO ] [MAIN ] BNS: Generated 138 derivative records from 51416 primary records. [2025-10-22T23:28:29.431003] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-22T23:28:29.449038] [DEBUG] [LOCAL ] BNS: Derivative data saved (138 records). [2025-10-22T23:28:29.449190] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-22T23:28:29.453021] [INFO ] [MAIN ] Derivative Progress: 256/2052 symbols. BNS took 0.4s. Estimated remaining time: 11m 49s [2025-10-22T23:28:29.453165] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:29.461318] [DEBUG] [LOCAL ] BNT: Loaded 3527 existing records from primary storage. [2025-10-22T23:28:29.461454] [INFO ] [MAIN ] BNT: Loaded 3527 primary data records. [2025-10-22T23:28:29.811887] [DEBUG] [MAIN ] BNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:29.837539] [INFO ] [MAIN ] BNT: Generated 138 derivative records from 3527 primary records. [2025-10-22T23:28:29.837680] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-22T23:28:29.847720] [DEBUG] [LOCAL ] BNT: Derivative data saved (138 records). [2025-10-22T23:28:29.847804] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-22T23:28:29.850077] [INFO ] [MAIN ] Derivative Progress: 257/2052 symbols. BNT took 0.4s. Estimated remaining time: 11m 49s [2025-10-22T23:28:29.850174] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:29.858519] [DEBUG] [LOCAL ] BNY: Loaded 7253 existing records from primary storage. [2025-10-22T23:28:29.858664] [INFO ] [MAIN ] BNY: Loaded 7253 primary data records. [2025-10-22T23:28:30.162755] [DEBUG] [MAIN ] BNY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:30.188324] [INFO ] [MAIN ] BNY: Generated 138 derivative records from 7253 primary records. [2025-10-22T23:28:30.188434] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-22T23:28:30.199080] [DEBUG] [LOCAL ] BNY: Derivative data saved (138 records). [2025-10-22T23:28:30.199161] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-10-22T23:28:30.201365] [INFO ] [MAIN ] Derivative Progress: 258/2052 symbols. BNY took 0.4s. Estimated remaining time: 11m 48s [2025-10-22T23:28:30.201463] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:30.219330] [DEBUG] [LOCAL ] BOC: Loaded 18186 existing records from primary storage. [2025-10-22T23:28:30.219462] [INFO ] [MAIN ] BOC: Loaded 18186 primary data records. [2025-10-22T23:28:30.527976] [DEBUG] [MAIN ] BOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:30.553570] [INFO ] [MAIN ] BOC: Generated 138 derivative records from 18186 primary records. [2025-10-22T23:28:30.553720] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-22T23:28:30.565215] [DEBUG] [LOCAL ] BOC: Derivative data saved (138 records). [2025-10-22T23:28:30.565295] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-22T23:28:30.568106] [INFO ] [MAIN ] Derivative Progress: 259/2052 symbols. BOC took 0.4s. Estimated remaining time: 11m 48s [2025-10-22T23:28:30.568201] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:30.586906] [DEBUG] [LOCAL ] BOE: Loaded 18068 existing records from primary storage. [2025-10-22T23:28:30.587041] [INFO ] [MAIN ] BOE: Loaded 18068 primary data records. [2025-10-22T23:28:30.897407] [DEBUG] [MAIN ] BOE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:30.923134] [INFO ] [MAIN ] BOE: Generated 138 derivative records from 18068 primary records. [2025-10-22T23:28:30.923242] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-10-22T23:28:30.937882] [DEBUG] [LOCAL ] BOE: Derivative data saved (138 records). [2025-10-22T23:28:30.938020] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-10-22T23:28:30.941034] [INFO ] [MAIN ] Derivative Progress: 260/2052 symbols. BOE took 0.4s. Estimated remaining time: 11m 47s [2025-10-22T23:28:30.941129] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:30.969485] [DEBUG] [LOCAL ] BOH: Loaded 30638 existing records from primary storage. [2025-10-22T23:28:30.969630] [INFO ] [MAIN ] BOH: Loaded 30638 primary data records. [2025-10-22T23:28:31.282338] [DEBUG] [MAIN ] BOH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:31.308067] [INFO ] [MAIN ] BOH: Generated 138 derivative records from 30638 primary records. [2025-10-22T23:28:31.308178] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-22T23:28:31.319529] [DEBUG] [LOCAL ] BOH: Derivative data saved (138 records). [2025-10-22T23:28:31.319609] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-22T23:28:31.322586] [INFO ] [MAIN ] Derivative Progress: 261/2052 symbols. BOH took 0.4s. Estimated remaining time: 11m 47s [2025-10-22T23:28:31.322719] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:31.353691] [DEBUG] [LOCAL ] BOND: Loaded 32409 existing records from primary storage. [2025-10-22T23:28:31.353841] [INFO ] [MAIN ] BOND: Loaded 32409 primary data records. [2025-10-22T23:28:31.693208] [DEBUG] [MAIN ] BOND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:31.721894] [INFO ] [MAIN ] BOND: Generated 138 derivative records from 32409 primary records. [2025-10-22T23:28:31.722255] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-22T23:28:31.734719] [DEBUG] [LOCAL ] BOND: Derivative data saved (138 records). [2025-10-22T23:28:31.734824] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-22T23:28:31.737986] [INFO ] [MAIN ] Derivative Progress: 262/2052 symbols. BOND took 0.4s. Estimated remaining time: 11m 46s [2025-10-22T23:28:31.738091] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:31.777577] [DEBUG] [LOCAL ] BOOT: Loaded 39419 existing records from primary storage. [2025-10-22T23:28:31.777769] [INFO ] [MAIN ] BOOT: Loaded 39419 primary data records. [2025-10-22T23:28:32.121846] [DEBUG] [MAIN ] BOOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:32.150814] [INFO ] [MAIN ] BOOT: Generated 138 derivative records from 39419 primary records. [2025-10-22T23:28:32.151013] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-22T23:28:32.164234] [DEBUG] [LOCAL ] BOOT: Derivative data saved (138 records). [2025-10-22T23:28:32.164371] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-22T23:28:32.167404] [INFO ] [MAIN ] Derivative Progress: 263/2052 symbols. BOOT took 0.4s. Estimated remaining time: 11m 46s [2025-10-22T23:28:32.167534] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:32.190361] [DEBUG] [LOCAL ] BOW: Loaded 22829 existing records from primary storage. [2025-10-22T23:28:32.190529] [INFO ] [MAIN ] BOW: Loaded 22829 primary data records. [2025-10-22T23:28:32.533482] [DEBUG] [MAIN ] BOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:32.563776] [INFO ] [MAIN ] BOW: Generated 138 derivative records from 22829 primary records. [2025-10-22T23:28:32.563993] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-22T23:28:32.576820] [DEBUG] [LOCAL ] BOW: Derivative data saved (138 records). [2025-10-22T23:28:32.576981] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-22T23:28:32.579808] [INFO ] [MAIN ] Derivative Progress: 264/2052 symbols. BOW took 0.4s. Estimated remaining time: 11m 46s [2025-10-22T23:28:32.579999] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:32.629574] [DEBUG] [LOCAL ] BOX: Loaded 50125 existing records from primary storage. [2025-10-22T23:28:32.629775] [INFO ] [MAIN ] BOX: Loaded 50125 primary data records. [2025-10-22T23:28:32.959910] [DEBUG] [MAIN ] BOX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:32.985805] [INFO ] [MAIN ] BOX: Generated 138 derivative records from 50125 primary records. [2025-10-22T23:28:32.985989] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-10-22T23:28:32.997822] [DEBUG] [LOCAL ] BOX: Derivative data saved (138 records). [2025-10-22T23:28:32.997962] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-10-22T23:28:33.000771] [INFO ] [MAIN ] Derivative Progress: 265/2052 symbols. BOX took 0.4s. Estimated remaining time: 11m 46s [2025-10-22T23:28:33.000910] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:33.054577] [DEBUG] [LOCAL ] BP: Loaded 53706 existing records from primary storage. [2025-10-22T23:28:33.054774] [INFO ] [MAIN ] BP: Loaded 53706 primary data records. [2025-10-22T23:28:33.362432] [DEBUG] [MAIN ] BP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:33.387795] [INFO ] [MAIN ] BP: Generated 138 derivative records from 53706 primary records. [2025-10-22T23:28:33.387903] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-10-22T23:28:33.399539] [DEBUG] [LOCAL ] BP: Derivative data saved (138 records). [2025-10-22T23:28:33.399618] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-10-22T23:28:33.402486] [INFO ] [MAIN ] Derivative Progress: 266/2052 symbols. BP took 0.4s. Estimated remaining time: 11m 45s [2025-10-22T23:28:33.402582] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:33.434280] [DEBUG] [LOCAL ] BR: Loaded 34554 existing records from primary storage. [2025-10-22T23:28:33.434432] [INFO ] [MAIN ] BR: Loaded 34554 primary data records. [2025-10-22T23:28:33.768185] [DEBUG] [MAIN ] BR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:33.793921] [INFO ] [MAIN ] BR: Generated 138 derivative records from 34554 primary records. [2025-10-22T23:28:33.794078] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-22T23:28:33.805985] [DEBUG] [LOCAL ] BR: Derivative data saved (138 records). [2025-10-22T23:28:33.806073] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-22T23:28:33.808919] [INFO ] [MAIN ] Derivative Progress: 267/2052 symbols. BR took 0.4s. Estimated remaining time: 11m 45s [2025-10-22T23:28:33.809025] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:33.859863] [DEBUG] [LOCAL ] BRBR: Loaded 51828 existing records from primary storage. [2025-10-22T23:28:33.860029] [INFO ] [MAIN ] BRBR: Loaded 51828 primary data records. [2025-10-22T23:28:34.167893] [DEBUG] [MAIN ] BRBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:34.193419] [INFO ] [MAIN ] BRBR: Generated 138 derivative records from 51828 primary records. [2025-10-22T23:28:34.193523] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-10-22T23:28:34.205281] [DEBUG] [LOCAL ] BRBR: Derivative data saved (138 records). [2025-10-22T23:28:34.205359] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-10-22T23:28:34.208258] [INFO ] [MAIN ] Derivative Progress: 268/2052 symbols. BRBR took 0.4s. Estimated remaining time: 11m 45s [2025-10-22T23:28:34.208358] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:34.227541] [DEBUG] [LOCAL ] BRC: Loaded 18341 existing records from primary storage. [2025-10-22T23:28:34.227697] [INFO ] [MAIN ] BRC: Loaded 18341 primary data records. [2025-10-22T23:28:34.538935] [DEBUG] [MAIN ] BRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:34.564162] [INFO ] [MAIN ] BRC: Generated 138 derivative records from 18341 primary records. [2025-10-22T23:28:34.564263] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-22T23:28:34.575692] [DEBUG] [LOCAL ] BRC: Derivative data saved (138 records). [2025-10-22T23:28:34.575776] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-10-22T23:28:34.578325] [INFO ] [MAIN ] Derivative Progress: 269/2052 symbols. BRC took 0.4s. Estimated remaining time: 11m 44s [2025-10-22T23:28:34.578425] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:34.614621] [DEBUG] [LOCAL ] BRCC: Loaded 40024 existing records from primary storage. [2025-10-22T23:28:34.614803] [INFO ] [MAIN ] BRCC: Loaded 40024 primary data records. [2025-10-22T23:28:34.924174] [DEBUG] [MAIN ] BRCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:34.950027] [INFO ] [MAIN ] BRCC: Generated 138 derivative records from 40024 primary records. [2025-10-22T23:28:34.950138] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-10-22T23:28:34.961728] [DEBUG] [LOCAL ] BRCC: Derivative data saved (138 records). [2025-10-22T23:28:34.961810] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-10-22T23:28:34.964573] [INFO ] [MAIN ] Derivative Progress: 270/2052 symbols. BRCC took 0.4s. Estimated remaining time: 11m 44s [2025-10-22T23:28:34.964711] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:35.015577] [DEBUG] [LOCAL ] BRO: Loaded 52096 existing records from primary storage. [2025-10-22T23:28:35.015762] [INFO ] [MAIN ] BRO: Loaded 52096 primary data records. [2025-10-22T23:28:35.322682] [DEBUG] [MAIN ] BRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:35.348135] [INFO ] [MAIN ] BRO: Generated 138 derivative records from 52096 primary records. [2025-10-22T23:28:35.348243] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-10-22T23:28:35.360015] [DEBUG] [LOCAL ] BRO: Derivative data saved (138 records). [2025-10-22T23:28:35.360095] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-10-22T23:28:35.362948] [INFO ] [MAIN ] Derivative Progress: 271/2052 symbols. BRO took 0.4s. Estimated remaining time: 11m 43s [2025-10-22T23:28:35.363044] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:35.412604] [DEBUG] [LOCAL ] BROS: Loaded 53301 existing records from primary storage. [2025-10-22T23:28:35.412789] [INFO ] [MAIN ] BROS: Loaded 53301 primary data records. [2025-10-22T23:28:35.723308] [DEBUG] [MAIN ] BROS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:35.748860] [INFO ] [MAIN ] BROS: Generated 138 derivative records from 53301 primary records. [2025-10-22T23:28:35.749006] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-22T23:28:35.760963] [DEBUG] [LOCAL ] BROS: Derivative data saved (138 records). [2025-10-22T23:28:35.761044] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-22T23:28:35.763889] [INFO ] [MAIN ] Derivative Progress: 272/2052 symbols. BROS took 0.4s. Estimated remaining time: 11m 43s [2025-10-22T23:28:35.763983] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:35.796322] [DEBUG] [LOCAL ] BRSP: Loaded 36477 existing records from primary storage. [2025-10-22T23:28:35.796478] [INFO ] [MAIN ] BRSP: Loaded 36477 primary data records. [2025-10-22T23:28:36.125429] [DEBUG] [MAIN ] BRSP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:36.150571] [INFO ] [MAIN ] BRSP: Generated 138 derivative records from 36477 primary records. [2025-10-22T23:28:36.150720] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-10-22T23:28:36.161766] [DEBUG] [LOCAL ] BRSP: Derivative data saved (138 records). [2025-10-22T23:28:36.161845] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-10-22T23:28:36.164485] [INFO ] [MAIN ] Derivative Progress: 273/2052 symbols. BRSP took 0.4s. Estimated remaining time: 11m 43s [2025-10-22T23:28:36.164584] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:36.173207] [DEBUG] [LOCAL ] BRT: Loaded 5261 existing records from primary storage. [2025-10-22T23:28:36.173322] [INFO ] [MAIN ] BRT: Loaded 5261 primary data records. [2025-10-22T23:28:36.478905] [DEBUG] [MAIN ] BRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:36.505285] [INFO ] [MAIN ] BRT: Generated 138 derivative records from 5261 primary records. [2025-10-22T23:28:36.505402] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-10-22T23:28:36.516086] [DEBUG] [LOCAL ] BRT: Derivative data saved (138 records). [2025-10-22T23:28:36.516166] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-10-22T23:28:36.518254] [INFO ] [MAIN ] Derivative Progress: 274/2052 symbols. BRT took 0.4s. Estimated remaining time: 11m 42s [2025-10-22T23:28:36.518352] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:36.568509] [DEBUG] [LOCAL ] BRX: Loaded 51818 existing records from primary storage. [2025-10-22T23:28:36.568695] [INFO ] [MAIN ] BRX: Loaded 51818 primary data records. [2025-10-22T23:28:36.879951] [DEBUG] [MAIN ] BRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:36.905393] [INFO ] [MAIN ] BRX: Generated 138 derivative records from 51818 primary records. [2025-10-22T23:28:36.905498] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-22T23:28:36.917154] [DEBUG] [LOCAL ] BRX: Derivative data saved (138 records). [2025-10-22T23:28:36.917234] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-10-22T23:28:36.920153] [INFO ] [MAIN ] Derivative Progress: 275/2052 symbols. BRX took 0.4s. Estimated remaining time: 11m 42s [2025-10-22T23:28:36.920250] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:36.952305] [DEBUG] [LOCAL ] BSBR: Loaded 35877 existing records from primary storage. [2025-10-22T23:28:36.952455] [INFO ] [MAIN ] BSBR: Loaded 35877 primary data records. [2025-10-22T23:28:37.261088] [DEBUG] [MAIN ] BSBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:37.286376] [INFO ] [MAIN ] BSBR: Generated 138 derivative records from 35877 primary records. [2025-10-22T23:28:37.286483] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-10-22T23:28:37.297526] [DEBUG] [LOCAL ] BSBR: Derivative data saved (138 records). [2025-10-22T23:28:37.297604] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-10-22T23:28:37.300345] [INFO ] [MAIN ] Derivative Progress: 276/2052 symbols. BSBR took 0.4s. Estimated remaining time: 11m 41s [2025-10-22T23:28:37.300439] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:37.311448] [DEBUG] [LOCAL ] BSL: Loaded 7898 existing records from primary storage. [2025-10-22T23:28:37.311562] [INFO ] [MAIN ] BSL: Loaded 7898 primary data records. [2025-10-22T23:28:37.621100] [DEBUG] [MAIN ] BSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:37.646554] [INFO ] [MAIN ] BSL: Generated 138 derivative records from 7898 primary records. [2025-10-22T23:28:37.646681] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-10-22T23:28:37.657996] [DEBUG] [LOCAL ] BSL: Derivative data saved (138 records). [2025-10-22T23:28:37.658077] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-10-22T23:28:37.660198] [INFO ] [MAIN ] Derivative Progress: 277/2052 symbols. BSL took 0.4s. Estimated remaining time: 11m 41s [2025-10-22T23:28:37.660297] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:37.690475] [DEBUG] [LOCAL ] BSM: Loaded 32282 existing records from primary storage. [2025-10-22T23:28:37.690632] [INFO ] [MAIN ] BSM: Loaded 32282 primary data records. [2025-10-22T23:28:38.020977] [DEBUG] [MAIN ] BSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:38.050763] [INFO ] [MAIN ] BSM: Generated 138 derivative records from 32282 primary records. [2025-10-22T23:28:38.050977] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-10-22T23:28:38.062846] [DEBUG] [LOCAL ] BSM: Derivative data saved (138 records). [2025-10-22T23:28:38.062928] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-10-22T23:28:38.065916] [INFO ] [MAIN ] Derivative Progress: 278/2052 symbols. BSM took 0.4s. Estimated remaining time: 11m 40s [2025-10-22T23:28:38.066018] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:38.084699] [DEBUG] [LOCAL ] BST: Loaded 18388 existing records from primary storage. [2025-10-22T23:28:38.084832] [INFO ] [MAIN ] BST: Loaded 18388 primary data records. [2025-10-22T23:28:38.392378] [DEBUG] [MAIN ] BST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:38.418429] [INFO ] [MAIN ] BST: Generated 138 derivative records from 18388 primary records. [2025-10-22T23:28:38.418560] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-10-22T23:28:38.429949] [DEBUG] [LOCAL ] BST: Derivative data saved (138 records). [2025-10-22T23:28:38.430046] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-10-22T23:28:38.432759] [INFO ] [MAIN ] Derivative Progress: 279/2052 symbols. BST took 0.4s. Estimated remaining time: 11m 40s [2025-10-22T23:28:38.432896] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:38.455795] [DEBUG] [LOCAL ] BSTZ: Loaded 24418 existing records from primary storage. [2025-10-22T23:28:38.455929] [INFO ] [MAIN ] BSTZ: Loaded 24418 primary data records. [2025-10-22T23:28:38.766149] [DEBUG] [MAIN ] BSTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:38.792316] [INFO ] [MAIN ] BSTZ: Generated 138 derivative records from 24418 primary records. [2025-10-22T23:28:38.792433] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-10-22T23:28:38.804136] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (138 records). [2025-10-22T23:28:38.804219] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-10-22T23:28:38.806916] [INFO ] [MAIN ] Derivative Progress: 280/2052 symbols. BSTZ took 0.4s. Estimated remaining time: 11m 39s [2025-10-22T23:28:38.807019] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:38.858320] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-22T23:28:38.858479] [INFO ] [MAIN ] BSX: Loaded 53688 primary data records. [2025-10-22T23:28:39.171369] [DEBUG] [MAIN ] BSX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:39.197098] [INFO ] [MAIN ] BSX: Generated 138 derivative records from 53688 primary records. [2025-10-22T23:28:39.197217] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-10-22T23:28:39.209071] [DEBUG] [LOCAL ] BSX: Derivative data saved (138 records). [2025-10-22T23:28:39.209154] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-10-22T23:28:39.212075] [INFO ] [MAIN ] Derivative Progress: 281/2052 symbols. BSX took 0.4s. Estimated remaining time: 11m 39s [2025-10-22T23:28:39.212182] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:39.222624] [DEBUG] [LOCAL ] BTA: Loaded 5760 existing records from primary storage. [2025-10-22T23:28:39.222774] [INFO ] [MAIN ] BTA: Loaded 5760 primary data records. [2025-10-22T23:28:39.529181] [DEBUG] [MAIN ] BTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:39.554423] [INFO ] [MAIN ] BTA: Generated 138 derivative records from 5760 primary records. [2025-10-22T23:28:39.554535] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-22T23:28:39.564828] [DEBUG] [LOCAL ] BTA: Derivative data saved (138 records). [2025-10-22T23:28:39.564911] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-10-22T23:28:39.567011] [INFO ] [MAIN ] Derivative Progress: 282/2052 symbols. BTA took 0.4s. Estimated remaining time: 11m 38s [2025-10-22T23:28:39.567114] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:39.616575] [DEBUG] [LOCAL ] BTE: Loaded 52696 existing records from primary storage. [2025-10-22T23:28:39.616786] [INFO ] [MAIN ] BTE: Loaded 52696 primary data records. [2025-10-22T23:28:39.945488] [DEBUG] [MAIN ] BTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:39.970787] [INFO ] [MAIN ] BTE: Generated 138 derivative records from 52696 primary records. [2025-10-22T23:28:39.970903] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-10-22T23:28:39.982344] [DEBUG] [LOCAL ] BTE: Derivative data saved (138 records). [2025-10-22T23:28:39.982424] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-10-22T23:28:39.985411] [INFO ] [MAIN ] Derivative Progress: 283/2052 symbols. BTE took 0.4s. Estimated remaining time: 11m 38s [2025-10-22T23:28:39.985515] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:40.035202] [DEBUG] [LOCAL ] BTI: Loaded 53592 existing records from primary storage. [2025-10-22T23:28:40.035366] [INFO ] [MAIN ] BTI: Loaded 53592 primary data records. [2025-10-22T23:28:40.340465] [DEBUG] [MAIN ] BTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:40.365521] [INFO ] [MAIN ] BTI: Generated 138 derivative records from 53592 primary records. [2025-10-22T23:28:40.365635] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-10-22T23:28:40.377140] [DEBUG] [LOCAL ] BTI: Derivative data saved (138 records). [2025-10-22T23:28:40.377221] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-10-22T23:28:40.380075] [INFO ] [MAIN ] Derivative Progress: 284/2052 symbols. BTI took 0.4s. Estimated remaining time: 11m 38s [2025-10-22T23:28:40.380176] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:40.391288] [DEBUG] [LOCAL ] BTO: Loaded 8703 existing records from primary storage. [2025-10-22T23:28:40.391411] [INFO ] [MAIN ] BTO: Loaded 8703 primary data records. [2025-10-22T23:28:40.696454] [DEBUG] [MAIN ] BTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:40.721551] [INFO ] [MAIN ] BTO: Generated 138 derivative records from 8703 primary records. [2025-10-22T23:28:40.721741] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-22T23:28:40.733138] [DEBUG] [LOCAL ] BTO: Derivative data saved (138 records). [2025-10-22T23:28:40.733219] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-22T23:28:40.735190] [INFO ] [MAIN ] Derivative Progress: 285/2052 symbols. BTO took 0.4s. Estimated remaining time: 11m 37s [2025-10-22T23:28:40.735287] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:40.752089] [DEBUG] [LOCAL ] BTT: Loaded 15359 existing records from primary storage. [2025-10-22T23:28:40.752227] [INFO ] [MAIN ] BTT: Loaded 15359 primary data records. [2025-10-22T23:28:41.055698] [DEBUG] [MAIN ] BTT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:41.081804] [INFO ] [MAIN ] BTT: Generated 138 derivative records from 15359 primary records. [2025-10-22T23:28:41.081971] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-10-22T23:28:41.093411] [DEBUG] [LOCAL ] BTT: Derivative data saved (138 records). [2025-10-22T23:28:41.093495] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-10-22T23:28:41.096010] [INFO ] [MAIN ] Derivative Progress: 286/2052 symbols. BTT took 0.4s. Estimated remaining time: 11m 36s [2025-10-22T23:28:41.096116] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:41.147020] [DEBUG] [LOCAL ] BTU: Loaded 53337 existing records from primary storage. [2025-10-22T23:28:41.147176] [INFO ] [MAIN ] BTU: Loaded 53337 primary data records. [2025-10-22T23:28:41.453039] [DEBUG] [MAIN ] BTU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:41.478428] [INFO ] [MAIN ] BTU: Generated 138 derivative records from 53337 primary records. [2025-10-22T23:28:41.478569] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-10-22T23:28:41.490370] [DEBUG] [LOCAL ] BTU: Derivative data saved (138 records). [2025-10-22T23:28:41.490454] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-10-22T23:28:41.493281] [INFO ] [MAIN ] Derivative Progress: 287/2052 symbols. BTU took 0.4s. Estimated remaining time: 11m 36s [2025-10-22T23:28:41.493388] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:41.515065] [DEBUG] [LOCAL ] BTZ: Loaded 22396 existing records from primary storage. [2025-10-22T23:28:41.515213] [INFO ] [MAIN ] BTZ: Loaded 22396 primary data records. [2025-10-22T23:28:41.850492] [DEBUG] [MAIN ] BTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:41.876250] [INFO ] [MAIN ] BTZ: Generated 138 derivative records from 22396 primary records. [2025-10-22T23:28:41.876393] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-22T23:28:41.888022] [DEBUG] [LOCAL ] BTZ: Derivative data saved (138 records). [2025-10-22T23:28:41.888103] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-22T23:28:41.890742] [INFO ] [MAIN ] Derivative Progress: 288/2052 symbols. BTZ took 0.4s. Estimated remaining time: 11m 36s [2025-10-22T23:28:41.890843] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:41.939980] [DEBUG] [LOCAL ] BUD: Loaded 52597 existing records from primary storage. [2025-10-22T23:28:41.940133] [INFO ] [MAIN ] BUD: Loaded 52597 primary data records. [2025-10-22T23:28:42.246500] [DEBUG] [MAIN ] BUD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:42.271719] [INFO ] [MAIN ] BUD: Generated 138 derivative records from 52597 primary records. [2025-10-22T23:28:42.271848] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-22T23:28:42.283525] [DEBUG] [LOCAL ] BUD: Derivative data saved (138 records). [2025-10-22T23:28:42.283617] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-22T23:28:42.286472] [INFO ] [MAIN ] Derivative Progress: 289/2052 symbols. BUD took 0.4s. Estimated remaining time: 11m 35s [2025-10-22T23:28:42.286576] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:42.300008] [DEBUG] [LOCAL ] BUI: Loaded 11824 existing records from primary storage. [2025-10-22T23:28:42.300136] [INFO ] [MAIN ] BUI: Loaded 11824 primary data records. [2025-10-22T23:28:42.607251] [DEBUG] [MAIN ] BUI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:42.632631] [INFO ] [MAIN ] BUI: Generated 138 derivative records from 11824 primary records. [2025-10-22T23:28:42.632789] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-10-22T23:28:42.644624] [DEBUG] [LOCAL ] BUI: Derivative data saved (138 records). [2025-10-22T23:28:42.644737] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-10-22T23:28:42.646839] [INFO ] [MAIN ] Derivative Progress: 290/2052 symbols. BUI took 0.4s. Estimated remaining time: 11m 35s [2025-10-22T23:28:42.646965] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:42.691548] [DEBUG] [LOCAL ] BUR: Loaded 45446 existing records from primary storage. [2025-10-22T23:28:42.691752] [INFO ] [MAIN ] BUR: Loaded 45446 primary data records. [2025-10-22T23:28:42.997774] [DEBUG] [MAIN ] BUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:43.023253] [INFO ] [MAIN ] BUR: Generated 138 derivative records from 45446 primary records. [2025-10-22T23:28:43.023462] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-22T23:28:43.035270] [DEBUG] [LOCAL ] BUR: Derivative data saved (138 records). [2025-10-22T23:28:43.035375] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-10-22T23:28:43.038137] [INFO ] [MAIN ] Derivative Progress: 291/2052 symbols. BUR took 0.4s. Estimated remaining time: 11m 34s [2025-10-22T23:28:43.038262] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:43.079603] [DEBUG] [LOCAL ] BURL: Loaded 45416 existing records from primary storage. [2025-10-22T23:28:43.079811] [INFO ] [MAIN ] BURL: Loaded 45416 primary data records. [2025-10-22T23:28:43.387153] [DEBUG] [MAIN ] BURL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:43.412399] [INFO ] [MAIN ] BURL: Generated 138 derivative records from 45416 primary records. [2025-10-22T23:28:43.412519] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-22T23:28:43.424107] [DEBUG] [LOCAL ] BURL: Derivative data saved (138 records). [2025-10-22T23:28:43.424199] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-22T23:28:43.426949] [INFO ] [MAIN ] Derivative Progress: 292/2052 symbols. BURL took 0.4s. Estimated remaining time: 11m 34s [2025-10-22T23:28:43.427056] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:43.443865] [DEBUG] [LOCAL ] BUXX: Loaded 15332 existing records from primary storage. [2025-10-22T23:28:43.444007] [INFO ] [MAIN ] BUXX: Loaded 15332 primary data records. [2025-10-22T23:28:43.753051] [DEBUG] [MAIN ] BUXX: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:28:43.778752] [INFO ] [MAIN ] BUXX: Generated 138 derivative records from 15332 primary records. [2025-10-22T23:28:43.778885] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-10-22T23:28:43.790870] [DEBUG] [LOCAL ] BUXX: Derivative data saved (138 records). [2025-10-22T23:28:43.790972] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-10-22T23:28:43.793148] [INFO ] [MAIN ] Derivative Progress: 293/2052 symbols. BUXX took 0.4s. Estimated remaining time: 11m 33s [2025-10-22T23:28:43.793267] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:43.832975] [DEBUG] [LOCAL ] BVN: Loaded 44515 existing records from primary storage. [2025-10-22T23:28:43.833151] [INFO ] [MAIN ] BVN: Loaded 44515 primary data records. [2025-10-22T23:28:44.169416] [DEBUG] [MAIN ] BVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:44.196268] [INFO ] [MAIN ] BVN: Generated 138 derivative records from 44515 primary records. [2025-10-22T23:28:44.196450] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-10-22T23:28:44.208214] [DEBUG] [LOCAL ] BVN: Derivative data saved (138 records). [2025-10-22T23:28:44.208293] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-10-22T23:28:44.211191] [INFO ] [MAIN ] Derivative Progress: 294/2052 symbols. BVN took 0.4s. Estimated remaining time: 11m 33s [2025-10-22T23:28:44.211289] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:44.259616] [DEBUG] [LOCAL ] BWA: Loaded 52078 existing records from primary storage. [2025-10-22T23:28:44.259821] [INFO ] [MAIN ] BWA: Loaded 52078 primary data records. [2025-10-22T23:28:44.584087] [DEBUG] [MAIN ] BWA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:44.609363] [INFO ] [MAIN ] BWA: Generated 138 derivative records from 52078 primary records. [2025-10-22T23:28:44.609479] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-22T23:28:44.620878] [DEBUG] [LOCAL ] BWA: Derivative data saved (138 records). [2025-10-22T23:28:44.620958] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-22T23:28:44.623884] [INFO ] [MAIN ] Derivative Progress: 295/2052 symbols. BWA took 0.4s. Estimated remaining time: 11m 33s [2025-10-22T23:28:44.623985] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:44.637538] [DEBUG] [LOCAL ] BWG: Loaded 12559 existing records from primary storage. [2025-10-22T23:28:44.637681] [INFO ] [MAIN ] BWG: Loaded 12559 primary data records. [2025-10-22T23:28:44.941614] [DEBUG] [MAIN ] BWG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:44.966970] [INFO ] [MAIN ] BWG: Generated 138 derivative records from 12559 primary records. [2025-10-22T23:28:44.967084] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-22T23:28:44.978878] [DEBUG] [LOCAL ] BWG: Derivative data saved (138 records). [2025-10-22T23:28:44.978958] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-10-22T23:28:44.981100] [INFO ] [MAIN ] Derivative Progress: 296/2052 symbols. BWG took 0.4s. Estimated remaining time: 11m 32s [2025-10-22T23:28:44.981197] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:45.011455] [DEBUG] [LOCAL ] BWLP: Loaded 32092 existing records from primary storage. [2025-10-22T23:28:45.011602] [INFO ] [MAIN ] BWLP: Loaded 32092 primary data records. [2025-10-22T23:28:45.319297] [DEBUG] [MAIN ] BWLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:45.345215] [INFO ] [MAIN ] BWLP: Generated 138 derivative records from 32092 primary records. [2025-10-22T23:28:45.345349] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-10-22T23:28:45.356913] [DEBUG] [LOCAL ] BWLP: Derivative data saved (138 records). [2025-10-22T23:28:45.356994] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-10-22T23:28:45.359814] [INFO ] [MAIN ] Derivative Progress: 297/2052 symbols. BWLP took 0.4s. Estimated remaining time: 11m 32s [2025-10-22T23:28:45.359911] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:45.367462] [DEBUG] [LOCAL ] BWNB: Loaded 4051 existing records from primary storage. [2025-10-22T23:28:45.367563] [INFO ] [MAIN ] BWNB: Loaded 4051 primary data records. [2025-10-22T23:28:45.673027] [DEBUG] [MAIN ] BWNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:45.698405] [INFO ] [MAIN ] BWNB: Generated 138 derivative records from 4051 primary records. [2025-10-22T23:28:45.698527] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-22T23:28:45.708556] [DEBUG] [LOCAL ] BWNB: Derivative data saved (138 records). [2025-10-22T23:28:45.708639] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-22T23:28:45.710926] [INFO ] [MAIN ] Derivative Progress: 298/2052 symbols. BWNB took 0.4s. Estimated remaining time: 11m 31s [2025-10-22T23:28:45.711026] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:45.717809] [DEBUG] [LOCAL ] BWSN: Loaded 5048 existing records from primary storage. [2025-10-22T23:28:45.717916] [INFO ] [MAIN ] BWSN: Loaded 5048 primary data records. [2025-10-22T23:28:46.046926] [DEBUG] [MAIN ] BWSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:46.072702] [INFO ] [MAIN ] BWSN: Generated 138 derivative records from 5048 primary records. [2025-10-22T23:28:46.072820] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-10-22T23:28:46.083006] [DEBUG] [LOCAL ] BWSN: Derivative data saved (138 records). [2025-10-22T23:28:46.083088] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-10-22T23:28:46.085412] [INFO ] [MAIN ] Derivative Progress: 299/2052 symbols. BWSN took 0.4s. Estimated remaining time: 11m 30s [2025-10-22T23:28:46.085510] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:46.129896] [DEBUG] [LOCAL ] BWXT: Loaded 47260 existing records from primary storage. [2025-10-22T23:28:46.130056] [INFO ] [MAIN ] BWXT: Loaded 47260 primary data records. [2025-10-22T23:28:46.441235] [DEBUG] [MAIN ] BWXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:46.466901] [INFO ] [MAIN ] BWXT: Generated 138 derivative records from 47260 primary records. [2025-10-22T23:28:46.467011] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-22T23:28:46.478565] [DEBUG] [LOCAL ] BWXT: Derivative data saved (138 records). [2025-10-22T23:28:46.478665] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-10-22T23:28:46.481366] [INFO ] [MAIN ] Derivative Progress: 300/2052 symbols. BWXT took 0.4s. Estimated remaining time: 11m 30s [2025-10-22T23:28:46.481468] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:46.526316] [DEBUG] [LOCAL ] BXP: Loaded 49849 existing records from primary storage. [2025-10-22T23:28:46.526487] [INFO ] [MAIN ] BXP: Loaded 49849 primary data records. [2025-10-22T23:28:46.839049] [DEBUG] [MAIN ] BXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:46.864636] [INFO ] [MAIN ] BXP: Generated 138 derivative records from 49849 primary records. [2025-10-22T23:28:46.864829] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-10-22T23:28:46.876298] [DEBUG] [LOCAL ] BXP: Derivative data saved (138 records). [2025-10-22T23:28:46.876378] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-10-22T23:28:46.879159] [INFO ] [MAIN ] Derivative Progress: 301/2052 symbols. BXP took 0.4s. Estimated remaining time: 11m 30s [2025-10-22T23:28:46.879261] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:46.901396] [DEBUG] [LOCAL ] BY: Loaded 21636 existing records from primary storage. [2025-10-22T23:28:46.901555] [INFO ] [MAIN ] BY: Loaded 21636 primary data records. [2025-10-22T23:28:47.213303] [DEBUG] [MAIN ] BY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:47.239038] [INFO ] [MAIN ] BY: Generated 138 derivative records from 21636 primary records. [2025-10-22T23:28:47.239208] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-10-22T23:28:47.250634] [DEBUG] [LOCAL ] BY: Derivative data saved (138 records). [2025-10-22T23:28:47.250742] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-10-22T23:28:47.253339] [INFO ] [MAIN ] Derivative Progress: 302/2052 symbols. BY took 0.4s. Estimated remaining time: 11m 29s [2025-10-22T23:28:47.253437] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:47.293298] [DEBUG] [LOCAL ] BYD: Loaded 44941 existing records from primary storage. [2025-10-22T23:28:47.293465] [INFO ] [MAIN ] BYD: Loaded 44941 primary data records. [2025-10-22T23:28:47.605743] [DEBUG] [MAIN ] BYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:47.631170] [INFO ] [MAIN ] BYD: Generated 138 derivative records from 44941 primary records. [2025-10-22T23:28:47.631301] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-22T23:28:47.642680] [DEBUG] [LOCAL ] BYD: Derivative data saved (138 records). [2025-10-22T23:28:47.642771] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-10-22T23:28:47.645528] [INFO ] [MAIN ] Derivative Progress: 303/2052 symbols. BYD took 0.4s. Estimated remaining time: 11m 29s [2025-10-22T23:28:47.645673] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:47.659219] [DEBUG] [LOCAL ] BYM: Loaded 11369 existing records from primary storage. [2025-10-22T23:28:47.659349] [INFO ] [MAIN ] BYM: Loaded 11369 primary data records. [2025-10-22T23:28:48.003854] [DEBUG] [MAIN ] BYM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:48.030067] [INFO ] [MAIN ] BYM: Generated 138 derivative records from 11369 primary records. [2025-10-22T23:28:48.030215] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-22T23:28:48.042069] [DEBUG] [LOCAL ] BYM: Derivative data saved (138 records). [2025-10-22T23:28:48.042157] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-10-22T23:28:48.044262] [INFO ] [MAIN ] Derivative Progress: 304/2052 symbols. BYM took 0.4s. Estimated remaining time: 11m 28s [2025-10-22T23:28:48.044361] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:48.073761] [DEBUG] [LOCAL ] BZH: Loaded 32065 existing records from primary storage. [2025-10-22T23:28:48.073924] [INFO ] [MAIN ] BZH: Loaded 32065 primary data records. [2025-10-22T23:28:48.382350] [DEBUG] [MAIN ] BZH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:48.407773] [INFO ] [MAIN ] BZH: Generated 138 derivative records from 32065 primary records. [2025-10-22T23:28:48.407896] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-10-22T23:28:48.419585] [DEBUG] [LOCAL ] BZH: Derivative data saved (138 records). [2025-10-22T23:28:48.419687] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-10-22T23:28:48.422484] [INFO ] [MAIN ] Derivative Progress: 305/2052 symbols. BZH took 0.4s. Estimated remaining time: 11m 28s [2025-10-22T23:28:48.422584] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:48.442424] [DEBUG] [LOCAL ] CAAP: Loaded 19805 existing records from primary storage. [2025-10-22T23:28:48.442560] [INFO ] [MAIN ] CAAP: Loaded 19805 primary data records. [2025-10-22T23:28:48.749982] [DEBUG] [MAIN ] CAAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:48.776045] [INFO ] [MAIN ] CAAP: Generated 138 derivative records from 19805 primary records. [2025-10-22T23:28:48.776228] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-22T23:28:48.791268] [DEBUG] [LOCAL ] CAAP: Derivative data saved (138 records). [2025-10-22T23:28:48.791476] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-22T23:28:48.794212] [INFO ] [MAIN ] Derivative Progress: 306/2052 symbols. CAAP took 0.4s. Estimated remaining time: 11m 27s [2025-10-22T23:28:48.794303] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:48.812731] [DEBUG] [LOCAL ] CABO: Loaded 16659 existing records from primary storage. [2025-10-22T23:28:48.812869] [INFO ] [MAIN ] CABO: Loaded 16659 primary data records. [2025-10-22T23:28:49.117601] [DEBUG] [MAIN ] CABO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:49.143284] [INFO ] [MAIN ] CABO: Generated 138 derivative records from 16659 primary records. [2025-10-22T23:28:49.143394] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-22T23:28:49.155349] [DEBUG] [LOCAL ] CABO: Derivative data saved (138 records). [2025-10-22T23:28:49.155432] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-22T23:28:49.157672] [INFO ] [MAIN ] Derivative Progress: 307/2052 symbols. CABO took 0.4s. Estimated remaining time: 11m 27s [2025-10-22T23:28:49.157767] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:49.180225] [DEBUG] [LOCAL ] CACI: Loaded 22378 existing records from primary storage. [2025-10-22T23:28:49.180382] [INFO ] [MAIN ] CACI: Loaded 22378 primary data records. [2025-10-22T23:28:49.491280] [DEBUG] [MAIN ] CACI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:28:49.517083] [INFO ] [MAIN ] CACI: Generated 138 derivative records from 22378 primary records. [2025-10-22T23:28:49.517214] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-22T23:28:49.528690] [DEBUG] [LOCAL ] CACI: Derivative data saved (138 records). [2025-10-22T23:28:49.528774] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-22T23:28:49.531536] [INFO ] [MAIN ] Derivative Progress: 308/2052 symbols. CACI took 0.4s. Estimated remaining time: 11m 26s [2025-10-22T23:28:49.531636] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:49.575484] [DEBUG] [LOCAL ] CADE: Loaded 49685 existing records from primary storage. [2025-10-22T23:28:49.575680] [INFO ] [MAIN ] CADE: Loaded 49685 primary data records. [2025-10-22T23:28:49.882265] [DEBUG] [MAIN ] CADE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:49.908322] [INFO ] [MAIN ] CADE: Generated 138 derivative records from 49685 primary records. [2025-10-22T23:28:49.908496] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-22T23:28:49.920156] [DEBUG] [LOCAL ] CADE: Derivative data saved (138 records). [2025-10-22T23:28:49.920239] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-22T23:28:49.923131] [INFO ] [MAIN ] Derivative Progress: 309/2052 symbols. CADE took 0.4s. Estimated remaining time: 11m 26s [2025-10-22T23:28:49.923242] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:49.958690] [DEBUG] [LOCAL ] CAE: Loaded 39045 existing records from primary storage. [2025-10-22T23:28:49.958846] [INFO ] [MAIN ] CAE: Loaded 39045 primary data records. [2025-10-22T23:28:50.303064] [DEBUG] [MAIN ] CAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:50.328584] [INFO ] [MAIN ] CAE: Generated 138 derivative records from 39045 primary records. [2025-10-22T23:28:50.328702] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-10-22T23:28:50.340259] [DEBUG] [LOCAL ] CAE: Derivative data saved (138 records). [2025-10-22T23:28:50.340340] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-10-22T23:28:50.344827] [INFO ] [MAIN ] Derivative Progress: 310/2052 symbols. CAE took 0.4s. Estimated remaining time: 11m 26s [2025-10-22T23:28:50.344924] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:50.396944] [DEBUG] [LOCAL ] CAG: Loaded 53666 existing records from primary storage. [2025-10-22T23:28:50.397106] [INFO ] [MAIN ] CAG: Loaded 53666 primary data records. [2025-10-22T23:28:50.701177] [DEBUG] [MAIN ] CAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:50.726265] [INFO ] [MAIN ] CAG: Generated 138 derivative records from 53666 primary records. [2025-10-22T23:28:50.726387] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-22T23:28:50.738003] [DEBUG] [LOCAL ] CAG: Derivative data saved (138 records). [2025-10-22T23:28:50.738083] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-10-22T23:28:50.741282] [INFO ] [MAIN ] Derivative Progress: 311/2052 symbols. CAG took 0.4s. Estimated remaining time: 11m 25s [2025-10-22T23:28:50.741387] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:50.794073] [DEBUG] [LOCAL ] CAH: Loaded 51420 existing records from primary storage. [2025-10-22T23:28:50.794237] [INFO ] [MAIN ] CAH: Loaded 51420 primary data records. [2025-10-22T23:28:51.100794] [DEBUG] [MAIN ] CAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:51.125766] [INFO ] [MAIN ] CAH: Generated 138 derivative records from 51420 primary records. [2025-10-22T23:28:51.125894] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-22T23:28:51.137836] [DEBUG] [LOCAL ] CAH: Derivative data saved (138 records). [2025-10-22T23:28:51.137918] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-22T23:28:51.141104] [INFO ] [MAIN ] Derivative Progress: 312/2052 symbols. CAH took 0.4s. Estimated remaining time: 11m 25s [2025-10-22T23:28:51.141201] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:51.180128] [DEBUG] [LOCAL ] CAL: Loaded 42762 existing records from primary storage. [2025-10-22T23:28:51.180284] [INFO ] [MAIN ] CAL: Loaded 42762 primary data records. [2025-10-22T23:28:51.486452] [DEBUG] [MAIN ] CAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:51.511757] [INFO ] [MAIN ] CAL: Generated 138 derivative records from 42762 primary records. [2025-10-22T23:28:51.511863] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-22T23:28:51.523310] [DEBUG] [LOCAL ] CAL: Derivative data saved (138 records). [2025-10-22T23:28:51.523388] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-22T23:28:51.526262] [INFO ] [MAIN ] Derivative Progress: 313/2052 symbols. CAL took 0.4s. Estimated remaining time: 11m 24s [2025-10-22T23:28:51.526364] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:51.560709] [DEBUG] [LOCAL ] CALX: Loaded 37238 existing records from primary storage. [2025-10-22T23:28:51.560860] [INFO ] [MAIN ] CALX: Loaded 37238 primary data records. [2025-10-22T23:28:51.871983] [DEBUG] [MAIN ] CALX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:51.897237] [INFO ] [MAIN ] CALX: Generated 138 derivative records from 37238 primary records. [2025-10-22T23:28:51.897371] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-22T23:28:51.908607] [DEBUG] [LOCAL ] CALX: Derivative data saved (138 records). [2025-10-22T23:28:51.908704] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-22T23:28:51.911562] [INFO ] [MAIN ] Derivative Progress: 314/2052 symbols. CALX took 0.4s. Estimated remaining time: 11m 24s [2025-10-22T23:28:51.911698] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:51.936897] [DEBUG] [LOCAL ] CANG: Loaded 27031 existing records from primary storage. [2025-10-22T23:28:51.937040] [INFO ] [MAIN ] CANG: Loaded 27031 primary data records. [2025-10-22T23:28:52.267115] [DEBUG] [MAIN ] CANG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:52.296460] [INFO ] [MAIN ] CANG: Generated 138 derivative records from 27031 primary records. [2025-10-22T23:28:52.296677] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-10-22T23:28:52.307677] [DEBUG] [LOCAL ] CANG: Derivative data saved (138 records). [2025-10-22T23:28:52.307758] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-10-22T23:28:52.310816] [INFO ] [MAIN ] Derivative Progress: 315/2052 symbols. CANG took 0.4s. Estimated remaining time: 11m 24s [2025-10-22T23:28:52.310914] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:52.319918] [DEBUG] [LOCAL ] CAPL: Loaded 5383 existing records from primary storage. [2025-10-22T23:28:52.320085] [INFO ] [MAIN ] CAPL: Loaded 5383 primary data records. [2025-10-22T23:28:52.624878] [DEBUG] [MAIN ] CAPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:52.650032] [INFO ] [MAIN ] CAPL: Generated 138 derivative records from 5383 primary records. [2025-10-22T23:28:52.650152] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-22T23:28:52.660906] [DEBUG] [LOCAL ] CAPL: Derivative data saved (138 records). [2025-10-22T23:28:52.661003] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-22T23:28:52.663328] [INFO ] [MAIN ] Derivative Progress: 316/2052 symbols. CAPL took 0.4s. Estimated remaining time: 11m 23s [2025-10-22T23:28:52.663422] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:52.714747] [DEBUG] [LOCAL ] CARR: Loaded 53603 existing records from primary storage. [2025-10-22T23:28:52.714923] [INFO ] [MAIN ] CARR: Loaded 53603 primary data records. [2025-10-22T23:28:53.028028] [DEBUG] [MAIN ] CARR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:53.053458] [INFO ] [MAIN ] CARR: Generated 138 derivative records from 53603 primary records. [2025-10-22T23:28:53.053592] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-22T23:28:53.065426] [DEBUG] [LOCAL ] CARR: Derivative data saved (138 records). [2025-10-22T23:28:53.065509] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-22T23:28:53.068861] [INFO ] [MAIN ] Derivative Progress: 317/2052 symbols. CARR took 0.4s. Estimated remaining time: 11m 23s [2025-10-22T23:28:53.068977] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:53.106773] [DEBUG] [LOCAL ] CARS: Loaded 39772 existing records from primary storage. [2025-10-22T23:28:53.106949] [INFO ] [MAIN ] CARS: Loaded 39772 primary data records. [2025-10-22T23:28:53.417793] [DEBUG] [MAIN ] CARS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:53.443205] [INFO ] [MAIN ] CARS: Generated 138 derivative records from 39772 primary records. [2025-10-22T23:28:53.443371] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-10-22T23:28:53.455115] [DEBUG] [LOCAL ] CARS: Derivative data saved (138 records). [2025-10-22T23:28:53.455198] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-10-22T23:28:53.458162] [INFO ] [MAIN ] Derivative Progress: 318/2052 symbols. CARS took 0.4s. Estimated remaining time: 11m 22s [2025-10-22T23:28:53.458262] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:53.508225] [DEBUG] [LOCAL ] CAT: Loaded 52953 existing records from primary storage. [2025-10-22T23:28:53.508401] [INFO ] [MAIN ] CAT: Loaded 52953 primary data records. [2025-10-22T23:28:53.815828] [DEBUG] [MAIN ] CAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:53.841300] [INFO ] [MAIN ] CAT: Generated 138 derivative records from 52953 primary records. [2025-10-22T23:28:53.841428] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-22T23:28:53.853210] [DEBUG] [LOCAL ] CAT: Derivative data saved (138 records). [2025-10-22T23:28:53.853292] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-22T23:28:53.856514] [INFO ] [MAIN ] Derivative Progress: 319/2052 symbols. CAT took 0.4s. Estimated remaining time: 11m 22s [2025-10-22T23:28:53.856614] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:53.866253] [DEBUG] [LOCAL ] CATO: Loaded 6647 existing records from primary storage. [2025-10-22T23:28:53.866379] [INFO ] [MAIN ] CATO: Loaded 6647 primary data records. [2025-10-22T23:28:54.198529] [DEBUG] [MAIN ] CATO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:54.225921] [INFO ] [MAIN ] CATO: Generated 138 derivative records from 6647 primary records. [2025-10-22T23:28:54.226109] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-22T23:28:54.236978] [DEBUG] [LOCAL ] CATO: Derivative data saved (138 records). [2025-10-22T23:28:54.237092] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-22T23:28:54.239519] [INFO ] [MAIN ] Derivative Progress: 320/2052 symbols. CATO took 0.4s. Estimated remaining time: 11m 21s [2025-10-22T23:28:54.239673] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:54.292871] [DEBUG] [LOCAL ] CAVA: Loaded 53551 existing records from primary storage. [2025-10-22T23:28:54.293053] [INFO ] [MAIN ] CAVA: Loaded 53551 primary data records. [2025-10-22T23:28:54.602995] [DEBUG] [MAIN ] CAVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:54.628325] [INFO ] [MAIN ] CAVA: Generated 138 derivative records from 53551 primary records. [2025-10-22T23:28:54.628442] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-10-22T23:28:54.639878] [DEBUG] [LOCAL ] CAVA: Derivative data saved (138 records). [2025-10-22T23:28:54.639958] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-10-22T23:28:54.643025] [INFO ] [MAIN ] Derivative Progress: 321/2052 symbols. CAVA took 0.4s. Estimated remaining time: 11m 21s [2025-10-22T23:28:54.643142] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:54.687964] [DEBUG] [LOCAL ] CB: Loaded 49964 existing records from primary storage. [2025-10-22T23:28:54.688125] [INFO ] [MAIN ] CB: Loaded 49964 primary data records. [2025-10-22T23:28:54.998307] [DEBUG] [MAIN ] CB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:55.024386] [INFO ] [MAIN ] CB: Generated 138 derivative records from 49964 primary records. [2025-10-22T23:28:55.024503] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-22T23:28:55.036115] [DEBUG] [LOCAL ] CB: Derivative data saved (138 records). [2025-10-22T23:28:55.036196] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-22T23:28:55.039102] [INFO ] [MAIN ] Derivative Progress: 322/2052 symbols. CB took 0.4s. Estimated remaining time: 11m 21s [2025-10-22T23:28:55.039206] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:55.055020] [DEBUG] [LOCAL ] CBAN: Loaded 10154 existing records from primary storage. [2025-10-22T23:28:55.055191] [INFO ] [MAIN ] CBAN: Loaded 10154 primary data records. [2025-10-22T23:28:55.374526] [DEBUG] [MAIN ] CBAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:55.402028] [INFO ] [MAIN ] CBAN: Generated 138 derivative records from 10154 primary records. [2025-10-22T23:28:55.402247] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-10-22T23:28:55.414140] [DEBUG] [LOCAL ] CBAN: Derivative data saved (138 records). [2025-10-22T23:28:55.414230] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-10-22T23:28:55.416377] [INFO ] [MAIN ] Derivative Progress: 323/2052 symbols. CBAN took 0.4s. Estimated remaining time: 11m 20s [2025-10-22T23:28:55.416476] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:55.432017] [DEBUG] [LOCAL ] CBL: Loaded 16048 existing records from primary storage. [2025-10-22T23:28:55.432152] [INFO ] [MAIN ] CBL: Loaded 16048 primary data records. [2025-10-22T23:28:55.738097] [DEBUG] [MAIN ] CBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:55.767703] [INFO ] [MAIN ] CBL: Generated 138 derivative records from 16048 primary records. [2025-10-22T23:28:55.767880] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-10-22T23:28:55.779422] [DEBUG] [LOCAL ] CBL: Derivative data saved (138 records). [2025-10-22T23:28:55.779504] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-10-22T23:28:55.782249] [INFO ] [MAIN ] Derivative Progress: 324/2052 symbols. CBL took 0.4s. Estimated remaining time: 11m 20s [2025-10-22T23:28:55.782364] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:55.787069] [DEBUG] [LOCAL ] CBNA: Loaded 2864 existing records from primary storage. [2025-10-22T23:28:55.787175] [INFO ] [MAIN ] CBNA: Loaded 2864 primary data records. [2025-10-22T23:28:56.122715] [DEBUG] [MAIN ] CBNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:56.148087] [INFO ] [MAIN ] CBNA: Generated 138 derivative records from 2864 primary records. [2025-10-22T23:28:56.148225] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-22T23:28:56.157523] [DEBUG] [LOCAL ] CBNA: Derivative data saved (138 records). [2025-10-22T23:28:56.157627] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-22T23:28:56.159847] [INFO ] [MAIN ] Derivative Progress: 325/2052 symbols. CBNA took 0.4s. Estimated remaining time: 11m 19s [2025-10-22T23:28:56.159963] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:56.211579] [DEBUG] [LOCAL ] CBRE: Loaded 50278 existing records from primary storage. [2025-10-22T23:28:56.211823] [INFO ] [MAIN ] CBRE: Loaded 50278 primary data records. [2025-10-22T23:28:56.529967] [DEBUG] [MAIN ] CBRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:56.556418] [INFO ] [MAIN ] CBRE: Generated 138 derivative records from 50278 primary records. [2025-10-22T23:28:56.556554] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-22T23:28:56.568969] [DEBUG] [LOCAL ] CBRE: Derivative data saved (138 records). [2025-10-22T23:28:56.569063] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-22T23:28:56.572282] [INFO ] [MAIN ] Derivative Progress: 326/2052 symbols. CBRE took 0.4s. Estimated remaining time: 11m 19s [2025-10-22T23:28:56.572403] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:56.602064] [DEBUG] [LOCAL ] CBT: Loaded 30925 existing records from primary storage. [2025-10-22T23:28:56.602244] [INFO ] [MAIN ] CBT: Loaded 30925 primary data records. [2025-10-22T23:28:56.908403] [DEBUG] [MAIN ] CBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:56.937178] [INFO ] [MAIN ] CBT: Generated 138 derivative records from 30925 primary records. [2025-10-22T23:28:56.937379] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-22T23:28:56.951516] [DEBUG] [LOCAL ] CBT: Derivative data saved (138 records). [2025-10-22T23:28:56.951666] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-22T23:28:56.954800] [INFO ] [MAIN ] Derivative Progress: 327/2052 symbols. CBT took 0.4s. Estimated remaining time: 11m 18s [2025-10-22T23:28:56.954935] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:56.978842] [DEBUG] [LOCAL ] CBU: Loaded 22633 existing records from primary storage. [2025-10-22T23:28:56.979021] [INFO ] [MAIN ] CBU: Loaded 22633 primary data records. [2025-10-22T23:28:57.327789] [DEBUG] [MAIN ] CBU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:57.356410] [INFO ] [MAIN ] CBU: Generated 138 derivative records from 22633 primary records. [2025-10-22T23:28:57.356594] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-22T23:28:57.370558] [DEBUG] [LOCAL ] CBU: Derivative data saved (138 records). [2025-10-22T23:28:57.370709] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-22T23:28:57.373721] [INFO ] [MAIN ] Derivative Progress: 328/2052 symbols. CBU took 0.4s. Estimated remaining time: 11m 18s [2025-10-22T23:28:57.373854] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:57.407133] [DEBUG] [LOCAL ] CBZ: Loaded 34267 existing records from primary storage. [2025-10-22T23:28:57.407314] [INFO ] [MAIN ] CBZ: Loaded 34267 primary data records. [2025-10-22T23:28:57.712895] [DEBUG] [MAIN ] CBZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:57.737958] [INFO ] [MAIN ] CBZ: Generated 138 derivative records from 34267 primary records. [2025-10-22T23:28:57.738111] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-22T23:28:57.749542] [DEBUG] [LOCAL ] CBZ: Derivative data saved (138 records). [2025-10-22T23:28:57.749627] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-10-22T23:28:57.752461] [INFO ] [MAIN ] Derivative Progress: 329/2052 symbols. CBZ took 0.4s. Estimated remaining time: 11m 18s [2025-10-22T23:28:57.752559] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:57.803795] [DEBUG] [LOCAL ] CC: Loaded 53015 existing records from primary storage. [2025-10-22T23:28:57.803965] [INFO ] [MAIN ] CC: Loaded 53015 primary data records. [2025-10-22T23:28:58.111546] [DEBUG] [MAIN ] CC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:58.136880] [INFO ] [MAIN ] CC: Generated 138 derivative records from 53015 primary records. [2025-10-22T23:28:58.137001] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-22T23:28:58.148737] [DEBUG] [LOCAL ] CC: Derivative data saved (138 records). [2025-10-22T23:28:58.148819] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-22T23:28:58.152008] [INFO ] [MAIN ] Derivative Progress: 330/2052 symbols. CC took 0.4s. Estimated remaining time: 11m 17s [2025-10-22T23:28:58.152110] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:58.203041] [DEBUG] [LOCAL ] CCI: Loaded 53109 existing records from primary storage. [2025-10-22T23:28:58.203198] [INFO ] [MAIN ] CCI: Loaded 53109 primary data records. [2025-10-22T23:28:58.527557] [DEBUG] [MAIN ] CCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:58.556772] [INFO ] [MAIN ] CCI: Generated 138 derivative records from 53109 primary records. [2025-10-22T23:28:58.556952] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-22T23:28:58.568882] [DEBUG] [LOCAL ] CCI: Derivative data saved (138 records). [2025-10-22T23:28:58.568965] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-22T23:28:58.572332] [INFO ] [MAIN ] Derivative Progress: 331/2052 symbols. CCI took 0.4s. Estimated remaining time: 11m 17s [2025-10-22T23:28:58.572438] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:58.588896] [DEBUG] [LOCAL ] CCIF: Loaded 15143 existing records from primary storage. [2025-10-22T23:28:58.589029] [INFO ] [MAIN ] CCIF: Loaded 15143 primary data records. [2025-10-22T23:28:58.893760] [DEBUG] [MAIN ] CCIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:58.918953] [INFO ] [MAIN ] CCIF: Generated 138 derivative records from 15143 primary records. [2025-10-22T23:28:58.919076] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-22T23:28:58.930157] [DEBUG] [LOCAL ] CCIF: Derivative data saved (138 records). [2025-10-22T23:28:58.930241] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-22T23:28:58.932949] [INFO ] [MAIN ] Derivative Progress: 332/2052 symbols. CCIF took 0.4s. Estimated remaining time: 11m 17s [2025-10-22T23:28:58.933047] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:58.982640] [DEBUG] [LOCAL ] CCJ: Loaded 53690 existing records from primary storage. [2025-10-22T23:28:58.982832] [INFO ] [MAIN ] CCJ: Loaded 53690 primary data records. [2025-10-22T23:28:59.288716] [DEBUG] [MAIN ] CCJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:59.313776] [INFO ] [MAIN ] CCJ: Generated 138 derivative records from 53690 primary records. [2025-10-22T23:28:59.313899] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-22T23:28:59.325780] [DEBUG] [LOCAL ] CCJ: Derivative data saved (138 records). [2025-10-22T23:28:59.325866] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-22T23:28:59.329124] [INFO ] [MAIN ] Derivative Progress: 333/2052 symbols. CCJ took 0.4s. Estimated remaining time: 11m 16s [2025-10-22T23:28:59.329233] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:59.373517] [DEBUG] [LOCAL ] CCK: Loaded 46505 existing records from primary storage. [2025-10-22T23:28:59.373699] [INFO ] [MAIN ] CCK: Loaded 46505 primary data records. [2025-10-22T23:28:59.676674] [DEBUG] [MAIN ] CCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:28:59.701953] [INFO ] [MAIN ] CCK: Generated 138 derivative records from 46505 primary records. [2025-10-22T23:28:59.702095] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-22T23:28:59.713706] [DEBUG] [LOCAL ] CCK: Derivative data saved (138 records). [2025-10-22T23:28:59.713792] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-10-22T23:28:59.716556] [INFO ] [MAIN ] Derivative Progress: 334/2052 symbols. CCK took 0.4s. Estimated remaining time: 11m 16s [2025-10-22T23:28:59.716699] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:28:59.769337] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-22T23:28:59.769502] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-10-22T23:29:00.080832] [DEBUG] [MAIN ] CCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:00.106424] [INFO ] [MAIN ] CCL: Generated 138 derivative records from 53800 primary records. [2025-10-22T23:29:00.106558] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-10-22T23:29:00.118441] [DEBUG] [LOCAL ] CCL: Derivative data saved (138 records). [2025-10-22T23:29:00.118526] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-10-22T23:29:00.121883] [INFO ] [MAIN ] Derivative Progress: 335/2052 symbols. CCL took 0.4s. Estimated remaining time: 11m 15s [2025-10-22T23:29:00.121993] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:00.167577] [DEBUG] [LOCAL ] CCO: Loaded 48537 existing records from primary storage. [2025-10-22T23:29:00.167790] [INFO ] [MAIN ] CCO: Loaded 48537 primary data records. [2025-10-22T23:29:00.497883] [DEBUG] [MAIN ] CCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:00.523486] [INFO ] [MAIN ] CCO: Generated 138 derivative records from 48537 primary records. [2025-10-22T23:29:00.523618] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-22T23:29:00.535395] [DEBUG] [LOCAL ] CCO: Derivative data saved (138 records). [2025-10-22T23:29:00.535483] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-22T23:29:00.538813] [INFO ] [MAIN ] Derivative Progress: 336/2052 symbols. CCO took 0.4s. Estimated remaining time: 11m 15s [2025-10-22T23:29:00.538930] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:00.551090] [DEBUG] [LOCAL ] CCRD: Loaded 9562 existing records from primary storage. [2025-10-22T23:29:00.551238] [INFO ] [MAIN ] CCRD: Loaded 9562 primary data records. [2025-10-22T23:29:00.859355] [DEBUG] [MAIN ] CCRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:00.884783] [INFO ] [MAIN ] CCRD: Generated 138 derivative records from 9562 primary records. [2025-10-22T23:29:00.884914] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-22T23:29:00.896031] [DEBUG] [LOCAL ] CCRD: Derivative data saved (138 records). [2025-10-22T23:29:00.896115] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-22T23:29:00.898449] [INFO ] [MAIN ] Derivative Progress: 337/2052 symbols. CCRD took 0.4s. Estimated remaining time: 11m 15s [2025-10-22T23:29:00.898593] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:00.927748] [DEBUG] [LOCAL ] CCS: Loaded 29903 existing records from primary storage. [2025-10-22T23:29:00.927919] [INFO ] [MAIN ] CCS: Loaded 29903 primary data records. [2025-10-22T23:29:01.231817] [DEBUG] [MAIN ] CCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:01.257349] [INFO ] [MAIN ] CCS: Generated 138 derivative records from 29903 primary records. [2025-10-22T23:29:01.257500] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-22T23:29:01.268849] [DEBUG] [LOCAL ] CCS: Derivative data saved (138 records). [2025-10-22T23:29:01.268938] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-10-22T23:29:01.272110] [INFO ] [MAIN ] Derivative Progress: 338/2052 symbols. CCS took 0.4s. Estimated remaining time: 11m 14s [2025-10-22T23:29:01.272230] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:01.294052] [DEBUG] [LOCAL ] CCU: Loaded 21640 existing records from primary storage. [2025-10-22T23:29:01.294215] [INFO ] [MAIN ] CCU: Loaded 21640 primary data records. [2025-10-22T23:29:01.602126] [DEBUG] [MAIN ] CCU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:01.627488] [INFO ] [MAIN ] CCU: Generated 138 derivative records from 21640 primary records. [2025-10-22T23:29:01.627689] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-22T23:29:01.639279] [DEBUG] [LOCAL ] CCU: Derivative data saved (138 records). [2025-10-22T23:29:01.639368] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-10-22T23:29:01.642234] [INFO ] [MAIN ] Derivative Progress: 339/2052 symbols. CCU took 0.4s. Estimated remaining time: 11m 14s [2025-10-22T23:29:01.642347] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:01.692955] [DEBUG] [LOCAL ] CDE: Loaded 53644 existing records from primary storage. [2025-10-22T23:29:01.693138] [INFO ] [MAIN ] CDE: Loaded 53644 primary data records. [2025-10-22T23:29:02.025167] [DEBUG] [MAIN ] CDE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:02.055760] [INFO ] [MAIN ] CDE: Generated 138 derivative records from 53644 primary records. [2025-10-22T23:29:02.055967] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-22T23:29:02.068595] [DEBUG] [LOCAL ] CDE: Derivative data saved (138 records). [2025-10-22T23:29:02.068720] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-22T23:29:02.072203] [INFO ] [MAIN ] Derivative Progress: 340/2052 symbols. CDE took 0.4s. Estimated remaining time: 11m 13s [2025-10-22T23:29:02.072319] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:02.085523] [DEBUG] [LOCAL ] CDLR: Loaded 10195 existing records from primary storage. [2025-10-22T23:29:02.085705] [INFO ] [MAIN ] CDLR: Loaded 10195 primary data records. [2025-10-22T23:29:02.450797] [DEBUG] [MAIN ] CDLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:02.477820] [INFO ] [MAIN ] CDLR: Generated 138 derivative records from 10195 primary records. [2025-10-22T23:29:02.478030] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-22T23:29:02.489461] [DEBUG] [LOCAL ] CDLR: Derivative data saved (138 records). [2025-10-22T23:29:02.489546] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-22T23:29:02.491931] [INFO ] [MAIN ] Derivative Progress: 341/2052 symbols. CDLR took 0.4s. Estimated remaining time: 11m 13s [2025-10-22T23:29:02.492045] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:02.534433] [DEBUG] [LOCAL ] CDP: Loaded 42262 existing records from primary storage. [2025-10-22T23:29:02.534610] [INFO ] [MAIN ] CDP: Loaded 42262 primary data records. [2025-10-22T23:29:02.865632] [DEBUG] [MAIN ] CDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:02.891129] [INFO ] [MAIN ] CDP: Generated 138 derivative records from 42262 primary records. [2025-10-22T23:29:02.891272] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-22T23:29:02.903099] [DEBUG] [LOCAL ] CDP: Derivative data saved (138 records). [2025-10-22T23:29:02.903184] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-22T23:29:02.906151] [INFO ] [MAIN ] Derivative Progress: 342/2052 symbols. CDP took 0.4s. Estimated remaining time: 11m 13s [2025-10-22T23:29:02.906259] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:02.929563] [DEBUG] [LOCAL ] CDRE: Loaded 24728 existing records from primary storage. [2025-10-22T23:29:02.929742] [INFO ] [MAIN ] CDRE: Loaded 24728 primary data records. [2025-10-22T23:29:03.234416] [DEBUG] [MAIN ] CDRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:03.259563] [INFO ] [MAIN ] CDRE: Generated 138 derivative records from 24728 primary records. [2025-10-22T23:29:03.259727] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-22T23:29:03.271176] [DEBUG] [LOCAL ] CDRE: Derivative data saved (138 records). [2025-10-22T23:29:03.271261] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-22T23:29:03.273946] [INFO ] [MAIN ] Derivative Progress: 343/2052 symbols. CDRE took 0.4s. Estimated remaining time: 11m 12s [2025-10-22T23:29:03.274053] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:03.321339] [DEBUG] [LOCAL ] CE: Loaded 51253 existing records from primary storage. [2025-10-22T23:29:03.321506] [INFO ] [MAIN ] CE: Loaded 51253 primary data records. [2025-10-22T23:29:03.630303] [DEBUG] [MAIN ] CE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:03.657862] [INFO ] [MAIN ] CE: Generated 138 derivative records from 51253 primary records. [2025-10-22T23:29:03.658008] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-22T23:29:03.670316] [DEBUG] [LOCAL ] CE: Derivative data saved (138 records). [2025-10-22T23:29:03.670419] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-22T23:29:03.673559] [INFO ] [MAIN ] Derivative Progress: 344/2052 symbols. CE took 0.4s. Estimated remaining time: 11m 12s [2025-10-22T23:29:03.673717] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:03.700820] [DEBUG] [LOCAL ] CEPU: Loaded 27008 existing records from primary storage. [2025-10-22T23:29:03.700979] [INFO ] [MAIN ] CEPU: Loaded 27008 primary data records. [2025-10-22T23:29:04.013080] [DEBUG] [MAIN ] CEPU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:04.038751] [INFO ] [MAIN ] CEPU: Generated 138 derivative records from 27008 primary records. [2025-10-22T23:29:04.038912] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-22T23:29:04.050559] [DEBUG] [LOCAL ] CEPU: Derivative data saved (138 records). [2025-10-22T23:29:04.050676] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-22T23:29:04.053523] [INFO ] [MAIN ] Derivative Progress: 345/2052 symbols. CEPU took 0.4s. Estimated remaining time: 11m 11s [2025-10-22T23:29:04.053679] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:04.102839] [DEBUG] [LOCAL ] CFG: Loaded 53623 existing records from primary storage. [2025-10-22T23:29:04.103006] [INFO ] [MAIN ] CFG: Loaded 53623 primary data records. [2025-10-22T23:29:04.410781] [DEBUG] [MAIN ] CFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:04.435810] [INFO ] [MAIN ] CFG: Generated 138 derivative records from 53623 primary records. [2025-10-22T23:29:04.435949] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-22T23:29:04.447628] [DEBUG] [LOCAL ] CFG: Derivative data saved (138 records). [2025-10-22T23:29:04.447731] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-22T23:29:04.450962] [INFO ] [MAIN ] Derivative Progress: 346/2052 symbols. CFG took 0.4s. Estimated remaining time: 11m 11s [2025-10-22T23:29:04.451065] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:04.490480] [DEBUG] [LOCAL ] CGAU: Loaded 43921 existing records from primary storage. [2025-10-22T23:29:04.490637] [INFO ] [MAIN ] CGAU: Loaded 43921 primary data records. [2025-10-22T23:29:04.817073] [DEBUG] [MAIN ] CGAU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:04.842120] [INFO ] [MAIN ] CGAU: Generated 138 derivative records from 43921 primary records. [2025-10-22T23:29:04.842250] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-22T23:29:04.856626] [DEBUG] [LOCAL ] CGAU: Derivative data saved (138 records). [2025-10-22T23:29:04.856762] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-10-22T23:29:04.860027] [INFO ] [MAIN ] Derivative Progress: 347/2052 symbols. CGAU took 0.4s. Estimated remaining time: 11m 11s [2025-10-22T23:29:04.860133] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:04.863287] [DEBUG] [LOCAL ] CGV: Loaded 1359 existing records from primary storage. [2025-10-22T23:29:04.863376] [INFO ] [MAIN ] CGV: Loaded 1359 primary data records. [2025-10-22T23:29:05.164698] [DEBUG] [MAIN ] CGV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:29:05.190279] [INFO ] [MAIN ] CGV: Generated 138 derivative records from 1359 primary records. [2025-10-22T23:29:05.190402] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-22T23:29:05.199724] [DEBUG] [LOCAL ] CGV: Derivative data saved (138 records). [2025-10-22T23:29:05.199834] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-22T23:29:05.202092] [INFO ] [MAIN ] Derivative Progress: 348/2052 symbols. CGV took 0.3s. Estimated remaining time: 11m 10s [2025-10-22T23:29:05.202194] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:05.224355] [DEBUG] [LOCAL ] CHCT: Loaded 24266 existing records from primary storage. [2025-10-22T23:29:05.224501] [INFO ] [MAIN ] CHCT: Loaded 24266 primary data records. [2025-10-22T23:29:05.526838] [DEBUG] [MAIN ] CHCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:05.555975] [INFO ] [MAIN ] CHCT: Generated 138 derivative records from 24266 primary records. [2025-10-22T23:29:05.556118] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-10-22T23:29:05.567893] [DEBUG] [LOCAL ] CHCT: Derivative data saved (138 records). [2025-10-22T23:29:05.567977] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-10-22T23:29:05.570915] [INFO ] [MAIN ] Derivative Progress: 349/2052 symbols. CHCT took 0.4s. Estimated remaining time: 11m 10s [2025-10-22T23:29:05.571026] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:05.619738] [DEBUG] [LOCAL ] CHD: Loaded 52320 existing records from primary storage. [2025-10-22T23:29:05.619909] [INFO ] [MAIN ] CHD: Loaded 52320 primary data records. [2025-10-22T23:29:05.925267] [DEBUG] [MAIN ] CHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:05.950609] [INFO ] [MAIN ] CHD: Generated 138 derivative records from 52320 primary records. [2025-10-22T23:29:05.950762] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-22T23:29:05.962337] [DEBUG] [LOCAL ] CHD: Derivative data saved (138 records). [2025-10-22T23:29:05.962421] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-10-22T23:29:05.965746] [INFO ] [MAIN ] Derivative Progress: 350/2052 symbols. CHD took 0.4s. Estimated remaining time: 11m 9s [2025-10-22T23:29:05.965870] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:05.982973] [DEBUG] [LOCAL ] CHE: Loaded 15327 existing records from primary storage. [2025-10-22T23:29:05.983119] [INFO ] [MAIN ] CHE: Loaded 15327 primary data records. [2025-10-22T23:29:06.315124] [DEBUG] [MAIN ] CHE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:06.340296] [INFO ] [MAIN ] CHE: Generated 138 derivative records from 15327 primary records. [2025-10-22T23:29:06.340439] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-22T23:29:06.352193] [DEBUG] [LOCAL ] CHE: Derivative data saved (138 records). [2025-10-22T23:29:06.352275] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-22T23:29:06.355096] [INFO ] [MAIN ] Derivative Progress: 351/2052 symbols. CHE took 0.4s. Estimated remaining time: 11m 9s [2025-10-22T23:29:06.355197] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:06.398195] [DEBUG] [LOCAL ] CHGG: Loaded 47586 existing records from primary storage. [2025-10-22T23:29:06.398358] [INFO ] [MAIN ] CHGG: Loaded 47586 primary data records. [2025-10-22T23:29:06.725217] [DEBUG] [MAIN ] CHGG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:06.750404] [INFO ] [MAIN ] CHGG: Generated 138 derivative records from 47586 primary records. [2025-10-22T23:29:06.750566] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-10-22T23:29:06.762320] [DEBUG] [LOCAL ] CHGG: Derivative data saved (138 records). [2025-10-22T23:29:06.762408] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-10-22T23:29:06.765262] [INFO ] [MAIN ] Derivative Progress: 352/2052 symbols. CHGG took 0.4s. Estimated remaining time: 11m 9s [2025-10-22T23:29:06.765369] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:06.797360] [DEBUG] [LOCAL ] CHH: Loaded 32225 existing records from primary storage. [2025-10-22T23:29:06.797524] [INFO ] [MAIN ] CHH: Loaded 32225 primary data records. [2025-10-22T23:29:07.112146] [DEBUG] [MAIN ] CHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:07.137848] [INFO ] [MAIN ] CHH: Generated 138 derivative records from 32225 primary records. [2025-10-22T23:29:07.138002] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-22T23:29:07.149771] [DEBUG] [LOCAL ] CHH: Derivative data saved (138 records). [2025-10-22T23:29:07.149856] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-10-22T23:29:07.152830] [INFO ] [MAIN ] Derivative Progress: 353/2052 symbols. CHH took 0.4s. Estimated remaining time: 11m 8s [2025-10-22T23:29:07.152931] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:07.173185] [DEBUG] [LOCAL ] CHMI: Loaded 21188 existing records from primary storage. [2025-10-22T23:29:07.173325] [INFO ] [MAIN ] CHMI: Loaded 21188 primary data records. [2025-10-22T23:29:07.485468] [DEBUG] [MAIN ] CHMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:07.511363] [INFO ] [MAIN ] CHMI: Generated 138 derivative records from 21188 primary records. [2025-10-22T23:29:07.511487] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-10-22T23:29:07.522812] [DEBUG] [LOCAL ] CHMI: Derivative data saved (138 records). [2025-10-22T23:29:07.522899] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-10-22T23:29:07.525800] [INFO ] [MAIN ] Derivative Progress: 354/2052 symbols. CHMI took 0.4s. Estimated remaining time: 11m 8s [2025-10-22T23:29:07.525905] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:07.534706] [DEBUG] [LOCAL ] CHN: Loaded 4983 existing records from primary storage. [2025-10-22T23:29:07.534827] [INFO ] [MAIN ] CHN: Loaded 4983 primary data records. [2025-10-22T23:29:07.860705] [DEBUG] [MAIN ] CHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:07.888096] [INFO ] [MAIN ] CHN: Generated 138 derivative records from 4983 primary records. [2025-10-22T23:29:07.888348] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-10-22T23:29:07.899135] [DEBUG] [LOCAL ] CHN: Derivative data saved (138 records). [2025-10-22T23:29:07.899252] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-10-22T23:29:07.901691] [INFO ] [MAIN ] Derivative Progress: 355/2052 symbols. CHN took 0.4s. Estimated remaining time: 11m 7s [2025-10-22T23:29:07.901814] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:07.947359] [DEBUG] [LOCAL ] CHPT: Loaded 47004 existing records from primary storage. [2025-10-22T23:29:07.947525] [INFO ] [MAIN ] CHPT: Loaded 47004 primary data records. [2025-10-22T23:29:08.254835] [DEBUG] [MAIN ] CHPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:08.280230] [INFO ] [MAIN ] CHPT: Generated 138 derivative records from 47004 primary records. [2025-10-22T23:29:08.280358] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-10-22T23:29:08.292015] [DEBUG] [LOCAL ] CHPT: Derivative data saved (138 records). [2025-10-22T23:29:08.292099] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-10-22T23:29:08.295237] [INFO ] [MAIN ] Derivative Progress: 356/2052 symbols. CHPT took 0.4s. Estimated remaining time: 11m 7s [2025-10-22T23:29:08.295336] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:08.312212] [DEBUG] [LOCAL ] CIA: Loaded 16492 existing records from primary storage. [2025-10-22T23:29:08.312346] [INFO ] [MAIN ] CIA: Loaded 16492 primary data records. [2025-10-22T23:29:08.649427] [DEBUG] [MAIN ] CIA: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:29:08.675171] [INFO ] [MAIN ] CIA: Generated 138 derivative records from 16492 primary records. [2025-10-22T23:29:08.675292] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-22T23:29:08.686826] [DEBUG] [LOCAL ] CIA: Derivative data saved (138 records). [2025-10-22T23:29:08.686913] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-10-22T23:29:08.689310] [INFO ] [MAIN ] Derivative Progress: 357/2052 symbols. CIA took 0.4s. Estimated remaining time: 11m 6s [2025-10-22T23:29:08.689412] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:08.717314] [DEBUG] [LOCAL ] CIB: Loaded 30292 existing records from primary storage. [2025-10-22T23:29:08.717474] [INFO ] [MAIN ] CIB: Loaded 30292 primary data records. [2025-10-22T23:29:09.026062] [DEBUG] [MAIN ] CIB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:09.055946] [INFO ] [MAIN ] CIB: Generated 138 derivative records from 30292 primary records. [2025-10-22T23:29:09.056112] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-10-22T23:29:09.067961] [DEBUG] [LOCAL ] CIB: Derivative data saved (138 records). [2025-10-22T23:29:09.068043] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-10-22T23:29:09.070999] [INFO ] [MAIN ] Derivative Progress: 358/2052 symbols. CIB took 0.4s. Estimated remaining time: 11m 6s [2025-10-22T23:29:09.071099] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:09.119676] [DEBUG] [LOCAL ] CIEN: Loaded 52121 existing records from primary storage. [2025-10-22T23:29:09.119834] [INFO ] [MAIN ] CIEN: Loaded 52121 primary data records. [2025-10-22T23:29:09.428045] [DEBUG] [MAIN ] CIEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:09.453473] [INFO ] [MAIN ] CIEN: Generated 138 derivative records from 52121 primary records. [2025-10-22T23:29:09.453597] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-10-22T23:29:09.465171] [DEBUG] [LOCAL ] CIEN: Derivative data saved (138 records). [2025-10-22T23:29:09.465252] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-10-22T23:29:09.468422] [INFO ] [MAIN ] Derivative Progress: 359/2052 symbols. CIEN took 0.4s. Estimated remaining time: 11m 6s [2025-10-22T23:29:09.468528] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:09.476107] [DEBUG] [LOCAL ] CIF: Loaded 3978 existing records from primary storage. [2025-10-22T23:29:09.476216] [INFO ] [MAIN ] CIF: Loaded 3978 primary data records. [2025-10-22T23:29:09.783269] [DEBUG] [MAIN ] CIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:09.808715] [INFO ] [MAIN ] CIF: Generated 138 derivative records from 3978 primary records. [2025-10-22T23:29:09.808833] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-10-22T23:29:09.818667] [DEBUG] [LOCAL ] CIF: Derivative data saved (138 records). [2025-10-22T23:29:09.818754] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-10-22T23:29:09.820830] [INFO ] [MAIN ] Derivative Progress: 360/2052 symbols. CIF took 0.4s. Estimated remaining time: 11m 5s [2025-10-22T23:29:09.820931] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:09.861864] [DEBUG] [LOCAL ] CIG: Loaded 44526 existing records from primary storage. [2025-10-22T23:29:09.862018] [INFO ] [MAIN ] CIG: Loaded 44526 primary data records. [2025-10-22T23:29:10.169831] [DEBUG] [MAIN ] CIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:10.195526] [INFO ] [MAIN ] CIG: Generated 138 derivative records from 44526 primary records. [2025-10-22T23:29:10.195689] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-10-22T23:29:10.207235] [DEBUG] [LOCAL ] CIG: Derivative data saved (138 records). [2025-10-22T23:29:10.207361] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-10-22T23:29:10.210504] [INFO ] [MAIN ] Derivative Progress: 361/2052 symbols. CIG took 0.4s. Estimated remaining time: 11m 5s [2025-10-22T23:29:10.210607] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:10.227404] [DEBUG] [LOCAL ] CII: Loaded 15134 existing records from primary storage. [2025-10-22T23:29:10.227554] [INFO ] [MAIN ] CII: Loaded 15134 primary data records. [2025-10-22T23:29:10.573148] [DEBUG] [MAIN ] CII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:10.599062] [INFO ] [MAIN ] CII: Generated 138 derivative records from 15134 primary records. [2025-10-22T23:29:10.599191] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-10-22T23:29:10.610576] [DEBUG] [LOCAL ] CII: Derivative data saved (138 records). [2025-10-22T23:29:10.610682] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-10-22T23:29:10.613324] [INFO ] [MAIN ] Derivative Progress: 362/2052 symbols. CII took 0.4s. Estimated remaining time: 11m 4s [2025-10-22T23:29:10.613424] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:10.648246] [DEBUG] [LOCAL ] CIM: Loaded 37394 existing records from primary storage. [2025-10-22T23:29:10.648410] [INFO ] [MAIN ] CIM: Loaded 37394 primary data records. [2025-10-22T23:29:10.956198] [DEBUG] [MAIN ] CIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:10.981393] [INFO ] [MAIN ] CIM: Generated 138 derivative records from 37394 primary records. [2025-10-22T23:29:10.981517] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-10-22T23:29:10.993302] [DEBUG] [LOCAL ] CIM: Derivative data saved (138 records). [2025-10-22T23:29:10.993384] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-10-22T23:29:10.996263] [INFO ] [MAIN ] Derivative Progress: 363/2052 symbols. CIM took 0.4s. Estimated remaining time: 11m 4s [2025-10-22T23:29:10.996364] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:11.000936] [DEBUG] [LOCAL ] CIMN: Loaded 2705 existing records from primary storage. [2025-10-22T23:29:11.001034] [INFO ] [MAIN ] CIMN: Loaded 2705 primary data records. [2025-10-22T23:29:11.306327] [DEBUG] [MAIN ] CIMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:11.331405] [INFO ] [MAIN ] CIMN: Generated 138 derivative records from 2705 primary records. [2025-10-22T23:29:11.331529] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-10-22T23:29:11.341059] [DEBUG] [LOCAL ] CIMN: Derivative data saved (138 records). [2025-10-22T23:29:11.341151] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-10-22T23:29:11.343369] [INFO ] [MAIN ] Derivative Progress: 364/2052 symbols. CIMN took 0.3s. Estimated remaining time: 11m 3s [2025-10-22T23:29:11.343469] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:11.361756] [DEBUG] [LOCAL ] CINT: Loaded 20384 existing records from primary storage. [2025-10-22T23:29:11.361907] [INFO ] [MAIN ] CINT: Loaded 20384 primary data records. [2025-10-22T23:29:11.696197] [DEBUG] [MAIN ] CINT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:11.727347] [INFO ] [MAIN ] CINT: Generated 138 derivative records from 20384 primary records. [2025-10-22T23:29:11.727638] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-10-22T23:29:11.743963] [DEBUG] [LOCAL ] CINT: Derivative data saved (138 records). [2025-10-22T23:29:11.744119] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-10-22T23:29:11.747029] [INFO ] [MAIN ] Derivative Progress: 365/2052 symbols. CINT took 0.4s. Estimated remaining time: 11m 3s [2025-10-22T23:29:11.747135] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:11.776057] [DEBUG] [LOCAL ] CIO: Loaded 21207 existing records from primary storage. [2025-10-22T23:29:11.776235] [INFO ] [MAIN ] CIO: Loaded 21207 primary data records. [2025-10-22T23:29:12.118434] [DEBUG] [MAIN ] CIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:12.144181] [INFO ] [MAIN ] CIO: Generated 138 derivative records from 21207 primary records. [2025-10-22T23:29:12.144360] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-22T23:29:12.156119] [DEBUG] [LOCAL ] CIO: Derivative data saved (138 records). [2025-10-22T23:29:12.156237] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-10-22T23:29:12.159148] [INFO ] [MAIN ] Derivative Progress: 366/2052 symbols. CIO took 0.4s. Estimated remaining time: 11m 2s [2025-10-22T23:29:12.159253] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:12.186766] [DEBUG] [LOCAL ] CION: Loaded 28073 existing records from primary storage. [2025-10-22T23:29:12.186922] [INFO ] [MAIN ] CION: Loaded 28073 primary data records. [2025-10-22T23:29:12.517682] [DEBUG] [MAIN ] CION: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:12.544606] [INFO ] [MAIN ] CION: Generated 138 derivative records from 28073 primary records. [2025-10-22T23:29:12.544773] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-10-22T23:29:12.556701] [DEBUG] [LOCAL ] CION: Derivative data saved (138 records). [2025-10-22T23:29:12.556805] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-10-22T23:29:12.559870] [INFO ] [MAIN ] Derivative Progress: 367/2052 symbols. CION took 0.4s. Estimated remaining time: 11m 2s [2025-10-22T23:29:12.559975] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:12.609626] [DEBUG] [LOCAL ] CIVI: Loaded 52730 existing records from primary storage. [2025-10-22T23:29:12.609827] [INFO ] [MAIN ] CIVI: Loaded 52730 primary data records. [2025-10-22T23:29:12.963483] [DEBUG] [MAIN ] CIVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:12.989367] [INFO ] [MAIN ] CIVI: Generated 138 derivative records from 52730 primary records. [2025-10-22T23:29:12.989483] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-22T23:29:13.001443] [DEBUG] [LOCAL ] CIVI: Derivative data saved (138 records). [2025-10-22T23:29:13.001541] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-22T23:29:13.006317] [INFO ] [MAIN ] Derivative Progress: 368/2052 symbols. CIVI took 0.4s. Estimated remaining time: 11m 2s [2025-10-22T23:29:13.006438] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:13.056583] [DEBUG] [LOCAL ] CL: Loaded 53649 existing records from primary storage. [2025-10-22T23:29:13.056795] [INFO ] [MAIN ] CL: Loaded 53649 primary data records. [2025-10-22T23:29:13.369734] [DEBUG] [MAIN ] CL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:13.395125] [INFO ] [MAIN ] CL: Generated 138 derivative records from 53649 primary records. [2025-10-22T23:29:13.395323] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-10-22T23:29:13.406956] [DEBUG] [LOCAL ] CL: Derivative data saved (138 records). [2025-10-22T23:29:13.407059] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-10-22T23:29:13.410203] [INFO ] [MAIN ] Derivative Progress: 369/2052 symbols. CL took 0.4s. Estimated remaining time: 11m 2s [2025-10-22T23:29:13.410315] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:13.442870] [DEBUG] [LOCAL ] CLB: Loaded 33453 existing records from primary storage. [2025-10-22T23:29:13.443038] [INFO ] [MAIN ] CLB: Loaded 33453 primary data records. [2025-10-22T23:29:13.752632] [DEBUG] [MAIN ] CLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:13.777969] [INFO ] [MAIN ] CLB: Generated 138 derivative records from 33453 primary records. [2025-10-22T23:29:13.778085] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-10-22T23:29:13.789478] [DEBUG] [LOCAL ] CLB: Derivative data saved (138 records). [2025-10-22T23:29:13.789557] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-10-22T23:29:13.792466] [INFO ] [MAIN ] Derivative Progress: 370/2052 symbols. CLB took 0.4s. Estimated remaining time: 11m 1s [2025-10-22T23:29:13.792572] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:13.816084] [DEBUG] [LOCAL ] CLDT: Loaded 25165 existing records from primary storage. [2025-10-22T23:29:13.816237] [INFO ] [MAIN ] CLDT: Loaded 25165 primary data records. [2025-10-22T23:29:14.122073] [DEBUG] [MAIN ] CLDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:14.147671] [INFO ] [MAIN ] CLDT: Generated 138 derivative records from 25165 primary records. [2025-10-22T23:29:14.147797] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-22T23:29:14.158746] [DEBUG] [LOCAL ] CLDT: Derivative data saved (138 records). [2025-10-22T23:29:14.158827] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-10-22T23:29:14.161629] [INFO ] [MAIN ] Derivative Progress: 371/2052 symbols. CLDT took 0.4s. Estimated remaining time: 11m 1s [2025-10-22T23:29:14.161764] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:14.212249] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-22T23:29:14.212415] [INFO ] [MAIN ] CLF: Loaded 53741 primary data records. [2025-10-22T23:29:14.527210] [DEBUG] [MAIN ] CLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:14.552705] [INFO ] [MAIN ] CLF: Generated 138 derivative records from 53741 primary records. [2025-10-22T23:29:14.552890] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-10-22T23:29:14.564606] [DEBUG] [LOCAL ] CLF: Derivative data saved (138 records). [2025-10-22T23:29:14.564720] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-10-22T23:29:14.567938] [INFO ] [MAIN ] Derivative Progress: 372/2052 symbols. CLF took 0.4s. Estimated remaining time: 11m 0s [2025-10-22T23:29:14.568040] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:14.594618] [DEBUG] [LOCAL ] CLH: Loaded 27584 existing records from primary storage. [2025-10-22T23:29:14.594793] [INFO ] [MAIN ] CLH: Loaded 27584 primary data records. [2025-10-22T23:29:14.925757] [DEBUG] [MAIN ] CLH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:14.951823] [INFO ] [MAIN ] CLH: Generated 138 derivative records from 27584 primary records. [2025-10-22T23:29:14.951959] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-22T23:29:14.963632] [DEBUG] [LOCAL ] CLH: Derivative data saved (138 records). [2025-10-22T23:29:14.963735] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-10-22T23:29:14.966611] [INFO ] [MAIN ] Derivative Progress: 373/2052 symbols. CLH took 0.4s. Estimated remaining time: 10m 60s [2025-10-22T23:29:14.966752] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:14.979225] [DEBUG] [LOCAL ] CLPR: Loaded 9996 existing records from primary storage. [2025-10-22T23:29:14.979360] [INFO ] [MAIN ] CLPR: Loaded 9996 primary data records. [2025-10-22T23:29:15.284860] [DEBUG] [MAIN ] CLPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:15.310406] [INFO ] [MAIN ] CLPR: Generated 138 derivative records from 9996 primary records. [2025-10-22T23:29:15.310513] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-10-22T23:29:15.321772] [DEBUG] [LOCAL ] CLPR: Derivative data saved (138 records). [2025-10-22T23:29:15.321859] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-10-22T23:29:15.324085] [INFO ] [MAIN ] Derivative Progress: 374/2052 symbols. CLPR took 0.4s. Estimated remaining time: 10m 59s [2025-10-22T23:29:15.324186] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:15.375845] [DEBUG] [LOCAL ] CLS: Loaded 53563 existing records from primary storage. [2025-10-22T23:29:15.376019] [INFO ] [MAIN ] CLS: Loaded 53563 primary data records. [2025-10-22T23:29:15.682358] [DEBUG] [MAIN ] CLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:15.707320] [INFO ] [MAIN ] CLS: Generated 138 derivative records from 53563 primary records. [2025-10-22T23:29:15.707502] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-10-22T23:29:15.719815] [DEBUG] [LOCAL ] CLS: Derivative data saved (138 records). [2025-10-22T23:29:15.719946] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-10-22T23:29:15.723079] [INFO ] [MAIN ] Derivative Progress: 375/2052 symbols. CLS took 0.4s. Estimated remaining time: 10m 59s [2025-10-22T23:29:15.723206] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:15.780749] [DEBUG] [LOCAL ] CLVT: Loaded 51912 existing records from primary storage. [2025-10-22T23:29:15.780920] [INFO ] [MAIN ] CLVT: Loaded 51912 primary data records. [2025-10-22T23:29:16.089258] [DEBUG] [MAIN ] CLVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:16.115579] [INFO ] [MAIN ] CLVT: Generated 138 derivative records from 51912 primary records. [2025-10-22T23:29:16.115797] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-10-22T23:29:16.128084] [DEBUG] [LOCAL ] CLVT: Derivative data saved (138 records). [2025-10-22T23:29:16.128224] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-10-22T23:29:16.131406] [INFO ] [MAIN ] Derivative Progress: 376/2052 symbols. CLVT took 0.4s. Estimated remaining time: 10m 59s [2025-10-22T23:29:16.131531] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:16.152730] [DEBUG] [LOCAL ] CLW: Loaded 21127 existing records from primary storage. [2025-10-22T23:29:16.152897] [INFO ] [MAIN ] CLW: Loaded 21127 primary data records. [2025-10-22T23:29:16.478462] [DEBUG] [MAIN ] CLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:16.504883] [INFO ] [MAIN ] CLW: Generated 138 derivative records from 21127 primary records. [2025-10-22T23:29:16.505127] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-22T23:29:16.517036] [DEBUG] [LOCAL ] CLW: Derivative data saved (138 records). [2025-10-22T23:29:16.517199] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-22T23:29:16.520045] [INFO ] [MAIN ] Derivative Progress: 377/2052 symbols. CLW took 0.4s. Estimated remaining time: 10m 58s [2025-10-22T23:29:16.520161] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:16.575872] [DEBUG] [LOCAL ] CLX: Loaded 51814 existing records from primary storage. [2025-10-22T23:29:16.576089] [INFO ] [MAIN ] CLX: Loaded 51814 primary data records. [2025-10-22T23:29:16.921053] [DEBUG] [MAIN ] CLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:16.947186] [INFO ] [MAIN ] CLX: Generated 138 derivative records from 51814 primary records. [2025-10-22T23:29:16.947328] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-22T23:29:16.959201] [DEBUG] [LOCAL ] CLX: Derivative data saved (138 records). [2025-10-22T23:29:16.959281] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-10-22T23:29:16.962348] [INFO ] [MAIN ] Derivative Progress: 378/2052 symbols. CLX took 0.4s. Estimated remaining time: 10m 58s [2025-10-22T23:29:16.962456] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:17.005598] [DEBUG] [LOCAL ] CM: Loaded 48431 existing records from primary storage. [2025-10-22T23:29:17.005784] [INFO ] [MAIN ] CM: Loaded 48431 primary data records. [2025-10-22T23:29:17.328932] [DEBUG] [MAIN ] CM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:17.354249] [INFO ] [MAIN ] CM: Generated 138 derivative records from 48431 primary records. [2025-10-22T23:29:17.354369] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-22T23:29:17.366036] [DEBUG] [LOCAL ] CM: Derivative data saved (138 records). [2025-10-22T23:29:17.366127] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-22T23:29:17.369102] [INFO ] [MAIN ] Derivative Progress: 379/2052 symbols. CM took 0.4s. Estimated remaining time: 10m 58s [2025-10-22T23:29:17.369220] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:17.415973] [DEBUG] [LOCAL ] CMA: Loaded 50170 existing records from primary storage. [2025-10-22T23:29:17.416140] [INFO ] [MAIN ] CMA: Loaded 50170 primary data records. [2025-10-22T23:29:17.718870] [DEBUG] [MAIN ] CMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:17.743966] [INFO ] [MAIN ] CMA: Generated 138 derivative records from 50170 primary records. [2025-10-22T23:29:17.744096] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-10-22T23:29:17.755666] [DEBUG] [LOCAL ] CMA: Derivative data saved (138 records). [2025-10-22T23:29:17.755754] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-10-22T23:29:17.758529] [INFO ] [MAIN ] Derivative Progress: 380/2052 symbols. CMA took 0.4s. Estimated remaining time: 10m 57s [2025-10-22T23:29:17.758635] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:17.784839] [DEBUG] [LOCAL ] CMBT: Loaded 27509 existing records from primary storage. [2025-10-22T23:29:17.784996] [INFO ] [MAIN ] CMBT: Loaded 27509 primary data records. [2025-10-22T23:29:18.090990] [DEBUG] [MAIN ] CMBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:18.119303] [INFO ] [MAIN ] CMBT: Generated 138 derivative records from 27509 primary records. [2025-10-22T23:29:18.119437] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-22T23:29:18.131138] [DEBUG] [LOCAL ] CMBT: Derivative data saved (138 records). [2025-10-22T23:29:18.131229] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-22T23:29:18.133980] [INFO ] [MAIN ] Derivative Progress: 381/2052 symbols. CMBT took 0.4s. Estimated remaining time: 10m 57s [2025-10-22T23:29:18.134087] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:18.176894] [DEBUG] [LOCAL ] CMC: Loaded 45548 existing records from primary storage. [2025-10-22T23:29:18.177063] [INFO ] [MAIN ] CMC: Loaded 45548 primary data records. [2025-10-22T23:29:18.519866] [DEBUG] [MAIN ] CMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:18.545503] [INFO ] [MAIN ] CMC: Generated 138 derivative records from 45548 primary records. [2025-10-22T23:29:18.545632] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-22T23:29:18.557189] [DEBUG] [LOCAL ] CMC: Derivative data saved (138 records). [2025-10-22T23:29:18.557281] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-10-22T23:29:18.561072] [INFO ] [MAIN ] Derivative Progress: 382/2052 symbols. CMC took 0.4s. Estimated remaining time: 10m 57s [2025-10-22T23:29:18.561173] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:18.569737] [DEBUG] [LOCAL ] CMCM: Loaded 4828 existing records from primary storage. [2025-10-22T23:29:18.569864] [INFO ] [MAIN ] CMCM: Loaded 4828 primary data records. [2025-10-22T23:29:18.891758] [DEBUG] [MAIN ] CMCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:18.917343] [INFO ] [MAIN ] CMCM: Generated 138 derivative records from 4828 primary records. [2025-10-22T23:29:18.917459] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-22T23:29:18.927045] [DEBUG] [LOCAL ] CMCM: Derivative data saved (138 records). [2025-10-22T23:29:18.927128] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-22T23:29:18.929135] [INFO ] [MAIN ] Derivative Progress: 383/2052 symbols. CMCM took 0.4s. Estimated remaining time: 10m 56s [2025-10-22T23:29:18.929230] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:18.969417] [DEBUG] [LOCAL ] CMI: Loaded 41637 existing records from primary storage. [2025-10-22T23:29:18.969575] [INFO ] [MAIN ] CMI: Loaded 41637 primary data records. [2025-10-22T23:29:19.301368] [DEBUG] [MAIN ] CMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:19.326548] [INFO ] [MAIN ] CMI: Generated 138 derivative records from 41637 primary records. [2025-10-22T23:29:19.326706] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-22T23:29:19.338456] [DEBUG] [LOCAL ] CMI: Derivative data saved (138 records). [2025-10-22T23:29:19.338536] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-22T23:29:19.341346] [INFO ] [MAIN ] Derivative Progress: 384/2052 symbols. CMI took 0.4s. Estimated remaining time: 10m 56s [2025-10-22T23:29:19.341443] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:19.374296] [DEBUG] [LOCAL ] CMP: Loaded 35683 existing records from primary storage. [2025-10-22T23:29:19.374451] [INFO ] [MAIN ] CMP: Loaded 35683 primary data records. [2025-10-22T23:29:19.682156] [DEBUG] [MAIN ] CMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:19.707458] [INFO ] [MAIN ] CMP: Generated 138 derivative records from 35683 primary records. [2025-10-22T23:29:19.707587] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-22T23:29:19.719048] [DEBUG] [LOCAL ] CMP: Derivative data saved (138 records). [2025-10-22T23:29:19.719129] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-22T23:29:19.721970] [INFO ] [MAIN ] Derivative Progress: 385/2052 symbols. CMP took 0.4s. Estimated remaining time: 10m 55s [2025-10-22T23:29:19.722067] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:19.757420] [DEBUG] [LOCAL ] CMPO: Loaded 38424 existing records from primary storage. [2025-10-22T23:29:19.757581] [INFO ] [MAIN ] CMPO: Loaded 38424 primary data records. [2025-10-22T23:29:20.070956] [DEBUG] [MAIN ] CMPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:20.096993] [INFO ] [MAIN ] CMPO: Generated 138 derivative records from 38424 primary records. [2025-10-22T23:29:20.097119] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-22T23:29:20.108766] [DEBUG] [LOCAL ] CMPO: Derivative data saved (138 records). [2025-10-22T23:29:20.108856] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-22T23:29:20.111790] [INFO ] [MAIN ] Derivative Progress: 386/2052 symbols. CMPO took 0.4s. Estimated remaining time: 10m 55s [2025-10-22T23:29:20.111894] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:20.145366] [DEBUG] [LOCAL ] CMRE: Loaded 35651 existing records from primary storage. [2025-10-22T23:29:20.145545] [INFO ] [MAIN ] CMRE: Loaded 35651 primary data records. [2025-10-22T23:29:20.460109] [DEBUG] [MAIN ] CMRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:20.485714] [INFO ] [MAIN ] CMRE: Generated 138 derivative records from 35651 primary records. [2025-10-22T23:29:20.485869] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-10-22T23:29:20.497240] [DEBUG] [LOCAL ] CMRE: Derivative data saved (138 records). [2025-10-22T23:29:20.497350] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-10-22T23:29:20.500203] [INFO ] [MAIN ] Derivative Progress: 387/2052 symbols. CMRE took 0.4s. Estimated remaining time: 10m 55s [2025-10-22T23:29:20.500301] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:20.548399] [DEBUG] [LOCAL ] CMS: Loaded 52551 existing records from primary storage. [2025-10-22T23:29:20.548558] [INFO ] [MAIN ] CMS: Loaded 52551 primary data records. [2025-10-22T23:29:20.859806] [DEBUG] [MAIN ] CMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:20.885442] [INFO ] [MAIN ] CMS: Generated 138 derivative records from 52551 primary records. [2025-10-22T23:29:20.885612] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-10-22T23:29:20.897327] [DEBUG] [LOCAL ] CMS: Derivative data saved (138 records). [2025-10-22T23:29:20.897447] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-10-22T23:29:20.900549] [INFO ] [MAIN ] Derivative Progress: 388/2052 symbols. CMS took 0.4s. Estimated remaining time: 10m 54s [2025-10-22T23:29:20.900683] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:20.905980] [DEBUG] [LOCAL ] CMSA: Loaded 3471 existing records from primary storage. [2025-10-22T23:29:20.906090] [INFO ] [MAIN ] CMSA: Loaded 3471 primary data records. [2025-10-22T23:29:21.234416] [DEBUG] [MAIN ] CMSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:21.259735] [INFO ] [MAIN ] CMSA: Generated 138 derivative records from 3471 primary records. [2025-10-22T23:29:21.259851] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-10-22T23:29:21.270101] [DEBUG] [LOCAL ] CMSA: Derivative data saved (138 records). [2025-10-22T23:29:21.270187] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-10-22T23:29:21.272354] [INFO ] [MAIN ] Derivative Progress: 389/2052 symbols. CMSA took 0.4s. Estimated remaining time: 10m 54s [2025-10-22T23:29:21.272463] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:21.278983] [DEBUG] [LOCAL ] CMSC: Loaded 4809 existing records from primary storage. [2025-10-22T23:29:21.279094] [INFO ] [MAIN ] CMSC: Loaded 4809 primary data records. [2025-10-22T23:29:21.582538] [DEBUG] [MAIN ] CMSC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:21.607606] [INFO ] [MAIN ] CMSC: Generated 138 derivative records from 4809 primary records. [2025-10-22T23:29:21.607770] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-22T23:29:21.618603] [DEBUG] [LOCAL ] CMSC: Derivative data saved (138 records). [2025-10-22T23:29:21.618766] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-10-22T23:29:21.621013] [INFO ] [MAIN ] Derivative Progress: 390/2052 symbols. CMSC took 0.3s. Estimated remaining time: 10m 53s [2025-10-22T23:29:21.621114] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:21.630050] [DEBUG] [LOCAL ] CMSD: Loaded 7603 existing records from primary storage. [2025-10-22T23:29:21.630195] [INFO ] [MAIN ] CMSD: Loaded 7603 primary data records. [2025-10-22T23:29:21.949510] [DEBUG] [MAIN ] CMSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:21.976059] [INFO ] [MAIN ] CMSD: Generated 138 derivative records from 7603 primary records. [2025-10-22T23:29:21.976241] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-22T23:29:21.987913] [DEBUG] [LOCAL ] CMSD: Derivative data saved (138 records). [2025-10-22T23:29:21.987995] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-22T23:29:21.990230] [INFO ] [MAIN ] Derivative Progress: 391/2052 symbols. CMSD took 0.4s. Estimated remaining time: 10m 53s [2025-10-22T23:29:21.990344] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:22.023072] [DEBUG] [LOCAL ] CMTG: Loaded 35217 existing records from primary storage. [2025-10-22T23:29:22.023236] [INFO ] [MAIN ] CMTG: Loaded 35217 primary data records. [2025-10-22T23:29:22.343077] [DEBUG] [MAIN ] CMTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:22.372662] [INFO ] [MAIN ] CMTG: Generated 138 derivative records from 35217 primary records. [2025-10-22T23:29:22.372828] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-22T23:29:22.384208] [DEBUG] [LOCAL ] CMTG: Derivative data saved (138 records). [2025-10-22T23:29:22.384290] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-10-22T23:29:22.388006] [INFO ] [MAIN ] Derivative Progress: 392/2052 symbols. CMTG took 0.4s. Estimated remaining time: 10m 52s [2025-10-22T23:29:22.388113] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:22.398155] [DEBUG] [LOCAL ] CMU: Loaded 6348 existing records from primary storage. [2025-10-22T23:29:22.398286] [INFO ] [MAIN ] CMU: Loaded 6348 primary data records. [2025-10-22T23:29:22.708393] [DEBUG] [MAIN ] CMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:22.733464] [INFO ] [MAIN ] CMU: Generated 138 derivative records from 6348 primary records. [2025-10-22T23:29:22.733571] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-10-22T23:29:22.743312] [DEBUG] [LOCAL ] CMU: Derivative data saved (138 records). [2025-10-22T23:29:22.743392] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-10-22T23:29:22.745672] [INFO ] [MAIN ] Derivative Progress: 393/2052 symbols. CMU took 0.4s. Estimated remaining time: 10m 52s [2025-10-22T23:29:22.745770] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:22.776729] [DEBUG] [LOCAL ] CNA: Loaded 32534 existing records from primary storage. [2025-10-22T23:29:22.776896] [INFO ] [MAIN ] CNA: Loaded 32534 primary data records. [2025-10-22T23:29:23.109197] [DEBUG] [MAIN ] CNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:23.134118] [INFO ] [MAIN ] CNA: Generated 138 derivative records from 32534 primary records. [2025-10-22T23:29:23.134229] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-10-22T23:29:23.145591] [DEBUG] [LOCAL ] CNA: Derivative data saved (138 records). [2025-10-22T23:29:23.145692] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-10-22T23:29:23.148633] [INFO ] [MAIN ] Derivative Progress: 394/2052 symbols. CNA took 0.4s. Estimated remaining time: 10m 51s [2025-10-22T23:29:23.148782] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:23.203235] [DEBUG] [LOCAL ] CNC: Loaded 53779 existing records from primary storage. [2025-10-22T23:29:23.203417] [INFO ] [MAIN ] CNC: Loaded 53779 primary data records. [2025-10-22T23:29:23.513246] [DEBUG] [MAIN ] CNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:23.541761] [INFO ] [MAIN ] CNC: Generated 138 derivative records from 53779 primary records. [2025-10-22T23:29:23.541883] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-22T23:29:23.553678] [DEBUG] [LOCAL ] CNC: Derivative data saved (138 records). [2025-10-22T23:29:23.553762] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-22T23:29:23.555914] [INFO ] [MAIN ] Derivative Progress: 395/2052 symbols. CNC took 0.4s. Estimated remaining time: 10m 51s [2025-10-22T23:29:23.556006] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:23.608243] [DEBUG] [LOCAL ] CNI: Loaded 51658 existing records from primary storage. [2025-10-22T23:29:23.608417] [INFO ] [MAIN ] CNI: Loaded 51658 primary data records. [2025-10-22T23:29:23.920737] [DEBUG] [MAIN ] CNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:23.945947] [INFO ] [MAIN ] CNI: Generated 138 derivative records from 51658 primary records. [2025-10-22T23:29:23.946082] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-22T23:29:23.957710] [DEBUG] [LOCAL ] CNI: Derivative data saved (138 records). [2025-10-22T23:29:23.957799] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-10-22T23:29:23.960779] [INFO ] [MAIN ] Derivative Progress: 396/2052 symbols. CNI took 0.4s. Estimated remaining time: 10m 51s [2025-10-22T23:29:23.960888] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:24.019865] [DEBUG] [LOCAL ] CNK: Loaded 52908 existing records from primary storage. [2025-10-22T23:29:24.020232] [INFO ] [MAIN ] CNK: Loaded 52908 primary data records. [2025-10-22T23:29:24.330340] [DEBUG] [MAIN ] CNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:24.355375] [INFO ] [MAIN ] CNK: Generated 138 derivative records from 52908 primary records. [2025-10-22T23:29:24.355491] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-10-22T23:29:24.367362] [DEBUG] [LOCAL ] CNK: Derivative data saved (138 records). [2025-10-22T23:29:24.367445] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-10-22T23:29:24.370429] [INFO ] [MAIN ] Derivative Progress: 397/2052 symbols. CNK took 0.4s. Estimated remaining time: 10m 50s [2025-10-22T23:29:24.370560] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:24.400308] [DEBUG] [LOCAL ] CNMD: Loaded 32058 existing records from primary storage. [2025-10-22T23:29:24.400465] [INFO ] [MAIN ] CNMD: Loaded 32058 primary data records. [2025-10-22T23:29:24.704274] [DEBUG] [MAIN ] CNMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:24.729410] [INFO ] [MAIN ] CNMD: Generated 138 derivative records from 32058 primary records. [2025-10-22T23:29:24.729535] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-10-22T23:29:24.741029] [DEBUG] [LOCAL ] CNMD: Derivative data saved (138 records). [2025-10-22T23:29:24.741114] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-10-22T23:29:24.743878] [INFO ] [MAIN ] Derivative Progress: 398/2052 symbols. CNMD took 0.4s. Estimated remaining time: 10m 50s [2025-10-22T23:29:24.743970] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:24.781898] [DEBUG] [LOCAL ] CNO: Loaded 40344 existing records from primary storage. [2025-10-22T23:29:24.782060] [INFO ] [MAIN ] CNO: Loaded 40344 primary data records. [2025-10-22T23:29:25.116121] [DEBUG] [MAIN ] CNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:25.141239] [INFO ] [MAIN ] CNO: Generated 138 derivative records from 40344 primary records. [2025-10-22T23:29:25.141377] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-22T23:29:25.152964] [DEBUG] [LOCAL ] CNO: Derivative data saved (138 records). [2025-10-22T23:29:25.153044] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-10-22T23:29:25.155897] [INFO ] [MAIN ] Derivative Progress: 399/2052 symbols. CNO took 0.4s. Estimated remaining time: 10m 50s [2025-10-22T23:29:25.155995] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:25.208428] [DEBUG] [LOCAL ] CNP: Loaded 53475 existing records from primary storage. [2025-10-22T23:29:25.208590] [INFO ] [MAIN ] CNP: Loaded 53475 primary data records. [2025-10-22T23:29:25.511974] [DEBUG] [MAIN ] CNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:25.536900] [INFO ] [MAIN ] CNP: Generated 138 derivative records from 53475 primary records. [2025-10-22T23:29:25.537040] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-10-22T23:29:25.548534] [DEBUG] [LOCAL ] CNP: Derivative data saved (138 records). [2025-10-22T23:29:25.548619] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-10-22T23:29:25.551669] [INFO ] [MAIN ] Derivative Progress: 400/2052 symbols. CNP took 0.4s. Estimated remaining time: 10m 49s [2025-10-22T23:29:25.551767] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:25.604173] [DEBUG] [LOCAL ] CNQ: Loaded 53582 existing records from primary storage. [2025-10-22T23:29:25.604338] [INFO ] [MAIN ] CNQ: Loaded 53582 primary data records. [2025-10-22T23:29:25.906775] [DEBUG] [MAIN ] CNQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:25.932004] [INFO ] [MAIN ] CNQ: Generated 138 derivative records from 53582 primary records. [2025-10-22T23:29:25.932145] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-22T23:29:25.943809] [DEBUG] [LOCAL ] CNQ: Derivative data saved (138 records). [2025-10-22T23:29:25.943890] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-22T23:29:25.946896] [INFO ] [MAIN ] Derivative Progress: 401/2052 symbols. CNQ took 0.4s. Estimated remaining time: 10m 49s [2025-10-22T23:29:25.946990] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:25.985545] [DEBUG] [LOCAL ] CODI: Loaded 41954 existing records from primary storage. [2025-10-22T23:29:25.985728] [INFO ] [MAIN ] CODI: Loaded 41954 primary data records. [2025-10-22T23:29:26.290226] [DEBUG] [MAIN ] CODI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:26.315516] [INFO ] [MAIN ] CODI: Generated 138 derivative records from 41954 primary records. [2025-10-22T23:29:26.315662] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-10-22T23:29:26.326915] [DEBUG] [LOCAL ] CODI: Derivative data saved (138 records). [2025-10-22T23:29:26.326995] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-10-22T23:29:26.329928] [INFO ] [MAIN ] Derivative Progress: 402/2052 symbols. CODI took 0.4s. Estimated remaining time: 10m 48s [2025-10-22T23:29:26.330032] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:26.386741] [DEBUG] [LOCAL ] COF: Loaded 53625 existing records from primary storage. [2025-10-22T23:29:26.386903] [INFO ] [MAIN ] COF: Loaded 53625 primary data records. [2025-10-22T23:29:26.692639] [DEBUG] [MAIN ] COF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:26.718121] [INFO ] [MAIN ] COF: Generated 138 derivative records from 53625 primary records. [2025-10-22T23:29:26.718263] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-10-22T23:29:26.730187] [DEBUG] [LOCAL ] COF: Derivative data saved (138 records). [2025-10-22T23:29:26.730276] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-10-22T23:29:26.733371] [INFO ] [MAIN ] Derivative Progress: 403/2052 symbols. COF took 0.4s. Estimated remaining time: 10m 48s [2025-10-22T23:29:26.733480] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:26.787225] [DEBUG] [LOCAL ] COLD: Loaded 52485 existing records from primary storage. [2025-10-22T23:29:26.787407] [INFO ] [MAIN ] COLD: Loaded 52485 primary data records. [2025-10-22T23:29:27.110070] [DEBUG] [MAIN ] COLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:27.138947] [INFO ] [MAIN ] COLD: Generated 138 derivative records from 52485 primary records. [2025-10-22T23:29:27.139112] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-10-22T23:29:27.151074] [DEBUG] [LOCAL ] COLD: Derivative data saved (138 records). [2025-10-22T23:29:27.151168] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-10-22T23:29:27.154418] [INFO ] [MAIN ] Derivative Progress: 404/2052 symbols. COLD took 0.4s. Estimated remaining time: 10m 48s [2025-10-22T23:29:27.154517] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:27.210777] [DEBUG] [LOCAL ] COMP: Loaded 53404 existing records from primary storage. [2025-10-22T23:29:27.210947] [INFO ] [MAIN ] COMP: Loaded 53404 primary data records. [2025-10-22T23:29:27.579717] [DEBUG] [MAIN ] COMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:27.608237] [INFO ] [MAIN ] COMP: Generated 138 derivative records from 53404 primary records. [2025-10-22T23:29:27.608427] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-10-22T23:29:27.620493] [DEBUG] [LOCAL ] COMP: Derivative data saved (138 records). [2025-10-22T23:29:27.620628] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-10-22T23:29:27.623842] [INFO ] [MAIN ] Derivative Progress: 405/2052 symbols. COMP took 0.5s. Estimated remaining time: 10m 48s [2025-10-22T23:29:27.623948] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:27.650397] [DEBUG] [LOCAL ] COOK: Loaded 24851 existing records from primary storage. [2025-10-22T23:29:27.650569] [INFO ] [MAIN ] COOK: Loaded 24851 primary data records. [2025-10-22T23:29:27.958382] [DEBUG] [MAIN ] COOK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:27.988448] [INFO ] [MAIN ] COOK: Generated 138 derivative records from 24851 primary records. [2025-10-22T23:29:27.989898] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-22T23:29:28.002715] [DEBUG] [LOCAL ] COOK: Derivative data saved (138 records). [2025-10-22T23:29:28.002802] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-10-22T23:29:28.006288] [INFO ] [MAIN ] Derivative Progress: 406/2052 symbols. COOK took 0.4s. Estimated remaining time: 10m 47s [2025-10-22T23:29:28.006392] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:28.060289] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-22T23:29:28.060449] [INFO ] [MAIN ] COP: Loaded 53727 primary data records. [2025-10-22T23:29:28.384980] [DEBUG] [MAIN ] COP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:28.410054] [INFO ] [MAIN ] COP: Generated 138 derivative records from 53727 primary records. [2025-10-22T23:29:28.410191] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-10-22T23:29:28.421619] [DEBUG] [LOCAL ] COP: Derivative data saved (138 records). [2025-10-22T23:29:28.421725] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-10-22T23:29:28.424864] [INFO ] [MAIN ] Derivative Progress: 407/2052 symbols. COP took 0.4s. Estimated remaining time: 10m 47s [2025-10-22T23:29:28.424959] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:28.469182] [DEBUG] [LOCAL ] COR: Loaded 46258 existing records from primary storage. [2025-10-22T23:29:28.469347] [INFO ] [MAIN ] COR: Loaded 46258 primary data records. [2025-10-22T23:29:28.790138] [DEBUG] [MAIN ] COR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:28.816988] [INFO ] [MAIN ] COR: Generated 138 derivative records from 46258 primary records. [2025-10-22T23:29:28.817112] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-10-22T23:29:28.829278] [DEBUG] [LOCAL ] COR: Derivative data saved (138 records). [2025-10-22T23:29:28.829363] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-10-22T23:29:28.832798] [INFO ] [MAIN ] Derivative Progress: 408/2052 symbols. COR took 0.4s. Estimated remaining time: 10m 47s [2025-10-22T23:29:28.832899] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:28.880693] [DEBUG] [LOCAL ] COUR: Loaded 49401 existing records from primary storage. [2025-10-22T23:29:28.880868] [INFO ] [MAIN ] COUR: Loaded 49401 primary data records. [2025-10-22T23:29:29.204328] [DEBUG] [MAIN ] COUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:29.231136] [INFO ] [MAIN ] COUR: Generated 138 derivative records from 49401 primary records. [2025-10-22T23:29:29.231331] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-10-22T23:29:29.243207] [DEBUG] [LOCAL ] COUR: Derivative data saved (138 records). [2025-10-22T23:29:29.243288] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-10-22T23:29:29.246411] [INFO ] [MAIN ] Derivative Progress: 409/2052 symbols. COUR took 0.4s. Estimated remaining time: 10m 46s [2025-10-22T23:29:29.246508] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:29.298413] [DEBUG] [LOCAL ] CP: Loaded 53228 existing records from primary storage. [2025-10-22T23:29:29.298585] [INFO ] [MAIN ] CP: Loaded 53228 primary data records. [2025-10-22T23:29:29.651685] [DEBUG] [MAIN ] CP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:29.677772] [INFO ] [MAIN ] CP: Generated 138 derivative records from 53228 primary records. [2025-10-22T23:29:29.677931] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-10-22T23:29:29.689752] [DEBUG] [LOCAL ] CP: Derivative data saved (138 records). [2025-10-22T23:29:29.689858] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-10-22T23:29:29.693150] [INFO ] [MAIN ] Derivative Progress: 410/2052 symbols. CP took 0.4s. Estimated remaining time: 10m 46s [2025-10-22T23:29:29.693261] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:29.721329] [DEBUG] [LOCAL ] CPA: Loaded 27769 existing records from primary storage. [2025-10-22T23:29:29.721488] [INFO ] [MAIN ] CPA: Loaded 27769 primary data records. [2025-10-22T23:29:30.030409] [DEBUG] [MAIN ] CPA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:30.055507] [INFO ] [MAIN ] CPA: Generated 138 derivative records from 27769 primary records. [2025-10-22T23:29:30.055617] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-10-22T23:29:30.067230] [DEBUG] [LOCAL ] CPA: Derivative data saved (138 records). [2025-10-22T23:29:30.067337] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-10-22T23:29:30.070193] [INFO ] [MAIN ] Derivative Progress: 411/2052 symbols. CPA took 0.4s. Estimated remaining time: 10m 46s [2025-10-22T23:29:30.070290] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:30.099150] [DEBUG] [LOCAL ] CPAY: Loaded 30086 existing records from primary storage. [2025-10-22T23:29:30.099299] [INFO ] [MAIN ] CPAY: Loaded 30086 primary data records. [2025-10-22T23:29:30.407686] [DEBUG] [MAIN ] CPAY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:30.433064] [INFO ] [MAIN ] CPAY: Generated 138 derivative records from 30086 primary records. [2025-10-22T23:29:30.433189] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-22T23:29:30.444583] [DEBUG] [LOCAL ] CPAY: Derivative data saved (138 records). [2025-10-22T23:29:30.444683] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-22T23:29:30.447577] [INFO ] [MAIN ] Derivative Progress: 412/2052 symbols. CPAY took 0.4s. Estimated remaining time: 10m 45s [2025-10-22T23:29:30.447707] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:30.464087] [DEBUG] [LOCAL ] CPF: Loaded 15178 existing records from primary storage. [2025-10-22T23:29:30.464219] [INFO ] [MAIN ] CPF: Loaded 15178 primary data records. [2025-10-22T23:29:30.769170] [DEBUG] [MAIN ] CPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:30.794300] [INFO ] [MAIN ] CPF: Generated 138 derivative records from 15178 primary records. [2025-10-22T23:29:30.794422] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-10-22T23:29:30.805892] [DEBUG] [LOCAL ] CPF: Derivative data saved (138 records). [2025-10-22T23:29:30.805970] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-10-22T23:29:30.808634] [INFO ] [MAIN ] Derivative Progress: 413/2052 symbols. CPF took 0.4s. Estimated remaining time: 10m 45s [2025-10-22T23:29:30.808768] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:30.825130] [DEBUG] [LOCAL ] CPK: Loaded 13889 existing records from primary storage. [2025-10-22T23:29:30.825263] [INFO ] [MAIN ] CPK: Loaded 13889 primary data records. [2025-10-22T23:29:31.125736] [DEBUG] [MAIN ] CPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:31.150926] [INFO ] [MAIN ] CPK: Generated 138 derivative records from 13889 primary records. [2025-10-22T23:29:31.151058] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-22T23:29:31.162622] [DEBUG] [LOCAL ] CPK: Derivative data saved (138 records). [2025-10-22T23:29:31.162719] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-10-22T23:29:31.165431] [INFO ] [MAIN ] Derivative Progress: 414/2052 symbols. CPK took 0.4s. Estimated remaining time: 10m 44s [2025-10-22T23:29:31.165528] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:31.221041] [DEBUG] [LOCAL ] CPRI: Loaded 52430 existing records from primary storage. [2025-10-22T23:29:31.221199] [INFO ] [MAIN ] CPRI: Loaded 52430 primary data records. [2025-10-22T23:29:31.549629] [DEBUG] [MAIN ] CPRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:31.574745] [INFO ] [MAIN ] CPRI: Generated 138 derivative records from 52430 primary records. [2025-10-22T23:29:31.574858] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-22T23:29:31.586372] [DEBUG] [LOCAL ] CPRI: Derivative data saved (138 records). [2025-10-22T23:29:31.586450] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-10-22T23:29:31.589542] [INFO ] [MAIN ] Derivative Progress: 415/2052 symbols. CPRI took 0.4s. Estimated remaining time: 10m 44s [2025-10-22T23:29:31.589663] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:31.613268] [DEBUG] [LOCAL ] CPS: Loaded 24879 existing records from primary storage. [2025-10-22T23:29:31.613456] [INFO ] [MAIN ] CPS: Loaded 24879 primary data records. [2025-10-22T23:29:31.933052] [DEBUG] [MAIN ] CPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:31.958240] [INFO ] [MAIN ] CPS: Generated 138 derivative records from 24879 primary records. [2025-10-22T23:29:31.958353] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-10-22T23:29:31.969948] [DEBUG] [LOCAL ] CPS: Derivative data saved (138 records). [2025-10-22T23:29:31.970035] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-10-22T23:29:31.973982] [INFO ] [MAIN ] Derivative Progress: 416/2052 symbols. CPS took 0.4s. Estimated remaining time: 10m 43s [2025-10-22T23:29:31.974078] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:32.020962] [DEBUG] [LOCAL ] CPT: Loaded 44485 existing records from primary storage. [2025-10-22T23:29:32.021157] [INFO ] [MAIN ] CPT: Loaded 44485 primary data records. [2025-10-22T23:29:32.364004] [DEBUG] [MAIN ] CPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:32.391294] [INFO ] [MAIN ] CPT: Generated 138 derivative records from 44485 primary records. [2025-10-22T23:29:32.391491] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-22T23:29:32.404340] [DEBUG] [LOCAL ] CPT: Derivative data saved (138 records). [2025-10-22T23:29:32.404500] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-22T23:29:32.408403] [INFO ] [MAIN ] Derivative Progress: 417/2052 symbols. CPT took 0.4s. Estimated remaining time: 10m 43s [2025-10-22T23:29:32.408622] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:32.432639] [DEBUG] [LOCAL ] CQP: Loaded 18676 existing records from primary storage. [2025-10-22T23:29:32.433004] [INFO ] [MAIN ] CQP: Loaded 18676 primary data records. [2025-10-22T23:29:32.899460] [DEBUG] [MAIN ] CQP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:32.931148] [INFO ] [MAIN ] CQP: Generated 138 derivative records from 18676 primary records. [2025-10-22T23:29:32.931407] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-10-22T23:29:32.945006] [DEBUG] [LOCAL ] CQP: Derivative data saved (138 records). [2025-10-22T23:29:32.945200] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-10-22T23:29:32.948719] [INFO ] [MAIN ] Derivative Progress: 418/2052 symbols. CQP took 0.5s. Estimated remaining time: 10m 43s [2025-10-22T23:29:32.948939] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:32.977059] [DEBUG] [LOCAL ] CR: Loaded 23949 existing records from primary storage. [2025-10-22T23:29:32.977297] [INFO ] [MAIN ] CR: Loaded 23949 primary data records. [2025-10-22T23:29:33.324072] [DEBUG] [MAIN ] CR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:29:33.354261] [INFO ] [MAIN ] CR: Generated 138 derivative records from 23949 primary records. [2025-10-22T23:29:33.354687] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-22T23:29:33.366910] [DEBUG] [LOCAL ] CR: Derivative data saved (138 records). [2025-10-22T23:29:33.367066] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-22T23:29:33.370116] [INFO ] [MAIN ] Derivative Progress: 419/2052 symbols. CR took 0.4s. Estimated remaining time: 10m 43s [2025-10-22T23:29:33.370227] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:33.386183] [DEBUG] [LOCAL ] CRBD: Loaded 8761 existing records from primary storage. [2025-10-22T23:29:33.386390] [INFO ] [MAIN ] CRBD: Loaded 8761 primary data records. [2025-10-22T23:29:33.729937] [DEBUG] [MAIN ] CRBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:33.755409] [INFO ] [MAIN ] CRBD: Generated 138 derivative records from 8761 primary records. [2025-10-22T23:29:33.755548] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-10-22T23:29:33.769359] [DEBUG] [LOCAL ] CRBD: Derivative data saved (138 records). [2025-10-22T23:29:33.769445] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-10-22T23:29:33.771873] [INFO ] [MAIN ] Derivative Progress: 420/2052 symbols. CRBD took 0.4s. Estimated remaining time: 10m 43s [2025-10-22T23:29:33.771964] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:33.824969] [DEBUG] [LOCAL ] CRBG: Loaded 52600 existing records from primary storage. [2025-10-22T23:29:33.825132] [INFO ] [MAIN ] CRBG: Loaded 52600 primary data records. [2025-10-22T23:29:34.152082] [DEBUG] [MAIN ] CRBG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:34.177379] [INFO ] [MAIN ] CRBG: Generated 138 derivative records from 52600 primary records. [2025-10-22T23:29:34.177536] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-22T23:29:34.189309] [DEBUG] [LOCAL ] CRBG: Derivative data saved (138 records). [2025-10-22T23:29:34.189409] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-22T23:29:34.192884] [INFO ] [MAIN ] Derivative Progress: 421/2052 symbols. CRBG took 0.4s. Estimated remaining time: 10m 42s [2025-10-22T23:29:34.193005] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:34.234928] [DEBUG] [LOCAL ] CRC: Loaded 44118 existing records from primary storage. [2025-10-22T23:29:34.235114] [INFO ] [MAIN ] CRC: Loaded 44118 primary data records. [2025-10-22T23:29:34.546321] [DEBUG] [MAIN ] CRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:34.572347] [INFO ] [MAIN ] CRC: Generated 138 derivative records from 44118 primary records. [2025-10-22T23:29:34.572509] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-22T23:29:34.583996] [DEBUG] [LOCAL ] CRC: Derivative data saved (138 records). [2025-10-22T23:29:34.584074] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-10-22T23:29:34.587074] [INFO ] [MAIN ] Derivative Progress: 422/2052 symbols. CRC took 0.4s. Estimated remaining time: 10m 42s [2025-10-22T23:29:34.587168] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:34.637589] [DEBUG] [LOCAL ] CRGY: Loaded 52497 existing records from primary storage. [2025-10-22T23:29:34.637807] [INFO ] [MAIN ] CRGY: Loaded 52497 primary data records. [2025-10-22T23:29:34.945177] [DEBUG] [MAIN ] CRGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:34.970659] [INFO ] [MAIN ] CRGY: Generated 138 derivative records from 52497 primary records. [2025-10-22T23:29:34.970804] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-22T23:29:34.982331] [DEBUG] [LOCAL ] CRGY: Derivative data saved (138 records). [2025-10-22T23:29:34.982415] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-22T23:29:34.985697] [INFO ] [MAIN ] Derivative Progress: 423/2052 symbols. CRGY took 0.4s. Estimated remaining time: 10m 42s [2025-10-22T23:29:34.985831] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:35.042276] [DEBUG] [LOCAL ] CRH: Loaded 53422 existing records from primary storage. [2025-10-22T23:29:35.042439] [INFO ] [MAIN ] CRH: Loaded 53422 primary data records. [2025-10-22T23:29:35.359367] [DEBUG] [MAIN ] CRH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:35.384971] [INFO ] [MAIN ] CRH: Generated 138 derivative records from 53422 primary records. [2025-10-22T23:29:35.385113] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-10-22T23:29:35.397058] [DEBUG] [LOCAL ] CRH: Derivative data saved (138 records). [2025-10-22T23:29:35.397172] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-10-22T23:29:35.400515] [INFO ] [MAIN ] Derivative Progress: 424/2052 symbols. CRH took 0.4s. Estimated remaining time: 10m 41s [2025-10-22T23:29:35.400609] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:35.447162] [DEBUG] [LOCAL ] CRI: Loaded 49486 existing records from primary storage. [2025-10-22T23:29:35.447356] [INFO ] [MAIN ] CRI: Loaded 49486 primary data records. [2025-10-22T23:29:35.764712] [DEBUG] [MAIN ] CRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:35.791764] [INFO ] [MAIN ] CRI: Generated 138 derivative records from 49486 primary records. [2025-10-22T23:29:35.791941] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-22T23:29:35.803617] [DEBUG] [LOCAL ] CRI: Derivative data saved (138 records). [2025-10-22T23:29:35.803721] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-10-22T23:29:35.806754] [INFO ] [MAIN ] Derivative Progress: 425/2052 symbols. CRI took 0.4s. Estimated remaining time: 10m 41s [2025-10-22T23:29:35.806846] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:35.858413] [DEBUG] [LOCAL ] CRK: Loaded 52226 existing records from primary storage. [2025-10-22T23:29:35.858573] [INFO ] [MAIN ] CRK: Loaded 52226 primary data records. [2025-10-22T23:29:36.198530] [DEBUG] [MAIN ] CRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:36.224412] [INFO ] [MAIN ] CRK: Generated 138 derivative records from 52226 primary records. [2025-10-22T23:29:36.224547] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-10-22T23:29:36.236188] [DEBUG] [LOCAL ] CRK: Derivative data saved (138 records). [2025-10-22T23:29:36.236274] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-10-22T23:29:36.239682] [INFO ] [MAIN ] Derivative Progress: 426/2052 symbols. CRK took 0.4s. Estimated remaining time: 10m 41s [2025-10-22T23:29:36.239810] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:36.282264] [DEBUG] [LOCAL ] CRL: Loaded 42624 existing records from primary storage. [2025-10-22T23:29:36.282423] [INFO ] [MAIN ] CRL: Loaded 42624 primary data records. [2025-10-22T23:29:36.596233] [DEBUG] [MAIN ] CRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:36.622109] [INFO ] [MAIN ] CRL: Generated 138 derivative records from 42624 primary records. [2025-10-22T23:29:36.622292] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-22T23:29:36.634295] [DEBUG] [LOCAL ] CRL: Derivative data saved (138 records). [2025-10-22T23:29:36.634411] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-22T23:29:36.637526] [INFO ] [MAIN ] Derivative Progress: 427/2052 symbols. CRL took 0.4s. Estimated remaining time: 10m 40s [2025-10-22T23:29:36.637635] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:36.692338] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-22T23:29:36.692504] [INFO ] [MAIN ] CRM: Loaded 53770 primary data records. [2025-10-22T23:29:37.000529] [DEBUG] [MAIN ] CRM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:37.025471] [INFO ] [MAIN ] CRM: Generated 138 derivative records from 53770 primary records. [2025-10-22T23:29:37.025591] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-22T23:29:37.037436] [DEBUG] [LOCAL ] CRM: Derivative data saved (138 records). [2025-10-22T23:29:37.037525] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-10-22T23:29:37.040796] [INFO ] [MAIN ] Derivative Progress: 428/2052 symbols. CRM took 0.4s. Estimated remaining time: 10m 40s [2025-10-22T23:29:37.040894] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:37.082876] [DEBUG] [LOCAL ] CRS: Loaded 43101 existing records from primary storage. [2025-10-22T23:29:37.083034] [INFO ] [MAIN ] CRS: Loaded 43101 primary data records. [2025-10-22T23:29:37.394635] [DEBUG] [MAIN ] CRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:37.420432] [INFO ] [MAIN ] CRS: Generated 138 derivative records from 43101 primary records. [2025-10-22T23:29:37.420577] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-10-22T23:29:37.432618] [DEBUG] [LOCAL ] CRS: Derivative data saved (138 records). [2025-10-22T23:29:37.432715] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-10-22T23:29:37.435731] [INFO ] [MAIN ] Derivative Progress: 429/2052 symbols. CRS took 0.4s. Estimated remaining time: 10m 40s [2025-10-22T23:29:37.435829] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:37.444285] [DEBUG] [LOCAL ] CRT: Loaded 4763 existing records from primary storage. [2025-10-22T23:29:37.444414] [INFO ] [MAIN ] CRT: Loaded 4763 primary data records. [2025-10-22T23:29:37.761497] [DEBUG] [MAIN ] CRT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:29:37.787492] [INFO ] [MAIN ] CRT: Generated 138 derivative records from 4763 primary records. [2025-10-22T23:29:37.787623] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-22T23:29:37.798134] [DEBUG] [LOCAL ] CRT: Derivative data saved (138 records). [2025-10-22T23:29:37.798256] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-10-22T23:29:37.800488] [INFO ] [MAIN ] Derivative Progress: 430/2052 symbols. CRT took 0.4s. Estimated remaining time: 10m 39s [2025-10-22T23:29:37.800585] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:37.842562] [DEBUG] [LOCAL ] CSAN: Loaded 42220 existing records from primary storage. [2025-10-22T23:29:37.842735] [INFO ] [MAIN ] CSAN: Loaded 42220 primary data records. [2025-10-22T23:29:38.179109] [DEBUG] [MAIN ] CSAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:38.204881] [INFO ] [MAIN ] CSAN: Generated 138 derivative records from 42220 primary records. [2025-10-22T23:29:38.204990] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-22T23:29:38.216274] [DEBUG] [LOCAL ] CSAN: Derivative data saved (138 records). [2025-10-22T23:29:38.216357] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-22T23:29:38.219744] [INFO ] [MAIN ] Derivative Progress: 431/2052 symbols. CSAN took 0.4s. Estimated remaining time: 10m 39s [2025-10-22T23:29:38.219857] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:38.250363] [DEBUG] [LOCAL ] CSL: Loaded 31148 existing records from primary storage. [2025-10-22T23:29:38.250514] [INFO ] [MAIN ] CSL: Loaded 31148 primary data records. [2025-10-22T23:29:38.571677] [DEBUG] [MAIN ] CSL: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:29:38.597345] [INFO ] [MAIN ] CSL: Generated 138 derivative records from 31148 primary records. [2025-10-22T23:29:38.597482] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-22T23:29:38.610014] [DEBUG] [LOCAL ] CSL: Derivative data saved (138 records). [2025-10-22T23:29:38.610102] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-22T23:29:38.613092] [INFO ] [MAIN ] Derivative Progress: 432/2052 symbols. CSL took 0.4s. Estimated remaining time: 10m 38s [2025-10-22T23:29:38.613194] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:38.629033] [DEBUG] [LOCAL ] CSR: Loaded 13395 existing records from primary storage. [2025-10-22T23:29:38.629168] [INFO ] [MAIN ] CSR: Loaded 13395 primary data records. [2025-10-22T23:29:38.943751] [DEBUG] [MAIN ] CSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:38.968741] [INFO ] [MAIN ] CSR: Generated 138 derivative records from 13395 primary records. [2025-10-22T23:29:38.968883] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-22T23:29:38.979980] [DEBUG] [LOCAL ] CSR: Derivative data saved (138 records). [2025-10-22T23:29:38.980060] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-10-22T23:29:38.982862] [INFO ] [MAIN ] Derivative Progress: 433/2052 symbols. CSR took 0.4s. Estimated remaining time: 10m 38s [2025-10-22T23:29:38.982958] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:38.996673] [DEBUG] [LOCAL ] CSV: Loaded 12427 existing records from primary storage. [2025-10-22T23:29:38.996789] [INFO ] [MAIN ] CSV: Loaded 12427 primary data records. [2025-10-22T23:29:39.304509] [DEBUG] [MAIN ] CSV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:39.329628] [INFO ] [MAIN ] CSV: Generated 138 derivative records from 12427 primary records. [2025-10-22T23:29:39.329744] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-22T23:29:39.340879] [DEBUG] [LOCAL ] CSV: Derivative data saved (138 records). [2025-10-22T23:29:39.340958] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-22T23:29:39.343847] [INFO ] [MAIN ] Derivative Progress: 434/2052 symbols. CSV took 0.4s. Estimated remaining time: 10m 37s [2025-10-22T23:29:39.343949] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:39.353670] [DEBUG] [LOCAL ] CTBB: Loaded 6394 existing records from primary storage. [2025-10-22T23:29:39.353784] [INFO ] [MAIN ] CTBB: Loaded 6394 primary data records. [2025-10-22T23:29:39.655584] [DEBUG] [MAIN ] CTBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:39.680519] [INFO ] [MAIN ] CTBB: Generated 138 derivative records from 6394 primary records. [2025-10-22T23:29:39.680625] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-10-22T23:29:39.691312] [DEBUG] [LOCAL ] CTBB: Derivative data saved (138 records). [2025-10-22T23:29:39.691389] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-10-22T23:29:39.693743] [INFO ] [MAIN ] Derivative Progress: 435/2052 symbols. CTBB took 0.3s. Estimated remaining time: 10m 37s [2025-10-22T23:29:39.693841] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:39.701482] [DEBUG] [LOCAL ] CTDD: Loaded 5135 existing records from primary storage. [2025-10-22T23:29:39.701590] [INFO ] [MAIN ] CTDD: Loaded 5135 primary data records. [2025-10-22T23:29:40.030376] [DEBUG] [MAIN ] CTDD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:29:40.055903] [INFO ] [MAIN ] CTDD: Generated 138 derivative records from 5135 primary records. [2025-10-22T23:29:40.056026] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-10-22T23:29:40.069575] [DEBUG] [LOCAL ] CTDD: Derivative data saved (138 records). [2025-10-22T23:29:40.069690] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-10-22T23:29:40.072176] [INFO ] [MAIN ] Derivative Progress: 436/2052 symbols. CTDD took 0.4s. Estimated remaining time: 10m 36s [2025-10-22T23:29:40.072293] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:40.106819] [DEBUG] [LOCAL ] CTOS: Loaded 37221 existing records from primary storage. [2025-10-22T23:29:40.106966] [INFO ] [MAIN ] CTOS: Loaded 37221 primary data records. [2025-10-22T23:29:40.412562] [DEBUG] [MAIN ] CTOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:40.437500] [INFO ] [MAIN ] CTOS: Generated 138 derivative records from 37221 primary records. [2025-10-22T23:29:40.437625] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-10-22T23:29:40.448535] [DEBUG] [LOCAL ] CTOS: Derivative data saved (138 records). [2025-10-22T23:29:40.448629] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-10-22T23:29:40.451846] [INFO ] [MAIN ] Derivative Progress: 437/2052 symbols. CTOS took 0.4s. Estimated remaining time: 10m 36s [2025-10-22T23:29:40.451940] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:40.503961] [DEBUG] [LOCAL ] CTRA: Loaded 53647 existing records from primary storage. [2025-10-22T23:29:40.504115] [INFO ] [MAIN ] CTRA: Loaded 53647 primary data records. [2025-10-22T23:29:40.810482] [DEBUG] [MAIN ] CTRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:40.835402] [INFO ] [MAIN ] CTRA: Generated 138 derivative records from 53647 primary records. [2025-10-22T23:29:40.835596] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-22T23:29:40.847229] [DEBUG] [LOCAL ] CTRA: Derivative data saved (138 records). [2025-10-22T23:29:40.847336] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-10-22T23:29:40.850631] [INFO ] [MAIN ] Derivative Progress: 438/2052 symbols. CTRA took 0.4s. Estimated remaining time: 10m 36s [2025-10-22T23:29:40.850780] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:40.900496] [DEBUG] [LOCAL ] CTRE: Loaded 49425 existing records from primary storage. [2025-10-22T23:29:40.900711] [INFO ] [MAIN ] CTRE: Loaded 49425 primary data records. [2025-10-22T23:29:41.211217] [DEBUG] [MAIN ] CTRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:41.237319] [INFO ] [MAIN ] CTRE: Generated 138 derivative records from 49425 primary records. [2025-10-22T23:29:41.237501] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-10-22T23:29:41.249512] [DEBUG] [LOCAL ] CTRE: Derivative data saved (138 records). [2025-10-22T23:29:41.249604] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-10-22T23:29:41.252837] [INFO ] [MAIN ] Derivative Progress: 439/2052 symbols. CTRE took 0.4s. Estimated remaining time: 10m 35s [2025-10-22T23:29:41.252932] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:41.272633] [DEBUG] [LOCAL ] CTS: Loaded 19510 existing records from primary storage. [2025-10-22T23:29:41.272805] [INFO ] [MAIN ] CTS: Loaded 19510 primary data records. [2025-10-22T23:29:41.587057] [DEBUG] [MAIN ] CTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:41.613529] [INFO ] [MAIN ] CTS: Generated 138 derivative records from 19510 primary records. [2025-10-22T23:29:41.613727] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-22T23:29:41.625358] [DEBUG] [LOCAL ] CTS: Derivative data saved (138 records). [2025-10-22T23:29:41.625491] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-10-22T23:29:41.628841] [INFO ] [MAIN ] Derivative Progress: 440/2052 symbols. CTS took 0.4s. Estimated remaining time: 10m 35s [2025-10-22T23:29:41.628964] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:41.685778] [DEBUG] [LOCAL ] CTVA: Loaded 53308 existing records from primary storage. [2025-10-22T23:29:41.685954] [INFO ] [MAIN ] CTVA: Loaded 53308 primary data records. [2025-10-22T23:29:42.009540] [DEBUG] [MAIN ] CTVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:42.034278] [INFO ] [MAIN ] CTVA: Generated 138 derivative records from 53308 primary records. [2025-10-22T23:29:42.034390] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-10-22T23:29:42.045900] [DEBUG] [LOCAL ] CTVA: Derivative data saved (138 records). [2025-10-22T23:29:42.045977] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-10-22T23:29:42.049276] [INFO ] [MAIN ] Derivative Progress: 441/2052 symbols. CTVA took 0.4s. Estimated remaining time: 10m 35s [2025-10-22T23:29:42.049370] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:42.098241] [DEBUG] [LOCAL ] CUBE: Loaded 50871 existing records from primary storage. [2025-10-22T23:29:42.098405] [INFO ] [MAIN ] CUBE: Loaded 50871 primary data records. [2025-10-22T23:29:42.422260] [DEBUG] [MAIN ] CUBE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:42.447448] [INFO ] [MAIN ] CUBE: Generated 138 derivative records from 50871 primary records. [2025-10-22T23:29:42.447556] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-10-22T23:29:42.458886] [DEBUG] [LOCAL ] CUBE: Derivative data saved (138 records). [2025-10-22T23:29:42.458964] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-10-22T23:29:42.462292] [INFO ] [MAIN ] Derivative Progress: 442/2052 symbols. CUBE took 0.4s. Estimated remaining time: 10m 34s [2025-10-22T23:29:42.462384] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:42.491171] [DEBUG] [LOCAL ] CUBI: Loaded 26998 existing records from primary storage. [2025-10-22T23:29:42.491331] [INFO ] [MAIN ] CUBI: Loaded 26998 primary data records. [2025-10-22T23:29:42.796340] [DEBUG] [MAIN ] CUBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:42.821145] [INFO ] [MAIN ] CUBI: Generated 138 derivative records from 26998 primary records. [2025-10-22T23:29:42.821264] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-10-22T23:29:42.832876] [DEBUG] [LOCAL ] CUBI: Derivative data saved (138 records). [2025-10-22T23:29:42.832954] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-10-22T23:29:42.836166] [INFO ] [MAIN ] Derivative Progress: 443/2052 symbols. CUBI took 0.4s. Estimated remaining time: 10m 34s [2025-10-22T23:29:42.836262] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:42.885697] [DEBUG] [LOCAL ] CUK: Loaded 51064 existing records from primary storage. [2025-10-22T23:29:42.885851] [INFO ] [MAIN ] CUK: Loaded 51064 primary data records. [2025-10-22T23:29:43.188367] [DEBUG] [MAIN ] CUK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:43.213261] [INFO ] [MAIN ] CUK: Generated 138 derivative records from 51064 primary records. [2025-10-22T23:29:43.213375] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-22T23:29:43.224997] [DEBUG] [LOCAL ] CUK: Derivative data saved (138 records). [2025-10-22T23:29:43.225076] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-22T23:29:43.228359] [INFO ] [MAIN ] Derivative Progress: 444/2052 symbols. CUK took 0.4s. Estimated remaining time: 10m 33s [2025-10-22T23:29:43.228454] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:43.232994] [DEBUG] [LOCAL ] CULP: Loaded 2843 existing records from primary storage. [2025-10-22T23:29:43.233080] [INFO ] [MAIN ] CULP: Loaded 2843 primary data records. [2025-10-22T23:29:43.538759] [DEBUG] [MAIN ] CULP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:43.564054] [INFO ] [MAIN ] CULP: Generated 138 derivative records from 2843 primary records. [2025-10-22T23:29:43.564161] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-10-22T23:29:43.573079] [DEBUG] [LOCAL ] CULP: Derivative data saved (138 records). [2025-10-22T23:29:43.573156] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-10-22T23:29:43.575510] [INFO ] [MAIN ] Derivative Progress: 445/2052 symbols. CULP took 0.3s. Estimated remaining time: 10m 33s [2025-10-22T23:29:43.575609] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:43.608933] [DEBUG] [LOCAL ] CURB: Loaded 32786 existing records from primary storage. [2025-10-22T23:29:43.609082] [INFO ] [MAIN ] CURB: Loaded 32786 primary data records. [2025-10-22T23:29:43.911967] [DEBUG] [MAIN ] CURB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:43.936841] [INFO ] [MAIN ] CURB: Generated 138 derivative records from 32786 primary records. [2025-10-22T23:29:43.936943] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-10-22T23:29:43.948267] [DEBUG] [LOCAL ] CURB: Derivative data saved (138 records). [2025-10-22T23:29:43.948345] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-10-22T23:29:43.951563] [INFO ] [MAIN ] Derivative Progress: 446/2052 symbols. CURB took 0.4s. Estimated remaining time: 10m 32s [2025-10-22T23:29:43.951701] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:43.978187] [DEBUG] [LOCAL ] CURV: Loaded 27192 existing records from primary storage. [2025-10-22T23:29:43.978324] [INFO ] [MAIN ] CURV: Loaded 27192 primary data records. [2025-10-22T23:29:44.311035] [DEBUG] [MAIN ] CURV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:44.336161] [INFO ] [MAIN ] CURV: Generated 138 derivative records from 27192 primary records. [2025-10-22T23:29:44.336264] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-10-22T23:29:44.347275] [DEBUG] [LOCAL ] CURV: Derivative data saved (138 records). [2025-10-22T23:29:44.347356] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-10-22T23:29:44.350464] [INFO ] [MAIN ] Derivative Progress: 447/2052 symbols. CURV took 0.4s. Estimated remaining time: 10m 32s [2025-10-22T23:29:44.350605] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:44.393963] [DEBUG] [LOCAL ] CUZ: Loaded 49436 existing records from primary storage. [2025-10-22T23:29:44.394120] [INFO ] [MAIN ] CUZ: Loaded 49436 primary data records. [2025-10-22T23:29:44.697944] [DEBUG] [MAIN ] CUZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:44.722993] [INFO ] [MAIN ] CUZ: Generated 138 derivative records from 49436 primary records. [2025-10-22T23:29:44.723106] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-10-22T23:29:44.734718] [DEBUG] [LOCAL ] CUZ: Derivative data saved (138 records). [2025-10-22T23:29:44.734800] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-10-22T23:29:44.737824] [INFO ] [MAIN ] Derivative Progress: 448/2052 symbols. CUZ took 0.4s. Estimated remaining time: 10m 32s [2025-10-22T23:29:44.737923] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:44.788444] [DEBUG] [LOCAL ] CVE: Loaded 53567 existing records from primary storage. [2025-10-22T23:29:44.788608] [INFO ] [MAIN ] CVE: Loaded 53567 primary data records. [2025-10-22T23:29:45.095408] [DEBUG] [MAIN ] CVE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:45.120487] [INFO ] [MAIN ] CVE: Generated 138 derivative records from 53567 primary records. [2025-10-22T23:29:45.120597] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-10-22T23:29:45.132700] [DEBUG] [LOCAL ] CVE: Derivative data saved (138 records). [2025-10-22T23:29:45.132782] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-10-22T23:29:45.135756] [INFO ] [MAIN ] Derivative Progress: 449/2052 symbols. CVE took 0.4s. Estimated remaining time: 10m 31s [2025-10-22T23:29:45.135852] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:45.152165] [DEBUG] [LOCAL ] CVLG: Loaded 15231 existing records from primary storage. [2025-10-22T23:29:45.152298] [INFO ] [MAIN ] CVLG: Loaded 15231 primary data records. [2025-10-22T23:29:45.454005] [DEBUG] [MAIN ] CVLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:45.478936] [INFO ] [MAIN ] CVLG: Generated 138 derivative records from 15231 primary records. [2025-10-22T23:29:45.479043] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-10-22T23:29:45.490478] [DEBUG] [LOCAL ] CVLG: Derivative data saved (138 records). [2025-10-22T23:29:45.490564] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-10-22T23:29:45.493226] [INFO ] [MAIN ] Derivative Progress: 450/2052 symbols. CVLG took 0.4s. Estimated remaining time: 10m 31s [2025-10-22T23:29:45.493322] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:45.543275] [DEBUG] [LOCAL ] CVNA: Loaded 52837 existing records from primary storage. [2025-10-22T23:29:45.543431] [INFO ] [MAIN ] CVNA: Loaded 52837 primary data records. [2025-10-22T23:29:45.849454] [DEBUG] [MAIN ] CVNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:45.874468] [INFO ] [MAIN ] CVNA: Generated 138 derivative records from 52837 primary records. [2025-10-22T23:29:45.874570] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-10-22T23:29:45.886252] [DEBUG] [LOCAL ] CVNA: Derivative data saved (138 records). [2025-10-22T23:29:45.886330] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-10-22T23:29:45.889319] [INFO ] [MAIN ] Derivative Progress: 451/2052 symbols. CVNA took 0.4s. Estimated remaining time: 10m 30s [2025-10-22T23:29:45.889425] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:45.938194] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-22T23:29:45.938363] [INFO ] [MAIN ] CVS: Loaded 53694 primary data records. [2025-10-22T23:29:46.267147] [DEBUG] [MAIN ] CVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:46.292248] [INFO ] [MAIN ] CVS: Generated 138 derivative records from 53694 primary records. [2025-10-22T23:29:46.292364] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-22T23:29:46.303924] [DEBUG] [LOCAL ] CVS: Derivative data saved (138 records). [2025-10-22T23:29:46.304001] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-22T23:29:46.306967] [INFO ] [MAIN ] Derivative Progress: 452/2052 symbols. CVS took 0.4s. Estimated remaining time: 10m 30s [2025-10-22T23:29:46.307066] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:46.359027] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-22T23:29:46.359183] [INFO ] [MAIN ] CVX: Loaded 53760 primary data records. [2025-10-22T23:29:46.661673] [DEBUG] [MAIN ] CVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:46.686522] [INFO ] [MAIN ] CVX: Generated 138 derivative records from 53760 primary records. [2025-10-22T23:29:46.686618] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-10-22T23:29:46.698749] [DEBUG] [LOCAL ] CVX: Derivative data saved (138 records). [2025-10-22T23:29:46.698833] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-10-22T23:29:46.701748] [INFO ] [MAIN ] Derivative Progress: 453/2052 symbols. CVX took 0.4s. Estimated remaining time: 10m 30s [2025-10-22T23:29:46.701848] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:46.723705] [DEBUG] [LOCAL ] CW: Loaded 21935 existing records from primary storage. [2025-10-22T23:29:46.723845] [INFO ] [MAIN ] CW: Loaded 21935 primary data records. [2025-10-22T23:29:47.029730] [DEBUG] [MAIN ] CW: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:29:47.054698] [INFO ] [MAIN ] CW: Generated 138 derivative records from 21935 primary records. [2025-10-22T23:29:47.054815] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-10-22T23:29:47.066418] [DEBUG] [LOCAL ] CW: Derivative data saved (138 records). [2025-10-22T23:29:47.066497] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-10-22T23:29:47.069176] [INFO ] [MAIN ] Derivative Progress: 454/2052 symbols. CW took 0.4s. Estimated remaining time: 10m 29s [2025-10-22T23:29:47.069269] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:47.118611] [DEBUG] [LOCAL ] CWAN: Loaded 52687 existing records from primary storage. [2025-10-22T23:29:47.118815] [INFO ] [MAIN ] CWAN: Loaded 52687 primary data records. [2025-10-22T23:29:47.423927] [DEBUG] [MAIN ] CWAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:47.449097] [INFO ] [MAIN ] CWAN: Generated 138 derivative records from 52687 primary records. [2025-10-22T23:29:47.449201] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-10-22T23:29:47.461000] [DEBUG] [LOCAL ] CWAN: Derivative data saved (138 records). [2025-10-22T23:29:47.461079] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-10-22T23:29:47.464089] [INFO ] [MAIN ] Derivative Progress: 455/2052 symbols. CWAN took 0.4s. Estimated remaining time: 10m 29s [2025-10-22T23:29:47.464186] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:47.505028] [DEBUG] [LOCAL ] CWEN: Loaded 45287 existing records from primary storage. [2025-10-22T23:29:47.505185] [INFO ] [MAIN ] CWEN: Loaded 45287 primary data records. [2025-10-22T23:29:47.809468] [DEBUG] [MAIN ] CWEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:47.834272] [INFO ] [MAIN ] CWEN: Generated 138 derivative records from 45287 primary records. [2025-10-22T23:29:47.834403] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-10-22T23:29:47.845832] [DEBUG] [LOCAL ] CWEN: Derivative data saved (138 records). [2025-10-22T23:29:47.845909] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-10-22T23:29:47.848556] [INFO ] [MAIN ] Derivative Progress: 456/2052 symbols. CWEN took 0.4s. Estimated remaining time: 10m 28s [2025-10-22T23:29:47.848687] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:47.897219] [DEBUG] [LOCAL ] CWH: Loaded 51271 existing records from primary storage. [2025-10-22T23:29:47.897403] [INFO ] [MAIN ] CWH: Loaded 51271 primary data records. [2025-10-22T23:29:48.202767] [DEBUG] [MAIN ] CWH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:48.227882] [INFO ] [MAIN ] CWH: Generated 138 derivative records from 51271 primary records. [2025-10-22T23:29:48.228052] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-10-22T23:29:48.239750] [DEBUG] [LOCAL ] CWH: Derivative data saved (138 records). [2025-10-22T23:29:48.239833] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-10-22T23:29:48.242951] [INFO ] [MAIN ] Derivative Progress: 457/2052 symbols. CWH took 0.4s. Estimated remaining time: 10m 28s [2025-10-22T23:29:48.243063] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:48.288629] [DEBUG] [LOCAL ] CWK: Loaded 49638 existing records from primary storage. [2025-10-22T23:29:48.288832] [INFO ] [MAIN ] CWK: Loaded 49638 primary data records. [2025-10-22T23:29:48.632758] [DEBUG] [MAIN ] CWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:48.663125] [INFO ] [MAIN ] CWK: Generated 138 derivative records from 49638 primary records. [2025-10-22T23:29:48.663373] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-22T23:29:48.675268] [DEBUG] [LOCAL ] CWK: Derivative data saved (138 records). [2025-10-22T23:29:48.675357] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-10-22T23:29:48.678295] [INFO ] [MAIN ] Derivative Progress: 458/2052 symbols. CWK took 0.4s. Estimated remaining time: 10m 28s [2025-10-22T23:29:48.678401] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:48.704594] [DEBUG] [LOCAL ] CWT: Loaded 28062 existing records from primary storage. [2025-10-22T23:29:48.704785] [INFO ] [MAIN ] CWT: Loaded 28062 primary data records. [2025-10-22T23:29:49.012333] [DEBUG] [MAIN ] CWT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:49.037462] [INFO ] [MAIN ] CWT: Generated 138 derivative records from 28062 primary records. [2025-10-22T23:29:49.037605] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-10-22T23:29:49.049126] [DEBUG] [LOCAL ] CWT: Derivative data saved (138 records). [2025-10-22T23:29:49.049214] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-10-22T23:29:49.052012] [INFO ] [MAIN ] Derivative Progress: 459/2052 symbols. CWT took 0.4s. Estimated remaining time: 10m 27s [2025-10-22T23:29:49.052110] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:49.099803] [DEBUG] [LOCAL ] CX: Loaded 52826 existing records from primary storage. [2025-10-22T23:29:49.099967] [INFO ] [MAIN ] CX: Loaded 52826 primary data records. [2025-10-22T23:29:49.420430] [DEBUG] [MAIN ] CX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:49.445043] [INFO ] [MAIN ] CX: Generated 138 derivative records from 52826 primary records. [2025-10-22T23:29:49.445169] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-22T23:29:49.456659] [DEBUG] [LOCAL ] CX: Derivative data saved (138 records). [2025-10-22T23:29:49.456777] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-10-22T23:29:49.459868] [INFO ] [MAIN ] Derivative Progress: 460/2052 symbols. CX took 0.4s. Estimated remaining time: 10m 27s [2025-10-22T23:29:49.459975] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:49.469613] [DEBUG] [LOCAL ] CXE: Loaded 6414 existing records from primary storage. [2025-10-22T23:29:49.469775] [INFO ] [MAIN ] CXE: Loaded 6414 primary data records. [2025-10-22T23:29:49.797222] [DEBUG] [MAIN ] CXE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:49.822966] [INFO ] [MAIN ] CXE: Generated 138 derivative records from 6414 primary records. [2025-10-22T23:29:49.823132] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-22T23:29:49.833984] [DEBUG] [LOCAL ] CXE: Derivative data saved (138 records). [2025-10-22T23:29:49.834079] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-22T23:29:49.837031] [INFO ] [MAIN ] Derivative Progress: 461/2052 symbols. CXE took 0.4s. Estimated remaining time: 10m 26s [2025-10-22T23:29:49.837140] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:49.844349] [DEBUG] [LOCAL ] CXH: Loaded 4392 existing records from primary storage. [2025-10-22T23:29:49.844477] [INFO ] [MAIN ] CXH: Loaded 4392 primary data records. [2025-10-22T23:29:50.156798] [DEBUG] [MAIN ] CXH: Filtered 6931 bins outside market hours, 7727 incomplete bins [2025-10-22T23:29:50.182869] [INFO ] [MAIN ] CXH: Generated 138 derivative records from 4392 primary records. [2025-10-22T23:29:50.183067] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-22T23:29:50.192920] [DEBUG] [LOCAL ] CXH: Derivative data saved (138 records). [2025-10-22T23:29:50.193144] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-10-22T23:29:50.196349] [INFO ] [MAIN ] Derivative Progress: 462/2052 symbols. CXH took 0.4s. Estimated remaining time: 10m 26s [2025-10-22T23:29:50.196478] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:50.246875] [DEBUG] [LOCAL ] CXM: Loaded 47404 existing records from primary storage. [2025-10-22T23:29:50.247112] [INFO ] [MAIN ] CXM: Loaded 47404 primary data records. [2025-10-22T23:29:50.610818] [DEBUG] [MAIN ] CXM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:50.638579] [INFO ] [MAIN ] CXM: Generated 138 derivative records from 47404 primary records. [2025-10-22T23:29:50.638861] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-22T23:29:50.650951] [DEBUG] [LOCAL ] CXM: Derivative data saved (138 records). [2025-10-22T23:29:50.651138] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-22T23:29:50.655292] [INFO ] [MAIN ] Derivative Progress: 463/2052 symbols. CXM took 0.5s. Estimated remaining time: 10m 26s [2025-10-22T23:29:50.655416] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:50.687229] [DEBUG] [LOCAL ] CXT: Loaded 30698 existing records from primary storage. [2025-10-22T23:29:50.687512] [INFO ] [MAIN ] CXT: Loaded 30698 primary data records. [2025-10-22T23:29:51.016090] [DEBUG] [MAIN ] CXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:51.045898] [INFO ] [MAIN ] CXT: Generated 138 derivative records from 30698 primary records. [2025-10-22T23:29:51.046170] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-22T23:29:51.058518] [DEBUG] [LOCAL ] CXT: Derivative data saved (138 records). [2025-10-22T23:29:51.058676] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-22T23:29:51.062572] [INFO ] [MAIN ] Derivative Progress: 464/2052 symbols. CXT took 0.4s. Estimated remaining time: 10m 25s [2025-10-22T23:29:51.062777] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:51.107210] [DEBUG] [LOCAL ] CXW: Loaded 43639 existing records from primary storage. [2025-10-22T23:29:51.107490] [INFO ] [MAIN ] CXW: Loaded 43639 primary data records. [2025-10-22T23:29:51.432552] [DEBUG] [MAIN ] CXW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:51.460171] [INFO ] [MAIN ] CXW: Generated 138 derivative records from 43639 primary records. [2025-10-22T23:29:51.460476] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-22T23:29:51.472667] [DEBUG] [LOCAL ] CXW: Derivative data saved (138 records). [2025-10-22T23:29:51.472791] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-22T23:29:51.476543] [INFO ] [MAIN ] Derivative Progress: 465/2052 symbols. CXW took 0.4s. Estimated remaining time: 10m 25s [2025-10-22T23:29:51.476714] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:51.505689] [DEBUG] [LOCAL ] CYD: Loaded 27277 existing records from primary storage. [2025-10-22T23:29:51.505920] [INFO ] [MAIN ] CYD: Loaded 27277 primary data records. [2025-10-22T23:29:51.837731] [DEBUG] [MAIN ] CYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:51.862618] [INFO ] [MAIN ] CYD: Generated 138 derivative records from 27277 primary records. [2025-10-22T23:29:51.862802] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-10-22T23:29:51.874341] [DEBUG] [LOCAL ] CYD: Derivative data saved (138 records). [2025-10-22T23:29:51.874420] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-10-22T23:29:51.877247] [INFO ] [MAIN ] Derivative Progress: 466/2052 symbols. CYD took 0.4s. Estimated remaining time: 10m 25s [2025-10-22T23:29:51.877368] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:51.918947] [DEBUG] [LOCAL ] CYH: Loaded 47658 existing records from primary storage. [2025-10-22T23:29:51.919108] [INFO ] [MAIN ] CYH: Loaded 47658 primary data records. [2025-10-22T23:29:52.221436] [DEBUG] [MAIN ] CYH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:52.246472] [INFO ] [MAIN ] CYH: Generated 138 derivative records from 47658 primary records. [2025-10-22T23:29:52.246609] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-22T23:29:52.257882] [DEBUG] [LOCAL ] CYH: Derivative data saved (138 records). [2025-10-22T23:29:52.257961] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-22T23:29:52.260690] [INFO ] [MAIN ] Derivative Progress: 467/2052 symbols. CYH took 0.4s. Estimated remaining time: 10m 24s [2025-10-22T23:29:52.260784] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:52.309357] [DEBUG] [LOCAL ] D: Loaded 53649 existing records from primary storage. [2025-10-22T23:29:52.309516] [INFO ] [MAIN ] D: Loaded 53649 primary data records. [2025-10-22T23:29:52.648713] [DEBUG] [MAIN ] D: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:52.674448] [INFO ] [MAIN ] D: Generated 138 derivative records from 53649 primary records. [2025-10-22T23:29:52.674572] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-10-22T23:29:52.686282] [DEBUG] [LOCAL ] D: Derivative data saved (138 records). [2025-10-22T23:29:52.686391] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-10-22T23:29:52.689504] [INFO ] [MAIN ] Derivative Progress: 468/2052 symbols. D took 0.4s. Estimated remaining time: 10m 24s [2025-10-22T23:29:52.689677] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:52.703466] [DEBUG] [LOCAL ] DAC: Loaded 12381 existing records from primary storage. [2025-10-22T23:29:52.703607] [INFO ] [MAIN ] DAC: Loaded 12381 primary data records. [2025-10-22T23:29:53.017066] [DEBUG] [MAIN ] DAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:53.043498] [INFO ] [MAIN ] DAC: Generated 138 derivative records from 12381 primary records. [2025-10-22T23:29:53.043675] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-10-22T23:29:53.054778] [DEBUG] [LOCAL ] DAC: Derivative data saved (138 records). [2025-10-22T23:29:53.054862] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-10-22T23:29:53.057584] [INFO ] [MAIN ] Derivative Progress: 469/2052 symbols. DAC took 0.4s. Estimated remaining time: 10m 23s [2025-10-22T23:29:53.057717] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:53.109398] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-22T23:29:53.109565] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-10-22T23:29:53.427452] [DEBUG] [MAIN ] DAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:53.454303] [INFO ] [MAIN ] DAL: Generated 138 derivative records from 53753 primary records. [2025-10-22T23:29:53.454437] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-10-22T23:29:53.466881] [DEBUG] [LOCAL ] DAL: Derivative data saved (138 records). [2025-10-22T23:29:53.467002] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-10-22T23:29:53.470157] [INFO ] [MAIN ] Derivative Progress: 470/2052 symbols. DAL took 0.4s. Estimated remaining time: 10m 23s [2025-10-22T23:29:53.470250] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:53.515964] [DEBUG] [LOCAL ] DAN: Loaded 49384 existing records from primary storage. [2025-10-22T23:29:53.516128] [INFO ] [MAIN ] DAN: Loaded 49384 primary data records. [2025-10-22T23:29:53.832547] [DEBUG] [MAIN ] DAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:53.858548] [INFO ] [MAIN ] DAN: Generated 138 derivative records from 49384 primary records. [2025-10-22T23:29:53.858690] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-10-22T23:29:53.871615] [DEBUG] [LOCAL ] DAN: Derivative data saved (138 records). [2025-10-22T23:29:53.871801] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-10-22T23:29:53.874845] [INFO ] [MAIN ] Derivative Progress: 471/2052 symbols. DAN took 0.4s. Estimated remaining time: 10m 23s [2025-10-22T23:29:53.874939] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:53.894834] [DEBUG] [LOCAL ] DAO: Loaded 19714 existing records from primary storage. [2025-10-22T23:29:53.894990] [INFO ] [MAIN ] DAO: Loaded 19714 primary data records. [2025-10-22T23:29:54.200232] [DEBUG] [MAIN ] DAO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:54.225482] [INFO ] [MAIN ] DAO: Generated 138 derivative records from 19714 primary records. [2025-10-22T23:29:54.225631] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-10-22T23:29:54.236755] [DEBUG] [LOCAL ] DAO: Derivative data saved (138 records). [2025-10-22T23:29:54.236854] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-10-22T23:29:54.239605] [INFO ] [MAIN ] Derivative Progress: 472/2052 symbols. DAO took 0.4s. Estimated remaining time: 10m 22s [2025-10-22T23:29:54.239751] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:54.289775] [DEBUG] [LOCAL ] DAR: Loaded 51998 existing records from primary storage. [2025-10-22T23:29:54.289954] [INFO ] [MAIN ] DAR: Loaded 51998 primary data records. [2025-10-22T23:29:54.651125] [DEBUG] [MAIN ] DAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:54.678181] [INFO ] [MAIN ] DAR: Generated 138 derivative records from 51998 primary records. [2025-10-22T23:29:54.678353] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-22T23:29:54.690333] [DEBUG] [LOCAL ] DAR: Derivative data saved (138 records). [2025-10-22T23:29:54.690419] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-22T23:29:54.693533] [INFO ] [MAIN ] Derivative Progress: 473/2052 symbols. DAR took 0.5s. Estimated remaining time: 10m 22s [2025-10-22T23:29:54.693667] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:54.734354] [DEBUG] [LOCAL ] DAVA: Loaded 41943 existing records from primary storage. [2025-10-22T23:29:54.734522] [INFO ] [MAIN ] DAVA: Loaded 41943 primary data records. [2025-10-22T23:29:55.049508] [DEBUG] [MAIN ] DAVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:55.074337] [INFO ] [MAIN ] DAVA: Generated 138 derivative records from 41943 primary records. [2025-10-22T23:29:55.074486] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-22T23:29:55.086270] [DEBUG] [LOCAL ] DAVA: Derivative data saved (138 records). [2025-10-22T23:29:55.086357] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-10-22T23:29:55.089388] [INFO ] [MAIN ] Derivative Progress: 474/2052 symbols. DAVA took 0.4s. Estimated remaining time: 10m 22s [2025-10-22T23:29:55.089504] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:55.135217] [DEBUG] [LOCAL ] DAY: Loaded 49122 existing records from primary storage. [2025-10-22T23:29:55.135392] [INFO ] [MAIN ] DAY: Loaded 49122 primary data records. [2025-10-22T23:29:55.438508] [DEBUG] [MAIN ] DAY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:55.463393] [INFO ] [MAIN ] DAY: Generated 138 derivative records from 49122 primary records. [2025-10-22T23:29:55.463540] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-10-22T23:29:55.475155] [DEBUG] [LOCAL ] DAY: Derivative data saved (138 records). [2025-10-22T23:29:55.475303] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-10-22T23:29:55.478312] [INFO ] [MAIN ] Derivative Progress: 475/2052 symbols. DAY took 0.4s. Estimated remaining time: 10m 21s [2025-10-22T23:29:55.478412] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:55.527190] [DEBUG] [LOCAL ] DB: Loaded 52466 existing records from primary storage. [2025-10-22T23:29:55.527369] [INFO ] [MAIN ] DB: Loaded 52466 primary data records. [2025-10-22T23:29:55.830688] [DEBUG] [MAIN ] DB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:55.855946] [INFO ] [MAIN ] DB: Generated 138 derivative records from 52466 primary records. [2025-10-22T23:29:55.856061] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-22T23:29:55.867493] [DEBUG] [LOCAL ] DB: Derivative data saved (138 records). [2025-10-22T23:29:55.867574] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-10-22T23:29:55.871272] [INFO ] [MAIN ] Derivative Progress: 476/2052 symbols. DB took 0.4s. Estimated remaining time: 10m 21s [2025-10-22T23:29:55.871370] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:55.909911] [DEBUG] [LOCAL ] DBI: Loaded 43370 existing records from primary storage. [2025-10-22T23:29:55.910079] [INFO ] [MAIN ] DBI: Loaded 43370 primary data records. [2025-10-22T23:29:56.219896] [DEBUG] [MAIN ] DBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:56.244935] [INFO ] [MAIN ] DBI: Generated 138 derivative records from 43370 primary records. [2025-10-22T23:29:56.245090] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-22T23:29:56.256440] [DEBUG] [LOCAL ] DBI: Derivative data saved (138 records). [2025-10-22T23:29:56.256518] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-10-22T23:29:56.259337] [INFO ] [MAIN ] Derivative Progress: 477/2052 symbols. DBI took 0.4s. Estimated remaining time: 10m 20s [2025-10-22T23:29:56.259431] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:56.271304] [DEBUG] [LOCAL ] DBL: Loaded 9247 existing records from primary storage. [2025-10-22T23:29:56.271449] [INFO ] [MAIN ] DBL: Loaded 9247 primary data records. [2025-10-22T23:29:56.580994] [DEBUG] [MAIN ] DBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:56.606114] [INFO ] [MAIN ] DBL: Generated 138 derivative records from 9247 primary records. [2025-10-22T23:29:56.606271] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-10-22T23:29:56.618036] [DEBUG] [LOCAL ] DBL: Derivative data saved (138 records). [2025-10-22T23:29:56.618120] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-10-22T23:29:56.620363] [INFO ] [MAIN ] Derivative Progress: 478/2052 symbols. DBL took 0.4s. Estimated remaining time: 10m 20s [2025-10-22T23:29:56.620453] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:56.665281] [DEBUG] [LOCAL ] DBRG: Loaded 49979 existing records from primary storage. [2025-10-22T23:29:56.665440] [INFO ] [MAIN ] DBRG: Loaded 49979 primary data records. [2025-10-22T23:29:57.009265] [DEBUG] [MAIN ] DBRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:57.036232] [INFO ] [MAIN ] DBRG: Generated 138 derivative records from 49979 primary records. [2025-10-22T23:29:57.036358] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-10-22T23:29:57.048205] [DEBUG] [LOCAL ] DBRG: Derivative data saved (138 records). [2025-10-22T23:29:57.048285] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-10-22T23:29:57.051383] [INFO ] [MAIN ] Derivative Progress: 479/2052 symbols. DBRG took 0.4s. Estimated remaining time: 10m 20s [2025-10-22T23:29:57.051482] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:57.085870] [DEBUG] [LOCAL ] DCI: Loaded 36843 existing records from primary storage. [2025-10-22T23:29:57.086040] [INFO ] [MAIN ] DCI: Loaded 36843 primary data records. [2025-10-22T23:29:57.404112] [DEBUG] [MAIN ] DCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:57.430479] [INFO ] [MAIN ] DCI: Generated 138 derivative records from 36843 primary records. [2025-10-22T23:29:57.430606] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-10-22T23:29:57.442251] [DEBUG] [LOCAL ] DCI: Derivative data saved (138 records). [2025-10-22T23:29:57.442354] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-10-22T23:29:57.445704] [INFO ] [MAIN ] Derivative Progress: 480/2052 symbols. DCI took 0.4s. Estimated remaining time: 10m 19s [2025-10-22T23:29:57.445822] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:57.462408] [DEBUG] [LOCAL ] DCO: Loaded 14967 existing records from primary storage. [2025-10-22T23:29:57.462550] [INFO ] [MAIN ] DCO: Loaded 14967 primary data records. [2025-10-22T23:29:57.788406] [DEBUG] [MAIN ] DCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:57.813964] [INFO ] [MAIN ] DCO: Generated 138 derivative records from 14967 primary records. [2025-10-22T23:29:57.814093] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-10-22T23:29:57.825262] [DEBUG] [LOCAL ] DCO: Derivative data saved (138 records). [2025-10-22T23:29:57.825342] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-10-22T23:29:57.828246] [INFO ] [MAIN ] Derivative Progress: 481/2052 symbols. DCO took 0.4s. Estimated remaining time: 10m 19s [2025-10-22T23:29:57.828354] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:57.876399] [DEBUG] [LOCAL ] DDD: Loaded 50948 existing records from primary storage. [2025-10-22T23:29:57.876562] [INFO ] [MAIN ] DDD: Loaded 50948 primary data records. [2025-10-22T23:29:58.180762] [DEBUG] [MAIN ] DDD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:58.205863] [INFO ] [MAIN ] DDD: Generated 138 derivative records from 50948 primary records. [2025-10-22T23:29:58.206054] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-10-22T23:29:58.217609] [DEBUG] [LOCAL ] DDD: Derivative data saved (138 records). [2025-10-22T23:29:58.217711] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-10-22T23:29:58.220935] [INFO ] [MAIN ] Derivative Progress: 482/2052 symbols. DDD took 0.4s. Estimated remaining time: 10m 18s [2025-10-22T23:29:58.221035] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:58.253046] [DEBUG] [LOCAL ] DDL: Loaded 37179 existing records from primary storage. [2025-10-22T23:29:58.253205] [INFO ] [MAIN ] DDL: Loaded 37179 primary data records. [2025-10-22T23:29:58.569582] [DEBUG] [MAIN ] DDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:58.596245] [INFO ] [MAIN ] DDL: Generated 138 derivative records from 37179 primary records. [2025-10-22T23:29:58.596445] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-10-22T23:29:58.608149] [DEBUG] [LOCAL ] DDL: Derivative data saved (138 records). [2025-10-22T23:29:58.608246] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-10-22T23:29:58.611397] [INFO ] [MAIN ] Derivative Progress: 483/2052 symbols. DDL took 0.4s. Estimated remaining time: 10m 18s [2025-10-22T23:29:58.611497] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:58.626627] [DEBUG] [LOCAL ] DDS: Loaded 12375 existing records from primary storage. [2025-10-22T23:29:58.626808] [INFO ] [MAIN ] DDS: Loaded 12375 primary data records. [2025-10-22T23:29:58.975487] [DEBUG] [MAIN ] DDS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:29:59.001704] [INFO ] [MAIN ] DDS: Generated 138 derivative records from 12375 primary records. [2025-10-22T23:29:59.001892] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-10-22T23:29:59.013576] [DEBUG] [LOCAL ] DDS: Derivative data saved (138 records). [2025-10-22T23:29:59.013744] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-10-22T23:29:59.016575] [INFO ] [MAIN ] Derivative Progress: 484/2052 symbols. DDS took 0.4s. Estimated remaining time: 10m 18s [2025-10-22T23:29:59.016766] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:59.061143] [DEBUG] [LOCAL ] DE: Loaded 47533 existing records from primary storage. [2025-10-22T23:29:59.061307] [INFO ] [MAIN ] DE: Loaded 47533 primary data records. [2025-10-22T23:29:59.364830] [DEBUG] [MAIN ] DE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:59.390438] [INFO ] [MAIN ] DE: Generated 138 derivative records from 47533 primary records. [2025-10-22T23:29:59.390556] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-22T23:29:59.402093] [DEBUG] [LOCAL ] DE: Derivative data saved (138 records). [2025-10-22T23:29:59.402172] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-10-22T23:29:59.404867] [INFO ] [MAIN ] Derivative Progress: 485/2052 symbols. DE took 0.4s. Estimated remaining time: 10m 17s [2025-10-22T23:29:59.404967] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:59.461540] [DEBUG] [LOCAL ] DECK: Loaded 53301 existing records from primary storage. [2025-10-22T23:29:59.461752] [INFO ] [MAIN ] DECK: Loaded 53301 primary data records. [2025-10-22T23:29:59.768116] [DEBUG] [MAIN ] DECK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:29:59.792921] [INFO ] [MAIN ] DECK: Generated 138 derivative records from 53301 primary records. [2025-10-22T23:29:59.793027] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-10-22T23:29:59.804796] [DEBUG] [LOCAL ] DECK: Derivative data saved (138 records). [2025-10-22T23:29:59.804879] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-10-22T23:29:59.807942] [INFO ] [MAIN ] Derivative Progress: 486/2052 symbols. DECK took 0.4s. Estimated remaining time: 10m 17s [2025-10-22T23:29:59.808047] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:29:59.854364] [DEBUG] [LOCAL ] DEI: Loaded 48295 existing records from primary storage. [2025-10-22T23:29:59.854523] [INFO ] [MAIN ] DEI: Loaded 48295 primary data records. [2025-10-22T23:30:00.159030] [DEBUG] [MAIN ] DEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:00.184209] [INFO ] [MAIN ] DEI: Generated 138 derivative records from 48295 primary records. [2025-10-22T23:30:00.184351] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-10-22T23:30:00.195868] [DEBUG] [LOCAL ] DEI: Derivative data saved (138 records). [2025-10-22T23:30:00.195947] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-10-22T23:30:00.198930] [INFO ] [MAIN ] Derivative Progress: 487/2052 symbols. DEI took 0.4s. Estimated remaining time: 10m 16s [2025-10-22T23:30:00.199030] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:00.251918] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-22T23:30:00.252080] [INFO ] [MAIN ] DELL: Loaded 53736 primary data records. [2025-10-22T23:30:00.561420] [DEBUG] [MAIN ] DELL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:00.586401] [INFO ] [MAIN ] DELL: Generated 138 derivative records from 53736 primary records. [2025-10-22T23:30:00.586532] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-10-22T23:30:00.598256] [DEBUG] [LOCAL ] DELL: Derivative data saved (138 records). [2025-10-22T23:30:00.598338] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-10-22T23:30:00.601345] [INFO ] [MAIN ] Derivative Progress: 488/2052 symbols. DELL took 0.4s. Estimated remaining time: 10m 16s [2025-10-22T23:30:00.601443] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:00.649231] [DEBUG] [LOCAL ] DEO: Loaded 49185 existing records from primary storage. [2025-10-22T23:30:00.649388] [INFO ] [MAIN ] DEO: Loaded 49185 primary data records. [2025-10-22T23:30:00.983438] [DEBUG] [MAIN ] DEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:01.008713] [INFO ] [MAIN ] DEO: Generated 138 derivative records from 49185 primary records. [2025-10-22T23:30:01.008862] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-10-22T23:30:01.020438] [DEBUG] [LOCAL ] DEO: Derivative data saved (138 records). [2025-10-22T23:30:01.020518] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-10-22T23:30:01.023499] [INFO ] [MAIN ] Derivative Progress: 489/2052 symbols. DEO took 0.4s. Estimated remaining time: 10m 16s [2025-10-22T23:30:01.023596] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:01.075524] [DEBUG] [LOCAL ] DG: Loaded 53259 existing records from primary storage. [2025-10-22T23:30:01.075710] [INFO ] [MAIN ] DG: Loaded 53259 primary data records. [2025-10-22T23:30:01.386037] [DEBUG] [MAIN ] DG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:01.412606] [INFO ] [MAIN ] DG: Generated 138 derivative records from 53259 primary records. [2025-10-22T23:30:01.412826] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-10-22T23:30:01.424883] [DEBUG] [LOCAL ] DG: Derivative data saved (138 records). [2025-10-22T23:30:01.425034] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-10-22T23:30:01.428337] [INFO ] [MAIN ] Derivative Progress: 490/2052 symbols. DG took 0.4s. Estimated remaining time: 10m 15s [2025-10-22T23:30:01.428506] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:01.475673] [DEBUG] [LOCAL ] DGX: Loaded 44610 existing records from primary storage. [2025-10-22T23:30:01.475867] [INFO ] [MAIN ] DGX: Loaded 44610 primary data records. [2025-10-22T23:30:01.790612] [DEBUG] [MAIN ] DGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:01.831167] [INFO ] [MAIN ] DGX: Generated 138 derivative records from 44610 primary records. [2025-10-22T23:30:01.831401] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-10-22T23:30:01.850834] [DEBUG] [LOCAL ] DGX: Derivative data saved (138 records). [2025-10-22T23:30:01.851233] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-10-22T23:30:01.855764] [INFO ] [MAIN ] Derivative Progress: 491/2052 symbols. DGX took 0.4s. Estimated remaining time: 10m 15s [2025-10-22T23:30:01.856047] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:01.888897] [DEBUG] [LOCAL ] DHF: Loaded 20878 existing records from primary storage. [2025-10-22T23:30:01.889081] [INFO ] [MAIN ] DHF: Loaded 20878 primary data records. [2025-10-22T23:30:02.212690] [DEBUG] [MAIN ] DHF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:02.237624] [INFO ] [MAIN ] DHF: Generated 138 derivative records from 20878 primary records. [2025-10-22T23:30:02.237775] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-10-22T23:30:02.248800] [DEBUG] [LOCAL ] DHF: Derivative data saved (138 records). [2025-10-22T23:30:02.248883] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-10-22T23:30:02.251775] [INFO ] [MAIN ] Derivative Progress: 492/2052 symbols. DHF took 0.4s. Estimated remaining time: 10m 15s [2025-10-22T23:30:02.251875] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:02.314793] [DEBUG] [LOCAL ] DHI: Loaded 53363 existing records from primary storage. [2025-10-22T23:30:02.314998] [INFO ] [MAIN ] DHI: Loaded 53363 primary data records. [2025-10-22T23:30:02.648190] [DEBUG] [MAIN ] DHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:02.673973] [INFO ] [MAIN ] DHI: Generated 138 derivative records from 53363 primary records. [2025-10-22T23:30:02.674188] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-10-22T23:30:02.685973] [DEBUG] [LOCAL ] DHI: Derivative data saved (138 records). [2025-10-22T23:30:02.686054] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-10-22T23:30:02.689217] [INFO ] [MAIN ] Derivative Progress: 493/2052 symbols. DHI took 0.4s. Estimated remaining time: 10m 15s [2025-10-22T23:30:02.689326] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:02.705772] [DEBUG] [LOCAL ] DIAX: Loaded 12723 existing records from primary storage. [2025-10-22T23:30:02.705913] [INFO ] [MAIN ] DIAX: Loaded 12723 primary data records. [2025-10-22T23:30:03.031460] [DEBUG] [MAIN ] DIAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:03.057218] [INFO ] [MAIN ] DIAX: Generated 138 derivative records from 12723 primary records. [2025-10-22T23:30:03.057380] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-10-22T23:30:03.068805] [DEBUG] [LOCAL ] DIAX: Derivative data saved (138 records). [2025-10-22T23:30:03.068883] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-10-22T23:30:03.071591] [INFO ] [MAIN ] Derivative Progress: 494/2052 symbols. DIAX took 0.4s. Estimated remaining time: 10m 14s [2025-10-22T23:30:03.071741] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:03.107937] [DEBUG] [LOCAL ] DIN: Loaded 36752 existing records from primary storage. [2025-10-22T23:30:03.108103] [INFO ] [MAIN ] DIN: Loaded 36752 primary data records. [2025-10-22T23:30:03.448369] [DEBUG] [MAIN ] DIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:03.473712] [INFO ] [MAIN ] DIN: Generated 138 derivative records from 36752 primary records. [2025-10-22T23:30:03.473919] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-10-22T23:30:03.486161] [DEBUG] [LOCAL ] DIN: Derivative data saved (138 records). [2025-10-22T23:30:03.486285] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-10-22T23:30:03.489285] [INFO ] [MAIN ] Derivative Progress: 495/2052 symbols. DIN took 0.4s. Estimated remaining time: 10m 14s [2025-10-22T23:30:03.489397] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:03.542211] [DEBUG] [LOCAL ] DINO: Loaded 52825 existing records from primary storage. [2025-10-22T23:30:03.542383] [INFO ] [MAIN ] DINO: Loaded 52825 primary data records. [2025-10-22T23:30:03.851509] [DEBUG] [MAIN ] DINO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:03.876244] [INFO ] [MAIN ] DINO: Generated 138 derivative records from 52825 primary records. [2025-10-22T23:30:03.876368] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-10-22T23:30:03.887989] [DEBUG] [LOCAL ] DINO: Derivative data saved (138 records). [2025-10-22T23:30:03.888084] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-10-22T23:30:03.891281] [INFO ] [MAIN ] Derivative Progress: 496/2052 symbols. DINO took 0.4s. Estimated remaining time: 10m 13s [2025-10-22T23:30:03.891394] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:03.937331] [DEBUG] [LOCAL ] DK: Loaded 49230 existing records from primary storage. [2025-10-22T23:30:03.937503] [INFO ] [MAIN ] DK: Loaded 49230 primary data records. [2025-10-22T23:30:04.242917] [DEBUG] [MAIN ] DK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:04.267961] [INFO ] [MAIN ] DK: Generated 138 derivative records from 49230 primary records. [2025-10-22T23:30:04.268097] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-10-22T23:30:04.279999] [DEBUG] [LOCAL ] DK: Derivative data saved (138 records). [2025-10-22T23:30:04.280118] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-10-22T23:30:04.283168] [INFO ] [MAIN ] Derivative Progress: 497/2052 symbols. DK took 0.4s. Estimated remaining time: 10m 13s [2025-10-22T23:30:04.283286] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:04.302865] [DEBUG] [LOCAL ] DKL: Loaded 16871 existing records from primary storage. [2025-10-22T23:30:04.303023] [INFO ] [MAIN ] DKL: Loaded 16871 primary data records. [2025-10-22T23:30:04.609229] [DEBUG] [MAIN ] DKL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:04.634610] [INFO ] [MAIN ] DKL: Generated 138 derivative records from 16871 primary records. [2025-10-22T23:30:04.634755] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-10-22T23:30:04.646053] [DEBUG] [LOCAL ] DKL: Derivative data saved (138 records). [2025-10-22T23:30:04.646136] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-10-22T23:30:04.648907] [INFO ] [MAIN ] Derivative Progress: 498/2052 symbols. DKL took 0.4s. Estimated remaining time: 10m 13s [2025-10-22T23:30:04.649032] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:04.679920] [DEBUG] [LOCAL ] DLB: Loaded 32217 existing records from primary storage. [2025-10-22T23:30:04.680086] [INFO ] [MAIN ] DLB: Loaded 32217 primary data records. [2025-10-22T23:30:04.986842] [DEBUG] [MAIN ] DLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:05.012480] [INFO ] [MAIN ] DLB: Generated 138 derivative records from 32217 primary records. [2025-10-22T23:30:05.012613] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-10-22T23:30:05.024484] [DEBUG] [LOCAL ] DLB: Derivative data saved (138 records). [2025-10-22T23:30:05.024570] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-10-22T23:30:05.027580] [INFO ] [MAIN ] Derivative Progress: 499/2052 symbols. DLB took 0.4s. Estimated remaining time: 10m 12s [2025-10-22T23:30:05.027715] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:05.038016] [DEBUG] [LOCAL ] DLNG: Loaded 6048 existing records from primary storage. [2025-10-22T23:30:05.038152] [INFO ] [MAIN ] DLNG: Loaded 6048 primary data records. [2025-10-22T23:30:05.378206] [DEBUG] [MAIN ] DLNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:05.403675] [INFO ] [MAIN ] DLNG: Generated 138 derivative records from 6048 primary records. [2025-10-22T23:30:05.403803] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-10-22T23:30:05.414413] [DEBUG] [LOCAL ] DLNG: Derivative data saved (138 records). [2025-10-22T23:30:05.414496] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-10-22T23:30:05.416784] [INFO ] [MAIN ] Derivative Progress: 500/2052 symbols. DLNG took 0.4s. Estimated remaining time: 10m 12s [2025-10-22T23:30:05.416887] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:05.473130] [DEBUG] [LOCAL ] DLR: Loaded 50597 existing records from primary storage. [2025-10-22T23:30:05.473328] [INFO ] [MAIN ] DLR: Loaded 50597 primary data records. [2025-10-22T23:30:05.783450] [DEBUG] [MAIN ] DLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:05.808999] [INFO ] [MAIN ] DLR: Generated 138 derivative records from 50597 primary records. [2025-10-22T23:30:05.809156] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-22T23:30:05.821299] [DEBUG] [LOCAL ] DLR: Derivative data saved (138 records). [2025-10-22T23:30:05.821388] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-10-22T23:30:05.824525] [INFO ] [MAIN ] Derivative Progress: 501/2052 symbols. DLR took 0.4s. Estimated remaining time: 10m 11s [2025-10-22T23:30:05.824696] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:05.853914] [DEBUG] [LOCAL ] DLX: Loaded 28049 existing records from primary storage. [2025-10-22T23:30:05.854071] [INFO ] [MAIN ] DLX: Loaded 28049 primary data records. [2025-10-22T23:30:06.165930] [DEBUG] [MAIN ] DLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:06.191602] [INFO ] [MAIN ] DLX: Generated 138 derivative records from 28049 primary records. [2025-10-22T23:30:06.191742] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-10-22T23:30:06.203285] [DEBUG] [LOCAL ] DLX: Derivative data saved (138 records). [2025-10-22T23:30:06.203389] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-10-22T23:30:06.206221] [INFO ] [MAIN ] Derivative Progress: 502/2052 symbols. DLX took 0.4s. Estimated remaining time: 10m 11s [2025-10-22T23:30:06.206341] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:06.215735] [DEBUG] [LOCAL ] DMA: Loaded 4714 existing records from primary storage. [2025-10-22T23:30:06.215888] [INFO ] [MAIN ] DMA: Loaded 4714 primary data records. [2025-10-22T23:30:06.528506] [DEBUG] [MAIN ] DMA: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:30:06.554888] [INFO ] [MAIN ] DMA: Generated 138 derivative records from 4714 primary records. [2025-10-22T23:30:06.555023] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-10-22T23:30:06.565031] [DEBUG] [LOCAL ] DMA: Derivative data saved (138 records). [2025-10-22T23:30:06.565120] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-10-22T23:30:06.567367] [INFO ] [MAIN ] Derivative Progress: 503/2052 symbols. DMA took 0.4s. Estimated remaining time: 10m 10s [2025-10-22T23:30:06.567501] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:06.580488] [DEBUG] [LOCAL ] DMO: Loaded 9788 existing records from primary storage. [2025-10-22T23:30:06.580691] [INFO ] [MAIN ] DMO: Loaded 9788 primary data records. [2025-10-22T23:30:06.894994] [DEBUG] [MAIN ] DMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:06.920210] [INFO ] [MAIN ] DMO: Generated 138 derivative records from 9788 primary records. [2025-10-22T23:30:06.920363] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-10-22T23:30:06.932002] [DEBUG] [LOCAL ] DMO: Derivative data saved (138 records). [2025-10-22T23:30:06.932085] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-10-22T23:30:06.934212] [INFO ] [MAIN ] Derivative Progress: 504/2052 symbols. DMO took 0.4s. Estimated remaining time: 10m 10s [2025-10-22T23:30:06.934329] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:06.978612] [DEBUG] [LOCAL ] DNOW: Loaded 43752 existing records from primary storage. [2025-10-22T23:30:06.978810] [INFO ] [MAIN ] DNOW: Loaded 43752 primary data records. [2025-10-22T23:30:07.344304] [DEBUG] [MAIN ] DNOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:07.372621] [INFO ] [MAIN ] DNOW: Generated 138 derivative records from 43752 primary records. [2025-10-22T23:30:07.372777] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-10-22T23:30:07.385416] [DEBUG] [LOCAL ] DNOW: Derivative data saved (138 records). [2025-10-22T23:30:07.385499] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-10-22T23:30:07.388563] [INFO ] [MAIN ] Derivative Progress: 505/2052 symbols. DNOW took 0.5s. Estimated remaining time: 10m 10s [2025-10-22T23:30:07.388695] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:07.421217] [DEBUG] [LOCAL ] DNP: Loaded 32937 existing records from primary storage. [2025-10-22T23:30:07.421374] [INFO ] [MAIN ] DNP: Loaded 32937 primary data records. [2025-10-22T23:30:07.740349] [DEBUG] [MAIN ] DNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:07.765187] [INFO ] [MAIN ] DNP: Generated 138 derivative records from 32937 primary records. [2025-10-22T23:30:07.765297] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-10-22T23:30:07.776863] [DEBUG] [LOCAL ] DNP: Derivative data saved (138 records). [2025-10-22T23:30:07.776959] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-10-22T23:30:07.779598] [INFO ] [MAIN ] Derivative Progress: 506/2052 symbols. DNP took 0.4s. Estimated remaining time: 10m 9s [2025-10-22T23:30:07.779755] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:07.832865] [DEBUG] [LOCAL ] DOC: Loaded 53555 existing records from primary storage. [2025-10-22T23:30:07.833040] [INFO ] [MAIN ] DOC: Loaded 53555 primary data records. [2025-10-22T23:30:08.138389] [DEBUG] [MAIN ] DOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:08.163249] [INFO ] [MAIN ] DOC: Generated 138 derivative records from 53555 primary records. [2025-10-22T23:30:08.163391] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-22T23:30:08.175223] [DEBUG] [LOCAL ] DOC: Derivative data saved (138 records). [2025-10-22T23:30:08.175322] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-22T23:30:08.178425] [INFO ] [MAIN ] Derivative Progress: 507/2052 symbols. DOC took 0.4s. Estimated remaining time: 10m 9s [2025-10-22T23:30:08.178552] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:08.227823] [DEBUG] [LOCAL ] DOCN: Loaded 51129 existing records from primary storage. [2025-10-22T23:30:08.228006] [INFO ] [MAIN ] DOCN: Loaded 51129 primary data records. [2025-10-22T23:30:08.532556] [DEBUG] [MAIN ] DOCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:08.557700] [INFO ] [MAIN ] DOCN: Generated 138 derivative records from 51129 primary records. [2025-10-22T23:30:08.557807] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-22T23:30:08.569307] [DEBUG] [LOCAL ] DOCN: Derivative data saved (138 records). [2025-10-22T23:30:08.569388] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-10-22T23:30:08.572438] [INFO ] [MAIN ] Derivative Progress: 508/2052 symbols. DOCN took 0.4s. Estimated remaining time: 10m 9s [2025-10-22T23:30:08.572534] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:08.619574] [DEBUG] [LOCAL ] DOCS: Loaded 50353 existing records from primary storage. [2025-10-22T23:30:08.619740] [INFO ] [MAIN ] DOCS: Loaded 50353 primary data records. [2025-10-22T23:30:08.927465] [DEBUG] [MAIN ] DOCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:08.956367] [INFO ] [MAIN ] DOCS: Generated 138 derivative records from 50353 primary records. [2025-10-22T23:30:08.956526] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-10-22T23:30:08.968305] [DEBUG] [LOCAL ] DOCS: Derivative data saved (138 records). [2025-10-22T23:30:08.968387] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-10-22T23:30:08.971328] [INFO ] [MAIN ] Derivative Progress: 509/2052 symbols. DOCS took 0.4s. Estimated remaining time: 10m 8s [2025-10-22T23:30:08.971427] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:09.001886] [DEBUG] [LOCAL ] DOUG: Loaded 33811 existing records from primary storage. [2025-10-22T23:30:09.002038] [INFO ] [MAIN ] DOUG: Loaded 33811 primary data records. [2025-10-22T23:30:09.343077] [DEBUG] [MAIN ] DOUG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:09.368557] [INFO ] [MAIN ] DOUG: Generated 138 derivative records from 33811 primary records. [2025-10-22T23:30:09.368706] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-22T23:30:09.380087] [DEBUG] [LOCAL ] DOUG: Derivative data saved (138 records). [2025-10-22T23:30:09.380165] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-10-22T23:30:09.382996] [INFO ] [MAIN ] Derivative Progress: 510/2052 symbols. DOUG took 0.4s. Estimated remaining time: 10m 8s [2025-10-22T23:30:09.383105] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:09.428011] [DEBUG] [LOCAL ] DOV: Loaded 45584 existing records from primary storage. [2025-10-22T23:30:09.428199] [INFO ] [MAIN ] DOV: Loaded 45584 primary data records. [2025-10-22T23:30:09.738522] [DEBUG] [MAIN ] DOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:09.764141] [INFO ] [MAIN ] DOV: Generated 138 derivative records from 45584 primary records. [2025-10-22T23:30:09.764272] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-10-22T23:30:09.776309] [DEBUG] [LOCAL ] DOV: Derivative data saved (138 records). [2025-10-22T23:30:09.776391] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-10-22T23:30:09.779286] [INFO ] [MAIN ] Derivative Progress: 511/2052 symbols. DOV took 0.4s. Estimated remaining time: 10m 7s [2025-10-22T23:30:09.779385] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:09.840139] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-22T23:30:09.840325] [INFO ] [MAIN ] DOW: Loaded 53733 primary data records. [2025-10-22T23:30:10.151317] [DEBUG] [MAIN ] DOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:10.176237] [INFO ] [MAIN ] DOW: Generated 138 derivative records from 53733 primary records. [2025-10-22T23:30:10.176345] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-10-22T23:30:10.188081] [DEBUG] [LOCAL ] DOW: Derivative data saved (138 records). [2025-10-22T23:30:10.188158] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-10-22T23:30:10.191210] [INFO ] [MAIN ] Derivative Progress: 512/2052 symbols. DOW took 0.4s. Estimated remaining time: 10m 7s [2025-10-22T23:30:10.191306] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:10.208315] [DEBUG] [LOCAL ] DPG: Loaded 13345 existing records from primary storage. [2025-10-22T23:30:10.208457] [INFO ] [MAIN ] DPG: Loaded 13345 primary data records. [2025-10-22T23:30:10.515160] [DEBUG] [MAIN ] DPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:10.540412] [INFO ] [MAIN ] DPG: Generated 138 derivative records from 13345 primary records. [2025-10-22T23:30:10.540518] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-10-22T23:30:10.552038] [DEBUG] [LOCAL ] DPG: Derivative data saved (138 records). [2025-10-22T23:30:10.552115] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-10-22T23:30:10.554783] [INFO ] [MAIN ] Derivative Progress: 513/2052 symbols. DPG took 0.4s. Estimated remaining time: 10m 7s [2025-10-22T23:30:10.554880] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:10.591938] [DEBUG] [LOCAL ] DRD: Loaded 37899 existing records from primary storage. [2025-10-22T23:30:10.592093] [INFO ] [MAIN ] DRD: Loaded 37899 primary data records. [2025-10-22T23:30:10.905174] [DEBUG] [MAIN ] DRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:10.931133] [INFO ] [MAIN ] DRD: Generated 138 derivative records from 37899 primary records. [2025-10-22T23:30:10.931255] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-10-22T23:30:10.942956] [DEBUG] [LOCAL ] DRD: Derivative data saved (138 records). [2025-10-22T23:30:10.943033] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-10-22T23:30:10.945870] [INFO ] [MAIN ] Derivative Progress: 514/2052 symbols. DRD took 0.4s. Estimated remaining time: 10m 6s [2025-10-22T23:30:10.945965] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:10.990803] [DEBUG] [LOCAL ] DRI: Loaded 47513 existing records from primary storage. [2025-10-22T23:30:10.990958] [INFO ] [MAIN ] DRI: Loaded 47513 primary data records. [2025-10-22T23:30:11.294116] [DEBUG] [MAIN ] DRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:11.319083] [INFO ] [MAIN ] DRI: Generated 138 derivative records from 47513 primary records. [2025-10-22T23:30:11.319193] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-10-22T23:30:11.331259] [DEBUG] [LOCAL ] DRI: Derivative data saved (138 records). [2025-10-22T23:30:11.331342] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-10-22T23:30:11.334062] [INFO ] [MAIN ] Derivative Progress: 515/2052 symbols. DRI took 0.4s. Estimated remaining time: 10m 6s [2025-10-22T23:30:11.334167] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:11.361737] [DEBUG] [LOCAL ] DSL: Loaded 28887 existing records from primary storage. [2025-10-22T23:30:11.361878] [INFO ] [MAIN ] DSL: Loaded 28887 primary data records. [2025-10-22T23:30:11.693019] [DEBUG] [MAIN ] DSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:11.718518] [INFO ] [MAIN ] DSL: Generated 138 derivative records from 28887 primary records. [2025-10-22T23:30:11.718683] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-10-22T23:30:11.730485] [DEBUG] [LOCAL ] DSL: Derivative data saved (138 records). [2025-10-22T23:30:11.730570] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-10-22T23:30:11.733595] [INFO ] [MAIN ] Derivative Progress: 516/2052 symbols. DSL took 0.4s. Estimated remaining time: 10m 5s [2025-10-22T23:30:11.733715] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:11.750543] [DEBUG] [LOCAL ] DSM: Loaded 14178 existing records from primary storage. [2025-10-22T23:30:11.750704] [INFO ] [MAIN ] DSM: Loaded 14178 primary data records. [2025-10-22T23:30:12.052157] [DEBUG] [MAIN ] DSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:12.076842] [INFO ] [MAIN ] DSM: Generated 138 derivative records from 14178 primary records. [2025-10-22T23:30:12.076944] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-10-22T23:30:12.087158] [DEBUG] [LOCAL ] DSM: Derivative data saved (138 records). [2025-10-22T23:30:12.087236] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-10-22T23:30:12.089998] [INFO ] [MAIN ] Derivative Progress: 517/2052 symbols. DSM took 0.4s. Estimated remaining time: 10m 5s [2025-10-22T23:30:12.090093] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:12.112209] [DEBUG] [LOCAL ] DSU: Loaded 22871 existing records from primary storage. [2025-10-22T23:30:12.112343] [INFO ] [MAIN ] DSU: Loaded 22871 primary data records. [2025-10-22T23:30:12.414890] [DEBUG] [MAIN ] DSU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:12.443397] [INFO ] [MAIN ] DSU: Generated 138 derivative records from 22871 primary records. [2025-10-22T23:30:12.443524] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-10-22T23:30:12.455064] [DEBUG] [LOCAL ] DSU: Derivative data saved (138 records). [2025-10-22T23:30:12.455142] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-10-22T23:30:12.458070] [INFO ] [MAIN ] Derivative Progress: 518/2052 symbols. DSU took 0.4s. Estimated remaining time: 10m 4s [2025-10-22T23:30:12.458167] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:12.481096] [DEBUG] [LOCAL ] DSX: Loaded 23496 existing records from primary storage. [2025-10-22T23:30:12.481237] [INFO ] [MAIN ] DSX: Loaded 23496 primary data records. [2025-10-22T23:30:12.788339] [DEBUG] [MAIN ] DSX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:12.813057] [INFO ] [MAIN ] DSX: Generated 138 derivative records from 23496 primary records. [2025-10-22T23:30:12.813166] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-10-22T23:30:12.824358] [DEBUG] [LOCAL ] DSX: Derivative data saved (138 records). [2025-10-22T23:30:12.824435] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-10-22T23:30:12.827312] [INFO ] [MAIN ] Derivative Progress: 519/2052 symbols. DSX took 0.4s. Estimated remaining time: 10m 4s [2025-10-22T23:30:12.827406] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:12.877375] [DEBUG] [LOCAL ] DT: Loaded 52954 existing records from primary storage. [2025-10-22T23:30:12.877532] [INFO ] [MAIN ] DT: Loaded 52954 primary data records. [2025-10-22T23:30:13.182116] [DEBUG] [MAIN ] DT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:13.207308] [INFO ] [MAIN ] DT: Generated 138 derivative records from 52954 primary records. [2025-10-22T23:30:13.207419] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-10-22T23:30:13.218760] [DEBUG] [LOCAL ] DT: Derivative data saved (138 records). [2025-10-22T23:30:13.218839] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-10-22T23:30:13.221949] [INFO ] [MAIN ] Derivative Progress: 520/2052 symbols. DT took 0.4s. Estimated remaining time: 10m 4s [2025-10-22T23:30:13.222046] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:13.269739] [DEBUG] [LOCAL ] DTE: Loaded 47121 existing records from primary storage. [2025-10-22T23:30:13.269896] [INFO ] [MAIN ] DTE: Loaded 47121 primary data records. [2025-10-22T23:30:13.602075] [DEBUG] [MAIN ] DTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:13.630136] [INFO ] [MAIN ] DTE: Generated 138 derivative records from 47121 primary records. [2025-10-22T23:30:13.630308] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-10-22T23:30:13.642100] [DEBUG] [LOCAL ] DTE: Derivative data saved (138 records). [2025-10-22T23:30:13.642193] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-10-22T23:30:13.645091] [INFO ] [MAIN ] Derivative Progress: 521/2052 symbols. DTE took 0.4s. Estimated remaining time: 10m 3s [2025-10-22T23:30:13.645210] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:13.655885] [DEBUG] [LOCAL ] DTG: Loaded 5687 existing records from primary storage. [2025-10-22T23:30:13.656036] [INFO ] [MAIN ] DTG: Loaded 5687 primary data records. [2025-10-22T23:30:13.969570] [DEBUG] [MAIN ] DTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:13.995429] [INFO ] [MAIN ] DTG: Generated 138 derivative records from 5687 primary records. [2025-10-22T23:30:13.995557] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-10-22T23:30:14.006353] [DEBUG] [LOCAL ] DTG: Derivative data saved (138 records). [2025-10-22T23:30:14.006455] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-10-22T23:30:14.008755] [INFO ] [MAIN ] Derivative Progress: 522/2052 symbols. DTG took 0.4s. Estimated remaining time: 10m 3s [2025-10-22T23:30:14.008879] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:14.054218] [DEBUG] [LOCAL ] DTM: Loaded 43686 existing records from primary storage. [2025-10-22T23:30:14.054378] [INFO ] [MAIN ] DTM: Loaded 43686 primary data records. [2025-10-22T23:30:14.367112] [DEBUG] [MAIN ] DTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:14.392518] [INFO ] [MAIN ] DTM: Generated 138 derivative records from 43686 primary records. [2025-10-22T23:30:14.392696] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-10-22T23:30:14.404342] [DEBUG] [LOCAL ] DTM: Derivative data saved (138 records). [2025-10-22T23:30:14.404441] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-10-22T23:30:14.407379] [INFO ] [MAIN ] Derivative Progress: 523/2052 symbols. DTM took 0.4s. Estimated remaining time: 10m 2s [2025-10-22T23:30:14.407497] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:14.416543] [DEBUG] [LOCAL ] DTW: Loaded 4713 existing records from primary storage. [2025-10-22T23:30:14.416734] [INFO ] [MAIN ] DTW: Loaded 4713 primary data records. [2025-10-22T23:30:14.721665] [DEBUG] [MAIN ] DTW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:14.746626] [INFO ] [MAIN ] DTW: Generated 138 derivative records from 4713 primary records. [2025-10-22T23:30:14.746769] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-10-22T23:30:14.757221] [DEBUG] [LOCAL ] DTW: Derivative data saved (138 records). [2025-10-22T23:30:14.757313] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-10-22T23:30:14.759420] [INFO ] [MAIN ] Derivative Progress: 524/2052 symbols. DTW took 0.4s. Estimated remaining time: 10m 2s [2025-10-22T23:30:14.759518] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:14.768076] [DEBUG] [LOCAL ] DUKB: Loaded 6134 existing records from primary storage. [2025-10-22T23:30:14.768203] [INFO ] [MAIN ] DUKB: Loaded 6134 primary data records. [2025-10-22T23:30:15.071972] [DEBUG] [MAIN ] DUKB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:15.097089] [INFO ] [MAIN ] DUKB: Generated 138 derivative records from 6134 primary records. [2025-10-22T23:30:15.097210] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-10-22T23:30:15.108127] [DEBUG] [LOCAL ] DUKB: Derivative data saved (138 records). [2025-10-22T23:30:15.108232] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-10-22T23:30:15.110514] [INFO ] [MAIN ] Derivative Progress: 525/2052 symbols. DUKB took 0.4s. Estimated remaining time: 10m 1s [2025-10-22T23:30:15.110706] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:15.163040] [DEBUG] [LOCAL ] DV: Loaded 51241 existing records from primary storage. [2025-10-22T23:30:15.163219] [INFO ] [MAIN ] DV: Loaded 51241 primary data records. [2025-10-22T23:30:15.501796] [DEBUG] [MAIN ] DV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:15.527862] [INFO ] [MAIN ] DV: Generated 138 derivative records from 51241 primary records. [2025-10-22T23:30:15.527984] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-22T23:30:15.540185] [DEBUG] [LOCAL ] DV: Derivative data saved (138 records). [2025-10-22T23:30:15.540273] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-22T23:30:15.543449] [INFO ] [MAIN ] Derivative Progress: 526/2052 symbols. DV took 0.4s. Estimated remaining time: 10m 1s [2025-10-22T23:30:15.543579] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:15.584032] [DEBUG] [LOCAL ] DVA: Loaded 40649 existing records from primary storage. [2025-10-22T23:30:15.584191] [INFO ] [MAIN ] DVA: Loaded 40649 primary data records. [2025-10-22T23:30:15.895443] [DEBUG] [MAIN ] DVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:15.924313] [INFO ] [MAIN ] DVA: Generated 138 derivative records from 40649 primary records. [2025-10-22T23:30:15.924524] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-10-22T23:30:15.936192] [DEBUG] [LOCAL ] DVA: Derivative data saved (138 records). [2025-10-22T23:30:15.936271] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-10-22T23:30:15.939163] [INFO ] [MAIN ] Derivative Progress: 527/2052 symbols. DVA took 0.4s. Estimated remaining time: 10m 1s [2025-10-22T23:30:15.939259] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:15.987869] [DEBUG] [LOCAL ] DXC: Loaded 49919 existing records from primary storage. [2025-10-22T23:30:15.988028] [INFO ] [MAIN ] DXC: Loaded 49919 primary data records. [2025-10-22T23:30:16.298547] [DEBUG] [MAIN ] DXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:16.324221] [INFO ] [MAIN ] DXC: Generated 138 derivative records from 49919 primary records. [2025-10-22T23:30:16.324356] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-10-22T23:30:16.336022] [DEBUG] [LOCAL ] DXC: Derivative data saved (138 records). [2025-10-22T23:30:16.336102] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-10-22T23:30:16.339058] [INFO ] [MAIN ] Derivative Progress: 528/2052 symbols. DXC took 0.4s. Estimated remaining time: 10m 0s [2025-10-22T23:30:16.339162] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:16.376075] [DEBUG] [LOCAL ] DXYZ: Loaded 37126 existing records from primary storage. [2025-10-22T23:30:16.376233] [INFO ] [MAIN ] DXYZ: Loaded 37126 primary data records. [2025-10-22T23:30:16.703636] [DEBUG] [MAIN ] DXYZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:16.728621] [INFO ] [MAIN ] DXYZ: Generated 138 derivative records from 37126 primary records. [2025-10-22T23:30:16.728763] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-10-22T23:30:16.740136] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (138 records). [2025-10-22T23:30:16.740215] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-10-22T23:30:16.743053] [INFO ] [MAIN ] Derivative Progress: 529/2052 symbols. DXYZ took 0.4s. Estimated remaining time: 9m 60s [2025-10-22T23:30:16.743156] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:16.771188] [DEBUG] [LOCAL ] DY: Loaded 28046 existing records from primary storage. [2025-10-22T23:30:16.771356] [INFO ] [MAIN ] DY: Loaded 28046 primary data records. [2025-10-22T23:30:17.082670] [DEBUG] [MAIN ] DY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:17.107920] [INFO ] [MAIN ] DY: Generated 138 derivative records from 28046 primary records. [2025-10-22T23:30:17.108035] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-10-22T23:30:17.119541] [DEBUG] [LOCAL ] DY: Derivative data saved (138 records). [2025-10-22T23:30:17.119619] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-10-22T23:30:17.122496] [INFO ] [MAIN ] Derivative Progress: 530/2052 symbols. DY took 0.4s. Estimated remaining time: 9m 59s [2025-10-22T23:30:17.122598] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:17.170528] [DEBUG] [LOCAL ] EAT: Loaded 49719 existing records from primary storage. [2025-10-22T23:30:17.170715] [INFO ] [MAIN ] EAT: Loaded 49719 primary data records. [2025-10-22T23:30:17.474317] [DEBUG] [MAIN ] EAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:17.499224] [INFO ] [MAIN ] EAT: Generated 138 derivative records from 49719 primary records. [2025-10-22T23:30:17.499357] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-10-22T23:30:17.510980] [DEBUG] [LOCAL ] EAT: Derivative data saved (138 records). [2025-10-22T23:30:17.511060] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-10-22T23:30:17.514051] [INFO ] [MAIN ] Derivative Progress: 531/2052 symbols. EAT took 0.4s. Estimated remaining time: 9m 59s [2025-10-22T23:30:17.514146] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:17.534929] [DEBUG] [LOCAL ] EBF: Loaded 19250 existing records from primary storage. [2025-10-22T23:30:17.535084] [INFO ] [MAIN ] EBF: Loaded 19250 primary data records. [2025-10-22T23:30:17.868846] [DEBUG] [MAIN ] EBF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:17.894124] [INFO ] [MAIN ] EBF: Generated 138 derivative records from 19250 primary records. [2025-10-22T23:30:17.894258] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-10-22T23:30:17.905813] [DEBUG] [LOCAL ] EBF: Derivative data saved (138 records). [2025-10-22T23:30:17.905894] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-10-22T23:30:17.908610] [INFO ] [MAIN ] Derivative Progress: 532/2052 symbols. EBF took 0.4s. Estimated remaining time: 9m 59s [2025-10-22T23:30:17.908739] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:17.948560] [DEBUG] [LOCAL ] EBR: Loaded 43347 existing records from primary storage. [2025-10-22T23:30:17.948752] [INFO ] [MAIN ] EBR: Loaded 43347 primary data records. [2025-10-22T23:30:18.254158] [DEBUG] [MAIN ] EBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:18.280155] [INFO ] [MAIN ] EBR: Generated 138 derivative records from 43347 primary records. [2025-10-22T23:30:18.280312] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-22T23:30:18.291709] [DEBUG] [LOCAL ] EBR: Derivative data saved (138 records). [2025-10-22T23:30:18.291824] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-10-22T23:30:18.294577] [INFO ] [MAIN ] Derivative Progress: 533/2052 symbols. EBR took 0.4s. Estimated remaining time: 9m 58s [2025-10-22T23:30:18.294714] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:18.338775] [DEBUG] [LOCAL ] EBS: Loaded 46589 existing records from primary storage. [2025-10-22T23:30:18.338940] [INFO ] [MAIN ] EBS: Loaded 46589 primary data records. [2025-10-22T23:30:18.656718] [DEBUG] [MAIN ] EBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:18.681779] [INFO ] [MAIN ] EBS: Generated 138 derivative records from 46589 primary records. [2025-10-22T23:30:18.681878] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-10-22T23:30:18.693182] [DEBUG] [LOCAL ] EBS: Derivative data saved (138 records). [2025-10-22T23:30:18.693263] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-10-22T23:30:18.696213] [INFO ] [MAIN ] Derivative Progress: 534/2052 symbols. EBS took 0.4s. Estimated remaining time: 9m 58s [2025-10-22T23:30:18.696320] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:18.726687] [DEBUG] [LOCAL ] ECAT: Loaded 29135 existing records from primary storage. [2025-10-22T23:30:18.726838] [INFO ] [MAIN ] ECAT: Loaded 29135 primary data records. [2025-10-22T23:30:19.039413] [DEBUG] [MAIN ] ECAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:19.065234] [INFO ] [MAIN ] ECAT: Generated 138 derivative records from 29135 primary records. [2025-10-22T23:30:19.065418] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-10-22T23:30:19.078114] [DEBUG] [LOCAL ] ECAT: Derivative data saved (138 records). [2025-10-22T23:30:19.078268] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-10-22T23:30:19.081294] [INFO ] [MAIN ] Derivative Progress: 535/2052 symbols. ECAT took 0.4s. Estimated remaining time: 9m 57s [2025-10-22T23:30:19.081438] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:19.122565] [DEBUG] [LOCAL ] ECC: Loaded 43377 existing records from primary storage. [2025-10-22T23:30:19.122783] [INFO ] [MAIN ] ECC: Loaded 43377 primary data records. [2025-10-22T23:30:19.447378] [DEBUG] [MAIN ] ECC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:19.473285] [INFO ] [MAIN ] ECC: Generated 138 derivative records from 43377 primary records. [2025-10-22T23:30:19.473402] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-10-22T23:30:19.484823] [DEBUG] [LOCAL ] ECC: Derivative data saved (138 records). [2025-10-22T23:30:19.484939] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-10-22T23:30:19.487878] [INFO ] [MAIN ] Derivative Progress: 536/2052 symbols. ECC took 0.4s. Estimated remaining time: 9m 57s [2025-10-22T23:30:19.487977] [INFO ] [MAIN ] ECCU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:19.492635] [DEBUG] [LOCAL ] ECCU: Loaded 2152 existing records from primary storage. [2025-10-22T23:30:19.492748] [INFO ] [MAIN ] ECCU: Loaded 2152 primary data records. [2025-10-22T23:30:19.843602] [DEBUG] [MAIN ] ECCU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:19.869680] [INFO ] [MAIN ] ECCU: Generated 138 derivative records from 2152 primary records. [2025-10-22T23:30:19.869862] [DEBUG] [LOCAL ] ECCU: Saving derivative data. [2025-10-22T23:30:19.879462] [DEBUG] [LOCAL ] ECCU: Derivative data saved (138 records). [2025-10-22T23:30:19.879576] [INFO ] [MAIN ] ECCU: Successfully saved derivative data. [2025-10-22T23:30:19.881917] [INFO ] [MAIN ] Derivative Progress: 537/2052 symbols. ECCU took 0.4s. Estimated remaining time: 9m 57s [2025-10-22T23:30:19.882030] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:19.916965] [DEBUG] [LOCAL ] ECG: Loaded 32780 existing records from primary storage. [2025-10-22T23:30:19.917137] [INFO ] [MAIN ] ECG: Loaded 32780 primary data records. [2025-10-22T23:30:20.224790] [DEBUG] [MAIN ] ECG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:20.250835] [INFO ] [MAIN ] ECG: Generated 138 derivative records from 32780 primary records. [2025-10-22T23:30:20.251058] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-10-22T23:30:20.266704] [DEBUG] [LOCAL ] ECG: Derivative data saved (138 records). [2025-10-22T23:30:20.266901] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-10-22T23:30:20.270025] [INFO ] [MAIN ] Derivative Progress: 538/2052 symbols. ECG took 0.4s. Estimated remaining time: 9m 56s [2025-10-22T23:30:20.270152] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:20.318490] [DEBUG] [LOCAL ] ECL: Loaded 46689 existing records from primary storage. [2025-10-22T23:30:20.318701] [INFO ] [MAIN ] ECL: Loaded 46689 primary data records. [2025-10-22T23:30:20.646106] [DEBUG] [MAIN ] ECL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:20.673061] [INFO ] [MAIN ] ECL: Generated 138 derivative records from 46689 primary records. [2025-10-22T23:30:20.673263] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-22T23:30:20.685137] [DEBUG] [LOCAL ] ECL: Derivative data saved (138 records). [2025-10-22T23:30:20.685256] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-10-22T23:30:20.688228] [INFO ] [MAIN ] Derivative Progress: 539/2052 symbols. ECL took 0.4s. Estimated remaining time: 9m 56s [2025-10-22T23:30:20.688363] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:20.709790] [DEBUG] [LOCAL ] ECO: Loaded 18017 existing records from primary storage. [2025-10-22T23:30:20.709945] [INFO ] [MAIN ] ECO: Loaded 18017 primary data records. [2025-10-22T23:30:21.032407] [DEBUG] [MAIN ] ECO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:21.058122] [INFO ] [MAIN ] ECO: Generated 138 derivative records from 18017 primary records. [2025-10-22T23:30:21.058233] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-22T23:30:21.070121] [DEBUG] [LOCAL ] ECO: Derivative data saved (138 records). [2025-10-22T23:30:21.070246] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-10-22T23:30:21.073091] [INFO ] [MAIN ] Derivative Progress: 540/2052 symbols. ECO took 0.4s. Estimated remaining time: 9m 56s [2025-10-22T23:30:21.073190] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:21.118455] [DEBUG] [LOCAL ] ECVT: Loaded 43112 existing records from primary storage. [2025-10-22T23:30:21.118627] [INFO ] [MAIN ] ECVT: Loaded 43112 primary data records. [2025-10-22T23:30:21.430920] [DEBUG] [MAIN ] ECVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:21.456016] [INFO ] [MAIN ] ECVT: Generated 138 derivative records from 43112 primary records. [2025-10-22T23:30:21.456150] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-10-22T23:30:21.467577] [DEBUG] [LOCAL ] ECVT: Derivative data saved (138 records). [2025-10-22T23:30:21.467680] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-10-22T23:30:21.470456] [INFO ] [MAIN ] Derivative Progress: 541/2052 symbols. ECVT took 0.4s. Estimated remaining time: 9m 55s [2025-10-22T23:30:21.470548] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:21.526241] [DEBUG] [LOCAL ] ED: Loaded 52572 existing records from primary storage. [2025-10-22T23:30:21.526400] [INFO ] [MAIN ] ED: Loaded 52572 primary data records. [2025-10-22T23:30:21.873088] [DEBUG] [MAIN ] ED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:21.903187] [INFO ] [MAIN ] ED: Generated 138 derivative records from 52572 primary records. [2025-10-22T23:30:21.903399] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-10-22T23:30:21.919380] [DEBUG] [LOCAL ] ED: Derivative data saved (138 records). [2025-10-22T23:30:21.919543] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-10-22T23:30:21.923007] [INFO ] [MAIN ] Derivative Progress: 542/2052 symbols. ED took 0.5s. Estimated remaining time: 9m 55s [2025-10-22T23:30:21.923160] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:21.954987] [DEBUG] [LOCAL ] EDD: Loaded 27270 existing records from primary storage. [2025-10-22T23:30:21.955141] [INFO ] [MAIN ] EDD: Loaded 27270 primary data records. [2025-10-22T23:30:22.264697] [DEBUG] [MAIN ] EDD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:22.289940] [INFO ] [MAIN ] EDD: Generated 138 derivative records from 27270 primary records. [2025-10-22T23:30:22.290073] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-10-22T23:30:22.301306] [DEBUG] [LOCAL ] EDD: Derivative data saved (138 records). [2025-10-22T23:30:22.301404] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-10-22T23:30:22.304218] [INFO ] [MAIN ] Derivative Progress: 543/2052 symbols. EDD took 0.4s. Estimated remaining time: 9m 55s [2025-10-22T23:30:22.304315] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:22.320550] [DEBUG] [LOCAL ] EDF: Loaded 12838 existing records from primary storage. [2025-10-22T23:30:22.320713] [INFO ] [MAIN ] EDF: Loaded 12838 primary data records. [2025-10-22T23:30:22.630159] [DEBUG] [MAIN ] EDF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:22.655383] [INFO ] [MAIN ] EDF: Generated 138 derivative records from 12838 primary records. [2025-10-22T23:30:22.655561] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-10-22T23:30:22.666448] [DEBUG] [LOCAL ] EDF: Derivative data saved (138 records). [2025-10-22T23:30:22.666546] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-10-22T23:30:22.669327] [INFO ] [MAIN ] Derivative Progress: 544/2052 symbols. EDF took 0.4s. Estimated remaining time: 9m 54s [2025-10-22T23:30:22.669436] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:22.690671] [DEBUG] [LOCAL ] EDN: Loaded 19304 existing records from primary storage. [2025-10-22T23:30:22.690827] [INFO ] [MAIN ] EDN: Loaded 19304 primary data records. [2025-10-22T23:30:23.002626] [DEBUG] [MAIN ] EDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:23.027428] [INFO ] [MAIN ] EDN: Generated 138 derivative records from 19304 primary records. [2025-10-22T23:30:23.027529] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-22T23:30:23.038750] [DEBUG] [LOCAL ] EDN: Derivative data saved (138 records). [2025-10-22T23:30:23.038831] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-22T23:30:23.041608] [INFO ] [MAIN ] Derivative Progress: 545/2052 symbols. EDN took 0.4s. Estimated remaining time: 9m 54s [2025-10-22T23:30:23.041774] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:23.083828] [DEBUG] [LOCAL ] EDU: Loaded 44813 existing records from primary storage. [2025-10-22T23:30:23.083989] [INFO ] [MAIN ] EDU: Loaded 44813 primary data records. [2025-10-22T23:30:23.396549] [DEBUG] [MAIN ] EDU: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:30:23.421575] [INFO ] [MAIN ] EDU: Generated 138 derivative records from 44813 primary records. [2025-10-22T23:30:23.421749] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-22T23:30:23.432966] [DEBUG] [LOCAL ] EDU: Derivative data saved (138 records). [2025-10-22T23:30:23.433043] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-10-22T23:30:23.435805] [INFO ] [MAIN ] Derivative Progress: 546/2052 symbols. EDU took 0.4s. Estimated remaining time: 9m 53s [2025-10-22T23:30:23.435898] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:23.467038] [DEBUG] [LOCAL ] EE: Loaded 32539 existing records from primary storage. [2025-10-22T23:30:23.467199] [INFO ] [MAIN ] EE: Loaded 32539 primary data records. [2025-10-22T23:30:23.805906] [DEBUG] [MAIN ] EE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:23.831412] [INFO ] [MAIN ] EE: Generated 138 derivative records from 32539 primary records. [2025-10-22T23:30:23.831536] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-10-22T23:30:23.842911] [DEBUG] [LOCAL ] EE: Derivative data saved (138 records). [2025-10-22T23:30:23.842989] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-10-22T23:30:23.845943] [INFO ] [MAIN ] Derivative Progress: 547/2052 symbols. EE took 0.4s. Estimated remaining time: 9m 53s [2025-10-22T23:30:23.846047] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:23.859211] [DEBUG] [LOCAL ] EEX: Loaded 9811 existing records from primary storage. [2025-10-22T23:30:23.859354] [INFO ] [MAIN ] EEX: Loaded 9811 primary data records. [2025-10-22T23:30:24.164134] [DEBUG] [MAIN ] EEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:24.189532] [INFO ] [MAIN ] EEX: Generated 138 derivative records from 9811 primary records. [2025-10-22T23:30:24.189678] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-10-22T23:30:24.200675] [DEBUG] [LOCAL ] EEX: Derivative data saved (138 records). [2025-10-22T23:30:24.200744] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-10-22T23:30:24.202965] [INFO ] [MAIN ] Derivative Progress: 548/2052 symbols. EEX took 0.4s. Estimated remaining time: 9m 52s [2025-10-22T23:30:24.203058] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:24.246712] [DEBUG] [LOCAL ] EFC: Loaded 46280 existing records from primary storage. [2025-10-22T23:30:24.246872] [INFO ] [MAIN ] EFC: Loaded 46280 primary data records. [2025-10-22T23:30:24.576531] [DEBUG] [MAIN ] EFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:24.609288] [INFO ] [MAIN ] EFC: Generated 138 derivative records from 46280 primary records. [2025-10-22T23:30:24.609517] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-10-22T23:30:24.633547] [DEBUG] [LOCAL ] EFC: Derivative data saved (138 records). [2025-10-22T23:30:24.633914] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-10-22T23:30:24.638765] [INFO ] [MAIN ] Derivative Progress: 549/2052 symbols. EFC took 0.4s. Estimated remaining time: 9m 52s [2025-10-22T23:30:24.638990] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:24.666018] [DEBUG] [LOCAL ] EFR: Loaded 15025 existing records from primary storage. [2025-10-22T23:30:24.666228] [INFO ] [MAIN ] EFR: Loaded 15025 primary data records. [2025-10-22T23:30:25.153090] [DEBUG] [MAIN ] EFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:25.193496] [INFO ] [MAIN ] EFR: Generated 138 derivative records from 15025 primary records. [2025-10-22T23:30:25.193756] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-22T23:30:25.212227] [DEBUG] [LOCAL ] EFR: Derivative data saved (138 records). [2025-10-22T23:30:25.212441] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-10-22T23:30:25.216577] [INFO ] [MAIN ] Derivative Progress: 550/2052 symbols. EFR took 0.6s. Estimated remaining time: 9m 52s [2025-10-22T23:30:25.216909] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:25.255305] [DEBUG] [LOCAL ] EFXT: Loaded 29466 existing records from primary storage. [2025-10-22T23:30:25.255526] [INFO ] [MAIN ] EFXT: Loaded 29466 primary data records. [2025-10-22T23:30:25.672849] [DEBUG] [MAIN ] EFXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:25.699865] [INFO ] [MAIN ] EFXT: Generated 138 derivative records from 29466 primary records. [2025-10-22T23:30:25.700061] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-10-22T23:30:25.712166] [DEBUG] [LOCAL ] EFXT: Derivative data saved (138 records). [2025-10-22T23:30:25.712258] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-10-22T23:30:25.715490] [INFO ] [MAIN ] Derivative Progress: 551/2052 symbols. EFXT took 0.5s. Estimated remaining time: 9m 52s [2025-10-22T23:30:25.715587] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:25.742931] [DEBUG] [LOCAL ] EG: Loaded 27544 existing records from primary storage. [2025-10-22T23:30:25.743084] [INFO ] [MAIN ] EG: Loaded 27544 primary data records. [2025-10-22T23:30:26.050380] [DEBUG] [MAIN ] EG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:26.075460] [INFO ] [MAIN ] EG: Generated 138 derivative records from 27544 primary records. [2025-10-22T23:30:26.075627] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-10-22T23:30:26.087233] [DEBUG] [LOCAL ] EG: Derivative data saved (138 records). [2025-10-22T23:30:26.087330] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-10-22T23:30:26.089948] [INFO ] [MAIN ] Derivative Progress: 552/2052 symbols. EG took 0.4s. Estimated remaining time: 9m 52s [2025-10-22T23:30:26.090047] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:26.140197] [DEBUG] [LOCAL ] EGO: Loaded 51739 existing records from primary storage. [2025-10-22T23:30:26.140357] [INFO ] [MAIN ] EGO: Loaded 51739 primary data records. [2025-10-22T23:30:26.467285] [DEBUG] [MAIN ] EGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:26.492863] [INFO ] [MAIN ] EGO: Generated 138 derivative records from 51739 primary records. [2025-10-22T23:30:26.493036] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-10-22T23:30:26.505035] [DEBUG] [LOCAL ] EGO: Derivative data saved (138 records). [2025-10-22T23:30:26.505117] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-10-22T23:30:26.507968] [INFO ] [MAIN ] Derivative Progress: 553/2052 symbols. EGO took 0.4s. Estimated remaining time: 9m 51s [2025-10-22T23:30:26.508066] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:26.540850] [DEBUG] [LOCAL ] EGP: Loaded 30227 existing records from primary storage. [2025-10-22T23:30:26.541006] [INFO ] [MAIN ] EGP: Loaded 30227 primary data records. [2025-10-22T23:30:26.875525] [DEBUG] [MAIN ] EGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:26.912046] [INFO ] [MAIN ] EGP: Generated 138 derivative records from 30227 primary records. [2025-10-22T23:30:26.912277] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-10-22T23:30:26.924449] [DEBUG] [LOCAL ] EGP: Derivative data saved (138 records). [2025-10-22T23:30:26.924533] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-10-22T23:30:26.927101] [INFO ] [MAIN ] Derivative Progress: 554/2052 symbols. EGP took 0.4s. Estimated remaining time: 9m 51s [2025-10-22T23:30:26.927202] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:26.968460] [DEBUG] [LOCAL ] EGY: Loaded 41231 existing records from primary storage. [2025-10-22T23:30:26.968688] [INFO ] [MAIN ] EGY: Loaded 41231 primary data records. [2025-10-22T23:30:27.286110] [DEBUG] [MAIN ] EGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:27.311322] [INFO ] [MAIN ] EGY: Generated 138 derivative records from 41231 primary records. [2025-10-22T23:30:27.311460] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-10-22T23:30:27.322993] [DEBUG] [LOCAL ] EGY: Derivative data saved (138 records). [2025-10-22T23:30:27.323072] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-10-22T23:30:27.325633] [INFO ] [MAIN ] Derivative Progress: 555/2052 symbols. EGY took 0.4s. Estimated remaining time: 9m 51s [2025-10-22T23:30:27.325765] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:27.352916] [DEBUG] [LOCAL ] EHAB: Loaded 29342 existing records from primary storage. [2025-10-22T23:30:27.353065] [INFO ] [MAIN ] EHAB: Loaded 29342 primary data records. [2025-10-22T23:30:27.657242] [DEBUG] [MAIN ] EHAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:27.682385] [INFO ] [MAIN ] EHAB: Generated 138 derivative records from 29342 primary records. [2025-10-22T23:30:27.682496] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-10-22T23:30:27.693724] [DEBUG] [LOCAL ] EHAB: Derivative data saved (138 records). [2025-10-22T23:30:27.693804] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-10-22T23:30:27.696603] [INFO ] [MAIN ] Derivative Progress: 556/2052 symbols. EHAB took 0.4s. Estimated remaining time: 9m 50s [2025-10-22T23:30:27.696731] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:27.737737] [DEBUG] [LOCAL ] EHC: Loaded 40923 existing records from primary storage. [2025-10-22T23:30:27.737901] [INFO ] [MAIN ] EHC: Loaded 40923 primary data records. [2025-10-22T23:30:28.048148] [DEBUG] [MAIN ] EHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:28.074004] [INFO ] [MAIN ] EHC: Generated 138 derivative records from 40923 primary records. [2025-10-22T23:30:28.074237] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-10-22T23:30:28.086278] [DEBUG] [LOCAL ] EHC: Derivative data saved (138 records). [2025-10-22T23:30:28.086431] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-10-22T23:30:28.089029] [INFO ] [MAIN ] Derivative Progress: 557/2052 symbols. EHC took 0.4s. Estimated remaining time: 9m 50s [2025-10-22T23:30:28.089169] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:28.103249] [DEBUG] [LOCAL ] EHI: Loaded 10532 existing records from primary storage. [2025-10-22T23:30:28.103395] [INFO ] [MAIN ] EHI: Loaded 10532 primary data records. [2025-10-22T23:30:28.436035] [DEBUG] [MAIN ] EHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:28.461511] [INFO ] [MAIN ] EHI: Generated 138 derivative records from 10532 primary records. [2025-10-22T23:30:28.461614] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-10-22T23:30:28.472936] [DEBUG] [LOCAL ] EHI: Derivative data saved (138 records). [2025-10-22T23:30:28.473041] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-10-22T23:30:28.474811] [INFO ] [MAIN ] Derivative Progress: 558/2052 symbols. EHI took 0.4s. Estimated remaining time: 9m 49s [2025-10-22T23:30:28.474904] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:28.498407] [DEBUG] [LOCAL ] EIC: Loaded 22441 existing records from primary storage. [2025-10-22T23:30:28.498564] [INFO ] [MAIN ] EIC: Loaded 22441 primary data records. [2025-10-22T23:30:28.808189] [DEBUG] [MAIN ] EIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:28.833583] [INFO ] [MAIN ] EIC: Generated 138 derivative records from 22441 primary records. [2025-10-22T23:30:28.833728] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-10-22T23:30:28.845416] [DEBUG] [LOCAL ] EIC: Derivative data saved (138 records). [2025-10-22T23:30:28.845513] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-10-22T23:30:28.848066] [INFO ] [MAIN ] Derivative Progress: 559/2052 symbols. EIC took 0.4s. Estimated remaining time: 9m 49s [2025-10-22T23:30:28.848181] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:28.869633] [DEBUG] [LOCAL ] EIG: Loaded 20065 existing records from primary storage. [2025-10-22T23:30:28.869820] [INFO ] [MAIN ] EIG: Loaded 20065 primary data records. [2025-10-22T23:30:29.181766] [DEBUG] [MAIN ] EIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:29.207062] [INFO ] [MAIN ] EIG: Generated 138 derivative records from 20065 primary records. [2025-10-22T23:30:29.207226] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-22T23:30:29.218962] [DEBUG] [LOCAL ] EIG: Derivative data saved (138 records). [2025-10-22T23:30:29.219099] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-10-22T23:30:29.221582] [INFO ] [MAIN ] Derivative Progress: 560/2052 symbols. EIG took 0.4s. Estimated remaining time: 9m 48s [2025-10-22T23:30:29.221782] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:29.274575] [DEBUG] [LOCAL ] EIX: Loaded 53348 existing records from primary storage. [2025-10-22T23:30:29.274818] [INFO ] [MAIN ] EIX: Loaded 53348 primary data records. [2025-10-22T23:30:29.584083] [DEBUG] [MAIN ] EIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:29.608977] [INFO ] [MAIN ] EIX: Generated 138 derivative records from 53348 primary records. [2025-10-22T23:30:29.609157] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-10-22T23:30:29.620600] [DEBUG] [LOCAL ] EIX: Derivative data saved (138 records). [2025-10-22T23:30:29.620711] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-10-22T23:30:29.623481] [INFO ] [MAIN ] Derivative Progress: 561/2052 symbols. EIX took 0.4s. Estimated remaining time: 9m 48s [2025-10-22T23:30:29.623598] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:29.675383] [DEBUG] [LOCAL ] EL: Loaded 53385 existing records from primary storage. [2025-10-22T23:30:29.675574] [INFO ] [MAIN ] EL: Loaded 53385 primary data records. [2025-10-22T23:30:29.980756] [DEBUG] [MAIN ] EL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:30.005754] [INFO ] [MAIN ] EL: Generated 138 derivative records from 53385 primary records. [2025-10-22T23:30:30.005905] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-10-22T23:30:30.017538] [DEBUG] [LOCAL ] EL: Derivative data saved (138 records). [2025-10-22T23:30:30.017639] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-10-22T23:30:30.020397] [INFO ] [MAIN ] Derivative Progress: 562/2052 symbols. EL took 0.4s. Estimated remaining time: 9m 48s [2025-10-22T23:30:30.020521] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:30.072865] [DEBUG] [LOCAL ] ELAN: Loaded 53314 existing records from primary storage. [2025-10-22T23:30:30.073057] [INFO ] [MAIN ] ELAN: Loaded 53314 primary data records. [2025-10-22T23:30:30.407164] [DEBUG] [MAIN ] ELAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:30.432063] [INFO ] [MAIN ] ELAN: Generated 138 derivative records from 53314 primary records. [2025-10-22T23:30:30.432231] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-22T23:30:30.444184] [DEBUG] [LOCAL ] ELAN: Derivative data saved (138 records). [2025-10-22T23:30:30.444323] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-10-22T23:30:30.447201] [INFO ] [MAIN ] Derivative Progress: 563/2052 symbols. ELAN took 0.4s. Estimated remaining time: 9m 47s [2025-10-22T23:30:30.447355] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:30.453558] [DEBUG] [LOCAL ] ELC: Loaded 3431 existing records from primary storage. [2025-10-22T23:30:30.453702] [INFO ] [MAIN ] ELC: Loaded 3431 primary data records. [2025-10-22T23:30:30.762559] [DEBUG] [MAIN ] ELC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:30.788143] [INFO ] [MAIN ] ELC: Generated 138 derivative records from 3431 primary records. [2025-10-22T23:30:30.788285] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-10-22T23:30:30.798608] [DEBUG] [LOCAL ] ELC: Derivative data saved (138 records). [2025-10-22T23:30:30.798732] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-10-22T23:30:30.801468] [INFO ] [MAIN ] Derivative Progress: 564/2052 symbols. ELC took 0.4s. Estimated remaining time: 9m 47s [2025-10-22T23:30:30.801571] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:30.841182] [DEBUG] [LOCAL ] ELME: Loaded 39292 existing records from primary storage. [2025-10-22T23:30:30.841346] [INFO ] [MAIN ] ELME: Loaded 39292 primary data records. [2025-10-22T23:30:31.148494] [DEBUG] [MAIN ] ELME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:31.173243] [INFO ] [MAIN ] ELME: Generated 138 derivative records from 39292 primary records. [2025-10-22T23:30:31.173408] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-10-22T23:30:31.184833] [DEBUG] [LOCAL ] ELME: Derivative data saved (138 records). [2025-10-22T23:30:31.184912] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-10-22T23:30:31.187460] [INFO ] [MAIN ] Derivative Progress: 565/2052 symbols. ELME took 0.4s. Estimated remaining time: 9m 46s [2025-10-22T23:30:31.187565] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:31.218365] [DEBUG] [LOCAL ] EME: Loaded 30650 existing records from primary storage. [2025-10-22T23:30:31.218524] [INFO ] [MAIN ] EME: Loaded 30650 primary data records. [2025-10-22T23:30:31.521293] [DEBUG] [MAIN ] EME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:31.546387] [INFO ] [MAIN ] EME: Generated 138 derivative records from 30650 primary records. [2025-10-22T23:30:31.546523] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-10-22T23:30:31.557967] [DEBUG] [LOCAL ] EME: Derivative data saved (138 records). [2025-10-22T23:30:31.558047] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-10-22T23:30:31.560743] [INFO ] [MAIN ] Derivative Progress: 566/2052 symbols. EME took 0.4s. Estimated remaining time: 9m 46s [2025-10-22T23:30:31.560852] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:31.566387] [DEBUG] [LOCAL ] EMF: Loaded 3081 existing records from primary storage. [2025-10-22T23:30:31.566483] [INFO ] [MAIN ] EMF: Loaded 3081 primary data records. [2025-10-22T23:30:31.893956] [DEBUG] [MAIN ] EMF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:31.921202] [INFO ] [MAIN ] EMF: Generated 138 derivative records from 3081 primary records. [2025-10-22T23:30:31.921381] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-22T23:30:31.931276] [DEBUG] [LOCAL ] EMF: Derivative data saved (138 records). [2025-10-22T23:30:31.931369] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-10-22T23:30:31.933252] [INFO ] [MAIN ] Derivative Progress: 567/2052 symbols. EMF took 0.4s. Estimated remaining time: 9m 46s [2025-10-22T23:30:31.933359] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:31.937990] [DEBUG] [LOCAL ] EMP: Loaded 2888 existing records from primary storage. [2025-10-22T23:30:31.938113] [INFO ] [MAIN ] EMP: Loaded 2888 primary data records. [2025-10-22T23:30:32.244525] [DEBUG] [MAIN ] EMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:32.269810] [INFO ] [MAIN ] EMP: Generated 138 derivative records from 2888 primary records. [2025-10-22T23:30:32.269924] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-10-22T23:30:32.279814] [DEBUG] [LOCAL ] EMP: Derivative data saved (138 records). [2025-10-22T23:30:32.279895] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-10-22T23:30:32.281857] [INFO ] [MAIN ] Derivative Progress: 568/2052 symbols. EMP took 0.3s. Estimated remaining time: 9m 45s [2025-10-22T23:30:32.281953] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:32.333227] [DEBUG] [LOCAL ] ENB: Loaded 53511 existing records from primary storage. [2025-10-22T23:30:32.333388] [INFO ] [MAIN ] ENB: Loaded 53511 primary data records. [2025-10-22T23:30:32.661815] [DEBUG] [MAIN ] ENB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:32.687198] [INFO ] [MAIN ] ENB: Generated 138 derivative records from 53511 primary records. [2025-10-22T23:30:32.687358] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-10-22T23:30:32.698925] [DEBUG] [LOCAL ] ENB: Derivative data saved (138 records). [2025-10-22T23:30:32.699008] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-10-22T23:30:32.702090] [INFO ] [MAIN ] Derivative Progress: 569/2052 symbols. ENB took 0.4s. Estimated remaining time: 9m 45s [2025-10-22T23:30:32.702198] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:32.734193] [DEBUG] [LOCAL ] ENIC: Loaded 36415 existing records from primary storage. [2025-10-22T23:30:32.734343] [INFO ] [MAIN ] ENIC: Loaded 36415 primary data records. [2025-10-22T23:30:33.040322] [DEBUG] [MAIN ] ENIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:33.065422] [INFO ] [MAIN ] ENIC: Generated 138 derivative records from 36415 primary records. [2025-10-22T23:30:33.065550] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-10-22T23:30:33.076838] [DEBUG] [LOCAL ] ENIC: Derivative data saved (138 records). [2025-10-22T23:30:33.076921] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-10-22T23:30:33.079678] [INFO ] [MAIN ] Derivative Progress: 570/2052 symbols. ENIC took 0.4s. Estimated remaining time: 9m 44s [2025-10-22T23:30:33.079790] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:33.083753] [DEBUG] [LOCAL ] ENO: Loaded 1737 existing records from primary storage. [2025-10-22T23:30:33.083844] [INFO ] [MAIN ] ENO: Loaded 1737 primary data records. [2025-10-22T23:30:33.387819] [DEBUG] [MAIN ] ENO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:33.413637] [INFO ] [MAIN ] ENO: Generated 138 derivative records from 1737 primary records. [2025-10-22T23:30:33.413777] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-10-22T23:30:33.423021] [DEBUG] [LOCAL ] ENO: Derivative data saved (138 records). [2025-10-22T23:30:33.423104] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-10-22T23:30:33.425065] [INFO ] [MAIN ] Derivative Progress: 571/2052 symbols. ENO took 0.3s. Estimated remaining time: 9m 44s [2025-10-22T23:30:33.425161] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:33.466933] [DEBUG] [LOCAL ] ENR: Loaded 43819 existing records from primary storage. [2025-10-22T23:30:33.467091] [INFO ] [MAIN ] ENR: Loaded 43819 primary data records. [2025-10-22T23:30:33.774878] [DEBUG] [MAIN ] ENR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:33.800694] [INFO ] [MAIN ] ENR: Generated 138 derivative records from 43819 primary records. [2025-10-22T23:30:33.800840] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-22T23:30:33.812477] [DEBUG] [LOCAL ] ENR: Derivative data saved (138 records). [2025-10-22T23:30:33.812562] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-10-22T23:30:33.815613] [INFO ] [MAIN ] Derivative Progress: 572/2052 symbols. ENR took 0.4s. Estimated remaining time: 9m 43s [2025-10-22T23:30:33.815730] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:33.841115] [DEBUG] [LOCAL ] ENVA: Loaded 25234 existing records from primary storage. [2025-10-22T23:30:33.841267] [INFO ] [MAIN ] ENVA: Loaded 25234 primary data records. [2025-10-22T23:30:34.151422] [DEBUG] [MAIN ] ENVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:34.177352] [INFO ] [MAIN ] ENVA: Generated 138 derivative records from 25234 primary records. [2025-10-22T23:30:34.177532] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-22T23:30:34.189292] [DEBUG] [LOCAL ] ENVA: Derivative data saved (138 records). [2025-10-22T23:30:34.189397] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-10-22T23:30:34.192139] [INFO ] [MAIN ] Derivative Progress: 573/2052 symbols. ENVA took 0.4s. Estimated remaining time: 9m 43s [2025-10-22T23:30:34.192258] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:34.246353] [DEBUG] [LOCAL ] EOG: Loaded 53390 existing records from primary storage. [2025-10-22T23:30:34.246522] [INFO ] [MAIN ] EOG: Loaded 53390 primary data records. [2025-10-22T23:30:34.580834] [DEBUG] [MAIN ] EOG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:34.607915] [INFO ] [MAIN ] EOG: Generated 138 derivative records from 53390 primary records. [2025-10-22T23:30:34.608093] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-22T23:30:34.620024] [DEBUG] [LOCAL ] EOG: Derivative data saved (138 records). [2025-10-22T23:30:34.620110] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-22T23:30:34.623273] [INFO ] [MAIN ] Derivative Progress: 574/2052 symbols. EOG took 0.4s. Estimated remaining time: 9m 43s [2025-10-22T23:30:34.623367] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:34.637637] [DEBUG] [LOCAL ] EOI: Loaded 10436 existing records from primary storage. [2025-10-22T23:30:34.637818] [INFO ] [MAIN ] EOI: Loaded 10436 primary data records. [2025-10-22T23:30:34.956244] [DEBUG] [MAIN ] EOI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:34.981622] [INFO ] [MAIN ] EOI: Generated 138 derivative records from 10436 primary records. [2025-10-22T23:30:34.981796] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-22T23:30:34.993966] [DEBUG] [LOCAL ] EOI: Derivative data saved (138 records). [2025-10-22T23:30:34.994060] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-10-22T23:30:34.996079] [INFO ] [MAIN ] Derivative Progress: 575/2052 symbols. EOI took 0.4s. Estimated remaining time: 9m 42s [2025-10-22T23:30:34.996168] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:35.013934] [DEBUG] [LOCAL ] EOS: Loaded 14668 existing records from primary storage. [2025-10-22T23:30:35.014086] [INFO ] [MAIN ] EOS: Loaded 14668 primary data records. [2025-10-22T23:30:35.322750] [DEBUG] [MAIN ] EOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:35.348024] [INFO ] [MAIN ] EOS: Generated 138 derivative records from 14668 primary records. [2025-10-22T23:30:35.348224] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-10-22T23:30:35.359789] [DEBUG] [LOCAL ] EOS: Derivative data saved (138 records). [2025-10-22T23:30:35.359872] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-10-22T23:30:35.362522] [INFO ] [MAIN ] Derivative Progress: 576/2052 symbols. EOS took 0.4s. Estimated remaining time: 9m 42s [2025-10-22T23:30:35.362635] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:35.402000] [DEBUG] [LOCAL ] EPAM: Loaded 39328 existing records from primary storage. [2025-10-22T23:30:35.402160] [INFO ] [MAIN ] EPAM: Loaded 39328 primary data records. [2025-10-22T23:30:35.708981] [DEBUG] [MAIN ] EPAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:35.733927] [INFO ] [MAIN ] EPAM: Generated 138 derivative records from 39328 primary records. [2025-10-22T23:30:35.734062] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-10-22T23:30:35.745822] [DEBUG] [LOCAL ] EPAM: Derivative data saved (138 records). [2025-10-22T23:30:35.745919] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-10-22T23:30:35.748841] [INFO ] [MAIN ] Derivative Progress: 577/2052 symbols. EPAM took 0.4s. Estimated remaining time: 9m 41s [2025-10-22T23:30:35.748933] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:35.786311] [DEBUG] [LOCAL ] EPC: Loaded 39741 existing records from primary storage. [2025-10-22T23:30:35.786470] [INFO ] [MAIN ] EPC: Loaded 39741 primary data records. [2025-10-22T23:30:36.095296] [DEBUG] [MAIN ] EPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:36.120846] [INFO ] [MAIN ] EPC: Generated 138 derivative records from 39741 primary records. [2025-10-22T23:30:36.121025] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-10-22T23:30:36.133023] [DEBUG] [LOCAL ] EPC: Derivative data saved (138 records). [2025-10-22T23:30:36.133108] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-10-22T23:30:36.135985] [INFO ] [MAIN ] Derivative Progress: 578/2052 symbols. EPC took 0.4s. Estimated remaining time: 9m 41s [2025-10-22T23:30:36.136080] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:36.187882] [DEBUG] [LOCAL ] EPD: Loaded 53608 existing records from primary storage. [2025-10-22T23:30:36.188047] [INFO ] [MAIN ] EPD: Loaded 53608 primary data records. [2025-10-22T23:30:36.518487] [DEBUG] [MAIN ] EPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:36.543461] [INFO ] [MAIN ] EPD: Generated 138 derivative records from 53608 primary records. [2025-10-22T23:30:36.543592] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-10-22T23:30:36.555414] [DEBUG] [LOCAL ] EPD: Derivative data saved (138 records). [2025-10-22T23:30:36.555495] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-10-22T23:30:36.558626] [INFO ] [MAIN ] Derivative Progress: 579/2052 symbols. EPD took 0.4s. Estimated remaining time: 9m 41s [2025-10-22T23:30:36.558740] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:36.600113] [DEBUG] [LOCAL ] EPR: Loaded 43707 existing records from primary storage. [2025-10-22T23:30:36.600278] [INFO ] [MAIN ] EPR: Loaded 43707 primary data records. [2025-10-22T23:30:36.904077] [DEBUG] [MAIN ] EPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:36.929379] [INFO ] [MAIN ] EPR: Generated 138 derivative records from 43707 primary records. [2025-10-22T23:30:36.929509] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-10-22T23:30:36.940942] [DEBUG] [LOCAL ] EPR: Derivative data saved (138 records). [2025-10-22T23:30:36.941023] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-10-22T23:30:36.943842] [INFO ] [MAIN ] Derivative Progress: 580/2052 symbols. EPR took 0.4s. Estimated remaining time: 9m 40s [2025-10-22T23:30:36.943944] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:36.989537] [DEBUG] [LOCAL ] EPRT: Loaded 48479 existing records from primary storage. [2025-10-22T23:30:36.989731] [INFO ] [MAIN ] EPRT: Loaded 48479 primary data records. [2025-10-22T23:30:37.295158] [DEBUG] [MAIN ] EPRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:37.320913] [INFO ] [MAIN ] EPRT: Generated 138 derivative records from 48479 primary records. [2025-10-22T23:30:37.321092] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-10-22T23:30:37.332947] [DEBUG] [LOCAL ] EPRT: Derivative data saved (138 records). [2025-10-22T23:30:37.333025] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-10-22T23:30:37.335940] [INFO ] [MAIN ] Derivative Progress: 581/2052 symbols. EPRT took 0.4s. Estimated remaining time: 9m 40s [2025-10-22T23:30:37.336032] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:37.350768] [DEBUG] [LOCAL ] EQBK: Loaded 11303 existing records from primary storage. [2025-10-22T23:30:37.350906] [INFO ] [MAIN ] EQBK: Loaded 11303 primary data records. [2025-10-22T23:30:37.658227] [DEBUG] [MAIN ] EQBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:37.683016] [INFO ] [MAIN ] EQBK: Generated 138 derivative records from 11303 primary records. [2025-10-22T23:30:37.683177] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-10-22T23:30:37.694465] [DEBUG] [LOCAL ] EQBK: Derivative data saved (138 records). [2025-10-22T23:30:37.694545] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-10-22T23:30:37.697112] [INFO ] [MAIN ] Derivative Progress: 582/2052 symbols. EQBK took 0.4s. Estimated remaining time: 9m 39s [2025-10-22T23:30:37.697204] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:37.748285] [DEBUG] [LOCAL ] EQH: Loaded 52699 existing records from primary storage. [2025-10-22T23:30:37.748452] [INFO ] [MAIN ] EQH: Loaded 52699 primary data records. [2025-10-22T23:30:38.056232] [DEBUG] [MAIN ] EQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:38.081536] [INFO ] [MAIN ] EQH: Generated 138 derivative records from 52699 primary records. [2025-10-22T23:30:38.081713] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-10-22T23:30:38.093329] [DEBUG] [LOCAL ] EQH: Derivative data saved (138 records). [2025-10-22T23:30:38.093417] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-10-22T23:30:38.096519] [INFO ] [MAIN ] Derivative Progress: 583/2052 symbols. EQH took 0.4s. Estimated remaining time: 9m 39s [2025-10-22T23:30:38.096619] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:38.148525] [DEBUG] [LOCAL ] EQNR: Loaded 53050 existing records from primary storage. [2025-10-22T23:30:38.148731] [INFO ] [MAIN ] EQNR: Loaded 53050 primary data records. [2025-10-22T23:30:38.492161] [DEBUG] [MAIN ] EQNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:38.517848] [INFO ] [MAIN ] EQNR: Generated 138 derivative records from 53050 primary records. [2025-10-22T23:30:38.517992] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-10-22T23:30:38.529959] [DEBUG] [LOCAL ] EQNR: Derivative data saved (138 records). [2025-10-22T23:30:38.530043] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-10-22T23:30:38.533208] [INFO ] [MAIN ] Derivative Progress: 584/2052 symbols. EQNR took 0.4s. Estimated remaining time: 9m 39s [2025-10-22T23:30:38.533307] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:38.582878] [DEBUG] [LOCAL ] EQR: Loaded 51810 existing records from primary storage. [2025-10-22T23:30:38.583040] [INFO ] [MAIN ] EQR: Loaded 51810 primary data records. [2025-10-22T23:30:38.896459] [DEBUG] [MAIN ] EQR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:38.923381] [INFO ] [MAIN ] EQR: Generated 138 derivative records from 51810 primary records. [2025-10-22T23:30:38.923513] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-22T23:30:38.935222] [DEBUG] [LOCAL ] EQR: Derivative data saved (138 records). [2025-10-22T23:30:38.935312] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-10-22T23:30:38.938546] [INFO ] [MAIN ] Derivative Progress: 585/2052 symbols. EQR took 0.4s. Estimated remaining time: 9m 38s [2025-10-22T23:30:38.938692] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:38.990030] [DEBUG] [LOCAL ] EQT: Loaded 53685 existing records from primary storage. [2025-10-22T23:30:38.990194] [INFO ] [MAIN ] EQT: Loaded 53685 primary data records. [2025-10-22T23:30:39.305602] [DEBUG] [MAIN ] EQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:39.332026] [INFO ] [MAIN ] EQT: Generated 138 derivative records from 53685 primary records. [2025-10-22T23:30:39.332172] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-22T23:30:39.344133] [DEBUG] [LOCAL ] EQT: Derivative data saved (138 records). [2025-10-22T23:30:39.344218] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-10-22T23:30:39.347446] [INFO ] [MAIN ] Derivative Progress: 586/2052 symbols. EQT took 0.4s. Estimated remaining time: 9m 38s [2025-10-22T23:30:39.347559] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:39.353177] [DEBUG] [LOCAL ] EQV: Loaded 2702 existing records from primary storage. [2025-10-22T23:30:39.353279] [INFO ] [MAIN ] EQV: Loaded 2702 primary data records. [2025-10-22T23:30:39.673818] [DEBUG] [MAIN ] EQV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:39.700536] [INFO ] [MAIN ] EQV: Generated 138 derivative records from 2702 primary records. [2025-10-22T23:30:39.700720] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-22T23:30:39.710914] [DEBUG] [LOCAL ] EQV: Derivative data saved (138 records). [2025-10-22T23:30:39.711001] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-10-22T23:30:39.713226] [INFO ] [MAIN ] Derivative Progress: 587/2052 symbols. EQV took 0.4s. Estimated remaining time: 9m 37s [2025-10-22T23:30:39.713327] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:39.760911] [DEBUG] [LOCAL ] ERJ: Loaded 50289 existing records from primary storage. [2025-10-22T23:30:39.761073] [INFO ] [MAIN ] ERJ: Loaded 50289 primary data records. [2025-10-22T23:30:40.079091] [DEBUG] [MAIN ] ERJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:40.104725] [INFO ] [MAIN ] ERJ: Generated 138 derivative records from 50289 primary records. [2025-10-22T23:30:40.104866] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-22T23:30:40.116305] [DEBUG] [LOCAL ] ERJ: Derivative data saved (138 records). [2025-10-22T23:30:40.116388] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-22T23:30:40.119396] [INFO ] [MAIN ] Derivative Progress: 588/2052 symbols. ERJ took 0.4s. Estimated remaining time: 9m 37s [2025-10-22T23:30:40.119494] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:40.160238] [DEBUG] [LOCAL ] ERO: Loaded 42159 existing records from primary storage. [2025-10-22T23:30:40.160397] [INFO ] [MAIN ] ERO: Loaded 42159 primary data records. [2025-10-22T23:30:40.474383] [DEBUG] [MAIN ] ERO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:40.500634] [INFO ] [MAIN ] ERO: Generated 138 derivative records from 42159 primary records. [2025-10-22T23:30:40.500822] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-22T23:30:40.512620] [DEBUG] [LOCAL ] ERO: Derivative data saved (138 records). [2025-10-22T23:30:40.512725] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-22T23:30:40.515738] [INFO ] [MAIN ] Derivative Progress: 589/2052 symbols. ERO took 0.4s. Estimated remaining time: 9m 37s [2025-10-22T23:30:40.515839] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:40.565777] [DEBUG] [LOCAL ] ES: Loaded 52699 existing records from primary storage. [2025-10-22T23:30:40.565937] [INFO ] [MAIN ] ES: Loaded 52699 primary data records. [2025-10-22T23:30:40.892786] [DEBUG] [MAIN ] ES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:40.918722] [INFO ] [MAIN ] ES: Generated 138 derivative records from 52699 primary records. [2025-10-22T23:30:40.918867] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-10-22T23:30:40.930747] [DEBUG] [LOCAL ] ES: Derivative data saved (138 records). [2025-10-22T23:30:40.930836] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-10-22T23:30:40.934019] [INFO ] [MAIN ] Derivative Progress: 590/2052 symbols. ES took 0.4s. Estimated remaining time: 9m 36s [2025-10-22T23:30:40.934115] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:40.965689] [DEBUG] [LOCAL ] ESAB: Loaded 25928 existing records from primary storage. [2025-10-22T23:30:40.965839] [INFO ] [MAIN ] ESAB: Loaded 25928 primary data records. [2025-10-22T23:30:41.277892] [DEBUG] [MAIN ] ESAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:41.304020] [INFO ] [MAIN ] ESAB: Generated 138 derivative records from 25928 primary records. [2025-10-22T23:30:41.304181] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-22T23:30:41.316132] [DEBUG] [LOCAL ] ESAB: Derivative data saved (138 records). [2025-10-22T23:30:41.316234] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-22T23:30:41.319408] [INFO ] [MAIN ] Derivative Progress: 591/2052 symbols. ESAB took 0.4s. Estimated remaining time: 9m 36s [2025-10-22T23:30:41.319545] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:41.340516] [DEBUG] [LOCAL ] ESE: Loaded 16465 existing records from primary storage. [2025-10-22T23:30:41.340703] [INFO ] [MAIN ] ESE: Loaded 16465 primary data records. [2025-10-22T23:30:41.649804] [DEBUG] [MAIN ] ESE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:41.675535] [INFO ] [MAIN ] ESE: Generated 138 derivative records from 16465 primary records. [2025-10-22T23:30:41.675703] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-22T23:30:41.687371] [DEBUG] [LOCAL ] ESE: Derivative data saved (138 records). [2025-10-22T23:30:41.687456] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-22T23:30:41.690368] [INFO ] [MAIN ] Derivative Progress: 592/2052 symbols. ESE took 0.4s. Estimated remaining time: 9m 35s [2025-10-22T23:30:41.690468] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:41.742504] [DEBUG] [LOCAL ] ESI: Loaded 50618 existing records from primary storage. [2025-10-22T23:30:41.742708] [INFO ] [MAIN ] ESI: Loaded 50618 primary data records. [2025-10-22T23:30:42.046622] [DEBUG] [MAIN ] ESI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:42.071519] [INFO ] [MAIN ] ESI: Generated 138 derivative records from 50618 primary records. [2025-10-22T23:30:42.071635] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-22T23:30:42.083285] [DEBUG] [LOCAL ] ESI: Derivative data saved (138 records). [2025-10-22T23:30:42.083384] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-22T23:30:42.086628] [INFO ] [MAIN ] Derivative Progress: 593/2052 symbols. ESI took 0.4s. Estimated remaining time: 9m 35s [2025-10-22T23:30:42.086744] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:42.123164] [DEBUG] [LOCAL ] ESNT: Loaded 37977 existing records from primary storage. [2025-10-22T23:30:42.123321] [INFO ] [MAIN ] ESNT: Loaded 37977 primary data records. [2025-10-22T23:30:42.425623] [DEBUG] [MAIN ] ESNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:42.450683] [INFO ] [MAIN ] ESNT: Generated 138 derivative records from 37977 primary records. [2025-10-22T23:30:42.450792] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-22T23:30:42.462006] [DEBUG] [LOCAL ] ESNT: Derivative data saved (138 records). [2025-10-22T23:30:42.462086] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-10-22T23:30:42.465115] [INFO ] [MAIN ] Derivative Progress: 594/2052 symbols. ESNT took 0.4s. Estimated remaining time: 9m 35s [2025-10-22T23:30:42.465229] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:42.510280] [DEBUG] [LOCAL ] ESRT: Loaded 46546 existing records from primary storage. [2025-10-22T23:30:42.510458] [INFO ] [MAIN ] ESRT: Loaded 46546 primary data records. [2025-10-22T23:30:42.849865] [DEBUG] [MAIN ] ESRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:42.875290] [INFO ] [MAIN ] ESRT: Generated 138 derivative records from 46546 primary records. [2025-10-22T23:30:42.875405] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-22T23:30:42.886845] [DEBUG] [LOCAL ] ESRT: Derivative data saved (138 records). [2025-10-22T23:30:42.886937] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-22T23:30:42.890271] [INFO ] [MAIN ] Derivative Progress: 595/2052 symbols. ESRT took 0.4s. Estimated remaining time: 9m 34s [2025-10-22T23:30:42.890378] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:42.922219] [DEBUG] [LOCAL ] ESS: Loaded 30164 existing records from primary storage. [2025-10-22T23:30:42.922374] [INFO ] [MAIN ] ESS: Loaded 30164 primary data records. [2025-10-22T23:30:43.229562] [DEBUG] [MAIN ] ESS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:43.254624] [INFO ] [MAIN ] ESS: Generated 138 derivative records from 30164 primary records. [2025-10-22T23:30:43.254784] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-22T23:30:43.266470] [DEBUG] [LOCAL ] ESS: Derivative data saved (138 records). [2025-10-22T23:30:43.266556] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-22T23:30:43.269441] [INFO ] [MAIN ] Derivative Progress: 596/2052 symbols. ESS took 0.4s. Estimated remaining time: 9m 34s [2025-10-22T23:30:43.269535] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:43.314632] [DEBUG] [LOCAL ] ESTC: Loaded 50253 existing records from primary storage. [2025-10-22T23:30:43.314826] [INFO ] [MAIN ] ESTC: Loaded 50253 primary data records. [2025-10-22T23:30:43.622571] [DEBUG] [MAIN ] ESTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:43.648280] [INFO ] [MAIN ] ESTC: Generated 138 derivative records from 50253 primary records. [2025-10-22T23:30:43.648408] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-10-22T23:30:43.660035] [DEBUG] [LOCAL ] ESTC: Derivative data saved (138 records). [2025-10-22T23:30:43.660121] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-10-22T23:30:43.663152] [INFO ] [MAIN ] Derivative Progress: 597/2052 symbols. ESTC took 0.4s. Estimated remaining time: 9m 33s [2025-10-22T23:30:43.663268] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:43.718008] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-22T23:30:43.718170] [INFO ] [MAIN ] ET: Loaded 53789 primary data records. [2025-10-22T23:30:44.026623] [DEBUG] [MAIN ] ET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:44.052242] [INFO ] [MAIN ] ET: Generated 138 derivative records from 53789 primary records. [2025-10-22T23:30:44.052372] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-10-22T23:30:44.064230] [DEBUG] [LOCAL ] ET: Derivative data saved (138 records). [2025-10-22T23:30:44.064314] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-10-22T23:30:44.067459] [INFO ] [MAIN ] Derivative Progress: 598/2052 symbols. ET took 0.4s. Estimated remaining time: 9m 33s [2025-10-22T23:30:44.067558] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:44.082841] [DEBUG] [LOCAL ] ETB: Loaded 11764 existing records from primary storage. [2025-10-22T23:30:44.082981] [INFO ] [MAIN ] ETB: Loaded 11764 primary data records. [2025-10-22T23:30:44.389190] [DEBUG] [MAIN ] ETB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:44.414893] [INFO ] [MAIN ] ETB: Generated 138 derivative records from 11764 primary records. [2025-10-22T23:30:44.415033] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-10-22T23:30:44.426351] [DEBUG] [LOCAL ] ETB: Derivative data saved (138 records). [2025-10-22T23:30:44.426432] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-10-22T23:30:44.429165] [INFO ] [MAIN ] Derivative Progress: 599/2052 symbols. ETB took 0.4s. Estimated remaining time: 9m 33s [2025-10-22T23:30:44.429267] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:44.458021] [DEBUG] [LOCAL ] ETD: Loaded 27141 existing records from primary storage. [2025-10-22T23:30:44.458184] [INFO ] [MAIN ] ETD: Loaded 27141 primary data records. [2025-10-22T23:30:44.793210] [DEBUG] [MAIN ] ETD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:44.819025] [INFO ] [MAIN ] ETD: Generated 138 derivative records from 27141 primary records. [2025-10-22T23:30:44.819166] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-22T23:30:44.830709] [DEBUG] [LOCAL ] ETD: Derivative data saved (138 records). [2025-10-22T23:30:44.830787] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-22T23:30:44.833525] [INFO ] [MAIN ] Derivative Progress: 600/2052 symbols. ETD took 0.4s. Estimated remaining time: 9m 32s [2025-10-22T23:30:44.833623] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:44.852335] [DEBUG] [LOCAL ] ETJ: Loaded 16449 existing records from primary storage. [2025-10-22T23:30:44.852479] [INFO ] [MAIN ] ETJ: Loaded 16449 primary data records. [2025-10-22T23:30:45.160687] [DEBUG] [MAIN ] ETJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:45.186055] [INFO ] [MAIN ] ETJ: Generated 138 derivative records from 16449 primary records. [2025-10-22T23:30:45.186178] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-22T23:30:45.197336] [DEBUG] [LOCAL ] ETJ: Derivative data saved (138 records). [2025-10-22T23:30:45.197419] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-22T23:30:45.200182] [INFO ] [MAIN ] Derivative Progress: 601/2052 symbols. ETJ took 0.4s. Estimated remaining time: 9m 32s [2025-10-22T23:30:45.200284] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:45.251602] [DEBUG] [LOCAL ] ETN: Loaded 52571 existing records from primary storage. [2025-10-22T23:30:45.251795] [INFO ] [MAIN ] ETN: Loaded 52571 primary data records. [2025-10-22T23:30:45.576997] [DEBUG] [MAIN ] ETN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:45.602357] [INFO ] [MAIN ] ETN: Generated 138 derivative records from 52571 primary records. [2025-10-22T23:30:45.602539] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-22T23:30:45.614295] [DEBUG] [LOCAL ] ETN: Derivative data saved (138 records). [2025-10-22T23:30:45.614389] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-10-22T23:30:45.617817] [INFO ] [MAIN ] Derivative Progress: 602/2052 symbols. ETN took 0.4s. Estimated remaining time: 9m 31s [2025-10-22T23:30:45.617942] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:45.629247] [DEBUG] [LOCAL ] ETO: Loaded 6892 existing records from primary storage. [2025-10-22T23:30:45.629395] [INFO ] [MAIN ] ETO: Loaded 6892 primary data records. [2025-10-22T23:30:45.936848] [DEBUG] [MAIN ] ETO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:45.962097] [INFO ] [MAIN ] ETO: Generated 138 derivative records from 6892 primary records. [2025-10-22T23:30:45.962274] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-22T23:30:45.973903] [DEBUG] [LOCAL ] ETO: Derivative data saved (138 records). [2025-10-22T23:30:45.973991] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-22T23:30:45.976082] [INFO ] [MAIN ] Derivative Progress: 603/2052 symbols. ETO took 0.4s. Estimated remaining time: 9m 31s [2025-10-22T23:30:45.976181] [INFO ] [MAIN ] ETSY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:46.026531] [DEBUG] [LOCAL ] ETSY: Loaded 53569 existing records from primary storage. [2025-10-22T23:30:46.026722] [INFO ] [MAIN ] ETSY: Loaded 53569 primary data records. [2025-10-22T23:30:46.334599] [DEBUG] [MAIN ] ETSY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:46.359589] [INFO ] [MAIN ] ETSY: Generated 138 derivative records from 53569 primary records. [2025-10-22T23:30:46.359777] [DEBUG] [LOCAL ] ETSY: Saving derivative data. [2025-10-22T23:30:46.371521] [DEBUG] [LOCAL ] ETSY: Derivative data saved (138 records). [2025-10-22T23:30:46.371600] [INFO ] [MAIN ] ETSY: Successfully saved derivative data. [2025-10-22T23:30:46.374727] [INFO ] [MAIN ] Derivative Progress: 604/2052 symbols. ETSY took 0.4s. Estimated remaining time: 9m 31s [2025-10-22T23:30:46.374824] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:46.398728] [DEBUG] [LOCAL ] ETV: Loaded 21830 existing records from primary storage. [2025-10-22T23:30:46.398879] [INFO ] [MAIN ] ETV: Loaded 21830 primary data records. [2025-10-22T23:30:46.701981] [DEBUG] [MAIN ] ETV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:46.726982] [INFO ] [MAIN ] ETV: Generated 138 derivative records from 21830 primary records. [2025-10-22T23:30:46.727129] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-10-22T23:30:46.738900] [DEBUG] [LOCAL ] ETV: Derivative data saved (138 records). [2025-10-22T23:30:46.738986] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-10-22T23:30:46.741776] [INFO ] [MAIN ] Derivative Progress: 605/2052 symbols. ETV took 0.4s. Estimated remaining time: 9m 30s [2025-10-22T23:30:46.741904] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:46.766939] [DEBUG] [LOCAL ] ETW: Loaded 25106 existing records from primary storage. [2025-10-22T23:30:46.767098] [INFO ] [MAIN ] ETW: Loaded 25106 primary data records. [2025-10-22T23:30:47.091917] [DEBUG] [MAIN ] ETW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:47.116922] [INFO ] [MAIN ] ETW: Generated 138 derivative records from 25106 primary records. [2025-10-22T23:30:47.117046] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-22T23:30:47.128323] [DEBUG] [LOCAL ] ETW: Derivative data saved (138 records). [2025-10-22T23:30:47.128404] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-10-22T23:30:47.131197] [INFO ] [MAIN ] Derivative Progress: 606/2052 symbols. ETW took 0.4s. Estimated remaining time: 9m 30s [2025-10-22T23:30:47.131288] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:47.141276] [DEBUG] [LOCAL ] ETX: Loaded 5336 existing records from primary storage. [2025-10-22T23:30:47.141408] [INFO ] [MAIN ] ETX: Loaded 5336 primary data records. [2025-10-22T23:30:47.448007] [DEBUG] [MAIN ] ETX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:47.473113] [INFO ] [MAIN ] ETX: Generated 138 derivative records from 5336 primary records. [2025-10-22T23:30:47.473276] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-10-22T23:30:47.484185] [DEBUG] [LOCAL ] ETX: Derivative data saved (138 records). [2025-10-22T23:30:47.484278] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-10-22T23:30:47.486432] [INFO ] [MAIN ] Derivative Progress: 607/2052 symbols. ETX took 0.4s. Estimated remaining time: 9m 29s [2025-10-22T23:30:47.486550] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:47.506749] [DEBUG] [LOCAL ] EVC: Loaded 17862 existing records from primary storage. [2025-10-22T23:30:47.506901] [INFO ] [MAIN ] EVC: Loaded 17862 primary data records. [2025-10-22T23:30:47.815499] [DEBUG] [MAIN ] EVC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:47.840418] [INFO ] [MAIN ] EVC: Generated 138 derivative records from 17862 primary records. [2025-10-22T23:30:47.840524] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-22T23:30:47.851532] [DEBUG] [LOCAL ] EVC: Derivative data saved (138 records). [2025-10-22T23:30:47.851610] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-22T23:30:47.854456] [INFO ] [MAIN ] Derivative Progress: 608/2052 symbols. EVC took 0.4s. Estimated remaining time: 9m 29s [2025-10-22T23:30:47.854553] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:47.886993] [DEBUG] [LOCAL ] EVEX: Loaded 33091 existing records from primary storage. [2025-10-22T23:30:47.887154] [INFO ] [MAIN ] EVEX: Loaded 33091 primary data records. [2025-10-22T23:30:48.190978] [DEBUG] [MAIN ] EVEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:48.215665] [INFO ] [MAIN ] EVEX: Generated 138 derivative records from 33091 primary records. [2025-10-22T23:30:48.215773] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-22T23:30:48.226839] [DEBUG] [LOCAL ] EVEX: Derivative data saved (138 records). [2025-10-22T23:30:48.226918] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-22T23:30:48.229757] [INFO ] [MAIN ] Derivative Progress: 609/2052 symbols. EVEX took 0.4s. Estimated remaining time: 9m 28s [2025-10-22T23:30:48.229852] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:48.242754] [DEBUG] [LOCAL ] EVF: Loaded 9694 existing records from primary storage. [2025-10-22T23:30:48.242881] [INFO ] [MAIN ] EVF: Loaded 9694 primary data records. [2025-10-22T23:30:48.551775] [DEBUG] [MAIN ] EVF: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:30:48.577165] [INFO ] [MAIN ] EVF: Generated 138 derivative records from 9694 primary records. [2025-10-22T23:30:48.577293] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-22T23:30:48.588165] [DEBUG] [LOCAL ] EVF: Derivative data saved (138 records). [2025-10-22T23:30:48.588254] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-22T23:30:48.590394] [INFO ] [MAIN ] Derivative Progress: 610/2052 symbols. EVF took 0.4s. Estimated remaining time: 9m 28s [2025-10-22T23:30:48.590486] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:48.600476] [DEBUG] [LOCAL ] EVG: Loaded 5750 existing records from primary storage. [2025-10-22T23:30:48.600604] [INFO ] [MAIN ] EVG: Loaded 5750 primary data records. [2025-10-22T23:30:48.931805] [DEBUG] [MAIN ] EVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:48.957483] [INFO ] [MAIN ] EVG: Generated 138 derivative records from 5750 primary records. [2025-10-22T23:30:48.957665] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-22T23:30:48.968635] [DEBUG] [LOCAL ] EVG: Derivative data saved (138 records). [2025-10-22T23:30:48.968735] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-22T23:30:48.970973] [INFO ] [MAIN ] Derivative Progress: 611/2052 symbols. EVG took 0.4s. Estimated remaining time: 9m 27s [2025-10-22T23:30:48.971066] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:49.016233] [DEBUG] [LOCAL ] EVH: Loaded 49602 existing records from primary storage. [2025-10-22T23:30:49.016394] [INFO ] [MAIN ] EVH: Loaded 49602 primary data records. [2025-10-22T23:30:49.323321] [DEBUG] [MAIN ] EVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:49.349265] [INFO ] [MAIN ] EVH: Generated 138 derivative records from 49602 primary records. [2025-10-22T23:30:49.349406] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-22T23:30:49.361038] [DEBUG] [LOCAL ] EVH: Derivative data saved (138 records). [2025-10-22T23:30:49.361119] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-10-22T23:30:49.364027] [INFO ] [MAIN ] Derivative Progress: 612/2052 symbols. EVH took 0.4s. Estimated remaining time: 9m 27s [2025-10-22T23:30:49.364122] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:49.378451] [DEBUG] [LOCAL ] EVN: Loaded 10780 existing records from primary storage. [2025-10-22T23:30:49.378596] [INFO ] [MAIN ] EVN: Loaded 10780 primary data records. [2025-10-22T23:30:49.694901] [DEBUG] [MAIN ] EVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:49.720251] [INFO ] [MAIN ] EVN: Generated 138 derivative records from 10780 primary records. [2025-10-22T23:30:49.720414] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-22T23:30:49.732767] [DEBUG] [LOCAL ] EVN: Derivative data saved (138 records). [2025-10-22T23:30:49.732875] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-22T23:30:49.734917] [INFO ] [MAIN ] Derivative Progress: 613/2052 symbols. EVN took 0.4s. Estimated remaining time: 9m 27s [2025-10-22T23:30:49.735007] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:49.769294] [DEBUG] [LOCAL ] EVR: Loaded 33601 existing records from primary storage. [2025-10-22T23:30:49.769463] [INFO ] [MAIN ] EVR: Loaded 33601 primary data records. [2025-10-22T23:30:50.077219] [DEBUG] [MAIN ] EVR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:30:50.103106] [INFO ] [MAIN ] EVR: Generated 138 derivative records from 33601 primary records. [2025-10-22T23:30:50.103300] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-22T23:30:50.115281] [DEBUG] [LOCAL ] EVR: Derivative data saved (138 records). [2025-10-22T23:30:50.115365] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-22T23:30:50.118296] [INFO ] [MAIN ] Derivative Progress: 614/2052 symbols. EVR took 0.4s. Estimated remaining time: 9m 26s [2025-10-22T23:30:50.118387] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:50.137917] [DEBUG] [LOCAL ] EVT: Loaded 16515 existing records from primary storage. [2025-10-22T23:30:50.138079] [INFO ] [MAIN ] EVT: Loaded 16515 primary data records. [2025-10-22T23:30:50.445702] [DEBUG] [MAIN ] EVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:50.471781] [INFO ] [MAIN ] EVT: Generated 138 derivative records from 16515 primary records. [2025-10-22T23:30:50.471911] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-10-22T23:30:50.483405] [DEBUG] [LOCAL ] EVT: Derivative data saved (138 records). [2025-10-22T23:30:50.483482] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-10-22T23:30:50.486222] [INFO ] [MAIN ] Derivative Progress: 615/2052 symbols. EVT took 0.4s. Estimated remaining time: 9m 26s [2025-10-22T23:30:50.486312] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:50.514746] [DEBUG] [LOCAL ] EVTC: Loaded 26785 existing records from primary storage. [2025-10-22T23:30:50.514893] [INFO ] [MAIN ] EVTC: Loaded 26785 primary data records. [2025-10-22T23:30:50.874011] [DEBUG] [MAIN ] EVTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:50.899303] [INFO ] [MAIN ] EVTC: Generated 138 derivative records from 26785 primary records. [2025-10-22T23:30:50.899411] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-22T23:30:50.910686] [DEBUG] [LOCAL ] EVTC: Derivative data saved (138 records). [2025-10-22T23:30:50.910766] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-22T23:30:50.913575] [INFO ] [MAIN ] Derivative Progress: 616/2052 symbols. EVTC took 0.4s. Estimated remaining time: 9m 25s [2025-10-22T23:30:50.913701] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:50.952940] [DEBUG] [LOCAL ] EVTL: Loaded 41363 existing records from primary storage. [2025-10-22T23:30:50.953099] [INFO ] [MAIN ] EVTL: Loaded 41363 primary data records. [2025-10-22T23:30:51.268672] [DEBUG] [MAIN ] EVTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:51.294170] [INFO ] [MAIN ] EVTL: Generated 138 derivative records from 41363 primary records. [2025-10-22T23:30:51.294287] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-22T23:30:51.305538] [DEBUG] [LOCAL ] EVTL: Derivative data saved (138 records). [2025-10-22T23:30:51.305669] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-10-22T23:30:51.308633] [INFO ] [MAIN ] Derivative Progress: 617/2052 symbols. EVTL took 0.4s. Estimated remaining time: 9m 25s [2025-10-22T23:30:51.308792] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:51.336080] [DEBUG] [LOCAL ] EVTR: Loaded 25397 existing records from primary storage. [2025-10-22T23:30:51.336257] [INFO ] [MAIN ] EVTR: Loaded 25397 primary data records. [2025-10-22T23:30:51.659601] [DEBUG] [MAIN ] EVTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:51.685521] [INFO ] [MAIN ] EVTR: Generated 138 derivative records from 25397 primary records. [2025-10-22T23:30:51.685695] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-22T23:30:51.697462] [DEBUG] [LOCAL ] EVTR: Derivative data saved (138 records). [2025-10-22T23:30:51.697548] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-10-22T23:30:51.700454] [INFO ] [MAIN ] Derivative Progress: 618/2052 symbols. EVTR took 0.4s. Estimated remaining time: 9m 25s [2025-10-22T23:30:51.700569] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:51.752613] [DEBUG] [LOCAL ] EW: Loaded 53399 existing records from primary storage. [2025-10-22T23:30:51.752825] [INFO ] [MAIN ] EW: Loaded 53399 primary data records. [2025-10-22T23:30:52.082853] [DEBUG] [MAIN ] EW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:52.108105] [INFO ] [MAIN ] EW: Generated 138 derivative records from 53399 primary records. [2025-10-22T23:30:52.108216] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-22T23:30:52.119838] [DEBUG] [LOCAL ] EW: Derivative data saved (138 records). [2025-10-22T23:30:52.119916] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-22T23:30:52.123048] [INFO ] [MAIN ] Derivative Progress: 619/2052 symbols. EW took 0.4s. Estimated remaining time: 9m 24s [2025-10-22T23:30:52.123143] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:52.154702] [DEBUG] [LOCAL ] EXG: Loaded 33614 existing records from primary storage. [2025-10-22T23:30:52.154856] [INFO ] [MAIN ] EXG: Loaded 33614 primary data records. [2025-10-22T23:30:52.461256] [DEBUG] [MAIN ] EXG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:52.490237] [INFO ] [MAIN ] EXG: Generated 138 derivative records from 33614 primary records. [2025-10-22T23:30:52.490398] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-22T23:30:52.501873] [DEBUG] [LOCAL ] EXG: Derivative data saved (138 records). [2025-10-22T23:30:52.501952] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-22T23:30:52.504806] [INFO ] [MAIN ] Derivative Progress: 620/2052 symbols. EXG took 0.4s. Estimated remaining time: 9m 24s [2025-10-22T23:30:52.504931] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:52.556176] [DEBUG] [LOCAL ] EXK: Loaded 53187 existing records from primary storage. [2025-10-22T23:30:52.556333] [INFO ] [MAIN ] EXK: Loaded 53187 primary data records. [2025-10-22T23:30:52.892606] [DEBUG] [MAIN ] EXK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:52.917973] [INFO ] [MAIN ] EXK: Generated 138 derivative records from 53187 primary records. [2025-10-22T23:30:52.918116] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-22T23:30:52.929713] [DEBUG] [LOCAL ] EXK: Derivative data saved (138 records). [2025-10-22T23:30:52.929791] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-22T23:30:52.932773] [INFO ] [MAIN ] Derivative Progress: 621/2052 symbols. EXK took 0.4s. Estimated remaining time: 9m 24s [2025-10-22T23:30:52.932864] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:52.962744] [DEBUG] [LOCAL ] EXP: Loaded 29175 existing records from primary storage. [2025-10-22T23:30:52.962894] [INFO ] [MAIN ] EXP: Loaded 29175 primary data records. [2025-10-22T23:30:53.270299] [DEBUG] [MAIN ] EXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:53.295450] [INFO ] [MAIN ] EXP: Generated 138 derivative records from 29175 primary records. [2025-10-22T23:30:53.295635] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-22T23:30:53.307517] [DEBUG] [LOCAL ] EXP: Derivative data saved (138 records). [2025-10-22T23:30:53.307631] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-10-22T23:30:53.310426] [INFO ] [MAIN ] Derivative Progress: 622/2052 symbols. EXP took 0.4s. Estimated remaining time: 9m 23s [2025-10-22T23:30:53.310520] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:53.357668] [DEBUG] [LOCAL ] EXPD: Loaded 47729 existing records from primary storage. [2025-10-22T23:30:53.357831] [INFO ] [MAIN ] EXPD: Loaded 47729 primary data records. [2025-10-22T23:30:53.669504] [DEBUG] [MAIN ] EXPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:53.695182] [INFO ] [MAIN ] EXPD: Generated 138 derivative records from 47729 primary records. [2025-10-22T23:30:53.695303] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-22T23:30:53.707038] [DEBUG] [LOCAL ] EXPD: Derivative data saved (138 records). [2025-10-22T23:30:53.707125] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-10-22T23:30:53.710080] [INFO ] [MAIN ] Derivative Progress: 623/2052 symbols. EXPD took 0.4s. Estimated remaining time: 9m 23s [2025-10-22T23:30:53.710189] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:53.754205] [DEBUG] [LOCAL ] EXR: Loaded 45503 existing records from primary storage. [2025-10-22T23:30:53.754364] [INFO ] [MAIN ] EXR: Loaded 45503 primary data records. [2025-10-22T23:30:54.062971] [DEBUG] [MAIN ] EXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:54.088492] [INFO ] [MAIN ] EXR: Generated 138 derivative records from 45503 primary records. [2025-10-22T23:30:54.088598] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-22T23:30:54.100277] [DEBUG] [LOCAL ] EXR: Derivative data saved (138 records). [2025-10-22T23:30:54.100358] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-10-22T23:30:54.103256] [INFO ] [MAIN ] Derivative Progress: 624/2052 symbols. EXR took 0.4s. Estimated remaining time: 9m 22s [2025-10-22T23:30:54.103355] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:54.156088] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-22T23:30:54.156247] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-10-22T23:30:54.468459] [DEBUG] [MAIN ] F: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:54.493739] [INFO ] [MAIN ] F: Generated 138 derivative records from 53820 primary records. [2025-10-22T23:30:54.493841] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-22T23:30:54.505731] [DEBUG] [LOCAL ] F: Derivative data saved (138 records). [2025-10-22T23:30:54.505809] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-22T23:30:54.508957] [INFO ] [MAIN ] Derivative Progress: 625/2052 symbols. F took 0.4s. Estimated remaining time: 9m 22s [2025-10-22T23:30:54.509059] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:54.547966] [DEBUG] [LOCAL ] FAF: Loaded 41432 existing records from primary storage. [2025-10-22T23:30:54.548121] [INFO ] [MAIN ] FAF: Loaded 41432 primary data records. [2025-10-22T23:30:54.853611] [DEBUG] [MAIN ] FAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:54.878526] [INFO ] [MAIN ] FAF: Generated 138 derivative records from 41432 primary records. [2025-10-22T23:30:54.878629] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-22T23:30:54.889889] [DEBUG] [LOCAL ] FAF: Derivative data saved (138 records). [2025-10-22T23:30:54.889966] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-22T23:30:54.892961] [INFO ] [MAIN ] Derivative Progress: 626/2052 symbols. FAF took 0.4s. Estimated remaining time: 9m 22s [2025-10-22T23:30:54.893065] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:54.920786] [DEBUG] [LOCAL ] FBK: Loaded 27466 existing records from primary storage. [2025-10-22T23:30:54.920939] [INFO ] [MAIN ] FBK: Loaded 27466 primary data records. [2025-10-22T23:30:55.258829] [DEBUG] [MAIN ] FBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:55.284580] [INFO ] [MAIN ] FBK: Generated 138 derivative records from 27466 primary records. [2025-10-22T23:30:55.284711] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-22T23:30:55.296133] [DEBUG] [LOCAL ] FBK: Derivative data saved (138 records). [2025-10-22T23:30:55.296221] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-22T23:30:55.299228] [INFO ] [MAIN ] Derivative Progress: 627/2052 symbols. FBK took 0.4s. Estimated remaining time: 9m 21s [2025-10-22T23:30:55.299334] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:55.342836] [DEBUG] [LOCAL ] FBP: Loaded 45588 existing records from primary storage. [2025-10-22T23:30:55.342993] [INFO ] [MAIN ] FBP: Loaded 45588 primary data records. [2025-10-22T23:30:55.659904] [DEBUG] [MAIN ] FBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:55.685392] [INFO ] [MAIN ] FBP: Generated 138 derivative records from 45588 primary records. [2025-10-22T23:30:55.685524] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-22T23:30:55.697298] [DEBUG] [LOCAL ] FBP: Derivative data saved (138 records). [2025-10-22T23:30:55.697382] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-22T23:30:55.700333] [INFO ] [MAIN ] Derivative Progress: 628/2052 symbols. FBP took 0.4s. Estimated remaining time: 9m 21s [2025-10-22T23:30:55.700431] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:55.736412] [DEBUG] [LOCAL ] FBRT: Loaded 35216 existing records from primary storage. [2025-10-22T23:30:55.736570] [INFO ] [MAIN ] FBRT: Loaded 35216 primary data records. [2025-10-22T23:30:56.056281] [DEBUG] [MAIN ] FBRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:56.083079] [INFO ] [MAIN ] FBRT: Generated 138 derivative records from 35216 primary records. [2025-10-22T23:30:56.083260] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-10-22T23:30:56.094976] [DEBUG] [LOCAL ] FBRT: Derivative data saved (138 records). [2025-10-22T23:30:56.095079] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-10-22T23:30:56.097995] [INFO ] [MAIN ] Derivative Progress: 629/2052 symbols. FBRT took 0.4s. Estimated remaining time: 9m 20s [2025-10-22T23:30:56.098106] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:56.127436] [DEBUG] [LOCAL ] FCN: Loaded 25886 existing records from primary storage. [2025-10-22T23:30:56.127609] [INFO ] [MAIN ] FCN: Loaded 25886 primary data records. [2025-10-22T23:30:56.447118] [DEBUG] [MAIN ] FCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:56.483201] [INFO ] [MAIN ] FCN: Generated 138 derivative records from 25886 primary records. [2025-10-22T23:30:56.483443] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-22T23:30:56.497167] [DEBUG] [LOCAL ] FCN: Derivative data saved (138 records). [2025-10-22T23:30:56.497360] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-22T23:30:56.500272] [INFO ] [MAIN ] Derivative Progress: 630/2052 symbols. FCN took 0.4s. Estimated remaining time: 9m 20s [2025-10-22T23:30:56.500377] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:56.536877] [DEBUG] [LOCAL ] FCPT: Loaded 36980 existing records from primary storage. [2025-10-22T23:30:56.537037] [INFO ] [MAIN ] FCPT: Loaded 36980 primary data records. [2025-10-22T23:30:56.840615] [DEBUG] [MAIN ] FCPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:56.865449] [INFO ] [MAIN ] FCPT: Generated 138 derivative records from 36980 primary records. [2025-10-22T23:30:56.865581] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-22T23:30:56.877027] [DEBUG] [LOCAL ] FCPT: Derivative data saved (138 records). [2025-10-22T23:30:56.877105] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-22T23:30:56.880045] [INFO ] [MAIN ] Derivative Progress: 631/2052 symbols. FCPT took 0.4s. Estimated remaining time: 9m 20s [2025-10-22T23:30:56.880141] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:56.897052] [DEBUG] [LOCAL ] FCT: Loaded 14722 existing records from primary storage. [2025-10-22T23:30:56.897190] [INFO ] [MAIN ] FCT: Loaded 14722 primary data records. [2025-10-22T23:30:57.237664] [DEBUG] [MAIN ] FCT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:30:57.263834] [INFO ] [MAIN ] FCT: Generated 138 derivative records from 14722 primary records. [2025-10-22T23:30:57.263967] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-22T23:30:57.275152] [DEBUG] [LOCAL ] FCT: Derivative data saved (138 records). [2025-10-22T23:30:57.275240] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-10-22T23:30:57.278205] [INFO ] [MAIN ] Derivative Progress: 632/2052 symbols. FCT took 0.4s. Estimated remaining time: 9m 19s [2025-10-22T23:30:57.278300] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:57.329759] [DEBUG] [LOCAL ] FCX: Loaded 53701 existing records from primary storage. [2025-10-22T23:30:57.329919] [INFO ] [MAIN ] FCX: Loaded 53701 primary data records. [2025-10-22T23:30:57.652684] [DEBUG] [MAIN ] FCX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:57.677283] [INFO ] [MAIN ] FCX: Generated 138 derivative records from 53701 primary records. [2025-10-22T23:30:57.677389] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-22T23:30:57.688958] [DEBUG] [LOCAL ] FCX: Derivative data saved (138 records). [2025-10-22T23:30:57.689037] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-10-22T23:30:57.692256] [INFO ] [MAIN ] Derivative Progress: 633/2052 symbols. FCX took 0.4s. Estimated remaining time: 9m 19s [2025-10-22T23:30:57.692365] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:57.721847] [DEBUG] [LOCAL ] FDP: Loaded 29707 existing records from primary storage. [2025-10-22T23:30:57.721994] [INFO ] [MAIN ] FDP: Loaded 29707 primary data records. [2025-10-22T23:30:58.030354] [DEBUG] [MAIN ] FDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:58.055084] [INFO ] [MAIN ] FDP: Generated 138 derivative records from 29707 primary records. [2025-10-22T23:30:58.055214] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-22T23:30:58.066445] [DEBUG] [LOCAL ] FDP: Derivative data saved (138 records). [2025-10-22T23:30:58.066525] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-22T23:30:58.069290] [INFO ] [MAIN ] Derivative Progress: 634/2052 symbols. FDP took 0.4s. Estimated remaining time: 9m 18s [2025-10-22T23:30:58.069390] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:58.097966] [DEBUG] [LOCAL ] FDS: Loaded 28003 existing records from primary storage. [2025-10-22T23:30:58.098117] [INFO ] [MAIN ] FDS: Loaded 28003 primary data records. [2025-10-22T23:30:58.401073] [DEBUG] [MAIN ] FDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:58.426001] [INFO ] [MAIN ] FDS: Generated 138 derivative records from 28003 primary records. [2025-10-22T23:30:58.426157] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-22T23:30:58.437688] [DEBUG] [LOCAL ] FDS: Derivative data saved (138 records). [2025-10-22T23:30:58.437783] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-22T23:30:58.440507] [INFO ] [MAIN ] Derivative Progress: 635/2052 symbols. FDS took 0.4s. Estimated remaining time: 9m 18s [2025-10-22T23:30:58.440603] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:58.490524] [DEBUG] [LOCAL ] FDX: Loaded 51182 existing records from primary storage. [2025-10-22T23:30:58.490719] [INFO ] [MAIN ] FDX: Loaded 51182 primary data records. [2025-10-22T23:30:58.803447] [DEBUG] [MAIN ] FDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:58.828300] [INFO ] [MAIN ] FDX: Generated 138 derivative records from 51182 primary records. [2025-10-22T23:30:58.828439] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-22T23:30:58.840374] [DEBUG] [LOCAL ] FDX: Derivative data saved (138 records). [2025-10-22T23:30:58.840456] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-10-22T23:30:58.843480] [INFO ] [MAIN ] Derivative Progress: 636/2052 symbols. FDX took 0.4s. Estimated remaining time: 9m 18s [2025-10-22T23:30:58.843576] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:58.894542] [DEBUG] [LOCAL ] FE: Loaded 53433 existing records from primary storage. [2025-10-22T23:30:58.894748] [INFO ] [MAIN ] FE: Loaded 53433 primary data records. [2025-10-22T23:30:59.224092] [DEBUG] [MAIN ] FE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:59.249324] [INFO ] [MAIN ] FE: Generated 138 derivative records from 53433 primary records. [2025-10-22T23:30:59.249461] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-22T23:30:59.260898] [DEBUG] [LOCAL ] FE: Derivative data saved (138 records). [2025-10-22T23:30:59.260975] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-22T23:30:59.263953] [INFO ] [MAIN ] Derivative Progress: 637/2052 symbols. FE took 0.4s. Estimated remaining time: 9m 17s [2025-10-22T23:30:59.264049] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:59.309778] [DEBUG] [LOCAL ] FERG: Loaded 48718 existing records from primary storage. [2025-10-22T23:30:59.310004] [INFO ] [MAIN ] FERG: Loaded 48718 primary data records. [2025-10-22T23:30:59.616382] [DEBUG] [MAIN ] FERG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:30:59.645783] [INFO ] [MAIN ] FERG: Generated 138 derivative records from 48718 primary records. [2025-10-22T23:30:59.646011] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-22T23:30:59.657888] [DEBUG] [LOCAL ] FERG: Derivative data saved (138 records). [2025-10-22T23:30:59.658003] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-22T23:30:59.661150] [INFO ] [MAIN ] Derivative Progress: 638/2052 symbols. FERG took 0.4s. Estimated remaining time: 9m 17s [2025-10-22T23:30:59.661309] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:30:59.678483] [DEBUG] [LOCAL ] FET: Loaded 12875 existing records from primary storage. [2025-10-22T23:30:59.678682] [INFO ] [MAIN ] FET: Loaded 12875 primary data records. [2025-10-22T23:30:59.983106] [DEBUG] [MAIN ] FET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:00.008277] [INFO ] [MAIN ] FET: Generated 138 derivative records from 12875 primary records. [2025-10-22T23:31:00.008382] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-22T23:31:00.019629] [DEBUG] [LOCAL ] FET: Derivative data saved (138 records). [2025-10-22T23:31:00.019727] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-22T23:31:00.022388] [INFO ] [MAIN ] Derivative Progress: 639/2052 symbols. FET took 0.4s. Estimated remaining time: 9m 16s [2025-10-22T23:31:00.022485] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:00.047064] [DEBUG] [LOCAL ] FF: Loaded 23707 existing records from primary storage. [2025-10-22T23:31:00.047209] [INFO ] [MAIN ] FF: Loaded 23707 primary data records. [2025-10-22T23:31:00.353409] [DEBUG] [MAIN ] FF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:00.378500] [INFO ] [MAIN ] FF: Generated 138 derivative records from 23707 primary records. [2025-10-22T23:31:00.378612] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-22T23:31:00.389768] [DEBUG] [LOCAL ] FF: Derivative data saved (138 records). [2025-10-22T23:31:00.389857] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-22T23:31:00.392507] [INFO ] [MAIN ] Derivative Progress: 640/2052 symbols. FF took 0.4s. Estimated remaining time: 9m 16s [2025-10-22T23:31:00.392613] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:00.402633] [DEBUG] [LOCAL ] FFA: Loaded 5586 existing records from primary storage. [2025-10-22T23:31:00.402789] [INFO ] [MAIN ] FFA: Loaded 5586 primary data records. [2025-10-22T23:31:00.718990] [DEBUG] [MAIN ] FFA: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:31:00.745165] [INFO ] [MAIN ] FFA: Generated 138 derivative records from 5586 primary records. [2025-10-22T23:31:00.745357] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-10-22T23:31:00.756950] [DEBUG] [LOCAL ] FFA: Derivative data saved (138 records). [2025-10-22T23:31:00.757049] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-10-22T23:31:00.759175] [INFO ] [MAIN ] Derivative Progress: 641/2052 symbols. FFA took 0.4s. Estimated remaining time: 9m 16s [2025-10-22T23:31:00.759297] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:00.778849] [DEBUG] [LOCAL ] FFC: Loaded 16583 existing records from primary storage. [2025-10-22T23:31:00.779014] [INFO ] [MAIN ] FFC: Loaded 16583 primary data records. [2025-10-22T23:31:01.081972] [DEBUG] [MAIN ] FFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:01.107061] [INFO ] [MAIN ] FFC: Generated 138 derivative records from 16583 primary records. [2025-10-22T23:31:01.107227] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-22T23:31:01.118797] [DEBUG] [LOCAL ] FFC: Derivative data saved (138 records). [2025-10-22T23:31:01.118896] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-22T23:31:01.121793] [INFO ] [MAIN ] Derivative Progress: 642/2052 symbols. FFC took 0.4s. Estimated remaining time: 9m 15s [2025-10-22T23:31:01.121919] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:01.156475] [DEBUG] [LOCAL ] FFWM: Loaded 35671 existing records from primary storage. [2025-10-22T23:31:01.156711] [INFO ] [MAIN ] FFWM: Loaded 35671 primary data records. [2025-10-22T23:31:01.487471] [DEBUG] [MAIN ] FFWM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:01.512383] [INFO ] [MAIN ] FFWM: Generated 138 derivative records from 35671 primary records. [2025-10-22T23:31:01.512510] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-10-22T23:31:01.523763] [DEBUG] [LOCAL ] FFWM: Derivative data saved (138 records). [2025-10-22T23:31:01.523848] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-10-22T23:31:01.526673] [INFO ] [MAIN ] Derivative Progress: 643/2052 symbols. FFWM took 0.4s. Estimated remaining time: 9m 15s [2025-10-22T23:31:01.526757] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:01.551838] [DEBUG] [LOCAL ] FG: Loaded 21366 existing records from primary storage. [2025-10-22T23:31:01.552014] [INFO ] [MAIN ] FG: Loaded 21366 primary data records. [2025-10-22T23:31:01.883260] [DEBUG] [MAIN ] FG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:01.908508] [INFO ] [MAIN ] FG: Generated 138 derivative records from 21366 primary records. [2025-10-22T23:31:01.908707] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-22T23:31:01.920565] [DEBUG] [LOCAL ] FG: Derivative data saved (138 records). [2025-10-22T23:31:01.920710] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-10-22T23:31:01.924126] [INFO ] [MAIN ] Derivative Progress: 644/2052 symbols. FG took 0.4s. Estimated remaining time: 9m 14s [2025-10-22T23:31:01.924339] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:01.934105] [DEBUG] [LOCAL ] FGN: Loaded 3560 existing records from primary storage. [2025-10-22T23:31:01.934290] [INFO ] [MAIN ] FGN: Loaded 3560 primary data records. [2025-10-22T23:31:02.259548] [DEBUG] [MAIN ] FGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:02.285135] [INFO ] [MAIN ] FGN: Generated 138 derivative records from 3560 primary records. [2025-10-22T23:31:02.285336] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-10-22T23:31:02.296698] [DEBUG] [LOCAL ] FGN: Derivative data saved (138 records). [2025-10-22T23:31:02.296792] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-10-22T23:31:02.299100] [INFO ] [MAIN ] Derivative Progress: 645/2052 symbols. FGN took 0.4s. Estimated remaining time: 9m 14s [2025-10-22T23:31:02.299205] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:02.341508] [DEBUG] [LOCAL ] FHI: Loaded 39410 existing records from primary storage. [2025-10-22T23:31:02.341699] [INFO ] [MAIN ] FHI: Loaded 39410 primary data records. [2025-10-22T23:31:02.658437] [DEBUG] [MAIN ] FHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:02.684108] [INFO ] [MAIN ] FHI: Generated 138 derivative records from 39410 primary records. [2025-10-22T23:31:02.684324] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-22T23:31:02.695805] [DEBUG] [LOCAL ] FHI: Derivative data saved (138 records). [2025-10-22T23:31:02.695928] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-10-22T23:31:02.698945] [INFO ] [MAIN ] Derivative Progress: 646/2052 symbols. FHI took 0.4s. Estimated remaining time: 9m 14s [2025-10-22T23:31:02.699112] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:02.760387] [DEBUG] [LOCAL ] FHN: Loaded 53399 existing records from primary storage. [2025-10-22T23:31:02.760596] [INFO ] [MAIN ] FHN: Loaded 53399 primary data records. [2025-10-22T23:31:03.081252] [DEBUG] [MAIN ] FHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:03.106946] [INFO ] [MAIN ] FHN: Generated 138 derivative records from 53399 primary records. [2025-10-22T23:31:03.107148] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-22T23:31:03.118942] [DEBUG] [LOCAL ] FHN: Derivative data saved (138 records). [2025-10-22T23:31:03.119047] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-10-22T23:31:03.122264] [INFO ] [MAIN ] Derivative Progress: 647/2052 symbols. FHN took 0.4s. Estimated remaining time: 9m 13s [2025-10-22T23:31:03.122428] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:03.178165] [DEBUG] [LOCAL ] FI: Loaded 53586 existing records from primary storage. [2025-10-22T23:31:03.178339] [INFO ] [MAIN ] FI: Loaded 53586 primary data records. [2025-10-22T23:31:03.526482] [DEBUG] [MAIN ] FI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:03.553199] [INFO ] [MAIN ] FI: Generated 138 derivative records from 53586 primary records. [2025-10-22T23:31:03.553384] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-22T23:31:03.565534] [DEBUG] [LOCAL ] FI: Derivative data saved (138 records). [2025-10-22T23:31:03.565709] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-22T23:31:03.569028] [INFO ] [MAIN ] Derivative Progress: 648/2052 symbols. FI took 0.4s. Estimated remaining time: 9m 13s [2025-10-22T23:31:03.569196] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:03.594166] [DEBUG] [LOCAL ] FICO: Loaded 21963 existing records from primary storage. [2025-10-22T23:31:03.594334] [INFO ] [MAIN ] FICO: Loaded 21963 primary data records. [2025-10-22T23:31:03.917551] [DEBUG] [MAIN ] FICO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:03.942395] [INFO ] [MAIN ] FICO: Generated 138 derivative records from 21963 primary records. [2025-10-22T23:31:03.942522] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-22T23:31:03.954353] [DEBUG] [LOCAL ] FICO: Derivative data saved (138 records). [2025-10-22T23:31:03.954437] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-10-22T23:31:03.957167] [INFO ] [MAIN ] Derivative Progress: 649/2052 symbols. FICO took 0.4s. Estimated remaining time: 9m 12s [2025-10-22T23:31:03.957282] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:04.000737] [DEBUG] [LOCAL ] FIGS: Loaded 48545 existing records from primary storage. [2025-10-22T23:31:04.000898] [INFO ] [MAIN ] FIGS: Loaded 48545 primary data records. [2025-10-22T23:31:04.307128] [DEBUG] [MAIN ] FIGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:04.332260] [INFO ] [MAIN ] FIGS: Generated 138 derivative records from 48545 primary records. [2025-10-22T23:31:04.332376] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-22T23:31:04.343422] [DEBUG] [LOCAL ] FIGS: Derivative data saved (138 records). [2025-10-22T23:31:04.343512] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-22T23:31:04.346419] [INFO ] [MAIN ] Derivative Progress: 650/2052 symbols. FIGS took 0.4s. Estimated remaining time: 9m 12s [2025-10-22T23:31:04.346520] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:04.385118] [DEBUG] [LOCAL ] FIHL: Loaded 39044 existing records from primary storage. [2025-10-22T23:31:04.385293] [INFO ] [MAIN ] FIHL: Loaded 39044 primary data records. [2025-10-22T23:31:04.688830] [DEBUG] [MAIN ] FIHL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:04.714367] [INFO ] [MAIN ] FIHL: Generated 138 derivative records from 39044 primary records. [2025-10-22T23:31:04.714552] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-22T23:31:04.726178] [DEBUG] [LOCAL ] FIHL: Derivative data saved (138 records). [2025-10-22T23:31:04.726317] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-22T23:31:04.729302] [INFO ] [MAIN ] Derivative Progress: 651/2052 symbols. FIHL took 0.4s. Estimated remaining time: 9m 12s [2025-10-22T23:31:04.729418] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:04.745258] [DEBUG] [LOCAL ] FINS: Loaded 8261 existing records from primary storage. [2025-10-22T23:31:04.745416] [INFO ] [MAIN ] FINS: Loaded 8261 primary data records. [2025-10-22T23:31:05.053570] [DEBUG] [MAIN ] FINS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:05.078549] [INFO ] [MAIN ] FINS: Generated 138 derivative records from 8261 primary records. [2025-10-22T23:31:05.078708] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-22T23:31:05.089744] [DEBUG] [LOCAL ] FINS: Derivative data saved (138 records). [2025-10-22T23:31:05.089827] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-22T23:31:05.092471] [INFO ] [MAIN ] Derivative Progress: 652/2052 symbols. FINS took 0.4s. Estimated remaining time: 9m 11s [2025-10-22T23:31:05.092564] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:05.141143] [DEBUG] [LOCAL ] FINV: Loaded 45222 existing records from primary storage. [2025-10-22T23:31:05.141300] [INFO ] [MAIN ] FINV: Loaded 45222 primary data records. [2025-10-22T23:31:05.469321] [DEBUG] [MAIN ] FINV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:05.494166] [INFO ] [MAIN ] FINV: Generated 138 derivative records from 45222 primary records. [2025-10-22T23:31:05.494291] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-22T23:31:05.505446] [DEBUG] [LOCAL ] FINV: Derivative data saved (138 records). [2025-10-22T23:31:05.505526] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-22T23:31:05.508537] [INFO ] [MAIN ] Derivative Progress: 653/2052 symbols. FINV took 0.4s. Estimated remaining time: 9m 11s [2025-10-22T23:31:05.508662] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:05.572217] [DEBUG] [LOCAL ] FIS: Loaded 53325 existing records from primary storage. [2025-10-22T23:31:05.572385] [INFO ] [MAIN ] FIS: Loaded 53325 primary data records. [2025-10-22T23:31:05.875813] [DEBUG] [MAIN ] FIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:05.901000] [INFO ] [MAIN ] FIS: Generated 138 derivative records from 53325 primary records. [2025-10-22T23:31:05.901171] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-22T23:31:05.915829] [DEBUG] [LOCAL ] FIS: Derivative data saved (138 records). [2025-10-22T23:31:05.915992] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-22T23:31:05.919529] [INFO ] [MAIN ] Derivative Progress: 654/2052 symbols. FIS took 0.4s. Estimated remaining time: 9m 11s [2025-10-22T23:31:05.919720] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:05.958685] [DEBUG] [LOCAL ] FIX: Loaded 28424 existing records from primary storage. [2025-10-22T23:31:05.958857] [INFO ] [MAIN ] FIX: Loaded 28424 primary data records. [2025-10-22T23:31:06.260410] [DEBUG] [MAIN ] FIX: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:31:06.285374] [INFO ] [MAIN ] FIX: Generated 138 derivative records from 28424 primary records. [2025-10-22T23:31:06.285502] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-22T23:31:06.296842] [DEBUG] [LOCAL ] FIX: Derivative data saved (138 records). [2025-10-22T23:31:06.296920] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-22T23:31:06.299633] [INFO ] [MAIN ] Derivative Progress: 655/2052 symbols. FIX took 0.4s. Estimated remaining time: 9m 10s [2025-10-22T23:31:06.299762] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:06.316781] [DEBUG] [LOCAL ] FLC: Loaded 5396 existing records from primary storage. [2025-10-22T23:31:06.316907] [INFO ] [MAIN ] FLC: Loaded 5396 primary data records. [2025-10-22T23:31:06.621624] [DEBUG] [MAIN ] FLC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:06.646218] [INFO ] [MAIN ] FLC: Generated 138 derivative records from 5396 primary records. [2025-10-22T23:31:06.646342] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-22T23:31:06.657080] [DEBUG] [LOCAL ] FLC: Derivative data saved (138 records). [2025-10-22T23:31:06.657159] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-22T23:31:06.659218] [INFO ] [MAIN ] Derivative Progress: 656/2052 symbols. FLC took 0.4s. Estimated remaining time: 9m 10s [2025-10-22T23:31:06.659315] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:06.714352] [DEBUG] [LOCAL ] FLG: Loaded 53319 existing records from primary storage. [2025-10-22T23:31:06.714511] [INFO ] [MAIN ] FLG: Loaded 53319 primary data records. [2025-10-22T23:31:07.026878] [DEBUG] [MAIN ] FLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:07.051883] [INFO ] [MAIN ] FLG: Generated 138 derivative records from 53319 primary records. [2025-10-22T23:31:07.052007] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-22T23:31:07.063587] [DEBUG] [LOCAL ] FLG: Derivative data saved (138 records). [2025-10-22T23:31:07.063686] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-22T23:31:07.066667] [INFO ] [MAIN ] Derivative Progress: 657/2052 symbols. FLG took 0.4s. Estimated remaining time: 9m 9s [2025-10-22T23:31:07.066772] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:07.123681] [DEBUG] [LOCAL ] FLNG: Loaded 33319 existing records from primary storage. [2025-10-22T23:31:07.123848] [INFO ] [MAIN ] FLNG: Loaded 33319 primary data records. [2025-10-22T23:31:07.453357] [DEBUG] [MAIN ] FLNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:07.478476] [INFO ] [MAIN ] FLNG: Generated 138 derivative records from 33319 primary records. [2025-10-22T23:31:07.478606] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-22T23:31:07.490213] [DEBUG] [LOCAL ] FLNG: Derivative data saved (138 records). [2025-10-22T23:31:07.490293] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-22T23:31:07.493078] [INFO ] [MAIN ] Derivative Progress: 658/2052 symbols. FLNG took 0.4s. Estimated remaining time: 9m 9s [2025-10-22T23:31:07.493175] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:07.544800] [DEBUG] [LOCAL ] FLO: Loaded 52073 existing records from primary storage. [2025-10-22T23:31:07.544967] [INFO ] [MAIN ] FLO: Loaded 52073 primary data records. [2025-10-22T23:31:07.850332] [DEBUG] [MAIN ] FLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:07.875429] [INFO ] [MAIN ] FLO: Generated 138 derivative records from 52073 primary records. [2025-10-22T23:31:07.875560] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-22T23:31:07.887300] [DEBUG] [LOCAL ] FLO: Derivative data saved (138 records). [2025-10-22T23:31:07.887385] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-22T23:31:07.890600] [INFO ] [MAIN ] Derivative Progress: 659/2052 symbols. FLO took 0.4s. Estimated remaining time: 9m 9s [2025-10-22T23:31:07.890724] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:07.941367] [DEBUG] [LOCAL ] FLR: Loaded 53263 existing records from primary storage. [2025-10-22T23:31:07.941533] [INFO ] [MAIN ] FLR: Loaded 53263 primary data records. [2025-10-22T23:31:08.253367] [DEBUG] [MAIN ] FLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:08.278502] [INFO ] [MAIN ] FLR: Generated 138 derivative records from 53263 primary records. [2025-10-22T23:31:08.278698] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-22T23:31:08.290172] [DEBUG] [LOCAL ] FLR: Derivative data saved (138 records). [2025-10-22T23:31:08.290298] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-22T23:31:08.293362] [INFO ] [MAIN ] Derivative Progress: 660/2052 symbols. FLR took 0.4s. Estimated remaining time: 9m 8s [2025-10-22T23:31:08.293507] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:08.342369] [DEBUG] [LOCAL ] FLS: Loaded 50409 existing records from primary storage. [2025-10-22T23:31:08.342552] [INFO ] [MAIN ] FLS: Loaded 50409 primary data records. [2025-10-22T23:31:08.659249] [DEBUG] [MAIN ] FLS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:31:08.685868] [INFO ] [MAIN ] FLS: Generated 138 derivative records from 50409 primary records. [2025-10-22T23:31:08.686058] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-22T23:31:08.697679] [DEBUG] [LOCAL ] FLS: Derivative data saved (138 records). [2025-10-22T23:31:08.697805] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-22T23:31:08.700838] [INFO ] [MAIN ] Derivative Progress: 661/2052 symbols. FLS took 0.4s. Estimated remaining time: 9m 8s [2025-10-22T23:31:08.701021] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:08.751519] [DEBUG] [LOCAL ] FLUT: Loaded 50672 existing records from primary storage. [2025-10-22T23:31:08.751712] [INFO ] [MAIN ] FLUT: Loaded 50672 primary data records. [2025-10-22T23:31:09.055279] [DEBUG] [MAIN ] FLUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:09.080559] [INFO ] [MAIN ] FLUT: Generated 138 derivative records from 50672 primary records. [2025-10-22T23:31:09.080735] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-22T23:31:09.092316] [DEBUG] [LOCAL ] FLUT: Derivative data saved (138 records). [2025-10-22T23:31:09.092397] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-22T23:31:09.095384] [INFO ] [MAIN ] Derivative Progress: 662/2052 symbols. FLUT took 0.4s. Estimated remaining time: 9m 7s [2025-10-22T23:31:09.095477] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:09.118446] [DEBUG] [LOCAL ] FLXR: Loaded 21360 existing records from primary storage. [2025-10-22T23:31:09.118600] [INFO ] [MAIN ] FLXR: Loaded 21360 primary data records. [2025-10-22T23:31:09.424440] [DEBUG] [MAIN ] FLXR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:31:09.450494] [INFO ] [MAIN ] FLXR: Generated 138 derivative records from 21360 primary records. [2025-10-22T23:31:09.450704] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-10-22T23:31:09.462021] [DEBUG] [LOCAL ] FLXR: Derivative data saved (138 records). [2025-10-22T23:31:09.462101] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-10-22T23:31:09.464790] [INFO ] [MAIN ] Derivative Progress: 663/2052 symbols. FLXR took 0.4s. Estimated remaining time: 9m 7s [2025-10-22T23:31:09.464899] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:09.515947] [DEBUG] [LOCAL ] FMC: Loaded 51883 existing records from primary storage. [2025-10-22T23:31:09.516138] [INFO ] [MAIN ] FMC: Loaded 51883 primary data records. [2025-10-22T23:31:09.853213] [DEBUG] [MAIN ] FMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:09.878423] [INFO ] [MAIN ] FMC: Generated 138 derivative records from 51883 primary records. [2025-10-22T23:31:09.878661] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-22T23:31:09.889949] [DEBUG] [LOCAL ] FMC: Derivative data saved (138 records). [2025-10-22T23:31:09.890027] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-22T23:31:09.893107] [INFO ] [MAIN ] Derivative Progress: 664/2052 symbols. FMC took 0.4s. Estimated remaining time: 9m 7s [2025-10-22T23:31:09.893201] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:09.902872] [DEBUG] [LOCAL ] FMN: Loaded 5477 existing records from primary storage. [2025-10-22T23:31:09.903001] [INFO ] [MAIN ] FMN: Loaded 5477 primary data records. [2025-10-22T23:31:10.219464] [DEBUG] [MAIN ] FMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:10.244801] [INFO ] [MAIN ] FMN: Generated 138 derivative records from 5477 primary records. [2025-10-22T23:31:10.244924] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-22T23:31:10.255616] [DEBUG] [LOCAL ] FMN: Derivative data saved (138 records). [2025-10-22T23:31:10.255715] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-22T23:31:10.257819] [INFO ] [MAIN ] Derivative Progress: 665/2052 symbols. FMN took 0.4s. Estimated remaining time: 9m 6s [2025-10-22T23:31:10.257915] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:10.286813] [DEBUG] [LOCAL ] FMS: Loaded 30344 existing records from primary storage. [2025-10-22T23:31:10.286968] [INFO ] [MAIN ] FMS: Loaded 30344 primary data records. [2025-10-22T23:31:10.600553] [DEBUG] [MAIN ] FMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:10.625806] [INFO ] [MAIN ] FMS: Generated 138 derivative records from 30344 primary records. [2025-10-22T23:31:10.625930] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-22T23:31:10.637429] [DEBUG] [LOCAL ] FMS: Derivative data saved (138 records). [2025-10-22T23:31:10.637508] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-22T23:31:10.640329] [INFO ] [MAIN ] Derivative Progress: 666/2052 symbols. FMS took 0.4s. Estimated remaining time: 9m 6s [2025-10-22T23:31:10.640428] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:10.680018] [DEBUG] [LOCAL ] FMX: Loaded 40436 existing records from primary storage. [2025-10-22T23:31:10.680177] [INFO ] [MAIN ] FMX: Loaded 40436 primary data records. [2025-10-22T23:31:10.985169] [DEBUG] [MAIN ] FMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:11.010296] [INFO ] [MAIN ] FMX: Generated 138 derivative records from 40436 primary records. [2025-10-22T23:31:11.010521] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-22T23:31:11.021948] [DEBUG] [LOCAL ] FMX: Derivative data saved (138 records). [2025-10-22T23:31:11.022037] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-22T23:31:11.025166] [INFO ] [MAIN ] Derivative Progress: 667/2052 symbols. FMX took 0.4s. Estimated remaining time: 9m 5s [2025-10-22T23:31:11.025265] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:11.028906] [DEBUG] [LOCAL ] FMY: Loaded 1360 existing records from primary storage. [2025-10-22T23:31:11.028991] [INFO ] [MAIN ] FMY: Loaded 1360 primary data records. [2025-10-22T23:31:11.338847] [DEBUG] [MAIN ] FMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:11.365697] [INFO ] [MAIN ] FMY: Generated 138 derivative records from 1360 primary records. [2025-10-22T23:31:11.365909] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-22T23:31:11.376053] [DEBUG] [LOCAL ] FMY: Derivative data saved (138 records). [2025-10-22T23:31:11.376142] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-22T23:31:11.378339] [INFO ] [MAIN ] Derivative Progress: 668/2052 symbols. FMY took 0.4s. Estimated remaining time: 9m 5s [2025-10-22T23:31:11.378434] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:11.417911] [DEBUG] [LOCAL ] FN: Loaded 37392 existing records from primary storage. [2025-10-22T23:31:11.418074] [INFO ] [MAIN ] FN: Loaded 37392 primary data records. [2025-10-22T23:31:11.763830] [DEBUG] [MAIN ] FN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:11.789770] [INFO ] [MAIN ] FN: Generated 138 derivative records from 37392 primary records. [2025-10-22T23:31:11.789914] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-22T23:31:11.801946] [DEBUG] [LOCAL ] FN: Derivative data saved (138 records). [2025-10-22T23:31:11.802035] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-22T23:31:11.805049] [INFO ] [MAIN ] Derivative Progress: 669/2052 symbols. FN took 0.4s. Estimated remaining time: 9m 5s [2025-10-22T23:31:11.805152] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:11.861077] [DEBUG] [LOCAL ] FNB: Loaded 52602 existing records from primary storage. [2025-10-22T23:31:11.861243] [INFO ] [MAIN ] FNB: Loaded 52602 primary data records. [2025-10-22T23:31:12.176183] [DEBUG] [MAIN ] FNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:12.202156] [INFO ] [MAIN ] FNB: Generated 138 derivative records from 52602 primary records. [2025-10-22T23:31:12.202314] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-22T23:31:12.214217] [DEBUG] [LOCAL ] FNB: Derivative data saved (138 records). [2025-10-22T23:31:12.214306] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-22T23:31:12.217478] [INFO ] [MAIN ] Derivative Progress: 670/2052 symbols. FNB took 0.4s. Estimated remaining time: 9m 4s [2025-10-22T23:31:12.217579] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:12.267243] [DEBUG] [LOCAL ] FND: Loaded 52075 existing records from primary storage. [2025-10-22T23:31:12.267441] [INFO ] [MAIN ] FND: Loaded 52075 primary data records. [2025-10-22T23:31:12.590512] [DEBUG] [MAIN ] FND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:12.616301] [INFO ] [MAIN ] FND: Generated 138 derivative records from 52075 primary records. [2025-10-22T23:31:12.616488] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-22T23:31:12.629593] [DEBUG] [LOCAL ] FND: Derivative data saved (138 records). [2025-10-22T23:31:12.629718] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-22T23:31:12.633077] [INFO ] [MAIN ] Derivative Progress: 671/2052 symbols. FND took 0.4s. Estimated remaining time: 9m 4s [2025-10-22T23:31:12.633205] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:12.679285] [DEBUG] [LOCAL ] FNF: Loaded 48737 existing records from primary storage. [2025-10-22T23:31:12.679447] [INFO ] [MAIN ] FNF: Loaded 48737 primary data records. [2025-10-22T23:31:12.998114] [DEBUG] [MAIN ] FNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:13.024222] [INFO ] [MAIN ] FNF: Generated 138 derivative records from 48737 primary records. [2025-10-22T23:31:13.024359] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-22T23:31:13.036148] [DEBUG] [LOCAL ] FNF: Derivative data saved (138 records). [2025-10-22T23:31:13.036238] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-10-22T23:31:13.039175] [INFO ] [MAIN ] Derivative Progress: 672/2052 symbols. FNF took 0.4s. Estimated remaining time: 9m 3s [2025-10-22T23:31:13.039275] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:13.083907] [DEBUG] [LOCAL ] FNV: Loaded 46129 existing records from primary storage. [2025-10-22T23:31:13.084068] [INFO ] [MAIN ] FNV: Loaded 46129 primary data records. [2025-10-22T23:31:13.394804] [DEBUG] [MAIN ] FNV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:13.422390] [INFO ] [MAIN ] FNV: Generated 138 derivative records from 46129 primary records. [2025-10-22T23:31:13.422578] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-22T23:31:13.434499] [DEBUG] [LOCAL ] FNV: Derivative data saved (138 records). [2025-10-22T23:31:13.434593] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-10-22T23:31:13.437555] [INFO ] [MAIN ] Derivative Progress: 673/2052 symbols. FNV took 0.4s. Estimated remaining time: 9m 3s [2025-10-22T23:31:13.437697] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:13.453930] [DEBUG] [LOCAL ] FOA: Loaded 13013 existing records from primary storage. [2025-10-22T23:31:13.454074] [INFO ] [MAIN ] FOA: Loaded 13013 primary data records. [2025-10-22T23:31:13.788570] [DEBUG] [MAIN ] FOA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:13.814161] [INFO ] [MAIN ] FOA: Generated 138 derivative records from 13013 primary records. [2025-10-22T23:31:13.814364] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-22T23:31:13.826064] [DEBUG] [LOCAL ] FOA: Derivative data saved (138 records). [2025-10-22T23:31:13.826148] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-10-22T23:31:13.829006] [INFO ] [MAIN ] Derivative Progress: 674/2052 symbols. FOA took 0.4s. Estimated remaining time: 9m 3s [2025-10-22T23:31:13.829117] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:13.841500] [DEBUG] [LOCAL ] FOF: Loaded 8391 existing records from primary storage. [2025-10-22T23:31:13.841689] [INFO ] [MAIN ] FOF: Loaded 8391 primary data records. [2025-10-22T23:31:14.152206] [DEBUG] [MAIN ] FOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:14.179274] [INFO ] [MAIN ] FOF: Generated 138 derivative records from 8391 primary records. [2025-10-22T23:31:14.179397] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-22T23:31:14.191630] [DEBUG] [LOCAL ] FOF: Derivative data saved (138 records). [2025-10-22T23:31:14.191747] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-22T23:31:14.193914] [INFO ] [MAIN ] Derivative Progress: 675/2052 symbols. FOF took 0.4s. Estimated remaining time: 9m 2s [2025-10-22T23:31:14.194009] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:14.215408] [DEBUG] [LOCAL ] FOR: Loaded 19506 existing records from primary storage. [2025-10-22T23:31:14.215566] [INFO ] [MAIN ] FOR: Loaded 19506 primary data records. [2025-10-22T23:31:14.527712] [DEBUG] [MAIN ] FOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:14.552892] [INFO ] [MAIN ] FOR: Generated 138 derivative records from 19506 primary records. [2025-10-22T23:31:14.553041] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-22T23:31:14.564478] [DEBUG] [LOCAL ] FOR: Derivative data saved (138 records). [2025-10-22T23:31:14.564563] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-22T23:31:14.567354] [INFO ] [MAIN ] Derivative Progress: 676/2052 symbols. FOR took 0.4s. Estimated remaining time: 9m 2s [2025-10-22T23:31:14.567453] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:14.613535] [DEBUG] [LOCAL ] FOUR: Loaded 49712 existing records from primary storage. [2025-10-22T23:31:14.613732] [INFO ] [MAIN ] FOUR: Loaded 49712 primary data records. [2025-10-22T23:31:14.919719] [DEBUG] [MAIN ] FOUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:14.944440] [INFO ] [MAIN ] FOUR: Generated 138 derivative records from 49712 primary records. [2025-10-22T23:31:14.944554] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-22T23:31:14.956154] [DEBUG] [LOCAL ] FOUR: Derivative data saved (138 records). [2025-10-22T23:31:14.956235] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-22T23:31:14.959250] [INFO ] [MAIN ] Derivative Progress: 677/2052 symbols. FOUR took 0.4s. Estimated remaining time: 9m 1s [2025-10-22T23:31:14.959344] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:14.980563] [DEBUG] [LOCAL ] FPF: Loaded 18735 existing records from primary storage. [2025-10-22T23:31:14.980742] [INFO ] [MAIN ] FPF: Loaded 18735 primary data records. [2025-10-22T23:31:15.287109] [DEBUG] [MAIN ] FPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:15.312445] [INFO ] [MAIN ] FPF: Generated 138 derivative records from 18735 primary records. [2025-10-22T23:31:15.312562] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-22T23:31:15.324001] [DEBUG] [LOCAL ] FPF: Derivative data saved (138 records). [2025-10-22T23:31:15.324081] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-22T23:31:15.326919] [INFO ] [MAIN ] Derivative Progress: 678/2052 symbols. FPF took 0.4s. Estimated remaining time: 9m 1s [2025-10-22T23:31:15.327010] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:15.347665] [DEBUG] [LOCAL ] FPH: Loaded 19183 existing records from primary storage. [2025-10-22T23:31:15.347819] [INFO ] [MAIN ] FPH: Loaded 19183 primary data records. [2025-10-22T23:31:15.662389] [DEBUG] [MAIN ] FPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:15.688490] [INFO ] [MAIN ] FPH: Generated 138 derivative records from 19183 primary records. [2025-10-22T23:31:15.688727] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-22T23:31:15.699582] [DEBUG] [LOCAL ] FPH: Derivative data saved (138 records). [2025-10-22T23:31:15.699683] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-22T23:31:15.702488] [INFO ] [MAIN ] Derivative Progress: 679/2052 symbols. FPH took 0.4s. Estimated remaining time: 9m 1s [2025-10-22T23:31:15.702590] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:15.734746] [DEBUG] [LOCAL ] FPI: Loaded 31375 existing records from primary storage. [2025-10-22T23:31:15.734908] [INFO ] [MAIN ] FPI: Loaded 31375 primary data records. [2025-10-22T23:31:16.069216] [DEBUG] [MAIN ] FPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:16.095134] [INFO ] [MAIN ] FPI: Generated 138 derivative records from 31375 primary records. [2025-10-22T23:31:16.095296] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-22T23:31:16.106965] [DEBUG] [LOCAL ] FPI: Derivative data saved (138 records). [2025-10-22T23:31:16.107063] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-10-22T23:31:16.110041] [INFO ] [MAIN ] Derivative Progress: 680/2052 symbols. FPI took 0.4s. Estimated remaining time: 9m 0s [2025-10-22T23:31:16.110143] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:16.151993] [DEBUG] [LOCAL ] FR: Loaded 46648 existing records from primary storage. [2025-10-22T23:31:16.152155] [INFO ] [MAIN ] FR: Loaded 46648 primary data records. [2025-10-22T23:31:16.466563] [DEBUG] [MAIN ] FR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:16.492419] [INFO ] [MAIN ] FR: Generated 138 derivative records from 46648 primary records. [2025-10-22T23:31:16.492598] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-22T23:31:16.503985] [DEBUG] [LOCAL ] FR: Derivative data saved (138 records). [2025-10-22T23:31:16.504065] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-10-22T23:31:16.507195] [INFO ] [MAIN ] Derivative Progress: 681/2052 symbols. FR took 0.4s. Estimated remaining time: 8m 60s [2025-10-22T23:31:16.507326] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:16.524174] [DEBUG] [LOCAL ] FRA: Loaded 14058 existing records from primary storage. [2025-10-22T23:31:16.524317] [INFO ] [MAIN ] FRA: Loaded 14058 primary data records. [2025-10-22T23:31:16.837194] [DEBUG] [MAIN ] FRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:16.863554] [INFO ] [MAIN ] FRA: Generated 138 derivative records from 14058 primary records. [2025-10-22T23:31:16.863709] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-22T23:31:16.875164] [DEBUG] [LOCAL ] FRA: Derivative data saved (138 records). [2025-10-22T23:31:16.875247] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-22T23:31:16.878115] [INFO ] [MAIN ] Derivative Progress: 682/2052 symbols. FRA took 0.4s. Estimated remaining time: 8m 59s [2025-10-22T23:31:16.878217] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:16.897625] [DEBUG] [LOCAL ] FRGE: Loaded 15540 existing records from primary storage. [2025-10-22T23:31:16.897795] [INFO ] [MAIN ] FRGE: Loaded 15540 primary data records. [2025-10-22T23:31:17.222471] [DEBUG] [MAIN ] FRGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:17.248247] [INFO ] [MAIN ] FRGE: Generated 138 derivative records from 15540 primary records. [2025-10-22T23:31:17.248409] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-22T23:31:17.259893] [DEBUG] [LOCAL ] FRGE: Derivative data saved (138 records). [2025-10-22T23:31:17.259977] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-10-22T23:31:17.262936] [INFO ] [MAIN ] Derivative Progress: 683/2052 symbols. FRGE took 0.4s. Estimated remaining time: 8m 59s [2025-10-22T23:31:17.263036] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:17.313820] [DEBUG] [LOCAL ] FRO: Loaded 51679 existing records from primary storage. [2025-10-22T23:31:17.313980] [INFO ] [MAIN ] FRO: Loaded 51679 primary data records. [2025-10-22T23:31:17.727403] [DEBUG] [MAIN ] FRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:17.764151] [INFO ] [MAIN ] FRO: Generated 138 derivative records from 51679 primary records. [2025-10-22T23:31:17.764402] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-22T23:31:17.778735] [DEBUG] [LOCAL ] FRO: Derivative data saved (138 records). [2025-10-22T23:31:17.778905] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-22T23:31:17.782557] [INFO ] [MAIN ] Derivative Progress: 684/2052 symbols. FRO took 0.5s. Estimated remaining time: 8m 59s [2025-10-22T23:31:17.782794] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:17.842840] [DEBUG] [LOCAL ] FRT: Loaded 41468 existing records from primary storage. [2025-10-22T23:31:17.843070] [INFO ] [MAIN ] FRT: Loaded 41468 primary data records. [2025-10-22T23:31:18.353083] [DEBUG] [MAIN ] FRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:18.389586] [INFO ] [MAIN ] FRT: Generated 138 derivative records from 41468 primary records. [2025-10-22T23:31:18.389885] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-10-22T23:31:18.409088] [DEBUG] [LOCAL ] FRT: Derivative data saved (138 records). [2025-10-22T23:31:18.409289] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-10-22T23:31:18.413168] [INFO ] [MAIN ] Derivative Progress: 685/2052 symbols. FRT took 0.6s. Estimated remaining time: 8m 59s [2025-10-22T23:31:18.413400] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:18.458040] [DEBUG] [LOCAL ] FSCO: Loaded 38527 existing records from primary storage. [2025-10-22T23:31:18.458266] [INFO ] [MAIN ] FSCO: Loaded 38527 primary data records. [2025-10-22T23:31:18.814693] [DEBUG] [MAIN ] FSCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:18.841033] [INFO ] [MAIN ] FSCO: Generated 138 derivative records from 38527 primary records. [2025-10-22T23:31:18.841220] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-22T23:31:18.852740] [DEBUG] [LOCAL ] FSCO: Derivative data saved (138 records). [2025-10-22T23:31:18.852884] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-22T23:31:18.855995] [INFO ] [MAIN ] Derivative Progress: 686/2052 symbols. FSCO took 0.4s. Estimated remaining time: 8m 59s [2025-10-22T23:31:18.856149] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:18.904289] [DEBUG] [LOCAL ] FSK: Loaded 49476 existing records from primary storage. [2025-10-22T23:31:18.904467] [INFO ] [MAIN ] FSK: Loaded 49476 primary data records. [2025-10-22T23:31:19.218266] [DEBUG] [MAIN ] FSK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:19.243216] [INFO ] [MAIN ] FSK: Generated 138 derivative records from 49476 primary records. [2025-10-22T23:31:19.243334] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-22T23:31:19.255019] [DEBUG] [LOCAL ] FSK: Derivative data saved (138 records). [2025-10-22T23:31:19.255111] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-22T23:31:19.258009] [INFO ] [MAIN ] Derivative Progress: 687/2052 symbols. FSK took 0.4s. Estimated remaining time: 8m 58s [2025-10-22T23:31:19.258103] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:19.306579] [DEBUG] [LOCAL ] FSLY: Loaded 51303 existing records from primary storage. [2025-10-22T23:31:19.306767] [INFO ] [MAIN ] FSLY: Loaded 51303 primary data records. [2025-10-22T23:31:19.610032] [DEBUG] [MAIN ] FSLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:19.635054] [INFO ] [MAIN ] FSLY: Generated 138 derivative records from 51303 primary records. [2025-10-22T23:31:19.635202] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-22T23:31:19.646494] [DEBUG] [LOCAL ] FSLY: Derivative data saved (138 records). [2025-10-22T23:31:19.646573] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-22T23:31:19.649908] [INFO ] [MAIN ] Derivative Progress: 688/2052 symbols. FSLY took 0.4s. Estimated remaining time: 8m 58s [2025-10-22T23:31:19.650025] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:19.684148] [DEBUG] [LOCAL ] FSS: Loaded 33138 existing records from primary storage. [2025-10-22T23:31:19.684315] [INFO ] [MAIN ] FSS: Loaded 33138 primary data records. [2025-10-22T23:31:19.996945] [DEBUG] [MAIN ] FSS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:20.023506] [INFO ] [MAIN ] FSS: Generated 138 derivative records from 33138 primary records. [2025-10-22T23:31:20.023723] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-22T23:31:20.035561] [DEBUG] [LOCAL ] FSS: Derivative data saved (138 records). [2025-10-22T23:31:20.035731] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-22T23:31:20.038614] [INFO ] [MAIN ] Derivative Progress: 689/2052 symbols. FSS took 0.4s. Estimated remaining time: 8m 57s [2025-10-22T23:31:20.038803] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:20.049791] [DEBUG] [LOCAL ] FT: Loaded 6800 existing records from primary storage. [2025-10-22T23:31:20.049969] [INFO ] [MAIN ] FT: Loaded 6800 primary data records. [2025-10-22T23:31:20.414151] [DEBUG] [MAIN ] FT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:20.440355] [INFO ] [MAIN ] FT: Generated 138 derivative records from 6800 primary records. [2025-10-22T23:31:20.440533] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-22T23:31:20.451622] [DEBUG] [LOCAL ] FT: Derivative data saved (138 records). [2025-10-22T23:31:20.451756] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-10-22T23:31:20.453902] [INFO ] [MAIN ] Derivative Progress: 690/2052 symbols. FT took 0.4s. Estimated remaining time: 8m 57s [2025-10-22T23:31:20.454027] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:20.469344] [DEBUG] [LOCAL ] FTHY: Loaded 12294 existing records from primary storage. [2025-10-22T23:31:20.469526] [INFO ] [MAIN ] FTHY: Loaded 12294 primary data records. [2025-10-22T23:31:20.812037] [DEBUG] [MAIN ] FTHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:20.841560] [INFO ] [MAIN ] FTHY: Generated 138 derivative records from 12294 primary records. [2025-10-22T23:31:20.841783] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-22T23:31:20.853924] [DEBUG] [LOCAL ] FTHY: Derivative data saved (138 records). [2025-10-22T23:31:20.854022] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-22T23:31:20.856818] [INFO ] [MAIN ] Derivative Progress: 691/2052 symbols. FTHY took 0.4s. Estimated remaining time: 8m 57s [2025-10-22T23:31:20.856925] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:20.911578] [DEBUG] [LOCAL ] FTI: Loaded 53293 existing records from primary storage. [2025-10-22T23:31:20.911783] [INFO ] [MAIN ] FTI: Loaded 53293 primary data records. [2025-10-22T23:31:21.243993] [DEBUG] [MAIN ] FTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:21.269210] [INFO ] [MAIN ] FTI: Generated 138 derivative records from 53293 primary records. [2025-10-22T23:31:21.269361] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-22T23:31:21.281072] [DEBUG] [LOCAL ] FTI: Derivative data saved (138 records). [2025-10-22T23:31:21.281161] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-22T23:31:21.284411] [INFO ] [MAIN ] Derivative Progress: 692/2052 symbols. FTI took 0.4s. Estimated remaining time: 8m 56s [2025-10-22T23:31:21.284524] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:21.317616] [DEBUG] [LOCAL ] FTK: Loaded 32937 existing records from primary storage. [2025-10-22T23:31:21.317807] [INFO ] [MAIN ] FTK: Loaded 32937 primary data records. [2025-10-22T23:31:21.621242] [DEBUG] [MAIN ] FTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:21.647170] [INFO ] [MAIN ] FTK: Generated 138 derivative records from 32937 primary records. [2025-10-22T23:31:21.647362] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-22T23:31:21.659037] [DEBUG] [LOCAL ] FTK: Derivative data saved (138 records). [2025-10-22T23:31:21.659152] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-22T23:31:21.662033] [INFO ] [MAIN ] Derivative Progress: 693/2052 symbols. FTK took 0.4s. Estimated remaining time: 8m 56s [2025-10-22T23:31:21.662136] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:21.702468] [DEBUG] [LOCAL ] FTS: Loaded 42482 existing records from primary storage. [2025-10-22T23:31:21.702631] [INFO ] [MAIN ] FTS: Loaded 42482 primary data records. [2025-10-22T23:31:22.009245] [DEBUG] [MAIN ] FTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:22.034320] [INFO ] [MAIN ] FTS: Generated 138 derivative records from 42482 primary records. [2025-10-22T23:31:22.034466] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-22T23:31:22.045823] [DEBUG] [LOCAL ] FTS: Derivative data saved (138 records). [2025-10-22T23:31:22.045902] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-22T23:31:22.049006] [INFO ] [MAIN ] Derivative Progress: 694/2052 symbols. FTS took 0.4s. Estimated remaining time: 8m 55s [2025-10-22T23:31:22.049106] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:22.099494] [DEBUG] [LOCAL ] FTV: Loaded 53022 existing records from primary storage. [2025-10-22T23:31:22.099702] [INFO ] [MAIN ] FTV: Loaded 53022 primary data records. [2025-10-22T23:31:22.449886] [DEBUG] [MAIN ] FTV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:22.477793] [INFO ] [MAIN ] FTV: Generated 138 derivative records from 53022 primary records. [2025-10-22T23:31:22.478173] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-22T23:31:22.490744] [DEBUG] [LOCAL ] FTV: Derivative data saved (138 records). [2025-10-22T23:31:22.490881] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-22T23:31:22.494441] [INFO ] [MAIN ] Derivative Progress: 695/2052 symbols. FTV took 0.4s. Estimated remaining time: 8m 55s [2025-10-22T23:31:22.494554] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:22.499728] [DEBUG] [LOCAL ] FTWO: Loaded 1949 existing records from primary storage. [2025-10-22T23:31:22.499844] [INFO ] [MAIN ] FTWO: Loaded 1949 primary data records. [2025-10-22T23:31:22.816942] [DEBUG] [MAIN ] FTWO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:31:22.842164] [INFO ] [MAIN ] FTWO: Generated 138 derivative records from 1949 primary records. [2025-10-22T23:31:22.842296] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-22T23:31:22.852263] [DEBUG] [LOCAL ] FTWO: Derivative data saved (138 records). [2025-10-22T23:31:22.852343] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-22T23:31:22.854437] [INFO ] [MAIN ] Derivative Progress: 696/2052 symbols. FTWO took 0.4s. Estimated remaining time: 8m 55s [2025-10-22T23:31:22.854536] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:22.906943] [DEBUG] [LOCAL ] FUBO: Loaded 53718 existing records from primary storage. [2025-10-22T23:31:22.907110] [INFO ] [MAIN ] FUBO: Loaded 53718 primary data records. [2025-10-22T23:31:23.219497] [DEBUG] [MAIN ] FUBO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:23.245610] [INFO ] [MAIN ] FUBO: Generated 138 derivative records from 53718 primary records. [2025-10-22T23:31:23.245822] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-22T23:31:23.257458] [DEBUG] [LOCAL ] FUBO: Derivative data saved (138 records). [2025-10-22T23:31:23.257610] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-22T23:31:23.260807] [INFO ] [MAIN ] Derivative Progress: 697/2052 symbols. FUBO took 0.4s. Estimated remaining time: 8m 54s [2025-10-22T23:31:23.260965] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:23.295153] [DEBUG] [LOCAL ] FUL: Loaded 31986 existing records from primary storage. [2025-10-22T23:31:23.295323] [INFO ] [MAIN ] FUL: Loaded 31986 primary data records. [2025-10-22T23:31:23.601570] [DEBUG] [MAIN ] FUL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:23.628309] [INFO ] [MAIN ] FUL: Generated 138 derivative records from 31986 primary records. [2025-10-22T23:31:23.628503] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-22T23:31:23.640287] [DEBUG] [LOCAL ] FUL: Derivative data saved (138 records). [2025-10-22T23:31:23.640434] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-22T23:31:23.643367] [INFO ] [MAIN ] Derivative Progress: 698/2052 symbols. FUL took 0.4s. Estimated remaining time: 8m 54s [2025-10-22T23:31:23.643518] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:23.693684] [DEBUG] [LOCAL ] FUN: Loaded 52023 existing records from primary storage. [2025-10-22T23:31:23.693849] [INFO ] [MAIN ] FUN: Loaded 52023 primary data records. [2025-10-22T23:31:24.023333] [DEBUG] [MAIN ] FUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:24.051346] [INFO ] [MAIN ] FUN: Generated 138 derivative records from 52023 primary records. [2025-10-22T23:31:24.051561] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-22T23:31:24.063764] [DEBUG] [LOCAL ] FUN: Derivative data saved (138 records). [2025-10-22T23:31:24.063935] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-22T23:31:24.067525] [INFO ] [MAIN ] Derivative Progress: 699/2052 symbols. FUN took 0.4s. Estimated remaining time: 8m 54s [2025-10-22T23:31:24.067719] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:24.095188] [DEBUG] [LOCAL ] FVR: Loaded 20820 existing records from primary storage. [2025-10-22T23:31:24.095396] [INFO ] [MAIN ] FVR: Loaded 20820 primary data records. [2025-10-22T23:31:24.516492] [DEBUG] [MAIN ] FVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:24.542192] [INFO ] [MAIN ] FVR: Generated 138 derivative records from 20820 primary records. [2025-10-22T23:31:24.542392] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-22T23:31:24.554130] [DEBUG] [LOCAL ] FVR: Derivative data saved (138 records). [2025-10-22T23:31:24.554224] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-10-22T23:31:24.557169] [INFO ] [MAIN ] Derivative Progress: 700/2052 symbols. FVR took 0.5s. Estimated remaining time: 8m 53s [2025-10-22T23:31:24.557314] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:24.595850] [DEBUG] [LOCAL ] FVRR: Loaded 40496 existing records from primary storage. [2025-10-22T23:31:24.596012] [INFO ] [MAIN ] FVRR: Loaded 40496 primary data records. [2025-10-22T23:31:24.933175] [DEBUG] [MAIN ] FVRR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:24.958833] [INFO ] [MAIN ] FVRR: Generated 138 derivative records from 40496 primary records. [2025-10-22T23:31:24.959040] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-22T23:31:24.971114] [DEBUG] [LOCAL ] FVRR: Derivative data saved (138 records). [2025-10-22T23:31:24.971238] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-22T23:31:24.974213] [INFO ] [MAIN ] Derivative Progress: 701/2052 symbols. FVRR took 0.4s. Estimated remaining time: 8m 53s [2025-10-22T23:31:24.974330] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:24.978150] [DEBUG] [LOCAL ] FXED: Loaded 1227 existing records from primary storage. [2025-10-22T23:31:24.978266] [INFO ] [MAIN ] FXED: Loaded 1227 primary data records. [2025-10-22T23:31:25.290012] [DEBUG] [MAIN ] FXED: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:31:25.315277] [INFO ] [MAIN ] FXED: Generated 138 derivative records from 1227 primary records. [2025-10-22T23:31:25.315392] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-22T23:31:25.325110] [DEBUG] [LOCAL ] FXED: Derivative data saved (138 records). [2025-10-22T23:31:25.325192] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-22T23:31:25.327700] [INFO ] [MAIN ] Derivative Progress: 702/2052 symbols. FXED took 0.4s. Estimated remaining time: 8m 53s [2025-10-22T23:31:25.327802] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:25.373382] [DEBUG] [LOCAL ] G: Loaded 50090 existing records from primary storage. [2025-10-22T23:31:25.373552] [INFO ] [MAIN ] G: Loaded 50090 primary data records. [2025-10-22T23:31:25.679169] [DEBUG] [MAIN ] G: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:25.704364] [INFO ] [MAIN ] G: Generated 138 derivative records from 50090 primary records. [2025-10-22T23:31:25.704489] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-22T23:31:25.715997] [DEBUG] [LOCAL ] G: Derivative data saved (138 records). [2025-10-22T23:31:25.716080] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-22T23:31:25.719142] [INFO ] [MAIN ] Derivative Progress: 703/2052 symbols. G took 0.4s. Estimated remaining time: 8m 52s [2025-10-22T23:31:25.719240] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:25.746160] [DEBUG] [LOCAL ] GAB: Loaded 27447 existing records from primary storage. [2025-10-22T23:31:25.746320] [INFO ] [MAIN ] GAB: Loaded 27447 primary data records. [2025-10-22T23:31:26.054229] [DEBUG] [MAIN ] GAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:26.080460] [INFO ] [MAIN ] GAB: Generated 138 derivative records from 27447 primary records. [2025-10-22T23:31:26.080599] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-22T23:31:26.091925] [DEBUG] [LOCAL ] GAB: Derivative data saved (138 records). [2025-10-22T23:31:26.092013] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-22T23:31:26.094964] [INFO ] [MAIN ] Derivative Progress: 704/2052 symbols. GAB took 0.4s. Estimated remaining time: 8m 52s [2025-10-22T23:31:26.095066] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:26.103089] [DEBUG] [LOCAL ] GAM: Loaded 3825 existing records from primary storage. [2025-10-22T23:31:26.103203] [INFO ] [MAIN ] GAM: Loaded 3825 primary data records. [2025-10-22T23:31:26.477390] [DEBUG] [MAIN ] GAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:26.504081] [INFO ] [MAIN ] GAM: Generated 138 derivative records from 3825 primary records. [2025-10-22T23:31:26.504240] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-22T23:31:26.514164] [DEBUG] [LOCAL ] GAM: Derivative data saved (138 records). [2025-10-22T23:31:26.514253] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-22T23:31:26.516437] [INFO ] [MAIN ] Derivative Progress: 705/2052 symbols. GAM took 0.4s. Estimated remaining time: 8m 51s [2025-10-22T23:31:26.516541] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:26.569096] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-22T23:31:26.569259] [INFO ] [MAIN ] GAP: Loaded 53653 primary data records. [2025-10-22T23:31:26.932935] [DEBUG] [MAIN ] GAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:26.958899] [INFO ] [MAIN ] GAP: Generated 138 derivative records from 53653 primary records. [2025-10-22T23:31:26.959092] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-22T23:31:26.971451] [DEBUG] [LOCAL ] GAP: Derivative data saved (138 records). [2025-10-22T23:31:26.971577] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-22T23:31:26.975473] [INFO ] [MAIN ] Derivative Progress: 706/2052 symbols. GAP took 0.5s. Estimated remaining time: 8m 51s [2025-10-22T23:31:26.975621] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:26.998386] [DEBUG] [LOCAL ] GATX: Loaded 18061 existing records from primary storage. [2025-10-22T23:31:26.998554] [INFO ] [MAIN ] GATX: Loaded 18061 primary data records. [2025-10-22T23:31:27.320736] [DEBUG] [MAIN ] GATX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:27.346536] [INFO ] [MAIN ] GATX: Generated 138 derivative records from 18061 primary records. [2025-10-22T23:31:27.346828] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-22T23:31:27.358865] [DEBUG] [LOCAL ] GATX: Derivative data saved (138 records). [2025-10-22T23:31:27.359017] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-22T23:31:27.361798] [INFO ] [MAIN ] Derivative Progress: 707/2052 symbols. GATX took 0.4s. Estimated remaining time: 8m 51s [2025-10-22T23:31:27.361901] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:27.378342] [DEBUG] [LOCAL ] GBAB: Loaded 12735 existing records from primary storage. [2025-10-22T23:31:27.378489] [INFO ] [MAIN ] GBAB: Loaded 12735 primary data records. [2025-10-22T23:31:27.692980] [DEBUG] [MAIN ] GBAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:27.720324] [INFO ] [MAIN ] GBAB: Generated 138 derivative records from 12735 primary records. [2025-10-22T23:31:27.720486] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-22T23:31:27.732037] [DEBUG] [LOCAL ] GBAB: Derivative data saved (138 records). [2025-10-22T23:31:27.732140] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-10-22T23:31:27.734965] [INFO ] [MAIN ] Derivative Progress: 708/2052 symbols. GBAB took 0.4s. Estimated remaining time: 8m 50s [2025-10-22T23:31:27.735084] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:27.773290] [DEBUG] [LOCAL ] GBCI: Loaded 41187 existing records from primary storage. [2025-10-22T23:31:27.773449] [INFO ] [MAIN ] GBCI: Loaded 41187 primary data records. [2025-10-22T23:31:28.080536] [DEBUG] [MAIN ] GBCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:28.105492] [INFO ] [MAIN ] GBCI: Generated 138 derivative records from 41187 primary records. [2025-10-22T23:31:28.105677] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-22T23:31:28.116951] [DEBUG] [LOCAL ] GBCI: Derivative data saved (138 records). [2025-10-22T23:31:28.117034] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-22T23:31:28.120036] [INFO ] [MAIN ] Derivative Progress: 709/2052 symbols. GBCI took 0.4s. Estimated remaining time: 8m 50s [2025-10-22T23:31:28.120136] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:28.156759] [DEBUG] [LOCAL ] GBTG: Loaded 40227 existing records from primary storage. [2025-10-22T23:31:28.156928] [INFO ] [MAIN ] GBTG: Loaded 40227 primary data records. [2025-10-22T23:31:28.462121] [DEBUG] [MAIN ] GBTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:28.487145] [INFO ] [MAIN ] GBTG: Generated 138 derivative records from 40227 primary records. [2025-10-22T23:31:28.487354] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-22T23:31:28.498441] [DEBUG] [LOCAL ] GBTG: Derivative data saved (138 records). [2025-10-22T23:31:28.498527] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-22T23:31:28.501545] [INFO ] [MAIN ] Derivative Progress: 710/2052 symbols. GBTG took 0.4s. Estimated remaining time: 8m 49s [2025-10-22T23:31:28.501672] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:28.529424] [DEBUG] [LOCAL ] GBX: Loaded 28211 existing records from primary storage. [2025-10-22T23:31:28.529595] [INFO ] [MAIN ] GBX: Loaded 28211 primary data records. [2025-10-22T23:31:28.881603] [DEBUG] [MAIN ] GBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:28.909906] [INFO ] [MAIN ] GBX: Generated 138 derivative records from 28211 primary records. [2025-10-22T23:31:28.910315] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-22T23:31:28.922839] [DEBUG] [LOCAL ] GBX: Derivative data saved (138 records). [2025-10-22T23:31:28.922998] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-22T23:31:28.926821] [INFO ] [MAIN ] Derivative Progress: 711/2052 symbols. GBX took 0.4s. Estimated remaining time: 8m 49s [2025-10-22T23:31:28.927009] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:28.969853] [DEBUG] [LOCAL ] GCI: Loaded 43579 existing records from primary storage. [2025-10-22T23:31:28.970028] [INFO ] [MAIN ] GCI: Loaded 43579 primary data records. [2025-10-22T23:31:29.288859] [DEBUG] [MAIN ] GCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:29.316235] [INFO ] [MAIN ] GCI: Generated 138 derivative records from 43579 primary records. [2025-10-22T23:31:29.316436] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-22T23:31:29.328056] [DEBUG] [LOCAL ] GCI: Derivative data saved (138 records). [2025-10-22T23:31:29.328207] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-22T23:31:29.331236] [INFO ] [MAIN ] Derivative Progress: 712/2052 symbols. GCI took 0.4s. Estimated remaining time: 8m 49s [2025-10-22T23:31:29.331368] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:29.355810] [DEBUG] [LOCAL ] GCO: Loaded 22815 existing records from primary storage. [2025-10-22T23:31:29.355971] [INFO ] [MAIN ] GCO: Loaded 22815 primary data records. [2025-10-22T23:31:29.674875] [DEBUG] [MAIN ] GCO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:31:29.701744] [INFO ] [MAIN ] GCO: Generated 138 derivative records from 22815 primary records. [2025-10-22T23:31:29.701905] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-10-22T23:31:29.713439] [DEBUG] [LOCAL ] GCO: Derivative data saved (138 records). [2025-10-22T23:31:29.713564] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-10-22T23:31:29.716761] [INFO ] [MAIN ] Derivative Progress: 713/2052 symbols. GCO took 0.4s. Estimated remaining time: 8m 48s [2025-10-22T23:31:29.716858] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:29.739864] [DEBUG] [LOCAL ] GCTS: Loaded 20286 existing records from primary storage. [2025-10-22T23:31:29.740034] [INFO ] [MAIN ] GCTS: Loaded 20286 primary data records. [2025-10-22T23:31:30.054230] [DEBUG] [MAIN ] GCTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:30.079121] [INFO ] [MAIN ] GCTS: Generated 138 derivative records from 20286 primary records. [2025-10-22T23:31:30.079233] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-22T23:31:30.090300] [DEBUG] [LOCAL ] GCTS: Derivative data saved (138 records). [2025-10-22T23:31:30.090381] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-22T23:31:30.093290] [INFO ] [MAIN ] Derivative Progress: 714/2052 symbols. GCTS took 0.4s. Estimated remaining time: 8m 48s [2025-10-22T23:31:30.093391] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:30.104018] [DEBUG] [LOCAL ] GCV: Loaded 7752 existing records from primary storage. [2025-10-22T23:31:30.104156] [INFO ] [MAIN ] GCV: Loaded 7752 primary data records. [2025-10-22T23:31:30.410625] [DEBUG] [MAIN ] GCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:30.437127] [INFO ] [MAIN ] GCV: Generated 138 derivative records from 7752 primary records. [2025-10-22T23:31:30.437344] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-22T23:31:30.448530] [DEBUG] [LOCAL ] GCV: Derivative data saved (138 records). [2025-10-22T23:31:30.448624] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-10-22T23:31:30.451024] [INFO ] [MAIN ] Derivative Progress: 715/2052 symbols. GCV took 0.4s. Estimated remaining time: 8m 47s [2025-10-22T23:31:30.451146] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:30.495164] [DEBUG] [LOCAL ] GD: Loaded 46474 existing records from primary storage. [2025-10-22T23:31:30.495341] [INFO ] [MAIN ] GD: Loaded 46474 primary data records. [2025-10-22T23:31:30.810537] [DEBUG] [MAIN ] GD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:30.835852] [INFO ] [MAIN ] GD: Generated 138 derivative records from 46474 primary records. [2025-10-22T23:31:30.835982] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-22T23:31:30.847765] [DEBUG] [LOCAL ] GD: Derivative data saved (138 records). [2025-10-22T23:31:30.847851] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-22T23:31:30.850842] [INFO ] [MAIN ] Derivative Progress: 716/2052 symbols. GD took 0.4s. Estimated remaining time: 8m 47s [2025-10-22T23:31:30.850952] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:30.898448] [DEBUG] [LOCAL ] GDDY: Loaded 49624 existing records from primary storage. [2025-10-22T23:31:30.898613] [INFO ] [MAIN ] GDDY: Loaded 49624 primary data records. [2025-10-22T23:31:31.228460] [DEBUG] [MAIN ] GDDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:31.253340] [INFO ] [MAIN ] GDDY: Generated 138 derivative records from 49624 primary records. [2025-10-22T23:31:31.253481] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-22T23:31:31.265192] [DEBUG] [LOCAL ] GDDY: Derivative data saved (138 records). [2025-10-22T23:31:31.265289] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-22T23:31:31.268414] [INFO ] [MAIN ] Derivative Progress: 717/2052 symbols. GDDY took 0.4s. Estimated remaining time: 8m 47s [2025-10-22T23:31:31.268529] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:31.281719] [DEBUG] [LOCAL ] GDIV: Loaded 3507 existing records from primary storage. [2025-10-22T23:31:31.281861] [INFO ] [MAIN ] GDIV: Loaded 3507 primary data records. [2025-10-22T23:31:31.598060] [DEBUG] [MAIN ] GDIV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:31:31.623587] [INFO ] [MAIN ] GDIV: Generated 138 derivative records from 3507 primary records. [2025-10-22T23:31:31.623732] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-22T23:31:31.634178] [DEBUG] [LOCAL ] GDIV: Derivative data saved (138 records). [2025-10-22T23:31:31.634261] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-10-22T23:31:31.636550] [INFO ] [MAIN ] Derivative Progress: 718/2052 symbols. GDIV took 0.4s. Estimated remaining time: 8m 46s [2025-10-22T23:31:31.636662] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:31.641415] [DEBUG] [LOCAL ] GDL: Loaded 2510 existing records from primary storage. [2025-10-22T23:31:31.641508] [INFO ] [MAIN ] GDL: Loaded 2510 primary data records. [2025-10-22T23:31:31.959403] [DEBUG] [MAIN ] GDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:31.984678] [INFO ] [MAIN ] GDL: Generated 138 derivative records from 2510 primary records. [2025-10-22T23:31:31.984820] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-22T23:31:31.993698] [DEBUG] [LOCAL ] GDL: Derivative data saved (138 records). [2025-10-22T23:31:31.993782] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-22T23:31:31.996082] [INFO ] [MAIN ] Derivative Progress: 719/2052 symbols. GDL took 0.4s. Estimated remaining time: 8m 46s [2025-10-22T23:31:31.996182] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:32.004794] [DEBUG] [LOCAL ] GDO: Loaded 5852 existing records from primary storage. [2025-10-22T23:31:32.004925] [INFO ] [MAIN ] GDO: Loaded 5852 primary data records. [2025-10-22T23:31:32.307609] [DEBUG] [MAIN ] GDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:32.335723] [INFO ] [MAIN ] GDO: Generated 138 derivative records from 5852 primary records. [2025-10-22T23:31:32.335926] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-22T23:31:32.346717] [DEBUG] [LOCAL ] GDO: Derivative data saved (138 records). [2025-10-22T23:31:32.346810] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-22T23:31:32.349191] [INFO ] [MAIN ] Derivative Progress: 720/2052 symbols. GDO took 0.4s. Estimated remaining time: 8m 45s [2025-10-22T23:31:32.349301] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:32.388121] [DEBUG] [LOCAL ] GDOT: Loaded 37641 existing records from primary storage. [2025-10-22T23:31:32.388292] [INFO ] [MAIN ] GDOT: Loaded 37641 primary data records. [2025-10-22T23:31:32.711599] [DEBUG] [MAIN ] GDOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:32.737743] [INFO ] [MAIN ] GDOT: Generated 138 derivative records from 37641 primary records. [2025-10-22T23:31:32.737922] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-22T23:31:32.749487] [DEBUG] [LOCAL ] GDOT: Derivative data saved (138 records). [2025-10-22T23:31:32.749573] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-22T23:31:32.752962] [INFO ] [MAIN ] Derivative Progress: 721/2052 symbols. GDOT took 0.4s. Estimated remaining time: 8m 45s [2025-10-22T23:31:32.753070] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:32.774776] [DEBUG] [LOCAL ] GDV: Loaded 19143 existing records from primary storage. [2025-10-22T23:31:32.774951] [INFO ] [MAIN ] GDV: Loaded 19143 primary data records. [2025-10-22T23:31:33.118707] [DEBUG] [MAIN ] GDV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:33.145075] [INFO ] [MAIN ] GDV: Generated 138 derivative records from 19143 primary records. [2025-10-22T23:31:33.145243] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-22T23:31:33.156896] [DEBUG] [LOCAL ] GDV: Derivative data saved (138 records). [2025-10-22T23:31:33.156992] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-22T23:31:33.159891] [INFO ] [MAIN ] Derivative Progress: 722/2052 symbols. GDV took 0.4s. Estimated remaining time: 8m 45s [2025-10-22T23:31:33.159991] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:33.213450] [DEBUG] [LOCAL ] GE: Loaded 53697 existing records from primary storage. [2025-10-22T23:31:33.213689] [INFO ] [MAIN ] GE: Loaded 53697 primary data records. [2025-10-22T23:31:33.528510] [DEBUG] [MAIN ] GE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:33.553424] [INFO ] [MAIN ] GE: Generated 138 derivative records from 53697 primary records. [2025-10-22T23:31:33.553554] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-22T23:31:33.565371] [DEBUG] [LOCAL ] GE: Derivative data saved (138 records). [2025-10-22T23:31:33.565464] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-22T23:31:33.568540] [INFO ] [MAIN ] Derivative Progress: 723/2052 symbols. GE took 0.4s. Estimated remaining time: 8m 44s [2025-10-22T23:31:33.568636] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:33.589891] [DEBUG] [LOCAL ] GEF: Loaded 20692 existing records from primary storage. [2025-10-22T23:31:33.590021] [INFO ] [MAIN ] GEF: Loaded 20692 primary data records. [2025-10-22T23:31:33.895821] [DEBUG] [MAIN ] GEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:33.921915] [INFO ] [MAIN ] GEF: Generated 138 derivative records from 20692 primary records. [2025-10-22T23:31:33.922100] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-22T23:31:33.933491] [DEBUG] [LOCAL ] GEF: Derivative data saved (138 records). [2025-10-22T23:31:33.933607] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-22T23:31:33.936391] [INFO ] [MAIN ] Derivative Progress: 724/2052 symbols. GEF took 0.4s. Estimated remaining time: 8m 44s [2025-10-22T23:31:33.936488] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:33.968055] [DEBUG] [LOCAL ] GEL: Loaded 31221 existing records from primary storage. [2025-10-22T23:31:33.968217] [INFO ] [MAIN ] GEL: Loaded 31221 primary data records. [2025-10-22T23:31:34.276377] [DEBUG] [MAIN ] GEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:34.301605] [INFO ] [MAIN ] GEL: Generated 138 derivative records from 31221 primary records. [2025-10-22T23:31:34.301784] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-10-22T23:31:34.313180] [DEBUG] [LOCAL ] GEL: Derivative data saved (138 records). [2025-10-22T23:31:34.313260] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-10-22T23:31:34.316117] [INFO ] [MAIN ] Derivative Progress: 725/2052 symbols. GEL took 0.4s. Estimated remaining time: 8m 43s [2025-10-22T23:31:34.316215] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:34.367762] [DEBUG] [LOCAL ] GENI: Loaded 52937 existing records from primary storage. [2025-10-22T23:31:34.367926] [INFO ] [MAIN ] GENI: Loaded 52937 primary data records. [2025-10-22T23:31:34.672727] [DEBUG] [MAIN ] GENI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:34.697926] [INFO ] [MAIN ] GENI: Generated 138 derivative records from 52937 primary records. [2025-10-22T23:31:34.698058] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-22T23:31:34.709739] [DEBUG] [LOCAL ] GENI: Derivative data saved (138 records). [2025-10-22T23:31:34.709827] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-22T23:31:34.713061] [INFO ] [MAIN ] Derivative Progress: 726/2052 symbols. GENI took 0.4s. Estimated remaining time: 8m 43s [2025-10-22T23:31:34.713162] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:34.762215] [DEBUG] [LOCAL ] GEO: Loaded 51707 existing records from primary storage. [2025-10-22T23:31:34.762383] [INFO ] [MAIN ] GEO: Loaded 51707 primary data records. [2025-10-22T23:31:35.104351] [DEBUG] [MAIN ] GEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:35.132403] [INFO ] [MAIN ] GEO: Generated 138 derivative records from 51707 primary records. [2025-10-22T23:31:35.132583] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-22T23:31:35.145748] [DEBUG] [LOCAL ] GEO: Derivative data saved (138 records). [2025-10-22T23:31:35.145835] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-22T23:31:35.149141] [INFO ] [MAIN ] Derivative Progress: 727/2052 symbols. GEO took 0.4s. Estimated remaining time: 8m 43s [2025-10-22T23:31:35.149246] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:35.188165] [DEBUG] [LOCAL ] GES: Loaded 37820 existing records from primary storage. [2025-10-22T23:31:35.188334] [INFO ] [MAIN ] GES: Loaded 37820 primary data records. [2025-10-22T23:31:35.527885] [DEBUG] [MAIN ] GES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:35.553251] [INFO ] [MAIN ] GES: Generated 138 derivative records from 37820 primary records. [2025-10-22T23:31:35.553399] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-22T23:31:35.565466] [DEBUG] [LOCAL ] GES: Derivative data saved (138 records). [2025-10-22T23:31:35.565546] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-22T23:31:35.568458] [INFO ] [MAIN ] Derivative Progress: 728/2052 symbols. GES took 0.4s. Estimated remaining time: 8m 42s [2025-10-22T23:31:35.568561] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:35.602811] [DEBUG] [LOCAL ] GETY: Loaded 35237 existing records from primary storage. [2025-10-22T23:31:35.602965] [INFO ] [MAIN ] GETY: Loaded 35237 primary data records. [2025-10-22T23:31:35.921989] [DEBUG] [MAIN ] GETY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:35.947803] [INFO ] [MAIN ] GETY: Generated 138 derivative records from 35237 primary records. [2025-10-22T23:31:35.947949] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-22T23:31:35.959228] [DEBUG] [LOCAL ] GETY: Derivative data saved (138 records). [2025-10-22T23:31:35.959311] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-22T23:31:35.962192] [INFO ] [MAIN ] Derivative Progress: 729/2052 symbols. GETY took 0.4s. Estimated remaining time: 8m 42s [2025-10-22T23:31:35.962297] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:36.015273] [DEBUG] [LOCAL ] GEV: Loaded 52992 existing records from primary storage. [2025-10-22T23:31:36.015439] [INFO ] [MAIN ] GEV: Loaded 52992 primary data records. [2025-10-22T23:31:36.337007] [DEBUG] [MAIN ] GEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:36.362742] [INFO ] [MAIN ] GEV: Generated 138 derivative records from 52992 primary records. [2025-10-22T23:31:36.362853] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-22T23:31:36.374438] [DEBUG] [LOCAL ] GEV: Derivative data saved (138 records). [2025-10-22T23:31:36.374516] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-22T23:31:36.377616] [INFO ] [MAIN ] Derivative Progress: 730/2052 symbols. GEV took 0.4s. Estimated remaining time: 8m 42s [2025-10-22T23:31:36.377748] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:36.383044] [DEBUG] [LOCAL ] GF: Loaded 2623 existing records from primary storage. [2025-10-22T23:31:36.383131] [INFO ] [MAIN ] GF: Loaded 2623 primary data records. [2025-10-22T23:31:36.687128] [DEBUG] [MAIN ] GF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:36.713317] [INFO ] [MAIN ] GF: Generated 138 derivative records from 2623 primary records. [2025-10-22T23:31:36.713432] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-22T23:31:36.722892] [DEBUG] [LOCAL ] GF: Derivative data saved (138 records). [2025-10-22T23:31:36.722973] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-10-22T23:31:36.725045] [INFO ] [MAIN ] Derivative Progress: 731/2052 symbols. GF took 0.3s. Estimated remaining time: 8m 41s [2025-10-22T23:31:36.725141] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:36.754900] [DEBUG] [LOCAL ] GFF: Loaded 29398 existing records from primary storage. [2025-10-22T23:31:36.755053] [INFO ] [MAIN ] GFF: Loaded 29398 primary data records. [2025-10-22T23:31:37.090984] [DEBUG] [MAIN ] GFF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:37.116994] [INFO ] [MAIN ] GFF: Generated 138 derivative records from 29398 primary records. [2025-10-22T23:31:37.117189] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-22T23:31:37.128798] [DEBUG] [LOCAL ] GFF: Derivative data saved (138 records). [2025-10-22T23:31:37.128898] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-22T23:31:37.131838] [INFO ] [MAIN ] Derivative Progress: 732/2052 symbols. GFF took 0.4s. Estimated remaining time: 8m 41s [2025-10-22T23:31:37.131937] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:37.183394] [DEBUG] [LOCAL ] GFI: Loaded 53116 existing records from primary storage. [2025-10-22T23:31:37.183559] [INFO ] [MAIN ] GFI: Loaded 53116 primary data records. [2025-10-22T23:31:37.493478] [DEBUG] [MAIN ] GFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:37.518935] [INFO ] [MAIN ] GFI: Generated 138 derivative records from 53116 primary records. [2025-10-22T23:31:37.519124] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-22T23:31:37.530998] [DEBUG] [LOCAL ] GFI: Derivative data saved (138 records). [2025-10-22T23:31:37.531096] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-22T23:31:37.534206] [INFO ] [MAIN ] Derivative Progress: 733/2052 symbols. GFI took 0.4s. Estimated remaining time: 8m 40s [2025-10-22T23:31:37.534339] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:37.579792] [DEBUG] [LOCAL ] GFL: Loaded 47496 existing records from primary storage. [2025-10-22T23:31:37.579964] [INFO ] [MAIN ] GFL: Loaded 47496 primary data records. [2025-10-22T23:31:37.888136] [DEBUG] [MAIN ] GFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:37.913166] [INFO ] [MAIN ] GFL: Generated 138 derivative records from 47496 primary records. [2025-10-22T23:31:37.913331] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-22T23:31:37.924772] [DEBUG] [LOCAL ] GFL: Derivative data saved (138 records). [2025-10-22T23:31:37.924860] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-22T23:31:37.927632] [INFO ] [MAIN ] Derivative Progress: 734/2052 symbols. GFL took 0.4s. Estimated remaining time: 8m 40s [2025-10-22T23:31:37.927779] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:37.937952] [DEBUG] [LOCAL ] GFR: Loaded 7332 existing records from primary storage. [2025-10-22T23:31:37.938096] [INFO ] [MAIN ] GFR: Loaded 7332 primary data records. [2025-10-22T23:31:38.237524] [DEBUG] [MAIN ] GFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:38.262492] [INFO ] [MAIN ] GFR: Generated 138 derivative records from 7332 primary records. [2025-10-22T23:31:38.262675] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-22T23:31:38.272802] [DEBUG] [LOCAL ] GFR: Derivative data saved (138 records). [2025-10-22T23:31:38.272884] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-10-22T23:31:38.274883] [INFO ] [MAIN ] Derivative Progress: 735/2052 symbols. GFR took 0.3s. Estimated remaining time: 8m 39s [2025-10-22T23:31:38.274984] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:38.313482] [DEBUG] [LOCAL ] GGG: Loaded 40560 existing records from primary storage. [2025-10-22T23:31:38.313680] [INFO ] [MAIN ] GGG: Loaded 40560 primary data records. [2025-10-22T23:31:38.614824] [DEBUG] [MAIN ] GGG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:38.639837] [INFO ] [MAIN ] GGG: Generated 138 derivative records from 40560 primary records. [2025-10-22T23:31:38.639949] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-22T23:31:38.651343] [DEBUG] [LOCAL ] GGG: Derivative data saved (138 records). [2025-10-22T23:31:38.651423] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-22T23:31:38.654347] [INFO ] [MAIN ] Derivative Progress: 736/2052 symbols. GGG took 0.4s. Estimated remaining time: 8m 39s [2025-10-22T23:31:38.654455] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:38.671513] [DEBUG] [LOCAL ] GGT: Loaded 14455 existing records from primary storage. [2025-10-22T23:31:38.671688] [INFO ] [MAIN ] GGT: Loaded 14455 primary data records. [2025-10-22T23:31:38.973517] [DEBUG] [MAIN ] GGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:38.998271] [INFO ] [MAIN ] GGT: Generated 138 derivative records from 14455 primary records. [2025-10-22T23:31:38.998401] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-22T23:31:39.009779] [DEBUG] [LOCAL ] GGT: Derivative data saved (138 records). [2025-10-22T23:31:39.009869] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-10-22T23:31:39.011983] [INFO ] [MAIN ] Derivative Progress: 737/2052 symbols. GGT took 0.4s. Estimated remaining time: 8m 39s [2025-10-22T23:31:39.012077] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:39.017038] [DEBUG] [LOCAL ] GGZ: Loaded 2348 existing records from primary storage. [2025-10-22T23:31:39.017125] [INFO ] [MAIN ] GGZ: Loaded 2348 primary data records. [2025-10-22T23:31:39.339209] [DEBUG] [MAIN ] GGZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:39.364218] [INFO ] [MAIN ] GGZ: Generated 138 derivative records from 2348 primary records. [2025-10-22T23:31:39.364328] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-22T23:31:39.373689] [DEBUG] [LOCAL ] GGZ: Derivative data saved (138 records). [2025-10-22T23:31:39.373768] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-10-22T23:31:39.375896] [INFO ] [MAIN ] Derivative Progress: 738/2052 symbols. GGZ took 0.4s. Estimated remaining time: 8m 38s [2025-10-22T23:31:39.375996] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:39.380908] [DEBUG] [LOCAL ] GHC: Loaded 2954 existing records from primary storage. [2025-10-22T23:31:39.380996] [INFO ] [MAIN ] GHC: Loaded 2954 primary data records. [2025-10-22T23:31:39.691113] [DEBUG] [MAIN ] GHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:39.716443] [INFO ] [MAIN ] GHC: Generated 138 derivative records from 2954 primary records. [2025-10-22T23:31:39.716572] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-22T23:31:39.726742] [DEBUG] [LOCAL ] GHC: Derivative data saved (138 records). [2025-10-22T23:31:39.726824] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-10-22T23:31:39.729456] [INFO ] [MAIN ] Derivative Progress: 739/2052 symbols. GHC took 0.4s. Estimated remaining time: 8m 38s [2025-10-22T23:31:39.729561] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:39.735213] [DEBUG] [LOCAL ] GHG: Loaded 3269 existing records from primary storage. [2025-10-22T23:31:39.735314] [INFO ] [MAIN ] GHG: Loaded 3269 primary data records. [2025-10-22T23:31:40.042154] [DEBUG] [MAIN ] GHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:40.067014] [INFO ] [MAIN ] GHG: Generated 138 derivative records from 3269 primary records. [2025-10-22T23:31:40.067142] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-22T23:31:40.076462] [DEBUG] [LOCAL ] GHG: Derivative data saved (138 records). [2025-10-22T23:31:40.076554] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-22T23:31:40.078840] [INFO ] [MAIN ] Derivative Progress: 740/2052 symbols. GHG took 0.3s. Estimated remaining time: 8m 37s [2025-10-22T23:31:40.078941] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:40.089453] [DEBUG] [LOCAL ] GHI: Loaded 7763 existing records from primary storage. [2025-10-22T23:31:40.089586] [INFO ] [MAIN ] GHI: Loaded 7763 primary data records. [2025-10-22T23:31:40.393598] [DEBUG] [MAIN ] GHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:40.418431] [INFO ] [MAIN ] GHI: Generated 138 derivative records from 7763 primary records. [2025-10-22T23:31:40.418575] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-22T23:31:40.430080] [DEBUG] [LOCAL ] GHI: Derivative data saved (138 records). [2025-10-22T23:31:40.430162] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-22T23:31:40.432415] [INFO ] [MAIN ] Derivative Progress: 741/2052 symbols. GHI took 0.4s. Estimated remaining time: 8m 37s [2025-10-22T23:31:40.432513] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:40.441385] [DEBUG] [LOCAL ] GHLD: Loaded 4327 existing records from primary storage. [2025-10-22T23:31:40.441504] [INFO ] [MAIN ] GHLD: Loaded 4327 primary data records. [2025-10-22T23:31:40.742255] [DEBUG] [MAIN ] GHLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:40.767310] [INFO ] [MAIN ] GHLD: Generated 138 derivative records from 4327 primary records. [2025-10-22T23:31:40.767517] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-22T23:31:40.777220] [DEBUG] [LOCAL ] GHLD: Derivative data saved (138 records). [2025-10-22T23:31:40.777320] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-22T23:31:40.779665] [INFO ] [MAIN ] Derivative Progress: 742/2052 symbols. GHLD took 0.3s. Estimated remaining time: 8m 36s [2025-10-22T23:31:40.779761] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:40.795577] [DEBUG] [LOCAL ] GHM: Loaded 14307 existing records from primary storage. [2025-10-22T23:31:40.795751] [INFO ] [MAIN ] GHM: Loaded 14307 primary data records. [2025-10-22T23:31:41.140420] [DEBUG] [MAIN ] GHM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:41.169563] [INFO ] [MAIN ] GHM: Generated 138 derivative records from 14307 primary records. [2025-10-22T23:31:41.169752] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-22T23:31:41.181763] [DEBUG] [LOCAL ] GHM: Derivative data saved (138 records). [2025-10-22T23:31:41.181849] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-22T23:31:41.185262] [INFO ] [MAIN ] Derivative Progress: 743/2052 symbols. GHM took 0.4s. Estimated remaining time: 8m 36s [2025-10-22T23:31:41.185391] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:41.208741] [DEBUG] [LOCAL ] GHY: Loaded 20840 existing records from primary storage. [2025-10-22T23:31:41.208900] [INFO ] [MAIN ] GHY: Loaded 20840 primary data records. [2025-10-22T23:31:41.519229] [DEBUG] [MAIN ] GHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:41.544782] [INFO ] [MAIN ] GHY: Generated 138 derivative records from 20840 primary records. [2025-10-22T23:31:41.544936] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-22T23:31:41.556448] [DEBUG] [LOCAL ] GHY: Derivative data saved (138 records). [2025-10-22T23:31:41.556562] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-22T23:31:41.559600] [INFO ] [MAIN ] Derivative Progress: 744/2052 symbols. GHY took 0.4s. Estimated remaining time: 8m 35s [2025-10-22T23:31:41.559738] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:41.590375] [DEBUG] [LOCAL ] GIB: Loaded 31346 existing records from primary storage. [2025-10-22T23:31:41.590547] [INFO ] [MAIN ] GIB: Loaded 31346 primary data records. [2025-10-22T23:31:41.909959] [DEBUG] [MAIN ] GIB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:41.935262] [INFO ] [MAIN ] GIB: Generated 138 derivative records from 31346 primary records. [2025-10-22T23:31:41.935428] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-22T23:31:41.947110] [DEBUG] [LOCAL ] GIB: Derivative data saved (138 records). [2025-10-22T23:31:41.947193] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-22T23:31:41.950251] [INFO ] [MAIN ] Derivative Progress: 745/2052 symbols. GIB took 0.4s. Estimated remaining time: 8m 35s [2025-10-22T23:31:41.950352] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:41.966673] [DEBUG] [LOCAL ] GIC: Loaded 13184 existing records from primary storage. [2025-10-22T23:31:41.966822] [INFO ] [MAIN ] GIC: Loaded 13184 primary data records. [2025-10-22T23:31:42.280007] [DEBUG] [MAIN ] GIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:42.306112] [INFO ] [MAIN ] GIC: Generated 138 derivative records from 13184 primary records. [2025-10-22T23:31:42.306296] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-22T23:31:42.317482] [DEBUG] [LOCAL ] GIC: Derivative data saved (138 records). [2025-10-22T23:31:42.317575] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-22T23:31:42.320484] [INFO ] [MAIN ] Derivative Progress: 746/2052 symbols. GIC took 0.4s. Estimated remaining time: 8m 35s [2025-10-22T23:31:42.320587] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:42.361824] [DEBUG] [LOCAL ] GIL: Loaded 43951 existing records from primary storage. [2025-10-22T23:31:42.361973] [INFO ] [MAIN ] GIL: Loaded 43951 primary data records. [2025-10-22T23:31:42.672953] [DEBUG] [MAIN ] GIL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:42.698184] [INFO ] [MAIN ] GIL: Generated 138 derivative records from 43951 primary records. [2025-10-22T23:31:42.698353] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-22T23:31:42.709825] [DEBUG] [LOCAL ] GIL: Derivative data saved (138 records). [2025-10-22T23:31:42.709919] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-22T23:31:42.712748] [INFO ] [MAIN ] Derivative Progress: 747/2052 symbols. GIL took 0.4s. Estimated remaining time: 8m 34s [2025-10-22T23:31:42.712856] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:42.764871] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-10-22T23:31:42.765058] [INFO ] [MAIN ] GIS: Loaded 53675 primary data records. [2025-10-22T23:31:43.108005] [DEBUG] [MAIN ] GIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:43.133057] [INFO ] [MAIN ] GIS: Generated 138 derivative records from 53675 primary records. [2025-10-22T23:31:43.133170] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-22T23:31:43.144721] [DEBUG] [LOCAL ] GIS: Derivative data saved (138 records). [2025-10-22T23:31:43.144800] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-22T23:31:43.148201] [INFO ] [MAIN ] Derivative Progress: 748/2052 symbols. GIS took 0.4s. Estimated remaining time: 8m 34s [2025-10-22T23:31:43.148305] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:43.187465] [DEBUG] [LOCAL ] GKOS: Loaded 42465 existing records from primary storage. [2025-10-22T23:31:43.187628] [INFO ] [MAIN ] GKOS: Loaded 42465 primary data records. [2025-10-22T23:31:43.498349] [DEBUG] [MAIN ] GKOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:43.523961] [INFO ] [MAIN ] GKOS: Generated 138 derivative records from 42465 primary records. [2025-10-22T23:31:43.524097] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-22T23:31:43.535571] [DEBUG] [LOCAL ] GKOS: Derivative data saved (138 records). [2025-10-22T23:31:43.535677] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-22T23:31:43.538625] [INFO ] [MAIN ] Derivative Progress: 749/2052 symbols. GKOS took 0.4s. Estimated remaining time: 8m 33s [2025-10-22T23:31:43.538752] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:43.576690] [DEBUG] [LOCAL ] GL: Loaded 37380 existing records from primary storage. [2025-10-22T23:31:43.576849] [INFO ] [MAIN ] GL: Loaded 37380 primary data records. [2025-10-22T23:31:43.887593] [DEBUG] [MAIN ] GL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:43.913561] [INFO ] [MAIN ] GL: Generated 138 derivative records from 37380 primary records. [2025-10-22T23:31:43.913724] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-22T23:31:43.925373] [DEBUG] [LOCAL ] GL: Derivative data saved (138 records). [2025-10-22T23:31:43.925464] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-22T23:31:43.928593] [INFO ] [MAIN ] Derivative Progress: 750/2052 symbols. GL took 0.4s. Estimated remaining time: 8m 33s [2025-10-22T23:31:43.928727] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:43.975891] [DEBUG] [LOCAL ] GLOB: Loaded 48049 existing records from primary storage. [2025-10-22T23:31:43.976053] [INFO ] [MAIN ] GLOB: Loaded 48049 primary data records. [2025-10-22T23:31:44.286630] [DEBUG] [MAIN ] GLOB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:44.312510] [INFO ] [MAIN ] GLOB: Generated 138 derivative records from 48049 primary records. [2025-10-22T23:31:44.312683] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-10-22T23:31:44.324367] [DEBUG] [LOCAL ] GLOB: Derivative data saved (138 records). [2025-10-22T23:31:44.324450] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-10-22T23:31:44.327751] [INFO ] [MAIN ] Derivative Progress: 751/2052 symbols. GLOB took 0.4s. Estimated remaining time: 8m 33s [2025-10-22T23:31:44.327863] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:44.340450] [DEBUG] [LOCAL ] GLP: Loaded 9234 existing records from primary storage. [2025-10-22T23:31:44.340596] [INFO ] [MAIN ] GLP: Loaded 9234 primary data records. [2025-10-22T23:31:44.655815] [DEBUG] [MAIN ] GLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:44.680920] [INFO ] [MAIN ] GLP: Generated 138 derivative records from 9234 primary records. [2025-10-22T23:31:44.681031] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-22T23:31:44.695522] [DEBUG] [LOCAL ] GLP: Derivative data saved (138 records). [2025-10-22T23:31:44.695632] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-10-22T23:31:44.697988] [INFO ] [MAIN ] Derivative Progress: 752/2052 symbols. GLP took 0.4s. Estimated remaining time: 8m 32s [2025-10-22T23:31:44.698110] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:44.749309] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-10-22T23:31:44.749481] [INFO ] [MAIN ] GLW: Loaded 53635 primary data records. [2025-10-22T23:31:45.060299] [DEBUG] [MAIN ] GLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:45.085278] [INFO ] [MAIN ] GLW: Generated 138 derivative records from 53635 primary records. [2025-10-22T23:31:45.085402] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-22T23:31:45.096901] [DEBUG] [LOCAL ] GLW: Derivative data saved (138 records). [2025-10-22T23:31:45.096984] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-22T23:31:45.100324] [INFO ] [MAIN ] Derivative Progress: 753/2052 symbols. GLW took 0.4s. Estimated remaining time: 8m 32s [2025-10-22T23:31:45.100437] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:45.152202] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-22T23:31:45.152367] [INFO ] [MAIN ] GM: Loaded 53729 primary data records. [2025-10-22T23:31:45.480875] [DEBUG] [MAIN ] GM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:45.506289] [INFO ] [MAIN ] GM: Generated 138 derivative records from 53729 primary records. [2025-10-22T23:31:45.506419] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-22T23:31:45.518171] [DEBUG] [LOCAL ] GM: Derivative data saved (138 records). [2025-10-22T23:31:45.518256] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-22T23:31:45.521604] [INFO ] [MAIN ] Derivative Progress: 754/2052 symbols. GM took 0.4s. Estimated remaining time: 8m 31s [2025-10-22T23:31:45.521731] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:45.574451] [DEBUG] [LOCAL ] GME: Loaded 53781 existing records from primary storage. [2025-10-22T23:31:45.574614] [INFO ] [MAIN ] GME: Loaded 53781 primary data records. [2025-10-22T23:31:45.883565] [DEBUG] [MAIN ] GME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:45.908716] [INFO ] [MAIN ] GME: Generated 138 derivative records from 53781 primary records. [2025-10-22T23:31:45.908859] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-22T23:31:45.921026] [DEBUG] [LOCAL ] GME: Derivative data saved (138 records). [2025-10-22T23:31:45.921126] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-22T23:31:45.924246] [INFO ] [MAIN ] Derivative Progress: 755/2052 symbols. GME took 0.4s. Estimated remaining time: 8m 31s [2025-10-22T23:31:45.924350] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:45.968937] [DEBUG] [LOCAL ] GMED: Loaded 48094 existing records from primary storage. [2025-10-22T23:31:45.969100] [INFO ] [MAIN ] GMED: Loaded 48094 primary data records. [2025-10-22T23:31:46.279812] [DEBUG] [MAIN ] GMED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:46.306037] [INFO ] [MAIN ] GMED: Generated 138 derivative records from 48094 primary records. [2025-10-22T23:31:46.306222] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-22T23:31:46.317933] [DEBUG] [LOCAL ] GMED: Derivative data saved (138 records). [2025-10-22T23:31:46.318070] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-22T23:31:46.321173] [INFO ] [MAIN ] Derivative Progress: 756/2052 symbols. GMED took 0.4s. Estimated remaining time: 8m 31s [2025-10-22T23:31:46.321295] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:46.355284] [DEBUG] [LOCAL ] GMRE: Loaded 36438 existing records from primary storage. [2025-10-22T23:31:46.355470] [INFO ] [MAIN ] GMRE: Loaded 36438 primary data records. [2025-10-22T23:31:46.681485] [DEBUG] [MAIN ] GMRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:46.707912] [INFO ] [MAIN ] GMRE: Generated 138 derivative records from 36438 primary records. [2025-10-22T23:31:46.708083] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-22T23:31:46.720453] [DEBUG] [LOCAL ] GMRE: Derivative data saved (138 records). [2025-10-22T23:31:46.720545] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-22T23:31:46.723591] [INFO ] [MAIN ] Derivative Progress: 757/2052 symbols. GMRE took 0.4s. Estimated remaining time: 8m 30s [2025-10-22T23:31:46.723742] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:46.744192] [DEBUG] [LOCAL ] GNE: Loaded 18074 existing records from primary storage. [2025-10-22T23:31:46.744344] [INFO ] [MAIN ] GNE: Loaded 18074 primary data records. [2025-10-22T23:31:47.050418] [DEBUG] [MAIN ] GNE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:47.075260] [INFO ] [MAIN ] GNE: Generated 138 derivative records from 18074 primary records. [2025-10-22T23:31:47.075411] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-22T23:31:47.086737] [DEBUG] [LOCAL ] GNE: Derivative data saved (138 records). [2025-10-22T23:31:47.086830] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-22T23:31:47.089573] [INFO ] [MAIN ] Derivative Progress: 758/2052 symbols. GNE took 0.4s. Estimated remaining time: 8m 30s [2025-10-22T23:31:47.089727] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:47.128789] [DEBUG] [LOCAL ] GNK: Loaded 39524 existing records from primary storage. [2025-10-22T23:31:47.128956] [INFO ] [MAIN ] GNK: Loaded 39524 primary data records. [2025-10-22T23:31:47.465480] [DEBUG] [MAIN ] GNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:47.493000] [INFO ] [MAIN ] GNK: Generated 138 derivative records from 39524 primary records. [2025-10-22T23:31:47.493153] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-22T23:31:47.505151] [DEBUG] [LOCAL ] GNK: Derivative data saved (138 records). [2025-10-22T23:31:47.505230] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-22T23:31:47.508167] [INFO ] [MAIN ] Derivative Progress: 759/2052 symbols. GNK took 0.4s. Estimated remaining time: 8m 30s [2025-10-22T23:31:47.508262] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:47.551629] [DEBUG] [LOCAL ] GNL: Loaded 46512 existing records from primary storage. [2025-10-22T23:31:47.551820] [INFO ] [MAIN ] GNL: Loaded 46512 primary data records. [2025-10-22T23:31:47.884570] [DEBUG] [MAIN ] GNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:47.910096] [INFO ] [MAIN ] GNL: Generated 138 derivative records from 46512 primary records. [2025-10-22T23:31:47.910267] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-22T23:31:47.921545] [DEBUG] [LOCAL ] GNL: Derivative data saved (138 records). [2025-10-22T23:31:47.921625] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-22T23:31:47.924336] [INFO ] [MAIN ] Derivative Progress: 760/2052 symbols. GNL took 0.4s. Estimated remaining time: 8m 29s [2025-10-22T23:31:47.924484] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:47.971902] [DEBUG] [LOCAL ] GNRC: Loaded 45359 existing records from primary storage. [2025-10-22T23:31:47.972075] [INFO ] [MAIN ] GNRC: Loaded 45359 primary data records. [2025-10-22T23:31:48.292910] [DEBUG] [MAIN ] GNRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:48.325806] [INFO ] [MAIN ] GNRC: Generated 138 derivative records from 45359 primary records. [2025-10-22T23:31:48.325990] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-22T23:31:48.337847] [DEBUG] [LOCAL ] GNRC: Derivative data saved (138 records). [2025-10-22T23:31:48.337941] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-22T23:31:48.340587] [INFO ] [MAIN ] Derivative Progress: 761/2052 symbols. GNRC took 0.4s. Estimated remaining time: 8m 29s [2025-10-22T23:31:48.340744] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:48.352942] [DEBUG] [LOCAL ] GNT: Loaded 8632 existing records from primary storage. [2025-10-22T23:31:48.353098] [INFO ] [MAIN ] GNT: Loaded 8632 primary data records. [2025-10-22T23:31:48.661787] [DEBUG] [MAIN ] GNT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:31:48.698946] [INFO ] [MAIN ] GNT: Generated 138 derivative records from 8632 primary records. [2025-10-22T23:31:48.699137] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-22T23:31:48.710286] [DEBUG] [LOCAL ] GNT: Derivative data saved (138 records). [2025-10-22T23:31:48.710407] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-22T23:31:48.712431] [INFO ] [MAIN ] Derivative Progress: 762/2052 symbols. GNT took 0.4s. Estimated remaining time: 8m 28s [2025-10-22T23:31:48.712536] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:48.762382] [DEBUG] [LOCAL ] GNW: Loaded 51369 existing records from primary storage. [2025-10-22T23:31:48.762595] [INFO ] [MAIN ] GNW: Loaded 51369 primary data records. [2025-10-22T23:31:49.129050] [DEBUG] [MAIN ] GNW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:49.158879] [INFO ] [MAIN ] GNW: Generated 138 derivative records from 51369 primary records. [2025-10-22T23:31:49.159072] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-22T23:31:49.171102] [DEBUG] [LOCAL ] GNW: Derivative data saved (138 records). [2025-10-22T23:31:49.171277] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-22T23:31:49.174885] [INFO ] [MAIN ] Derivative Progress: 763/2052 symbols. GNW took 0.5s. Estimated remaining time: 8m 28s [2025-10-22T23:31:49.175039] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:49.219214] [DEBUG] [LOCAL ] GOF: Loaded 42713 existing records from primary storage. [2025-10-22T23:31:49.219396] [INFO ] [MAIN ] GOF: Loaded 42713 primary data records. [2025-10-22T23:31:49.569942] [DEBUG] [MAIN ] GOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:49.596163] [INFO ] [MAIN ] GOF: Generated 138 derivative records from 42713 primary records. [2025-10-22T23:31:49.596342] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-22T23:31:49.608198] [DEBUG] [LOCAL ] GOF: Derivative data saved (138 records). [2025-10-22T23:31:49.608290] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-22T23:31:49.611236] [INFO ] [MAIN ] Derivative Progress: 764/2052 symbols. GOF took 0.4s. Estimated remaining time: 8m 28s [2025-10-22T23:31:49.611333] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:49.642570] [DEBUG] [LOCAL ] GOLF: Loaded 30311 existing records from primary storage. [2025-10-22T23:31:49.642769] [INFO ] [MAIN ] GOLF: Loaded 30311 primary data records. [2025-10-22T23:31:49.974983] [DEBUG] [MAIN ] GOLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:50.010780] [INFO ] [MAIN ] GOLF: Generated 138 derivative records from 30311 primary records. [2025-10-22T23:31:50.011000] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-22T23:31:50.024434] [DEBUG] [LOCAL ] GOLF: Derivative data saved (138 records). [2025-10-22T23:31:50.024552] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-22T23:31:50.027728] [INFO ] [MAIN ] Derivative Progress: 765/2052 symbols. GOLF took 0.4s. Estimated remaining time: 8m 27s [2025-10-22T23:31:50.027853] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:50.075351] [DEBUG] [LOCAL ] GOOS: Loaded 44038 existing records from primary storage. [2025-10-22T23:31:50.075539] [INFO ] [MAIN ] GOOS: Loaded 44038 primary data records. [2025-10-22T23:31:50.466082] [DEBUG] [MAIN ] GOOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:50.498666] [INFO ] [MAIN ] GOOS: Generated 138 derivative records from 44038 primary records. [2025-10-22T23:31:50.498872] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-22T23:31:50.512383] [DEBUG] [LOCAL ] GOOS: Derivative data saved (138 records). [2025-10-22T23:31:50.512481] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-22T23:31:50.515517] [INFO ] [MAIN ] Derivative Progress: 766/2052 symbols. GOOS took 0.5s. Estimated remaining time: 8m 27s [2025-10-22T23:31:50.515636] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:50.554064] [DEBUG] [LOCAL ] GOTU: Loaded 36876 existing records from primary storage. [2025-10-22T23:31:50.554246] [INFO ] [MAIN ] GOTU: Loaded 36876 primary data records. [2025-10-22T23:31:50.875308] [DEBUG] [MAIN ] GOTU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:50.901305] [INFO ] [MAIN ] GOTU: Generated 138 derivative records from 36876 primary records. [2025-10-22T23:31:50.901489] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-22T23:31:50.913081] [DEBUG] [LOCAL ] GOTU: Derivative data saved (138 records). [2025-10-22T23:31:50.913200] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-22T23:31:50.916395] [INFO ] [MAIN ] Derivative Progress: 767/2052 symbols. GOTU took 0.4s. Estimated remaining time: 8m 27s [2025-10-22T23:31:50.916562] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:50.965587] [DEBUG] [LOCAL ] GPC: Loaded 45916 existing records from primary storage. [2025-10-22T23:31:50.965794] [INFO ] [MAIN ] GPC: Loaded 45916 primary data records. [2025-10-22T23:31:51.290908] [DEBUG] [MAIN ] GPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:51.316975] [INFO ] [MAIN ] GPC: Generated 138 derivative records from 45916 primary records. [2025-10-22T23:31:51.317147] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-10-22T23:31:51.329315] [DEBUG] [LOCAL ] GPC: Derivative data saved (138 records). [2025-10-22T23:31:51.329408] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-10-22T23:31:51.332134] [INFO ] [MAIN ] Derivative Progress: 768/2052 symbols. GPC took 0.4s. Estimated remaining time: 8m 26s [2025-10-22T23:31:51.332250] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:51.351403] [DEBUG] [LOCAL ] GPI: Loaded 14678 existing records from primary storage. [2025-10-22T23:31:51.351561] [INFO ] [MAIN ] GPI: Loaded 14678 primary data records. [2025-10-22T23:31:51.715321] [DEBUG] [MAIN ] GPI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:31:51.740765] [INFO ] [MAIN ] GPI: Generated 138 derivative records from 14678 primary records. [2025-10-22T23:31:51.740881] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-22T23:31:51.752416] [DEBUG] [LOCAL ] GPI: Derivative data saved (138 records). [2025-10-22T23:31:51.752504] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-22T23:31:51.755259] [INFO ] [MAIN ] Derivative Progress: 769/2052 symbols. GPI took 0.4s. Estimated remaining time: 8m 26s [2025-10-22T23:31:51.755368] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:51.766148] [DEBUG] [LOCAL ] GPJA: Loaded 4108 existing records from primary storage. [2025-10-22T23:31:51.766279] [INFO ] [MAIN ] GPJA: Loaded 4108 primary data records. [2025-10-22T23:31:52.067533] [DEBUG] [MAIN ] GPJA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:52.092450] [INFO ] [MAIN ] GPJA: Generated 138 derivative records from 4108 primary records. [2025-10-22T23:31:52.092599] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-22T23:31:52.103116] [DEBUG] [LOCAL ] GPJA: Derivative data saved (138 records). [2025-10-22T23:31:52.103224] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-22T23:31:52.105409] [INFO ] [MAIN ] Derivative Progress: 770/2052 symbols. GPJA took 0.4s. Estimated remaining time: 8m 26s [2025-10-22T23:31:52.105505] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:52.156411] [DEBUG] [LOCAL ] GPK: Loaded 52780 existing records from primary storage. [2025-10-22T23:31:52.156580] [INFO ] [MAIN ] GPK: Loaded 52780 primary data records. [2025-10-22T23:31:52.461250] [DEBUG] [MAIN ] GPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:52.486067] [INFO ] [MAIN ] GPK: Generated 138 derivative records from 52780 primary records. [2025-10-22T23:31:52.486196] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-22T23:31:52.498029] [DEBUG] [LOCAL ] GPK: Derivative data saved (138 records). [2025-10-22T23:31:52.498132] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-22T23:31:52.501473] [INFO ] [MAIN ] Derivative Progress: 771/2052 symbols. GPK took 0.4s. Estimated remaining time: 8m 25s [2025-10-22T23:31:52.501584] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:52.530684] [DEBUG] [LOCAL ] GPMT: Loaded 25950 existing records from primary storage. [2025-10-22T23:31:52.530856] [INFO ] [MAIN ] GPMT: Loaded 25950 primary data records. [2025-10-22T23:31:52.841691] [DEBUG] [MAIN ] GPMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:52.867131] [INFO ] [MAIN ] GPMT: Generated 138 derivative records from 25950 primary records. [2025-10-22T23:31:52.867324] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-22T23:31:52.879126] [DEBUG] [LOCAL ] GPMT: Derivative data saved (138 records). [2025-10-22T23:31:52.879236] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-22T23:31:52.882399] [INFO ] [MAIN ] Derivative Progress: 772/2052 symbols. GPMT took 0.4s. Estimated remaining time: 8m 25s [2025-10-22T23:31:52.882538] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:52.936011] [DEBUG] [LOCAL ] GPN: Loaded 51867 existing records from primary storage. [2025-10-22T23:31:52.936182] [INFO ] [MAIN ] GPN: Loaded 51867 primary data records. [2025-10-22T23:31:53.244593] [DEBUG] [MAIN ] GPN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:53.270008] [INFO ] [MAIN ] GPN: Generated 138 derivative records from 51867 primary records. [2025-10-22T23:31:53.270187] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-22T23:31:53.281835] [DEBUG] [LOCAL ] GPN: Derivative data saved (138 records). [2025-10-22T23:31:53.281944] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-22T23:31:53.285369] [INFO ] [MAIN ] Derivative Progress: 773/2052 symbols. GPN took 0.4s. Estimated remaining time: 8m 24s [2025-10-22T23:31:53.285484] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:53.309944] [DEBUG] [LOCAL ] GPOR: Loaded 23317 existing records from primary storage. [2025-10-22T23:31:53.310116] [INFO ] [MAIN ] GPOR: Loaded 23317 primary data records. [2025-10-22T23:31:53.623147] [DEBUG] [MAIN ] GPOR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:31:53.648303] [INFO ] [MAIN ] GPOR: Generated 138 derivative records from 23317 primary records. [2025-10-22T23:31:53.648476] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-22T23:31:53.659998] [DEBUG] [LOCAL ] GPOR: Derivative data saved (138 records). [2025-10-22T23:31:53.660082] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-10-22T23:31:53.662963] [INFO ] [MAIN ] Derivative Progress: 774/2052 symbols. GPOR took 0.4s. Estimated remaining time: 8m 24s [2025-10-22T23:31:53.663069] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:53.700601] [DEBUG] [LOCAL ] GPRK: Loaded 39851 existing records from primary storage. [2025-10-22T23:31:53.700992] [INFO ] [MAIN ] GPRK: Loaded 39851 primary data records. [2025-10-22T23:31:54.032249] [DEBUG] [MAIN ] GPRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:54.057973] [INFO ] [MAIN ] GPRK: Generated 138 derivative records from 39851 primary records. [2025-10-22T23:31:54.058135] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-22T23:31:54.069195] [DEBUG] [LOCAL ] GPRK: Derivative data saved (138 records). [2025-10-22T23:31:54.069281] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-10-22T23:31:54.072265] [INFO ] [MAIN ] Derivative Progress: 775/2052 symbols. GPRK took 0.4s. Estimated remaining time: 8m 24s [2025-10-22T23:31:54.072388] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:54.099968] [DEBUG] [LOCAL ] GRBK: Loaded 26691 existing records from primary storage. [2025-10-22T23:31:54.100129] [INFO ] [MAIN ] GRBK: Loaded 26691 primary data records. [2025-10-22T23:31:54.414379] [DEBUG] [MAIN ] GRBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:54.440004] [INFO ] [MAIN ] GRBK: Generated 138 derivative records from 26691 primary records. [2025-10-22T23:31:54.440169] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-22T23:31:54.451552] [DEBUG] [LOCAL ] GRBK: Derivative data saved (138 records). [2025-10-22T23:31:54.451671] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-22T23:31:54.454782] [INFO ] [MAIN ] Derivative Progress: 776/2052 symbols. GRBK took 0.4s. Estimated remaining time: 8m 23s [2025-10-22T23:31:54.454910] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:54.468474] [DEBUG] [LOCAL ] GRC: Loaded 9268 existing records from primary storage. [2025-10-22T23:31:54.468672] [INFO ] [MAIN ] GRC: Loaded 9268 primary data records. [2025-10-22T23:31:54.776917] [DEBUG] [MAIN ] GRC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:31:54.801999] [INFO ] [MAIN ] GRC: Generated 138 derivative records from 9268 primary records. [2025-10-22T23:31:54.802120] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-22T23:31:54.813298] [DEBUG] [LOCAL ] GRC: Derivative data saved (138 records). [2025-10-22T23:31:54.813377] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-22T23:31:54.816156] [INFO ] [MAIN ] Derivative Progress: 777/2052 symbols. GRC took 0.4s. Estimated remaining time: 8m 23s [2025-10-22T23:31:54.816249] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:54.838259] [DEBUG] [LOCAL ] GRDN: Loaded 21258 existing records from primary storage. [2025-10-22T23:31:54.838405] [INFO ] [MAIN ] GRDN: Loaded 21258 primary data records. [2025-10-22T23:31:55.146446] [DEBUG] [MAIN ] GRDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:55.171484] [INFO ] [MAIN ] GRDN: Generated 138 derivative records from 21258 primary records. [2025-10-22T23:31:55.171618] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-22T23:31:55.183693] [DEBUG] [LOCAL ] GRDN: Derivative data saved (138 records). [2025-10-22T23:31:55.183779] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-22T23:31:55.186863] [INFO ] [MAIN ] Derivative Progress: 778/2052 symbols. GRDN took 0.4s. Estimated remaining time: 8m 22s [2025-10-22T23:31:55.186961] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:55.225409] [DEBUG] [LOCAL ] GRMN: Loaded 39812 existing records from primary storage. [2025-10-22T23:31:55.225571] [INFO ] [MAIN ] GRMN: Loaded 39812 primary data records. [2025-10-22T23:31:55.540956] [DEBUG] [MAIN ] GRMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:55.566049] [INFO ] [MAIN ] GRMN: Generated 138 derivative records from 39812 primary records. [2025-10-22T23:31:55.566199] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-22T23:31:55.578057] [DEBUG] [LOCAL ] GRMN: Derivative data saved (138 records). [2025-10-22T23:31:55.578194] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-22T23:31:55.581290] [INFO ] [MAIN ] Derivative Progress: 779/2052 symbols. GRMN took 0.4s. Estimated remaining time: 8m 22s [2025-10-22T23:31:55.581406] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:55.628849] [DEBUG] [LOCAL ] GRND: Loaded 50191 existing records from primary storage. [2025-10-22T23:31:55.629019] [INFO ] [MAIN ] GRND: Loaded 50191 primary data records. [2025-10-22T23:31:55.972779] [DEBUG] [MAIN ] GRND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:55.998529] [INFO ] [MAIN ] GRND: Generated 138 derivative records from 50191 primary records. [2025-10-22T23:31:55.998720] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-22T23:31:56.010395] [DEBUG] [LOCAL ] GRND: Derivative data saved (138 records). [2025-10-22T23:31:56.010485] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-22T23:31:56.013610] [INFO ] [MAIN ] Derivative Progress: 780/2052 symbols. GRND took 0.4s. Estimated remaining time: 8m 22s [2025-10-22T23:31:56.013761] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:56.045190] [DEBUG] [LOCAL ] GRNT: Loaded 33953 existing records from primary storage. [2025-10-22T23:31:56.045342] [INFO ] [MAIN ] GRNT: Loaded 33953 primary data records. [2025-10-22T23:31:56.354320] [DEBUG] [MAIN ] GRNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:56.379731] [INFO ] [MAIN ] GRNT: Generated 138 derivative records from 33953 primary records. [2025-10-22T23:31:56.379905] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-22T23:31:56.390798] [DEBUG] [LOCAL ] GRNT: Derivative data saved (138 records). [2025-10-22T23:31:56.390908] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-22T23:31:56.393755] [INFO ] [MAIN ] Derivative Progress: 781/2052 symbols. GRNT took 0.4s. Estimated remaining time: 8m 21s [2025-10-22T23:31:56.393897] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:56.406730] [DEBUG] [LOCAL ] GROV: Loaded 8616 existing records from primary storage. [2025-10-22T23:31:56.406891] [INFO ] [MAIN ] GROV: Loaded 8616 primary data records. [2025-10-22T23:31:56.732864] [DEBUG] [MAIN ] GROV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:56.762742] [INFO ] [MAIN ] GROV: Generated 138 derivative records from 8616 primary records. [2025-10-22T23:31:56.762984] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-22T23:31:56.774561] [DEBUG] [LOCAL ] GROV: Derivative data saved (138 records). [2025-10-22T23:31:56.774742] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-22T23:31:56.776883] [INFO ] [MAIN ] Derivative Progress: 782/2052 symbols. GROV took 0.4s. Estimated remaining time: 8m 21s [2025-10-22T23:31:56.777001] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:56.785801] [DEBUG] [LOCAL ] GRX: Loaded 4839 existing records from primary storage. [2025-10-22T23:31:56.785954] [INFO ] [MAIN ] GRX: Loaded 4839 primary data records. [2025-10-22T23:31:57.095340] [DEBUG] [MAIN ] GRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:57.121000] [INFO ] [MAIN ] GRX: Generated 138 derivative records from 4839 primary records. [2025-10-22T23:31:57.121165] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-22T23:31:57.131534] [DEBUG] [LOCAL ] GRX: Derivative data saved (138 records). [2025-10-22T23:31:57.131697] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-22T23:31:57.133952] [INFO ] [MAIN ] Derivative Progress: 783/2052 symbols. GRX took 0.4s. Estimated remaining time: 8m 20s [2025-10-22T23:31:57.134084] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:57.184530] [DEBUG] [LOCAL ] GS: Loaded 51777 existing records from primary storage. [2025-10-22T23:31:57.184799] [INFO ] [MAIN ] GS: Loaded 51777 primary data records. [2025-10-22T23:31:57.490430] [DEBUG] [MAIN ] GS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:57.515599] [INFO ] [MAIN ] GS: Generated 138 derivative records from 51777 primary records. [2025-10-22T23:31:57.515810] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-22T23:31:57.527588] [DEBUG] [LOCAL ] GS: Derivative data saved (138 records). [2025-10-22T23:31:57.527754] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-22T23:31:57.531051] [INFO ] [MAIN ] Derivative Progress: 784/2052 symbols. GS took 0.4s. Estimated remaining time: 8m 20s [2025-10-22T23:31:57.531196] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:57.574901] [DEBUG] [LOCAL ] GSBD: Loaded 39527 existing records from primary storage. [2025-10-22T23:31:57.575103] [INFO ] [MAIN ] GSBD: Loaded 39527 primary data records. [2025-10-22T23:31:57.915275] [DEBUG] [MAIN ] GSBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:57.940518] [INFO ] [MAIN ] GSBD: Generated 138 derivative records from 39527 primary records. [2025-10-22T23:31:57.940688] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-22T23:31:57.952336] [DEBUG] [LOCAL ] GSBD: Derivative data saved (138 records). [2025-10-22T23:31:57.952428] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-22T23:31:57.955423] [INFO ] [MAIN ] Derivative Progress: 785/2052 symbols. GSBD took 0.4s. Estimated remaining time: 8m 20s [2025-10-22T23:31:57.955519] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:58.007104] [DEBUG] [LOCAL ] GSK: Loaded 53511 existing records from primary storage. [2025-10-22T23:31:58.007286] [INFO ] [MAIN ] GSK: Loaded 53511 primary data records. [2025-10-22T23:31:58.311209] [DEBUG] [MAIN ] GSK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:58.336003] [INFO ] [MAIN ] GSK: Generated 138 derivative records from 53511 primary records. [2025-10-22T23:31:58.336147] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-22T23:31:58.347786] [DEBUG] [LOCAL ] GSK: Derivative data saved (138 records). [2025-10-22T23:31:58.347877] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-22T23:31:58.351107] [INFO ] [MAIN ] Derivative Progress: 786/2052 symbols. GSK took 0.4s. Estimated remaining time: 8m 19s [2025-10-22T23:31:58.351209] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:58.382784] [DEBUG] [LOCAL ] GSL: Loaded 32919 existing records from primary storage. [2025-10-22T23:31:58.382943] [INFO ] [MAIN ] GSL: Loaded 32919 primary data records. [2025-10-22T23:31:58.692994] [DEBUG] [MAIN ] GSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:58.718198] [INFO ] [MAIN ] GSL: Generated 138 derivative records from 32919 primary records. [2025-10-22T23:31:58.718367] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-22T23:31:58.730238] [DEBUG] [LOCAL ] GSL: Derivative data saved (138 records). [2025-10-22T23:31:58.730346] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-22T23:31:58.733147] [INFO ] [MAIN ] Derivative Progress: 787/2052 symbols. GSL took 0.4s. Estimated remaining time: 8m 19s [2025-10-22T23:31:58.733279] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:58.780200] [DEBUG] [LOCAL ] GTES: Loaded 50288 existing records from primary storage. [2025-10-22T23:31:58.780369] [INFO ] [MAIN ] GTES: Loaded 50288 primary data records. [2025-10-22T23:31:59.084750] [DEBUG] [MAIN ] GTES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:59.110121] [INFO ] [MAIN ] GTES: Generated 138 derivative records from 50288 primary records. [2025-10-22T23:31:59.110291] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-22T23:31:59.122042] [DEBUG] [LOCAL ] GTES: Derivative data saved (138 records). [2025-10-22T23:31:59.122154] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-22T23:31:59.125129] [INFO ] [MAIN ] Derivative Progress: 788/2052 symbols. GTES took 0.4s. Estimated remaining time: 8m 18s [2025-10-22T23:31:59.125236] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:59.167068] [DEBUG] [LOCAL ] GTLS: Loaded 43141 existing records from primary storage. [2025-10-22T23:31:59.167230] [INFO ] [MAIN ] GTLS: Loaded 43141 primary data records. [2025-10-22T23:31:59.471713] [DEBUG] [MAIN ] GTLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:59.498011] [INFO ] [MAIN ] GTLS: Generated 138 derivative records from 43141 primary records. [2025-10-22T23:31:59.498236] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-22T23:31:59.510594] [DEBUG] [LOCAL ] GTLS: Derivative data saved (138 records). [2025-10-22T23:31:59.510720] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-10-22T23:31:59.513594] [INFO ] [MAIN ] Derivative Progress: 789/2052 symbols. GTLS took 0.4s. Estimated remaining time: 8m 18s [2025-10-22T23:31:59.513749] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:59.554795] [DEBUG] [LOCAL ] GTN: Loaded 44840 existing records from primary storage. [2025-10-22T23:31:59.554962] [INFO ] [MAIN ] GTN: Loaded 44840 primary data records. [2025-10-22T23:31:59.858602] [DEBUG] [MAIN ] GTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:31:59.883226] [INFO ] [MAIN ] GTN: Generated 138 derivative records from 44840 primary records. [2025-10-22T23:31:59.883359] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-22T23:31:59.894360] [DEBUG] [LOCAL ] GTN: Derivative data saved (138 records). [2025-10-22T23:31:59.894439] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-22T23:31:59.897105] [INFO ] [MAIN ] Derivative Progress: 790/2052 symbols. GTN took 0.4s. Estimated remaining time: 8m 18s [2025-10-22T23:31:59.897200] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:31:59.925861] [DEBUG] [LOCAL ] GTY: Loaded 30006 existing records from primary storage. [2025-10-22T23:31:59.926205] [INFO ] [MAIN ] GTY: Loaded 30006 primary data records. [2025-10-22T23:32:00.254934] [DEBUG] [MAIN ] GTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:00.280170] [INFO ] [MAIN ] GTY: Generated 138 derivative records from 30006 primary records. [2025-10-22T23:32:00.280272] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-22T23:32:00.291909] [DEBUG] [LOCAL ] GTY: Derivative data saved (138 records). [2025-10-22T23:32:00.291986] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-22T23:32:00.294697] [INFO ] [MAIN ] Derivative Progress: 791/2052 symbols. GTY took 0.4s. Estimated remaining time: 8m 17s [2025-10-22T23:32:00.294792] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:00.310202] [DEBUG] [LOCAL ] GUG: Loaded 12168 existing records from primary storage. [2025-10-22T23:32:00.310332] [INFO ] [MAIN ] GUG: Loaded 12168 primary data records. [2025-10-22T23:32:00.613912] [DEBUG] [MAIN ] GUG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:00.638832] [INFO ] [MAIN ] GUG: Generated 138 derivative records from 12168 primary records. [2025-10-22T23:32:00.639014] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-22T23:32:00.650594] [DEBUG] [LOCAL ] GUG: Derivative data saved (138 records). [2025-10-22T23:32:00.650732] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-10-22T23:32:00.653375] [INFO ] [MAIN ] Derivative Progress: 792/2052 symbols. GUG took 0.4s. Estimated remaining time: 8m 17s [2025-10-22T23:32:00.653476] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:00.671419] [DEBUG] [LOCAL ] GUT: Loaded 15487 existing records from primary storage. [2025-10-22T23:32:00.671568] [INFO ] [MAIN ] GUT: Loaded 15487 primary data records. [2025-10-22T23:32:00.979155] [DEBUG] [MAIN ] GUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:01.004214] [INFO ] [MAIN ] GUT: Generated 138 derivative records from 15487 primary records. [2025-10-22T23:32:01.004360] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-22T23:32:01.015365] [DEBUG] [LOCAL ] GUT: Derivative data saved (138 records). [2025-10-22T23:32:01.015452] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-22T23:32:01.018191] [INFO ] [MAIN ] Derivative Progress: 793/2052 symbols. GUT took 0.4s. Estimated remaining time: 8m 16s [2025-10-22T23:32:01.018311] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:01.051239] [DEBUG] [LOCAL ] GVA: Loaded 32580 existing records from primary storage. [2025-10-22T23:32:01.051395] [INFO ] [MAIN ] GVA: Loaded 32580 primary data records. [2025-10-22T23:32:01.372194] [DEBUG] [MAIN ] GVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:01.397232] [INFO ] [MAIN ] GVA: Generated 138 derivative records from 32580 primary records. [2025-10-22T23:32:01.397405] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-22T23:32:01.408998] [DEBUG] [LOCAL ] GVA: Derivative data saved (138 records). [2025-10-22T23:32:01.409087] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-10-22T23:32:01.411984] [INFO ] [MAIN ] Derivative Progress: 794/2052 symbols. GVA took 0.4s. Estimated remaining time: 8m 16s [2025-10-22T23:32:01.412103] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:01.433629] [DEBUG] [LOCAL ] GWH: Loaded 20115 existing records from primary storage. [2025-10-22T23:32:01.433810] [INFO ] [MAIN ] GWH: Loaded 20115 primary data records. [2025-10-22T23:32:01.771515] [DEBUG] [MAIN ] GWH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:01.796989] [INFO ] [MAIN ] GWH: Generated 138 derivative records from 20115 primary records. [2025-10-22T23:32:01.797102] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-22T23:32:01.808615] [DEBUG] [LOCAL ] GWH: Derivative data saved (138 records). [2025-10-22T23:32:01.808721] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-22T23:32:01.811463] [INFO ] [MAIN ] Derivative Progress: 795/2052 symbols. GWH took 0.4s. Estimated remaining time: 8m 16s [2025-10-22T23:32:01.811561] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:01.850671] [DEBUG] [LOCAL ] GWRE: Loaded 39608 existing records from primary storage. [2025-10-22T23:32:01.850827] [INFO ] [MAIN ] GWRE: Loaded 39608 primary data records. [2025-10-22T23:32:02.176568] [DEBUG] [MAIN ] GWRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:02.201683] [INFO ] [MAIN ] GWRE: Generated 138 derivative records from 39608 primary records. [2025-10-22T23:32:02.201784] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-10-22T23:32:02.213181] [DEBUG] [LOCAL ] GWRE: Derivative data saved (138 records). [2025-10-22T23:32:02.213259] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-10-22T23:32:02.216119] [INFO ] [MAIN ] Derivative Progress: 796/2052 symbols. GWRE took 0.4s. Estimated remaining time: 8m 15s [2025-10-22T23:32:02.216218] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:02.237924] [DEBUG] [LOCAL ] GWW: Loaded 19181 existing records from primary storage. [2025-10-22T23:32:02.238058] [INFO ] [MAIN ] GWW: Loaded 19181 primary data records. [2025-10-22T23:32:02.542921] [DEBUG] [MAIN ] GWW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:02.568111] [INFO ] [MAIN ] GWW: Generated 138 derivative records from 19181 primary records. [2025-10-22T23:32:02.568237] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-22T23:32:02.579774] [DEBUG] [LOCAL ] GWW: Derivative data saved (138 records). [2025-10-22T23:32:02.579855] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-10-22T23:32:02.582789] [INFO ] [MAIN ] Derivative Progress: 797/2052 symbols. GWW took 0.4s. Estimated remaining time: 8m 15s [2025-10-22T23:32:02.582892] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:02.628607] [DEBUG] [LOCAL ] GXO: Loaded 46455 existing records from primary storage. [2025-10-22T23:32:02.628821] [INFO ] [MAIN ] GXO: Loaded 46455 primary data records. [2025-10-22T23:32:02.931036] [DEBUG] [MAIN ] GXO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:02.956019] [INFO ] [MAIN ] GXO: Generated 138 derivative records from 46455 primary records. [2025-10-22T23:32:02.956123] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-10-22T23:32:02.967449] [DEBUG] [LOCAL ] GXO: Derivative data saved (138 records). [2025-10-22T23:32:02.967533] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-10-22T23:32:02.970468] [INFO ] [MAIN ] Derivative Progress: 798/2052 symbols. GXO took 0.4s. Estimated remaining time: 8m 14s [2025-10-22T23:32:02.970562] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:02.974347] [DEBUG] [LOCAL ] GYLD: Loaded 1532 existing records from primary storage. [2025-10-22T23:32:02.974432] [INFO ] [MAIN ] GYLD: Loaded 1532 primary data records. [2025-10-22T23:32:03.273256] [DEBUG] [MAIN ] GYLD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:32:03.298279] [INFO ] [MAIN ] GYLD: Generated 138 derivative records from 1532 primary records. [2025-10-22T23:32:03.298389] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-10-22T23:32:03.307601] [DEBUG] [LOCAL ] GYLD: Derivative data saved (138 records). [2025-10-22T23:32:03.307702] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-10-22T23:32:03.309781] [INFO ] [MAIN ] Derivative Progress: 799/2052 symbols. GYLD took 0.3s. Estimated remaining time: 8m 14s [2025-10-22T23:32:03.309879] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:03.356491] [DEBUG] [LOCAL ] H: Loaded 44372 existing records from primary storage. [2025-10-22T23:32:03.356683] [INFO ] [MAIN ] H: Loaded 44372 primary data records. [2025-10-22T23:32:03.661565] [DEBUG] [MAIN ] H: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:03.686316] [INFO ] [MAIN ] H: Generated 138 derivative records from 44372 primary records. [2025-10-22T23:32:03.686416] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-10-22T23:32:03.698003] [DEBUG] [LOCAL ] H: Derivative data saved (138 records). [2025-10-22T23:32:03.698079] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-10-22T23:32:03.701157] [INFO ] [MAIN ] Derivative Progress: 800/2052 symbols. H took 0.4s. Estimated remaining time: 8m 13s [2025-10-22T23:32:03.701252] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:03.738815] [DEBUG] [LOCAL ] HAE: Loaded 39324 existing records from primary storage. [2025-10-22T23:32:03.738967] [INFO ] [MAIN ] HAE: Loaded 39324 primary data records. [2025-10-22T23:32:04.071048] [DEBUG] [MAIN ] HAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:04.096205] [INFO ] [MAIN ] HAE: Generated 138 derivative records from 39324 primary records. [2025-10-22T23:32:04.096307] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-10-22T23:32:04.107796] [DEBUG] [LOCAL ] HAE: Derivative data saved (138 records). [2025-10-22T23:32:04.107876] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-10-22T23:32:04.110805] [INFO ] [MAIN ] Derivative Progress: 801/2052 symbols. HAE took 0.4s. Estimated remaining time: 8m 13s [2025-10-22T23:32:04.110902] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:04.149063] [DEBUG] [LOCAL ] HAFN: Loaded 42607 existing records from primary storage. [2025-10-22T23:32:04.149220] [INFO ] [MAIN ] HAFN: Loaded 42607 primary data records. [2025-10-22T23:32:04.456225] [DEBUG] [MAIN ] HAFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:04.481109] [INFO ] [MAIN ] HAFN: Generated 138 derivative records from 42607 primary records. [2025-10-22T23:32:04.481232] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-10-22T23:32:04.492421] [DEBUG] [LOCAL ] HAFN: Derivative data saved (138 records). [2025-10-22T23:32:04.492500] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-10-22T23:32:04.495406] [INFO ] [MAIN ] Derivative Progress: 802/2052 symbols. HAFN took 0.4s. Estimated remaining time: 8m 13s [2025-10-22T23:32:04.495502] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:04.546149] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-22T23:32:04.546303] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-10-22T23:32:04.852451] [DEBUG] [MAIN ] HAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:04.878341] [INFO ] [MAIN ] HAL: Generated 138 derivative records from 53718 primary records. [2025-10-22T23:32:04.878580] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-10-22T23:32:04.890584] [DEBUG] [LOCAL ] HAL: Derivative data saved (138 records). [2025-10-22T23:32:04.890759] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-10-22T23:32:04.894195] [INFO ] [MAIN ] Derivative Progress: 803/2052 symbols. HAL took 0.4s. Estimated remaining time: 8m 12s [2025-10-22T23:32:04.894352] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:04.940535] [DEBUG] [LOCAL ] HASI: Loaded 47728 existing records from primary storage. [2025-10-22T23:32:04.940766] [INFO ] [MAIN ] HASI: Loaded 47728 primary data records. [2025-10-22T23:32:05.256829] [DEBUG] [MAIN ] HASI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:05.282131] [INFO ] [MAIN ] HASI: Generated 138 derivative records from 47728 primary records. [2025-10-22T23:32:05.282232] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-10-22T23:32:05.294182] [DEBUG] [LOCAL ] HASI: Derivative data saved (138 records). [2025-10-22T23:32:05.294261] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-10-22T23:32:05.297001] [INFO ] [MAIN ] Derivative Progress: 804/2052 symbols. HASI took 0.4s. Estimated remaining time: 8m 12s [2025-10-22T23:32:05.297101] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:05.343850] [DEBUG] [LOCAL ] HAYW: Loaded 48803 existing records from primary storage. [2025-10-22T23:32:05.344022] [INFO ] [MAIN ] HAYW: Loaded 48803 primary data records. [2025-10-22T23:32:05.649360] [DEBUG] [MAIN ] HAYW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:05.674712] [INFO ] [MAIN ] HAYW: Generated 138 derivative records from 48803 primary records. [2025-10-22T23:32:05.674831] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-10-22T23:32:05.686716] [DEBUG] [LOCAL ] HAYW: Derivative data saved (138 records). [2025-10-22T23:32:05.686798] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-10-22T23:32:05.689732] [INFO ] [MAIN ] Derivative Progress: 805/2052 symbols. HAYW took 0.4s. Estimated remaining time: 8m 11s [2025-10-22T23:32:05.689833] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:05.700256] [DEBUG] [LOCAL ] HBB: Loaded 6298 existing records from primary storage. [2025-10-22T23:32:05.700381] [INFO ] [MAIN ] HBB: Loaded 6298 primary data records. [2025-10-22T23:32:06.032862] [DEBUG] [MAIN ] HBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:06.057993] [INFO ] [MAIN ] HBB: Generated 138 derivative records from 6298 primary records. [2025-10-22T23:32:06.058101] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-10-22T23:32:06.068605] [DEBUG] [LOCAL ] HBB: Derivative data saved (138 records). [2025-10-22T23:32:06.068702] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-10-22T23:32:06.070802] [INFO ] [MAIN ] Derivative Progress: 806/2052 symbols. HBB took 0.4s. Estimated remaining time: 8m 11s [2025-10-22T23:32:06.070915] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:06.122421] [DEBUG] [LOCAL ] HBI: Loaded 52906 existing records from primary storage. [2025-10-22T23:32:06.122578] [INFO ] [MAIN ] HBI: Loaded 52906 primary data records. [2025-10-22T23:32:06.424301] [DEBUG] [MAIN ] HBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:06.449114] [INFO ] [MAIN ] HBI: Generated 138 derivative records from 52906 primary records. [2025-10-22T23:32:06.449221] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-10-22T23:32:06.460245] [DEBUG] [LOCAL ] HBI: Derivative data saved (138 records). [2025-10-22T23:32:06.460323] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-10-22T23:32:06.463530] [INFO ] [MAIN ] Derivative Progress: 807/2052 symbols. HBI took 0.4s. Estimated remaining time: 8m 11s [2025-10-22T23:32:06.463632] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:06.514004] [DEBUG] [LOCAL ] HBM: Loaded 52980 existing records from primary storage. [2025-10-22T23:32:06.514162] [INFO ] [MAIN ] HBM: Loaded 52980 primary data records. [2025-10-22T23:32:06.820524] [DEBUG] [MAIN ] HBM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:06.845957] [INFO ] [MAIN ] HBM: Generated 138 derivative records from 52980 primary records. [2025-10-22T23:32:06.846060] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-10-22T23:32:06.857702] [DEBUG] [LOCAL ] HBM: Derivative data saved (138 records). [2025-10-22T23:32:06.857787] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-10-22T23:32:06.861017] [INFO ] [MAIN ] Derivative Progress: 808/2052 symbols. HBM took 0.4s. Estimated remaining time: 8m 10s [2025-10-22T23:32:06.861113] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:06.904185] [DEBUG] [LOCAL ] HCA: Loaded 46893 existing records from primary storage. [2025-10-22T23:32:06.904343] [INFO ] [MAIN ] HCA: Loaded 46893 primary data records. [2025-10-22T23:32:07.206261] [DEBUG] [MAIN ] HCA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:07.231075] [INFO ] [MAIN ] HCA: Generated 138 derivative records from 46893 primary records. [2025-10-22T23:32:07.231181] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-10-22T23:32:07.242571] [DEBUG] [LOCAL ] HCA: Derivative data saved (138 records). [2025-10-22T23:32:07.242672] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-10-22T23:32:07.245339] [INFO ] [MAIN ] Derivative Progress: 809/2052 symbols. HCA took 0.4s. Estimated remaining time: 8m 10s [2025-10-22T23:32:07.245435] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:07.286826] [DEBUG] [LOCAL ] HCC: Loaded 44974 existing records from primary storage. [2025-10-22T23:32:07.286982] [INFO ] [MAIN ] HCC: Loaded 44974 primary data records. [2025-10-22T23:32:07.592523] [DEBUG] [MAIN ] HCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:07.618298] [INFO ] [MAIN ] HCC: Generated 138 derivative records from 44974 primary records. [2025-10-22T23:32:07.618411] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-10-22T23:32:07.629911] [DEBUG] [LOCAL ] HCC: Derivative data saved (138 records). [2025-10-22T23:32:07.629989] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-10-22T23:32:07.632704] [INFO ] [MAIN ] Derivative Progress: 810/2052 symbols. HCC took 0.4s. Estimated remaining time: 8m 9s [2025-10-22T23:32:07.632800] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:07.650171] [DEBUG] [LOCAL ] HCI: Loaded 14079 existing records from primary storage. [2025-10-22T23:32:07.650319] [INFO ] [MAIN ] HCI: Loaded 14079 primary data records. [2025-10-22T23:32:07.951188] [DEBUG] [MAIN ] HCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:07.976219] [INFO ] [MAIN ] HCI: Generated 138 derivative records from 14079 primary records. [2025-10-22T23:32:07.976329] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-10-22T23:32:07.987695] [DEBUG] [LOCAL ] HCI: Derivative data saved (138 records). [2025-10-22T23:32:07.987772] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-10-22T23:32:07.990338] [INFO ] [MAIN ] Derivative Progress: 811/2052 symbols. HCI took 0.4s. Estimated remaining time: 8m 9s [2025-10-22T23:32:07.990438] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:08.041512] [DEBUG] [LOCAL ] HD: Loaded 53467 existing records from primary storage. [2025-10-22T23:32:08.041702] [INFO ] [MAIN ] HD: Loaded 53467 primary data records. [2025-10-22T23:32:08.366072] [DEBUG] [MAIN ] HD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:08.391240] [INFO ] [MAIN ] HD: Generated 138 derivative records from 53467 primary records. [2025-10-22T23:32:08.391346] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-10-22T23:32:08.402995] [DEBUG] [LOCAL ] HD: Derivative data saved (138 records). [2025-10-22T23:32:08.403075] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-10-22T23:32:08.406334] [INFO ] [MAIN ] Derivative Progress: 812/2052 symbols. HD took 0.4s. Estimated remaining time: 8m 9s [2025-10-22T23:32:08.406433] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:08.456170] [DEBUG] [LOCAL ] HDB: Loaded 51909 existing records from primary storage. [2025-10-22T23:32:08.456330] [INFO ] [MAIN ] HDB: Loaded 51909 primary data records. [2025-10-22T23:32:08.757102] [DEBUG] [MAIN ] HDB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:08.781951] [INFO ] [MAIN ] HDB: Generated 138 derivative records from 51909 primary records. [2025-10-22T23:32:08.782058] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-10-22T23:32:08.793356] [DEBUG] [LOCAL ] HDB: Derivative data saved (138 records). [2025-10-22T23:32:08.793435] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-10-22T23:32:08.796518] [INFO ] [MAIN ] Derivative Progress: 813/2052 symbols. HDB took 0.4s. Estimated remaining time: 8m 8s [2025-10-22T23:32:08.796617] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:08.843794] [DEBUG] [LOCAL ] HE: Loaded 48806 existing records from primary storage. [2025-10-22T23:32:08.843958] [INFO ] [MAIN ] HE: Loaded 48806 primary data records. [2025-10-22T23:32:09.146431] [DEBUG] [MAIN ] HE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:09.171422] [INFO ] [MAIN ] HE: Generated 138 derivative records from 48806 primary records. [2025-10-22T23:32:09.171529] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-10-22T23:32:09.183049] [DEBUG] [LOCAL ] HE: Derivative data saved (138 records). [2025-10-22T23:32:09.183129] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-10-22T23:32:09.186096] [INFO ] [MAIN ] Derivative Progress: 814/2052 symbols. HE took 0.4s. Estimated remaining time: 8m 8s [2025-10-22T23:32:09.186189] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:09.217191] [DEBUG] [LOCAL ] HEI: Loaded 30521 existing records from primary storage. [2025-10-22T23:32:09.217359] [INFO ] [MAIN ] HEI: Loaded 30521 primary data records. [2025-10-22T23:32:09.518016] [DEBUG] [MAIN ] HEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:09.542958] [INFO ] [MAIN ] HEI: Generated 138 derivative records from 30521 primary records. [2025-10-22T23:32:09.543078] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-10-22T23:32:09.554601] [DEBUG] [LOCAL ] HEI: Derivative data saved (138 records). [2025-10-22T23:32:09.554697] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-10-22T23:32:09.557556] [INFO ] [MAIN ] Derivative Progress: 815/2052 symbols. HEI took 0.4s. Estimated remaining time: 8m 7s [2025-10-22T23:32:09.557689] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:09.568455] [DEBUG] [LOCAL ] HEQ: Loaded 6756 existing records from primary storage. [2025-10-22T23:32:09.568581] [INFO ] [MAIN ] HEQ: Loaded 6756 primary data records. [2025-10-22T23:32:09.879776] [DEBUG] [MAIN ] HEQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:09.905387] [INFO ] [MAIN ] HEQ: Generated 138 derivative records from 6756 primary records. [2025-10-22T23:32:09.905542] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-10-22T23:32:09.916209] [DEBUG] [LOCAL ] HEQ: Derivative data saved (138 records). [2025-10-22T23:32:09.916297] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-10-22T23:32:09.918539] [INFO ] [MAIN ] Derivative Progress: 816/2052 symbols. HEQ took 0.4s. Estimated remaining time: 8m 7s [2025-10-22T23:32:09.918635] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:09.965898] [DEBUG] [LOCAL ] HESM: Loaded 48607 existing records from primary storage. [2025-10-22T23:32:09.966071] [INFO ] [MAIN ] HESM: Loaded 48607 primary data records. [2025-10-22T23:32:10.415555] [DEBUG] [MAIN ] HESM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:10.448055] [INFO ] [MAIN ] HESM: Generated 138 derivative records from 48607 primary records. [2025-10-22T23:32:10.448292] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-10-22T23:32:10.462584] [DEBUG] [LOCAL ] HESM: Derivative data saved (138 records). [2025-10-22T23:32:10.462814] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-10-22T23:32:10.466315] [INFO ] [MAIN ] Derivative Progress: 817/2052 symbols. HESM took 0.5s. Estimated remaining time: 8m 7s [2025-10-22T23:32:10.466489] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:10.490937] [DEBUG] [LOCAL ] HFRO: Loaded 16376 existing records from primary storage. [2025-10-22T23:32:10.491138] [INFO ] [MAIN ] HFRO: Loaded 16376 primary data records. [2025-10-22T23:32:10.958088] [DEBUG] [MAIN ] HFRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:10.984398] [INFO ] [MAIN ] HFRO: Generated 138 derivative records from 16376 primary records. [2025-10-22T23:32:10.984596] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-10-22T23:32:10.996783] [DEBUG] [LOCAL ] HFRO: Derivative data saved (138 records). [2025-10-22T23:32:10.996905] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-10-22T23:32:11.000020] [INFO ] [MAIN ] Derivative Progress: 818/2052 symbols. HFRO took 0.5s. Estimated remaining time: 8m 7s [2025-10-22T23:32:11.000140] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:11.019791] [DEBUG] [LOCAL ] HGER: Loaded 15543 existing records from primary storage. [2025-10-22T23:32:11.019951] [INFO ] [MAIN ] HGER: Loaded 15543 primary data records. [2025-10-22T23:32:11.326884] [DEBUG] [MAIN ] HGER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:11.352241] [INFO ] [MAIN ] HGER: Generated 138 derivative records from 15543 primary records. [2025-10-22T23:32:11.352352] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-10-22T23:32:11.364014] [DEBUG] [LOCAL ] HGER: Derivative data saved (138 records). [2025-10-22T23:32:11.364109] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-10-22T23:32:11.366942] [INFO ] [MAIN ] Derivative Progress: 819/2052 symbols. HGER took 0.4s. Estimated remaining time: 8m 6s [2025-10-22T23:32:11.367040] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:11.380013] [DEBUG] [LOCAL ] HGLB: Loaded 9621 existing records from primary storage. [2025-10-22T23:32:11.380149] [INFO ] [MAIN ] HGLB: Loaded 9621 primary data records. [2025-10-22T23:32:11.686770] [DEBUG] [MAIN ] HGLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:11.713826] [INFO ] [MAIN ] HGLB: Generated 138 derivative records from 9621 primary records. [2025-10-22T23:32:11.713939] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-10-22T23:32:11.726151] [DEBUG] [LOCAL ] HGLB: Derivative data saved (138 records). [2025-10-22T23:32:11.726238] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-10-22T23:32:11.728604] [INFO ] [MAIN ] Derivative Progress: 820/2052 symbols. HGLB took 0.4s. Estimated remaining time: 8m 6s [2025-10-22T23:32:11.728747] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:11.746697] [DEBUG] [LOCAL ] HGTY: Loaded 13361 existing records from primary storage. [2025-10-22T23:32:11.746842] [INFO ] [MAIN ] HGTY: Loaded 13361 primary data records. [2025-10-22T23:32:12.060589] [DEBUG] [MAIN ] HGTY: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:32:12.086098] [INFO ] [MAIN ] HGTY: Generated 138 derivative records from 13361 primary records. [2025-10-22T23:32:12.086269] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-10-22T23:32:12.097889] [DEBUG] [LOCAL ] HGTY: Derivative data saved (138 records). [2025-10-22T23:32:12.098005] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-10-22T23:32:12.101220] [INFO ] [MAIN ] Derivative Progress: 821/2052 symbols. HGTY took 0.4s. Estimated remaining time: 8m 5s [2025-10-22T23:32:12.101355] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:12.145625] [DEBUG] [LOCAL ] HGV: Loaded 46058 existing records from primary storage. [2025-10-22T23:32:12.145807] [INFO ] [MAIN ] HGV: Loaded 46058 primary data records. [2025-10-22T23:32:12.475053] [DEBUG] [MAIN ] HGV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:12.500213] [INFO ] [MAIN ] HGV: Generated 138 derivative records from 46058 primary records. [2025-10-22T23:32:12.500357] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-10-22T23:32:12.511564] [DEBUG] [LOCAL ] HGV: Derivative data saved (138 records). [2025-10-22T23:32:12.511663] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-10-22T23:32:12.514523] [INFO ] [MAIN ] Derivative Progress: 822/2052 symbols. HGV took 0.4s. Estimated remaining time: 8m 5s [2025-10-22T23:32:12.514618] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:12.546475] [DEBUG] [LOCAL ] HHH: Loaded 33047 existing records from primary storage. [2025-10-22T23:32:12.546638] [INFO ] [MAIN ] HHH: Loaded 33047 primary data records. [2025-10-22T23:32:12.854057] [DEBUG] [MAIN ] HHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:12.879119] [INFO ] [MAIN ] HHH: Generated 138 derivative records from 33047 primary records. [2025-10-22T23:32:12.879235] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-10-22T23:32:12.890676] [DEBUG] [LOCAL ] HHH: Derivative data saved (138 records). [2025-10-22T23:32:12.890758] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-10-22T23:32:12.893820] [INFO ] [MAIN ] Derivative Progress: 823/2052 symbols. HHH took 0.4s. Estimated remaining time: 8m 5s [2025-10-22T23:32:12.893937] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:12.929516] [DEBUG] [LOCAL ] HI: Loaded 36110 existing records from primary storage. [2025-10-22T23:32:12.929742] [INFO ] [MAIN ] HI: Loaded 36110 primary data records. [2025-10-22T23:32:13.238474] [DEBUG] [MAIN ] HI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:13.263900] [INFO ] [MAIN ] HI: Generated 138 derivative records from 36110 primary records. [2025-10-22T23:32:13.264045] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-10-22T23:32:13.275880] [DEBUG] [LOCAL ] HI: Derivative data saved (138 records). [2025-10-22T23:32:13.275977] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-10-22T23:32:13.279100] [INFO ] [MAIN ] Derivative Progress: 824/2052 symbols. HI took 0.4s. Estimated remaining time: 8m 4s [2025-10-22T23:32:13.279217] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:13.332030] [DEBUG] [LOCAL ] HIG: Loaded 51135 existing records from primary storage. [2025-10-22T23:32:13.332207] [INFO ] [MAIN ] HIG: Loaded 51135 primary data records. [2025-10-22T23:32:13.637896] [DEBUG] [MAIN ] HIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:13.662740] [INFO ] [MAIN ] HIG: Generated 138 derivative records from 51135 primary records. [2025-10-22T23:32:13.662853] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-10-22T23:32:13.674733] [DEBUG] [LOCAL ] HIG: Derivative data saved (138 records). [2025-10-22T23:32:13.674823] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-10-22T23:32:13.678190] [INFO ] [MAIN ] Derivative Progress: 825/2052 symbols. HIG took 0.4s. Estimated remaining time: 8m 4s [2025-10-22T23:32:13.678303] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:13.714801] [DEBUG] [LOCAL ] HII: Loaded 33319 existing records from primary storage. [2025-10-22T23:32:13.714969] [INFO ] [MAIN ] HII: Loaded 33319 primary data records. [2025-10-22T23:32:14.023353] [DEBUG] [MAIN ] HII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:14.048970] [INFO ] [MAIN ] HII: Generated 138 derivative records from 33319 primary records. [2025-10-22T23:32:14.049097] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-10-22T23:32:14.060713] [DEBUG] [LOCAL ] HII: Derivative data saved (138 records). [2025-10-22T23:32:14.060800] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-10-22T23:32:14.063906] [INFO ] [MAIN ] Derivative Progress: 826/2052 symbols. HII took 0.4s. Estimated remaining time: 8m 3s [2025-10-22T23:32:14.064041] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:14.114219] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-22T23:32:14.114396] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-10-22T23:32:14.424772] [DEBUG] [MAIN ] HIMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:14.450263] [INFO ] [MAIN ] HIMS: Generated 138 derivative records from 53817 primary records. [2025-10-22T23:32:14.450379] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-10-22T23:32:14.462103] [DEBUG] [LOCAL ] HIMS: Derivative data saved (138 records). [2025-10-22T23:32:14.462185] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-10-22T23:32:14.465572] [INFO ] [MAIN ] Derivative Progress: 827/2052 symbols. HIMS took 0.4s. Estimated remaining time: 8m 3s [2025-10-22T23:32:14.465697] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:14.489682] [DEBUG] [LOCAL ] HIO: Loaded 23941 existing records from primary storage. [2025-10-22T23:32:14.489844] [INFO ] [MAIN ] HIO: Loaded 23941 primary data records. [2025-10-22T23:32:14.819197] [DEBUG] [MAIN ] HIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:14.844464] [INFO ] [MAIN ] HIO: Generated 138 derivative records from 23941 primary records. [2025-10-22T23:32:14.844593] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-10-22T23:32:14.856005] [DEBUG] [LOCAL ] HIO: Derivative data saved (138 records). [2025-10-22T23:32:14.856087] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-10-22T23:32:14.859090] [INFO ] [MAIN ] Derivative Progress: 828/2052 symbols. HIO took 0.4s. Estimated remaining time: 8m 3s [2025-10-22T23:32:14.859203] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:14.882370] [DEBUG] [LOCAL ] HIPO: Loaded 21379 existing records from primary storage. [2025-10-22T23:32:14.882505] [INFO ] [MAIN ] HIPO: Loaded 21379 primary data records. [2025-10-22T23:32:15.188935] [DEBUG] [MAIN ] HIPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:15.213896] [INFO ] [MAIN ] HIPO: Generated 138 derivative records from 21379 primary records. [2025-10-22T23:32:15.214001] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-10-22T23:32:15.225206] [DEBUG] [LOCAL ] HIPO: Derivative data saved (138 records). [2025-10-22T23:32:15.225285] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-10-22T23:32:15.228257] [INFO ] [MAIN ] Derivative Progress: 829/2052 symbols. HIPO took 0.4s. Estimated remaining time: 8m 2s [2025-10-22T23:32:15.228362] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:15.272490] [DEBUG] [LOCAL ] HIW: Loaded 44400 existing records from primary storage. [2025-10-22T23:32:15.272695] [INFO ] [MAIN ] HIW: Loaded 44400 primary data records. [2025-10-22T23:32:15.583310] [DEBUG] [MAIN ] HIW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:15.608240] [INFO ] [MAIN ] HIW: Generated 138 derivative records from 44400 primary records. [2025-10-22T23:32:15.608341] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-10-22T23:32:15.619996] [DEBUG] [LOCAL ] HIW: Derivative data saved (138 records). [2025-10-22T23:32:15.620080] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-10-22T23:32:15.623238] [INFO ] [MAIN ] Derivative Progress: 830/2052 symbols. HIW took 0.4s. Estimated remaining time: 8m 2s [2025-10-22T23:32:15.623343] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:15.646197] [DEBUG] [LOCAL ] HIX: Loaded 20442 existing records from primary storage. [2025-10-22T23:32:15.646335] [INFO ] [MAIN ] HIX: Loaded 20442 primary data records. [2025-10-22T23:32:15.955347] [DEBUG] [MAIN ] HIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:15.981038] [INFO ] [MAIN ] HIX: Generated 138 derivative records from 20442 primary records. [2025-10-22T23:32:15.981146] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-10-22T23:32:15.992109] [DEBUG] [LOCAL ] HIX: Derivative data saved (138 records). [2025-10-22T23:32:15.992196] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-10-22T23:32:15.995085] [INFO ] [MAIN ] Derivative Progress: 831/2052 symbols. HIX took 0.4s. Estimated remaining time: 8m 1s [2025-10-22T23:32:15.995197] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:16.015957] [DEBUG] [LOCAL ] HKD: Loaded 18679 existing records from primary storage. [2025-10-22T23:32:16.016113] [INFO ] [MAIN ] HKD: Loaded 18679 primary data records. [2025-10-22T23:32:16.341539] [DEBUG] [MAIN ] HKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:16.366685] [INFO ] [MAIN ] HKD: Generated 138 derivative records from 18679 primary records. [2025-10-22T23:32:16.366872] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-10-22T23:32:16.378258] [DEBUG] [LOCAL ] HKD: Derivative data saved (138 records). [2025-10-22T23:32:16.378359] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-10-22T23:32:16.381308] [INFO ] [MAIN ] Derivative Progress: 832/2052 symbols. HKD took 0.4s. Estimated remaining time: 8m 1s [2025-10-22T23:32:16.381431] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:16.432936] [DEBUG] [LOCAL ] HL: Loaded 53676 existing records from primary storage. [2025-10-22T23:32:16.433102] [INFO ] [MAIN ] HL: Loaded 53676 primary data records. [2025-10-22T23:32:16.762183] [DEBUG] [MAIN ] HL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:16.787534] [INFO ] [MAIN ] HL: Generated 138 derivative records from 53676 primary records. [2025-10-22T23:32:16.787718] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-10-22T23:32:16.799132] [DEBUG] [LOCAL ] HL: Derivative data saved (138 records). [2025-10-22T23:32:16.799221] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-10-22T23:32:16.802630] [INFO ] [MAIN ] Derivative Progress: 833/2052 symbols. HL took 0.4s. Estimated remaining time: 8m 1s [2025-10-22T23:32:16.802787] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:16.847406] [DEBUG] [LOCAL ] HLF: Loaded 48453 existing records from primary storage. [2025-10-22T23:32:16.847581] [INFO ] [MAIN ] HLF: Loaded 48453 primary data records. [2025-10-22T23:32:17.154875] [DEBUG] [MAIN ] HLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:17.180250] [INFO ] [MAIN ] HLF: Generated 138 derivative records from 48453 primary records. [2025-10-22T23:32:17.180380] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-10-22T23:32:17.191789] [DEBUG] [LOCAL ] HLF: Derivative data saved (138 records). [2025-10-22T23:32:17.191870] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-10-22T23:32:17.194816] [INFO ] [MAIN ] Derivative Progress: 834/2052 symbols. HLF took 0.4s. Estimated remaining time: 8m 0s [2025-10-22T23:32:17.194910] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:17.227400] [DEBUG] [LOCAL ] HLI: Loaded 30581 existing records from primary storage. [2025-10-22T23:32:17.227554] [INFO ] [MAIN ] HLI: Loaded 30581 primary data records. [2025-10-22T23:32:17.533280] [DEBUG] [MAIN ] HLI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:17.558149] [INFO ] [MAIN ] HLI: Generated 138 derivative records from 30581 primary records. [2025-10-22T23:32:17.558289] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-10-22T23:32:17.569876] [DEBUG] [LOCAL ] HLI: Derivative data saved (138 records). [2025-10-22T23:32:17.569956] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-10-22T23:32:17.572818] [INFO ] [MAIN ] Derivative Progress: 835/2052 symbols. HLI took 0.4s. Estimated remaining time: 7m 60s [2025-10-22T23:32:17.572927] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:17.600914] [DEBUG] [LOCAL ] HLIO: Loaded 28093 existing records from primary storage. [2025-10-22T23:32:17.601076] [INFO ] [MAIN ] HLIO: Loaded 28093 primary data records. [2025-10-22T23:32:17.937944] [DEBUG] [MAIN ] HLIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:17.963830] [INFO ] [MAIN ] HLIO: Generated 138 derivative records from 28093 primary records. [2025-10-22T23:32:17.963970] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-10-22T23:32:17.975828] [DEBUG] [LOCAL ] HLIO: Derivative data saved (138 records). [2025-10-22T23:32:17.975927] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-10-22T23:32:17.978915] [INFO ] [MAIN ] Derivative Progress: 836/2052 symbols. HLIO took 0.4s. Estimated remaining time: 7m 59s [2025-10-22T23:32:17.979016] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:18.010798] [DEBUG] [LOCAL ] HLLY: Loaded 33310 existing records from primary storage. [2025-10-22T23:32:18.010952] [INFO ] [MAIN ] HLLY: Loaded 33310 primary data records. [2025-10-22T23:32:18.325509] [DEBUG] [MAIN ] HLLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:18.352340] [INFO ] [MAIN ] HLLY: Generated 138 derivative records from 33310 primary records. [2025-10-22T23:32:18.352452] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-10-22T23:32:18.364002] [DEBUG] [LOCAL ] HLLY: Derivative data saved (138 records). [2025-10-22T23:32:18.364084] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-10-22T23:32:18.367062] [INFO ] [MAIN ] Derivative Progress: 837/2052 symbols. HLLY took 0.4s. Estimated remaining time: 7m 59s [2025-10-22T23:32:18.367181] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:18.418886] [DEBUG] [LOCAL ] HLN: Loaded 53128 existing records from primary storage. [2025-10-22T23:32:18.419051] [INFO ] [MAIN ] HLN: Loaded 53128 primary data records. [2025-10-22T23:32:18.764615] [DEBUG] [MAIN ] HLN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:18.790582] [INFO ] [MAIN ] HLN: Generated 138 derivative records from 53128 primary records. [2025-10-22T23:32:18.790757] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-10-22T23:32:18.802658] [DEBUG] [LOCAL ] HLN: Derivative data saved (138 records). [2025-10-22T23:32:18.802743] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-10-22T23:32:18.805935] [INFO ] [MAIN ] Derivative Progress: 838/2052 symbols. HLN took 0.4s. Estimated remaining time: 7m 59s [2025-10-22T23:32:18.806029] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:18.853703] [DEBUG] [LOCAL ] HLT: Loaded 50461 existing records from primary storage. [2025-10-22T23:32:18.853869] [INFO ] [MAIN ] HLT: Loaded 50461 primary data records. [2025-10-22T23:32:19.167078] [DEBUG] [MAIN ] HLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:19.192233] [INFO ] [MAIN ] HLT: Generated 138 derivative records from 50461 primary records. [2025-10-22T23:32:19.192397] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-10-22T23:32:19.204020] [DEBUG] [LOCAL ] HLT: Derivative data saved (138 records). [2025-10-22T23:32:19.204101] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-10-22T23:32:19.207033] [INFO ] [MAIN ] Derivative Progress: 839/2052 symbols. HLT took 0.4s. Estimated remaining time: 7m 58s [2025-10-22T23:32:19.207134] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:19.250599] [DEBUG] [LOCAL ] HLX: Loaded 47326 existing records from primary storage. [2025-10-22T23:32:19.250781] [INFO ] [MAIN ] HLX: Loaded 47326 primary data records. [2025-10-22T23:32:19.557520] [DEBUG] [MAIN ] HLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:19.583759] [INFO ] [MAIN ] HLX: Generated 138 derivative records from 47326 primary records. [2025-10-22T23:32:19.583910] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-10-22T23:32:19.595063] [DEBUG] [LOCAL ] HLX: Derivative data saved (138 records). [2025-10-22T23:32:19.595147] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-10-22T23:32:19.597868] [INFO ] [MAIN ] Derivative Progress: 840/2052 symbols. HLX took 0.4s. Estimated remaining time: 7m 58s [2025-10-22T23:32:19.597968] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:19.641595] [DEBUG] [LOCAL ] HMC: Loaded 46285 existing records from primary storage. [2025-10-22T23:32:19.641789] [INFO ] [MAIN ] HMC: Loaded 46285 primary data records. [2025-10-22T23:32:19.971959] [DEBUG] [MAIN ] HMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:19.997077] [INFO ] [MAIN ] HMC: Generated 138 derivative records from 46285 primary records. [2025-10-22T23:32:19.997295] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-10-22T23:32:20.008837] [DEBUG] [LOCAL ] HMC: Derivative data saved (138 records). [2025-10-22T23:32:20.008915] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-10-22T23:32:20.011579] [INFO ] [MAIN ] Derivative Progress: 841/2052 symbols. HMC took 0.4s. Estimated remaining time: 7m 57s [2025-10-22T23:32:20.011705] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:20.035329] [DEBUG] [LOCAL ] HMN: Loaded 23255 existing records from primary storage. [2025-10-22T23:32:20.035489] [INFO ] [MAIN ] HMN: Loaded 23255 primary data records. [2025-10-22T23:32:20.364076] [DEBUG] [MAIN ] HMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:20.389699] [INFO ] [MAIN ] HMN: Generated 138 derivative records from 23255 primary records. [2025-10-22T23:32:20.389847] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-10-22T23:32:20.401116] [DEBUG] [LOCAL ] HMN: Derivative data saved (138 records). [2025-10-22T23:32:20.401200] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-10-22T23:32:20.403985] [INFO ] [MAIN ] Derivative Progress: 842/2052 symbols. HMN took 0.4s. Estimated remaining time: 7m 57s [2025-10-22T23:32:20.404091] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:20.455981] [DEBUG] [LOCAL ] HMY: Loaded 53166 existing records from primary storage. [2025-10-22T23:32:20.456145] [INFO ] [MAIN ] HMY: Loaded 53166 primary data records. [2025-10-22T23:32:20.790006] [DEBUG] [MAIN ] HMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:20.815671] [INFO ] [MAIN ] HMY: Generated 138 derivative records from 53166 primary records. [2025-10-22T23:32:20.815858] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-10-22T23:32:20.827673] [DEBUG] [LOCAL ] HMY: Derivative data saved (138 records). [2025-10-22T23:32:20.827757] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-10-22T23:32:20.830803] [INFO ] [MAIN ] Derivative Progress: 843/2052 symbols. HMY took 0.4s. Estimated remaining time: 7m 57s [2025-10-22T23:32:20.830904] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:20.859760] [DEBUG] [LOCAL ] HNI: Loaded 29772 existing records from primary storage. [2025-10-22T23:32:20.859916] [INFO ] [MAIN ] HNI: Loaded 29772 primary data records. [2025-10-22T23:32:21.172312] [DEBUG] [MAIN ] HNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:21.198407] [INFO ] [MAIN ] HNI: Generated 138 derivative records from 29772 primary records. [2025-10-22T23:32:21.198558] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-10-22T23:32:21.210016] [DEBUG] [LOCAL ] HNI: Derivative data saved (138 records). [2025-10-22T23:32:21.210126] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-10-22T23:32:21.213001] [INFO ] [MAIN ] Derivative Progress: 844/2052 symbols. HNI took 0.4s. Estimated remaining time: 7m 56s [2025-10-22T23:32:21.213133] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:21.262196] [DEBUG] [LOCAL ] HOG: Loaded 50639 existing records from primary storage. [2025-10-22T23:32:21.262365] [INFO ] [MAIN ] HOG: Loaded 50639 primary data records. [2025-10-22T23:32:21.579480] [DEBUG] [MAIN ] HOG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:21.605455] [INFO ] [MAIN ] HOG: Generated 138 derivative records from 50639 primary records. [2025-10-22T23:32:21.605570] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-10-22T23:32:21.617525] [DEBUG] [LOCAL ] HOG: Derivative data saved (138 records). [2025-10-22T23:32:21.617603] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-10-22T23:32:21.620831] [INFO ] [MAIN ] Derivative Progress: 845/2052 symbols. HOG took 0.4s. Estimated remaining time: 7m 56s [2025-10-22T23:32:21.620929] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:21.661927] [DEBUG] [LOCAL ] HOMB: Loaded 43676 existing records from primary storage. [2025-10-22T23:32:21.662093] [INFO ] [MAIN ] HOMB: Loaded 43676 primary data records. [2025-10-22T23:32:21.982607] [DEBUG] [MAIN ] HOMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:22.008344] [INFO ] [MAIN ] HOMB: Generated 138 derivative records from 43676 primary records. [2025-10-22T23:32:22.008532] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-10-22T23:32:22.020323] [DEBUG] [LOCAL ] HOMB: Derivative data saved (138 records). [2025-10-22T23:32:22.020430] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-10-22T23:32:22.023264] [INFO ] [MAIN ] Derivative Progress: 846/2052 symbols. HOMB took 0.4s. Estimated remaining time: 7m 56s [2025-10-22T23:32:22.023380] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:22.066323] [DEBUG] [LOCAL ] HOUS: Loaded 45734 existing records from primary storage. [2025-10-22T23:32:22.066501] [INFO ] [MAIN ] HOUS: Loaded 45734 primary data records. [2025-10-22T23:32:22.379858] [DEBUG] [MAIN ] HOUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:22.405371] [INFO ] [MAIN ] HOUS: Generated 138 derivative records from 45734 primary records. [2025-10-22T23:32:22.405553] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-10-22T23:32:22.416835] [DEBUG] [LOCAL ] HOUS: Derivative data saved (138 records). [2025-10-22T23:32:22.416962] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-10-22T23:32:22.419762] [INFO ] [MAIN ] Derivative Progress: 847/2052 symbols. HOUS took 0.4s. Estimated remaining time: 7m 55s [2025-10-22T23:32:22.419876] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:22.437160] [DEBUG] [LOCAL ] HOV: Loaded 13798 existing records from primary storage. [2025-10-22T23:32:22.437339] [INFO ] [MAIN ] HOV: Loaded 13798 primary data records. [2025-10-22T23:32:22.752379] [DEBUG] [MAIN ] HOV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:32:22.778576] [INFO ] [MAIN ] HOV: Generated 138 derivative records from 13798 primary records. [2025-10-22T23:32:22.778770] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-10-22T23:32:22.790477] [DEBUG] [LOCAL ] HOV: Derivative data saved (138 records). [2025-10-22T23:32:22.790609] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-10-22T23:32:22.793437] [INFO ] [MAIN ] Derivative Progress: 848/2052 symbols. HOV took 0.4s. Estimated remaining time: 7m 55s [2025-10-22T23:32:22.793578] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:22.844990] [DEBUG] [LOCAL ] HP: Loaded 51399 existing records from primary storage. [2025-10-22T23:32:22.845159] [INFO ] [MAIN ] HP: Loaded 51399 primary data records. [2025-10-22T23:32:23.180620] [DEBUG] [MAIN ] HP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:23.206978] [INFO ] [MAIN ] HP: Generated 138 derivative records from 51399 primary records. [2025-10-22T23:32:23.207128] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-10-22T23:32:23.218848] [DEBUG] [LOCAL ] HP: Derivative data saved (138 records). [2025-10-22T23:32:23.218931] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-10-22T23:32:23.222086] [INFO ] [MAIN ] Derivative Progress: 849/2052 symbols. HP took 0.4s. Estimated remaining time: 7m 54s [2025-10-22T23:32:23.222181] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:23.273868] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-22T23:32:23.274034] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-10-22T23:32:23.588199] [DEBUG] [MAIN ] HPE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:23.613352] [INFO ] [MAIN ] HPE: Generated 138 derivative records from 53697 primary records. [2025-10-22T23:32:23.613486] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-10-22T23:32:23.625468] [DEBUG] [LOCAL ] HPE: Derivative data saved (138 records). [2025-10-22T23:32:23.625551] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-10-22T23:32:23.628720] [INFO ] [MAIN ] Derivative Progress: 850/2052 symbols. HPE took 0.4s. Estimated remaining time: 7m 54s [2025-10-22T23:32:23.628830] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:23.639621] [DEBUG] [LOCAL ] HPF: Loaded 7482 existing records from primary storage. [2025-10-22T23:32:23.639791] [INFO ] [MAIN ] HPF: Loaded 7482 primary data records. [2025-10-22T23:32:23.947549] [DEBUG] [MAIN ] HPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:23.972353] [INFO ] [MAIN ] HPF: Generated 138 derivative records from 7482 primary records. [2025-10-22T23:32:23.972455] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-10-22T23:32:23.983391] [DEBUG] [LOCAL ] HPF: Derivative data saved (138 records). [2025-10-22T23:32:23.983468] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-10-22T23:32:23.985629] [INFO ] [MAIN ] Derivative Progress: 851/2052 symbols. HPF took 0.4s. Estimated remaining time: 7m 54s [2025-10-22T23:32:23.985747] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:23.998542] [DEBUG] [LOCAL ] HPI: Loaded 10731 existing records from primary storage. [2025-10-22T23:32:23.998709] [INFO ] [MAIN ] HPI: Loaded 10731 primary data records. [2025-10-22T23:32:24.300470] [DEBUG] [MAIN ] HPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:24.325526] [INFO ] [MAIN ] HPI: Generated 138 derivative records from 10731 primary records. [2025-10-22T23:32:24.325684] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-10-22T23:32:24.337376] [DEBUG] [LOCAL ] HPI: Derivative data saved (138 records). [2025-10-22T23:32:24.337461] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-10-22T23:32:24.339696] [INFO ] [MAIN ] Derivative Progress: 852/2052 symbols. HPI took 0.4s. Estimated remaining time: 7m 53s [2025-10-22T23:32:24.339786] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:24.386367] [DEBUG] [LOCAL ] HPP: Loaded 51224 existing records from primary storage. [2025-10-22T23:32:24.386529] [INFO ] [MAIN ] HPP: Loaded 51224 primary data records. [2025-10-22T23:32:24.692492] [DEBUG] [MAIN ] HPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:24.718137] [INFO ] [MAIN ] HPP: Generated 138 derivative records from 51224 primary records. [2025-10-22T23:32:24.718248] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-10-22T23:32:24.729698] [DEBUG] [LOCAL ] HPP: Derivative data saved (138 records). [2025-10-22T23:32:24.729779] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-10-22T23:32:24.732857] [INFO ] [MAIN ] Derivative Progress: 853/2052 symbols. HPP took 0.4s. Estimated remaining time: 7m 53s [2025-10-22T23:32:24.732954] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:24.784279] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-10-22T23:32:24.784443] [INFO ] [MAIN ] HPQ: Loaded 53669 primary data records. [2025-10-22T23:32:25.114955] [DEBUG] [MAIN ] HPQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:25.140000] [INFO ] [MAIN ] HPQ: Generated 138 derivative records from 53669 primary records. [2025-10-22T23:32:25.140117] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-10-22T23:32:25.151783] [DEBUG] [LOCAL ] HPQ: Derivative data saved (138 records). [2025-10-22T23:32:25.151866] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-10-22T23:32:25.155070] [INFO ] [MAIN ] Derivative Progress: 854/2052 symbols. HPQ took 0.4s. Estimated remaining time: 7m 52s [2025-10-22T23:32:25.155174] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:25.169280] [DEBUG] [LOCAL ] HPS: Loaded 10322 existing records from primary storage. [2025-10-22T23:32:25.169419] [INFO ] [MAIN ] HPS: Loaded 10322 primary data records. [2025-10-22T23:32:25.479738] [DEBUG] [MAIN ] HPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:25.505273] [INFO ] [MAIN ] HPS: Generated 138 derivative records from 10322 primary records. [2025-10-22T23:32:25.505422] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-10-22T23:32:25.517477] [DEBUG] [LOCAL ] HPS: Derivative data saved (138 records). [2025-10-22T23:32:25.517565] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-10-22T23:32:25.520069] [INFO ] [MAIN ] Derivative Progress: 855/2052 symbols. HPS took 0.4s. Estimated remaining time: 7m 52s [2025-10-22T23:32:25.520165] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:25.547638] [DEBUG] [LOCAL ] HQH: Loaded 25772 existing records from primary storage. [2025-10-22T23:32:25.547828] [INFO ] [MAIN ] HQH: Loaded 25772 primary data records. [2025-10-22T23:32:25.856210] [DEBUG] [MAIN ] HQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:25.881147] [INFO ] [MAIN ] HQH: Generated 138 derivative records from 25772 primary records. [2025-10-22T23:32:25.881337] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-10-22T23:32:25.893020] [DEBUG] [LOCAL ] HQH: Derivative data saved (138 records). [2025-10-22T23:32:25.893129] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-10-22T23:32:25.896080] [INFO ] [MAIN ] Derivative Progress: 856/2052 symbols. HQH took 0.4s. Estimated remaining time: 7m 52s [2025-10-22T23:32:25.896181] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:25.915858] [DEBUG] [LOCAL ] HQL: Loaded 16898 existing records from primary storage. [2025-10-22T23:32:25.916007] [INFO ] [MAIN ] HQL: Loaded 16898 primary data records. [2025-10-22T23:32:26.233619] [DEBUG] [MAIN ] HQL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:26.259699] [INFO ] [MAIN ] HQL: Generated 138 derivative records from 16898 primary records. [2025-10-22T23:32:26.259860] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-10-22T23:32:26.271573] [DEBUG] [LOCAL ] HQL: Derivative data saved (138 records). [2025-10-22T23:32:26.271679] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-10-22T23:32:26.274496] [INFO ] [MAIN ] Derivative Progress: 857/2052 symbols. HQL took 0.4s. Estimated remaining time: 7m 51s [2025-10-22T23:32:26.274605] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:26.328041] [DEBUG] [LOCAL ] HR: Loaded 52108 existing records from primary storage. [2025-10-22T23:32:26.328216] [INFO ] [MAIN ] HR: Loaded 52108 primary data records. [2025-10-22T23:32:26.642845] [DEBUG] [MAIN ] HR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:26.669030] [INFO ] [MAIN ] HR: Generated 138 derivative records from 52108 primary records. [2025-10-22T23:32:26.669204] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-10-22T23:32:26.681468] [DEBUG] [LOCAL ] HR: Derivative data saved (138 records). [2025-10-22T23:32:26.681567] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-10-22T23:32:26.684953] [INFO ] [MAIN ] Derivative Progress: 858/2052 symbols. HR took 0.4s. Estimated remaining time: 7m 51s [2025-10-22T23:32:26.685059] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:26.731340] [DEBUG] [LOCAL ] HRB: Loaded 48219 existing records from primary storage. [2025-10-22T23:32:26.731510] [INFO ] [MAIN ] HRB: Loaded 48219 primary data records. [2025-10-22T23:32:27.074042] [DEBUG] [MAIN ] HRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:27.102480] [INFO ] [MAIN ] HRB: Generated 138 derivative records from 48219 primary records. [2025-10-22T23:32:27.102691] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-10-22T23:32:27.115658] [DEBUG] [LOCAL ] HRB: Derivative data saved (138 records). [2025-10-22T23:32:27.115762] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-10-22T23:32:27.119006] [INFO ] [MAIN ] Derivative Progress: 859/2052 symbols. HRB took 0.4s. Estimated remaining time: 7m 50s [2025-10-22T23:32:27.119117] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:27.154109] [DEBUG] [LOCAL ] HRI: Loaded 32142 existing records from primary storage. [2025-10-22T23:32:27.154305] [INFO ] [MAIN ] HRI: Loaded 32142 primary data records. [2025-10-22T23:32:27.468081] [DEBUG] [MAIN ] HRI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:32:27.493539] [INFO ] [MAIN ] HRI: Generated 138 derivative records from 32142 primary records. [2025-10-22T23:32:27.493743] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-10-22T23:32:27.505357] [DEBUG] [LOCAL ] HRI: Derivative data saved (138 records). [2025-10-22T23:32:27.505435] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-10-22T23:32:27.508428] [INFO ] [MAIN ] Derivative Progress: 860/2052 symbols. HRI took 0.4s. Estimated remaining time: 7m 50s [2025-10-22T23:32:27.508557] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:27.558552] [DEBUG] [LOCAL ] HRL: Loaded 53125 existing records from primary storage. [2025-10-22T23:32:27.558742] [INFO ] [MAIN ] HRL: Loaded 53125 primary data records. [2025-10-22T23:32:27.864874] [DEBUG] [MAIN ] HRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:27.890481] [INFO ] [MAIN ] HRL: Generated 138 derivative records from 53125 primary records. [2025-10-22T23:32:27.890598] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-10-22T23:32:27.902375] [DEBUG] [LOCAL ] HRL: Derivative data saved (138 records). [2025-10-22T23:32:27.902455] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-10-22T23:32:27.905634] [INFO ] [MAIN ] Derivative Progress: 861/2052 symbols. HRL took 0.4s. Estimated remaining time: 7m 50s [2025-10-22T23:32:27.905750] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:27.938925] [DEBUG] [LOCAL ] HRTG: Loaded 34520 existing records from primary storage. [2025-10-22T23:32:27.939096] [INFO ] [MAIN ] HRTG: Loaded 34520 primary data records. [2025-10-22T23:32:28.249361] [DEBUG] [MAIN ] HRTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:28.275022] [INFO ] [MAIN ] HRTG: Generated 138 derivative records from 34520 primary records. [2025-10-22T23:32:28.275223] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-10-22T23:32:28.287134] [DEBUG] [LOCAL ] HRTG: Derivative data saved (138 records). [2025-10-22T23:32:28.287242] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-10-22T23:32:28.290347] [INFO ] [MAIN ] Derivative Progress: 862/2052 symbols. HRTG took 0.4s. Estimated remaining time: 7m 49s [2025-10-22T23:32:28.290486] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:28.340096] [DEBUG] [LOCAL ] HSBC: Loaded 50990 existing records from primary storage. [2025-10-22T23:32:28.340270] [INFO ] [MAIN ] HSBC: Loaded 50990 primary data records. [2025-10-22T23:32:28.650666] [DEBUG] [MAIN ] HSBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:28.675478] [INFO ] [MAIN ] HSBC: Generated 138 derivative records from 50990 primary records. [2025-10-22T23:32:28.675603] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-10-22T23:32:28.687047] [DEBUG] [LOCAL ] HSBC: Derivative data saved (138 records). [2025-10-22T23:32:28.687127] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-10-22T23:32:28.690388] [INFO ] [MAIN ] Derivative Progress: 863/2052 symbols. HSBC took 0.4s. Estimated remaining time: 7m 49s [2025-10-22T23:32:28.690483] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:28.707292] [DEBUG] [LOCAL ] HSHP: Loaded 14457 existing records from primary storage. [2025-10-22T23:32:28.707440] [INFO ] [MAIN ] HSHP: Loaded 14457 primary data records. [2025-10-22T23:32:29.009310] [DEBUG] [MAIN ] HSHP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:29.035066] [INFO ] [MAIN ] HSHP: Generated 138 derivative records from 14457 primary records. [2025-10-22T23:32:29.035249] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-10-22T23:32:29.046421] [DEBUG] [LOCAL ] HSHP: Derivative data saved (138 records). [2025-10-22T23:32:29.046568] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-10-22T23:32:29.049496] [INFO ] [MAIN ] Derivative Progress: 864/2052 symbols. HSHP took 0.4s. Estimated remaining time: 7m 48s [2025-10-22T23:32:29.049605] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:29.100762] [DEBUG] [LOCAL ] HSY: Loaded 50376 existing records from primary storage. [2025-10-22T23:32:29.100927] [INFO ] [MAIN ] HSY: Loaded 50376 primary data records. [2025-10-22T23:32:29.427477] [DEBUG] [MAIN ] HSY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:29.452605] [INFO ] [MAIN ] HSY: Generated 138 derivative records from 50376 primary records. [2025-10-22T23:32:29.452742] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-10-22T23:32:29.467930] [DEBUG] [LOCAL ] HSY: Derivative data saved (138 records). [2025-10-22T23:32:29.468038] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-10-22T23:32:29.471154] [INFO ] [MAIN ] Derivative Progress: 865/2052 symbols. HSY took 0.4s. Estimated remaining time: 7m 48s [2025-10-22T23:32:29.471245] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:29.489379] [DEBUG] [LOCAL ] HTD: Loaded 14245 existing records from primary storage. [2025-10-22T23:32:29.489526] [INFO ] [MAIN ] HTD: Loaded 14245 primary data records. [2025-10-22T23:32:29.800895] [DEBUG] [MAIN ] HTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:29.826237] [INFO ] [MAIN ] HTD: Generated 138 derivative records from 14245 primary records. [2025-10-22T23:32:29.826424] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-10-22T23:32:29.838321] [DEBUG] [LOCAL ] HTD: Derivative data saved (138 records). [2025-10-22T23:32:29.838410] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-10-22T23:32:29.841292] [INFO ] [MAIN ] Derivative Progress: 866/2052 symbols. HTD took 0.4s. Estimated remaining time: 7m 48s [2025-10-22T23:32:29.841447] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:29.890204] [DEBUG] [LOCAL ] HTGC: Loaded 47694 existing records from primary storage. [2025-10-22T23:32:29.890374] [INFO ] [MAIN ] HTGC: Loaded 47694 primary data records. [2025-10-22T23:32:30.197708] [DEBUG] [MAIN ] HTGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:30.223413] [INFO ] [MAIN ] HTGC: Generated 138 derivative records from 47694 primary records. [2025-10-22T23:32:30.223600] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-10-22T23:32:30.235520] [DEBUG] [LOCAL ] HTGC: Derivative data saved (138 records). [2025-10-22T23:32:30.235674] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-10-22T23:32:30.238512] [INFO ] [MAIN ] Derivative Progress: 867/2052 symbols. HTGC took 0.4s. Estimated remaining time: 7m 47s [2025-10-22T23:32:30.238610] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:30.269538] [DEBUG] [LOCAL ] HTH: Loaded 32437 existing records from primary storage. [2025-10-22T23:32:30.269716] [INFO ] [MAIN ] HTH: Loaded 32437 primary data records. [2025-10-22T23:32:30.579329] [DEBUG] [MAIN ] HTH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:30.605334] [INFO ] [MAIN ] HTH: Generated 138 derivative records from 32437 primary records. [2025-10-22T23:32:30.605464] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-10-22T23:32:30.617024] [DEBUG] [LOCAL ] HTH: Derivative data saved (138 records). [2025-10-22T23:32:30.617104] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-10-22T23:32:30.620108] [INFO ] [MAIN ] Derivative Progress: 868/2052 symbols. HTH took 0.4s. Estimated remaining time: 7m 47s [2025-10-22T23:32:30.620209] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:30.655081] [DEBUG] [LOCAL ] HUBB: Loaded 36083 existing records from primary storage. [2025-10-22T23:32:30.655236] [INFO ] [MAIN ] HUBB: Loaded 36083 primary data records. [2025-10-22T23:32:30.969943] [DEBUG] [MAIN ] HUBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:30.995608] [INFO ] [MAIN ] HUBB: Generated 138 derivative records from 36083 primary records. [2025-10-22T23:32:30.995793] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-10-22T23:32:31.007532] [DEBUG] [LOCAL ] HUBB: Derivative data saved (138 records). [2025-10-22T23:32:31.007621] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-10-22T23:32:31.010677] [INFO ] [MAIN ] Derivative Progress: 869/2052 symbols. HUBB took 0.4s. Estimated remaining time: 7m 46s [2025-10-22T23:32:31.010786] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:31.049997] [DEBUG] [LOCAL ] HUBS: Loaded 39936 existing records from primary storage. [2025-10-22T23:32:31.050160] [INFO ] [MAIN ] HUBS: Loaded 39936 primary data records. [2025-10-22T23:32:31.388548] [DEBUG] [MAIN ] HUBS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:32:31.414019] [INFO ] [MAIN ] HUBS: Generated 138 derivative records from 39936 primary records. [2025-10-22T23:32:31.414138] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-10-22T23:32:31.425790] [DEBUG] [LOCAL ] HUBS: Derivative data saved (138 records). [2025-10-22T23:32:31.425870] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-10-22T23:32:31.429033] [INFO ] [MAIN ] Derivative Progress: 870/2052 symbols. HUBS took 0.4s. Estimated remaining time: 7m 46s [2025-10-22T23:32:31.429131] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:31.474730] [DEBUG] [LOCAL ] HUM: Loaded 49274 existing records from primary storage. [2025-10-22T23:32:31.474893] [INFO ] [MAIN ] HUM: Loaded 49274 primary data records. [2025-10-22T23:32:31.781980] [DEBUG] [MAIN ] HUM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:31.807507] [INFO ] [MAIN ] HUM: Generated 138 derivative records from 49274 primary records. [2025-10-22T23:32:31.807817] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-10-22T23:32:31.819617] [DEBUG] [LOCAL ] HUM: Derivative data saved (138 records). [2025-10-22T23:32:31.819725] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-10-22T23:32:31.822916] [INFO ] [MAIN ] Derivative Progress: 871/2052 symbols. HUM took 0.4s. Estimated remaining time: 7m 46s [2025-10-22T23:32:31.823019] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:31.873050] [DEBUG] [LOCAL ] HUN: Loaded 53210 existing records from primary storage. [2025-10-22T23:32:31.873211] [INFO ] [MAIN ] HUN: Loaded 53210 primary data records. [2025-10-22T23:32:32.181218] [DEBUG] [MAIN ] HUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:32.206831] [INFO ] [MAIN ] HUN: Generated 138 derivative records from 53210 primary records. [2025-10-22T23:32:32.206952] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-10-22T23:32:32.218737] [DEBUG] [LOCAL ] HUN: Derivative data saved (138 records). [2025-10-22T23:32:32.218817] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-10-22T23:32:32.221839] [INFO ] [MAIN ] Derivative Progress: 872/2052 symbols. HUN took 0.4s. Estimated remaining time: 7m 45s [2025-10-22T23:32:32.221936] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:32.262372] [DEBUG] [LOCAL ] HUYA: Loaded 43617 existing records from primary storage. [2025-10-22T23:32:32.262537] [INFO ] [MAIN ] HUYA: Loaded 43617 primary data records. [2025-10-22T23:32:32.570300] [DEBUG] [MAIN ] HUYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:32.596390] [INFO ] [MAIN ] HUYA: Generated 138 derivative records from 43617 primary records. [2025-10-22T23:32:32.596588] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-10-22T23:32:32.608404] [DEBUG] [LOCAL ] HUYA: Derivative data saved (138 records). [2025-10-22T23:32:32.608556] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-10-22T23:32:32.611468] [INFO ] [MAIN ] Derivative Progress: 873/2052 symbols. HUYA took 0.4s. Estimated remaining time: 7m 45s [2025-10-22T23:32:32.611566] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:32.630825] [DEBUG] [LOCAL ] HVT: Loaded 14734 existing records from primary storage. [2025-10-22T23:32:32.630985] [INFO ] [MAIN ] HVT: Loaded 14734 primary data records. [2025-10-22T23:32:32.942201] [DEBUG] [MAIN ] HVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:32.967474] [INFO ] [MAIN ] HVT: Generated 138 derivative records from 14734 primary records. [2025-10-22T23:32:32.967606] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-10-22T23:32:32.979248] [DEBUG] [LOCAL ] HVT: Derivative data saved (138 records). [2025-10-22T23:32:32.979326] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-10-22T23:32:32.981970] [INFO ] [MAIN ] Derivative Progress: 874/2052 symbols. HVT took 0.4s. Estimated remaining time: 7m 44s [2025-10-22T23:32:32.982065] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:33.035191] [DEBUG] [LOCAL ] HWM: Loaded 52700 existing records from primary storage. [2025-10-22T23:32:33.035358] [INFO ] [MAIN ] HWM: Loaded 52700 primary data records. [2025-10-22T23:32:33.363879] [DEBUG] [MAIN ] HWM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:33.389225] [INFO ] [MAIN ] HWM: Generated 138 derivative records from 52700 primary records. [2025-10-22T23:32:33.389369] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-10-22T23:32:33.401345] [DEBUG] [LOCAL ] HWM: Derivative data saved (138 records). [2025-10-22T23:32:33.401423] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-10-22T23:32:33.404484] [INFO ] [MAIN ] Derivative Progress: 875/2052 symbols. HWM took 0.4s. Estimated remaining time: 7m 44s [2025-10-22T23:32:33.404578] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:33.446772] [DEBUG] [LOCAL ] HXL: Loaded 45788 existing records from primary storage. [2025-10-22T23:32:33.446931] [INFO ] [MAIN ] HXL: Loaded 45788 primary data records. [2025-10-22T23:32:33.749257] [DEBUG] [MAIN ] HXL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:33.774088] [INFO ] [MAIN ] HXL: Generated 138 derivative records from 45788 primary records. [2025-10-22T23:32:33.774212] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-10-22T23:32:33.785577] [DEBUG] [LOCAL ] HXL: Derivative data saved (138 records). [2025-10-22T23:32:33.785680] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-10-22T23:32:33.788289] [INFO ] [MAIN ] Derivative Progress: 876/2052 symbols. HXL took 0.4s. Estimated remaining time: 7m 44s [2025-10-22T23:32:33.788386] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:33.801562] [DEBUG] [LOCAL ] HY: Loaded 9852 existing records from primary storage. [2025-10-22T23:32:33.801709] [INFO ] [MAIN ] HY: Loaded 9852 primary data records. [2025-10-22T23:32:34.104945] [DEBUG] [MAIN ] HY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:34.130051] [INFO ] [MAIN ] HY: Generated 138 derivative records from 9852 primary records. [2025-10-22T23:32:34.130163] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-10-22T23:32:34.141625] [DEBUG] [LOCAL ] HY: Derivative data saved (138 records). [2025-10-22T23:32:34.141721] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-10-22T23:32:34.143716] [INFO ] [MAIN ] Derivative Progress: 877/2052 symbols. HY took 0.4s. Estimated remaining time: 7m 43s [2025-10-22T23:32:34.143807] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:34.157077] [DEBUG] [LOCAL ] HYI: Loaded 9586 existing records from primary storage. [2025-10-22T23:32:34.157210] [INFO ] [MAIN ] HYI: Loaded 9586 primary data records. [2025-10-22T23:32:34.462546] [DEBUG] [MAIN ] HYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:34.487694] [INFO ] [MAIN ] HYI: Generated 138 derivative records from 9586 primary records. [2025-10-22T23:32:34.487812] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-10-22T23:32:34.499125] [DEBUG] [LOCAL ] HYI: Derivative data saved (138 records). [2025-10-22T23:32:34.499205] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-10-22T23:32:34.501252] [INFO ] [MAIN ] Derivative Progress: 878/2052 symbols. HYI took 0.4s. Estimated remaining time: 7m 43s [2025-10-22T23:32:34.501343] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:34.533851] [DEBUG] [LOCAL ] HYT: Loaded 33567 existing records from primary storage. [2025-10-22T23:32:34.533998] [INFO ] [MAIN ] HYT: Loaded 33567 primary data records. [2025-10-22T23:32:34.837775] [DEBUG] [MAIN ] HYT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:34.862801] [INFO ] [MAIN ] HYT: Generated 138 derivative records from 33567 primary records. [2025-10-22T23:32:34.862935] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-10-22T23:32:34.874477] [DEBUG] [LOCAL ] HYT: Derivative data saved (138 records). [2025-10-22T23:32:34.874555] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-10-22T23:32:34.877375] [INFO ] [MAIN ] Derivative Progress: 879/2052 symbols. HYT took 0.4s. Estimated remaining time: 7m 42s [2025-10-22T23:32:34.877472] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:34.883024] [DEBUG] [LOCAL ] HYTR: Loaded 3093 existing records from primary storage. [2025-10-22T23:32:34.883115] [INFO ] [MAIN ] HYTR: Loaded 3093 primary data records. [2025-10-22T23:32:35.215022] [DEBUG] [MAIN ] HYTR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:32:35.240357] [INFO ] [MAIN ] HYTR: Generated 138 derivative records from 3093 primary records. [2025-10-22T23:32:35.240482] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-10-22T23:32:35.250623] [DEBUG] [LOCAL ] HYTR: Derivative data saved (138 records). [2025-10-22T23:32:35.250724] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-10-22T23:32:35.252778] [INFO ] [MAIN ] Derivative Progress: 880/2052 symbols. HYTR took 0.4s. Estimated remaining time: 7m 42s [2025-10-22T23:32:35.252876] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:35.281105] [DEBUG] [LOCAL ] HZO: Loaded 28526 existing records from primary storage. [2025-10-22T23:32:35.281252] [INFO ] [MAIN ] HZO: Loaded 28526 primary data records. [2025-10-22T23:32:35.586145] [DEBUG] [MAIN ] HZO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:35.611027] [INFO ] [MAIN ] HZO: Generated 138 derivative records from 28526 primary records. [2025-10-22T23:32:35.611150] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-10-22T23:32:35.622464] [DEBUG] [LOCAL ] HZO: Derivative data saved (138 records). [2025-10-22T23:32:35.622543] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-10-22T23:32:35.625414] [INFO ] [MAIN ] Derivative Progress: 881/2052 symbols. HZO took 0.4s. Estimated remaining time: 7m 41s [2025-10-22T23:32:35.625515] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:35.635696] [DEBUG] [LOCAL ] IAE: Loaded 6307 existing records from primary storage. [2025-10-22T23:32:35.635819] [INFO ] [MAIN ] IAE: Loaded 6307 primary data records. [2025-10-22T23:32:35.937054] [DEBUG] [MAIN ] IAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:35.962000] [INFO ] [MAIN ] IAE: Generated 138 derivative records from 6307 primary records. [2025-10-22T23:32:35.962126] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-10-22T23:32:35.972205] [DEBUG] [LOCAL ] IAE: Derivative data saved (138 records). [2025-10-22T23:32:35.972286] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-10-22T23:32:35.974407] [INFO ] [MAIN ] Derivative Progress: 882/2052 symbols. IAE took 0.3s. Estimated remaining time: 7m 41s [2025-10-22T23:32:35.974502] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:36.031082] [DEBUG] [LOCAL ] IAG: Loaded 53492 existing records from primary storage. [2025-10-22T23:32:36.031244] [INFO ] [MAIN ] IAG: Loaded 53492 primary data records. [2025-10-22T23:32:36.333779] [DEBUG] [MAIN ] IAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:36.358587] [INFO ] [MAIN ] IAG: Generated 138 derivative records from 53492 primary records. [2025-10-22T23:32:36.358720] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-22T23:32:36.369997] [DEBUG] [LOCAL ] IAG: Derivative data saved (138 records). [2025-10-22T23:32:36.370078] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-10-22T23:32:36.373114] [INFO ] [MAIN ] Derivative Progress: 883/2052 symbols. IAG took 0.4s. Estimated remaining time: 7m 41s [2025-10-22T23:32:36.373209] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:36.422397] [DEBUG] [LOCAL ] IBM: Loaded 53628 existing records from primary storage. [2025-10-22T23:32:36.422568] [INFO ] [MAIN ] IBM: Loaded 53628 primary data records. [2025-10-22T23:32:36.726349] [DEBUG] [MAIN ] IBM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:36.751168] [INFO ] [MAIN ] IBM: Generated 138 derivative records from 53628 primary records. [2025-10-22T23:32:36.751270] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-22T23:32:36.762903] [DEBUG] [LOCAL ] IBM: Derivative data saved (138 records). [2025-10-22T23:32:36.762989] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-10-22T23:32:36.766188] [INFO ] [MAIN ] Derivative Progress: 884/2052 symbols. IBM took 0.4s. Estimated remaining time: 7m 40s [2025-10-22T23:32:36.766287] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:36.814982] [DEBUG] [LOCAL ] IBN: Loaded 52834 existing records from primary storage. [2025-10-22T23:32:36.815141] [INFO ] [MAIN ] IBN: Loaded 52834 primary data records. [2025-10-22T23:32:37.117823] [DEBUG] [MAIN ] IBN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:37.142595] [INFO ] [MAIN ] IBN: Generated 138 derivative records from 52834 primary records. [2025-10-22T23:32:37.142716] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-22T23:32:37.154094] [DEBUG] [LOCAL ] IBN: Derivative data saved (138 records). [2025-10-22T23:32:37.154176] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-10-22T23:32:37.157174] [INFO ] [MAIN ] Derivative Progress: 885/2052 symbols. IBN took 0.4s. Estimated remaining time: 7m 40s [2025-10-22T23:32:37.157291] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:37.186303] [DEBUG] [LOCAL ] IBP: Loaded 28663 existing records from primary storage. [2025-10-22T23:32:37.186450] [INFO ] [MAIN ] IBP: Loaded 28663 primary data records. [2025-10-22T23:32:37.551569] [DEBUG] [MAIN ] IBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:37.580100] [INFO ] [MAIN ] IBP: Generated 138 derivative records from 28663 primary records. [2025-10-22T23:32:37.580290] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-10-22T23:32:37.592172] [DEBUG] [LOCAL ] IBP: Derivative data saved (138 records). [2025-10-22T23:32:37.592274] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-10-22T23:32:37.595120] [INFO ] [MAIN ] Derivative Progress: 886/2052 symbols. IBP took 0.4s. Estimated remaining time: 7m 40s [2025-10-22T23:32:37.595226] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:37.633906] [DEBUG] [LOCAL ] IBTA: Loaded 36072 existing records from primary storage. [2025-10-22T23:32:37.634091] [INFO ] [MAIN ] IBTA: Loaded 36072 primary data records. [2025-10-22T23:32:37.958250] [DEBUG] [MAIN ] IBTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:37.983934] [INFO ] [MAIN ] IBTA: Generated 138 derivative records from 36072 primary records. [2025-10-22T23:32:37.984064] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-22T23:32:37.995589] [DEBUG] [LOCAL ] IBTA: Derivative data saved (138 records). [2025-10-22T23:32:37.995698] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-22T23:32:37.998566] [INFO ] [MAIN ] Derivative Progress: 887/2052 symbols. IBTA took 0.4s. Estimated remaining time: 7m 39s [2025-10-22T23:32:37.998728] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:38.057535] [DEBUG] [LOCAL ] ICE: Loaded 53009 existing records from primary storage. [2025-10-22T23:32:38.057730] [INFO ] [MAIN ] ICE: Loaded 53009 primary data records. [2025-10-22T23:32:38.363189] [DEBUG] [MAIN ] ICE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:38.388594] [INFO ] [MAIN ] ICE: Generated 138 derivative records from 53009 primary records. [2025-10-22T23:32:38.388776] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-22T23:32:38.400601] [DEBUG] [LOCAL ] ICE: Derivative data saved (138 records). [2025-10-22T23:32:38.400704] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-22T23:32:38.403817] [INFO ] [MAIN ] Derivative Progress: 888/2052 symbols. ICE took 0.4s. Estimated remaining time: 7m 39s [2025-10-22T23:32:38.403915] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:38.439249] [DEBUG] [LOCAL ] ICL: Loaded 38132 existing records from primary storage. [2025-10-22T23:32:38.439414] [INFO ] [MAIN ] ICL: Loaded 38132 primary data records. [2025-10-22T23:32:38.748988] [DEBUG] [MAIN ] ICL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:38.774426] [INFO ] [MAIN ] ICL: Generated 138 derivative records from 38132 primary records. [2025-10-22T23:32:38.774544] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-22T23:32:38.785931] [DEBUG] [LOCAL ] ICL: Derivative data saved (138 records). [2025-10-22T23:32:38.786019] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-22T23:32:38.789057] [INFO ] [MAIN ] Derivative Progress: 889/2052 symbols. ICL took 0.4s. Estimated remaining time: 7m 38s [2025-10-22T23:32:38.789148] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:38.822378] [DEBUG] [LOCAL ] IDA: Loaded 32728 existing records from primary storage. [2025-10-22T23:32:38.822542] [INFO ] [MAIN ] IDA: Loaded 32728 primary data records. [2025-10-22T23:32:39.131232] [DEBUG] [MAIN ] IDA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:39.156659] [INFO ] [MAIN ] IDA: Generated 138 derivative records from 32728 primary records. [2025-10-22T23:32:39.156823] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-22T23:32:39.168482] [DEBUG] [LOCAL ] IDA: Derivative data saved (138 records). [2025-10-22T23:32:39.168563] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-10-22T23:32:39.171460] [INFO ] [MAIN ] Derivative Progress: 890/2052 symbols. IDA took 0.4s. Estimated remaining time: 7m 38s [2025-10-22T23:32:39.171553] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:39.184733] [DEBUG] [LOCAL ] IDE: Loaded 9050 existing records from primary storage. [2025-10-22T23:32:39.184864] [INFO ] [MAIN ] IDE: Loaded 9050 primary data records. [2025-10-22T23:32:39.517539] [DEBUG] [MAIN ] IDE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:39.543456] [INFO ] [MAIN ] IDE: Generated 138 derivative records from 9050 primary records. [2025-10-22T23:32:39.543663] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-22T23:32:39.555408] [DEBUG] [LOCAL ] IDE: Derivative data saved (138 records). [2025-10-22T23:32:39.555505] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-22T23:32:39.557902] [INFO ] [MAIN ] Derivative Progress: 891/2052 symbols. IDE took 0.4s. Estimated remaining time: 7m 38s [2025-10-22T23:32:39.558033] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:39.578325] [DEBUG] [LOCAL ] IDT: Loaded 18550 existing records from primary storage. [2025-10-22T23:32:39.578485] [INFO ] [MAIN ] IDT: Loaded 18550 primary data records. [2025-10-22T23:32:39.887219] [DEBUG] [MAIN ] IDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:39.912529] [INFO ] [MAIN ] IDT: Generated 138 derivative records from 18550 primary records. [2025-10-22T23:32:39.912689] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-22T23:32:39.923904] [DEBUG] [LOCAL ] IDT: Derivative data saved (138 records). [2025-10-22T23:32:39.923983] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-22T23:32:39.926911] [INFO ] [MAIN ] Derivative Progress: 892/2052 symbols. IDT took 0.4s. Estimated remaining time: 7m 37s [2025-10-22T23:32:39.927011] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:39.964959] [DEBUG] [LOCAL ] IEX: Loaded 38271 existing records from primary storage. [2025-10-22T23:32:39.965113] [INFO ] [MAIN ] IEX: Loaded 38271 primary data records. [2025-10-22T23:32:40.273191] [DEBUG] [MAIN ] IEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:40.298346] [INFO ] [MAIN ] IEX: Generated 138 derivative records from 38271 primary records. [2025-10-22T23:32:40.298457] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-22T23:32:40.310273] [DEBUG] [LOCAL ] IEX: Derivative data saved (138 records). [2025-10-22T23:32:40.310353] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-22T23:32:40.313220] [INFO ] [MAIN ] Derivative Progress: 893/2052 symbols. IEX took 0.4s. Estimated remaining time: 7m 37s [2025-10-22T23:32:40.313318] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:40.362912] [DEBUG] [LOCAL ] IFF: Loaded 51225 existing records from primary storage. [2025-10-22T23:32:40.363059] [INFO ] [MAIN ] IFF: Loaded 51225 primary data records. [2025-10-22T23:32:40.669081] [DEBUG] [MAIN ] IFF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:40.694202] [INFO ] [MAIN ] IFF: Generated 138 derivative records from 51225 primary records. [2025-10-22T23:32:40.694309] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-22T23:32:40.705952] [DEBUG] [LOCAL ] IFF: Derivative data saved (138 records). [2025-10-22T23:32:40.706035] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-22T23:32:40.709401] [INFO ] [MAIN ] Derivative Progress: 894/2052 symbols. IFF took 0.4s. Estimated remaining time: 7m 36s [2025-10-22T23:32:40.709505] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:40.730098] [DEBUG] [LOCAL ] IFN: Loaded 18590 existing records from primary storage. [2025-10-22T23:32:40.730237] [INFO ] [MAIN ] IFN: Loaded 18590 primary data records. [2025-10-22T23:32:41.034607] [DEBUG] [MAIN ] IFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:41.059604] [INFO ] [MAIN ] IFN: Generated 138 derivative records from 18590 primary records. [2025-10-22T23:32:41.059735] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-22T23:32:41.071364] [DEBUG] [LOCAL ] IFN: Derivative data saved (138 records). [2025-10-22T23:32:41.071459] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-22T23:32:41.074233] [INFO ] [MAIN ] Derivative Progress: 895/2052 symbols. IFN took 0.4s. Estimated remaining time: 7m 36s [2025-10-22T23:32:41.074351] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:41.097538] [DEBUG] [LOCAL ] IFS: Loaded 22165 existing records from primary storage. [2025-10-22T23:32:41.097715] [INFO ] [MAIN ] IFS: Loaded 22165 primary data records. [2025-10-22T23:32:41.427177] [DEBUG] [MAIN ] IFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:41.452341] [INFO ] [MAIN ] IFS: Generated 138 derivative records from 22165 primary records. [2025-10-22T23:32:41.452471] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-22T23:32:41.463810] [DEBUG] [LOCAL ] IFS: Derivative data saved (138 records). [2025-10-22T23:32:41.463895] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-10-22T23:32:41.466743] [INFO ] [MAIN ] Derivative Progress: 896/2052 symbols. IFS took 0.4s. Estimated remaining time: 7m 35s [2025-10-22T23:32:41.466845] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:41.480155] [DEBUG] [LOCAL ] IGA: Loaded 10128 existing records from primary storage. [2025-10-22T23:32:41.480296] [INFO ] [MAIN ] IGA: Loaded 10128 primary data records. [2025-10-22T23:32:41.782789] [DEBUG] [MAIN ] IGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:41.808347] [INFO ] [MAIN ] IGA: Generated 138 derivative records from 10128 primary records. [2025-10-22T23:32:41.808481] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-22T23:32:41.820758] [DEBUG] [LOCAL ] IGA: Derivative data saved (138 records). [2025-10-22T23:32:41.820852] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-22T23:32:41.823478] [INFO ] [MAIN ] Derivative Progress: 897/2052 symbols. IGA took 0.4s. Estimated remaining time: 7m 35s [2025-10-22T23:32:41.823575] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:41.844095] [DEBUG] [LOCAL ] IGD: Loaded 19135 existing records from primary storage. [2025-10-22T23:32:41.844242] [INFO ] [MAIN ] IGD: Loaded 19135 primary data records. [2025-10-22T23:32:42.145502] [DEBUG] [MAIN ] IGD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:42.170368] [INFO ] [MAIN ] IGD: Generated 138 derivative records from 19135 primary records. [2025-10-22T23:32:42.170482] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-22T23:32:42.181526] [DEBUG] [LOCAL ] IGD: Derivative data saved (138 records). [2025-10-22T23:32:42.181608] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-22T23:32:42.184498] [INFO ] [MAIN ] Derivative Progress: 898/2052 symbols. IGD took 0.4s. Estimated remaining time: 7m 35s [2025-10-22T23:32:42.184595] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:42.193157] [DEBUG] [LOCAL ] IGI: Loaded 4050 existing records from primary storage. [2025-10-22T23:32:42.193271] [INFO ] [MAIN ] IGI: Loaded 4050 primary data records. [2025-10-22T23:32:42.493501] [DEBUG] [MAIN ] IGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:42.521967] [INFO ] [MAIN ] IGI: Generated 138 derivative records from 4050 primary records. [2025-10-22T23:32:42.522167] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-22T23:32:42.532010] [DEBUG] [LOCAL ] IGI: Derivative data saved (138 records). [2025-10-22T23:32:42.532090] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-22T23:32:42.534361] [INFO ] [MAIN ] Derivative Progress: 899/2052 symbols. IGI took 0.3s. Estimated remaining time: 7m 34s [2025-10-22T23:32:42.534463] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:42.564532] [DEBUG] [LOCAL ] IGR: Loaded 30409 existing records from primary storage. [2025-10-22T23:32:42.564704] [INFO ] [MAIN ] IGR: Loaded 30409 primary data records. [2025-10-22T23:32:42.869194] [DEBUG] [MAIN ] IGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:42.896102] [INFO ] [MAIN ] IGR: Generated 138 derivative records from 30409 primary records. [2025-10-22T23:32:42.896298] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-22T23:32:42.910521] [DEBUG] [LOCAL ] IGR: Derivative data saved (138 records). [2025-10-22T23:32:42.910627] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-22T23:32:42.913605] [INFO ] [MAIN ] Derivative Progress: 900/2052 symbols. IGR took 0.4s. Estimated remaining time: 7m 34s [2025-10-22T23:32:42.913756] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:42.919250] [DEBUG] [LOCAL ] IH: Loaded 2722 existing records from primary storage. [2025-10-22T23:32:42.919346] [INFO ] [MAIN ] IH: Loaded 2722 primary data records. [2025-10-22T23:32:43.228711] [DEBUG] [MAIN ] IH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:43.254208] [INFO ] [MAIN ] IH: Generated 138 derivative records from 2722 primary records. [2025-10-22T23:32:43.254400] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-22T23:32:43.263440] [DEBUG] [LOCAL ] IH: Derivative data saved (138 records). [2025-10-22T23:32:43.263524] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-10-22T23:32:43.265848] [INFO ] [MAIN ] Derivative Progress: 901/2052 symbols. IH took 0.4s. Estimated remaining time: 7m 33s [2025-10-22T23:32:43.265946] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:43.275557] [DEBUG] [LOCAL ] IHD: Loaded 7364 existing records from primary storage. [2025-10-22T23:32:43.275739] [INFO ] [MAIN ] IHD: Loaded 7364 primary data records. [2025-10-22T23:32:43.603731] [DEBUG] [MAIN ] IHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:43.629826] [INFO ] [MAIN ] IHD: Generated 138 derivative records from 7364 primary records. [2025-10-22T23:32:43.629997] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-22T23:32:43.640659] [DEBUG] [LOCAL ] IHD: Derivative data saved (138 records). [2025-10-22T23:32:43.640765] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-22T23:32:43.643099] [INFO ] [MAIN ] Derivative Progress: 902/2052 symbols. IHD took 0.4s. Estimated remaining time: 7m 33s [2025-10-22T23:32:43.643205] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:43.667137] [DEBUG] [LOCAL ] IHG: Loaded 23951 existing records from primary storage. [2025-10-22T23:32:43.667348] [INFO ] [MAIN ] IHG: Loaded 23951 primary data records. [2025-10-22T23:32:43.975745] [DEBUG] [MAIN ] IHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:44.001057] [INFO ] [MAIN ] IHG: Generated 138 derivative records from 23951 primary records. [2025-10-22T23:32:44.001191] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-22T23:32:44.012843] [DEBUG] [LOCAL ] IHG: Derivative data saved (138 records). [2025-10-22T23:32:44.012925] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-22T23:32:44.015788] [INFO ] [MAIN ] Derivative Progress: 903/2052 symbols. IHG took 0.4s. Estimated remaining time: 7m 32s [2025-10-22T23:32:44.015892] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:44.050182] [DEBUG] [LOCAL ] IHS: Loaded 37211 existing records from primary storage. [2025-10-22T23:32:44.050347] [INFO ] [MAIN ] IHS: Loaded 37211 primary data records. [2025-10-22T23:32:44.361529] [DEBUG] [MAIN ] IHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:44.387786] [INFO ] [MAIN ] IHS: Generated 138 derivative records from 37211 primary records. [2025-10-22T23:32:44.387967] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-22T23:32:44.399524] [DEBUG] [LOCAL ] IHS: Derivative data saved (138 records). [2025-10-22T23:32:44.399613] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-10-22T23:32:44.402628] [INFO ] [MAIN ] Derivative Progress: 904/2052 symbols. IHS took 0.4s. Estimated remaining time: 7m 32s [2025-10-22T23:32:44.402758] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:44.412442] [DEBUG] [LOCAL ] IIF: Loaded 5278 existing records from primary storage. [2025-10-22T23:32:44.412581] [INFO ] [MAIN ] IIF: Loaded 5278 primary data records. [2025-10-22T23:32:44.731077] [DEBUG] [MAIN ] IIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:44.757630] [INFO ] [MAIN ] IIF: Generated 138 derivative records from 5278 primary records. [2025-10-22T23:32:44.757821] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-22T23:32:44.768428] [DEBUG] [LOCAL ] IIF: Derivative data saved (138 records). [2025-10-22T23:32:44.768507] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-22T23:32:44.770811] [INFO ] [MAIN ] Derivative Progress: 905/2052 symbols. IIF took 0.4s. Estimated remaining time: 7m 32s [2025-10-22T23:32:44.770915] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:44.788243] [DEBUG] [LOCAL ] IIIN: Loaded 16243 existing records from primary storage. [2025-10-22T23:32:44.788390] [INFO ] [MAIN ] IIIN: Loaded 16243 primary data records. [2025-10-22T23:32:45.094315] [DEBUG] [MAIN ] IIIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:45.120435] [INFO ] [MAIN ] IIIN: Generated 138 derivative records from 16243 primary records. [2025-10-22T23:32:45.120613] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-22T23:32:45.131987] [DEBUG] [LOCAL ] IIIN: Derivative data saved (138 records). [2025-10-22T23:32:45.132068] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-10-22T23:32:45.134896] [INFO ] [MAIN ] Derivative Progress: 906/2052 symbols. IIIN took 0.4s. Estimated remaining time: 7m 31s [2025-10-22T23:32:45.134998] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:45.152550] [DEBUG] [LOCAL ] IIM: Loaded 15480 existing records from primary storage. [2025-10-22T23:32:45.152742] [INFO ] [MAIN ] IIM: Loaded 15480 primary data records. [2025-10-22T23:32:45.495469] [DEBUG] [MAIN ] IIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:45.521846] [INFO ] [MAIN ] IIM: Generated 138 derivative records from 15480 primary records. [2025-10-22T23:32:45.522005] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-22T23:32:45.534739] [DEBUG] [LOCAL ] IIM: Derivative data saved (138 records). [2025-10-22T23:32:45.534827] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-22T23:32:45.537684] [INFO ] [MAIN ] Derivative Progress: 907/2052 symbols. IIM took 0.4s. Estimated remaining time: 7m 31s [2025-10-22T23:32:45.537781] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:45.566504] [DEBUG] [LOCAL ] IIPR: Loaded 28846 existing records from primary storage. [2025-10-22T23:32:45.566706] [INFO ] [MAIN ] IIPR: Loaded 28846 primary data records. [2025-10-22T23:32:45.889973] [DEBUG] [MAIN ] IIPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:45.916014] [INFO ] [MAIN ] IIPR: Generated 138 derivative records from 28846 primary records. [2025-10-22T23:32:45.916142] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-22T23:32:45.928082] [DEBUG] [LOCAL ] IIPR: Derivative data saved (138 records). [2025-10-22T23:32:45.928163] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-22T23:32:45.931573] [INFO ] [MAIN ] Derivative Progress: 908/2052 symbols. IIPR took 0.4s. Estimated remaining time: 7m 30s [2025-10-22T23:32:45.931700] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:45.972909] [DEBUG] [LOCAL ] IMAX: Loaded 43444 existing records from primary storage. [2025-10-22T23:32:45.973068] [INFO ] [MAIN ] IMAX: Loaded 43444 primary data records. [2025-10-22T23:32:46.276152] [DEBUG] [MAIN ] IMAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:46.302230] [INFO ] [MAIN ] IMAX: Generated 138 derivative records from 43444 primary records. [2025-10-22T23:32:46.302415] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-22T23:32:46.314397] [DEBUG] [LOCAL ] IMAX: Derivative data saved (138 records). [2025-10-22T23:32:46.314548] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-10-22T23:32:46.317454] [INFO ] [MAIN ] Derivative Progress: 909/2052 symbols. IMAX took 0.4s. Estimated remaining time: 7m 30s [2025-10-22T23:32:46.317577] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:46.363867] [DEBUG] [LOCAL ] INFA: Loaded 48602 existing records from primary storage. [2025-10-22T23:32:46.364042] [INFO ] [MAIN ] INFA: Loaded 48602 primary data records. [2025-10-22T23:32:46.679186] [DEBUG] [MAIN ] INFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:46.705225] [INFO ] [MAIN ] INFA: Generated 138 derivative records from 48602 primary records. [2025-10-22T23:32:46.705373] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-22T23:32:46.718154] [DEBUG] [LOCAL ] INFA: Derivative data saved (138 records). [2025-10-22T23:32:46.718308] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-22T23:32:46.721444] [INFO ] [MAIN ] Derivative Progress: 910/2052 symbols. INFA took 0.4s. Estimated remaining time: 7m 30s [2025-10-22T23:32:46.721538] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:46.775915] [DEBUG] [LOCAL ] INFY: Loaded 53596 existing records from primary storage. [2025-10-22T23:32:46.776082] [INFO ] [MAIN ] INFY: Loaded 53596 primary data records. [2025-10-22T23:32:47.099146] [DEBUG] [MAIN ] INFY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:47.126067] [INFO ] [MAIN ] INFY: Generated 138 derivative records from 53596 primary records. [2025-10-22T23:32:47.126223] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-22T23:32:47.138315] [DEBUG] [LOCAL ] INFY: Derivative data saved (138 records). [2025-10-22T23:32:47.138409] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-22T23:32:47.141563] [INFO ] [MAIN ] Derivative Progress: 911/2052 symbols. INFY took 0.4s. Estimated remaining time: 7m 29s [2025-10-22T23:32:47.141686] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:47.192690] [DEBUG] [LOCAL ] ING: Loaded 50701 existing records from primary storage. [2025-10-22T23:32:47.192878] [INFO ] [MAIN ] ING: Loaded 50701 primary data records. [2025-10-22T23:32:47.534192] [DEBUG] [MAIN ] ING: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:47.559517] [INFO ] [MAIN ] ING: Generated 138 derivative records from 50701 primary records. [2025-10-22T23:32:47.559691] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-10-22T23:32:47.571306] [DEBUG] [LOCAL ] ING: Derivative data saved (138 records). [2025-10-22T23:32:47.571390] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-10-22T23:32:47.574477] [INFO ] [MAIN ] Derivative Progress: 912/2052 symbols. ING took 0.4s. Estimated remaining time: 7m 29s [2025-10-22T23:32:47.574595] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:47.602996] [DEBUG] [LOCAL ] INGM: Loaded 28088 existing records from primary storage. [2025-10-22T23:32:47.603164] [INFO ] [MAIN ] INGM: Loaded 28088 primary data records. [2025-10-22T23:32:47.937847] [DEBUG] [MAIN ] INGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:47.964018] [INFO ] [MAIN ] INGM: Generated 138 derivative records from 28088 primary records. [2025-10-22T23:32:47.964202] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-22T23:32:47.976176] [DEBUG] [LOCAL ] INGM: Derivative data saved (138 records). [2025-10-22T23:32:47.976341] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-22T23:32:47.979261] [INFO ] [MAIN ] Derivative Progress: 913/2052 symbols. INGM took 0.4s. Estimated remaining time: 7m 29s [2025-10-22T23:32:47.979372] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:48.013924] [DEBUG] [LOCAL ] INGR: Loaded 33764 existing records from primary storage. [2025-10-22T23:32:48.014084] [INFO ] [MAIN ] INGR: Loaded 33764 primary data records. [2025-10-22T23:32:48.322359] [DEBUG] [MAIN ] INGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:48.348507] [INFO ] [MAIN ] INGR: Generated 138 derivative records from 33764 primary records. [2025-10-22T23:32:48.348698] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-22T23:32:48.360732] [DEBUG] [LOCAL ] INGR: Derivative data saved (138 records). [2025-10-22T23:32:48.360821] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-22T23:32:48.363721] [INFO ] [MAIN ] Derivative Progress: 914/2052 symbols. INGR took 0.4s. Estimated remaining time: 7m 28s [2025-10-22T23:32:48.363828] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:48.403294] [DEBUG] [LOCAL ] INN: Loaded 41470 existing records from primary storage. [2025-10-22T23:32:48.403474] [INFO ] [MAIN ] INN: Loaded 41470 primary data records. [2025-10-22T23:32:48.739225] [DEBUG] [MAIN ] INN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:48.764290] [INFO ] [MAIN ] INN: Generated 138 derivative records from 41470 primary records. [2025-10-22T23:32:48.764458] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-22T23:32:48.775914] [DEBUG] [LOCAL ] INN: Derivative data saved (138 records). [2025-10-22T23:32:48.776005] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-22T23:32:48.779008] [INFO ] [MAIN ] Derivative Progress: 915/2052 symbols. INN took 0.4s. Estimated remaining time: 7m 28s [2025-10-22T23:32:48.779100] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:48.816926] [DEBUG] [LOCAL ] INSP: Loaded 38560 existing records from primary storage. [2025-10-22T23:32:48.817091] [INFO ] [MAIN ] INSP: Loaded 38560 primary data records. [2025-10-22T23:32:49.135712] [DEBUG] [MAIN ] INSP: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:32:49.161334] [INFO ] [MAIN ] INSP: Generated 138 derivative records from 38560 primary records. [2025-10-22T23:32:49.161463] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-22T23:32:49.173028] [DEBUG] [LOCAL ] INSP: Derivative data saved (138 records). [2025-10-22T23:32:49.173113] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-22T23:32:49.176061] [INFO ] [MAIN ] Derivative Progress: 916/2052 symbols. INSP took 0.4s. Estimated remaining time: 7m 27s [2025-10-22T23:32:49.176156] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:49.213706] [DEBUG] [LOCAL ] INSW: Loaded 39208 existing records from primary storage. [2025-10-22T23:32:49.213875] [INFO ] [MAIN ] INSW: Loaded 39208 primary data records. [2025-10-22T23:32:49.553077] [DEBUG] [MAIN ] INSW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:49.578384] [INFO ] [MAIN ] INSW: Generated 138 derivative records from 39208 primary records. [2025-10-22T23:32:49.578512] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-22T23:32:49.590030] [DEBUG] [LOCAL ] INSW: Derivative data saved (138 records). [2025-10-22T23:32:49.590115] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-22T23:32:49.593084] [INFO ] [MAIN ] Derivative Progress: 917/2052 symbols. INSW took 0.4s. Estimated remaining time: 7m 27s [2025-10-22T23:32:49.593211] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:49.642811] [DEBUG] [LOCAL ] INVH: Loaded 53194 existing records from primary storage. [2025-10-22T23:32:49.642979] [INFO ] [MAIN ] INVH: Loaded 53194 primary data records. [2025-10-22T23:32:49.949199] [DEBUG] [MAIN ] INVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:49.974207] [INFO ] [MAIN ] INVH: Generated 138 derivative records from 53194 primary records. [2025-10-22T23:32:49.974315] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-22T23:32:49.986115] [DEBUG] [LOCAL ] INVH: Derivative data saved (138 records). [2025-10-22T23:32:49.986203] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-22T23:32:49.989397] [INFO ] [MAIN ] Derivative Progress: 918/2052 symbols. INVH took 0.4s. Estimated remaining time: 7m 27s [2025-10-22T23:32:49.989502] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:50.018835] [DEBUG] [LOCAL ] INVX: Loaded 29045 existing records from primary storage. [2025-10-22T23:32:50.019005] [INFO ] [MAIN ] INVX: Loaded 29045 primary data records. [2025-10-22T23:32:50.325767] [DEBUG] [MAIN ] INVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:50.350880] [INFO ] [MAIN ] INVX: Generated 138 derivative records from 29045 primary records. [2025-10-22T23:32:50.351040] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-22T23:32:50.362706] [DEBUG] [LOCAL ] INVX: Derivative data saved (138 records). [2025-10-22T23:32:50.362787] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-10-22T23:32:50.365615] [INFO ] [MAIN ] Derivative Progress: 919/2052 symbols. INVX took 0.4s. Estimated remaining time: 7m 26s [2025-10-22T23:32:50.365762] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:50.417933] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-22T23:32:50.418112] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-10-22T23:32:50.730907] [DEBUG] [MAIN ] IONQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:50.757284] [INFO ] [MAIN ] IONQ: Generated 138 derivative records from 53788 primary records. [2025-10-22T23:32:50.757432] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-22T23:32:50.769172] [DEBUG] [LOCAL ] IONQ: Derivative data saved (138 records). [2025-10-22T23:32:50.769255] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-22T23:32:50.772447] [INFO ] [MAIN ] Derivative Progress: 920/2052 symbols. IONQ took 0.4s. Estimated remaining time: 7m 26s [2025-10-22T23:32:50.772551] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:50.822313] [DEBUG] [LOCAL ] IOT: Loaded 53475 existing records from primary storage. [2025-10-22T23:32:50.822478] [INFO ] [MAIN ] IOT: Loaded 53475 primary data records. [2025-10-22T23:32:51.147693] [DEBUG] [MAIN ] IOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:51.172678] [INFO ] [MAIN ] IOT: Generated 138 derivative records from 53475 primary records. [2025-10-22T23:32:51.172859] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-22T23:32:51.184224] [DEBUG] [LOCAL ] IOT: Derivative data saved (138 records). [2025-10-22T23:32:51.184310] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-22T23:32:51.187536] [INFO ] [MAIN ] Derivative Progress: 921/2052 symbols. IOT took 0.4s. Estimated remaining time: 7m 25s [2025-10-22T23:32:51.187635] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:51.238435] [DEBUG] [LOCAL ] IP: Loaded 53300 existing records from primary storage. [2025-10-22T23:32:51.238600] [INFO ] [MAIN ] IP: Loaded 53300 primary data records. [2025-10-22T23:32:51.545276] [DEBUG] [MAIN ] IP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:51.570742] [INFO ] [MAIN ] IP: Generated 138 derivative records from 53300 primary records. [2025-10-22T23:32:51.570903] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-22T23:32:51.582505] [DEBUG] [LOCAL ] IP: Derivative data saved (138 records). [2025-10-22T23:32:51.582588] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-22T23:32:51.585777] [INFO ] [MAIN ] Derivative Progress: 922/2052 symbols. IP took 0.4s. Estimated remaining time: 7m 25s [2025-10-22T23:32:51.585931] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:51.637236] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-22T23:32:51.637424] [INFO ] [MAIN ] IPG: Loaded 53330 primary data records. [2025-10-22T23:32:51.961042] [DEBUG] [MAIN ] IPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:51.985957] [INFO ] [MAIN ] IPG: Generated 138 derivative records from 53330 primary records. [2025-10-22T23:32:51.986112] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-22T23:32:51.997861] [DEBUG] [LOCAL ] IPG: Derivative data saved (138 records). [2025-10-22T23:32:51.997946] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-22T23:32:52.000992] [INFO ] [MAIN ] Derivative Progress: 923/2052 symbols. IPG took 0.4s. Estimated remaining time: 7m 25s [2025-10-22T23:32:52.001086] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:52.023015] [DEBUG] [LOCAL ] IPI: Loaded 21414 existing records from primary storage. [2025-10-22T23:32:52.023158] [INFO ] [MAIN ] IPI: Loaded 21414 primary data records. [2025-10-22T23:32:52.326980] [DEBUG] [MAIN ] IPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:52.355516] [INFO ] [MAIN ] IPI: Generated 138 derivative records from 21414 primary records. [2025-10-22T23:32:52.355684] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-22T23:32:52.366929] [DEBUG] [LOCAL ] IPI: Derivative data saved (138 records). [2025-10-22T23:32:52.367007] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-22T23:32:52.369960] [INFO ] [MAIN ] Derivative Progress: 924/2052 symbols. IPI took 0.4s. Estimated remaining time: 7m 24s [2025-10-22T23:32:52.370060] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:52.387690] [DEBUG] [LOCAL ] IQI: Loaded 17764 existing records from primary storage. [2025-10-22T23:32:52.387827] [INFO ] [MAIN ] IQI: Loaded 17764 primary data records. [2025-10-22T23:32:52.689469] [DEBUG] [MAIN ] IQI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:52.714583] [INFO ] [MAIN ] IQI: Generated 138 derivative records from 17764 primary records. [2025-10-22T23:32:52.714735] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-22T23:32:52.725917] [DEBUG] [LOCAL ] IQI: Derivative data saved (138 records). [2025-10-22T23:32:52.726001] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-22T23:32:52.728748] [INFO ] [MAIN ] Derivative Progress: 925/2052 symbols. IQI took 0.4s. Estimated remaining time: 7m 24s [2025-10-22T23:32:52.728848] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:52.774532] [DEBUG] [LOCAL ] IQV: Loaded 49962 existing records from primary storage. [2025-10-22T23:32:52.774722] [INFO ] [MAIN ] IQV: Loaded 49962 primary data records. [2025-10-22T23:32:53.077218] [DEBUG] [MAIN ] IQV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:53.102380] [INFO ] [MAIN ] IQV: Generated 138 derivative records from 49962 primary records. [2025-10-22T23:32:53.102496] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-22T23:32:53.114148] [DEBUG] [LOCAL ] IQV: Derivative data saved (138 records). [2025-10-22T23:32:53.114226] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-10-22T23:32:53.117291] [INFO ] [MAIN ] Derivative Progress: 926/2052 symbols. IQV took 0.4s. Estimated remaining time: 7m 23s [2025-10-22T23:32:53.117388] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:53.167286] [DEBUG] [LOCAL ] IR: Loaded 52749 existing records from primary storage. [2025-10-22T23:32:53.167452] [INFO ] [MAIN ] IR: Loaded 52749 primary data records. [2025-10-22T23:32:53.469731] [DEBUG] [MAIN ] IR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:53.494951] [INFO ] [MAIN ] IR: Generated 138 derivative records from 52749 primary records. [2025-10-22T23:32:53.495065] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-22T23:32:53.506529] [DEBUG] [LOCAL ] IR: Derivative data saved (138 records). [2025-10-22T23:32:53.506611] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-22T23:32:53.509846] [INFO ] [MAIN ] Derivative Progress: 927/2052 symbols. IR took 0.4s. Estimated remaining time: 7m 23s [2025-10-22T23:32:53.509962] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:53.553775] [DEBUG] [LOCAL ] IRM: Loaded 48910 existing records from primary storage. [2025-10-22T23:32:53.553941] [INFO ] [MAIN ] IRM: Loaded 48910 primary data records. [2025-10-22T23:32:53.898211] [DEBUG] [MAIN ] IRM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:53.924383] [INFO ] [MAIN ] IRM: Generated 138 derivative records from 48910 primary records. [2025-10-22T23:32:53.924529] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-22T23:32:53.936900] [DEBUG] [LOCAL ] IRM: Derivative data saved (138 records). [2025-10-22T23:32:53.936986] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-22T23:32:53.940290] [INFO ] [MAIN ] Derivative Progress: 928/2052 symbols. IRM took 0.4s. Estimated remaining time: 7m 23s [2025-10-22T23:32:53.940396] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:53.968479] [DEBUG] [LOCAL ] IRS: Loaded 23290 existing records from primary storage. [2025-10-22T23:32:53.968623] [INFO ] [MAIN ] IRS: Loaded 23290 primary data records. [2025-10-22T23:32:54.277339] [DEBUG] [MAIN ] IRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:54.304606] [INFO ] [MAIN ] IRS: Generated 138 derivative records from 23290 primary records. [2025-10-22T23:32:54.304791] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-22T23:32:54.316365] [DEBUG] [LOCAL ] IRS: Derivative data saved (138 records). [2025-10-22T23:32:54.316447] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-22T23:32:54.319373] [INFO ] [MAIN ] Derivative Progress: 929/2052 symbols. IRS took 0.4s. Estimated remaining time: 7m 22s [2025-10-22T23:32:54.319473] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:54.371512] [DEBUG] [LOCAL ] IRT: Loaded 50443 existing records from primary storage. [2025-10-22T23:32:54.371791] [INFO ] [MAIN ] IRT: Loaded 50443 primary data records. [2025-10-22T23:32:54.691997] [DEBUG] [MAIN ] IRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:54.721128] [INFO ] [MAIN ] IRT: Generated 138 derivative records from 50443 primary records. [2025-10-22T23:32:54.721305] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-22T23:32:54.733387] [DEBUG] [LOCAL ] IRT: Derivative data saved (138 records). [2025-10-22T23:32:54.733492] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-22T23:32:54.737335] [INFO ] [MAIN ] Derivative Progress: 930/2052 symbols. IRT took 0.4s. Estimated remaining time: 7m 22s [2025-10-22T23:32:54.737470] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:54.757183] [DEBUG] [LOCAL ] ISD: Loaded 15648 existing records from primary storage. [2025-10-22T23:32:54.757378] [INFO ] [MAIN ] ISD: Loaded 15648 primary data records. [2025-10-22T23:32:55.074268] [DEBUG] [MAIN ] ISD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:55.101142] [INFO ] [MAIN ] ISD: Generated 138 derivative records from 15648 primary records. [2025-10-22T23:32:55.101372] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-22T23:32:55.113710] [DEBUG] [LOCAL ] ISD: Derivative data saved (138 records). [2025-10-22T23:32:55.113834] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-22T23:32:55.116630] [INFO ] [MAIN ] Derivative Progress: 931/2052 symbols. ISD took 0.4s. Estimated remaining time: 7m 22s [2025-10-22T23:32:55.116766] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:55.158914] [DEBUG] [LOCAL ] IT: Loaded 42205 existing records from primary storage. [2025-10-22T23:32:55.159096] [INFO ] [MAIN ] IT: Loaded 42205 primary data records. [2025-10-22T23:32:55.480374] [DEBUG] [MAIN ] IT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:32:55.505875] [INFO ] [MAIN ] IT: Generated 138 derivative records from 42205 primary records. [2025-10-22T23:32:55.506021] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-22T23:32:55.517770] [DEBUG] [LOCAL ] IT: Derivative data saved (138 records). [2025-10-22T23:32:55.517857] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-22T23:32:55.520791] [INFO ] [MAIN ] Derivative Progress: 932/2052 symbols. IT took 0.4s. Estimated remaining time: 7m 21s [2025-10-22T23:32:55.520911] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:55.552772] [DEBUG] [LOCAL ] ITGR: Loaded 30945 existing records from primary storage. [2025-10-22T23:32:55.552931] [INFO ] [MAIN ] ITGR: Loaded 30945 primary data records. [2025-10-22T23:32:55.885854] [DEBUG] [MAIN ] ITGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:55.910888] [INFO ] [MAIN ] ITGR: Generated 138 derivative records from 30945 primary records. [2025-10-22T23:32:55.911005] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-22T23:32:55.922457] [DEBUG] [LOCAL ] ITGR: Derivative data saved (138 records). [2025-10-22T23:32:55.922537] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-22T23:32:55.925344] [INFO ] [MAIN ] Derivative Progress: 933/2052 symbols. ITGR took 0.4s. Estimated remaining time: 7m 21s [2025-10-22T23:32:55.925444] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:55.958688] [DEBUG] [LOCAL ] ITT: Loaded 32352 existing records from primary storage. [2025-10-22T23:32:55.958853] [INFO ] [MAIN ] ITT: Loaded 32352 primary data records. [2025-10-22T23:32:56.268033] [DEBUG] [MAIN ] ITT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:56.293326] [INFO ] [MAIN ] ITT: Generated 138 derivative records from 32352 primary records. [2025-10-22T23:32:56.293462] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-22T23:32:56.305196] [DEBUG] [LOCAL ] ITT: Derivative data saved (138 records). [2025-10-22T23:32:56.305278] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-22T23:32:56.308055] [INFO ] [MAIN ] Derivative Progress: 934/2052 symbols. ITT took 0.4s. Estimated remaining time: 7m 20s [2025-10-22T23:32:56.308153] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:56.358601] [DEBUG] [LOCAL ] ITUB: Loaded 53318 existing records from primary storage. [2025-10-22T23:32:56.358793] [INFO ] [MAIN ] ITUB: Loaded 53318 primary data records. [2025-10-22T23:32:56.665536] [DEBUG] [MAIN ] ITUB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:56.691464] [INFO ] [MAIN ] ITUB: Generated 138 derivative records from 53318 primary records. [2025-10-22T23:32:56.691629] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-22T23:32:56.704058] [DEBUG] [LOCAL ] ITUB: Derivative data saved (138 records). [2025-10-22T23:32:56.704164] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-10-22T23:32:56.707493] [INFO ] [MAIN ] Derivative Progress: 935/2052 symbols. ITUB took 0.4s. Estimated remaining time: 7m 20s [2025-10-22T23:32:56.707627] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:56.752366] [DEBUG] [LOCAL ] ITW: Loaded 45583 existing records from primary storage. [2025-10-22T23:32:56.752542] [INFO ] [MAIN ] ITW: Loaded 45583 primary data records. [2025-10-22T23:32:57.101131] [DEBUG] [MAIN ] ITW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:57.126456] [INFO ] [MAIN ] ITW: Generated 138 derivative records from 45583 primary records. [2025-10-22T23:32:57.126675] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-22T23:32:57.138328] [DEBUG] [LOCAL ] ITW: Derivative data saved (138 records). [2025-10-22T23:32:57.138412] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-22T23:32:57.141181] [INFO ] [MAIN ] Derivative Progress: 936/2052 symbols. ITW took 0.4s. Estimated remaining time: 7m 20s [2025-10-22T23:32:57.141283] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:57.185813] [DEBUG] [LOCAL ] IVR: Loaded 47827 existing records from primary storage. [2025-10-22T23:32:57.185981] [INFO ] [MAIN ] IVR: Loaded 47827 primary data records. [2025-10-22T23:32:57.488365] [DEBUG] [MAIN ] IVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:57.513537] [INFO ] [MAIN ] IVR: Generated 138 derivative records from 47827 primary records. [2025-10-22T23:32:57.513750] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-22T23:32:57.525114] [DEBUG] [LOCAL ] IVR: Derivative data saved (138 records). [2025-10-22T23:32:57.525216] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-10-22T23:32:57.528190] [INFO ] [MAIN ] Derivative Progress: 937/2052 symbols. IVR took 0.4s. Estimated remaining time: 7m 19s [2025-10-22T23:32:57.528315] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:57.559720] [DEBUG] [LOCAL ] IVT: Loaded 31418 existing records from primary storage. [2025-10-22T23:32:57.559888] [INFO ] [MAIN ] IVT: Loaded 31418 primary data records. [2025-10-22T23:32:57.867475] [DEBUG] [MAIN ] IVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:57.892525] [INFO ] [MAIN ] IVT: Generated 138 derivative records from 31418 primary records. [2025-10-22T23:32:57.892638] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-22T23:32:57.904326] [DEBUG] [LOCAL ] IVT: Derivative data saved (138 records). [2025-10-22T23:32:57.904413] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-22T23:32:57.907328] [INFO ] [MAIN ] Derivative Progress: 938/2052 symbols. IVT took 0.4s. Estimated remaining time: 7m 19s [2025-10-22T23:32:57.907433] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:57.959466] [DEBUG] [LOCAL ] IVZ: Loaded 53130 existing records from primary storage. [2025-10-22T23:32:57.959676] [INFO ] [MAIN ] IVZ: Loaded 53130 primary data records. [2025-10-22T23:32:58.283509] [DEBUG] [MAIN ] IVZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:58.308684] [INFO ] [MAIN ] IVZ: Generated 138 derivative records from 53130 primary records. [2025-10-22T23:32:58.308843] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-22T23:32:58.320848] [DEBUG] [LOCAL ] IVZ: Derivative data saved (138 records). [2025-10-22T23:32:58.320932] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-22T23:32:58.323993] [INFO ] [MAIN ] Derivative Progress: 939/2052 symbols. IVZ took 0.4s. Estimated remaining time: 7m 18s [2025-10-22T23:32:58.324099] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:58.346561] [DEBUG] [LOCAL ] IX: Loaded 22121 existing records from primary storage. [2025-10-22T23:32:58.346731] [INFO ] [MAIN ] IX: Loaded 22121 primary data records. [2025-10-22T23:32:58.654499] [DEBUG] [MAIN ] IX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:58.679490] [INFO ] [MAIN ] IX: Generated 138 derivative records from 22121 primary records. [2025-10-22T23:32:58.679604] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-22T23:32:58.691207] [DEBUG] [LOCAL ] IX: Derivative data saved (138 records). [2025-10-22T23:32:58.691290] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-22T23:32:58.694047] [INFO ] [MAIN ] Derivative Progress: 940/2052 symbols. IX took 0.4s. Estimated remaining time: 7m 18s [2025-10-22T23:32:58.694157] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:58.733126] [DEBUG] [LOCAL ] J: Loaded 40527 existing records from primary storage. [2025-10-22T23:32:58.733288] [INFO ] [MAIN ] J: Loaded 40527 primary data records. [2025-10-22T23:32:59.043235] [DEBUG] [MAIN ] J: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:59.069076] [INFO ] [MAIN ] J: Generated 138 derivative records from 40527 primary records. [2025-10-22T23:32:59.069229] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-22T23:32:59.081466] [DEBUG] [LOCAL ] J: Derivative data saved (138 records). [2025-10-22T23:32:59.081561] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-22T23:32:59.084461] [INFO ] [MAIN ] Derivative Progress: 941/2052 symbols. J took 0.4s. Estimated remaining time: 7m 18s [2025-10-22T23:32:59.084560] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:59.125559] [DEBUG] [LOCAL ] JBGS: Loaded 41708 existing records from primary storage. [2025-10-22T23:32:59.125781] [INFO ] [MAIN ] JBGS: Loaded 41708 primary data records. [2025-10-22T23:32:59.441081] [DEBUG] [MAIN ] JBGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:59.466519] [INFO ] [MAIN ] JBGS: Generated 138 derivative records from 41708 primary records. [2025-10-22T23:32:59.466691] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-22T23:32:59.478611] [DEBUG] [LOCAL ] JBGS: Derivative data saved (138 records). [2025-10-22T23:32:59.478728] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-22T23:32:59.481727] [INFO ] [MAIN ] Derivative Progress: 942/2052 symbols. JBGS took 0.4s. Estimated remaining time: 7m 17s [2025-10-22T23:32:59.481852] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:59.520983] [DEBUG] [LOCAL ] JBI: Loaded 42579 existing records from primary storage. [2025-10-22T23:32:59.521151] [INFO ] [MAIN ] JBI: Loaded 42579 primary data records. [2025-10-22T23:32:59.843037] [DEBUG] [MAIN ] JBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:32:59.868036] [INFO ] [MAIN ] JBI: Generated 138 derivative records from 42579 primary records. [2025-10-22T23:32:59.868166] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-22T23:32:59.879829] [DEBUG] [LOCAL ] JBI: Derivative data saved (138 records). [2025-10-22T23:32:59.879915] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-22T23:32:59.882813] [INFO ] [MAIN ] Derivative Progress: 943/2052 symbols. JBI took 0.4s. Estimated remaining time: 7m 17s [2025-10-22T23:32:59.882914] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:32:59.927891] [DEBUG] [LOCAL ] JBL: Loaded 48330 existing records from primary storage. [2025-10-22T23:32:59.928059] [INFO ] [MAIN ] JBL: Loaded 48330 primary data records. [2025-10-22T23:33:00.287908] [DEBUG] [MAIN ] JBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:00.315406] [INFO ] [MAIN ] JBL: Generated 138 derivative records from 48330 primary records. [2025-10-22T23:33:00.315618] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-22T23:33:00.328048] [DEBUG] [LOCAL ] JBL: Derivative data saved (138 records). [2025-10-22T23:33:00.328164] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-22T23:33:00.331145] [INFO ] [MAIN ] Derivative Progress: 944/2052 symbols. JBL took 0.4s. Estimated remaining time: 7m 17s [2025-10-22T23:33:00.331289] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:00.361952] [DEBUG] [LOCAL ] JBND: Loaded 27369 existing records from primary storage. [2025-10-22T23:33:00.362107] [INFO ] [MAIN ] JBND: Loaded 27369 primary data records. [2025-10-22T23:33:00.689420] [DEBUG] [MAIN ] JBND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:00.717135] [INFO ] [MAIN ] JBND: Generated 138 derivative records from 27369 primary records. [2025-10-22T23:33:00.717324] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-22T23:33:00.730136] [DEBUG] [LOCAL ] JBND: Derivative data saved (138 records). [2025-10-22T23:33:00.730216] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-22T23:33:00.733090] [INFO ] [MAIN ] Derivative Progress: 945/2052 symbols. JBND took 0.4s. Estimated remaining time: 7m 16s [2025-10-22T23:33:00.733183] [INFO ] [MAIN ] JBTM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:00.767638] [DEBUG] [LOCAL ] JBTM: Loaded 33593 existing records from primary storage. [2025-10-22T23:33:00.767831] [INFO ] [MAIN ] JBTM: Loaded 33593 primary data records. [2025-10-22T23:33:01.103102] [DEBUG] [MAIN ] JBTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:01.134205] [INFO ] [MAIN ] JBTM: Generated 138 derivative records from 33593 primary records. [2025-10-22T23:33:01.134374] [DEBUG] [LOCAL ] JBTM: Saving derivative data. [2025-10-22T23:33:01.146872] [DEBUG] [LOCAL ] JBTM: Derivative data saved (138 records). [2025-10-22T23:33:01.146962] [INFO ] [MAIN ] JBTM: Successfully saved derivative data. [2025-10-22T23:33:01.150076] [INFO ] [MAIN ] Derivative Progress: 946/2052 symbols. JBTM took 0.4s. Estimated remaining time: 7m 16s [2025-10-22T23:33:01.150182] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:01.162432] [DEBUG] [LOCAL ] JCE: Loaded 7251 existing records from primary storage. [2025-10-22T23:33:01.162573] [INFO ] [MAIN ] JCE: Loaded 7251 primary data records. [2025-10-22T23:33:01.480141] [DEBUG] [MAIN ] JCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:01.506170] [INFO ] [MAIN ] JCE: Generated 138 derivative records from 7251 primary records. [2025-10-22T23:33:01.506298] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-22T23:33:01.517337] [DEBUG] [LOCAL ] JCE: Derivative data saved (138 records). [2025-10-22T23:33:01.517419] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-10-22T23:33:01.520018] [INFO ] [MAIN ] Derivative Progress: 947/2052 symbols. JCE took 0.4s. Estimated remaining time: 7m 15s [2025-10-22T23:33:01.520116] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:01.574364] [DEBUG] [LOCAL ] JCI: Loaded 53518 existing records from primary storage. [2025-10-22T23:33:01.574525] [INFO ] [MAIN ] JCI: Loaded 53518 primary data records. [2025-10-22T23:33:01.897063] [DEBUG] [MAIN ] JCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:01.922449] [INFO ] [MAIN ] JCI: Generated 138 derivative records from 53518 primary records. [2025-10-22T23:33:01.922591] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-22T23:33:01.934484] [DEBUG] [LOCAL ] JCI: Derivative data saved (138 records). [2025-10-22T23:33:01.934564] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-22T23:33:01.937922] [INFO ] [MAIN ] Derivative Progress: 948/2052 symbols. JCI took 0.4s. Estimated remaining time: 7m 15s [2025-10-22T23:33:01.938020] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:01.987488] [DEBUG] [LOCAL ] JEF: Loaded 50191 existing records from primary storage. [2025-10-22T23:33:01.987696] [INFO ] [MAIN ] JEF: Loaded 50191 primary data records. [2025-10-22T23:33:02.323867] [DEBUG] [MAIN ] JEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:02.349977] [INFO ] [MAIN ] JEF: Generated 138 derivative records from 50191 primary records. [2025-10-22T23:33:02.350144] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-22T23:33:02.361789] [DEBUG] [LOCAL ] JEF: Derivative data saved (138 records). [2025-10-22T23:33:02.361872] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-10-22T23:33:02.364917] [INFO ] [MAIN ] Derivative Progress: 949/2052 symbols. JEF took 0.4s. Estimated remaining time: 7m 15s [2025-10-22T23:33:02.365060] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:02.408486] [DEBUG] [LOCAL ] JELD: Loaded 45878 existing records from primary storage. [2025-10-22T23:33:02.408671] [INFO ] [MAIN ] JELD: Loaded 45878 primary data records. [2025-10-22T23:33:02.730394] [DEBUG] [MAIN ] JELD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:02.756676] [INFO ] [MAIN ] JELD: Generated 138 derivative records from 45878 primary records. [2025-10-22T23:33:02.756869] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-22T23:33:02.768414] [DEBUG] [LOCAL ] JELD: Derivative data saved (138 records). [2025-10-22T23:33:02.768560] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-22T23:33:02.771725] [INFO ] [MAIN ] Derivative Progress: 950/2052 symbols. JELD took 0.4s. Estimated remaining time: 7m 14s [2025-10-22T23:33:02.771842] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:02.807600] [DEBUG] [LOCAL ] JFR: Loaded 30994 existing records from primary storage. [2025-10-22T23:33:02.807807] [INFO ] [MAIN ] JFR: Loaded 30994 primary data records. [2025-10-22T23:33:03.122176] [DEBUG] [MAIN ] JFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:03.147837] [INFO ] [MAIN ] JFR: Generated 138 derivative records from 30994 primary records. [2025-10-22T23:33:03.148026] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-22T23:33:03.159550] [DEBUG] [LOCAL ] JFR: Derivative data saved (138 records). [2025-10-22T23:33:03.159717] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-22T23:33:03.162553] [INFO ] [MAIN ] Derivative Progress: 951/2052 symbols. JFR took 0.4s. Estimated remaining time: 7m 14s [2025-10-22T23:33:03.162705] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:03.178925] [DEBUG] [LOCAL ] JGH: Loaded 12537 existing records from primary storage. [2025-10-22T23:33:03.179086] [INFO ] [MAIN ] JGH: Loaded 12537 primary data records. [2025-10-22T23:33:03.497342] [DEBUG] [MAIN ] JGH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:03.523029] [INFO ] [MAIN ] JGH: Generated 138 derivative records from 12537 primary records. [2025-10-22T23:33:03.523167] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-22T23:33:03.534340] [DEBUG] [LOCAL ] JGH: Derivative data saved (138 records). [2025-10-22T23:33:03.534421] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-22T23:33:03.537286] [INFO ] [MAIN ] Derivative Progress: 952/2052 symbols. JGH took 0.4s. Estimated remaining time: 7m 13s [2025-10-22T23:33:03.537386] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:03.546061] [DEBUG] [LOCAL ] JHI: Loaded 4142 existing records from primary storage. [2025-10-22T23:33:03.546190] [INFO ] [MAIN ] JHI: Loaded 4142 primary data records. [2025-10-22T23:33:03.854279] [DEBUG] [MAIN ] JHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:03.880969] [INFO ] [MAIN ] JHI: Generated 138 derivative records from 4142 primary records. [2025-10-22T23:33:03.881156] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-22T23:33:03.891582] [DEBUG] [LOCAL ] JHI: Derivative data saved (138 records). [2025-10-22T23:33:03.891681] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-10-22T23:33:03.893862] [INFO ] [MAIN ] Derivative Progress: 953/2052 symbols. JHI took 0.4s. Estimated remaining time: 7m 13s [2025-10-22T23:33:03.893987] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:03.898318] [DEBUG] [LOCAL ] JHS: Loaded 2984 existing records from primary storage. [2025-10-22T23:33:03.898405] [INFO ] [MAIN ] JHS: Loaded 2984 primary data records. [2025-10-22T23:33:04.241305] [DEBUG] [MAIN ] JHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:04.267837] [INFO ] [MAIN ] JHS: Generated 138 derivative records from 2984 primary records. [2025-10-22T23:33:04.268013] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-22T23:33:04.277629] [DEBUG] [LOCAL ] JHS: Derivative data saved (138 records). [2025-10-22T23:33:04.277726] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-22T23:33:04.280142] [INFO ] [MAIN ] Derivative Progress: 954/2052 symbols. JHS took 0.4s. Estimated remaining time: 7m 13s [2025-10-22T23:33:04.280238] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:04.334380] [DEBUG] [LOCAL ] JHX: Loaded 53199 existing records from primary storage. [2025-10-22T23:33:04.334555] [INFO ] [MAIN ] JHX: Loaded 53199 primary data records. [2025-10-22T23:33:04.644370] [DEBUG] [MAIN ] JHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:04.669408] [INFO ] [MAIN ] JHX: Generated 138 derivative records from 53199 primary records. [2025-10-22T23:33:04.669548] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-22T23:33:04.681275] [DEBUG] [LOCAL ] JHX: Derivative data saved (138 records). [2025-10-22T23:33:04.681353] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-22T23:33:04.684635] [INFO ] [MAIN ] Derivative Progress: 955/2052 symbols. JHX took 0.4s. Estimated remaining time: 7m 12s [2025-10-22T23:33:04.684756] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:04.703781] [DEBUG] [LOCAL ] JILL: Loaded 15268 existing records from primary storage. [2025-10-22T23:33:04.703927] [INFO ] [MAIN ] JILL: Loaded 15268 primary data records. [2025-10-22T23:33:05.021002] [DEBUG] [MAIN ] JILL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:05.045776] [INFO ] [MAIN ] JILL: Generated 138 derivative records from 15268 primary records. [2025-10-22T23:33:05.045886] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-22T23:33:05.057172] [DEBUG] [LOCAL ] JILL: Derivative data saved (138 records). [2025-10-22T23:33:05.057290] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-22T23:33:05.060023] [INFO ] [MAIN ] Derivative Progress: 956/2052 symbols. JILL took 0.4s. Estimated remaining time: 7m 12s [2025-10-22T23:33:05.060118] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:05.095757] [DEBUG] [LOCAL ] JKS: Loaded 39215 existing records from primary storage. [2025-10-22T23:33:05.095914] [INFO ] [MAIN ] JKS: Loaded 39215 primary data records. [2025-10-22T23:33:05.403338] [DEBUG] [MAIN ] JKS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:05.429328] [INFO ] [MAIN ] JKS: Generated 138 derivative records from 39215 primary records. [2025-10-22T23:33:05.429467] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-22T23:33:05.440998] [DEBUG] [LOCAL ] JKS: Derivative data saved (138 records). [2025-10-22T23:33:05.441078] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-22T23:33:05.443945] [INFO ] [MAIN ] Derivative Progress: 957/2052 symbols. JKS took 0.4s. Estimated remaining time: 7m 11s [2025-10-22T23:33:05.444043] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:05.474604] [DEBUG] [LOCAL ] JLL: Loaded 31450 existing records from primary storage. [2025-10-22T23:33:05.474809] [INFO ] [MAIN ] JLL: Loaded 31450 primary data records. [2025-10-22T23:33:05.779143] [DEBUG] [MAIN ] JLL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:05.804263] [INFO ] [MAIN ] JLL: Generated 138 derivative records from 31450 primary records. [2025-10-22T23:33:05.804379] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-22T23:33:05.815939] [DEBUG] [LOCAL ] JLL: Derivative data saved (138 records). [2025-10-22T23:33:05.816018] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-10-22T23:33:05.818944] [INFO ] [MAIN ] Derivative Progress: 958/2052 symbols. JLL took 0.4s. Estimated remaining time: 7m 11s [2025-10-22T23:33:05.819041] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:05.827394] [DEBUG] [LOCAL ] JLS: Loaded 4013 existing records from primary storage. [2025-10-22T23:33:05.827503] [INFO ] [MAIN ] JLS: Loaded 4013 primary data records. [2025-10-22T23:33:06.127470] [DEBUG] [MAIN ] JLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:06.152375] [INFO ] [MAIN ] JLS: Generated 138 derivative records from 4013 primary records. [2025-10-22T23:33:06.152543] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-22T23:33:06.163044] [DEBUG] [LOCAL ] JLS: Derivative data saved (138 records). [2025-10-22T23:33:06.163130] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-10-22T23:33:06.165269] [INFO ] [MAIN ] Derivative Progress: 959/2052 symbols. JLS took 0.3s. Estimated remaining time: 7m 11s [2025-10-22T23:33:06.165372] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:06.219250] [DEBUG] [LOCAL ] JMIA: Loaded 51205 existing records from primary storage. [2025-10-22T23:33:06.219442] [INFO ] [MAIN ] JMIA: Loaded 51205 primary data records. [2025-10-22T23:33:06.545337] [DEBUG] [MAIN ] JMIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:06.570605] [INFO ] [MAIN ] JMIA: Generated 138 derivative records from 51205 primary records. [2025-10-22T23:33:06.570792] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-22T23:33:06.582451] [DEBUG] [LOCAL ] JMIA: Derivative data saved (138 records). [2025-10-22T23:33:06.582550] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-10-22T23:33:06.585967] [INFO ] [MAIN ] Derivative Progress: 960/2052 symbols. JMIA took 0.4s. Estimated remaining time: 7m 10s [2025-10-22T23:33:06.586071] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:06.642013] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-22T23:33:06.642179] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-10-22T23:33:06.949481] [DEBUG] [MAIN ] JNJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:06.974997] [INFO ] [MAIN ] JNJ: Generated 138 derivative records from 53753 primary records. [2025-10-22T23:33:06.975181] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-22T23:33:06.987088] [DEBUG] [LOCAL ] JNJ: Derivative data saved (138 records). [2025-10-22T23:33:06.987174] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-22T23:33:06.990390] [INFO ] [MAIN ] Derivative Progress: 961/2052 symbols. JNJ took 0.4s. Estimated remaining time: 7m 10s [2025-10-22T23:33:06.990498] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:07.049432] [DEBUG] [LOCAL ] JOBY: Loaded 53809 existing records from primary storage. [2025-10-22T23:33:07.049694] [INFO ] [MAIN ] JOBY: Loaded 53809 primary data records. [2025-10-22T23:33:07.357827] [DEBUG] [MAIN ] JOBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:07.383205] [INFO ] [MAIN ] JOBY: Generated 138 derivative records from 53809 primary records. [2025-10-22T23:33:07.383457] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-22T23:33:07.395565] [DEBUG] [LOCAL ] JOBY: Derivative data saved (138 records). [2025-10-22T23:33:07.395740] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-22T23:33:07.399000] [INFO ] [MAIN ] Derivative Progress: 962/2052 symbols. JOBY took 0.4s. Estimated remaining time: 7m 9s [2025-10-22T23:33:07.399105] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:07.423405] [DEBUG] [LOCAL ] JOE: Loaded 23683 existing records from primary storage. [2025-10-22T23:33:07.423564] [INFO ] [MAIN ] JOE: Loaded 23683 primary data records. [2025-10-22T23:33:07.743398] [DEBUG] [MAIN ] JOE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:07.768046] [INFO ] [MAIN ] JOE: Generated 138 derivative records from 23683 primary records. [2025-10-22T23:33:07.768150] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-22T23:33:07.779405] [DEBUG] [LOCAL ] JOE: Derivative data saved (138 records). [2025-10-22T23:33:07.779483] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-22T23:33:07.782347] [INFO ] [MAIN ] Derivative Progress: 963/2052 symbols. JOE took 0.4s. Estimated remaining time: 7m 9s [2025-10-22T23:33:07.782445] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:07.793675] [DEBUG] [LOCAL ] JOF: Loaded 6920 existing records from primary storage. [2025-10-22T23:33:07.793803] [INFO ] [MAIN ] JOF: Loaded 6920 primary data records. [2025-10-22T23:33:08.096239] [DEBUG] [MAIN ] JOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:08.121255] [INFO ] [MAIN ] JOF: Generated 138 derivative records from 6920 primary records. [2025-10-22T23:33:08.121434] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-22T23:33:08.132360] [DEBUG] [LOCAL ] JOF: Derivative data saved (138 records). [2025-10-22T23:33:08.132438] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-22T23:33:08.134635] [INFO ] [MAIN ] Derivative Progress: 964/2052 symbols. JOF took 0.4s. Estimated remaining time: 7m 9s [2025-10-22T23:33:08.134747] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:08.170801] [DEBUG] [LOCAL ] JPC: Loaded 36948 existing records from primary storage. [2025-10-22T23:33:08.170955] [INFO ] [MAIN ] JPC: Loaded 36948 primary data records. [2025-10-22T23:33:08.497489] [DEBUG] [MAIN ] JPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:08.528753] [INFO ] [MAIN ] JPC: Generated 138 derivative records from 36948 primary records. [2025-10-22T23:33:08.529035] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-10-22T23:33:08.542459] [DEBUG] [LOCAL ] JPC: Derivative data saved (138 records). [2025-10-22T23:33:08.542548] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-10-22T23:33:08.545600] [INFO ] [MAIN ] Derivative Progress: 965/2052 symbols. JPC took 0.4s. Estimated remaining time: 7m 8s [2025-10-22T23:33:08.545735] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:08.609428] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-22T23:33:08.609634] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-10-22T23:33:08.931095] [DEBUG] [MAIN ] JPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:08.956842] [INFO ] [MAIN ] JPM: Generated 138 derivative records from 53794 primary records. [2025-10-22T23:33:08.957015] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-22T23:33:08.968924] [DEBUG] [LOCAL ] JPM: Derivative data saved (138 records). [2025-10-22T23:33:08.969009] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-22T23:33:08.971996] [INFO ] [MAIN ] Derivative Progress: 966/2052 symbols. JPM took 0.4s. Estimated remaining time: 7m 8s [2025-10-22T23:33:08.972189] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:09.004117] [DEBUG] [LOCAL ] JQC: Loaded 33868 existing records from primary storage. [2025-10-22T23:33:09.004292] [INFO ] [MAIN ] JQC: Loaded 33868 primary data records. [2025-10-22T23:33:09.324485] [DEBUG] [MAIN ] JQC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:09.349875] [INFO ] [MAIN ] JQC: Generated 138 derivative records from 33868 primary records. [2025-10-22T23:33:09.350103] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-22T23:33:09.361140] [DEBUG] [LOCAL ] JQC: Derivative data saved (138 records). [2025-10-22T23:33:09.361231] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-22T23:33:09.364004] [INFO ] [MAIN ] Derivative Progress: 967/2052 symbols. JQC took 0.4s. Estimated remaining time: 7m 7s [2025-10-22T23:33:09.364098] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:09.382445] [DEBUG] [LOCAL ] JRI: Loaded 15306 existing records from primary storage. [2025-10-22T23:33:09.382586] [INFO ] [MAIN ] JRI: Loaded 15306 primary data records. [2025-10-22T23:33:09.691993] [DEBUG] [MAIN ] JRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:09.718514] [INFO ] [MAIN ] JRI: Generated 138 derivative records from 15306 primary records. [2025-10-22T23:33:09.718669] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-22T23:33:09.730406] [DEBUG] [LOCAL ] JRI: Derivative data saved (138 records). [2025-10-22T23:33:09.730489] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-22T23:33:09.733197] [INFO ] [MAIN ] Derivative Progress: 968/2052 symbols. JRI took 0.4s. Estimated remaining time: 7m 7s [2025-10-22T23:33:09.733308] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:09.748149] [DEBUG] [LOCAL ] JRS: Loaded 11529 existing records from primary storage. [2025-10-22T23:33:09.748297] [INFO ] [MAIN ] JRS: Loaded 11529 primary data records. [2025-10-22T23:33:10.067434] [DEBUG] [MAIN ] JRS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:33:10.094254] [INFO ] [MAIN ] JRS: Generated 138 derivative records from 11529 primary records. [2025-10-22T23:33:10.094440] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-22T23:33:10.105571] [DEBUG] [LOCAL ] JRS: Derivative data saved (138 records). [2025-10-22T23:33:10.105679] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-22T23:33:10.108455] [INFO ] [MAIN ] Derivative Progress: 969/2052 symbols. JRS took 0.4s. Estimated remaining time: 7m 7s [2025-10-22T23:33:10.108557] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:10.151084] [DEBUG] [LOCAL ] JXN: Loaded 44322 existing records from primary storage. [2025-10-22T23:33:10.151259] [INFO ] [MAIN ] JXN: Loaded 44322 primary data records. [2025-10-22T23:33:10.500286] [DEBUG] [MAIN ] JXN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:10.527210] [INFO ] [MAIN ] JXN: Generated 138 derivative records from 44322 primary records. [2025-10-22T23:33:10.527418] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-22T23:33:10.539736] [DEBUG] [LOCAL ] JXN: Derivative data saved (138 records). [2025-10-22T23:33:10.539834] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-22T23:33:10.542714] [INFO ] [MAIN ] Derivative Progress: 970/2052 symbols. JXN took 0.4s. Estimated remaining time: 7m 6s [2025-10-22T23:33:10.542810] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:10.589076] [DEBUG] [LOCAL ] K: Loaded 50378 existing records from primary storage. [2025-10-22T23:33:10.589258] [INFO ] [MAIN ] K: Loaded 50378 primary data records. [2025-10-22T23:33:10.892483] [DEBUG] [MAIN ] K: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:10.917532] [INFO ] [MAIN ] K: Generated 138 derivative records from 50378 primary records. [2025-10-22T23:33:10.917751] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-22T23:33:10.929176] [DEBUG] [LOCAL ] K: Derivative data saved (138 records). [2025-10-22T23:33:10.929258] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-22T23:33:10.932166] [INFO ] [MAIN ] Derivative Progress: 971/2052 symbols. K took 0.4s. Estimated remaining time: 7m 6s [2025-10-22T23:33:10.932257] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:10.949165] [DEBUG] [LOCAL ] KAI: Loaded 13405 existing records from primary storage. [2025-10-22T23:33:10.949316] [INFO ] [MAIN ] KAI: Loaded 13405 primary data records. [2025-10-22T23:33:11.256139] [DEBUG] [MAIN ] KAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:11.281530] [INFO ] [MAIN ] KAI: Generated 138 derivative records from 13405 primary records. [2025-10-22T23:33:11.281704] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-22T23:33:11.293206] [DEBUG] [LOCAL ] KAI: Derivative data saved (138 records). [2025-10-22T23:33:11.293284] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-22T23:33:11.295866] [INFO ] [MAIN ] Derivative Progress: 972/2052 symbols. KAI took 0.4s. Estimated remaining time: 7m 5s [2025-10-22T23:33:11.295960] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:11.332135] [DEBUG] [LOCAL ] KAR: Loaded 39707 existing records from primary storage. [2025-10-22T23:33:11.332300] [INFO ] [MAIN ] KAR: Loaded 39707 primary data records. [2025-10-22T23:33:11.641384] [DEBUG] [MAIN ] KAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:11.667807] [INFO ] [MAIN ] KAR: Generated 138 derivative records from 39707 primary records. [2025-10-22T23:33:11.667992] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-22T23:33:11.680305] [DEBUG] [LOCAL ] KAR: Derivative data saved (138 records). [2025-10-22T23:33:11.680464] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-22T23:33:11.683460] [INFO ] [MAIN ] Derivative Progress: 973/2052 symbols. KAR took 0.4s. Estimated remaining time: 7m 5s [2025-10-22T23:33:11.683629] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:11.709380] [DEBUG] [LOCAL ] KB: Loaded 23045 existing records from primary storage. [2025-10-22T23:33:11.709583] [INFO ] [MAIN ] KB: Loaded 23045 primary data records. [2025-10-22T23:33:12.050790] [DEBUG] [MAIN ] KB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:12.076221] [INFO ] [MAIN ] KB: Generated 138 derivative records from 23045 primary records. [2025-10-22T23:33:12.076431] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-22T23:33:12.088146] [DEBUG] [LOCAL ] KB: Derivative data saved (138 records). [2025-10-22T23:33:12.088262] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-22T23:33:12.091151] [INFO ] [MAIN ] Derivative Progress: 974/2052 symbols. KB took 0.4s. Estimated remaining time: 7m 5s [2025-10-22T23:33:12.091249] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:12.115804] [DEBUG] [LOCAL ] KBDC: Loaded 22661 existing records from primary storage. [2025-10-22T23:33:12.115970] [INFO ] [MAIN ] KBDC: Loaded 22661 primary data records. [2025-10-22T23:33:12.421186] [DEBUG] [MAIN ] KBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:12.445986] [INFO ] [MAIN ] KBDC: Generated 138 derivative records from 22661 primary records. [2025-10-22T23:33:12.446123] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-22T23:33:12.457770] [DEBUG] [LOCAL ] KBDC: Derivative data saved (138 records). [2025-10-22T23:33:12.457854] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-22T23:33:12.460604] [INFO ] [MAIN ] Derivative Progress: 975/2052 symbols. KBDC took 0.4s. Estimated remaining time: 7m 4s [2025-10-22T23:33:12.460734] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:12.505156] [DEBUG] [LOCAL ] KBH: Loaded 48710 existing records from primary storage. [2025-10-22T23:33:12.505316] [INFO ] [MAIN ] KBH: Loaded 48710 primary data records. [2025-10-22T23:33:12.829273] [DEBUG] [MAIN ] KBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:12.854584] [INFO ] [MAIN ] KBH: Generated 138 derivative records from 48710 primary records. [2025-10-22T23:33:12.854728] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-22T23:33:12.865935] [DEBUG] [LOCAL ] KBH: Derivative data saved (138 records). [2025-10-22T23:33:12.866012] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-22T23:33:12.869197] [INFO ] [MAIN ] Derivative Progress: 976/2052 symbols. KBH took 0.4s. Estimated remaining time: 7m 4s [2025-10-22T23:33:12.869322] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:12.913893] [DEBUG] [LOCAL ] KBR: Loaded 47970 existing records from primary storage. [2025-10-22T23:33:12.914054] [INFO ] [MAIN ] KBR: Loaded 47970 primary data records. [2025-10-22T23:33:13.220503] [DEBUG] [MAIN ] KBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:13.246481] [INFO ] [MAIN ] KBR: Generated 138 derivative records from 47970 primary records. [2025-10-22T23:33:13.246622] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-22T23:33:13.258247] [DEBUG] [LOCAL ] KBR: Derivative data saved (138 records). [2025-10-22T23:33:13.258327] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-22T23:33:13.261283] [INFO ] [MAIN ] Derivative Progress: 977/2052 symbols. KBR took 0.4s. Estimated remaining time: 7m 3s [2025-10-22T23:33:13.261379] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:13.311073] [DEBUG] [LOCAL ] KD: Loaded 52332 existing records from primary storage. [2025-10-22T23:33:13.311239] [INFO ] [MAIN ] KD: Loaded 52332 primary data records. [2025-10-22T23:33:13.624957] [DEBUG] [MAIN ] KD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:13.651999] [INFO ] [MAIN ] KD: Generated 138 derivative records from 52332 primary records. [2025-10-22T23:33:13.652204] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-22T23:33:13.664119] [DEBUG] [LOCAL ] KD: Derivative data saved (138 records). [2025-10-22T23:33:13.664276] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-22T23:33:13.667816] [INFO ] [MAIN ] Derivative Progress: 978/2052 symbols. KD took 0.4s. Estimated remaining time: 7m 3s [2025-10-22T23:33:13.668011] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:13.677101] [DEBUG] [LOCAL ] KEN: Loaded 4612 existing records from primary storage. [2025-10-22T23:33:13.677295] [INFO ] [MAIN ] KEN: Loaded 4612 primary data records. [2025-10-22T23:33:13.983548] [DEBUG] [MAIN ] KEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:14.008611] [INFO ] [MAIN ] KEN: Generated 138 derivative records from 4612 primary records. [2025-10-22T23:33:14.008764] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-22T23:33:14.018851] [DEBUG] [LOCAL ] KEN: Derivative data saved (138 records). [2025-10-22T23:33:14.018930] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-22T23:33:14.020999] [INFO ] [MAIN ] Derivative Progress: 979/2052 symbols. KEN took 0.4s. Estimated remaining time: 7m 3s [2025-10-22T23:33:14.021101] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:14.053448] [DEBUG] [LOCAL ] KEP: Loaded 32572 existing records from primary storage. [2025-10-22T23:33:14.053603] [INFO ] [MAIN ] KEP: Loaded 32572 primary data records. [2025-10-22T23:33:14.359402] [DEBUG] [MAIN ] KEP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:14.384449] [INFO ] [MAIN ] KEP: Generated 138 derivative records from 32572 primary records. [2025-10-22T23:33:14.384577] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-22T23:33:14.396125] [DEBUG] [LOCAL ] KEP: Derivative data saved (138 records). [2025-10-22T23:33:14.396202] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-22T23:33:14.399076] [INFO ] [MAIN ] Derivative Progress: 980/2052 symbols. KEP took 0.4s. Estimated remaining time: 7m 2s [2025-10-22T23:33:14.399170] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:14.435598] [DEBUG] [LOCAL ] KEX: Loaded 38734 existing records from primary storage. [2025-10-22T23:33:14.435789] [INFO ] [MAIN ] KEX: Loaded 38734 primary data records. [2025-10-22T23:33:14.770227] [DEBUG] [MAIN ] KEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:14.796243] [INFO ] [MAIN ] KEX: Generated 138 derivative records from 38734 primary records. [2025-10-22T23:33:14.796417] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-22T23:33:14.807949] [DEBUG] [LOCAL ] KEX: Derivative data saved (138 records). [2025-10-22T23:33:14.808030] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-22T23:33:14.810997] [INFO ] [MAIN ] Derivative Progress: 981/2052 symbols. KEX took 0.4s. Estimated remaining time: 7m 2s [2025-10-22T23:33:14.811118] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:14.853202] [DEBUG] [LOCAL ] KEYS: Loaded 43120 existing records from primary storage. [2025-10-22T23:33:14.853363] [INFO ] [MAIN ] KEYS: Loaded 43120 primary data records. [2025-10-22T23:33:15.162395] [DEBUG] [MAIN ] KEYS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:15.189267] [INFO ] [MAIN ] KEYS: Generated 138 derivative records from 43120 primary records. [2025-10-22T23:33:15.189466] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-22T23:33:15.201639] [DEBUG] [LOCAL ] KEYS: Derivative data saved (138 records). [2025-10-22T23:33:15.201764] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-10-22T23:33:15.204321] [INFO ] [MAIN ] Derivative Progress: 982/2052 symbols. KEYS took 0.4s. Estimated remaining time: 7m 1s [2025-10-22T23:33:15.204429] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:15.209553] [DEBUG] [LOCAL ] KF: Loaded 2360 existing records from primary storage. [2025-10-22T23:33:15.209665] [INFO ] [MAIN ] KF: Loaded 2360 primary data records. [2025-10-22T23:33:15.533538] [DEBUG] [MAIN ] KF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:15.560738] [INFO ] [MAIN ] KF: Generated 138 derivative records from 2360 primary records. [2025-10-22T23:33:15.560929] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-22T23:33:15.570258] [DEBUG] [LOCAL ] KF: Derivative data saved (138 records). [2025-10-22T23:33:15.570368] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-10-22T23:33:15.572371] [INFO ] [MAIN ] Derivative Progress: 983/2052 symbols. KF took 0.4s. Estimated remaining time: 7m 1s [2025-10-22T23:33:15.572487] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:15.593465] [DEBUG] [LOCAL ] KFRC: Loaded 20843 existing records from primary storage. [2025-10-22T23:33:15.593638] [INFO ] [MAIN ] KFRC: Loaded 20843 primary data records. [2025-10-22T23:33:15.906101] [DEBUG] [MAIN ] KFRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:15.931328] [INFO ] [MAIN ] KFRC: Generated 138 derivative records from 20843 primary records. [2025-10-22T23:33:15.931457] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-22T23:33:15.942936] [DEBUG] [LOCAL ] KFRC: Derivative data saved (138 records). [2025-10-22T23:33:15.943019] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-22T23:33:15.945748] [INFO ] [MAIN ] Derivative Progress: 984/2052 symbols. KFRC took 0.4s. Estimated remaining time: 7m 1s [2025-10-22T23:33:15.945861] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:15.958365] [DEBUG] [LOCAL ] KFS: Loaded 8701 existing records from primary storage. [2025-10-22T23:33:15.958528] [INFO ] [MAIN ] KFS: Loaded 8701 primary data records. [2025-10-22T23:33:16.263104] [DEBUG] [MAIN ] KFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:16.288125] [INFO ] [MAIN ] KFS: Generated 138 derivative records from 8701 primary records. [2025-10-22T23:33:16.288257] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-22T23:33:16.299505] [DEBUG] [LOCAL ] KFS: Derivative data saved (138 records). [2025-10-22T23:33:16.299590] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-22T23:33:16.301729] [INFO ] [MAIN ] Derivative Progress: 985/2052 symbols. KFS took 0.4s. Estimated remaining time: 7m 0s [2025-10-22T23:33:16.301819] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:16.330414] [DEBUG] [LOCAL ] KFY: Loaded 29511 existing records from primary storage. [2025-10-22T23:33:16.330564] [INFO ] [MAIN ] KFY: Loaded 29511 primary data records. [2025-10-22T23:33:16.659855] [DEBUG] [MAIN ] KFY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:16.684674] [INFO ] [MAIN ] KFY: Generated 138 derivative records from 29511 primary records. [2025-10-22T23:33:16.684776] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-10-22T23:33:16.696179] [DEBUG] [LOCAL ] KFY: Derivative data saved (138 records). [2025-10-22T23:33:16.696258] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-10-22T23:33:16.699059] [INFO ] [MAIN ] Derivative Progress: 986/2052 symbols. KFY took 0.4s. Estimated remaining time: 6m 60s [2025-10-22T23:33:16.699155] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:16.751634] [DEBUG] [LOCAL ] KGC: Loaded 53700 existing records from primary storage. [2025-10-22T23:33:16.751827] [INFO ] [MAIN ] KGC: Loaded 53700 primary data records. [2025-10-22T23:33:17.055108] [DEBUG] [MAIN ] KGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:17.080293] [INFO ] [MAIN ] KGC: Generated 138 derivative records from 53700 primary records. [2025-10-22T23:33:17.080398] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-22T23:33:17.092125] [DEBUG] [LOCAL ] KGC: Derivative data saved (138 records). [2025-10-22T23:33:17.092203] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-22T23:33:17.095176] [INFO ] [MAIN ] Derivative Progress: 987/2052 symbols. KGC took 0.4s. Estimated remaining time: 6m 59s [2025-10-22T23:33:17.095272] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:17.137293] [DEBUG] [LOCAL ] KGS: Loaded 46063 existing records from primary storage. [2025-10-22T23:33:17.137454] [INFO ] [MAIN ] KGS: Loaded 46063 primary data records. [2025-10-22T23:33:17.440189] [DEBUG] [MAIN ] KGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:17.465628] [INFO ] [MAIN ] KGS: Generated 138 derivative records from 46063 primary records. [2025-10-22T23:33:17.465798] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-22T23:33:17.476999] [DEBUG] [LOCAL ] KGS: Derivative data saved (138 records). [2025-10-22T23:33:17.477083] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-22T23:33:17.479885] [INFO ] [MAIN ] Derivative Progress: 988/2052 symbols. KGS took 0.4s. Estimated remaining time: 6m 59s [2025-10-22T23:33:17.480025] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:17.505407] [DEBUG] [LOCAL ] KIO: Loaded 21683 existing records from primary storage. [2025-10-22T23:33:17.505575] [INFO ] [MAIN ] KIO: Loaded 21683 primary data records. [2025-10-22T23:33:17.813786] [DEBUG] [MAIN ] KIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:17.839206] [INFO ] [MAIN ] KIO: Generated 138 derivative records from 21683 primary records. [2025-10-22T23:33:17.839311] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-22T23:33:17.850699] [DEBUG] [LOCAL ] KIO: Derivative data saved (138 records). [2025-10-22T23:33:17.850779] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-22T23:33:17.853408] [INFO ] [MAIN ] Derivative Progress: 989/2052 symbols. KIO took 0.4s. Estimated remaining time: 6m 59s [2025-10-22T23:33:17.853514] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:17.910084] [DEBUG] [LOCAL ] KKR: Loaded 53500 existing records from primary storage. [2025-10-22T23:33:17.910264] [INFO ] [MAIN ] KKR: Loaded 53500 primary data records. [2025-10-22T23:33:18.309197] [DEBUG] [MAIN ] KKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:18.349044] [INFO ] [MAIN ] KKR: Generated 138 derivative records from 53500 primary records. [2025-10-22T23:33:18.349284] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-22T23:33:18.367785] [DEBUG] [LOCAL ] KKR: Derivative data saved (138 records). [2025-10-22T23:33:18.367993] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-10-22T23:33:18.371879] [INFO ] [MAIN ] Derivative Progress: 990/2052 symbols. KKR took 0.5s. Estimated remaining time: 6m 58s [2025-10-22T23:33:18.372124] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:18.385179] [DEBUG] [LOCAL ] KKRS: Loaded 5547 existing records from primary storage. [2025-10-22T23:33:18.385361] [INFO ] [MAIN ] KKRS: Loaded 5547 primary data records. [2025-10-22T23:33:18.891421] [DEBUG] [MAIN ] KKRS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:33:18.920637] [INFO ] [MAIN ] KKRS: Generated 138 derivative records from 5547 primary records. [2025-10-22T23:33:18.920888] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-22T23:33:18.931865] [DEBUG] [LOCAL ] KKRS: Derivative data saved (138 records). [2025-10-22T23:33:18.932022] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-22T23:33:18.934233] [INFO ] [MAIN ] Derivative Progress: 991/2052 symbols. KKRS took 0.6s. Estimated remaining time: 6m 58s [2025-10-22T23:33:18.934342] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:18.971144] [DEBUG] [LOCAL ] KLC: Loaded 36128 existing records from primary storage. [2025-10-22T23:33:18.971329] [INFO ] [MAIN ] KLC: Loaded 36128 primary data records. [2025-10-22T23:33:19.311327] [DEBUG] [MAIN ] KLC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:19.337400] [INFO ] [MAIN ] KLC: Generated 138 derivative records from 36128 primary records. [2025-10-22T23:33:19.337583] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-22T23:33:19.349135] [DEBUG] [LOCAL ] KLC: Derivative data saved (138 records). [2025-10-22T23:33:19.349252] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-22T23:33:19.352085] [INFO ] [MAIN ] Derivative Progress: 992/2052 symbols. KLC took 0.4s. Estimated remaining time: 6m 58s [2025-10-22T23:33:19.352196] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:19.409844] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-22T23:33:19.410020] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-10-22T23:33:19.774940] [DEBUG] [MAIN ] KMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:19.802242] [INFO ] [MAIN ] KMI: Generated 138 derivative records from 53693 primary records. [2025-10-22T23:33:19.802435] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-22T23:33:19.814605] [DEBUG] [LOCAL ] KMI: Derivative data saved (138 records). [2025-10-22T23:33:19.814772] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-10-22T23:33:19.818099] [INFO ] [MAIN ] Derivative Progress: 993/2052 symbols. KMI took 0.5s. Estimated remaining time: 6m 57s [2025-10-22T23:33:19.818255] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:19.823751] [DEBUG] [LOCAL ] KMPB: Loaded 3484 existing records from primary storage. [2025-10-22T23:33:19.823902] [INFO ] [MAIN ] KMPB: Loaded 3484 primary data records. [2025-10-22T23:33:20.156926] [DEBUG] [MAIN ] KMPB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:20.182334] [INFO ] [MAIN ] KMPB: Generated 138 derivative records from 3484 primary records. [2025-10-22T23:33:20.182491] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-22T23:33:20.192621] [DEBUG] [LOCAL ] KMPB: Derivative data saved (138 records). [2025-10-22T23:33:20.192864] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-22T23:33:20.194921] [INFO ] [MAIN ] Derivative Progress: 994/2052 symbols. KMPB took 0.4s. Estimated remaining time: 6m 57s [2025-10-22T23:33:20.195023] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:20.236910] [DEBUG] [LOCAL ] KMPR: Loaded 40496 existing records from primary storage. [2025-10-22T23:33:20.237074] [INFO ] [MAIN ] KMPR: Loaded 40496 primary data records. [2025-10-22T23:33:20.553311] [DEBUG] [MAIN ] KMPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:20.579235] [INFO ] [MAIN ] KMPR: Generated 138 derivative records from 40496 primary records. [2025-10-22T23:33:20.579347] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-22T23:33:20.591073] [DEBUG] [LOCAL ] KMPR: Derivative data saved (138 records). [2025-10-22T23:33:20.591158] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-22T23:33:20.594294] [INFO ] [MAIN ] Derivative Progress: 995/2052 symbols. KMPR took 0.4s. Estimated remaining time: 6m 57s [2025-10-22T23:33:20.594407] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:20.636912] [DEBUG] [LOCAL ] KMT: Loaded 42861 existing records from primary storage. [2025-10-22T23:33:20.637070] [INFO ] [MAIN ] KMT: Loaded 42861 primary data records. [2025-10-22T23:33:20.948770] [DEBUG] [MAIN ] KMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:20.973817] [INFO ] [MAIN ] KMT: Generated 138 derivative records from 42861 primary records. [2025-10-22T23:33:20.973922] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-22T23:33:20.985456] [DEBUG] [LOCAL ] KMT: Derivative data saved (138 records). [2025-10-22T23:33:20.985540] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-22T23:33:20.988480] [INFO ] [MAIN ] Derivative Progress: 996/2052 symbols. KMT took 0.4s. Estimated remaining time: 6m 56s [2025-10-22T23:33:20.988584] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:21.041247] [DEBUG] [LOCAL ] KMX: Loaded 53286 existing records from primary storage. [2025-10-22T23:33:21.041425] [INFO ] [MAIN ] KMX: Loaded 53286 primary data records. [2025-10-22T23:33:21.380609] [DEBUG] [MAIN ] KMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:21.407843] [INFO ] [MAIN ] KMX: Generated 138 derivative records from 53286 primary records. [2025-10-22T23:33:21.407974] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-22T23:33:21.419854] [DEBUG] [LOCAL ] KMX: Derivative data saved (138 records). [2025-10-22T23:33:21.419943] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-10-22T23:33:21.423128] [INFO ] [MAIN ] Derivative Progress: 997/2052 symbols. KMX took 0.4s. Estimated remaining time: 6m 56s [2025-10-22T23:33:21.423231] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:21.464831] [DEBUG] [LOCAL ] KN: Loaded 38389 existing records from primary storage. [2025-10-22T23:33:21.464993] [INFO ] [MAIN ] KN: Loaded 38389 primary data records. [2025-10-22T23:33:21.791449] [DEBUG] [MAIN ] KN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:21.829261] [INFO ] [MAIN ] KN: Generated 138 derivative records from 38389 primary records. [2025-10-22T23:33:21.829456] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-22T23:33:21.841428] [DEBUG] [LOCAL ] KN: Derivative data saved (138 records). [2025-10-22T23:33:21.841516] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-22T23:33:21.844438] [INFO ] [MAIN ] Derivative Progress: 998/2052 symbols. KN took 0.4s. Estimated remaining time: 6m 55s [2025-10-22T23:33:21.844538] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:21.882714] [DEBUG] [LOCAL ] KNF: Loaded 36630 existing records from primary storage. [2025-10-22T23:33:21.882887] [INFO ] [MAIN ] KNF: Loaded 36630 primary data records. [2025-10-22T23:33:22.191979] [DEBUG] [MAIN ] KNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:22.217077] [INFO ] [MAIN ] KNF: Generated 138 derivative records from 36630 primary records. [2025-10-22T23:33:22.217188] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-22T23:33:22.228745] [DEBUG] [LOCAL ] KNF: Derivative data saved (138 records). [2025-10-22T23:33:22.228827] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-22T23:33:22.232047] [INFO ] [MAIN ] Derivative Progress: 999/2052 symbols. KNF took 0.4s. Estimated remaining time: 6m 55s [2025-10-22T23:33:22.232149] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:22.245920] [DEBUG] [LOCAL ] KNOP: Loaded 10075 existing records from primary storage. [2025-10-22T23:33:22.246039] [INFO ] [MAIN ] KNOP: Loaded 10075 primary data records. [2025-10-22T23:33:22.551059] [DEBUG] [MAIN ] KNOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:22.576497] [INFO ] [MAIN ] KNOP: Generated 138 derivative records from 10075 primary records. [2025-10-22T23:33:22.576666] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-10-22T23:33:22.587911] [DEBUG] [LOCAL ] KNOP: Derivative data saved (138 records). [2025-10-22T23:33:22.588012] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-10-22T23:33:22.590171] [INFO ] [MAIN ] Derivative Progress: 1000/2052 symbols. KNOP took 0.4s. Estimated remaining time: 6m 55s [2025-10-22T23:33:22.590266] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:22.610832] [DEBUG] [LOCAL ] KNSL: Loaded 18288 existing records from primary storage. [2025-10-22T23:33:22.610969] [INFO ] [MAIN ] KNSL: Loaded 18288 primary data records. [2025-10-22T23:33:22.919012] [DEBUG] [MAIN ] KNSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:22.943886] [INFO ] [MAIN ] KNSL: Generated 138 derivative records from 18288 primary records. [2025-10-22T23:33:22.944039] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-22T23:33:22.955853] [DEBUG] [LOCAL ] KNSL: Derivative data saved (138 records). [2025-10-22T23:33:22.955936] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-22T23:33:22.958688] [INFO ] [MAIN ] Derivative Progress: 1001/2052 symbols. KNSL took 0.4s. Estimated remaining time: 6m 54s [2025-10-22T23:33:22.958786] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:23.006076] [DEBUG] [LOCAL ] KNTK: Loaded 47207 existing records from primary storage. [2025-10-22T23:33:23.006259] [INFO ] [MAIN ] KNTK: Loaded 47207 primary data records. [2025-10-22T23:33:23.340009] [DEBUG] [MAIN ] KNTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:23.365490] [INFO ] [MAIN ] KNTK: Generated 138 derivative records from 47207 primary records. [2025-10-22T23:33:23.365598] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-22T23:33:23.377128] [DEBUG] [LOCAL ] KNTK: Derivative data saved (138 records). [2025-10-22T23:33:23.377209] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-22T23:33:23.380198] [INFO ] [MAIN ] Derivative Progress: 1002/2052 symbols. KNTK took 0.4s. Estimated remaining time: 6m 54s [2025-10-22T23:33:23.380295] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:23.433609] [DEBUG] [LOCAL ] KNX: Loaded 52645 existing records from primary storage. [2025-10-22T23:33:23.433814] [INFO ] [MAIN ] KNX: Loaded 52645 primary data records. [2025-10-22T23:33:23.756614] [DEBUG] [MAIN ] KNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:23.790762] [INFO ] [MAIN ] KNX: Generated 138 derivative records from 52645 primary records. [2025-10-22T23:33:23.790911] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-22T23:33:23.802512] [DEBUG] [LOCAL ] KNX: Derivative data saved (138 records). [2025-10-22T23:33:23.802632] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-22T23:33:23.805871] [INFO ] [MAIN ] Derivative Progress: 1003/2052 symbols. KNX took 0.4s. Estimated remaining time: 6m 54s [2025-10-22T23:33:23.806043] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:23.851831] [DEBUG] [LOCAL ] KODK: Loaded 43711 existing records from primary storage. [2025-10-22T23:33:23.852052] [INFO ] [MAIN ] KODK: Loaded 43711 primary data records. [2025-10-22T23:33:24.223519] [DEBUG] [MAIN ] KODK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:24.249278] [INFO ] [MAIN ] KODK: Generated 138 derivative records from 43711 primary records. [2025-10-22T23:33:24.249422] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-22T23:33:24.260301] [DEBUG] [LOCAL ] KODK: Derivative data saved (138 records). [2025-10-22T23:33:24.260378] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-22T23:33:24.263130] [INFO ] [MAIN ] Derivative Progress: 1004/2052 symbols. KODK took 0.5s. Estimated remaining time: 6m 53s [2025-10-22T23:33:24.263226] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:24.290468] [DEBUG] [LOCAL ] KOF: Loaded 26529 existing records from primary storage. [2025-10-22T23:33:24.290607] [INFO ] [MAIN ] KOF: Loaded 26529 primary data records. [2025-10-22T23:33:24.596392] [DEBUG] [MAIN ] KOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:24.621717] [INFO ] [MAIN ] KOF: Generated 138 derivative records from 26529 primary records. [2025-10-22T23:33:24.621821] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-22T23:33:24.635372] [DEBUG] [LOCAL ] KOF: Derivative data saved (138 records). [2025-10-22T23:33:24.635469] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-22T23:33:24.638628] [INFO ] [MAIN ] Derivative Progress: 1005/2052 symbols. KOF took 0.4s. Estimated remaining time: 6m 53s [2025-10-22T23:33:24.638786] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:24.658881] [DEBUG] [LOCAL ] KOP: Loaded 17332 existing records from primary storage. [2025-10-22T23:33:24.659014] [INFO ] [MAIN ] KOP: Loaded 17332 primary data records. [2025-10-22T23:33:24.972435] [DEBUG] [MAIN ] KOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:25.003832] [INFO ] [MAIN ] KOP: Generated 138 derivative records from 17332 primary records. [2025-10-22T23:33:25.004016] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-22T23:33:25.015629] [DEBUG] [LOCAL ] KOP: Derivative data saved (138 records). [2025-10-22T23:33:25.015742] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-22T23:33:25.018458] [INFO ] [MAIN ] Derivative Progress: 1006/2052 symbols. KOP took 0.4s. Estimated remaining time: 6m 52s [2025-10-22T23:33:25.018562] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:25.022745] [DEBUG] [LOCAL ] KORE: Loaded 2179 existing records from primary storage. [2025-10-22T23:33:25.022837] [INFO ] [MAIN ] KORE: Loaded 2179 primary data records. [2025-10-22T23:33:25.352067] [DEBUG] [MAIN ] KORE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:25.377365] [INFO ] [MAIN ] KORE: Generated 138 derivative records from 2179 primary records. [2025-10-22T23:33:25.377529] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-10-22T23:33:25.386577] [DEBUG] [LOCAL ] KORE: Derivative data saved (138 records). [2025-10-22T23:33:25.386688] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-10-22T23:33:25.388824] [INFO ] [MAIN ] Derivative Progress: 1007/2052 symbols. KORE took 0.4s. Estimated remaining time: 6m 52s [2025-10-22T23:33:25.388938] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:25.445995] [DEBUG] [LOCAL ] KOS: Loaded 53093 existing records from primary storage. [2025-10-22T23:33:25.446162] [INFO ] [MAIN ] KOS: Loaded 53093 primary data records. [2025-10-22T23:33:25.753730] [DEBUG] [MAIN ] KOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:25.779083] [INFO ] [MAIN ] KOS: Generated 138 derivative records from 53093 primary records. [2025-10-22T23:33:25.779227] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-22T23:33:25.791088] [DEBUG] [LOCAL ] KOS: Derivative data saved (138 records). [2025-10-22T23:33:25.791170] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-22T23:33:25.794397] [INFO ] [MAIN ] Derivative Progress: 1008/2052 symbols. KOS took 0.4s. Estimated remaining time: 6m 52s [2025-10-22T23:33:25.794506] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:25.849262] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-22T23:33:25.849431] [INFO ] [MAIN ] KR: Loaded 53681 primary data records. [2025-10-22T23:33:26.163608] [DEBUG] [MAIN ] KR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:26.189084] [INFO ] [MAIN ] KR: Generated 138 derivative records from 53681 primary records. [2025-10-22T23:33:26.189206] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-22T23:33:26.201046] [DEBUG] [LOCAL ] KR: Derivative data saved (138 records). [2025-10-22T23:33:26.201129] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-22T23:33:26.204084] [INFO ] [MAIN ] Derivative Progress: 1009/2052 symbols. KR took 0.4s. Estimated remaining time: 6m 51s [2025-10-22T23:33:26.204186] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:26.252055] [DEBUG] [LOCAL ] KRC: Loaded 48094 existing records from primary storage. [2025-10-22T23:33:26.252241] [INFO ] [MAIN ] KRC: Loaded 48094 primary data records. [2025-10-22T23:33:26.574199] [DEBUG] [MAIN ] KRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:26.603876] [INFO ] [MAIN ] KRC: Generated 138 derivative records from 48094 primary records. [2025-10-22T23:33:26.604053] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-22T23:33:26.617680] [DEBUG] [LOCAL ] KRC: Derivative data saved (138 records). [2025-10-22T23:33:26.617776] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-10-22T23:33:26.621087] [INFO ] [MAIN ] Derivative Progress: 1010/2052 symbols. KRC took 0.4s. Estimated remaining time: 6m 51s [2025-10-22T23:33:26.621309] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:26.661220] [DEBUG] [LOCAL ] KREF: Loaded 38061 existing records from primary storage. [2025-10-22T23:33:26.661380] [INFO ] [MAIN ] KREF: Loaded 38061 primary data records. [2025-10-22T23:33:26.967662] [DEBUG] [MAIN ] KREF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:26.993200] [INFO ] [MAIN ] KREF: Generated 138 derivative records from 38061 primary records. [2025-10-22T23:33:26.993359] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-22T23:33:27.005067] [DEBUG] [LOCAL ] KREF: Derivative data saved (138 records). [2025-10-22T23:33:27.005152] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-22T23:33:27.008031] [INFO ] [MAIN ] Derivative Progress: 1011/2052 symbols. KREF took 0.4s. Estimated remaining time: 6m 50s [2025-10-22T23:33:27.008166] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:27.058764] [DEBUG] [LOCAL ] KRG: Loaded 49271 existing records from primary storage. [2025-10-22T23:33:27.058953] [INFO ] [MAIN ] KRG: Loaded 49271 primary data records. [2025-10-22T23:33:27.371359] [DEBUG] [MAIN ] KRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:27.396970] [INFO ] [MAIN ] KRG: Generated 138 derivative records from 49271 primary records. [2025-10-22T23:33:27.397086] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-22T23:33:27.408777] [DEBUG] [LOCAL ] KRG: Derivative data saved (138 records). [2025-10-22T23:33:27.408862] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-22T23:33:27.411733] [INFO ] [MAIN ] Derivative Progress: 1012/2052 symbols. KRG took 0.4s. Estimated remaining time: 6m 50s [2025-10-22T23:33:27.411833] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:27.439213] [DEBUG] [LOCAL ] KRO: Loaded 26553 existing records from primary storage. [2025-10-22T23:33:27.439361] [INFO ] [MAIN ] KRO: Loaded 26553 primary data records. [2025-10-22T23:33:27.770215] [DEBUG] [MAIN ] KRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:27.795344] [INFO ] [MAIN ] KRO: Generated 138 derivative records from 26553 primary records. [2025-10-22T23:33:27.795475] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-22T23:33:27.806569] [DEBUG] [LOCAL ] KRO: Derivative data saved (138 records). [2025-10-22T23:33:27.806685] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-22T23:33:27.809356] [INFO ] [MAIN ] Derivative Progress: 1013/2052 symbols. KRO took 0.4s. Estimated remaining time: 6m 50s [2025-10-22T23:33:27.809474] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:27.845273] [DEBUG] [LOCAL ] KRP: Loaded 35928 existing records from primary storage. [2025-10-22T23:33:27.845443] [INFO ] [MAIN ] KRP: Loaded 35928 primary data records. [2025-10-22T23:33:28.160811] [DEBUG] [MAIN ] KRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:28.185899] [INFO ] [MAIN ] KRP: Generated 138 derivative records from 35928 primary records. [2025-10-22T23:33:28.186081] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-22T23:33:28.197757] [DEBUG] [LOCAL ] KRP: Derivative data saved (138 records). [2025-10-22T23:33:28.197854] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-22T23:33:28.200870] [INFO ] [MAIN ] Derivative Progress: 1014/2052 symbols. KRP took 0.4s. Estimated remaining time: 6m 49s [2025-10-22T23:33:28.200984] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:28.253080] [DEBUG] [LOCAL ] KSS: Loaded 53589 existing records from primary storage. [2025-10-22T23:33:28.253243] [INFO ] [MAIN ] KSS: Loaded 53589 primary data records. [2025-10-22T23:33:28.562115] [DEBUG] [MAIN ] KSS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:28.587062] [INFO ] [MAIN ] KSS: Generated 138 derivative records from 53589 primary records. [2025-10-22T23:33:28.587171] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-22T23:33:28.599101] [DEBUG] [LOCAL ] KSS: Derivative data saved (138 records). [2025-10-22T23:33:28.599191] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-22T23:33:28.602285] [INFO ] [MAIN ] Derivative Progress: 1015/2052 symbols. KSS took 0.4s. Estimated remaining time: 6m 49s [2025-10-22T23:33:28.602381] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:28.645005] [DEBUG] [LOCAL ] KT: Loaded 45383 existing records from primary storage. [2025-10-22T23:33:28.645166] [INFO ] [MAIN ] KT: Loaded 45383 primary data records. [2025-10-22T23:33:28.949544] [DEBUG] [MAIN ] KT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:28.974503] [INFO ] [MAIN ] KT: Generated 138 derivative records from 45383 primary records. [2025-10-22T23:33:28.974623] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-22T23:33:28.986131] [DEBUG] [LOCAL ] KT: Derivative data saved (138 records). [2025-10-22T23:33:28.986210] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-22T23:33:28.988800] [INFO ] [MAIN ] Derivative Progress: 1016/2052 symbols. KT took 0.4s. Estimated remaining time: 6m 48s [2025-10-22T23:33:28.988903] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:29.026450] [DEBUG] [LOCAL ] KTB: Loaded 40299 existing records from primary storage. [2025-10-22T23:33:29.026613] [INFO ] [MAIN ] KTB: Loaded 40299 primary data records. [2025-10-22T23:33:29.337041] [DEBUG] [MAIN ] KTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:29.365440] [INFO ] [MAIN ] KTB: Generated 138 derivative records from 40299 primary records. [2025-10-22T23:33:29.365579] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-22T23:33:29.376893] [DEBUG] [LOCAL ] KTB: Derivative data saved (138 records). [2025-10-22T23:33:29.376974] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-22T23:33:29.379800] [INFO ] [MAIN ] Derivative Progress: 1017/2052 symbols. KTB took 0.4s. Estimated remaining time: 6m 48s [2025-10-22T23:33:29.379895] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:29.395029] [DEBUG] [LOCAL ] KTF: Loaded 11658 existing records from primary storage. [2025-10-22T23:33:29.395174] [INFO ] [MAIN ] KTF: Loaded 11658 primary data records. [2025-10-22T23:33:29.736267] [DEBUG] [MAIN ] KTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:29.762637] [INFO ] [MAIN ] KTF: Generated 138 derivative records from 11658 primary records. [2025-10-22T23:33:29.762807] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-22T23:33:29.773908] [DEBUG] [LOCAL ] KTF: Derivative data saved (138 records). [2025-10-22T23:33:29.773993] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-22T23:33:29.776605] [INFO ] [MAIN ] Derivative Progress: 1018/2052 symbols. KTF took 0.4s. Estimated remaining time: 6m 48s [2025-10-22T23:33:29.776740] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:29.829813] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-22T23:33:29.829978] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-10-22T23:33:30.156076] [DEBUG] [MAIN ] KVUE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:30.183692] [INFO ] [MAIN ] KVUE: Generated 138 derivative records from 53667 primary records. [2025-10-22T23:33:30.183880] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-22T23:33:30.195954] [DEBUG] [LOCAL ] KVUE: Derivative data saved (138 records). [2025-10-22T23:33:30.196035] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-22T23:33:30.199113] [INFO ] [MAIN ] Derivative Progress: 1019/2052 symbols. KVUE took 0.4s. Estimated remaining time: 6m 47s [2025-10-22T23:33:30.199212] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:30.248331] [DEBUG] [LOCAL ] KVYO: Loaded 50891 existing records from primary storage. [2025-10-22T23:33:30.248490] [INFO ] [MAIN ] KVYO: Loaded 50891 primary data records. [2025-10-22T23:33:30.567952] [DEBUG] [MAIN ] KVYO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:30.594375] [INFO ] [MAIN ] KVYO: Generated 138 derivative records from 50891 primary records. [2025-10-22T23:33:30.594513] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-22T23:33:30.606096] [DEBUG] [LOCAL ] KVYO: Derivative data saved (138 records). [2025-10-22T23:33:30.606175] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-22T23:33:30.609257] [INFO ] [MAIN ] Derivative Progress: 1020/2052 symbols. KVYO took 0.4s. Estimated remaining time: 6m 47s [2025-10-22T23:33:30.609363] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:30.647344] [DEBUG] [LOCAL ] KW: Loaded 40330 existing records from primary storage. [2025-10-22T23:33:30.647508] [INFO ] [MAIN ] KW: Loaded 40330 primary data records. [2025-10-22T23:33:30.962117] [DEBUG] [MAIN ] KW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:30.987339] [INFO ] [MAIN ] KW: Generated 138 derivative records from 40330 primary records. [2025-10-22T23:33:30.987501] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-22T23:33:30.998672] [DEBUG] [LOCAL ] KW: Derivative data saved (138 records). [2025-10-22T23:33:30.998759] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-22T23:33:31.001473] [INFO ] [MAIN ] Derivative Progress: 1021/2052 symbols. KW took 0.4s. Estimated remaining time: 6m 47s [2025-10-22T23:33:31.001569] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:31.020784] [DEBUG] [LOCAL ] KWR: Loaded 15690 existing records from primary storage. [2025-10-22T23:33:31.020940] [INFO ] [MAIN ] KWR: Loaded 15690 primary data records. [2025-10-22T23:33:31.332907] [DEBUG] [MAIN ] KWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:31.358239] [INFO ] [MAIN ] KWR: Generated 138 derivative records from 15690 primary records. [2025-10-22T23:33:31.358452] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-22T23:33:31.370123] [DEBUG] [LOCAL ] KWR: Derivative data saved (138 records). [2025-10-22T23:33:31.370204] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-22T23:33:31.372735] [INFO ] [MAIN ] Derivative Progress: 1022/2052 symbols. KWR took 0.4s. Estimated remaining time: 6m 46s [2025-10-22T23:33:31.372836] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:31.403346] [DEBUG] [LOCAL ] KYN: Loaded 30129 existing records from primary storage. [2025-10-22T23:33:31.403510] [INFO ] [MAIN ] KYN: Loaded 30129 primary data records. [2025-10-22T23:33:31.735500] [DEBUG] [MAIN ] KYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:31.760458] [INFO ] [MAIN ] KYN: Generated 138 derivative records from 30129 primary records. [2025-10-22T23:33:31.760576] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-22T23:33:31.772031] [DEBUG] [LOCAL ] KYN: Derivative data saved (138 records). [2025-10-22T23:33:31.772113] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-22T23:33:31.774842] [INFO ] [MAIN ] Derivative Progress: 1023/2052 symbols. KYN took 0.4s. Estimated remaining time: 6m 46s [2025-10-22T23:33:31.774944] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:31.812349] [DEBUG] [LOCAL ] L: Loaded 41146 existing records from primary storage. [2025-10-22T23:33:31.812511] [INFO ] [MAIN ] L: Loaded 41146 primary data records. [2025-10-22T23:33:32.121619] [DEBUG] [MAIN ] L: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:32.146472] [INFO ] [MAIN ] L: Generated 138 derivative records from 41146 primary records. [2025-10-22T23:33:32.146611] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-10-22T23:33:32.158041] [DEBUG] [LOCAL ] L: Derivative data saved (138 records). [2025-10-22T23:33:32.158121] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-10-22T23:33:32.160975] [INFO ] [MAIN ] Derivative Progress: 1024/2052 symbols. L took 0.4s. Estimated remaining time: 6m 45s [2025-10-22T23:33:32.161074] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:32.211011] [DEBUG] [LOCAL ] LAC: Loaded 52571 existing records from primary storage. [2025-10-22T23:33:32.211187] [INFO ] [MAIN ] LAC: Loaded 52571 primary data records. [2025-10-22T23:33:32.525463] [DEBUG] [MAIN ] LAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:32.550500] [INFO ] [MAIN ] LAC: Generated 138 derivative records from 52571 primary records. [2025-10-22T23:33:32.550666] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-22T23:33:32.562112] [DEBUG] [LOCAL ] LAC: Derivative data saved (138 records). [2025-10-22T23:33:32.562191] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-22T23:33:32.565388] [INFO ] [MAIN ] Derivative Progress: 1025/2052 symbols. LAC took 0.4s. Estimated remaining time: 6m 45s [2025-10-22T23:33:32.565487] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:32.590043] [DEBUG] [LOCAL ] LAD: Loaded 23290 existing records from primary storage. [2025-10-22T23:33:32.590193] [INFO ] [MAIN ] LAD: Loaded 23290 primary data records. [2025-10-22T23:33:32.904192] [DEBUG] [MAIN ] LAD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:33:32.929618] [INFO ] [MAIN ] LAD: Generated 138 derivative records from 23290 primary records. [2025-10-22T23:33:32.929799] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-22T23:33:32.941252] [DEBUG] [LOCAL ] LAD: Derivative data saved (138 records). [2025-10-22T23:33:32.941330] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-10-22T23:33:32.944001] [INFO ] [MAIN ] Derivative Progress: 1026/2052 symbols. LAD took 0.4s. Estimated remaining time: 6m 45s [2025-10-22T23:33:32.944094] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:32.982585] [DEBUG] [LOCAL ] LADR: Loaded 39334 existing records from primary storage. [2025-10-22T23:33:32.982778] [INFO ] [MAIN ] LADR: Loaded 39334 primary data records. [2025-10-22T23:33:33.288351] [DEBUG] [MAIN ] LADR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:33.314616] [INFO ] [MAIN ] LADR: Generated 138 derivative records from 39334 primary records. [2025-10-22T23:33:33.314841] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-22T23:33:33.326319] [DEBUG] [LOCAL ] LADR: Derivative data saved (138 records). [2025-10-22T23:33:33.326406] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-22T23:33:33.329232] [INFO ] [MAIN ] Derivative Progress: 1027/2052 symbols. LADR took 0.4s. Estimated remaining time: 6m 44s [2025-10-22T23:33:33.329358] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:33.334955] [DEBUG] [LOCAL ] LANV: Loaded 2784 existing records from primary storage. [2025-10-22T23:33:33.335111] [INFO ] [MAIN ] LANV: Loaded 2784 primary data records. [2025-10-22T23:33:33.670298] [DEBUG] [MAIN ] LANV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:33.695562] [INFO ] [MAIN ] LANV: Generated 138 derivative records from 2784 primary records. [2025-10-22T23:33:33.695778] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-22T23:33:33.704681] [DEBUG] [LOCAL ] LANV: Derivative data saved (138 records). [2025-10-22T23:33:33.704762] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-22T23:33:33.706840] [INFO ] [MAIN ] Derivative Progress: 1028/2052 symbols. LANV took 0.4s. Estimated remaining time: 6m 44s [2025-10-22T23:33:33.706932] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:33.723121] [DEBUG] [LOCAL ] LAW: Loaded 14897 existing records from primary storage. [2025-10-22T23:33:33.723261] [INFO ] [MAIN ] LAW: Loaded 14897 primary data records. [2025-10-22T23:33:34.029944] [DEBUG] [MAIN ] LAW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:34.054902] [INFO ] [MAIN ] LAW: Generated 138 derivative records from 14897 primary records. [2025-10-22T23:33:34.055014] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-22T23:33:34.066153] [DEBUG] [LOCAL ] LAW: Derivative data saved (138 records). [2025-10-22T23:33:34.066234] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-22T23:33:34.068331] [INFO ] [MAIN ] Derivative Progress: 1029/2052 symbols. LAW took 0.4s. Estimated remaining time: 6m 43s [2025-10-22T23:33:34.068424] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:34.110263] [DEBUG] [LOCAL ] LAZ: Loaded 44442 existing records from primary storage. [2025-10-22T23:33:34.110419] [INFO ] [MAIN ] LAZ: Loaded 44442 primary data records. [2025-10-22T23:33:34.418885] [DEBUG] [MAIN ] LAZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:34.443821] [INFO ] [MAIN ] LAZ: Generated 138 derivative records from 44442 primary records. [2025-10-22T23:33:34.443968] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-22T23:33:34.455541] [DEBUG] [LOCAL ] LAZ: Derivative data saved (138 records). [2025-10-22T23:33:34.455631] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-22T23:33:34.458388] [INFO ] [MAIN ] Derivative Progress: 1030/2052 symbols. LAZ took 0.4s. Estimated remaining time: 6m 43s [2025-10-22T23:33:34.458489] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:34.493154] [DEBUG] [LOCAL ] LB: Loaded 36982 existing records from primary storage. [2025-10-22T23:33:34.493321] [INFO ] [MAIN ] LB: Loaded 36982 primary data records. [2025-10-22T23:33:34.802701] [DEBUG] [MAIN ] LB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:34.827691] [INFO ] [MAIN ] LB: Generated 138 derivative records from 36982 primary records. [2025-10-22T23:33:34.827837] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-22T23:33:34.839233] [DEBUG] [LOCAL ] LB: Derivative data saved (138 records). [2025-10-22T23:33:34.839322] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-10-22T23:33:34.842170] [INFO ] [MAIN ] Derivative Progress: 1031/2052 symbols. LB took 0.4s. Estimated remaining time: 6m 42s [2025-10-22T23:33:34.842266] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:34.889706] [DEBUG] [LOCAL ] LC: Loaded 48255 existing records from primary storage. [2025-10-22T23:33:34.889871] [INFO ] [MAIN ] LC: Loaded 48255 primary data records. [2025-10-22T23:33:35.196255] [DEBUG] [MAIN ] LC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:35.221252] [INFO ] [MAIN ] LC: Generated 138 derivative records from 48255 primary records. [2025-10-22T23:33:35.221401] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-22T23:33:35.233294] [DEBUG] [LOCAL ] LC: Derivative data saved (138 records). [2025-10-22T23:33:35.233385] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-10-22T23:33:35.236263] [INFO ] [MAIN ] Derivative Progress: 1032/2052 symbols. LC took 0.4s. Estimated remaining time: 6m 42s [2025-10-22T23:33:35.236363] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:35.264849] [DEBUG] [LOCAL ] LCII: Loaded 26860 existing records from primary storage. [2025-10-22T23:33:35.265005] [INFO ] [MAIN ] LCII: Loaded 26860 primary data records. [2025-10-22T23:33:35.574660] [DEBUG] [MAIN ] LCII: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:33:35.599971] [INFO ] [MAIN ] LCII: Generated 138 derivative records from 26860 primary records. [2025-10-22T23:33:35.600134] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-10-22T23:33:35.611518] [DEBUG] [LOCAL ] LCII: Derivative data saved (138 records). [2025-10-22T23:33:35.611598] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-10-22T23:33:35.614431] [INFO ] [MAIN ] Derivative Progress: 1033/2052 symbols. LCII took 0.4s. Estimated remaining time: 6m 42s [2025-10-22T23:33:35.614535] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:35.658745] [DEBUG] [LOCAL ] LDI: Loaded 45123 existing records from primary storage. [2025-10-22T23:33:35.658909] [INFO ] [MAIN ] LDI: Loaded 45123 primary data records. [2025-10-22T23:33:35.989041] [DEBUG] [MAIN ] LDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:36.014492] [INFO ] [MAIN ] LDI: Generated 138 derivative records from 45123 primary records. [2025-10-22T23:33:36.014637] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-22T23:33:36.030459] [DEBUG] [LOCAL ] LDI: Derivative data saved (138 records). [2025-10-22T23:33:36.030830] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-22T23:33:36.033638] [INFO ] [MAIN ] Derivative Progress: 1034/2052 symbols. LDI took 0.4s. Estimated remaining time: 6m 41s [2025-10-22T23:33:36.033800] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:36.077427] [DEBUG] [LOCAL ] LDOS: Loaded 44631 existing records from primary storage. [2025-10-22T23:33:36.077601] [INFO ] [MAIN ] LDOS: Loaded 44631 primary data records. [2025-10-22T23:33:36.380675] [DEBUG] [MAIN ] LDOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:36.405808] [INFO ] [MAIN ] LDOS: Generated 138 derivative records from 44631 primary records. [2025-10-22T23:33:36.405971] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-22T23:33:36.417832] [DEBUG] [LOCAL ] LDOS: Derivative data saved (138 records). [2025-10-22T23:33:36.417919] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-22T23:33:36.420638] [INFO ] [MAIN ] Derivative Progress: 1035/2052 symbols. LDOS took 0.4s. Estimated remaining time: 6m 41s [2025-10-22T23:33:36.420771] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:36.437038] [DEBUG] [LOCAL ] LDP: Loaded 12503 existing records from primary storage. [2025-10-22T23:33:36.437188] [INFO ] [MAIN ] LDP: Loaded 12503 primary data records. [2025-10-22T23:33:36.746174] [DEBUG] [MAIN ] LDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:36.771167] [INFO ] [MAIN ] LDP: Generated 138 derivative records from 12503 primary records. [2025-10-22T23:33:36.771300] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-22T23:33:36.782609] [DEBUG] [LOCAL ] LDP: Derivative data saved (138 records). [2025-10-22T23:33:36.782711] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-22T23:33:36.786150] [INFO ] [MAIN ] Derivative Progress: 1036/2052 symbols. LDP took 0.4s. Estimated remaining time: 6m 40s [2025-10-22T23:33:36.786252] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:36.827465] [DEBUG] [LOCAL ] LEA: Loaded 41127 existing records from primary storage. [2025-10-22T23:33:36.827680] [INFO ] [MAIN ] LEA: Loaded 41127 primary data records. [2025-10-22T23:33:37.131324] [DEBUG] [MAIN ] LEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:37.156371] [INFO ] [MAIN ] LEA: Generated 138 derivative records from 41127 primary records. [2025-10-22T23:33:37.156515] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-22T23:33:37.168265] [DEBUG] [LOCAL ] LEA: Derivative data saved (138 records). [2025-10-22T23:33:37.168359] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-10-22T23:33:37.171320] [INFO ] [MAIN ] Derivative Progress: 1037/2052 symbols. LEA took 0.4s. Estimated remaining time: 6m 40s [2025-10-22T23:33:37.171432] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:37.218427] [DEBUG] [LOCAL ] LEG: Loaded 49950 existing records from primary storage. [2025-10-22T23:33:37.218600] [INFO ] [MAIN ] LEG: Loaded 49950 primary data records. [2025-10-22T23:33:37.524819] [DEBUG] [MAIN ] LEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:37.550070] [INFO ] [MAIN ] LEG: Generated 138 derivative records from 49950 primary records. [2025-10-22T23:33:37.550188] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-22T23:33:37.561905] [DEBUG] [LOCAL ] LEG: Derivative data saved (138 records). [2025-10-22T23:33:37.561994] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-22T23:33:37.564933] [INFO ] [MAIN ] Derivative Progress: 1038/2052 symbols. LEG took 0.4s. Estimated remaining time: 6m 40s [2025-10-22T23:33:37.565037] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:37.620132] [DEBUG] [LOCAL ] LEN: Loaded 53196 existing records from primary storage. [2025-10-22T23:33:37.620307] [INFO ] [MAIN ] LEN: Loaded 53196 primary data records. [2025-10-22T23:33:37.953049] [DEBUG] [MAIN ] LEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:37.978775] [INFO ] [MAIN ] LEN: Generated 138 derivative records from 53196 primary records. [2025-10-22T23:33:37.978942] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-22T23:33:37.991142] [DEBUG] [LOCAL ] LEN: Derivative data saved (138 records). [2025-10-22T23:33:37.991232] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-22T23:33:37.994405] [INFO ] [MAIN ] Derivative Progress: 1039/2052 symbols. LEN took 0.4s. Estimated remaining time: 6m 39s [2025-10-22T23:33:37.994516] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:38.017071] [DEBUG] [LOCAL ] LEO: Loaded 16855 existing records from primary storage. [2025-10-22T23:33:38.017232] [INFO ] [MAIN ] LEO: Loaded 16855 primary data records. [2025-10-22T23:33:38.324434] [DEBUG] [MAIN ] LEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:38.349813] [INFO ] [MAIN ] LEO: Generated 138 derivative records from 16855 primary records. [2025-10-22T23:33:38.349951] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-22T23:33:38.360725] [DEBUG] [LOCAL ] LEO: Derivative data saved (138 records). [2025-10-22T23:33:38.360812] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-10-22T23:33:38.363454] [INFO ] [MAIN ] Derivative Progress: 1040/2052 symbols. LEO took 0.4s. Estimated remaining time: 6m 39s [2025-10-22T23:33:38.363557] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:38.416977] [DEBUG] [LOCAL ] LEVI: Loaded 51827 existing records from primary storage. [2025-10-22T23:33:38.417153] [INFO ] [MAIN ] LEVI: Loaded 51827 primary data records. [2025-10-22T23:33:38.721209] [DEBUG] [MAIN ] LEVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:38.746081] [INFO ] [MAIN ] LEVI: Generated 138 derivative records from 51827 primary records. [2025-10-22T23:33:38.746229] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-22T23:33:38.758204] [DEBUG] [LOCAL ] LEVI: Derivative data saved (138 records). [2025-10-22T23:33:38.758289] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-22T23:33:38.761405] [INFO ] [MAIN ] Derivative Progress: 1041/2052 symbols. LEVI took 0.4s. Estimated remaining time: 6m 38s [2025-10-22T23:33:38.761514] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:38.781976] [DEBUG] [LOCAL ] LFT: Loaded 18119 existing records from primary storage. [2025-10-22T23:33:38.782130] [INFO ] [MAIN ] LFT: Loaded 18119 primary data records. [2025-10-22T23:33:39.085573] [DEBUG] [MAIN ] LFT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:39.110890] [INFO ] [MAIN ] LFT: Generated 138 derivative records from 18119 primary records. [2025-10-22T23:33:39.111060] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-22T23:33:39.122296] [DEBUG] [LOCAL ] LFT: Derivative data saved (138 records). [2025-10-22T23:33:39.122381] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-22T23:33:39.125115] [INFO ] [MAIN ] Derivative Progress: 1042/2052 symbols. LFT took 0.4s. Estimated remaining time: 6m 38s [2025-10-22T23:33:39.125215] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:39.139470] [DEBUG] [LOCAL ] LGI: Loaded 9951 existing records from primary storage. [2025-10-22T23:33:39.139618] [INFO ] [MAIN ] LGI: Loaded 9951 primary data records. [2025-10-22T23:33:39.449759] [DEBUG] [MAIN ] LGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:39.475736] [INFO ] [MAIN ] LGI: Generated 138 derivative records from 9951 primary records. [2025-10-22T23:33:39.475872] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-22T23:33:39.487836] [DEBUG] [LOCAL ] LGI: Derivative data saved (138 records). [2025-10-22T23:33:39.487926] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-10-22T23:33:39.490084] [INFO ] [MAIN ] Derivative Progress: 1043/2052 symbols. LGI took 0.4s. Estimated remaining time: 6m 38s [2025-10-22T23:33:39.490183] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:39.527455] [DEBUG] [LOCAL ] LH: Loaded 37024 existing records from primary storage. [2025-10-22T23:33:39.527635] [INFO ] [MAIN ] LH: Loaded 37024 primary data records. [2025-10-22T23:33:39.862892] [DEBUG] [MAIN ] LH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:39.887976] [INFO ] [MAIN ] LH: Generated 138 derivative records from 37024 primary records. [2025-10-22T23:33:39.888107] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-22T23:33:39.899893] [DEBUG] [LOCAL ] LH: Derivative data saved (138 records). [2025-10-22T23:33:39.899988] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-22T23:33:39.902913] [INFO ] [MAIN ] Derivative Progress: 1044/2052 symbols. LH took 0.4s. Estimated remaining time: 6m 37s [2025-10-22T23:33:39.903029] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:39.949346] [DEBUG] [LOCAL ] LHX: Loaded 48471 existing records from primary storage. [2025-10-22T23:33:39.949511] [INFO ] [MAIN ] LHX: Loaded 48471 primary data records. [2025-10-22T23:33:40.254841] [DEBUG] [MAIN ] LHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:40.279868] [INFO ] [MAIN ] LHX: Generated 138 derivative records from 48471 primary records. [2025-10-22T23:33:40.279997] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-22T23:33:40.291546] [DEBUG] [LOCAL ] LHX: Derivative data saved (138 records). [2025-10-22T23:33:40.291628] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-22T23:33:40.294553] [INFO ] [MAIN ] Derivative Progress: 1045/2052 symbols. LHX took 0.4s. Estimated remaining time: 6m 37s [2025-10-22T23:33:40.294687] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:40.327072] [DEBUG] [LOCAL ] LII: Loaded 27810 existing records from primary storage. [2025-10-22T23:33:40.327276] [INFO ] [MAIN ] LII: Loaded 27810 primary data records. [2025-10-22T23:33:40.646010] [DEBUG] [MAIN ] LII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:40.672110] [INFO ] [MAIN ] LII: Generated 138 derivative records from 27810 primary records. [2025-10-22T23:33:40.672244] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-22T23:33:40.684291] [DEBUG] [LOCAL ] LII: Derivative data saved (138 records). [2025-10-22T23:33:40.684383] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-22T23:33:40.687317] [INFO ] [MAIN ] Derivative Progress: 1046/2052 symbols. LII took 0.4s. Estimated remaining time: 6m 36s [2025-10-22T23:33:40.687436] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:40.731797] [DEBUG] [LOCAL ] LION: Loaded 46933 existing records from primary storage. [2025-10-22T23:33:40.731961] [INFO ] [MAIN ] LION: Loaded 46933 primary data records. [2025-10-22T23:33:41.042205] [DEBUG] [MAIN ] LION: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:41.067489] [INFO ] [MAIN ] LION: Generated 138 derivative records from 46933 primary records. [2025-10-22T23:33:41.067659] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-22T23:33:41.079371] [DEBUG] [LOCAL ] LION: Derivative data saved (138 records). [2025-10-22T23:33:41.079454] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-10-22T23:33:41.082224] [INFO ] [MAIN ] Derivative Progress: 1047/2052 symbols. LION took 0.4s. Estimated remaining time: 6m 36s [2025-10-22T23:33:41.082323] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:41.134027] [DEBUG] [LOCAL ] LLY: Loaded 53191 existing records from primary storage. [2025-10-22T23:33:41.134201] [INFO ] [MAIN ] LLY: Loaded 53191 primary data records. [2025-10-22T23:33:41.441600] [DEBUG] [MAIN ] LLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:41.466847] [INFO ] [MAIN ] LLY: Generated 138 derivative records from 53191 primary records. [2025-10-22T23:33:41.466974] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-22T23:33:41.479043] [DEBUG] [LOCAL ] LLY: Derivative data saved (138 records). [2025-10-22T23:33:41.479139] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-22T23:33:41.482249] [INFO ] [MAIN ] Derivative Progress: 1048/2052 symbols. LLY took 0.4s. Estimated remaining time: 6m 36s [2025-10-22T23:33:41.482358] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:41.533753] [DEBUG] [LOCAL ] LMND: Loaded 52122 existing records from primary storage. [2025-10-22T23:33:41.533922] [INFO ] [MAIN ] LMND: Loaded 52122 primary data records. [2025-10-22T23:33:41.838801] [DEBUG] [MAIN ] LMND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:41.863700] [INFO ] [MAIN ] LMND: Generated 138 derivative records from 52122 primary records. [2025-10-22T23:33:41.863855] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-22T23:33:41.875547] [DEBUG] [LOCAL ] LMND: Derivative data saved (138 records). [2025-10-22T23:33:41.875629] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-10-22T23:33:41.878859] [INFO ] [MAIN ] Derivative Progress: 1049/2052 symbols. LMND took 0.4s. Estimated remaining time: 6m 35s [2025-10-22T23:33:41.878969] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:41.925939] [DEBUG] [LOCAL ] LMT: Loaded 49623 existing records from primary storage. [2025-10-22T23:33:41.926101] [INFO ] [MAIN ] LMT: Loaded 49623 primary data records. [2025-10-22T23:33:42.255401] [DEBUG] [MAIN ] LMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:42.280715] [INFO ] [MAIN ] LMT: Generated 138 derivative records from 49623 primary records. [2025-10-22T23:33:42.280822] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-10-22T23:33:42.292358] [DEBUG] [LOCAL ] LMT: Derivative data saved (138 records). [2025-10-22T23:33:42.292437] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-10-22T23:33:42.295441] [INFO ] [MAIN ] Derivative Progress: 1050/2052 symbols. LMT took 0.4s. Estimated remaining time: 6m 35s [2025-10-22T23:33:42.295535] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:42.344787] [DEBUG] [LOCAL ] LNC: Loaded 51466 existing records from primary storage. [2025-10-22T23:33:42.344943] [INFO ] [MAIN ] LNC: Loaded 51466 primary data records. [2025-10-22T23:33:42.652407] [DEBUG] [MAIN ] LNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:42.682417] [INFO ] [MAIN ] LNC: Generated 138 derivative records from 51466 primary records. [2025-10-22T23:33:42.683575] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-22T23:33:42.696041] [DEBUG] [LOCAL ] LNC: Derivative data saved (138 records). [2025-10-22T23:33:42.696122] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-22T23:33:42.699453] [INFO ] [MAIN ] Derivative Progress: 1051/2052 symbols. LNC took 0.4s. Estimated remaining time: 6m 35s [2025-10-22T23:33:42.699547] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:42.709345] [DEBUG] [LOCAL ] LND: Loaded 4960 existing records from primary storage. [2025-10-22T23:33:42.709472] [INFO ] [MAIN ] LND: Loaded 4960 primary data records. [2025-10-22T23:33:43.013389] [DEBUG] [MAIN ] LND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:43.038453] [INFO ] [MAIN ] LND: Generated 138 derivative records from 4960 primary records. [2025-10-22T23:33:43.038565] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-22T23:33:43.048577] [DEBUG] [LOCAL ] LND: Derivative data saved (138 records). [2025-10-22T23:33:43.048682] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-22T23:33:43.050570] [INFO ] [MAIN ] Derivative Progress: 1052/2052 symbols. LND took 0.4s. Estimated remaining time: 6m 34s [2025-10-22T23:33:43.050716] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:43.102115] [DEBUG] [LOCAL ] LNG: Loaded 51063 existing records from primary storage. [2025-10-22T23:33:43.102274] [INFO ] [MAIN ] LNG: Loaded 51063 primary data records. [2025-10-22T23:33:43.409410] [DEBUG] [MAIN ] LNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:43.434473] [INFO ] [MAIN ] LNG: Generated 138 derivative records from 51063 primary records. [2025-10-22T23:33:43.434586] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-22T23:33:43.446159] [DEBUG] [LOCAL ] LNG: Derivative data saved (138 records). [2025-10-22T23:33:43.446240] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-22T23:33:43.449221] [INFO ] [MAIN ] Derivative Progress: 1053/2052 symbols. LNG took 0.4s. Estimated remaining time: 6m 34s [2025-10-22T23:33:43.449321] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:43.464701] [DEBUG] [LOCAL ] LNN: Loaded 11504 existing records from primary storage. [2025-10-22T23:33:43.464971] [INFO ] [MAIN ] LNN: Loaded 11504 primary data records. [2025-10-22T23:33:43.809591] [DEBUG] [MAIN ] LNN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:43.834961] [INFO ] [MAIN ] LNN: Generated 138 derivative records from 11504 primary records. [2025-10-22T23:33:43.835121] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-22T23:33:43.846527] [DEBUG] [LOCAL ] LNN: Derivative data saved (138 records). [2025-10-22T23:33:43.846605] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-10-22T23:33:43.848965] [INFO ] [MAIN ] Derivative Progress: 1054/2052 symbols. LNN took 0.4s. Estimated remaining time: 6m 33s [2025-10-22T23:33:43.849058] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:43.888811] [DEBUG] [LOCAL ] LOAR: Loaded 42026 existing records from primary storage. [2025-10-22T23:33:43.888990] [INFO ] [MAIN ] LOAR: Loaded 42026 primary data records. [2025-10-22T23:33:44.216546] [DEBUG] [MAIN ] LOAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:44.241984] [INFO ] [MAIN ] LOAR: Generated 138 derivative records from 42026 primary records. [2025-10-22T23:33:44.242172] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-22T23:33:44.253692] [DEBUG] [LOCAL ] LOAR: Derivative data saved (138 records). [2025-10-22T23:33:44.253797] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-22T23:33:44.256394] [INFO ] [MAIN ] Derivative Progress: 1055/2052 symbols. LOAR took 0.4s. Estimated remaining time: 6m 33s [2025-10-22T23:33:44.256505] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:44.283776] [DEBUG] [LOCAL ] LOB: Loaded 26644 existing records from primary storage. [2025-10-22T23:33:44.283933] [INFO ] [MAIN ] LOB: Loaded 26644 primary data records. [2025-10-22T23:33:44.592718] [DEBUG] [MAIN ] LOB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:44.618440] [INFO ] [MAIN ] LOB: Generated 138 derivative records from 26644 primary records. [2025-10-22T23:33:44.618586] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-22T23:33:44.630150] [DEBUG] [LOCAL ] LOB: Derivative data saved (138 records). [2025-10-22T23:33:44.630231] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-22T23:33:44.632720] [INFO ] [MAIN ] Derivative Progress: 1056/2052 symbols. LOB took 0.4s. Estimated remaining time: 6m 33s [2025-10-22T23:33:44.632817] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:44.638100] [DEBUG] [LOCAL ] LOCL: Loaded 3504 existing records from primary storage. [2025-10-22T23:33:44.638197] [INFO ] [MAIN ] LOCL: Loaded 3504 primary data records. [2025-10-22T23:33:44.940632] [DEBUG] [MAIN ] LOCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:44.965820] [INFO ] [MAIN ] LOCL: Generated 138 derivative records from 3504 primary records. [2025-10-22T23:33:44.965992] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-22T23:33:44.975334] [DEBUG] [LOCAL ] LOCL: Derivative data saved (138 records). [2025-10-22T23:33:44.975422] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-22T23:33:44.977235] [INFO ] [MAIN ] Derivative Progress: 1057/2052 symbols. LOCL took 0.3s. Estimated remaining time: 6m 32s [2025-10-22T23:33:44.977348] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:45.010052] [DEBUG] [LOCAL ] LOMA: Loaded 32716 existing records from primary storage. [2025-10-22T23:33:45.010212] [INFO ] [MAIN ] LOMA: Loaded 32716 primary data records. [2025-10-22T23:33:45.315146] [DEBUG] [MAIN ] LOMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:45.340380] [INFO ] [MAIN ] LOMA: Generated 138 derivative records from 32716 primary records. [2025-10-22T23:33:45.340541] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-22T23:33:45.352196] [DEBUG] [LOCAL ] LOMA: Derivative data saved (138 records). [2025-10-22T23:33:45.352274] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-22T23:33:45.354690] [INFO ] [MAIN ] Derivative Progress: 1058/2052 symbols. LOMA took 0.4s. Estimated remaining time: 6m 32s [2025-10-22T23:33:45.354781] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:45.406367] [DEBUG] [LOCAL ] LOW: Loaded 52970 existing records from primary storage. [2025-10-22T23:33:45.406526] [INFO ] [MAIN ] LOW: Loaded 52970 primary data records. [2025-10-22T23:33:45.712728] [DEBUG] [MAIN ] LOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:45.738156] [INFO ] [MAIN ] LOW: Generated 138 derivative records from 52970 primary records. [2025-10-22T23:33:45.738272] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-22T23:33:45.750182] [DEBUG] [LOCAL ] LOW: Derivative data saved (138 records). [2025-10-22T23:33:45.750259] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-22T23:33:45.752965] [INFO ] [MAIN ] Derivative Progress: 1059/2052 symbols. LOW took 0.4s. Estimated remaining time: 6m 31s [2025-10-22T23:33:45.753086] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:45.790895] [DEBUG] [LOCAL ] LPG: Loaded 39248 existing records from primary storage. [2025-10-22T23:33:45.791055] [INFO ] [MAIN ] LPG: Loaded 39248 primary data records. [2025-10-22T23:33:46.129619] [DEBUG] [MAIN ] LPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:46.155083] [INFO ] [MAIN ] LPG: Generated 138 derivative records from 39248 primary records. [2025-10-22T23:33:46.155227] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-22T23:33:46.166937] [DEBUG] [LOCAL ] LPG: Derivative data saved (138 records). [2025-10-22T23:33:46.167023] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-22T23:33:46.169760] [INFO ] [MAIN ] Derivative Progress: 1060/2052 symbols. LPG took 0.4s. Estimated remaining time: 6m 31s [2025-10-22T23:33:46.169927] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:46.197899] [DEBUG] [LOCAL ] LPL: Loaded 28986 existing records from primary storage. [2025-10-22T23:33:46.198050] [INFO ] [MAIN ] LPL: Loaded 28986 primary data records. [2025-10-22T23:33:46.502870] [DEBUG] [MAIN ] LPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:46.527892] [INFO ] [MAIN ] LPL: Generated 138 derivative records from 28986 primary records. [2025-10-22T23:33:46.528005] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-22T23:33:46.539115] [DEBUG] [LOCAL ] LPL: Derivative data saved (138 records). [2025-10-22T23:33:46.539201] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-22T23:33:46.541556] [INFO ] [MAIN ] Derivative Progress: 1061/2052 symbols. LPL took 0.4s. Estimated remaining time: 6m 31s [2025-10-22T23:33:46.541680] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:46.578883] [DEBUG] [LOCAL ] LPX: Loaded 40055 existing records from primary storage. [2025-10-22T23:33:46.579043] [INFO ] [MAIN ] LPX: Loaded 40055 primary data records. [2025-10-22T23:33:46.884841] [DEBUG] [MAIN ] LPX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:46.910106] [INFO ] [MAIN ] LPX: Generated 138 derivative records from 40055 primary records. [2025-10-22T23:33:46.910244] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-22T23:33:46.921604] [DEBUG] [LOCAL ] LPX: Derivative data saved (138 records). [2025-10-22T23:33:46.921705] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-22T23:33:46.924176] [INFO ] [MAIN ] Derivative Progress: 1062/2052 symbols. LPX took 0.4s. Estimated remaining time: 6m 30s [2025-10-22T23:33:46.924270] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:46.962975] [DEBUG] [LOCAL ] LRN: Loaded 39335 existing records from primary storage. [2025-10-22T23:33:46.963137] [INFO ] [MAIN ] LRN: Loaded 39335 primary data records. [2025-10-22T23:33:47.272046] [DEBUG] [MAIN ] LRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:47.297695] [INFO ] [MAIN ] LRN: Generated 138 derivative records from 39335 primary records. [2025-10-22T23:33:47.297884] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-22T23:33:47.309631] [DEBUG] [LOCAL ] LRN: Derivative data saved (138 records). [2025-10-22T23:33:47.309729] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-22T23:33:47.312208] [INFO ] [MAIN ] Derivative Progress: 1063/2052 symbols. LRN took 0.4s. Estimated remaining time: 6m 30s [2025-10-22T23:33:47.312301] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:47.351693] [DEBUG] [LOCAL ] LSPD: Loaded 42329 existing records from primary storage. [2025-10-22T23:33:47.351853] [INFO ] [MAIN ] LSPD: Loaded 42329 primary data records. [2025-10-22T23:33:47.662021] [DEBUG] [MAIN ] LSPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:47.691503] [INFO ] [MAIN ] LSPD: Generated 138 derivative records from 42329 primary records. [2025-10-22T23:33:47.691731] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-22T23:33:47.703503] [DEBUG] [LOCAL ] LSPD: Derivative data saved (138 records). [2025-10-22T23:33:47.703607] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-22T23:33:47.706315] [INFO ] [MAIN ] Derivative Progress: 1064/2052 symbols. LSPD took 0.4s. Estimated remaining time: 6m 29s [2025-10-22T23:33:47.706410] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:47.737030] [DEBUG] [LOCAL ] LTC: Loaded 30631 existing records from primary storage. [2025-10-22T23:33:47.737203] [INFO ] [MAIN ] LTC: Loaded 30631 primary data records. [2025-10-22T23:33:48.077454] [DEBUG] [MAIN ] LTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:48.103933] [INFO ] [MAIN ] LTC: Generated 138 derivative records from 30631 primary records. [2025-10-22T23:33:48.104112] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-22T23:33:48.115534] [DEBUG] [LOCAL ] LTC: Derivative data saved (138 records). [2025-10-22T23:33:48.115633] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-22T23:33:48.118237] [INFO ] [MAIN ] Derivative Progress: 1065/2052 symbols. LTC took 0.4s. Estimated remaining time: 6m 29s [2025-10-22T23:33:48.118347] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:48.169492] [DEBUG] [LOCAL ] LTH: Loaded 51635 existing records from primary storage. [2025-10-22T23:33:48.169679] [INFO ] [MAIN ] LTH: Loaded 51635 primary data records. [2025-10-22T23:33:48.481836] [DEBUG] [MAIN ] LTH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:48.507676] [INFO ] [MAIN ] LTH: Generated 138 derivative records from 51635 primary records. [2025-10-22T23:33:48.507822] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-22T23:33:48.519931] [DEBUG] [LOCAL ] LTH: Derivative data saved (138 records). [2025-10-22T23:33:48.520017] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-22T23:33:48.523088] [INFO ] [MAIN ] Derivative Progress: 1066/2052 symbols. LTH took 0.4s. Estimated remaining time: 6m 29s [2025-10-22T23:33:48.523211] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:48.559911] [DEBUG] [LOCAL ] LTM: Loaded 39222 existing records from primary storage. [2025-10-22T23:33:48.560089] [INFO ] [MAIN ] LTM: Loaded 39222 primary data records. [2025-10-22T23:33:48.871142] [DEBUG] [MAIN ] LTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:48.896110] [INFO ] [MAIN ] LTM: Generated 138 derivative records from 39222 primary records. [2025-10-22T23:33:48.896261] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-22T23:33:48.907873] [DEBUG] [LOCAL ] LTM: Derivative data saved (138 records). [2025-10-22T23:33:48.907955] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-22T23:33:48.910554] [INFO ] [MAIN ] Derivative Progress: 1067/2052 symbols. LTM took 0.4s. Estimated remaining time: 6m 28s [2025-10-22T23:33:48.910684] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:48.955689] [DEBUG] [LOCAL ] LU: Loaded 49220 existing records from primary storage. [2025-10-22T23:33:48.955860] [INFO ] [MAIN ] LU: Loaded 49220 primary data records. [2025-10-22T23:33:49.266355] [DEBUG] [MAIN ] LU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:49.292139] [INFO ] [MAIN ] LU: Generated 138 derivative records from 49220 primary records. [2025-10-22T23:33:49.292278] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-22T23:33:49.304082] [DEBUG] [LOCAL ] LU: Derivative data saved (138 records). [2025-10-22T23:33:49.304168] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-22T23:33:49.306905] [INFO ] [MAIN ] Derivative Progress: 1068/2052 symbols. LU took 0.4s. Estimated remaining time: 6m 28s [2025-10-22T23:33:49.307007] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:49.335868] [DEBUG] [LOCAL ] LUCK: Loaded 23877 existing records from primary storage. [2025-10-22T23:33:49.336040] [INFO ] [MAIN ] LUCK: Loaded 23877 primary data records. [2025-10-22T23:33:49.657986] [DEBUG] [MAIN ] LUCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:49.683327] [INFO ] [MAIN ] LUCK: Generated 138 derivative records from 23877 primary records. [2025-10-22T23:33:49.683450] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-22T23:33:49.694954] [DEBUG] [LOCAL ] LUCK: Derivative data saved (138 records). [2025-10-22T23:33:49.695034] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-22T23:33:49.697598] [INFO ] [MAIN ] Derivative Progress: 1069/2052 symbols. LUCK took 0.4s. Estimated remaining time: 6m 27s [2025-10-22T23:33:49.697733] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:49.748848] [DEBUG] [LOCAL ] LUMN: Loaded 53645 existing records from primary storage. [2025-10-22T23:33:49.749011] [INFO ] [MAIN ] LUMN: Loaded 53645 primary data records. [2025-10-22T23:33:50.056373] [DEBUG] [MAIN ] LUMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:50.081174] [INFO ] [MAIN ] LUMN: Generated 138 derivative records from 53645 primary records. [2025-10-22T23:33:50.081289] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-22T23:33:50.092522] [DEBUG] [LOCAL ] LUMN: Derivative data saved (138 records). [2025-10-22T23:33:50.092601] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-10-22T23:33:50.095550] [INFO ] [MAIN ] Derivative Progress: 1070/2052 symbols. LUMN took 0.4s. Estimated remaining time: 6m 27s [2025-10-22T23:33:50.095671] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:50.149074] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-22T23:33:50.149250] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-10-22T23:33:50.474625] [DEBUG] [MAIN ] LUV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:50.499476] [INFO ] [MAIN ] LUV: Generated 138 derivative records from 53689 primary records. [2025-10-22T23:33:50.499589] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-22T23:33:50.511024] [DEBUG] [LOCAL ] LUV: Derivative data saved (138 records). [2025-10-22T23:33:50.511103] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-22T23:33:50.514089] [INFO ] [MAIN ] Derivative Progress: 1071/2052 symbols. LUV took 0.4s. Estimated remaining time: 6m 27s [2025-10-22T23:33:50.514189] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:50.565338] [DEBUG] [LOCAL ] LVS: Loaded 53569 existing records from primary storage. [2025-10-22T23:33:50.565500] [INFO ] [MAIN ] LVS: Loaded 53569 primary data records. [2025-10-22T23:33:50.869488] [DEBUG] [MAIN ] LVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:50.895478] [INFO ] [MAIN ] LVS: Generated 138 derivative records from 53569 primary records. [2025-10-22T23:33:50.895596] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-10-22T23:33:50.907106] [DEBUG] [LOCAL ] LVS: Derivative data saved (138 records). [2025-10-22T23:33:50.907186] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-10-22T23:33:50.910082] [INFO ] [MAIN ] Derivative Progress: 1072/2052 symbols. LVS took 0.4s. Estimated remaining time: 6m 26s [2025-10-22T23:33:50.910183] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:50.930188] [DEBUG] [LOCAL ] LVWR: Loaded 18636 existing records from primary storage. [2025-10-22T23:33:50.930330] [INFO ] [MAIN ] LVWR: Loaded 18636 primary data records. [2025-10-22T23:33:51.235581] [DEBUG] [MAIN ] LVWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:51.260633] [INFO ] [MAIN ] LVWR: Generated 138 derivative records from 18636 primary records. [2025-10-22T23:33:51.260782] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-22T23:33:51.271603] [DEBUG] [LOCAL ] LVWR: Derivative data saved (138 records). [2025-10-22T23:33:51.271703] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-22T23:33:51.274267] [INFO ] [MAIN ] Derivative Progress: 1073/2052 symbols. LVWR took 0.4s. Estimated remaining time: 6m 26s [2025-10-22T23:33:51.274364] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:51.322958] [DEBUG] [LOCAL ] LW: Loaded 51164 existing records from primary storage. [2025-10-22T23:33:51.323126] [INFO ] [MAIN ] LW: Loaded 51164 primary data records. [2025-10-22T23:33:51.629694] [DEBUG] [MAIN ] LW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:51.655347] [INFO ] [MAIN ] LW: Generated 138 derivative records from 51164 primary records. [2025-10-22T23:33:51.655496] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-22T23:33:51.666996] [DEBUG] [LOCAL ] LW: Derivative data saved (138 records). [2025-10-22T23:33:51.667080] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-22T23:33:51.670084] [INFO ] [MAIN ] Derivative Progress: 1074/2052 symbols. LW took 0.4s. Estimated remaining time: 6m 25s [2025-10-22T23:33:51.670215] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:51.690426] [DEBUG] [LOCAL ] LXFR: Loaded 16413 existing records from primary storage. [2025-10-22T23:33:51.690582] [INFO ] [MAIN ] LXFR: Loaded 16413 primary data records. [2025-10-22T23:33:51.995151] [DEBUG] [MAIN ] LXFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:52.020256] [INFO ] [MAIN ] LXFR: Generated 138 derivative records from 16413 primary records. [2025-10-22T23:33:52.020388] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-22T23:33:52.032001] [DEBUG] [LOCAL ] LXFR: Derivative data saved (138 records). [2025-10-22T23:33:52.032081] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-22T23:33:52.034553] [INFO ] [MAIN ] Derivative Progress: 1075/2052 symbols. LXFR took 0.4s. Estimated remaining time: 6m 25s [2025-10-22T23:33:52.034703] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:52.084880] [DEBUG] [LOCAL ] LXP: Loaded 50756 existing records from primary storage. [2025-10-22T23:33:52.085045] [INFO ] [MAIN ] LXP: Loaded 50756 primary data records. [2025-10-22T23:33:52.418483] [DEBUG] [MAIN ] LXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:52.443881] [INFO ] [MAIN ] LXP: Generated 138 derivative records from 50756 primary records. [2025-10-22T23:33:52.443999] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-22T23:33:52.455530] [DEBUG] [LOCAL ] LXP: Derivative data saved (138 records). [2025-10-22T23:33:52.455615] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-22T23:33:52.458668] [INFO ] [MAIN ] Derivative Progress: 1076/2052 symbols. LXP took 0.4s. Estimated remaining time: 6m 25s [2025-10-22T23:33:52.458767] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:52.488703] [DEBUG] [LOCAL ] LXU: Loaded 31461 existing records from primary storage. [2025-10-22T23:33:52.488856] [INFO ] [MAIN ] LXU: Loaded 31461 primary data records. [2025-10-22T23:33:52.802597] [DEBUG] [MAIN ] LXU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:52.827960] [INFO ] [MAIN ] LXU: Generated 138 derivative records from 31461 primary records. [2025-10-22T23:33:52.828085] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-22T23:33:52.839433] [DEBUG] [LOCAL ] LXU: Derivative data saved (138 records). [2025-10-22T23:33:52.839516] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-22T23:33:52.842207] [INFO ] [MAIN ] Derivative Progress: 1077/2052 symbols. LXU took 0.4s. Estimated remaining time: 6m 24s [2025-10-22T23:33:52.842303] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:52.893483] [DEBUG] [LOCAL ] LYB: Loaded 53621 existing records from primary storage. [2025-10-22T23:33:52.893680] [INFO ] [MAIN ] LYB: Loaded 53621 primary data records. [2025-10-22T23:33:53.197784] [DEBUG] [MAIN ] LYB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:53.222771] [INFO ] [MAIN ] LYB: Generated 138 derivative records from 53621 primary records. [2025-10-22T23:33:53.222878] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-22T23:33:53.234269] [DEBUG] [LOCAL ] LYB: Derivative data saved (138 records). [2025-10-22T23:33:53.234354] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-22T23:33:53.237231] [INFO ] [MAIN ] Derivative Progress: 1078/2052 symbols. LYB took 0.4s. Estimated remaining time: 6m 24s [2025-10-22T23:33:53.237348] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:53.287338] [DEBUG] [LOCAL ] LYG: Loaded 52652 existing records from primary storage. [2025-10-22T23:33:53.287502] [INFO ] [MAIN ] LYG: Loaded 52652 primary data records. [2025-10-22T23:33:53.592553] [DEBUG] [MAIN ] LYG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:53.617665] [INFO ] [MAIN ] LYG: Generated 138 derivative records from 52652 primary records. [2025-10-22T23:33:53.617785] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-22T23:33:53.628989] [DEBUG] [LOCAL ] LYG: Derivative data saved (138 records). [2025-10-22T23:33:53.629068] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-22T23:33:53.631959] [INFO ] [MAIN ] Derivative Progress: 1079/2052 symbols. LYG took 0.4s. Estimated remaining time: 6m 23s [2025-10-22T23:33:53.632056] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:53.683410] [DEBUG] [LOCAL ] LYV: Loaded 51001 existing records from primary storage. [2025-10-22T23:33:53.683571] [INFO ] [MAIN ] LYV: Loaded 51001 primary data records. [2025-10-22T23:33:53.988070] [DEBUG] [MAIN ] LYV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:54.013726] [INFO ] [MAIN ] LYV: Generated 138 derivative records from 51001 primary records. [2025-10-22T23:33:54.013841] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-22T23:33:54.025560] [DEBUG] [LOCAL ] LYV: Derivative data saved (138 records). [2025-10-22T23:33:54.025658] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-22T23:33:54.028578] [INFO ] [MAIN ] Derivative Progress: 1080/2052 symbols. LYV took 0.4s. Estimated remaining time: 6m 23s [2025-10-22T23:33:54.028695] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:54.062003] [DEBUG] [LOCAL ] LZB: Loaded 35036 existing records from primary storage. [2025-10-22T23:33:54.062158] [INFO ] [MAIN ] LZB: Loaded 35036 primary data records. [2025-10-22T23:33:54.396508] [DEBUG] [MAIN ] LZB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:54.421633] [INFO ] [MAIN ] LZB: Generated 138 derivative records from 35036 primary records. [2025-10-22T23:33:54.421765] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-22T23:33:54.432956] [DEBUG] [LOCAL ] LZB: Derivative data saved (138 records). [2025-10-22T23:33:54.433035] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-22T23:33:54.435791] [INFO ] [MAIN ] Derivative Progress: 1081/2052 symbols. LZB took 0.4s. Estimated remaining time: 6m 23s [2025-10-22T23:33:54.435902] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:54.453020] [DEBUG] [LOCAL ] LZM: Loaded 14818 existing records from primary storage. [2025-10-22T23:33:54.453173] [INFO ] [MAIN ] LZM: Loaded 14818 primary data records. [2025-10-22T23:33:54.760535] [DEBUG] [MAIN ] LZM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:54.785912] [INFO ] [MAIN ] LZM: Generated 138 derivative records from 14818 primary records. [2025-10-22T23:33:54.786091] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-22T23:33:54.797159] [DEBUG] [LOCAL ] LZM: Derivative data saved (138 records). [2025-10-22T23:33:54.797282] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-22T23:33:54.799950] [INFO ] [MAIN ] Derivative Progress: 1082/2052 symbols. LZM took 0.4s. Estimated remaining time: 6m 22s [2025-10-22T23:33:54.800057] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:54.854180] [DEBUG] [LOCAL ] M: Loaded 53544 existing records from primary storage. [2025-10-22T23:33:54.854352] [INFO ] [MAIN ] M: Loaded 53544 primary data records. [2025-10-22T23:33:55.158577] [DEBUG] [MAIN ] M: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:55.183864] [INFO ] [MAIN ] M: Generated 138 derivative records from 53544 primary records. [2025-10-22T23:33:55.183969] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-22T23:33:55.195812] [DEBUG] [LOCAL ] M: Derivative data saved (138 records). [2025-10-22T23:33:55.195893] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-22T23:33:55.198937] [INFO ] [MAIN ] Derivative Progress: 1083/2052 symbols. M took 0.4s. Estimated remaining time: 6m 22s [2025-10-22T23:33:55.199037] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:55.249524] [DEBUG] [LOCAL ] MA: Loaded 52451 existing records from primary storage. [2025-10-22T23:33:55.249705] [INFO ] [MAIN ] MA: Loaded 52451 primary data records. [2025-10-22T23:33:55.575438] [DEBUG] [MAIN ] MA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:55.600774] [INFO ] [MAIN ] MA: Generated 138 derivative records from 52451 primary records. [2025-10-22T23:33:55.600880] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-22T23:33:55.612884] [DEBUG] [LOCAL ] MA: Derivative data saved (138 records). [2025-10-22T23:33:55.612964] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-22T23:33:55.616147] [INFO ] [MAIN ] Derivative Progress: 1084/2052 symbols. MA took 0.4s. Estimated remaining time: 6m 21s [2025-10-22T23:33:55.616250] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:55.658232] [DEBUG] [LOCAL ] MAA: Loaded 43002 existing records from primary storage. [2025-10-22T23:33:55.658395] [INFO ] [MAIN ] MAA: Loaded 43002 primary data records. [2025-10-22T23:33:55.962448] [DEBUG] [MAIN ] MAA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:55.990496] [INFO ] [MAIN ] MAA: Generated 138 derivative records from 43002 primary records. [2025-10-22T23:33:55.990688] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-22T23:33:56.002337] [DEBUG] [LOCAL ] MAA: Derivative data saved (138 records). [2025-10-22T23:33:56.002415] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-22T23:33:56.005085] [INFO ] [MAIN ] Derivative Progress: 1085/2052 symbols. MAA took 0.4s. Estimated remaining time: 6m 21s [2025-10-22T23:33:56.005182] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:56.052991] [DEBUG] [LOCAL ] MAC: Loaded 49610 existing records from primary storage. [2025-10-22T23:33:56.053151] [INFO ] [MAIN ] MAC: Loaded 49610 primary data records. [2025-10-22T23:33:56.357828] [DEBUG] [MAIN ] MAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:56.382890] [INFO ] [MAIN ] MAC: Generated 138 derivative records from 49610 primary records. [2025-10-22T23:33:56.383012] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-10-22T23:33:56.394617] [DEBUG] [LOCAL ] MAC: Derivative data saved (138 records). [2025-10-22T23:33:56.394714] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-10-22T23:33:56.397583] [INFO ] [MAIN ] Derivative Progress: 1086/2052 symbols. MAC took 0.4s. Estimated remaining time: 6m 21s [2025-10-22T23:33:56.397704] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:56.432676] [DEBUG] [LOCAL ] MAGN: Loaded 36149 existing records from primary storage. [2025-10-22T23:33:56.432834] [INFO ] [MAIN ] MAGN: Loaded 36149 primary data records. [2025-10-22T23:33:56.757152] [DEBUG] [MAIN ] MAGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:56.782253] [INFO ] [MAIN ] MAGN: Generated 138 derivative records from 36149 primary records. [2025-10-22T23:33:56.782384] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-22T23:33:56.793819] [DEBUG] [LOCAL ] MAGN: Derivative data saved (138 records). [2025-10-22T23:33:56.793901] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-22T23:33:56.796996] [INFO ] [MAIN ] Derivative Progress: 1087/2052 symbols. MAGN took 0.4s. Estimated remaining time: 6m 20s [2025-10-22T23:33:56.797145] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:56.835588] [DEBUG] [LOCAL ] MAIN: Loaded 41940 existing records from primary storage. [2025-10-22T23:33:56.835762] [INFO ] [MAIN ] MAIN: Loaded 41940 primary data records. [2025-10-22T23:33:57.144982] [DEBUG] [MAIN ] MAIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:57.170535] [INFO ] [MAIN ] MAIN: Generated 138 derivative records from 41940 primary records. [2025-10-22T23:33:57.170680] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-22T23:33:57.182062] [DEBUG] [LOCAL ] MAIN: Derivative data saved (138 records). [2025-10-22T23:33:57.182140] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-22T23:33:57.185026] [INFO ] [MAIN ] Derivative Progress: 1088/2052 symbols. MAIN took 0.4s. Estimated remaining time: 6m 20s [2025-10-22T23:33:57.185124] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:57.225954] [DEBUG] [LOCAL ] MAN: Loaded 44306 existing records from primary storage. [2025-10-22T23:33:57.226113] [INFO ] [MAIN ] MAN: Loaded 44306 primary data records. [2025-10-22T23:33:57.531178] [DEBUG] [MAIN ] MAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:57.556418] [INFO ] [MAIN ] MAN: Generated 138 derivative records from 44306 primary records. [2025-10-22T23:33:57.556551] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-22T23:33:57.568123] [DEBUG] [LOCAL ] MAN: Derivative data saved (138 records). [2025-10-22T23:33:57.568204] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-22T23:33:57.570936] [INFO ] [MAIN ] Derivative Progress: 1089/2052 symbols. MAN took 0.4s. Estimated remaining time: 6m 19s [2025-10-22T23:33:57.571033] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:57.598902] [DEBUG] [LOCAL ] MANU: Loaded 27190 existing records from primary storage. [2025-10-22T23:33:57.599049] [INFO ] [MAIN ] MANU: Loaded 27190 primary data records. [2025-10-22T23:33:57.910501] [DEBUG] [MAIN ] MANU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:57.935734] [INFO ] [MAIN ] MANU: Generated 138 derivative records from 27190 primary records. [2025-10-22T23:33:57.935870] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-22T23:33:57.947660] [DEBUG] [LOCAL ] MANU: Derivative data saved (138 records). [2025-10-22T23:33:57.947745] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-22T23:33:57.950541] [INFO ] [MAIN ] Derivative Progress: 1090/2052 symbols. MANU took 0.4s. Estimated remaining time: 6m 19s [2025-10-22T23:33:57.950681] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:58.000819] [DEBUG] [LOCAL ] MAS: Loaded 52226 existing records from primary storage. [2025-10-22T23:33:58.000991] [INFO ] [MAIN ] MAS: Loaded 52226 primary data records. [2025-10-22T23:33:58.308003] [DEBUG] [MAIN ] MAS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:58.333120] [INFO ] [MAIN ] MAS: Generated 138 derivative records from 52226 primary records. [2025-10-22T23:33:58.333228] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-22T23:33:58.344920] [DEBUG] [LOCAL ] MAS: Derivative data saved (138 records). [2025-10-22T23:33:58.344998] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-22T23:33:58.348269] [INFO ] [MAIN ] Derivative Progress: 1091/2052 symbols. MAS took 0.4s. Estimated remaining time: 6m 19s [2025-10-22T23:33:58.348383] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:58.381938] [DEBUG] [LOCAL ] MATV: Loaded 35045 existing records from primary storage. [2025-10-22T23:33:58.382094] [INFO ] [MAIN ] MATV: Loaded 35045 primary data records. [2025-10-22T23:33:58.716139] [DEBUG] [MAIN ] MATV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:58.741450] [INFO ] [MAIN ] MATV: Generated 138 derivative records from 35045 primary records. [2025-10-22T23:33:58.741563] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-22T23:33:58.753041] [DEBUG] [LOCAL ] MATV: Derivative data saved (138 records). [2025-10-22T23:33:58.753119] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-22T23:33:58.755999] [INFO ] [MAIN ] Derivative Progress: 1092/2052 symbols. MATV took 0.4s. Estimated remaining time: 6m 18s [2025-10-22T23:33:58.756095] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:58.788492] [DEBUG] [LOCAL ] MATX: Loaded 31898 existing records from primary storage. [2025-10-22T23:33:58.788664] [INFO ] [MAIN ] MATX: Loaded 31898 primary data records. [2025-10-22T23:33:59.097907] [DEBUG] [MAIN ] MATX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:59.122958] [INFO ] [MAIN ] MATX: Generated 138 derivative records from 31898 primary records. [2025-10-22T23:33:59.123076] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-22T23:33:59.134568] [DEBUG] [LOCAL ] MATX: Derivative data saved (138 records). [2025-10-22T23:33:59.134665] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-10-22T23:33:59.137611] [INFO ] [MAIN ] Derivative Progress: 1093/2052 symbols. MATX took 0.4s. Estimated remaining time: 6m 18s [2025-10-22T23:33:59.137786] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:59.167383] [DEBUG] [LOCAL ] MAX: Loaded 30725 existing records from primary storage. [2025-10-22T23:33:59.167536] [INFO ] [MAIN ] MAX: Loaded 30725 primary data records. [2025-10-22T23:33:59.476464] [DEBUG] [MAIN ] MAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:59.501610] [INFO ] [MAIN ] MAX: Generated 138 derivative records from 30725 primary records. [2025-10-22T23:33:59.501742] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-22T23:33:59.513156] [DEBUG] [LOCAL ] MAX: Derivative data saved (138 records). [2025-10-22T23:33:59.513234] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-22T23:33:59.516012] [INFO ] [MAIN ] Derivative Progress: 1094/2052 symbols. MAX took 0.4s. Estimated remaining time: 6m 17s [2025-10-22T23:33:59.516111] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:59.558213] [DEBUG] [LOCAL ] MBC: Loaded 43879 existing records from primary storage. [2025-10-22T23:33:59.558373] [INFO ] [MAIN ] MBC: Loaded 43879 primary data records. [2025-10-22T23:33:59.862680] [DEBUG] [MAIN ] MBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:33:59.887775] [INFO ] [MAIN ] MBC: Generated 138 derivative records from 43879 primary records. [2025-10-22T23:33:59.887925] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-22T23:33:59.899688] [DEBUG] [LOCAL ] MBC: Derivative data saved (138 records). [2025-10-22T23:33:59.899772] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-22T23:33:59.902386] [INFO ] [MAIN ] Derivative Progress: 1095/2052 symbols. MBC took 0.4s. Estimated remaining time: 6m 17s [2025-10-22T23:33:59.902488] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:33:59.926490] [DEBUG] [LOCAL ] MBI: Loaded 23968 existing records from primary storage. [2025-10-22T23:33:59.926690] [INFO ] [MAIN ] MBI: Loaded 23968 primary data records. [2025-10-22T23:34:00.230391] [DEBUG] [MAIN ] MBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:00.255666] [INFO ] [MAIN ] MBI: Generated 138 derivative records from 23968 primary records. [2025-10-22T23:34:00.255844] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-22T23:34:00.267017] [DEBUG] [LOCAL ] MBI: Derivative data saved (138 records). [2025-10-22T23:34:00.267120] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-22T23:34:00.269992] [INFO ] [MAIN ] Derivative Progress: 1096/2052 symbols. MBI took 0.4s. Estimated remaining time: 6m 17s [2025-10-22T23:34:00.270112] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:00.311732] [DEBUG] [LOCAL ] MC: Loaded 43670 existing records from primary storage. [2025-10-22T23:34:00.311906] [INFO ] [MAIN ] MC: Loaded 43670 primary data records. [2025-10-22T23:34:00.649554] [DEBUG] [MAIN ] MC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:00.674931] [INFO ] [MAIN ] MC: Generated 138 derivative records from 43670 primary records. [2025-10-22T23:34:00.675114] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-22T23:34:00.686662] [DEBUG] [LOCAL ] MC: Derivative data saved (138 records). [2025-10-22T23:34:00.686767] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-22T23:34:00.689532] [INFO ] [MAIN ] Derivative Progress: 1097/2052 symbols. MC took 0.4s. Estimated remaining time: 6m 16s [2025-10-22T23:34:00.689699] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:00.704386] [DEBUG] [LOCAL ] MCB: Loaded 11254 existing records from primary storage. [2025-10-22T23:34:00.704556] [INFO ] [MAIN ] MCB: Loaded 11254 primary data records. [2025-10-22T23:34:01.014588] [DEBUG] [MAIN ] MCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:01.040597] [INFO ] [MAIN ] MCB: Generated 138 derivative records from 11254 primary records. [2025-10-22T23:34:01.040990] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-22T23:34:01.052309] [DEBUG] [LOCAL ] MCB: Derivative data saved (138 records). [2025-10-22T23:34:01.052400] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-22T23:34:01.055166] [INFO ] [MAIN ] Derivative Progress: 1098/2052 symbols. MCB took 0.4s. Estimated remaining time: 6m 16s [2025-10-22T23:34:01.055290] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:01.065786] [DEBUG] [LOCAL ] MCI: Loaded 6182 existing records from primary storage. [2025-10-22T23:34:01.066034] [INFO ] [MAIN ] MCI: Loaded 6182 primary data records. [2025-10-22T23:34:01.381894] [DEBUG] [MAIN ] MCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:01.407023] [INFO ] [MAIN ] MCI: Generated 138 derivative records from 6182 primary records. [2025-10-22T23:34:01.407176] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-22T23:34:01.418710] [DEBUG] [LOCAL ] MCI: Derivative data saved (138 records). [2025-10-22T23:34:01.418823] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-22T23:34:01.421067] [INFO ] [MAIN ] Derivative Progress: 1099/2052 symbols. MCI took 0.4s. Estimated remaining time: 6m 15s [2025-10-22T23:34:01.421184] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:01.460581] [DEBUG] [LOCAL ] MCK: Loaded 38009 existing records from primary storage. [2025-10-22T23:34:01.460783] [INFO ] [MAIN ] MCK: Loaded 38009 primary data records. [2025-10-22T23:34:01.770629] [DEBUG] [MAIN ] MCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:01.796273] [INFO ] [MAIN ] MCK: Generated 138 derivative records from 38009 primary records. [2025-10-22T23:34:01.796409] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-22T23:34:01.808438] [DEBUG] [LOCAL ] MCK: Derivative data saved (138 records). [2025-10-22T23:34:01.808522] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-22T23:34:01.811841] [INFO ] [MAIN ] Derivative Progress: 1100/2052 symbols. MCK took 0.4s. Estimated remaining time: 6m 15s [2025-10-22T23:34:01.812009] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:01.825034] [DEBUG] [LOCAL ] MCN: Loaded 7984 existing records from primary storage. [2025-10-22T23:34:01.825178] [INFO ] [MAIN ] MCN: Loaded 7984 primary data records. [2025-10-22T23:34:02.130756] [DEBUG] [MAIN ] MCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:02.156189] [INFO ] [MAIN ] MCN: Generated 138 derivative records from 7984 primary records. [2025-10-22T23:34:02.156334] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-10-22T23:34:02.166702] [DEBUG] [LOCAL ] MCN: Derivative data saved (138 records). [2025-10-22T23:34:02.166788] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-10-22T23:34:02.169025] [INFO ] [MAIN ] Derivative Progress: 1101/2052 symbols. MCN took 0.4s. Estimated remaining time: 6m 15s [2025-10-22T23:34:02.169127] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:02.208100] [DEBUG] [LOCAL ] MCO: Loaded 39425 existing records from primary storage. [2025-10-22T23:34:02.208265] [INFO ] [MAIN ] MCO: Loaded 39425 primary data records. [2025-10-22T23:34:02.541956] [DEBUG] [MAIN ] MCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:02.567716] [INFO ] [MAIN ] MCO: Generated 138 derivative records from 39425 primary records. [2025-10-22T23:34:02.567847] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-22T23:34:02.579472] [DEBUG] [LOCAL ] MCO: Derivative data saved (138 records). [2025-10-22T23:34:02.579565] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-22T23:34:02.582558] [INFO ] [MAIN ] Derivative Progress: 1102/2052 symbols. MCO took 0.4s. Estimated remaining time: 6m 14s [2025-10-22T23:34:02.582688] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:02.595160] [DEBUG] [LOCAL ] MCR: Loaded 8866 existing records from primary storage. [2025-10-22T23:34:02.595291] [INFO ] [MAIN ] MCR: Loaded 8866 primary data records. [2025-10-22T23:34:02.899847] [DEBUG] [MAIN ] MCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:02.928724] [INFO ] [MAIN ] MCR: Generated 138 derivative records from 8866 primary records. [2025-10-22T23:34:02.928926] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-22T23:34:02.939792] [DEBUG] [LOCAL ] MCR: Derivative data saved (138 records). [2025-10-22T23:34:02.939876] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-22T23:34:02.942192] [INFO ] [MAIN ] Derivative Progress: 1103/2052 symbols. MCR took 0.4s. Estimated remaining time: 6m 14s [2025-10-22T23:34:02.942291] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:02.964567] [DEBUG] [LOCAL ] MCS: Loaded 21186 existing records from primary storage. [2025-10-22T23:34:02.964742] [INFO ] [MAIN ] MCS: Loaded 21186 primary data records. [2025-10-22T23:34:03.271018] [DEBUG] [MAIN ] MCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:03.296479] [INFO ] [MAIN ] MCS: Generated 138 derivative records from 21186 primary records. [2025-10-22T23:34:03.296688] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-22T23:34:03.308470] [DEBUG] [LOCAL ] MCS: Derivative data saved (138 records). [2025-10-22T23:34:03.308628] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-22T23:34:03.311578] [INFO ] [MAIN ] Derivative Progress: 1104/2052 symbols. MCS took 0.4s. Estimated remaining time: 6m 13s [2025-10-22T23:34:03.311723] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:03.335776] [DEBUG] [LOCAL ] MCY: Loaded 23567 existing records from primary storage. [2025-10-22T23:34:03.335941] [INFO ] [MAIN ] MCY: Loaded 23567 primary data records. [2025-10-22T23:34:03.654008] [DEBUG] [MAIN ] MCY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:03.679615] [INFO ] [MAIN ] MCY: Generated 138 derivative records from 23567 primary records. [2025-10-22T23:34:03.679761] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-22T23:34:03.691166] [DEBUG] [LOCAL ] MCY: Derivative data saved (138 records). [2025-10-22T23:34:03.691249] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-10-22T23:34:03.694236] [INFO ] [MAIN ] Derivative Progress: 1105/2052 symbols. MCY took 0.4s. Estimated remaining time: 6m 13s [2025-10-22T23:34:03.694348] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:03.732013] [DEBUG] [LOCAL ] MD: Loaded 38572 existing records from primary storage. [2025-10-22T23:34:03.732189] [INFO ] [MAIN ] MD: Loaded 38572 primary data records. [2025-10-22T23:34:04.059850] [DEBUG] [MAIN ] MD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:04.085708] [INFO ] [MAIN ] MD: Generated 138 derivative records from 38572 primary records. [2025-10-22T23:34:04.085884] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-22T23:34:04.097641] [DEBUG] [LOCAL ] MD: Derivative data saved (138 records). [2025-10-22T23:34:04.097738] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-22T23:34:04.100805] [INFO ] [MAIN ] Derivative Progress: 1106/2052 symbols. MD took 0.4s. Estimated remaining time: 6m 13s [2025-10-22T23:34:04.100924] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:04.111186] [DEBUG] [LOCAL ] MDST: Loaded 6110 existing records from primary storage. [2025-10-22T23:34:04.111328] [INFO ] [MAIN ] MDST: Loaded 6110 primary data records. [2025-10-22T23:34:04.429221] [DEBUG] [MAIN ] MDST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:04.454433] [INFO ] [MAIN ] MDST: Generated 138 derivative records from 6110 primary records. [2025-10-22T23:34:04.454568] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-22T23:34:04.465424] [DEBUG] [LOCAL ] MDST: Derivative data saved (138 records). [2025-10-22T23:34:04.465506] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-22T23:34:04.467724] [INFO ] [MAIN ] Derivative Progress: 1107/2052 symbols. MDST took 0.4s. Estimated remaining time: 6m 12s [2025-10-22T23:34:04.467824] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:04.519452] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-22T23:34:04.519626] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-10-22T23:34:04.858429] [DEBUG] [MAIN ] MDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:04.885437] [INFO ] [MAIN ] MDT: Generated 138 derivative records from 53678 primary records. [2025-10-22T23:34:04.885589] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-22T23:34:04.897582] [DEBUG] [LOCAL ] MDT: Derivative data saved (138 records). [2025-10-22T23:34:04.897687] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-22T23:34:04.901084] [INFO ] [MAIN ] Derivative Progress: 1108/2052 symbols. MDT took 0.4s. Estimated remaining time: 6m 12s [2025-10-22T23:34:04.901201] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:04.947102] [DEBUG] [LOCAL ] MDU: Loaded 48009 existing records from primary storage. [2025-10-22T23:34:04.947285] [INFO ] [MAIN ] MDU: Loaded 48009 primary data records. [2025-10-22T23:34:05.269548] [DEBUG] [MAIN ] MDU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:05.294705] [INFO ] [MAIN ] MDU: Generated 138 derivative records from 48009 primary records. [2025-10-22T23:34:05.294923] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-22T23:34:05.306605] [DEBUG] [LOCAL ] MDU: Derivative data saved (138 records). [2025-10-22T23:34:05.306717] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-22T23:34:05.309710] [INFO ] [MAIN ] Derivative Progress: 1109/2052 symbols. MDU took 0.4s. Estimated remaining time: 6m 11s [2025-10-22T23:34:05.309824] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:05.322493] [DEBUG] [LOCAL ] MDV: Loaded 8298 existing records from primary storage. [2025-10-22T23:34:05.322667] [INFO ] [MAIN ] MDV: Loaded 8298 primary data records. [2025-10-22T23:34:05.638361] [DEBUG] [MAIN ] MDV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:05.663674] [INFO ] [MAIN ] MDV: Generated 138 derivative records from 8298 primary records. [2025-10-22T23:34:05.663833] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-22T23:34:05.675496] [DEBUG] [LOCAL ] MDV: Derivative data saved (138 records). [2025-10-22T23:34:05.675585] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-10-22T23:34:05.677817] [INFO ] [MAIN ] Derivative Progress: 1110/2052 symbols. MDV took 0.4s. Estimated remaining time: 6m 11s [2025-10-22T23:34:05.677929] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:05.698049] [DEBUG] [LOCAL ] MEC: Loaded 16914 existing records from primary storage. [2025-10-22T23:34:05.698215] [INFO ] [MAIN ] MEC: Loaded 16914 primary data records. [2025-10-22T23:34:06.011490] [DEBUG] [MAIN ] MEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:06.036704] [INFO ] [MAIN ] MEC: Generated 138 derivative records from 16914 primary records. [2025-10-22T23:34:06.036845] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-22T23:34:06.048495] [DEBUG] [LOCAL ] MEC: Derivative data saved (138 records). [2025-10-22T23:34:06.048585] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-22T23:34:06.051375] [INFO ] [MAIN ] Derivative Progress: 1111/2052 symbols. MEC took 0.4s. Estimated remaining time: 6m 11s [2025-10-22T23:34:06.051486] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:06.072511] [DEBUG] [LOCAL ] MED: Loaded 20919 existing records from primary storage. [2025-10-22T23:34:06.072706] [INFO ] [MAIN ] MED: Loaded 20919 primary data records. [2025-10-22T23:34:06.381572] [DEBUG] [MAIN ] MED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:06.406835] [INFO ] [MAIN ] MED: Generated 138 derivative records from 20919 primary records. [2025-10-22T23:34:06.406976] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-22T23:34:06.418520] [DEBUG] [LOCAL ] MED: Derivative data saved (138 records). [2025-10-22T23:34:06.418605] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-22T23:34:06.421527] [INFO ] [MAIN ] Derivative Progress: 1112/2052 symbols. MED took 0.4s. Estimated remaining time: 6m 10s [2025-10-22T23:34:06.421625] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:06.453255] [DEBUG] [LOCAL ] MEG: Loaded 31527 existing records from primary storage. [2025-10-22T23:34:06.453413] [INFO ] [MAIN ] MEG: Loaded 31527 primary data records. [2025-10-22T23:34:06.784561] [DEBUG] [MAIN ] MEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:06.809955] [INFO ] [MAIN ] MEG: Generated 138 derivative records from 31527 primary records. [2025-10-22T23:34:06.810124] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-22T23:34:06.821705] [DEBUG] [LOCAL ] MEG: Derivative data saved (138 records). [2025-10-22T23:34:06.821803] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-22T23:34:06.824766] [INFO ] [MAIN ] Derivative Progress: 1113/2052 symbols. MEG took 0.4s. Estimated remaining time: 6m 10s [2025-10-22T23:34:06.824886] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:06.846537] [DEBUG] [LOCAL ] MEGI: Loaded 19699 existing records from primary storage. [2025-10-22T23:34:06.846713] [INFO ] [MAIN ] MEGI: Loaded 19699 primary data records. [2025-10-22T23:34:07.150341] [DEBUG] [MAIN ] MEGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:07.175614] [INFO ] [MAIN ] MEGI: Generated 138 derivative records from 19699 primary records. [2025-10-22T23:34:07.175767] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-22T23:34:07.187509] [DEBUG] [LOCAL ] MEGI: Derivative data saved (138 records). [2025-10-22T23:34:07.187590] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-22T23:34:07.190385] [INFO ] [MAIN ] Derivative Progress: 1114/2052 symbols. MEGI took 0.4s. Estimated remaining time: 6m 9s [2025-10-22T23:34:07.190487] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:07.220124] [DEBUG] [LOCAL ] MEI: Loaded 31216 existing records from primary storage. [2025-10-22T23:34:07.220279] [INFO ] [MAIN ] MEI: Loaded 31216 primary data records. [2025-10-22T23:34:07.526935] [DEBUG] [MAIN ] MEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:07.551814] [INFO ] [MAIN ] MEI: Generated 138 derivative records from 31216 primary records. [2025-10-22T23:34:07.551932] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-22T23:34:07.563093] [DEBUG] [LOCAL ] MEI: Derivative data saved (138 records). [2025-10-22T23:34:07.563180] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-22T23:34:07.566123] [INFO ] [MAIN ] Derivative Progress: 1115/2052 symbols. MEI took 0.4s. Estimated remaining time: 6m 9s [2025-10-22T23:34:07.566228] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:07.617067] [DEBUG] [LOCAL ] MET: Loaded 53300 existing records from primary storage. [2025-10-22T23:34:07.617234] [INFO ] [MAIN ] MET: Loaded 53300 primary data records. [2025-10-22T23:34:07.920109] [DEBUG] [MAIN ] MET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:07.944969] [INFO ] [MAIN ] MET: Generated 138 derivative records from 53300 primary records. [2025-10-22T23:34:07.945076] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-22T23:34:07.956496] [DEBUG] [LOCAL ] MET: Derivative data saved (138 records). [2025-10-22T23:34:07.956576] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-22T23:34:07.959589] [INFO ] [MAIN ] Derivative Progress: 1116/2052 symbols. MET took 0.4s. Estimated remaining time: 6m 9s [2025-10-22T23:34:07.959717] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:08.001161] [DEBUG] [LOCAL ] MFA: Loaded 45582 existing records from primary storage. [2025-10-22T23:34:08.001321] [INFO ] [MAIN ] MFA: Loaded 45582 primary data records. [2025-10-22T23:34:08.305035] [DEBUG] [MAIN ] MFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:08.330211] [INFO ] [MAIN ] MFA: Generated 138 derivative records from 45582 primary records. [2025-10-22T23:34:08.330378] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-22T23:34:08.341593] [DEBUG] [LOCAL ] MFA: Derivative data saved (138 records). [2025-10-22T23:34:08.341704] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-22T23:34:08.344365] [INFO ] [MAIN ] Derivative Progress: 1117/2052 symbols. MFA took 0.4s. Estimated remaining time: 6m 8s [2025-10-22T23:34:08.344465] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:08.352955] [DEBUG] [LOCAL ] MFAN: Loaded 4309 existing records from primary storage. [2025-10-22T23:34:08.353076] [INFO ] [MAIN ] MFAN: Loaded 4309 primary data records. [2025-10-22T23:34:08.681834] [DEBUG] [MAIN ] MFAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:08.708129] [INFO ] [MAIN ] MFAN: Generated 138 derivative records from 4309 primary records. [2025-10-22T23:34:08.708239] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-22T23:34:08.718259] [DEBUG] [LOCAL ] MFAN: Derivative data saved (138 records). [2025-10-22T23:34:08.718337] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-22T23:34:08.720405] [INFO ] [MAIN ] Derivative Progress: 1118/2052 symbols. MFAN took 0.4s. Estimated remaining time: 6m 8s [2025-10-22T23:34:08.720499] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:08.727049] [DEBUG] [LOCAL ] MFAO: Loaded 3896 existing records from primary storage. [2025-10-22T23:34:08.727149] [INFO ] [MAIN ] MFAO: Loaded 3896 primary data records. [2025-10-22T23:34:09.026901] [DEBUG] [MAIN ] MFAO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:09.051972] [INFO ] [MAIN ] MFAO: Generated 138 derivative records from 3896 primary records. [2025-10-22T23:34:09.052125] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-22T23:34:09.061996] [DEBUG] [LOCAL ] MFAO: Derivative data saved (138 records). [2025-10-22T23:34:09.062074] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-22T23:34:09.064152] [INFO ] [MAIN ] Derivative Progress: 1119/2052 symbols. MFAO took 0.3s. Estimated remaining time: 6m 7s [2025-10-22T23:34:09.064247] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:09.121850] [DEBUG] [LOCAL ] MFC: Loaded 50997 existing records from primary storage. [2025-10-22T23:34:09.122050] [INFO ] [MAIN ] MFC: Loaded 50997 primary data records. [2025-10-22T23:34:09.454209] [DEBUG] [MAIN ] MFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:09.481771] [INFO ] [MAIN ] MFC: Generated 138 derivative records from 50997 primary records. [2025-10-22T23:34:09.482002] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-22T23:34:09.494995] [DEBUG] [LOCAL ] MFC: Derivative data saved (138 records). [2025-10-22T23:34:09.495129] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-22T23:34:09.498358] [INFO ] [MAIN ] Derivative Progress: 1120/2052 symbols. MFC took 0.4s. Estimated remaining time: 6m 7s [2025-10-22T23:34:09.498457] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:09.546725] [DEBUG] [LOCAL ] MFG: Loaded 49552 existing records from primary storage. [2025-10-22T23:34:09.546892] [INFO ] [MAIN ] MFG: Loaded 49552 primary data records. [2025-10-22T23:34:09.872788] [DEBUG] [MAIN ] MFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:09.900720] [INFO ] [MAIN ] MFG: Generated 138 derivative records from 49552 primary records. [2025-10-22T23:34:09.900934] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-22T23:34:09.912356] [DEBUG] [LOCAL ] MFG: Derivative data saved (138 records). [2025-10-22T23:34:09.912440] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-10-22T23:34:09.915503] [INFO ] [MAIN ] Derivative Progress: 1121/2052 symbols. MFG took 0.4s. Estimated remaining time: 6m 7s [2025-10-22T23:34:09.915601] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:09.933971] [DEBUG] [LOCAL ] MFM: Loaded 14090 existing records from primary storage. [2025-10-22T23:34:09.934156] [INFO ] [MAIN ] MFM: Loaded 14090 primary data records. [2025-10-22T23:34:10.281258] [DEBUG] [MAIN ] MFM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:10.308764] [INFO ] [MAIN ] MFM: Generated 138 derivative records from 14090 primary records. [2025-10-22T23:34:10.309066] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-22T23:34:10.322675] [DEBUG] [LOCAL ] MFM: Derivative data saved (138 records). [2025-10-22T23:34:10.322876] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-10-22T23:34:10.326523] [INFO ] [MAIN ] Derivative Progress: 1122/2052 symbols. MFM took 0.4s. Estimated remaining time: 6m 6s [2025-10-22T23:34:10.326762] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:10.340850] [DEBUG] [LOCAL ] MFSG: Loaded 5956 existing records from primary storage. [2025-10-22T23:34:10.341054] [INFO ] [MAIN ] MFSG: Loaded 5956 primary data records. [2025-10-22T23:34:10.813368] [DEBUG] [MAIN ] MFSG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:34:10.847344] [INFO ] [MAIN ] MFSG: Generated 138 derivative records from 5956 primary records. [2025-10-22T23:34:10.847637] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-22T23:34:10.865425] [DEBUG] [LOCAL ] MFSG: Derivative data saved (138 records). [2025-10-22T23:34:10.865631] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-22T23:34:10.868887] [INFO ] [MAIN ] Derivative Progress: 1123/2052 symbols. MFSG took 0.5s. Estimated remaining time: 6m 6s [2025-10-22T23:34:10.869095] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:10.890639] [DEBUG] [LOCAL ] MFSI: Loaded 12648 existing records from primary storage. [2025-10-22T23:34:10.890870] [INFO ] [MAIN ] MFSI: Loaded 12648 primary data records. [2025-10-22T23:34:11.356102] [DEBUG] [MAIN ] MFSI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:34:11.385031] [INFO ] [MAIN ] MFSI: Generated 138 derivative records from 12648 primary records. [2025-10-22T23:34:11.385210] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-22T23:34:11.397533] [DEBUG] [LOCAL ] MFSI: Derivative data saved (138 records). [2025-10-22T23:34:11.397717] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-22T23:34:11.400831] [INFO ] [MAIN ] Derivative Progress: 1124/2052 symbols. MFSI took 0.5s. Estimated remaining time: 6m 6s [2025-10-22T23:34:11.401021] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:11.406025] [DEBUG] [LOCAL ] MFSV: Loaded 2944 existing records from primary storage. [2025-10-22T23:34:11.406181] [INFO ] [MAIN ] MFSV: Loaded 2944 primary data records. [2025-10-22T23:34:11.715974] [DEBUG] [MAIN ] MFSV: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-22T23:34:11.742508] [INFO ] [MAIN ] MFSV: Generated 138 derivative records from 2944 primary records. [2025-10-22T23:34:11.742638] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-22T23:34:11.752602] [DEBUG] [LOCAL ] MFSV: Derivative data saved (138 records). [2025-10-22T23:34:11.752716] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-22T23:34:11.755059] [INFO ] [MAIN ] Derivative Progress: 1125/2052 symbols. MFSV took 0.4s. Estimated remaining time: 6m 5s [2025-10-22T23:34:11.755155] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:11.771582] [DEBUG] [LOCAL ] MG: Loaded 15383 existing records from primary storage. [2025-10-22T23:34:11.771744] [INFO ] [MAIN ] MG: Loaded 15383 primary data records. [2025-10-22T23:34:12.083932] [DEBUG] [MAIN ] MG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:12.110149] [INFO ] [MAIN ] MG: Generated 138 derivative records from 15383 primary records. [2025-10-22T23:34:12.110340] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-22T23:34:12.123810] [DEBUG] [LOCAL ] MG: Derivative data saved (138 records). [2025-10-22T23:34:12.123933] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-22T23:34:12.126913] [INFO ] [MAIN ] Derivative Progress: 1126/2052 symbols. MG took 0.4s. Estimated remaining time: 6m 5s [2025-10-22T23:34:12.127014] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:12.175877] [DEBUG] [LOCAL ] MGA: Loaded 50391 existing records from primary storage. [2025-10-22T23:34:12.176057] [INFO ] [MAIN ] MGA: Loaded 50391 primary data records. [2025-10-22T23:34:12.498307] [DEBUG] [MAIN ] MGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:12.525316] [INFO ] [MAIN ] MGA: Generated 138 derivative records from 50391 primary records. [2025-10-22T23:34:12.525513] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-22T23:34:12.538066] [DEBUG] [LOCAL ] MGA: Derivative data saved (138 records). [2025-10-22T23:34:12.538179] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-22T23:34:12.541277] [INFO ] [MAIN ] Derivative Progress: 1127/2052 symbols. MGA took 0.4s. Estimated remaining time: 6m 4s [2025-10-22T23:34:12.541410] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:12.550316] [DEBUG] [LOCAL ] MGF: Loaded 4133 existing records from primary storage. [2025-10-22T23:34:12.550450] [INFO ] [MAIN ] MGF: Loaded 4133 primary data records. [2025-10-22T23:34:12.872796] [DEBUG] [MAIN ] MGF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:12.898757] [INFO ] [MAIN ] MGF: Generated 138 derivative records from 4133 primary records. [2025-10-22T23:34:12.898980] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-22T23:34:12.908627] [DEBUG] [LOCAL ] MGF: Derivative data saved (138 records). [2025-10-22T23:34:12.908743] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-22T23:34:12.910937] [INFO ] [MAIN ] Derivative Progress: 1128/2052 symbols. MGF took 0.4s. Estimated remaining time: 6m 4s [2025-10-22T23:34:12.911039] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:12.964468] [DEBUG] [LOCAL ] MGM: Loaded 53605 existing records from primary storage. [2025-10-22T23:34:12.964639] [INFO ] [MAIN ] MGM: Loaded 53605 primary data records. [2025-10-22T23:34:13.304164] [DEBUG] [MAIN ] MGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:13.329530] [INFO ] [MAIN ] MGM: Generated 138 derivative records from 53605 primary records. [2025-10-22T23:34:13.329706] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-22T23:34:13.341144] [DEBUG] [LOCAL ] MGM: Derivative data saved (138 records). [2025-10-22T23:34:13.341230] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-22T23:34:13.344611] [INFO ] [MAIN ] Derivative Progress: 1129/2052 symbols. MGM took 0.4s. Estimated remaining time: 6m 4s [2025-10-22T23:34:13.344765] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:13.354489] [DEBUG] [LOCAL ] MGR: Loaded 5536 existing records from primary storage. [2025-10-22T23:34:13.354632] [INFO ] [MAIN ] MGR: Loaded 5536 primary data records. [2025-10-22T23:34:13.657417] [DEBUG] [MAIN ] MGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:13.682307] [INFO ] [MAIN ] MGR: Generated 138 derivative records from 5536 primary records. [2025-10-22T23:34:13.682417] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-22T23:34:13.693296] [DEBUG] [LOCAL ] MGR: Derivative data saved (138 records). [2025-10-22T23:34:13.693380] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-22T23:34:13.695579] [INFO ] [MAIN ] Derivative Progress: 1130/2052 symbols. MGR took 0.4s. Estimated remaining time: 6m 3s [2025-10-22T23:34:13.695701] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:13.702663] [DEBUG] [LOCAL ] MGRB: Loaded 3994 existing records from primary storage. [2025-10-22T23:34:13.702822] [INFO ] [MAIN ] MGRB: Loaded 3994 primary data records. [2025-10-22T23:34:14.006126] [DEBUG] [MAIN ] MGRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:14.031665] [INFO ] [MAIN ] MGRB: Generated 138 derivative records from 3994 primary records. [2025-10-22T23:34:14.031776] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-22T23:34:14.042792] [DEBUG] [LOCAL ] MGRB: Derivative data saved (138 records). [2025-10-22T23:34:14.042872] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-10-22T23:34:14.045162] [INFO ] [MAIN ] Derivative Progress: 1131/2052 symbols. MGRB took 0.3s. Estimated remaining time: 6m 3s [2025-10-22T23:34:14.045257] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:14.049851] [DEBUG] [LOCAL ] MGRD: Loaded 2206 existing records from primary storage. [2025-10-22T23:34:14.049941] [INFO ] [MAIN ] MGRD: Loaded 2206 primary data records. [2025-10-22T23:34:14.350204] [DEBUG] [MAIN ] MGRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:14.379675] [INFO ] [MAIN ] MGRD: Generated 138 derivative records from 2206 primary records. [2025-10-22T23:34:14.379942] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-22T23:34:14.394524] [DEBUG] [LOCAL ] MGRD: Derivative data saved (138 records). [2025-10-22T23:34:14.394721] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-22T23:34:14.397793] [INFO ] [MAIN ] Derivative Progress: 1132/2052 symbols. MGRD took 0.4s. Estimated remaining time: 6m 2s [2025-10-22T23:34:14.397984] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:14.409661] [DEBUG] [LOCAL ] MGRE: Loaded 6420 existing records from primary storage. [2025-10-22T23:34:14.409821] [INFO ] [MAIN ] MGRE: Loaded 6420 primary data records. [2025-10-22T23:34:14.718591] [DEBUG] [MAIN ] MGRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:14.744998] [INFO ] [MAIN ] MGRE: Generated 138 derivative records from 6420 primary records. [2025-10-22T23:34:14.745195] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-22T23:34:14.756340] [DEBUG] [LOCAL ] MGRE: Derivative data saved (138 records). [2025-10-22T23:34:14.756478] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-22T23:34:14.759026] [INFO ] [MAIN ] Derivative Progress: 1133/2052 symbols. MGRE took 0.4s. Estimated remaining time: 6m 2s [2025-10-22T23:34:14.759172] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:14.812328] [DEBUG] [LOCAL ] MGY: Loaded 52424 existing records from primary storage. [2025-10-22T23:34:14.812510] [INFO ] [MAIN ] MGY: Loaded 52424 primary data records. [2025-10-22T23:34:15.169470] [DEBUG] [MAIN ] MGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:15.196171] [INFO ] [MAIN ] MGY: Generated 138 derivative records from 52424 primary records. [2025-10-22T23:34:15.196363] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-10-22T23:34:15.208472] [DEBUG] [LOCAL ] MGY: Derivative data saved (138 records). [2025-10-22T23:34:15.208625] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-10-22T23:34:15.212105] [INFO ] [MAIN ] Derivative Progress: 1134/2052 symbols. MGY took 0.5s. Estimated remaining time: 6m 2s [2025-10-22T23:34:15.212272] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:15.228430] [DEBUG] [LOCAL ] MHD: Loaded 11922 existing records from primary storage. [2025-10-22T23:34:15.228597] [INFO ] [MAIN ] MHD: Loaded 11922 primary data records. [2025-10-22T23:34:15.549162] [DEBUG] [MAIN ] MHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:15.575757] [INFO ] [MAIN ] MHD: Generated 138 derivative records from 11922 primary records. [2025-10-22T23:34:15.575968] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-22T23:34:15.587293] [DEBUG] [LOCAL ] MHD: Derivative data saved (138 records). [2025-10-22T23:34:15.587428] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-22T23:34:15.590507] [INFO ] [MAIN ] Derivative Progress: 1135/2052 symbols. MHD took 0.4s. Estimated remaining time: 6m 1s [2025-10-22T23:34:15.590732] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:15.604176] [DEBUG] [LOCAL ] MHF: Loaded 9054 existing records from primary storage. [2025-10-22T23:34:15.604340] [INFO ] [MAIN ] MHF: Loaded 9054 primary data records. [2025-10-22T23:34:15.926809] [DEBUG] [MAIN ] MHF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:15.953737] [INFO ] [MAIN ] MHF: Generated 138 derivative records from 9054 primary records. [2025-10-22T23:34:15.953927] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-22T23:34:15.964894] [DEBUG] [LOCAL ] MHF: Derivative data saved (138 records). [2025-10-22T23:34:15.965036] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-22T23:34:15.967438] [INFO ] [MAIN ] Derivative Progress: 1136/2052 symbols. MHF took 0.4s. Estimated remaining time: 6m 1s [2025-10-22T23:34:15.967550] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:16.009742] [DEBUG] [LOCAL ] MHK: Loaded 41973 existing records from primary storage. [2025-10-22T23:34:16.009914] [INFO ] [MAIN ] MHK: Loaded 41973 primary data records. [2025-10-22T23:34:16.327527] [DEBUG] [MAIN ] MHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:16.354158] [INFO ] [MAIN ] MHK: Generated 138 derivative records from 41973 primary records. [2025-10-22T23:34:16.354343] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-22T23:34:16.366251] [DEBUG] [LOCAL ] MHK: Derivative data saved (138 records). [2025-10-22T23:34:16.366396] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-22T23:34:16.369562] [INFO ] [MAIN ] Derivative Progress: 1137/2052 symbols. MHK took 0.4s. Estimated remaining time: 6m 0s [2025-10-22T23:34:16.369712] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:16.380344] [DEBUG] [LOCAL ] MHN: Loaded 7382 existing records from primary storage. [2025-10-22T23:34:16.380510] [INFO ] [MAIN ] MHN: Loaded 7382 primary data records. [2025-10-22T23:34:16.710115] [DEBUG] [MAIN ] MHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:16.735245] [INFO ] [MAIN ] MHN: Generated 138 derivative records from 7382 primary records. [2025-10-22T23:34:16.735375] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-22T23:34:16.745835] [DEBUG] [LOCAL ] MHN: Derivative data saved (138 records). [2025-10-22T23:34:16.745916] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-22T23:34:16.748300] [INFO ] [MAIN ] Derivative Progress: 1138/2052 symbols. MHN took 0.4s. Estimated remaining time: 6m 0s [2025-10-22T23:34:16.748396] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:16.772049] [DEBUG] [LOCAL ] MHO: Loaded 23675 existing records from primary storage. [2025-10-22T23:34:16.772198] [INFO ] [MAIN ] MHO: Loaded 23675 primary data records. [2025-10-22T23:34:17.115315] [DEBUG] [MAIN ] MHO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:17.141120] [INFO ] [MAIN ] MHO: Generated 138 derivative records from 23675 primary records. [2025-10-22T23:34:17.141305] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-22T23:34:17.153295] [DEBUG] [LOCAL ] MHO: Derivative data saved (138 records). [2025-10-22T23:34:17.153432] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-22T23:34:17.156566] [INFO ] [MAIN ] Derivative Progress: 1139/2052 symbols. MHO took 0.4s. Estimated remaining time: 5m 60s [2025-10-22T23:34:17.156754] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:17.173768] [DEBUG] [LOCAL ] MIN: Loaded 13938 existing records from primary storage. [2025-10-22T23:34:17.173920] [INFO ] [MAIN ] MIN: Loaded 13938 primary data records. [2025-10-22T23:34:17.486465] [DEBUG] [MAIN ] MIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:17.514814] [INFO ] [MAIN ] MIN: Generated 138 derivative records from 13938 primary records. [2025-10-22T23:34:17.514998] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-22T23:34:17.525754] [DEBUG] [LOCAL ] MIN: Derivative data saved (138 records). [2025-10-22T23:34:17.525864] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-22T23:34:17.528941] [INFO ] [MAIN ] Derivative Progress: 1140/2052 symbols. MIN took 0.4s. Estimated remaining time: 5m 59s [2025-10-22T23:34:17.529077] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:17.580202] [DEBUG] [LOCAL ] MIR: Loaded 51402 existing records from primary storage. [2025-10-22T23:34:17.580376] [INFO ] [MAIN ] MIR: Loaded 51402 primary data records. [2025-10-22T23:34:17.891394] [DEBUG] [MAIN ] MIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:17.917026] [INFO ] [MAIN ] MIR: Generated 138 derivative records from 51402 primary records. [2025-10-22T23:34:17.917209] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-22T23:34:17.929508] [DEBUG] [LOCAL ] MIR: Derivative data saved (138 records). [2025-10-22T23:34:17.929665] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-10-22T23:34:17.933038] [INFO ] [MAIN ] Derivative Progress: 1141/2052 symbols. MIR took 0.4s. Estimated remaining time: 5m 59s [2025-10-22T23:34:17.933146] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:17.955383] [DEBUG] [LOCAL ] MITT: Loaded 22283 existing records from primary storage. [2025-10-22T23:34:17.955546] [INFO ] [MAIN ] MITT: Loaded 22283 primary data records. [2025-10-22T23:34:18.266075] [DEBUG] [MAIN ] MITT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:18.294931] [INFO ] [MAIN ] MITT: Generated 138 derivative records from 22283 primary records. [2025-10-22T23:34:18.295101] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-22T23:34:18.306089] [DEBUG] [LOCAL ] MITT: Derivative data saved (138 records). [2025-10-22T23:34:18.306175] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-22T23:34:18.309210] [INFO ] [MAIN ] Derivative Progress: 1142/2052 symbols. MITT took 0.4s. Estimated remaining time: 5m 58s [2025-10-22T23:34:18.309308] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:18.319690] [DEBUG] [LOCAL ] MIY: Loaded 6216 existing records from primary storage. [2025-10-22T23:34:18.319830] [INFO ] [MAIN ] MIY: Loaded 6216 primary data records. [2025-10-22T23:34:18.634688] [DEBUG] [MAIN ] MIY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:18.662124] [INFO ] [MAIN ] MIY: Generated 138 derivative records from 6216 primary records. [2025-10-22T23:34:18.662322] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-22T23:34:18.673616] [DEBUG] [LOCAL ] MIY: Derivative data saved (138 records). [2025-10-22T23:34:18.673798] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-22T23:34:18.676306] [INFO ] [MAIN ] Derivative Progress: 1143/2052 symbols. MIY took 0.4s. Estimated remaining time: 5m 58s [2025-10-22T23:34:18.676474] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:18.730449] [DEBUG] [LOCAL ] MKC: Loaded 52525 existing records from primary storage. [2025-10-22T23:34:18.730691] [INFO ] [MAIN ] MKC: Loaded 52525 primary data records. [2025-10-22T23:34:19.049258] [DEBUG] [MAIN ] MKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:19.075114] [INFO ] [MAIN ] MKC: Generated 138 derivative records from 52525 primary records. [2025-10-22T23:34:19.075300] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-22T23:34:19.086924] [DEBUG] [LOCAL ] MKC: Derivative data saved (138 records). [2025-10-22T23:34:19.087025] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-22T23:34:19.090422] [INFO ] [MAIN ] Derivative Progress: 1144/2052 symbols. MKC took 0.4s. Estimated remaining time: 5m 58s [2025-10-22T23:34:19.090538] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:19.125384] [DEBUG] [LOCAL ] MKL: Loaded 33801 existing records from primary storage. [2025-10-22T23:34:19.125545] [INFO ] [MAIN ] MKL: Loaded 33801 primary data records. [2025-10-22T23:34:19.483008] [DEBUG] [MAIN ] MKL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:19.510704] [INFO ] [MAIN ] MKL: Generated 138 derivative records from 33801 primary records. [2025-10-22T23:34:19.510887] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-22T23:34:19.524471] [DEBUG] [LOCAL ] MKL: Derivative data saved (138 records). [2025-10-22T23:34:19.524615] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-22T23:34:19.528484] [INFO ] [MAIN ] Derivative Progress: 1145/2052 symbols. MKL took 0.4s. Estimated remaining time: 5m 57s [2025-10-22T23:34:19.528574] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:19.572545] [DEBUG] [LOCAL ] MLI: Loaded 43388 existing records from primary storage. [2025-10-22T23:34:19.572733] [INFO ] [MAIN ] MLI: Loaded 43388 primary data records. [2025-10-22T23:34:19.882209] [DEBUG] [MAIN ] MLI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:19.907595] [INFO ] [MAIN ] MLI: Generated 138 derivative records from 43388 primary records. [2025-10-22T23:34:19.907751] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-22T23:34:19.919153] [DEBUG] [LOCAL ] MLI: Derivative data saved (138 records). [2025-10-22T23:34:19.919234] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-22T23:34:19.922187] [INFO ] [MAIN ] Derivative Progress: 1146/2052 symbols. MLI took 0.4s. Estimated remaining time: 5m 57s [2025-10-22T23:34:19.922284] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:19.951687] [DEBUG] [LOCAL ] MLM: Loaded 28634 existing records from primary storage. [2025-10-22T23:34:19.951844] [INFO ] [MAIN ] MLM: Loaded 28634 primary data records. [2025-10-22T23:34:20.263954] [DEBUG] [MAIN ] MLM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:20.289082] [INFO ] [MAIN ] MLM: Generated 138 derivative records from 28634 primary records. [2025-10-22T23:34:20.289201] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-22T23:34:20.300743] [DEBUG] [LOCAL ] MLM: Derivative data saved (138 records). [2025-10-22T23:34:20.300825] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-22T23:34:20.303844] [INFO ] [MAIN ] Derivative Progress: 1147/2052 symbols. MLM took 0.4s. Estimated remaining time: 5m 57s [2025-10-22T23:34:20.303942] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:20.333304] [DEBUG] [LOCAL ] MLNK: Loaded 27397 existing records from primary storage. [2025-10-22T23:34:20.333457] [INFO ] [MAIN ] MLNK: Loaded 27397 primary data records. [2025-10-22T23:34:20.640042] [DEBUG] [MAIN ] MLNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:20.667515] [INFO ] [MAIN ] MLNK: Generated 138 derivative records from 27397 primary records. [2025-10-22T23:34:20.667783] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-10-22T23:34:20.680100] [DEBUG] [LOCAL ] MLNK: Derivative data saved (138 records). [2025-10-22T23:34:20.680184] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-10-22T23:34:20.683610] [INFO ] [MAIN ] Derivative Progress: 1148/2052 symbols. MLNK took 0.4s. Estimated remaining time: 5m 56s [2025-10-22T23:34:20.683761] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:20.690358] [DEBUG] [LOCAL ] MLP: Loaded 3004 existing records from primary storage. [2025-10-22T23:34:20.690456] [INFO ] [MAIN ] MLP: Loaded 3004 primary data records. [2025-10-22T23:34:21.039137] [DEBUG] [MAIN ] MLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:21.065459] [INFO ] [MAIN ] MLP: Generated 138 derivative records from 3004 primary records. [2025-10-22T23:34:21.065719] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-22T23:34:21.075591] [DEBUG] [LOCAL ] MLP: Derivative data saved (138 records). [2025-10-22T23:34:21.075731] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-22T23:34:21.079105] [INFO ] [MAIN ] Derivative Progress: 1149/2052 symbols. MLP took 0.4s. Estimated remaining time: 5m 56s [2025-10-22T23:34:21.079194] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:21.099876] [DEBUG] [LOCAL ] MLR: Loaded 12116 existing records from primary storage. [2025-10-22T23:34:21.100052] [INFO ] [MAIN ] MLR: Loaded 12116 primary data records. [2025-10-22T23:34:21.451913] [DEBUG] [MAIN ] MLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:21.478049] [INFO ] [MAIN ] MLR: Generated 138 derivative records from 12116 primary records. [2025-10-22T23:34:21.478217] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-10-22T23:34:21.489736] [DEBUG] [LOCAL ] MLR: Derivative data saved (138 records). [2025-10-22T23:34:21.489868] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-10-22T23:34:21.492828] [INFO ] [MAIN ] Derivative Progress: 1150/2052 symbols. MLR took 0.4s. Estimated remaining time: 5m 55s [2025-10-22T23:34:21.492927] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:21.549529] [DEBUG] [LOCAL ] MMC: Loaded 51936 existing records from primary storage. [2025-10-22T23:34:21.549735] [INFO ] [MAIN ] MMC: Loaded 51936 primary data records. [2025-10-22T23:34:21.871244] [DEBUG] [MAIN ] MMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:21.897385] [INFO ] [MAIN ] MMC: Generated 138 derivative records from 51936 primary records. [2025-10-22T23:34:21.897553] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-22T23:34:21.909604] [DEBUG] [LOCAL ] MMC: Derivative data saved (138 records). [2025-10-22T23:34:21.909704] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-10-22T23:34:21.913046] [INFO ] [MAIN ] Derivative Progress: 1151/2052 symbols. MMC took 0.4s. Estimated remaining time: 5m 55s [2025-10-22T23:34:21.913153] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:21.927732] [DEBUG] [LOCAL ] MMD: Loaded 10733 existing records from primary storage. [2025-10-22T23:34:21.927907] [INFO ] [MAIN ] MMD: Loaded 10733 primary data records. [2025-10-22T23:34:22.243061] [DEBUG] [MAIN ] MMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:22.270760] [INFO ] [MAIN ] MMD: Generated 138 derivative records from 10733 primary records. [2025-10-22T23:34:22.270883] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-22T23:34:22.283080] [DEBUG] [LOCAL ] MMD: Derivative data saved (138 records). [2025-10-22T23:34:22.283166] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-22T23:34:22.285375] [INFO ] [MAIN ] Derivative Progress: 1152/2052 symbols. MMD took 0.4s. Estimated remaining time: 5m 55s [2025-10-22T23:34:22.285473] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:22.303843] [DEBUG] [LOCAL ] MMI: Loaded 15372 existing records from primary storage. [2025-10-22T23:34:22.303993] [INFO ] [MAIN ] MMI: Loaded 15372 primary data records. [2025-10-22T23:34:22.608312] [DEBUG] [MAIN ] MMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:22.633976] [INFO ] [MAIN ] MMI: Generated 138 derivative records from 15372 primary records. [2025-10-22T23:34:22.634100] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-22T23:34:22.645577] [DEBUG] [LOCAL ] MMI: Derivative data saved (138 records). [2025-10-22T23:34:22.645683] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-22T23:34:22.648501] [INFO ] [MAIN ] Derivative Progress: 1153/2052 symbols. MMI took 0.4s. Estimated remaining time: 5m 54s [2025-10-22T23:34:22.648606] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:22.701691] [DEBUG] [LOCAL ] MMM: Loaded 53112 existing records from primary storage. [2025-10-22T23:34:22.701853] [INFO ] [MAIN ] MMM: Loaded 53112 primary data records. [2025-10-22T23:34:23.016792] [DEBUG] [MAIN ] MMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:23.042752] [INFO ] [MAIN ] MMM: Generated 138 derivative records from 53112 primary records. [2025-10-22T23:34:23.042898] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-22T23:34:23.054754] [DEBUG] [LOCAL ] MMM: Derivative data saved (138 records). [2025-10-22T23:34:23.054838] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-22T23:34:23.057953] [INFO ] [MAIN ] Derivative Progress: 1154/2052 symbols. MMM took 0.4s. Estimated remaining time: 5m 54s [2025-10-22T23:34:23.058054] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:23.090026] [DEBUG] [LOCAL ] MMS: Loaded 33396 existing records from primary storage. [2025-10-22T23:34:23.090184] [INFO ] [MAIN ] MMS: Loaded 33396 primary data records. [2025-10-22T23:34:23.430469] [DEBUG] [MAIN ] MMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:23.456387] [INFO ] [MAIN ] MMS: Generated 138 derivative records from 33396 primary records. [2025-10-22T23:34:23.456509] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-22T23:34:23.468010] [DEBUG] [LOCAL ] MMS: Derivative data saved (138 records). [2025-10-22T23:34:23.468099] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-10-22T23:34:23.471075] [INFO ] [MAIN ] Derivative Progress: 1155/2052 symbols. MMS took 0.4s. Estimated remaining time: 5m 53s [2025-10-22T23:34:23.471185] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:23.484788] [DEBUG] [LOCAL ] MMT: Loaded 10142 existing records from primary storage. [2025-10-22T23:34:23.484941] [INFO ] [MAIN ] MMT: Loaded 10142 primary data records. [2025-10-22T23:34:23.804234] [DEBUG] [MAIN ] MMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:23.830248] [INFO ] [MAIN ] MMT: Generated 138 derivative records from 10142 primary records. [2025-10-22T23:34:23.830377] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-22T23:34:23.841885] [DEBUG] [LOCAL ] MMT: Derivative data saved (138 records). [2025-10-22T23:34:23.841972] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-22T23:34:23.844179] [INFO ] [MAIN ] Derivative Progress: 1156/2052 symbols. MMT took 0.4s. Estimated remaining time: 5m 53s [2025-10-22T23:34:23.844291] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:23.864097] [DEBUG] [LOCAL ] MMU: Loaded 16784 existing records from primary storage. [2025-10-22T23:34:23.864256] [INFO ] [MAIN ] MMU: Loaded 16784 primary data records. [2025-10-22T23:34:24.170177] [DEBUG] [MAIN ] MMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:24.195754] [INFO ] [MAIN ] MMU: Generated 138 derivative records from 16784 primary records. [2025-10-22T23:34:24.195883] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-22T23:34:24.207074] [DEBUG] [LOCAL ] MMU: Derivative data saved (138 records). [2025-10-22T23:34:24.207153] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-22T23:34:24.209948] [INFO ] [MAIN ] Derivative Progress: 1157/2052 symbols. MMU took 0.4s. Estimated remaining time: 5m 53s [2025-10-22T23:34:24.210053] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:24.236757] [DEBUG] [LOCAL ] MNR: Loaded 24999 existing records from primary storage. [2025-10-22T23:34:24.236905] [INFO ] [MAIN ] MNR: Loaded 24999 primary data records. [2025-10-22T23:34:24.552348] [DEBUG] [MAIN ] MNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:24.578366] [INFO ] [MAIN ] MNR: Generated 138 derivative records from 24999 primary records. [2025-10-22T23:34:24.578513] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-22T23:34:24.590177] [DEBUG] [LOCAL ] MNR: Derivative data saved (138 records). [2025-10-22T23:34:24.590258] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-22T23:34:24.593207] [INFO ] [MAIN ] Derivative Progress: 1158/2052 symbols. MNR took 0.4s. Estimated remaining time: 5m 52s [2025-10-22T23:34:24.593307] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:24.635824] [DEBUG] [LOCAL ] MNSO: Loaded 44038 existing records from primary storage. [2025-10-22T23:34:24.635987] [INFO ] [MAIN ] MNSO: Loaded 44038 primary data records. [2025-10-22T23:34:24.946830] [DEBUG] [MAIN ] MNSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:24.972589] [INFO ] [MAIN ] MNSO: Generated 138 derivative records from 44038 primary records. [2025-10-22T23:34:24.972759] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-22T23:34:24.984340] [DEBUG] [LOCAL ] MNSO: Derivative data saved (138 records). [2025-10-22T23:34:24.984420] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-22T23:34:24.987376] [INFO ] [MAIN ] Derivative Progress: 1159/2052 symbols. MNSO took 0.4s. Estimated remaining time: 5m 52s [2025-10-22T23:34:24.987485] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:25.030297] [DEBUG] [LOCAL ] MOD: Loaded 44505 existing records from primary storage. [2025-10-22T23:34:25.030457] [INFO ] [MAIN ] MOD: Loaded 44505 primary data records. [2025-10-22T23:34:25.345720] [DEBUG] [MAIN ] MOD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:25.373331] [INFO ] [MAIN ] MOD: Generated 138 derivative records from 44505 primary records. [2025-10-22T23:34:25.373478] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-22T23:34:25.385200] [DEBUG] [LOCAL ] MOD: Derivative data saved (138 records). [2025-10-22T23:34:25.385281] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-22T23:34:25.388118] [INFO ] [MAIN ] Derivative Progress: 1160/2052 symbols. MOD took 0.4s. Estimated remaining time: 5m 51s [2025-10-22T23:34:25.388217] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:25.437040] [DEBUG] [LOCAL ] MODG: Loaded 51534 existing records from primary storage. [2025-10-22T23:34:25.437203] [INFO ] [MAIN ] MODG: Loaded 51534 primary data records. [2025-10-22T23:34:25.769298] [DEBUG] [MAIN ] MODG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:25.795198] [INFO ] [MAIN ] MODG: Generated 138 derivative records from 51534 primary records. [2025-10-22T23:34:25.795332] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-22T23:34:25.806771] [DEBUG] [LOCAL ] MODG: Derivative data saved (138 records). [2025-10-22T23:34:25.806854] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-22T23:34:25.810030] [INFO ] [MAIN ] Derivative Progress: 1161/2052 symbols. MODG took 0.4s. Estimated remaining time: 5m 51s [2025-10-22T23:34:25.810136] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:25.851628] [DEBUG] [LOCAL ] MOH: Loaded 43041 existing records from primary storage. [2025-10-22T23:34:25.851826] [INFO ] [MAIN ] MOH: Loaded 43041 primary data records. [2025-10-22T23:34:26.165798] [DEBUG] [MAIN ] MOH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:26.191845] [INFO ] [MAIN ] MOH: Generated 138 derivative records from 43041 primary records. [2025-10-22T23:34:26.191964] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-10-22T23:34:26.203635] [DEBUG] [LOCAL ] MOH: Derivative data saved (138 records). [2025-10-22T23:34:26.203737] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-10-22T23:34:26.206588] [INFO ] [MAIN ] Derivative Progress: 1162/2052 symbols. MOH took 0.4s. Estimated remaining time: 5m 51s [2025-10-22T23:34:26.206736] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:26.258480] [DEBUG] [LOCAL ] MOS: Loaded 53511 existing records from primary storage. [2025-10-22T23:34:26.258682] [INFO ] [MAIN ] MOS: Loaded 53511 primary data records. [2025-10-22T23:34:26.565533] [DEBUG] [MAIN ] MOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:26.590786] [INFO ] [MAIN ] MOS: Generated 138 derivative records from 53511 primary records. [2025-10-22T23:34:26.590914] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-22T23:34:26.602510] [DEBUG] [LOCAL ] MOS: Derivative data saved (138 records). [2025-10-22T23:34:26.602589] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-10-22T23:34:26.605766] [INFO ] [MAIN ] Derivative Progress: 1163/2052 symbols. MOS took 0.4s. Estimated remaining time: 5m 50s [2025-10-22T23:34:26.605868] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:26.628227] [DEBUG] [LOCAL ] MOV: Loaded 21161 existing records from primary storage. [2025-10-22T23:34:26.628375] [INFO ] [MAIN ] MOV: Loaded 21161 primary data records. [2025-10-22T23:34:26.942155] [DEBUG] [MAIN ] MOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:26.968235] [INFO ] [MAIN ] MOV: Generated 138 derivative records from 21161 primary records. [2025-10-22T23:34:26.968382] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-10-22T23:34:26.979872] [DEBUG] [LOCAL ] MOV: Derivative data saved (138 records). [2025-10-22T23:34:26.979963] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-10-22T23:34:26.982760] [INFO ] [MAIN ] Derivative Progress: 1164/2052 symbols. MOV took 0.4s. Estimated remaining time: 5m 50s [2025-10-22T23:34:26.982865] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:27.037934] [DEBUG] [LOCAL ] MP: Loaded 53744 existing records from primary storage. [2025-10-22T23:34:27.038139] [INFO ] [MAIN ] MP: Loaded 53744 primary data records. [2025-10-22T23:34:27.347342] [DEBUG] [MAIN ] MP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:27.373258] [INFO ] [MAIN ] MP: Generated 138 derivative records from 53744 primary records. [2025-10-22T23:34:27.373396] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-10-22T23:34:27.385399] [DEBUG] [LOCAL ] MP: Derivative data saved (138 records). [2025-10-22T23:34:27.385486] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-10-22T23:34:27.388745] [INFO ] [MAIN ] Derivative Progress: 1165/2052 symbols. MP took 0.4s. Estimated remaining time: 5m 49s [2025-10-22T23:34:27.388842] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:27.398582] [DEBUG] [LOCAL ] MPA: Loaded 5192 existing records from primary storage. [2025-10-22T23:34:27.398743] [INFO ] [MAIN ] MPA: Loaded 5192 primary data records. [2025-10-22T23:34:27.732628] [DEBUG] [MAIN ] MPA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:27.758352] [INFO ] [MAIN ] MPA: Generated 138 derivative records from 5192 primary records. [2025-10-22T23:34:27.758465] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-22T23:34:27.769189] [DEBUG] [LOCAL ] MPA: Derivative data saved (138 records). [2025-10-22T23:34:27.769269] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-10-22T23:34:27.771486] [INFO ] [MAIN ] Derivative Progress: 1166/2052 symbols. MPA took 0.4s. Estimated remaining time: 5m 49s [2025-10-22T23:34:27.771600] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:27.823577] [DEBUG] [LOCAL ] MPC: Loaded 51893 existing records from primary storage. [2025-10-22T23:34:27.823757] [INFO ] [MAIN ] MPC: Loaded 51893 primary data records. [2025-10-22T23:34:28.134214] [DEBUG] [MAIN ] MPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:28.159857] [INFO ] [MAIN ] MPC: Generated 138 derivative records from 51893 primary records. [2025-10-22T23:34:28.160032] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-10-22T23:34:28.172262] [DEBUG] [LOCAL ] MPC: Derivative data saved (138 records). [2025-10-22T23:34:28.172392] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-10-22T23:34:28.175481] [INFO ] [MAIN ] Derivative Progress: 1167/2052 symbols. MPC took 0.4s. Estimated remaining time: 5m 49s [2025-10-22T23:34:28.175603] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:28.225537] [DEBUG] [LOCAL ] MPLX: Loaded 50774 existing records from primary storage. [2025-10-22T23:34:28.225746] [INFO ] [MAIN ] MPLX: Loaded 50774 primary data records. [2025-10-22T23:34:28.531940] [DEBUG] [MAIN ] MPLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:28.557530] [INFO ] [MAIN ] MPLX: Generated 138 derivative records from 50774 primary records. [2025-10-22T23:34:28.557673] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-10-22T23:34:28.569205] [DEBUG] [LOCAL ] MPLX: Derivative data saved (138 records). [2025-10-22T23:34:28.569289] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-10-22T23:34:28.572427] [INFO ] [MAIN ] Derivative Progress: 1168/2052 symbols. MPLX took 0.4s. Estimated remaining time: 5m 48s [2025-10-22T23:34:28.572539] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:28.581454] [DEBUG] [LOCAL ] MPV: Loaded 4350 existing records from primary storage. [2025-10-22T23:34:28.581556] [INFO ] [MAIN ] MPV: Loaded 4350 primary data records. [2025-10-22T23:34:28.894282] [DEBUG] [MAIN ] MPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:28.920040] [INFO ] [MAIN ] MPV: Generated 138 derivative records from 4350 primary records. [2025-10-22T23:34:28.920204] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-10-22T23:34:28.930877] [DEBUG] [LOCAL ] MPV: Derivative data saved (138 records). [2025-10-22T23:34:28.930956] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-10-22T23:34:28.933014] [INFO ] [MAIN ] Derivative Progress: 1169/2052 symbols. MPV took 0.4s. Estimated remaining time: 5m 48s [2025-10-22T23:34:28.933114] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:28.984398] [DEBUG] [LOCAL ] MPW: Loaded 53485 existing records from primary storage. [2025-10-22T23:34:28.984560] [INFO ] [MAIN ] MPW: Loaded 53485 primary data records. [2025-10-22T23:34:29.293413] [DEBUG] [MAIN ] MPW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:29.318718] [INFO ] [MAIN ] MPW: Generated 138 derivative records from 53485 primary records. [2025-10-22T23:34:29.318845] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-10-22T23:34:29.330145] [DEBUG] [LOCAL ] MPW: Derivative data saved (138 records). [2025-10-22T23:34:29.330225] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-10-22T23:34:29.333508] [INFO ] [MAIN ] Derivative Progress: 1170/2052 symbols. MPW took 0.4s. Estimated remaining time: 5m 47s [2025-10-22T23:34:29.333617] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:29.342056] [DEBUG] [LOCAL ] MPX: Loaded 3955 existing records from primary storage. [2025-10-22T23:34:29.342173] [INFO ] [MAIN ] MPX: Loaded 3955 primary data records. [2025-10-22T23:34:29.694418] [DEBUG] [MAIN ] MPX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:29.719927] [INFO ] [MAIN ] MPX: Generated 138 derivative records from 3955 primary records. [2025-10-22T23:34:29.720080] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-10-22T23:34:29.730728] [DEBUG] [LOCAL ] MPX: Derivative data saved (138 records). [2025-10-22T23:34:29.730814] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-10-22T23:34:29.732891] [INFO ] [MAIN ] Derivative Progress: 1171/2052 symbols. MPX took 0.4s. Estimated remaining time: 5m 47s [2025-10-22T23:34:29.732997] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:29.743597] [DEBUG] [LOCAL ] MQT: Loaded 7975 existing records from primary storage. [2025-10-22T23:34:29.743768] [INFO ] [MAIN ] MQT: Loaded 7975 primary data records. [2025-10-22T23:34:30.043021] [DEBUG] [MAIN ] MQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:30.068160] [INFO ] [MAIN ] MQT: Generated 138 derivative records from 7975 primary records. [2025-10-22T23:34:30.068293] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-10-22T23:34:30.078779] [DEBUG] [LOCAL ] MQT: Derivative data saved (138 records). [2025-10-22T23:34:30.078859] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-10-22T23:34:30.081041] [INFO ] [MAIN ] Derivative Progress: 1172/2052 symbols. MQT took 0.3s. Estimated remaining time: 5m 47s [2025-10-22T23:34:30.081145] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:30.097614] [DEBUG] [LOCAL ] MQY: Loaded 16545 existing records from primary storage. [2025-10-22T23:34:30.097767] [INFO ] [MAIN ] MQY: Loaded 16545 primary data records. [2025-10-22T23:34:30.397806] [DEBUG] [MAIN ] MQY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:30.422951] [INFO ] [MAIN ] MQY: Generated 138 derivative records from 16545 primary records. [2025-10-22T23:34:30.423059] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-10-22T23:34:30.434369] [DEBUG] [LOCAL ] MQY: Derivative data saved (138 records). [2025-10-22T23:34:30.434448] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-10-22T23:34:30.437128] [INFO ] [MAIN ] Derivative Progress: 1173/2052 symbols. MQY took 0.4s. Estimated remaining time: 5m 46s [2025-10-22T23:34:30.437229] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:30.476141] [DEBUG] [LOCAL ] MRC: Loaded 37105 existing records from primary storage. [2025-10-22T23:34:30.476298] [INFO ] [MAIN ] MRC: Loaded 37105 primary data records. [2025-10-22T23:34:30.781284] [DEBUG] [MAIN ] MRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:30.806179] [INFO ] [MAIN ] MRC: Generated 138 derivative records from 37105 primary records. [2025-10-22T23:34:30.806312] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-10-22T23:34:30.817992] [DEBUG] [LOCAL ] MRC: Derivative data saved (138 records). [2025-10-22T23:34:30.818073] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-10-22T23:34:30.820902] [INFO ] [MAIN ] Derivative Progress: 1174/2052 symbols. MRC took 0.4s. Estimated remaining time: 5m 46s [2025-10-22T23:34:30.820999] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:30.872286] [DEBUG] [LOCAL ] MRK: Loaded 53790 existing records from primary storage. [2025-10-22T23:34:30.872445] [INFO ] [MAIN ] MRK: Loaded 53790 primary data records. [2025-10-22T23:34:31.176350] [DEBUG] [MAIN ] MRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:31.202012] [INFO ] [MAIN ] MRK: Generated 138 derivative records from 53790 primary records. [2025-10-22T23:34:31.202210] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-10-22T23:34:31.213963] [DEBUG] [LOCAL ] MRK: Derivative data saved (138 records). [2025-10-22T23:34:31.214042] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-10-22T23:34:31.217103] [INFO ] [MAIN ] Derivative Progress: 1175/2052 symbols. MRK took 0.4s. Estimated remaining time: 5m 45s [2025-10-22T23:34:31.217195] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:31.270713] [DEBUG] [LOCAL ] MS: Loaded 53688 existing records from primary storage. [2025-10-22T23:34:31.270876] [INFO ] [MAIN ] MS: Loaded 53688 primary data records. [2025-10-22T23:34:31.608023] [DEBUG] [MAIN ] MS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:31.633204] [INFO ] [MAIN ] MS: Generated 138 derivative records from 53688 primary records. [2025-10-22T23:34:31.633343] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-10-22T23:34:31.645178] [DEBUG] [LOCAL ] MS: Derivative data saved (138 records). [2025-10-22T23:34:31.645257] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-10-22T23:34:31.648376] [INFO ] [MAIN ] Derivative Progress: 1176/2052 symbols. MS took 0.4s. Estimated remaining time: 5m 45s [2025-10-22T23:34:31.648478] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:31.669530] [DEBUG] [LOCAL ] MSA: Loaded 18830 existing records from primary storage. [2025-10-22T23:34:31.669696] [INFO ] [MAIN ] MSA: Loaded 18830 primary data records. [2025-10-22T23:34:31.974472] [DEBUG] [MAIN ] MSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:31.999427] [INFO ] [MAIN ] MSA: Generated 138 derivative records from 18830 primary records. [2025-10-22T23:34:31.999543] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-10-22T23:34:32.011078] [DEBUG] [LOCAL ] MSA: Derivative data saved (138 records). [2025-10-22T23:34:32.011156] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-10-22T23:34:32.013939] [INFO ] [MAIN ] Derivative Progress: 1177/2052 symbols. MSA took 0.4s. Estimated remaining time: 5m 45s [2025-10-22T23:34:32.014043] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:32.025622] [DEBUG] [LOCAL ] MSB: Loaded 7968 existing records from primary storage. [2025-10-22T23:34:32.025769] [INFO ] [MAIN ] MSB: Loaded 7968 primary data records. [2025-10-22T23:34:32.334947] [DEBUG] [MAIN ] MSB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:32.360539] [INFO ] [MAIN ] MSB: Generated 138 derivative records from 7968 primary records. [2025-10-22T23:34:32.360749] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-10-22T23:34:32.371942] [DEBUG] [LOCAL ] MSB: Derivative data saved (138 records). [2025-10-22T23:34:32.372046] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-10-22T23:34:32.374199] [INFO ] [MAIN ] Derivative Progress: 1178/2052 symbols. MSB took 0.4s. Estimated remaining time: 5m 44s [2025-10-22T23:34:32.374301] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:32.410616] [DEBUG] [LOCAL ] MSCI: Loaded 34183 existing records from primary storage. [2025-10-22T23:34:32.410803] [INFO ] [MAIN ] MSCI: Loaded 34183 primary data records. [2025-10-22T23:34:32.723586] [DEBUG] [MAIN ] MSCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:32.748320] [INFO ] [MAIN ] MSCI: Generated 138 derivative records from 34183 primary records. [2025-10-22T23:34:32.748446] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-10-22T23:34:32.759928] [DEBUG] [LOCAL ] MSCI: Derivative data saved (138 records). [2025-10-22T23:34:32.760007] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-10-22T23:34:32.763155] [INFO ] [MAIN ] Derivative Progress: 1179/2052 symbols. MSCI took 0.4s. Estimated remaining time: 5m 44s [2025-10-22T23:34:32.763258] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:32.781715] [DEBUG] [LOCAL ] MSD: Loaded 16543 existing records from primary storage. [2025-10-22T23:34:32.781860] [INFO ] [MAIN ] MSD: Loaded 16543 primary data records. [2025-10-22T23:34:33.089230] [DEBUG] [MAIN ] MSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:33.114687] [INFO ] [MAIN ] MSD: Generated 138 derivative records from 16543 primary records. [2025-10-22T23:34:33.114864] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-10-22T23:34:33.125740] [DEBUG] [LOCAL ] MSD: Derivative data saved (138 records). [2025-10-22T23:34:33.125836] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-10-22T23:34:33.128700] [INFO ] [MAIN ] Derivative Progress: 1180/2052 symbols. MSD took 0.4s. Estimated remaining time: 5m 43s [2025-10-22T23:34:33.128834] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:33.166618] [DEBUG] [LOCAL ] MSDL: Loaded 38577 existing records from primary storage. [2025-10-22T23:34:33.166820] [INFO ] [MAIN ] MSDL: Loaded 38577 primary data records. [2025-10-22T23:34:33.474358] [DEBUG] [MAIN ] MSDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:33.499379] [INFO ] [MAIN ] MSDL: Generated 138 derivative records from 38577 primary records. [2025-10-22T23:34:33.499508] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-10-22T23:34:33.511087] [DEBUG] [LOCAL ] MSDL: Derivative data saved (138 records). [2025-10-22T23:34:33.511167] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-10-22T23:34:33.514085] [INFO ] [MAIN ] Derivative Progress: 1181/2052 symbols. MSDL took 0.4s. Estimated remaining time: 5m 43s [2025-10-22T23:34:33.514185] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:33.541315] [DEBUG] [LOCAL ] MSGE: Loaded 27002 existing records from primary storage. [2025-10-22T23:34:33.541468] [INFO ] [MAIN ] MSGE: Loaded 27002 primary data records. [2025-10-22T23:34:33.875758] [DEBUG] [MAIN ] MSGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:33.901382] [INFO ] [MAIN ] MSGE: Generated 138 derivative records from 27002 primary records. [2025-10-22T23:34:33.901533] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-10-22T23:34:33.912904] [DEBUG] [LOCAL ] MSGE: Derivative data saved (138 records). [2025-10-22T23:34:33.912983] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-10-22T23:34:33.915987] [INFO ] [MAIN ] Derivative Progress: 1182/2052 symbols. MSGE took 0.4s. Estimated remaining time: 5m 43s [2025-10-22T23:34:33.916085] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:33.935506] [DEBUG] [LOCAL ] MSGS: Loaded 17199 existing records from primary storage. [2025-10-22T23:34:33.935680] [INFO ] [MAIN ] MSGS: Loaded 17199 primary data records. [2025-10-22T23:34:34.239244] [DEBUG] [MAIN ] MSGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:34.264243] [INFO ] [MAIN ] MSGS: Generated 138 derivative records from 17199 primary records. [2025-10-22T23:34:34.264372] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-10-22T23:34:34.275979] [DEBUG] [LOCAL ] MSGS: Derivative data saved (138 records). [2025-10-22T23:34:34.276091] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-10-22T23:34:34.278906] [INFO ] [MAIN ] Derivative Progress: 1183/2052 symbols. MSGS took 0.4s. Estimated remaining time: 5m 42s [2025-10-22T23:34:34.279002] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:34.316366] [DEBUG] [LOCAL ] MSI: Loaded 39574 existing records from primary storage. [2025-10-22T23:34:34.316527] [INFO ] [MAIN ] MSI: Loaded 39574 primary data records. [2025-10-22T23:34:34.623389] [DEBUG] [MAIN ] MSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:34.648785] [INFO ] [MAIN ] MSI: Generated 138 derivative records from 39574 primary records. [2025-10-22T23:34:34.648970] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-10-22T23:34:34.660746] [DEBUG] [LOCAL ] MSI: Derivative data saved (138 records). [2025-10-22T23:34:34.660829] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-10-22T23:34:34.663783] [INFO ] [MAIN ] Derivative Progress: 1184/2052 symbols. MSI took 0.4s. Estimated remaining time: 5m 42s [2025-10-22T23:34:34.663888] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:34.698295] [DEBUG] [LOCAL ] MSM: Loaded 35407 existing records from primary storage. [2025-10-22T23:34:34.698465] [INFO ] [MAIN ] MSM: Loaded 35407 primary data records. [2025-10-22T23:34:35.018111] [DEBUG] [MAIN ] MSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:35.045196] [INFO ] [MAIN ] MSM: Generated 138 derivative records from 35407 primary records. [2025-10-22T23:34:35.045401] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-10-22T23:34:35.057703] [DEBUG] [LOCAL ] MSM: Derivative data saved (138 records). [2025-10-22T23:34:35.057864] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-10-22T23:34:35.060935] [INFO ] [MAIN ] Derivative Progress: 1185/2052 symbols. MSM took 0.4s. Estimated remaining time: 5m 41s [2025-10-22T23:34:35.061065] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:35.109785] [DEBUG] [LOCAL ] MT: Loaded 50419 existing records from primary storage. [2025-10-22T23:34:35.109956] [INFO ] [MAIN ] MT: Loaded 50419 primary data records. [2025-10-22T23:34:35.421304] [DEBUG] [MAIN ] MT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:35.446502] [INFO ] [MAIN ] MT: Generated 138 derivative records from 50419 primary records. [2025-10-22T23:34:35.446682] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-10-22T23:34:35.458277] [DEBUG] [LOCAL ] MT: Derivative data saved (138 records). [2025-10-22T23:34:35.458366] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-10-22T23:34:35.461679] [INFO ] [MAIN ] Derivative Progress: 1186/2052 symbols. MT took 0.4s. Estimated remaining time: 5m 41s [2025-10-22T23:34:35.461799] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:35.507881] [DEBUG] [LOCAL ] MTB: Loaded 46640 existing records from primary storage. [2025-10-22T23:34:35.508048] [INFO ] [MAIN ] MTB: Loaded 46640 primary data records. [2025-10-22T23:34:35.843764] [DEBUG] [MAIN ] MTB: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:34:35.869354] [INFO ] [MAIN ] MTB: Generated 138 derivative records from 46640 primary records. [2025-10-22T23:34:35.869495] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-10-22T23:34:35.881324] [DEBUG] [LOCAL ] MTB: Derivative data saved (138 records). [2025-10-22T23:34:35.881415] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-10-22T23:34:35.884359] [INFO ] [MAIN ] Derivative Progress: 1187/2052 symbols. MTB took 0.4s. Estimated remaining time: 5m 41s [2025-10-22T23:34:35.884473] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:35.905534] [DEBUG] [LOCAL ] MTD: Loaded 15156 existing records from primary storage. [2025-10-22T23:34:35.905737] [INFO ] [MAIN ] MTD: Loaded 15156 primary data records. [2025-10-22T23:34:36.218522] [DEBUG] [MAIN ] MTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:36.244877] [INFO ] [MAIN ] MTD: Generated 138 derivative records from 15156 primary records. [2025-10-22T23:34:36.245061] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-10-22T23:34:36.256948] [DEBUG] [LOCAL ] MTD: Derivative data saved (138 records). [2025-10-22T23:34:36.257082] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-10-22T23:34:36.259936] [INFO ] [MAIN ] Derivative Progress: 1188/2052 symbols. MTD took 0.4s. Estimated remaining time: 5m 40s [2025-10-22T23:34:36.260034] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:36.310633] [DEBUG] [LOCAL ] MTDR: Loaded 51762 existing records from primary storage. [2025-10-22T23:34:36.310842] [INFO ] [MAIN ] MTDR: Loaded 51762 primary data records. [2025-10-22T23:34:36.628997] [DEBUG] [MAIN ] MTDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:36.655064] [INFO ] [MAIN ] MTDR: Generated 138 derivative records from 51762 primary records. [2025-10-22T23:34:36.655257] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-10-22T23:34:36.667181] [DEBUG] [LOCAL ] MTDR: Derivative data saved (138 records). [2025-10-22T23:34:36.667357] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-10-22T23:34:36.670758] [INFO ] [MAIN ] Derivative Progress: 1189/2052 symbols. MTDR took 0.4s. Estimated remaining time: 5m 40s [2025-10-22T23:34:36.670911] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:36.720461] [DEBUG] [LOCAL ] MTG: Loaded 51061 existing records from primary storage. [2025-10-22T23:34:36.720638] [INFO ] [MAIN ] MTG: Loaded 51061 primary data records. [2025-10-22T23:34:37.032362] [DEBUG] [MAIN ] MTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:37.057761] [INFO ] [MAIN ] MTG: Generated 138 derivative records from 51061 primary records. [2025-10-22T23:34:37.057943] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-10-22T23:34:37.069851] [DEBUG] [LOCAL ] MTG: Derivative data saved (138 records). [2025-10-22T23:34:37.069981] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-10-22T23:34:37.073335] [INFO ] [MAIN ] Derivative Progress: 1190/2052 symbols. MTG took 0.4s. Estimated remaining time: 5m 39s [2025-10-22T23:34:37.073491] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:37.114872] [DEBUG] [LOCAL ] MTH: Loaded 43777 existing records from primary storage. [2025-10-22T23:34:37.115045] [INFO ] [MAIN ] MTH: Loaded 43777 primary data records. [2025-10-22T23:34:37.433468] [DEBUG] [MAIN ] MTH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:37.460030] [INFO ] [MAIN ] MTH: Generated 138 derivative records from 43777 primary records. [2025-10-22T23:34:37.460240] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-10-22T23:34:37.472124] [DEBUG] [LOCAL ] MTH: Derivative data saved (138 records). [2025-10-22T23:34:37.472288] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-10-22T23:34:37.475239] [INFO ] [MAIN ] Derivative Progress: 1191/2052 symbols. MTH took 0.4s. Estimated remaining time: 5m 39s [2025-10-22T23:34:37.475376] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:37.515527] [DEBUG] [LOCAL ] MTN: Loaded 39380 existing records from primary storage. [2025-10-22T23:34:37.515735] [INFO ] [MAIN ] MTN: Loaded 39380 primary data records. [2025-10-22T23:34:37.861315] [DEBUG] [MAIN ] MTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:37.887057] [INFO ] [MAIN ] MTN: Generated 138 derivative records from 39380 primary records. [2025-10-22T23:34:37.887241] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-10-22T23:34:37.899328] [DEBUG] [LOCAL ] MTN: Derivative data saved (138 records). [2025-10-22T23:34:37.899473] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-10-22T23:34:37.902466] [INFO ] [MAIN ] Derivative Progress: 1192/2052 symbols. MTN took 0.4s. Estimated remaining time: 5m 39s [2025-10-22T23:34:37.902598] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:37.923211] [DEBUG] [LOCAL ] MTRN: Loaded 18137 existing records from primary storage. [2025-10-22T23:34:37.923373] [INFO ] [MAIN ] MTRN: Loaded 18137 primary data records. [2025-10-22T23:34:38.249590] [DEBUG] [MAIN ] MTRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:38.275581] [INFO ] [MAIN ] MTRN: Generated 138 derivative records from 18137 primary records. [2025-10-22T23:34:38.275799] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-10-22T23:34:38.287461] [DEBUG] [LOCAL ] MTRN: Derivative data saved (138 records). [2025-10-22T23:34:38.287547] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-10-22T23:34:38.290329] [INFO ] [MAIN ] Derivative Progress: 1193/2052 symbols. MTRN took 0.4s. Estimated remaining time: 5m 38s [2025-10-22T23:34:38.290440] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:38.321063] [DEBUG] [LOCAL ] MTUS: Loaded 27451 existing records from primary storage. [2025-10-22T23:34:38.321242] [INFO ] [MAIN ] MTUS: Loaded 27451 primary data records. [2025-10-22T23:34:38.654539] [DEBUG] [MAIN ] MTUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:38.681600] [INFO ] [MAIN ] MTUS: Generated 138 derivative records from 27451 primary records. [2025-10-22T23:34:38.681788] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-10-22T23:34:38.693849] [DEBUG] [LOCAL ] MTUS: Derivative data saved (138 records). [2025-10-22T23:34:38.693942] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-10-22T23:34:38.696951] [INFO ] [MAIN ] Derivative Progress: 1194/2052 symbols. MTUS took 0.4s. Estimated remaining time: 5m 38s [2025-10-22T23:34:38.697067] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:38.724824] [DEBUG] [LOCAL ] MTW: Loaded 26422 existing records from primary storage. [2025-10-22T23:34:38.724991] [INFO ] [MAIN ] MTW: Loaded 26422 primary data records. [2025-10-22T23:34:39.100696] [DEBUG] [MAIN ] MTW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:39.126832] [INFO ] [MAIN ] MTW: Generated 138 derivative records from 26422 primary records. [2025-10-22T23:34:39.127002] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-10-22T23:34:39.138821] [DEBUG] [LOCAL ] MTW: Derivative data saved (138 records). [2025-10-22T23:34:39.138904] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-10-22T23:34:39.142026] [INFO ] [MAIN ] Derivative Progress: 1195/2052 symbols. MTW took 0.4s. Estimated remaining time: 5m 38s [2025-10-22T23:34:39.142193] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:39.166694] [DEBUG] [LOCAL ] MTX: Loaded 22589 existing records from primary storage. [2025-10-22T23:34:39.166892] [INFO ] [MAIN ] MTX: Loaded 22589 primary data records. [2025-10-22T23:34:39.496190] [DEBUG] [MAIN ] MTX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:39.522324] [INFO ] [MAIN ] MTX: Generated 138 derivative records from 22589 primary records. [2025-10-22T23:34:39.522470] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-10-22T23:34:39.534041] [DEBUG] [LOCAL ] MTX: Derivative data saved (138 records). [2025-10-22T23:34:39.534124] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-10-22T23:34:39.537152] [INFO ] [MAIN ] Derivative Progress: 1196/2052 symbols. MTX took 0.4s. Estimated remaining time: 5m 37s [2025-10-22T23:34:39.537271] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:39.578711] [DEBUG] [LOCAL ] MTZ: Loaded 42746 existing records from primary storage. [2025-10-22T23:34:39.578878] [INFO ] [MAIN ] MTZ: Loaded 42746 primary data records. [2025-10-22T23:34:39.896690] [DEBUG] [MAIN ] MTZ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:34:39.922052] [INFO ] [MAIN ] MTZ: Generated 138 derivative records from 42746 primary records. [2025-10-22T23:34:39.922163] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-10-22T23:34:39.933805] [DEBUG] [LOCAL ] MTZ: Derivative data saved (138 records). [2025-10-22T23:34:39.933887] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-10-22T23:34:39.937006] [INFO ] [MAIN ] Derivative Progress: 1197/2052 symbols. MTZ took 0.4s. Estimated remaining time: 5m 37s [2025-10-22T23:34:39.937127] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:39.951868] [DEBUG] [LOCAL ] MUA: Loaded 11533 existing records from primary storage. [2025-10-22T23:34:39.952002] [INFO ] [MAIN ] MUA: Loaded 11533 primary data records. [2025-10-22T23:34:40.288605] [DEBUG] [MAIN ] MUA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:40.313979] [INFO ] [MAIN ] MUA: Generated 138 derivative records from 11533 primary records. [2025-10-22T23:34:40.314094] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-10-22T23:34:40.325324] [DEBUG] [LOCAL ] MUA: Derivative data saved (138 records). [2025-10-22T23:34:40.325406] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-10-22T23:34:40.328310] [INFO ] [MAIN ] Derivative Progress: 1198/2052 symbols. MUA took 0.4s. Estimated remaining time: 5m 36s [2025-10-22T23:34:40.328427] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:40.351444] [DEBUG] [LOCAL ] MUC: Loaded 20640 existing records from primary storage. [2025-10-22T23:34:40.351593] [INFO ] [MAIN ] MUC: Loaded 20640 primary data records. [2025-10-22T23:34:40.671829] [DEBUG] [MAIN ] MUC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:40.697413] [INFO ] [MAIN ] MUC: Generated 138 derivative records from 20640 primary records. [2025-10-22T23:34:40.697539] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-10-22T23:34:40.708905] [DEBUG] [LOCAL ] MUC: Derivative data saved (138 records). [2025-10-22T23:34:40.708985] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-10-22T23:34:40.711960] [INFO ] [MAIN ] Derivative Progress: 1199/2052 symbols. MUC took 0.4s. Estimated remaining time: 5m 36s [2025-10-22T23:34:40.712055] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:40.726754] [DEBUG] [LOCAL ] MUE: Loaded 12225 existing records from primary storage. [2025-10-22T23:34:40.726889] [INFO ] [MAIN ] MUE: Loaded 12225 primary data records. [2025-10-22T23:34:41.039388] [DEBUG] [MAIN ] MUE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:41.065711] [INFO ] [MAIN ] MUE: Generated 138 derivative records from 12225 primary records. [2025-10-22T23:34:41.065824] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-10-22T23:34:41.076793] [DEBUG] [LOCAL ] MUE: Derivative data saved (138 records). [2025-10-22T23:34:41.076874] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-10-22T23:34:41.079764] [INFO ] [MAIN ] Derivative Progress: 1200/2052 symbols. MUE took 0.4s. Estimated remaining time: 5m 36s [2025-10-22T23:34:41.079862] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:41.133728] [DEBUG] [LOCAL ] MUFG: Loaded 52428 existing records from primary storage. [2025-10-22T23:34:41.133908] [INFO ] [MAIN ] MUFG: Loaded 52428 primary data records. [2025-10-22T23:34:41.450417] [DEBUG] [MAIN ] MUFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:41.476890] [INFO ] [MAIN ] MUFG: Generated 138 derivative records from 52428 primary records. [2025-10-22T23:34:41.477066] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-10-22T23:34:41.488951] [DEBUG] [LOCAL ] MUFG: Derivative data saved (138 records). [2025-10-22T23:34:41.489038] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-10-22T23:34:41.492559] [INFO ] [MAIN ] Derivative Progress: 1201/2052 symbols. MUFG took 0.4s. Estimated remaining time: 5m 35s [2025-10-22T23:34:41.492687] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:41.510289] [DEBUG] [LOCAL ] MUJ: Loaded 13888 existing records from primary storage. [2025-10-22T23:34:41.510433] [INFO ] [MAIN ] MUJ: Loaded 13888 primary data records. [2025-10-22T23:34:41.845534] [DEBUG] [MAIN ] MUJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:41.870478] [INFO ] [MAIN ] MUJ: Generated 138 derivative records from 13888 primary records. [2025-10-22T23:34:41.870623] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-10-22T23:34:41.882002] [DEBUG] [LOCAL ] MUJ: Derivative data saved (138 records). [2025-10-22T23:34:41.882087] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-10-22T23:34:41.884935] [INFO ] [MAIN ] Derivative Progress: 1202/2052 symbols. MUJ took 0.4s. Estimated remaining time: 5m 35s [2025-10-22T23:34:41.885035] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:41.935156] [DEBUG] [LOCAL ] MUR: Loaded 52861 existing records from primary storage. [2025-10-22T23:34:41.935314] [INFO ] [MAIN ] MUR: Loaded 52861 primary data records. [2025-10-22T23:34:42.276360] [DEBUG] [MAIN ] MUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:42.306474] [INFO ] [MAIN ] MUR: Generated 138 derivative records from 52861 primary records. [2025-10-22T23:34:42.306682] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-10-22T23:34:42.319241] [DEBUG] [LOCAL ] MUR: Derivative data saved (138 records). [2025-10-22T23:34:42.319328] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-10-22T23:34:42.322818] [INFO ] [MAIN ] Derivative Progress: 1203/2052 symbols. MUR took 0.4s. Estimated remaining time: 5m 34s [2025-10-22T23:34:42.322938] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:42.349205] [DEBUG] [LOCAL ] MUSA: Loaded 24600 existing records from primary storage. [2025-10-22T23:34:42.349378] [INFO ] [MAIN ] MUSA: Loaded 24600 primary data records. [2025-10-22T23:34:42.681840] [DEBUG] [MAIN ] MUSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:42.707240] [INFO ] [MAIN ] MUSA: Generated 138 derivative records from 24600 primary records. [2025-10-22T23:34:42.707438] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-10-22T23:34:42.719044] [DEBUG] [LOCAL ] MUSA: Derivative data saved (138 records). [2025-10-22T23:34:42.719130] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-10-22T23:34:42.722072] [INFO ] [MAIN ] Derivative Progress: 1204/2052 symbols. MUSA took 0.4s. Estimated remaining time: 5m 34s [2025-10-22T23:34:42.722208] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:42.765837] [DEBUG] [LOCAL ] MUX: Loaded 43833 existing records from primary storage. [2025-10-22T23:34:42.766002] [INFO ] [MAIN ] MUX: Loaded 43833 primary data records. [2025-10-22T23:34:43.071608] [DEBUG] [MAIN ] MUX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:43.096974] [INFO ] [MAIN ] MUX: Generated 138 derivative records from 43833 primary records. [2025-10-22T23:34:43.097113] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-10-22T23:34:43.108704] [DEBUG] [LOCAL ] MUX: Derivative data saved (138 records). [2025-10-22T23:34:43.108808] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-10-22T23:34:43.111609] [INFO ] [MAIN ] Derivative Progress: 1205/2052 symbols. MUX took 0.4s. Estimated remaining time: 5m 34s [2025-10-22T23:34:43.111745] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:43.128019] [DEBUG] [LOCAL ] MVF: Loaded 12686 existing records from primary storage. [2025-10-22T23:34:43.128174] [INFO ] [MAIN ] MVF: Loaded 12686 primary data records. [2025-10-22T23:34:43.437563] [DEBUG] [MAIN ] MVF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:43.463567] [INFO ] [MAIN ] MVF: Generated 138 derivative records from 12686 primary records. [2025-10-22T23:34:43.463758] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-10-22T23:34:43.474679] [DEBUG] [LOCAL ] MVF: Derivative data saved (138 records). [2025-10-22T23:34:43.474774] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-10-22T23:34:43.477503] [INFO ] [MAIN ] Derivative Progress: 1206/2052 symbols. MVF took 0.4s. Estimated remaining time: 5m 33s [2025-10-22T23:34:43.477600] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:43.490572] [DEBUG] [LOCAL ] MVO: Loaded 8969 existing records from primary storage. [2025-10-22T23:34:43.490739] [INFO ] [MAIN ] MVO: Loaded 8969 primary data records. [2025-10-22T23:34:43.821198] [DEBUG] [MAIN ] MVO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:34:43.860281] [INFO ] [MAIN ] MVO: Generated 138 derivative records from 8969 primary records. [2025-10-22T23:34:43.860500] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-10-22T23:34:43.874438] [DEBUG] [LOCAL ] MVO: Derivative data saved (138 records). [2025-10-22T23:34:43.874591] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-10-22T23:34:43.877191] [INFO ] [MAIN ] Derivative Progress: 1207/2052 symbols. MVO took 0.4s. Estimated remaining time: 5m 33s [2025-10-22T23:34:43.877358] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:43.892206] [DEBUG] [LOCAL ] MVT: Loaded 9790 existing records from primary storage. [2025-10-22T23:34:43.892373] [INFO ] [MAIN ] MVT: Loaded 9790 primary data records. [2025-10-22T23:34:44.241528] [DEBUG] [MAIN ] MVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:44.267691] [INFO ] [MAIN ] MVT: Generated 138 derivative records from 9790 primary records. [2025-10-22T23:34:44.267888] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-10-22T23:34:44.279399] [DEBUG] [LOCAL ] MVT: Derivative data saved (138 records). [2025-10-22T23:34:44.279526] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-10-22T23:34:44.281766] [INFO ] [MAIN ] Derivative Progress: 1208/2052 symbols. MVT took 0.4s. Estimated remaining time: 5m 32s [2025-10-22T23:34:44.281884] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:44.324625] [DEBUG] [LOCAL ] MWA: Loaded 45767 existing records from primary storage. [2025-10-22T23:34:44.324817] [INFO ] [MAIN ] MWA: Loaded 45767 primary data records. [2025-10-22T23:34:44.645623] [DEBUG] [MAIN ] MWA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:44.672521] [INFO ] [MAIN ] MWA: Generated 138 derivative records from 45767 primary records. [2025-10-22T23:34:44.672741] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-10-22T23:34:44.684465] [DEBUG] [LOCAL ] MWA: Derivative data saved (138 records). [2025-10-22T23:34:44.684571] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-10-22T23:34:44.687459] [INFO ] [MAIN ] Derivative Progress: 1209/2052 symbols. MWA took 0.4s. Estimated remaining time: 5m 32s [2025-10-22T23:34:44.687612] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:44.715047] [DEBUG] [LOCAL ] MX: Loaded 22229 existing records from primary storage. [2025-10-22T23:34:44.715215] [INFO ] [MAIN ] MX: Loaded 22229 primary data records. [2025-10-22T23:34:45.036100] [DEBUG] [MAIN ] MX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:45.062826] [INFO ] [MAIN ] MX: Generated 138 derivative records from 22229 primary records. [2025-10-22T23:34:45.062999] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-10-22T23:34:45.075150] [DEBUG] [LOCAL ] MX: Derivative data saved (138 records). [2025-10-22T23:34:45.075300] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-10-22T23:34:45.078222] [INFO ] [MAIN ] Derivative Progress: 1210/2052 symbols. MX took 0.4s. Estimated remaining time: 5m 32s [2025-10-22T23:34:45.078347] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:45.088467] [DEBUG] [LOCAL ] MXF: Loaded 5491 existing records from primary storage. [2025-10-22T23:34:45.088637] [INFO ] [MAIN ] MXF: Loaded 5491 primary data records. [2025-10-22T23:34:45.414015] [DEBUG] [MAIN ] MXF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:45.440720] [INFO ] [MAIN ] MXF: Generated 138 derivative records from 5491 primary records. [2025-10-22T23:34:45.440890] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-10-22T23:34:45.451932] [DEBUG] [LOCAL ] MXF: Derivative data saved (138 records). [2025-10-22T23:34:45.452023] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-10-22T23:34:45.454340] [INFO ] [MAIN ] Derivative Progress: 1211/2052 symbols. MXF took 0.4s. Estimated remaining time: 5m 31s [2025-10-22T23:34:45.454449] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:45.469967] [DEBUG] [LOCAL ] MYD: Loaded 13143 existing records from primary storage. [2025-10-22T23:34:45.470119] [INFO ] [MAIN ] MYD: Loaded 13143 primary data records. [2025-10-22T23:34:45.795465] [DEBUG] [MAIN ] MYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:45.821801] [INFO ] [MAIN ] MYD: Generated 138 derivative records from 13143 primary records. [2025-10-22T23:34:45.821948] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-10-22T23:34:45.833154] [DEBUG] [LOCAL ] MYD: Derivative data saved (138 records). [2025-10-22T23:34:45.833237] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-10-22T23:34:45.836004] [INFO ] [MAIN ] Derivative Progress: 1212/2052 symbols. MYD took 0.4s. Estimated remaining time: 5m 31s [2025-10-22T23:34:45.836097] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:45.861139] [DEBUG] [LOCAL ] MYE: Loaded 24003 existing records from primary storage. [2025-10-22T23:34:45.861294] [INFO ] [MAIN ] MYE: Loaded 24003 primary data records. [2025-10-22T23:34:46.219290] [DEBUG] [MAIN ] MYE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:46.245433] [INFO ] [MAIN ] MYE: Generated 138 derivative records from 24003 primary records. [2025-10-22T23:34:46.245611] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-10-22T23:34:46.257951] [DEBUG] [LOCAL ] MYE: Derivative data saved (138 records). [2025-10-22T23:34:46.258090] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-10-22T23:34:46.261053] [INFO ] [MAIN ] Derivative Progress: 1213/2052 symbols. MYE took 0.4s. Estimated remaining time: 5m 30s [2025-10-22T23:34:46.261210] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:46.283480] [DEBUG] [LOCAL ] MYI: Loaded 19068 existing records from primary storage. [2025-10-22T23:34:46.283693] [INFO ] [MAIN ] MYI: Loaded 19068 primary data records. [2025-10-22T23:34:46.602985] [DEBUG] [MAIN ] MYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:46.627994] [INFO ] [MAIN ] MYI: Generated 138 derivative records from 19068 primary records. [2025-10-22T23:34:46.628162] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-10-22T23:34:46.639762] [DEBUG] [LOCAL ] MYI: Derivative data saved (138 records). [2025-10-22T23:34:46.639858] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-10-22T23:34:46.642877] [INFO ] [MAIN ] Derivative Progress: 1214/2052 symbols. MYI took 0.4s. Estimated remaining time: 5m 30s [2025-10-22T23:34:46.642987] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:46.656515] [DEBUG] [LOCAL ] MYN: Loaded 9951 existing records from primary storage. [2025-10-22T23:34:46.656696] [INFO ] [MAIN ] MYN: Loaded 9951 primary data records. [2025-10-22T23:34:46.964286] [DEBUG] [MAIN ] MYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:46.989718] [INFO ] [MAIN ] MYN: Generated 138 derivative records from 9951 primary records. [2025-10-22T23:34:46.989905] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-10-22T23:34:47.001393] [DEBUG] [LOCAL ] MYN: Derivative data saved (138 records). [2025-10-22T23:34:47.001520] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-10-22T23:34:47.003872] [INFO ] [MAIN ] Derivative Progress: 1215/2052 symbols. MYN took 0.4s. Estimated remaining time: 5m 30s [2025-10-22T23:34:47.003992] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:47.040394] [DEBUG] [LOCAL ] NABL: Loaded 38946 existing records from primary storage. [2025-10-22T23:34:47.040560] [INFO ] [MAIN ] NABL: Loaded 38946 primary data records. [2025-10-22T23:34:47.345611] [DEBUG] [MAIN ] NABL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:47.370678] [INFO ] [MAIN ] NABL: Generated 138 derivative records from 38946 primary records. [2025-10-22T23:34:47.370818] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-10-22T23:34:47.382030] [DEBUG] [LOCAL ] NABL: Derivative data saved (138 records). [2025-10-22T23:34:47.382109] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-10-22T23:34:47.385120] [INFO ] [MAIN ] Derivative Progress: 1216/2052 symbols. NABL took 0.4s. Estimated remaining time: 5m 29s [2025-10-22T23:34:47.385219] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:47.410539] [DEBUG] [LOCAL ] NAC: Loaded 24487 existing records from primary storage. [2025-10-22T23:34:47.410732] [INFO ] [MAIN ] NAC: Loaded 24487 primary data records. [2025-10-22T23:34:47.730371] [DEBUG] [MAIN ] NAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:47.755376] [INFO ] [MAIN ] NAC: Generated 138 derivative records from 24487 primary records. [2025-10-22T23:34:47.755564] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-10-22T23:34:47.767359] [DEBUG] [LOCAL ] NAC: Derivative data saved (138 records). [2025-10-22T23:34:47.767445] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-10-22T23:34:47.770391] [INFO ] [MAIN ] Derivative Progress: 1217/2052 symbols. NAC took 0.4s. Estimated remaining time: 5m 29s [2025-10-22T23:34:47.770485] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:47.808826] [DEBUG] [LOCAL ] NAD: Loaded 33581 existing records from primary storage. [2025-10-22T23:34:47.809009] [INFO ] [MAIN ] NAD: Loaded 33581 primary data records. [2025-10-22T23:34:48.137609] [DEBUG] [MAIN ] NAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:48.163495] [INFO ] [MAIN ] NAD: Generated 138 derivative records from 33581 primary records. [2025-10-22T23:34:48.163686] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-10-22T23:34:48.175459] [DEBUG] [LOCAL ] NAD: Derivative data saved (138 records). [2025-10-22T23:34:48.175559] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-10-22T23:34:48.178805] [INFO ] [MAIN ] Derivative Progress: 1218/2052 symbols. NAD took 0.4s. Estimated remaining time: 5m 28s [2025-10-22T23:34:48.178908] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:48.191622] [DEBUG] [LOCAL ] NAN: Loaded 8427 existing records from primary storage. [2025-10-22T23:34:48.191795] [INFO ] [MAIN ] NAN: Loaded 8427 primary data records. [2025-10-22T23:34:48.533553] [DEBUG] [MAIN ] NAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:48.560766] [INFO ] [MAIN ] NAN: Generated 138 derivative records from 8427 primary records. [2025-10-22T23:34:48.560937] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-10-22T23:34:48.572384] [DEBUG] [LOCAL ] NAN: Derivative data saved (138 records). [2025-10-22T23:34:48.572466] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-10-22T23:34:48.574925] [INFO ] [MAIN ] Derivative Progress: 1219/2052 symbols. NAN took 0.4s. Estimated remaining time: 5m 28s [2025-10-22T23:34:48.575023] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:48.621367] [DEBUG] [LOCAL ] NAT: Loaded 49207 existing records from primary storage. [2025-10-22T23:34:48.621531] [INFO ] [MAIN ] NAT: Loaded 49207 primary data records. [2025-10-22T23:34:48.936254] [DEBUG] [MAIN ] NAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:48.962634] [INFO ] [MAIN ] NAT: Generated 138 derivative records from 49207 primary records. [2025-10-22T23:34:48.962820] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-10-22T23:34:48.974427] [DEBUG] [LOCAL ] NAT: Derivative data saved (138 records). [2025-10-22T23:34:48.974510] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-10-22T23:34:48.977788] [INFO ] [MAIN ] Derivative Progress: 1220/2052 symbols. NAT took 0.4s. Estimated remaining time: 5m 28s [2025-10-22T23:34:48.977900] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:49.010299] [DEBUG] [LOCAL ] NATL: Loaded 32096 existing records from primary storage. [2025-10-22T23:34:49.010458] [INFO ] [MAIN ] NATL: Loaded 32096 primary data records. [2025-10-22T23:34:49.323370] [DEBUG] [MAIN ] NATL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:49.350382] [INFO ] [MAIN ] NATL: Generated 138 derivative records from 32096 primary records. [2025-10-22T23:34:49.350550] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-10-22T23:34:49.362666] [DEBUG] [LOCAL ] NATL: Derivative data saved (138 records). [2025-10-22T23:34:49.362788] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-10-22T23:34:49.365785] [INFO ] [MAIN ] Derivative Progress: 1221/2052 symbols. NATL took 0.4s. Estimated remaining time: 5m 27s [2025-10-22T23:34:49.365894] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:49.371265] [DEBUG] [LOCAL ] NAZ: Loaded 2670 existing records from primary storage. [2025-10-22T23:34:49.371355] [INFO ] [MAIN ] NAZ: Loaded 2670 primary data records. [2025-10-22T23:34:49.700016] [DEBUG] [MAIN ] NAZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:49.730533] [INFO ] [MAIN ] NAZ: Generated 138 derivative records from 2670 primary records. [2025-10-22T23:34:49.730803] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-10-22T23:34:49.744272] [DEBUG] [LOCAL ] NAZ: Derivative data saved (138 records). [2025-10-22T23:34:49.744407] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-10-22T23:34:49.746678] [INFO ] [MAIN ] Derivative Progress: 1222/2052 symbols. NAZ took 0.4s. Estimated remaining time: 5m 27s [2025-10-22T23:34:49.746798] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:49.761446] [DEBUG] [LOCAL ] NBB: Loaded 9022 existing records from primary storage. [2025-10-22T23:34:49.761599] [INFO ] [MAIN ] NBB: Loaded 9022 primary data records. [2025-10-22T23:34:50.081180] [DEBUG] [MAIN ] NBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:50.110742] [INFO ] [MAIN ] NBB: Generated 138 derivative records from 9022 primary records. [2025-10-22T23:34:50.110969] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-10-22T23:34:50.128556] [DEBUG] [LOCAL ] NBB: Derivative data saved (138 records). [2025-10-22T23:34:50.128765] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-10-22T23:34:50.131673] [INFO ] [MAIN ] Derivative Progress: 1223/2052 symbols. NBB took 0.4s. Estimated remaining time: 5m 26s [2025-10-22T23:34:50.131794] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:50.159539] [DEBUG] [LOCAL ] NBHC: Loaded 23669 existing records from primary storage. [2025-10-22T23:34:50.159722] [INFO ] [MAIN ] NBHC: Loaded 23669 primary data records. [2025-10-22T23:34:50.492868] [DEBUG] [MAIN ] NBHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:50.518202] [INFO ] [MAIN ] NBHC: Generated 138 derivative records from 23669 primary records. [2025-10-22T23:34:50.518349] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-10-22T23:34:50.529764] [DEBUG] [LOCAL ] NBHC: Derivative data saved (138 records). [2025-10-22T23:34:50.529858] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-10-22T23:34:50.532754] [INFO ] [MAIN ] Derivative Progress: 1224/2052 symbols. NBHC took 0.4s. Estimated remaining time: 5m 26s [2025-10-22T23:34:50.532848] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:50.565143] [DEBUG] [LOCAL ] NBR: Loaded 34369 existing records from primary storage. [2025-10-22T23:34:50.565298] [INFO ] [MAIN ] NBR: Loaded 34369 primary data records. [2025-10-22T23:34:50.874158] [DEBUG] [MAIN ] NBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:50.899785] [INFO ] [MAIN ] NBR: Generated 138 derivative records from 34369 primary records. [2025-10-22T23:34:50.899923] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-10-22T23:34:50.911457] [DEBUG] [LOCAL ] NBR: Derivative data saved (138 records). [2025-10-22T23:34:50.911543] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-10-22T23:34:50.914480] [INFO ] [MAIN ] Derivative Progress: 1225/2052 symbols. NBR took 0.4s. Estimated remaining time: 5m 26s [2025-10-22T23:34:50.914631] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:50.938719] [DEBUG] [LOCAL ] NBXG: Loaded 21680 existing records from primary storage. [2025-10-22T23:34:50.938875] [INFO ] [MAIN ] NBXG: Loaded 21680 primary data records. [2025-10-22T23:34:51.257217] [DEBUG] [MAIN ] NBXG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:51.282190] [INFO ] [MAIN ] NBXG: Generated 138 derivative records from 21680 primary records. [2025-10-22T23:34:51.282360] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-10-22T23:34:51.293916] [DEBUG] [LOCAL ] NBXG: Derivative data saved (138 records). [2025-10-22T23:34:51.293997] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-10-22T23:34:51.296878] [INFO ] [MAIN ] Derivative Progress: 1226/2052 symbols. NBXG took 0.4s. Estimated remaining time: 5m 25s [2025-10-22T23:34:51.296980] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:51.302077] [DEBUG] [LOCAL ] NC: Loaded 1998 existing records from primary storage. [2025-10-22T23:34:51.302168] [INFO ] [MAIN ] NC: Loaded 1998 primary data records. [2025-10-22T23:34:51.604919] [DEBUG] [MAIN ] NC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:51.630824] [INFO ] [MAIN ] NC: Generated 138 derivative records from 1998 primary records. [2025-10-22T23:34:51.630998] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-10-22T23:34:51.640486] [DEBUG] [LOCAL ] NC: Derivative data saved (138 records). [2025-10-22T23:34:51.640586] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-10-22T23:34:51.642796] [INFO ] [MAIN ] Derivative Progress: 1227/2052 symbols. NC took 0.3s. Estimated remaining time: 5m 25s [2025-10-22T23:34:51.642891] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:51.662696] [DEBUG] [LOCAL ] NCA: Loaded 9773 existing records from primary storage. [2025-10-22T23:34:51.662837] [INFO ] [MAIN ] NCA: Loaded 9773 primary data records. [2025-10-22T23:34:51.974831] [DEBUG] [MAIN ] NCA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:52.003638] [INFO ] [MAIN ] NCA: Generated 138 derivative records from 9773 primary records. [2025-10-22T23:34:52.003818] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-10-22T23:34:52.014981] [DEBUG] [LOCAL ] NCA: Derivative data saved (138 records). [2025-10-22T23:34:52.015064] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-10-22T23:34:52.017219] [INFO ] [MAIN ] Derivative Progress: 1228/2052 symbols. NCA took 0.4s. Estimated remaining time: 5m 24s [2025-10-22T23:34:52.017341] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:52.041289] [DEBUG] [LOCAL ] NCDL: Loaded 21597 existing records from primary storage. [2025-10-22T23:34:52.041444] [INFO ] [MAIN ] NCDL: Loaded 21597 primary data records. [2025-10-22T23:34:52.390062] [DEBUG] [MAIN ] NCDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:52.418581] [INFO ] [MAIN ] NCDL: Generated 138 derivative records from 21597 primary records. [2025-10-22T23:34:52.418797] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-10-22T23:34:52.430548] [DEBUG] [LOCAL ] NCDL: Derivative data saved (138 records). [2025-10-22T23:34:52.430673] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-10-22T23:34:52.433579] [INFO ] [MAIN ] Derivative Progress: 1229/2052 symbols. NCDL took 0.4s. Estimated remaining time: 5m 24s [2025-10-22T23:34:52.433706] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:52.489707] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-10-22T23:34:52.489872] [INFO ] [MAIN ] NCLH: Loaded 53753 primary data records. [2025-10-22T23:34:52.801061] [DEBUG] [MAIN ] NCLH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:52.826733] [INFO ] [MAIN ] NCLH: Generated 138 derivative records from 53753 primary records. [2025-10-22T23:34:52.826889] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-10-22T23:34:52.839209] [DEBUG] [LOCAL ] NCLH: Derivative data saved (138 records). [2025-10-22T23:34:52.839295] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-10-22T23:34:52.842539] [INFO ] [MAIN ] Derivative Progress: 1230/2052 symbols. NCLH took 0.4s. Estimated remaining time: 5m 24s [2025-10-22T23:34:52.842634] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:52.860140] [DEBUG] [LOCAL ] NCV: Loaded 13884 existing records from primary storage. [2025-10-22T23:34:52.860282] [INFO ] [MAIN ] NCV: Loaded 13884 primary data records. [2025-10-22T23:34:53.172751] [DEBUG] [MAIN ] NCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:53.197838] [INFO ] [MAIN ] NCV: Generated 138 derivative records from 13884 primary records. [2025-10-22T23:34:53.197987] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-10-22T23:34:53.209469] [DEBUG] [LOCAL ] NCV: Derivative data saved (138 records). [2025-10-22T23:34:53.209556] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-10-22T23:34:53.212304] [INFO ] [MAIN ] Derivative Progress: 1231/2052 symbols. NCV took 0.4s. Estimated remaining time: 5m 23s [2025-10-22T23:34:53.212400] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:53.228056] [DEBUG] [LOCAL ] NCZ: Loaded 12268 existing records from primary storage. [2025-10-22T23:34:53.228205] [INFO ] [MAIN ] NCZ: Loaded 12268 primary data records. [2025-10-22T23:34:53.536763] [DEBUG] [MAIN ] NCZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:53.562814] [INFO ] [MAIN ] NCZ: Generated 138 derivative records from 12268 primary records. [2025-10-22T23:34:53.562987] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-10-22T23:34:53.574662] [DEBUG] [LOCAL ] NCZ: Derivative data saved (138 records). [2025-10-22T23:34:53.574743] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-10-22T23:34:53.577442] [INFO ] [MAIN ] Derivative Progress: 1232/2052 symbols. NCZ took 0.4s. Estimated remaining time: 5m 23s [2025-10-22T23:34:53.577539] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:53.595442] [DEBUG] [LOCAL ] NDMO: Loaded 16956 existing records from primary storage. [2025-10-22T23:34:53.595612] [INFO ] [MAIN ] NDMO: Loaded 16956 primary data records. [2025-10-22T23:34:53.910096] [DEBUG] [MAIN ] NDMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:53.935385] [INFO ] [MAIN ] NDMO: Generated 138 derivative records from 16956 primary records. [2025-10-22T23:34:53.935559] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-10-22T23:34:53.947146] [DEBUG] [LOCAL ] NDMO: Derivative data saved (138 records). [2025-10-22T23:34:53.947234] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-10-22T23:34:53.949990] [INFO ] [MAIN ] Derivative Progress: 1233/2052 symbols. NDMO took 0.4s. Estimated remaining time: 5m 22s [2025-10-22T23:34:53.950084] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:54.001108] [DEBUG] [LOCAL ] NE: Loaded 52301 existing records from primary storage. [2025-10-22T23:34:54.001273] [INFO ] [MAIN ] NE: Loaded 52301 primary data records. [2025-10-22T23:34:54.311572] [DEBUG] [MAIN ] NE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:54.337200] [INFO ] [MAIN ] NE: Generated 138 derivative records from 52301 primary records. [2025-10-22T23:34:54.337361] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-10-22T23:34:54.349171] [DEBUG] [LOCAL ] NE: Derivative data saved (138 records). [2025-10-22T23:34:54.349258] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-10-22T23:34:54.352362] [INFO ] [MAIN ] Derivative Progress: 1234/2052 symbols. NE took 0.4s. Estimated remaining time: 5m 22s [2025-10-22T23:34:54.352476] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:54.389806] [DEBUG] [LOCAL ] NEA: Loaded 35122 existing records from primary storage. [2025-10-22T23:34:54.389998] [INFO ] [MAIN ] NEA: Loaded 35122 primary data records. [2025-10-22T23:34:54.735914] [DEBUG] [MAIN ] NEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:54.762003] [INFO ] [MAIN ] NEA: Generated 138 derivative records from 35122 primary records. [2025-10-22T23:34:54.762141] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-10-22T23:34:54.774196] [DEBUG] [LOCAL ] NEA: Derivative data saved (138 records). [2025-10-22T23:34:54.774296] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-10-22T23:34:54.777349] [INFO ] [MAIN ] Derivative Progress: 1235/2052 symbols. NEA took 0.4s. Estimated remaining time: 5m 22s [2025-10-22T23:34:54.777466] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:54.828204] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-10-22T23:34:54.828368] [INFO ] [MAIN ] NEE: Loaded 53707 primary data records. [2025-10-22T23:34:55.149405] [DEBUG] [MAIN ] NEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:55.174459] [INFO ] [MAIN ] NEE: Generated 138 derivative records from 53707 primary records. [2025-10-22T23:34:55.174598] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-10-22T23:34:55.186107] [DEBUG] [LOCAL ] NEE: Derivative data saved (138 records). [2025-10-22T23:34:55.186190] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-10-22T23:34:55.189319] [INFO ] [MAIN ] Derivative Progress: 1236/2052 symbols. NEE took 0.4s. Estimated remaining time: 5m 21s [2025-10-22T23:34:55.189418] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:55.240806] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-10-22T23:34:55.240969] [INFO ] [MAIN ] NEM: Loaded 53708 primary data records. [2025-10-22T23:34:55.547929] [DEBUG] [MAIN ] NEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:55.573420] [INFO ] [MAIN ] NEM: Generated 138 derivative records from 53708 primary records. [2025-10-22T23:34:55.573598] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-10-22T23:34:55.585438] [DEBUG] [LOCAL ] NEM: Derivative data saved (138 records). [2025-10-22T23:34:55.585529] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-10-22T23:34:55.588695] [INFO ] [MAIN ] Derivative Progress: 1237/2052 symbols. NEM took 0.4s. Estimated remaining time: 5m 21s [2025-10-22T23:34:55.588805] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:55.642914] [DEBUG] [LOCAL ] NET: Loaded 52801 existing records from primary storage. [2025-10-22T23:34:55.643085] [INFO ] [MAIN ] NET: Loaded 52801 primary data records. [2025-10-22T23:34:55.953585] [DEBUG] [MAIN ] NET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:55.979005] [INFO ] [MAIN ] NET: Generated 138 derivative records from 52801 primary records. [2025-10-22T23:34:55.979171] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-10-22T23:34:55.991191] [DEBUG] [LOCAL ] NET: Derivative data saved (138 records). [2025-10-22T23:34:55.991276] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-10-22T23:34:55.994357] [INFO ] [MAIN ] Derivative Progress: 1238/2052 symbols. NET took 0.4s. Estimated remaining time: 5m 21s [2025-10-22T23:34:55.994462] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:56.006745] [DEBUG] [LOCAL ] NEU: Loaded 8614 existing records from primary storage. [2025-10-22T23:34:56.006900] [INFO ] [MAIN ] NEU: Loaded 8614 primary data records. [2025-10-22T23:34:56.315537] [DEBUG] [MAIN ] NEU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:56.340349] [INFO ] [MAIN ] NEU: Generated 138 derivative records from 8614 primary records. [2025-10-22T23:34:56.340465] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-10-22T23:34:56.352007] [DEBUG] [LOCAL ] NEU: Derivative data saved (138 records). [2025-10-22T23:34:56.352087] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-10-22T23:34:56.354225] [INFO ] [MAIN ] Derivative Progress: 1239/2052 symbols. NEU took 0.4s. Estimated remaining time: 5m 20s [2025-10-22T23:34:56.354317] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:56.364384] [DEBUG] [LOCAL ] NEXA: Loaded 5704 existing records from primary storage. [2025-10-22T23:34:56.364523] [INFO ] [MAIN ] NEXA: Loaded 5704 primary data records. [2025-10-22T23:34:56.687017] [DEBUG] [MAIN ] NEXA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:56.712124] [INFO ] [MAIN ] NEXA: Generated 138 derivative records from 5704 primary records. [2025-10-22T23:34:56.712250] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-10-22T23:34:56.722083] [DEBUG] [LOCAL ] NEXA: Derivative data saved (138 records). [2025-10-22T23:34:56.722167] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-10-22T23:34:56.724356] [INFO ] [MAIN ] Derivative Progress: 1240/2052 symbols. NEXA took 0.4s. Estimated remaining time: 5m 20s [2025-10-22T23:34:56.724452] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:56.761863] [DEBUG] [LOCAL ] NFG: Loaded 38254 existing records from primary storage. [2025-10-22T23:34:56.762023] [INFO ] [MAIN ] NFG: Loaded 38254 primary data records. [2025-10-22T23:34:57.071373] [DEBUG] [MAIN ] NFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:57.097067] [INFO ] [MAIN ] NFG: Generated 138 derivative records from 38254 primary records. [2025-10-22T23:34:57.097293] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-10-22T23:34:57.108866] [DEBUG] [LOCAL ] NFG: Derivative data saved (138 records). [2025-10-22T23:34:57.108945] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-10-22T23:34:57.111958] [INFO ] [MAIN ] Derivative Progress: 1241/2052 symbols. NFG took 0.4s. Estimated remaining time: 5m 19s [2025-10-22T23:34:57.112058] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:57.134176] [DEBUG] [LOCAL ] NFJ: Loaded 19717 existing records from primary storage. [2025-10-22T23:34:57.134331] [INFO ] [MAIN ] NFJ: Loaded 19717 primary data records. [2025-10-22T23:34:57.442475] [DEBUG] [MAIN ] NFJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:57.468542] [INFO ] [MAIN ] NFJ: Generated 138 derivative records from 19717 primary records. [2025-10-22T23:34:57.468723] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-10-22T23:34:57.480617] [DEBUG] [LOCAL ] NFJ: Derivative data saved (138 records). [2025-10-22T23:34:57.480740] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-10-22T23:34:57.483494] [INFO ] [MAIN ] Derivative Progress: 1242/2052 symbols. NFJ took 0.4s. Estimated remaining time: 5m 19s [2025-10-22T23:34:57.483593] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:57.526821] [DEBUG] [LOCAL ] NGG: Loaded 46767 existing records from primary storage. [2025-10-22T23:34:57.527005] [INFO ] [MAIN ] NGG: Loaded 46767 primary data records. [2025-10-22T23:34:57.842733] [DEBUG] [MAIN ] NGG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:57.868607] [INFO ] [MAIN ] NGG: Generated 138 derivative records from 46767 primary records. [2025-10-22T23:34:57.868806] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-10-22T23:34:57.880565] [DEBUG] [LOCAL ] NGG: Derivative data saved (138 records). [2025-10-22T23:34:57.880695] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-10-22T23:34:57.883442] [INFO ] [MAIN ] Derivative Progress: 1243/2052 symbols. NGG took 0.4s. Estimated remaining time: 5m 19s [2025-10-22T23:34:57.883548] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:57.912286] [DEBUG] [LOCAL ] NGL: Loaded 29896 existing records from primary storage. [2025-10-22T23:34:57.912440] [INFO ] [MAIN ] NGL: Loaded 29896 primary data records. [2025-10-22T23:34:58.230739] [DEBUG] [MAIN ] NGL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:58.256585] [INFO ] [MAIN ] NGL: Generated 138 derivative records from 29896 primary records. [2025-10-22T23:34:58.256795] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-10-22T23:34:58.268196] [DEBUG] [LOCAL ] NGL: Derivative data saved (138 records). [2025-10-22T23:34:58.268302] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-10-22T23:34:58.271182] [INFO ] [MAIN ] Derivative Progress: 1244/2052 symbols. NGL took 0.4s. Estimated remaining time: 5m 18s [2025-10-22T23:34:58.271336] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:58.286155] [DEBUG] [LOCAL ] NGS: Loaded 10875 existing records from primary storage. [2025-10-22T23:34:58.286305] [INFO ] [MAIN ] NGS: Loaded 10875 primary data records. [2025-10-22T23:34:58.618874] [DEBUG] [MAIN ] NGS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:34:58.644328] [INFO ] [MAIN ] NGS: Generated 138 derivative records from 10875 primary records. [2025-10-22T23:34:58.644481] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-10-22T23:34:58.655790] [DEBUG] [LOCAL ] NGS: Derivative data saved (138 records). [2025-10-22T23:34:58.655873] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-10-22T23:34:58.658593] [INFO ] [MAIN ] Derivative Progress: 1245/2052 symbols. NGS took 0.4s. Estimated remaining time: 5m 18s [2025-10-22T23:34:58.658726] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:58.681874] [DEBUG] [LOCAL ] NGVC: Loaded 22759 existing records from primary storage. [2025-10-22T23:34:58.682026] [INFO ] [MAIN ] NGVC: Loaded 22759 primary data records. [2025-10-22T23:34:58.985680] [DEBUG] [MAIN ] NGVC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:59.011166] [INFO ] [MAIN ] NGVC: Generated 138 derivative records from 22759 primary records. [2025-10-22T23:34:59.011287] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-10-22T23:34:59.022885] [DEBUG] [LOCAL ] NGVC: Derivative data saved (138 records). [2025-10-22T23:34:59.022987] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-10-22T23:34:59.025719] [INFO ] [MAIN ] Derivative Progress: 1246/2052 symbols. NGVC took 0.4s. Estimated remaining time: 5m 17s [2025-10-22T23:34:59.025816] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:59.049583] [DEBUG] [LOCAL ] NGVT: Loaded 23771 existing records from primary storage. [2025-10-22T23:34:59.049748] [INFO ] [MAIN ] NGVT: Loaded 23771 primary data records. [2025-10-22T23:34:59.380862] [DEBUG] [MAIN ] NGVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:59.406607] [INFO ] [MAIN ] NGVT: Generated 138 derivative records from 23771 primary records. [2025-10-22T23:34:59.406752] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-10-22T23:34:59.418326] [DEBUG] [LOCAL ] NGVT: Derivative data saved (138 records). [2025-10-22T23:34:59.418407] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-10-22T23:34:59.421171] [INFO ] [MAIN ] Derivative Progress: 1247/2052 symbols. NGVT took 0.4s. Estimated remaining time: 5m 17s [2025-10-22T23:34:59.421269] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:59.443515] [DEBUG] [LOCAL ] NHI: Loaded 21900 existing records from primary storage. [2025-10-22T23:34:59.443694] [INFO ] [MAIN ] NHI: Loaded 21900 primary data records. [2025-10-22T23:34:59.766249] [DEBUG] [MAIN ] NHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:34:59.792032] [INFO ] [MAIN ] NHI: Generated 138 derivative records from 21900 primary records. [2025-10-22T23:34:59.792224] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-10-22T23:34:59.803695] [DEBUG] [LOCAL ] NHI: Derivative data saved (138 records). [2025-10-22T23:34:59.803812] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-10-22T23:34:59.806674] [INFO ] [MAIN ] Derivative Progress: 1248/2052 symbols. NHI took 0.4s. Estimated remaining time: 5m 17s [2025-10-22T23:34:59.806782] [INFO ] [MAIN ] NI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:34:59.858166] [DEBUG] [LOCAL ] NI: Loaded 53408 existing records from primary storage. [2025-10-22T23:34:59.858343] [INFO ] [MAIN ] NI: Loaded 53408 primary data records. [2025-10-22T23:35:00.163857] [DEBUG] [MAIN ] NI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:00.189218] [INFO ] [MAIN ] NI: Generated 138 derivative records from 53408 primary records. [2025-10-22T23:35:00.189389] [DEBUG] [LOCAL ] NI: Saving derivative data. [2025-10-22T23:35:00.200838] [DEBUG] [LOCAL ] NI: Derivative data saved (138 records). [2025-10-22T23:35:00.200923] [INFO ] [MAIN ] NI: Successfully saved derivative data. [2025-10-22T23:35:00.203887] [INFO ] [MAIN ] Derivative Progress: 1249/2052 symbols. NI took 0.4s. Estimated remaining time: 5m 16s [2025-10-22T23:35:00.203990] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:00.217088] [DEBUG] [LOCAL ] NIC: Loaded 8868 existing records from primary storage. [2025-10-22T23:35:00.217223] [INFO ] [MAIN ] NIC: Loaded 8868 primary data records. [2025-10-22T23:35:00.554387] [DEBUG] [MAIN ] NIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:00.579693] [INFO ] [MAIN ] NIC: Generated 138 derivative records from 8868 primary records. [2025-10-22T23:35:00.579842] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-10-22T23:35:00.591638] [DEBUG] [LOCAL ] NIC: Derivative data saved (138 records). [2025-10-22T23:35:00.591741] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-10-22T23:35:00.593769] [INFO ] [MAIN ] Derivative Progress: 1250/2052 symbols. NIC took 0.4s. Estimated remaining time: 5m 16s [2025-10-22T23:35:00.593868] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:00.608513] [DEBUG] [LOCAL ] NIE: Loaded 11724 existing records from primary storage. [2025-10-22T23:35:00.608681] [INFO ] [MAIN ] NIE: Loaded 11724 primary data records. [2025-10-22T23:35:00.911899] [DEBUG] [MAIN ] NIE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:00.937292] [INFO ] [MAIN ] NIE: Generated 138 derivative records from 11724 primary records. [2025-10-22T23:35:00.937471] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-10-22T23:35:00.948930] [DEBUG] [LOCAL ] NIE: Derivative data saved (138 records). [2025-10-22T23:35:00.949027] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-10-22T23:35:00.951730] [INFO ] [MAIN ] Derivative Progress: 1251/2052 symbols. NIE took 0.4s. Estimated remaining time: 5m 15s [2025-10-22T23:35:00.951850] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:00.957834] [DEBUG] [LOCAL ] NIM: Loaded 3526 existing records from primary storage. [2025-10-22T23:35:00.958000] [INFO ] [MAIN ] NIM: Loaded 3526 primary data records. [2025-10-22T23:35:01.274619] [DEBUG] [MAIN ] NIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:01.300472] [INFO ] [MAIN ] NIM: Generated 138 derivative records from 3526 primary records. [2025-10-22T23:35:01.300623] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-10-22T23:35:01.310545] [DEBUG] [LOCAL ] NIM: Derivative data saved (138 records). [2025-10-22T23:35:01.310625] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-10-22T23:35:01.312891] [INFO ] [MAIN ] Derivative Progress: 1252/2052 symbols. NIM took 0.4s. Estimated remaining time: 5m 15s [2025-10-22T23:35:01.312986] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:01.345365] [DEBUG] [LOCAL ] NINE: Loaded 28666 existing records from primary storage. [2025-10-22T23:35:01.345556] [INFO ] [MAIN ] NINE: Loaded 28666 primary data records. [2025-10-22T23:35:01.665334] [DEBUG] [MAIN ] NINE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:01.690700] [INFO ] [MAIN ] NINE: Generated 138 derivative records from 28666 primary records. [2025-10-22T23:35:01.690893] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-10-22T23:35:01.702987] [DEBUG] [LOCAL ] NINE: Derivative data saved (138 records). [2025-10-22T23:35:01.703098] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-10-22T23:35:01.706360] [INFO ] [MAIN ] Derivative Progress: 1253/2052 symbols. NINE took 0.4s. Estimated remaining time: 5m 15s [2025-10-22T23:35:01.706480] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:01.757884] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-22T23:35:01.758053] [INFO ] [MAIN ] NIO: Loaded 53802 primary data records. [2025-10-22T23:35:02.088195] [DEBUG] [MAIN ] NIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:02.115527] [INFO ] [MAIN ] NIO: Generated 138 derivative records from 53802 primary records. [2025-10-22T23:35:02.115735] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-10-22T23:35:02.127723] [DEBUG] [LOCAL ] NIO: Derivative data saved (138 records). [2025-10-22T23:35:02.127842] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-10-22T23:35:02.131011] [INFO ] [MAIN ] Derivative Progress: 1254/2052 symbols. NIO took 0.4s. Estimated remaining time: 5m 14s [2025-10-22T23:35:02.131155] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:02.170480] [DEBUG] [LOCAL ] NJR: Loaded 37856 existing records from primary storage. [2025-10-22T23:35:02.170706] [INFO ] [MAIN ] NJR: Loaded 37856 primary data records. [2025-10-22T23:35:02.513475] [DEBUG] [MAIN ] NJR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:02.541871] [INFO ] [MAIN ] NJR: Generated 138 derivative records from 37856 primary records. [2025-10-22T23:35:02.542124] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-10-22T23:35:02.555274] [DEBUG] [LOCAL ] NJR: Derivative data saved (138 records). [2025-10-22T23:35:02.555449] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-10-22T23:35:02.558476] [INFO ] [MAIN ] Derivative Progress: 1255/2052 symbols. NJR took 0.4s. Estimated remaining time: 5m 14s [2025-10-22T23:35:02.558636] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:02.580228] [DEBUG] [LOCAL ] NKX: Loaded 13670 existing records from primary storage. [2025-10-22T23:35:02.580418] [INFO ] [MAIN ] NKX: Loaded 13670 primary data records. [2025-10-22T23:35:03.041820] [DEBUG] [MAIN ] NKX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:03.074294] [INFO ] [MAIN ] NKX: Generated 138 derivative records from 13670 primary records. [2025-10-22T23:35:03.074580] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-10-22T23:35:03.092889] [DEBUG] [LOCAL ] NKX: Derivative data saved (138 records). [2025-10-22T23:35:03.093105] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-10-22T23:35:03.097174] [INFO ] [MAIN ] Derivative Progress: 1256/2052 symbols. NKX took 0.5s. Estimated remaining time: 5m 13s [2025-10-22T23:35:03.097436] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:03.120228] [DEBUG] [LOCAL ] NLOP: Loaded 11491 existing records from primary storage. [2025-10-22T23:35:03.120437] [INFO ] [MAIN ] NLOP: Loaded 11491 primary data records. [2025-10-22T23:35:03.542420] [DEBUG] [MAIN ] NLOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:03.571238] [INFO ] [MAIN ] NLOP: Generated 138 derivative records from 11491 primary records. [2025-10-22T23:35:03.571421] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-10-22T23:35:03.583223] [DEBUG] [LOCAL ] NLOP: Derivative data saved (138 records). [2025-10-22T23:35:03.583326] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-10-22T23:35:03.586379] [INFO ] [MAIN ] Derivative Progress: 1257/2052 symbols. NLOP took 0.5s. Estimated remaining time: 5m 13s [2025-10-22T23:35:03.586479] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:03.641143] [DEBUG] [LOCAL ] NLY: Loaded 53564 existing records from primary storage. [2025-10-22T23:35:03.641310] [INFO ] [MAIN ] NLY: Loaded 53564 primary data records. [2025-10-22T23:35:03.961474] [DEBUG] [MAIN ] NLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:03.987005] [INFO ] [MAIN ] NLY: Generated 138 derivative records from 53564 primary records. [2025-10-22T23:35:03.987160] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-10-22T23:35:03.999081] [DEBUG] [LOCAL ] NLY: Derivative data saved (138 records). [2025-10-22T23:35:03.999171] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-10-22T23:35:04.002293] [INFO ] [MAIN ] Derivative Progress: 1258/2052 symbols. NLY took 0.4s. Estimated remaining time: 5m 13s [2025-10-22T23:35:04.002398] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:04.017832] [DEBUG] [LOCAL ] NMAI: Loaded 12567 existing records from primary storage. [2025-10-22T23:35:04.017966] [INFO ] [MAIN ] NMAI: Loaded 12567 primary data records. [2025-10-22T23:35:04.324194] [DEBUG] [MAIN ] NMAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:04.349063] [INFO ] [MAIN ] NMAI: Generated 138 derivative records from 12567 primary records. [2025-10-22T23:35:04.349166] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-10-22T23:35:04.360419] [DEBUG] [LOCAL ] NMAI: Derivative data saved (138 records). [2025-10-22T23:35:04.360498] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-10-22T23:35:04.363227] [INFO ] [MAIN ] Derivative Progress: 1259/2052 symbols. NMAI took 0.4s. Estimated remaining time: 5m 12s [2025-10-22T23:35:04.363327] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:04.382476] [DEBUG] [LOCAL ] NMCO: Loaded 16631 existing records from primary storage. [2025-10-22T23:35:04.382607] [INFO ] [MAIN ] NMCO: Loaded 16631 primary data records. [2025-10-22T23:35:04.687094] [DEBUG] [MAIN ] NMCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:04.712311] [INFO ] [MAIN ] NMCO: Generated 138 derivative records from 16631 primary records. [2025-10-22T23:35:04.712414] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-10-22T23:35:04.723699] [DEBUG] [LOCAL ] NMCO: Derivative data saved (138 records). [2025-10-22T23:35:04.723778] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-10-22T23:35:04.726486] [INFO ] [MAIN ] Derivative Progress: 1260/2052 symbols. NMCO took 0.4s. Estimated remaining time: 5m 12s [2025-10-22T23:35:04.726587] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:04.741419] [DEBUG] [LOCAL ] NMG: Loaded 12064 existing records from primary storage. [2025-10-22T23:35:04.741548] [INFO ] [MAIN ] NMG: Loaded 12064 primary data records. [2025-10-22T23:35:05.071289] [DEBUG] [MAIN ] NMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:05.097805] [INFO ] [MAIN ] NMG: Generated 138 derivative records from 12064 primary records. [2025-10-22T23:35:05.097948] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-10-22T23:35:05.108718] [DEBUG] [LOCAL ] NMG: Derivative data saved (138 records). [2025-10-22T23:35:05.108799] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-10-22T23:35:05.111256] [INFO ] [MAIN ] Derivative Progress: 1261/2052 symbols. NMG took 0.4s. Estimated remaining time: 5m 12s [2025-10-22T23:35:05.111354] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:05.119605] [DEBUG] [LOCAL ] NMI: Loaded 4049 existing records from primary storage. [2025-10-22T23:35:05.119754] [INFO ] [MAIN ] NMI: Loaded 4049 primary data records. [2025-10-22T23:35:05.426608] [DEBUG] [MAIN ] NMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:05.451940] [INFO ] [MAIN ] NMI: Generated 138 derivative records from 4049 primary records. [2025-10-22T23:35:05.452049] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-10-22T23:35:05.461877] [DEBUG] [LOCAL ] NMI: Derivative data saved (138 records). [2025-10-22T23:35:05.461954] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-10-22T23:35:05.464201] [INFO ] [MAIN ] Derivative Progress: 1262/2052 symbols. NMI took 0.4s. Estimated remaining time: 5m 11s [2025-10-22T23:35:05.464298] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:05.479944] [DEBUG] [LOCAL ] NMM: Loaded 14137 existing records from primary storage. [2025-10-22T23:35:05.480084] [INFO ] [MAIN ] NMM: Loaded 14137 primary data records. [2025-10-22T23:35:05.789533] [DEBUG] [MAIN ] NMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:05.814944] [INFO ] [MAIN ] NMM: Generated 138 derivative records from 14137 primary records. [2025-10-22T23:35:05.815060] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-10-22T23:35:05.826077] [DEBUG] [LOCAL ] NMM: Derivative data saved (138 records). [2025-10-22T23:35:05.826157] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-10-22T23:35:05.828953] [INFO ] [MAIN ] Derivative Progress: 1263/2052 symbols. NMM took 0.4s. Estimated remaining time: 5m 11s [2025-10-22T23:35:05.829048] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:05.862108] [DEBUG] [LOCAL ] NMR: Loaded 35454 existing records from primary storage. [2025-10-22T23:35:05.862259] [INFO ] [MAIN ] NMR: Loaded 35454 primary data records. [2025-10-22T23:35:06.179374] [DEBUG] [MAIN ] NMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:06.204747] [INFO ] [MAIN ] NMR: Generated 138 derivative records from 35454 primary records. [2025-10-22T23:35:06.204926] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-10-22T23:35:06.216353] [DEBUG] [LOCAL ] NMR: Derivative data saved (138 records). [2025-10-22T23:35:06.216465] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-10-22T23:35:06.219603] [INFO ] [MAIN ] Derivative Progress: 1264/2052 symbols. NMR took 0.4s. Estimated remaining time: 5m 10s [2025-10-22T23:35:06.219781] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:06.225481] [DEBUG] [LOCAL ] NMS: Loaded 2889 existing records from primary storage. [2025-10-22T23:35:06.225610] [INFO ] [MAIN ] NMS: Loaded 2889 primary data records. [2025-10-22T23:35:06.565217] [DEBUG] [MAIN ] NMS: Filtered 6931 bins outside market hours, 7727 incomplete bins [2025-10-22T23:35:06.595776] [INFO ] [MAIN ] NMS: Generated 138 derivative records from 2889 primary records. [2025-10-22T23:35:06.595944] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-10-22T23:35:06.607884] [DEBUG] [LOCAL ] NMS: Derivative data saved (138 records). [2025-10-22T23:35:06.607981] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-10-22T23:35:06.610465] [INFO ] [MAIN ] Derivative Progress: 1265/2052 symbols. NMS took 0.4s. Estimated remaining time: 5m 10s [2025-10-22T23:35:06.610585] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:06.615891] [DEBUG] [LOCAL ] NMT: Loaded 2811 existing records from primary storage. [2025-10-22T23:35:06.615985] [INFO ] [MAIN ] NMT: Loaded 2811 primary data records. [2025-10-22T23:35:06.975116] [DEBUG] [MAIN ] NMT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:35:07.002781] [INFO ] [MAIN ] NMT: Generated 138 derivative records from 2811 primary records. [2025-10-22T23:35:07.002972] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-10-22T23:35:07.013348] [DEBUG] [LOCAL ] NMT: Derivative data saved (138 records). [2025-10-22T23:35:07.013447] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-10-22T23:35:07.015758] [INFO ] [MAIN ] Derivative Progress: 1266/2052 symbols. NMT took 0.4s. Estimated remaining time: 5m 10s [2025-10-22T23:35:07.015851] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:07.035630] [DEBUG] [LOCAL ] NMZ: Loaded 21383 existing records from primary storage. [2025-10-22T23:35:07.035817] [INFO ] [MAIN ] NMZ: Loaded 21383 primary data records. [2025-10-22T23:35:07.356459] [DEBUG] [MAIN ] NMZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:07.382771] [INFO ] [MAIN ] NMZ: Generated 138 derivative records from 21383 primary records. [2025-10-22T23:35:07.382945] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-10-22T23:35:07.394879] [DEBUG] [LOCAL ] NMZ: Derivative data saved (138 records). [2025-10-22T23:35:07.394985] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-10-22T23:35:07.398599] [INFO ] [MAIN ] Derivative Progress: 1267/2052 symbols. NMZ took 0.4s. Estimated remaining time: 5m 9s [2025-10-22T23:35:07.398790] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:07.413720] [DEBUG] [LOCAL ] NNI: Loaded 10508 existing records from primary storage. [2025-10-22T23:35:07.413877] [INFO ] [MAIN ] NNI: Loaded 10508 primary data records. [2025-10-22T23:35:07.739972] [DEBUG] [MAIN ] NNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:07.765503] [INFO ] [MAIN ] NNI: Generated 138 derivative records from 10508 primary records. [2025-10-22T23:35:07.765606] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-10-22T23:35:07.777575] [DEBUG] [LOCAL ] NNI: Derivative data saved (138 records). [2025-10-22T23:35:07.777678] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-10-22T23:35:07.780107] [INFO ] [MAIN ] Derivative Progress: 1268/2052 symbols. NNI took 0.4s. Estimated remaining time: 5m 9s [2025-10-22T23:35:07.780220] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:07.825784] [DEBUG] [LOCAL ] NNN: Loaded 48165 existing records from primary storage. [2025-10-22T23:35:07.825946] [INFO ] [MAIN ] NNN: Loaded 48165 primary data records. [2025-10-22T23:35:08.134189] [DEBUG] [MAIN ] NNN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:08.159584] [INFO ] [MAIN ] NNN: Generated 138 derivative records from 48165 primary records. [2025-10-22T23:35:08.159774] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-10-22T23:35:08.171213] [DEBUG] [LOCAL ] NNN: Derivative data saved (138 records). [2025-10-22T23:35:08.171293] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-10-22T23:35:08.174344] [INFO ] [MAIN ] Derivative Progress: 1269/2052 symbols. NNN took 0.4s. Estimated remaining time: 5m 8s [2025-10-22T23:35:08.174445] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:08.184038] [DEBUG] [LOCAL ] NNY: Loaded 5674 existing records from primary storage. [2025-10-22T23:35:08.184176] [INFO ] [MAIN ] NNY: Loaded 5674 primary data records. [2025-10-22T23:35:08.525609] [DEBUG] [MAIN ] NNY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:08.559123] [INFO ] [MAIN ] NNY: Generated 138 derivative records from 5674 primary records. [2025-10-22T23:35:08.559543] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-10-22T23:35:08.574221] [DEBUG] [LOCAL ] NNY: Derivative data saved (138 records). [2025-10-22T23:35:08.574438] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-10-22T23:35:08.577550] [INFO ] [MAIN ] Derivative Progress: 1270/2052 symbols. NNY took 0.4s. Estimated remaining time: 5m 8s [2025-10-22T23:35:08.577773] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:08.598849] [DEBUG] [LOCAL ] NOA: Loaded 15736 existing records from primary storage. [2025-10-22T23:35:08.599047] [INFO ] [MAIN ] NOA: Loaded 15736 primary data records. [2025-10-22T23:35:08.960280] [DEBUG] [MAIN ] NOA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:08.986148] [INFO ] [MAIN ] NOA: Generated 138 derivative records from 15736 primary records. [2025-10-22T23:35:08.986298] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-10-22T23:35:08.997960] [DEBUG] [LOCAL ] NOA: Derivative data saved (138 records). [2025-10-22T23:35:08.998055] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-10-22T23:35:09.000938] [INFO ] [MAIN ] Derivative Progress: 1271/2052 symbols. NOA took 0.4s. Estimated remaining time: 5m 8s [2025-10-22T23:35:09.001044] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:09.022610] [DEBUG] [LOCAL ] NOAH: Loaded 19844 existing records from primary storage. [2025-10-22T23:35:09.022788] [INFO ] [MAIN ] NOAH: Loaded 19844 primary data records. [2025-10-22T23:35:09.345406] [DEBUG] [MAIN ] NOAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:09.370632] [INFO ] [MAIN ] NOAH: Generated 138 derivative records from 19844 primary records. [2025-10-22T23:35:09.370802] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-10-22T23:35:09.382214] [DEBUG] [LOCAL ] NOAH: Derivative data saved (138 records). [2025-10-22T23:35:09.382295] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-10-22T23:35:09.385222] [INFO ] [MAIN ] Derivative Progress: 1272/2052 symbols. NOAH took 0.4s. Estimated remaining time: 5m 7s [2025-10-22T23:35:09.385317] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:09.424467] [DEBUG] [LOCAL ] NOC: Loaded 41598 existing records from primary storage. [2025-10-22T23:35:09.424627] [INFO ] [MAIN ] NOC: Loaded 41598 primary data records. [2025-10-22T23:35:09.728333] [DEBUG] [MAIN ] NOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:09.753103] [INFO ] [MAIN ] NOC: Generated 138 derivative records from 41598 primary records. [2025-10-22T23:35:09.753217] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-10-22T23:35:09.764750] [DEBUG] [LOCAL ] NOC: Derivative data saved (138 records). [2025-10-22T23:35:09.764831] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-10-22T23:35:09.767903] [INFO ] [MAIN ] Derivative Progress: 1273/2052 symbols. NOC took 0.4s. Estimated remaining time: 5m 7s [2025-10-22T23:35:09.767997] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:09.816925] [DEBUG] [LOCAL ] NOG: Loaded 51348 existing records from primary storage. [2025-10-22T23:35:09.817085] [INFO ] [MAIN ] NOG: Loaded 51348 primary data records. [2025-10-22T23:35:10.120631] [DEBUG] [MAIN ] NOG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:10.145769] [INFO ] [MAIN ] NOG: Generated 138 derivative records from 51348 primary records. [2025-10-22T23:35:10.145894] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-10-22T23:35:10.157512] [DEBUG] [LOCAL ] NOG: Derivative data saved (138 records). [2025-10-22T23:35:10.157591] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-10-22T23:35:10.160779] [INFO ] [MAIN ] Derivative Progress: 1274/2052 symbols. NOG took 0.4s. Estimated remaining time: 5m 6s [2025-10-22T23:35:10.160887] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:10.211725] [DEBUG] [LOCAL ] NOK: Loaded 53622 existing records from primary storage. [2025-10-22T23:35:10.211888] [INFO ] [MAIN ] NOK: Loaded 53622 primary data records. [2025-10-22T23:35:10.516791] [DEBUG] [MAIN ] NOK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:10.542097] [INFO ] [MAIN ] NOK: Generated 138 derivative records from 53622 primary records. [2025-10-22T23:35:10.542238] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-10-22T23:35:10.553594] [DEBUG] [LOCAL ] NOK: Derivative data saved (138 records). [2025-10-22T23:35:10.553695] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-10-22T23:35:10.556948] [INFO ] [MAIN ] Derivative Progress: 1275/2052 symbols. NOK took 0.4s. Estimated remaining time: 5m 6s [2025-10-22T23:35:10.557043] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:10.598140] [DEBUG] [LOCAL ] NOMD: Loaded 43199 existing records from primary storage. [2025-10-22T23:35:10.598301] [INFO ] [MAIN ] NOMD: Loaded 43199 primary data records. [2025-10-22T23:35:10.903247] [DEBUG] [MAIN ] NOMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:10.928585] [INFO ] [MAIN ] NOMD: Generated 138 derivative records from 43199 primary records. [2025-10-22T23:35:10.928811] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-10-22T23:35:10.940532] [DEBUG] [LOCAL ] NOMD: Derivative data saved (138 records). [2025-10-22T23:35:10.940619] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-10-22T23:35:10.943576] [INFO ] [MAIN ] Derivative Progress: 1276/2052 symbols. NOMD took 0.4s. Estimated remaining time: 5m 6s [2025-10-22T23:35:10.943725] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:10.980173] [DEBUG] [LOCAL ] NOTE: Loaded 39580 existing records from primary storage. [2025-10-22T23:35:10.980331] [INFO ] [MAIN ] NOTE: Loaded 39580 primary data records. [2025-10-22T23:35:11.308971] [DEBUG] [MAIN ] NOTE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:35:11.334551] [INFO ] [MAIN ] NOTE: Generated 138 derivative records from 39580 primary records. [2025-10-22T23:35:11.334731] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-10-22T23:35:11.344740] [DEBUG] [LOCAL ] NOTE: Derivative data saved (138 records). [2025-10-22T23:35:11.344840] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-10-22T23:35:11.347852] [INFO ] [MAIN ] Derivative Progress: 1277/2052 symbols. NOTE took 0.4s. Estimated remaining time: 5m 5s [2025-10-22T23:35:11.347954] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:11.400078] [DEBUG] [LOCAL ] NOV: Loaded 53163 existing records from primary storage. [2025-10-22T23:35:11.400241] [INFO ] [MAIN ] NOV: Loaded 53163 primary data records. [2025-10-22T23:35:11.705732] [DEBUG] [MAIN ] NOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:11.731814] [INFO ] [MAIN ] NOV: Generated 138 derivative records from 53163 primary records. [2025-10-22T23:35:11.731998] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-10-22T23:35:11.743850] [DEBUG] [LOCAL ] NOV: Derivative data saved (138 records). [2025-10-22T23:35:11.743962] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-10-22T23:35:11.747109] [INFO ] [MAIN ] Derivative Progress: 1278/2052 symbols. NOV took 0.4s. Estimated remaining time: 5m 5s [2025-10-22T23:35:11.747241] [INFO ] [MAIN ] NOW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:11.793280] [DEBUG] [LOCAL ] NOW: Loaded 47850 existing records from primary storage. [2025-10-22T23:35:11.793452] [INFO ] [MAIN ] NOW: Loaded 47850 primary data records. [2025-10-22T23:35:12.105634] [DEBUG] [MAIN ] NOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:12.130782] [INFO ] [MAIN ] NOW: Generated 138 derivative records from 47850 primary records. [2025-10-22T23:35:12.130942] [DEBUG] [LOCAL ] NOW: Saving derivative data. [2025-10-22T23:35:12.142597] [DEBUG] [LOCAL ] NOW: Derivative data saved (138 records). [2025-10-22T23:35:12.142704] [INFO ] [MAIN ] NOW: Successfully saved derivative data. [2025-10-22T23:35:12.145640] [INFO ] [MAIN ] Derivative Progress: 1279/2052 symbols. NOW took 0.4s. Estimated remaining time: 5m 4s [2025-10-22T23:35:12.145779] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:12.165062] [DEBUG] [LOCAL ] NPCT: Loaded 16365 existing records from primary storage. [2025-10-22T23:35:12.165230] [INFO ] [MAIN ] NPCT: Loaded 16365 primary data records. [2025-10-22T23:35:12.473184] [DEBUG] [MAIN ] NPCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:12.499104] [INFO ] [MAIN ] NPCT: Generated 138 derivative records from 16365 primary records. [2025-10-22T23:35:12.499265] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-10-22T23:35:12.510626] [DEBUG] [LOCAL ] NPCT: Derivative data saved (138 records). [2025-10-22T23:35:12.510742] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-10-22T23:35:12.513508] [INFO ] [MAIN ] Derivative Progress: 1280/2052 symbols. NPCT took 0.4s. Estimated remaining time: 5m 4s [2025-10-22T23:35:12.513628] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:12.527341] [DEBUG] [LOCAL ] NPFD: Loaded 9999 existing records from primary storage. [2025-10-22T23:35:12.527513] [INFO ] [MAIN ] NPFD: Loaded 9999 primary data records. [2025-10-22T23:35:12.837476] [DEBUG] [MAIN ] NPFD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:12.863200] [INFO ] [MAIN ] NPFD: Generated 138 derivative records from 9999 primary records. [2025-10-22T23:35:12.863345] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-10-22T23:35:12.875109] [DEBUG] [LOCAL ] NPFD: Derivative data saved (138 records). [2025-10-22T23:35:12.875209] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-10-22T23:35:12.877449] [INFO ] [MAIN ] Derivative Progress: 1281/2052 symbols. NPFD took 0.4s. Estimated remaining time: 5m 4s [2025-10-22T23:35:12.877563] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:12.889910] [DEBUG] [LOCAL ] NPK: Loaded 8371 existing records from primary storage. [2025-10-22T23:35:12.890058] [INFO ] [MAIN ] NPK: Loaded 8371 primary data records. [2025-10-22T23:35:13.221906] [DEBUG] [MAIN ] NPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:13.247869] [INFO ] [MAIN ] NPK: Generated 138 derivative records from 8371 primary records. [2025-10-22T23:35:13.248025] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-10-22T23:35:13.259285] [DEBUG] [LOCAL ] NPK: Derivative data saved (138 records). [2025-10-22T23:35:13.259371] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-10-22T23:35:13.261662] [INFO ] [MAIN ] Derivative Progress: 1282/2052 symbols. NPK took 0.4s. Estimated remaining time: 5m 3s [2025-10-22T23:35:13.261796] [INFO ] [MAIN ] NPKI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:13.300105] [DEBUG] [LOCAL ] NPKI: Loaded 40429 existing records from primary storage. [2025-10-22T23:35:13.300271] [INFO ] [MAIN ] NPKI: Loaded 40429 primary data records. [2025-10-22T23:35:13.615570] [DEBUG] [MAIN ] NPKI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:13.641320] [INFO ] [MAIN ] NPKI: Generated 138 derivative records from 40429 primary records. [2025-10-22T23:35:13.641592] [DEBUG] [LOCAL ] NPKI: Saving derivative data. [2025-10-22T23:35:13.653478] [DEBUG] [LOCAL ] NPKI: Derivative data saved (138 records). [2025-10-22T23:35:13.653562] [INFO ] [MAIN ] NPKI: Successfully saved derivative data. [2025-10-22T23:35:13.656484] [INFO ] [MAIN ] Derivative Progress: 1283/2052 symbols. NPKI took 0.4s. Estimated remaining time: 5m 3s [2025-10-22T23:35:13.656586] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:13.674244] [DEBUG] [LOCAL ] NPO: Loaded 13496 existing records from primary storage. [2025-10-22T23:35:13.674391] [INFO ] [MAIN ] NPO: Loaded 13496 primary data records. [2025-10-22T23:35:13.982170] [DEBUG] [MAIN ] NPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:14.007080] [INFO ] [MAIN ] NPO: Generated 138 derivative records from 13496 primary records. [2025-10-22T23:35:14.007211] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-10-22T23:35:14.018610] [DEBUG] [LOCAL ] NPO: Derivative data saved (138 records). [2025-10-22T23:35:14.018708] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-10-22T23:35:14.021404] [INFO ] [MAIN ] Derivative Progress: 1284/2052 symbols. NPO took 0.4s. Estimated remaining time: 5m 2s [2025-10-22T23:35:14.021503] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:14.031313] [DEBUG] [LOCAL ] NPV: Loaded 5380 existing records from primary storage. [2025-10-22T23:35:14.031444] [INFO ] [MAIN ] NPV: Loaded 5380 primary data records. [2025-10-22T23:35:14.352221] [DEBUG] [MAIN ] NPV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:35:14.377619] [INFO ] [MAIN ] NPV: Generated 138 derivative records from 5380 primary records. [2025-10-22T23:35:14.377765] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-10-22T23:35:14.388537] [DEBUG] [LOCAL ] NPV: Derivative data saved (138 records). [2025-10-22T23:35:14.388617] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-10-22T23:35:14.390822] [INFO ] [MAIN ] Derivative Progress: 1285/2052 symbols. NPV took 0.4s. Estimated remaining time: 5m 2s [2025-10-22T23:35:14.390920] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:14.432983] [DEBUG] [LOCAL ] NPWR: Loaded 43444 existing records from primary storage. [2025-10-22T23:35:14.433143] [INFO ] [MAIN ] NPWR: Loaded 43444 primary data records. [2025-10-22T23:35:14.738706] [DEBUG] [MAIN ] NPWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:14.763804] [INFO ] [MAIN ] NPWR: Generated 138 derivative records from 43444 primary records. [2025-10-22T23:35:14.763924] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-10-22T23:35:14.775507] [DEBUG] [LOCAL ] NPWR: Derivative data saved (138 records). [2025-10-22T23:35:14.775601] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-10-22T23:35:14.778810] [INFO ] [MAIN ] Derivative Progress: 1286/2052 symbols. NPWR took 0.4s. Estimated remaining time: 5m 2s [2025-10-22T23:35:14.778918] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:14.792084] [DEBUG] [LOCAL ] NQP: Loaded 9070 existing records from primary storage. [2025-10-22T23:35:14.792222] [INFO ] [MAIN ] NQP: Loaded 9070 primary data records. [2025-10-22T23:35:15.131195] [DEBUG] [MAIN ] NQP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:15.156684] [INFO ] [MAIN ] NQP: Generated 138 derivative records from 9070 primary records. [2025-10-22T23:35:15.156813] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-10-22T23:35:15.168287] [DEBUG] [LOCAL ] NQP: Derivative data saved (138 records). [2025-10-22T23:35:15.168387] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-10-22T23:35:15.170559] [INFO ] [MAIN ] Derivative Progress: 1287/2052 symbols. NQP took 0.4s. Estimated remaining time: 5m 1s [2025-10-22T23:35:15.170674] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:15.202279] [DEBUG] [LOCAL ] NRDY: Loaded 32164 existing records from primary storage. [2025-10-22T23:35:15.202430] [INFO ] [MAIN ] NRDY: Loaded 32164 primary data records. [2025-10-22T23:35:15.509626] [DEBUG] [MAIN ] NRDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:15.534539] [INFO ] [MAIN ] NRDY: Generated 138 derivative records from 32164 primary records. [2025-10-22T23:35:15.534691] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-10-22T23:35:15.546040] [DEBUG] [LOCAL ] NRDY: Derivative data saved (138 records). [2025-10-22T23:35:15.546119] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-10-22T23:35:15.549091] [INFO ] [MAIN ] Derivative Progress: 1288/2052 symbols. NRDY took 0.4s. Estimated remaining time: 5m 1s [2025-10-22T23:35:15.549198] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:15.561175] [DEBUG] [LOCAL ] NREF: Loaded 7815 existing records from primary storage. [2025-10-22T23:35:15.561302] [INFO ] [MAIN ] NREF: Loaded 7815 primary data records. [2025-10-22T23:35:15.871130] [DEBUG] [MAIN ] NREF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:15.896059] [INFO ] [MAIN ] NREF: Generated 138 derivative records from 7815 primary records. [2025-10-22T23:35:15.896208] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-10-22T23:35:15.907694] [DEBUG] [LOCAL ] NREF: Derivative data saved (138 records). [2025-10-22T23:35:15.907783] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-10-22T23:35:15.910043] [INFO ] [MAIN ] Derivative Progress: 1289/2052 symbols. NREF took 0.4s. Estimated remaining time: 5m 0s [2025-10-22T23:35:15.910136] [INFO ] [MAIN ] NRG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:15.964292] [DEBUG] [LOCAL ] NRG: Loaded 52825 existing records from primary storage. [2025-10-22T23:35:15.964462] [INFO ] [MAIN ] NRG: Loaded 52825 primary data records. [2025-10-22T23:35:16.266769] [DEBUG] [MAIN ] NRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:16.294615] [INFO ] [MAIN ] NRG: Generated 138 derivative records from 52825 primary records. [2025-10-22T23:35:16.294806] [DEBUG] [LOCAL ] NRG: Saving derivative data. [2025-10-22T23:35:16.306932] [DEBUG] [LOCAL ] NRG: Derivative data saved (138 records). [2025-10-22T23:35:16.307022] [INFO ] [MAIN ] NRG: Successfully saved derivative data. [2025-10-22T23:35:16.310260] [INFO ] [MAIN ] Derivative Progress: 1290/2052 symbols. NRG took 0.4s. Estimated remaining time: 4m 60s [2025-10-22T23:35:16.310366] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:16.351472] [DEBUG] [LOCAL ] NRGV: Loaded 43940 existing records from primary storage. [2025-10-22T23:35:16.351634] [INFO ] [MAIN ] NRGV: Loaded 43940 primary data records. [2025-10-22T23:35:16.660871] [DEBUG] [MAIN ] NRGV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:16.687778] [INFO ] [MAIN ] NRGV: Generated 138 derivative records from 43940 primary records. [2025-10-22T23:35:16.687921] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-10-22T23:35:16.699622] [DEBUG] [LOCAL ] NRGV: Derivative data saved (138 records). [2025-10-22T23:35:16.699726] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-10-22T23:35:16.702578] [INFO ] [MAIN ] Derivative Progress: 1291/2052 symbols. NRGV took 0.4s. Estimated remaining time: 4m 60s [2025-10-22T23:35:16.702724] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:16.724336] [DEBUG] [LOCAL ] NRK: Loaded 20423 existing records from primary storage. [2025-10-22T23:35:16.724489] [INFO ] [MAIN ] NRK: Loaded 20423 primary data records. [2025-10-22T23:35:17.047223] [DEBUG] [MAIN ] NRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:17.073926] [INFO ] [MAIN ] NRK: Generated 138 derivative records from 20423 primary records. [2025-10-22T23:35:17.074085] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-10-22T23:35:17.085626] [DEBUG] [LOCAL ] NRK: Derivative data saved (138 records). [2025-10-22T23:35:17.085731] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-10-22T23:35:17.088528] [INFO ] [MAIN ] Derivative Progress: 1292/2052 symbols. NRK took 0.4s. Estimated remaining time: 4m 59s [2025-10-22T23:35:17.088810] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:17.097302] [DEBUG] [LOCAL ] NRP: Loaded 4126 existing records from primary storage. [2025-10-22T23:35:17.097447] [INFO ] [MAIN ] NRP: Loaded 4126 primary data records. [2025-10-22T23:35:17.441312] [DEBUG] [MAIN ] NRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:17.466978] [INFO ] [MAIN ] NRP: Generated 138 derivative records from 4126 primary records. [2025-10-22T23:35:17.467115] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-10-22T23:35:17.477424] [DEBUG] [LOCAL ] NRP: Derivative data saved (138 records). [2025-10-22T23:35:17.477508] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-10-22T23:35:17.479866] [INFO ] [MAIN ] Derivative Progress: 1293/2052 symbols. NRP took 0.4s. Estimated remaining time: 4m 59s [2025-10-22T23:35:17.479982] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:17.487397] [DEBUG] [LOCAL ] NRT: Loaded 4872 existing records from primary storage. [2025-10-22T23:35:17.487538] [INFO ] [MAIN ] NRT: Loaded 4872 primary data records. [2025-10-22T23:35:17.786211] [DEBUG] [MAIN ] NRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:17.811584] [INFO ] [MAIN ] NRT: Generated 138 derivative records from 4872 primary records. [2025-10-22T23:35:17.811820] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-10-22T23:35:17.822312] [DEBUG] [LOCAL ] NRT: Derivative data saved (138 records). [2025-10-22T23:35:17.822448] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-10-22T23:35:17.824890] [INFO ] [MAIN ] Derivative Progress: 1294/2052 symbols. NRT took 0.3s. Estimated remaining time: 4m 58s [2025-10-22T23:35:17.825024] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:17.830594] [DEBUG] [LOCAL ] NRUC: Loaded 3098 existing records from primary storage. [2025-10-22T23:35:17.830750] [INFO ] [MAIN ] NRUC: Loaded 3098 primary data records. [2025-10-22T23:35:18.139814] [DEBUG] [MAIN ] NRUC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:18.169353] [INFO ] [MAIN ] NRUC: Generated 138 derivative records from 3098 primary records. [2025-10-22T23:35:18.169577] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-10-22T23:35:18.179775] [DEBUG] [LOCAL ] NRUC: Derivative data saved (138 records). [2025-10-22T23:35:18.179871] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-10-22T23:35:18.182223] [INFO ] [MAIN ] Derivative Progress: 1295/2052 symbols. NRUC took 0.4s. Estimated remaining time: 4m 58s [2025-10-22T23:35:18.182342] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:18.228190] [DEBUG] [LOCAL ] NSA: Loaded 45071 existing records from primary storage. [2025-10-22T23:35:18.228361] [INFO ] [MAIN ] NSA: Loaded 45071 primary data records. [2025-10-22T23:35:18.532093] [DEBUG] [MAIN ] NSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:18.557224] [INFO ] [MAIN ] NSA: Generated 138 derivative records from 45071 primary records. [2025-10-22T23:35:18.557421] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-10-22T23:35:18.568804] [DEBUG] [LOCAL ] NSA: Derivative data saved (138 records). [2025-10-22T23:35:18.568888] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-10-22T23:35:18.572070] [INFO ] [MAIN ] Derivative Progress: 1296/2052 symbols. NSA took 0.4s. Estimated remaining time: 4m 58s [2025-10-22T23:35:18.572173] [INFO ] [MAIN ] NSC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:18.617100] [DEBUG] [LOCAL ] NSC: Loaded 48653 existing records from primary storage. [2025-10-22T23:35:18.617292] [INFO ] [MAIN ] NSC: Loaded 48653 primary data records. [2025-10-22T23:35:18.932473] [DEBUG] [MAIN ] NSC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:18.962280] [INFO ] [MAIN ] NSC: Generated 138 derivative records from 48653 primary records. [2025-10-22T23:35:18.962469] [DEBUG] [LOCAL ] NSC: Saving derivative data. [2025-10-22T23:35:18.974286] [DEBUG] [LOCAL ] NSC: Derivative data saved (138 records). [2025-10-22T23:35:18.974367] [INFO ] [MAIN ] NSC: Successfully saved derivative data. [2025-10-22T23:35:18.977472] [INFO ] [MAIN ] Derivative Progress: 1297/2052 symbols. NSC took 0.4s. Estimated remaining time: 4m 57s [2025-10-22T23:35:18.977588] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:19.012010] [DEBUG] [LOCAL ] NSP: Loaded 35753 existing records from primary storage. [2025-10-22T23:35:19.012172] [INFO ] [MAIN ] NSP: Loaded 35753 primary data records. [2025-10-22T23:35:19.353276] [DEBUG] [MAIN ] NSP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:19.379182] [INFO ] [MAIN ] NSP: Generated 138 derivative records from 35753 primary records. [2025-10-22T23:35:19.379338] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-10-22T23:35:19.390989] [DEBUG] [LOCAL ] NSP: Derivative data saved (138 records). [2025-10-22T23:35:19.391074] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-10-22T23:35:19.394005] [INFO ] [MAIN ] Derivative Progress: 1298/2052 symbols. NSP took 0.4s. Estimated remaining time: 4m 57s [2025-10-22T23:35:19.394116] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:19.415718] [DEBUG] [LOCAL ] NTB: Loaded 20182 existing records from primary storage. [2025-10-22T23:35:19.415875] [INFO ] [MAIN ] NTB: Loaded 20182 primary data records. [2025-10-22T23:35:19.745773] [DEBUG] [MAIN ] NTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:19.771379] [INFO ] [MAIN ] NTB: Generated 138 derivative records from 20182 primary records. [2025-10-22T23:35:19.771539] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-10-22T23:35:19.783097] [DEBUG] [LOCAL ] NTB: Derivative data saved (138 records). [2025-10-22T23:35:19.783223] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-10-22T23:35:19.786157] [INFO ] [MAIN ] Derivative Progress: 1299/2052 symbols. NTB took 0.4s. Estimated remaining time: 4m 56s [2025-10-22T23:35:19.786268] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:19.837387] [DEBUG] [LOCAL ] NTR: Loaded 52631 existing records from primary storage. [2025-10-22T23:35:19.837554] [INFO ] [MAIN ] NTR: Loaded 52631 primary data records. [2025-10-22T23:35:20.148315] [DEBUG] [MAIN ] NTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:20.173177] [INFO ] [MAIN ] NTR: Generated 138 derivative records from 52631 primary records. [2025-10-22T23:35:20.173319] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-10-22T23:35:20.184946] [DEBUG] [LOCAL ] NTR: Derivative data saved (138 records). [2025-10-22T23:35:20.185028] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-10-22T23:35:20.188161] [INFO ] [MAIN ] Derivative Progress: 1300/2052 symbols. NTR took 0.4s. Estimated remaining time: 4m 56s [2025-10-22T23:35:20.188265] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:20.230714] [DEBUG] [LOCAL ] NTST: Loaded 44049 existing records from primary storage. [2025-10-22T23:35:20.230877] [INFO ] [MAIN ] NTST: Loaded 44049 primary data records. [2025-10-22T23:35:20.536925] [DEBUG] [MAIN ] NTST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:20.561887] [INFO ] [MAIN ] NTST: Generated 138 derivative records from 44049 primary records. [2025-10-22T23:35:20.562035] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-10-22T23:35:20.573742] [DEBUG] [LOCAL ] NTST: Derivative data saved (138 records). [2025-10-22T23:35:20.573827] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-10-22T23:35:20.576586] [INFO ] [MAIN ] Derivative Progress: 1301/2052 symbols. NTST took 0.4s. Estimated remaining time: 4m 56s [2025-10-22T23:35:20.576737] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:20.630281] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-10-22T23:35:20.630449] [INFO ] [MAIN ] NU: Loaded 53746 primary data records. [2025-10-22T23:35:20.956161] [DEBUG] [MAIN ] NU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:20.981212] [INFO ] [MAIN ] NU: Generated 138 derivative records from 53746 primary records. [2025-10-22T23:35:20.981363] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-10-22T23:35:20.993192] [DEBUG] [LOCAL ] NU: Derivative data saved (138 records). [2025-10-22T23:35:20.993272] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-10-22T23:35:20.996315] [INFO ] [MAIN ] Derivative Progress: 1302/2052 symbols. NU took 0.4s. Estimated remaining time: 4m 55s [2025-10-22T23:35:20.996443] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:21.030792] [DEBUG] [LOCAL ] NUS: Loaded 36083 existing records from primary storage. [2025-10-22T23:35:21.030951] [INFO ] [MAIN ] NUS: Loaded 36083 primary data records. [2025-10-22T23:35:21.373712] [DEBUG] [MAIN ] NUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:21.399093] [INFO ] [MAIN ] NUS: Generated 138 derivative records from 36083 primary records. [2025-10-22T23:35:21.399251] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-10-22T23:35:21.410918] [DEBUG] [LOCAL ] NUS: Derivative data saved (138 records). [2025-10-22T23:35:21.411003] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-10-22T23:35:21.413895] [INFO ] [MAIN ] Derivative Progress: 1303/2052 symbols. NUS took 0.4s. Estimated remaining time: 4m 55s [2025-10-22T23:35:21.414001] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:21.437222] [DEBUG] [LOCAL ] NUV: Loaded 23286 existing records from primary storage. [2025-10-22T23:35:21.437400] [INFO ] [MAIN ] NUV: Loaded 23286 primary data records. [2025-10-22T23:35:21.756409] [DEBUG] [MAIN ] NUV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:21.782411] [INFO ] [MAIN ] NUV: Generated 138 derivative records from 23286 primary records. [2025-10-22T23:35:21.782532] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-10-22T23:35:21.793847] [DEBUG] [LOCAL ] NUV: Derivative data saved (138 records). [2025-10-22T23:35:21.793926] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-10-22T23:35:21.796735] [INFO ] [MAIN ] Derivative Progress: 1304/2052 symbols. NUV took 0.4s. Estimated remaining time: 4m 54s [2025-10-22T23:35:21.796850] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:21.850980] [DEBUG] [LOCAL ] NUVB: Loaded 51712 existing records from primary storage. [2025-10-22T23:35:21.851140] [INFO ] [MAIN ] NUVB: Loaded 51712 primary data records. [2025-10-22T23:35:22.161993] [DEBUG] [MAIN ] NUVB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:22.187939] [INFO ] [MAIN ] NUVB: Generated 138 derivative records from 51712 primary records. [2025-10-22T23:35:22.188098] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-10-22T23:35:22.199684] [DEBUG] [LOCAL ] NUVB: Derivative data saved (138 records). [2025-10-22T23:35:22.199767] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-10-22T23:35:22.202888] [INFO ] [MAIN ] Derivative Progress: 1305/2052 symbols. NUVB took 0.4s. Estimated remaining time: 4m 54s [2025-10-22T23:35:22.202988] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:22.214132] [DEBUG] [LOCAL ] NUW: Loaded 6639 existing records from primary storage. [2025-10-22T23:35:22.214270] [INFO ] [MAIN ] NUW: Loaded 6639 primary data records. [2025-10-22T23:35:22.519446] [DEBUG] [MAIN ] NUW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:22.544613] [INFO ] [MAIN ] NUW: Generated 138 derivative records from 6639 primary records. [2025-10-22T23:35:22.544769] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-10-22T23:35:22.555578] [DEBUG] [LOCAL ] NUW: Derivative data saved (138 records). [2025-10-22T23:35:22.555680] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-10-22T23:35:22.557845] [INFO ] [MAIN ] Derivative Progress: 1306/2052 symbols. NUW took 0.4s. Estimated remaining time: 4m 54s [2025-10-22T23:35:22.557948] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:22.586998] [DEBUG] [LOCAL ] NVG: Loaded 27394 existing records from primary storage. [2025-10-22T23:35:22.587163] [INFO ] [MAIN ] NVG: Loaded 27394 primary data records. [2025-10-22T23:35:22.900873] [DEBUG] [MAIN ] NVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:22.925972] [INFO ] [MAIN ] NVG: Generated 138 derivative records from 27394 primary records. [2025-10-22T23:35:22.926123] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-10-22T23:35:22.937928] [DEBUG] [LOCAL ] NVG: Derivative data saved (138 records). [2025-10-22T23:35:22.938009] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-10-22T23:35:22.941136] [INFO ] [MAIN ] Derivative Progress: 1307/2052 symbols. NVG took 0.4s. Estimated remaining time: 4m 53s [2025-10-22T23:35:22.941235] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:22.972192] [DEBUG] [LOCAL ] NVGS: Loaded 29948 existing records from primary storage. [2025-10-22T23:35:22.972350] [INFO ] [MAIN ] NVGS: Loaded 29948 primary data records. [2025-10-22T23:35:23.279127] [DEBUG] [MAIN ] NVGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:23.305061] [INFO ] [MAIN ] NVGS: Generated 138 derivative records from 29948 primary records. [2025-10-22T23:35:23.305224] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-10-22T23:35:23.316672] [DEBUG] [LOCAL ] NVGS: Derivative data saved (138 records). [2025-10-22T23:35:23.316757] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-10-22T23:35:23.319628] [INFO ] [MAIN ] Derivative Progress: 1308/2052 symbols. NVGS took 0.4s. Estimated remaining time: 4m 53s [2025-10-22T23:35:23.319760] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:23.371880] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-10-22T23:35:23.372054] [INFO ] [MAIN ] NVO: Loaded 53784 primary data records. [2025-10-22T23:35:23.724408] [DEBUG] [MAIN ] NVO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:23.750629] [INFO ] [MAIN ] NVO: Generated 138 derivative records from 53784 primary records. [2025-10-22T23:35:23.750837] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-10-22T23:35:23.762740] [DEBUG] [LOCAL ] NVO: Derivative data saved (138 records). [2025-10-22T23:35:23.762891] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-10-22T23:35:23.766192] [INFO ] [MAIN ] Derivative Progress: 1309/2052 symbols. NVO took 0.4s. Estimated remaining time: 4m 52s [2025-10-22T23:35:23.766348] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:23.805120] [DEBUG] [LOCAL ] NVRI: Loaded 38962 existing records from primary storage. [2025-10-22T23:35:23.805297] [INFO ] [MAIN ] NVRI: Loaded 38962 primary data records. [2025-10-22T23:35:24.152792] [DEBUG] [MAIN ] NVRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:24.178826] [INFO ] [MAIN ] NVRI: Generated 138 derivative records from 38962 primary records. [2025-10-22T23:35:24.179017] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-10-22T23:35:24.190546] [DEBUG] [LOCAL ] NVRI: Derivative data saved (138 records). [2025-10-22T23:35:24.190713] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-10-22T23:35:24.193720] [INFO ] [MAIN ] Derivative Progress: 1310/2052 symbols. NVRI took 0.4s. Estimated remaining time: 4m 52s [2025-10-22T23:35:24.193864] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:24.246535] [DEBUG] [LOCAL ] NVS: Loaded 51301 existing records from primary storage. [2025-10-22T23:35:24.246750] [INFO ] [MAIN ] NVS: Loaded 51301 primary data records. [2025-10-22T23:35:24.557211] [DEBUG] [MAIN ] NVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:24.582105] [INFO ] [MAIN ] NVS: Generated 138 derivative records from 51301 primary records. [2025-10-22T23:35:24.582217] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-10-22T23:35:24.593784] [DEBUG] [LOCAL ] NVS: Derivative data saved (138 records). [2025-10-22T23:35:24.593864] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-10-22T23:35:24.597182] [INFO ] [MAIN ] Derivative Progress: 1311/2052 symbols. NVS took 0.4s. Estimated remaining time: 4m 52s [2025-10-22T23:35:24.597306] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:24.647423] [DEBUG] [LOCAL ] NVST: Loaded 51406 existing records from primary storage. [2025-10-22T23:35:24.647585] [INFO ] [MAIN ] NVST: Loaded 51406 primary data records. [2025-10-22T23:35:24.951263] [DEBUG] [MAIN ] NVST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:24.976218] [INFO ] [MAIN ] NVST: Generated 138 derivative records from 51406 primary records. [2025-10-22T23:35:24.976340] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-10-22T23:35:24.987800] [DEBUG] [LOCAL ] NVST: Derivative data saved (138 records). [2025-10-22T23:35:24.987880] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-10-22T23:35:24.991187] [INFO ] [MAIN ] Derivative Progress: 1312/2052 symbols. NVST took 0.4s. Estimated remaining time: 4m 51s [2025-10-22T23:35:24.991286] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:25.044948] [DEBUG] [LOCAL ] NVT: Loaded 51415 existing records from primary storage. [2025-10-22T23:35:25.045138] [INFO ] [MAIN ] NVT: Loaded 51415 primary data records. [2025-10-22T23:35:25.370783] [DEBUG] [MAIN ] NVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:25.397788] [INFO ] [MAIN ] NVT: Generated 138 derivative records from 51415 primary records. [2025-10-22T23:35:25.398062] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-10-22T23:35:25.410329] [DEBUG] [LOCAL ] NVT: Derivative data saved (138 records). [2025-10-22T23:35:25.410443] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-10-22T23:35:25.413622] [INFO ] [MAIN ] Derivative Progress: 1313/2052 symbols. NVT took 0.4s. Estimated remaining time: 4m 51s [2025-10-22T23:35:25.413757] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:25.467529] [DEBUG] [LOCAL ] NWG: Loaded 51400 existing records from primary storage. [2025-10-22T23:35:25.467725] [INFO ] [MAIN ] NWG: Loaded 51400 primary data records. [2025-10-22T23:35:25.820529] [DEBUG] [MAIN ] NWG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:25.846976] [INFO ] [MAIN ] NWG: Generated 138 derivative records from 51400 primary records. [2025-10-22T23:35:25.847169] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-10-22T23:35:25.859060] [DEBUG] [LOCAL ] NWG: Derivative data saved (138 records). [2025-10-22T23:35:25.859182] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-10-22T23:35:25.862497] [INFO ] [MAIN ] Derivative Progress: 1314/2052 symbols. NWG took 0.4s. Estimated remaining time: 4m 51s [2025-10-22T23:35:25.862661] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:25.890162] [DEBUG] [LOCAL ] NWN: Loaded 26434 existing records from primary storage. [2025-10-22T23:35:25.890338] [INFO ] [MAIN ] NWN: Loaded 26434 primary data records. [2025-10-22T23:35:26.217305] [DEBUG] [MAIN ] NWN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:26.242876] [INFO ] [MAIN ] NWN: Generated 138 derivative records from 26434 primary records. [2025-10-22T23:35:26.243063] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-10-22T23:35:26.254520] [DEBUG] [LOCAL ] NWN: Derivative data saved (138 records). [2025-10-22T23:35:26.254684] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-10-22T23:35:26.257608] [INFO ] [MAIN ] Derivative Progress: 1315/2052 symbols. NWN took 0.4s. Estimated remaining time: 4m 50s [2025-10-22T23:35:26.257776] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:26.293535] [DEBUG] [LOCAL ] NX: Loaded 33325 existing records from primary storage. [2025-10-22T23:35:26.293737] [INFO ] [MAIN ] NX: Loaded 33325 primary data records. [2025-10-22T23:35:26.606924] [DEBUG] [MAIN ] NX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:26.632934] [INFO ] [MAIN ] NX: Generated 138 derivative records from 33325 primary records. [2025-10-22T23:35:26.633137] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-10-22T23:35:26.645106] [DEBUG] [LOCAL ] NX: Derivative data saved (138 records). [2025-10-22T23:35:26.645203] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-10-22T23:35:26.648368] [INFO ] [MAIN ] Derivative Progress: 1316/2052 symbols. NX took 0.4s. Estimated remaining time: 4m 50s [2025-10-22T23:35:26.648486] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:26.657233] [DEBUG] [LOCAL ] NXC: Loaded 4057 existing records from primary storage. [2025-10-22T23:35:26.657385] [INFO ] [MAIN ] NXC: Loaded 4057 primary data records. [2025-10-22T23:35:26.978795] [DEBUG] [MAIN ] NXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:27.005689] [INFO ] [MAIN ] NXC: Generated 138 derivative records from 4057 primary records. [2025-10-22T23:35:27.005876] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-10-22T23:35:27.016362] [DEBUG] [LOCAL ] NXC: Derivative data saved (138 records). [2025-10-22T23:35:27.016505] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-10-22T23:35:27.018838] [INFO ] [MAIN ] Derivative Progress: 1317/2052 symbols. NXC took 0.4s. Estimated remaining time: 4m 49s [2025-10-22T23:35:27.018959] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:27.035579] [DEBUG] [LOCAL ] NXDT: Loaded 14784 existing records from primary storage. [2025-10-22T23:35:27.035775] [INFO ] [MAIN ] NXDT: Loaded 14784 primary data records. [2025-10-22T23:35:27.366138] [DEBUG] [MAIN ] NXDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:27.392270] [INFO ] [MAIN ] NXDT: Generated 138 derivative records from 14784 primary records. [2025-10-22T23:35:27.392425] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-10-22T23:35:27.403990] [DEBUG] [LOCAL ] NXDT: Derivative data saved (138 records). [2025-10-22T23:35:27.404097] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-10-22T23:35:27.407021] [INFO ] [MAIN ] Derivative Progress: 1318/2052 symbols. NXDT took 0.4s. Estimated remaining time: 4m 49s [2025-10-22T23:35:27.407133] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:27.460832] [DEBUG] [LOCAL ] NXE: Loaded 53067 existing records from primary storage. [2025-10-22T23:35:27.461008] [INFO ] [MAIN ] NXE: Loaded 53067 primary data records. [2025-10-22T23:35:27.829249] [DEBUG] [MAIN ] NXE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:27.855781] [INFO ] [MAIN ] NXE: Generated 138 derivative records from 53067 primary records. [2025-10-22T23:35:27.855975] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-10-22T23:35:27.867190] [DEBUG] [LOCAL ] NXE: Derivative data saved (138 records). [2025-10-22T23:35:27.867314] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-10-22T23:35:27.870468] [INFO ] [MAIN ] Derivative Progress: 1319/2052 symbols. NXE took 0.5s. Estimated remaining time: 4m 49s [2025-10-22T23:35:27.870581] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:27.884839] [DEBUG] [LOCAL ] NXG: Loaded 10466 existing records from primary storage. [2025-10-22T23:35:27.884992] [INFO ] [MAIN ] NXG: Loaded 10466 primary data records. [2025-10-22T23:35:28.204013] [DEBUG] [MAIN ] NXG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:28.230428] [INFO ] [MAIN ] NXG: Generated 138 derivative records from 10466 primary records. [2025-10-22T23:35:28.230580] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-10-22T23:35:28.242553] [DEBUG] [LOCAL ] NXG: Derivative data saved (138 records). [2025-10-22T23:35:28.242678] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-10-22T23:35:28.245035] [INFO ] [MAIN ] Derivative Progress: 1320/2052 symbols. NXG took 0.4s. Estimated remaining time: 4m 48s [2025-10-22T23:35:28.245137] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:28.263830] [DEBUG] [LOCAL ] NXJ: Loaded 14830 existing records from primary storage. [2025-10-22T23:35:28.263994] [INFO ] [MAIN ] NXJ: Loaded 14830 primary data records. [2025-10-22T23:35:28.620449] [DEBUG] [MAIN ] NXJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:28.645314] [INFO ] [MAIN ] NXJ: Generated 138 derivative records from 14830 primary records. [2025-10-22T23:35:28.645453] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-10-22T23:35:28.656832] [DEBUG] [LOCAL ] NXJ: Derivative data saved (138 records). [2025-10-22T23:35:28.656917] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-10-22T23:35:28.659741] [INFO ] [MAIN ] Derivative Progress: 1321/2052 symbols. NXJ took 0.4s. Estimated remaining time: 4m 48s [2025-10-22T23:35:28.659846] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:28.665222] [DEBUG] [LOCAL ] NXN: Loaded 2296 existing records from primary storage. [2025-10-22T23:35:28.665317] [INFO ] [MAIN ] NXN: Loaded 2296 primary data records. [2025-10-22T23:35:28.975234] [DEBUG] [MAIN ] NXN: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:35:29.001133] [INFO ] [MAIN ] NXN: Generated 138 derivative records from 2296 primary records. [2025-10-22T23:35:29.001302] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-10-22T23:35:29.010838] [DEBUG] [LOCAL ] NXN: Derivative data saved (138 records). [2025-10-22T23:35:29.010938] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-10-22T23:35:29.013248] [INFO ] [MAIN ] Derivative Progress: 1322/2052 symbols. NXN took 0.4s. Estimated remaining time: 4m 47s [2025-10-22T23:35:29.013348] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:29.027788] [DEBUG] [LOCAL ] NXP: Loaded 12233 existing records from primary storage. [2025-10-22T23:35:29.027928] [INFO ] [MAIN ] NXP: Loaded 12233 primary data records. [2025-10-22T23:35:29.346620] [DEBUG] [MAIN ] NXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:29.371622] [INFO ] [MAIN ] NXP: Generated 138 derivative records from 12233 primary records. [2025-10-22T23:35:29.371766] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-10-22T23:35:29.383060] [DEBUG] [LOCAL ] NXP: Derivative data saved (138 records). [2025-10-22T23:35:29.383142] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-10-22T23:35:29.386211] [INFO ] [MAIN ] Derivative Progress: 1323/2052 symbols. NXP took 0.4s. Estimated remaining time: 4m 47s [2025-10-22T23:35:29.386310] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:29.406372] [DEBUG] [LOCAL ] NXRT: Loaded 18929 existing records from primary storage. [2025-10-22T23:35:29.406514] [INFO ] [MAIN ] NXRT: Loaded 18929 primary data records. [2025-10-22T23:35:29.740595] [DEBUG] [MAIN ] NXRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:29.765600] [INFO ] [MAIN ] NXRT: Generated 138 derivative records from 18929 primary records. [2025-10-22T23:35:29.765773] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-10-22T23:35:29.777571] [DEBUG] [LOCAL ] NXRT: Derivative data saved (138 records). [2025-10-22T23:35:29.777677] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-10-22T23:35:29.780516] [INFO ] [MAIN ] Derivative Progress: 1324/2052 symbols. NXRT took 0.4s. Estimated remaining time: 4m 47s [2025-10-22T23:35:29.780614] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:29.829083] [DEBUG] [LOCAL ] NYT: Loaded 49445 existing records from primary storage. [2025-10-22T23:35:29.829271] [INFO ] [MAIN ] NYT: Loaded 49445 primary data records. [2025-10-22T23:35:30.133532] [DEBUG] [MAIN ] NYT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:30.158391] [INFO ] [MAIN ] NYT: Generated 138 derivative records from 49445 primary records. [2025-10-22T23:35:30.158510] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-10-22T23:35:30.169994] [DEBUG] [LOCAL ] NYT: Derivative data saved (138 records). [2025-10-22T23:35:30.170074] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-10-22T23:35:30.173097] [INFO ] [MAIN ] Derivative Progress: 1325/2052 symbols. NYT took 0.4s. Estimated remaining time: 4m 46s [2025-10-22T23:35:30.173192] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:30.202826] [DEBUG] [LOCAL ] NZF: Loaded 28713 existing records from primary storage. [2025-10-22T23:35:30.202970] [INFO ] [MAIN ] NZF: Loaded 28713 primary data records. [2025-10-22T23:35:30.508165] [DEBUG] [MAIN ] NZF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:30.533400] [INFO ] [MAIN ] NZF: Generated 138 derivative records from 28713 primary records. [2025-10-22T23:35:30.533574] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-10-22T23:35:30.545163] [DEBUG] [LOCAL ] NZF: Derivative data saved (138 records). [2025-10-22T23:35:30.545244] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-10-22T23:35:30.548140] [INFO ] [MAIN ] Derivative Progress: 1326/2052 symbols. NZF took 0.4s. Estimated remaining time: 4m 46s [2025-10-22T23:35:30.548244] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:30.600194] [DEBUG] [LOCAL ] OBDC: Loaded 51730 existing records from primary storage. [2025-10-22T23:35:30.600349] [INFO ] [MAIN ] OBDC: Loaded 51730 primary data records. [2025-10-22T23:35:30.908313] [DEBUG] [MAIN ] OBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:30.933493] [INFO ] [MAIN ] OBDC: Generated 138 derivative records from 51730 primary records. [2025-10-22T23:35:30.933616] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-10-22T23:35:30.945411] [DEBUG] [LOCAL ] OBDC: Derivative data saved (138 records). [2025-10-22T23:35:30.945491] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-10-22T23:35:30.948728] [INFO ] [MAIN ] Derivative Progress: 1327/2052 symbols. OBDC took 0.4s. Estimated remaining time: 4m 45s [2025-10-22T23:35:30.948830] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:30.967601] [DEBUG] [LOCAL ] OBK: Loaded 16363 existing records from primary storage. [2025-10-22T23:35:30.967767] [INFO ] [MAIN ] OBK: Loaded 16363 primary data records. [2025-10-22T23:35:31.274059] [DEBUG] [MAIN ] OBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:31.299403] [INFO ] [MAIN ] OBK: Generated 138 derivative records from 16363 primary records. [2025-10-22T23:35:31.299537] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-10-22T23:35:31.310684] [DEBUG] [LOCAL ] OBK: Derivative data saved (138 records). [2025-10-22T23:35:31.310771] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-10-22T23:35:31.313690] [INFO ] [MAIN ] Derivative Progress: 1328/2052 symbols. OBK took 0.4s. Estimated remaining time: 4m 45s [2025-10-22T23:35:31.313788] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:31.357210] [DEBUG] [LOCAL ] OC: Loaded 44899 existing records from primary storage. [2025-10-22T23:35:31.357393] [INFO ] [MAIN ] OC: Loaded 44899 primary data records. [2025-10-22T23:35:31.667163] [DEBUG] [MAIN ] OC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:35:31.692916] [INFO ] [MAIN ] OC: Generated 138 derivative records from 44899 primary records. [2025-10-22T23:35:31.693032] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-10-22T23:35:31.704473] [DEBUG] [LOCAL ] OC: Derivative data saved (138 records). [2025-10-22T23:35:31.704551] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-10-22T23:35:31.707394] [INFO ] [MAIN ] Derivative Progress: 1329/2052 symbols. OC took 0.4s. Estimated remaining time: 4m 45s [2025-10-22T23:35:31.707504] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:31.718570] [DEBUG] [LOCAL ] OCFT: Loaded 7090 existing records from primary storage. [2025-10-22T23:35:31.718725] [INFO ] [MAIN ] OCFT: Loaded 7090 primary data records. [2025-10-22T23:35:32.046582] [DEBUG] [MAIN ] OCFT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:32.071843] [INFO ] [MAIN ] OCFT: Generated 138 derivative records from 7090 primary records. [2025-10-22T23:35:32.071948] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-10-22T23:35:32.081524] [DEBUG] [LOCAL ] OCFT: Derivative data saved (138 records). [2025-10-22T23:35:32.081604] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-10-22T23:35:32.083820] [INFO ] [MAIN ] Derivative Progress: 1330/2052 symbols. OCFT took 0.4s. Estimated remaining time: 4m 44s [2025-10-22T23:35:32.083919] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:32.094780] [DEBUG] [LOCAL ] ODC: Loaded 8681 existing records from primary storage. [2025-10-22T23:35:32.094899] [INFO ] [MAIN ] ODC: Loaded 8681 primary data records. [2025-10-22T23:35:32.394794] [DEBUG] [MAIN ] ODC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:32.419535] [INFO ] [MAIN ] ODC: Generated 138 derivative records from 8681 primary records. [2025-10-22T23:35:32.419635] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-10-22T23:35:32.431090] [DEBUG] [LOCAL ] ODC: Derivative data saved (138 records). [2025-10-22T23:35:32.431168] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-10-22T23:35:32.433419] [INFO ] [MAIN ] Derivative Progress: 1331/2052 symbols. ODC took 0.3s. Estimated remaining time: 4m 44s [2025-10-22T23:35:32.433511] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:32.462623] [DEBUG] [LOCAL ] ODV: Loaded 30003 existing records from primary storage. [2025-10-22T23:35:32.462801] [INFO ] [MAIN ] ODV: Loaded 30003 primary data records. [2025-10-22T23:35:32.768758] [DEBUG] [MAIN ] ODV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:32.793506] [INFO ] [MAIN ] ODV: Generated 138 derivative records from 30003 primary records. [2025-10-22T23:35:32.793609] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-10-22T23:35:32.804806] [DEBUG] [LOCAL ] ODV: Derivative data saved (138 records). [2025-10-22T23:35:32.804884] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-10-22T23:35:32.807860] [INFO ] [MAIN ] Derivative Progress: 1332/2052 symbols. ODV took 0.4s. Estimated remaining time: 4m 43s [2025-10-22T23:35:32.807960] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:32.842125] [DEBUG] [LOCAL ] OEC: Loaded 37142 existing records from primary storage. [2025-10-22T23:35:32.842273] [INFO ] [MAIN ] OEC: Loaded 37142 primary data records. [2025-10-22T23:35:33.146131] [DEBUG] [MAIN ] OEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:33.171243] [INFO ] [MAIN ] OEC: Generated 138 derivative records from 37142 primary records. [2025-10-22T23:35:33.171352] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-10-22T23:35:33.182828] [DEBUG] [LOCAL ] OEC: Derivative data saved (138 records). [2025-10-22T23:35:33.182906] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-10-22T23:35:33.185939] [INFO ] [MAIN ] Derivative Progress: 1333/2052 symbols. OEC took 0.4s. Estimated remaining time: 4m 43s [2025-10-22T23:35:33.186049] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:33.206801] [DEBUG] [LOCAL ] OFG: Loaded 20595 existing records from primary storage. [2025-10-22T23:35:33.206941] [INFO ] [MAIN ] OFG: Loaded 20595 primary data records. [2025-10-22T23:35:33.509803] [DEBUG] [MAIN ] OFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:33.534672] [INFO ] [MAIN ] OFG: Generated 138 derivative records from 20595 primary records. [2025-10-22T23:35:33.534784] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-10-22T23:35:33.546178] [DEBUG] [LOCAL ] OFG: Derivative data saved (138 records). [2025-10-22T23:35:33.546256] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-10-22T23:35:33.549205] [INFO ] [MAIN ] Derivative Progress: 1334/2052 symbols. OFG took 0.4s. Estimated remaining time: 4m 43s [2025-10-22T23:35:33.549306] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:33.591130] [DEBUG] [LOCAL ] OGE: Loaded 45782 existing records from primary storage. [2025-10-22T23:35:33.591290] [INFO ] [MAIN ] OGE: Loaded 45782 primary data records. [2025-10-22T23:35:33.917224] [DEBUG] [MAIN ] OGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:33.942360] [INFO ] [MAIN ] OGE: Generated 138 derivative records from 45782 primary records. [2025-10-22T23:35:33.942469] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-10-22T23:35:33.953739] [DEBUG] [LOCAL ] OGE: Derivative data saved (138 records). [2025-10-22T23:35:33.953819] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-10-22T23:35:33.956596] [INFO ] [MAIN ] Derivative Progress: 1335/2052 symbols. OGE took 0.4s. Estimated remaining time: 4m 42s [2025-10-22T23:35:33.956731] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:34.006696] [DEBUG] [LOCAL ] OGN: Loaded 53117 existing records from primary storage. [2025-10-22T23:35:34.006858] [INFO ] [MAIN ] OGN: Loaded 53117 primary data records. [2025-10-22T23:35:34.309016] [DEBUG] [MAIN ] OGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:34.333727] [INFO ] [MAIN ] OGN: Generated 138 derivative records from 53117 primary records. [2025-10-22T23:35:34.333885] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-10-22T23:35:34.345279] [DEBUG] [LOCAL ] OGN: Derivative data saved (138 records). [2025-10-22T23:35:34.345358] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-10-22T23:35:34.348352] [INFO ] [MAIN ] Derivative Progress: 1336/2052 symbols. OGN took 0.4s. Estimated remaining time: 4m 42s [2025-10-22T23:35:34.348451] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:34.398883] [DEBUG] [LOCAL ] OHI: Loaded 51841 existing records from primary storage. [2025-10-22T23:35:34.399044] [INFO ] [MAIN ] OHI: Loaded 51841 primary data records. [2025-10-22T23:35:34.712467] [DEBUG] [MAIN ] OHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:34.738375] [INFO ] [MAIN ] OHI: Generated 138 derivative records from 51841 primary records. [2025-10-22T23:35:34.738511] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-10-22T23:35:34.750719] [DEBUG] [LOCAL ] OHI: Derivative data saved (138 records). [2025-10-22T23:35:34.750815] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-10-22T23:35:34.753926] [INFO ] [MAIN ] Derivative Progress: 1337/2052 symbols. OHI took 0.4s. Estimated remaining time: 4m 41s [2025-10-22T23:35:34.754024] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:34.801115] [DEBUG] [LOCAL ] OI: Loaded 47048 existing records from primary storage. [2025-10-22T23:35:34.801288] [INFO ] [MAIN ] OI: Loaded 47048 primary data records. [2025-10-22T23:35:35.106325] [DEBUG] [MAIN ] OI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:35.131134] [INFO ] [MAIN ] OI: Generated 138 derivative records from 47048 primary records. [2025-10-22T23:35:35.131242] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-10-22T23:35:35.142719] [DEBUG] [LOCAL ] OI: Derivative data saved (138 records). [2025-10-22T23:35:35.142806] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-10-22T23:35:35.145571] [INFO ] [MAIN ] Derivative Progress: 1338/2052 symbols. OI took 0.4s. Estimated remaining time: 4m 41s [2025-10-22T23:35:35.145698] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:35.161664] [DEBUG] [LOCAL ] OIA: Loaded 13047 existing records from primary storage. [2025-10-22T23:35:35.161800] [INFO ] [MAIN ] OIA: Loaded 13047 primary data records. [2025-10-22T23:35:35.462277] [DEBUG] [MAIN ] OIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:35.487029] [INFO ] [MAIN ] OIA: Generated 138 derivative records from 13047 primary records. [2025-10-22T23:35:35.487183] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-10-22T23:35:35.497966] [DEBUG] [LOCAL ] OIA: Derivative data saved (138 records). [2025-10-22T23:35:35.498045] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-10-22T23:35:35.500619] [INFO ] [MAIN ] Derivative Progress: 1339/2052 symbols. OIA took 0.4s. Estimated remaining time: 4m 41s [2025-10-22T23:35:35.500750] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:35.539735] [DEBUG] [LOCAL ] OII: Loaded 41819 existing records from primary storage. [2025-10-22T23:35:35.539896] [INFO ] [MAIN ] OII: Loaded 41819 primary data records. [2025-10-22T23:35:35.871046] [DEBUG] [MAIN ] OII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:35.896628] [INFO ] [MAIN ] OII: Generated 138 derivative records from 41819 primary records. [2025-10-22T23:35:35.896847] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-10-22T23:35:35.908295] [DEBUG] [LOCAL ] OII: Derivative data saved (138 records). [2025-10-22T23:35:35.908398] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-10-22T23:35:35.911378] [INFO ] [MAIN ] Derivative Progress: 1340/2052 symbols. OII took 0.4s. Estimated remaining time: 4m 40s [2025-10-22T23:35:35.911480] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:35.949010] [DEBUG] [LOCAL ] OIS: Loaded 39794 existing records from primary storage. [2025-10-22T23:35:35.949191] [INFO ] [MAIN ] OIS: Loaded 39794 primary data records. [2025-10-22T23:35:36.257489] [DEBUG] [MAIN ] OIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:36.282698] [INFO ] [MAIN ] OIS: Generated 138 derivative records from 39794 primary records. [2025-10-22T23:35:36.282898] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-10-22T23:35:36.294035] [DEBUG] [LOCAL ] OIS: Derivative data saved (138 records). [2025-10-22T23:35:36.294147] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-10-22T23:35:36.297183] [INFO ] [MAIN ] Derivative Progress: 1341/2052 symbols. OIS took 0.4s. Estimated remaining time: 4m 40s [2025-10-22T23:35:36.297332] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:36.349102] [DEBUG] [LOCAL ] OKE: Loaded 53576 existing records from primary storage. [2025-10-22T23:35:36.349284] [INFO ] [MAIN ] OKE: Loaded 53576 primary data records. [2025-10-22T23:35:36.654431] [DEBUG] [MAIN ] OKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:36.679384] [INFO ] [MAIN ] OKE: Generated 138 derivative records from 53576 primary records. [2025-10-22T23:35:36.679507] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-10-22T23:35:36.691082] [DEBUG] [LOCAL ] OKE: Derivative data saved (138 records). [2025-10-22T23:35:36.691177] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-10-22T23:35:36.694292] [INFO ] [MAIN ] Derivative Progress: 1342/2052 symbols. OKE took 0.4s. Estimated remaining time: 4m 39s [2025-10-22T23:35:36.694421] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:36.744331] [DEBUG] [LOCAL ] OLN: Loaded 52000 existing records from primary storage. [2025-10-22T23:35:36.744503] [INFO ] [MAIN ] OLN: Loaded 52000 primary data records. [2025-10-22T23:35:37.048844] [DEBUG] [MAIN ] OLN: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:35:37.075022] [INFO ] [MAIN ] OLN: Generated 138 derivative records from 52000 primary records. [2025-10-22T23:35:37.075151] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-10-22T23:35:37.087095] [DEBUG] [LOCAL ] OLN: Derivative data saved (138 records). [2025-10-22T23:35:37.087176] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-10-22T23:35:37.090402] [INFO ] [MAIN ] Derivative Progress: 1343/2052 symbols. OLN took 0.4s. Estimated remaining time: 4m 39s [2025-10-22T23:35:37.090507] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:37.104047] [DEBUG] [LOCAL ] OLP: Loaded 10043 existing records from primary storage. [2025-10-22T23:35:37.104180] [INFO ] [MAIN ] OLP: Loaded 10043 primary data records. [2025-10-22T23:35:37.407944] [DEBUG] [MAIN ] OLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:37.433046] [INFO ] [MAIN ] OLP: Generated 138 derivative records from 10043 primary records. [2025-10-22T23:35:37.433157] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-10-22T23:35:37.445063] [DEBUG] [LOCAL ] OLP: Derivative data saved (138 records). [2025-10-22T23:35:37.445144] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-10-22T23:35:37.447285] [INFO ] [MAIN ] Derivative Progress: 1344/2052 symbols. OLP took 0.4s. Estimated remaining time: 4m 39s [2025-10-22T23:35:37.447403] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:37.497579] [DEBUG] [LOCAL ] OMC: Loaded 53292 existing records from primary storage. [2025-10-22T23:35:37.497767] [INFO ] [MAIN ] OMC: Loaded 53292 primary data records. [2025-10-22T23:35:37.805917] [DEBUG] [MAIN ] OMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:37.831160] [INFO ] [MAIN ] OMC: Generated 138 derivative records from 53292 primary records. [2025-10-22T23:35:37.831285] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-10-22T23:35:37.842822] [DEBUG] [LOCAL ] OMC: Derivative data saved (138 records). [2025-10-22T23:35:37.842925] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-10-22T23:35:37.846056] [INFO ] [MAIN ] Derivative Progress: 1345/2052 symbols. OMC took 0.4s. Estimated remaining time: 4m 38s [2025-10-22T23:35:37.846172] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:37.889017] [DEBUG] [LOCAL ] OMF: Loaded 46434 existing records from primary storage. [2025-10-22T23:35:37.889190] [INFO ] [MAIN ] OMF: Loaded 46434 primary data records. [2025-10-22T23:35:38.213872] [DEBUG] [MAIN ] OMF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:38.239301] [INFO ] [MAIN ] OMF: Generated 138 derivative records from 46434 primary records. [2025-10-22T23:35:38.239410] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-10-22T23:35:38.250800] [DEBUG] [LOCAL ] OMF: Derivative data saved (138 records). [2025-10-22T23:35:38.250881] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-10-22T23:35:38.253630] [INFO ] [MAIN ] Derivative Progress: 1346/2052 symbols. OMF took 0.4s. Estimated remaining time: 4m 38s [2025-10-22T23:35:38.253759] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:38.296256] [DEBUG] [LOCAL ] OMI: Loaded 46218 existing records from primary storage. [2025-10-22T23:35:38.296429] [INFO ] [MAIN ] OMI: Loaded 46218 primary data records. [2025-10-22T23:35:38.597927] [DEBUG] [MAIN ] OMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:38.622946] [INFO ] [MAIN ] OMI: Generated 138 derivative records from 46218 primary records. [2025-10-22T23:35:38.623059] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-10-22T23:35:38.634148] [DEBUG] [LOCAL ] OMI: Derivative data saved (138 records). [2025-10-22T23:35:38.634228] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-10-22T23:35:38.637062] [INFO ] [MAIN ] Derivative Progress: 1347/2052 symbols. OMI took 0.4s. Estimated remaining time: 4m 37s [2025-10-22T23:35:38.637158] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:38.648505] [DEBUG] [LOCAL ] ONIT: Loaded 7526 existing records from primary storage. [2025-10-22T23:35:38.648638] [INFO ] [MAIN ] ONIT: Loaded 7526 primary data records. [2025-10-22T23:35:38.949102] [DEBUG] [MAIN ] ONIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:38.974046] [INFO ] [MAIN ] ONIT: Generated 138 derivative records from 7526 primary records. [2025-10-22T23:35:38.974202] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-10-22T23:35:38.985094] [DEBUG] [LOCAL ] ONIT: Derivative data saved (138 records). [2025-10-22T23:35:38.985171] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-10-22T23:35:38.987441] [INFO ] [MAIN ] Derivative Progress: 1348/2052 symbols. ONIT took 0.4s. Estimated remaining time: 4m 37s [2025-10-22T23:35:38.987537] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:39.014711] [DEBUG] [LOCAL ] ONL: Loaded 28911 existing records from primary storage. [2025-10-22T23:35:39.014868] [INFO ] [MAIN ] ONL: Loaded 28911 primary data records. [2025-10-22T23:35:39.319542] [DEBUG] [MAIN ] ONL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:39.344294] [INFO ] [MAIN ] ONL: Generated 138 derivative records from 28911 primary records. [2025-10-22T23:35:39.344413] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-10-22T23:35:39.355743] [DEBUG] [LOCAL ] ONL: Derivative data saved (138 records). [2025-10-22T23:35:39.355823] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-10-22T23:35:39.358794] [INFO ] [MAIN ] Derivative Progress: 1349/2052 symbols. ONL took 0.4s. Estimated remaining time: 4m 37s [2025-10-22T23:35:39.358892] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:39.412750] [DEBUG] [LOCAL ] ONON: Loaded 53613 existing records from primary storage. [2025-10-22T23:35:39.412925] [INFO ] [MAIN ] ONON: Loaded 53613 primary data records. [2025-10-22T23:35:39.718742] [DEBUG] [MAIN ] ONON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:39.743457] [INFO ] [MAIN ] ONON: Generated 138 derivative records from 53613 primary records. [2025-10-22T23:35:39.743600] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-10-22T23:35:39.755326] [DEBUG] [LOCAL ] ONON: Derivative data saved (138 records). [2025-10-22T23:35:39.755407] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-10-22T23:35:39.758757] [INFO ] [MAIN ] Derivative Progress: 1350/2052 symbols. ONON took 0.4s. Estimated remaining time: 4m 36s [2025-10-22T23:35:39.758857] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:39.782471] [DEBUG] [LOCAL ] ONTF: Loaded 22531 existing records from primary storage. [2025-10-22T23:35:39.782638] [INFO ] [MAIN ] ONTF: Loaded 22531 primary data records. [2025-10-22T23:35:40.122281] [DEBUG] [MAIN ] ONTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:40.148569] [INFO ] [MAIN ] ONTF: Generated 138 derivative records from 22531 primary records. [2025-10-22T23:35:40.148808] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-10-22T23:35:40.161284] [DEBUG] [LOCAL ] ONTF: Derivative data saved (138 records). [2025-10-22T23:35:40.161437] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-10-22T23:35:40.164476] [INFO ] [MAIN ] Derivative Progress: 1351/2052 symbols. ONTF took 0.4s. Estimated remaining time: 4m 36s [2025-10-22T23:35:40.164631] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:40.216410] [DEBUG] [LOCAL ] ONTO: Loaded 47210 existing records from primary storage. [2025-10-22T23:35:40.216585] [INFO ] [MAIN ] ONTO: Loaded 47210 primary data records. [2025-10-22T23:35:40.536196] [DEBUG] [MAIN ] ONTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:40.561669] [INFO ] [MAIN ] ONTO: Generated 138 derivative records from 47210 primary records. [2025-10-22T23:35:40.561790] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-10-22T23:35:40.573431] [DEBUG] [LOCAL ] ONTO: Derivative data saved (138 records). [2025-10-22T23:35:40.573508] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-10-22T23:35:40.576128] [INFO ] [MAIN ] Derivative Progress: 1352/2052 symbols. ONTO took 0.4s. Estimated remaining time: 4m 35s [2025-10-22T23:35:40.576226] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:40.596469] [DEBUG] [LOCAL ] OOMA: Loaded 18269 existing records from primary storage. [2025-10-22T23:35:40.596615] [INFO ] [MAIN ] OOMA: Loaded 18269 primary data records. [2025-10-22T23:35:40.901732] [DEBUG] [MAIN ] OOMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:40.927073] [INFO ] [MAIN ] OOMA: Generated 138 derivative records from 18269 primary records. [2025-10-22T23:35:40.927265] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-10-22T23:35:40.939040] [DEBUG] [LOCAL ] OOMA: Derivative data saved (138 records). [2025-10-22T23:35:40.939164] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-10-22T23:35:40.941955] [INFO ] [MAIN ] Derivative Progress: 1353/2052 symbols. OOMA took 0.4s. Estimated remaining time: 4m 35s [2025-10-22T23:35:40.942070] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:40.970058] [DEBUG] [LOCAL ] OPAD: Loaded 26424 existing records from primary storage. [2025-10-22T23:35:40.970234] [INFO ] [MAIN ] OPAD: Loaded 26424 primary data records. [2025-10-22T23:35:41.282317] [DEBUG] [MAIN ] OPAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:41.307428] [INFO ] [MAIN ] OPAD: Generated 138 derivative records from 26424 primary records. [2025-10-22T23:35:41.307589] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-10-22T23:35:41.318872] [DEBUG] [LOCAL ] OPAD: Derivative data saved (138 records). [2025-10-22T23:35:41.318951] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-10-22T23:35:41.321689] [INFO ] [MAIN ] Derivative Progress: 1354/2052 symbols. OPAD took 0.4s. Estimated remaining time: 4m 35s [2025-10-22T23:35:41.321785] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:41.365612] [DEBUG] [LOCAL ] OPFI: Loaded 46022 existing records from primary storage. [2025-10-22T23:35:41.365804] [INFO ] [MAIN ] OPFI: Loaded 46022 primary data records. [2025-10-22T23:35:41.666502] [DEBUG] [MAIN ] OPFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:41.691396] [INFO ] [MAIN ] OPFI: Generated 138 derivative records from 46022 primary records. [2025-10-22T23:35:41.691504] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-10-22T23:35:41.703044] [DEBUG] [LOCAL ] OPFI: Derivative data saved (138 records). [2025-10-22T23:35:41.703127] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-10-22T23:35:41.705753] [INFO ] [MAIN ] Derivative Progress: 1355/2052 symbols. OPFI took 0.4s. Estimated remaining time: 4m 34s [2025-10-22T23:35:41.705859] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:41.720796] [DEBUG] [LOCAL ] OPP: Loaded 12339 existing records from primary storage. [2025-10-22T23:35:41.720934] [INFO ] [MAIN ] OPP: Loaded 12339 primary data records. [2025-10-22T23:35:42.078396] [DEBUG] [MAIN ] OPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:42.110595] [INFO ] [MAIN ] OPP: Generated 138 derivative records from 12339 primary records. [2025-10-22T23:35:42.110746] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-10-22T23:35:42.123504] [DEBUG] [LOCAL ] OPP: Derivative data saved (138 records). [2025-10-22T23:35:42.123597] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-10-22T23:35:42.126558] [INFO ] [MAIN ] Derivative Progress: 1356/2052 symbols. OPP took 0.4s. Estimated remaining time: 4m 34s [2025-10-22T23:35:42.126746] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:42.174463] [DEBUG] [LOCAL ] OR: Loaded 46846 existing records from primary storage. [2025-10-22T23:35:42.174688] [INFO ] [MAIN ] OR: Loaded 46846 primary data records. [2025-10-22T23:35:42.494366] [DEBUG] [MAIN ] OR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:42.520884] [INFO ] [MAIN ] OR: Generated 138 derivative records from 46846 primary records. [2025-10-22T23:35:42.521085] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-10-22T23:35:42.532976] [DEBUG] [LOCAL ] OR: Derivative data saved (138 records). [2025-10-22T23:35:42.533112] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-10-22T23:35:42.535870] [INFO ] [MAIN ] Derivative Progress: 1357/2052 symbols. OR took 0.4s. Estimated remaining time: 4m 34s [2025-10-22T23:35:42.536019] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:42.569530] [DEBUG] [LOCAL ] ORA: Loaded 33147 existing records from primary storage. [2025-10-22T23:35:42.569741] [INFO ] [MAIN ] ORA: Loaded 33147 primary data records. [2025-10-22T23:35:42.899939] [DEBUG] [MAIN ] ORA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:42.926959] [INFO ] [MAIN ] ORA: Generated 138 derivative records from 33147 primary records. [2025-10-22T23:35:42.927091] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-10-22T23:35:42.938857] [DEBUG] [LOCAL ] ORA: Derivative data saved (138 records). [2025-10-22T23:35:42.938943] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-10-22T23:35:42.941870] [INFO ] [MAIN ] Derivative Progress: 1358/2052 symbols. ORA took 0.4s. Estimated remaining time: 4m 33s [2025-10-22T23:35:42.941973] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:42.992589] [DEBUG] [LOCAL ] ORC: Loaded 52479 existing records from primary storage. [2025-10-22T23:35:42.992791] [INFO ] [MAIN ] ORC: Loaded 52479 primary data records. [2025-10-22T23:35:43.299203] [DEBUG] [MAIN ] ORC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:43.324470] [INFO ] [MAIN ] ORC: Generated 138 derivative records from 52479 primary records. [2025-10-22T23:35:43.324669] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-10-22T23:35:43.335778] [DEBUG] [LOCAL ] ORC: Derivative data saved (138 records). [2025-10-22T23:35:43.335862] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-10-22T23:35:43.338912] [INFO ] [MAIN ] Derivative Progress: 1359/2052 symbols. ORC took 0.4s. Estimated remaining time: 4m 33s [2025-10-22T23:35:43.339007] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:43.368540] [DEBUG] [LOCAL ] ORN: Loaded 30727 existing records from primary storage. [2025-10-22T23:35:43.368748] [INFO ] [MAIN ] ORN: Loaded 30727 primary data records. [2025-10-22T23:35:43.677260] [DEBUG] [MAIN ] ORN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:43.702184] [INFO ] [MAIN ] ORN: Generated 138 derivative records from 30727 primary records. [2025-10-22T23:35:43.702346] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-10-22T23:35:43.713736] [DEBUG] [LOCAL ] ORN: Derivative data saved (138 records). [2025-10-22T23:35:43.713821] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-10-22T23:35:43.716537] [INFO ] [MAIN ] Derivative Progress: 1360/2052 symbols. ORN took 0.4s. Estimated remaining time: 4m 32s [2025-10-22T23:35:43.716637] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:43.774211] [DEBUG] [LOCAL ] OSCR: Loaded 53769 existing records from primary storage. [2025-10-22T23:35:43.774395] [INFO ] [MAIN ] OSCR: Loaded 53769 primary data records. [2025-10-22T23:35:44.144082] [DEBUG] [MAIN ] OSCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:44.169814] [INFO ] [MAIN ] OSCR: Generated 138 derivative records from 53769 primary records. [2025-10-22T23:35:44.169932] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-10-22T23:35:44.181544] [DEBUG] [LOCAL ] OSCR: Derivative data saved (138 records). [2025-10-22T23:35:44.181625] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-10-22T23:35:44.184698] [INFO ] [MAIN ] Derivative Progress: 1361/2052 symbols. OSCR took 0.5s. Estimated remaining time: 4m 32s [2025-10-22T23:35:44.184794] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:44.237918] [DEBUG] [LOCAL ] OTIS: Loaded 52700 existing records from primary storage. [2025-10-22T23:35:44.238081] [INFO ] [MAIN ] OTIS: Loaded 52700 primary data records. [2025-10-22T23:35:44.542909] [DEBUG] [MAIN ] OTIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:44.568536] [INFO ] [MAIN ] OTIS: Generated 138 derivative records from 52700 primary records. [2025-10-22T23:35:44.568690] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-10-22T23:35:44.580258] [DEBUG] [LOCAL ] OTIS: Derivative data saved (138 records). [2025-10-22T23:35:44.580335] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-10-22T23:35:44.583370] [INFO ] [MAIN ] Derivative Progress: 1362/2052 symbols. OTIS took 0.4s. Estimated remaining time: 4m 32s [2025-10-22T23:35:44.583463] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:44.628155] [DEBUG] [LOCAL ] OUT: Loaded 47687 existing records from primary storage. [2025-10-22T23:35:44.628317] [INFO ] [MAIN ] OUT: Loaded 47687 primary data records. [2025-10-22T23:35:44.935200] [DEBUG] [MAIN ] OUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:44.960582] [INFO ] [MAIN ] OUT: Generated 138 derivative records from 47687 primary records. [2025-10-22T23:35:44.960973] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-10-22T23:35:44.972525] [DEBUG] [LOCAL ] OUT: Derivative data saved (138 records). [2025-10-22T23:35:44.972613] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-10-22T23:35:44.975383] [INFO ] [MAIN ] Derivative Progress: 1363/2052 symbols. OUT took 0.4s. Estimated remaining time: 4m 31s [2025-10-22T23:35:44.975494] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:45.026968] [DEBUG] [LOCAL ] OVV: Loaded 53493 existing records from primary storage. [2025-10-22T23:35:45.027136] [INFO ] [MAIN ] OVV: Loaded 53493 primary data records. [2025-10-22T23:35:45.342835] [DEBUG] [MAIN ] OVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:45.368412] [INFO ] [MAIN ] OVV: Generated 138 derivative records from 53493 primary records. [2025-10-22T23:35:45.368562] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-10-22T23:35:45.380783] [DEBUG] [LOCAL ] OVV: Derivative data saved (138 records). [2025-10-22T23:35:45.380877] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-10-22T23:35:45.384083] [INFO ] [MAIN ] Derivative Progress: 1364/2052 symbols. OVV took 0.4s. Estimated remaining time: 4m 31s [2025-10-22T23:35:45.384213] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:45.437175] [DEBUG] [LOCAL ] OWL: Loaded 53560 existing records from primary storage. [2025-10-22T23:35:45.437368] [INFO ] [MAIN ] OWL: Loaded 53560 primary data records. [2025-10-22T23:35:45.750020] [DEBUG] [MAIN ] OWL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:45.775888] [INFO ] [MAIN ] OWL: Generated 138 derivative records from 53560 primary records. [2025-10-22T23:35:45.776065] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-10-22T23:35:45.787841] [DEBUG] [LOCAL ] OWL: Derivative data saved (138 records). [2025-10-22T23:35:45.787931] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-10-22T23:35:45.791116] [INFO ] [MAIN ] Derivative Progress: 1365/2052 symbols. OWL took 0.4s. Estimated remaining time: 4m 30s [2025-10-22T23:35:45.791236] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:45.804712] [DEBUG] [LOCAL ] OWLT: Loaded 9777 existing records from primary storage. [2025-10-22T23:35:45.804864] [INFO ] [MAIN ] OWLT: Loaded 9777 primary data records. [2025-10-22T23:35:46.115336] [DEBUG] [MAIN ] OWLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:46.140703] [INFO ] [MAIN ] OWLT: Generated 138 derivative records from 9777 primary records. [2025-10-22T23:35:46.140859] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-10-22T23:35:46.152074] [DEBUG] [LOCAL ] OWLT: Derivative data saved (138 records). [2025-10-22T23:35:46.152156] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-10-22T23:35:46.154298] [INFO ] [MAIN ] Derivative Progress: 1366/2052 symbols. OWLT took 0.4s. Estimated remaining time: 4m 30s [2025-10-22T23:35:46.154399] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:46.187815] [DEBUG] [LOCAL ] OXM: Loaded 33140 existing records from primary storage. [2025-10-22T23:35:46.187974] [INFO ] [MAIN ] OXM: Loaded 33140 primary data records. [2025-10-22T23:35:46.529683] [DEBUG] [MAIN ] OXM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:46.555759] [INFO ] [MAIN ] OXM: Generated 138 derivative records from 33140 primary records. [2025-10-22T23:35:46.555924] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-10-22T23:35:46.567307] [DEBUG] [LOCAL ] OXM: Derivative data saved (138 records). [2025-10-22T23:35:46.567399] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-10-22T23:35:46.570489] [INFO ] [MAIN ] Derivative Progress: 1367/2052 symbols. OXM took 0.4s. Estimated remaining time: 4m 30s [2025-10-22T23:35:46.570605] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:46.622496] [DEBUG] [LOCAL ] PAAS: Loaded 53625 existing records from primary storage. [2025-10-22T23:35:46.622707] [INFO ] [MAIN ] PAAS: Loaded 53625 primary data records. [2025-10-22T23:35:46.930833] [DEBUG] [MAIN ] PAAS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:46.956008] [INFO ] [MAIN ] PAAS: Generated 138 derivative records from 53625 primary records. [2025-10-22T23:35:46.956142] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-10-22T23:35:46.967833] [DEBUG] [LOCAL ] PAAS: Derivative data saved (138 records). [2025-10-22T23:35:46.967913] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-10-22T23:35:46.971060] [INFO ] [MAIN ] Derivative Progress: 1368/2052 symbols. PAAS took 0.4s. Estimated remaining time: 4m 29s [2025-10-22T23:35:46.971164] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:46.985999] [DEBUG] [LOCAL ] PAC: Loaded 11566 existing records from primary storage. [2025-10-22T23:35:46.986135] [INFO ] [MAIN ] PAC: Loaded 11566 primary data records. [2025-10-22T23:35:47.290358] [DEBUG] [MAIN ] PAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:47.315422] [INFO ] [MAIN ] PAC: Generated 138 derivative records from 11566 primary records. [2025-10-22T23:35:47.315591] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-10-22T23:35:47.327086] [DEBUG] [LOCAL ] PAC: Derivative data saved (138 records). [2025-10-22T23:35:47.327187] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-10-22T23:35:47.330014] [INFO ] [MAIN ] Derivative Progress: 1369/2052 symbols. PAC took 0.4s. Estimated remaining time: 4m 29s [2025-10-22T23:35:47.330133] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:47.360026] [DEBUG] [LOCAL ] PACK: Loaded 31862 existing records from primary storage. [2025-10-22T23:35:47.360195] [INFO ] [MAIN ] PACK: Loaded 31862 primary data records. [2025-10-22T23:35:47.673002] [DEBUG] [MAIN ] PACK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:47.697966] [INFO ] [MAIN ] PACK: Generated 138 derivative records from 31862 primary records. [2025-10-22T23:35:47.698159] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-10-22T23:35:47.709538] [DEBUG] [LOCAL ] PACK: Derivative data saved (138 records). [2025-10-22T23:35:47.709636] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-10-22T23:35:47.713143] [INFO ] [MAIN ] Derivative Progress: 1370/2052 symbols. PACK took 0.4s. Estimated remaining time: 4m 28s [2025-10-22T23:35:47.713276] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:47.747618] [DEBUG] [LOCAL ] PACS: Loaded 34769 existing records from primary storage. [2025-10-22T23:35:47.747808] [INFO ] [MAIN ] PACS: Loaded 34769 primary data records. [2025-10-22T23:35:48.056316] [DEBUG] [MAIN ] PACS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:48.081540] [INFO ] [MAIN ] PACS: Generated 138 derivative records from 34769 primary records. [2025-10-22T23:35:48.081700] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-10-22T23:35:48.093370] [DEBUG] [LOCAL ] PACS: Derivative data saved (138 records). [2025-10-22T23:35:48.093476] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-10-22T23:35:48.096549] [INFO ] [MAIN ] Derivative Progress: 1371/2052 symbols. PACS took 0.4s. Estimated remaining time: 4m 28s [2025-10-22T23:35:48.096706] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:48.120438] [DEBUG] [LOCAL ] PAG: Loaded 21200 existing records from primary storage. [2025-10-22T23:35:48.120616] [INFO ] [MAIN ] PAG: Loaded 21200 primary data records. [2025-10-22T23:35:48.509903] [DEBUG] [MAIN ] PAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:48.534937] [INFO ] [MAIN ] PAG: Generated 138 derivative records from 21200 primary records. [2025-10-22T23:35:48.535040] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-10-22T23:35:48.546443] [DEBUG] [LOCAL ] PAG: Derivative data saved (138 records). [2025-10-22T23:35:48.546521] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-10-22T23:35:48.549364] [INFO ] [MAIN ] Derivative Progress: 1372/2052 symbols. PAG took 0.5s. Estimated remaining time: 4m 28s [2025-10-22T23:35:48.549462] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:48.598630] [DEBUG] [LOCAL ] PAGS: Loaded 52806 existing records from primary storage. [2025-10-22T23:35:48.598822] [INFO ] [MAIN ] PAGS: Loaded 52806 primary data records. [2025-10-22T23:35:48.903891] [DEBUG] [MAIN ] PAGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:48.929044] [INFO ] [MAIN ] PAGS: Generated 138 derivative records from 52806 primary records. [2025-10-22T23:35:48.929152] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-10-22T23:35:48.940506] [DEBUG] [LOCAL ] PAGS: Derivative data saved (138 records). [2025-10-22T23:35:48.940586] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-10-22T23:35:48.943635] [INFO ] [MAIN ] Derivative Progress: 1373/2052 symbols. PAGS took 0.4s. Estimated remaining time: 4m 27s [2025-10-22T23:35:48.943753] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:48.949060] [DEBUG] [LOCAL ] PAI: Loaded 2830 existing records from primary storage. [2025-10-22T23:35:48.949148] [INFO ] [MAIN ] PAI: Loaded 2830 primary data records. [2025-10-22T23:35:49.250140] [DEBUG] [MAIN ] PAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:49.275229] [INFO ] [MAIN ] PAI: Generated 138 derivative records from 2830 primary records. [2025-10-22T23:35:49.275340] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-10-22T23:35:49.284983] [DEBUG] [LOCAL ] PAI: Derivative data saved (138 records). [2025-10-22T23:35:49.285062] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-10-22T23:35:49.287101] [INFO ] [MAIN ] Derivative Progress: 1374/2052 symbols. PAI took 0.3s. Estimated remaining time: 4m 27s [2025-10-22T23:35:49.287196] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:49.314385] [DEBUG] [LOCAL ] PAM: Loaded 29064 existing records from primary storage. [2025-10-22T23:35:49.314532] [INFO ] [MAIN ] PAM: Loaded 29064 primary data records. [2025-10-22T23:35:49.615628] [DEBUG] [MAIN ] PAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:49.640615] [INFO ] [MAIN ] PAM: Generated 138 derivative records from 29064 primary records. [2025-10-22T23:35:49.640767] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-10-22T23:35:49.652118] [DEBUG] [LOCAL ] PAM: Derivative data saved (138 records). [2025-10-22T23:35:49.652198] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-10-22T23:35:49.654988] [INFO ] [MAIN ] Derivative Progress: 1375/2052 symbols. PAM took 0.4s. Estimated remaining time: 4m 26s [2025-10-22T23:35:49.655082] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:49.687726] [DEBUG] [LOCAL ] PAR: Loaded 34300 existing records from primary storage. [2025-10-22T23:35:49.687873] [INFO ] [MAIN ] PAR: Loaded 34300 primary data records. [2025-10-22T23:35:49.997102] [DEBUG] [MAIN ] PAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:50.023219] [INFO ] [MAIN ] PAR: Generated 138 derivative records from 34300 primary records. [2025-10-22T23:35:50.023403] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-10-22T23:35:50.035158] [DEBUG] [LOCAL ] PAR: Derivative data saved (138 records). [2025-10-22T23:35:50.035244] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-10-22T23:35:50.038216] [INFO ] [MAIN ] Derivative Progress: 1376/2052 symbols. PAR took 0.4s. Estimated remaining time: 4m 26s [2025-10-22T23:35:50.038335] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:50.084300] [DEBUG] [LOCAL ] PARR: Loaded 47952 existing records from primary storage. [2025-10-22T23:35:50.084482] [INFO ] [MAIN ] PARR: Loaded 47952 primary data records. [2025-10-22T23:35:50.432928] [DEBUG] [MAIN ] PARR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:50.459449] [INFO ] [MAIN ] PARR: Generated 138 derivative records from 47952 primary records. [2025-10-22T23:35:50.459614] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-10-22T23:35:50.471633] [DEBUG] [LOCAL ] PARR: Derivative data saved (138 records). [2025-10-22T23:35:50.471739] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-10-22T23:35:50.474749] [INFO ] [MAIN ] Derivative Progress: 1377/2052 symbols. PARR took 0.4s. Estimated remaining time: 4m 26s [2025-10-22T23:35:50.474860] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:50.530273] [DEBUG] [LOCAL ] PATH: Loaded 53680 existing records from primary storage. [2025-10-22T23:35:50.530436] [INFO ] [MAIN ] PATH: Loaded 53680 primary data records. [2025-10-22T23:35:50.857724] [DEBUG] [MAIN ] PATH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:50.883373] [INFO ] [MAIN ] PATH: Generated 138 derivative records from 53680 primary records. [2025-10-22T23:35:50.883549] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-10-22T23:35:50.895661] [DEBUG] [LOCAL ] PATH: Derivative data saved (138 records). [2025-10-22T23:35:50.895760] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-10-22T23:35:50.898865] [INFO ] [MAIN ] Derivative Progress: 1378/2052 symbols. PATH took 0.4s. Estimated remaining time: 4m 25s [2025-10-22T23:35:50.898987] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:50.921709] [DEBUG] [LOCAL ] PAXS: Loaded 20921 existing records from primary storage. [2025-10-22T23:35:50.921865] [INFO ] [MAIN ] PAXS: Loaded 20921 primary data records. [2025-10-22T23:35:51.239249] [DEBUG] [MAIN ] PAXS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:51.264031] [INFO ] [MAIN ] PAXS: Generated 138 derivative records from 20921 primary records. [2025-10-22T23:35:51.264140] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-10-22T23:35:51.279840] [DEBUG] [LOCAL ] PAXS: Derivative data saved (138 records). [2025-10-22T23:35:51.280029] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-10-22T23:35:51.283600] [INFO ] [MAIN ] Derivative Progress: 1379/2052 symbols. PAXS took 0.4s. Estimated remaining time: 4m 25s [2025-10-22T23:35:51.283803] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:51.326826] [DEBUG] [LOCAL ] PAY: Loaded 38615 existing records from primary storage. [2025-10-22T23:35:51.326999] [INFO ] [MAIN ] PAY: Loaded 38615 primary data records. [2025-10-22T23:35:51.651383] [DEBUG] [MAIN ] PAY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:51.677684] [INFO ] [MAIN ] PAY: Generated 138 derivative records from 38615 primary records. [2025-10-22T23:35:51.677828] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-10-22T23:35:51.690150] [DEBUG] [LOCAL ] PAY: Derivative data saved (138 records). [2025-10-22T23:35:51.690239] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-10-22T23:35:51.693299] [INFO ] [MAIN ] Derivative Progress: 1380/2052 symbols. PAY took 0.4s. Estimated remaining time: 4m 25s [2025-10-22T23:35:51.693414] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:51.736015] [DEBUG] [LOCAL ] PAYC: Loaded 36051 existing records from primary storage. [2025-10-22T23:35:51.736201] [INFO ] [MAIN ] PAYC: Loaded 36051 primary data records. [2025-10-22T23:35:52.050065] [DEBUG] [MAIN ] PAYC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:35:52.075405] [INFO ] [MAIN ] PAYC: Generated 138 derivative records from 36051 primary records. [2025-10-22T23:35:52.075520] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-10-22T23:35:52.087225] [DEBUG] [LOCAL ] PAYC: Derivative data saved (138 records). [2025-10-22T23:35:52.087357] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-10-22T23:35:52.090200] [INFO ] [MAIN ] Derivative Progress: 1381/2052 symbols. PAYC took 0.4s. Estimated remaining time: 4m 24s [2025-10-22T23:35:52.090294] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:52.131549] [DEBUG] [LOCAL ] PB: Loaded 42332 existing records from primary storage. [2025-10-22T23:35:52.131741] [INFO ] [MAIN ] PB: Loaded 42332 primary data records. [2025-10-22T23:35:52.450472] [DEBUG] [MAIN ] PB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:52.475526] [INFO ] [MAIN ] PB: Generated 138 derivative records from 42332 primary records. [2025-10-22T23:35:52.475665] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-10-22T23:35:52.486948] [DEBUG] [LOCAL ] PB: Derivative data saved (138 records). [2025-10-22T23:35:52.487029] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-10-22T23:35:52.489950] [INFO ] [MAIN ] Derivative Progress: 1382/2052 symbols. PB took 0.4s. Estimated remaining time: 4m 24s [2025-10-22T23:35:52.490046] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:52.536954] [DEBUG] [LOCAL ] PBA: Loaded 49189 existing records from primary storage. [2025-10-22T23:35:52.537109] [INFO ] [MAIN ] PBA: Loaded 49189 primary data records. [2025-10-22T23:35:52.863499] [DEBUG] [MAIN ] PBA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:52.889103] [INFO ] [MAIN ] PBA: Generated 138 derivative records from 49189 primary records. [2025-10-22T23:35:52.889220] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-10-22T23:35:52.900607] [DEBUG] [LOCAL ] PBA: Derivative data saved (138 records). [2025-10-22T23:35:52.900710] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-10-22T23:35:52.903694] [INFO ] [MAIN ] Derivative Progress: 1383/2052 symbols. PBA took 0.4s. Estimated remaining time: 4m 23s [2025-10-22T23:35:52.903792] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:52.956860] [DEBUG] [LOCAL ] PBF: Loaded 53104 existing records from primary storage. [2025-10-22T23:35:52.957014] [INFO ] [MAIN ] PBF: Loaded 53104 primary data records. [2025-10-22T23:35:53.264873] [DEBUG] [MAIN ] PBF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:53.290596] [INFO ] [MAIN ] PBF: Generated 138 derivative records from 53104 primary records. [2025-10-22T23:35:53.290734] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-10-22T23:35:53.302438] [DEBUG] [LOCAL ] PBF: Derivative data saved (138 records). [2025-10-22T23:35:53.302516] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-10-22T23:35:53.305616] [INFO ] [MAIN ] Derivative Progress: 1384/2052 symbols. PBF took 0.4s. Estimated remaining time: 4m 23s [2025-10-22T23:35:53.305734] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:53.337479] [DEBUG] [LOCAL ] PBH: Loaded 32424 existing records from primary storage. [2025-10-22T23:35:53.337633] [INFO ] [MAIN ] PBH: Loaded 32424 primary data records. [2025-10-22T23:35:53.641112] [DEBUG] [MAIN ] PBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:53.666513] [INFO ] [MAIN ] PBH: Generated 138 derivative records from 32424 primary records. [2025-10-22T23:35:53.666626] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-10-22T23:35:53.678290] [DEBUG] [LOCAL ] PBH: Derivative data saved (138 records). [2025-10-22T23:35:53.678370] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-10-22T23:35:53.681339] [INFO ] [MAIN ] Derivative Progress: 1385/2052 symbols. PBH took 0.4s. Estimated remaining time: 4m 23s [2025-10-22T23:35:53.681436] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:53.731598] [DEBUG] [LOCAL ] PBI: Loaded 49986 existing records from primary storage. [2025-10-22T23:35:53.731799] [INFO ] [MAIN ] PBI: Loaded 49986 primary data records. [2025-10-22T23:35:54.037582] [DEBUG] [MAIN ] PBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:54.062705] [INFO ] [MAIN ] PBI: Generated 138 derivative records from 49986 primary records. [2025-10-22T23:35:54.062816] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-10-22T23:35:54.074572] [DEBUG] [LOCAL ] PBI: Derivative data saved (138 records). [2025-10-22T23:35:54.074680] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-10-22T23:35:54.077754] [INFO ] [MAIN ] Derivative Progress: 1386/2052 symbols. PBI took 0.4s. Estimated remaining time: 4m 22s [2025-10-22T23:35:54.077852] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:54.134261] [DEBUG] [LOCAL ] PBR: Loaded 53713 existing records from primary storage. [2025-10-22T23:35:54.134421] [INFO ] [MAIN ] PBR: Loaded 53713 primary data records. [2025-10-22T23:35:54.438442] [DEBUG] [MAIN ] PBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:54.463283] [INFO ] [MAIN ] PBR: Generated 138 derivative records from 53713 primary records. [2025-10-22T23:35:54.463445] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-10-22T23:35:54.475140] [DEBUG] [LOCAL ] PBR: Derivative data saved (138 records). [2025-10-22T23:35:54.475219] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-10-22T23:35:54.478309] [INFO ] [MAIN ] Derivative Progress: 1387/2052 symbols. PBR took 0.4s. Estimated remaining time: 4m 22s [2025-10-22T23:35:54.478404] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:54.498115] [DEBUG] [LOCAL ] PBT: Loaded 17314 existing records from primary storage. [2025-10-22T23:35:54.498257] [INFO ] [MAIN ] PBT: Loaded 17314 primary data records. [2025-10-22T23:35:54.825077] [DEBUG] [MAIN ] PBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:54.856013] [INFO ] [MAIN ] PBT: Generated 138 derivative records from 17314 primary records. [2025-10-22T23:35:54.856206] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-10-22T23:35:54.868289] [DEBUG] [LOCAL ] PBT: Derivative data saved (138 records). [2025-10-22T23:35:54.868372] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-10-22T23:35:54.871753] [INFO ] [MAIN ] Derivative Progress: 1388/2052 symbols. PBT took 0.4s. Estimated remaining time: 4m 21s [2025-10-22T23:35:54.871874] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:54.885853] [DEBUG] [LOCAL ] PCF: Loaded 9086 existing records from primary storage. [2025-10-22T23:35:54.885988] [INFO ] [MAIN ] PCF: Loaded 9086 primary data records. [2025-10-22T23:35:55.266070] [DEBUG] [MAIN ] PCF: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:35:55.299316] [INFO ] [MAIN ] PCF: Generated 138 derivative records from 9086 primary records. [2025-10-22T23:35:55.299547] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-10-22T23:35:55.313097] [DEBUG] [LOCAL ] PCF: Derivative data saved (138 records). [2025-10-22T23:35:55.313278] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-10-22T23:35:55.315909] [INFO ] [MAIN ] Derivative Progress: 1389/2052 symbols. PCF took 0.4s. Estimated remaining time: 4m 21s [2025-10-22T23:35:55.316097] [INFO ] [MAIN ] PCG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:55.393559] [DEBUG] [LOCAL ] PCG: Loaded 53719 existing records from primary storage. [2025-10-22T23:35:55.393826] [INFO ] [MAIN ] PCG: Loaded 53719 primary data records. [2025-10-22T23:35:55.805103] [DEBUG] [MAIN ] PCG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:55.837751] [INFO ] [MAIN ] PCG: Generated 138 derivative records from 53719 primary records. [2025-10-22T23:35:55.837979] [DEBUG] [LOCAL ] PCG: Saving derivative data. [2025-10-22T23:35:55.854213] [DEBUG] [LOCAL ] PCG: Derivative data saved (138 records). [2025-10-22T23:35:55.854378] [INFO ] [MAIN ] PCG: Successfully saved derivative data. [2025-10-22T23:35:55.857791] [INFO ] [MAIN ] Derivative Progress: 1390/2052 symbols. PCG took 0.5s. Estimated remaining time: 4m 21s [2025-10-22T23:35:55.857942] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:55.869603] [DEBUG] [LOCAL ] PCM: Loaded 6875 existing records from primary storage. [2025-10-22T23:35:55.869805] [INFO ] [MAIN ] PCM: Loaded 6875 primary data records. [2025-10-22T23:35:56.193114] [DEBUG] [MAIN ] PCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:56.218524] [INFO ] [MAIN ] PCM: Generated 138 derivative records from 6875 primary records. [2025-10-22T23:35:56.218693] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-10-22T23:35:56.229446] [DEBUG] [LOCAL ] PCM: Derivative data saved (138 records). [2025-10-22T23:35:56.229529] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-10-22T23:35:56.231637] [INFO ] [MAIN ] Derivative Progress: 1391/2052 symbols. PCM took 0.4s. Estimated remaining time: 4m 20s [2025-10-22T23:35:56.231771] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:56.258087] [DEBUG] [LOCAL ] PCN: Loaded 25332 existing records from primary storage. [2025-10-22T23:35:56.258236] [INFO ] [MAIN ] PCN: Loaded 25332 primary data records. [2025-10-22T23:35:56.559549] [DEBUG] [MAIN ] PCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:56.584600] [INFO ] [MAIN ] PCN: Generated 138 derivative records from 25332 primary records. [2025-10-22T23:35:56.584786] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-10-22T23:35:56.596201] [DEBUG] [LOCAL ] PCN: Derivative data saved (138 records). [2025-10-22T23:35:56.596285] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-10-22T23:35:56.599176] [INFO ] [MAIN ] Derivative Progress: 1392/2052 symbols. PCN took 0.4s. Estimated remaining time: 4m 20s [2025-10-22T23:35:56.599284] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:56.645775] [DEBUG] [LOCAL ] PCOR: Loaded 47461 existing records from primary storage. [2025-10-22T23:35:56.645998] [INFO ] [MAIN ] PCOR: Loaded 47461 primary data records. [2025-10-22T23:35:56.975171] [DEBUG] [MAIN ] PCOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:57.000618] [INFO ] [MAIN ] PCOR: Generated 138 derivative records from 47461 primary records. [2025-10-22T23:35:57.000858] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-10-22T23:35:57.012264] [DEBUG] [LOCAL ] PCOR: Derivative data saved (138 records). [2025-10-22T23:35:57.012362] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-10-22T23:35:57.015316] [INFO ] [MAIN ] Derivative Progress: 1393/2052 symbols. PCOR took 0.4s. Estimated remaining time: 4m 19s [2025-10-22T23:35:57.015417] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:57.029239] [DEBUG] [LOCAL ] PCQ: Loaded 12114 existing records from primary storage. [2025-10-22T23:35:57.029382] [INFO ] [MAIN ] PCQ: Loaded 12114 primary data records. [2025-10-22T23:35:57.347186] [DEBUG] [MAIN ] PCQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:57.372309] [INFO ] [MAIN ] PCQ: Generated 138 derivative records from 12114 primary records. [2025-10-22T23:35:57.372424] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-10-22T23:35:57.383141] [DEBUG] [LOCAL ] PCQ: Derivative data saved (138 records). [2025-10-22T23:35:57.383229] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-10-22T23:35:57.385895] [INFO ] [MAIN ] Derivative Progress: 1394/2052 symbols. PCQ took 0.4s. Estimated remaining time: 4m 19s [2025-10-22T23:35:57.385991] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:57.433527] [DEBUG] [LOCAL ] PD: Loaded 48330 existing records from primary storage. [2025-10-22T23:35:57.433717] [INFO ] [MAIN ] PD: Loaded 48330 primary data records. [2025-10-22T23:35:57.737953] [DEBUG] [MAIN ] PD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:57.763189] [INFO ] [MAIN ] PD: Generated 138 derivative records from 48330 primary records. [2025-10-22T23:35:57.763315] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-10-22T23:35:57.775089] [DEBUG] [LOCAL ] PD: Derivative data saved (138 records). [2025-10-22T23:35:57.775168] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-10-22T23:35:57.778111] [INFO ] [MAIN ] Derivative Progress: 1395/2052 symbols. PD took 0.4s. Estimated remaining time: 4m 19s [2025-10-22T23:35:57.778214] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:57.826890] [DEBUG] [LOCAL ] PDI: Loaded 50186 existing records from primary storage. [2025-10-22T23:35:57.827045] [INFO ] [MAIN ] PDI: Loaded 50186 primary data records. [2025-10-22T23:35:58.136801] [DEBUG] [MAIN ] PDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:58.162183] [INFO ] [MAIN ] PDI: Generated 138 derivative records from 50186 primary records. [2025-10-22T23:35:58.162295] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-10-22T23:35:58.174007] [DEBUG] [LOCAL ] PDI: Derivative data saved (138 records). [2025-10-22T23:35:58.174086] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-10-22T23:35:58.177031] [INFO ] [MAIN ] Derivative Progress: 1396/2052 symbols. PDI took 0.4s. Estimated remaining time: 4m 18s [2025-10-22T23:35:58.177130] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:58.215766] [DEBUG] [LOCAL ] PDM: Loaded 39741 existing records from primary storage. [2025-10-22T23:35:58.215925] [INFO ] [MAIN ] PDM: Loaded 39741 primary data records. [2025-10-22T23:35:58.546347] [DEBUG] [MAIN ] PDM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:58.575127] [INFO ] [MAIN ] PDM: Generated 138 derivative records from 39741 primary records. [2025-10-22T23:35:58.575359] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-10-22T23:35:58.587518] [DEBUG] [LOCAL ] PDM: Derivative data saved (138 records). [2025-10-22T23:35:58.587629] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-10-22T23:35:58.591985] [INFO ] [MAIN ] Derivative Progress: 1397/2052 symbols. PDM took 0.4s. Estimated remaining time: 4m 18s [2025-10-22T23:35:58.592124] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:58.628860] [DEBUG] [LOCAL ] PDO: Loaded 31375 existing records from primary storage. [2025-10-22T23:35:58.629089] [INFO ] [MAIN ] PDO: Loaded 31375 primary data records. [2025-10-22T23:35:59.055959] [DEBUG] [MAIN ] PDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:59.083526] [INFO ] [MAIN ] PDO: Generated 138 derivative records from 31375 primary records. [2025-10-22T23:35:59.083848] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-10-22T23:35:59.096373] [DEBUG] [LOCAL ] PDO: Derivative data saved (138 records). [2025-10-22T23:35:59.096550] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-10-22T23:35:59.100885] [INFO ] [MAIN ] Derivative Progress: 1398/2052 symbols. PDO took 0.5s. Estimated remaining time: 4m 18s [2025-10-22T23:35:59.101061] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:59.127002] [DEBUG] [LOCAL ] PDS: Loaded 16604 existing records from primary storage. [2025-10-22T23:35:59.127304] [INFO ] [MAIN ] PDS: Loaded 16604 primary data records. [2025-10-22T23:35:59.469855] [DEBUG] [MAIN ] PDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:59.497118] [INFO ] [MAIN ] PDS: Generated 138 derivative records from 16604 primary records. [2025-10-22T23:35:59.497419] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-10-22T23:35:59.509849] [DEBUG] [LOCAL ] PDS: Derivative data saved (138 records). [2025-10-22T23:35:59.509944] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-10-22T23:35:59.513843] [INFO ] [MAIN ] Derivative Progress: 1399/2052 symbols. PDS took 0.4s. Estimated remaining time: 4m 17s [2025-10-22T23:35:59.513960] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:59.538232] [DEBUG] [LOCAL ] PDT: Loaded 17437 existing records from primary storage. [2025-10-22T23:35:59.538453] [INFO ] [MAIN ] PDT: Loaded 17437 primary data records. [2025-10-22T23:35:59.893289] [DEBUG] [MAIN ] PDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:35:59.922285] [INFO ] [MAIN ] PDT: Generated 138 derivative records from 17437 primary records. [2025-10-22T23:35:59.922571] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-10-22T23:35:59.935502] [DEBUG] [LOCAL ] PDT: Derivative data saved (138 records). [2025-10-22T23:35:59.935726] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-10-22T23:35:59.940265] [INFO ] [MAIN ] Derivative Progress: 1400/2052 symbols. PDT took 0.4s. Estimated remaining time: 4m 17s [2025-10-22T23:35:59.940478] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:35:59.962699] [DEBUG] [LOCAL ] PDX: Loaded 14138 existing records from primary storage. [2025-10-22T23:35:59.962937] [INFO ] [MAIN ] PDX: Loaded 14138 primary data records. [2025-10-22T23:36:00.322321] [DEBUG] [MAIN ] PDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:00.352358] [INFO ] [MAIN ] PDX: Generated 138 derivative records from 14138 primary records. [2025-10-22T23:36:00.352845] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-10-22T23:36:00.366372] [DEBUG] [LOCAL ] PDX: Derivative data saved (138 records). [2025-10-22T23:36:00.366517] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-10-22T23:36:00.370896] [INFO ] [MAIN ] Derivative Progress: 1401/2052 symbols. PDX took 0.4s. Estimated remaining time: 4m 16s [2025-10-22T23:36:00.371063] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:00.434323] [DEBUG] [LOCAL ] PEB: Loaded 50732 existing records from primary storage. [2025-10-22T23:36:00.434582] [INFO ] [MAIN ] PEB: Loaded 50732 primary data records. [2025-10-22T23:36:00.807510] [DEBUG] [MAIN ] PEB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:00.837540] [INFO ] [MAIN ] PEB: Generated 138 derivative records from 50732 primary records. [2025-10-22T23:36:00.837810] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-10-22T23:36:00.850632] [DEBUG] [LOCAL ] PEB: Derivative data saved (138 records). [2025-10-22T23:36:00.850817] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-10-22T23:36:00.855547] [INFO ] [MAIN ] Derivative Progress: 1402/2052 symbols. PEB took 0.5s. Estimated remaining time: 4m 16s [2025-10-22T23:36:00.855728] [INFO ] [MAIN ] PEG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:00.918422] [DEBUG] [LOCAL ] PEG: Loaded 53124 existing records from primary storage. [2025-10-22T23:36:00.918722] [INFO ] [MAIN ] PEG: Loaded 53124 primary data records. [2025-10-22T23:36:01.264374] [DEBUG] [MAIN ] PEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:01.291900] [INFO ] [MAIN ] PEG: Generated 138 derivative records from 53124 primary records. [2025-10-22T23:36:01.292149] [DEBUG] [LOCAL ] PEG: Saving derivative data. [2025-10-22T23:36:01.304351] [DEBUG] [LOCAL ] PEG: Derivative data saved (138 records). [2025-10-22T23:36:01.304484] [INFO ] [MAIN ] PEG: Successfully saved derivative data. [2025-10-22T23:36:01.309125] [INFO ] [MAIN ] Derivative Progress: 1403/2052 symbols. PEG took 0.5s. Estimated remaining time: 4m 16s [2025-10-22T23:36:01.309283] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:01.344385] [DEBUG] [LOCAL ] PEN: Loaded 29554 existing records from primary storage. [2025-10-22T23:36:01.344613] [INFO ] [MAIN ] PEN: Loaded 29554 primary data records. [2025-10-22T23:36:01.766940] [DEBUG] [MAIN ] PEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:01.798620] [INFO ] [MAIN ] PEN: Generated 138 derivative records from 29554 primary records. [2025-10-22T23:36:01.798911] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-10-22T23:36:01.811908] [DEBUG] [LOCAL ] PEN: Derivative data saved (138 records). [2025-10-22T23:36:01.812059] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-10-22T23:36:01.816384] [INFO ] [MAIN ] Derivative Progress: 1404/2052 symbols. PEN took 0.5s. Estimated remaining time: 4m 15s [2025-10-22T23:36:01.816785] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:01.836780] [DEBUG] [LOCAL ] PEO: Loaded 11042 existing records from primary storage. [2025-10-22T23:36:01.837021] [INFO ] [MAIN ] PEO: Loaded 11042 primary data records. [2025-10-22T23:36:02.209800] [DEBUG] [MAIN ] PEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:02.236708] [INFO ] [MAIN ] PEO: Generated 138 derivative records from 11042 primary records. [2025-10-22T23:36:02.236976] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-10-22T23:36:02.249976] [DEBUG] [LOCAL ] PEO: Derivative data saved (138 records). [2025-10-22T23:36:02.250096] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-10-22T23:36:02.253423] [INFO ] [MAIN ] Derivative Progress: 1405/2052 symbols. PEO took 0.4s. Estimated remaining time: 4m 15s [2025-10-22T23:36:02.253555] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:02.274068] [DEBUG] [LOCAL ] PERF: Loaded 14512 existing records from primary storage. [2025-10-22T23:36:02.274281] [INFO ] [MAIN ] PERF: Loaded 14512 primary data records. [2025-10-22T23:36:02.610577] [DEBUG] [MAIN ] PERF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:02.639120] [INFO ] [MAIN ] PERF: Generated 138 derivative records from 14512 primary records. [2025-10-22T23:36:02.639399] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-10-22T23:36:02.651125] [DEBUG] [LOCAL ] PERF: Derivative data saved (138 records). [2025-10-22T23:36:02.651218] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-10-22T23:36:02.655371] [INFO ] [MAIN ] Derivative Progress: 1406/2052 symbols. PERF took 0.4s. Estimated remaining time: 4m 15s [2025-10-22T23:36:02.655491] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:02.666216] [DEBUG] [LOCAL ] PFD: Loaded 5349 existing records from primary storage. [2025-10-22T23:36:02.666369] [INFO ] [MAIN ] PFD: Loaded 5349 primary data records. [2025-10-22T23:36:02.995321] [DEBUG] [MAIN ] PFD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:03.020828] [INFO ] [MAIN ] PFD: Generated 138 derivative records from 5349 primary records. [2025-10-22T23:36:03.020972] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-10-22T23:36:03.031599] [DEBUG] [LOCAL ] PFD: Derivative data saved (138 records). [2025-10-22T23:36:03.031707] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-10-22T23:36:03.034080] [INFO ] [MAIN ] Derivative Progress: 1407/2052 symbols. PFD took 0.4s. Estimated remaining time: 4m 14s [2025-10-22T23:36:03.034202] [INFO ] [MAIN ] PFE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:03.093086] [DEBUG] [LOCAL ] PFE: Loaded 53813 existing records from primary storage. [2025-10-22T23:36:03.093260] [INFO ] [MAIN ] PFE: Loaded 53813 primary data records. [2025-10-22T23:36:03.418254] [DEBUG] [MAIN ] PFE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:03.445918] [INFO ] [MAIN ] PFE: Generated 138 derivative records from 53813 primary records. [2025-10-22T23:36:03.446104] [DEBUG] [LOCAL ] PFE: Saving derivative data. [2025-10-22T23:36:03.459104] [DEBUG] [LOCAL ] PFE: Derivative data saved (138 records). [2025-10-22T23:36:03.459244] [INFO ] [MAIN ] PFE: Successfully saved derivative data. [2025-10-22T23:36:03.462833] [INFO ] [MAIN ] Derivative Progress: 1408/2052 symbols. PFE took 0.4s. Estimated remaining time: 4m 14s [2025-10-22T23:36:03.462942] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:03.511040] [DEBUG] [LOCAL ] PFGC: Loaded 46794 existing records from primary storage. [2025-10-22T23:36:03.511225] [INFO ] [MAIN ] PFGC: Loaded 46794 primary data records. [2025-10-22T23:36:03.873514] [DEBUG] [MAIN ] PFGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:03.899542] [INFO ] [MAIN ] PFGC: Generated 138 derivative records from 46794 primary records. [2025-10-22T23:36:03.899721] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-10-22T23:36:03.911518] [DEBUG] [LOCAL ] PFGC: Derivative data saved (138 records). [2025-10-22T23:36:03.911612] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-10-22T23:36:03.914703] [INFO ] [MAIN ] Derivative Progress: 1409/2052 symbols. PFGC took 0.5s. Estimated remaining time: 4m 13s [2025-10-22T23:36:03.914800] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:03.925636] [DEBUG] [LOCAL ] PFH: Loaded 6414 existing records from primary storage. [2025-10-22T23:36:03.925778] [INFO ] [MAIN ] PFH: Loaded 6414 primary data records. [2025-10-22T23:36:04.237469] [DEBUG] [MAIN ] PFH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:04.264262] [INFO ] [MAIN ] PFH: Generated 138 derivative records from 6414 primary records. [2025-10-22T23:36:04.264444] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-10-22T23:36:04.275931] [DEBUG] [LOCAL ] PFH: Derivative data saved (138 records). [2025-10-22T23:36:04.276064] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-10-22T23:36:04.278398] [INFO ] [MAIN ] Derivative Progress: 1410/2052 symbols. PFH took 0.4s. Estimated remaining time: 4m 13s [2025-10-22T23:36:04.278533] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:04.295383] [DEBUG] [LOCAL ] PFL: Loaded 14446 existing records from primary storage. [2025-10-22T23:36:04.295562] [INFO ] [MAIN ] PFL: Loaded 14446 primary data records. [2025-10-22T23:36:04.603443] [DEBUG] [MAIN ] PFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:04.628688] [INFO ] [MAIN ] PFL: Generated 138 derivative records from 14446 primary records. [2025-10-22T23:36:04.628808] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-10-22T23:36:04.639749] [DEBUG] [LOCAL ] PFL: Derivative data saved (138 records). [2025-10-22T23:36:04.639834] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-10-22T23:36:04.642620] [INFO ] [MAIN ] Derivative Progress: 1411/2052 symbols. PFL took 0.4s. Estimated remaining time: 4m 13s [2025-10-22T23:36:04.642758] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:04.685668] [DEBUG] [LOCAL ] PFLT: Loaded 44240 existing records from primary storage. [2025-10-22T23:36:04.685829] [INFO ] [MAIN ] PFLT: Loaded 44240 primary data records. [2025-10-22T23:36:05.009518] [DEBUG] [MAIN ] PFLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:05.038332] [INFO ] [MAIN ] PFLT: Generated 138 derivative records from 44240 primary records. [2025-10-22T23:36:05.038516] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-10-22T23:36:05.050436] [DEBUG] [LOCAL ] PFLT: Derivative data saved (138 records). [2025-10-22T23:36:05.050537] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-10-22T23:36:05.053788] [INFO ] [MAIN ] Derivative Progress: 1412/2052 symbols. PFLT took 0.4s. Estimated remaining time: 4m 12s [2025-10-22T23:36:05.053896] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:05.078043] [DEBUG] [LOCAL ] PFN: Loaded 22150 existing records from primary storage. [2025-10-22T23:36:05.078203] [INFO ] [MAIN ] PFN: Loaded 22150 primary data records. [2025-10-22T23:36:05.386113] [DEBUG] [MAIN ] PFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:05.411788] [INFO ] [MAIN ] PFN: Generated 138 derivative records from 22150 primary records. [2025-10-22T23:36:05.411916] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-10-22T23:36:05.422956] [DEBUG] [LOCAL ] PFN: Derivative data saved (138 records). [2025-10-22T23:36:05.423041] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-10-22T23:36:05.425908] [INFO ] [MAIN ] Derivative Progress: 1413/2052 symbols. PFN took 0.4s. Estimated remaining time: 4m 12s [2025-10-22T23:36:05.426005] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:05.436015] [DEBUG] [LOCAL ] PFO: Loaded 6073 existing records from primary storage. [2025-10-22T23:36:05.436125] [INFO ] [MAIN ] PFO: Loaded 6073 primary data records. [2025-10-22T23:36:05.775145] [DEBUG] [MAIN ] PFO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:05.801376] [INFO ] [MAIN ] PFO: Generated 138 derivative records from 6073 primary records. [2025-10-22T23:36:05.801518] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-10-22T23:36:05.811926] [DEBUG] [LOCAL ] PFO: Derivative data saved (138 records). [2025-10-22T23:36:05.812007] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-10-22T23:36:05.814256] [INFO ] [MAIN ] Derivative Progress: 1414/2052 symbols. PFO took 0.4s. Estimated remaining time: 4m 11s [2025-10-22T23:36:05.814355] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:05.856001] [DEBUG] [LOCAL ] PFS: Loaded 35666 existing records from primary storage. [2025-10-22T23:36:05.856161] [INFO ] [MAIN ] PFS: Loaded 35666 primary data records. [2025-10-22T23:36:06.174930] [DEBUG] [MAIN ] PFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:06.200776] [INFO ] [MAIN ] PFS: Generated 138 derivative records from 35666 primary records. [2025-10-22T23:36:06.200945] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-10-22T23:36:06.212567] [DEBUG] [LOCAL ] PFS: Derivative data saved (138 records). [2025-10-22T23:36:06.212668] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-10-22T23:36:06.215950] [INFO ] [MAIN ] Derivative Progress: 1415/2052 symbols. PFS took 0.4s. Estimated remaining time: 4m 11s [2025-10-22T23:36:06.216058] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:06.245686] [DEBUG] [LOCAL ] PFSI: Loaded 29100 existing records from primary storage. [2025-10-22T23:36:06.245853] [INFO ] [MAIN ] PFSI: Loaded 29100 primary data records. [2025-10-22T23:36:06.556217] [DEBUG] [MAIN ] PFSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:06.582261] [INFO ] [MAIN ] PFSI: Generated 138 derivative records from 29100 primary records. [2025-10-22T23:36:06.582437] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-10-22T23:36:06.594305] [DEBUG] [LOCAL ] PFSI: Derivative data saved (138 records). [2025-10-22T23:36:06.594397] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-10-22T23:36:06.597492] [INFO ] [MAIN ] Derivative Progress: 1416/2052 symbols. PFSI took 0.4s. Estimated remaining time: 4m 11s [2025-10-22T23:36:06.597598] [INFO ] [MAIN ] PG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:06.655765] [DEBUG] [LOCAL ] PG: Loaded 53753 existing records from primary storage. [2025-10-22T23:36:06.655943] [INFO ] [MAIN ] PG: Loaded 53753 primary data records. [2025-10-22T23:36:06.968822] [DEBUG] [MAIN ] PG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:06.994679] [INFO ] [MAIN ] PG: Generated 138 derivative records from 53753 primary records. [2025-10-22T23:36:06.994839] [DEBUG] [LOCAL ] PG: Saving derivative data. [2025-10-22T23:36:07.006635] [DEBUG] [LOCAL ] PG: Derivative data saved (138 records). [2025-10-22T23:36:07.006768] [INFO ] [MAIN ] PG: Successfully saved derivative data. [2025-10-22T23:36:07.010233] [INFO ] [MAIN ] Derivative Progress: 1417/2052 symbols. PG took 0.4s. Estimated remaining time: 4m 10s [2025-10-22T23:36:07.010349] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:07.019847] [DEBUG] [LOCAL ] PGP: Loaded 5642 existing records from primary storage. [2025-10-22T23:36:07.019972] [INFO ] [MAIN ] PGP: Loaded 5642 primary data records. [2025-10-22T23:36:07.322122] [DEBUG] [MAIN ] PGP: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:36:07.347835] [INFO ] [MAIN ] PGP: Generated 138 derivative records from 5642 primary records. [2025-10-22T23:36:07.347978] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-10-22T23:36:07.358376] [DEBUG] [LOCAL ] PGP: Derivative data saved (138 records). [2025-10-22T23:36:07.358469] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-10-22T23:36:07.360959] [INFO ] [MAIN ] Derivative Progress: 1418/2052 symbols. PGP took 0.4s. Estimated remaining time: 4m 10s [2025-10-22T23:36:07.361094] [INFO ] [MAIN ] PGR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:07.415449] [DEBUG] [LOCAL ] PGR: Loaded 52867 existing records from primary storage. [2025-10-22T23:36:07.415637] [INFO ] [MAIN ] PGR: Loaded 52867 primary data records. [2025-10-22T23:36:07.730309] [DEBUG] [MAIN ] PGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:07.755392] [INFO ] [MAIN ] PGR: Generated 138 derivative records from 52867 primary records. [2025-10-22T23:36:07.755529] [DEBUG] [LOCAL ] PGR: Saving derivative data. [2025-10-22T23:36:07.767168] [DEBUG] [LOCAL ] PGR: Derivative data saved (138 records). [2025-10-22T23:36:07.767265] [INFO ] [MAIN ] PGR: Successfully saved derivative data. [2025-10-22T23:36:07.770759] [INFO ] [MAIN ] Derivative Progress: 1419/2052 symbols. PGR took 0.4s. Estimated remaining time: 4m 9s [2025-10-22T23:36:07.770876] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:07.815756] [DEBUG] [LOCAL ] PGRE: Loaded 46946 existing records from primary storage. [2025-10-22T23:36:07.815937] [INFO ] [MAIN ] PGRE: Loaded 46946 primary data records. [2025-10-22T23:36:08.143762] [DEBUG] [MAIN ] PGRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:08.170436] [INFO ] [MAIN ] PGRE: Generated 138 derivative records from 46946 primary records. [2025-10-22T23:36:08.170566] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-10-22T23:36:08.182757] [DEBUG] [LOCAL ] PGRE: Derivative data saved (138 records). [2025-10-22T23:36:08.182881] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-10-22T23:36:08.186049] [INFO ] [MAIN ] Derivative Progress: 1420/2052 symbols. PGRE took 0.4s. Estimated remaining time: 4m 9s [2025-10-22T23:36:08.186169] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:08.195937] [DEBUG] [LOCAL ] PGZ: Loaded 5498 existing records from primary storage. [2025-10-22T23:36:08.196092] [INFO ] [MAIN ] PGZ: Loaded 5498 primary data records. [2025-10-22T23:36:08.502341] [DEBUG] [MAIN ] PGZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:08.527183] [INFO ] [MAIN ] PGZ: Generated 138 derivative records from 5498 primary records. [2025-10-22T23:36:08.527347] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-10-22T23:36:08.538177] [DEBUG] [LOCAL ] PGZ: Derivative data saved (138 records). [2025-10-22T23:36:08.538271] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-10-22T23:36:08.540578] [INFO ] [MAIN ] Derivative Progress: 1421/2052 symbols. PGZ took 0.4s. Estimated remaining time: 4m 9s [2025-10-22T23:36:08.540708] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:08.579133] [DEBUG] [LOCAL ] PH: Loaded 36514 existing records from primary storage. [2025-10-22T23:36:08.579304] [INFO ] [MAIN ] PH: Loaded 36514 primary data records. [2025-10-22T23:36:08.883346] [DEBUG] [MAIN ] PH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:08.908594] [INFO ] [MAIN ] PH: Generated 138 derivative records from 36514 primary records. [2025-10-22T23:36:08.908972] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-10-22T23:36:08.920847] [DEBUG] [LOCAL ] PH: Derivative data saved (138 records). [2025-10-22T23:36:08.920950] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-10-22T23:36:08.924123] [INFO ] [MAIN ] Derivative Progress: 1422/2052 symbols. PH took 0.4s. Estimated remaining time: 4m 8s [2025-10-22T23:36:08.924233] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:08.973688] [DEBUG] [LOCAL ] PHG: Loaded 45475 existing records from primary storage. [2025-10-22T23:36:08.973872] [INFO ] [MAIN ] PHG: Loaded 45475 primary data records. [2025-10-22T23:36:09.287175] [DEBUG] [MAIN ] PHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:09.312510] [INFO ] [MAIN ] PHG: Generated 138 derivative records from 45475 primary records. [2025-10-22T23:36:09.312702] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-10-22T23:36:09.324484] [DEBUG] [LOCAL ] PHG: Derivative data saved (138 records). [2025-10-22T23:36:09.324568] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-10-22T23:36:09.328006] [INFO ] [MAIN ] Derivative Progress: 1423/2052 symbols. PHG took 0.4s. Estimated remaining time: 4m 8s [2025-10-22T23:36:09.328111] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:09.346264] [DEBUG] [LOCAL ] PHI: Loaded 15189 existing records from primary storage. [2025-10-22T23:36:09.346419] [INFO ] [MAIN ] PHI: Loaded 15189 primary data records. [2025-10-22T23:36:09.653667] [DEBUG] [MAIN ] PHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:09.680378] [INFO ] [MAIN ] PHI: Generated 138 derivative records from 15189 primary records. [2025-10-22T23:36:09.680594] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-10-22T23:36:09.691716] [DEBUG] [LOCAL ] PHI: Derivative data saved (138 records). [2025-10-22T23:36:09.691813] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-10-22T23:36:09.694686] [INFO ] [MAIN ] Derivative Progress: 1424/2052 symbols. PHI took 0.4s. Estimated remaining time: 4m 7s [2025-10-22T23:36:09.694841] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:09.725296] [DEBUG] [LOCAL ] PHIN: Loaded 31408 existing records from primary storage. [2025-10-22T23:36:09.725471] [INFO ] [MAIN ] PHIN: Loaded 31408 primary data records. [2025-10-22T23:36:10.064111] [DEBUG] [MAIN ] PHIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:10.090471] [INFO ] [MAIN ] PHIN: Generated 138 derivative records from 31408 primary records. [2025-10-22T23:36:10.090680] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-10-22T23:36:10.102425] [DEBUG] [LOCAL ] PHIN: Derivative data saved (138 records). [2025-10-22T23:36:10.102531] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-10-22T23:36:10.105633] [INFO ] [MAIN ] Derivative Progress: 1425/2052 symbols. PHIN took 0.4s. Estimated remaining time: 4m 7s [2025-10-22T23:36:10.105799] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:10.134032] [DEBUG] [LOCAL ] PHK: Loaded 26760 existing records from primary storage. [2025-10-22T23:36:10.134207] [INFO ] [MAIN ] PHK: Loaded 26760 primary data records. [2025-10-22T23:36:10.447562] [DEBUG] [MAIN ] PHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:10.472822] [INFO ] [MAIN ] PHK: Generated 138 derivative records from 26760 primary records. [2025-10-22T23:36:10.472955] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-10-22T23:36:10.484111] [DEBUG] [LOCAL ] PHK: Derivative data saved (138 records). [2025-10-22T23:36:10.484203] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-10-22T23:36:10.487222] [INFO ] [MAIN ] Derivative Progress: 1426/2052 symbols. PHK took 0.4s. Estimated remaining time: 4m 7s [2025-10-22T23:36:10.487348] [INFO ] [MAIN ] PHM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:10.541551] [DEBUG] [LOCAL ] PHM: Loaded 51691 existing records from primary storage. [2025-10-22T23:36:10.541754] [INFO ] [MAIN ] PHM: Loaded 51691 primary data records. [2025-10-22T23:36:10.852991] [DEBUG] [MAIN ] PHM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:10.878407] [INFO ] [MAIN ] PHM: Generated 138 derivative records from 51691 primary records. [2025-10-22T23:36:10.878561] [DEBUG] [LOCAL ] PHM: Saving derivative data. [2025-10-22T23:36:10.890401] [DEBUG] [LOCAL ] PHM: Derivative data saved (138 records). [2025-10-22T23:36:10.890502] [INFO ] [MAIN ] PHM: Successfully saved derivative data. [2025-10-22T23:36:10.893766] [INFO ] [MAIN ] Derivative Progress: 1427/2052 symbols. PHM took 0.4s. Estimated remaining time: 4m 6s [2025-10-22T23:36:10.893893] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:10.930984] [DEBUG] [LOCAL ] PHR: Loaded 37953 existing records from primary storage. [2025-10-22T23:36:10.931159] [INFO ] [MAIN ] PHR: Loaded 37953 primary data records. [2025-10-22T23:36:11.240616] [DEBUG] [MAIN ] PHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:11.266167] [INFO ] [MAIN ] PHR: Generated 138 derivative records from 37953 primary records. [2025-10-22T23:36:11.266318] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-10-22T23:36:11.278199] [DEBUG] [LOCAL ] PHR: Derivative data saved (138 records). [2025-10-22T23:36:11.278293] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-10-22T23:36:11.281295] [INFO ] [MAIN ] Derivative Progress: 1428/2052 symbols. PHR took 0.4s. Estimated remaining time: 4m 6s [2025-10-22T23:36:11.281417] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:11.328044] [DEBUG] [LOCAL ] PII: Loaded 48713 existing records from primary storage. [2025-10-22T23:36:11.328206] [INFO ] [MAIN ] PII: Loaded 48713 primary data records. [2025-10-22T23:36:11.633802] [DEBUG] [MAIN ] PII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:11.659519] [INFO ] [MAIN ] PII: Generated 138 derivative records from 48713 primary records. [2025-10-22T23:36:11.659701] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-10-22T23:36:11.671281] [DEBUG] [LOCAL ] PII: Derivative data saved (138 records). [2025-10-22T23:36:11.671403] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-10-22T23:36:11.674444] [INFO ] [MAIN ] Derivative Progress: 1429/2052 symbols. PII took 0.4s. Estimated remaining time: 4m 6s [2025-10-22T23:36:11.674548] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:11.683454] [DEBUG] [LOCAL ] PIM: Loaded 4846 existing records from primary storage. [2025-10-22T23:36:11.683595] [INFO ] [MAIN ] PIM: Loaded 4846 primary data records. [2025-10-22T23:36:12.037055] [DEBUG] [MAIN ] PIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:12.062712] [INFO ] [MAIN ] PIM: Generated 138 derivative records from 4846 primary records. [2025-10-22T23:36:12.062895] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-10-22T23:36:12.072820] [DEBUG] [LOCAL ] PIM: Derivative data saved (138 records). [2025-10-22T23:36:12.072920] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-10-22T23:36:12.075145] [INFO ] [MAIN ] Derivative Progress: 1430/2052 symbols. PIM took 0.4s. Estimated remaining time: 4m 5s [2025-10-22T23:36:12.075258] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:12.092834] [DEBUG] [LOCAL ] PINE: Loaded 14383 existing records from primary storage. [2025-10-22T23:36:12.093005] [INFO ] [MAIN ] PINE: Loaded 14383 primary data records. [2025-10-22T23:36:12.445562] [DEBUG] [MAIN ] PINE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:12.478981] [INFO ] [MAIN ] PINE: Generated 138 derivative records from 14383 primary records. [2025-10-22T23:36:12.479168] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-10-22T23:36:12.490735] [DEBUG] [LOCAL ] PINE: Derivative data saved (138 records). [2025-10-22T23:36:12.490814] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-10-22T23:36:12.493521] [INFO ] [MAIN ] Derivative Progress: 1431/2052 symbols. PINE took 0.4s. Estimated remaining time: 4m 5s [2025-10-22T23:36:12.493618] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:12.547144] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-10-22T23:36:12.547323] [INFO ] [MAIN ] PINS: Loaded 53693 primary data records. [2025-10-22T23:36:12.848404] [DEBUG] [MAIN ] PINS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:12.873438] [INFO ] [MAIN ] PINS: Generated 138 derivative records from 53693 primary records. [2025-10-22T23:36:12.873580] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-10-22T23:36:12.885174] [DEBUG] [LOCAL ] PINS: Derivative data saved (138 records). [2025-10-22T23:36:12.885253] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-10-22T23:36:12.888384] [INFO ] [MAIN ] Derivative Progress: 1432/2052 symbols. PINS took 0.4s. Estimated remaining time: 4m 4s [2025-10-22T23:36:12.888482] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:12.907789] [DEBUG] [LOCAL ] PIPR: Loaded 14992 existing records from primary storage. [2025-10-22T23:36:12.907922] [INFO ] [MAIN ] PIPR: Loaded 14992 primary data records. [2025-10-22T23:36:13.209285] [DEBUG] [MAIN ] PIPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:13.234577] [INFO ] [MAIN ] PIPR: Generated 138 derivative records from 14992 primary records. [2025-10-22T23:36:13.234749] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-10-22T23:36:13.246424] [DEBUG] [LOCAL ] PIPR: Derivative data saved (138 records). [2025-10-22T23:36:13.246506] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-10-22T23:36:13.249378] [INFO ] [MAIN ] Derivative Progress: 1433/2052 symbols. PIPR took 0.4s. Estimated remaining time: 4m 4s [2025-10-22T23:36:13.249481] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:13.272826] [DEBUG] [LOCAL ] PJT: Loaded 21211 existing records from primary storage. [2025-10-22T23:36:13.272971] [INFO ] [MAIN ] PJT: Loaded 21211 primary data records. [2025-10-22T23:36:13.575331] [DEBUG] [MAIN ] PJT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:36:13.600501] [INFO ] [MAIN ] PJT: Generated 138 derivative records from 21211 primary records. [2025-10-22T23:36:13.600617] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-10-22T23:36:13.612192] [DEBUG] [LOCAL ] PJT: Derivative data saved (138 records). [2025-10-22T23:36:13.612272] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-10-22T23:36:13.615065] [INFO ] [MAIN ] Derivative Progress: 1434/2052 symbols. PJT took 0.4s. Estimated remaining time: 4m 4s [2025-10-22T23:36:13.615165] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:13.668325] [DEBUG] [LOCAL ] PK: Loaded 52755 existing records from primary storage. [2025-10-22T23:36:13.668486] [INFO ] [MAIN ] PK: Loaded 52755 primary data records. [2025-10-22T23:36:14.005143] [DEBUG] [MAIN ] PK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:14.030547] [INFO ] [MAIN ] PK: Generated 138 derivative records from 52755 primary records. [2025-10-22T23:36:14.030746] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-10-22T23:36:14.042379] [DEBUG] [LOCAL ] PK: Derivative data saved (138 records). [2025-10-22T23:36:14.042460] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-10-22T23:36:14.045579] [INFO ] [MAIN ] Derivative Progress: 1435/2052 symbols. PK took 0.4s. Estimated remaining time: 4m 3s [2025-10-22T23:36:14.045726] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:14.063180] [DEBUG] [LOCAL ] PKE: Loaded 14290 existing records from primary storage. [2025-10-22T23:36:14.063329] [INFO ] [MAIN ] PKE: Loaded 14290 primary data records. [2025-10-22T23:36:14.365966] [DEBUG] [MAIN ] PKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:14.391526] [INFO ] [MAIN ] PKE: Generated 138 derivative records from 14290 primary records. [2025-10-22T23:36:14.391793] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-10-22T23:36:14.403203] [DEBUG] [LOCAL ] PKE: Derivative data saved (138 records). [2025-10-22T23:36:14.403281] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-10-22T23:36:14.405973] [INFO ] [MAIN ] Derivative Progress: 1436/2052 symbols. PKE took 0.4s. Estimated remaining time: 4m 3s [2025-10-22T23:36:14.406064] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:14.444673] [DEBUG] [LOCAL ] PKG: Loaded 38565 existing records from primary storage. [2025-10-22T23:36:14.444829] [INFO ] [MAIN ] PKG: Loaded 38565 primary data records. [2025-10-22T23:36:14.750310] [DEBUG] [MAIN ] PKG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:36:14.775596] [INFO ] [MAIN ] PKG: Generated 138 derivative records from 38565 primary records. [2025-10-22T23:36:14.775759] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-10-22T23:36:14.787546] [DEBUG] [LOCAL ] PKG: Derivative data saved (138 records). [2025-10-22T23:36:14.787690] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-10-22T23:36:14.790599] [INFO ] [MAIN ] Derivative Progress: 1437/2052 symbols. PKG took 0.4s. Estimated remaining time: 4m 2s [2025-10-22T23:36:14.790743] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:14.811095] [DEBUG] [LOCAL ] PKST: Loaded 18133 existing records from primary storage. [2025-10-22T23:36:14.811235] [INFO ] [MAIN ] PKST: Loaded 18133 primary data records. [2025-10-22T23:36:15.133205] [DEBUG] [MAIN ] PKST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:15.158918] [INFO ] [MAIN ] PKST: Generated 138 derivative records from 18133 primary records. [2025-10-22T23:36:15.159101] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-10-22T23:36:15.170907] [DEBUG] [LOCAL ] PKST: Derivative data saved (138 records). [2025-10-22T23:36:15.171020] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-10-22T23:36:15.173741] [INFO ] [MAIN ] Derivative Progress: 1438/2052 symbols. PKST took 0.4s. Estimated remaining time: 4m 2s [2025-10-22T23:36:15.173876] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:15.197684] [DEBUG] [LOCAL ] PKX: Loaded 22626 existing records from primary storage. [2025-10-22T23:36:15.197849] [INFO ] [MAIN ] PKX: Loaded 22626 primary data records. [2025-10-22T23:36:15.502399] [DEBUG] [MAIN ] PKX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:15.527392] [INFO ] [MAIN ] PKX: Generated 138 derivative records from 22626 primary records. [2025-10-22T23:36:15.527609] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-10-22T23:36:15.539181] [DEBUG] [LOCAL ] PKX: Derivative data saved (138 records). [2025-10-22T23:36:15.539314] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-10-22T23:36:15.542366] [INFO ] [MAIN ] Derivative Progress: 1439/2052 symbols. PKX took 0.4s. Estimated remaining time: 4m 2s [2025-10-22T23:36:15.542514] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:15.599027] [DEBUG] [LOCAL ] PL: Loaded 53212 existing records from primary storage. [2025-10-22T23:36:15.599194] [INFO ] [MAIN ] PL: Loaded 53212 primary data records. [2025-10-22T23:36:15.903200] [DEBUG] [MAIN ] PL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:15.928020] [INFO ] [MAIN ] PL: Generated 138 derivative records from 53212 primary records. [2025-10-22T23:36:15.928158] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-10-22T23:36:15.939702] [DEBUG] [LOCAL ] PL: Derivative data saved (138 records). [2025-10-22T23:36:15.939792] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-10-22T23:36:15.942906] [INFO ] [MAIN ] Derivative Progress: 1440/2052 symbols. PL took 0.4s. Estimated remaining time: 4m 1s [2025-10-22T23:36:15.943004] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:16.000891] [DEBUG] [LOCAL ] PLD: Loaded 53416 existing records from primary storage. [2025-10-22T23:36:16.001051] [INFO ] [MAIN ] PLD: Loaded 53416 primary data records. [2025-10-22T23:36:16.324269] [DEBUG] [MAIN ] PLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:16.349340] [INFO ] [MAIN ] PLD: Generated 138 derivative records from 53416 primary records. [2025-10-22T23:36:16.349522] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-10-22T23:36:16.361293] [DEBUG] [LOCAL ] PLD: Derivative data saved (138 records). [2025-10-22T23:36:16.361378] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-10-22T23:36:16.364518] [INFO ] [MAIN ] Derivative Progress: 1441/2052 symbols. PLD took 0.4s. Estimated remaining time: 4m 1s [2025-10-22T23:36:16.364633] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:16.414675] [DEBUG] [LOCAL ] PLNT: Loaded 48026 existing records from primary storage. [2025-10-22T23:36:16.414837] [INFO ] [MAIN ] PLNT: Loaded 48026 primary data records. [2025-10-22T23:36:16.757152] [DEBUG] [MAIN ] PLNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:16.785959] [INFO ] [MAIN ] PLNT: Generated 138 derivative records from 48026 primary records. [2025-10-22T23:36:16.786105] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-10-22T23:36:16.799660] [DEBUG] [LOCAL ] PLNT: Derivative data saved (138 records). [2025-10-22T23:36:16.799756] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-10-22T23:36:16.802928] [INFO ] [MAIN ] Derivative Progress: 1442/2052 symbols. PLNT took 0.4s. Estimated remaining time: 4m 0s [2025-10-22T23:36:16.803042] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:16.840306] [DEBUG] [LOCAL ] PLYM: Loaded 34435 existing records from primary storage. [2025-10-22T23:36:16.840467] [INFO ] [MAIN ] PLYM: Loaded 34435 primary data records. [2025-10-22T23:36:17.150895] [DEBUG] [MAIN ] PLYM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:17.176032] [INFO ] [MAIN ] PLYM: Generated 138 derivative records from 34435 primary records. [2025-10-22T23:36:17.176162] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-10-22T23:36:17.187680] [DEBUG] [LOCAL ] PLYM: Derivative data saved (138 records). [2025-10-22T23:36:17.187764] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-10-22T23:36:17.190562] [INFO ] [MAIN ] Derivative Progress: 1443/2052 symbols. PLYM took 0.4s. Estimated remaining time: 4m 0s [2025-10-22T23:36:17.190694] [INFO ] [MAIN ] PM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:17.247576] [DEBUG] [LOCAL ] PM: Loaded 53674 existing records from primary storage. [2025-10-22T23:36:17.247863] [INFO ] [MAIN ] PM: Loaded 53674 primary data records. [2025-10-22T23:36:17.561178] [DEBUG] [MAIN ] PM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:17.587376] [INFO ] [MAIN ] PM: Generated 138 derivative records from 53674 primary records. [2025-10-22T23:36:17.587535] [DEBUG] [LOCAL ] PM: Saving derivative data. [2025-10-22T23:36:17.599452] [DEBUG] [LOCAL ] PM: Derivative data saved (138 records). [2025-10-22T23:36:17.599534] [INFO ] [MAIN ] PM: Successfully saved derivative data. [2025-10-22T23:36:17.602737] [INFO ] [MAIN ] Derivative Progress: 1444/2052 symbols. PM took 0.4s. Estimated remaining time: 3m 60s [2025-10-22T23:36:17.602836] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:17.626289] [DEBUG] [LOCAL ] PML: Loaded 21888 existing records from primary storage. [2025-10-22T23:36:17.626445] [INFO ] [MAIN ] PML: Loaded 21888 primary data records. [2025-10-22T23:36:17.940539] [DEBUG] [MAIN ] PML: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:17.965827] [INFO ] [MAIN ] PML: Generated 138 derivative records from 21888 primary records. [2025-10-22T23:36:17.965989] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-10-22T23:36:17.976958] [DEBUG] [LOCAL ] PML: Derivative data saved (138 records). [2025-10-22T23:36:17.977055] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-10-22T23:36:17.979863] [INFO ] [MAIN ] Derivative Progress: 1445/2052 symbols. PML took 0.4s. Estimated remaining time: 3m 59s [2025-10-22T23:36:17.979972] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:17.993809] [DEBUG] [LOCAL ] PMM: Loaded 10032 existing records from primary storage. [2025-10-22T23:36:17.993955] [INFO ] [MAIN ] PMM: Loaded 10032 primary data records. [2025-10-22T23:36:18.326184] [DEBUG] [MAIN ] PMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:18.351340] [INFO ] [MAIN ] PMM: Generated 138 derivative records from 10032 primary records. [2025-10-22T23:36:18.351485] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-10-22T23:36:18.362232] [DEBUG] [LOCAL ] PMM: Derivative data saved (138 records). [2025-10-22T23:36:18.362319] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-10-22T23:36:18.364501] [INFO ] [MAIN ] Derivative Progress: 1446/2052 symbols. PMM took 0.4s. Estimated remaining time: 3m 59s [2025-10-22T23:36:18.364597] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:18.378061] [DEBUG] [LOCAL ] PMO: Loaded 9459 existing records from primary storage. [2025-10-22T23:36:18.378211] [INFO ] [MAIN ] PMO: Loaded 9459 primary data records. [2025-10-22T23:36:18.687102] [DEBUG] [MAIN ] PMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:18.712412] [INFO ] [MAIN ] PMO: Generated 138 derivative records from 9459 primary records. [2025-10-22T23:36:18.712559] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-10-22T23:36:18.723921] [DEBUG] [LOCAL ] PMO: Derivative data saved (138 records). [2025-10-22T23:36:18.724003] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-10-22T23:36:18.726257] [INFO ] [MAIN ] Derivative Progress: 1447/2052 symbols. PMO took 0.4s. Estimated remaining time: 3m 58s [2025-10-22T23:36:18.726348] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:18.765743] [DEBUG] [LOCAL ] PMT: Loaded 40705 existing records from primary storage. [2025-10-22T23:36:18.765905] [INFO ] [MAIN ] PMT: Loaded 40705 primary data records. [2025-10-22T23:36:19.070725] [DEBUG] [MAIN ] PMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:19.096104] [INFO ] [MAIN ] PMT: Generated 138 derivative records from 40705 primary records. [2025-10-22T23:36:19.096225] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-10-22T23:36:19.107637] [DEBUG] [LOCAL ] PMT: Derivative data saved (138 records). [2025-10-22T23:36:19.107738] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-10-22T23:36:19.110749] [INFO ] [MAIN ] Derivative Progress: 1448/2052 symbols. PMT took 0.4s. Estimated remaining time: 3m 58s [2025-10-22T23:36:19.110845] [INFO ] [MAIN ] PNC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:19.162145] [DEBUG] [LOCAL ] PNC: Loaded 52065 existing records from primary storage. [2025-10-22T23:36:19.162311] [INFO ] [MAIN ] PNC: Loaded 52065 primary data records. [2025-10-22T23:36:19.464898] [DEBUG] [MAIN ] PNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:19.490122] [INFO ] [MAIN ] PNC: Generated 138 derivative records from 52065 primary records. [2025-10-22T23:36:19.490250] [DEBUG] [LOCAL ] PNC: Saving derivative data. [2025-10-22T23:36:19.502000] [DEBUG] [LOCAL ] PNC: Derivative data saved (138 records). [2025-10-22T23:36:19.502080] [INFO ] [MAIN ] PNC: Successfully saved derivative data. [2025-10-22T23:36:19.505167] [INFO ] [MAIN ] Derivative Progress: 1449/2052 symbols. PNC took 0.4s. Estimated remaining time: 3m 58s [2025-10-22T23:36:19.505261] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:19.516075] [DEBUG] [LOCAL ] PNI: Loaded 6901 existing records from primary storage. [2025-10-22T23:36:19.516203] [INFO ] [MAIN ] PNI: Loaded 6901 primary data records. [2025-10-22T23:36:19.823157] [DEBUG] [MAIN ] PNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:19.847998] [INFO ] [MAIN ] PNI: Generated 138 derivative records from 6901 primary records. [2025-10-22T23:36:19.848116] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-10-22T23:36:19.858156] [DEBUG] [LOCAL ] PNI: Derivative data saved (138 records). [2025-10-22T23:36:19.858233] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-10-22T23:36:19.860339] [INFO ] [MAIN ] Derivative Progress: 1450/2052 symbols. PNI took 0.4s. Estimated remaining time: 3m 57s [2025-10-22T23:36:19.860445] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:19.892215] [DEBUG] [LOCAL ] PNNT: Loaded 33331 existing records from primary storage. [2025-10-22T23:36:19.892373] [INFO ] [MAIN ] PNNT: Loaded 33331 primary data records. [2025-10-22T23:36:20.230575] [DEBUG] [MAIN ] PNNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:20.262667] [INFO ] [MAIN ] PNNT: Generated 138 derivative records from 33331 primary records. [2025-10-22T23:36:20.262830] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-10-22T23:36:20.274027] [DEBUG] [LOCAL ] PNNT: Derivative data saved (138 records). [2025-10-22T23:36:20.274143] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-10-22T23:36:20.277082] [INFO ] [MAIN ] Derivative Progress: 1451/2052 symbols. PNNT took 0.4s. Estimated remaining time: 3m 57s [2025-10-22T23:36:20.277177] [INFO ] [MAIN ] PNR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:20.322824] [DEBUG] [LOCAL ] PNR: Loaded 47486 existing records from primary storage. [2025-10-22T23:36:20.322979] [INFO ] [MAIN ] PNR: Loaded 47486 primary data records. [2025-10-22T23:36:20.631080] [DEBUG] [MAIN ] PNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:20.655840] [INFO ] [MAIN ] PNR: Generated 138 derivative records from 47486 primary records. [2025-10-22T23:36:20.655951] [DEBUG] [LOCAL ] PNR: Saving derivative data. [2025-10-22T23:36:20.667762] [DEBUG] [LOCAL ] PNR: Derivative data saved (138 records). [2025-10-22T23:36:20.667858] [INFO ] [MAIN ] PNR: Successfully saved derivative data. [2025-10-22T23:36:20.670718] [INFO ] [MAIN ] Derivative Progress: 1452/2052 symbols. PNR took 0.4s. Estimated remaining time: 3m 56s [2025-10-22T23:36:20.670874] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:20.714384] [DEBUG] [LOCAL ] PNW: Loaded 45501 existing records from primary storage. [2025-10-22T23:36:20.714559] [INFO ] [MAIN ] PNW: Loaded 45501 primary data records. [2025-10-22T23:36:21.030842] [DEBUG] [MAIN ] PNW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:21.058081] [INFO ] [MAIN ] PNW: Generated 138 derivative records from 45501 primary records. [2025-10-22T23:36:21.058259] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-10-22T23:36:21.069749] [DEBUG] [LOCAL ] PNW: Derivative data saved (138 records). [2025-10-22T23:36:21.069833] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-10-22T23:36:21.072596] [INFO ] [MAIN ] Derivative Progress: 1453/2052 symbols. PNW took 0.4s. Estimated remaining time: 3m 56s [2025-10-22T23:36:21.072724] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:21.115695] [DEBUG] [LOCAL ] POR: Loaded 46735 existing records from primary storage. [2025-10-22T23:36:21.115854] [INFO ] [MAIN ] POR: Loaded 46735 primary data records. [2025-10-22T23:36:21.419109] [DEBUG] [MAIN ] POR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:21.444144] [INFO ] [MAIN ] POR: Generated 138 derivative records from 46735 primary records. [2025-10-22T23:36:21.444271] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-10-22T23:36:21.455770] [DEBUG] [LOCAL ] POR: Derivative data saved (138 records). [2025-10-22T23:36:21.455857] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-10-22T23:36:21.458738] [INFO ] [MAIN ] Derivative Progress: 1454/2052 symbols. POR took 0.4s. Estimated remaining time: 3m 56s [2025-10-22T23:36:21.458836] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:21.496307] [DEBUG] [LOCAL ] POST: Loaded 38443 existing records from primary storage. [2025-10-22T23:36:21.496479] [INFO ] [MAIN ] POST: Loaded 38443 primary data records. [2025-10-22T23:36:21.803439] [DEBUG] [MAIN ] POST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:21.829709] [INFO ] [MAIN ] POST: Generated 138 derivative records from 38443 primary records. [2025-10-22T23:36:21.829867] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-10-22T23:36:21.841416] [DEBUG] [LOCAL ] POST: Derivative data saved (138 records). [2025-10-22T23:36:21.841495] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-10-22T23:36:21.844443] [INFO ] [MAIN ] Derivative Progress: 1455/2052 symbols. POST took 0.4s. Estimated remaining time: 3m 55s [2025-10-22T23:36:21.844539] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:21.895189] [DEBUG] [LOCAL ] PPG: Loaded 50502 existing records from primary storage. [2025-10-22T23:36:21.895355] [INFO ] [MAIN ] PPG: Loaded 50502 primary data records. [2025-10-22T23:36:22.203185] [DEBUG] [MAIN ] PPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:22.228593] [INFO ] [MAIN ] PPG: Generated 138 derivative records from 50502 primary records. [2025-10-22T23:36:22.228774] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-10-22T23:36:22.240387] [DEBUG] [LOCAL ] PPG: Derivative data saved (138 records). [2025-10-22T23:36:22.240471] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-10-22T23:36:22.243684] [INFO ] [MAIN ] Derivative Progress: 1456/2052 symbols. PPG took 0.4s. Estimated remaining time: 3m 55s [2025-10-22T23:36:22.243778] [INFO ] [MAIN ] PPL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:22.294410] [DEBUG] [LOCAL ] PPL: Loaded 53505 existing records from primary storage. [2025-10-22T23:36:22.294572] [INFO ] [MAIN ] PPL: Loaded 53505 primary data records. [2025-10-22T23:36:22.621120] [DEBUG] [MAIN ] PPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:22.646141] [INFO ] [MAIN ] PPL: Generated 138 derivative records from 53505 primary records. [2025-10-22T23:36:22.646258] [DEBUG] [LOCAL ] PPL: Saving derivative data. [2025-10-22T23:36:22.657604] [DEBUG] [LOCAL ] PPL: Derivative data saved (138 records). [2025-10-22T23:36:22.657711] [INFO ] [MAIN ] PPL: Successfully saved derivative data. [2025-10-22T23:36:22.660860] [INFO ] [MAIN ] Derivative Progress: 1457/2052 symbols. PPL took 0.4s. Estimated remaining time: 3m 54s [2025-10-22T23:36:22.660954] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:22.682787] [DEBUG] [LOCAL ] PPT: Loaded 19701 existing records from primary storage. [2025-10-22T23:36:22.682938] [INFO ] [MAIN ] PPT: Loaded 19701 primary data records. [2025-10-22T23:36:22.989266] [DEBUG] [MAIN ] PPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:23.014046] [INFO ] [MAIN ] PPT: Generated 138 derivative records from 19701 primary records. [2025-10-22T23:36:23.014183] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-10-22T23:36:23.024980] [DEBUG] [LOCAL ] PPT: Derivative data saved (138 records). [2025-10-22T23:36:23.025060] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-10-22T23:36:23.027927] [INFO ] [MAIN ] Derivative Progress: 1458/2052 symbols. PPT took 0.4s. Estimated remaining time: 3m 54s [2025-10-22T23:36:23.028022] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:23.081719] [DEBUG] [LOCAL ] PR: Loaded 53611 existing records from primary storage. [2025-10-22T23:36:23.081873] [INFO ] [MAIN ] PR: Loaded 53611 primary data records. [2025-10-22T23:36:23.387148] [DEBUG] [MAIN ] PR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:23.412295] [INFO ] [MAIN ] PR: Generated 138 derivative records from 53611 primary records. [2025-10-22T23:36:23.412436] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-10-22T23:36:23.424426] [DEBUG] [LOCAL ] PR: Derivative data saved (138 records). [2025-10-22T23:36:23.424508] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-10-22T23:36:23.427830] [INFO ] [MAIN ] Derivative Progress: 1459/2052 symbols. PR took 0.4s. Estimated remaining time: 3m 54s [2025-10-22T23:36:23.427926] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:23.459787] [DEBUG] [LOCAL ] PRA: Loaded 34389 existing records from primary storage. [2025-10-22T23:36:23.459944] [INFO ] [MAIN ] PRA: Loaded 34389 primary data records. [2025-10-22T23:36:23.767955] [DEBUG] [MAIN ] PRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:23.792885] [INFO ] [MAIN ] PRA: Generated 138 derivative records from 34389 primary records. [2025-10-22T23:36:23.792982] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-10-22T23:36:23.804267] [DEBUG] [LOCAL ] PRA: Derivative data saved (138 records). [2025-10-22T23:36:23.804344] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-10-22T23:36:23.807279] [INFO ] [MAIN ] Derivative Progress: 1460/2052 symbols. PRA took 0.4s. Estimated remaining time: 3m 53s [2025-10-22T23:36:23.807378] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:23.812581] [DEBUG] [LOCAL ] PRCS: Loaded 2782 existing records from primary storage. [2025-10-22T23:36:23.812692] [INFO ] [MAIN ] PRCS: Loaded 2782 primary data records. [2025-10-22T23:36:24.141789] [DEBUG] [MAIN ] PRCS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:36:24.167855] [INFO ] [MAIN ] PRCS: Generated 138 derivative records from 2782 primary records. [2025-10-22T23:36:24.168068] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-10-22T23:36:24.177883] [DEBUG] [LOCAL ] PRCS: Derivative data saved (138 records). [2025-10-22T23:36:24.178008] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-10-22T23:36:24.180373] [INFO ] [MAIN ] Derivative Progress: 1461/2052 symbols. PRCS took 0.4s. Estimated remaining time: 3m 53s [2025-10-22T23:36:24.180480] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:24.210751] [DEBUG] [LOCAL ] PRG: Loaded 29701 existing records from primary storage. [2025-10-22T23:36:24.210919] [INFO ] [MAIN ] PRG: Loaded 29701 primary data records. [2025-10-22T23:36:24.548927] [DEBUG] [MAIN ] PRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:24.575051] [INFO ] [MAIN ] PRG: Generated 138 derivative records from 29701 primary records. [2025-10-22T23:36:24.575260] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-10-22T23:36:24.587073] [DEBUG] [LOCAL ] PRG: Derivative data saved (138 records). [2025-10-22T23:36:24.587218] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-10-22T23:36:24.590259] [INFO ] [MAIN ] Derivative Progress: 1462/2052 symbols. PRG took 0.4s. Estimated remaining time: 3m 52s [2025-10-22T23:36:24.590398] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:24.634584] [DEBUG] [LOCAL ] PRGO: Loaded 47131 existing records from primary storage. [2025-10-22T23:36:24.634797] [INFO ] [MAIN ] PRGO: Loaded 47131 primary data records. [2025-10-22T23:36:24.942286] [DEBUG] [MAIN ] PRGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:24.968508] [INFO ] [MAIN ] PRGO: Generated 138 derivative records from 47131 primary records. [2025-10-22T23:36:24.968717] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-10-22T23:36:24.980615] [DEBUG] [LOCAL ] PRGO: Derivative data saved (138 records). [2025-10-22T23:36:24.980756] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-10-22T23:36:24.983512] [INFO ] [MAIN ] Derivative Progress: 1463/2052 symbols. PRGO took 0.4s. Estimated remaining time: 3m 52s [2025-10-22T23:36:24.983620] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:24.992884] [DEBUG] [LOCAL ] PRH: Loaded 4687 existing records from primary storage. [2025-10-22T23:36:24.993236] [INFO ] [MAIN ] PRH: Loaded 4687 primary data records. [2025-10-22T23:36:25.304987] [DEBUG] [MAIN ] PRH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:25.333675] [INFO ] [MAIN ] PRH: Generated 138 derivative records from 4687 primary records. [2025-10-22T23:36:25.333844] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-10-22T23:36:25.344190] [DEBUG] [LOCAL ] PRH: Derivative data saved (138 records). [2025-10-22T23:36:25.344276] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-10-22T23:36:25.346344] [INFO ] [MAIN ] Derivative Progress: 1464/2052 symbols. PRH took 0.4s. Estimated remaining time: 3m 52s [2025-10-22T23:36:25.346441] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:25.364926] [DEBUG] [LOCAL ] PRI: Loaded 17709 existing records from primary storage. [2025-10-22T23:36:25.365066] [INFO ] [MAIN ] PRI: Loaded 17709 primary data records. [2025-10-22T23:36:25.668868] [DEBUG] [MAIN ] PRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:25.694055] [INFO ] [MAIN ] PRI: Generated 138 derivative records from 17709 primary records. [2025-10-22T23:36:25.694222] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-10-22T23:36:25.706027] [DEBUG] [LOCAL ] PRI: Derivative data saved (138 records). [2025-10-22T23:36:25.706117] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-10-22T23:36:25.709074] [INFO ] [MAIN ] Derivative Progress: 1465/2052 symbols. PRI took 0.4s. Estimated remaining time: 3m 51s [2025-10-22T23:36:25.709207] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:25.752466] [DEBUG] [LOCAL ] PRIM: Loaded 44097 existing records from primary storage. [2025-10-22T23:36:25.752625] [INFO ] [MAIN ] PRIM: Loaded 44097 primary data records. [2025-10-22T23:36:26.109970] [DEBUG] [MAIN ] PRIM: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:36:26.137137] [INFO ] [MAIN ] PRIM: Generated 138 derivative records from 44097 primary records. [2025-10-22T23:36:26.137335] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-10-22T23:36:26.149427] [DEBUG] [LOCAL ] PRIM: Derivative data saved (138 records). [2025-10-22T23:36:26.149519] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-10-22T23:36:26.152394] [INFO ] [MAIN ] Derivative Progress: 1466/2052 symbols. PRIM took 0.4s. Estimated remaining time: 3m 51s [2025-10-22T23:36:26.152500] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:26.191266] [DEBUG] [LOCAL ] PRKS: Loaded 42224 existing records from primary storage. [2025-10-22T23:36:26.191425] [INFO ] [MAIN ] PRKS: Loaded 42224 primary data records. [2025-10-22T23:36:26.544768] [DEBUG] [MAIN ] PRKS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:26.572082] [INFO ] [MAIN ] PRKS: Generated 138 derivative records from 42224 primary records. [2025-10-22T23:36:26.572245] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-10-22T23:36:26.584077] [DEBUG] [LOCAL ] PRKS: Derivative data saved (138 records). [2025-10-22T23:36:26.584175] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-10-22T23:36:26.587294] [INFO ] [MAIN ] Derivative Progress: 1467/2052 symbols. PRKS took 0.4s. Estimated remaining time: 3m 51s [2025-10-22T23:36:26.587428] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:26.609392] [DEBUG] [LOCAL ] PRLB: Loaded 20243 existing records from primary storage. [2025-10-22T23:36:26.609593] [INFO ] [MAIN ] PRLB: Loaded 20243 primary data records. [2025-10-22T23:36:26.933672] [DEBUG] [MAIN ] PRLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:26.963517] [INFO ] [MAIN ] PRLB: Generated 138 derivative records from 20243 primary records. [2025-10-22T23:36:26.963694] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-10-22T23:36:26.975234] [DEBUG] [LOCAL ] PRLB: Derivative data saved (138 records). [2025-10-22T23:36:26.975318] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-10-22T23:36:26.978351] [INFO ] [MAIN ] Derivative Progress: 1468/2052 symbols. PRLB took 0.4s. Estimated remaining time: 3m 50s [2025-10-22T23:36:26.978457] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:27.022180] [DEBUG] [LOCAL ] PRM: Loaded 44368 existing records from primary storage. [2025-10-22T23:36:27.022390] [INFO ] [MAIN ] PRM: Loaded 44368 primary data records. [2025-10-22T23:36:27.359879] [DEBUG] [MAIN ] PRM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:27.391151] [INFO ] [MAIN ] PRM: Generated 138 derivative records from 44368 primary records. [2025-10-22T23:36:27.391359] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-10-22T23:36:27.405211] [DEBUG] [LOCAL ] PRM: Derivative data saved (138 records). [2025-10-22T23:36:27.405363] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-10-22T23:36:27.408618] [INFO ] [MAIN ] Derivative Progress: 1469/2052 symbols. PRM took 0.4s. Estimated remaining time: 3m 50s [2025-10-22T23:36:27.408822] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:27.462979] [DEBUG] [LOCAL ] PRMB: Loaded 53101 existing records from primary storage. [2025-10-22T23:36:27.463150] [INFO ] [MAIN ] PRMB: Loaded 53101 primary data records. [2025-10-22T23:36:27.774022] [DEBUG] [MAIN ] PRMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:27.799595] [INFO ] [MAIN ] PRMB: Generated 138 derivative records from 53101 primary records. [2025-10-22T23:36:27.799770] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-10-22T23:36:27.812163] [DEBUG] [LOCAL ] PRMB: Derivative data saved (138 records). [2025-10-22T23:36:27.812244] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-10-22T23:36:27.815683] [INFO ] [MAIN ] Derivative Progress: 1470/2052 symbols. PRMB took 0.4s. Estimated remaining time: 3m 49s [2025-10-22T23:36:27.815803] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:27.856295] [DEBUG] [LOCAL ] PRO: Loaded 40143 existing records from primary storage. [2025-10-22T23:36:27.856458] [INFO ] [MAIN ] PRO: Loaded 40143 primary data records. [2025-10-22T23:36:28.173360] [DEBUG] [MAIN ] PRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:28.199412] [INFO ] [MAIN ] PRO: Generated 138 derivative records from 40143 primary records. [2025-10-22T23:36:28.199538] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-10-22T23:36:28.211153] [DEBUG] [LOCAL ] PRO: Derivative data saved (138 records). [2025-10-22T23:36:28.211237] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-10-22T23:36:28.214222] [INFO ] [MAIN ] Derivative Progress: 1471/2052 symbols. PRO took 0.4s. Estimated remaining time: 3m 49s [2025-10-22T23:36:28.214334] [INFO ] [MAIN ] PRSU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:28.238534] [DEBUG] [LOCAL ] PRSU: Loaded 23124 existing records from primary storage. [2025-10-22T23:36:28.238703] [INFO ] [MAIN ] PRSU: Loaded 23124 primary data records. [2025-10-22T23:36:28.591572] [DEBUG] [MAIN ] PRSU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:28.617234] [INFO ] [MAIN ] PRSU: Generated 138 derivative records from 23124 primary records. [2025-10-22T23:36:28.617437] [DEBUG] [LOCAL ] PRSU: Saving derivative data. [2025-10-22T23:36:28.628880] [DEBUG] [LOCAL ] PRSU: Derivative data saved (138 records). [2025-10-22T23:36:28.628961] [INFO ] [MAIN ] PRSU: Successfully saved derivative data. [2025-10-22T23:36:28.631805] [INFO ] [MAIN ] Derivative Progress: 1472/2052 symbols. PRSU took 0.4s. Estimated remaining time: 3m 49s [2025-10-22T23:36:28.631903] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:28.641407] [DEBUG] [LOCAL ] PRT: Loaded 5061 existing records from primary storage. [2025-10-22T23:36:28.641539] [INFO ] [MAIN ] PRT: Loaded 5061 primary data records. [2025-10-22T23:36:28.946531] [DEBUG] [MAIN ] PRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:28.972522] [INFO ] [MAIN ] PRT: Generated 138 derivative records from 5061 primary records. [2025-10-22T23:36:28.972703] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-10-22T23:36:28.983538] [DEBUG] [LOCAL ] PRT: Derivative data saved (138 records). [2025-10-22T23:36:28.983619] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-10-22T23:36:28.985852] [INFO ] [MAIN ] Derivative Progress: 1473/2052 symbols. PRT took 0.4s. Estimated remaining time: 3m 48s [2025-10-22T23:36:28.985946] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:29.038968] [DEBUG] [LOCAL ] PRU: Loaded 51171 existing records from primary storage. [2025-10-22T23:36:29.039132] [INFO ] [MAIN ] PRU: Loaded 51171 primary data records. [2025-10-22T23:36:29.357490] [DEBUG] [MAIN ] PRU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:29.383612] [INFO ] [MAIN ] PRU: Generated 138 derivative records from 51171 primary records. [2025-10-22T23:36:29.383768] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-10-22T23:36:29.395505] [DEBUG] [LOCAL ] PRU: Derivative data saved (138 records). [2025-10-22T23:36:29.395594] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-10-22T23:36:29.399078] [INFO ] [MAIN ] Derivative Progress: 1474/2052 symbols. PRU took 0.4s. Estimated remaining time: 3m 48s [2025-10-22T23:36:29.399188] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:29.440989] [DEBUG] [LOCAL ] PSA: Loaded 42093 existing records from primary storage. [2025-10-22T23:36:29.441146] [INFO ] [MAIN ] PSA: Loaded 42093 primary data records. [2025-10-22T23:36:29.755167] [DEBUG] [MAIN ] PSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:29.780914] [INFO ] [MAIN ] PSA: Generated 138 derivative records from 42093 primary records. [2025-10-22T23:36:29.781086] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-10-22T23:36:29.792842] [DEBUG] [LOCAL ] PSA: Derivative data saved (138 records). [2025-10-22T23:36:29.792941] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-10-22T23:36:29.796077] [INFO ] [MAIN ] Derivative Progress: 1475/2052 symbols. PSA took 0.4s. Estimated remaining time: 3m 47s [2025-10-22T23:36:29.796203] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:29.808527] [DEBUG] [LOCAL ] PSBD: Loaded 8246 existing records from primary storage. [2025-10-22T23:36:29.808705] [INFO ] [MAIN ] PSBD: Loaded 8246 primary data records. [2025-10-22T23:36:30.115629] [DEBUG] [MAIN ] PSBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:30.142444] [INFO ] [MAIN ] PSBD: Generated 138 derivative records from 8246 primary records. [2025-10-22T23:36:30.142673] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-10-22T23:36:30.154721] [DEBUG] [LOCAL ] PSBD: Derivative data saved (138 records). [2025-10-22T23:36:30.154882] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-10-22T23:36:30.157209] [INFO ] [MAIN ] Derivative Progress: 1476/2052 symbols. PSBD took 0.4s. Estimated remaining time: 3m 47s [2025-10-22T23:36:30.157356] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:30.168816] [DEBUG] [LOCAL ] PSF: Loaded 6947 existing records from primary storage. [2025-10-22T23:36:30.168988] [INFO ] [MAIN ] PSF: Loaded 6947 primary data records. [2025-10-22T23:36:30.479993] [DEBUG] [MAIN ] PSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:30.505135] [INFO ] [MAIN ] PSF: Generated 138 derivative records from 6947 primary records. [2025-10-22T23:36:30.505335] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-10-22T23:36:30.516491] [DEBUG] [LOCAL ] PSF: Derivative data saved (138 records). [2025-10-22T23:36:30.516602] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-10-22T23:36:30.518949] [INFO ] [MAIN ] Derivative Progress: 1477/2052 symbols. PSF took 0.4s. Estimated remaining time: 3m 47s [2025-10-22T23:36:30.519065] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:30.548927] [DEBUG] [LOCAL ] PSFE: Loaded 29574 existing records from primary storage. [2025-10-22T23:36:30.549097] [INFO ] [MAIN ] PSFE: Loaded 29574 primary data records. [2025-10-22T23:36:30.897949] [DEBUG] [MAIN ] PSFE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:30.924170] [INFO ] [MAIN ] PSFE: Generated 138 derivative records from 29574 primary records. [2025-10-22T23:36:30.924344] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-10-22T23:36:30.936184] [DEBUG] [LOCAL ] PSFE: Derivative data saved (138 records). [2025-10-22T23:36:30.936285] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-10-22T23:36:30.939199] [INFO ] [MAIN ] Derivative Progress: 1478/2052 symbols. PSFE took 0.4s. Estimated remaining time: 3m 46s [2025-10-22T23:36:30.939313] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:30.984509] [DEBUG] [LOCAL ] PSN: Loaded 45180 existing records from primary storage. [2025-10-22T23:36:30.984721] [INFO ] [MAIN ] PSN: Loaded 45180 primary data records. [2025-10-22T23:36:31.297895] [DEBUG] [MAIN ] PSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:31.324234] [INFO ] [MAIN ] PSN: Generated 138 derivative records from 45180 primary records. [2025-10-22T23:36:31.324454] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-10-22T23:36:31.336438] [DEBUG] [LOCAL ] PSN: Derivative data saved (138 records). [2025-10-22T23:36:31.336579] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-10-22T23:36:31.339758] [INFO ] [MAIN ] Derivative Progress: 1479/2052 symbols. PSN took 0.4s. Estimated remaining time: 3m 46s [2025-10-22T23:36:31.339900] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:31.379172] [DEBUG] [LOCAL ] PSO: Loaded 36655 existing records from primary storage. [2025-10-22T23:36:31.379361] [INFO ] [MAIN ] PSO: Loaded 36655 primary data records. [2025-10-22T23:36:31.703175] [DEBUG] [MAIN ] PSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:31.733949] [INFO ] [MAIN ] PSO: Generated 138 derivative records from 36655 primary records. [2025-10-22T23:36:31.734109] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-10-22T23:36:31.746586] [DEBUG] [LOCAL ] PSO: Derivative data saved (138 records). [2025-10-22T23:36:31.746694] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-10-22T23:36:31.750078] [INFO ] [MAIN ] Derivative Progress: 1480/2052 symbols. PSO took 0.4s. Estimated remaining time: 3m 45s [2025-10-22T23:36:31.750205] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:31.788846] [DEBUG] [LOCAL ] PSQH: Loaded 35401 existing records from primary storage. [2025-10-22T23:36:31.789006] [INFO ] [MAIN ] PSQH: Loaded 35401 primary data records. [2025-10-22T23:36:32.120930] [DEBUG] [MAIN ] PSQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:32.145988] [INFO ] [MAIN ] PSQH: Generated 138 derivative records from 35401 primary records. [2025-10-22T23:36:32.146128] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-10-22T23:36:32.157608] [DEBUG] [LOCAL ] PSQH: Derivative data saved (138 records). [2025-10-22T23:36:32.157709] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-10-22T23:36:32.160856] [INFO ] [MAIN ] Derivative Progress: 1481/2052 symbols. PSQH took 0.4s. Estimated remaining time: 3m 45s [2025-10-22T23:36:32.160972] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:32.212353] [DEBUG] [LOCAL ] PSTG: Loaded 52833 existing records from primary storage. [2025-10-22T23:36:32.212520] [INFO ] [MAIN ] PSTG: Loaded 52833 primary data records. [2025-10-22T23:36:32.517187] [DEBUG] [MAIN ] PSTG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:36:32.542525] [INFO ] [MAIN ] PSTG: Generated 138 derivative records from 52833 primary records. [2025-10-22T23:36:32.542686] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-10-22T23:36:32.554316] [DEBUG] [LOCAL ] PSTG: Derivative data saved (138 records). [2025-10-22T23:36:32.554398] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-10-22T23:36:32.557942] [INFO ] [MAIN ] Derivative Progress: 1482/2052 symbols. PSTG took 0.4s. Estimated remaining time: 3m 45s [2025-10-22T23:36:32.558068] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:32.580166] [DEBUG] [LOCAL ] PSTL: Loaded 19894 existing records from primary storage. [2025-10-22T23:36:32.580316] [INFO ] [MAIN ] PSTL: Loaded 19894 primary data records. [2025-10-22T23:36:32.908698] [DEBUG] [MAIN ] PSTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:32.933614] [INFO ] [MAIN ] PSTL: Generated 138 derivative records from 19894 primary records. [2025-10-22T23:36:32.933766] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-10-22T23:36:32.945372] [DEBUG] [LOCAL ] PSTL: Derivative data saved (138 records). [2025-10-22T23:36:32.945451] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-10-22T23:36:32.948326] [INFO ] [MAIN ] Derivative Progress: 1483/2052 symbols. PSTL took 0.4s. Estimated remaining time: 3m 44s [2025-10-22T23:36:32.948427] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:33.001707] [DEBUG] [LOCAL ] PSX: Loaded 53124 existing records from primary storage. [2025-10-22T23:36:33.001868] [INFO ] [MAIN ] PSX: Loaded 53124 primary data records. [2025-10-22T23:36:33.305328] [DEBUG] [MAIN ] PSX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:33.330337] [INFO ] [MAIN ] PSX: Generated 138 derivative records from 53124 primary records. [2025-10-22T23:36:33.330467] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-10-22T23:36:33.342488] [DEBUG] [LOCAL ] PSX: Derivative data saved (138 records). [2025-10-22T23:36:33.342569] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-10-22T23:36:33.345714] [INFO ] [MAIN ] Derivative Progress: 1484/2052 symbols. PSX took 0.4s. Estimated remaining time: 3m 44s [2025-10-22T23:36:33.345828] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:33.364128] [DEBUG] [LOCAL ] PTA: Loaded 15444 existing records from primary storage. [2025-10-22T23:36:33.364278] [INFO ] [MAIN ] PTA: Loaded 15444 primary data records. [2025-10-22T23:36:33.670736] [DEBUG] [MAIN ] PTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:33.696249] [INFO ] [MAIN ] PTA: Generated 138 derivative records from 15444 primary records. [2025-10-22T23:36:33.696384] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-10-22T23:36:33.707869] [DEBUG] [LOCAL ] PTA: Derivative data saved (138 records). [2025-10-22T23:36:33.707951] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-10-22T23:36:33.710634] [INFO ] [MAIN ] Derivative Progress: 1485/2052 symbols. PTA took 0.4s. Estimated remaining time: 3m 43s [2025-10-22T23:36:33.710774] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:33.747861] [DEBUG] [LOCAL ] PTY: Loaded 37908 existing records from primary storage. [2025-10-22T23:36:33.748020] [INFO ] [MAIN ] PTY: Loaded 37908 primary data records. [2025-10-22T23:36:34.052471] [DEBUG] [MAIN ] PTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:34.077511] [INFO ] [MAIN ] PTY: Generated 138 derivative records from 37908 primary records. [2025-10-22T23:36:34.077636] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-10-22T23:36:34.089431] [DEBUG] [LOCAL ] PTY: Derivative data saved (138 records). [2025-10-22T23:36:34.089519] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-10-22T23:36:34.092334] [INFO ] [MAIN ] Derivative Progress: 1486/2052 symbols. PTY took 0.4s. Estimated remaining time: 3m 43s [2025-10-22T23:36:34.092435] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:34.133576] [DEBUG] [LOCAL ] PUK: Loaded 44333 existing records from primary storage. [2025-10-22T23:36:34.133766] [INFO ] [MAIN ] PUK: Loaded 44333 primary data records. [2025-10-22T23:36:34.436098] [DEBUG] [MAIN ] PUK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:34.461363] [INFO ] [MAIN ] PUK: Generated 138 derivative records from 44333 primary records. [2025-10-22T23:36:34.461528] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-10-22T23:36:34.473353] [DEBUG] [LOCAL ] PUK: Derivative data saved (138 records). [2025-10-22T23:36:34.473438] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-10-22T23:36:34.476047] [INFO ] [MAIN ] Derivative Progress: 1487/2052 symbols. PUK took 0.4s. Estimated remaining time: 3m 43s [2025-10-22T23:36:34.476152] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:34.521203] [DEBUG] [LOCAL ] PUMP: Loaded 49434 existing records from primary storage. [2025-10-22T23:36:34.521371] [INFO ] [MAIN ] PUMP: Loaded 49434 primary data records. [2025-10-22T23:36:34.851744] [DEBUG] [MAIN ] PUMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:34.876736] [INFO ] [MAIN ] PUMP: Generated 138 derivative records from 49434 primary records. [2025-10-22T23:36:34.876865] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-10-22T23:36:34.888083] [DEBUG] [LOCAL ] PUMP: Derivative data saved (138 records). [2025-10-22T23:36:34.888178] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-10-22T23:36:34.891031] [INFO ] [MAIN ] Derivative Progress: 1488/2052 symbols. PUMP took 0.4s. Estimated remaining time: 3m 42s [2025-10-22T23:36:34.891136] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:34.939812] [DEBUG] [LOCAL ] PVH: Loaded 49508 existing records from primary storage. [2025-10-22T23:36:34.940024] [INFO ] [MAIN ] PVH: Loaded 49508 primary data records. [2025-10-22T23:36:35.284485] [DEBUG] [MAIN ] PVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:35.309447] [INFO ] [MAIN ] PVH: Generated 138 derivative records from 49508 primary records. [2025-10-22T23:36:35.309575] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-10-22T23:36:35.321111] [DEBUG] [LOCAL ] PVH: Derivative data saved (138 records). [2025-10-22T23:36:35.321253] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-10-22T23:36:35.324312] [INFO ] [MAIN ] Derivative Progress: 1489/2052 symbols. PVH took 0.4s. Estimated remaining time: 3m 42s [2025-10-22T23:36:35.324434] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:35.334183] [DEBUG] [LOCAL ] PVL: Loaded 4737 existing records from primary storage. [2025-10-22T23:36:35.334323] [INFO ] [MAIN ] PVL: Loaded 4737 primary data records. [2025-10-22T23:36:35.640244] [DEBUG] [MAIN ] PVL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:35.666684] [INFO ] [MAIN ] PVL: Generated 138 derivative records from 4737 primary records. [2025-10-22T23:36:35.666850] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-10-22T23:36:35.677175] [DEBUG] [LOCAL ] PVL: Derivative data saved (138 records). [2025-10-22T23:36:35.677292] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-10-22T23:36:35.679377] [INFO ] [MAIN ] Derivative Progress: 1490/2052 symbols. PVL took 0.4s. Estimated remaining time: 3m 41s [2025-10-22T23:36:35.679478] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:35.724767] [DEBUG] [LOCAL ] PWR: Loaded 46492 existing records from primary storage. [2025-10-22T23:36:35.724928] [INFO ] [MAIN ] PWR: Loaded 46492 primary data records. [2025-10-22T23:36:36.040242] [DEBUG] [MAIN ] PWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:36.065817] [INFO ] [MAIN ] PWR: Generated 138 derivative records from 46492 primary records. [2025-10-22T23:36:36.065979] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-10-22T23:36:36.077603] [DEBUG] [LOCAL ] PWR: Derivative data saved (138 records). [2025-10-22T23:36:36.077716] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-10-22T23:36:36.080585] [INFO ] [MAIN ] Derivative Progress: 1491/2052 symbols. PWR took 0.4s. Estimated remaining time: 3m 41s [2025-10-22T23:36:36.080730] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:36.114159] [DEBUG] [LOCAL ] PX: Loaded 33950 existing records from primary storage. [2025-10-22T23:36:36.114323] [INFO ] [MAIN ] PX: Loaded 33950 primary data records. [2025-10-22T23:36:36.433261] [DEBUG] [MAIN ] PX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:36.458301] [INFO ] [MAIN ] PX: Generated 138 derivative records from 33950 primary records. [2025-10-22T23:36:36.458414] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-10-22T23:36:36.470081] [DEBUG] [LOCAL ] PX: Derivative data saved (138 records). [2025-10-22T23:36:36.470165] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-10-22T23:36:36.473720] [INFO ] [MAIN ] Derivative Progress: 1492/2052 symbols. PX took 0.4s. Estimated remaining time: 3m 41s [2025-10-22T23:36:36.473875] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:36.501018] [DEBUG] [LOCAL ] QD: Loaded 27517 existing records from primary storage. [2025-10-22T23:36:36.501171] [INFO ] [MAIN ] QD: Loaded 27517 primary data records. [2025-10-22T23:36:36.807975] [DEBUG] [MAIN ] QD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:36.833100] [INFO ] [MAIN ] QD: Generated 138 derivative records from 27517 primary records. [2025-10-22T23:36:36.833247] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-10-22T23:36:36.844323] [DEBUG] [LOCAL ] QD: Derivative data saved (138 records). [2025-10-22T23:36:36.844410] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-10-22T23:36:36.847202] [INFO ] [MAIN ] Derivative Progress: 1493/2052 symbols. QD took 0.4s. Estimated remaining time: 3m 40s [2025-10-22T23:36:36.847321] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:36.892250] [DEBUG] [LOCAL ] QGEN: Loaded 49044 existing records from primary storage. [2025-10-22T23:36:36.892409] [INFO ] [MAIN ] QGEN: Loaded 49044 primary data records. [2025-10-22T23:36:37.214589] [DEBUG] [MAIN ] QGEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:37.239430] [INFO ] [MAIN ] QGEN: Generated 138 derivative records from 49044 primary records. [2025-10-22T23:36:37.239547] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-10-22T23:36:37.250877] [DEBUG] [LOCAL ] QGEN: Derivative data saved (138 records). [2025-10-22T23:36:37.250958] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-10-22T23:36:37.253893] [INFO ] [MAIN ] Derivative Progress: 1494/2052 symbols. QGEN took 0.4s. Estimated remaining time: 3m 40s [2025-10-22T23:36:37.253989] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:37.305765] [DEBUG] [LOCAL ] QS: Loaded 53760 existing records from primary storage. [2025-10-22T23:36:37.305924] [INFO ] [MAIN ] QS: Loaded 53760 primary data records. [2025-10-22T23:36:37.610402] [DEBUG] [MAIN ] QS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:37.635193] [INFO ] [MAIN ] QS: Generated 138 derivative records from 53760 primary records. [2025-10-22T23:36:37.635306] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-10-22T23:36:37.646816] [DEBUG] [LOCAL ] QS: Derivative data saved (138 records). [2025-10-22T23:36:37.646896] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-10-22T23:36:37.649947] [INFO ] [MAIN ] Derivative Progress: 1495/2052 symbols. QS took 0.4s. Estimated remaining time: 3m 39s [2025-10-22T23:36:37.650051] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:37.701175] [DEBUG] [LOCAL ] QSR: Loaded 52450 existing records from primary storage. [2025-10-22T23:36:37.701333] [INFO ] [MAIN ] QSR: Loaded 52450 primary data records. [2025-10-22T23:36:38.003916] [DEBUG] [MAIN ] QSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:38.028880] [INFO ] [MAIN ] QSR: Generated 138 derivative records from 52450 primary records. [2025-10-22T23:36:38.028978] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-10-22T23:36:38.040357] [DEBUG] [LOCAL ] QSR: Derivative data saved (138 records). [2025-10-22T23:36:38.040444] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-10-22T23:36:38.043447] [INFO ] [MAIN ] Derivative Progress: 1496/2052 symbols. QSR took 0.4s. Estimated remaining time: 3m 39s [2025-10-22T23:36:38.043539] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:38.080055] [DEBUG] [LOCAL ] QTWO: Loaded 39446 existing records from primary storage. [2025-10-22T23:36:38.080211] [INFO ] [MAIN ] QTWO: Loaded 39446 primary data records. [2025-10-22T23:36:38.389002] [DEBUG] [MAIN ] QTWO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:38.414482] [INFO ] [MAIN ] QTWO: Generated 138 derivative records from 39446 primary records. [2025-10-22T23:36:38.414679] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-10-22T23:36:38.426895] [DEBUG] [LOCAL ] QTWO: Derivative data saved (138 records). [2025-10-22T23:36:38.426977] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-10-22T23:36:38.429911] [INFO ] [MAIN ] Derivative Progress: 1497/2052 symbols. QTWO took 0.4s. Estimated remaining time: 3m 39s [2025-10-22T23:36:38.430011] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:38.453011] [DEBUG] [LOCAL ] QUAD: Loaded 22988 existing records from primary storage. [2025-10-22T23:36:38.453160] [INFO ] [MAIN ] QUAD: Loaded 22988 primary data records. [2025-10-22T23:36:38.756943] [DEBUG] [MAIN ] QUAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:38.782013] [INFO ] [MAIN ] QUAD: Generated 138 derivative records from 22988 primary records. [2025-10-22T23:36:38.782148] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-10-22T23:36:38.793278] [DEBUG] [LOCAL ] QUAD: Derivative data saved (138 records). [2025-10-22T23:36:38.793355] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-10-22T23:36:38.796097] [INFO ] [MAIN ] Derivative Progress: 1498/2052 symbols. QUAD took 0.4s. Estimated remaining time: 3m 38s [2025-10-22T23:36:38.796194] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:38.808492] [DEBUG] [LOCAL ] QVCC: Loaded 8694 existing records from primary storage. [2025-10-22T23:36:38.808633] [INFO ] [MAIN ] QVCC: Loaded 8694 primary data records. [2025-10-22T23:36:39.133577] [DEBUG] [MAIN ] QVCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:39.158696] [INFO ] [MAIN ] QVCC: Generated 138 derivative records from 8694 primary records. [2025-10-22T23:36:39.158847] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-10-22T23:36:39.170126] [DEBUG] [LOCAL ] QVCC: Derivative data saved (138 records). [2025-10-22T23:36:39.170211] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-10-22T23:36:39.172261] [INFO ] [MAIN ] Derivative Progress: 1499/2052 symbols. QVCC took 0.4s. Estimated remaining time: 3m 38s [2025-10-22T23:36:39.172353] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:39.180840] [DEBUG] [LOCAL ] QVCD: Loaded 4565 existing records from primary storage. [2025-10-22T23:36:39.180946] [INFO ] [MAIN ] QVCD: Loaded 4565 primary data records. [2025-10-22T23:36:39.480778] [DEBUG] [MAIN ] QVCD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:39.505975] [INFO ] [MAIN ] QVCD: Generated 138 derivative records from 4565 primary records. [2025-10-22T23:36:39.506094] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-10-22T23:36:39.516004] [DEBUG] [LOCAL ] QVCD: Derivative data saved (138 records). [2025-10-22T23:36:39.516082] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-10-22T23:36:39.518179] [INFO ] [MAIN ] Derivative Progress: 1500/2052 symbols. QVCD took 0.3s. Estimated remaining time: 3m 37s [2025-10-22T23:36:39.518272] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:39.570894] [DEBUG] [LOCAL ] QXO: Loaded 53475 existing records from primary storage. [2025-10-22T23:36:39.571059] [INFO ] [MAIN ] QXO: Loaded 53475 primary data records. [2025-10-22T23:36:39.871835] [DEBUG] [MAIN ] QXO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:36:39.897170] [INFO ] [MAIN ] QXO: Generated 138 derivative records from 53475 primary records. [2025-10-22T23:36:39.897311] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-10-22T23:36:39.908894] [DEBUG] [LOCAL ] QXO: Derivative data saved (138 records). [2025-10-22T23:36:39.908972] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-10-22T23:36:39.912162] [INFO ] [MAIN ] Derivative Progress: 1501/2052 symbols. QXO took 0.4s. Estimated remaining time: 3m 37s [2025-10-22T23:36:39.912259] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:39.944277] [DEBUG] [LOCAL ] R: Loaded 27881 existing records from primary storage. [2025-10-22T23:36:39.944439] [INFO ] [MAIN ] R: Loaded 27881 primary data records. [2025-10-22T23:36:40.248639] [DEBUG] [MAIN ] R: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:40.273576] [INFO ] [MAIN ] R: Generated 138 derivative records from 27881 primary records. [2025-10-22T23:36:40.273710] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-10-22T23:36:40.285309] [DEBUG] [LOCAL ] R: Derivative data saved (138 records). [2025-10-22T23:36:40.285397] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-10-22T23:36:40.288113] [INFO ] [MAIN ] Derivative Progress: 1502/2052 symbols. R took 0.4s. Estimated remaining time: 3m 37s [2025-10-22T23:36:40.288208] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:40.310858] [DEBUG] [LOCAL ] RA: Loaded 21871 existing records from primary storage. [2025-10-22T23:36:40.311003] [INFO ] [MAIN ] RA: Loaded 21871 primary data records. [2025-10-22T23:36:40.614309] [DEBUG] [MAIN ] RA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:40.639207] [INFO ] [MAIN ] RA: Generated 138 derivative records from 21871 primary records. [2025-10-22T23:36:40.639327] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-10-22T23:36:40.650912] [DEBUG] [LOCAL ] RA: Derivative data saved (138 records). [2025-10-22T23:36:40.650993] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-10-22T23:36:40.653747] [INFO ] [MAIN ] Derivative Progress: 1503/2052 symbols. RA took 0.4s. Estimated remaining time: 3m 36s [2025-10-22T23:36:40.653846] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:40.687762] [DEBUG] [LOCAL ] RACE: Loaded 32943 existing records from primary storage. [2025-10-22T23:36:40.687918] [INFO ] [MAIN ] RACE: Loaded 32943 primary data records. [2025-10-22T23:36:41.018566] [DEBUG] [MAIN ] RACE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:41.043824] [INFO ] [MAIN ] RACE: Generated 138 derivative records from 32943 primary records. [2025-10-22T23:36:41.043970] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-10-22T23:36:41.055375] [DEBUG] [LOCAL ] RACE: Derivative data saved (138 records). [2025-10-22T23:36:41.055473] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-10-22T23:36:41.058422] [INFO ] [MAIN ] Derivative Progress: 1504/2052 symbols. RACE took 0.4s. Estimated remaining time: 3m 36s [2025-10-22T23:36:41.058552] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:41.094882] [DEBUG] [LOCAL ] RAMP: Loaded 37664 existing records from primary storage. [2025-10-22T23:36:41.095047] [INFO ] [MAIN ] RAMP: Loaded 37664 primary data records. [2025-10-22T23:36:41.402968] [DEBUG] [MAIN ] RAMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:41.428318] [INFO ] [MAIN ] RAMP: Generated 138 derivative records from 37664 primary records. [2025-10-22T23:36:41.428480] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-10-22T23:36:41.440245] [DEBUG] [LOCAL ] RAMP: Derivative data saved (138 records). [2025-10-22T23:36:41.440339] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-10-22T23:36:41.443269] [INFO ] [MAIN ] Derivative Progress: 1505/2052 symbols. RAMP took 0.4s. Estimated remaining time: 3m 36s [2025-10-22T23:36:41.443372] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:41.488539] [DEBUG] [LOCAL ] RBA: Loaded 46060 existing records from primary storage. [2025-10-22T23:36:41.488735] [INFO ] [MAIN ] RBA: Loaded 46060 primary data records. [2025-10-22T23:36:41.814196] [DEBUG] [MAIN ] RBA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:41.841551] [INFO ] [MAIN ] RBA: Generated 138 derivative records from 46060 primary records. [2025-10-22T23:36:41.841790] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-10-22T23:36:41.853830] [DEBUG] [LOCAL ] RBA: Derivative data saved (138 records). [2025-10-22T23:36:41.853950] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-10-22T23:36:41.856845] [INFO ] [MAIN ] Derivative Progress: 1506/2052 symbols. RBA took 0.4s. Estimated remaining time: 3m 35s [2025-10-22T23:36:41.856990] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:41.875784] [DEBUG] [LOCAL ] RBC: Loaded 15288 existing records from primary storage. [2025-10-22T23:36:41.875948] [INFO ] [MAIN ] RBC: Loaded 15288 primary data records. [2025-10-22T23:36:42.189073] [DEBUG] [MAIN ] RBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:42.214149] [INFO ] [MAIN ] RBC: Generated 138 derivative records from 15288 primary records. [2025-10-22T23:36:42.214271] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-10-22T23:36:42.225776] [DEBUG] [LOCAL ] RBC: Derivative data saved (138 records). [2025-10-22T23:36:42.225855] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-10-22T23:36:42.228561] [INFO ] [MAIN ] Derivative Progress: 1507/2052 symbols. RBC took 0.4s. Estimated remaining time: 3m 35s [2025-10-22T23:36:42.228701] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:42.281302] [DEBUG] [LOCAL ] RBLX: Loaded 53718 existing records from primary storage. [2025-10-22T23:36:42.281464] [INFO ] [MAIN ] RBLX: Loaded 53718 primary data records. [2025-10-22T23:36:42.590264] [DEBUG] [MAIN ] RBLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:42.615210] [INFO ] [MAIN ] RBLX: Generated 138 derivative records from 53718 primary records. [2025-10-22T23:36:42.615314] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-10-22T23:36:42.627120] [DEBUG] [LOCAL ] RBLX: Derivative data saved (138 records). [2025-10-22T23:36:42.627210] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-10-22T23:36:42.630335] [INFO ] [MAIN ] Derivative Progress: 1508/2052 symbols. RBLX took 0.4s. Estimated remaining time: 3m 34s [2025-10-22T23:36:42.630443] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:42.643689] [DEBUG] [LOCAL ] RBOT: Loaded 6236 existing records from primary storage. [2025-10-22T23:36:42.643835] [INFO ] [MAIN ] RBOT: Loaded 6236 primary data records. [2025-10-22T23:36:42.975068] [DEBUG] [MAIN ] RBOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:43.000376] [INFO ] [MAIN ] RBOT: Generated 138 derivative records from 6236 primary records. [2025-10-22T23:36:43.000482] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-10-22T23:36:43.010454] [DEBUG] [LOCAL ] RBOT: Derivative data saved (138 records). [2025-10-22T23:36:43.010530] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-10-22T23:36:43.012604] [INFO ] [MAIN ] Derivative Progress: 1509/2052 symbols. RBOT took 0.4s. Estimated remaining time: 3m 34s [2025-10-22T23:36:43.012727] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:43.063669] [DEBUG] [LOCAL ] RBRK: Loaded 53165 existing records from primary storage. [2025-10-22T23:36:43.063834] [INFO ] [MAIN ] RBRK: Loaded 53165 primary data records. [2025-10-22T23:36:43.410128] [DEBUG] [MAIN ] RBRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:43.438964] [INFO ] [MAIN ] RBRK: Generated 138 derivative records from 53165 primary records. [2025-10-22T23:36:43.439148] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-10-22T23:36:43.451883] [DEBUG] [LOCAL ] RBRK: Derivative data saved (138 records). [2025-10-22T23:36:43.451971] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-10-22T23:36:43.455539] [INFO ] [MAIN ] Derivative Progress: 1510/2052 symbols. RBRK took 0.4s. Estimated remaining time: 3m 34s [2025-10-22T23:36:43.455684] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:43.502784] [DEBUG] [LOCAL ] RC: Loaded 48871 existing records from primary storage. [2025-10-22T23:36:43.502965] [INFO ] [MAIN ] RC: Loaded 48871 primary data records. [2025-10-22T23:36:43.832373] [DEBUG] [MAIN ] RC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:43.858401] [INFO ] [MAIN ] RC: Generated 138 derivative records from 48871 primary records. [2025-10-22T23:36:43.858582] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-10-22T23:36:43.870478] [DEBUG] [LOCAL ] RC: Derivative data saved (138 records). [2025-10-22T23:36:43.870672] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-10-22T23:36:43.874493] [INFO ] [MAIN ] Derivative Progress: 1511/2052 symbols. RC took 0.4s. Estimated remaining time: 3m 33s [2025-10-22T23:36:43.874674] [INFO ] [MAIN ] RCD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:43.881306] [DEBUG] [LOCAL ] RCD: Loaded 3332 existing records from primary storage. [2025-10-22T23:36:43.881412] [INFO ] [MAIN ] RCD: Loaded 3332 primary data records. [2025-10-22T23:36:44.180953] [DEBUG] [MAIN ] RCD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:44.205834] [INFO ] [MAIN ] RCD: Generated 138 derivative records from 3332 primary records. [2025-10-22T23:36:44.205981] [DEBUG] [LOCAL ] RCD: Saving derivative data. [2025-10-22T23:36:44.215634] [DEBUG] [LOCAL ] RCD: Derivative data saved (138 records). [2025-10-22T23:36:44.215735] [INFO ] [MAIN ] RCD: Successfully saved derivative data. [2025-10-22T23:36:44.217887] [INFO ] [MAIN ] Derivative Progress: 1512/2052 symbols. RCD took 0.3s. Estimated remaining time: 3m 33s [2025-10-22T23:36:44.218004] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:44.263482] [DEBUG] [LOCAL ] RCI: Loaded 48578 existing records from primary storage. [2025-10-22T23:36:44.263664] [INFO ] [MAIN ] RCI: Loaded 48578 primary data records. [2025-10-22T23:36:44.564078] [DEBUG] [MAIN ] RCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:44.589046] [INFO ] [MAIN ] RCI: Generated 138 derivative records from 48578 primary records. [2025-10-22T23:36:44.589149] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-10-22T23:36:44.600547] [DEBUG] [LOCAL ] RCI: Derivative data saved (138 records). [2025-10-22T23:36:44.600624] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-10-22T23:36:44.603809] [INFO ] [MAIN ] Derivative Progress: 1513/2052 symbols. RCI took 0.4s. Estimated remaining time: 3m 32s [2025-10-22T23:36:44.603910] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:44.619059] [DEBUG] [LOCAL ] RCS: Loaded 12437 existing records from primary storage. [2025-10-22T23:36:44.619190] [INFO ] [MAIN ] RCS: Loaded 12437 primary data records. [2025-10-22T23:36:44.925324] [DEBUG] [MAIN ] RCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:44.950746] [INFO ] [MAIN ] RCS: Generated 138 derivative records from 12437 primary records. [2025-10-22T23:36:44.950896] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-10-22T23:36:44.961931] [DEBUG] [LOCAL ] RCS: Derivative data saved (138 records). [2025-10-22T23:36:44.962017] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-10-22T23:36:44.964811] [INFO ] [MAIN ] Derivative Progress: 1514/2052 symbols. RCS took 0.4s. Estimated remaining time: 3m 32s [2025-10-22T23:36:44.964913] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:45.005493] [DEBUG] [LOCAL ] RCUS: Loaded 42963 existing records from primary storage. [2025-10-22T23:36:45.005680] [INFO ] [MAIN ] RCUS: Loaded 42963 primary data records. [2025-10-22T23:36:45.336877] [DEBUG] [MAIN ] RCUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:45.362870] [INFO ] [MAIN ] RCUS: Generated 138 derivative records from 42963 primary records. [2025-10-22T23:36:45.362998] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-10-22T23:36:45.374632] [DEBUG] [LOCAL ] RCUS: Derivative data saved (138 records). [2025-10-22T23:36:45.374732] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-10-22T23:36:45.377688] [INFO ] [MAIN ] Derivative Progress: 1515/2052 symbols. RCUS took 0.4s. Estimated remaining time: 3m 32s [2025-10-22T23:36:45.377804] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:45.432801] [DEBUG] [LOCAL ] RDDT: Loaded 53772 existing records from primary storage. [2025-10-22T23:36:45.432970] [INFO ] [MAIN ] RDDT: Loaded 53772 primary data records. [2025-10-22T23:36:45.733845] [DEBUG] [MAIN ] RDDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:45.758806] [INFO ] [MAIN ] RDDT: Generated 138 derivative records from 53772 primary records. [2025-10-22T23:36:45.758926] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-10-22T23:36:45.770622] [DEBUG] [LOCAL ] RDDT: Derivative data saved (138 records). [2025-10-22T23:36:45.770719] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-10-22T23:36:45.774044] [INFO ] [MAIN ] Derivative Progress: 1516/2052 symbols. RDDT took 0.4s. Estimated remaining time: 3m 31s [2025-10-22T23:36:45.774141] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:45.815675] [DEBUG] [LOCAL ] RDN: Loaded 44108 existing records from primary storage. [2025-10-22T23:36:45.815836] [INFO ] [MAIN ] RDN: Loaded 44108 primary data records. [2025-10-22T23:36:46.116021] [DEBUG] [MAIN ] RDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:46.141033] [INFO ] [MAIN ] RDN: Generated 138 derivative records from 44108 primary records. [2025-10-22T23:36:46.141134] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-10-22T23:36:46.152604] [DEBUG] [LOCAL ] RDN: Derivative data saved (138 records). [2025-10-22T23:36:46.152702] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-10-22T23:36:46.155461] [INFO ] [MAIN ] Derivative Progress: 1517/2052 symbols. RDN took 0.4s. Estimated remaining time: 3m 31s [2025-10-22T23:36:46.155561] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:46.206695] [DEBUG] [LOCAL ] RDW: Loaded 52288 existing records from primary storage. [2025-10-22T23:36:46.206846] [INFO ] [MAIN ] RDW: Loaded 52288 primary data records. [2025-10-22T23:36:46.513603] [DEBUG] [MAIN ] RDW: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:36:46.538537] [INFO ] [MAIN ] RDW: Generated 138 derivative records from 52288 primary records. [2025-10-22T23:36:46.538664] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-10-22T23:36:46.550176] [DEBUG] [LOCAL ] RDW: Derivative data saved (138 records). [2025-10-22T23:36:46.550255] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-10-22T23:36:46.553704] [INFO ] [MAIN ] Derivative Progress: 1518/2052 symbols. RDW took 0.4s. Estimated remaining time: 3m 30s [2025-10-22T23:36:46.553808] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:46.597116] [DEBUG] [LOCAL ] RDY: Loaded 46215 existing records from primary storage. [2025-10-22T23:36:46.597288] [INFO ] [MAIN ] RDY: Loaded 46215 primary data records. [2025-10-22T23:36:46.899363] [DEBUG] [MAIN ] RDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:46.924327] [INFO ] [MAIN ] RDY: Generated 138 derivative records from 46215 primary records. [2025-10-22T23:36:46.924461] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-10-22T23:36:46.936189] [DEBUG] [LOCAL ] RDY: Derivative data saved (138 records). [2025-10-22T23:36:46.936284] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-10-22T23:36:46.939208] [INFO ] [MAIN ] Derivative Progress: 1519/2052 symbols. RDY took 0.4s. Estimated remaining time: 3m 30s [2025-10-22T23:36:46.939331] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:46.983859] [DEBUG] [LOCAL ] RELX: Loaded 48581 existing records from primary storage. [2025-10-22T23:36:46.984035] [INFO ] [MAIN ] RELX: Loaded 48581 primary data records. [2025-10-22T23:36:47.318920] [DEBUG] [MAIN ] RELX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:47.344387] [INFO ] [MAIN ] RELX: Generated 138 derivative records from 48581 primary records. [2025-10-22T23:36:47.344604] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-10-22T23:36:47.356275] [DEBUG] [LOCAL ] RELX: Derivative data saved (138 records). [2025-10-22T23:36:47.356403] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-10-22T23:36:47.359823] [INFO ] [MAIN ] Derivative Progress: 1520/2052 symbols. RELX took 0.4s. Estimated remaining time: 3m 30s [2025-10-22T23:36:47.360005] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:47.400479] [DEBUG] [LOCAL ] RERE: Loaded 41799 existing records from primary storage. [2025-10-22T23:36:47.400692] [INFO ] [MAIN ] RERE: Loaded 41799 primary data records. [2025-10-22T23:36:47.706384] [DEBUG] [MAIN ] RERE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:47.731157] [INFO ] [MAIN ] RERE: Generated 138 derivative records from 41799 primary records. [2025-10-22T23:36:47.731260] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-10-22T23:36:47.742411] [DEBUG] [LOCAL ] RERE: Derivative data saved (138 records). [2025-10-22T23:36:47.742489] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-10-22T23:36:47.745487] [INFO ] [MAIN ] Derivative Progress: 1521/2052 symbols. RERE took 0.4s. Estimated remaining time: 3m 29s [2025-10-22T23:36:47.745591] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:47.787887] [DEBUG] [LOCAL ] RES: Loaded 46858 existing records from primary storage. [2025-10-22T23:36:47.788051] [INFO ] [MAIN ] RES: Loaded 46858 primary data records. [2025-10-22T23:36:48.092066] [DEBUG] [MAIN ] RES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:48.117149] [INFO ] [MAIN ] RES: Generated 138 derivative records from 46858 primary records. [2025-10-22T23:36:48.117274] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-10-22T23:36:48.128394] [DEBUG] [LOCAL ] RES: Derivative data saved (138 records). [2025-10-22T23:36:48.128471] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-10-22T23:36:48.131114] [INFO ] [MAIN ] Derivative Progress: 1522/2052 symbols. RES took 0.4s. Estimated remaining time: 3m 29s [2025-10-22T23:36:48.131218] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:48.169314] [DEBUG] [LOCAL ] REVG: Loaded 40157 existing records from primary storage. [2025-10-22T23:36:48.169469] [INFO ] [MAIN ] REVG: Loaded 40157 primary data records. [2025-10-22T23:36:48.477289] [DEBUG] [MAIN ] REVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:48.502431] [INFO ] [MAIN ] REVG: Generated 138 derivative records from 40157 primary records. [2025-10-22T23:36:48.502534] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-10-22T23:36:48.513978] [DEBUG] [LOCAL ] REVG: Derivative data saved (138 records). [2025-10-22T23:36:48.514056] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-10-22T23:36:48.516863] [INFO ] [MAIN ] Derivative Progress: 1523/2052 symbols. REVG took 0.4s. Estimated remaining time: 3m 28s [2025-10-22T23:36:48.516961] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:48.534039] [DEBUG] [LOCAL ] REX: Loaded 14324 existing records from primary storage. [2025-10-22T23:36:48.534173] [INFO ] [MAIN ] REX: Loaded 14324 primary data records. [2025-10-22T23:36:48.849790] [DEBUG] [MAIN ] REX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:48.875462] [INFO ] [MAIN ] REX: Generated 138 derivative records from 14324 primary records. [2025-10-22T23:36:48.875618] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-10-22T23:36:48.887263] [DEBUG] [LOCAL ] REX: Derivative data saved (138 records). [2025-10-22T23:36:48.887346] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-10-22T23:36:48.890106] [INFO ] [MAIN ] Derivative Progress: 1524/2052 symbols. REX took 0.4s. Estimated remaining time: 3m 28s [2025-10-22T23:36:48.890223] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:48.940758] [DEBUG] [LOCAL ] REXR: Loaded 52193 existing records from primary storage. [2025-10-22T23:36:48.940930] [INFO ] [MAIN ] REXR: Loaded 52193 primary data records. [2025-10-22T23:36:49.282480] [DEBUG] [MAIN ] REXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:49.309492] [INFO ] [MAIN ] REXR: Generated 138 derivative records from 52193 primary records. [2025-10-22T23:36:49.309624] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-10-22T23:36:49.321722] [DEBUG] [LOCAL ] REXR: Derivative data saved (138 records). [2025-10-22T23:36:49.321810] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-10-22T23:36:49.325351] [INFO ] [MAIN ] Derivative Progress: 1525/2052 symbols. REXR took 0.4s. Estimated remaining time: 3m 28s [2025-10-22T23:36:49.325483] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:49.374003] [DEBUG] [LOCAL ] REZI: Loaded 47098 existing records from primary storage. [2025-10-22T23:36:49.374172] [INFO ] [MAIN ] REZI: Loaded 47098 primary data records. [2025-10-22T23:36:49.713887] [DEBUG] [MAIN ] REZI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:49.738956] [INFO ] [MAIN ] REZI: Generated 138 derivative records from 47098 primary records. [2025-10-22T23:36:49.739126] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-10-22T23:36:49.750831] [DEBUG] [LOCAL ] REZI: Derivative data saved (138 records). [2025-10-22T23:36:49.750914] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-10-22T23:36:49.753484] [INFO ] [MAIN ] Derivative Progress: 1526/2052 symbols. REZI took 0.4s. Estimated remaining time: 3m 27s [2025-10-22T23:36:49.753593] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:49.805092] [DEBUG] [LOCAL ] RF: Loaded 53633 existing records from primary storage. [2025-10-22T23:36:49.805260] [INFO ] [MAIN ] RF: Loaded 53633 primary data records. [2025-10-22T23:36:50.117091] [DEBUG] [MAIN ] RF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:50.144269] [INFO ] [MAIN ] RF: Generated 138 derivative records from 53633 primary records. [2025-10-22T23:36:50.144413] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-10-22T23:36:50.156828] [DEBUG] [LOCAL ] RF: Derivative data saved (138 records). [2025-10-22T23:36:50.156949] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-10-22T23:36:50.160535] [INFO ] [MAIN ] Derivative Progress: 1527/2052 symbols. RF took 0.4s. Estimated remaining time: 3m 27s [2025-10-22T23:36:50.160693] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:50.176241] [DEBUG] [LOCAL ] RFI: Loaded 10230 existing records from primary storage. [2025-10-22T23:36:50.176406] [INFO ] [MAIN ] RFI: Loaded 10230 primary data records. [2025-10-22T23:36:50.491349] [DEBUG] [MAIN ] RFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:50.517120] [INFO ] [MAIN ] RFI: Generated 138 derivative records from 10230 primary records. [2025-10-22T23:36:50.517302] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-10-22T23:36:50.529378] [DEBUG] [LOCAL ] RFI: Derivative data saved (138 records). [2025-10-22T23:36:50.529466] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-10-22T23:36:50.531483] [INFO ] [MAIN ] Derivative Progress: 1528/2052 symbols. RFI took 0.4s. Estimated remaining time: 3m 26s [2025-10-22T23:36:50.531576] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:50.546780] [DEBUG] [LOCAL ] RFL: Loaded 11419 existing records from primary storage. [2025-10-22T23:36:50.546925] [INFO ] [MAIN ] RFL: Loaded 11419 primary data records. [2025-10-22T23:36:50.862142] [DEBUG] [MAIN ] RFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:50.887467] [INFO ] [MAIN ] RFL: Generated 138 derivative records from 11419 primary records. [2025-10-22T23:36:50.887667] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-10-22T23:36:50.898775] [DEBUG] [LOCAL ] RFL: Derivative data saved (138 records). [2025-10-22T23:36:50.898867] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-10-22T23:36:50.901385] [INFO ] [MAIN ] Derivative Progress: 1529/2052 symbols. RFL took 0.4s. Estimated remaining time: 3m 26s [2025-10-22T23:36:50.901476] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:50.910166] [DEBUG] [LOCAL ] RFM: Loaded 4209 existing records from primary storage. [2025-10-22T23:36:50.910275] [INFO ] [MAIN ] RFM: Loaded 4209 primary data records. [2025-10-22T23:36:51.211325] [DEBUG] [MAIN ] RFM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:51.236585] [INFO ] [MAIN ] RFM: Generated 138 derivative records from 4209 primary records. [2025-10-22T23:36:51.236759] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-10-22T23:36:51.247137] [DEBUG] [LOCAL ] RFM: Derivative data saved (138 records). [2025-10-22T23:36:51.247217] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-10-22T23:36:51.249306] [INFO ] [MAIN ] Derivative Progress: 1530/2052 symbols. RFM took 0.3s. Estimated remaining time: 3m 26s [2025-10-22T23:36:51.249401] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:51.261039] [DEBUG] [LOCAL ] RFMZ: Loaded 9010 existing records from primary storage. [2025-10-22T23:36:51.261164] [INFO ] [MAIN ] RFMZ: Loaded 9010 primary data records. [2025-10-22T23:36:51.590265] [DEBUG] [MAIN ] RFMZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:51.616008] [INFO ] [MAIN ] RFMZ: Generated 138 derivative records from 9010 primary records. [2025-10-22T23:36:51.616226] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-10-22T23:36:51.629342] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (138 records). [2025-10-22T23:36:51.629507] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-10-22T23:36:51.631678] [INFO ] [MAIN ] Derivative Progress: 1531/2052 symbols. RFMZ took 0.4s. Estimated remaining time: 3m 25s [2025-10-22T23:36:51.631772] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:51.662330] [DEBUG] [LOCAL ] RGA: Loaded 29198 existing records from primary storage. [2025-10-22T23:36:51.662484] [INFO ] [MAIN ] RGA: Loaded 29198 primary data records. [2025-10-22T23:36:52.001553] [DEBUG] [MAIN ] RGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:52.026582] [INFO ] [MAIN ] RGA: Generated 138 derivative records from 29198 primary records. [2025-10-22T23:36:52.026744] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-10-22T23:36:52.038219] [DEBUG] [LOCAL ] RGA: Derivative data saved (138 records). [2025-10-22T23:36:52.038298] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-10-22T23:36:52.041084] [INFO ] [MAIN ] Derivative Progress: 1532/2052 symbols. RGA took 0.4s. Estimated remaining time: 3m 25s [2025-10-22T23:36:52.041218] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:52.062905] [DEBUG] [LOCAL ] RGR: Loaded 20982 existing records from primary storage. [2025-10-22T23:36:52.063047] [INFO ] [MAIN ] RGR: Loaded 20982 primary data records. [2025-10-22T23:36:52.368201] [DEBUG] [MAIN ] RGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:52.393203] [INFO ] [MAIN ] RGR: Generated 138 derivative records from 20982 primary records. [2025-10-22T23:36:52.393309] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-10-22T23:36:52.404574] [DEBUG] [LOCAL ] RGR: Derivative data saved (138 records). [2025-10-22T23:36:52.404671] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-10-22T23:36:52.407418] [INFO ] [MAIN ] Derivative Progress: 1533/2052 symbols. RGR took 0.4s. Estimated remaining time: 3m 24s [2025-10-22T23:36:52.407522] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:52.412800] [DEBUG] [LOCAL ] RGT: Loaded 2685 existing records from primary storage. [2025-10-22T23:36:52.412885] [INFO ] [MAIN ] RGT: Loaded 2685 primary data records. [2025-10-22T23:36:52.716030] [DEBUG] [MAIN ] RGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:52.741063] [INFO ] [MAIN ] RGT: Generated 138 derivative records from 2685 primary records. [2025-10-22T23:36:52.741207] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-10-22T23:36:52.750859] [DEBUG] [LOCAL ] RGT: Derivative data saved (138 records). [2025-10-22T23:36:52.750939] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-10-22T23:36:52.753053] [INFO ] [MAIN ] Derivative Progress: 1534/2052 symbols. RGT took 0.3s. Estimated remaining time: 3m 24s [2025-10-22T23:36:52.753151] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:52.799248] [DEBUG] [LOCAL ] RH: Loaded 47133 existing records from primary storage. [2025-10-22T23:36:52.799408] [INFO ] [MAIN ] RH: Loaded 47133 primary data records. [2025-10-22T23:36:53.112819] [DEBUG] [MAIN ] RH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:53.139292] [INFO ] [MAIN ] RH: Generated 138 derivative records from 47133 primary records. [2025-10-22T23:36:53.139483] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-10-22T23:36:53.151621] [DEBUG] [LOCAL ] RH: Derivative data saved (138 records). [2025-10-22T23:36:53.151753] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-10-22T23:36:53.154988] [INFO ] [MAIN ] Derivative Progress: 1535/2052 symbols. RH took 0.4s. Estimated remaining time: 3m 24s [2025-10-22T23:36:53.155096] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:53.201342] [DEBUG] [LOCAL ] RHI: Loaded 49689 existing records from primary storage. [2025-10-22T23:36:53.201504] [INFO ] [MAIN ] RHI: Loaded 49689 primary data records. [2025-10-22T23:36:53.533829] [DEBUG] [MAIN ] RHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:53.565805] [INFO ] [MAIN ] RHI: Generated 138 derivative records from 49689 primary records. [2025-10-22T23:36:53.565997] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-10-22T23:36:53.580800] [DEBUG] [LOCAL ] RHI: Derivative data saved (138 records). [2025-10-22T23:36:53.580926] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-10-22T23:36:53.584574] [INFO ] [MAIN ] Derivative Progress: 1536/2052 symbols. RHI took 0.4s. Estimated remaining time: 3m 23s [2025-10-22T23:36:53.584770] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:53.631352] [DEBUG] [LOCAL ] RHP: Loaded 40303 existing records from primary storage. [2025-10-22T23:36:53.631551] [INFO ] [MAIN ] RHP: Loaded 40303 primary data records. [2025-10-22T23:36:54.008257] [DEBUG] [MAIN ] RHP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:54.040751] [INFO ] [MAIN ] RHP: Generated 138 derivative records from 40303 primary records. [2025-10-22T23:36:54.040944] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-10-22T23:36:54.053995] [DEBUG] [LOCAL ] RHP: Derivative data saved (138 records). [2025-10-22T23:36:54.054105] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-10-22T23:36:54.057018] [INFO ] [MAIN ] Derivative Progress: 1537/2052 symbols. RHP took 0.5s. Estimated remaining time: 3m 23s [2025-10-22T23:36:54.057137] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:54.111304] [DEBUG] [LOCAL ] RIG: Loaded 53675 existing records from primary storage. [2025-10-22T23:36:54.111487] [INFO ] [MAIN ] RIG: Loaded 53675 primary data records. [2025-10-22T23:36:54.414555] [DEBUG] [MAIN ] RIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:54.439634] [INFO ] [MAIN ] RIG: Generated 138 derivative records from 53675 primary records. [2025-10-22T23:36:54.439815] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-10-22T23:36:54.451737] [DEBUG] [LOCAL ] RIG: Derivative data saved (138 records). [2025-10-22T23:36:54.451853] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-10-22T23:36:54.454842] [INFO ] [MAIN ] Derivative Progress: 1538/2052 symbols. RIG took 0.4s. Estimated remaining time: 3m 23s [2025-10-22T23:36:54.454960] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:54.513294] [DEBUG] [LOCAL ] RIO: Loaded 53402 existing records from primary storage. [2025-10-22T23:36:54.513462] [INFO ] [MAIN ] RIO: Loaded 53402 primary data records. [2025-10-22T23:36:54.856744] [DEBUG] [MAIN ] RIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:54.883719] [INFO ] [MAIN ] RIO: Generated 138 derivative records from 53402 primary records. [2025-10-22T23:36:54.883915] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-10-22T23:36:54.896048] [DEBUG] [LOCAL ] RIO: Derivative data saved (138 records). [2025-10-22T23:36:54.896194] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-10-22T23:36:54.899139] [INFO ] [MAIN ] Derivative Progress: 1539/2052 symbols. RIO took 0.4s. Estimated remaining time: 3m 22s [2025-10-22T23:36:54.899241] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:54.954417] [DEBUG] [LOCAL ] RITM: Loaded 52945 existing records from primary storage. [2025-10-22T23:36:54.954595] [INFO ] [MAIN ] RITM: Loaded 52945 primary data records. [2025-10-22T23:36:55.279357] [DEBUG] [MAIN ] RITM: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:36:55.304297] [INFO ] [MAIN ] RITM: Generated 138 derivative records from 52945 primary records. [2025-10-22T23:36:55.304431] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-10-22T23:36:55.316159] [DEBUG] [LOCAL ] RITM: Derivative data saved (138 records). [2025-10-22T23:36:55.316237] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-10-22T23:36:55.319108] [INFO ] [MAIN ] Derivative Progress: 1540/2052 symbols. RITM took 0.4s. Estimated remaining time: 3m 22s [2025-10-22T23:36:55.319198] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:55.335372] [DEBUG] [LOCAL ] RIV: Loaded 12627 existing records from primary storage. [2025-10-22T23:36:55.335509] [INFO ] [MAIN ] RIV: Loaded 12627 primary data records. [2025-10-22T23:36:55.661211] [DEBUG] [MAIN ] RIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:55.686491] [INFO ] [MAIN ] RIV: Generated 138 derivative records from 12627 primary records. [2025-10-22T23:36:55.686619] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-10-22T23:36:55.697932] [DEBUG] [LOCAL ] RIV: Derivative data saved (138 records). [2025-10-22T23:36:55.698016] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-10-22T23:36:55.700586] [INFO ] [MAIN ] Derivative Progress: 1541/2052 symbols. RIV took 0.4s. Estimated remaining time: 3m 21s [2025-10-22T23:36:55.700724] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:55.745896] [DEBUG] [LOCAL ] RJF: Loaded 46546 existing records from primary storage. [2025-10-22T23:36:55.746061] [INFO ] [MAIN ] RJF: Loaded 46546 primary data records. [2025-10-22T23:36:56.046980] [DEBUG] [MAIN ] RJF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:56.072034] [INFO ] [MAIN ] RJF: Generated 138 derivative records from 46546 primary records. [2025-10-22T23:36:56.072137] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-10-22T23:36:56.083803] [DEBUG] [LOCAL ] RJF: Derivative data saved (138 records). [2025-10-22T23:36:56.083884] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-10-22T23:36:56.086407] [INFO ] [MAIN ] Derivative Progress: 1542/2052 symbols. RJF took 0.4s. Estimated remaining time: 3m 21s [2025-10-22T23:36:56.086503] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:56.139460] [DEBUG] [LOCAL ] RKT: Loaded 53729 existing records from primary storage. [2025-10-22T23:36:56.139621] [INFO ] [MAIN ] RKT: Loaded 53729 primary data records. [2025-10-22T23:36:56.449480] [DEBUG] [MAIN ] RKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:56.475222] [INFO ] [MAIN ] RKT: Generated 138 derivative records from 53729 primary records. [2025-10-22T23:36:56.475360] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-10-22T23:36:56.487769] [DEBUG] [LOCAL ] RKT: Derivative data saved (138 records). [2025-10-22T23:36:56.487851] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-10-22T23:36:56.490806] [INFO ] [MAIN ] Derivative Progress: 1543/2052 symbols. RKT took 0.4s. Estimated remaining time: 3m 21s [2025-10-22T23:36:56.490896] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:56.528290] [DEBUG] [LOCAL ] RL: Loaded 39350 existing records from primary storage. [2025-10-22T23:36:56.528477] [INFO ] [MAIN ] RL: Loaded 39350 primary data records. [2025-10-22T23:36:56.839316] [DEBUG] [MAIN ] RL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:56.864716] [INFO ] [MAIN ] RL: Generated 138 derivative records from 39350 primary records. [2025-10-22T23:36:56.864828] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-10-22T23:36:56.876294] [DEBUG] [LOCAL ] RL: Derivative data saved (138 records). [2025-10-22T23:36:56.876374] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-10-22T23:36:56.879180] [INFO ] [MAIN ] Derivative Progress: 1544/2052 symbols. RL took 0.4s. Estimated remaining time: 3m 20s [2025-10-22T23:36:56.879280] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:56.912499] [DEBUG] [LOCAL ] RLI: Loaded 34703 existing records from primary storage. [2025-10-22T23:36:56.912676] [INFO ] [MAIN ] RLI: Loaded 34703 primary data records. [2025-10-22T23:36:57.220107] [DEBUG] [MAIN ] RLI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:57.245396] [INFO ] [MAIN ] RLI: Generated 138 derivative records from 34703 primary records. [2025-10-22T23:36:57.245503] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-10-22T23:36:57.256912] [DEBUG] [LOCAL ] RLI: Derivative data saved (138 records). [2025-10-22T23:36:57.256992] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-10-22T23:36:57.259867] [INFO ] [MAIN ] Derivative Progress: 1545/2052 symbols. RLI took 0.4s. Estimated remaining time: 3m 20s [2025-10-22T23:36:57.259992] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:57.303581] [DEBUG] [LOCAL ] RLJ: Loaded 47956 existing records from primary storage. [2025-10-22T23:36:57.303762] [INFO ] [MAIN ] RLJ: Loaded 47956 primary data records. [2025-10-22T23:36:57.637864] [DEBUG] [MAIN ] RLJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:57.663444] [INFO ] [MAIN ] RLJ: Generated 138 derivative records from 47956 primary records. [2025-10-22T23:36:57.663568] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-10-22T23:36:57.674232] [DEBUG] [LOCAL ] RLJ: Derivative data saved (138 records). [2025-10-22T23:36:57.674313] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-10-22T23:36:57.677199] [INFO ] [MAIN ] Derivative Progress: 1546/2052 symbols. RLJ took 0.4s. Estimated remaining time: 3m 19s [2025-10-22T23:36:57.677323] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:57.691691] [DEBUG] [LOCAL ] RLTY: Loaded 10963 existing records from primary storage. [2025-10-22T23:36:57.691830] [INFO ] [MAIN ] RLTY: Loaded 10963 primary data records. [2025-10-22T23:36:58.001765] [DEBUG] [MAIN ] RLTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:58.026978] [INFO ] [MAIN ] RLTY: Generated 138 derivative records from 10963 primary records. [2025-10-22T23:36:58.027103] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-10-22T23:36:58.039038] [DEBUG] [LOCAL ] RLTY: Derivative data saved (138 records). [2025-10-22T23:36:58.039121] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-10-22T23:36:58.041143] [INFO ] [MAIN ] Derivative Progress: 1547/2052 symbols. RLTY took 0.4s. Estimated remaining time: 3m 19s [2025-10-22T23:36:58.041237] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:58.085502] [DEBUG] [LOCAL ] RLX: Loaded 48165 existing records from primary storage. [2025-10-22T23:36:58.085696] [INFO ] [MAIN ] RLX: Loaded 48165 primary data records. [2025-10-22T23:36:58.404555] [DEBUG] [MAIN ] RLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:58.429473] [INFO ] [MAIN ] RLX: Generated 138 derivative records from 48165 primary records. [2025-10-22T23:36:58.429617] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-10-22T23:36:58.440863] [DEBUG] [LOCAL ] RLX: Derivative data saved (138 records). [2025-10-22T23:36:58.440942] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-10-22T23:36:58.443836] [INFO ] [MAIN ] Derivative Progress: 1548/2052 symbols. RLX took 0.4s. Estimated remaining time: 3m 19s [2025-10-22T23:36:58.443933] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:58.455278] [DEBUG] [LOCAL ] RM: Loaded 7508 existing records from primary storage. [2025-10-22T23:36:58.455418] [INFO ] [MAIN ] RM: Loaded 7508 primary data records. [2025-10-22T23:36:58.759547] [DEBUG] [MAIN ] RM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:58.784821] [INFO ] [MAIN ] RM: Generated 138 derivative records from 7508 primary records. [2025-10-22T23:36:58.784966] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-10-22T23:36:58.795834] [DEBUG] [LOCAL ] RM: Derivative data saved (138 records). [2025-10-22T23:36:58.795913] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-10-22T23:36:58.798016] [INFO ] [MAIN ] Derivative Progress: 1549/2052 symbols. RM took 0.4s. Estimated remaining time: 3m 18s [2025-10-22T23:36:58.798111] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:58.819337] [DEBUG] [LOCAL ] RMAX: Loaded 21614 existing records from primary storage. [2025-10-22T23:36:58.819511] [INFO ] [MAIN ] RMAX: Loaded 21614 primary data records. [2025-10-22T23:36:59.128421] [DEBUG] [MAIN ] RMAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:59.153363] [INFO ] [MAIN ] RMAX: Generated 138 derivative records from 21614 primary records. [2025-10-22T23:36:59.153506] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-10-22T23:36:59.164561] [DEBUG] [LOCAL ] RMAX: Derivative data saved (138 records). [2025-10-22T23:36:59.164639] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-10-22T23:36:59.167448] [INFO ] [MAIN ] Derivative Progress: 1550/2052 symbols. RMAX took 0.4s. Estimated remaining time: 3m 18s [2025-10-22T23:36:59.167539] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:59.206322] [DEBUG] [LOCAL ] RMD: Loaded 41879 existing records from primary storage. [2025-10-22T23:36:59.206480] [INFO ] [MAIN ] RMD: Loaded 41879 primary data records. [2025-10-22T23:36:59.518079] [DEBUG] [MAIN ] RMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:59.544144] [INFO ] [MAIN ] RMD: Generated 138 derivative records from 41879 primary records. [2025-10-22T23:36:59.544273] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-10-22T23:36:59.555943] [DEBUG] [LOCAL ] RMD: Derivative data saved (138 records). [2025-10-22T23:36:59.556022] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-10-22T23:36:59.558830] [INFO ] [MAIN ] Derivative Progress: 1551/2052 symbols. RMD took 0.4s. Estimated remaining time: 3m 17s [2025-10-22T23:36:59.558935] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:59.568110] [DEBUG] [LOCAL ] RMI: Loaded 4769 existing records from primary storage. [2025-10-22T23:36:59.568235] [INFO ] [MAIN ] RMI: Loaded 4769 primary data records. [2025-10-22T23:36:59.916762] [DEBUG] [MAIN ] RMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:36:59.942032] [INFO ] [MAIN ] RMI: Generated 138 derivative records from 4769 primary records. [2025-10-22T23:36:59.942172] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-10-22T23:36:59.952698] [DEBUG] [LOCAL ] RMI: Derivative data saved (138 records). [2025-10-22T23:36:59.952781] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-10-22T23:36:59.954680] [INFO ] [MAIN ] Derivative Progress: 1552/2052 symbols. RMI took 0.4s. Estimated remaining time: 3m 17s [2025-10-22T23:36:59.954778] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:36:59.967574] [DEBUG] [LOCAL ] RMM: Loaded 10866 existing records from primary storage. [2025-10-22T23:36:59.967740] [INFO ] [MAIN ] RMM: Loaded 10866 primary data records. [2025-10-22T23:37:00.281319] [DEBUG] [MAIN ] RMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:00.306600] [INFO ] [MAIN ] RMM: Generated 138 derivative records from 10866 primary records. [2025-10-22T23:37:00.306773] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-10-22T23:37:00.318783] [DEBUG] [LOCAL ] RMM: Derivative data saved (138 records). [2025-10-22T23:37:00.318874] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-10-22T23:37:00.320687] [INFO ] [MAIN ] Derivative Progress: 1553/2052 symbols. RMM took 0.4s. Estimated remaining time: 3m 17s [2025-10-22T23:37:00.320791] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:00.330281] [DEBUG] [LOCAL ] RMMZ: Loaded 4798 existing records from primary storage. [2025-10-22T23:37:00.330418] [INFO ] [MAIN ] RMMZ: Loaded 4798 primary data records. [2025-10-22T23:37:00.635321] [DEBUG] [MAIN ] RMMZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:00.661479] [INFO ] [MAIN ] RMMZ: Generated 138 derivative records from 4798 primary records. [2025-10-22T23:37:00.661749] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-10-22T23:37:00.672507] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (138 records). [2025-10-22T23:37:00.672615] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-10-22T23:37:00.674621] [INFO ] [MAIN ] Derivative Progress: 1554/2052 symbols. RMMZ took 0.4s. Estimated remaining time: 3m 16s [2025-10-22T23:37:00.674758] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:00.694707] [DEBUG] [LOCAL ] RMT: Loaded 17151 existing records from primary storage. [2025-10-22T23:37:00.695071] [INFO ] [MAIN ] RMT: Loaded 17151 primary data records. [2025-10-22T23:37:01.003873] [DEBUG] [MAIN ] RMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:01.029757] [INFO ] [MAIN ] RMT: Generated 138 derivative records from 17151 primary records. [2025-10-22T23:37:01.029880] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-10-22T23:37:01.041223] [DEBUG] [LOCAL ] RMT: Derivative data saved (138 records). [2025-10-22T23:37:01.041303] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-10-22T23:37:01.043748] [INFO ] [MAIN ] Derivative Progress: 1555/2052 symbols. RMT took 0.4s. Estimated remaining time: 3m 16s [2025-10-22T23:37:01.043851] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:01.088169] [DEBUG] [LOCAL ] RNG: Loaded 47979 existing records from primary storage. [2025-10-22T23:37:01.088337] [INFO ] [MAIN ] RNG: Loaded 47979 primary data records. [2025-10-22T23:37:01.402048] [DEBUG] [MAIN ] RNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:01.426896] [INFO ] [MAIN ] RNG: Generated 138 derivative records from 47979 primary records. [2025-10-22T23:37:01.427009] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-10-22T23:37:01.438621] [DEBUG] [LOCAL ] RNG: Derivative data saved (138 records). [2025-10-22T23:37:01.438727] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-10-22T23:37:01.441348] [INFO ] [MAIN ] Derivative Progress: 1556/2052 symbols. RNG took 0.4s. Estimated remaining time: 3m 15s [2025-10-22T23:37:01.441443] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:01.463635] [DEBUG] [LOCAL ] RNGR: Loaded 20718 existing records from primary storage. [2025-10-22T23:37:01.463797] [INFO ] [MAIN ] RNGR: Loaded 20718 primary data records. [2025-10-22T23:37:01.797746] [DEBUG] [MAIN ] RNGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:01.823446] [INFO ] [MAIN ] RNGR: Generated 138 derivative records from 20718 primary records. [2025-10-22T23:37:01.823590] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-10-22T23:37:01.835463] [DEBUG] [LOCAL ] RNGR: Derivative data saved (138 records). [2025-10-22T23:37:01.835565] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-10-22T23:37:01.838145] [INFO ] [MAIN ] Derivative Progress: 1557/2052 symbols. RNGR took 0.4s. Estimated remaining time: 3m 15s [2025-10-22T23:37:01.838243] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:01.856673] [DEBUG] [LOCAL ] RNP: Loaded 15933 existing records from primary storage. [2025-10-22T23:37:01.856820] [INFO ] [MAIN ] RNP: Loaded 15933 primary data records. [2025-10-22T23:37:02.159460] [DEBUG] [MAIN ] RNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:02.185061] [INFO ] [MAIN ] RNP: Generated 138 derivative records from 15933 primary records. [2025-10-22T23:37:02.185200] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-10-22T23:37:02.196774] [DEBUG] [LOCAL ] RNP: Derivative data saved (138 records). [2025-10-22T23:37:02.196864] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-10-22T23:37:02.199235] [INFO ] [MAIN ] Derivative Progress: 1558/2052 symbols. RNP took 0.4s. Estimated remaining time: 3m 15s [2025-10-22T23:37:02.199340] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:02.234245] [DEBUG] [LOCAL ] RNR: Loaded 33518 existing records from primary storage. [2025-10-22T23:37:02.234406] [INFO ] [MAIN ] RNR: Loaded 33518 primary data records. [2025-10-22T23:37:02.539568] [DEBUG] [MAIN ] RNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:02.564505] [INFO ] [MAIN ] RNR: Generated 138 derivative records from 33518 primary records. [2025-10-22T23:37:02.564635] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-10-22T23:37:02.576267] [DEBUG] [LOCAL ] RNR: Derivative data saved (138 records). [2025-10-22T23:37:02.576351] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-10-22T23:37:02.578912] [INFO ] [MAIN ] Derivative Progress: 1559/2052 symbols. RNR took 0.4s. Estimated remaining time: 3m 14s [2025-10-22T23:37:02.579014] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:02.613892] [DEBUG] [LOCAL ] RNST: Loaded 35883 existing records from primary storage. [2025-10-22T23:37:02.614050] [INFO ] [MAIN ] RNST: Loaded 35883 primary data records. [2025-10-22T23:37:02.928397] [DEBUG] [MAIN ] RNST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:02.955820] [INFO ] [MAIN ] RNST: Generated 138 derivative records from 35883 primary records. [2025-10-22T23:37:02.955982] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-10-22T23:37:02.967890] [DEBUG] [LOCAL ] RNST: Derivative data saved (138 records). [2025-10-22T23:37:02.968005] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-10-22T23:37:02.970678] [INFO ] [MAIN ] Derivative Progress: 1560/2052 symbols. RNST took 0.4s. Estimated remaining time: 3m 14s [2025-10-22T23:37:02.970784] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:02.993678] [DEBUG] [LOCAL ] ROG: Loaded 21642 existing records from primary storage. [2025-10-22T23:37:02.993838] [INFO ] [MAIN ] ROG: Loaded 21642 primary data records. [2025-10-22T23:37:03.370381] [DEBUG] [MAIN ] ROG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:03.410491] [INFO ] [MAIN ] ROG: Generated 138 derivative records from 21642 primary records. [2025-10-22T23:37:03.410738] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-10-22T23:37:03.426868] [DEBUG] [LOCAL ] ROG: Derivative data saved (138 records). [2025-10-22T23:37:03.427056] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-10-22T23:37:03.429877] [INFO ] [MAIN ] Derivative Progress: 1561/2052 symbols. ROG took 0.5s. Estimated remaining time: 3m 13s [2025-10-22T23:37:03.430081] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:03.490792] [DEBUG] [LOCAL ] ROK: Loaded 42806 existing records from primary storage. [2025-10-22T23:37:03.491010] [INFO ] [MAIN ] ROK: Loaded 42806 primary data records. [2025-10-22T23:37:03.885047] [DEBUG] [MAIN ] ROK: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:37:03.922453] [INFO ] [MAIN ] ROK: Generated 138 derivative records from 42806 primary records. [2025-10-22T23:37:03.922701] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-10-22T23:37:03.941354] [DEBUG] [LOCAL ] ROK: Derivative data saved (138 records). [2025-10-22T23:37:03.941546] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-10-22T23:37:03.945081] [INFO ] [MAIN ] Derivative Progress: 1562/2052 symbols. ROK took 0.5s. Estimated remaining time: 3m 13s [2025-10-22T23:37:03.945243] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:03.999061] [DEBUG] [LOCAL ] ROL: Loaded 50245 existing records from primary storage. [2025-10-22T23:37:03.999263] [INFO ] [MAIN ] ROL: Loaded 50245 primary data records. [2025-10-22T23:37:04.315199] [DEBUG] [MAIN ] ROL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:04.344455] [INFO ] [MAIN ] ROL: Generated 138 derivative records from 50245 primary records. [2025-10-22T23:37:04.344703] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-10-22T23:37:04.356615] [DEBUG] [LOCAL ] ROL: Derivative data saved (138 records). [2025-10-22T23:37:04.356745] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-10-22T23:37:04.359494] [INFO ] [MAIN ] Derivative Progress: 1563/2052 symbols. ROL took 0.4s. Estimated remaining time: 3m 13s [2025-10-22T23:37:04.359606] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:04.401397] [DEBUG] [LOCAL ] RPM: Loaded 42049 existing records from primary storage. [2025-10-22T23:37:04.401569] [INFO ] [MAIN ] RPM: Loaded 42049 primary data records. [2025-10-22T23:37:04.722895] [DEBUG] [MAIN ] RPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:04.748515] [INFO ] [MAIN ] RPM: Generated 138 derivative records from 42049 primary records. [2025-10-22T23:37:04.748701] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-10-22T23:37:04.760444] [DEBUG] [LOCAL ] RPM: Derivative data saved (138 records). [2025-10-22T23:37:04.760532] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-10-22T23:37:04.763160] [INFO ] [MAIN ] Derivative Progress: 1564/2052 symbols. RPM took 0.4s. Estimated remaining time: 3m 12s [2025-10-22T23:37:04.763260] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:04.783431] [DEBUG] [LOCAL ] RPT: Loaded 18982 existing records from primary storage. [2025-10-22T23:37:04.783583] [INFO ] [MAIN ] RPT: Loaded 18982 primary data records. [2025-10-22T23:37:05.092577] [DEBUG] [MAIN ] RPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:05.117577] [INFO ] [MAIN ] RPT: Generated 138 derivative records from 18982 primary records. [2025-10-22T23:37:05.117752] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-10-22T23:37:05.128980] [DEBUG] [LOCAL ] RPT: Derivative data saved (138 records). [2025-10-22T23:37:05.129070] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-10-22T23:37:05.131588] [INFO ] [MAIN ] Derivative Progress: 1565/2052 symbols. RPT took 0.4s. Estimated remaining time: 3m 12s [2025-10-22T23:37:05.131722] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:05.160767] [DEBUG] [LOCAL ] RQI: Loaded 28772 existing records from primary storage. [2025-10-22T23:37:05.160924] [INFO ] [MAIN ] RQI: Loaded 28772 primary data records. [2025-10-22T23:37:05.468307] [DEBUG] [MAIN ] RQI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:05.493490] [INFO ] [MAIN ] RQI: Generated 138 derivative records from 28772 primary records. [2025-10-22T23:37:05.493662] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-10-22T23:37:05.505541] [DEBUG] [LOCAL ] RQI: Derivative data saved (138 records). [2025-10-22T23:37:05.505625] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-10-22T23:37:05.508211] [INFO ] [MAIN ] Derivative Progress: 1566/2052 symbols. RQI took 0.4s. Estimated remaining time: 3m 11s [2025-10-22T23:37:05.508311] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:05.559378] [DEBUG] [LOCAL ] RRC: Loaded 52917 existing records from primary storage. [2025-10-22T23:37:05.559545] [INFO ] [MAIN ] RRC: Loaded 52917 primary data records. [2025-10-22T23:37:05.893058] [DEBUG] [MAIN ] RRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:05.923104] [INFO ] [MAIN ] RRC: Generated 138 derivative records from 52917 primary records. [2025-10-22T23:37:05.923298] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-10-22T23:37:05.935234] [DEBUG] [LOCAL ] RRC: Derivative data saved (138 records). [2025-10-22T23:37:05.935318] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-10-22T23:37:05.938461] [INFO ] [MAIN ] Derivative Progress: 1567/2052 symbols. RRC took 0.4s. Estimated remaining time: 3m 11s [2025-10-22T23:37:05.938580] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:05.985272] [DEBUG] [LOCAL ] RRX: Loaded 40772 existing records from primary storage. [2025-10-22T23:37:05.985455] [INFO ] [MAIN ] RRX: Loaded 40772 primary data records. [2025-10-22T23:37:06.352539] [DEBUG] [MAIN ] RRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:06.380278] [INFO ] [MAIN ] RRX: Generated 138 derivative records from 40772 primary records. [2025-10-22T23:37:06.380473] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-10-22T23:37:06.393440] [DEBUG] [LOCAL ] RRX: Derivative data saved (138 records). [2025-10-22T23:37:06.393531] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-10-22T23:37:06.396497] [INFO ] [MAIN ] Derivative Progress: 1568/2052 symbols. RRX took 0.5s. Estimated remaining time: 3m 11s [2025-10-22T23:37:06.396610] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:06.422217] [DEBUG] [LOCAL ] RS: Loaded 24518 existing records from primary storage. [2025-10-22T23:37:06.422375] [INFO ] [MAIN ] RS: Loaded 24518 primary data records. [2025-10-22T23:37:06.750443] [DEBUG] [MAIN ] RS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:37:06.775382] [INFO ] [MAIN ] RS: Generated 138 derivative records from 24518 primary records. [2025-10-22T23:37:06.775525] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-10-22T23:37:06.787230] [DEBUG] [LOCAL ] RS: Derivative data saved (138 records). [2025-10-22T23:37:06.787342] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-10-22T23:37:06.789970] [INFO ] [MAIN ] Derivative Progress: 1569/2052 symbols. RS took 0.4s. Estimated remaining time: 3m 10s [2025-10-22T23:37:06.790076] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:06.799073] [DEBUG] [LOCAL ] RSF: Loaded 4258 existing records from primary storage. [2025-10-22T23:37:06.799202] [INFO ] [MAIN ] RSF: Loaded 4258 primary data records. [2025-10-22T23:37:07.100907] [DEBUG] [MAIN ] RSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:07.127285] [INFO ] [MAIN ] RSF: Generated 138 derivative records from 4258 primary records. [2025-10-22T23:37:07.127481] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-10-22T23:37:07.138225] [DEBUG] [LOCAL ] RSF: Derivative data saved (138 records). [2025-10-22T23:37:07.138384] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-10-22T23:37:07.140497] [INFO ] [MAIN ] Derivative Progress: 1570/2052 symbols. RSF took 0.4s. Estimated remaining time: 3m 10s [2025-10-22T23:37:07.140678] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:07.185907] [DEBUG] [LOCAL ] RSG: Loaded 47300 existing records from primary storage. [2025-10-22T23:37:07.186078] [INFO ] [MAIN ] RSG: Loaded 47300 primary data records. [2025-10-22T23:37:07.487575] [DEBUG] [MAIN ] RSG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:07.512612] [INFO ] [MAIN ] RSG: Generated 138 derivative records from 47300 primary records. [2025-10-22T23:37:07.512790] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-10-22T23:37:07.524544] [DEBUG] [LOCAL ] RSG: Derivative data saved (138 records). [2025-10-22T23:37:07.524624] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-10-22T23:37:07.527730] [INFO ] [MAIN ] Derivative Progress: 1571/2052 symbols. RSG took 0.4s. Estimated remaining time: 3m 10s [2025-10-22T23:37:07.527847] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:07.572201] [DEBUG] [LOCAL ] RSI: Loaded 46976 existing records from primary storage. [2025-10-22T23:37:07.572364] [INFO ] [MAIN ] RSI: Loaded 46976 primary data records. [2025-10-22T23:37:07.877807] [DEBUG] [MAIN ] RSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:07.902774] [INFO ] [MAIN ] RSI: Generated 138 derivative records from 46976 primary records. [2025-10-22T23:37:07.902914] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-10-22T23:37:07.914729] [DEBUG] [LOCAL ] RSI: Derivative data saved (138 records). [2025-10-22T23:37:07.914815] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-10-22T23:37:07.917502] [INFO ] [MAIN ] Derivative Progress: 1572/2052 symbols. RSI took 0.4s. Estimated remaining time: 3m 9s [2025-10-22T23:37:07.917603] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:07.948309] [DEBUG] [LOCAL ] RSKD: Loaded 33238 existing records from primary storage. [2025-10-22T23:37:07.948470] [INFO ] [MAIN ] RSKD: Loaded 33238 primary data records. [2025-10-22T23:37:08.280161] [DEBUG] [MAIN ] RSKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:08.305312] [INFO ] [MAIN ] RSKD: Generated 138 derivative records from 33238 primary records. [2025-10-22T23:37:08.305455] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-10-22T23:37:08.316451] [DEBUG] [LOCAL ] RSKD: Derivative data saved (138 records). [2025-10-22T23:37:08.316545] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-10-22T23:37:08.319366] [INFO ] [MAIN ] Derivative Progress: 1573/2052 symbols. RSKD took 0.4s. Estimated remaining time: 3m 9s [2025-10-22T23:37:08.319472] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:08.356130] [DEBUG] [LOCAL ] RTO: Loaded 39724 existing records from primary storage. [2025-10-22T23:37:08.356295] [INFO ] [MAIN ] RTO: Loaded 39724 primary data records. [2025-10-22T23:37:08.659622] [DEBUG] [MAIN ] RTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:08.684584] [INFO ] [MAIN ] RTO: Generated 138 derivative records from 39724 primary records. [2025-10-22T23:37:08.684734] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-10-22T23:37:08.696389] [DEBUG] [LOCAL ] RTO: Derivative data saved (138 records). [2025-10-22T23:37:08.696475] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-10-22T23:37:08.699257] [INFO ] [MAIN ] Derivative Progress: 1574/2052 symbols. RTO took 0.4s. Estimated remaining time: 3m 8s [2025-10-22T23:37:08.699358] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:08.753203] [DEBUG] [LOCAL ] RTX: Loaded 53706 existing records from primary storage. [2025-10-22T23:37:08.753372] [INFO ] [MAIN ] RTX: Loaded 53706 primary data records. [2025-10-22T23:37:09.056929] [DEBUG] [MAIN ] RTX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:09.082239] [INFO ] [MAIN ] RTX: Generated 138 derivative records from 53706 primary records. [2025-10-22T23:37:09.082405] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-10-22T23:37:09.094324] [DEBUG] [LOCAL ] RTX: Derivative data saved (138 records). [2025-10-22T23:37:09.094429] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-10-22T23:37:09.097400] [INFO ] [MAIN ] Derivative Progress: 1575/2052 symbols. RTX took 0.4s. Estimated remaining time: 3m 8s [2025-10-22T23:37:09.097514] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:09.143007] [DEBUG] [LOCAL ] RVLV: Loaded 47368 existing records from primary storage. [2025-10-22T23:37:09.143192] [INFO ] [MAIN ] RVLV: Loaded 47368 primary data records. [2025-10-22T23:37:09.478250] [DEBUG] [MAIN ] RVLV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:09.503904] [INFO ] [MAIN ] RVLV: Generated 138 derivative records from 47368 primary records. [2025-10-22T23:37:09.504089] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-10-22T23:37:09.515637] [DEBUG] [LOCAL ] RVLV: Derivative data saved (138 records). [2025-10-22T23:37:09.515756] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-10-22T23:37:09.518345] [INFO ] [MAIN ] Derivative Progress: 1576/2052 symbols. RVLV took 0.4s. Estimated remaining time: 3m 8s [2025-10-22T23:37:09.518457] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:09.546591] [DEBUG] [LOCAL ] RVT: Loaded 26119 existing records from primary storage. [2025-10-22T23:37:09.546792] [INFO ] [MAIN ] RVT: Loaded 26119 primary data records. [2025-10-22T23:37:09.849152] [DEBUG] [MAIN ] RVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:09.874207] [INFO ] [MAIN ] RVT: Generated 138 derivative records from 26119 primary records. [2025-10-22T23:37:09.874354] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-10-22T23:37:09.885850] [DEBUG] [LOCAL ] RVT: Derivative data saved (138 records). [2025-10-22T23:37:09.885934] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-10-22T23:37:09.888573] [INFO ] [MAIN ] Derivative Progress: 1577/2052 symbols. RVT took 0.4s. Estimated remaining time: 3m 7s [2025-10-22T23:37:09.888707] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:09.932427] [DEBUG] [LOCAL ] RVTY: Loaded 47785 existing records from primary storage. [2025-10-22T23:37:09.932588] [INFO ] [MAIN ] RVTY: Loaded 47785 primary data records. [2025-10-22T23:37:10.260020] [DEBUG] [MAIN ] RVTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:10.285254] [INFO ] [MAIN ] RVTY: Generated 138 derivative records from 47785 primary records. [2025-10-22T23:37:10.285384] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-10-22T23:37:10.296833] [DEBUG] [LOCAL ] RVTY: Derivative data saved (138 records). [2025-10-22T23:37:10.296923] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-10-22T23:37:10.299634] [INFO ] [MAIN ] Derivative Progress: 1578/2052 symbols. RVTY took 0.4s. Estimated remaining time: 3m 7s [2025-10-22T23:37:10.299756] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:10.337300] [DEBUG] [LOCAL ] RWT: Loaded 40374 existing records from primary storage. [2025-10-22T23:37:10.337458] [INFO ] [MAIN ] RWT: Loaded 40374 primary data records. [2025-10-22T23:37:10.641217] [DEBUG] [MAIN ] RWT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:10.666107] [INFO ] [MAIN ] RWT: Generated 138 derivative records from 40374 primary records. [2025-10-22T23:37:10.666221] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-10-22T23:37:10.677560] [DEBUG] [LOCAL ] RWT: Derivative data saved (138 records). [2025-10-22T23:37:10.677662] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-10-22T23:37:10.680444] [INFO ] [MAIN ] Derivative Progress: 1579/2052 symbols. RWT took 0.4s. Estimated remaining time: 3m 6s [2025-10-22T23:37:10.680544] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:10.724770] [DEBUG] [LOCAL ] RXO: Loaded 48464 existing records from primary storage. [2025-10-22T23:37:10.724929] [INFO ] [MAIN ] RXO: Loaded 48464 primary data records. [2025-10-22T23:37:11.032917] [DEBUG] [MAIN ] RXO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:37:11.058513] [INFO ] [MAIN ] RXO: Generated 138 derivative records from 48464 primary records. [2025-10-22T23:37:11.058739] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-10-22T23:37:11.070500] [DEBUG] [LOCAL ] RXO: Derivative data saved (138 records). [2025-10-22T23:37:11.070578] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-10-22T23:37:11.073520] [INFO ] [MAIN ] Derivative Progress: 1580/2052 symbols. RXO took 0.4s. Estimated remaining time: 3m 6s [2025-10-22T23:37:11.073616] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:11.118784] [DEBUG] [LOCAL ] RY: Loaded 47473 existing records from primary storage. [2025-10-22T23:37:11.118947] [INFO ] [MAIN ] RY: Loaded 47473 primary data records. [2025-10-22T23:37:11.423170] [DEBUG] [MAIN ] RY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:11.448596] [INFO ] [MAIN ] RY: Generated 138 derivative records from 47473 primary records. [2025-10-22T23:37:11.448727] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-10-22T23:37:11.460422] [DEBUG] [LOCAL ] RY: Derivative data saved (138 records). [2025-10-22T23:37:11.460512] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-10-22T23:37:11.463404] [INFO ] [MAIN ] Derivative Progress: 1581/2052 symbols. RY took 0.4s. Estimated remaining time: 3m 6s [2025-10-22T23:37:11.463498] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:11.496258] [DEBUG] [LOCAL ] RYAM: Loaded 35018 existing records from primary storage. [2025-10-22T23:37:11.496412] [INFO ] [MAIN ] RYAM: Loaded 35018 primary data records. [2025-10-22T23:37:11.802758] [DEBUG] [MAIN ] RYAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:11.828381] [INFO ] [MAIN ] RYAM: Generated 138 derivative records from 35018 primary records. [2025-10-22T23:37:11.828489] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-10-22T23:37:11.839418] [DEBUG] [LOCAL ] RYAM: Derivative data saved (138 records). [2025-10-22T23:37:11.839499] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-10-22T23:37:11.842247] [INFO ] [MAIN ] Derivative Progress: 1582/2052 symbols. RYAM took 0.4s. Estimated remaining time: 3m 5s [2025-10-22T23:37:11.842340] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:11.886495] [DEBUG] [LOCAL ] RYAN: Loaded 45003 existing records from primary storage. [2025-10-22T23:37:11.886679] [INFO ] [MAIN ] RYAN: Loaded 45003 primary data records. [2025-10-22T23:37:12.221274] [DEBUG] [MAIN ] RYAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:12.246218] [INFO ] [MAIN ] RYAN: Generated 138 derivative records from 45003 primary records. [2025-10-22T23:37:12.246369] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-10-22T23:37:12.257918] [DEBUG] [LOCAL ] RYAN: Derivative data saved (138 records). [2025-10-22T23:37:12.258011] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-10-22T23:37:12.260963] [INFO ] [MAIN ] Derivative Progress: 1583/2052 symbols. RYAN took 0.4s. Estimated remaining time: 3m 5s [2025-10-22T23:37:12.261073] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:12.283515] [DEBUG] [LOCAL ] RYI: Loaded 21663 existing records from primary storage. [2025-10-22T23:37:12.283693] [INFO ] [MAIN ] RYI: Loaded 21663 primary data records. [2025-10-22T23:37:12.587190] [DEBUG] [MAIN ] RYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:12.612703] [INFO ] [MAIN ] RYI: Generated 138 derivative records from 21663 primary records. [2025-10-22T23:37:12.612901] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-10-22T23:37:12.624469] [DEBUG] [LOCAL ] RYI: Derivative data saved (138 records). [2025-10-22T23:37:12.624562] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-10-22T23:37:12.627310] [INFO ] [MAIN ] Derivative Progress: 1584/2052 symbols. RYI took 0.4s. Estimated remaining time: 3m 4s [2025-10-22T23:37:12.627406] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:12.671222] [DEBUG] [LOCAL ] RYN: Loaded 45740 existing records from primary storage. [2025-10-22T23:37:12.671386] [INFO ] [MAIN ] RYN: Loaded 45740 primary data records. [2025-10-22T23:37:12.973562] [DEBUG] [MAIN ] RYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:12.998534] [INFO ] [MAIN ] RYN: Generated 138 derivative records from 45740 primary records. [2025-10-22T23:37:12.998704] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-10-22T23:37:13.010495] [DEBUG] [LOCAL ] RYN: Derivative data saved (138 records). [2025-10-22T23:37:13.010577] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-10-22T23:37:13.013487] [INFO ] [MAIN ] Derivative Progress: 1585/2052 symbols. RYN took 0.4s. Estimated remaining time: 3m 4s [2025-10-22T23:37:13.013587] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:13.023593] [DEBUG] [LOCAL ] RZB: Loaded 5891 existing records from primary storage. [2025-10-22T23:37:13.023741] [INFO ] [MAIN ] RZB: Loaded 5891 primary data records. [2025-10-22T23:37:13.327427] [DEBUG] [MAIN ] RZB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:13.354188] [INFO ] [MAIN ] RZB: Generated 138 derivative records from 5891 primary records. [2025-10-22T23:37:13.354376] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-10-22T23:37:13.365628] [DEBUG] [LOCAL ] RZB: Derivative data saved (138 records). [2025-10-22T23:37:13.365764] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-10-22T23:37:13.367971] [INFO ] [MAIN ] Derivative Progress: 1586/2052 symbols. RZB took 0.4s. Estimated remaining time: 3m 4s [2025-10-22T23:37:13.368064] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:13.377138] [DEBUG] [LOCAL ] RZC: Loaded 6485 existing records from primary storage. [2025-10-22T23:37:13.377298] [INFO ] [MAIN ] RZC: Loaded 6485 primary data records. [2025-10-22T23:37:13.675103] [DEBUG] [MAIN ] RZC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:13.700193] [INFO ] [MAIN ] RZC: Generated 138 derivative records from 6485 primary records. [2025-10-22T23:37:13.700317] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-22T23:37:13.711549] [DEBUG] [LOCAL ] RZC: Derivative data saved (138 records). [2025-10-22T23:37:13.711633] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-10-22T23:37:13.713822] [INFO ] [MAIN ] Derivative Progress: 1587/2052 symbols. RZC took 0.3s. Estimated remaining time: 3m 3s [2025-10-22T23:37:13.713923] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:13.769119] [DEBUG] [LOCAL ] S: Loaded 53538 existing records from primary storage. [2025-10-22T23:37:13.769291] [INFO ] [MAIN ] S: Loaded 53538 primary data records. [2025-10-22T23:37:14.076061] [DEBUG] [MAIN ] S: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:14.104761] [INFO ] [MAIN ] S: Generated 138 derivative records from 53538 primary records. [2025-10-22T23:37:14.104918] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-22T23:37:14.117345] [DEBUG] [LOCAL ] S: Derivative data saved (138 records). [2025-10-22T23:37:14.117457] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-22T23:37:14.120694] [INFO ] [MAIN ] Derivative Progress: 1588/2052 symbols. S took 0.4s. Estimated remaining time: 3m 3s [2025-10-22T23:37:14.120807] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:14.167223] [DEBUG] [LOCAL ] SA: Loaded 44669 existing records from primary storage. [2025-10-22T23:37:14.167414] [INFO ] [MAIN ] SA: Loaded 44669 primary data records. [2025-10-22T23:37:14.546913] [DEBUG] [MAIN ] SA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:14.574783] [INFO ] [MAIN ] SA: Generated 138 derivative records from 44669 primary records. [2025-10-22T23:37:14.574969] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-22T23:37:14.589128] [DEBUG] [LOCAL ] SA: Derivative data saved (138 records). [2025-10-22T23:37:14.589215] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-22T23:37:14.592466] [INFO ] [MAIN ] Derivative Progress: 1589/2052 symbols. SA took 0.5s. Estimated remaining time: 3m 2s [2025-10-22T23:37:14.592606] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:14.606366] [DEBUG] [LOCAL ] SABA: Loaded 9181 existing records from primary storage. [2025-10-22T23:37:14.606513] [INFO ] [MAIN ] SABA: Loaded 9181 primary data records. [2025-10-22T23:37:14.942063] [DEBUG] [MAIN ] SABA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:14.971333] [INFO ] [MAIN ] SABA: Generated 138 derivative records from 9181 primary records. [2025-10-22T23:37:14.971531] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-22T23:37:14.984660] [DEBUG] [LOCAL ] SABA: Derivative data saved (138 records). [2025-10-22T23:37:14.984834] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-22T23:37:14.987182] [INFO ] [MAIN ] Derivative Progress: 1590/2052 symbols. SABA took 0.4s. Estimated remaining time: 3m 2s [2025-10-22T23:37:14.987331] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:15.019180] [DEBUG] [LOCAL ] SAFE: Loaded 29883 existing records from primary storage. [2025-10-22T23:37:15.019342] [INFO ] [MAIN ] SAFE: Loaded 29883 primary data records. [2025-10-22T23:37:15.333247] [DEBUG] [MAIN ] SAFE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:15.358085] [INFO ] [MAIN ] SAFE: Generated 138 derivative records from 29883 primary records. [2025-10-22T23:37:15.358229] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-22T23:37:15.369806] [DEBUG] [LOCAL ] SAFE: Derivative data saved (138 records). [2025-10-22T23:37:15.369892] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-10-22T23:37:15.372854] [INFO ] [MAIN ] Derivative Progress: 1591/2052 symbols. SAFE took 0.4s. Estimated remaining time: 3m 2s [2025-10-22T23:37:15.372960] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:15.394759] [DEBUG] [LOCAL ] SAH: Loaded 20685 existing records from primary storage. [2025-10-22T23:37:15.394913] [INFO ] [MAIN ] SAH: Loaded 20685 primary data records. [2025-10-22T23:37:15.696814] [DEBUG] [MAIN ] SAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:15.721739] [INFO ] [MAIN ] SAH: Generated 138 derivative records from 20685 primary records. [2025-10-22T23:37:15.721850] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-22T23:37:15.733156] [DEBUG] [LOCAL ] SAH: Derivative data saved (138 records). [2025-10-22T23:37:15.733237] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-10-22T23:37:15.736077] [INFO ] [MAIN ] Derivative Progress: 1592/2052 symbols. SAH took 0.4s. Estimated remaining time: 3m 1s [2025-10-22T23:37:15.736171] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:15.758729] [DEBUG] [LOCAL ] SAM: Loaded 21215 existing records from primary storage. [2025-10-22T23:37:15.758881] [INFO ] [MAIN ] SAM: Loaded 21215 primary data records. [2025-10-22T23:37:16.061172] [DEBUG] [MAIN ] SAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:16.086406] [INFO ] [MAIN ] SAM: Generated 138 derivative records from 21215 primary records. [2025-10-22T23:37:16.086549] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-22T23:37:16.098130] [DEBUG] [LOCAL ] SAM: Derivative data saved (138 records). [2025-10-22T23:37:16.098210] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-10-22T23:37:16.101046] [INFO ] [MAIN ] Derivative Progress: 1593/2052 symbols. SAM took 0.4s. Estimated remaining time: 3m 1s [2025-10-22T23:37:16.101151] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:16.152224] [DEBUG] [LOCAL ] SAN: Loaded 52964 existing records from primary storage. [2025-10-22T23:37:16.152383] [INFO ] [MAIN ] SAN: Loaded 52964 primary data records. [2025-10-22T23:37:16.482069] [DEBUG] [MAIN ] SAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:16.508078] [INFO ] [MAIN ] SAN: Generated 138 derivative records from 52964 primary records. [2025-10-22T23:37:16.508245] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-22T23:37:16.519986] [DEBUG] [LOCAL ] SAN: Derivative data saved (138 records). [2025-10-22T23:37:16.520074] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-22T23:37:16.523239] [INFO ] [MAIN ] Derivative Progress: 1594/2052 symbols. SAN took 0.4s. Estimated remaining time: 3m 0s [2025-10-22T23:37:16.523344] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:16.571137] [DEBUG] [LOCAL ] SAP: Loaded 49878 existing records from primary storage. [2025-10-22T23:37:16.571307] [INFO ] [MAIN ] SAP: Loaded 49878 primary data records. [2025-10-22T23:37:16.883587] [DEBUG] [MAIN ] SAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:16.909504] [INFO ] [MAIN ] SAP: Generated 138 derivative records from 49878 primary records. [2025-10-22T23:37:16.909677] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-22T23:37:16.921456] [DEBUG] [LOCAL ] SAP: Derivative data saved (138 records). [2025-10-22T23:37:16.921539] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-22T23:37:16.924405] [INFO ] [MAIN ] Derivative Progress: 1595/2052 symbols. SAP took 0.4s. Estimated remaining time: 3m 0s [2025-10-22T23:37:16.924505] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:16.945170] [DEBUG] [LOCAL ] SAR: Loaded 17125 existing records from primary storage. [2025-10-22T23:37:16.945345] [INFO ] [MAIN ] SAR: Loaded 17125 primary data records. [2025-10-22T23:37:17.253742] [DEBUG] [MAIN ] SAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:17.278964] [INFO ] [MAIN ] SAR: Generated 138 derivative records from 17125 primary records. [2025-10-22T23:37:17.279122] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-10-22T23:37:17.290873] [DEBUG] [LOCAL ] SAR: Derivative data saved (138 records). [2025-10-22T23:37:17.290969] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-10-22T23:37:17.293671] [INFO ] [MAIN ] Derivative Progress: 1596/2052 symbols. SAR took 0.4s. Estimated remaining time: 2m 60s [2025-10-22T23:37:17.293791] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:17.338896] [DEBUG] [LOCAL ] SARO: Loaded 48231 existing records from primary storage. [2025-10-22T23:37:17.339081] [INFO ] [MAIN ] SARO: Loaded 48231 primary data records. [2025-10-22T23:37:17.651198] [DEBUG] [MAIN ] SARO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:17.676026] [INFO ] [MAIN ] SARO: Generated 138 derivative records from 48231 primary records. [2025-10-22T23:37:17.676146] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-22T23:37:17.687580] [DEBUG] [LOCAL ] SARO: Derivative data saved (138 records). [2025-10-22T23:37:17.687699] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-10-22T23:37:17.690610] [INFO ] [MAIN ] Derivative Progress: 1597/2052 symbols. SARO took 0.4s. Estimated remaining time: 2m 59s [2025-10-22T23:37:17.690742] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:17.721016] [DEBUG] [LOCAL ] SB: Loaded 32405 existing records from primary storage. [2025-10-22T23:37:17.721166] [INFO ] [MAIN ] SB: Loaded 32405 primary data records. [2025-10-22T23:37:18.029982] [DEBUG] [MAIN ] SB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:18.055695] [INFO ] [MAIN ] SB: Generated 138 derivative records from 32405 primary records. [2025-10-22T23:37:18.055824] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-22T23:37:18.066961] [DEBUG] [LOCAL ] SB: Derivative data saved (138 records). [2025-10-22T23:37:18.067042] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-22T23:37:18.069891] [INFO ] [MAIN ] Derivative Progress: 1598/2052 symbols. SB took 0.4s. Estimated remaining time: 2m 59s [2025-10-22T23:37:18.069991] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:18.116286] [DEBUG] [LOCAL ] SBH: Loaded 49854 existing records from primary storage. [2025-10-22T23:37:18.116447] [INFO ] [MAIN ] SBH: Loaded 49854 primary data records. [2025-10-22T23:37:18.452194] [DEBUG] [MAIN ] SBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:18.477841] [INFO ] [MAIN ] SBH: Generated 138 derivative records from 49854 primary records. [2025-10-22T23:37:18.477982] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-22T23:37:18.489568] [DEBUG] [LOCAL ] SBH: Derivative data saved (138 records). [2025-10-22T23:37:18.489683] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-10-22T23:37:18.492578] [INFO ] [MAIN ] Derivative Progress: 1599/2052 symbols. SBH took 0.4s. Estimated remaining time: 2m 58s [2025-10-22T23:37:18.492698] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:18.504787] [DEBUG] [LOCAL ] SBI: Loaded 7748 existing records from primary storage. [2025-10-22T23:37:18.504950] [INFO ] [MAIN ] SBI: Loaded 7748 primary data records. [2025-10-22T23:37:18.818533] [DEBUG] [MAIN ] SBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:18.843976] [INFO ] [MAIN ] SBI: Generated 138 derivative records from 7748 primary records. [2025-10-22T23:37:18.844097] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-22T23:37:18.854455] [DEBUG] [LOCAL ] SBI: Derivative data saved (138 records). [2025-10-22T23:37:18.854602] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-22T23:37:18.856736] [INFO ] [MAIN ] Derivative Progress: 1600/2052 symbols. SBI took 0.4s. Estimated remaining time: 2m 58s [2025-10-22T23:37:18.856847] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:18.867097] [DEBUG] [LOCAL ] SBR: Loaded 7813 existing records from primary storage. [2025-10-22T23:37:18.867281] [INFO ] [MAIN ] SBR: Loaded 7813 primary data records. [2025-10-22T23:37:19.179223] [DEBUG] [MAIN ] SBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:19.205387] [INFO ] [MAIN ] SBR: Generated 138 derivative records from 7813 primary records. [2025-10-22T23:37:19.205525] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-22T23:37:19.216489] [DEBUG] [LOCAL ] SBR: Derivative data saved (138 records). [2025-10-22T23:37:19.216573] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-22T23:37:19.218741] [INFO ] [MAIN ] Derivative Progress: 1601/2052 symbols. SBR took 0.4s. Estimated remaining time: 2m 58s [2025-10-22T23:37:19.218839] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:19.265513] [DEBUG] [LOCAL ] SBS: Loaded 49293 existing records from primary storage. [2025-10-22T23:37:19.265699] [INFO ] [MAIN ] SBS: Loaded 49293 primary data records. [2025-10-22T23:37:19.579228] [DEBUG] [MAIN ] SBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:19.606010] [INFO ] [MAIN ] SBS: Generated 138 derivative records from 49293 primary records. [2025-10-22T23:37:19.606170] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-22T23:37:19.618096] [DEBUG] [LOCAL ] SBS: Derivative data saved (138 records). [2025-10-22T23:37:19.618185] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-22T23:37:19.621310] [INFO ] [MAIN ] Derivative Progress: 1602/2052 symbols. SBS took 0.4s. Estimated remaining time: 2m 57s [2025-10-22T23:37:19.621446] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:19.641018] [DEBUG] [LOCAL ] SBSI: Loaded 14802 existing records from primary storage. [2025-10-22T23:37:19.641177] [INFO ] [MAIN ] SBSI: Loaded 14802 primary data records. [2025-10-22T23:37:19.989789] [DEBUG] [MAIN ] SBSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:20.016909] [INFO ] [MAIN ] SBSI: Generated 138 derivative records from 14802 primary records. [2025-10-22T23:37:20.017130] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-22T23:37:20.029004] [DEBUG] [LOCAL ] SBSI: Derivative data saved (138 records). [2025-10-22T23:37:20.029086] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-10-22T23:37:20.031806] [INFO ] [MAIN ] Derivative Progress: 1603/2052 symbols. SBSI took 0.4s. Estimated remaining time: 2m 57s [2025-10-22T23:37:20.031904] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:20.082026] [DEBUG] [LOCAL ] SBSW: Loaded 53185 existing records from primary storage. [2025-10-22T23:37:20.082190] [INFO ] [MAIN ] SBSW: Loaded 53185 primary data records. [2025-10-22T23:37:20.386819] [DEBUG] [MAIN ] SBSW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:20.412150] [INFO ] [MAIN ] SBSW: Generated 138 derivative records from 53185 primary records. [2025-10-22T23:37:20.412318] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-22T23:37:20.423827] [DEBUG] [LOCAL ] SBSW: Derivative data saved (138 records). [2025-10-22T23:37:20.423912] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-22T23:37:20.426945] [INFO ] [MAIN ] Derivative Progress: 1604/2052 symbols. SBSW took 0.4s. Estimated remaining time: 2m 56s [2025-10-22T23:37:20.427043] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:20.472926] [DEBUG] [LOCAL ] SCCO: Loaded 49566 existing records from primary storage. [2025-10-22T23:37:20.473093] [INFO ] [MAIN ] SCCO: Loaded 49566 primary data records. [2025-10-22T23:37:20.803904] [DEBUG] [MAIN ] SCCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:20.828953] [INFO ] [MAIN ] SCCO: Generated 138 derivative records from 49566 primary records. [2025-10-22T23:37:20.829107] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-22T23:37:20.840622] [DEBUG] [LOCAL ] SCCO: Derivative data saved (138 records). [2025-10-22T23:37:20.840727] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-22T23:37:20.843871] [INFO ] [MAIN ] Derivative Progress: 1605/2052 symbols. SCCO took 0.4s. Estimated remaining time: 2m 56s [2025-10-22T23:37:20.843985] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:20.860830] [DEBUG] [LOCAL ] SCD: Loaded 13496 existing records from primary storage. [2025-10-22T23:37:20.860972] [INFO ] [MAIN ] SCD: Loaded 13496 primary data records. [2025-10-22T23:37:21.177730] [DEBUG] [MAIN ] SCD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:21.203190] [INFO ] [MAIN ] SCD: Generated 138 derivative records from 13496 primary records. [2025-10-22T23:37:21.203390] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-22T23:37:21.215177] [DEBUG] [LOCAL ] SCD: Derivative data saved (138 records). [2025-10-22T23:37:21.215331] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-22T23:37:21.218261] [INFO ] [MAIN ] Derivative Progress: 1606/2052 symbols. SCD took 0.4s. Estimated remaining time: 2m 56s [2025-10-22T23:37:21.218455] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:21.272807] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-22T23:37:21.273008] [INFO ] [MAIN ] SCHW: Loaded 53685 primary data records. [2025-10-22T23:37:21.591079] [DEBUG] [MAIN ] SCHW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:21.616791] [INFO ] [MAIN ] SCHW: Generated 138 derivative records from 53685 primary records. [2025-10-22T23:37:21.616987] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-22T23:37:21.628858] [DEBUG] [LOCAL ] SCHW: Derivative data saved (138 records). [2025-10-22T23:37:21.628995] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-10-22T23:37:21.632186] [INFO ] [MAIN ] Derivative Progress: 1607/2052 symbols. SCHW took 0.4s. Estimated remaining time: 2m 55s [2025-10-22T23:37:21.632332] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:21.676257] [DEBUG] [LOCAL ] SCI: Loaded 46165 existing records from primary storage. [2025-10-22T23:37:21.676443] [INFO ] [MAIN ] SCI: Loaded 46165 primary data records. [2025-10-22T23:37:21.983741] [DEBUG] [MAIN ] SCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:22.008927] [INFO ] [MAIN ] SCI: Generated 138 derivative records from 46165 primary records. [2025-10-22T23:37:22.009082] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-22T23:37:22.020592] [DEBUG] [LOCAL ] SCI: Derivative data saved (138 records). [2025-10-22T23:37:22.020707] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-10-22T23:37:22.023545] [INFO ] [MAIN ] Derivative Progress: 1608/2052 symbols. SCI took 0.4s. Estimated remaining time: 2m 55s [2025-10-22T23:37:22.023684] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:22.041207] [DEBUG] [LOCAL ] SCL: Loaded 15126 existing records from primary storage. [2025-10-22T23:37:22.041360] [INFO ] [MAIN ] SCL: Loaded 15126 primary data records. [2025-10-22T23:37:22.348038] [DEBUG] [MAIN ] SCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:22.373594] [INFO ] [MAIN ] SCL: Generated 138 derivative records from 15126 primary records. [2025-10-22T23:37:22.373741] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-22T23:37:22.385120] [DEBUG] [LOCAL ] SCL: Derivative data saved (138 records). [2025-10-22T23:37:22.385212] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-10-22T23:37:22.388062] [INFO ] [MAIN ] Derivative Progress: 1609/2052 symbols. SCL took 0.4s. Estimated remaining time: 2m 55s [2025-10-22T23:37:22.388159] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:22.409940] [DEBUG] [LOCAL ] SCM: Loaded 19989 existing records from primary storage. [2025-10-22T23:37:22.410093] [INFO ] [MAIN ] SCM: Loaded 19989 primary data records. [2025-10-22T23:37:22.748812] [DEBUG] [MAIN ] SCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:22.774189] [INFO ] [MAIN ] SCM: Generated 138 derivative records from 19989 primary records. [2025-10-22T23:37:22.774362] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-22T23:37:22.786021] [DEBUG] [LOCAL ] SCM: Derivative data saved (138 records). [2025-10-22T23:37:22.786138] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-22T23:37:22.789165] [INFO ] [MAIN ] Derivative Progress: 1610/2052 symbols. SCM took 0.4s. Estimated remaining time: 2m 54s [2025-10-22T23:37:22.789331] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:22.839106] [DEBUG] [LOCAL ] SCS: Loaded 43227 existing records from primary storage. [2025-10-22T23:37:22.839336] [INFO ] [MAIN ] SCS: Loaded 43227 primary data records. [2025-10-22T23:37:23.162203] [DEBUG] [MAIN ] SCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:23.195851] [INFO ] [MAIN ] SCS: Generated 138 derivative records from 43227 primary records. [2025-10-22T23:37:23.196067] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-22T23:37:23.211795] [DEBUG] [LOCAL ] SCS: Derivative data saved (138 records). [2025-10-22T23:37:23.211967] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-22T23:37:23.215214] [INFO ] [MAIN ] Derivative Progress: 1611/2052 symbols. SCS took 0.4s. Estimated remaining time: 2m 54s [2025-10-22T23:37:23.215329] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:23.248436] [DEBUG] [LOCAL ] SD: Loaded 28248 existing records from primary storage. [2025-10-22T23:37:23.248599] [INFO ] [MAIN ] SD: Loaded 28248 primary data records. [2025-10-22T23:37:23.566103] [DEBUG] [MAIN ] SD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:23.592020] [INFO ] [MAIN ] SD: Generated 138 derivative records from 28248 primary records. [2025-10-22T23:37:23.592201] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-22T23:37:23.604982] [DEBUG] [LOCAL ] SD: Derivative data saved (138 records). [2025-10-22T23:37:23.605116] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-10-22T23:37:23.608040] [INFO ] [MAIN ] Derivative Progress: 1612/2052 symbols. SD took 0.4s. Estimated remaining time: 2m 53s [2025-10-22T23:37:23.608140] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:23.622607] [DEBUG] [LOCAL ] SDHC: Loaded 10378 existing records from primary storage. [2025-10-22T23:37:23.622811] [INFO ] [MAIN ] SDHC: Loaded 10378 primary data records. [2025-10-22T23:37:23.931159] [DEBUG] [MAIN ] SDHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:23.956046] [INFO ] [MAIN ] SDHC: Generated 138 derivative records from 10378 primary records. [2025-10-22T23:37:23.956170] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-22T23:37:23.967565] [DEBUG] [LOCAL ] SDHC: Derivative data saved (138 records). [2025-10-22T23:37:23.967666] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-22T23:37:23.969983] [INFO ] [MAIN ] Derivative Progress: 1613/2052 symbols. SDHC took 0.4s. Estimated remaining time: 2m 53s [2025-10-22T23:37:23.970078] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:23.984683] [DEBUG] [LOCAL ] SDHY: Loaded 11210 existing records from primary storage. [2025-10-22T23:37:23.984809] [INFO ] [MAIN ] SDHY: Loaded 11210 primary data records. [2025-10-22T23:37:24.290238] [DEBUG] [MAIN ] SDHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:24.315853] [INFO ] [MAIN ] SDHY: Generated 138 derivative records from 11210 primary records. [2025-10-22T23:37:24.316041] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-22T23:37:24.327261] [DEBUG] [LOCAL ] SDHY: Derivative data saved (138 records). [2025-10-22T23:37:24.327402] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-22T23:37:24.330194] [INFO ] [MAIN ] Derivative Progress: 1614/2052 symbols. SDHY took 0.4s. Estimated remaining time: 2m 53s [2025-10-22T23:37:24.330340] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:24.369507] [DEBUG] [LOCAL ] SDRL: Loaded 41106 existing records from primary storage. [2025-10-22T23:37:24.369724] [INFO ] [MAIN ] SDRL: Loaded 41106 primary data records. [2025-10-22T23:37:24.699182] [DEBUG] [MAIN ] SDRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:24.724227] [INFO ] [MAIN ] SDRL: Generated 138 derivative records from 41106 primary records. [2025-10-22T23:37:24.724335] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-10-22T23:37:24.735685] [DEBUG] [LOCAL ] SDRL: Derivative data saved (138 records). [2025-10-22T23:37:24.735765] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-10-22T23:37:24.738740] [INFO ] [MAIN ] Derivative Progress: 1615/2052 symbols. SDRL took 0.4s. Estimated remaining time: 2m 52s [2025-10-22T23:37:24.738836] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:24.781988] [DEBUG] [LOCAL ] SEE: Loaded 48091 existing records from primary storage. [2025-10-22T23:37:24.782142] [INFO ] [MAIN ] SEE: Loaded 48091 primary data records. [2025-10-22T23:37:25.083968] [DEBUG] [MAIN ] SEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:25.109000] [INFO ] [MAIN ] SEE: Generated 138 derivative records from 48091 primary records. [2025-10-22T23:37:25.109134] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-22T23:37:25.120579] [DEBUG] [LOCAL ] SEE: Derivative data saved (138 records). [2025-10-22T23:37:25.120685] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-10-22T23:37:25.123582] [INFO ] [MAIN ] Derivative Progress: 1616/2052 symbols. SEE took 0.4s. Estimated remaining time: 2m 52s [2025-10-22T23:37:25.123712] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:25.139181] [DEBUG] [LOCAL ] SEG: Loaded 12503 existing records from primary storage. [2025-10-22T23:37:25.139326] [INFO ] [MAIN ] SEG: Loaded 12503 primary data records. [2025-10-22T23:37:25.441511] [DEBUG] [MAIN ] SEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:25.466511] [INFO ] [MAIN ] SEG: Generated 138 derivative records from 12503 primary records. [2025-10-22T23:37:25.466633] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-22T23:37:25.477732] [DEBUG] [LOCAL ] SEG: Derivative data saved (138 records). [2025-10-22T23:37:25.477814] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-22T23:37:25.480483] [INFO ] [MAIN ] Derivative Progress: 1617/2052 symbols. SEG took 0.4s. Estimated remaining time: 2m 51s [2025-10-22T23:37:25.480602] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:25.525999] [DEBUG] [LOCAL ] SEI: Loaded 50024 existing records from primary storage. [2025-10-22T23:37:25.526163] [INFO ] [MAIN ] SEI: Loaded 50024 primary data records. [2025-10-22T23:37:25.827866] [DEBUG] [MAIN ] SEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:25.852918] [INFO ] [MAIN ] SEI: Generated 138 derivative records from 50024 primary records. [2025-10-22T23:37:25.853026] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-22T23:37:25.864347] [DEBUG] [LOCAL ] SEI: Derivative data saved (138 records). [2025-10-22T23:37:25.864425] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-22T23:37:25.867322] [INFO ] [MAIN ] Derivative Progress: 1618/2052 symbols. SEI took 0.4s. Estimated remaining time: 2m 51s [2025-10-22T23:37:25.867418] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:25.908384] [DEBUG] [LOCAL ] SEM: Loaded 43168 existing records from primary storage. [2025-10-22T23:37:25.908537] [INFO ] [MAIN ] SEM: Loaded 43168 primary data records. [2025-10-22T23:37:26.208998] [DEBUG] [MAIN ] SEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:26.234046] [INFO ] [MAIN ] SEM: Generated 138 derivative records from 43168 primary records. [2025-10-22T23:37:26.234157] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-22T23:37:26.245605] [DEBUG] [LOCAL ] SEM: Derivative data saved (138 records). [2025-10-22T23:37:26.245707] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-10-22T23:37:26.248331] [INFO ] [MAIN ] Derivative Progress: 1619/2052 symbols. SEM took 0.4s. Estimated remaining time: 2m 51s [2025-10-22T23:37:26.248432] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:26.286982] [DEBUG] [LOCAL ] SEMR: Loaded 42068 existing records from primary storage. [2025-10-22T23:37:26.287136] [INFO ] [MAIN ] SEMR: Loaded 42068 primary data records. [2025-10-22T23:37:26.619672] [DEBUG] [MAIN ] SEMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:26.644574] [INFO ] [MAIN ] SEMR: Generated 138 derivative records from 42068 primary records. [2025-10-22T23:37:26.644694] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-22T23:37:26.655978] [DEBUG] [LOCAL ] SEMR: Derivative data saved (138 records). [2025-10-22T23:37:26.656057] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-22T23:37:26.659022] [INFO ] [MAIN ] Derivative Progress: 1620/2052 symbols. SEMR took 0.4s. Estimated remaining time: 2m 50s [2025-10-22T23:37:26.659135] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:26.708613] [DEBUG] [LOCAL ] SES: Loaded 51614 existing records from primary storage. [2025-10-22T23:37:26.708799] [INFO ] [MAIN ] SES: Loaded 51614 primary data records. [2025-10-22T23:37:27.010189] [DEBUG] [MAIN ] SES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:27.035022] [INFO ] [MAIN ] SES: Generated 138 derivative records from 51614 primary records. [2025-10-22T23:37:27.035135] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-22T23:37:27.046480] [DEBUG] [LOCAL ] SES: Derivative data saved (138 records). [2025-10-22T23:37:27.046558] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-22T23:37:27.049587] [INFO ] [MAIN ] Derivative Progress: 1621/2052 symbols. SES took 0.4s. Estimated remaining time: 2m 50s [2025-10-22T23:37:27.049705] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:27.089145] [DEBUG] [LOCAL ] SF: Loaded 41355 existing records from primary storage. [2025-10-22T23:37:27.089306] [INFO ] [MAIN ] SF: Loaded 41355 primary data records. [2025-10-22T23:37:27.396599] [DEBUG] [MAIN ] SF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:27.421528] [INFO ] [MAIN ] SF: Generated 138 derivative records from 41355 primary records. [2025-10-22T23:37:27.421630] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-22T23:37:27.433067] [DEBUG] [LOCAL ] SF: Derivative data saved (138 records). [2025-10-22T23:37:27.433144] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-10-22T23:37:27.436044] [INFO ] [MAIN ] Derivative Progress: 1622/2052 symbols. SF took 0.4s. Estimated remaining time: 2m 49s [2025-10-22T23:37:27.436141] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:27.444001] [DEBUG] [LOCAL ] SFB: Loaded 3697 existing records from primary storage. [2025-10-22T23:37:27.444102] [INFO ] [MAIN ] SFB: Loaded 3697 primary data records. [2025-10-22T23:37:27.744974] [DEBUG] [MAIN ] SFB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:27.769912] [INFO ] [MAIN ] SFB: Generated 138 derivative records from 3697 primary records. [2025-10-22T23:37:27.770028] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-22T23:37:27.780103] [DEBUG] [LOCAL ] SFB: Derivative data saved (138 records). [2025-10-22T23:37:27.780189] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-22T23:37:27.782180] [INFO ] [MAIN ] Derivative Progress: 1623/2052 symbols. SFB took 0.3s. Estimated remaining time: 2m 49s [2025-10-22T23:37:27.782276] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:27.802500] [DEBUG] [LOCAL ] SFBS: Loaded 21398 existing records from primary storage. [2025-10-22T23:37:27.802630] [INFO ] [MAIN ] SFBS: Loaded 21398 primary data records. [2025-10-22T23:37:28.103354] [DEBUG] [MAIN ] SFBS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:37:28.128470] [INFO ] [MAIN ] SFBS: Generated 138 derivative records from 21398 primary records. [2025-10-22T23:37:28.128599] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-22T23:37:28.140067] [DEBUG] [LOCAL ] SFBS: Derivative data saved (138 records). [2025-10-22T23:37:28.140146] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-10-22T23:37:28.142908] [INFO ] [MAIN ] Derivative Progress: 1624/2052 symbols. SFBS took 0.4s. Estimated remaining time: 2m 49s [2025-10-22T23:37:28.143003] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:28.181951] [DEBUG] [LOCAL ] SFL: Loaded 45244 existing records from primary storage. [2025-10-22T23:37:28.182107] [INFO ] [MAIN ] SFL: Loaded 45244 primary data records. [2025-10-22T23:37:28.482372] [DEBUG] [MAIN ] SFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:28.507333] [INFO ] [MAIN ] SFL: Generated 138 derivative records from 45244 primary records. [2025-10-22T23:37:28.507436] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-10-22T23:37:28.518499] [DEBUG] [LOCAL ] SFL: Derivative data saved (138 records). [2025-10-22T23:37:28.518578] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-10-22T23:37:28.521293] [INFO ] [MAIN ] Derivative Progress: 1625/2052 symbols. SFL took 0.4s. Estimated remaining time: 2m 48s [2025-10-22T23:37:28.521414] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:28.572855] [DEBUG] [LOCAL ] SG: Loaded 53505 existing records from primary storage. [2025-10-22T23:37:28.573019] [INFO ] [MAIN ] SG: Loaded 53505 primary data records. [2025-10-22T23:37:28.895514] [DEBUG] [MAIN ] SG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:28.920456] [INFO ] [MAIN ] SG: Generated 138 derivative records from 53505 primary records. [2025-10-22T23:37:28.920569] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-22T23:37:28.932126] [DEBUG] [LOCAL ] SG: Derivative data saved (138 records). [2025-10-22T23:37:28.932205] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-10-22T23:37:28.935244] [INFO ] [MAIN ] Derivative Progress: 1626/2052 symbols. SG took 0.4s. Estimated remaining time: 2m 48s [2025-10-22T23:37:28.935337] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:28.979677] [DEBUG] [LOCAL ] SGHC: Loaded 47310 existing records from primary storage. [2025-10-22T23:37:28.979833] [INFO ] [MAIN ] SGHC: Loaded 47310 primary data records. [2025-10-22T23:37:29.280472] [DEBUG] [MAIN ] SGHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:29.305459] [INFO ] [MAIN ] SGHC: Generated 138 derivative records from 47310 primary records. [2025-10-22T23:37:29.305573] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-22T23:37:29.317104] [DEBUG] [LOCAL ] SGHC: Derivative data saved (138 records). [2025-10-22T23:37:29.317181] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-22T23:37:29.319858] [INFO ] [MAIN ] Derivative Progress: 1627/2052 symbols. SGHC took 0.4s. Estimated remaining time: 2m 47s [2025-10-22T23:37:29.319966] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:29.331124] [DEBUG] [LOCAL ] SGU: Loaded 6507 existing records from primary storage. [2025-10-22T23:37:29.331244] [INFO ] [MAIN ] SGU: Loaded 6507 primary data records. [2025-10-22T23:37:29.629724] [DEBUG] [MAIN ] SGU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:29.654233] [INFO ] [MAIN ] SGU: Generated 138 derivative records from 6507 primary records. [2025-10-22T23:37:29.654339] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-22T23:37:29.665003] [DEBUG] [LOCAL ] SGU: Derivative data saved (138 records). [2025-10-22T23:37:29.665083] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-22T23:37:29.667160] [INFO ] [MAIN ] Derivative Progress: 1628/2052 symbols. SGU took 0.3s. Estimated remaining time: 2m 47s [2025-10-22T23:37:29.667275] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:29.714234] [DEBUG] [LOCAL ] SHAK: Loaded 48652 existing records from primary storage. [2025-10-22T23:37:29.714400] [INFO ] [MAIN ] SHAK: Loaded 48652 primary data records. [2025-10-22T23:37:30.015995] [DEBUG] [MAIN ] SHAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:30.040723] [INFO ] [MAIN ] SHAK: Generated 138 derivative records from 48652 primary records. [2025-10-22T23:37:30.040827] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-22T23:37:30.052379] [DEBUG] [LOCAL ] SHAK: Derivative data saved (138 records). [2025-10-22T23:37:30.052467] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-10-22T23:37:30.055593] [INFO ] [MAIN ] Derivative Progress: 1629/2052 symbols. SHAK took 0.4s. Estimated remaining time: 2m 47s [2025-10-22T23:37:30.055713] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:30.109421] [DEBUG] [LOCAL ] SHEL: Loaded 53675 existing records from primary storage. [2025-10-22T23:37:30.109591] [INFO ] [MAIN ] SHEL: Loaded 53675 primary data records. [2025-10-22T23:37:30.410963] [DEBUG] [MAIN ] SHEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:30.435794] [INFO ] [MAIN ] SHEL: Generated 138 derivative records from 53675 primary records. [2025-10-22T23:37:30.435909] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-22T23:37:30.447293] [DEBUG] [LOCAL ] SHEL: Derivative data saved (138 records). [2025-10-22T23:37:30.447377] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-22T23:37:30.450407] [INFO ] [MAIN ] Derivative Progress: 1630/2052 symbols. SHEL took 0.4s. Estimated remaining time: 2m 46s [2025-10-22T23:37:30.450506] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:30.477102] [DEBUG] [LOCAL ] SHG: Loaded 26653 existing records from primary storage. [2025-10-22T23:37:30.477263] [INFO ] [MAIN ] SHG: Loaded 26653 primary data records. [2025-10-22T23:37:30.803528] [DEBUG] [MAIN ] SHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:30.828302] [INFO ] [MAIN ] SHG: Generated 138 derivative records from 26653 primary records. [2025-10-22T23:37:30.828434] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-22T23:37:30.839996] [DEBUG] [LOCAL ] SHG: Derivative data saved (138 records). [2025-10-22T23:37:30.840075] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-22T23:37:30.842958] [INFO ] [MAIN ] Derivative Progress: 1631/2052 symbols. SHG took 0.4s. Estimated remaining time: 2m 46s [2025-10-22T23:37:30.843058] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:30.887672] [DEBUG] [LOCAL ] SHO: Loaded 49127 existing records from primary storage. [2025-10-22T23:37:30.887833] [INFO ] [MAIN ] SHO: Loaded 49127 primary data records. [2025-10-22T23:37:31.188861] [DEBUG] [MAIN ] SHO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:31.213513] [INFO ] [MAIN ] SHO: Generated 138 derivative records from 49127 primary records. [2025-10-22T23:37:31.213617] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-22T23:37:31.224963] [DEBUG] [LOCAL ] SHO: Derivative data saved (138 records). [2025-10-22T23:37:31.225042] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-10-22T23:37:31.227864] [INFO ] [MAIN ] Derivative Progress: 1632/2052 symbols. SHO took 0.4s. Estimated remaining time: 2m 45s [2025-10-22T23:37:31.227968] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:31.233766] [DEBUG] [LOCAL ] SHOC: Loaded 3016 existing records from primary storage. [2025-10-22T23:37:31.233854] [INFO ] [MAIN ] SHOC: Loaded 3016 primary data records. [2025-10-22T23:37:31.532716] [DEBUG] [MAIN ] SHOC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:37:31.557882] [INFO ] [MAIN ] SHOC: Generated 138 derivative records from 3016 primary records. [2025-10-22T23:37:31.558034] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-22T23:37:31.568037] [DEBUG] [LOCAL ] SHOC: Derivative data saved (138 records). [2025-10-22T23:37:31.568114] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-22T23:37:31.570084] [INFO ] [MAIN ] Derivative Progress: 1633/2052 symbols. SHOC took 0.3s. Estimated remaining time: 2m 45s [2025-10-22T23:37:31.570177] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:31.616860] [DEBUG] [LOCAL ] SHW: Loaded 50382 existing records from primary storage. [2025-10-22T23:37:31.617016] [INFO ] [MAIN ] SHW: Loaded 50382 primary data records. [2025-10-22T23:37:31.917665] [DEBUG] [MAIN ] SHW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:31.942313] [INFO ] [MAIN ] SHW: Generated 138 derivative records from 50382 primary records. [2025-10-22T23:37:31.942419] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-22T23:37:31.953910] [DEBUG] [LOCAL ] SHW: Derivative data saved (138 records). [2025-10-22T23:37:31.953989] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-10-22T23:37:31.956860] [INFO ] [MAIN ] Derivative Progress: 1634/2052 symbols. SHW took 0.4s. Estimated remaining time: 2m 45s [2025-10-22T23:37:31.956960] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:31.997306] [DEBUG] [LOCAL ] SID: Loaded 42913 existing records from primary storage. [2025-10-22T23:37:31.997463] [INFO ] [MAIN ] SID: Loaded 42913 primary data records. [2025-10-22T23:37:32.298765] [DEBUG] [MAIN ] SID: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:32.323867] [INFO ] [MAIN ] SID: Generated 138 derivative records from 42913 primary records. [2025-10-22T23:37:32.323973] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-22T23:37:32.335979] [DEBUG] [LOCAL ] SID: Derivative data saved (138 records). [2025-10-22T23:37:32.336057] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-22T23:37:32.338882] [INFO ] [MAIN ] Derivative Progress: 1635/2052 symbols. SID took 0.4s. Estimated remaining time: 2m 44s [2025-10-22T23:37:32.338978] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:32.380748] [DEBUG] [LOCAL ] SIG: Loaded 45345 existing records from primary storage. [2025-10-22T23:37:32.380899] [INFO ] [MAIN ] SIG: Loaded 45345 primary data records. [2025-10-22T23:37:32.709218] [DEBUG] [MAIN ] SIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:32.734211] [INFO ] [MAIN ] SIG: Generated 138 derivative records from 45345 primary records. [2025-10-22T23:37:32.734321] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-22T23:37:32.745868] [DEBUG] [LOCAL ] SIG: Derivative data saved (138 records). [2025-10-22T23:37:32.745946] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-10-22T23:37:32.748804] [INFO ] [MAIN ] Derivative Progress: 1636/2052 symbols. SIG took 0.4s. Estimated remaining time: 2m 44s [2025-10-22T23:37:32.748918] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:32.774334] [DEBUG] [LOCAL ] SII: Loaded 24194 existing records from primary storage. [2025-10-22T23:37:32.774483] [INFO ] [MAIN ] SII: Loaded 24194 primary data records. [2025-10-22T23:37:33.075894] [DEBUG] [MAIN ] SII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:33.101027] [INFO ] [MAIN ] SII: Generated 138 derivative records from 24194 primary records. [2025-10-22T23:37:33.101154] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-22T23:37:33.112387] [DEBUG] [LOCAL ] SII: Derivative data saved (138 records). [2025-10-22T23:37:33.112466] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-22T23:37:33.115199] [INFO ] [MAIN ] Derivative Progress: 1637/2052 symbols. SII took 0.4s. Estimated remaining time: 2m 43s [2025-10-22T23:37:33.115296] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:33.144183] [DEBUG] [LOCAL ] SILA: Loaded 29955 existing records from primary storage. [2025-10-22T23:37:33.144325] [INFO ] [MAIN ] SILA: Loaded 29955 primary data records. [2025-10-22T23:37:33.453601] [DEBUG] [MAIN ] SILA: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:37:33.478547] [INFO ] [MAIN ] SILA: Generated 138 derivative records from 29955 primary records. [2025-10-22T23:37:33.478667] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-22T23:37:33.490173] [DEBUG] [LOCAL ] SILA: Derivative data saved (138 records). [2025-10-22T23:37:33.490252] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-22T23:37:33.493058] [INFO ] [MAIN ] Derivative Progress: 1638/2052 symbols. SILA took 0.4s. Estimated remaining time: 2m 43s [2025-10-22T23:37:33.493153] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:33.531238] [DEBUG] [LOCAL ] SITC: Loaded 41703 existing records from primary storage. [2025-10-22T23:37:33.531399] [INFO ] [MAIN ] SITC: Loaded 41703 primary data records. [2025-10-22T23:37:33.839196] [DEBUG] [MAIN ] SITC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:33.864512] [INFO ] [MAIN ] SITC: Generated 138 derivative records from 41703 primary records. [2025-10-22T23:37:33.864620] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-22T23:37:33.876131] [DEBUG] [LOCAL ] SITC: Derivative data saved (138 records). [2025-10-22T23:37:33.876209] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-10-22T23:37:33.879264] [INFO ] [MAIN ] Derivative Progress: 1639/2052 symbols. SITC took 0.4s. Estimated remaining time: 2m 43s [2025-10-22T23:37:33.879365] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:33.914845] [DEBUG] [LOCAL ] SITE: Loaded 35501 existing records from primary storage. [2025-10-22T23:37:33.915004] [INFO ] [MAIN ] SITE: Loaded 35501 primary data records. [2025-10-22T23:37:34.221200] [DEBUG] [MAIN ] SITE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:34.246403] [INFO ] [MAIN ] SITE: Generated 138 derivative records from 35501 primary records. [2025-10-22T23:37:34.246510] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-22T23:37:34.258032] [DEBUG] [LOCAL ] SITE: Derivative data saved (138 records). [2025-10-22T23:37:34.258112] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-22T23:37:34.261051] [INFO ] [MAIN ] Derivative Progress: 1640/2052 symbols. SITE took 0.4s. Estimated remaining time: 2m 42s [2025-10-22T23:37:34.261162] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:34.309254] [DEBUG] [LOCAL ] SJM: Loaded 50093 existing records from primary storage. [2025-10-22T23:37:34.309415] [INFO ] [MAIN ] SJM: Loaded 50093 primary data records. [2025-10-22T23:37:34.614792] [DEBUG] [MAIN ] SJM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:34.639773] [INFO ] [MAIN ] SJM: Generated 138 derivative records from 50093 primary records. [2025-10-22T23:37:34.639878] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-22T23:37:34.651395] [DEBUG] [LOCAL ] SJM: Derivative data saved (138 records). [2025-10-22T23:37:34.651486] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-10-22T23:37:34.654478] [INFO ] [MAIN ] Derivative Progress: 1641/2052 symbols. SJM took 0.4s. Estimated remaining time: 2m 42s [2025-10-22T23:37:34.654578] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:34.677131] [DEBUG] [LOCAL ] SJT: Loaded 22724 existing records from primary storage. [2025-10-22T23:37:34.677286] [INFO ] [MAIN ] SJT: Loaded 22724 primary data records. [2025-10-22T23:37:35.006428] [DEBUG] [MAIN ] SJT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:35.031403] [INFO ] [MAIN ] SJT: Generated 138 derivative records from 22724 primary records. [2025-10-22T23:37:35.031525] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-22T23:37:35.042511] [DEBUG] [LOCAL ] SJT: Derivative data saved (138 records). [2025-10-22T23:37:35.042591] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-22T23:37:35.045426] [INFO ] [MAIN ] Derivative Progress: 1642/2052 symbols. SJT took 0.4s. Estimated remaining time: 2m 41s [2025-10-22T23:37:35.045524] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:35.081383] [DEBUG] [LOCAL ] SKE: Loaded 37318 existing records from primary storage. [2025-10-22T23:37:35.081539] [INFO ] [MAIN ] SKE: Loaded 37318 primary data records. [2025-10-22T23:37:35.384303] [DEBUG] [MAIN ] SKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:35.409242] [INFO ] [MAIN ] SKE: Generated 138 derivative records from 37318 primary records. [2025-10-22T23:37:35.409365] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-22T23:37:35.420939] [DEBUG] [LOCAL ] SKE: Derivative data saved (138 records). [2025-10-22T23:37:35.421018] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-22T23:37:35.423939] [INFO ] [MAIN ] Derivative Progress: 1643/2052 symbols. SKE took 0.4s. Estimated remaining time: 2m 41s [2025-10-22T23:37:35.424038] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:35.435142] [DEBUG] [LOCAL ] SKIL: Loaded 6902 existing records from primary storage. [2025-10-22T23:37:35.435270] [INFO ] [MAIN ] SKIL: Loaded 6902 primary data records. [2025-10-22T23:37:35.734503] [DEBUG] [MAIN ] SKIL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:35.759483] [INFO ] [MAIN ] SKIL: Generated 138 derivative records from 6902 primary records. [2025-10-22T23:37:35.759627] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-22T23:37:35.770394] [DEBUG] [LOCAL ] SKIL: Derivative data saved (138 records). [2025-10-22T23:37:35.770477] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-22T23:37:35.772665] [INFO ] [MAIN ] Derivative Progress: 1644/2052 symbols. SKIL took 0.3s. Estimated remaining time: 2m 41s [2025-10-22T23:37:35.772763] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:35.785720] [DEBUG] [LOCAL ] SKLZ: Loaded 11463 existing records from primary storage. [2025-10-22T23:37:35.785866] [INFO ] [MAIN ] SKLZ: Loaded 11463 primary data records. [2025-10-22T23:37:36.084543] [DEBUG] [MAIN ] SKLZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:36.109839] [INFO ] [MAIN ] SKLZ: Generated 138 derivative records from 11463 primary records. [2025-10-22T23:37:36.109954] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-22T23:37:36.120953] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (138 records). [2025-10-22T23:37:36.121036] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-22T23:37:36.123831] [INFO ] [MAIN ] Derivative Progress: 1645/2052 symbols. SKLZ took 0.4s. Estimated remaining time: 2m 40s [2025-10-22T23:37:36.123936] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:36.158263] [DEBUG] [LOCAL ] SKM: Loaded 35160 existing records from primary storage. [2025-10-22T23:37:36.158428] [INFO ] [MAIN ] SKM: Loaded 35160 primary data records. [2025-10-22T23:37:36.460788] [DEBUG] [MAIN ] SKM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:36.485820] [INFO ] [MAIN ] SKM: Generated 138 derivative records from 35160 primary records. [2025-10-22T23:37:36.485937] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-10-22T23:37:36.497358] [DEBUG] [LOCAL ] SKM: Derivative data saved (138 records). [2025-10-22T23:37:36.497440] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-10-22T23:37:36.500330] [INFO ] [MAIN ] Derivative Progress: 1646/2052 symbols. SKM took 0.4s. Estimated remaining time: 2m 40s [2025-10-22T23:37:36.500430] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:36.539230] [DEBUG] [LOCAL ] SKT: Loaded 42303 existing records from primary storage. [2025-10-22T23:37:36.539389] [INFO ] [MAIN ] SKT: Loaded 42303 primary data records. [2025-10-22T23:37:36.867336] [DEBUG] [MAIN ] SKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:36.892494] [INFO ] [MAIN ] SKT: Generated 138 derivative records from 42303 primary records. [2025-10-22T23:37:36.892607] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-22T23:37:36.904059] [DEBUG] [LOCAL ] SKT: Derivative data saved (138 records). [2025-10-22T23:37:36.904138] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-10-22T23:37:36.907091] [INFO ] [MAIN ] Derivative Progress: 1647/2052 symbols. SKT took 0.4s. Estimated remaining time: 2m 39s [2025-10-22T23:37:36.907196] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:36.943467] [DEBUG] [LOCAL ] SKY: Loaded 38578 existing records from primary storage. [2025-10-22T23:37:36.943623] [INFO ] [MAIN ] SKY: Loaded 38578 primary data records. [2025-10-22T23:37:37.253128] [DEBUG] [MAIN ] SKY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:37.278109] [INFO ] [MAIN ] SKY: Generated 138 derivative records from 38578 primary records. [2025-10-22T23:37:37.278254] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-10-22T23:37:37.289839] [DEBUG] [LOCAL ] SKY: Derivative data saved (138 records). [2025-10-22T23:37:37.289926] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-10-22T23:37:37.292724] [INFO ] [MAIN ] Derivative Progress: 1648/2052 symbols. SKY took 0.4s. Estimated remaining time: 2m 39s [2025-10-22T23:37:37.292821] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:37.312217] [DEBUG] [LOCAL ] SKYH: Loaded 15813 existing records from primary storage. [2025-10-22T23:37:37.312362] [INFO ] [MAIN ] SKYH: Loaded 15813 primary data records. [2025-10-22T23:37:37.617162] [DEBUG] [MAIN ] SKYH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:37.642343] [INFO ] [MAIN ] SKYH: Generated 138 derivative records from 15813 primary records. [2025-10-22T23:37:37.642479] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-22T23:37:37.653999] [DEBUG] [LOCAL ] SKYH: Derivative data saved (138 records). [2025-10-22T23:37:37.654080] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-22T23:37:37.656807] [INFO ] [MAIN ] Derivative Progress: 1649/2052 symbols. SKYH took 0.4s. Estimated remaining time: 2m 39s [2025-10-22T23:37:37.656909] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:37.707929] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-10-22T23:37:37.708095] [INFO ] [MAIN ] SLB: Loaded 53697 primary data records. [2025-10-22T23:37:38.013595] [DEBUG] [MAIN ] SLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:38.038534] [INFO ] [MAIN ] SLB: Generated 138 derivative records from 53697 primary records. [2025-10-22T23:37:38.038683] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-10-22T23:37:38.050134] [DEBUG] [LOCAL ] SLB: Derivative data saved (138 records). [2025-10-22T23:37:38.050216] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-10-22T23:37:38.053322] [INFO ] [MAIN ] Derivative Progress: 1650/2052 symbols. SLB took 0.4s. Estimated remaining time: 2m 38s [2025-10-22T23:37:38.053425] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:38.089250] [DEBUG] [LOCAL ] SLF: Loaded 38364 existing records from primary storage. [2025-10-22T23:37:38.089405] [INFO ] [MAIN ] SLF: Loaded 38364 primary data records. [2025-10-22T23:37:38.392191] [DEBUG] [MAIN ] SLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:38.417332] [INFO ] [MAIN ] SLF: Generated 138 derivative records from 38364 primary records. [2025-10-22T23:37:38.417495] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-22T23:37:38.428984] [DEBUG] [LOCAL ] SLF: Derivative data saved (138 records). [2025-10-22T23:37:38.429066] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-22T23:37:38.431881] [INFO ] [MAIN ] Derivative Progress: 1651/2052 symbols. SLF took 0.4s. Estimated remaining time: 2m 38s [2025-10-22T23:37:38.431980] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:38.475477] [DEBUG] [LOCAL ] SLG: Loaded 45790 existing records from primary storage. [2025-10-22T23:37:38.475633] [INFO ] [MAIN ] SLG: Loaded 45790 primary data records. [2025-10-22T23:37:38.812705] [DEBUG] [MAIN ] SLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:38.838601] [INFO ] [MAIN ] SLG: Generated 138 derivative records from 45790 primary records. [2025-10-22T23:37:38.838806] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-22T23:37:38.850291] [DEBUG] [LOCAL ] SLG: Derivative data saved (138 records). [2025-10-22T23:37:38.850414] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-10-22T23:37:38.853597] [INFO ] [MAIN ] Derivative Progress: 1652/2052 symbols. SLG took 0.4s. Estimated remaining time: 2m 37s [2025-10-22T23:37:38.853776] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:38.895298] [DEBUG] [LOCAL ] SLGN: Loaded 41015 existing records from primary storage. [2025-10-22T23:37:38.895477] [INFO ] [MAIN ] SLGN: Loaded 41015 primary data records. [2025-10-22T23:37:39.205678] [DEBUG] [MAIN ] SLGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:39.230602] [INFO ] [MAIN ] SLGN: Generated 138 derivative records from 41015 primary records. [2025-10-22T23:37:39.230722] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-22T23:37:39.242089] [DEBUG] [LOCAL ] SLGN: Derivative data saved (138 records). [2025-10-22T23:37:39.242168] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-10-22T23:37:39.245025] [INFO ] [MAIN ] Derivative Progress: 1653/2052 symbols. SLGN took 0.4s. Estimated remaining time: 2m 37s [2025-10-22T23:37:39.245118] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:39.288945] [DEBUG] [LOCAL ] SLQT: Loaded 43361 existing records from primary storage. [2025-10-22T23:37:39.289100] [INFO ] [MAIN ] SLQT: Loaded 43361 primary data records. [2025-10-22T23:37:39.591231] [DEBUG] [MAIN ] SLQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:39.615978] [INFO ] [MAIN ] SLQT: Generated 138 derivative records from 43361 primary records. [2025-10-22T23:37:39.616108] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-22T23:37:39.627486] [DEBUG] [LOCAL ] SLQT: Derivative data saved (138 records). [2025-10-22T23:37:39.627567] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-22T23:37:39.630248] [INFO ] [MAIN ] Derivative Progress: 1654/2052 symbols. SLQT took 0.4s. Estimated remaining time: 2m 37s [2025-10-22T23:37:39.630348] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:39.658413] [DEBUG] [LOCAL ] SLVM: Loaded 27737 existing records from primary storage. [2025-10-22T23:37:39.658564] [INFO ] [MAIN ] SLVM: Loaded 27737 primary data records. [2025-10-22T23:37:39.965875] [DEBUG] [MAIN ] SLVM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:39.991583] [INFO ] [MAIN ] SLVM: Generated 138 derivative records from 27737 primary records. [2025-10-22T23:37:39.991739] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-22T23:37:40.003249] [DEBUG] [LOCAL ] SLVM: Derivative data saved (138 records). [2025-10-22T23:37:40.003341] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-10-22T23:37:40.006193] [INFO ] [MAIN ] Derivative Progress: 1655/2052 symbols. SLVM took 0.4s. Estimated remaining time: 2m 36s [2025-10-22T23:37:40.006303] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:40.056110] [DEBUG] [LOCAL ] SM: Loaded 52354 existing records from primary storage. [2025-10-22T23:37:40.056274] [INFO ] [MAIN ] SM: Loaded 52354 primary data records. [2025-10-22T23:37:40.357111] [DEBUG] [MAIN ] SM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:40.381971] [INFO ] [MAIN ] SM: Generated 138 derivative records from 52354 primary records. [2025-10-22T23:37:40.382153] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-22T23:37:40.393810] [DEBUG] [LOCAL ] SM: Derivative data saved (138 records). [2025-10-22T23:37:40.393898] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-10-22T23:37:40.397041] [INFO ] [MAIN ] Derivative Progress: 1656/2052 symbols. SM took 0.4s. Estimated remaining time: 2m 36s [2025-10-22T23:37:40.397164] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:40.409706] [DEBUG] [LOCAL ] SMBK: Loaded 8269 existing records from primary storage. [2025-10-22T23:37:40.409847] [INFO ] [MAIN ] SMBK: Loaded 8269 primary data records. [2025-10-22T23:37:40.740706] [DEBUG] [MAIN ] SMBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:40.765910] [INFO ] [MAIN ] SMBK: Generated 138 derivative records from 8269 primary records. [2025-10-22T23:37:40.766076] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-22T23:37:40.777440] [DEBUG] [LOCAL ] SMBK: Derivative data saved (138 records). [2025-10-22T23:37:40.777526] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-10-22T23:37:40.779618] [INFO ] [MAIN ] Derivative Progress: 1657/2052 symbols. SMBK took 0.4s. Estimated remaining time: 2m 35s [2025-10-22T23:37:40.779743] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:40.794075] [DEBUG] [LOCAL ] SMC: Loaded 10904 existing records from primary storage. [2025-10-22T23:37:40.794241] [INFO ] [MAIN ] SMC: Loaded 10904 primary data records. [2025-10-22T23:37:41.093195] [DEBUG] [MAIN ] SMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:41.118208] [INFO ] [MAIN ] SMC: Generated 138 derivative records from 10904 primary records. [2025-10-22T23:37:41.118328] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-22T23:37:41.130082] [DEBUG] [LOCAL ] SMC: Derivative data saved (138 records). [2025-10-22T23:37:41.130167] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-22T23:37:41.132268] [INFO ] [MAIN ] Derivative Progress: 1658/2052 symbols. SMC took 0.4s. Estimated remaining time: 2m 35s [2025-10-22T23:37:41.132365] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:41.178030] [DEBUG] [LOCAL ] SMFG: Loaded 48307 existing records from primary storage. [2025-10-22T23:37:41.178194] [INFO ] [MAIN ] SMFG: Loaded 48307 primary data records. [2025-10-22T23:37:41.481438] [DEBUG] [MAIN ] SMFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:41.506250] [INFO ] [MAIN ] SMFG: Generated 138 derivative records from 48307 primary records. [2025-10-22T23:37:41.506385] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-22T23:37:41.518085] [DEBUG] [LOCAL ] SMFG: Derivative data saved (138 records). [2025-10-22T23:37:41.518172] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-22T23:37:41.521205] [INFO ] [MAIN ] Derivative Progress: 1659/2052 symbols. SMFG took 0.4s. Estimated remaining time: 2m 35s [2025-10-22T23:37:41.521326] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:41.560885] [DEBUG] [LOCAL ] SMG: Loaded 42743 existing records from primary storage. [2025-10-22T23:37:41.561053] [INFO ] [MAIN ] SMG: Loaded 42743 primary data records. [2025-10-22T23:37:41.864942] [DEBUG] [MAIN ] SMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:41.890060] [INFO ] [MAIN ] SMG: Generated 138 derivative records from 42743 primary records. [2025-10-22T23:37:41.890182] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-22T23:37:41.901693] [DEBUG] [LOCAL ] SMG: Derivative data saved (138 records). [2025-10-22T23:37:41.901775] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-10-22T23:37:41.904618] [INFO ] [MAIN ] Derivative Progress: 1660/2052 symbols. SMG took 0.4s. Estimated remaining time: 2m 34s [2025-10-22T23:37:41.904750] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:41.920431] [DEBUG] [LOCAL ] SMHI: Loaded 12664 existing records from primary storage. [2025-10-22T23:37:41.920572] [INFO ] [MAIN ] SMHI: Loaded 12664 primary data records. [2025-10-22T23:37:42.223543] [DEBUG] [MAIN ] SMHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:42.248508] [INFO ] [MAIN ] SMHI: Generated 138 derivative records from 12664 primary records. [2025-10-22T23:37:42.248634] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-22T23:37:42.259676] [DEBUG] [LOCAL ] SMHI: Derivative data saved (138 records). [2025-10-22T23:37:42.259787] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-10-22T23:37:42.262546] [INFO ] [MAIN ] Derivative Progress: 1661/2052 symbols. SMHI took 0.4s. Estimated remaining time: 2m 34s [2025-10-22T23:37:42.262704] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:42.283817] [DEBUG] [LOCAL ] SMP: Loaded 18640 existing records from primary storage. [2025-10-22T23:37:42.283971] [INFO ] [MAIN ] SMP: Loaded 18640 primary data records. [2025-10-22T23:37:42.586227] [DEBUG] [MAIN ] SMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:42.611301] [INFO ] [MAIN ] SMP: Generated 138 derivative records from 18640 primary records. [2025-10-22T23:37:42.611483] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-10-22T23:37:42.622916] [DEBUG] [LOCAL ] SMP: Derivative data saved (138 records). [2025-10-22T23:37:42.623000] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-10-22T23:37:42.625863] [INFO ] [MAIN ] Derivative Progress: 1662/2052 symbols. SMP took 0.4s. Estimated remaining time: 2m 33s [2025-10-22T23:37:42.625961] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:42.666561] [DEBUG] [LOCAL ] SMRT: Loaded 43781 existing records from primary storage. [2025-10-22T23:37:42.666739] [INFO ] [MAIN ] SMRT: Loaded 43781 primary data records. [2025-10-22T23:37:42.989603] [DEBUG] [MAIN ] SMRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:43.014554] [INFO ] [MAIN ] SMRT: Generated 138 derivative records from 43781 primary records. [2025-10-22T23:37:43.014695] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-22T23:37:43.025990] [DEBUG] [LOCAL ] SMRT: Derivative data saved (138 records). [2025-10-22T23:37:43.026070] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-22T23:37:43.028832] [INFO ] [MAIN ] Derivative Progress: 1663/2052 symbols. SMRT took 0.4s. Estimated remaining time: 2m 33s [2025-10-22T23:37:43.028928] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:43.058239] [DEBUG] [LOCAL ] SMWB: Loaded 31619 existing records from primary storage. [2025-10-22T23:37:43.058396] [INFO ] [MAIN ] SMWB: Loaded 31619 primary data records. [2025-10-22T23:37:43.365432] [DEBUG] [MAIN ] SMWB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:43.390203] [INFO ] [MAIN ] SMWB: Generated 138 derivative records from 31619 primary records. [2025-10-22T23:37:43.390321] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-22T23:37:43.401558] [DEBUG] [LOCAL ] SMWB: Derivative data saved (138 records). [2025-10-22T23:37:43.401659] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-10-22T23:37:43.404498] [INFO ] [MAIN ] Derivative Progress: 1664/2052 symbols. SMWB took 0.4s. Estimated remaining time: 2m 33s [2025-10-22T23:37:43.404598] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:43.451281] [DEBUG] [LOCAL ] SN: Loaded 49982 existing records from primary storage. [2025-10-22T23:37:43.451447] [INFO ] [MAIN ] SN: Loaded 49982 primary data records. [2025-10-22T23:37:43.752709] [DEBUG] [MAIN ] SN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:43.777801] [INFO ] [MAIN ] SN: Generated 138 derivative records from 49982 primary records. [2025-10-22T23:37:43.777953] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-22T23:37:43.789536] [DEBUG] [LOCAL ] SN: Derivative data saved (138 records). [2025-10-22T23:37:43.789618] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-22T23:37:43.792639] [INFO ] [MAIN ] Derivative Progress: 1665/2052 symbols. SN took 0.4s. Estimated remaining time: 2m 32s [2025-10-22T23:37:43.792768] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:43.819375] [DEBUG] [LOCAL ] SNA: Loaded 25699 existing records from primary storage. [2025-10-22T23:37:43.819525] [INFO ] [MAIN ] SNA: Loaded 25699 primary data records. [2025-10-22T23:37:44.127341] [DEBUG] [MAIN ] SNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:44.152293] [INFO ] [MAIN ] SNA: Generated 138 derivative records from 25699 primary records. [2025-10-22T23:37:44.152434] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-10-22T23:37:44.164024] [DEBUG] [LOCAL ] SNA: Derivative data saved (138 records). [2025-10-22T23:37:44.164108] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-10-22T23:37:44.167022] [INFO ] [MAIN ] Derivative Progress: 1666/2052 symbols. SNA took 0.4s. Estimated remaining time: 2m 32s [2025-10-22T23:37:44.167128] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:44.217549] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-22T23:37:44.217752] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-10-22T23:37:44.520356] [DEBUG] [MAIN ] SNAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:44.545355] [INFO ] [MAIN ] SNAP: Generated 138 derivative records from 53796 primary records. [2025-10-22T23:37:44.545516] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-22T23:37:44.557152] [DEBUG] [LOCAL ] SNAP: Derivative data saved (138 records). [2025-10-22T23:37:44.557263] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-22T23:37:44.560536] [INFO ] [MAIN ] Derivative Progress: 1667/2052 symbols. SNAP took 0.4s. Estimated remaining time: 2m 32s [2025-10-22T23:37:44.560808] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:44.569410] [DEBUG] [LOCAL ] SNDA: Loaded 4475 existing records from primary storage. [2025-10-22T23:37:44.569536] [INFO ] [MAIN ] SNDA: Loaded 4475 primary data records. [2025-10-22T23:37:44.900764] [DEBUG] [MAIN ] SNDA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:44.926221] [INFO ] [MAIN ] SNDA: Generated 138 derivative records from 4475 primary records. [2025-10-22T23:37:44.926372] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-22T23:37:44.937010] [DEBUG] [LOCAL ] SNDA: Derivative data saved (138 records). [2025-10-22T23:37:44.937094] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-22T23:37:44.939259] [INFO ] [MAIN ] Derivative Progress: 1668/2052 symbols. SNDA took 0.4s. Estimated remaining time: 2m 31s [2025-10-22T23:37:44.939369] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:44.981413] [DEBUG] [LOCAL ] SNDR: Loaded 41601 existing records from primary storage. [2025-10-22T23:37:44.981576] [INFO ] [MAIN ] SNDR: Loaded 41601 primary data records. [2025-10-22T23:37:45.286369] [DEBUG] [MAIN ] SNDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:45.313409] [INFO ] [MAIN ] SNDR: Generated 138 derivative records from 41601 primary records. [2025-10-22T23:37:45.313545] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-22T23:37:45.325374] [DEBUG] [LOCAL ] SNDR: Derivative data saved (138 records). [2025-10-22T23:37:45.325456] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-10-22T23:37:45.328581] [INFO ] [MAIN ] Derivative Progress: 1669/2052 symbols. SNDR took 0.4s. Estimated remaining time: 2m 31s [2025-10-22T23:37:45.328713] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:45.371019] [DEBUG] [LOCAL ] SNN: Loaded 44338 existing records from primary storage. [2025-10-22T23:37:45.371181] [INFO ] [MAIN ] SNN: Loaded 44338 primary data records. [2025-10-22T23:37:45.695710] [DEBUG] [MAIN ] SNN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:45.722785] [INFO ] [MAIN ] SNN: Generated 138 derivative records from 44338 primary records. [2025-10-22T23:37:45.722925] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-22T23:37:45.735195] [DEBUG] [LOCAL ] SNN: Derivative data saved (138 records). [2025-10-22T23:37:45.735291] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-22T23:37:45.738634] [INFO ] [MAIN ] Derivative Progress: 1670/2052 symbols. SNN took 0.4s. Estimated remaining time: 2m 30s [2025-10-22T23:37:45.738782] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:45.788918] [DEBUG] [LOCAL ] SNV: Loaded 49060 existing records from primary storage. [2025-10-22T23:37:45.789100] [INFO ] [MAIN ] SNV: Loaded 49060 primary data records. [2025-10-22T23:37:46.117260] [DEBUG] [MAIN ] SNV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:46.145176] [INFO ] [MAIN ] SNV: Generated 138 derivative records from 49060 primary records. [2025-10-22T23:37:46.145350] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-10-22T23:37:46.157664] [DEBUG] [LOCAL ] SNV: Derivative data saved (138 records). [2025-10-22T23:37:46.157761] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-10-22T23:37:46.160822] [INFO ] [MAIN ] Derivative Progress: 1671/2052 symbols. SNV took 0.4s. Estimated remaining time: 2m 30s [2025-10-22T23:37:46.160929] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:46.205525] [DEBUG] [LOCAL ] SNX: Loaded 38854 existing records from primary storage. [2025-10-22T23:37:46.205712] [INFO ] [MAIN ] SNX: Loaded 38854 primary data records. [2025-10-22T23:37:46.536660] [DEBUG] [MAIN ] SNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:46.562662] [INFO ] [MAIN ] SNX: Generated 138 derivative records from 38854 primary records. [2025-10-22T23:37:46.562827] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-10-22T23:37:46.574622] [DEBUG] [LOCAL ] SNX: Derivative data saved (138 records). [2025-10-22T23:37:46.574728] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-10-22T23:37:46.577718] [INFO ] [MAIN ] Derivative Progress: 1672/2052 symbols. SNX took 0.4s. Estimated remaining time: 2m 30s [2025-10-22T23:37:46.577813] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:46.635508] [DEBUG] [LOCAL ] SO: Loaded 53615 existing records from primary storage. [2025-10-22T23:37:46.635716] [INFO ] [MAIN ] SO: Loaded 53615 primary data records. [2025-10-22T23:37:46.982575] [DEBUG] [MAIN ] SO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:47.008770] [INFO ] [MAIN ] SO: Generated 138 derivative records from 53615 primary records. [2025-10-22T23:37:47.008967] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-22T23:37:47.021076] [DEBUG] [LOCAL ] SO: Derivative data saved (138 records). [2025-10-22T23:37:47.021205] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-10-22T23:37:47.024360] [INFO ] [MAIN ] Derivative Progress: 1673/2052 symbols. SO took 0.4s. Estimated remaining time: 2m 29s [2025-10-22T23:37:47.024500] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:47.064055] [DEBUG] [LOCAL ] SOBO: Loaded 39390 existing records from primary storage. [2025-10-22T23:37:47.064223] [INFO ] [MAIN ] SOBO: Loaded 39390 primary data records. [2025-10-22T23:37:47.407354] [DEBUG] [MAIN ] SOBO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:47.434625] [INFO ] [MAIN ] SOBO: Generated 138 derivative records from 39390 primary records. [2025-10-22T23:37:47.434789] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-22T23:37:47.447591] [DEBUG] [LOCAL ] SOBO: Derivative data saved (138 records). [2025-10-22T23:37:47.447766] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-22T23:37:47.451021] [INFO ] [MAIN ] Derivative Progress: 1674/2052 symbols. SOBO took 0.4s. Estimated remaining time: 2m 29s [2025-10-22T23:37:47.451137] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:47.507445] [DEBUG] [LOCAL ] SOC: Loaded 51227 existing records from primary storage. [2025-10-22T23:37:47.507621] [INFO ] [MAIN ] SOC: Loaded 51227 primary data records. [2025-10-22T23:37:47.853881] [DEBUG] [MAIN ] SOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:47.881501] [INFO ] [MAIN ] SOC: Generated 138 derivative records from 51227 primary records. [2025-10-22T23:37:47.881670] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-22T23:37:47.894940] [DEBUG] [LOCAL ] SOC: Derivative data saved (138 records). [2025-10-22T23:37:47.895030] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-22T23:37:47.898172] [INFO ] [MAIN ] Derivative Progress: 1675/2052 symbols. SOC took 0.4s. Estimated remaining time: 2m 28s [2025-10-22T23:37:47.898302] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:47.907475] [DEBUG] [LOCAL ] SOJC: Loaded 4574 existing records from primary storage. [2025-10-22T23:37:47.907602] [INFO ] [MAIN ] SOJC: Loaded 4574 primary data records. [2025-10-22T23:37:48.224992] [DEBUG] [MAIN ] SOJC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:48.250066] [INFO ] [MAIN ] SOJC: Generated 138 derivative records from 4574 primary records. [2025-10-22T23:37:48.250210] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-22T23:37:48.260839] [DEBUG] [LOCAL ] SOJC: Derivative data saved (138 records). [2025-10-22T23:37:48.260921] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-22T23:37:48.262981] [INFO ] [MAIN ] Derivative Progress: 1676/2052 symbols. SOJC took 0.4s. Estimated remaining time: 2m 28s [2025-10-22T23:37:48.263076] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:48.277718] [DEBUG] [LOCAL ] SOJD: Loaded 12581 existing records from primary storage. [2025-10-22T23:37:48.277851] [INFO ] [MAIN ] SOJD: Loaded 12581 primary data records. [2025-10-22T23:37:48.579255] [DEBUG] [MAIN ] SOJD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:48.604286] [INFO ] [MAIN ] SOJD: Generated 138 derivative records from 12581 primary records. [2025-10-22T23:37:48.604446] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-22T23:37:48.615942] [DEBUG] [LOCAL ] SOJD: Derivative data saved (138 records). [2025-10-22T23:37:48.616029] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-22T23:37:48.618622] [INFO ] [MAIN ] Derivative Progress: 1677/2052 symbols. SOJD took 0.4s. Estimated remaining time: 2m 28s [2025-10-22T23:37:48.618744] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:48.634403] [DEBUG] [LOCAL ] SOJE: Loaded 8697 existing records from primary storage. [2025-10-22T23:37:48.634537] [INFO ] [MAIN ] SOJE: Loaded 8697 primary data records. [2025-10-22T23:37:48.941449] [DEBUG] [MAIN ] SOJE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:48.967156] [INFO ] [MAIN ] SOJE: Generated 138 derivative records from 8697 primary records. [2025-10-22T23:37:48.967367] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-22T23:37:48.979305] [DEBUG] [LOCAL ] SOJE: Derivative data saved (138 records). [2025-10-22T23:37:48.979439] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-22T23:37:48.981596] [INFO ] [MAIN ] Derivative Progress: 1678/2052 symbols. SOJE took 0.4s. Estimated remaining time: 2m 27s [2025-10-22T23:37:48.981715] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:48.999161] [DEBUG] [LOCAL ] SOL: Loaded 13561 existing records from primary storage. [2025-10-22T23:37:48.999326] [INFO ] [MAIN ] SOL: Loaded 13561 primary data records. [2025-10-22T23:37:49.341023] [DEBUG] [MAIN ] SOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:49.367151] [INFO ] [MAIN ] SOL: Generated 138 derivative records from 13561 primary records. [2025-10-22T23:37:49.367362] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-22T23:37:49.379119] [DEBUG] [LOCAL ] SOL: Derivative data saved (138 records). [2025-10-22T23:37:49.379267] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-22T23:37:49.382179] [INFO ] [MAIN ] Derivative Progress: 1679/2052 symbols. SOL took 0.4s. Estimated remaining time: 2m 27s [2025-10-22T23:37:49.382351] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:49.426305] [DEBUG] [LOCAL ] SOLV: Loaded 43384 existing records from primary storage. [2025-10-22T23:37:49.426482] [INFO ] [MAIN ] SOLV: Loaded 43384 primary data records. [2025-10-22T23:37:49.746433] [DEBUG] [MAIN ] SOLV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:49.772425] [INFO ] [MAIN ] SOLV: Generated 138 derivative records from 43384 primary records. [2025-10-22T23:37:49.772610] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-10-22T23:37:49.783926] [DEBUG] [LOCAL ] SOLV: Derivative data saved (138 records). [2025-10-22T23:37:49.784006] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-10-22T23:37:49.787061] [INFO ] [MAIN ] Derivative Progress: 1680/2052 symbols. SOLV took 0.4s. Estimated remaining time: 2m 26s [2025-10-22T23:37:49.787156] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:49.829432] [DEBUG] [LOCAL ] SON: Loaded 43544 existing records from primary storage. [2025-10-22T23:37:49.829589] [INFO ] [MAIN ] SON: Loaded 43544 primary data records. [2025-10-22T23:37:50.142671] [DEBUG] [MAIN ] SON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:50.168273] [INFO ] [MAIN ] SON: Generated 138 derivative records from 43544 primary records. [2025-10-22T23:37:50.168434] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-10-22T23:37:50.180085] [DEBUG] [LOCAL ] SON: Derivative data saved (138 records). [2025-10-22T23:37:50.180168] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-10-22T23:37:50.183165] [INFO ] [MAIN ] Derivative Progress: 1681/2052 symbols. SON took 0.4s. Estimated remaining time: 2m 26s [2025-10-22T23:37:50.183256] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:50.237221] [DEBUG] [LOCAL ] SONY: Loaded 53376 existing records from primary storage. [2025-10-22T23:37:50.237414] [INFO ] [MAIN ] SONY: Loaded 53376 primary data records. [2025-10-22T23:37:50.547994] [DEBUG] [MAIN ] SONY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:50.573306] [INFO ] [MAIN ] SONY: Generated 138 derivative records from 53376 primary records. [2025-10-22T23:37:50.573443] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-22T23:37:50.585362] [DEBUG] [LOCAL ] SONY: Derivative data saved (138 records). [2025-10-22T23:37:50.585446] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-22T23:37:50.588547] [INFO ] [MAIN ] Derivative Progress: 1682/2052 symbols. SONY took 0.4s. Estimated remaining time: 2m 26s [2025-10-22T23:37:50.588666] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:50.594100] [DEBUG] [LOCAL ] SOR: Loaded 2818 existing records from primary storage. [2025-10-22T23:37:50.594186] [INFO ] [MAIN ] SOR: Loaded 2818 primary data records. [2025-10-22T23:37:50.904792] [DEBUG] [MAIN ] SOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:50.931161] [INFO ] [MAIN ] SOR: Generated 138 derivative records from 2818 primary records. [2025-10-22T23:37:50.931323] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-22T23:37:50.941536] [DEBUG] [LOCAL ] SOR: Derivative data saved (138 records). [2025-10-22T23:37:50.941619] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-22T23:37:50.943762] [INFO ] [MAIN ] Derivative Progress: 1683/2052 symbols. SOR took 0.4s. Estimated remaining time: 2m 25s [2025-10-22T23:37:50.943856] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:50.956336] [DEBUG] [LOCAL ] SOS: Loaded 9686 existing records from primary storage. [2025-10-22T23:37:50.956475] [INFO ] [MAIN ] SOS: Loaded 9686 primary data records. [2025-10-22T23:37:51.288953] [DEBUG] [MAIN ] SOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:51.314432] [INFO ] [MAIN ] SOS: Generated 138 derivative records from 9686 primary records. [2025-10-22T23:37:51.314576] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-22T23:37:51.325267] [DEBUG] [LOCAL ] SOS: Derivative data saved (138 records). [2025-10-22T23:37:51.325352] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-22T23:37:51.330576] [INFO ] [MAIN ] Derivative Progress: 1684/2052 symbols. SOS took 0.4s. Estimated remaining time: 2m 25s [2025-10-22T23:37:51.330750] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:51.365302] [DEBUG] [LOCAL ] SPB: Loaded 34013 existing records from primary storage. [2025-10-22T23:37:51.365454] [INFO ] [MAIN ] SPB: Loaded 34013 primary data records. [2025-10-22T23:37:51.679742] [DEBUG] [MAIN ] SPB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:51.704503] [INFO ] [MAIN ] SPB: Generated 138 derivative records from 34013 primary records. [2025-10-22T23:37:51.704619] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-22T23:37:51.716084] [DEBUG] [LOCAL ] SPB: Derivative data saved (138 records). [2025-10-22T23:37:51.716166] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-22T23:37:51.719032] [INFO ] [MAIN ] Derivative Progress: 1685/2052 symbols. SPB took 0.4s. Estimated remaining time: 2m 24s [2025-10-22T23:37:51.719129] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:51.767824] [DEBUG] [LOCAL ] SPCE: Loaded 50052 existing records from primary storage. [2025-10-22T23:37:51.767994] [INFO ] [MAIN ] SPCE: Loaded 50052 primary data records. [2025-10-22T23:37:52.076419] [DEBUG] [MAIN ] SPCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:52.101366] [INFO ] [MAIN ] SPCE: Generated 138 derivative records from 50052 primary records. [2025-10-22T23:37:52.101470] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-22T23:37:52.113251] [DEBUG] [LOCAL ] SPCE: Derivative data saved (138 records). [2025-10-22T23:37:52.113355] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-22T23:37:52.116224] [INFO ] [MAIN ] Derivative Progress: 1686/2052 symbols. SPCE took 0.4s. Estimated remaining time: 2m 24s [2025-10-22T23:37:52.116322] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:52.126355] [DEBUG] [LOCAL ] SPE: Loaded 6149 existing records from primary storage. [2025-10-22T23:37:52.126469] [INFO ] [MAIN ] SPE: Loaded 6149 primary data records. [2025-10-22T23:37:52.430419] [DEBUG] [MAIN ] SPE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:52.456695] [INFO ] [MAIN ] SPE: Generated 138 derivative records from 6149 primary records. [2025-10-22T23:37:52.456856] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-22T23:37:52.468268] [DEBUG] [LOCAL ] SPE: Derivative data saved (138 records). [2025-10-22T23:37:52.468357] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-22T23:37:52.470634] [INFO ] [MAIN ] Derivative Progress: 1687/2052 symbols. SPE took 0.4s. Estimated remaining time: 2m 24s [2025-10-22T23:37:52.470775] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:52.522567] [DEBUG] [LOCAL ] SPG: Loaded 49934 existing records from primary storage. [2025-10-22T23:37:52.522768] [INFO ] [MAIN ] SPG: Loaded 49934 primary data records. [2025-10-22T23:37:52.830710] [DEBUG] [MAIN ] SPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:52.857410] [INFO ] [MAIN ] SPG: Generated 138 derivative records from 49934 primary records. [2025-10-22T23:37:52.857595] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-22T23:37:52.869324] [DEBUG] [LOCAL ] SPG: Derivative data saved (138 records). [2025-10-22T23:37:52.869415] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-10-22T23:37:52.872502] [INFO ] [MAIN ] Derivative Progress: 1688/2052 symbols. SPG took 0.4s. Estimated remaining time: 2m 23s [2025-10-22T23:37:52.872621] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:52.918390] [DEBUG] [LOCAL ] SPGI: Loaded 45897 existing records from primary storage. [2025-10-22T23:37:52.918556] [INFO ] [MAIN ] SPGI: Loaded 45897 primary data records. [2025-10-22T23:37:53.250046] [DEBUG] [MAIN ] SPGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:53.275210] [INFO ] [MAIN ] SPGI: Generated 138 derivative records from 45897 primary records. [2025-10-22T23:37:53.275367] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-22T23:37:53.286849] [DEBUG] [LOCAL ] SPGI: Derivative data saved (138 records). [2025-10-22T23:37:53.286926] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-10-22T23:37:53.289829] [INFO ] [MAIN ] Derivative Progress: 1689/2052 symbols. SPGI took 0.4s. Estimated remaining time: 2m 23s [2025-10-22T23:37:53.289918] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:53.311379] [DEBUG] [LOCAL ] SPH: Loaded 16482 existing records from primary storage. [2025-10-22T23:37:53.311540] [INFO ] [MAIN ] SPH: Loaded 16482 primary data records. [2025-10-22T23:37:53.653668] [DEBUG] [MAIN ] SPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:53.682529] [INFO ] [MAIN ] SPH: Generated 138 derivative records from 16482 primary records. [2025-10-22T23:37:53.682728] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-22T23:37:53.694589] [DEBUG] [LOCAL ] SPH: Derivative data saved (138 records). [2025-10-22T23:37:53.694700] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-22T23:37:53.697891] [INFO ] [MAIN ] Derivative Progress: 1690/2052 symbols. SPH took 0.4s. Estimated remaining time: 2m 22s [2025-10-22T23:37:53.697995] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:53.741197] [DEBUG] [LOCAL ] SPHR: Loaded 40681 existing records from primary storage. [2025-10-22T23:37:53.741380] [INFO ] [MAIN ] SPHR: Loaded 40681 primary data records. [2025-10-22T23:37:54.058738] [DEBUG] [MAIN ] SPHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:54.083597] [INFO ] [MAIN ] SPHR: Generated 138 derivative records from 40681 primary records. [2025-10-22T23:37:54.083764] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-22T23:37:54.095301] [DEBUG] [LOCAL ] SPHR: Derivative data saved (138 records). [2025-10-22T23:37:54.095380] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-10-22T23:37:54.098490] [INFO ] [MAIN ] Derivative Progress: 1691/2052 symbols. SPHR took 0.4s. Estimated remaining time: 2m 22s [2025-10-22T23:37:54.098591] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:54.137307] [DEBUG] [LOCAL ] SPIR: Loaded 37535 existing records from primary storage. [2025-10-22T23:37:54.137467] [INFO ] [MAIN ] SPIR: Loaded 37535 primary data records. [2025-10-22T23:37:54.454365] [DEBUG] [MAIN ] SPIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:54.480352] [INFO ] [MAIN ] SPIR: Generated 138 derivative records from 37535 primary records. [2025-10-22T23:37:54.480495] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-22T23:37:54.492288] [DEBUG] [LOCAL ] SPIR: Derivative data saved (138 records). [2025-10-22T23:37:54.492375] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-22T23:37:54.495354] [INFO ] [MAIN ] Derivative Progress: 1692/2052 symbols. SPIR took 0.4s. Estimated remaining time: 2m 22s [2025-10-22T23:37:54.495454] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:54.505225] [DEBUG] [LOCAL ] SPMC: Loaded 5246 existing records from primary storage. [2025-10-22T23:37:54.505351] [INFO ] [MAIN ] SPMC: Loaded 5246 primary data records. [2025-10-22T23:37:54.817861] [DEBUG] [MAIN ] SPMC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:37:54.843807] [INFO ] [MAIN ] SPMC: Generated 138 derivative records from 5246 primary records. [2025-10-22T23:37:54.843961] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-22T23:37:54.854556] [DEBUG] [LOCAL ] SPMC: Derivative data saved (138 records). [2025-10-22T23:37:54.854679] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-22T23:37:54.856856] [INFO ] [MAIN ] Derivative Progress: 1693/2052 symbols. SPMC took 0.4s. Estimated remaining time: 2m 21s [2025-10-22T23:37:54.856951] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:54.894614] [DEBUG] [LOCAL ] SPNT: Loaded 34220 existing records from primary storage. [2025-10-22T23:37:54.894807] [INFO ] [MAIN ] SPNT: Loaded 34220 primary data records. [2025-10-22T23:37:55.295376] [DEBUG] [MAIN ] SPNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:55.334793] [INFO ] [MAIN ] SPNT: Generated 138 derivative records from 34220 primary records. [2025-10-22T23:37:55.335013] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-22T23:37:55.351297] [DEBUG] [LOCAL ] SPNT: Derivative data saved (138 records). [2025-10-22T23:37:55.351476] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-10-22T23:37:55.355580] [INFO ] [MAIN ] Derivative Progress: 1694/2052 symbols. SPNT took 0.5s. Estimated remaining time: 2m 21s [2025-10-22T23:37:55.355840] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:55.403801] [DEBUG] [LOCAL ] SPR: Loaded 40712 existing records from primary storage. [2025-10-22T23:37:55.404003] [INFO ] [MAIN ] SPR: Loaded 40712 primary data records. [2025-10-22T23:37:55.837955] [DEBUG] [MAIN ] SPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:55.875883] [INFO ] [MAIN ] SPR: Generated 138 derivative records from 40712 primary records. [2025-10-22T23:37:55.876076] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-22T23:37:55.888271] [DEBUG] [LOCAL ] SPR: Derivative data saved (138 records). [2025-10-22T23:37:55.888452] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-10-22T23:37:55.891607] [INFO ] [MAIN ] Derivative Progress: 1695/2052 symbols. SPR took 0.5s. Estimated remaining time: 2m 21s [2025-10-22T23:37:55.891840] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:55.906083] [DEBUG] [LOCAL ] SPRU: Loaded 9997 existing records from primary storage. [2025-10-22T23:37:55.906272] [INFO ] [MAIN ] SPRU: Loaded 9997 primary data records. [2025-10-22T23:37:56.258318] [DEBUG] [MAIN ] SPRU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:56.285378] [INFO ] [MAIN ] SPRU: Generated 138 derivative records from 9997 primary records. [2025-10-22T23:37:56.285540] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-10-22T23:37:56.296845] [DEBUG] [LOCAL ] SPRU: Derivative data saved (138 records). [2025-10-22T23:37:56.296933] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-10-22T23:37:56.299769] [INFO ] [MAIN ] Derivative Progress: 1696/2052 symbols. SPRU took 0.4s. Estimated remaining time: 2m 20s [2025-10-22T23:37:56.299888] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:56.325945] [DEBUG] [LOCAL ] SPXC: Loaded 23163 existing records from primary storage. [2025-10-22T23:37:56.326113] [INFO ] [MAIN ] SPXC: Loaded 23163 primary data records. [2025-10-22T23:37:56.638315] [DEBUG] [MAIN ] SPXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:56.665902] [INFO ] [MAIN ] SPXC: Generated 138 derivative records from 23163 primary records. [2025-10-22T23:37:56.666074] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-10-22T23:37:56.678994] [DEBUG] [LOCAL ] SPXC: Derivative data saved (138 records). [2025-10-22T23:37:56.679131] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-10-22T23:37:56.682231] [INFO ] [MAIN ] Derivative Progress: 1697/2052 symbols. SPXC took 0.4s. Estimated remaining time: 2m 20s [2025-10-22T23:37:56.682352] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:56.696274] [DEBUG] [LOCAL ] SPXX: Loaded 9114 existing records from primary storage. [2025-10-22T23:37:56.696415] [INFO ] [MAIN ] SPXX: Loaded 9114 primary data records. [2025-10-22T23:37:57.034369] [DEBUG] [MAIN ] SPXX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:57.062567] [INFO ] [MAIN ] SPXX: Generated 138 derivative records from 9114 primary records. [2025-10-22T23:37:57.062742] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-22T23:37:57.075138] [DEBUG] [LOCAL ] SPXX: Derivative data saved (138 records). [2025-10-22T23:37:57.075238] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-22T23:37:57.077620] [INFO ] [MAIN ] Derivative Progress: 1698/2052 symbols. SPXX took 0.4s. Estimated remaining time: 2m 19s [2025-10-22T23:37:57.077745] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:57.107609] [DEBUG] [LOCAL ] SQNS: Loaded 28139 existing records from primary storage. [2025-10-22T23:37:57.107791] [INFO ] [MAIN ] SQNS: Loaded 28139 primary data records. [2025-10-22T23:37:57.444341] [DEBUG] [MAIN ] SQNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:57.474015] [INFO ] [MAIN ] SQNS: Generated 138 derivative records from 28139 primary records. [2025-10-22T23:37:57.474165] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-22T23:37:57.486674] [DEBUG] [LOCAL ] SQNS: Derivative data saved (138 records). [2025-10-22T23:37:57.486835] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-22T23:37:57.489966] [INFO ] [MAIN ] Derivative Progress: 1699/2052 symbols. SQNS took 0.4s. Estimated remaining time: 2m 19s [2025-10-22T23:37:57.490076] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:57.522025] [DEBUG] [LOCAL ] SR: Loaded 32257 existing records from primary storage. [2025-10-22T23:37:57.522186] [INFO ] [MAIN ] SR: Loaded 32257 primary data records. [2025-10-22T23:37:57.851551] [DEBUG] [MAIN ] SR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:57.877199] [INFO ] [MAIN ] SR: Generated 138 derivative records from 32257 primary records. [2025-10-22T23:37:57.877338] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-22T23:37:57.889166] [DEBUG] [LOCAL ] SR: Derivative data saved (138 records). [2025-10-22T23:37:57.889251] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-10-22T23:37:57.892279] [INFO ] [MAIN ] Derivative Progress: 1700/2052 symbols. SR took 0.4s. Estimated remaining time: 2m 19s [2025-10-22T23:37:57.892374] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:57.946217] [DEBUG] [LOCAL ] SRE: Loaded 53408 existing records from primary storage. [2025-10-22T23:37:57.946378] [INFO ] [MAIN ] SRE: Loaded 53408 primary data records. [2025-10-22T23:37:58.260733] [DEBUG] [MAIN ] SRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:58.286121] [INFO ] [MAIN ] SRE: Generated 138 derivative records from 53408 primary records. [2025-10-22T23:37:58.286276] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-22T23:37:58.298196] [DEBUG] [LOCAL ] SRE: Derivative data saved (138 records). [2025-10-22T23:37:58.298279] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-10-22T23:37:58.301480] [INFO ] [MAIN ] Derivative Progress: 1701/2052 symbols. SRE took 0.4s. Estimated remaining time: 2m 18s [2025-10-22T23:37:58.301576] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:58.315001] [DEBUG] [LOCAL ] SREA: Loaded 9661 existing records from primary storage. [2025-10-22T23:37:58.315153] [INFO ] [MAIN ] SREA: Loaded 9661 primary data records. [2025-10-22T23:37:58.619804] [DEBUG] [MAIN ] SREA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:58.644773] [INFO ] [MAIN ] SREA: Generated 138 derivative records from 9661 primary records. [2025-10-22T23:37:58.644895] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-22T23:37:58.656579] [DEBUG] [LOCAL ] SREA: Derivative data saved (138 records). [2025-10-22T23:37:58.656680] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-22T23:37:58.658859] [INFO ] [MAIN ] Derivative Progress: 1702/2052 symbols. SREA took 0.4s. Estimated remaining time: 2m 18s [2025-10-22T23:37:58.658949] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:58.697279] [DEBUG] [LOCAL ] SRFM: Loaded 40036 existing records from primary storage. [2025-10-22T23:37:58.697441] [INFO ] [MAIN ] SRFM: Loaded 40036 primary data records. [2025-10-22T23:37:59.015224] [DEBUG] [MAIN ] SRFM: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:37:59.041048] [INFO ] [MAIN ] SRFM: Generated 138 derivative records from 40036 primary records. [2025-10-22T23:37:59.041173] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-22T23:37:59.052495] [DEBUG] [LOCAL ] SRFM: Derivative data saved (138 records). [2025-10-22T23:37:59.052580] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-22T23:37:59.055625] [INFO ] [MAIN ] Derivative Progress: 1703/2052 symbols. SRFM took 0.4s. Estimated remaining time: 2m 17s [2025-10-22T23:37:59.055799] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:59.073223] [DEBUG] [LOCAL ] SRG: Loaded 14642 existing records from primary storage. [2025-10-22T23:37:59.073373] [INFO ] [MAIN ] SRG: Loaded 14642 primary data records. [2025-10-22T23:37:59.382361] [DEBUG] [MAIN ] SRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:59.411702] [INFO ] [MAIN ] SRG: Generated 138 derivative records from 14642 primary records. [2025-10-22T23:37:59.411994] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-22T23:37:59.423132] [DEBUG] [LOCAL ] SRG: Derivative data saved (138 records). [2025-10-22T23:37:59.423226] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-22T23:37:59.426135] [INFO ] [MAIN ] Derivative Progress: 1704/2052 symbols. SRG took 0.4s. Estimated remaining time: 2m 17s [2025-10-22T23:37:59.426248] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:59.452750] [DEBUG] [LOCAL ] SRI: Loaded 26227 existing records from primary storage. [2025-10-22T23:37:59.452897] [INFO ] [MAIN ] SRI: Loaded 26227 primary data records. [2025-10-22T23:37:59.791394] [DEBUG] [MAIN ] SRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:37:59.817100] [INFO ] [MAIN ] SRI: Generated 138 derivative records from 26227 primary records. [2025-10-22T23:37:59.817292] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-22T23:37:59.829417] [DEBUG] [LOCAL ] SRI: Derivative data saved (138 records). [2025-10-22T23:37:59.829544] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-22T23:37:59.832514] [INFO ] [MAIN ] Derivative Progress: 1705/2052 symbols. SRI took 0.4s. Estimated remaining time: 2m 17s [2025-10-22T23:37:59.832623] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:37:59.844578] [DEBUG] [LOCAL ] SRV: Loaded 7379 existing records from primary storage. [2025-10-22T23:37:59.844757] [INFO ] [MAIN ] SRV: Loaded 7379 primary data records. [2025-10-22T23:38:00.153600] [DEBUG] [MAIN ] SRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:00.179512] [INFO ] [MAIN ] SRV: Generated 138 derivative records from 7379 primary records. [2025-10-22T23:38:00.179717] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-22T23:38:00.190820] [DEBUG] [LOCAL ] SRV: Derivative data saved (138 records). [2025-10-22T23:38:00.190933] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-22T23:38:00.193203] [INFO ] [MAIN ] Derivative Progress: 1706/2052 symbols. SRV took 0.4s. Estimated remaining time: 2m 16s [2025-10-22T23:38:00.193317] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:00.234997] [DEBUG] [LOCAL ] SSB: Loaded 42715 existing records from primary storage. [2025-10-22T23:38:00.235162] [INFO ] [MAIN ] SSB: Loaded 42715 primary data records. [2025-10-22T23:38:00.553204] [DEBUG] [MAIN ] SSB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:00.579619] [INFO ] [MAIN ] SSB: Generated 138 derivative records from 42715 primary records. [2025-10-22T23:38:00.579816] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-22T23:38:00.591737] [DEBUG] [LOCAL ] SSB: Derivative data saved (138 records). [2025-10-22T23:38:00.591879] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-10-22T23:38:00.595139] [INFO ] [MAIN ] Derivative Progress: 1707/2052 symbols. SSB took 0.4s. Estimated remaining time: 2m 16s [2025-10-22T23:38:00.595269] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:00.620841] [DEBUG] [LOCAL ] SSD: Loaded 22377 existing records from primary storage. [2025-10-22T23:38:00.621004] [INFO ] [MAIN ] SSD: Loaded 22377 primary data records. [2025-10-22T23:38:00.941663] [DEBUG] [MAIN ] SSD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:38:00.967083] [INFO ] [MAIN ] SSD: Generated 138 derivative records from 22377 primary records. [2025-10-22T23:38:00.967285] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-10-22T23:38:00.979195] [DEBUG] [LOCAL ] SSD: Derivative data saved (138 records). [2025-10-22T23:38:00.979313] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-10-22T23:38:00.982211] [INFO ] [MAIN ] Derivative Progress: 1708/2052 symbols. SSD took 0.4s. Estimated remaining time: 2m 15s [2025-10-22T23:38:00.982320] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:01.022634] [DEBUG] [LOCAL ] SSL: Loaded 41386 existing records from primary storage. [2025-10-22T23:38:01.022843] [INFO ] [MAIN ] SSL: Loaded 41386 primary data records. [2025-10-22T23:38:01.353932] [DEBUG] [MAIN ] SSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:01.382594] [INFO ] [MAIN ] SSL: Generated 138 derivative records from 41386 primary records. [2025-10-22T23:38:01.382844] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-22T23:38:01.402009] [DEBUG] [LOCAL ] SSL: Derivative data saved (138 records). [2025-10-22T23:38:01.402197] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-22T23:38:01.406680] [INFO ] [MAIN ] Derivative Progress: 1709/2052 symbols. SSL took 0.4s. Estimated remaining time: 2m 15s [2025-10-22T23:38:01.406931] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:01.426272] [DEBUG] [LOCAL ] SST: Loaded 11382 existing records from primary storage. [2025-10-22T23:38:01.426467] [INFO ] [MAIN ] SST: Loaded 11382 primary data records. [2025-10-22T23:38:01.772006] [DEBUG] [MAIN ] SST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:01.799762] [INFO ] [MAIN ] SST: Generated 138 derivative records from 11382 primary records. [2025-10-22T23:38:01.799951] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-22T23:38:01.811041] [DEBUG] [LOCAL ] SST: Derivative data saved (138 records). [2025-10-22T23:38:01.811164] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-10-22T23:38:01.814066] [INFO ] [MAIN ] Derivative Progress: 1710/2052 symbols. SST took 0.4s. Estimated remaining time: 2m 15s [2025-10-22T23:38:01.814186] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:01.842801] [DEBUG] [LOCAL ] SSTK: Loaded 25244 existing records from primary storage. [2025-10-22T23:38:01.842979] [INFO ] [MAIN ] SSTK: Loaded 25244 primary data records. [2025-10-22T23:38:02.148531] [DEBUG] [MAIN ] SSTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:02.173368] [INFO ] [MAIN ] SSTK: Generated 138 derivative records from 25244 primary records. [2025-10-22T23:38:02.173496] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-22T23:38:02.184843] [DEBUG] [LOCAL ] SSTK: Derivative data saved (138 records). [2025-10-22T23:38:02.184930] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-10-22T23:38:02.187896] [INFO ] [MAIN ] Derivative Progress: 1711/2052 symbols. SSTK took 0.4s. Estimated remaining time: 2m 14s [2025-10-22T23:38:02.188000] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:02.236483] [DEBUG] [LOCAL ] ST: Loaded 49668 existing records from primary storage. [2025-10-22T23:38:02.236671] [INFO ] [MAIN ] ST: Loaded 49668 primary data records. [2025-10-22T23:38:02.539697] [DEBUG] [MAIN ] ST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:02.564778] [INFO ] [MAIN ] ST: Generated 138 derivative records from 49668 primary records. [2025-10-22T23:38:02.564933] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-22T23:38:02.576436] [DEBUG] [LOCAL ] ST: Derivative data saved (138 records). [2025-10-22T23:38:02.576523] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-10-22T23:38:02.579547] [INFO ] [MAIN ] Derivative Progress: 1712/2052 symbols. ST took 0.4s. Estimated remaining time: 2m 14s [2025-10-22T23:38:02.579668] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:02.628462] [DEBUG] [LOCAL ] STAG: Loaded 50046 existing records from primary storage. [2025-10-22T23:38:02.628633] [INFO ] [MAIN ] STAG: Loaded 50046 primary data records. [2025-10-22T23:38:02.975238] [DEBUG] [MAIN ] STAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:03.000106] [INFO ] [MAIN ] STAG: Generated 138 derivative records from 50046 primary records. [2025-10-22T23:38:03.000243] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-22T23:38:03.011992] [DEBUG] [LOCAL ] STAG: Derivative data saved (138 records). [2025-10-22T23:38:03.012092] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-10-22T23:38:03.015315] [INFO ] [MAIN ] Derivative Progress: 1713/2052 symbols. STAG took 0.4s. Estimated remaining time: 2m 13s [2025-10-22T23:38:03.015426] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:03.036190] [DEBUG] [LOCAL ] STC: Loaded 17391 existing records from primary storage. [2025-10-22T23:38:03.036356] [INFO ] [MAIN ] STC: Loaded 17391 primary data records. [2025-10-22T23:38:03.342379] [DEBUG] [MAIN ] STC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:03.367957] [INFO ] [MAIN ] STC: Generated 138 derivative records from 17391 primary records. [2025-10-22T23:38:03.368174] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-22T23:38:03.379672] [DEBUG] [LOCAL ] STC: Derivative data saved (138 records). [2025-10-22T23:38:03.379765] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-10-22T23:38:03.382615] [INFO ] [MAIN ] Derivative Progress: 1714/2052 symbols. STC took 0.4s. Estimated remaining time: 2m 13s [2025-10-22T23:38:03.382751] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:03.407114] [DEBUG] [LOCAL ] STEL: Loaded 22328 existing records from primary storage. [2025-10-22T23:38:03.407303] [INFO ] [MAIN ] STEL: Loaded 22328 primary data records. [2025-10-22T23:38:03.716908] [DEBUG] [MAIN ] STEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:03.742098] [INFO ] [MAIN ] STEL: Generated 138 derivative records from 22328 primary records. [2025-10-22T23:38:03.742258] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-22T23:38:03.753790] [DEBUG] [LOCAL ] STEL: Derivative data saved (138 records). [2025-10-22T23:38:03.753881] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-10-22T23:38:03.756838] [INFO ] [MAIN ] Derivative Progress: 1715/2052 symbols. STEL took 0.4s. Estimated remaining time: 2m 13s [2025-10-22T23:38:03.756956] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:03.795774] [DEBUG] [LOCAL ] STEM: Loaded 38406 existing records from primary storage. [2025-10-22T23:38:03.795934] [INFO ] [MAIN ] STEM: Loaded 38406 primary data records. [2025-10-22T23:38:04.148461] [DEBUG] [MAIN ] STEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:04.174944] [INFO ] [MAIN ] STEM: Generated 138 derivative records from 38406 primary records. [2025-10-22T23:38:04.175137] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-22T23:38:04.187485] [DEBUG] [LOCAL ] STEM: Derivative data saved (138 records). [2025-10-22T23:38:04.187579] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-22T23:38:04.190776] [INFO ] [MAIN ] Derivative Progress: 1716/2052 symbols. STEM took 0.4s. Estimated remaining time: 2m 12s [2025-10-22T23:38:04.190888] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:04.211309] [DEBUG] [LOCAL ] STEW: Loaded 15067 existing records from primary storage. [2025-10-22T23:38:04.211494] [INFO ] [MAIN ] STEW: Loaded 15067 primary data records. [2025-10-22T23:38:04.548006] [DEBUG] [MAIN ] STEW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:04.575372] [INFO ] [MAIN ] STEW: Generated 138 derivative records from 15067 primary records. [2025-10-22T23:38:04.575546] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-22T23:38:04.587203] [DEBUG] [LOCAL ] STEW: Derivative data saved (138 records). [2025-10-22T23:38:04.587306] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-22T23:38:04.590103] [INFO ] [MAIN ] Derivative Progress: 1717/2052 symbols. STEW took 0.4s. Estimated remaining time: 2m 12s [2025-10-22T23:38:04.590205] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:04.603588] [DEBUG] [LOCAL ] STK: Loaded 9700 existing records from primary storage. [2025-10-22T23:38:04.603745] [INFO ] [MAIN ] STK: Loaded 9700 primary data records. [2025-10-22T23:38:04.904964] [DEBUG] [MAIN ] STK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:04.929914] [INFO ] [MAIN ] STK: Generated 138 derivative records from 9700 primary records. [2025-10-22T23:38:04.930072] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-22T23:38:04.941951] [DEBUG] [LOCAL ] STK: Derivative data saved (138 records). [2025-10-22T23:38:04.942032] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-22T23:38:04.944224] [INFO ] [MAIN ] Derivative Progress: 1718/2052 symbols. STK took 0.4s. Estimated remaining time: 2m 11s [2025-10-22T23:38:04.944327] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:04.997695] [DEBUG] [LOCAL ] STLA: Loaded 53557 existing records from primary storage. [2025-10-22T23:38:04.997855] [INFO ] [MAIN ] STLA: Loaded 53557 primary data records. [2025-10-22T23:38:05.326614] [DEBUG] [MAIN ] STLA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:05.351583] [INFO ] [MAIN ] STLA: Generated 138 derivative records from 53557 primary records. [2025-10-22T23:38:05.351769] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-22T23:38:05.363624] [DEBUG] [LOCAL ] STLA: Derivative data saved (138 records). [2025-10-22T23:38:05.363723] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-22T23:38:05.366788] [INFO ] [MAIN ] Derivative Progress: 1719/2052 symbols. STLA took 0.4s. Estimated remaining time: 2m 11s [2025-10-22T23:38:05.366896] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:05.419613] [DEBUG] [LOCAL ] STM: Loaded 53573 existing records from primary storage. [2025-10-22T23:38:05.419813] [INFO ] [MAIN ] STM: Loaded 53573 primary data records. [2025-10-22T23:38:05.732269] [DEBUG] [MAIN ] STM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:05.758447] [INFO ] [MAIN ] STM: Generated 138 derivative records from 53573 primary records. [2025-10-22T23:38:05.758695] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-22T23:38:05.770871] [DEBUG] [LOCAL ] STM: Derivative data saved (138 records). [2025-10-22T23:38:05.770964] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-22T23:38:05.774118] [INFO ] [MAIN ] Derivative Progress: 1720/2052 symbols. STM took 0.4s. Estimated remaining time: 2m 11s [2025-10-22T23:38:05.774217] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:05.798152] [DEBUG] [LOCAL ] STN: Loaded 22576 existing records from primary storage. [2025-10-22T23:38:05.798318] [INFO ] [MAIN ] STN: Loaded 22576 primary data records. [2025-10-22T23:38:06.140301] [DEBUG] [MAIN ] STN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:06.165632] [INFO ] [MAIN ] STN: Generated 138 derivative records from 22576 primary records. [2025-10-22T23:38:06.165757] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-22T23:38:06.177388] [DEBUG] [LOCAL ] STN: Derivative data saved (138 records). [2025-10-22T23:38:06.177468] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-22T23:38:06.180326] [INFO ] [MAIN ] Derivative Progress: 1721/2052 symbols. STN took 0.4s. Estimated remaining time: 2m 10s [2025-10-22T23:38:06.180420] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:06.223977] [DEBUG] [LOCAL ] STNG: Loaded 43272 existing records from primary storage. [2025-10-22T23:38:06.224157] [INFO ] [MAIN ] STNG: Loaded 43272 primary data records. [2025-10-22T23:38:06.554839] [DEBUG] [MAIN ] STNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:06.580746] [INFO ] [MAIN ] STNG: Generated 138 derivative records from 43272 primary records. [2025-10-22T23:38:06.580888] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-22T23:38:06.592711] [DEBUG] [LOCAL ] STNG: Derivative data saved (138 records). [2025-10-22T23:38:06.592812] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-22T23:38:06.595614] [INFO ] [MAIN ] Derivative Progress: 1722/2052 symbols. STNG took 0.4s. Estimated remaining time: 2m 10s [2025-10-22T23:38:06.595762] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:06.610889] [DEBUG] [LOCAL ] STRV: Loaded 10686 existing records from primary storage. [2025-10-22T23:38:06.611056] [INFO ] [MAIN ] STRV: Loaded 10686 primary data records. [2025-10-22T23:38:06.923936] [DEBUG] [MAIN ] STRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:06.949867] [INFO ] [MAIN ] STRV: Generated 138 derivative records from 10686 primary records. [2025-10-22T23:38:06.950003] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-22T23:38:06.962076] [DEBUG] [LOCAL ] STRV: Derivative data saved (138 records). [2025-10-22T23:38:06.962185] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-22T23:38:06.964430] [INFO ] [MAIN ] Derivative Progress: 1723/2052 symbols. STRV took 0.4s. Estimated remaining time: 2m 10s [2025-10-22T23:38:06.964548] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:06.992834] [DEBUG] [LOCAL ] STVN: Loaded 26683 existing records from primary storage. [2025-10-22T23:38:06.993000] [INFO ] [MAIN ] STVN: Loaded 26683 primary data records. [2025-10-22T23:38:07.299598] [DEBUG] [MAIN ] STVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:07.324810] [INFO ] [MAIN ] STVN: Generated 138 derivative records from 26683 primary records. [2025-10-22T23:38:07.324922] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-22T23:38:07.336903] [DEBUG] [LOCAL ] STVN: Derivative data saved (138 records). [2025-10-22T23:38:07.336982] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-22T23:38:07.340106] [INFO ] [MAIN ] Derivative Progress: 1724/2052 symbols. STVN took 0.4s. Estimated remaining time: 2m 9s [2025-10-22T23:38:07.340216] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:07.395021] [DEBUG] [LOCAL ] STWD: Loaded 51960 existing records from primary storage. [2025-10-22T23:38:07.395178] [INFO ] [MAIN ] STWD: Loaded 51960 primary data records. [2025-10-22T23:38:07.704998] [DEBUG] [MAIN ] STWD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:07.730513] [INFO ] [MAIN ] STWD: Generated 138 derivative records from 51960 primary records. [2025-10-22T23:38:07.730672] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-22T23:38:07.742375] [DEBUG] [LOCAL ] STWD: Derivative data saved (138 records). [2025-10-22T23:38:07.742456] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-10-22T23:38:07.745560] [INFO ] [MAIN ] Derivative Progress: 1725/2052 symbols. STWD took 0.4s. Estimated remaining time: 2m 9s [2025-10-22T23:38:07.745687] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:07.749259] [DEBUG] [LOCAL ] STXD: Loaded 1337 existing records from primary storage. [2025-10-22T23:38:07.749343] [INFO ] [MAIN ] STXD: Loaded 1337 primary data records. [2025-10-22T23:38:08.080626] [DEBUG] [MAIN ] STXD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:38:08.105891] [INFO ] [MAIN ] STXD: Generated 138 derivative records from 1337 primary records. [2025-10-22T23:38:08.106038] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-22T23:38:08.114974] [DEBUG] [LOCAL ] STXD: Derivative data saved (138 records). [2025-10-22T23:38:08.115055] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-22T23:38:08.117135] [INFO ] [MAIN ] Derivative Progress: 1726/2052 symbols. STXD took 0.4s. Estimated remaining time: 2m 8s [2025-10-22T23:38:08.117230] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:08.121597] [DEBUG] [LOCAL ] STXE: Loaded 2051 existing records from primary storage. [2025-10-22T23:38:08.121704] [INFO ] [MAIN ] STXE: Loaded 2051 primary data records. [2025-10-22T23:38:08.424914] [DEBUG] [MAIN ] STXE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:38:08.450388] [INFO ] [MAIN ] STXE: Generated 138 derivative records from 2051 primary records. [2025-10-22T23:38:08.450509] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-22T23:38:08.460305] [DEBUG] [LOCAL ] STXE: Derivative data saved (138 records). [2025-10-22T23:38:08.460387] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-22T23:38:08.462591] [INFO ] [MAIN ] Derivative Progress: 1727/2052 symbols. STXE took 0.3s. Estimated remaining time: 2m 8s [2025-10-22T23:38:08.462707] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:08.467404] [DEBUG] [LOCAL ] STXG: Loaded 2290 existing records from primary storage. [2025-10-22T23:38:08.467494] [INFO ] [MAIN ] STXG: Loaded 2290 primary data records. [2025-10-22T23:38:08.773967] [DEBUG] [MAIN ] STXG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:38:08.799510] [INFO ] [MAIN ] STXG: Generated 138 derivative records from 2290 primary records. [2025-10-22T23:38:08.799623] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-22T23:38:08.809264] [DEBUG] [LOCAL ] STXG: Derivative data saved (138 records). [2025-10-22T23:38:08.809348] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-22T23:38:08.811470] [INFO ] [MAIN ] Derivative Progress: 1728/2052 symbols. STXG took 0.3s. Estimated remaining time: 2m 8s [2025-10-22T23:38:08.811566] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:08.815296] [DEBUG] [LOCAL ] STXK: Loaded 1477 existing records from primary storage. [2025-10-22T23:38:08.815381] [INFO ] [MAIN ] STXK: Loaded 1477 primary data records. [2025-10-22T23:38:09.123028] [DEBUG] [MAIN ] STXK: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:38:09.148531] [INFO ] [MAIN ] STXK: Generated 138 derivative records from 1477 primary records. [2025-10-22T23:38:09.148674] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-22T23:38:09.158024] [DEBUG] [LOCAL ] STXK: Derivative data saved (138 records). [2025-10-22T23:38:09.158105] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-10-22T23:38:09.160303] [INFO ] [MAIN ] Derivative Progress: 1729/2052 symbols. STXK took 0.3s. Estimated remaining time: 2m 7s [2025-10-22T23:38:09.160415] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:09.165240] [DEBUG] [LOCAL ] STXT: Loaded 2509 existing records from primary storage. [2025-10-22T23:38:09.165331] [INFO ] [MAIN ] STXT: Loaded 2509 primary data records. [2025-10-22T23:38:09.472339] [DEBUG] [MAIN ] STXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:09.497292] [INFO ] [MAIN ] STXT: Generated 138 derivative records from 2509 primary records. [2025-10-22T23:38:09.497425] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-22T23:38:09.507311] [DEBUG] [LOCAL ] STXT: Derivative data saved (138 records). [2025-10-22T23:38:09.507414] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-22T23:38:09.509603] [INFO ] [MAIN ] Derivative Progress: 1730/2052 symbols. STXT took 0.3s. Estimated remaining time: 2m 7s [2025-10-22T23:38:09.509717] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:09.513382] [DEBUG] [LOCAL ] STXV: Loaded 1462 existing records from primary storage. [2025-10-22T23:38:09.513469] [INFO ] [MAIN ] STXV: Loaded 1462 primary data records. [2025-10-22T23:38:09.844907] [DEBUG] [MAIN ] STXV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:38:09.870393] [INFO ] [MAIN ] STXV: Generated 138 derivative records from 1462 primary records. [2025-10-22T23:38:09.870523] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-22T23:38:09.879882] [DEBUG] [LOCAL ] STXV: Derivative data saved (138 records). [2025-10-22T23:38:09.879962] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-10-22T23:38:09.882262] [INFO ] [MAIN ] Derivative Progress: 1731/2052 symbols. STXV took 0.4s. Estimated remaining time: 2m 6s [2025-10-22T23:38:09.882379] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:09.935690] [DEBUG] [LOCAL ] SU: Loaded 53430 existing records from primary storage. [2025-10-22T23:38:09.935850] [INFO ] [MAIN ] SU: Loaded 53430 primary data records. [2025-10-22T23:38:10.244737] [DEBUG] [MAIN ] SU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:10.270006] [INFO ] [MAIN ] SU: Generated 138 derivative records from 53430 primary records. [2025-10-22T23:38:10.270132] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-22T23:38:10.281548] [DEBUG] [LOCAL ] SU: Derivative data saved (138 records). [2025-10-22T23:38:10.281629] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-22T23:38:10.284914] [INFO ] [MAIN ] Derivative Progress: 1732/2052 symbols. SU took 0.4s. Estimated remaining time: 2m 6s [2025-10-22T23:38:10.285020] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:10.327077] [DEBUG] [LOCAL ] SUI: Loaded 41833 existing records from primary storage. [2025-10-22T23:38:10.327228] [INFO ] [MAIN ] SUI: Loaded 41833 primary data records. [2025-10-22T23:38:10.635358] [DEBUG] [MAIN ] SUI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:10.660329] [INFO ] [MAIN ] SUI: Generated 138 derivative records from 41833 primary records. [2025-10-22T23:38:10.660466] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-22T23:38:10.672071] [DEBUG] [LOCAL ] SUI: Derivative data saved (138 records). [2025-10-22T23:38:10.672155] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-22T23:38:10.675044] [INFO ] [MAIN ] Derivative Progress: 1733/2052 symbols. SUI took 0.4s. Estimated remaining time: 2m 6s [2025-10-22T23:38:10.675142] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:10.712862] [DEBUG] [LOCAL ] SUN: Loaded 38757 existing records from primary storage. [2025-10-22T23:38:10.713012] [INFO ] [MAIN ] SUN: Loaded 38757 primary data records. [2025-10-22T23:38:11.022568] [DEBUG] [MAIN ] SUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:11.048034] [INFO ] [MAIN ] SUN: Generated 138 derivative records from 38757 primary records. [2025-10-22T23:38:11.048144] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-22T23:38:11.059621] [DEBUG] [LOCAL ] SUN: Derivative data saved (138 records). [2025-10-22T23:38:11.059728] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-22T23:38:11.062596] [INFO ] [MAIN ] Derivative Progress: 1734/2052 symbols. SUN took 0.4s. Estimated remaining time: 2m 5s [2025-10-22T23:38:11.062728] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:11.110132] [DEBUG] [LOCAL ] SUPV: Loaded 48048 existing records from primary storage. [2025-10-22T23:38:11.110293] [INFO ] [MAIN ] SUPV: Loaded 48048 primary data records. [2025-10-22T23:38:11.418335] [DEBUG] [MAIN ] SUPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:11.443289] [INFO ] [MAIN ] SUPV: Generated 138 derivative records from 48048 primary records. [2025-10-22T23:38:11.443405] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-22T23:38:11.454998] [DEBUG] [LOCAL ] SUPV: Derivative data saved (138 records). [2025-10-22T23:38:11.455090] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-22T23:38:11.458091] [INFO ] [MAIN ] Derivative Progress: 1735/2052 symbols. SUPV took 0.4s. Estimated remaining time: 2m 5s [2025-10-22T23:38:11.458183] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:11.502248] [DEBUG] [LOCAL ] SUZ: Loaded 45524 existing records from primary storage. [2025-10-22T23:38:11.502419] [INFO ] [MAIN ] SUZ: Loaded 45524 primary data records. [2025-10-22T23:38:11.812233] [DEBUG] [MAIN ] SUZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:11.838389] [INFO ] [MAIN ] SUZ: Generated 138 derivative records from 45524 primary records. [2025-10-22T23:38:11.838519] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-22T23:38:11.850122] [DEBUG] [LOCAL ] SUZ: Derivative data saved (138 records). [2025-10-22T23:38:11.850207] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-22T23:38:11.853099] [INFO ] [MAIN ] Derivative Progress: 1736/2052 symbols. SUZ took 0.4s. Estimated remaining time: 2m 4s [2025-10-22T23:38:11.853202] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:11.892511] [DEBUG] [LOCAL ] SVV: Loaded 40253 existing records from primary storage. [2025-10-22T23:38:11.892698] [INFO ] [MAIN ] SVV: Loaded 40253 primary data records. [2025-10-22T23:38:12.222103] [DEBUG] [MAIN ] SVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:12.247426] [INFO ] [MAIN ] SVV: Generated 138 derivative records from 40253 primary records. [2025-10-22T23:38:12.247595] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-22T23:38:12.259032] [DEBUG] [LOCAL ] SVV: Derivative data saved (138 records). [2025-10-22T23:38:12.259119] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-22T23:38:12.262037] [INFO ] [MAIN ] Derivative Progress: 1737/2052 symbols. SVV took 0.4s. Estimated remaining time: 2m 4s [2025-10-22T23:38:12.262152] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:12.314943] [DEBUG] [LOCAL ] SW: Loaded 53179 existing records from primary storage. [2025-10-22T23:38:12.315112] [INFO ] [MAIN ] SW: Loaded 53179 primary data records. [2025-10-22T23:38:12.617606] [DEBUG] [MAIN ] SW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:12.642799] [INFO ] [MAIN ] SW: Generated 138 derivative records from 53179 primary records. [2025-10-22T23:38:12.642944] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-22T23:38:12.654375] [DEBUG] [LOCAL ] SW: Derivative data saved (138 records). [2025-10-22T23:38:12.654475] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-22T23:38:12.657603] [INFO ] [MAIN ] Derivative Progress: 1738/2052 symbols. SW took 0.4s. Estimated remaining time: 2m 4s [2025-10-22T23:38:12.657735] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:12.709420] [DEBUG] [LOCAL ] SWK: Loaded 52397 existing records from primary storage. [2025-10-22T23:38:12.709585] [INFO ] [MAIN ] SWK: Loaded 52397 primary data records. [2025-10-22T23:38:13.020221] [DEBUG] [MAIN ] SWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:13.045252] [INFO ] [MAIN ] SWK: Generated 138 derivative records from 52397 primary records. [2025-10-22T23:38:13.045378] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-22T23:38:13.056638] [DEBUG] [LOCAL ] SWK: Derivative data saved (138 records). [2025-10-22T23:38:13.056938] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-22T23:38:13.060060] [INFO ] [MAIN ] Derivative Progress: 1739/2052 symbols. SWK took 0.4s. Estimated remaining time: 2m 3s [2025-10-22T23:38:13.060152] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:13.089348] [DEBUG] [LOCAL ] SWX: Loaded 30595 existing records from primary storage. [2025-10-22T23:38:13.089487] [INFO ] [MAIN ] SWX: Loaded 30595 primary data records. [2025-10-22T23:38:13.393173] [DEBUG] [MAIN ] SWX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:13.418161] [INFO ] [MAIN ] SWX: Generated 138 derivative records from 30595 primary records. [2025-10-22T23:38:13.418286] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-22T23:38:13.429979] [DEBUG] [LOCAL ] SWX: Derivative data saved (138 records). [2025-10-22T23:38:13.430060] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-22T23:38:13.432894] [INFO ] [MAIN ] Derivative Progress: 1740/2052 symbols. SWX took 0.4s. Estimated remaining time: 2m 3s [2025-10-22T23:38:13.432987] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:13.442794] [DEBUG] [LOCAL ] SWZ: Loaded 5997 existing records from primary storage. [2025-10-22T23:38:13.442904] [INFO ] [MAIN ] SWZ: Loaded 5997 primary data records. [2025-10-22T23:38:13.748398] [DEBUG] [MAIN ] SWZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:13.773140] [INFO ] [MAIN ] SWZ: Generated 138 derivative records from 5997 primary records. [2025-10-22T23:38:13.773289] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-22T23:38:13.783153] [DEBUG] [LOCAL ] SWZ: Derivative data saved (138 records). [2025-10-22T23:38:13.783235] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-10-22T23:38:13.785464] [INFO ] [MAIN ] Derivative Progress: 1741/2052 symbols. SWZ took 0.4s. Estimated remaining time: 2m 2s [2025-10-22T23:38:13.785563] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:13.826589] [DEBUG] [LOCAL ] SXC: Loaded 41575 existing records from primary storage. [2025-10-22T23:38:13.826768] [INFO ] [MAIN ] SXC: Loaded 41575 primary data records. [2025-10-22T23:38:14.157333] [DEBUG] [MAIN ] SXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:14.182690] [INFO ] [MAIN ] SXC: Generated 138 derivative records from 41575 primary records. [2025-10-22T23:38:14.182821] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-22T23:38:14.193985] [DEBUG] [LOCAL ] SXC: Derivative data saved (138 records). [2025-10-22T23:38:14.194065] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-22T23:38:14.197059] [INFO ] [MAIN ] Derivative Progress: 1742/2052 symbols. SXC took 0.4s. Estimated remaining time: 2m 2s [2025-10-22T23:38:14.197161] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:14.215621] [DEBUG] [LOCAL ] SXI: Loaded 12002 existing records from primary storage. [2025-10-22T23:38:14.215775] [INFO ] [MAIN ] SXI: Loaded 12002 primary data records. [2025-10-22T23:38:14.524514] [DEBUG] [MAIN ] SXI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:14.551434] [INFO ] [MAIN ] SXI: Generated 138 derivative records from 12002 primary records. [2025-10-22T23:38:14.551614] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-22T23:38:14.563586] [DEBUG] [LOCAL ] SXI: Derivative data saved (138 records). [2025-10-22T23:38:14.563718] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-22T23:38:14.566568] [INFO ] [MAIN ] Derivative Progress: 1743/2052 symbols. SXI took 0.4s. Estimated remaining time: 2m 2s [2025-10-22T23:38:14.566703] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:14.597880] [DEBUG] [LOCAL ] SXT: Loaded 29654 existing records from primary storage. [2025-10-22T23:38:14.598044] [INFO ] [MAIN ] SXT: Loaded 29654 primary data records. [2025-10-22T23:38:14.906094] [DEBUG] [MAIN ] SXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:14.931451] [INFO ] [MAIN ] SXT: Generated 138 derivative records from 29654 primary records. [2025-10-22T23:38:14.931557] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-22T23:38:14.943080] [DEBUG] [LOCAL ] SXT: Derivative data saved (138 records). [2025-10-22T23:38:14.943158] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-22T23:38:14.946039] [INFO ] [MAIN ] Derivative Progress: 1744/2052 symbols. SXT took 0.4s. Estimated remaining time: 2m 1s [2025-10-22T23:38:14.946132] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:15.000391] [DEBUG] [LOCAL ] SYF: Loaded 53451 existing records from primary storage. [2025-10-22T23:38:15.000552] [INFO ] [MAIN ] SYF: Loaded 53451 primary data records. [2025-10-22T23:38:15.308106] [DEBUG] [MAIN ] SYF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:15.333313] [INFO ] [MAIN ] SYF: Generated 138 derivative records from 53451 primary records. [2025-10-22T23:38:15.333419] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-10-22T23:38:15.345370] [DEBUG] [LOCAL ] SYF: Derivative data saved (138 records). [2025-10-22T23:38:15.345497] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-10-22T23:38:15.348637] [INFO ] [MAIN ] Derivative Progress: 1745/2052 symbols. SYF took 0.4s. Estimated remaining time: 2m 1s [2025-10-22T23:38:15.348749] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:15.395699] [DEBUG] [LOCAL ] SYK: Loaded 46804 existing records from primary storage. [2025-10-22T23:38:15.395858] [INFO ] [MAIN ] SYK: Loaded 46804 primary data records. [2025-10-22T23:38:15.703547] [DEBUG] [MAIN ] SYK: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:38:15.728954] [INFO ] [MAIN ] SYK: Generated 138 derivative records from 46804 primary records. [2025-10-22T23:38:15.729095] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-22T23:38:15.740717] [DEBUG] [LOCAL ] SYK: Derivative data saved (138 records). [2025-10-22T23:38:15.740803] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-22T23:38:15.743632] [INFO ] [MAIN ] Derivative Progress: 1746/2052 symbols. SYK took 0.4s. Estimated remaining time: 2m 0s [2025-10-22T23:38:15.743759] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:15.794498] [DEBUG] [LOCAL ] SYY: Loaded 53204 existing records from primary storage. [2025-10-22T23:38:15.794698] [INFO ] [MAIN ] SYY: Loaded 53204 primary data records. [2025-10-22T23:38:16.127066] [DEBUG] [MAIN ] SYY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:16.152013] [INFO ] [MAIN ] SYY: Generated 138 derivative records from 53204 primary records. [2025-10-22T23:38:16.152121] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-22T23:38:16.163865] [DEBUG] [LOCAL ] SYY: Derivative data saved (138 records). [2025-10-22T23:38:16.163943] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-22T23:38:16.167054] [INFO ] [MAIN ] Derivative Progress: 1747/2052 symbols. SYY took 0.4s. Estimated remaining time: 2m 0s [2025-10-22T23:38:16.167149] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:16.221280] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-22T23:38:16.221439] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-10-22T23:38:16.527888] [DEBUG] [MAIN ] T: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:16.552801] [INFO ] [MAIN ] T: Generated 138 derivative records from 53798 primary records. [2025-10-22T23:38:16.552974] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-22T23:38:16.564752] [DEBUG] [LOCAL ] T: Derivative data saved (138 records). [2025-10-22T23:38:16.564847] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-22T23:38:16.567890] [INFO ] [MAIN ] Derivative Progress: 1748/2052 symbols. T took 0.4s. Estimated remaining time: 1m 60s [2025-10-22T23:38:16.567980] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:16.611055] [DEBUG] [LOCAL ] TAC: Loaded 43411 existing records from primary storage. [2025-10-22T23:38:16.611226] [INFO ] [MAIN ] TAC: Loaded 43411 primary data records. [2025-10-22T23:38:16.918427] [DEBUG] [MAIN ] TAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:16.943479] [INFO ] [MAIN ] TAC: Generated 138 derivative records from 43411 primary records. [2025-10-22T23:38:16.943617] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-22T23:38:16.955164] [DEBUG] [LOCAL ] TAC: Derivative data saved (138 records). [2025-10-22T23:38:16.955245] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-22T23:38:16.958211] [INFO ] [MAIN ] Derivative Progress: 1749/2052 symbols. TAC took 0.4s. Estimated remaining time: 1m 59s [2025-10-22T23:38:16.958313] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:17.008338] [DEBUG] [LOCAL ] TAK: Loaded 50230 existing records from primary storage. [2025-10-22T23:38:17.008503] [INFO ] [MAIN ] TAK: Loaded 50230 primary data records. [2025-10-22T23:38:17.312485] [DEBUG] [MAIN ] TAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:17.337466] [INFO ] [MAIN ] TAK: Generated 138 derivative records from 50230 primary records. [2025-10-22T23:38:17.337595] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-22T23:38:17.349396] [DEBUG] [LOCAL ] TAK: Derivative data saved (138 records). [2025-10-22T23:38:17.349490] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-22T23:38:17.352387] [INFO ] [MAIN ] Derivative Progress: 1750/2052 symbols. TAK took 0.4s. Estimated remaining time: 1m 59s [2025-10-22T23:38:17.352496] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:17.406415] [DEBUG] [LOCAL ] TAL: Loaded 51715 existing records from primary storage. [2025-10-22T23:38:17.406594] [INFO ] [MAIN ] TAL: Loaded 51715 primary data records. [2025-10-22T23:38:17.733595] [DEBUG] [MAIN ] TAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:17.759438] [INFO ] [MAIN ] TAL: Generated 138 derivative records from 51715 primary records. [2025-10-22T23:38:17.759584] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-22T23:38:17.771481] [DEBUG] [LOCAL ] TAL: Derivative data saved (138 records). [2025-10-22T23:38:17.771570] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-22T23:38:17.774640] [INFO ] [MAIN ] Derivative Progress: 1751/2052 symbols. TAL took 0.4s. Estimated remaining time: 1m 58s [2025-10-22T23:38:17.774777] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:17.827764] [DEBUG] [LOCAL ] TALO: Loaded 50988 existing records from primary storage. [2025-10-22T23:38:17.827933] [INFO ] [MAIN ] TALO: Loaded 50988 primary data records. [2025-10-22T23:38:18.142006] [DEBUG] [MAIN ] TALO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:18.166716] [INFO ] [MAIN ] TALO: Generated 138 derivative records from 50988 primary records. [2025-10-22T23:38:18.166841] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-22T23:38:18.178202] [DEBUG] [LOCAL ] TALO: Derivative data saved (138 records). [2025-10-22T23:38:18.178297] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-22T23:38:18.181380] [INFO ] [MAIN ] Derivative Progress: 1752/2052 symbols. TALO took 0.4s. Estimated remaining time: 1m 58s [2025-10-22T23:38:18.181483] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:18.234847] [DEBUG] [LOCAL ] TAP: Loaded 52959 existing records from primary storage. [2025-10-22T23:38:18.235016] [INFO ] [MAIN ] TAP: Loaded 52959 primary data records. [2025-10-22T23:38:18.561935] [DEBUG] [MAIN ] TAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:18.586984] [INFO ] [MAIN ] TAP: Generated 138 derivative records from 52959 primary records. [2025-10-22T23:38:18.587152] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-22T23:38:18.598687] [DEBUG] [LOCAL ] TAP: Derivative data saved (138 records). [2025-10-22T23:38:18.598775] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-22T23:38:18.601819] [INFO ] [MAIN ] Derivative Progress: 1753/2052 symbols. TAP took 0.4s. Estimated remaining time: 1m 58s [2025-10-22T23:38:18.601939] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:18.636592] [DEBUG] [LOCAL ] TBBB: Loaded 35604 existing records from primary storage. [2025-10-22T23:38:18.636775] [INFO ] [MAIN ] TBBB: Loaded 35604 primary data records. [2025-10-22T23:38:18.945774] [DEBUG] [MAIN ] TBBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:18.971092] [INFO ] [MAIN ] TBBB: Generated 138 derivative records from 35604 primary records. [2025-10-22T23:38:18.971290] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-22T23:38:18.982989] [DEBUG] [LOCAL ] TBBB: Derivative data saved (138 records). [2025-10-22T23:38:18.983102] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-22T23:38:18.986051] [INFO ] [MAIN ] Derivative Progress: 1754/2052 symbols. TBBB took 0.4s. Estimated remaining time: 1m 57s [2025-10-22T23:38:18.986178] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:19.009590] [DEBUG] [LOCAL ] TBI: Loaded 22761 existing records from primary storage. [2025-10-22T23:38:19.009794] [INFO ] [MAIN ] TBI: Loaded 22761 primary data records. [2025-10-22T23:38:19.323635] [DEBUG] [MAIN ] TBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:19.348599] [INFO ] [MAIN ] TBI: Generated 138 derivative records from 22761 primary records. [2025-10-22T23:38:19.348735] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-22T23:38:19.359614] [DEBUG] [LOCAL ] TBI: Derivative data saved (138 records). [2025-10-22T23:38:19.359720] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-10-22T23:38:19.362414] [INFO ] [MAIN ] Derivative Progress: 1755/2052 symbols. TBI took 0.4s. Estimated remaining time: 1m 57s [2025-10-22T23:38:19.362516] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:19.370896] [DEBUG] [LOCAL ] TBN: Loaded 4034 existing records from primary storage. [2025-10-22T23:38:19.371015] [INFO ] [MAIN ] TBN: Loaded 4034 primary data records. [2025-10-22T23:38:19.675729] [DEBUG] [MAIN ] TBN: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:38:19.702055] [INFO ] [MAIN ] TBN: Generated 138 derivative records from 4034 primary records. [2025-10-22T23:38:19.702241] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-22T23:38:19.711717] [DEBUG] [LOCAL ] TBN: Derivative data saved (138 records). [2025-10-22T23:38:19.711801] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-22T23:38:19.714067] [INFO ] [MAIN ] Derivative Progress: 1756/2052 symbols. TBN took 0.4s. Estimated remaining time: 1m 57s [2025-10-22T23:38:19.714159] [INFO ] [MAIN ] TCBX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:19.726636] [DEBUG] [LOCAL ] TCBX: Loaded 10195 existing records from primary storage. [2025-10-22T23:38:19.726782] [INFO ] [MAIN ] TCBX: Loaded 10195 primary data records. [2025-10-22T23:38:20.026703] [DEBUG] [MAIN ] TCBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:20.051953] [INFO ] [MAIN ] TCBX: Generated 138 derivative records from 10195 primary records. [2025-10-22T23:38:20.052063] [DEBUG] [LOCAL ] TCBX: Saving derivative data. [2025-10-22T23:38:20.063498] [DEBUG] [LOCAL ] TCBX: Derivative data saved (138 records). [2025-10-22T23:38:20.063580] [INFO ] [MAIN ] TCBX: Successfully saved derivative data. [2025-10-22T23:38:20.065730] [INFO ] [MAIN ] Derivative Progress: 1757/2052 symbols. TCBX took 0.4s. Estimated remaining time: 1m 56s [2025-10-22T23:38:20.065828] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:20.116780] [DEBUG] [LOCAL ] TD: Loaded 52240 existing records from primary storage. [2025-10-22T23:38:20.116941] [INFO ] [MAIN ] TD: Loaded 52240 primary data records. [2025-10-22T23:38:20.442053] [DEBUG] [MAIN ] TD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:20.467103] [INFO ] [MAIN ] TD: Generated 138 derivative records from 52240 primary records. [2025-10-22T23:38:20.467211] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-22T23:38:20.478760] [DEBUG] [LOCAL ] TD: Derivative data saved (138 records). [2025-10-22T23:38:20.478839] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-22T23:38:20.481907] [INFO ] [MAIN ] Derivative Progress: 1758/2052 symbols. TD took 0.4s. Estimated remaining time: 1m 56s [2025-10-22T23:38:20.482013] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:20.526151] [DEBUG] [LOCAL ] TDC: Loaded 46401 existing records from primary storage. [2025-10-22T23:38:20.526315] [INFO ] [MAIN ] TDC: Loaded 46401 primary data records. [2025-10-22T23:38:20.830920] [DEBUG] [MAIN ] TDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:20.859336] [INFO ] [MAIN ] TDC: Generated 138 derivative records from 46401 primary records. [2025-10-22T23:38:20.859541] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-22T23:38:20.871209] [DEBUG] [LOCAL ] TDC: Derivative data saved (138 records). [2025-10-22T23:38:20.871291] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-22T23:38:20.874172] [INFO ] [MAIN ] Derivative Progress: 1759/2052 symbols. TDC took 0.4s. Estimated remaining time: 1m 55s [2025-10-22T23:38:20.874269] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:20.884626] [DEBUG] [LOCAL ] TDF: Loaded 6197 existing records from primary storage. [2025-10-22T23:38:20.884769] [INFO ] [MAIN ] TDF: Loaded 6197 primary data records. [2025-10-22T23:38:21.186522] [DEBUG] [MAIN ] TDF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:21.211547] [INFO ] [MAIN ] TDF: Generated 138 derivative records from 6197 primary records. [2025-10-22T23:38:21.211700] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-22T23:38:21.222059] [DEBUG] [LOCAL ] TDF: Derivative data saved (138 records). [2025-10-22T23:38:21.222139] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-22T23:38:21.224171] [INFO ] [MAIN ] Derivative Progress: 1760/2052 symbols. TDF took 0.3s. Estimated remaining time: 1m 55s [2025-10-22T23:38:21.224269] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:21.247544] [DEBUG] [LOCAL ] TDG: Loaded 21943 existing records from primary storage. [2025-10-22T23:38:21.247718] [INFO ] [MAIN ] TDG: Loaded 21943 primary data records. [2025-10-22T23:38:21.552200] [DEBUG] [MAIN ] TDG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:21.577842] [INFO ] [MAIN ] TDG: Generated 138 derivative records from 21943 primary records. [2025-10-22T23:38:21.577987] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-22T23:38:21.589987] [DEBUG] [LOCAL ] TDG: Derivative data saved (138 records). [2025-10-22T23:38:21.590078] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-22T23:38:21.592842] [INFO ] [MAIN ] Derivative Progress: 1761/2052 symbols. TDG took 0.4s. Estimated remaining time: 1m 55s [2025-10-22T23:38:21.592941] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:21.645124] [DEBUG] [LOCAL ] TDOC: Loaded 53369 existing records from primary storage. [2025-10-22T23:38:21.645281] [INFO ] [MAIN ] TDOC: Loaded 53369 primary data records. [2025-10-22T23:38:21.952997] [DEBUG] [MAIN ] TDOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:21.978048] [INFO ] [MAIN ] TDOC: Generated 138 derivative records from 53369 primary records. [2025-10-22T23:38:21.978208] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-22T23:38:21.989456] [DEBUG] [LOCAL ] TDOC: Derivative data saved (138 records). [2025-10-22T23:38:21.989534] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-10-22T23:38:21.992524] [INFO ] [MAIN ] Derivative Progress: 1762/2052 symbols. TDOC took 0.4s. Estimated remaining time: 1m 54s [2025-10-22T23:38:21.992617] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:22.033760] [DEBUG] [LOCAL ] TDS: Loaded 42187 existing records from primary storage. [2025-10-22T23:38:22.033929] [INFO ] [MAIN ] TDS: Loaded 42187 primary data records. [2025-10-22T23:38:22.372308] [DEBUG] [MAIN ] TDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:22.397957] [INFO ] [MAIN ] TDS: Generated 138 derivative records from 42187 primary records. [2025-10-22T23:38:22.398157] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-22T23:38:22.410028] [DEBUG] [LOCAL ] TDS: Derivative data saved (138 records). [2025-10-22T23:38:22.410108] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-22T23:38:22.413040] [INFO ] [MAIN ] Derivative Progress: 1763/2052 symbols. TDS took 0.4s. Estimated remaining time: 1m 54s [2025-10-22T23:38:22.413148] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:22.456830] [DEBUG] [LOCAL ] TDW: Loaded 44907 existing records from primary storage. [2025-10-22T23:38:22.456989] [INFO ] [MAIN ] TDW: Loaded 44907 primary data records. [2025-10-22T23:38:22.761320] [DEBUG] [MAIN ] TDW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:22.786882] [INFO ] [MAIN ] TDW: Generated 138 derivative records from 44907 primary records. [2025-10-22T23:38:22.787068] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-22T23:38:22.798512] [DEBUG] [LOCAL ] TDW: Derivative data saved (138 records). [2025-10-22T23:38:22.798609] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-22T23:38:22.801473] [INFO ] [MAIN ] Derivative Progress: 1764/2052 symbols. TDW took 0.4s. Estimated remaining time: 1m 53s [2025-10-22T23:38:22.801574] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:22.825259] [DEBUG] [LOCAL ] TDY: Loaded 22146 existing records from primary storage. [2025-10-22T23:38:22.825421] [INFO ] [MAIN ] TDY: Loaded 22146 primary data records. [2025-10-22T23:38:23.129780] [DEBUG] [MAIN ] TDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:23.154547] [INFO ] [MAIN ] TDY: Generated 138 derivative records from 22146 primary records. [2025-10-22T23:38:23.154677] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-22T23:38:23.166132] [DEBUG] [LOCAL ] TDY: Derivative data saved (138 records). [2025-10-22T23:38:23.166212] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-22T23:38:23.168862] [INFO ] [MAIN ] Derivative Progress: 1765/2052 symbols. TDY took 0.4s. Estimated remaining time: 1m 53s [2025-10-22T23:38:23.168958] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:23.180304] [DEBUG] [LOCAL ] TEAF: Loaded 7331 existing records from primary storage. [2025-10-22T23:38:23.180419] [INFO ] [MAIN ] TEAF: Loaded 7331 primary data records. [2025-10-22T23:38:23.484311] [DEBUG] [MAIN ] TEAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:23.513327] [INFO ] [MAIN ] TEAF: Generated 138 derivative records from 7331 primary records. [2025-10-22T23:38:23.513497] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-22T23:38:23.524522] [DEBUG] [LOCAL ] TEAF: Derivative data saved (138 records). [2025-10-22T23:38:23.524605] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-22T23:38:23.526669] [INFO ] [MAIN ] Derivative Progress: 1766/2052 symbols. TEAF took 0.4s. Estimated remaining time: 1m 53s [2025-10-22T23:38:23.526760] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:23.579932] [DEBUG] [LOCAL ] TECK: Loaded 53435 existing records from primary storage. [2025-10-22T23:38:23.580096] [INFO ] [MAIN ] TECK: Loaded 53435 primary data records. [2025-10-22T23:38:23.900584] [DEBUG] [MAIN ] TECK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:23.926603] [INFO ] [MAIN ] TECK: Generated 138 derivative records from 53435 primary records. [2025-10-22T23:38:23.926809] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-22T23:38:23.938453] [DEBUG] [LOCAL ] TECK: Derivative data saved (138 records). [2025-10-22T23:38:23.938592] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-22T23:38:23.941888] [INFO ] [MAIN ] Derivative Progress: 1767/2052 symbols. TECK took 0.4s. Estimated remaining time: 1m 52s [2025-10-22T23:38:23.942027] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:23.984077] [DEBUG] [LOCAL ] TEF: Loaded 36800 existing records from primary storage. [2025-10-22T23:38:23.984275] [INFO ] [MAIN ] TEF: Loaded 36800 primary data records. [2025-10-22T23:38:24.350393] [DEBUG] [MAIN ] TEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:24.377909] [INFO ] [MAIN ] TEF: Generated 138 derivative records from 36800 primary records. [2025-10-22T23:38:24.378131] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-22T23:38:24.389824] [DEBUG] [LOCAL ] TEF: Derivative data saved (138 records). [2025-10-22T23:38:24.389983] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-22T23:38:24.392961] [INFO ] [MAIN ] Derivative Progress: 1768/2052 symbols. TEF took 0.5s. Estimated remaining time: 1m 52s [2025-10-22T23:38:24.393133] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:24.415721] [DEBUG] [LOCAL ] TEI: Loaded 21181 existing records from primary storage. [2025-10-22T23:38:24.415882] [INFO ] [MAIN ] TEI: Loaded 21181 primary data records. [2025-10-22T23:38:24.737108] [DEBUG] [MAIN ] TEI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:38:24.763210] [INFO ] [MAIN ] TEI: Generated 138 derivative records from 21181 primary records. [2025-10-22T23:38:24.763334] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-22T23:38:24.774300] [DEBUG] [LOCAL ] TEI: Derivative data saved (138 records). [2025-10-22T23:38:24.774379] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-22T23:38:24.777106] [INFO ] [MAIN ] Derivative Progress: 1769/2052 symbols. TEI took 0.4s. Estimated remaining time: 1m 51s [2025-10-22T23:38:24.777211] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:24.830430] [DEBUG] [LOCAL ] TEL: Loaded 51046 existing records from primary storage. [2025-10-22T23:38:24.830599] [INFO ] [MAIN ] TEL: Loaded 51046 primary data records. [2025-10-22T23:38:25.154609] [DEBUG] [MAIN ] TEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:25.180222] [INFO ] [MAIN ] TEL: Generated 138 derivative records from 51046 primary records. [2025-10-22T23:38:25.180359] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-22T23:38:25.192177] [DEBUG] [LOCAL ] TEL: Derivative data saved (138 records). [2025-10-22T23:38:25.192264] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-22T23:38:25.195302] [INFO ] [MAIN ] Derivative Progress: 1770/2052 symbols. TEL took 0.4s. Estimated remaining time: 1m 51s [2025-10-22T23:38:25.195400] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:25.227264] [DEBUG] [LOCAL ] TEN: Loaded 30257 existing records from primary storage. [2025-10-22T23:38:25.227428] [INFO ] [MAIN ] TEN: Loaded 30257 primary data records. [2025-10-22T23:38:25.536240] [DEBUG] [MAIN ] TEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:25.561237] [INFO ] [MAIN ] TEN: Generated 138 derivative records from 30257 primary records. [2025-10-22T23:38:25.561370] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-22T23:38:25.572920] [DEBUG] [LOCAL ] TEN: Derivative data saved (138 records). [2025-10-22T23:38:25.573009] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-22T23:38:25.575775] [INFO ] [MAIN ] Derivative Progress: 1771/2052 symbols. TEN took 0.4s. Estimated remaining time: 1m 51s [2025-10-22T23:38:25.575876] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:25.598859] [DEBUG] [LOCAL ] TEO: Loaded 22745 existing records from primary storage. [2025-10-22T23:38:25.599004] [INFO ] [MAIN ] TEO: Loaded 22745 primary data records. [2025-10-22T23:38:25.904089] [DEBUG] [MAIN ] TEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:25.929307] [INFO ] [MAIN ] TEO: Generated 138 derivative records from 22745 primary records. [2025-10-22T23:38:25.929478] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-22T23:38:25.940719] [DEBUG] [LOCAL ] TEO: Derivative data saved (138 records). [2025-10-22T23:38:25.940813] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-22T23:38:25.943524] [INFO ] [MAIN ] Derivative Progress: 1772/2052 symbols. TEO took 0.4s. Estimated remaining time: 1m 50s [2025-10-22T23:38:25.943627] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:25.999396] [DEBUG] [LOCAL ] TEVA: Loaded 53622 existing records from primary storage. [2025-10-22T23:38:25.999566] [INFO ] [MAIN ] TEVA: Loaded 53622 primary data records. [2025-10-22T23:38:26.307595] [DEBUG] [MAIN ] TEVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:26.332490] [INFO ] [MAIN ] TEVA: Generated 138 derivative records from 53622 primary records. [2025-10-22T23:38:26.332672] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-10-22T23:38:26.344262] [DEBUG] [LOCAL ] TEVA: Derivative data saved (138 records). [2025-10-22T23:38:26.344346] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-10-22T23:38:26.347422] [INFO ] [MAIN ] Derivative Progress: 1773/2052 symbols. TEVA took 0.4s. Estimated remaining time: 1m 50s [2025-10-22T23:38:26.347523] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:26.389923] [DEBUG] [LOCAL ] TEX: Loaded 43477 existing records from primary storage. [2025-10-22T23:38:26.390082] [INFO ] [MAIN ] TEX: Loaded 43477 primary data records. [2025-10-22T23:38:26.718626] [DEBUG] [MAIN ] TEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:26.743802] [INFO ] [MAIN ] TEX: Generated 138 derivative records from 43477 primary records. [2025-10-22T23:38:26.743923] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-22T23:38:26.755992] [DEBUG] [LOCAL ] TEX: Derivative data saved (138 records). [2025-10-22T23:38:26.756079] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-22T23:38:26.759070] [INFO ] [MAIN ] Derivative Progress: 1774/2052 symbols. TEX took 0.4s. Estimated remaining time: 1m 49s [2025-10-22T23:38:26.759163] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:26.812333] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-22T23:38:26.812500] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-10-22T23:38:27.117061] [DEBUG] [MAIN ] TFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:27.142289] [INFO ] [MAIN ] TFC: Generated 138 derivative records from 53667 primary records. [2025-10-22T23:38:27.142407] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-22T23:38:27.153898] [DEBUG] [LOCAL ] TFC: Derivative data saved (138 records). [2025-10-22T23:38:27.153980] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-10-22T23:38:27.157006] [INFO ] [MAIN ] Derivative Progress: 1775/2052 symbols. TFC took 0.4s. Estimated remaining time: 1m 49s [2025-10-22T23:38:27.157109] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:27.190400] [DEBUG] [LOCAL ] TFII: Loaded 32251 existing records from primary storage. [2025-10-22T23:38:27.190557] [INFO ] [MAIN ] TFII: Loaded 32251 primary data records. [2025-10-22T23:38:27.501157] [DEBUG] [MAIN ] TFII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:27.526327] [INFO ] [MAIN ] TFII: Generated 138 derivative records from 32251 primary records. [2025-10-22T23:38:27.526435] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-22T23:38:27.537850] [DEBUG] [LOCAL ] TFII: Derivative data saved (138 records). [2025-10-22T23:38:27.537931] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-22T23:38:27.540816] [INFO ] [MAIN ] Derivative Progress: 1776/2052 symbols. TFII took 0.4s. Estimated remaining time: 1m 49s [2025-10-22T23:38:27.540915] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:27.565459] [DEBUG] [LOCAL ] TFIN: Loaded 23665 existing records from primary storage. [2025-10-22T23:38:27.565600] [INFO ] [MAIN ] TFIN: Loaded 23665 primary data records. [2025-10-22T23:38:27.872126] [DEBUG] [MAIN ] TFIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:27.897766] [INFO ] [MAIN ] TFIN: Generated 138 derivative records from 23665 primary records. [2025-10-22T23:38:27.897905] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-22T23:38:27.909538] [DEBUG] [LOCAL ] TFIN: Derivative data saved (138 records). [2025-10-22T23:38:27.909663] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-22T23:38:27.912436] [INFO ] [MAIN ] Derivative Progress: 1777/2052 symbols. TFIN took 0.4s. Estimated remaining time: 1m 48s [2025-10-22T23:38:27.912527] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:27.953010] [DEBUG] [LOCAL ] TFPM: Loaded 39860 existing records from primary storage. [2025-10-22T23:38:27.953172] [INFO ] [MAIN ] TFPM: Loaded 39860 primary data records. [2025-10-22T23:38:28.267194] [DEBUG] [MAIN ] TFPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:28.292186] [INFO ] [MAIN ] TFPM: Generated 138 derivative records from 39860 primary records. [2025-10-22T23:38:28.292289] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-22T23:38:28.303922] [DEBUG] [LOCAL ] TFPM: Derivative data saved (138 records). [2025-10-22T23:38:28.304005] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-22T23:38:28.307519] [INFO ] [MAIN ] Derivative Progress: 1778/2052 symbols. TFPM took 0.4s. Estimated remaining time: 1m 48s [2025-10-22T23:38:28.307626] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:28.345063] [DEBUG] [LOCAL ] TFX: Loaded 35633 existing records from primary storage. [2025-10-22T23:38:28.345221] [INFO ] [MAIN ] TFX: Loaded 35633 primary data records. [2025-10-22T23:38:28.679354] [DEBUG] [MAIN ] TFX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:28.704724] [INFO ] [MAIN ] TFX: Generated 138 derivative records from 35633 primary records. [2025-10-22T23:38:28.704845] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-22T23:38:28.716426] [DEBUG] [LOCAL ] TFX: Derivative data saved (138 records). [2025-10-22T23:38:28.716512] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-22T23:38:28.719754] [INFO ] [MAIN ] Derivative Progress: 1779/2052 symbols. TFX took 0.4s. Estimated remaining time: 1m 47s [2025-10-22T23:38:28.719848] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:28.733866] [DEBUG] [LOCAL ] TG: Loaded 10631 existing records from primary storage. [2025-10-22T23:38:28.734010] [INFO ] [MAIN ] TG: Loaded 10631 primary data records. [2025-10-22T23:38:29.054060] [DEBUG] [MAIN ] TG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:29.079953] [INFO ] [MAIN ] TG: Generated 138 derivative records from 10631 primary records. [2025-10-22T23:38:29.080097] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-22T23:38:29.091594] [DEBUG] [LOCAL ] TG: Derivative data saved (138 records). [2025-10-22T23:38:29.091706] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-22T23:38:29.093928] [INFO ] [MAIN ] Derivative Progress: 1780/2052 symbols. TG took 0.4s. Estimated remaining time: 1m 47s [2025-10-22T23:38:29.094024] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:29.122314] [DEBUG] [LOCAL ] TGLS: Loaded 27643 existing records from primary storage. [2025-10-22T23:38:29.122469] [INFO ] [MAIN ] TGLS: Loaded 27643 primary data records. [2025-10-22T23:38:29.433405] [DEBUG] [MAIN ] TGLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:29.458720] [INFO ] [MAIN ] TGLS: Generated 138 derivative records from 27643 primary records. [2025-10-22T23:38:29.458880] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-22T23:38:29.470399] [DEBUG] [LOCAL ] TGLS: Derivative data saved (138 records). [2025-10-22T23:38:29.470492] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-22T23:38:29.473439] [INFO ] [MAIN ] Derivative Progress: 1781/2052 symbols. TGLS took 0.4s. Estimated remaining time: 1m 47s [2025-10-22T23:38:29.473574] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:29.522156] [DEBUG] [LOCAL ] TGNA: Loaded 48517 existing records from primary storage. [2025-10-22T23:38:29.522326] [INFO ] [MAIN ] TGNA: Loaded 48517 primary data records. [2025-10-22T23:38:29.893024] [DEBUG] [MAIN ] TGNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:29.920229] [INFO ] [MAIN ] TGNA: Generated 138 derivative records from 48517 primary records. [2025-10-22T23:38:29.920475] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-22T23:38:29.932583] [DEBUG] [LOCAL ] TGNA: Derivative data saved (138 records). [2025-10-22T23:38:29.932743] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-22T23:38:29.936926] [INFO ] [MAIN ] Derivative Progress: 1782/2052 symbols. TGNA took 0.5s. Estimated remaining time: 1m 46s [2025-10-22T23:38:29.937049] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:29.974081] [DEBUG] [LOCAL ] TGS: Loaded 33787 existing records from primary storage. [2025-10-22T23:38:29.974315] [INFO ] [MAIN ] TGS: Loaded 33787 primary data records. [2025-10-22T23:38:30.298043] [DEBUG] [MAIN ] TGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:30.325729] [INFO ] [MAIN ] TGS: Generated 138 derivative records from 33787 primary records. [2025-10-22T23:38:30.326020] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-22T23:38:30.339009] [DEBUG] [LOCAL ] TGS: Derivative data saved (138 records). [2025-10-22T23:38:30.339167] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-22T23:38:30.343574] [INFO ] [MAIN ] Derivative Progress: 1783/2052 symbols. TGS took 0.4s. Estimated remaining time: 1m 46s [2025-10-22T23:38:30.343746] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:30.408178] [DEBUG] [LOCAL ] TGT: Loaded 53777 existing records from primary storage. [2025-10-22T23:38:30.408457] [INFO ] [MAIN ] TGT: Loaded 53777 primary data records. [2025-10-22T23:38:30.804983] [DEBUG] [MAIN ] TGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:30.840271] [INFO ] [MAIN ] TGT: Generated 138 derivative records from 53777 primary records. [2025-10-22T23:38:30.840597] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-22T23:38:30.860552] [DEBUG] [LOCAL ] TGT: Derivative data saved (138 records). [2025-10-22T23:38:30.860859] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-22T23:38:30.866322] [INFO ] [MAIN ] Derivative Progress: 1784/2052 symbols. TGT took 0.5s. Estimated remaining time: 1m 46s [2025-10-22T23:38:30.866705] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:30.940481] [DEBUG] [LOCAL ] THC: Loaded 46634 existing records from primary storage. [2025-10-22T23:38:30.940756] [INFO ] [MAIN ] THC: Loaded 46634 primary data records. [2025-10-22T23:38:31.283294] [DEBUG] [MAIN ] THC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:31.314615] [INFO ] [MAIN ] THC: Generated 138 derivative records from 46634 primary records. [2025-10-22T23:38:31.314894] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-22T23:38:31.327359] [DEBUG] [LOCAL ] THC: Derivative data saved (138 records). [2025-10-22T23:38:31.327461] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-22T23:38:31.331445] [INFO ] [MAIN ] Derivative Progress: 1785/2052 symbols. THC took 0.5s. Estimated remaining time: 1m 45s [2025-10-22T23:38:31.331566] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:31.357406] [DEBUG] [LOCAL ] THG: Loaded 21455 existing records from primary storage. [2025-10-22T23:38:31.357614] [INFO ] [MAIN ] THG: Loaded 21455 primary data records. [2025-10-22T23:38:31.698535] [DEBUG] [MAIN ] THG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:31.728389] [INFO ] [MAIN ] THG: Generated 138 derivative records from 21455 primary records. [2025-10-22T23:38:31.728667] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-22T23:38:31.741217] [DEBUG] [LOCAL ] THG: Derivative data saved (138 records). [2025-10-22T23:38:31.741354] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-22T23:38:31.745425] [INFO ] [MAIN ] Derivative Progress: 1786/2052 symbols. THG took 0.4s. Estimated remaining time: 1m 45s [2025-10-22T23:38:31.745537] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:31.751581] [DEBUG] [LOCAL ] THIR: Loaded 2461 existing records from primary storage. [2025-10-22T23:38:31.751737] [INFO ] [MAIN ] THIR: Loaded 2461 primary data records. [2025-10-22T23:38:32.101023] [DEBUG] [MAIN ] THIR: Filtered 6931 bins outside market hours, 7727 incomplete bins [2025-10-22T23:38:32.128726] [INFO ] [MAIN ] THIR: Generated 138 derivative records from 2461 primary records. [2025-10-22T23:38:32.128953] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-22T23:38:32.139505] [DEBUG] [LOCAL ] THIR: Derivative data saved (138 records). [2025-10-22T23:38:32.139713] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-22T23:38:32.143083] [INFO ] [MAIN ] Derivative Progress: 1787/2052 symbols. THIR took 0.4s. Estimated remaining time: 1m 44s [2025-10-22T23:38:32.143192] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:32.147926] [DEBUG] [LOCAL ] THLV: Loaded 1491 existing records from primary storage. [2025-10-22T23:38:32.148023] [INFO ] [MAIN ] THLV: Loaded 1491 primary data records. [2025-10-22T23:38:32.467754] [DEBUG] [MAIN ] THLV: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-10-22T23:38:32.495945] [INFO ] [MAIN ] THLV: Generated 138 derivative records from 1491 primary records. [2025-10-22T23:38:32.496163] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-22T23:38:32.505561] [DEBUG] [LOCAL ] THLV: Derivative data saved (138 records). [2025-10-22T23:38:32.505686] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-22T23:38:32.508914] [INFO ] [MAIN ] Derivative Progress: 1788/2052 symbols. THLV took 0.4s. Estimated remaining time: 1m 44s [2025-10-22T23:38:32.509032] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:32.557612] [DEBUG] [LOCAL ] THO: Loaded 41016 existing records from primary storage. [2025-10-22T23:38:32.557863] [INFO ] [MAIN ] THO: Loaded 41016 primary data records. [2025-10-22T23:38:32.900477] [DEBUG] [MAIN ] THO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:32.927114] [INFO ] [MAIN ] THO: Generated 138 derivative records from 41016 primary records. [2025-10-22T23:38:32.927317] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-22T23:38:32.939413] [DEBUG] [LOCAL ] THO: Derivative data saved (138 records). [2025-10-22T23:38:32.939512] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-22T23:38:32.943931] [INFO ] [MAIN ] Derivative Progress: 1789/2052 symbols. THO took 0.4s. Estimated remaining time: 1m 44s [2025-10-22T23:38:32.944066] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:32.974419] [DEBUG] [LOCAL ] THQ: Loaded 25335 existing records from primary storage. [2025-10-22T23:38:32.974627] [INFO ] [MAIN ] THQ: Loaded 25335 primary data records. [2025-10-22T23:38:33.338559] [DEBUG] [MAIN ] THQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:33.366269] [INFO ] [MAIN ] THQ: Generated 138 derivative records from 25335 primary records. [2025-10-22T23:38:33.366471] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-22T23:38:33.378761] [DEBUG] [LOCAL ] THQ: Derivative data saved (138 records). [2025-10-22T23:38:33.378939] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-22T23:38:33.381993] [INFO ] [MAIN ] Derivative Progress: 1790/2052 symbols. THQ took 0.4s. Estimated remaining time: 1m 43s [2025-10-22T23:38:33.382134] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:33.404905] [DEBUG] [LOCAL ] THR: Loaded 19563 existing records from primary storage. [2025-10-22T23:38:33.405082] [INFO ] [MAIN ] THR: Loaded 19563 primary data records. [2025-10-22T23:38:33.739061] [DEBUG] [MAIN ] THR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:33.766965] [INFO ] [MAIN ] THR: Generated 138 derivative records from 19563 primary records. [2025-10-22T23:38:33.767134] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-22T23:38:33.779494] [DEBUG] [LOCAL ] THR: Derivative data saved (138 records). [2025-10-22T23:38:33.779599] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-10-22T23:38:33.783127] [INFO ] [MAIN ] Derivative Progress: 1791/2052 symbols. THR took 0.4s. Estimated remaining time: 1m 43s [2025-10-22T23:38:33.783272] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:33.823940] [DEBUG] [LOCAL ] THS: Loaded 38681 existing records from primary storage. [2025-10-22T23:38:33.824109] [INFO ] [MAIN ] THS: Loaded 38681 primary data records. [2025-10-22T23:38:34.153941] [DEBUG] [MAIN ] THS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:34.179696] [INFO ] [MAIN ] THS: Generated 138 derivative records from 38681 primary records. [2025-10-22T23:38:34.179864] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-22T23:38:34.191918] [DEBUG] [LOCAL ] THS: Derivative data saved (138 records). [2025-10-22T23:38:34.192018] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-22T23:38:34.195591] [INFO ] [MAIN ] Derivative Progress: 1792/2052 symbols. THS took 0.4s. Estimated remaining time: 1m 42s [2025-10-22T23:38:34.195732] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:34.218380] [DEBUG] [LOCAL ] THW: Loaded 19592 existing records from primary storage. [2025-10-22T23:38:34.218545] [INFO ] [MAIN ] THW: Loaded 19592 primary data records. [2025-10-22T23:38:34.551075] [DEBUG] [MAIN ] THW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:34.579893] [INFO ] [MAIN ] THW: Generated 138 derivative records from 19592 primary records. [2025-10-22T23:38:34.580108] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-22T23:38:34.592460] [DEBUG] [LOCAL ] THW: Derivative data saved (138 records). [2025-10-22T23:38:34.592631] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-22T23:38:34.595857] [INFO ] [MAIN ] Derivative Progress: 1793/2052 symbols. THW took 0.4s. Estimated remaining time: 1m 42s [2025-10-22T23:38:34.596049] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:34.635092] [DEBUG] [LOCAL ] TIMB: Loaded 34700 existing records from primary storage. [2025-10-22T23:38:34.635265] [INFO ] [MAIN ] TIMB: Loaded 34700 primary data records. [2025-10-22T23:38:34.973688] [DEBUG] [MAIN ] TIMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:35.000071] [INFO ] [MAIN ] TIMB: Generated 138 derivative records from 34700 primary records. [2025-10-22T23:38:35.000240] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-22T23:38:35.012943] [DEBUG] [LOCAL ] TIMB: Derivative data saved (138 records). [2025-10-22T23:38:35.013042] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-22T23:38:35.016146] [INFO ] [MAIN ] Derivative Progress: 1794/2052 symbols. TIMB took 0.4s. Estimated remaining time: 1m 42s [2025-10-22T23:38:35.016247] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:35.022087] [DEBUG] [LOCAL ] TISI: Loaded 3153 existing records from primary storage. [2025-10-22T23:38:35.022187] [INFO ] [MAIN ] TISI: Loaded 3153 primary data records. [2025-10-22T23:38:35.377579] [DEBUG] [MAIN ] TISI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:35.403154] [INFO ] [MAIN ] TISI: Generated 138 derivative records from 3153 primary records. [2025-10-22T23:38:35.403321] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-22T23:38:35.412852] [DEBUG] [LOCAL ] TISI: Derivative data saved (138 records). [2025-10-22T23:38:35.412933] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-22T23:38:35.415241] [INFO ] [MAIN ] Derivative Progress: 1795/2052 symbols. TISI took 0.4s. Estimated remaining time: 1m 41s [2025-10-22T23:38:35.415346] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:35.448985] [DEBUG] [LOCAL ] TIXT: Loaded 32607 existing records from primary storage. [2025-10-22T23:38:35.449163] [INFO ] [MAIN ] TIXT: Loaded 32607 primary data records. [2025-10-22T23:38:35.753939] [DEBUG] [MAIN ] TIXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:35.779589] [INFO ] [MAIN ] TIXT: Generated 138 derivative records from 32607 primary records. [2025-10-22T23:38:35.779710] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-22T23:38:35.790639] [DEBUG] [LOCAL ] TIXT: Derivative data saved (138 records). [2025-10-22T23:38:35.790740] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-22T23:38:35.793924] [INFO ] [MAIN ] Derivative Progress: 1796/2052 symbols. TIXT took 0.4s. Estimated remaining time: 1m 41s [2025-10-22T23:38:35.794023] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:35.850137] [DEBUG] [LOCAL ] TJX: Loaded 53661 existing records from primary storage. [2025-10-22T23:38:35.850299] [INFO ] [MAIN ] TJX: Loaded 53661 primary data records. [2025-10-22T23:38:36.157215] [DEBUG] [MAIN ] TJX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:36.182246] [INFO ] [MAIN ] TJX: Generated 138 derivative records from 53661 primary records. [2025-10-22T23:38:36.182361] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-22T23:38:36.194096] [DEBUG] [LOCAL ] TJX: Derivative data saved (138 records). [2025-10-22T23:38:36.194174] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-10-22T23:38:36.197218] [INFO ] [MAIN ] Derivative Progress: 1797/2052 symbols. TJX took 0.4s. Estimated remaining time: 1m 40s [2025-10-22T23:38:36.197335] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:36.235427] [DEBUG] [LOCAL ] TKC: Loaded 40053 existing records from primary storage. [2025-10-22T23:38:36.235584] [INFO ] [MAIN ] TKC: Loaded 40053 primary data records. [2025-10-22T23:38:36.538755] [DEBUG] [MAIN ] TKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:36.563688] [INFO ] [MAIN ] TKC: Generated 138 derivative records from 40053 primary records. [2025-10-22T23:38:36.563799] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-22T23:38:36.574772] [DEBUG] [LOCAL ] TKC: Derivative data saved (138 records). [2025-10-22T23:38:36.574851] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-22T23:38:36.577780] [INFO ] [MAIN ] Derivative Progress: 1798/2052 symbols. TKC took 0.4s. Estimated remaining time: 1m 40s [2025-10-22T23:38:36.577873] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:36.620445] [DEBUG] [LOCAL ] TKO: Loaded 43490 existing records from primary storage. [2025-10-22T23:38:36.620599] [INFO ] [MAIN ] TKO: Loaded 43490 primary data records. [2025-10-22T23:38:36.927200] [DEBUG] [MAIN ] TKO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:36.952362] [INFO ] [MAIN ] TKO: Generated 138 derivative records from 43490 primary records. [2025-10-22T23:38:36.952467] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-10-22T23:38:36.964080] [DEBUG] [LOCAL ] TKO: Derivative data saved (138 records). [2025-10-22T23:38:36.964159] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-10-22T23:38:36.967151] [INFO ] [MAIN ] Derivative Progress: 1799/2052 symbols. TKO took 0.4s. Estimated remaining time: 1m 40s [2025-10-22T23:38:36.967274] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:37.005960] [DEBUG] [LOCAL ] TKR: Loaded 39247 existing records from primary storage. [2025-10-22T23:38:37.006114] [INFO ] [MAIN ] TKR: Loaded 39247 primary data records. [2025-10-22T23:38:37.334015] [DEBUG] [MAIN ] TKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:37.359132] [INFO ] [MAIN ] TKR: Generated 138 derivative records from 39247 primary records. [2025-10-22T23:38:37.359282] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-22T23:38:37.370612] [DEBUG] [LOCAL ] TKR: Derivative data saved (138 records). [2025-10-22T23:38:37.370708] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-10-22T23:38:37.373808] [INFO ] [MAIN ] Derivative Progress: 1800/2052 symbols. TKR took 0.4s. Estimated remaining time: 1m 39s [2025-10-22T23:38:37.373904] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:37.412756] [DEBUG] [LOCAL ] TLK: Loaded 38709 existing records from primary storage. [2025-10-22T23:38:37.412931] [INFO ] [MAIN ] TLK: Loaded 38709 primary data records. [2025-10-22T23:38:37.721569] [DEBUG] [MAIN ] TLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:37.746508] [INFO ] [MAIN ] TLK: Generated 138 derivative records from 38709 primary records. [2025-10-22T23:38:37.746628] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-22T23:38:37.758077] [DEBUG] [LOCAL ] TLK: Derivative data saved (138 records). [2025-10-22T23:38:37.758155] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-22T23:38:37.761045] [INFO ] [MAIN ] Derivative Progress: 1801/2052 symbols. TLK took 0.4s. Estimated remaining time: 1m 39s [2025-10-22T23:38:37.761133] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:37.780337] [DEBUG] [LOCAL ] TLYS: Loaded 16539 existing records from primary storage. [2025-10-22T23:38:37.780465] [INFO ] [MAIN ] TLYS: Loaded 16539 primary data records. [2025-10-22T23:38:38.082498] [DEBUG] [MAIN ] TLYS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:38.107413] [INFO ] [MAIN ] TLYS: Generated 138 derivative records from 16539 primary records. [2025-10-22T23:38:38.107542] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-22T23:38:38.118500] [DEBUG] [LOCAL ] TLYS: Derivative data saved (138 records). [2025-10-22T23:38:38.118579] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-22T23:38:38.121344] [INFO ] [MAIN ] Derivative Progress: 1802/2052 symbols. TLYS took 0.4s. Estimated remaining time: 1m 38s [2025-10-22T23:38:38.121438] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:38.158755] [DEBUG] [LOCAL ] TM: Loaded 36037 existing records from primary storage. [2025-10-22T23:38:38.158913] [INFO ] [MAIN ] TM: Loaded 36037 primary data records. [2025-10-22T23:38:38.468743] [DEBUG] [MAIN ] TM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:38.493831] [INFO ] [MAIN ] TM: Generated 138 derivative records from 36037 primary records. [2025-10-22T23:38:38.493940] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-22T23:38:38.505614] [DEBUG] [LOCAL ] TM: Derivative data saved (138 records). [2025-10-22T23:38:38.505715] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-22T23:38:38.508691] [INFO ] [MAIN ] Derivative Progress: 1803/2052 symbols. TM took 0.4s. Estimated remaining time: 1m 38s [2025-10-22T23:38:38.508787] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:38.563689] [DEBUG] [LOCAL ] TME: Loaded 53197 existing records from primary storage. [2025-10-22T23:38:38.563851] [INFO ] [MAIN ] TME: Loaded 53197 primary data records. [2025-10-22T23:38:38.888822] [DEBUG] [MAIN ] TME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:38.913831] [INFO ] [MAIN ] TME: Generated 138 derivative records from 53197 primary records. [2025-10-22T23:38:38.913969] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-22T23:38:38.925558] [DEBUG] [LOCAL ] TME: Derivative data saved (138 records). [2025-10-22T23:38:38.925660] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-22T23:38:38.928798] [INFO ] [MAIN ] Derivative Progress: 1804/2052 symbols. TME took 0.4s. Estimated remaining time: 1m 38s [2025-10-22T23:38:38.928920] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:38.971169] [DEBUG] [LOCAL ] TMHC: Loaded 45657 existing records from primary storage. [2025-10-22T23:38:38.971330] [INFO ] [MAIN ] TMHC: Loaded 45657 primary data records. [2025-10-22T23:38:39.312516] [DEBUG] [MAIN ] TMHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:39.338314] [INFO ] [MAIN ] TMHC: Generated 138 derivative records from 45657 primary records. [2025-10-22T23:38:39.338494] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-22T23:38:39.350077] [DEBUG] [LOCAL ] TMHC: Derivative data saved (138 records). [2025-10-22T23:38:39.350184] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-22T23:38:39.352977] [INFO ] [MAIN ] Derivative Progress: 1805/2052 symbols. TMHC took 0.4s. Estimated remaining time: 1m 37s [2025-10-22T23:38:39.353075] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:39.404463] [DEBUG] [LOCAL ] TMO: Loaded 52400 existing records from primary storage. [2025-10-22T23:38:39.404678] [INFO ] [MAIN ] TMO: Loaded 52400 primary data records. [2025-10-22T23:38:39.711606] [DEBUG] [MAIN ] TMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:39.737490] [INFO ] [MAIN ] TMO: Generated 138 derivative records from 52400 primary records. [2025-10-22T23:38:39.737704] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-22T23:38:39.749754] [DEBUG] [LOCAL ] TMO: Derivative data saved (138 records). [2025-10-22T23:38:39.749848] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-22T23:38:39.752954] [INFO ] [MAIN ] Derivative Progress: 1806/2052 symbols. TMO took 0.4s. Estimated remaining time: 1m 37s [2025-10-22T23:38:39.753051] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:39.770233] [DEBUG] [LOCAL ] TNC: Loaded 14163 existing records from primary storage. [2025-10-22T23:38:39.770379] [INFO ] [MAIN ] TNC: Loaded 14163 primary data records. [2025-10-22T23:38:40.089619] [DEBUG] [MAIN ] TNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:40.116484] [INFO ] [MAIN ] TNC: Generated 138 derivative records from 14163 primary records. [2025-10-22T23:38:40.116674] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-22T23:38:40.128751] [DEBUG] [LOCAL ] TNC: Derivative data saved (138 records). [2025-10-22T23:38:40.128845] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-22T23:38:40.131613] [INFO ] [MAIN ] Derivative Progress: 1807/2052 symbols. TNC took 0.4s. Estimated remaining time: 1m 36s [2025-10-22T23:38:40.131756] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:40.161278] [DEBUG] [LOCAL ] TNET: Loaded 28176 existing records from primary storage. [2025-10-22T23:38:40.161445] [INFO ] [MAIN ] TNET: Loaded 28176 primary data records. [2025-10-22T23:38:40.483949] [DEBUG] [MAIN ] TNET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:40.509497] [INFO ] [MAIN ] TNET: Generated 138 derivative records from 28176 primary records. [2025-10-22T23:38:40.509706] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-22T23:38:40.521416] [DEBUG] [LOCAL ] TNET: Derivative data saved (138 records). [2025-10-22T23:38:40.521505] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-22T23:38:40.524474] [INFO ] [MAIN ] Derivative Progress: 1808/2052 symbols. TNET took 0.4s. Estimated remaining time: 1m 36s [2025-10-22T23:38:40.524575] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:40.558909] [DEBUG] [LOCAL ] TNK: Loaded 35270 existing records from primary storage. [2025-10-22T23:38:40.559128] [INFO ] [MAIN ] TNK: Loaded 35270 primary data records. [2025-10-22T23:38:40.874164] [DEBUG] [MAIN ] TNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:40.899939] [INFO ] [MAIN ] TNK: Generated 138 derivative records from 35270 primary records. [2025-10-22T23:38:40.900099] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-22T23:38:40.911586] [DEBUG] [LOCAL ] TNK: Derivative data saved (138 records). [2025-10-22T23:38:40.911693] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-22T23:38:40.914594] [INFO ] [MAIN ] Derivative Progress: 1809/2052 symbols. TNK took 0.4s. Estimated remaining time: 1m 36s [2025-10-22T23:38:40.914709] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:40.953583] [DEBUG] [LOCAL ] TNL: Loaded 41725 existing records from primary storage. [2025-10-22T23:38:40.953768] [INFO ] [MAIN ] TNL: Loaded 41725 primary data records. [2025-10-22T23:38:41.269393] [DEBUG] [MAIN ] TNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:41.295193] [INFO ] [MAIN ] TNL: Generated 138 derivative records from 41725 primary records. [2025-10-22T23:38:41.295369] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-22T23:38:41.307212] [DEBUG] [LOCAL ] TNL: Derivative data saved (138 records). [2025-10-22T23:38:41.307347] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-22T23:38:41.310437] [INFO ] [MAIN ] Derivative Progress: 1810/2052 symbols. TNL took 0.4s. Estimated remaining time: 1m 35s [2025-10-22T23:38:41.310599] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:41.362869] [DEBUG] [LOCAL ] TOL: Loaded 50535 existing records from primary storage. [2025-10-22T23:38:41.363039] [INFO ] [MAIN ] TOL: Loaded 50535 primary data records. [2025-10-22T23:38:41.701006] [DEBUG] [MAIN ] TOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:41.727130] [INFO ] [MAIN ] TOL: Generated 138 derivative records from 50535 primary records. [2025-10-22T23:38:41.727301] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-22T23:38:41.740466] [DEBUG] [LOCAL ] TOL: Derivative data saved (138 records). [2025-10-22T23:38:41.740552] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-22T23:38:41.744168] [INFO ] [MAIN ] Derivative Progress: 1811/2052 symbols. TOL took 0.4s. Estimated remaining time: 1m 35s [2025-10-22T23:38:41.744263] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:41.797347] [DEBUG] [LOCAL ] TOST: Loaded 53690 existing records from primary storage. [2025-10-22T23:38:41.797522] [INFO ] [MAIN ] TOST: Loaded 53690 primary data records. [2025-10-22T23:38:42.110684] [DEBUG] [MAIN ] TOST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:42.136675] [INFO ] [MAIN ] TOST: Generated 138 derivative records from 53690 primary records. [2025-10-22T23:38:42.136826] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-22T23:38:42.148472] [DEBUG] [LOCAL ] TOST: Derivative data saved (138 records). [2025-10-22T23:38:42.148563] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-10-22T23:38:42.151739] [INFO ] [MAIN ] Derivative Progress: 1812/2052 symbols. TOST took 0.4s. Estimated remaining time: 1m 35s [2025-10-22T23:38:42.151839] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:42.179357] [DEBUG] [LOCAL ] TPB: Loaded 26309 existing records from primary storage. [2025-10-22T23:38:42.179511] [INFO ] [MAIN ] TPB: Loaded 26309 primary data records. [2025-10-22T23:38:42.491549] [DEBUG] [MAIN ] TPB: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:38:42.517043] [INFO ] [MAIN ] TPB: Generated 138 derivative records from 26309 primary records. [2025-10-22T23:38:42.517256] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-22T23:38:42.528864] [DEBUG] [LOCAL ] TPB: Derivative data saved (138 records). [2025-10-22T23:38:42.528946] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-22T23:38:42.531796] [INFO ] [MAIN ] Derivative Progress: 1813/2052 symbols. TPB took 0.4s. Estimated remaining time: 1m 34s [2025-10-22T23:38:42.531886] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:42.569817] [DEBUG] [LOCAL ] TPC: Loaded 39105 existing records from primary storage. [2025-10-22T23:38:42.569978] [INFO ] [MAIN ] TPC: Loaded 39105 primary data records. [2025-10-22T23:38:42.881584] [DEBUG] [MAIN ] TPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:42.906981] [INFO ] [MAIN ] TPC: Generated 138 derivative records from 39105 primary records. [2025-10-22T23:38:42.907106] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-22T23:38:42.918481] [DEBUG] [LOCAL ] TPC: Derivative data saved (138 records). [2025-10-22T23:38:42.918561] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-22T23:38:42.921497] [INFO ] [MAIN ] Derivative Progress: 1814/2052 symbols. TPC took 0.4s. Estimated remaining time: 1m 34s [2025-10-22T23:38:42.921616] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:42.964004] [DEBUG] [LOCAL ] TPH: Loaded 44779 existing records from primary storage. [2025-10-22T23:38:42.964173] [INFO ] [MAIN ] TPH: Loaded 44779 primary data records. [2025-10-22T23:38:43.276576] [DEBUG] [MAIN ] TPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:43.303483] [INFO ] [MAIN ] TPH: Generated 138 derivative records from 44779 primary records. [2025-10-22T23:38:43.303706] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-22T23:38:43.315442] [DEBUG] [LOCAL ] TPH: Derivative data saved (138 records). [2025-10-22T23:38:43.315529] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-22T23:38:43.318616] [INFO ] [MAIN ] Derivative Progress: 1815/2052 symbols. TPH took 0.4s. Estimated remaining time: 1m 33s [2025-10-22T23:38:43.318751] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:43.334600] [DEBUG] [LOCAL ] TPL: Loaded 12262 existing records from primary storage. [2025-10-22T23:38:43.334763] [INFO ] [MAIN ] TPL: Loaded 12262 primary data records. [2025-10-22T23:38:43.668635] [DEBUG] [MAIN ] TPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:43.694486] [INFO ] [MAIN ] TPL: Generated 138 derivative records from 12262 primary records. [2025-10-22T23:38:43.694625] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-22T23:38:43.706152] [DEBUG] [LOCAL ] TPL: Derivative data saved (138 records). [2025-10-22T23:38:43.706237] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-10-22T23:38:43.709054] [INFO ] [MAIN ] Derivative Progress: 1816/2052 symbols. TPL took 0.4s. Estimated remaining time: 1m 33s [2025-10-22T23:38:43.709155] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:43.762798] [DEBUG] [LOCAL ] TPR: Loaded 53368 existing records from primary storage. [2025-10-22T23:38:43.762959] [INFO ] [MAIN ] TPR: Loaded 53368 primary data records. [2025-10-22T23:38:44.070063] [DEBUG] [MAIN ] TPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:44.095173] [INFO ] [MAIN ] TPR: Generated 138 derivative records from 53368 primary records. [2025-10-22T23:38:44.095311] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-22T23:38:44.107140] [DEBUG] [LOCAL ] TPR: Derivative data saved (138 records). [2025-10-22T23:38:44.107217] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-22T23:38:44.110202] [INFO ] [MAIN ] Derivative Progress: 1817/2052 symbols. TPR took 0.4s. Estimated remaining time: 1m 33s [2025-10-22T23:38:44.110316] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:44.137491] [DEBUG] [LOCAL ] TPVG: Loaded 27151 existing records from primary storage. [2025-10-22T23:38:44.137682] [INFO ] [MAIN ] TPVG: Loaded 27151 primary data records. [2025-10-22T23:38:44.445021] [DEBUG] [MAIN ] TPVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:44.470402] [INFO ] [MAIN ] TPVG: Generated 138 derivative records from 27151 primary records. [2025-10-22T23:38:44.470505] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-22T23:38:44.481485] [DEBUG] [LOCAL ] TPVG: Derivative data saved (138 records). [2025-10-22T23:38:44.481563] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-22T23:38:44.484285] [INFO ] [MAIN ] Derivative Progress: 1818/2052 symbols. TPVG took 0.4s. Estimated remaining time: 1m 32s [2025-10-22T23:38:44.484381] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:44.496018] [DEBUG] [LOCAL ] TPYP: Loaded 7866 existing records from primary storage. [2025-10-22T23:38:44.496144] [INFO ] [MAIN ] TPYP: Loaded 7866 primary data records. [2025-10-22T23:38:44.795915] [DEBUG] [MAIN ] TPYP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:44.820769] [INFO ] [MAIN ] TPYP: Generated 138 derivative records from 7866 primary records. [2025-10-22T23:38:44.820871] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-22T23:38:44.831813] [DEBUG] [LOCAL ] TPYP: Derivative data saved (138 records). [2025-10-22T23:38:44.831891] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-22T23:38:44.833887] [INFO ] [MAIN ] Derivative Progress: 1819/2052 symbols. TPYP took 0.3s. Estimated remaining time: 1m 32s [2025-10-22T23:38:44.833983] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:44.841051] [DEBUG] [LOCAL ] TPZ: Loaded 4600 existing records from primary storage. [2025-10-22T23:38:44.841146] [INFO ] [MAIN ] TPZ: Loaded 4600 primary data records. [2025-10-22T23:38:45.140973] [DEBUG] [MAIN ] TPZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:45.165885] [INFO ] [MAIN ] TPZ: Generated 138 derivative records from 4600 primary records. [2025-10-22T23:38:45.165993] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-22T23:38:45.176599] [DEBUG] [LOCAL ] TPZ: Derivative data saved (138 records). [2025-10-22T23:38:45.176702] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-22T23:38:45.178794] [INFO ] [MAIN ] Derivative Progress: 1820/2052 symbols. TPZ took 0.3s. Estimated remaining time: 1m 31s [2025-10-22T23:38:45.178890] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:45.197702] [DEBUG] [LOCAL ] TR: Loaded 19117 existing records from primary storage. [2025-10-22T23:38:45.197840] [INFO ] [MAIN ] TR: Loaded 19117 primary data records. [2025-10-22T23:38:45.534098] [DEBUG] [MAIN ] TR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:45.559226] [INFO ] [MAIN ] TR: Generated 138 derivative records from 19117 primary records. [2025-10-22T23:38:45.559335] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-22T23:38:45.570581] [DEBUG] [LOCAL ] TR: Derivative data saved (138 records). [2025-10-22T23:38:45.570681] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-22T23:38:45.573479] [INFO ] [MAIN ] Derivative Progress: 1821/2052 symbols. TR took 0.4s. Estimated remaining time: 1m 31s [2025-10-22T23:38:45.573578] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:45.586886] [DEBUG] [LOCAL ] TRAK: Loaded 9585 existing records from primary storage. [2025-10-22T23:38:45.587010] [INFO ] [MAIN ] TRAK: Loaded 9585 primary data records. [2025-10-22T23:38:45.887831] [DEBUG] [MAIN ] TRAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:45.914358] [INFO ] [MAIN ] TRAK: Generated 138 derivative records from 9585 primary records. [2025-10-22T23:38:45.914562] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-22T23:38:45.925933] [DEBUG] [LOCAL ] TRAK: Derivative data saved (138 records). [2025-10-22T23:38:45.926010] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-22T23:38:45.928802] [INFO ] [MAIN ] Derivative Progress: 1822/2052 symbols. TRAK took 0.4s. Estimated remaining time: 1m 31s [2025-10-22T23:38:45.928897] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:45.947227] [DEBUG] [LOCAL ] TRC: Loaded 15391 existing records from primary storage. [2025-10-22T23:38:45.947386] [INFO ] [MAIN ] TRC: Loaded 15391 primary data records. [2025-10-22T23:38:46.250048] [DEBUG] [MAIN ] TRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:46.275094] [INFO ] [MAIN ] TRC: Generated 138 derivative records from 15391 primary records. [2025-10-22T23:38:46.275204] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-22T23:38:46.286309] [DEBUG] [LOCAL ] TRC: Derivative data saved (138 records). [2025-10-22T23:38:46.286390] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-22T23:38:46.289276] [INFO ] [MAIN ] Derivative Progress: 1823/2052 symbols. TRC took 0.4s. Estimated remaining time: 1m 30s [2025-10-22T23:38:46.289377] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:46.334818] [DEBUG] [LOCAL ] TREX: Loaded 49790 existing records from primary storage. [2025-10-22T23:38:46.334978] [INFO ] [MAIN ] TREX: Loaded 49790 primary data records. [2025-10-22T23:38:46.640130] [DEBUG] [MAIN ] TREX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:46.665461] [INFO ] [MAIN ] TREX: Generated 138 derivative records from 49790 primary records. [2025-10-22T23:38:46.665573] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-22T23:38:46.677068] [DEBUG] [LOCAL ] TREX: Derivative data saved (138 records). [2025-10-22T23:38:46.677168] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-22T23:38:46.680164] [INFO ] [MAIN ] Derivative Progress: 1824/2052 symbols. TREX took 0.4s. Estimated remaining time: 1m 30s [2025-10-22T23:38:46.680268] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:46.735053] [DEBUG] [LOCAL ] TRGP: Loaded 50729 existing records from primary storage. [2025-10-22T23:38:46.735215] [INFO ] [MAIN ] TRGP: Loaded 50729 primary data records. [2025-10-22T23:38:47.046164] [DEBUG] [MAIN ] TRGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:47.070939] [INFO ] [MAIN ] TRGP: Generated 138 derivative records from 50729 primary records. [2025-10-22T23:38:47.071045] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-22T23:38:47.082669] [DEBUG] [LOCAL ] TRGP: Derivative data saved (138 records). [2025-10-22T23:38:47.082791] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-10-22T23:38:47.085852] [INFO ] [MAIN ] Derivative Progress: 1825/2052 symbols. TRGP took 0.4s. Estimated remaining time: 1m 29s [2025-10-22T23:38:47.085942] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:47.120313] [DEBUG] [LOCAL ] TRN: Loaded 36276 existing records from primary storage. [2025-10-22T23:38:47.120480] [INFO ] [MAIN ] TRN: Loaded 36276 primary data records. [2025-10-22T23:38:47.450601] [DEBUG] [MAIN ] TRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:47.476714] [INFO ] [MAIN ] TRN: Generated 138 derivative records from 36276 primary records. [2025-10-22T23:38:47.476965] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-22T23:38:47.489225] [DEBUG] [LOCAL ] TRN: Derivative data saved (138 records). [2025-10-22T23:38:47.489387] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-22T23:38:47.492416] [INFO ] [MAIN ] Derivative Progress: 1826/2052 symbols. TRN took 0.4s. Estimated remaining time: 1m 29s [2025-10-22T23:38:47.492580] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:47.541535] [DEBUG] [LOCAL ] TRNO: Loaded 43615 existing records from primary storage. [2025-10-22T23:38:47.541778] [INFO ] [MAIN ] TRNO: Loaded 43615 primary data records. [2025-10-22T23:38:48.009024] [DEBUG] [MAIN ] TRNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:48.050015] [INFO ] [MAIN ] TRNO: Generated 138 derivative records from 43615 primary records. [2025-10-22T23:38:48.050256] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-22T23:38:48.068778] [DEBUG] [LOCAL ] TRNO: Derivative data saved (138 records). [2025-10-22T23:38:48.068984] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-22T23:38:48.073014] [INFO ] [MAIN ] Derivative Progress: 1827/2052 symbols. TRNO took 0.6s. Estimated remaining time: 1m 29s [2025-10-22T23:38:48.073231] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:48.154025] [DEBUG] [LOCAL ] TROX: Loaded 52233 existing records from primary storage. [2025-10-22T23:38:48.154256] [INFO ] [MAIN ] TROX: Loaded 52233 primary data records. [2025-10-22T23:38:48.542066] [DEBUG] [MAIN ] TROX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:48.567530] [INFO ] [MAIN ] TROX: Generated 138 derivative records from 52233 primary records. [2025-10-22T23:38:48.567682] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-22T23:38:48.579512] [DEBUG] [LOCAL ] TROX: Derivative data saved (138 records). [2025-10-22T23:38:48.579594] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-22T23:38:48.582798] [INFO ] [MAIN ] Derivative Progress: 1828/2052 symbols. TROX took 0.5s. Estimated remaining time: 1m 28s [2025-10-22T23:38:48.582894] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:48.633744] [DEBUG] [LOCAL ] TRP: Loaded 52127 existing records from primary storage. [2025-10-22T23:38:48.633899] [INFO ] [MAIN ] TRP: Loaded 52127 primary data records. [2025-10-22T23:38:48.936396] [DEBUG] [MAIN ] TRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:48.961711] [INFO ] [MAIN ] TRP: Generated 138 derivative records from 52127 primary records. [2025-10-22T23:38:48.961819] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-22T23:38:48.973253] [DEBUG] [LOCAL ] TRP: Derivative data saved (138 records). [2025-10-22T23:38:48.973330] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-22T23:38:48.976501] [INFO ] [MAIN ] Derivative Progress: 1829/2052 symbols. TRP took 0.4s. Estimated remaining time: 1m 28s [2025-10-22T23:38:48.976596] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:49.010927] [DEBUG] [LOCAL ] TRTX: Loaded 36901 existing records from primary storage. [2025-10-22T23:38:49.011079] [INFO ] [MAIN ] TRTX: Loaded 36901 primary data records. [2025-10-22T23:38:49.318300] [DEBUG] [MAIN ] TRTX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:49.343708] [INFO ] [MAIN ] TRTX: Generated 138 derivative records from 36901 primary records. [2025-10-22T23:38:49.343818] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-22T23:38:49.355128] [DEBUG] [LOCAL ] TRTX: Derivative data saved (138 records). [2025-10-22T23:38:49.355222] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-10-22T23:38:49.358088] [INFO ] [MAIN ] Derivative Progress: 1830/2052 symbols. TRTX took 0.4s. Estimated remaining time: 1m 27s [2025-10-22T23:38:49.358188] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:49.410068] [DEBUG] [LOCAL ] TRU: Loaded 51459 existing records from primary storage. [2025-10-22T23:38:49.410240] [INFO ] [MAIN ] TRU: Loaded 51459 primary data records. [2025-10-22T23:38:49.715269] [DEBUG] [MAIN ] TRU: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:38:49.740507] [INFO ] [MAIN ] TRU: Generated 138 derivative records from 51459 primary records. [2025-10-22T23:38:49.740613] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-22T23:38:49.752056] [DEBUG] [LOCAL ] TRU: Derivative data saved (138 records). [2025-10-22T23:38:49.752134] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-22T23:38:49.755215] [INFO ] [MAIN ] Derivative Progress: 1831/2052 symbols. TRU took 0.4s. Estimated remaining time: 1m 27s [2025-10-22T23:38:49.755314] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:49.801688] [DEBUG] [LOCAL ] TRV: Loaded 47467 existing records from primary storage. [2025-10-22T23:38:49.801843] [INFO ] [MAIN ] TRV: Loaded 47467 primary data records. [2025-10-22T23:38:50.126119] [DEBUG] [MAIN ] TRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:50.151206] [INFO ] [MAIN ] TRV: Generated 138 derivative records from 47467 primary records. [2025-10-22T23:38:50.151309] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-22T23:38:50.162683] [DEBUG] [LOCAL ] TRV: Derivative data saved (138 records). [2025-10-22T23:38:50.162762] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-22T23:38:50.165767] [INFO ] [MAIN ] Derivative Progress: 1832/2052 symbols. TRV took 0.4s. Estimated remaining time: 1m 27s [2025-10-22T23:38:50.165864] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:50.216716] [DEBUG] [LOCAL ] TS: Loaded 51646 existing records from primary storage. [2025-10-22T23:38:50.216878] [INFO ] [MAIN ] TS: Loaded 51646 primary data records. [2025-10-22T23:38:50.519150] [DEBUG] [MAIN ] TS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:50.543826] [INFO ] [MAIN ] TS: Generated 138 derivative records from 51646 primary records. [2025-10-22T23:38:50.543949] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-22T23:38:50.555367] [DEBUG] [LOCAL ] TS: Derivative data saved (138 records). [2025-10-22T23:38:50.555445] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-22T23:38:50.558495] [INFO ] [MAIN ] Derivative Progress: 1833/2052 symbols. TS took 0.4s. Estimated remaining time: 1m 26s [2025-10-22T23:38:50.558591] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:50.586314] [DEBUG] [LOCAL ] TSE: Loaded 27651 existing records from primary storage. [2025-10-22T23:38:50.586450] [INFO ] [MAIN ] TSE: Loaded 27651 primary data records. [2025-10-22T23:38:50.888452] [DEBUG] [MAIN ] TSE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:50.913447] [INFO ] [MAIN ] TSE: Generated 138 derivative records from 27651 primary records. [2025-10-22T23:38:50.913584] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-22T23:38:50.924979] [DEBUG] [LOCAL ] TSE: Derivative data saved (138 records). [2025-10-22T23:38:50.925062] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-22T23:38:50.927889] [INFO ] [MAIN ] Derivative Progress: 1834/2052 symbols. TSE took 0.4s. Estimated remaining time: 1m 26s [2025-10-22T23:38:50.927996] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:50.963338] [DEBUG] [LOCAL ] TSLX: Loaded 35762 existing records from primary storage. [2025-10-22T23:38:50.963500] [INFO ] [MAIN ] TSLX: Loaded 35762 primary data records. [2025-10-22T23:38:51.266198] [DEBUG] [MAIN ] TSLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:51.293498] [INFO ] [MAIN ] TSLX: Generated 138 derivative records from 35762 primary records. [2025-10-22T23:38:51.293637] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-22T23:38:51.305789] [DEBUG] [LOCAL ] TSLX: Derivative data saved (138 records). [2025-10-22T23:38:51.305876] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-22T23:38:51.308880] [INFO ] [MAIN ] Derivative Progress: 1835/2052 symbols. TSLX took 0.4s. Estimated remaining time: 1m 25s [2025-10-22T23:38:51.308998] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:51.366289] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-22T23:38:51.366459] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-10-22T23:38:51.710696] [DEBUG] [MAIN ] TSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:51.735760] [INFO ] [MAIN ] TSM: Generated 138 derivative records from 53819 primary records. [2025-10-22T23:38:51.735914] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-22T23:38:51.749006] [DEBUG] [LOCAL ] TSM: Derivative data saved (138 records). [2025-10-22T23:38:51.749137] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-22T23:38:51.752599] [INFO ] [MAIN ] Derivative Progress: 1836/2052 symbols. TSM took 0.4s. Estimated remaining time: 1m 25s [2025-10-22T23:38:51.752733] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:51.806076] [DEBUG] [LOCAL ] TSN: Loaded 53088 existing records from primary storage. [2025-10-22T23:38:51.806246] [INFO ] [MAIN ] TSN: Loaded 53088 primary data records. [2025-10-22T23:38:52.143814] [DEBUG] [MAIN ] TSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:52.172118] [INFO ] [MAIN ] TSN: Generated 138 derivative records from 53088 primary records. [2025-10-22T23:38:52.172304] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-22T23:38:52.183708] [DEBUG] [LOCAL ] TSN: Derivative data saved (138 records). [2025-10-22T23:38:52.183791] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-22T23:38:52.186885] [INFO ] [MAIN ] Derivative Progress: 1837/2052 symbols. TSN took 0.4s. Estimated remaining time: 1m 25s [2025-10-22T23:38:52.186981] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:52.201211] [DEBUG] [LOCAL ] TSQ: Loaded 11595 existing records from primary storage. [2025-10-22T23:38:52.201334] [INFO ] [MAIN ] TSQ: Loaded 11595 primary data records. [2025-10-22T23:38:52.524824] [DEBUG] [MAIN ] TSQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:52.550993] [INFO ] [MAIN ] TSQ: Generated 138 derivative records from 11595 primary records. [2025-10-22T23:38:52.551202] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-22T23:38:52.562518] [DEBUG] [LOCAL ] TSQ: Derivative data saved (138 records). [2025-10-22T23:38:52.562704] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-22T23:38:52.565552] [INFO ] [MAIN ] Derivative Progress: 1838/2052 symbols. TSQ took 0.4s. Estimated remaining time: 1m 24s [2025-10-22T23:38:52.565800] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:52.613691] [DEBUG] [LOCAL ] TT: Loaded 47001 existing records from primary storage. [2025-10-22T23:38:52.613866] [INFO ] [MAIN ] TT: Loaded 47001 primary data records. [2025-10-22T23:38:52.923439] [DEBUG] [MAIN ] TT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:52.951739] [INFO ] [MAIN ] TT: Generated 138 derivative records from 47001 primary records. [2025-10-22T23:38:52.951884] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-22T23:38:52.963376] [DEBUG] [LOCAL ] TT: Derivative data saved (138 records). [2025-10-22T23:38:52.963459] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-22T23:38:52.966288] [INFO ] [MAIN ] Derivative Progress: 1839/2052 symbols. TT took 0.4s. Estimated remaining time: 1m 24s [2025-10-22T23:38:52.966393] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:53.006505] [DEBUG] [LOCAL ] TTC: Loaded 41525 existing records from primary storage. [2025-10-22T23:38:53.006703] [INFO ] [MAIN ] TTC: Loaded 41525 primary data records. [2025-10-22T23:38:53.319857] [DEBUG] [MAIN ] TTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:53.345274] [INFO ] [MAIN ] TTC: Generated 138 derivative records from 41525 primary records. [2025-10-22T23:38:53.345462] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-22T23:38:53.357076] [DEBUG] [LOCAL ] TTC: Derivative data saved (138 records). [2025-10-22T23:38:53.357187] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-22T23:38:53.360146] [INFO ] [MAIN ] Derivative Progress: 1840/2052 symbols. TTC took 0.4s. Estimated remaining time: 1m 24s [2025-10-22T23:38:53.360267] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:53.412961] [DEBUG] [LOCAL ] TTE: Loaded 51552 existing records from primary storage. [2025-10-22T23:38:53.413136] [INFO ] [MAIN ] TTE: Loaded 51552 primary data records. [2025-10-22T23:38:53.725002] [DEBUG] [MAIN ] TTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:53.750605] [INFO ] [MAIN ] TTE: Generated 138 derivative records from 51552 primary records. [2025-10-22T23:38:53.750831] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-22T23:38:53.762672] [DEBUG] [LOCAL ] TTE: Derivative data saved (138 records). [2025-10-22T23:38:53.762769] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-22T23:38:53.765820] [INFO ] [MAIN ] Derivative Progress: 1841/2052 symbols. TTE took 0.4s. Estimated remaining time: 1m 23s [2025-10-22T23:38:53.765937] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:53.814826] [DEBUG] [LOCAL ] TTI: Loaded 46650 existing records from primary storage. [2025-10-22T23:38:53.815024] [INFO ] [MAIN ] TTI: Loaded 46650 primary data records. [2025-10-22T23:38:54.221942] [DEBUG] [MAIN ] TTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:54.248280] [INFO ] [MAIN ] TTI: Generated 138 derivative records from 46650 primary records. [2025-10-22T23:38:54.248470] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-22T23:38:54.260322] [DEBUG] [LOCAL ] TTI: Derivative data saved (138 records). [2025-10-22T23:38:54.260424] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-22T23:38:54.263125] [INFO ] [MAIN ] Derivative Progress: 1842/2052 symbols. TTI took 0.5s. Estimated remaining time: 1m 23s [2025-10-22T23:38:54.263252] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:54.312487] [DEBUG] [LOCAL ] TU: Loaded 49774 existing records from primary storage. [2025-10-22T23:38:54.312689] [INFO ] [MAIN ] TU: Loaded 49774 primary data records. [2025-10-22T23:38:54.621352] [DEBUG] [MAIN ] TU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:54.646689] [INFO ] [MAIN ] TU: Generated 138 derivative records from 49774 primary records. [2025-10-22T23:38:54.646847] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-22T23:38:54.658971] [DEBUG] [LOCAL ] TU: Derivative data saved (138 records). [2025-10-22T23:38:54.659060] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-22T23:38:54.661983] [INFO ] [MAIN ] Derivative Progress: 1843/2052 symbols. TU took 0.4s. Estimated remaining time: 1m 22s [2025-10-22T23:38:54.662078] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:54.704572] [DEBUG] [LOCAL ] TUYA: Loaded 45737 existing records from primary storage. [2025-10-22T23:38:54.704769] [INFO ] [MAIN ] TUYA: Loaded 45737 primary data records. [2025-10-22T23:38:55.010148] [DEBUG] [MAIN ] TUYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:55.035598] [INFO ] [MAIN ] TUYA: Generated 138 derivative records from 45737 primary records. [2025-10-22T23:38:55.035738] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-22T23:38:55.047126] [DEBUG] [LOCAL ] TUYA: Derivative data saved (138 records). [2025-10-22T23:38:55.047212] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-22T23:38:55.049979] [INFO ] [MAIN ] Derivative Progress: 1844/2052 symbols. TUYA took 0.4s. Estimated remaining time: 1m 22s [2025-10-22T23:38:55.050075] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:55.088638] [DEBUG] [LOCAL ] TV: Loaded 41238 existing records from primary storage. [2025-10-22T23:38:55.088829] [INFO ] [MAIN ] TV: Loaded 41238 primary data records. [2025-10-22T23:38:55.403620] [DEBUG] [MAIN ] TV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:55.428683] [INFO ] [MAIN ] TV: Generated 138 derivative records from 41238 primary records. [2025-10-22T23:38:55.428812] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-22T23:38:55.440157] [DEBUG] [LOCAL ] TV: Derivative data saved (138 records). [2025-10-22T23:38:55.440237] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-22T23:38:55.443120] [INFO ] [MAIN ] Derivative Progress: 1845/2052 symbols. TV took 0.4s. Estimated remaining time: 1m 22s [2025-10-22T23:38:55.443217] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:55.448921] [DEBUG] [LOCAL ] TVC: Loaded 3118 existing records from primary storage. [2025-10-22T23:38:55.449016] [INFO ] [MAIN ] TVC: Loaded 3118 primary data records. [2025-10-22T23:38:55.755915] [DEBUG] [MAIN ] TVC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:55.781340] [INFO ] [MAIN ] TVC: Generated 138 derivative records from 3118 primary records. [2025-10-22T23:38:55.781523] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-22T23:38:55.791431] [DEBUG] [LOCAL ] TVC: Derivative data saved (138 records). [2025-10-22T23:38:55.791515] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-22T23:38:55.793668] [INFO ] [MAIN ] Derivative Progress: 1846/2052 symbols. TVC took 0.4s. Estimated remaining time: 1m 21s [2025-10-22T23:38:55.793767] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:55.798745] [DEBUG] [LOCAL ] TVE: Loaded 2547 existing records from primary storage. [2025-10-22T23:38:55.798836] [INFO ] [MAIN ] TVE: Loaded 2547 primary data records. [2025-10-22T23:38:56.111009] [DEBUG] [MAIN ] TVE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:56.136745] [INFO ] [MAIN ] TVE: Generated 138 derivative records from 2547 primary records. [2025-10-22T23:38:56.136931] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-22T23:38:56.146847] [DEBUG] [LOCAL ] TVE: Derivative data saved (138 records). [2025-10-22T23:38:56.146941] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-10-22T23:38:56.149135] [INFO ] [MAIN ] Derivative Progress: 1847/2052 symbols. TVE took 0.4s. Estimated remaining time: 1m 21s [2025-10-22T23:38:56.149242] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:56.183333] [DEBUG] [LOCAL ] TWI: Loaded 33814 existing records from primary storage. [2025-10-22T23:38:56.183522] [INFO ] [MAIN ] TWI: Loaded 33814 primary data records. [2025-10-22T23:38:56.530054] [DEBUG] [MAIN ] TWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:56.555421] [INFO ] [MAIN ] TWI: Generated 138 derivative records from 33814 primary records. [2025-10-22T23:38:56.555562] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-22T23:38:56.566935] [DEBUG] [LOCAL ] TWI: Derivative data saved (138 records). [2025-10-22T23:38:56.567030] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-10-22T23:38:56.570242] [INFO ] [MAIN ] Derivative Progress: 1848/2052 symbols. TWI took 0.4s. Estimated remaining time: 1m 20s [2025-10-22T23:38:56.570363] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:56.625855] [DEBUG] [LOCAL ] TWLO: Loaded 52813 existing records from primary storage. [2025-10-22T23:38:56.626027] [INFO ] [MAIN ] TWLO: Loaded 52813 primary data records. [2025-10-22T23:38:56.933846] [DEBUG] [MAIN ] TWLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:56.959792] [INFO ] [MAIN ] TWLO: Generated 138 derivative records from 52813 primary records. [2025-10-22T23:38:56.959978] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-22T23:38:56.971902] [DEBUG] [LOCAL ] TWLO: Derivative data saved (138 records). [2025-10-22T23:38:56.972007] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-10-22T23:38:56.975184] [INFO ] [MAIN ] Derivative Progress: 1849/2052 symbols. TWLO took 0.4s. Estimated remaining time: 1m 20s [2025-10-22T23:38:56.975309] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:56.981249] [DEBUG] [LOCAL ] TWN: Loaded 3211 existing records from primary storage. [2025-10-22T23:38:56.981365] [INFO ] [MAIN ] TWN: Loaded 3211 primary data records. [2025-10-22T23:38:57.284195] [DEBUG] [MAIN ] TWN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:57.309209] [INFO ] [MAIN ] TWN: Generated 138 derivative records from 3211 primary records. [2025-10-22T23:38:57.309357] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-22T23:38:57.318482] [DEBUG] [LOCAL ] TWN: Derivative data saved (138 records). [2025-10-22T23:38:57.318582] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-22T23:38:57.320829] [INFO ] [MAIN ] Derivative Progress: 1850/2052 symbols. TWN took 0.3s. Estimated remaining time: 1m 20s [2025-10-22T23:38:57.320954] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:57.368920] [DEBUG] [LOCAL ] TWO: Loaded 48553 existing records from primary storage. [2025-10-22T23:38:57.369101] [INFO ] [MAIN ] TWO: Loaded 48553 primary data records. [2025-10-22T23:38:57.678792] [DEBUG] [MAIN ] TWO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:57.704824] [INFO ] [MAIN ] TWO: Generated 138 derivative records from 48553 primary records. [2025-10-22T23:38:57.704982] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-22T23:38:57.716734] [DEBUG] [LOCAL ] TWO: Derivative data saved (138 records). [2025-10-22T23:38:57.716832] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-22T23:38:57.720187] [INFO ] [MAIN ] Derivative Progress: 1851/2052 symbols. TWO took 0.4s. Estimated remaining time: 1m 19s [2025-10-22T23:38:57.720310] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:57.745064] [DEBUG] [LOCAL ] TX: Loaded 23146 existing records from primary storage. [2025-10-22T23:38:57.745230] [INFO ] [MAIN ] TX: Loaded 23146 primary data records. [2025-10-22T23:38:58.064410] [DEBUG] [MAIN ] TX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:58.090555] [INFO ] [MAIN ] TX: Generated 138 derivative records from 23146 primary records. [2025-10-22T23:38:58.090743] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-22T23:38:58.102473] [DEBUG] [LOCAL ] TX: Derivative data saved (138 records). [2025-10-22T23:38:58.102585] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-10-22T23:38:58.105496] [INFO ] [MAIN ] Derivative Progress: 1852/2052 symbols. TX took 0.4s. Estimated remaining time: 1m 19s [2025-10-22T23:38:58.105606] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:58.148089] [DEBUG] [LOCAL ] TXNM: Loaded 42857 existing records from primary storage. [2025-10-22T23:38:58.148278] [INFO ] [MAIN ] TXNM: Loaded 42857 primary data records. [2025-10-22T23:38:58.480151] [DEBUG] [MAIN ] TXNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:58.506163] [INFO ] [MAIN ] TXNM: Generated 138 derivative records from 42857 primary records. [2025-10-22T23:38:58.506385] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-10-22T23:38:58.518092] [DEBUG] [LOCAL ] TXNM: Derivative data saved (138 records). [2025-10-22T23:38:58.518189] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-10-22T23:38:58.521232] [INFO ] [MAIN ] Derivative Progress: 1853/2052 symbols. TXNM took 0.4s. Estimated remaining time: 1m 18s [2025-10-22T23:38:58.521341] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:58.543856] [DEBUG] [LOCAL ] TXO: Loaded 20043 existing records from primary storage. [2025-10-22T23:38:58.544058] [INFO ] [MAIN ] TXO: Loaded 20043 primary data records. [2025-10-22T23:38:58.851909] [DEBUG] [MAIN ] TXO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:58.876954] [INFO ] [MAIN ] TXO: Generated 138 derivative records from 20043 primary records. [2025-10-22T23:38:58.877141] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-22T23:38:58.889203] [DEBUG] [LOCAL ] TXO: Derivative data saved (138 records). [2025-10-22T23:38:58.889335] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-22T23:38:58.892256] [INFO ] [MAIN ] Derivative Progress: 1854/2052 symbols. TXO took 0.4s. Estimated remaining time: 1m 18s [2025-10-22T23:38:58.892364] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:58.940050] [DEBUG] [LOCAL ] TXT: Loaded 49510 existing records from primary storage. [2025-10-22T23:38:58.940214] [INFO ] [MAIN ] TXT: Loaded 49510 primary data records. [2025-10-22T23:38:59.252440] [DEBUG] [MAIN ] TXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:59.278490] [INFO ] [MAIN ] TXT: Generated 138 derivative records from 49510 primary records. [2025-10-22T23:38:59.278704] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-22T23:38:59.290444] [DEBUG] [LOCAL ] TXT: Derivative data saved (138 records). [2025-10-22T23:38:59.290589] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-10-22T23:38:59.293739] [INFO ] [MAIN ] Derivative Progress: 1855/2052 symbols. TXT took 0.4s. Estimated remaining time: 1m 18s [2025-10-22T23:38:59.293898] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:59.306361] [DEBUG] [LOCAL ] TY: Loaded 7524 existing records from primary storage. [2025-10-22T23:38:59.306495] [INFO ] [MAIN ] TY: Loaded 7524 primary data records. [2025-10-22T23:38:59.609767] [DEBUG] [MAIN ] TY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:59.635204] [INFO ] [MAIN ] TY: Generated 138 derivative records from 7524 primary records. [2025-10-22T23:38:59.635386] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-22T23:38:59.646116] [DEBUG] [LOCAL ] TY: Derivative data saved (138 records). [2025-10-22T23:38:59.646220] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-10-22T23:38:59.648410] [INFO ] [MAIN ] Derivative Progress: 1856/2052 symbols. TY took 0.4s. Estimated remaining time: 1m 17s [2025-10-22T23:38:59.648559] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:38:59.665711] [DEBUG] [LOCAL ] TYG: Loaded 13892 existing records from primary storage. [2025-10-22T23:38:59.665871] [INFO ] [MAIN ] TYG: Loaded 13892 primary data records. [2025-10-22T23:38:59.964868] [DEBUG] [MAIN ] TYG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:38:59.990086] [INFO ] [MAIN ] TYG: Generated 138 derivative records from 13892 primary records. [2025-10-22T23:38:59.990261] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-22T23:39:00.001517] [DEBUG] [LOCAL ] TYG: Derivative data saved (138 records). [2025-10-22T23:39:00.001600] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-22T23:39:00.004370] [INFO ] [MAIN ] Derivative Progress: 1857/2052 symbols. TYG took 0.4s. Estimated remaining time: 1m 17s [2025-10-22T23:39:00.004470] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:00.028437] [DEBUG] [LOCAL ] TYL: Loaded 21988 existing records from primary storage. [2025-10-22T23:39:00.028577] [INFO ] [MAIN ] TYL: Loaded 21988 primary data records. [2025-10-22T23:39:00.361847] [DEBUG] [MAIN ] TYL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:00.387329] [INFO ] [MAIN ] TYL: Generated 138 derivative records from 21988 primary records. [2025-10-22T23:39:00.387469] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-22T23:39:00.399008] [DEBUG] [LOCAL ] TYL: Derivative data saved (138 records). [2025-10-22T23:39:00.399091] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-22T23:39:00.402044] [INFO ] [MAIN ] Derivative Progress: 1858/2052 symbols. TYL took 0.4s. Estimated remaining time: 1m 16s [2025-10-22T23:39:00.402140] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:00.457894] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-22T23:39:00.458058] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-10-22T23:39:00.770110] [DEBUG] [MAIN ] U: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:00.797009] [INFO ] [MAIN ] U: Generated 138 derivative records from 53799 primary records. [2025-10-22T23:39:00.797228] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-22T23:39:00.813310] [DEBUG] [LOCAL ] U: Derivative data saved (138 records). [2025-10-22T23:39:00.813469] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-22T23:39:00.816601] [INFO ] [MAIN ] Derivative Progress: 1859/2052 symbols. U took 0.4s. Estimated remaining time: 1m 16s [2025-10-22T23:39:00.816755] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:00.869567] [DEBUG] [LOCAL ] UA: Loaded 50473 existing records from primary storage. [2025-10-22T23:39:00.869777] [INFO ] [MAIN ] UA: Loaded 50473 primary data records. [2025-10-22T23:39:01.191262] [DEBUG] [MAIN ] UA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:01.227831] [INFO ] [MAIN ] UA: Generated 138 derivative records from 50473 primary records. [2025-10-22T23:39:01.228046] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-22T23:39:01.244903] [DEBUG] [LOCAL ] UA: Derivative data saved (138 records). [2025-10-22T23:39:01.245087] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-22T23:39:01.249165] [INFO ] [MAIN ] Derivative Progress: 1860/2052 symbols. UA took 0.4s. Estimated remaining time: 1m 16s [2025-10-22T23:39:01.249318] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:01.306065] [DEBUG] [LOCAL ] UAA: Loaded 53498 existing records from primary storage. [2025-10-22T23:39:01.306253] [INFO ] [MAIN ] UAA: Loaded 53498 primary data records. [2025-10-22T23:39:01.610460] [DEBUG] [MAIN ] UAA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:01.635372] [INFO ] [MAIN ] UAA: Generated 138 derivative records from 53498 primary records. [2025-10-22T23:39:01.635558] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-22T23:39:01.647324] [DEBUG] [LOCAL ] UAA: Derivative data saved (138 records). [2025-10-22T23:39:01.647477] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-22T23:39:01.650634] [INFO ] [MAIN ] Derivative Progress: 1861/2052 symbols. UAA took 0.4s. Estimated remaining time: 1m 15s [2025-10-22T23:39:01.650765] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:01.660352] [DEBUG] [LOCAL ] UAN: Loaded 5302 existing records from primary storage. [2025-10-22T23:39:01.660483] [INFO ] [MAIN ] UAN: Loaded 5302 primary data records. [2025-10-22T23:39:01.969708] [DEBUG] [MAIN ] UAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:01.994815] [INFO ] [MAIN ] UAN: Generated 138 derivative records from 5302 primary records. [2025-10-22T23:39:01.994985] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-22T23:39:02.005721] [DEBUG] [LOCAL ] UAN: Derivative data saved (138 records). [2025-10-22T23:39:02.005869] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-22T23:39:02.008029] [INFO ] [MAIN ] Derivative Progress: 1862/2052 symbols. UAN took 0.4s. Estimated remaining time: 1m 15s [2025-10-22T23:39:02.008167] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:02.064955] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-22T23:39:02.065130] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-10-22T23:39:02.371763] [DEBUG] [MAIN ] UBER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:02.396536] [INFO ] [MAIN ] UBER: Generated 138 derivative records from 53806 primary records. [2025-10-22T23:39:02.396661] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-22T23:39:02.408625] [DEBUG] [LOCAL ] UBER: Derivative data saved (138 records). [2025-10-22T23:39:02.408750] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-22T23:39:02.412072] [INFO ] [MAIN ] Derivative Progress: 1863/2052 symbols. UBER took 0.4s. Estimated remaining time: 1m 14s [2025-10-22T23:39:02.412171] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:02.464279] [DEBUG] [LOCAL ] UBS: Loaded 52286 existing records from primary storage. [2025-10-22T23:39:02.464445] [INFO ] [MAIN ] UBS: Loaded 52286 primary data records. [2025-10-22T23:39:02.827894] [DEBUG] [MAIN ] UBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:02.863622] [INFO ] [MAIN ] UBS: Generated 138 derivative records from 52286 primary records. [2025-10-22T23:39:02.863928] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-22T23:39:02.877013] [DEBUG] [LOCAL ] UBS: Derivative data saved (138 records). [2025-10-22T23:39:02.877270] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-22T23:39:02.881856] [INFO ] [MAIN ] Derivative Progress: 1864/2052 symbols. UBS took 0.5s. Estimated remaining time: 1m 14s [2025-10-22T23:39:02.882139] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:02.941116] [DEBUG] [LOCAL ] UDR: Loaded 52105 existing records from primary storage. [2025-10-22T23:39:02.941344] [INFO ] [MAIN ] UDR: Loaded 52105 primary data records. [2025-10-22T23:39:03.258771] [DEBUG] [MAIN ] UDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:03.288124] [INFO ] [MAIN ] UDR: Generated 138 derivative records from 52105 primary records. [2025-10-22T23:39:03.288424] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-22T23:39:03.301487] [DEBUG] [LOCAL ] UDR: Derivative data saved (138 records). [2025-10-22T23:39:03.301616] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-22T23:39:03.306371] [INFO ] [MAIN ] Derivative Progress: 1865/2052 symbols. UDR took 0.4s. Estimated remaining time: 1m 14s [2025-10-22T23:39:03.306538] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:03.355593] [DEBUG] [LOCAL ] UE: Loaded 42468 existing records from primary storage. [2025-10-22T23:39:03.355848] [INFO ] [MAIN ] UE: Loaded 42468 primary data records. [2025-10-22T23:39:03.692504] [DEBUG] [MAIN ] UE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:03.719055] [INFO ] [MAIN ] UE: Generated 138 derivative records from 42468 primary records. [2025-10-22T23:39:03.719341] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-22T23:39:03.732035] [DEBUG] [LOCAL ] UE: Derivative data saved (138 records). [2025-10-22T23:39:03.732158] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-10-22T23:39:03.736361] [INFO ] [MAIN ] Derivative Progress: 1866/2052 symbols. UE took 0.4s. Estimated remaining time: 1m 13s [2025-10-22T23:39:03.736533] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:03.750397] [DEBUG] [LOCAL ] UFI: Loaded 8232 existing records from primary storage. [2025-10-22T23:39:03.750601] [INFO ] [MAIN ] UFI: Loaded 8232 primary data records. [2025-10-22T23:39:04.077835] [DEBUG] [MAIN ] UFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:04.105167] [INFO ] [MAIN ] UFI: Generated 138 derivative records from 8232 primary records. [2025-10-22T23:39:04.105459] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-22T23:39:04.117112] [DEBUG] [LOCAL ] UFI: Derivative data saved (138 records). [2025-10-22T23:39:04.117219] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-10-22T23:39:04.120634] [INFO ] [MAIN ] Derivative Progress: 1867/2052 symbols. UFI took 0.4s. Estimated remaining time: 1m 13s [2025-10-22T23:39:04.120806] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:04.178486] [DEBUG] [LOCAL ] UGI: Loaded 50495 existing records from primary storage. [2025-10-22T23:39:04.178786] [INFO ] [MAIN ] UGI: Loaded 50495 primary data records. [2025-10-22T23:39:04.509930] [DEBUG] [MAIN ] UGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:04.537180] [INFO ] [MAIN ] UGI: Generated 138 derivative records from 50495 primary records. [2025-10-22T23:39:04.537415] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-22T23:39:04.549885] [DEBUG] [LOCAL ] UGI: Derivative data saved (138 records). [2025-10-22T23:39:04.549990] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-22T23:39:04.554376] [INFO ] [MAIN ] Derivative Progress: 1868/2052 symbols. UGI took 0.4s. Estimated remaining time: 1m 12s [2025-10-22T23:39:04.554502] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:04.600582] [DEBUG] [LOCAL ] UGP: Loaded 42993 existing records from primary storage. [2025-10-22T23:39:04.600841] [INFO ] [MAIN ] UGP: Loaded 42993 primary data records. [2025-10-22T23:39:04.961681] [DEBUG] [MAIN ] UGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:04.989203] [INFO ] [MAIN ] UGP: Generated 138 derivative records from 42993 primary records. [2025-10-22T23:39:04.989481] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-22T23:39:05.004125] [DEBUG] [LOCAL ] UGP: Derivative data saved (138 records). [2025-10-22T23:39:05.004253] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-22T23:39:05.007968] [INFO ] [MAIN ] Derivative Progress: 1869/2052 symbols. UGP took 0.5s. Estimated remaining time: 1m 12s [2025-10-22T23:39:05.008113] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:05.031101] [DEBUG] [LOCAL ] UHAL: Loaded 16849 existing records from primary storage. [2025-10-22T23:39:05.031315] [INFO ] [MAIN ] UHAL: Loaded 16849 primary data records. [2025-10-22T23:39:05.353985] [DEBUG] [MAIN ] UHAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:05.380724] [INFO ] [MAIN ] UHAL: Generated 138 derivative records from 16849 primary records. [2025-10-22T23:39:05.380923] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-22T23:39:05.393488] [DEBUG] [LOCAL ] UHAL: Derivative data saved (138 records). [2025-10-22T23:39:05.393588] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-22T23:39:05.397729] [INFO ] [MAIN ] Derivative Progress: 1870/2052 symbols. UHAL took 0.4s. Estimated remaining time: 1m 12s [2025-10-22T23:39:05.397867] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:05.446561] [DEBUG] [LOCAL ] UHS: Loaded 39620 existing records from primary storage. [2025-10-22T23:39:05.446827] [INFO ] [MAIN ] UHS: Loaded 39620 primary data records. [2025-10-22T23:39:05.768733] [DEBUG] [MAIN ] UHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:05.794995] [INFO ] [MAIN ] UHS: Generated 138 derivative records from 39620 primary records. [2025-10-22T23:39:05.795219] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-22T23:39:05.807586] [DEBUG] [LOCAL ] UHS: Derivative data saved (138 records). [2025-10-22T23:39:05.807780] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-22T23:39:05.811551] [INFO ] [MAIN ] Derivative Progress: 1871/2052 symbols. UHS took 0.4s. Estimated remaining time: 1m 11s [2025-10-22T23:39:05.811697] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:05.827252] [DEBUG] [LOCAL ] UHT: Loaded 10210 existing records from primary storage. [2025-10-22T23:39:05.827452] [INFO ] [MAIN ] UHT: Loaded 10210 primary data records. [2025-10-22T23:39:06.159986] [DEBUG] [MAIN ] UHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:06.187068] [INFO ] [MAIN ] UHT: Generated 138 derivative records from 10210 primary records. [2025-10-22T23:39:06.187381] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-22T23:39:06.199785] [DEBUG] [LOCAL ] UHT: Derivative data saved (138 records). [2025-10-22T23:39:06.199920] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-10-22T23:39:06.203747] [INFO ] [MAIN ] Derivative Progress: 1872/2052 symbols. UHT took 0.4s. Estimated remaining time: 1m 11s [2025-10-22T23:39:06.203898] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:06.223841] [DEBUG] [LOCAL ] UI: Loaded 14196 existing records from primary storage. [2025-10-22T23:39:06.224067] [INFO ] [MAIN ] UI: Loaded 14196 primary data records. [2025-10-22T23:39:06.535378] [DEBUG] [MAIN ] UI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:06.565434] [INFO ] [MAIN ] UI: Generated 138 derivative records from 14196 primary records. [2025-10-22T23:39:06.565746] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-22T23:39:06.578244] [DEBUG] [LOCAL ] UI: Derivative data saved (138 records). [2025-10-22T23:39:06.578387] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-22T23:39:06.582870] [INFO ] [MAIN ] Derivative Progress: 1873/2052 symbols. UI took 0.4s. Estimated remaining time: 1m 11s [2025-10-22T23:39:06.583101] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:06.622888] [DEBUG] [LOCAL ] UIS: Loaded 36623 existing records from primary storage. [2025-10-22T23:39:06.623134] [INFO ] [MAIN ] UIS: Loaded 36623 primary data records. [2025-10-22T23:39:07.030525] [DEBUG] [MAIN ] UIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:07.059160] [INFO ] [MAIN ] UIS: Generated 138 derivative records from 36623 primary records. [2025-10-22T23:39:07.059408] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-22T23:39:07.072065] [DEBUG] [LOCAL ] UIS: Derivative data saved (138 records). [2025-10-22T23:39:07.072207] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-22T23:39:07.076471] [INFO ] [MAIN ] Derivative Progress: 1874/2052 symbols. UIS took 0.5s. Estimated remaining time: 1m 10s [2025-10-22T23:39:07.076684] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:07.139770] [DEBUG] [LOCAL ] UL: Loaded 53069 existing records from primary storage. [2025-10-22T23:39:07.140037] [INFO ] [MAIN ] UL: Loaded 53069 primary data records. [2025-10-22T23:39:07.526197] [DEBUG] [MAIN ] UL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:07.554547] [INFO ] [MAIN ] UL: Generated 138 derivative records from 53069 primary records. [2025-10-22T23:39:07.554843] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-22T23:39:07.567426] [DEBUG] [LOCAL ] UL: Derivative data saved (138 records). [2025-10-22T23:39:07.567532] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-10-22T23:39:07.571778] [INFO ] [MAIN ] Derivative Progress: 1875/2052 symbols. UL took 0.5s. Estimated remaining time: 1m 10s [2025-10-22T23:39:07.571940] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:07.619821] [DEBUG] [LOCAL ] ULS: Loaded 38524 existing records from primary storage. [2025-10-22T23:39:07.620065] [INFO ] [MAIN ] ULS: Loaded 38524 primary data records. [2025-10-22T23:39:08.000960] [DEBUG] [MAIN ] ULS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:08.035158] [INFO ] [MAIN ] ULS: Generated 138 derivative records from 38524 primary records. [2025-10-22T23:39:08.035400] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-22T23:39:08.049954] [DEBUG] [LOCAL ] ULS: Derivative data saved (138 records). [2025-10-22T23:39:08.050113] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-22T23:39:08.054602] [INFO ] [MAIN ] Derivative Progress: 1876/2052 symbols. ULS took 0.5s. Estimated remaining time: 1m 9s [2025-10-22T23:39:08.054814] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:08.119553] [DEBUG] [LOCAL ] UMC: Loaded 52671 existing records from primary storage. [2025-10-22T23:39:08.119836] [INFO ] [MAIN ] UMC: Loaded 52671 primary data records. [2025-10-22T23:39:08.466972] [DEBUG] [MAIN ] UMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:08.493827] [INFO ] [MAIN ] UMC: Generated 138 derivative records from 52671 primary records. [2025-10-22T23:39:08.494017] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-22T23:39:08.505816] [DEBUG] [LOCAL ] UMC: Derivative data saved (138 records). [2025-10-22T23:39:08.505911] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-22T23:39:08.510353] [INFO ] [MAIN ] Derivative Progress: 1877/2052 symbols. UMC took 0.5s. Estimated remaining time: 1m 9s [2025-10-22T23:39:08.510492] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:08.550326] [DEBUG] [LOCAL ] UMH: Loaded 34213 existing records from primary storage. [2025-10-22T23:39:08.550554] [INFO ] [MAIN ] UMH: Loaded 34213 primary data records. [2025-10-22T23:39:08.875593] [DEBUG] [MAIN ] UMH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:08.902159] [INFO ] [MAIN ] UMH: Generated 138 derivative records from 34213 primary records. [2025-10-22T23:39:08.902407] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-22T23:39:08.914710] [DEBUG] [LOCAL ] UMH: Derivative data saved (138 records). [2025-10-22T23:39:08.914818] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-22T23:39:08.918989] [INFO ] [MAIN ] Derivative Progress: 1878/2052 symbols. UMH took 0.4s. Estimated remaining time: 1m 9s [2025-10-22T23:39:08.919117] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:08.935739] [DEBUG] [LOCAL ] UNF: Loaded 11751 existing records from primary storage. [2025-10-22T23:39:08.935918] [INFO ] [MAIN ] UNF: Loaded 11751 primary data records. [2025-10-22T23:39:09.317714] [DEBUG] [MAIN ] UNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:09.345150] [INFO ] [MAIN ] UNF: Generated 138 derivative records from 11751 primary records. [2025-10-22T23:39:09.345403] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-22T23:39:09.357678] [DEBUG] [LOCAL ] UNF: Derivative data saved (138 records). [2025-10-22T23:39:09.357884] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-10-22T23:39:09.361733] [INFO ] [MAIN ] Derivative Progress: 1879/2052 symbols. UNF took 0.4s. Estimated remaining time: 1m 8s [2025-10-22T23:39:09.361917] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:09.407966] [DEBUG] [LOCAL ] UNFI: Loaded 42609 existing records from primary storage. [2025-10-22T23:39:09.408225] [INFO ] [MAIN ] UNFI: Loaded 42609 primary data records. [2025-10-22T23:39:09.747776] [DEBUG] [MAIN ] UNFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:09.777341] [INFO ] [MAIN ] UNFI: Generated 138 derivative records from 42609 primary records. [2025-10-22T23:39:09.777615] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-22T23:39:09.790496] [DEBUG] [LOCAL ] UNFI: Derivative data saved (138 records). [2025-10-22T23:39:09.790747] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-22T23:39:09.795029] [INFO ] [MAIN ] Derivative Progress: 1880/2052 symbols. UNFI took 0.4s. Estimated remaining time: 1m 8s [2025-10-22T23:39:09.795442] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:09.861185] [DEBUG] [LOCAL ] UNH: Loaded 53819 existing records from primary storage. [2025-10-22T23:39:09.861427] [INFO ] [MAIN ] UNH: Loaded 53819 primary data records. [2025-10-22T23:39:10.196479] [DEBUG] [MAIN ] UNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:10.224090] [INFO ] [MAIN ] UNH: Generated 138 derivative records from 53819 primary records. [2025-10-22T23:39:10.224288] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-22T23:39:10.237761] [DEBUG] [LOCAL ] UNH: Derivative data saved (138 records). [2025-10-22T23:39:10.237925] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-22T23:39:10.243339] [INFO ] [MAIN ] Derivative Progress: 1881/2052 symbols. UNH took 0.4s. Estimated remaining time: 1m 7s [2025-10-22T23:39:10.243499] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:10.296474] [DEBUG] [LOCAL ] UNM: Loaded 47961 existing records from primary storage. [2025-10-22T23:39:10.296739] [INFO ] [MAIN ] UNM: Loaded 47961 primary data records. [2025-10-22T23:39:10.619942] [DEBUG] [MAIN ] UNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:10.646263] [INFO ] [MAIN ] UNM: Generated 138 derivative records from 47961 primary records. [2025-10-22T23:39:10.646474] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-22T23:39:10.659128] [DEBUG] [LOCAL ] UNM: Derivative data saved (138 records). [2025-10-22T23:39:10.659289] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-22T23:39:10.663626] [INFO ] [MAIN ] Derivative Progress: 1882/2052 symbols. UNM took 0.4s. Estimated remaining time: 1m 7s [2025-10-22T23:39:10.663897] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:10.671137] [DEBUG] [LOCAL ] UNMA: Loaded 3413 existing records from primary storage. [2025-10-22T23:39:10.671266] [INFO ] [MAIN ] UNMA: Loaded 3413 primary data records. [2025-10-22T23:39:11.009661] [DEBUG] [MAIN ] UNMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:11.035920] [INFO ] [MAIN ] UNMA: Generated 138 derivative records from 3413 primary records. [2025-10-22T23:39:11.036123] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-22T23:39:11.047086] [DEBUG] [LOCAL ] UNMA: Derivative data saved (138 records). [2025-10-22T23:39:11.047169] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-22T23:39:11.050349] [INFO ] [MAIN ] Derivative Progress: 1883/2052 symbols. UNMA took 0.4s. Estimated remaining time: 1m 7s [2025-10-22T23:39:11.050469] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:11.111380] [DEBUG] [LOCAL ] UNP: Loaded 53362 existing records from primary storage. [2025-10-22T23:39:11.111619] [INFO ] [MAIN ] UNP: Loaded 53362 primary data records. [2025-10-22T23:39:11.446289] [DEBUG] [MAIN ] UNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:11.472140] [INFO ] [MAIN ] UNP: Generated 138 derivative records from 53362 primary records. [2025-10-22T23:39:11.472379] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-22T23:39:11.484476] [DEBUG] [LOCAL ] UNP: Derivative data saved (138 records). [2025-10-22T23:39:11.484575] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-22T23:39:11.489386] [INFO ] [MAIN ] Derivative Progress: 1884/2052 symbols. UNP took 0.4s. Estimated remaining time: 1m 6s [2025-10-22T23:39:11.489507] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:11.536822] [DEBUG] [LOCAL ] UP: Loaded 44436 existing records from primary storage. [2025-10-22T23:39:11.537050] [INFO ] [MAIN ] UP: Loaded 44436 primary data records. [2025-10-22T23:39:11.920161] [DEBUG] [MAIN ] UP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:11.948759] [INFO ] [MAIN ] UP: Generated 138 derivative records from 44436 primary records. [2025-10-22T23:39:11.948958] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-22T23:39:11.961041] [DEBUG] [LOCAL ] UP: Derivative data saved (138 records). [2025-10-22T23:39:11.961144] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-22T23:39:11.965337] [INFO ] [MAIN ] Derivative Progress: 1885/2052 symbols. UP took 0.5s. Estimated remaining time: 1m 6s [2025-10-22T23:39:11.965471] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:12.026311] [DEBUG] [LOCAL ] UPS: Loaded 53721 existing records from primary storage. [2025-10-22T23:39:12.026540] [INFO ] [MAIN ] UPS: Loaded 53721 primary data records. [2025-10-22T23:39:12.347113] [DEBUG] [MAIN ] UPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:12.373254] [INFO ] [MAIN ] UPS: Generated 138 derivative records from 53721 primary records. [2025-10-22T23:39:12.373485] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-10-22T23:39:12.385473] [DEBUG] [LOCAL ] UPS: Derivative data saved (138 records). [2025-10-22T23:39:12.385557] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-10-22T23:39:12.389848] [INFO ] [MAIN ] Derivative Progress: 1886/2052 symbols. UPS took 0.4s. Estimated remaining time: 1m 5s [2025-10-22T23:39:12.389959] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:12.428204] [DEBUG] [LOCAL ] URI: Loaded 34264 existing records from primary storage. [2025-10-22T23:39:12.428413] [INFO ] [MAIN ] URI: Loaded 34264 primary data records. [2025-10-22T23:39:12.744842] [DEBUG] [MAIN ] URI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:12.771846] [INFO ] [MAIN ] URI: Generated 138 derivative records from 34264 primary records. [2025-10-22T23:39:12.772056] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-10-22T23:39:12.783992] [DEBUG] [LOCAL ] URI: Derivative data saved (138 records). [2025-10-22T23:39:12.784094] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-10-22T23:39:12.788207] [INFO ] [MAIN ] Derivative Progress: 1887/2052 symbols. URI took 0.4s. Estimated remaining time: 1m 5s [2025-10-22T23:39:12.788355] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:12.825382] [DEBUG] [LOCAL ] USA: Loaded 36378 existing records from primary storage. [2025-10-22T23:39:12.825607] [INFO ] [MAIN ] USA: Loaded 36378 primary data records. [2025-10-22T23:39:13.202391] [DEBUG] [MAIN ] USA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:13.229118] [INFO ] [MAIN ] USA: Generated 138 derivative records from 36378 primary records. [2025-10-22T23:39:13.229348] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-22T23:39:13.241055] [DEBUG] [LOCAL ] USA: Derivative data saved (138 records). [2025-10-22T23:39:13.241144] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-22T23:39:13.245294] [INFO ] [MAIN ] Derivative Progress: 1888/2052 symbols. USA took 0.5s. Estimated remaining time: 1m 5s [2025-10-22T23:39:13.245404] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:13.270224] [DEBUG] [LOCAL ] USAC: Loaded 21590 existing records from primary storage. [2025-10-22T23:39:13.270421] [INFO ] [MAIN ] USAC: Loaded 21590 primary data records. [2025-10-22T23:39:13.597890] [DEBUG] [MAIN ] USAC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:39:13.624152] [INFO ] [MAIN ] USAC: Generated 138 derivative records from 21590 primary records. [2025-10-22T23:39:13.624364] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-22T23:39:13.636495] [DEBUG] [LOCAL ] USAC: Derivative data saved (138 records). [2025-10-22T23:39:13.636592] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-22T23:39:13.640582] [INFO ] [MAIN ] Derivative Progress: 1889/2052 symbols. USAC took 0.4s. Estimated remaining time: 1m 4s [2025-10-22T23:39:13.640732] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:13.696960] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-22T23:39:13.697218] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-10-22T23:39:14.068175] [DEBUG] [MAIN ] USB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:14.095487] [INFO ] [MAIN ] USB: Generated 138 derivative records from 53688 primary records. [2025-10-22T23:39:14.095760] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-22T23:39:14.108039] [DEBUG] [LOCAL ] USB: Derivative data saved (138 records). [2025-10-22T23:39:14.108125] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-22T23:39:14.112455] [INFO ] [MAIN ] Derivative Progress: 1890/2052 symbols. USB took 0.5s. Estimated remaining time: 1m 4s [2025-10-22T23:39:14.112561] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:14.165631] [DEBUG] [LOCAL ] USFD: Loaded 51132 existing records from primary storage. [2025-10-22T23:39:14.165899] [INFO ] [MAIN ] USFD: Loaded 51132 primary data records. [2025-10-22T23:39:14.506609] [DEBUG] [MAIN ] USFD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:14.534515] [INFO ] [MAIN ] USFD: Generated 138 derivative records from 51132 primary records. [2025-10-22T23:39:14.534785] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-22T23:39:14.547045] [DEBUG] [LOCAL ] USFD: Derivative data saved (138 records). [2025-10-22T23:39:14.547199] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-22T23:39:14.551325] [INFO ] [MAIN ] Derivative Progress: 1891/2052 symbols. USFD took 0.4s. Estimated remaining time: 1m 4s [2025-10-22T23:39:14.551458] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:14.573323] [DEBUG] [LOCAL ] USNA: Loaded 17995 existing records from primary storage. [2025-10-22T23:39:14.573535] [INFO ] [MAIN ] USNA: Loaded 17995 primary data records. [2025-10-22T23:39:14.904836] [DEBUG] [MAIN ] USNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:14.931979] [INFO ] [MAIN ] USNA: Generated 138 derivative records from 17995 primary records. [2025-10-22T23:39:14.932267] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-22T23:39:14.945261] [DEBUG] [LOCAL ] USNA: Derivative data saved (138 records). [2025-10-22T23:39:14.945461] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-22T23:39:14.949033] [INFO ] [MAIN ] Derivative Progress: 1892/2052 symbols. USNA took 0.4s. Estimated remaining time: 1m 3s [2025-10-22T23:39:14.949155] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:14.972121] [DEBUG] [LOCAL ] USPH: Loaded 17006 existing records from primary storage. [2025-10-22T23:39:14.972348] [INFO ] [MAIN ] USPH: Loaded 17006 primary data records. [2025-10-22T23:39:15.288120] [DEBUG] [MAIN ] USPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:15.314022] [INFO ] [MAIN ] USPH: Generated 138 derivative records from 17006 primary records. [2025-10-22T23:39:15.314196] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-22T23:39:15.325843] [DEBUG] [LOCAL ] USPH: Derivative data saved (138 records). [2025-10-22T23:39:15.325955] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-22T23:39:15.329614] [INFO ] [MAIN ] Derivative Progress: 1893/2052 symbols. USPH took 0.4s. Estimated remaining time: 1m 3s [2025-10-22T23:39:15.329792] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:15.362147] [DEBUG] [LOCAL ] UTF: Loaded 30943 existing records from primary storage. [2025-10-22T23:39:15.362362] [INFO ] [MAIN ] UTF: Loaded 30943 primary data records. [2025-10-22T23:39:15.674027] [DEBUG] [MAIN ] UTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:15.701831] [INFO ] [MAIN ] UTF: Generated 138 derivative records from 30943 primary records. [2025-10-22T23:39:15.702064] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-22T23:39:15.714851] [DEBUG] [LOCAL ] UTF: Derivative data saved (138 records). [2025-10-22T23:39:15.714959] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-22T23:39:15.719150] [INFO ] [MAIN ] Derivative Progress: 1894/2052 symbols. UTF took 0.4s. Estimated remaining time: 1m 2s [2025-10-22T23:39:15.719272] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:15.737023] [DEBUG] [LOCAL ] UTL: Loaded 11858 existing records from primary storage. [2025-10-22T23:39:15.737225] [INFO ] [MAIN ] UTL: Loaded 11858 primary data records. [2025-10-22T23:39:16.081460] [DEBUG] [MAIN ] UTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:16.107712] [INFO ] [MAIN ] UTL: Generated 138 derivative records from 11858 primary records. [2025-10-22T23:39:16.107893] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-22T23:39:16.119470] [DEBUG] [LOCAL ] UTL: Derivative data saved (138 records). [2025-10-22T23:39:16.119564] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-22T23:39:16.122491] [INFO ] [MAIN ] Derivative Progress: 1895/2052 symbols. UTL took 0.4s. Estimated remaining time: 1m 2s [2025-10-22T23:39:16.122618] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:16.166436] [DEBUG] [LOCAL ] UTZ: Loaded 44265 existing records from primary storage. [2025-10-22T23:39:16.166610] [INFO ] [MAIN ] UTZ: Loaded 44265 primary data records. [2025-10-22T23:39:16.472873] [DEBUG] [MAIN ] UTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:16.498620] [INFO ] [MAIN ] UTZ: Generated 138 derivative records from 44265 primary records. [2025-10-22T23:39:16.498831] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-22T23:39:16.510412] [DEBUG] [LOCAL ] UTZ: Derivative data saved (138 records). [2025-10-22T23:39:16.510501] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-22T23:39:16.513252] [INFO ] [MAIN ] Derivative Progress: 1896/2052 symbols. UTZ took 0.4s. Estimated remaining time: 1m 2s [2025-10-22T23:39:16.513367] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:16.536285] [DEBUG] [LOCAL ] UVE: Loaded 21957 existing records from primary storage. [2025-10-22T23:39:16.536453] [INFO ] [MAIN ] UVE: Loaded 21957 primary data records. [2025-10-22T23:39:16.845493] [DEBUG] [MAIN ] UVE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:16.870951] [INFO ] [MAIN ] UVE: Generated 138 derivative records from 21957 primary records. [2025-10-22T23:39:16.871096] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-22T23:39:16.882810] [DEBUG] [LOCAL ] UVE: Derivative data saved (138 records). [2025-10-22T23:39:16.882900] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-10-22T23:39:16.885794] [INFO ] [MAIN ] Derivative Progress: 1897/2052 symbols. UVE took 0.4s. Estimated remaining time: 1m 1s [2025-10-22T23:39:16.885929] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:16.909075] [DEBUG] [LOCAL ] UVV: Loaded 22770 existing records from primary storage. [2025-10-22T23:39:16.909241] [INFO ] [MAIN ] UVV: Loaded 22770 primary data records. [2025-10-22T23:39:17.216571] [DEBUG] [MAIN ] UVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:17.241473] [INFO ] [MAIN ] UVV: Generated 138 derivative records from 22770 primary records. [2025-10-22T23:39:17.241621] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-22T23:39:17.253019] [DEBUG] [LOCAL ] UVV: Derivative data saved (138 records). [2025-10-22T23:39:17.253102] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-22T23:39:17.255938] [INFO ] [MAIN ] Derivative Progress: 1898/2052 symbols. UVV took 0.4s. Estimated remaining time: 1m 1s [2025-10-22T23:39:17.256035] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:17.307148] [DEBUG] [LOCAL ] UWMC: Loaded 52960 existing records from primary storage. [2025-10-22T23:39:17.307330] [INFO ] [MAIN ] UWMC: Loaded 52960 primary data records. [2025-10-22T23:39:17.610724] [DEBUG] [MAIN ] UWMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:17.635755] [INFO ] [MAIN ] UWMC: Generated 138 derivative records from 52960 primary records. [2025-10-22T23:39:17.635917] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-22T23:39:17.647309] [DEBUG] [LOCAL ] UWMC: Derivative data saved (138 records). [2025-10-22T23:39:17.647391] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-22T23:39:17.650560] [INFO ] [MAIN ] Derivative Progress: 1899/2052 symbols. UWMC took 0.4s. Estimated remaining time: 1m 0s [2025-10-22T23:39:17.650725] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:17.660712] [DEBUG] [LOCAL ] UZD: Loaded 5801 existing records from primary storage. [2025-10-22T23:39:17.660847] [INFO ] [MAIN ] UZD: Loaded 5801 primary data records. [2025-10-22T23:39:17.964394] [DEBUG] [MAIN ] UZD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:17.989321] [INFO ] [MAIN ] UZD: Generated 138 derivative records from 5801 primary records. [2025-10-22T23:39:17.989460] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-22T23:39:17.999617] [DEBUG] [LOCAL ] UZD: Derivative data saved (138 records). [2025-10-22T23:39:17.999716] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-22T23:39:18.001854] [INFO ] [MAIN ] Derivative Progress: 1900/2052 symbols. UZD took 0.4s. Estimated remaining time: 60.0s [2025-10-22T23:39:18.001992] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:18.012431] [DEBUG] [LOCAL ] UZE: Loaded 6947 existing records from primary storage. [2025-10-22T23:39:18.012564] [INFO ] [MAIN ] UZE: Loaded 6947 primary data records. [2025-10-22T23:39:18.333601] [DEBUG] [MAIN ] UZE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:18.359848] [INFO ] [MAIN ] UZE: Generated 138 derivative records from 6947 primary records. [2025-10-22T23:39:18.360037] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-22T23:39:18.371087] [DEBUG] [LOCAL ] UZE: Derivative data saved (138 records). [2025-10-22T23:39:18.371171] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-22T23:39:18.373416] [INFO ] [MAIN ] Derivative Progress: 1901/2052 symbols. UZE took 0.4s. Estimated remaining time: 59.6s [2025-10-22T23:39:18.373515] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:18.429123] [DEBUG] [LOCAL ] V: Loaded 53751 existing records from primary storage. [2025-10-22T23:39:18.429290] [INFO ] [MAIN ] V: Loaded 53751 primary data records. [2025-10-22T23:39:18.745874] [DEBUG] [MAIN ] V: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:18.772268] [INFO ] [MAIN ] V: Generated 138 derivative records from 53751 primary records. [2025-10-22T23:39:18.772409] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-22T23:39:18.784297] [DEBUG] [LOCAL ] V: Derivative data saved (138 records). [2025-10-22T23:39:18.784378] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-22T23:39:18.787915] [INFO ] [MAIN ] Derivative Progress: 1902/2052 symbols. V took 0.4s. Estimated remaining time: 59.2s [2025-10-22T23:39:18.788046] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:18.823258] [DEBUG] [LOCAL ] VAC: Loaded 33667 existing records from primary storage. [2025-10-22T23:39:18.823415] [INFO ] [MAIN ] VAC: Loaded 33667 primary data records. [2025-10-22T23:39:19.133293] [DEBUG] [MAIN ] VAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:19.158326] [INFO ] [MAIN ] VAC: Generated 138 derivative records from 33667 primary records. [2025-10-22T23:39:19.158461] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-22T23:39:19.169913] [DEBUG] [LOCAL ] VAC: Derivative data saved (138 records). [2025-10-22T23:39:19.169999] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-22T23:39:19.172918] [INFO ] [MAIN ] Derivative Progress: 1903/2052 symbols. VAC took 0.4s. Estimated remaining time: 58.8s [2025-10-22T23:39:19.173016] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:19.219805] [DEBUG] [LOCAL ] VAL: Loaded 49858 existing records from primary storage. [2025-10-22T23:39:19.219978] [INFO ] [MAIN ] VAL: Loaded 49858 primary data records. [2025-10-22T23:39:19.533174] [DEBUG] [MAIN ] VAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:19.558322] [INFO ] [MAIN ] VAL: Generated 138 derivative records from 49858 primary records. [2025-10-22T23:39:19.558457] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-22T23:39:19.569896] [DEBUG] [LOCAL ] VAL: Derivative data saved (138 records). [2025-10-22T23:39:19.569978] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-22T23:39:19.573003] [INFO ] [MAIN ] Derivative Progress: 1904/2052 symbols. VAL took 0.4s. Estimated remaining time: 58.4s [2025-10-22T23:39:19.573103] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:19.625300] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-22T23:39:19.625465] [INFO ] [MAIN ] VALE: Loaded 53693 primary data records. [2025-10-22T23:39:19.930015] [DEBUG] [MAIN ] VALE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:19.955270] [INFO ] [MAIN ] VALE: Generated 138 derivative records from 53693 primary records. [2025-10-22T23:39:19.955412] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-22T23:39:19.967169] [DEBUG] [LOCAL ] VALE: Derivative data saved (138 records). [2025-10-22T23:39:19.967277] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-22T23:39:19.970414] [INFO ] [MAIN ] Derivative Progress: 1905/2052 symbols. VALE took 0.4s. Estimated remaining time: 58.0s [2025-10-22T23:39:19.970533] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:19.979734] [DEBUG] [LOCAL ] VATE: Loaded 5039 existing records from primary storage. [2025-10-22T23:39:19.979880] [INFO ] [MAIN ] VATE: Loaded 5039 primary data records. [2025-10-22T23:39:20.308380] [DEBUG] [MAIN ] VATE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:20.334030] [INFO ] [MAIN ] VATE: Generated 138 derivative records from 5039 primary records. [2025-10-22T23:39:20.334164] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-22T23:39:20.343811] [DEBUG] [LOCAL ] VATE: Derivative data saved (138 records). [2025-10-22T23:39:20.343895] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-22T23:39:20.346107] [INFO ] [MAIN ] Derivative Progress: 1906/2052 symbols. VATE took 0.4s. Estimated remaining time: 57.6s [2025-10-22T23:39:20.346204] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:20.356128] [DEBUG] [LOCAL ] VBF: Loaded 7200 existing records from primary storage. [2025-10-22T23:39:20.356264] [INFO ] [MAIN ] VBF: Loaded 7200 primary data records. [2025-10-22T23:39:20.656235] [DEBUG] [MAIN ] VBF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:20.681185] [INFO ] [MAIN ] VBF: Generated 138 derivative records from 7200 primary records. [2025-10-22T23:39:20.681318] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-22T23:39:20.692319] [DEBUG] [LOCAL ] VBF: Derivative data saved (138 records). [2025-10-22T23:39:20.692400] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-22T23:39:20.694562] [INFO ] [MAIN ] Derivative Progress: 1907/2052 symbols. VBF took 0.3s. Estimated remaining time: 57.2s [2025-10-22T23:39:20.694681] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:20.709764] [DEBUG] [LOCAL ] VCV: Loaded 13198 existing records from primary storage. [2025-10-22T23:39:20.709902] [INFO ] [MAIN ] VCV: Loaded 13198 primary data records. [2025-10-22T23:39:21.009940] [DEBUG] [MAIN ] VCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:21.034989] [INFO ] [MAIN ] VCV: Generated 138 derivative records from 13198 primary records. [2025-10-22T23:39:21.035121] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-22T23:39:21.046244] [DEBUG] [LOCAL ] VCV: Derivative data saved (138 records). [2025-10-22T23:39:21.046344] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-10-22T23:39:21.049148] [INFO ] [MAIN ] Derivative Progress: 1908/2052 symbols. VCV took 0.4s. Estimated remaining time: 56.8s [2025-10-22T23:39:21.049279] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:21.093745] [DEBUG] [LOCAL ] VEEV: Loaded 47109 existing records from primary storage. [2025-10-22T23:39:21.093915] [INFO ] [MAIN ] VEEV: Loaded 47109 primary data records. [2025-10-22T23:39:21.398316] [DEBUG] [MAIN ] VEEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:21.423565] [INFO ] [MAIN ] VEEV: Generated 138 derivative records from 47109 primary records. [2025-10-22T23:39:21.423727] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-22T23:39:21.435473] [DEBUG] [LOCAL ] VEEV: Derivative data saved (138 records). [2025-10-22T23:39:21.435555] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-22T23:39:21.438696] [INFO ] [MAIN ] Derivative Progress: 1909/2052 symbols. VEEV took 0.4s. Estimated remaining time: 56.4s [2025-10-22T23:39:21.438796] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:21.454307] [DEBUG] [LOCAL ] VEL: Loaded 11927 existing records from primary storage. [2025-10-22T23:39:21.454435] [INFO ] [MAIN ] VEL: Loaded 11927 primary data records. [2025-10-22T23:39:21.762141] [DEBUG] [MAIN ] VEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:21.787477] [INFO ] [MAIN ] VEL: Generated 138 derivative records from 11927 primary records. [2025-10-22T23:39:21.787621] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-22T23:39:21.799264] [DEBUG] [LOCAL ] VEL: Derivative data saved (138 records). [2025-10-22T23:39:21.799346] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-22T23:39:21.802023] [INFO ] [MAIN ] Derivative Progress: 1910/2052 symbols. VEL took 0.4s. Estimated remaining time: 56.0s [2025-10-22T23:39:21.802118] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:21.846014] [DEBUG] [LOCAL ] VET: Loaded 44082 existing records from primary storage. [2025-10-22T23:39:21.846172] [INFO ] [MAIN ] VET: Loaded 44082 primary data records. [2025-10-22T23:39:22.177468] [DEBUG] [MAIN ] VET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:22.202780] [INFO ] [MAIN ] VET: Generated 138 derivative records from 44082 primary records. [2025-10-22T23:39:22.202945] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-22T23:39:22.214208] [DEBUG] [LOCAL ] VET: Derivative data saved (138 records). [2025-10-22T23:39:22.214289] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-22T23:39:22.217261] [INFO ] [MAIN ] Derivative Progress: 1911/2052 symbols. VET took 0.4s. Estimated remaining time: 55.6s [2025-10-22T23:39:22.217364] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:22.272543] [DEBUG] [LOCAL ] VFC: Loaded 53607 existing records from primary storage. [2025-10-22T23:39:22.272739] [INFO ] [MAIN ] VFC: Loaded 53607 primary data records. [2025-10-22T23:39:22.575334] [DEBUG] [MAIN ] VFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:22.600434] [INFO ] [MAIN ] VFC: Generated 138 derivative records from 53607 primary records. [2025-10-22T23:39:22.600557] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-22T23:39:22.612326] [DEBUG] [LOCAL ] VFC: Derivative data saved (138 records). [2025-10-22T23:39:22.612409] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-22T23:39:22.615566] [INFO ] [MAIN ] Derivative Progress: 1912/2052 symbols. VFC took 0.4s. Estimated remaining time: 55.2s [2025-10-22T23:39:22.615700] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:22.624827] [DEBUG] [LOCAL ] VGI: Loaded 5213 existing records from primary storage. [2025-10-22T23:39:22.624946] [INFO ] [MAIN ] VGI: Loaded 5213 primary data records. [2025-10-22T23:39:22.928436] [DEBUG] [MAIN ] VGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:22.954048] [INFO ] [MAIN ] VGI: Generated 138 derivative records from 5213 primary records. [2025-10-22T23:39:22.954235] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-22T23:39:22.964428] [DEBUG] [LOCAL ] VGI: Derivative data saved (138 records). [2025-10-22T23:39:22.964548] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-22T23:39:22.966593] [INFO ] [MAIN ] Derivative Progress: 1913/2052 symbols. VGI took 0.4s. Estimated remaining time: 54.8s [2025-10-22T23:39:22.966745] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:22.986423] [DEBUG] [LOCAL ] VGM: Loaded 18643 existing records from primary storage. [2025-10-22T23:39:22.986577] [INFO ] [MAIN ] VGM: Loaded 18643 primary data records. [2025-10-22T23:39:23.299397] [DEBUG] [MAIN ] VGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:23.324970] [INFO ] [MAIN ] VGM: Generated 138 derivative records from 18643 primary records. [2025-10-22T23:39:23.325110] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-22T23:39:23.336332] [DEBUG] [LOCAL ] VGM: Derivative data saved (138 records). [2025-10-22T23:39:23.336416] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-22T23:39:23.339247] [INFO ] [MAIN ] Derivative Progress: 1914/2052 symbols. VGM took 0.4s. Estimated remaining time: 54.4s [2025-10-22T23:39:23.339349] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:23.344816] [DEBUG] [LOCAL ] VHI: Loaded 2673 existing records from primary storage. [2025-10-22T23:39:23.344902] [INFO ] [MAIN ] VHI: Loaded 2673 primary data records. [2025-10-22T23:39:23.649422] [DEBUG] [MAIN ] VHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:23.674567] [INFO ] [MAIN ] VHI: Generated 138 derivative records from 2673 primary records. [2025-10-22T23:39:23.674711] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-22T23:39:23.684539] [DEBUG] [LOCAL ] VHI: Derivative data saved (138 records). [2025-10-22T23:39:23.684624] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-22T23:39:23.686804] [INFO ] [MAIN ] Derivative Progress: 1915/2052 symbols. VHI took 0.3s. Estimated remaining time: 54.0s [2025-10-22T23:39:23.686901] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:23.740772] [DEBUG] [LOCAL ] VICI: Loaded 53653 existing records from primary storage. [2025-10-22T23:39:23.740934] [INFO ] [MAIN ] VICI: Loaded 53653 primary data records. [2025-10-22T23:39:24.074151] [DEBUG] [MAIN ] VICI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:24.099551] [INFO ] [MAIN ] VICI: Generated 138 derivative records from 53653 primary records. [2025-10-22T23:39:24.099731] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-22T23:39:24.111166] [DEBUG] [LOCAL ] VICI: Derivative data saved (138 records). [2025-10-22T23:39:24.111248] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-22T23:39:24.114469] [INFO ] [MAIN ] Derivative Progress: 1916/2052 symbols. VICI took 0.4s. Estimated remaining time: 53.6s [2025-10-22T23:39:24.114563] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:24.166582] [DEBUG] [LOCAL ] VIK: Loaded 52371 existing records from primary storage. [2025-10-22T23:39:24.166775] [INFO ] [MAIN ] VIK: Loaded 52371 primary data records. [2025-10-22T23:39:24.485316] [DEBUG] [MAIN ] VIK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:24.510833] [INFO ] [MAIN ] VIK: Generated 138 derivative records from 52371 primary records. [2025-10-22T23:39:24.511018] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-22T23:39:24.526601] [DEBUG] [LOCAL ] VIK: Derivative data saved (138 records). [2025-10-22T23:39:24.526805] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-22T23:39:24.530881] [INFO ] [MAIN ] Derivative Progress: 1917/2052 symbols. VIK took 0.4s. Estimated remaining time: 53.2s [2025-10-22T23:39:24.531063] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:24.591368] [DEBUG] [LOCAL ] VIPS: Loaded 51251 existing records from primary storage. [2025-10-22T23:39:24.591555] [INFO ] [MAIN ] VIPS: Loaded 51251 primary data records. [2025-10-22T23:39:24.921579] [DEBUG] [MAIN ] VIPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:24.947613] [INFO ] [MAIN ] VIPS: Generated 138 derivative records from 51251 primary records. [2025-10-22T23:39:24.947813] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-22T23:39:24.959548] [DEBUG] [LOCAL ] VIPS: Derivative data saved (138 records). [2025-10-22T23:39:24.959679] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-10-22T23:39:24.962917] [INFO ] [MAIN ] Derivative Progress: 1918/2052 symbols. VIPS took 0.4s. Estimated remaining time: 52.8s [2025-10-22T23:39:24.963037] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:25.006231] [DEBUG] [LOCAL ] VIRT: Loaded 46460 existing records from primary storage. [2025-10-22T23:39:25.006390] [INFO ] [MAIN ] VIRT: Loaded 46460 primary data records. [2025-10-22T23:39:25.311054] [DEBUG] [MAIN ] VIRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:25.336252] [INFO ] [MAIN ] VIRT: Generated 138 derivative records from 46460 primary records. [2025-10-22T23:39:25.336393] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-22T23:39:25.347902] [DEBUG] [LOCAL ] VIRT: Derivative data saved (138 records). [2025-10-22T23:39:25.347985] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-10-22T23:39:25.350671] [INFO ] [MAIN ] Derivative Progress: 1919/2052 symbols. VIRT took 0.4s. Estimated remaining time: 52.4s [2025-10-22T23:39:25.350768] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:25.394959] [DEBUG] [LOCAL ] VIST: Loaded 46640 existing records from primary storage. [2025-10-22T23:39:25.395120] [INFO ] [MAIN ] VIST: Loaded 46640 primary data records. [2025-10-22T23:39:25.699225] [DEBUG] [MAIN ] VIST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:25.724721] [INFO ] [MAIN ] VIST: Generated 138 derivative records from 46640 primary records. [2025-10-22T23:39:25.724886] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-22T23:39:25.736488] [DEBUG] [LOCAL ] VIST: Derivative data saved (138 records). [2025-10-22T23:39:25.736569] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-22T23:39:25.739423] [INFO ] [MAIN ] Derivative Progress: 1920/2052 symbols. VIST took 0.4s. Estimated remaining time: 52.1s [2025-10-22T23:39:25.739516] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:25.782804] [DEBUG] [LOCAL ] VIV: Loaded 44584 existing records from primary storage. [2025-10-22T23:39:25.782964] [INFO ] [MAIN ] VIV: Loaded 44584 primary data records. [2025-10-22T23:39:26.089032] [DEBUG] [MAIN ] VIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:26.114386] [INFO ] [MAIN ] VIV: Generated 138 derivative records from 44584 primary records. [2025-10-22T23:39:26.114533] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-22T23:39:26.126287] [DEBUG] [LOCAL ] VIV: Derivative data saved (138 records). [2025-10-22T23:39:26.126369] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-22T23:39:26.129119] [INFO ] [MAIN ] Derivative Progress: 1921/2052 symbols. VIV took 0.4s. Estimated remaining time: 51.7s [2025-10-22T23:39:26.129220] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:26.149213] [DEBUG] [LOCAL ] VKQ: Loaded 17853 existing records from primary storage. [2025-10-22T23:39:26.149365] [INFO ] [MAIN ] VKQ: Loaded 17853 primary data records. [2025-10-22T23:39:26.480998] [DEBUG] [MAIN ] VKQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:26.506019] [INFO ] [MAIN ] VKQ: Generated 138 derivative records from 17853 primary records. [2025-10-22T23:39:26.506159] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-22T23:39:26.517288] [DEBUG] [LOCAL ] VKQ: Derivative data saved (138 records). [2025-10-22T23:39:26.517370] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-10-22T23:39:26.520085] [INFO ] [MAIN ] Derivative Progress: 1922/2052 symbols. VKQ took 0.4s. Estimated remaining time: 51.3s [2025-10-22T23:39:26.520197] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:26.551087] [DEBUG] [LOCAL ] VLN: Loaded 31057 existing records from primary storage. [2025-10-22T23:39:26.551245] [INFO ] [MAIN ] VLN: Loaded 31057 primary data records. [2025-10-22T23:39:26.854756] [DEBUG] [MAIN ] VLN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:26.879755] [INFO ] [MAIN ] VLN: Generated 138 derivative records from 31057 primary records. [2025-10-22T23:39:26.879889] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-22T23:39:26.891252] [DEBUG] [LOCAL ] VLN: Derivative data saved (138 records). [2025-10-22T23:39:26.891331] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-22T23:39:26.894186] [INFO ] [MAIN ] Derivative Progress: 1923/2052 symbols. VLN took 0.4s. Estimated remaining time: 50.9s [2025-10-22T23:39:26.894286] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:26.953199] [DEBUG] [LOCAL ] VLO: Loaded 52956 existing records from primary storage. [2025-10-22T23:39:26.953359] [INFO ] [MAIN ] VLO: Loaded 52956 primary data records. [2025-10-22T23:39:27.258589] [DEBUG] [MAIN ] VLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:27.283617] [INFO ] [MAIN ] VLO: Generated 138 derivative records from 52956 primary records. [2025-10-22T23:39:27.283755] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-22T23:39:27.295501] [DEBUG] [LOCAL ] VLO: Derivative data saved (138 records). [2025-10-22T23:39:27.295585] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-22T23:39:27.298784] [INFO ] [MAIN ] Derivative Progress: 1924/2052 symbols. VLO took 0.4s. Estimated remaining time: 50.5s [2025-10-22T23:39:27.298887] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:27.337210] [DEBUG] [LOCAL ] VLRS: Loaded 39240 existing records from primary storage. [2025-10-22T23:39:27.337408] [INFO ] [MAIN ] VLRS: Loaded 39240 primary data records. [2025-10-22T23:39:27.642760] [DEBUG] [MAIN ] VLRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:27.667930] [INFO ] [MAIN ] VLRS: Generated 138 derivative records from 39240 primary records. [2025-10-22T23:39:27.668052] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-22T23:39:27.679289] [DEBUG] [LOCAL ] VLRS: Derivative data saved (138 records). [2025-10-22T23:39:27.679367] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-22T23:39:27.682366] [INFO ] [MAIN ] Derivative Progress: 1925/2052 symbols. VLRS took 0.4s. Estimated remaining time: 50.1s [2025-10-22T23:39:27.682480] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:27.691426] [DEBUG] [LOCAL ] VLT: Loaded 4282 existing records from primary storage. [2025-10-22T23:39:27.691535] [INFO ] [MAIN ] VLT: Loaded 4282 primary data records. [2025-10-22T23:39:28.000226] [DEBUG] [MAIN ] VLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:28.025270] [INFO ] [MAIN ] VLT: Generated 138 derivative records from 4282 primary records. [2025-10-22T23:39:28.025419] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-22T23:39:28.035943] [DEBUG] [LOCAL ] VLT: Derivative data saved (138 records). [2025-10-22T23:39:28.036023] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-22T23:39:28.038206] [INFO ] [MAIN ] Derivative Progress: 1926/2052 symbols. VLT took 0.4s. Estimated remaining time: 49.7s [2025-10-22T23:39:28.038303] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:28.084494] [DEBUG] [LOCAL ] VLTO: Loaded 46055 existing records from primary storage. [2025-10-22T23:39:28.084679] [INFO ] [MAIN ] VLTO: Loaded 46055 primary data records. [2025-10-22T23:39:28.414465] [DEBUG] [MAIN ] VLTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:28.439971] [INFO ] [MAIN ] VLTO: Generated 138 derivative records from 46055 primary records. [2025-10-22T23:39:28.440088] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-22T23:39:28.452034] [DEBUG] [LOCAL ] VLTO: Derivative data saved (138 records). [2025-10-22T23:39:28.452114] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-22T23:39:28.455378] [INFO ] [MAIN ] Derivative Progress: 1927/2052 symbols. VLTO took 0.4s. Estimated remaining time: 49.3s [2025-10-22T23:39:28.455475] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:28.495813] [DEBUG] [LOCAL ] VMC: Loaded 42153 existing records from primary storage. [2025-10-22T23:39:28.495972] [INFO ] [MAIN ] VMC: Loaded 42153 primary data records. [2025-10-22T23:39:28.805442] [DEBUG] [MAIN ] VMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:28.830494] [INFO ] [MAIN ] VMC: Generated 138 derivative records from 42153 primary records. [2025-10-22T23:39:28.830602] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-22T23:39:28.842371] [DEBUG] [LOCAL ] VMC: Derivative data saved (138 records). [2025-10-22T23:39:28.842448] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-22T23:39:28.845387] [INFO ] [MAIN ] Derivative Progress: 1928/2052 symbols. VMC took 0.4s. Estimated remaining time: 48.9s [2025-10-22T23:39:28.845485] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:28.863398] [DEBUG] [LOCAL ] VMI: Loaded 14939 existing records from primary storage. [2025-10-22T23:39:28.863532] [INFO ] [MAIN ] VMI: Loaded 14939 primary data records. [2025-10-22T23:39:29.167103] [DEBUG] [MAIN ] VMI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:39:29.192551] [INFO ] [MAIN ] VMI: Generated 138 derivative records from 14939 primary records. [2025-10-22T23:39:29.192694] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-22T23:39:29.204023] [DEBUG] [LOCAL ] VMI: Derivative data saved (138 records). [2025-10-22T23:39:29.204101] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-22T23:39:29.206782] [INFO ] [MAIN ] Derivative Progress: 1929/2052 symbols. VMI took 0.4s. Estimated remaining time: 48.5s [2025-10-22T23:39:29.206878] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:29.227771] [DEBUG] [LOCAL ] VMO: Loaded 20692 existing records from primary storage. [2025-10-22T23:39:29.227933] [INFO ] [MAIN ] VMO: Loaded 20692 primary data records. [2025-10-22T23:39:29.533064] [DEBUG] [MAIN ] VMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:29.558712] [INFO ] [MAIN ] VMO: Generated 138 derivative records from 20692 primary records. [2025-10-22T23:39:29.558829] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-22T23:39:29.569895] [DEBUG] [LOCAL ] VMO: Derivative data saved (138 records). [2025-10-22T23:39:29.569974] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-10-22T23:39:29.572781] [INFO ] [MAIN ] Derivative Progress: 1930/2052 symbols. VMO took 0.4s. Estimated remaining time: 48.1s [2025-10-22T23:39:29.572878] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:29.618479] [DEBUG] [LOCAL ] VNO: Loaded 48826 existing records from primary storage. [2025-10-22T23:39:29.618639] [INFO ] [MAIN ] VNO: Loaded 48826 primary data records. [2025-10-22T23:39:29.941418] [DEBUG] [MAIN ] VNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:29.966555] [INFO ] [MAIN ] VNO: Generated 138 derivative records from 48826 primary records. [2025-10-22T23:39:29.966725] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-22T23:39:29.978430] [DEBUG] [LOCAL ] VNO: Derivative data saved (138 records). [2025-10-22T23:39:29.978514] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-22T23:39:29.981510] [INFO ] [MAIN ] Derivative Progress: 1931/2052 symbols. VNO took 0.4s. Estimated remaining time: 47.7s [2025-10-22T23:39:29.981608] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:30.023791] [DEBUG] [LOCAL ] VNT: Loaded 43884 existing records from primary storage. [2025-10-22T23:39:30.023958] [INFO ] [MAIN ] VNT: Loaded 43884 primary data records. [2025-10-22T23:39:30.358461] [DEBUG] [MAIN ] VNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:30.384672] [INFO ] [MAIN ] VNT: Generated 138 derivative records from 43884 primary records. [2025-10-22T23:39:30.384869] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-22T23:39:30.396584] [DEBUG] [LOCAL ] VNT: Derivative data saved (138 records). [2025-10-22T23:39:30.396764] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-22T23:39:30.399747] [INFO ] [MAIN ] Derivative Progress: 1932/2052 symbols. VNT took 0.4s. Estimated remaining time: 47.3s [2025-10-22T23:39:30.399895] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:30.412996] [DEBUG] [LOCAL ] VOC: Loaded 9041 existing records from primary storage. [2025-10-22T23:39:30.413172] [INFO ] [MAIN ] VOC: Loaded 9041 primary data records. [2025-10-22T23:39:30.725191] [DEBUG] [MAIN ] VOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:30.751159] [INFO ] [MAIN ] VOC: Generated 138 derivative records from 9041 primary records. [2025-10-22T23:39:30.751336] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-22T23:39:30.763197] [DEBUG] [LOCAL ] VOC: Derivative data saved (138 records). [2025-10-22T23:39:30.763294] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-22T23:39:30.765478] [INFO ] [MAIN ] Derivative Progress: 1933/2052 symbols. VOC took 0.4s. Estimated remaining time: 46.9s [2025-10-22T23:39:30.765589] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:30.806322] [DEBUG] [LOCAL ] VOYA: Loaded 41801 existing records from primary storage. [2025-10-22T23:39:30.806493] [INFO ] [MAIN ] VOYA: Loaded 41801 primary data records. [2025-10-22T23:39:31.116514] [DEBUG] [MAIN ] VOYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:31.142194] [INFO ] [MAIN ] VOYA: Generated 138 derivative records from 41801 primary records. [2025-10-22T23:39:31.142428] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-22T23:39:31.154060] [DEBUG] [LOCAL ] VOYA: Derivative data saved (138 records). [2025-10-22T23:39:31.154142] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-22T23:39:31.157257] [INFO ] [MAIN ] Derivative Progress: 1934/2052 symbols. VOYA took 0.4s. Estimated remaining time: 46.5s [2025-10-22T23:39:31.157382] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:31.177365] [DEBUG] [LOCAL ] VPG: Loaded 16880 existing records from primary storage. [2025-10-22T23:39:31.177527] [INFO ] [MAIN ] VPG: Loaded 16880 primary data records. [2025-10-22T23:39:31.508985] [DEBUG] [MAIN ] VPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:31.535955] [INFO ] [MAIN ] VPG: Generated 138 derivative records from 16880 primary records. [2025-10-22T23:39:31.536149] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-22T23:39:31.548086] [DEBUG] [LOCAL ] VPG: Derivative data saved (138 records). [2025-10-22T23:39:31.548177] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-22T23:39:31.551066] [INFO ] [MAIN ] Derivative Progress: 1935/2052 symbols. VPG took 0.4s. Estimated remaining time: 46.1s [2025-10-22T23:39:31.551180] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:31.561201] [DEBUG] [LOCAL ] VPV: Loaded 5221 existing records from primary storage. [2025-10-22T23:39:31.561342] [INFO ] [MAIN ] VPV: Loaded 5221 primary data records. [2025-10-22T23:39:31.871576] [DEBUG] [MAIN ] VPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:31.899592] [INFO ] [MAIN ] VPV: Generated 138 derivative records from 5221 primary records. [2025-10-22T23:39:31.899802] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-22T23:39:31.910064] [DEBUG] [LOCAL ] VPV: Derivative data saved (138 records). [2025-10-22T23:39:31.910146] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-22T23:39:31.912436] [INFO ] [MAIN ] Derivative Progress: 1936/2052 symbols. VPV took 0.4s. Estimated remaining time: 45.7s [2025-10-22T23:39:31.912543] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:31.950159] [DEBUG] [LOCAL ] VRE: Loaded 35221 existing records from primary storage. [2025-10-22T23:39:31.950328] [INFO ] [MAIN ] VRE: Loaded 35221 primary data records. [2025-10-22T23:39:32.259501] [DEBUG] [MAIN ] VRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:32.285791] [INFO ] [MAIN ] VRE: Generated 138 derivative records from 35221 primary records. [2025-10-22T23:39:32.286049] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-22T23:39:32.299456] [DEBUG] [LOCAL ] VRE: Derivative data saved (138 records). [2025-10-22T23:39:32.299684] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-22T23:39:32.304044] [INFO ] [MAIN ] Derivative Progress: 1937/2052 symbols. VRE took 0.4s. Estimated remaining time: 45.3s [2025-10-22T23:39:32.304278] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:32.365200] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-22T23:39:32.365404] [INFO ] [MAIN ] VRT: Loaded 53753 primary data records. [2025-10-22T23:39:32.691738] [DEBUG] [MAIN ] VRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:32.717020] [INFO ] [MAIN ] VRT: Generated 138 derivative records from 53753 primary records. [2025-10-22T23:39:32.717307] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-22T23:39:32.729463] [DEBUG] [LOCAL ] VRT: Derivative data saved (138 records). [2025-10-22T23:39:32.729591] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-22T23:39:32.732870] [INFO ] [MAIN ] Derivative Progress: 1938/2052 symbols. VRT took 0.4s. Estimated remaining time: 44.9s [2025-10-22T23:39:32.732991] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:32.746883] [DEBUG] [LOCAL ] VRTS: Loaded 9371 existing records from primary storage. [2025-10-22T23:39:32.747036] [INFO ] [MAIN ] VRTS: Loaded 9371 primary data records. [2025-10-22T23:39:33.052866] [DEBUG] [MAIN ] VRTS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:39:33.078148] [INFO ] [MAIN ] VRTS: Generated 138 derivative records from 9371 primary records. [2025-10-22T23:39:33.078317] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-22T23:39:33.090169] [DEBUG] [LOCAL ] VRTS: Derivative data saved (138 records). [2025-10-22T23:39:33.090253] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-22T23:39:33.092466] [INFO ] [MAIN ] Derivative Progress: 1939/2052 symbols. VRTS took 0.4s. Estimated remaining time: 44.6s [2025-10-22T23:39:33.092558] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:33.147332] [DEBUG] [LOCAL ] VSCO: Loaded 52694 existing records from primary storage. [2025-10-22T23:39:33.147496] [INFO ] [MAIN ] VSCO: Loaded 52694 primary data records. [2025-10-22T23:39:33.453715] [DEBUG] [MAIN ] VSCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:33.478854] [INFO ] [MAIN ] VSCO: Generated 138 derivative records from 52694 primary records. [2025-10-22T23:39:33.478978] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-22T23:39:33.490878] [DEBUG] [LOCAL ] VSCO: Derivative data saved (138 records). [2025-10-22T23:39:33.490977] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-22T23:39:33.494199] [INFO ] [MAIN ] Derivative Progress: 1940/2052 symbols. VSCO took 0.4s. Estimated remaining time: 44.2s [2025-10-22T23:39:33.494299] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:33.541801] [DEBUG] [LOCAL ] VSH: Loaded 48228 existing records from primary storage. [2025-10-22T23:39:33.541969] [INFO ] [MAIN ] VSH: Loaded 48228 primary data records. [2025-10-22T23:39:33.858362] [DEBUG] [MAIN ] VSH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:33.886210] [INFO ] [MAIN ] VSH: Generated 138 derivative records from 48228 primary records. [2025-10-22T23:39:33.886392] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-22T23:39:33.898053] [DEBUG] [LOCAL ] VSH: Derivative data saved (138 records). [2025-10-22T23:39:33.898133] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-22T23:39:33.901180] [INFO ] [MAIN ] Derivative Progress: 1941/2052 symbols. VSH took 0.4s. Estimated remaining time: 43.8s [2025-10-22T23:39:33.901288] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:33.958268] [DEBUG] [LOCAL ] VST: Loaded 53709 existing records from primary storage. [2025-10-22T23:39:33.958427] [INFO ] [MAIN ] VST: Loaded 53709 primary data records. [2025-10-22T23:39:34.266166] [DEBUG] [MAIN ] VST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:34.291245] [INFO ] [MAIN ] VST: Generated 138 derivative records from 53709 primary records. [2025-10-22T23:39:34.291369] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-22T23:39:34.303101] [DEBUG] [LOCAL ] VST: Derivative data saved (138 records). [2025-10-22T23:39:34.303181] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-10-22T23:39:34.306247] [INFO ] [MAIN ] Derivative Progress: 1942/2052 symbols. VST took 0.4s. Estimated remaining time: 43.4s [2025-10-22T23:39:34.306350] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:34.351500] [DEBUG] [LOCAL ] VSTS: Loaded 48857 existing records from primary storage. [2025-10-22T23:39:34.351709] [INFO ] [MAIN ] VSTS: Loaded 48857 primary data records. [2025-10-22T23:39:34.676807] [DEBUG] [MAIN ] VSTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:34.702069] [INFO ] [MAIN ] VSTS: Generated 138 derivative records from 48857 primary records. [2025-10-22T23:39:34.702181] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-22T23:39:34.713163] [DEBUG] [LOCAL ] VSTS: Derivative data saved (138 records). [2025-10-22T23:39:34.713243] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-10-22T23:39:34.716227] [INFO ] [MAIN ] Derivative Progress: 1943/2052 symbols. VSTS took 0.4s. Estimated remaining time: 43.0s [2025-10-22T23:39:34.716325] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:34.755755] [DEBUG] [LOCAL ] VTEX: Loaded 42874 existing records from primary storage. [2025-10-22T23:39:34.755910] [INFO ] [MAIN ] VTEX: Loaded 42874 primary data records. [2025-10-22T23:39:35.063863] [DEBUG] [MAIN ] VTEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:35.090733] [INFO ] [MAIN ] VTEX: Generated 138 derivative records from 42874 primary records. [2025-10-22T23:39:35.090933] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-22T23:39:35.103259] [DEBUG] [LOCAL ] VTEX: Derivative data saved (138 records). [2025-10-22T23:39:35.103343] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-22T23:39:35.106416] [INFO ] [MAIN ] Derivative Progress: 1944/2052 symbols. VTEX took 0.4s. Estimated remaining time: 42.6s [2025-10-22T23:39:35.106527] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:35.156473] [DEBUG] [LOCAL ] VTLE: Loaded 47548 existing records from primary storage. [2025-10-22T23:39:35.156667] [INFO ] [MAIN ] VTLE: Loaded 47548 primary data records. [2025-10-22T23:39:35.489963] [DEBUG] [MAIN ] VTLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:35.517110] [INFO ] [MAIN ] VTLE: Generated 138 derivative records from 47548 primary records. [2025-10-22T23:39:35.517304] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-22T23:39:35.529624] [DEBUG] [LOCAL ] VTLE: Derivative data saved (138 records). [2025-10-22T23:39:35.529729] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-22T23:39:35.532748] [INFO ] [MAIN ] Derivative Progress: 1945/2052 symbols. VTLE took 0.4s. Estimated remaining time: 42.2s [2025-10-22T23:39:35.532854] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:35.553231] [DEBUG] [LOCAL ] VTMX: Loaded 17525 existing records from primary storage. [2025-10-22T23:39:35.553391] [INFO ] [MAIN ] VTMX: Loaded 17525 primary data records. [2025-10-22T23:39:35.860885] [DEBUG] [MAIN ] VTMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:35.886351] [INFO ] [MAIN ] VTMX: Generated 138 derivative records from 17525 primary records. [2025-10-22T23:39:35.886473] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-22T23:39:35.898235] [DEBUG] [LOCAL ] VTMX: Derivative data saved (138 records). [2025-10-22T23:39:35.898363] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-22T23:39:35.901065] [INFO ] [MAIN ] Derivative Progress: 1946/2052 symbols. VTMX took 0.4s. Estimated remaining time: 41.8s [2025-10-22T23:39:35.901205] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:35.912678] [DEBUG] [LOCAL ] VTN: Loaded 7114 existing records from primary storage. [2025-10-22T23:39:35.912820] [INFO ] [MAIN ] VTN: Loaded 7114 primary data records. [2025-10-22T23:39:36.216996] [DEBUG] [MAIN ] VTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:36.242367] [INFO ] [MAIN ] VTN: Generated 138 derivative records from 7114 primary records. [2025-10-22T23:39:36.242563] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-22T23:39:36.253313] [DEBUG] [LOCAL ] VTN: Derivative data saved (138 records). [2025-10-22T23:39:36.253397] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-22T23:39:36.255467] [INFO ] [MAIN ] Derivative Progress: 1947/2052 symbols. VTN took 0.4s. Estimated remaining time: 41.4s [2025-10-22T23:39:36.255566] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:36.275576] [DEBUG] [LOCAL ] VTOL: Loaded 19344 existing records from primary storage. [2025-10-22T23:39:36.275741] [INFO ] [MAIN ] VTOL: Loaded 19344 primary data records. [2025-10-22T23:39:36.607671] [DEBUG] [MAIN ] VTOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:36.632767] [INFO ] [MAIN ] VTOL: Generated 138 derivative records from 19344 primary records. [2025-10-22T23:39:36.632905] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-22T23:39:36.644406] [DEBUG] [LOCAL ] VTOL: Derivative data saved (138 records). [2025-10-22T23:39:36.644488] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-22T23:39:36.647383] [INFO ] [MAIN ] Derivative Progress: 1948/2052 symbols. VTOL took 0.4s. Estimated remaining time: 41.0s [2025-10-22T23:39:36.647501] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:36.702879] [DEBUG] [LOCAL ] VTR: Loaded 52678 existing records from primary storage. [2025-10-22T23:39:36.703046] [INFO ] [MAIN ] VTR: Loaded 52678 primary data records. [2025-10-22T23:39:37.007379] [DEBUG] [MAIN ] VTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:37.032975] [INFO ] [MAIN ] VTR: Generated 138 derivative records from 52678 primary records. [2025-10-22T23:39:37.033154] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-22T23:39:37.044712] [DEBUG] [LOCAL ] VTR: Derivative data saved (138 records). [2025-10-22T23:39:37.044800] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-22T23:39:37.047920] [INFO ] [MAIN ] Derivative Progress: 1949/2052 symbols. VTR took 0.4s. Estimated remaining time: 40.6s [2025-10-22T23:39:37.048033] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:37.078358] [DEBUG] [LOCAL ] VTS: Loaded 29835 existing records from primary storage. [2025-10-22T23:39:37.078515] [INFO ] [MAIN ] VTS: Loaded 29835 primary data records. [2025-10-22T23:39:37.403413] [DEBUG] [MAIN ] VTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:37.431251] [INFO ] [MAIN ] VTS: Generated 138 derivative records from 29835 primary records. [2025-10-22T23:39:37.431398] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-22T23:39:37.443849] [DEBUG] [LOCAL ] VTS: Derivative data saved (138 records). [2025-10-22T23:39:37.443935] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-22T23:39:37.446798] [INFO ] [MAIN ] Derivative Progress: 1950/2052 symbols. VTS took 0.4s. Estimated remaining time: 40.2s [2025-10-22T23:39:37.446915] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:37.478870] [DEBUG] [LOCAL ] VVR: Loaded 31188 existing records from primary storage. [2025-10-22T23:39:37.479030] [INFO ] [MAIN ] VVR: Loaded 31188 primary data records. [2025-10-22T23:39:37.799263] [DEBUG] [MAIN ] VVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:37.824418] [INFO ] [MAIN ] VVR: Generated 138 derivative records from 31188 primary records. [2025-10-22T23:39:37.824569] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-22T23:39:37.836046] [DEBUG] [LOCAL ] VVR: Derivative data saved (138 records). [2025-10-22T23:39:37.836127] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-22T23:39:37.839004] [INFO ] [MAIN ] Derivative Progress: 1951/2052 symbols. VVR took 0.4s. Estimated remaining time: 39.8s [2025-10-22T23:39:37.839102] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:37.888136] [DEBUG] [LOCAL ] VVV: Loaded 50131 existing records from primary storage. [2025-10-22T23:39:37.888298] [INFO ] [MAIN ] VVV: Loaded 50131 primary data records. [2025-10-22T23:39:38.196191] [DEBUG] [MAIN ] VVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:38.221066] [INFO ] [MAIN ] VVV: Generated 138 derivative records from 50131 primary records. [2025-10-22T23:39:38.221248] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-22T23:39:38.232757] [DEBUG] [LOCAL ] VVV: Derivative data saved (138 records). [2025-10-22T23:39:38.232841] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-22T23:39:38.235714] [INFO ] [MAIN ] Derivative Progress: 1952/2052 symbols. VVV took 0.4s. Estimated remaining time: 39.4s [2025-10-22T23:39:38.235815] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:38.259116] [DEBUG] [LOCAL ] VVX: Loaded 23034 existing records from primary storage. [2025-10-22T23:39:38.259269] [INFO ] [MAIN ] VVX: Loaded 23034 primary data records. [2025-10-22T23:39:38.594952] [DEBUG] [MAIN ] VVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:38.620196] [INFO ] [MAIN ] VVX: Generated 138 derivative records from 23034 primary records. [2025-10-22T23:39:38.620328] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-22T23:39:38.631726] [DEBUG] [LOCAL ] VVX: Derivative data saved (138 records). [2025-10-22T23:39:38.631807] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-22T23:39:38.634519] [INFO ] [MAIN ] Derivative Progress: 1953/2052 symbols. VVX took 0.4s. Estimated remaining time: 39.0s [2025-10-22T23:39:38.634618] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:38.683312] [DEBUG] [LOCAL ] VYX: Loaded 48308 existing records from primary storage. [2025-10-22T23:39:38.683474] [INFO ] [MAIN ] VYX: Loaded 48308 primary data records. [2025-10-22T23:39:38.987063] [DEBUG] [MAIN ] VYX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:39.012258] [INFO ] [MAIN ] VYX: Generated 138 derivative records from 48308 primary records. [2025-10-22T23:39:39.012425] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-22T23:39:39.024093] [DEBUG] [LOCAL ] VYX: Derivative data saved (138 records). [2025-10-22T23:39:39.024183] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-22T23:39:39.027038] [INFO ] [MAIN ] Derivative Progress: 1954/2052 symbols. VYX took 0.4s. Estimated remaining time: 38.6s [2025-10-22T23:39:39.027140] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:39.081207] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-22T23:39:39.081373] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-10-22T23:39:39.397559] [DEBUG] [MAIN ] VZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:39.423309] [INFO ] [MAIN ] VZ: Generated 138 derivative records from 53791 primary records. [2025-10-22T23:39:39.423488] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-22T23:39:39.435386] [DEBUG] [LOCAL ] VZ: Derivative data saved (138 records). [2025-10-22T23:39:39.435496] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-22T23:39:39.438727] [INFO ] [MAIN ] Derivative Progress: 1955/2052 symbols. VZ took 0.4s. Estimated remaining time: 38.2s [2025-10-22T23:39:39.438850] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:39.497154] [DEBUG] [LOCAL ] W: Loaded 53410 existing records from primary storage. [2025-10-22T23:39:39.497368] [INFO ] [MAIN ] W: Loaded 53410 primary data records. [2025-10-22T23:39:39.846922] [DEBUG] [MAIN ] W: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:39.885383] [INFO ] [MAIN ] W: Generated 138 derivative records from 53410 primary records. [2025-10-22T23:39:39.885672] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-22T23:39:39.901852] [DEBUG] [LOCAL ] W: Derivative data saved (138 records). [2025-10-22T23:39:39.902045] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-22T23:39:39.905955] [INFO ] [MAIN ] Derivative Progress: 1956/2052 symbols. W took 0.5s. Estimated remaining time: 37.9s [2025-10-22T23:39:39.906165] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:39.963593] [DEBUG] [LOCAL ] WAB: Loaded 43796 existing records from primary storage. [2025-10-22T23:39:39.963871] [INFO ] [MAIN ] WAB: Loaded 43796 primary data records. [2025-10-22T23:39:40.433598] [DEBUG] [MAIN ] WAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:40.470237] [INFO ] [MAIN ] WAB: Generated 138 derivative records from 43796 primary records. [2025-10-22T23:39:40.470426] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-22T23:39:40.483258] [DEBUG] [LOCAL ] WAB: Derivative data saved (138 records). [2025-10-22T23:39:40.483417] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-22T23:39:40.486487] [INFO ] [MAIN ] Derivative Progress: 1957/2052 symbols. WAB took 0.6s. Estimated remaining time: 37.5s [2025-10-22T23:39:40.486619] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:40.534252] [DEBUG] [LOCAL ] WAL: Loaded 45667 existing records from primary storage. [2025-10-22T23:39:40.534421] [INFO ] [MAIN ] WAL: Loaded 45667 primary data records. [2025-10-22T23:39:40.848239] [DEBUG] [MAIN ] WAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:40.873417] [INFO ] [MAIN ] WAL: Generated 138 derivative records from 45667 primary records. [2025-10-22T23:39:40.873573] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-22T23:39:40.884978] [DEBUG] [LOCAL ] WAL: Derivative data saved (138 records). [2025-10-22T23:39:40.885063] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-22T23:39:40.888026] [INFO ] [MAIN ] Derivative Progress: 1958/2052 symbols. WAL took 0.4s. Estimated remaining time: 37.1s [2025-10-22T23:39:40.888131] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:40.925017] [DEBUG] [LOCAL ] WAT: Loaded 35665 existing records from primary storage. [2025-10-22T23:39:40.925179] [INFO ] [MAIN ] WAT: Loaded 35665 primary data records. [2025-10-22T23:39:41.250920] [DEBUG] [MAIN ] WAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:41.276335] [INFO ] [MAIN ] WAT: Generated 138 derivative records from 35665 primary records. [2025-10-22T23:39:41.276501] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-22T23:39:41.288040] [DEBUG] [LOCAL ] WAT: Derivative data saved (138 records). [2025-10-22T23:39:41.288122] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-22T23:39:41.290963] [INFO ] [MAIN ] Derivative Progress: 1959/2052 symbols. WAT took 0.4s. Estimated remaining time: 36.7s [2025-10-22T23:39:41.291057] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:41.338319] [DEBUG] [LOCAL ] WBS: Loaded 48843 existing records from primary storage. [2025-10-22T23:39:41.338491] [INFO ] [MAIN ] WBS: Loaded 48843 primary data records. [2025-10-22T23:39:41.640799] [DEBUG] [MAIN ] WBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:41.666233] [INFO ] [MAIN ] WBS: Generated 138 derivative records from 48843 primary records. [2025-10-22T23:39:41.666433] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-22T23:39:41.678158] [DEBUG] [LOCAL ] WBS: Derivative data saved (138 records). [2025-10-22T23:39:41.678291] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-22T23:39:41.681272] [INFO ] [MAIN ] Derivative Progress: 1960/2052 symbols. WBS took 0.4s. Estimated remaining time: 36.3s [2025-10-22T23:39:41.681371] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:41.696590] [DEBUG] [LOCAL ] WBX: Loaded 9953 existing records from primary storage. [2025-10-22T23:39:41.696793] [INFO ] [MAIN ] WBX: Loaded 9953 primary data records. [2025-10-22T23:39:41.998504] [DEBUG] [MAIN ] WBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:42.023329] [INFO ] [MAIN ] WBX: Generated 138 derivative records from 9953 primary records. [2025-10-22T23:39:42.023443] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-22T23:39:42.034107] [DEBUG] [LOCAL ] WBX: Derivative data saved (138 records). [2025-10-22T23:39:42.034192] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-10-22T23:39:42.036227] [INFO ] [MAIN ] Derivative Progress: 1961/2052 symbols. WBX took 0.4s. Estimated remaining time: 35.9s [2025-10-22T23:39:42.036323] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:42.075503] [DEBUG] [LOCAL ] WCC: Loaded 38478 existing records from primary storage. [2025-10-22T23:39:42.075694] [INFO ] [MAIN ] WCC: Loaded 38478 primary data records. [2025-10-22T23:39:42.379861] [DEBUG] [MAIN ] WCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:42.404835] [INFO ] [MAIN ] WCC: Generated 138 derivative records from 38478 primary records. [2025-10-22T23:39:42.404945] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-22T23:39:42.416749] [DEBUG] [LOCAL ] WCC: Derivative data saved (138 records). [2025-10-22T23:39:42.416831] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-22T23:39:42.419689] [INFO ] [MAIN ] Derivative Progress: 1962/2052 symbols. WCC took 0.4s. Estimated remaining time: 35.5s [2025-10-22T23:39:42.419787] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:42.467536] [DEBUG] [LOCAL ] WCN: Loaded 47886 existing records from primary storage. [2025-10-22T23:39:42.467720] [INFO ] [MAIN ] WCN: Loaded 47886 primary data records. [2025-10-22T23:39:42.772283] [DEBUG] [MAIN ] WCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:42.797608] [INFO ] [MAIN ] WCN: Generated 138 derivative records from 47886 primary records. [2025-10-22T23:39:42.797801] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-22T23:39:42.809407] [DEBUG] [LOCAL ] WCN: Derivative data saved (138 records). [2025-10-22T23:39:42.809490] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-22T23:39:42.812495] [INFO ] [MAIN ] Derivative Progress: 1963/2052 symbols. WCN took 0.4s. Estimated remaining time: 35.1s [2025-10-22T23:39:42.812591] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:42.835686] [DEBUG] [LOCAL ] WD: Loaded 22521 existing records from primary storage. [2025-10-22T23:39:42.835826] [INFO ] [MAIN ] WD: Loaded 22521 primary data records. [2025-10-22T23:39:43.163169] [DEBUG] [MAIN ] WD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:43.188135] [INFO ] [MAIN ] WD: Generated 138 derivative records from 22521 primary records. [2025-10-22T23:39:43.188252] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-22T23:39:43.199509] [DEBUG] [LOCAL ] WD: Derivative data saved (138 records). [2025-10-22T23:39:43.199593] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-22T23:39:43.202469] [INFO ] [MAIN ] Derivative Progress: 1964/2052 symbols. WD took 0.4s. Estimated remaining time: 34.7s [2025-10-22T23:39:43.202573] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:43.223000] [DEBUG] [LOCAL ] WDH: Loaded 18039 existing records from primary storage. [2025-10-22T23:39:43.223143] [INFO ] [MAIN ] WDH: Loaded 18039 primary data records. [2025-10-22T23:39:43.531381] [DEBUG] [MAIN ] WDH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:43.556494] [INFO ] [MAIN ] WDH: Generated 138 derivative records from 18039 primary records. [2025-10-22T23:39:43.556623] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-22T23:39:43.567700] [DEBUG] [LOCAL ] WDH: Derivative data saved (138 records). [2025-10-22T23:39:43.567784] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-22T23:39:43.570553] [INFO ] [MAIN ] Derivative Progress: 1965/2052 symbols. WDH took 0.4s. Estimated remaining time: 34.3s [2025-10-22T23:39:43.570683] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:43.593553] [DEBUG] [LOCAL ] WDI: Loaded 21235 existing records from primary storage. [2025-10-22T23:39:43.593726] [INFO ] [MAIN ] WDI: Loaded 21235 primary data records. [2025-10-22T23:39:43.899404] [DEBUG] [MAIN ] WDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:43.924810] [INFO ] [MAIN ] WDI: Generated 138 derivative records from 21235 primary records. [2025-10-22T23:39:43.924942] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-22T23:39:43.936406] [DEBUG] [LOCAL ] WDI: Derivative data saved (138 records). [2025-10-22T23:39:43.936487] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-22T23:39:43.939378] [INFO ] [MAIN ] Derivative Progress: 1966/2052 symbols. WDI took 0.4s. Estimated remaining time: 33.9s [2025-10-22T23:39:43.939477] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:43.982956] [DEBUG] [LOCAL ] WDS: Loaded 43018 existing records from primary storage. [2025-10-22T23:39:43.983117] [INFO ] [MAIN ] WDS: Loaded 43018 primary data records. [2025-10-22T23:39:44.289052] [DEBUG] [MAIN ] WDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:44.314515] [INFO ] [MAIN ] WDS: Generated 138 derivative records from 43018 primary records. [2025-10-22T23:39:44.314688] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-22T23:39:44.326147] [DEBUG] [LOCAL ] WDS: Derivative data saved (138 records). [2025-10-22T23:39:44.326229] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-10-22T23:39:44.329233] [INFO ] [MAIN ] Derivative Progress: 1967/2052 symbols. WDS took 0.4s. Estimated remaining time: 33.5s [2025-10-22T23:39:44.329327] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:44.341505] [DEBUG] [LOCAL ] WEA: Loaded 7893 existing records from primary storage. [2025-10-22T23:39:44.341628] [INFO ] [MAIN ] WEA: Loaded 7893 primary data records. [2025-10-22T23:39:44.651475] [DEBUG] [MAIN ] WEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:44.676590] [INFO ] [MAIN ] WEA: Generated 138 derivative records from 7893 primary records. [2025-10-22T23:39:44.676770] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-22T23:39:44.687918] [DEBUG] [LOCAL ] WEA: Derivative data saved (138 records). [2025-10-22T23:39:44.688001] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-22T23:39:44.690239] [INFO ] [MAIN ] Derivative Progress: 1968/2052 symbols. WEA took 0.4s. Estimated remaining time: 33.1s [2025-10-22T23:39:44.690350] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:44.730677] [DEBUG] [LOCAL ] WEAV: Loaded 42360 existing records from primary storage. [2025-10-22T23:39:44.730860] [INFO ] [MAIN ] WEAV: Loaded 42360 primary data records. [2025-10-22T23:39:45.068589] [DEBUG] [MAIN ] WEAV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:45.093808] [INFO ] [MAIN ] WEAV: Generated 138 derivative records from 42360 primary records. [2025-10-22T23:39:45.093928] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-22T23:39:45.105024] [DEBUG] [LOCAL ] WEAV: Derivative data saved (138 records). [2025-10-22T23:39:45.105106] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-22T23:39:45.108138] [INFO ] [MAIN ] Derivative Progress: 1969/2052 symbols. WEAV took 0.4s. Estimated remaining time: 32.7s [2025-10-22T23:39:45.108239] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:45.162985] [DEBUG] [LOCAL ] WEC: Loaded 52169 existing records from primary storage. [2025-10-22T23:39:45.163149] [INFO ] [MAIN ] WEC: Loaded 52169 primary data records. [2025-10-22T23:39:45.470347] [DEBUG] [MAIN ] WEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:45.496050] [INFO ] [MAIN ] WEC: Generated 138 derivative records from 52169 primary records. [2025-10-22T23:39:45.496288] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-22T23:39:45.508376] [DEBUG] [LOCAL ] WEC: Derivative data saved (138 records). [2025-10-22T23:39:45.508466] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-22T23:39:45.511698] [INFO ] [MAIN ] Derivative Progress: 1970/2052 symbols. WEC took 0.4s. Estimated remaining time: 32.3s [2025-10-22T23:39:45.511804] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:45.567380] [DEBUG] [LOCAL ] WELL: Loaded 52296 existing records from primary storage. [2025-10-22T23:39:45.567548] [INFO ] [MAIN ] WELL: Loaded 52296 primary data records. [2025-10-22T23:39:45.877164] [DEBUG] [MAIN ] WELL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:45.903166] [INFO ] [MAIN ] WELL: Generated 138 derivative records from 52296 primary records. [2025-10-22T23:39:45.903303] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-22T23:39:45.915258] [DEBUG] [LOCAL ] WELL: Derivative data saved (138 records). [2025-10-22T23:39:45.915343] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-22T23:39:45.918518] [INFO ] [MAIN ] Derivative Progress: 1971/2052 symbols. WELL took 0.4s. Estimated remaining time: 31.9s [2025-10-22T23:39:45.918618] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:45.966679] [DEBUG] [LOCAL ] WES: Loaded 48723 existing records from primary storage. [2025-10-22T23:39:45.966842] [INFO ] [MAIN ] WES: Loaded 48723 primary data records. [2025-10-22T23:39:46.282963] [DEBUG] [MAIN ] WES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:46.308757] [INFO ] [MAIN ] WES: Generated 138 derivative records from 48723 primary records. [2025-10-22T23:39:46.308891] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-22T23:39:46.320449] [DEBUG] [LOCAL ] WES: Derivative data saved (138 records). [2025-10-22T23:39:46.320546] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-22T23:39:46.323610] [INFO ] [MAIN ] Derivative Progress: 1972/2052 symbols. WES took 0.4s. Estimated remaining time: 31.6s [2025-10-22T23:39:46.323747] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:46.356700] [DEBUG] [LOCAL ] WEX: Loaded 32398 existing records from primary storage. [2025-10-22T23:39:46.356860] [INFO ] [MAIN ] WEX: Loaded 32398 primary data records. [2025-10-22T23:39:46.674247] [DEBUG] [MAIN ] WEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:46.700674] [INFO ] [MAIN ] WEX: Generated 138 derivative records from 32398 primary records. [2025-10-22T23:39:46.700847] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-22T23:39:46.712461] [DEBUG] [LOCAL ] WEX: Derivative data saved (138 records). [2025-10-22T23:39:46.712543] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-22T23:39:46.715462] [INFO ] [MAIN ] Derivative Progress: 1973/2052 symbols. WEX took 0.4s. Estimated remaining time: 31.2s [2025-10-22T23:39:46.715561] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:46.729941] [DEBUG] [LOCAL ] WF: Loaded 10726 existing records from primary storage. [2025-10-22T23:39:46.730083] [INFO ] [MAIN ] WF: Loaded 10726 primary data records. [2025-10-22T23:39:47.040259] [DEBUG] [MAIN ] WF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:47.066301] [INFO ] [MAIN ] WF: Generated 138 derivative records from 10726 primary records. [2025-10-22T23:39:47.066473] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-22T23:39:47.078348] [DEBUG] [LOCAL ] WF: Derivative data saved (138 records). [2025-10-22T23:39:47.078438] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-22T23:39:47.080690] [INFO ] [MAIN ] Derivative Progress: 1974/2052 symbols. WF took 0.4s. Estimated remaining time: 30.8s [2025-10-22T23:39:47.080786] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:47.135435] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-22T23:39:47.135601] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-10-22T23:39:47.468974] [DEBUG] [MAIN ] WFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:47.494760] [INFO ] [MAIN ] WFC: Generated 138 derivative records from 53748 primary records. [2025-10-22T23:39:47.494914] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-22T23:39:47.506756] [DEBUG] [LOCAL ] WFC: Derivative data saved (138 records). [2025-10-22T23:39:47.506847] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-10-22T23:39:47.510106] [INFO ] [MAIN ] Derivative Progress: 1975/2052 symbols. WFC took 0.4s. Estimated remaining time: 30.4s [2025-10-22T23:39:47.510217] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:47.534866] [DEBUG] [LOCAL ] WFG: Loaded 24486 existing records from primary storage. [2025-10-22T23:39:47.535023] [INFO ] [MAIN ] WFG: Loaded 24486 primary data records. [2025-10-22T23:39:47.857405] [DEBUG] [MAIN ] WFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:47.883458] [INFO ] [MAIN ] WFG: Generated 138 derivative records from 24486 primary records. [2025-10-22T23:39:47.883622] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-22T23:39:47.895422] [DEBUG] [LOCAL ] WFG: Derivative data saved (138 records). [2025-10-22T23:39:47.895511] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-22T23:39:47.898530] [INFO ] [MAIN ] Derivative Progress: 1976/2052 symbols. WFG took 0.4s. Estimated remaining time: 30.0s [2025-10-22T23:39:47.898684] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:47.940014] [DEBUG] [LOCAL ] WGO: Loaded 37944 existing records from primary storage. [2025-10-22T23:39:47.940205] [INFO ] [MAIN ] WGO: Loaded 37944 primary data records. [2025-10-22T23:39:48.283442] [DEBUG] [MAIN ] WGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:48.316504] [INFO ] [MAIN ] WGO: Generated 138 derivative records from 37944 primary records. [2025-10-22T23:39:48.316773] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-22T23:39:48.329304] [DEBUG] [LOCAL ] WGO: Derivative data saved (138 records). [2025-10-22T23:39:48.329467] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-22T23:39:48.332579] [INFO ] [MAIN ] Derivative Progress: 1977/2052 symbols. WGO took 0.4s. Estimated remaining time: 29.6s [2025-10-22T23:39:48.332801] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:48.379536] [DEBUG] [LOCAL ] WH: Loaded 45260 existing records from primary storage. [2025-10-22T23:39:48.379729] [INFO ] [MAIN ] WH: Loaded 45260 primary data records. [2025-10-22T23:39:48.684995] [DEBUG] [MAIN ] WH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:48.709952] [INFO ] [MAIN ] WH: Generated 138 derivative records from 45260 primary records. [2025-10-22T23:39:48.710062] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-22T23:39:48.721330] [DEBUG] [LOCAL ] WH: Derivative data saved (138 records). [2025-10-22T23:39:48.721407] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-22T23:39:48.724444] [INFO ] [MAIN ] Derivative Progress: 1978/2052 symbols. WH took 0.4s. Estimated remaining time: 29.2s [2025-10-22T23:39:48.724540] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:48.764370] [DEBUG] [LOCAL ] WHD: Loaded 39955 existing records from primary storage. [2025-10-22T23:39:48.764524] [INFO ] [MAIN ] WHD: Loaded 39955 primary data records. [2025-10-22T23:39:49.068452] [DEBUG] [MAIN ] WHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:49.093343] [INFO ] [MAIN ] WHD: Generated 138 derivative records from 39955 primary records. [2025-10-22T23:39:49.093444] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-22T23:39:49.104693] [DEBUG] [LOCAL ] WHD: Derivative data saved (138 records). [2025-10-22T23:39:49.104771] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-22T23:39:49.107690] [INFO ] [MAIN ] Derivative Progress: 1979/2052 symbols. WHD took 0.4s. Estimated remaining time: 28.8s [2025-10-22T23:39:49.107785] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:49.113263] [DEBUG] [LOCAL ] WHG: Loaded 3052 existing records from primary storage. [2025-10-22T23:39:49.113350] [INFO ] [MAIN ] WHG: Loaded 3052 primary data records. [2025-10-22T23:39:49.447882] [DEBUG] [MAIN ] WHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:49.473707] [INFO ] [MAIN ] WHG: Generated 138 derivative records from 3052 primary records. [2025-10-22T23:39:49.473908] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-22T23:39:49.484299] [DEBUG] [LOCAL ] WHG: Derivative data saved (138 records). [2025-10-22T23:39:49.484451] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-22T23:39:49.486755] [INFO ] [MAIN ] Derivative Progress: 1980/2052 symbols. WHG took 0.4s. Estimated remaining time: 28.4s [2025-10-22T23:39:49.486912] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:49.535394] [DEBUG] [LOCAL ] WHR: Loaded 48900 existing records from primary storage. [2025-10-22T23:39:49.535595] [INFO ] [MAIN ] WHR: Loaded 48900 primary data records. [2025-10-22T23:39:49.847576] [DEBUG] [MAIN ] WHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:49.873305] [INFO ] [MAIN ] WHR: Generated 138 derivative records from 48900 primary records. [2025-10-22T23:39:49.873472] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-22T23:39:49.885154] [DEBUG] [LOCAL ] WHR: Derivative data saved (138 records). [2025-10-22T23:39:49.885263] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-22T23:39:49.888406] [INFO ] [MAIN ] Derivative Progress: 1981/2052 symbols. WHR took 0.4s. Estimated remaining time: 28.0s [2025-10-22T23:39:49.888515] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:49.898285] [DEBUG] [LOCAL ] WIA: Loaded 5029 existing records from primary storage. [2025-10-22T23:39:49.898428] [INFO ] [MAIN ] WIA: Loaded 5029 primary data records. [2025-10-22T23:39:50.205024] [DEBUG] [MAIN ] WIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:50.233882] [INFO ] [MAIN ] WIA: Generated 138 derivative records from 5029 primary records. [2025-10-22T23:39:50.234029] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-22T23:39:50.244374] [DEBUG] [LOCAL ] WIA: Derivative data saved (138 records). [2025-10-22T23:39:50.244457] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-22T23:39:50.246672] [INFO ] [MAIN ] Derivative Progress: 1982/2052 symbols. WIA took 0.4s. Estimated remaining time: 27.6s [2025-10-22T23:39:50.246787] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:50.261141] [DEBUG] [LOCAL ] WINN: Loaded 11207 existing records from primary storage. [2025-10-22T23:39:50.261283] [INFO ] [MAIN ] WINN: Loaded 11207 primary data records. [2025-10-22T23:39:50.571283] [DEBUG] [MAIN ] WINN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:50.597561] [INFO ] [MAIN ] WINN: Generated 138 derivative records from 11207 primary records. [2025-10-22T23:39:50.597763] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-22T23:39:50.609804] [DEBUG] [LOCAL ] WINN: Derivative data saved (138 records). [2025-10-22T23:39:50.609890] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-22T23:39:50.612627] [INFO ] [MAIN ] Derivative Progress: 1983/2052 symbols. WINN took 0.4s. Estimated remaining time: 27.2s [2025-10-22T23:39:50.612755] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:50.664699] [DEBUG] [LOCAL ] WIT: Loaded 52537 existing records from primary storage. [2025-10-22T23:39:50.664873] [INFO ] [MAIN ] WIT: Loaded 52537 primary data records. [2025-10-22T23:39:50.983514] [DEBUG] [MAIN ] WIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:51.008681] [INFO ] [MAIN ] WIT: Generated 138 derivative records from 52537 primary records. [2025-10-22T23:39:51.008831] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-22T23:39:51.020317] [DEBUG] [LOCAL ] WIT: Derivative data saved (138 records). [2025-10-22T23:39:51.020401] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-22T23:39:51.023410] [INFO ] [MAIN ] Derivative Progress: 1984/2052 symbols. WIT took 0.4s. Estimated remaining time: 26.8s [2025-10-22T23:39:51.023518] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:51.044886] [DEBUG] [LOCAL ] WIW: Loaded 20236 existing records from primary storage. [2025-10-22T23:39:51.045046] [INFO ] [MAIN ] WIW: Loaded 20236 primary data records. [2025-10-22T23:39:51.371965] [DEBUG] [MAIN ] WIW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:51.397028] [INFO ] [MAIN ] WIW: Generated 138 derivative records from 20236 primary records. [2025-10-22T23:39:51.397153] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-22T23:39:51.408410] [DEBUG] [LOCAL ] WIW: Derivative data saved (138 records). [2025-10-22T23:39:51.408495] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-22T23:39:51.411213] [INFO ] [MAIN ] Derivative Progress: 1985/2052 symbols. WIW took 0.4s. Estimated remaining time: 26.4s [2025-10-22T23:39:51.411317] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:51.448281] [DEBUG] [LOCAL ] WK: Loaded 37058 existing records from primary storage. [2025-10-22T23:39:51.448439] [INFO ] [MAIN ] WK: Loaded 37058 primary data records. [2025-10-22T23:39:51.750202] [DEBUG] [MAIN ] WK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:51.775115] [INFO ] [MAIN ] WK: Generated 138 derivative records from 37058 primary records. [2025-10-22T23:39:51.775266] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-22T23:39:51.786729] [DEBUG] [LOCAL ] WK: Derivative data saved (138 records). [2025-10-22T23:39:51.786820] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-22T23:39:51.789565] [INFO ] [MAIN ] Derivative Progress: 1986/2052 symbols. WK took 0.4s. Estimated remaining time: 26.0s [2025-10-22T23:39:51.789702] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:51.824292] [DEBUG] [LOCAL ] WKC: Loaded 34432 existing records from primary storage. [2025-10-22T23:39:51.824453] [INFO ] [MAIN ] WKC: Loaded 34432 primary data records. [2025-10-22T23:39:52.140849] [DEBUG] [MAIN ] WKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:52.167302] [INFO ] [MAIN ] WKC: Generated 138 derivative records from 34432 primary records. [2025-10-22T23:39:52.167481] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-22T23:39:52.179097] [DEBUG] [LOCAL ] WKC: Derivative data saved (138 records). [2025-10-22T23:39:52.179204] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-22T23:39:52.182152] [INFO ] [MAIN ] Derivative Progress: 1987/2052 symbols. WKC took 0.4s. Estimated remaining time: 25.6s [2025-10-22T23:39:52.182256] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:52.227985] [DEBUG] [LOCAL ] WLK: Loaded 45827 existing records from primary storage. [2025-10-22T23:39:52.228151] [INFO ] [MAIN ] WLK: Loaded 45827 primary data records. [2025-10-22T23:39:52.548683] [DEBUG] [MAIN ] WLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:52.574581] [INFO ] [MAIN ] WLK: Generated 138 derivative records from 45827 primary records. [2025-10-22T23:39:52.574770] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-22T23:39:52.586336] [DEBUG] [LOCAL ] WLK: Derivative data saved (138 records). [2025-10-22T23:39:52.586429] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-22T23:39:52.589353] [INFO ] [MAIN ] Derivative Progress: 1988/2052 symbols. WLK took 0.4s. Estimated remaining time: 25.2s [2025-10-22T23:39:52.589450] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:52.601089] [DEBUG] [LOCAL ] WLKP: Loaded 7193 existing records from primary storage. [2025-10-22T23:39:52.601214] [INFO ] [MAIN ] WLKP: Loaded 7193 primary data records. [2025-10-22T23:39:52.908212] [DEBUG] [MAIN ] WLKP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:52.933520] [INFO ] [MAIN ] WLKP: Generated 138 derivative records from 7193 primary records. [2025-10-22T23:39:52.933685] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-22T23:39:52.945121] [DEBUG] [LOCAL ] WLKP: Derivative data saved (138 records). [2025-10-22T23:39:52.945201] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-22T23:39:52.947256] [INFO ] [MAIN ] Derivative Progress: 1989/2052 symbols. WLKP took 0.4s. Estimated remaining time: 24.8s [2025-10-22T23:39:52.947350] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:52.977485] [DEBUG] [LOCAL ] WLY: Loaded 29776 existing records from primary storage. [2025-10-22T23:39:52.977639] [INFO ] [MAIN ] WLY: Loaded 29776 primary data records. [2025-10-22T23:39:53.313401] [DEBUG] [MAIN ] WLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:53.354571] [INFO ] [MAIN ] WLY: Generated 138 derivative records from 29776 primary records. [2025-10-22T23:39:53.354803] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-22T23:39:53.367503] [DEBUG] [LOCAL ] WLY: Derivative data saved (138 records). [2025-10-22T23:39:53.367678] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-22T23:39:53.370681] [INFO ] [MAIN ] Derivative Progress: 1990/2052 symbols. WLY took 0.4s. Estimated remaining time: 24.4s [2025-10-22T23:39:53.370779] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:53.420753] [DEBUG] [LOCAL ] WM: Loaded 50847 existing records from primary storage. [2025-10-22T23:39:53.420914] [INFO ] [MAIN ] WM: Loaded 50847 primary data records. [2025-10-22T23:39:53.737400] [DEBUG] [MAIN ] WM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:53.764124] [INFO ] [MAIN ] WM: Generated 138 derivative records from 50847 primary records. [2025-10-22T23:39:53.764243] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-22T23:39:53.776376] [DEBUG] [LOCAL ] WM: Derivative data saved (138 records). [2025-10-22T23:39:53.776455] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-22T23:39:53.779505] [INFO ] [MAIN ] Derivative Progress: 1991/2052 symbols. WM took 0.4s. Estimated remaining time: 24.1s [2025-10-22T23:39:53.779608] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:53.832490] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-22T23:39:53.832701] [INFO ] [MAIN ] WMB: Loaded 53672 primary data records. [2025-10-22T23:39:54.153932] [DEBUG] [MAIN ] WMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:54.182831] [INFO ] [MAIN ] WMB: Generated 138 derivative records from 53672 primary records. [2025-10-22T23:39:54.183017] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-22T23:39:54.194996] [DEBUG] [LOCAL ] WMB: Derivative data saved (138 records). [2025-10-22T23:39:54.195091] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-22T23:39:54.198468] [INFO ] [MAIN ] Derivative Progress: 1992/2052 symbols. WMB took 0.4s. Estimated remaining time: 23.7s [2025-10-22T23:39:54.198681] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:54.217533] [DEBUG] [LOCAL ] WMK: Loaded 14666 existing records from primary storage. [2025-10-22T23:39:54.217718] [INFO ] [MAIN ] WMK: Loaded 14666 primary data records. [2025-10-22T23:39:54.551085] [DEBUG] [MAIN ] WMK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:54.578137] [INFO ] [MAIN ] WMK: Generated 138 derivative records from 14666 primary records. [2025-10-22T23:39:54.578296] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-22T23:39:54.590466] [DEBUG] [LOCAL ] WMK: Derivative data saved (138 records). [2025-10-22T23:39:54.590556] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-22T23:39:54.593380] [INFO ] [MAIN ] Derivative Progress: 1993/2052 symbols. WMK took 0.4s. Estimated remaining time: 23.3s [2025-10-22T23:39:54.593484] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:54.633866] [DEBUG] [LOCAL ] WMS: Loaded 39517 existing records from primary storage. [2025-10-22T23:39:54.634035] [INFO ] [MAIN ] WMS: Loaded 39517 primary data records. [2025-10-22T23:39:54.938109] [DEBUG] [MAIN ] WMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:54.963478] [INFO ] [MAIN ] WMS: Generated 138 derivative records from 39517 primary records. [2025-10-22T23:39:54.963678] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-22T23:39:54.975611] [DEBUG] [LOCAL ] WMS: Derivative data saved (138 records). [2025-10-22T23:39:54.975725] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-22T23:39:54.978709] [INFO ] [MAIN ] Derivative Progress: 1994/2052 symbols. WMS took 0.4s. Estimated remaining time: 22.9s [2025-10-22T23:39:54.978815] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:55.031241] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-22T23:39:55.031423] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-10-22T23:39:55.336066] [DEBUG] [MAIN ] WMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:55.361157] [INFO ] [MAIN ] WMT: Generated 138 derivative records from 53800 primary records. [2025-10-22T23:39:55.361291] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-22T23:39:55.373297] [DEBUG] [LOCAL ] WMT: Derivative data saved (138 records). [2025-10-22T23:39:55.373378] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-22T23:39:55.376493] [INFO ] [MAIN ] Derivative Progress: 1995/2052 symbols. WMT took 0.4s. Estimated remaining time: 22.5s [2025-10-22T23:39:55.376617] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:55.413691] [DEBUG] [LOCAL ] WNC: Loaded 38118 existing records from primary storage. [2025-10-22T23:39:55.413857] [INFO ] [MAIN ] WNC: Loaded 38118 primary data records. [2025-10-22T23:39:55.753695] [DEBUG] [MAIN ] WNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:55.778978] [INFO ] [MAIN ] WNC: Generated 138 derivative records from 38118 primary records. [2025-10-22T23:39:55.779090] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-22T23:39:55.790512] [DEBUG] [LOCAL ] WNC: Derivative data saved (138 records). [2025-10-22T23:39:55.790594] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-22T23:39:55.793446] [INFO ] [MAIN ] Derivative Progress: 1996/2052 symbols. WNC took 0.4s. Estimated remaining time: 22.1s [2025-10-22T23:39:55.793540] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:55.846693] [DEBUG] [LOCAL ] WOLF: Loaded 53071 existing records from primary storage. [2025-10-22T23:39:55.846854] [INFO ] [MAIN ] WOLF: Loaded 53071 primary data records. [2025-10-22T23:39:56.150249] [DEBUG] [MAIN ] WOLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:56.175501] [INFO ] [MAIN ] WOLF: Generated 138 derivative records from 53071 primary records. [2025-10-22T23:39:56.175603] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-22T23:39:56.187207] [DEBUG] [LOCAL ] WOLF: Derivative data saved (138 records). [2025-10-22T23:39:56.187302] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-10-22T23:39:56.190294] [INFO ] [MAIN ] Derivative Progress: 1997/2052 symbols. WOLF took 0.4s. Estimated remaining time: 21.7s [2025-10-22T23:39:56.190394] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:56.214271] [DEBUG] [LOCAL ] WOR: Loaded 23551 existing records from primary storage. [2025-10-22T23:39:56.214422] [INFO ] [MAIN ] WOR: Loaded 23551 primary data records. [2025-10-22T23:39:56.524305] [DEBUG] [MAIN ] WOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:56.552095] [INFO ] [MAIN ] WOR: Generated 138 derivative records from 23551 primary records. [2025-10-22T23:39:56.552239] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-22T23:39:56.563737] [DEBUG] [LOCAL ] WOR: Derivative data saved (138 records). [2025-10-22T23:39:56.563834] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-22T23:39:56.566536] [INFO ] [MAIN ] Derivative Progress: 1998/2052 symbols. WOR took 0.4s. Estimated remaining time: 21.3s [2025-10-22T23:39:56.566630] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:56.596956] [DEBUG] [LOCAL ] WOW: Loaded 31103 existing records from primary storage. [2025-10-22T23:39:56.597110] [INFO ] [MAIN ] WOW: Loaded 31103 primary data records. [2025-10-22T23:39:56.907343] [DEBUG] [MAIN ] WOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:56.932418] [INFO ] [MAIN ] WOW: Generated 138 derivative records from 31103 primary records. [2025-10-22T23:39:56.932616] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-22T23:39:56.943819] [DEBUG] [LOCAL ] WOW: Derivative data saved (138 records). [2025-10-22T23:39:56.943944] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-22T23:39:56.946793] [INFO ] [MAIN ] Derivative Progress: 1999/2052 symbols. WOW took 0.4s. Estimated remaining time: 20.9s [2025-10-22T23:39:56.946886] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:56.993754] [DEBUG] [LOCAL ] WPC: Loaded 48154 existing records from primary storage. [2025-10-22T23:39:56.993946] [INFO ] [MAIN ] WPC: Loaded 48154 primary data records. [2025-10-22T23:39:57.302556] [DEBUG] [MAIN ] WPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:57.329803] [INFO ] [MAIN ] WPC: Generated 138 derivative records from 48154 primary records. [2025-10-22T23:39:57.329986] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-22T23:39:57.341557] [DEBUG] [LOCAL ] WPC: Derivative data saved (138 records). [2025-10-22T23:39:57.341720] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-22T23:39:57.344638] [INFO ] [MAIN ] Derivative Progress: 2000/2052 symbols. WPC took 0.4s. Estimated remaining time: 20.5s [2025-10-22T23:39:57.344818] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:57.398242] [DEBUG] [LOCAL ] WPM: Loaded 52787 existing records from primary storage. [2025-10-22T23:39:57.398424] [INFO ] [MAIN ] WPM: Loaded 52787 primary data records. [2025-10-22T23:39:57.733313] [DEBUG] [MAIN ] WPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:57.758742] [INFO ] [MAIN ] WPM: Generated 138 derivative records from 52787 primary records. [2025-10-22T23:39:57.758924] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-22T23:39:57.770493] [DEBUG] [LOCAL ] WPM: Derivative data saved (138 records). [2025-10-22T23:39:57.770598] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-22T23:39:57.773740] [INFO ] [MAIN ] Derivative Progress: 2001/2052 symbols. WPM took 0.4s. Estimated remaining time: 20.1s [2025-10-22T23:39:57.773861] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:57.808322] [DEBUG] [LOCAL ] WPP: Loaded 34340 existing records from primary storage. [2025-10-22T23:39:57.808482] [INFO ] [MAIN ] WPP: Loaded 34340 primary data records. [2025-10-22T23:39:58.128468] [DEBUG] [MAIN ] WPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:58.153552] [INFO ] [MAIN ] WPP: Generated 138 derivative records from 34340 primary records. [2025-10-22T23:39:58.153686] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-22T23:39:58.165253] [DEBUG] [LOCAL ] WPP: Derivative data saved (138 records). [2025-10-22T23:39:58.165332] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-10-22T23:39:58.168065] [INFO ] [MAIN ] Derivative Progress: 2002/2052 symbols. WPP took 0.4s. Estimated remaining time: 19.7s [2025-10-22T23:39:58.168162] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:58.218600] [DEBUG] [LOCAL ] WRB: Loaded 50788 existing records from primary storage. [2025-10-22T23:39:58.218793] [INFO ] [MAIN ] WRB: Loaded 50788 primary data records. [2025-10-22T23:39:58.524219] [DEBUG] [MAIN ] WRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:58.549427] [INFO ] [MAIN ] WRB: Generated 138 derivative records from 50788 primary records. [2025-10-22T23:39:58.549540] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-22T23:39:58.560854] [DEBUG] [LOCAL ] WRB: Derivative data saved (138 records). [2025-10-22T23:39:58.560932] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-22T23:39:58.563844] [INFO ] [MAIN ] Derivative Progress: 2003/2052 symbols. WRB took 0.4s. Estimated remaining time: 19.3s [2025-10-22T23:39:58.563943] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:58.614909] [DEBUG] [LOCAL ] WRBY: Loaded 50685 existing records from primary storage. [2025-10-22T23:39:58.615073] [INFO ] [MAIN ] WRBY: Loaded 50685 primary data records. [2025-10-22T23:39:58.922853] [DEBUG] [MAIN ] WRBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:58.948600] [INFO ] [MAIN ] WRBY: Generated 138 derivative records from 50685 primary records. [2025-10-22T23:39:58.948750] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-22T23:39:58.960207] [DEBUG] [LOCAL ] WRBY: Derivative data saved (138 records). [2025-10-22T23:39:58.960287] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-22T23:39:58.963290] [INFO ] [MAIN ] Derivative Progress: 2004/2052 symbols. WRBY took 0.4s. Estimated remaining time: 18.9s [2025-10-22T23:39:58.963382] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:58.987960] [DEBUG] [LOCAL ] WS: Loaded 23459 existing records from primary storage. [2025-10-22T23:39:58.988104] [INFO ] [MAIN ] WS: Loaded 23459 primary data records. [2025-10-22T23:39:59.295880] [DEBUG] [MAIN ] WS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:59.321268] [INFO ] [MAIN ] WS: Generated 138 derivative records from 23459 primary records. [2025-10-22T23:39:59.321473] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-22T23:39:59.333423] [DEBUG] [LOCAL ] WS: Derivative data saved (138 records). [2025-10-22T23:39:59.333518] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-22T23:39:59.336297] [INFO ] [MAIN ] Derivative Progress: 2005/2052 symbols. WS took 0.4s. Estimated remaining time: 18.5s [2025-10-22T23:39:59.336397] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:59.386268] [DEBUG] [LOCAL ] WSM: Loaded 48709 existing records from primary storage. [2025-10-22T23:39:59.386433] [INFO ] [MAIN ] WSM: Loaded 48709 primary data records. [2025-10-22T23:39:59.726163] [DEBUG] [MAIN ] WSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:39:59.755453] [INFO ] [MAIN ] WSM: Generated 138 derivative records from 48709 primary records. [2025-10-22T23:39:59.755638] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-22T23:39:59.767712] [DEBUG] [LOCAL ] WSM: Derivative data saved (138 records). [2025-10-22T23:39:59.767810] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-22T23:39:59.770702] [INFO ] [MAIN ] Derivative Progress: 2006/2052 symbols. WSM took 0.4s. Estimated remaining time: 18.1s [2025-10-22T23:39:59.770802] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:39:59.798570] [DEBUG] [LOCAL ] WSO: Loaded 25878 existing records from primary storage. [2025-10-22T23:39:59.798766] [INFO ] [MAIN ] WSO: Loaded 25878 primary data records. [2025-10-22T23:40:00.109586] [DEBUG] [MAIN ] WSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:00.134762] [INFO ] [MAIN ] WSO: Generated 138 derivative records from 25878 primary records. [2025-10-22T23:40:00.134887] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-22T23:40:00.146362] [DEBUG] [LOCAL ] WSO: Derivative data saved (138 records). [2025-10-22T23:40:00.146450] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-22T23:40:00.149326] [INFO ] [MAIN ] Derivative Progress: 2007/2052 symbols. WSO took 0.4s. Estimated remaining time: 17.7s [2025-10-22T23:40:00.149421] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:00.173383] [DEBUG] [LOCAL ] WSR: Loaded 22566 existing records from primary storage. [2025-10-22T23:40:00.173557] [INFO ] [MAIN ] WSR: Loaded 22566 primary data records. [2025-10-22T23:40:00.478610] [DEBUG] [MAIN ] WSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:00.503589] [INFO ] [MAIN ] WSR: Generated 138 derivative records from 22566 primary records. [2025-10-22T23:40:00.503725] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-22T23:40:00.515342] [DEBUG] [LOCAL ] WSR: Derivative data saved (138 records). [2025-10-22T23:40:00.515422] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-22T23:40:00.518183] [INFO ] [MAIN ] Derivative Progress: 2008/2052 symbols. WSR took 0.4s. Estimated remaining time: 17.4s [2025-10-22T23:40:00.518290] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:00.555143] [DEBUG] [LOCAL ] WST: Loaded 36684 existing records from primary storage. [2025-10-22T23:40:00.555303] [INFO ] [MAIN ] WST: Loaded 36684 primary data records. [2025-10-22T23:40:00.861433] [DEBUG] [MAIN ] WST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:00.886677] [INFO ] [MAIN ] WST: Generated 138 derivative records from 36684 primary records. [2025-10-22T23:40:00.886815] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-22T23:40:00.898605] [DEBUG] [LOCAL ] WST: Derivative data saved (138 records). [2025-10-22T23:40:00.898714] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-22T23:40:00.901686] [INFO ] [MAIN ] Derivative Progress: 2009/2052 symbols. WST took 0.4s. Estimated remaining time: 17.0s [2025-10-22T23:40:00.901802] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:00.948722] [DEBUG] [LOCAL ] WT: Loaded 48178 existing records from primary storage. [2025-10-22T23:40:00.948884] [INFO ] [MAIN ] WT: Loaded 48178 primary data records. [2025-10-22T23:40:01.283412] [DEBUG] [MAIN ] WT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:01.309420] [INFO ] [MAIN ] WT: Generated 138 derivative records from 48178 primary records. [2025-10-22T23:40:01.309575] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-22T23:40:01.321417] [DEBUG] [LOCAL ] WT: Derivative data saved (138 records). [2025-10-22T23:40:01.321554] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-22T23:40:01.324678] [INFO ] [MAIN ] Derivative Progress: 2010/2052 symbols. WT took 0.4s. Estimated remaining time: 16.6s [2025-10-22T23:40:01.324813] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:01.368806] [DEBUG] [LOCAL ] WTI: Loaded 44731 existing records from primary storage. [2025-10-22T23:40:01.368972] [INFO ] [MAIN ] WTI: Loaded 44731 primary data records. [2025-10-22T23:40:01.694313] [DEBUG] [MAIN ] WTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:01.724858] [INFO ] [MAIN ] WTI: Generated 138 derivative records from 44731 primary records. [2025-10-22T23:40:01.725085] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-22T23:40:01.737726] [DEBUG] [LOCAL ] WTI: Derivative data saved (138 records). [2025-10-22T23:40:01.737900] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-22T23:40:01.741051] [INFO ] [MAIN ] Derivative Progress: 2011/2052 symbols. WTI took 0.4s. Estimated remaining time: 16.2s [2025-10-22T23:40:01.741243] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:01.797813] [DEBUG] [LOCAL ] WTRG: Loaded 50940 existing records from primary storage. [2025-10-22T23:40:01.798205] [INFO ] [MAIN ] WTRG: Loaded 50940 primary data records. [2025-10-22T23:40:02.155975] [DEBUG] [MAIN ] WTRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:02.182912] [INFO ] [MAIN ] WTRG: Generated 138 derivative records from 50940 primary records. [2025-10-22T23:40:02.183124] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-22T23:40:02.194841] [DEBUG] [LOCAL ] WTRG: Derivative data saved (138 records). [2025-10-22T23:40:02.195001] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-22T23:40:02.198237] [INFO ] [MAIN ] Derivative Progress: 2012/2052 symbols. WTRG took 0.5s. Estimated remaining time: 15.8s [2025-10-22T23:40:02.198378] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:02.218607] [DEBUG] [LOCAL ] WTS: Loaded 17226 existing records from primary storage. [2025-10-22T23:40:02.218796] [INFO ] [MAIN ] WTS: Loaded 17226 primary data records. [2025-10-22T23:40:02.559707] [DEBUG] [MAIN ] WTS: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:40:02.587313] [INFO ] [MAIN ] WTS: Generated 138 derivative records from 17226 primary records. [2025-10-22T23:40:02.587502] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-22T23:40:02.599544] [DEBUG] [LOCAL ] WTS: Derivative data saved (138 records). [2025-10-22T23:40:02.599716] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-22T23:40:02.602478] [INFO ] [MAIN ] Derivative Progress: 2013/2052 symbols. WTS took 0.4s. Estimated remaining time: 15.4s [2025-10-22T23:40:02.602592] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:02.646640] [DEBUG] [LOCAL ] WTTR: Loaded 44535 existing records from primary storage. [2025-10-22T23:40:02.646843] [INFO ] [MAIN ] WTTR: Loaded 44535 primary data records. [2025-10-22T23:40:02.974962] [DEBUG] [MAIN ] WTTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:03.002542] [INFO ] [MAIN ] WTTR: Generated 138 derivative records from 44535 primary records. [2025-10-22T23:40:03.002777] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-22T23:40:03.014770] [DEBUG] [LOCAL ] WTTR: Derivative data saved (138 records). [2025-10-22T23:40:03.014924] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-22T23:40:03.018033] [INFO ] [MAIN ] Derivative Progress: 2014/2052 symbols. WTTR took 0.4s. Estimated remaining time: 15.0s [2025-10-22T23:40:03.018172] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:03.082913] [DEBUG] [LOCAL ] WU: Loaded 53487 existing records from primary storage. [2025-10-22T23:40:03.083304] [INFO ] [MAIN ] WU: Loaded 53487 primary data records. [2025-10-22T23:40:03.408489] [DEBUG] [MAIN ] WU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:03.434630] [INFO ] [MAIN ] WU: Generated 138 derivative records from 53487 primary records. [2025-10-22T23:40:03.434858] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-22T23:40:03.446813] [DEBUG] [LOCAL ] WU: Derivative data saved (138 records). [2025-10-22T23:40:03.446982] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-22T23:40:03.450321] [INFO ] [MAIN ] Derivative Progress: 2015/2052 symbols. WU took 0.4s. Estimated remaining time: 14.6s [2025-10-22T23:40:03.450476] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:03.500960] [DEBUG] [LOCAL ] WWW: Loaded 49243 existing records from primary storage. [2025-10-22T23:40:03.501135] [INFO ] [MAIN ] WWW: Loaded 49243 primary data records. [2025-10-22T23:40:03.856194] [DEBUG] [MAIN ] WWW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:03.881786] [INFO ] [MAIN ] WWW: Generated 138 derivative records from 49243 primary records. [2025-10-22T23:40:03.881961] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-22T23:40:03.894085] [DEBUG] [LOCAL ] WWW: Derivative data saved (138 records). [2025-10-22T23:40:03.894173] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-22T23:40:03.897316] [INFO ] [MAIN ] Derivative Progress: 2016/2052 symbols. WWW took 0.4s. Estimated remaining time: 14.2s [2025-10-22T23:40:03.897445] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:03.951728] [DEBUG] [LOCAL ] WY: Loaded 53213 existing records from primary storage. [2025-10-22T23:40:03.951906] [INFO ] [MAIN ] WY: Loaded 53213 primary data records. [2025-10-22T23:40:04.307847] [DEBUG] [MAIN ] WY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:04.337565] [INFO ] [MAIN ] WY: Generated 138 derivative records from 53213 primary records. [2025-10-22T23:40:04.337734] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-22T23:40:04.350955] [DEBUG] [LOCAL ] WY: Derivative data saved (138 records). [2025-10-22T23:40:04.351088] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-22T23:40:04.354312] [INFO ] [MAIN ] Derivative Progress: 2017/2052 symbols. WY took 0.5s. Estimated remaining time: 13.8s [2025-10-22T23:40:04.354413] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:04.386886] [DEBUG] [LOCAL ] XFLT: Loaded 29930 existing records from primary storage. [2025-10-22T23:40:04.387055] [INFO ] [MAIN ] XFLT: Loaded 29930 primary data records. [2025-10-22T23:40:04.719341] [DEBUG] [MAIN ] XFLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:04.744514] [INFO ] [MAIN ] XFLT: Generated 138 derivative records from 29930 primary records. [2025-10-22T23:40:04.744706] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-22T23:40:04.755957] [DEBUG] [LOCAL ] XFLT: Derivative data saved (138 records). [2025-10-22T23:40:04.756045] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-22T23:40:04.758863] [INFO ] [MAIN ] Derivative Progress: 2018/2052 symbols. XFLT took 0.4s. Estimated remaining time: 13.4s [2025-10-22T23:40:04.758980] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:04.801372] [DEBUG] [LOCAL ] XHR: Loaded 43369 existing records from primary storage. [2025-10-22T23:40:04.801534] [INFO ] [MAIN ] XHR: Loaded 43369 primary data records. [2025-10-22T23:40:05.112523] [DEBUG] [MAIN ] XHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:05.141118] [INFO ] [MAIN ] XHR: Generated 138 derivative records from 43369 primary records. [2025-10-22T23:40:05.141326] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-22T23:40:05.153359] [DEBUG] [LOCAL ] XHR: Derivative data saved (138 records). [2025-10-22T23:40:05.153449] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-22T23:40:05.156142] [INFO ] [MAIN ] Derivative Progress: 2019/2052 symbols. XHR took 0.4s. Estimated remaining time: 13.0s [2025-10-22T23:40:05.156244] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:05.215694] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-22T23:40:05.215873] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-10-22T23:40:05.524262] [DEBUG] [MAIN ] XOM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:05.549360] [INFO ] [MAIN ] XOM: Generated 138 derivative records from 53793 primary records. [2025-10-22T23:40:05.549541] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-22T23:40:05.561434] [DEBUG] [LOCAL ] XOM: Derivative data saved (138 records). [2025-10-22T23:40:05.561514] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-22T23:40:05.564526] [INFO ] [MAIN ] Derivative Progress: 2020/2052 symbols. XOM took 0.4s. Estimated remaining time: 12.6s [2025-10-22T23:40:05.564625] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:05.594148] [DEBUG] [LOCAL ] XPER: Loaded 30694 existing records from primary storage. [2025-10-22T23:40:05.594325] [INFO ] [MAIN ] XPER: Loaded 30694 primary data records. [2025-10-22T23:40:05.898233] [DEBUG] [MAIN ] XPER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:05.923303] [INFO ] [MAIN ] XPER: Generated 138 derivative records from 30694 primary records. [2025-10-22T23:40:05.923420] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-22T23:40:05.934474] [DEBUG] [LOCAL ] XPER: Derivative data saved (138 records). [2025-10-22T23:40:05.934553] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-22T23:40:05.937308] [INFO ] [MAIN ] Derivative Progress: 2021/2052 symbols. XPER took 0.4s. Estimated remaining time: 12.2s [2025-10-22T23:40:05.937408] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:05.993464] [DEBUG] [LOCAL ] XPEV: Loaded 53619 existing records from primary storage. [2025-10-22T23:40:05.993677] [INFO ] [MAIN ] XPEV: Loaded 53619 primary data records. [2025-10-22T23:40:06.325964] [DEBUG] [MAIN ] XPEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:06.351337] [INFO ] [MAIN ] XPEV: Generated 138 derivative records from 53619 primary records. [2025-10-22T23:40:06.351484] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-22T23:40:06.363370] [DEBUG] [LOCAL ] XPEV: Derivative data saved (138 records). [2025-10-22T23:40:06.363451] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-22T23:40:06.366546] [INFO ] [MAIN ] Derivative Progress: 2022/2052 symbols. XPEV took 0.4s. Estimated remaining time: 11.8s [2025-10-22T23:40:06.366667] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:06.412548] [DEBUG] [LOCAL ] XPO: Loaded 47458 existing records from primary storage. [2025-10-22T23:40:06.412757] [INFO ] [MAIN ] XPO: Loaded 47458 primary data records. [2025-10-22T23:40:06.718471] [DEBUG] [MAIN ] XPO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:40:06.743993] [INFO ] [MAIN ] XPO: Generated 138 derivative records from 47458 primary records. [2025-10-22T23:40:06.744137] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-22T23:40:06.755981] [DEBUG] [LOCAL ] XPO: Derivative data saved (138 records). [2025-10-22T23:40:06.756067] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-22T23:40:06.758881] [INFO ] [MAIN ] Derivative Progress: 2023/2052 symbols. XPO took 0.4s. Estimated remaining time: 11.4s [2025-10-22T23:40:06.758996] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:06.793686] [DEBUG] [LOCAL ] XPOF: Loaded 36943 existing records from primary storage. [2025-10-22T23:40:06.793846] [INFO ] [MAIN ] XPOF: Loaded 36943 primary data records. [2025-10-22T23:40:07.099698] [DEBUG] [MAIN ] XPOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:07.125817] [INFO ] [MAIN ] XPOF: Generated 138 derivative records from 36943 primary records. [2025-10-22T23:40:07.125982] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-22T23:40:07.137594] [DEBUG] [LOCAL ] XPOF: Derivative data saved (138 records). [2025-10-22T23:40:07.137696] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-22T23:40:07.140601] [INFO ] [MAIN ] Derivative Progress: 2024/2052 symbols. XPOF took 0.4s. Estimated remaining time: 11.0s [2025-10-22T23:40:07.140741] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:07.184287] [DEBUG] [LOCAL ] XPRO: Loaded 45796 existing records from primary storage. [2025-10-22T23:40:07.184454] [INFO ] [MAIN ] XPRO: Loaded 45796 primary data records. [2025-10-22T23:40:07.489976] [DEBUG] [MAIN ] XPRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:07.514958] [INFO ] [MAIN ] XPRO: Generated 138 derivative records from 45796 primary records. [2025-10-22T23:40:07.515086] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-22T23:40:07.526609] [DEBUG] [LOCAL ] XPRO: Derivative data saved (138 records). [2025-10-22T23:40:07.526724] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-22T23:40:07.529511] [INFO ] [MAIN ] Derivative Progress: 2025/2052 symbols. XPRO took 0.4s. Estimated remaining time: 10.7s [2025-10-22T23:40:07.529618] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:07.558791] [DEBUG] [LOCAL ] XYF: Loaded 27365 existing records from primary storage. [2025-10-22T23:40:07.558945] [INFO ] [MAIN ] XYF: Loaded 27365 primary data records. [2025-10-22T23:40:07.862630] [DEBUG] [MAIN ] XYF: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:40:07.888205] [INFO ] [MAIN ] XYF: Generated 138 derivative records from 27365 primary records. [2025-10-22T23:40:07.888354] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-22T23:40:07.899829] [DEBUG] [LOCAL ] XYF: Derivative data saved (138 records). [2025-10-22T23:40:07.899914] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-22T23:40:07.902782] [INFO ] [MAIN ] Derivative Progress: 2026/2052 symbols. XYF took 0.4s. Estimated remaining time: 10.3s [2025-10-22T23:40:07.902879] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:07.951235] [DEBUG] [LOCAL ] XYL: Loaded 47551 existing records from primary storage. [2025-10-22T23:40:07.951400] [INFO ] [MAIN ] XYL: Loaded 47551 primary data records. [2025-10-22T23:40:08.286556] [DEBUG] [MAIN ] XYL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:08.312336] [INFO ] [MAIN ] XYL: Generated 138 derivative records from 47551 primary records. [2025-10-22T23:40:08.312523] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-22T23:40:08.324312] [DEBUG] [LOCAL ] XYL: Derivative data saved (138 records). [2025-10-22T23:40:08.324411] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-22T23:40:08.327172] [INFO ] [MAIN ] Derivative Progress: 2027/2052 symbols. XYL took 0.4s. Estimated remaining time: 9.9s [2025-10-22T23:40:08.327315] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:08.360513] [DEBUG] [LOCAL ] YALA: Loaded 36411 existing records from primary storage. [2025-10-22T23:40:08.360711] [INFO ] [MAIN ] YALA: Loaded 36411 primary data records. [2025-10-22T23:40:08.672403] [DEBUG] [MAIN ] YALA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:08.698141] [INFO ] [MAIN ] YALA: Generated 138 derivative records from 36411 primary records. [2025-10-22T23:40:08.698348] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-22T23:40:08.709629] [DEBUG] [LOCAL ] YALA: Derivative data saved (138 records). [2025-10-22T23:40:08.709767] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-22T23:40:08.712735] [INFO ] [MAIN ] Derivative Progress: 2028/2052 symbols. YALA took 0.4s. Estimated remaining time: 9.5s [2025-10-22T23:40:08.712863] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:08.755737] [DEBUG] [LOCAL ] YELP: Loaded 45182 existing records from primary storage. [2025-10-22T23:40:08.755921] [INFO ] [MAIN ] YELP: Loaded 45182 primary data records. [2025-10-22T23:40:09.071362] [DEBUG] [MAIN ] YELP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:09.098447] [INFO ] [MAIN ] YELP: Generated 138 derivative records from 45182 primary records. [2025-10-22T23:40:09.098673] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-22T23:40:09.111258] [DEBUG] [LOCAL ] YELP: Derivative data saved (138 records). [2025-10-22T23:40:09.111380] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-22T23:40:09.114466] [INFO ] [MAIN ] Derivative Progress: 2029/2052 symbols. YELP took 0.4s. Estimated remaining time: 9.1s [2025-10-22T23:40:09.114572] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:09.165977] [DEBUG] [LOCAL ] YETI: Loaded 52517 existing records from primary storage. [2025-10-22T23:40:09.166148] [INFO ] [MAIN ] YETI: Loaded 52517 primary data records. [2025-10-22T23:40:09.472492] [DEBUG] [MAIN ] YETI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:09.498054] [INFO ] [MAIN ] YETI: Generated 138 derivative records from 52517 primary records. [2025-10-22T23:40:09.498219] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-22T23:40:09.509884] [DEBUG] [LOCAL ] YETI: Derivative data saved (138 records). [2025-10-22T23:40:09.509968] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-22T23:40:09.513078] [INFO ] [MAIN ] Derivative Progress: 2030/2052 symbols. YETI took 0.4s. Estimated remaining time: 8.7s [2025-10-22T23:40:09.513197] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:09.555320] [DEBUG] [LOCAL ] YEXT: Loaded 43044 existing records from primary storage. [2025-10-22T23:40:09.555552] [INFO ] [MAIN ] YEXT: Loaded 43044 primary data records. [2025-10-22T23:40:09.863416] [DEBUG] [MAIN ] YEXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:09.888929] [INFO ] [MAIN ] YEXT: Generated 138 derivative records from 43044 primary records. [2025-10-22T23:40:09.889082] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-22T23:40:09.900190] [DEBUG] [LOCAL ] YEXT: Derivative data saved (138 records). [2025-10-22T23:40:09.900279] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-22T23:40:09.902982] [INFO ] [MAIN ] Derivative Progress: 2031/2052 symbols. YEXT took 0.4s. Estimated remaining time: 8.3s [2025-10-22T23:40:09.903089] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:09.956096] [DEBUG] [LOCAL ] YMM: Loaded 52576 existing records from primary storage. [2025-10-22T23:40:09.956261] [INFO ] [MAIN ] YMM: Loaded 52576 primary data records. [2025-10-22T23:40:10.263397] [DEBUG] [MAIN ] YMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:10.288876] [INFO ] [MAIN ] YMM: Generated 138 derivative records from 52576 primary records. [2025-10-22T23:40:10.288990] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-22T23:40:10.300858] [DEBUG] [LOCAL ] YMM: Derivative data saved (138 records). [2025-10-22T23:40:10.300939] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-22T23:40:10.303984] [INFO ] [MAIN ] Derivative Progress: 2032/2052 symbols. YMM took 0.4s. Estimated remaining time: 7.9s [2025-10-22T23:40:10.304091] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:10.349854] [DEBUG] [LOCAL ] YOU: Loaded 49536 existing records from primary storage. [2025-10-22T23:40:10.350013] [INFO ] [MAIN ] YOU: Loaded 49536 primary data records. [2025-10-22T23:40:10.677147] [DEBUG] [MAIN ] YOU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:10.702222] [INFO ] [MAIN ] YOU: Generated 138 derivative records from 49536 primary records. [2025-10-22T23:40:10.702348] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-10-22T23:40:10.713896] [DEBUG] [LOCAL ] YOU: Derivative data saved (138 records). [2025-10-22T23:40:10.713978] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-10-22T23:40:10.716990] [INFO ] [MAIN ] Derivative Progress: 2033/2052 symbols. YOU took 0.4s. Estimated remaining time: 7.5s [2025-10-22T23:40:10.717085] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:10.766270] [DEBUG] [LOCAL ] YPF: Loaded 50750 existing records from primary storage. [2025-10-22T23:40:10.766434] [INFO ] [MAIN ] YPF: Loaded 50750 primary data records. [2025-10-22T23:40:11.070602] [DEBUG] [MAIN ] YPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:11.096315] [INFO ] [MAIN ] YPF: Generated 138 derivative records from 50750 primary records. [2025-10-22T23:40:11.096473] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-22T23:40:11.108017] [DEBUG] [LOCAL ] YPF: Derivative data saved (138 records). [2025-10-22T23:40:11.108097] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-22T23:40:11.111098] [INFO ] [MAIN ] Derivative Progress: 2034/2052 symbols. YPF took 0.4s. Estimated remaining time: 7.1s [2025-10-22T23:40:11.111205] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:11.125214] [DEBUG] [LOCAL ] YRD: Loaded 11169 existing records from primary storage. [2025-10-22T23:40:11.125358] [INFO ] [MAIN ] YRD: Loaded 11169 primary data records. [2025-10-22T23:40:11.428208] [DEBUG] [MAIN ] YRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:11.453237] [INFO ] [MAIN ] YRD: Generated 138 derivative records from 11169 primary records. [2025-10-22T23:40:11.453375] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-22T23:40:11.464198] [DEBUG] [LOCAL ] YRD: Derivative data saved (138 records). [2025-10-22T23:40:11.464278] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-22T23:40:11.466859] [INFO ] [MAIN ] Derivative Progress: 2035/2052 symbols. YRD took 0.4s. Estimated remaining time: 6.7s [2025-10-22T23:40:11.466950] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:11.492573] [DEBUG] [LOCAL ] YSG: Loaded 25642 existing records from primary storage. [2025-10-22T23:40:11.492763] [INFO ] [MAIN ] YSG: Loaded 25642 primary data records. [2025-10-22T23:40:11.796289] [DEBUG] [MAIN ] YSG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:11.822228] [INFO ] [MAIN ] YSG: Generated 138 derivative records from 25642 primary records. [2025-10-22T23:40:11.822402] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-22T23:40:11.833751] [DEBUG] [LOCAL ] YSG: Derivative data saved (138 records). [2025-10-22T23:40:11.833869] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-10-22T23:40:11.837074] [INFO ] [MAIN ] Derivative Progress: 2036/2052 symbols. YSG took 0.4s. Estimated remaining time: 6.3s [2025-10-22T23:40:11.837205] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:11.889177] [DEBUG] [LOCAL ] YUM: Loaded 51147 existing records from primary storage. [2025-10-22T23:40:11.889349] [INFO ] [MAIN ] YUM: Loaded 51147 primary data records. [2025-10-22T23:40:12.200244] [DEBUG] [MAIN ] YUM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:12.225474] [INFO ] [MAIN ] YUM: Generated 138 derivative records from 51147 primary records. [2025-10-22T23:40:12.225610] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-22T23:40:12.237660] [DEBUG] [LOCAL ] YUM: Derivative data saved (138 records). [2025-10-22T23:40:12.237758] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-22T23:40:12.241006] [INFO ] [MAIN ] Derivative Progress: 2037/2052 symbols. YUM took 0.4s. Estimated remaining time: 5.9s [2025-10-22T23:40:12.241128] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:12.292766] [DEBUG] [LOCAL ] YUMC: Loaded 52576 existing records from primary storage. [2025-10-22T23:40:12.292939] [INFO ] [MAIN ] YUMC: Loaded 52576 primary data records. [2025-10-22T23:40:12.652321] [DEBUG] [MAIN ] YUMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:12.677808] [INFO ] [MAIN ] YUMC: Generated 138 derivative records from 52576 primary records. [2025-10-22T23:40:12.677929] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-22T23:40:12.689411] [DEBUG] [LOCAL ] YUMC: Derivative data saved (138 records). [2025-10-22T23:40:12.689492] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-22T23:40:12.692569] [INFO ] [MAIN ] Derivative Progress: 2038/2052 symbols. YUMC took 0.5s. Estimated remaining time: 5.5s [2025-10-22T23:40:12.692703] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:12.742495] [DEBUG] [LOCAL ] ZBH: Loaded 50705 existing records from primary storage. [2025-10-22T23:40:12.742684] [INFO ] [MAIN ] ZBH: Loaded 50705 primary data records. [2025-10-22T23:40:13.048298] [DEBUG] [MAIN ] ZBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:13.073618] [INFO ] [MAIN ] ZBH: Generated 138 derivative records from 50705 primary records. [2025-10-22T23:40:13.073801] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-22T23:40:13.085478] [DEBUG] [LOCAL ] ZBH: Derivative data saved (138 records). [2025-10-22T23:40:13.085567] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-22T23:40:13.088521] [INFO ] [MAIN ] Derivative Progress: 2039/2052 symbols. ZBH took 0.4s. Estimated remaining time: 5.1s [2025-10-22T23:40:13.088666] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:13.109434] [DEBUG] [LOCAL ] ZEPP: Loaded 19612 existing records from primary storage. [2025-10-22T23:40:13.109585] [INFO ] [MAIN ] ZEPP: Loaded 19612 primary data records. [2025-10-22T23:40:13.446187] [DEBUG] [MAIN ] ZEPP: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-10-22T23:40:13.472687] [INFO ] [MAIN ] ZEPP: Generated 138 derivative records from 19612 primary records. [2025-10-22T23:40:13.472856] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-22T23:40:13.484572] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (138 records). [2025-10-22T23:40:13.484686] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-10-22T23:40:13.487672] [INFO ] [MAIN ] Derivative Progress: 2040/2052 symbols. ZEPP took 0.4s. Estimated remaining time: 4.7s [2025-10-22T23:40:13.487790] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:13.544354] [DEBUG] [LOCAL ] ZETA: Loaded 53618 existing records from primary storage. [2025-10-22T23:40:13.544552] [INFO ] [MAIN ] ZETA: Loaded 53618 primary data records. [2025-10-22T23:40:13.877850] [DEBUG] [MAIN ] ZETA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:13.905633] [INFO ] [MAIN ] ZETA: Generated 138 derivative records from 53618 primary records. [2025-10-22T23:40:13.905812] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-22T23:40:13.917628] [DEBUG] [LOCAL ] ZETA: Derivative data saved (138 records). [2025-10-22T23:40:13.917733] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-22T23:40:13.920872] [INFO ] [MAIN ] Derivative Progress: 2041/2052 symbols. ZETA took 0.4s. Estimated remaining time: 4.3s [2025-10-22T23:40:13.920992] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:13.961503] [DEBUG] [LOCAL ] ZGN: Loaded 40896 existing records from primary storage. [2025-10-22T23:40:13.961698] [INFO ] [MAIN ] ZGN: Loaded 40896 primary data records. [2025-10-22T23:40:14.280134] [DEBUG] [MAIN ] ZGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:14.305906] [INFO ] [MAIN ] ZGN: Generated 138 derivative records from 40896 primary records. [2025-10-22T23:40:14.306050] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-22T23:40:14.317342] [DEBUG] [LOCAL ] ZGN: Derivative data saved (138 records). [2025-10-22T23:40:14.317450] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-22T23:40:14.320253] [INFO ] [MAIN ] Derivative Progress: 2042/2052 symbols. ZGN took 0.4s. Estimated remaining time: 3.9s [2025-10-22T23:40:14.320347] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:14.344502] [DEBUG] [LOCAL ] ZH: Loaded 24633 existing records from primary storage. [2025-10-22T23:40:14.344687] [INFO ] [MAIN ] ZH: Loaded 24633 primary data records. [2025-10-22T23:40:14.745951] [DEBUG] [MAIN ] ZH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:14.774223] [INFO ] [MAIN ] ZH: Generated 138 derivative records from 24633 primary records. [2025-10-22T23:40:14.774413] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-22T23:40:14.785771] [DEBUG] [LOCAL ] ZH: Derivative data saved (138 records). [2025-10-22T23:40:14.785858] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-22T23:40:14.788578] [INFO ] [MAIN ] Derivative Progress: 2043/2052 symbols. ZH took 0.5s. Estimated remaining time: 3.6s [2025-10-22T23:40:14.788723] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:14.844099] [DEBUG] [LOCAL ] ZIM: Loaded 53462 existing records from primary storage. [2025-10-22T23:40:14.844272] [INFO ] [MAIN ] ZIM: Loaded 53462 primary data records. [2025-10-22T23:40:15.182128] [DEBUG] [MAIN ] ZIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:15.208197] [INFO ] [MAIN ] ZIM: Generated 138 derivative records from 53462 primary records. [2025-10-22T23:40:15.208315] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-22T23:40:15.220621] [DEBUG] [LOCAL ] ZIM: Derivative data saved (138 records). [2025-10-22T23:40:15.220730] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-10-22T23:40:15.223947] [INFO ] [MAIN ] Derivative Progress: 2044/2052 symbols. ZIM took 0.4s. Estimated remaining time: 3.2s [2025-10-22T23:40:15.224127] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:15.264459] [DEBUG] [LOCAL ] ZIP: Loaded 43466 existing records from primary storage. [2025-10-22T23:40:15.264623] [INFO ] [MAIN ] ZIP: Loaded 43466 primary data records. [2025-10-22T23:40:15.581326] [DEBUG] [MAIN ] ZIP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:15.607219] [INFO ] [MAIN ] ZIP: Generated 138 derivative records from 43466 primary records. [2025-10-22T23:40:15.607375] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-22T23:40:15.618706] [DEBUG] [LOCAL ] ZIP: Derivative data saved (138 records). [2025-10-22T23:40:15.618791] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-22T23:40:15.621694] [INFO ] [MAIN ] Derivative Progress: 2045/2052 symbols. ZIP took 0.4s. Estimated remaining time: 2.8s [2025-10-22T23:40:15.621795] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:15.659089] [DEBUG] [LOCAL ] ZK: Loaded 38961 existing records from primary storage. [2025-10-22T23:40:15.659247] [INFO ] [MAIN ] ZK: Loaded 38961 primary data records. [2025-10-22T23:40:15.981065] [DEBUG] [MAIN ] ZK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:16.007429] [INFO ] [MAIN ] ZK: Generated 138 derivative records from 38961 primary records. [2025-10-22T23:40:16.007555] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-22T23:40:16.019367] [DEBUG] [LOCAL ] ZK: Derivative data saved (138 records). [2025-10-22T23:40:16.019457] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-22T23:40:16.022478] [INFO ] [MAIN ] Derivative Progress: 2046/2052 symbols. ZK took 0.4s. Estimated remaining time: 2.4s [2025-10-22T23:40:16.022579] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:16.033702] [DEBUG] [LOCAL ] ZKH: Loaded 7323 existing records from primary storage. [2025-10-22T23:40:16.033837] [INFO ] [MAIN ] ZKH: Loaded 7323 primary data records. [2025-10-22T23:40:16.340794] [DEBUG] [MAIN ] ZKH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:16.365804] [INFO ] [MAIN ] ZKH: Generated 138 derivative records from 7323 primary records. [2025-10-22T23:40:16.365904] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-22T23:40:16.375660] [DEBUG] [LOCAL ] ZKH: Derivative data saved (138 records). [2025-10-22T23:40:16.375742] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-22T23:40:16.377812] [INFO ] [MAIN ] Derivative Progress: 2047/2052 symbols. ZKH took 0.4s. Estimated remaining time: 2.0s [2025-10-22T23:40:16.377940] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:16.425784] [DEBUG] [LOCAL ] ZTO: Loaded 49371 existing records from primary storage. [2025-10-22T23:40:16.425945] [INFO ] [MAIN ] ZTO: Loaded 49371 primary data records. [2025-10-22T23:40:16.730931] [DEBUG] [MAIN ] ZTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:16.756125] [INFO ] [MAIN ] ZTO: Generated 138 derivative records from 49371 primary records. [2025-10-22T23:40:16.756256] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-22T23:40:16.768071] [DEBUG] [LOCAL ] ZTO: Derivative data saved (138 records). [2025-10-22T23:40:16.768149] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-22T23:40:16.771013] [INFO ] [MAIN ] Derivative Progress: 2048/2052 symbols. ZTO took 0.4s. Estimated remaining time: 1.6s [2025-10-22T23:40:16.771107] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:16.789467] [DEBUG] [LOCAL ] ZTR: Loaded 16504 existing records from primary storage. [2025-10-22T23:40:16.789610] [INFO ] [MAIN ] ZTR: Loaded 16504 primary data records. [2025-10-22T23:40:17.111803] [DEBUG] [MAIN ] ZTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:17.136947] [INFO ] [MAIN ] ZTR: Generated 138 derivative records from 16504 primary records. [2025-10-22T23:40:17.137059] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-22T23:40:17.147874] [DEBUG] [LOCAL ] ZTR: Derivative data saved (138 records). [2025-10-22T23:40:17.147953] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-22T23:40:17.150548] [INFO ] [MAIN ] Derivative Progress: 2049/2052 symbols. ZTR took 0.4s. Estimated remaining time: 1.2s [2025-10-22T23:40:17.150675] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:17.204411] [DEBUG] [LOCAL ] ZTS: Loaded 53128 existing records from primary storage. [2025-10-22T23:40:17.204571] [INFO ] [MAIN ] ZTS: Loaded 53128 primary data records. [2025-10-22T23:40:17.526832] [DEBUG] [MAIN ] ZTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:17.551824] [INFO ] [MAIN ] ZTS: Generated 138 derivative records from 53128 primary records. [2025-10-22T23:40:17.551969] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-22T23:40:17.563674] [DEBUG] [LOCAL ] ZTS: Derivative data saved (138 records). [2025-10-22T23:40:17.563755] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-22T23:40:17.566760] [INFO ] [MAIN ] Derivative Progress: 2050/2052 symbols. ZTS took 0.4s. Estimated remaining time: 0.8s [2025-10-22T23:40:17.566855] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:17.599603] [DEBUG] [LOCAL ] ZVIA: Loaded 35832 existing records from primary storage. [2025-10-22T23:40:17.599786] [INFO ] [MAIN ] ZVIA: Loaded 35832 primary data records. [2025-10-22T23:40:17.923318] [DEBUG] [MAIN ] ZVIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:17.948785] [INFO ] [MAIN ] ZVIA: Generated 138 derivative records from 35832 primary records. [2025-10-22T23:40:17.948939] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-22T23:40:17.960211] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (138 records). [2025-10-22T23:40:17.960292] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-10-22T23:40:17.962981] [INFO ] [MAIN ] Derivative Progress: 2051/2052 symbols. ZVIA took 0.4s. Estimated remaining time: 0.4s [2025-10-22T23:40:17.963079] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-22T23:40:18.002037] [DEBUG] [LOCAL ] ZWS: Loaded 42136 existing records from primary storage. [2025-10-22T23:40:18.002199] [INFO ] [MAIN ] ZWS: Loaded 42136 primary data records. [2025-10-22T23:40:18.313400] [DEBUG] [MAIN ] ZWS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-10-22T23:40:18.338762] [INFO ] [MAIN ] ZWS: Generated 138 derivative records from 42136 primary records. [2025-10-22T23:40:18.338882] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-22T23:40:18.350459] [DEBUG] [LOCAL ] ZWS: Derivative data saved (138 records). [2025-10-22T23:40:18.350540] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-22T23:40:18.353268] [INFO ] [MAIN ] Derivative Progress: 2052/2052 symbols. ZWS took 0.4s. Estimated remaining time: 0.0s [2025-10-22T23:40:18.353385] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2052/2052 symbols) [2025-10-22T23:40:18.982053] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Data Generation Completed (2052/2052 @ 100.00%)'